CN1692644A

CN1692644A - Information processing device, information processing method and program, and recording medium

Info

Publication number: CN1692644A
Application number: CN 200380100246
Authority: CN
Inventors: 加藤元树
Original assignee: Sony Corp
Current assignee: Sony Corp
Priority date: 2002-12-18
Filing date: 2003-12-05
Publication date: 2005-11-02
Anticipated expiration: 2023-12-05
Also published as: CN100448285C

Abstract

An information processing device, which works as a recording device, creates a Clip Information file of a still image file (TS file) composed of a plurality of still images, creates a Playlist composed of a plurality of PlayItems indicating the reproduction path of a slide show, and records this information and the TS file on a DVD. The Clip Information file includes an EP_map, which is a table indicating the correspondence between the values of presentation type stamps PTS of the TS and the source packet numbers SPN in the TS indicated by the values. An information processing device, which works as a reproduction device, obtains the data addresses of the TS indicated by the Play Item reproduction start time, IN_time, and the reproduction end time, OUT_time, and reproduces still images by referencing the EP_map of the Clip Information and reading information therefrom.

Description

Messaging device, information processing method and program and recording medium

Technical field

The present invention relates to a kind of recording medium that records the data of forming by the rest image and the supplementary thereof of the so-called slideshow that is used to be suitable for the successively reproducing rest image (slide show) on it, be used to write down and/or reproduce information processing method, messaging device and the program of these data.

The application requires the priority of the Japanese patent application No.2003-132193 that submits in Japan in Japanese patent application No.2003-067025 that the Japanese patent application No.2002-367235 that submitted in Japan on December 18th, 2002, on March 12nd, 2003 submit in Japan and on May 9th, 2003, in this hereby incorporated by reference with these applications.

Background technology

The DVD video standard has been realized the successively reproducing (so-called slideshow) of rest image.Each rest image signal is encoded into the I picture (I image) of MPEG2 (Motion Picture Experts Group 2) video, and is multiplexed in the MPEG2 program.Be multiplexed in the MPEG2 program stream by the I image that will have voice data and sub-picture, can be in slideshow synchronously and reproduce this voice data and sub-picture.This slideshow reproduces with based on performance the presetting of timestamp the time.

It is the structure of unit that the program stream of DVD video has with VOBU (video object unit).This tradition DVD data structure is described among for example disclosed Japanese documentation H10-271444.The structure of the DVD video program stream of the schematically illustrated conventional example 1 of the Fig. 1 here.With reference to Fig. 1, the DVD video program stream is that the unit is managed with VOBS (video object set), and wherein VOBS is as the unit in the moving image work package (workpiece) for example.This VOBS is made up of a plurality of object videos (VOB), and is the data cell on dish as a set or a group record.VOB is made up of a plurality of subregions (cell), and wherein each subregion is corresponding to the scene in the moving image for example or the unit of segment (cut).Each subregion is made up of a plurality of VOBU (video object unit).Aspect live image, the duration of VOBU is 0.4 to 1.2 second.In this VOBU, include the GOP (image sets) of the one or more MPEG2 of having forms.

VOBU comprises as the navigation bag (N-PCK) that comprises the bag of VOBU management information.This navigation bag places the front end of each VOBU.Navigation comprises VOBU_SRI (VOBU search information) and SP_SYNCA.VOBU_SRI is included in before the playback duration of the VOBU that comprises this VOBU_SRI and the leading address of the VOBU that reproduces in N second (N is an integer) afterwards.SP_SYNCA comprises the address information of the sub-picture that reproduces with the audio video synchronization of the VOBU that comprises this SP_SYNCA.In for example reproducing moving image, at first read in this navigation bag, and reset according to carrying out by the management information of navigation bag appointment.

Except this NV-PCK, VOBU also comprises as the video packets (V_PCK) with bag of master image, as audio pack (A_PCK) A that comprises the bag of speech data and as sub-picture bag (SP_PCK) S that comprises the bag of secondary video data.V_PCK, A_PCK and SP_PCK compress with the default form such as MPEG2, and are recorded on the recording medium with this form.The VOBU2 that VOBU can adopt the VOBU1 that comprises video packets for example shown in Figure 1 (data and the order end code (Sequence_end_code) that comprise an I image) and not comprise video packets is for demonstrating.

The VOBU that is used for slideshow can not comprise video packets (video packets that comprises the MPEG2 video).For the VOBU that does not comprise video packets, for example the VOBU2 among Fig. 1 continues from the static video of last VOBU.The lasting duration of the static demonstration of I image can be controlled by navigation command.

The program stream of DVD audio frequency has the structure identical with structure shown in Figure 1 basically.The DVD audio format is realized the asynchronous pattern (but browsable slide show) of progress of audio playback and slideshow.But in browsable slide show, if the user continues to show that by for example remote control commands player thereby next rest image changes the static demonstration time of each rest image, thus audio playback is not interrupted the successively reproducing voice data.Therefore, in the DVD audio frequency, there is the nonsynchronous pattern of video playback and audio playback.

Simultaneously, before publish document 2002-158972 and stated data with the form that is different from Fig. 1 with the disclosed Japan Patent of the inventor's name application.This is called prior art example 2 below publication document.The application form that is recorded in the data in the prior art example 2 disclosed messaging devices has and is used to manage the two-layer of AV stream, i.e. playlist (PlayList) and montage (Clip).Playlist in the playlist layer is only by quoting with reference to the user of playlist with the data of reproduction and editor such as video data.On the other hand, when player reproduces AV stream by the playlist appointment, use clip layer.At this, it is an object that AV stream and supplementary thereof lump together, and it is that the unit is managed with the montage.The AV stream file is called montage AV stream file, and its supplementary is called clip information file.Montage AV stream file and clip information file are recorded on the recording medium discretely.Help data management by writing down and manage (supervise) flow data and supplementary thereof discretely.

Yet for data mode shown in Figure 1, address information is embedded in the mpeg program stream, becomes time-consuming thereby read.Just,, read flow data, analyze this data, and determine the address of the accessing points of rest image subsequently, therefore delayed read operation by the host CPU of player from dish reading in the address of definite rest image.Be similar to the form realization slideshow of prior art example 2 described audio-visual data as described above if can adopt, then can help data management, can adopt record and/or reproducer easily simultaneously with similar structures.

Summary of the invention

The purpose of this invention is to provide and a kind ofly write down the rest image that is used to use its form to be equivalent to (comparableto) audio-visual data form and recording medium that supplementary realizes the data of so-called slideshow in a simplified manner, be used to write down and/or reproduce information processing method, messaging device and the program of these data.

The invention provides a kind of messaging device, comprising: attribute information initiative (formulating) device is used to formulate the image attributes information of each rest image that rest image that management is made of one or more rest images concentrates; Playback control information initiative device, the playback control information that is used to formulate the playback path of specifying this rest image collection; And tape deck, be used to the playback control information of writing down this rest image collection, the image attributes information that is associated with this rest image collection and being associated with this rest image collection.It resets relevant with rest image on being recorded in recording medium according to image attributes information by the rest image of playback control information control.

According to the present invention, image attributes information and playback control information and rest image collection are recorded on the recording medium dividually.Therefore, when when tape deck is read and reproduce rest image, can at first read image attributes information and playback control information, and can generate each rest image of rest image collection with preset order, thereby can utilize the continuous playback (so-called slideshow) that realizes rest image with the similar form of conventional form that in the record live image, uses.

The present invention also provides a kind of information processing method, comprising: attribute information initiative step, the image attributes information of each rest image that the rest image that the initiative management is made of one or more rest images is concentrated; Playback control information initiative step, the playback control information of the playback path of this rest image collection is specified in initiative; And recording step, the playback control information of writing down this rest image collection, the image attributes information that is associated with this rest image collection and being associated with this rest image collection.It resets relevant with rest image on being recorded in recording medium according to image attributes information by the rest image of playback control information control.

The present invention also provides a kind of information processing method, comprise: reproduce step, record at least a portion rest image of this rest image collection of recording medium reproducing of the rest image collection that constitutes by one or more rest images and correspondence image attribute information and playback control information from it; And controlled step, step is reproduced in control according to playback control information reference picture attribute information.Image attributes information comprises the information of each rest image that this rest image of management is concentrated.The playback control information comprises the information of the expression playback path that uses the initiative of image attributes information.Playback path is specified the playback of at least a portion rest image of this rest image collection.

The present invention also provides a kind of and has been used to allow computer carry out the program of predetermined registration operation, wherein this program comprises: reproduce step, record at least a portion rest image of this rest image collection of recording medium reproducing of the rest image collection that is made of one or more rest images and correspondence image attribute information and playback control information from it; And controlled step, step is reproduced in control according to playback control information reference picture attribute information.Image attributes information comprises the information of each rest image that this rest image of management is concentrated.The playback control information comprises the information of the expression playback path that uses the initiative of image attributes information.Playback path is specified the playback of at least a portion rest image of this rest image collection.

The present invention also provides a kind of messaging device, comprising: attribute information initiative device, the image attributes information that is used for formulating each rest image of managing the one or more rest images that form the rest image collection; Playback control information initiative device, the playback control information that is used to formulate the expression playback path, wherein this playback path is specified the playback of the concentrated at least a portion rest image of this rest image; Tape deck is used for this rest image collection of record, the image attributes information and the playback control information of correspondence with it on recording medium; Transcriber is used for reading and reproducing rest image from recording medium; And control device, be used for according to playback control information reference picture attribute information with the control transcriber.Playback control information initiative device uses image attributes information initiative playback control information.

The present invention also provides a kind of information processing method, comprising: attribute information initiative step, the image attributes information of each rest image in one or more rest images of initiative management formation rest image collection; Playback control information initiative step, the playback control information of initiative expression playback path, wherein this playback path is specified the playback of the concentrated at least a portion rest image of this rest image; Recording step, this rest image collection of record, the image attributes information and the playback control information of correspondence with it on recording medium; Reproduce step, read and reproduce rest image from recording medium; And controlled step, reproduce step according to playback control information reference picture attribute information with control.Playback control information initiative step is used image attributes information initiative playback control information.

The present invention also provides a kind of and has been used to allow computer carry out the program of predetermined registration operation, and wherein this program comprises: attribute information initiative step, the image attributes information of each rest image in one or more rest images of initiative management formation rest image collection; Playback control information initiative step, the playback control information of initiative expression playback path, wherein this playback path is specified the playback of the concentrated at least a portion rest image of this rest image; Recording step, this rest image collection of record, the image attributes information and the playback control information of correspondence with it on recording medium; Reproduce step, read and reproduce rest image from recording medium; And controlled step, reproduce step according to playback control information reference picture attribute information with control.Playback control information initiative step is used image attributes information initiative playback control information.

The present invention also provides a kind of and recorded the rest image collection be made up of one or more rest images on it, be used to manage the image attributes information of each rest image that this rest image concentrates and the playback control information of using image attributes information to form.The playback control information represents to specify the playback path of the playback of at least a portion rest image that this rest image concentrates.

Description of drawings

Fig. 1 is the schematic diagram of structure that the program stream of traditional DVD video is shown;

Fig. 2 illustrates the simplified structure that is used for using according to the rest image on the recording medium of the messaging device of first embodiment of the invention form.

Fig. 3 illustrates the example of image file group and clip information thereof.

The reproduction time started that Fig. 4 illustrates each rest image in the first embodiment of the invention is the example of the playlist of the slideshow be scheduled to, and rest image and the relation between the recovery time.

Fig. 5 illustrates the playlist of Fig. 4 and the relation between the montage.

Fig. 6 is illustrated in the illustrative structures of the playlist in the first embodiment of the invention under the situation that playback time started with each rest image is the slideshow reproduced in synchronization voice data be scheduled to.

Fig. 7 illustrates in the first embodiment of the present invention example that the playback order of each rest image only is the playlist of the slideshow be scheduled to, and rest image and the relation between the recovery time.

Fig. 8 illustrates the playlist shown in Figure 7 and the example of the relation between the montage.

Fig. 9 illustrates the relation between playlist, clip information file and the audio stream.

Figure 10 is the block diagram that the messaging device in the first embodiment of the present invention is shown.

Figure 11 illustrates the catalogue that is recorded on the recording medium and the illustrative structures of file.

Figure 12 A illustrates the clip information in the first embodiment of the present invention, and Figure 12 B illustrates the example of the data placement of the static picture document relevant with Figure 12 A on recording medium (dish).

Figure 13 is the flow chart that is illustrated in according to the method for initiative playlist in the recording operation of the messaging device of first embodiment of the invention.

Figure 14 illustrates the block diagram that is used to reproduce by the messaging device of the data of messaging device record shown in Figure 10.

Figure 15 is the flow chart that illustrates according to the operation of the reproduction in the messaging device of first embodiment of the invention.

Figure 16 illustrates the example of the relation between the playlist and montage in the modification of first embodiment of the invention.

Figure 17 A illustrates clip information shown in Figure 16.

Figure 17 B illustrates the example of the data placement of the static picture document relevant with Figure 17 A on recording medium (dish).

Figure 18 A is illustrated in the clip information shown in the second embodiment of the present invention.

Figure 18 B illustrates the data placement of the static picture document relevant with Figure 18 A on recording medium (dish).

But Figure 19 illustrates in the second embodiment of the invention relation between the playlist under the situation of asynchronous reproducing audio data, clip information file and the audio stream in browsable slide show.

Figure 20 only illustrates in the third embodiment of the invention that the playback order of each rest image is the example of the playlist in the slideshow of being scheduled to and the schematic diagram of the relation between rest image and the playback duration.

Figure 21 only illustrates in the third embodiment of the present invention that the playback order of each rest image is another example of the playlist in the slideshow of being scheduled to and the schematic diagram of the relation between rest image and the playback duration.

Figure 22 illustrates playlist shown in Figure 20, its clip information and the relevant static picture document relation between the data placement on the recording medium (dish).

Figure 23 illustrates playlist shown in Figure 21, its clip information and the relevant static picture document relation between the data placement on the recording medium (dish).

Figure 24 illustrates another example of the third embodiment of the present invention, and specifically illustrates playlist, its clip information and the relevant static picture document relation between the data placement on the recording medium (dish).

Figure 25 illustrate in the third embodiment of the present invention with playlist, its clip information of the slideshow of the relation reappearing voice data of the playback synchronization of rest image, and the relation of relevant static picture document between the data placement on the recording medium (dish).

Figure 26 is the schematic diagram of example that is illustrated in the source grouping of index in the transfer stream file (static picture document).

Figure 27 is the schematic diagram that is illustrated in another example of the source grouping of indicating in the transfer stream file (static picture document).

Figure 28 illustrate in the third embodiment of the present invention with and the playlist of the slideshow of the asynchronous relation reappearing voice data of playback of rest image between relation.

Figure 29 be illustrated in from recording medium mutually alternately read static picture document that two files are promptly quoted by playitems playitem with time-sharing format and the situation of the audio stream quoted by secondary playitems playitem under the block diagram of reproducer.

Figure 30 A is the block diagram that BDAV MPEG2 TS player model 1 is shown, and Figure 30 B is the block diagram that BDAV MPEG2 TS player model 2 is shown.

But Figure 31 is the block diagram of the buffer model of browsable slide show.

But Figure 32 A is illustrated in the bit quantity that takies EB buffer (video codes buffer) during the slideshow of browse mode, and Figure 32 B illustrates the bit quantity that takies B4 buffer (audio code buffer).

But Figure 33 is used for being illustrated in the schematic diagram that browsable slide show is read the method for main TS and audio TS simultaneously.

Figure 34 illustrates and uses the I image as playlist, clip information file and the relation of relevant static picture document between the data placement on the recording medium (dish) under the situation of Still image data.

Figure 35 is the schematic diagram that is illustrated in the example of the source grouping of indicating in the transfer stream file (rest image (I image) file).

Figure 36 is the schematic diagram that is illustrated in another example of the source grouping of indicating in the transfer stream file (rest image (I image) file).

Figure 37 illustrates the flow chart that is used for according to the method for the recording operation initiative playlist of the messaging device of third embodiment of the invention.

Figure 38 is the flow chart that illustrates according to the operation of the reproduction in the messaging device of third embodiment of the invention.

Embodiment

With reference to accompanying drawing, describe the preferred embodiments of the present invention in detail.In these embodiments, the present invention is applied to a kind ofly be used at record on the DVD and/or reproduce the messaging device of data of the slideshow that record under the form of live image is used for realizing that rest image is reset continuously and the messaging device that is used to reproduce these data in utilization.

(1) first embodiment

(1-1) data structure

Here, structure by the messaging device in first embodiment of the invention record and/or the data reproduced is described.Fig. 2 illustrates the simplified structure that is used for using according to the rest image on the recording medium of record of the present invention and/or playback system form.This form has and the similar structure of aforementioned conventional example 2 described application forms, and has that to be used for the two-layer of management (oversee) AV stream be playlist (PlayList) and montage (Clip).

In this first embodiment, by rest image group as the rest image collection (image file group) and the formed a pair of object that is considered to of supplementary thereof that one or more sources are formed, this object is managed as the unit that is called montage.The supplementary of rest image group (image attributes information) is called clip information.

The set in the playback territory of the slideshow of the rest image in the employing montage is called playlist.This playlist is to represent for example playback control information of playback path (reproducing route (reproducing route)), and wherein this playback path is specified for example playback order of rest image.Therefore, playlist is formed by a group of playltems order.

Have two types playlist, one of them is real playlist, and another kind is empty playlist.Real playlist is considered to own together the part of the rest image group of its montage of quoting.Just, real playlist takies the data capacity that equates with the part of the rest image group of its montage of quoting in dish.If record new images group is then added it to real playlist automatically.If delete the part of the playback scope of real playlist, then also delete this partial data of the rest image group of its montage of quoting.On the contrary, empty playlist is considered to not own together clip data.If revise or delete empty playlist, any change does not take place in montage.In the following description, real playlist and empty playlist general designation is made playlist.

Fig. 3 illustrates the example of image file group and clip information thereof.In the present embodiment, one or more static picture documents are managed as the single image file group.Clip information file corresponding to this image file group is provided.This clip information is for being included in ID (file_id), the filename (file_name) corresponding to file_id, the byte-sized (file_size) of file, each rest image pixel count (horizontal_size) and the pixel count in vertical direction (vertical_size) thereof in the horizontal direction that each static picture document in the image file group comprises the rest image identification information when quoting static picture document one by one.

Though the data mode of rest image is JPEG, PNG in Fig. 3, data mode can certainly be any other suitable data mode, as long as used data mode is the Still image data form.

In the present embodiment, two kinds of slideshows are described.First kind of slideshow is such one type, wherein the playback time started of each rest image is scheduled to, when below also it being called the base slideshow or the time basic mode formula, and second slideshow is such one type, wherein the playback time started of each rest image be not be scheduled to but playback order be scheduled to, but below also it is called browsable slide show.

For time base slideshow, except entering the next lantern slide at user command reproducer (player), the playback of each lantern slide is carried out automatically, these lantern slides with the time reproduced automatically in the predetermined mode of regularly reproducing predetermined lantern slide on the axle.Therefore, the playback duration of each lantern slide (duration of the rest image of lantern slide) is limited.With rest image simultaneously under the situation of reproducing audio data, the time base slideshow in, audio reproducing can with the playback synchronization of rest image.

But for browsable slide show, playback order is scheduled to, and the playback duration of each lantern slide is limited or unlimited.If given lantern slide has unlimited playback duration, then except entering under the situation of next lantern slide at user command reproducer (player), resetting does not enter next lantern slide.Therefore, each lantern slide not the time reproduce when presetting on the axle.But if in browsable slide show with rest image reproducing audio data simultaneously, then the playback of voice data and rest image is asynchronous.

(1-2) has the slideshow of predetermined replay time started

The predetermined replay that has each rest image referring now to Fig. 4 to 6 explanation begins first kind of slideshow regularly.

(1-2-1) slideshow: rest image only

The reproduction time started that Fig. 4 illustrates each rest image is the slideshow of being scheduled to, and the reproduction time started that each rest image is shown respectively in the top and the bottom of this figure is the example of the playlist in the slideshow of being scheduled to and the relation between rest image and the playback duration.In the reproduction time started of each rest image is in the slideshow of being scheduled to, the time reproduce each rest image when presetting on the axle.

Playlist is made of a plurality of playitems playitem.With reference to Fig. 4, each playitems playitem has the IN_time (entry time) in the playback territory of representing slideshow and the data of OUT_time (time of going out).The playback time started and the concluding time of resetting are specified by the data of IN_time and OUT_time.Each playitems playitem has the data of each rest image that constitutes slideshow.This is called scene (Scene) below data.The ID (file_id) of the rest image identification information when this scene comprises as the image file group of quoting in the montage.These scenes also comprise the playback time started (start_time_stamp) in the playitems playitem.These scenes also comprise the playback duration in each scene, just, and as the demonstration time (duration) of the rest image playback duration of each rest image.

Playback duration in each scene can be overlapping in playitems playitem.Each scene can have a plurality of file_id.For example, under situation shown in Figure 4, scene [2] is overlapping with scene [1] and scene [3].In this case, the image of scene [2] is to show under the situation of the doubling of the image of itself and scene [1] and scene [2].The numeral file_id that marks in each image of Fig. 4.Though the information of the lap position of relevant each image, just, about the information of the image display position of the image display position of scene [2] and scene [1] can be explained in playlist, but it also can be explained in file that is different from playlist or the image file group of being quoted by scene [2].

Fig. 5 illustrates playlist shown in Figure 4 and the relation between the montage.Playlist is quoted the rest image in the montage, is file ID here.Clip information is represented the relation between the rest image (file ID) quoted by playlist and its entity (being filename here).Just, quote clip information with the filename File_name of identification as the ID (file_id) of the rest image identification information of in playlist, explaining.Read the static picture document of this document name from the image file group.

(1-2-2) slideshow: rest image+voice data

Explanation now is the situation of reproduced in synchronization voice data in the slideshow of being scheduled in the playback time started of each rest image.Fig. 6 is illustrated in the slideshow to have the illustrative structures of the mode reproducing audio data of timing relationship with rest image.When the playback time started at each rest image is in the slideshow of being scheduled to during synchronized audio data, except the playitems playitem (main path) of expression rest image playback path, the secondary playitems playitem (secondary path) in expression audio playback path also is provided in playlist, should the pair playitems playitem be the audio playback control information in expression audio data playback path wherein.

The playback time started (sync_start_PTS_of_PlayItem) when this pair playitems playitem comprises on the axle.This pair playitems playitem also comprised by the playback time started (SubPlayItem_IN_time) in its montage of quoting.Secondary playitems playitem also comprised by the playback time started (SubPlayItem_OUT_time) in its montage of quoting.

When secondary playitems playitem adopted performance timestamp (PTS) expression to the accessing points of montage inside, clip information file was useful on discovery and begins to flow the address information of decoding by it in the AV stream file.The AV stream file of the montage of being quoted by secondary playitems playitem is audio stream (auxiliary audio stream).This is called secondary audio stream below auxiliary audio stream.

Just, clip information file comprises a table (EP_map of audio frequency), and the time started of this table statement audio stream and expression are corresponding to the information of the address of the source grouping (minimum access unit) of time started and concluding time.This table can be cited obtaining the address corresponding to named list PTS between now, thereby reads and reproduce the voice data of being represented by this address.Since secondary playitems playitem have reproduction time the time playback time started on the axle, thereby the playback path of expression rest image, therefore might be in slideshow to have the mode reproducing audio data of timing relationship with rest image.

(1-3) only specify the slideshow of rest image playback order

Second kind of slideshow (but browsable slide show) of the playback order of rest image only specified in explanation with reference to Fig. 7 to 9.

(1-3-1) slideshow: rest image only

But Fig. 7 illustrates the example of browsable slide show and the relation between rest image and the playback duration.In this case, different with the situation of Fig. 4 to 6, shown in the top of Fig. 7, but the scene of the playitems playitem of browsable slide show is not specified the playback time started of rest image.Playback time started information (start_time_stamp) in the playitems playitem that the information of only specifying the playback order of each rest image on the playitems playitem replaces each rest image is provided.And different with the situation of Fig. 4 to 6, playitems playitem does not only have IN_time but also do not have OUT_time.The playback duration (demonstration time) that constitutes the rest image of slideshow is not determined.In this case, the user can specify the playback duration of each scene to player.

In addition, each scene of playlist information that can have a default playback duration of the corresponding expression of playback order in the playitems playitem with each rest image replaces as the predetermined replay time among Fig. 4 (playback duration).In this case, player can only reproduce rest image in default playback duration under the situation that lacks user's indication.Therefore, for the structure that default playback duration is provided, the user for example might utilize the remote control commands player to transfer to next rest image by the control of freely carrying out rest image.

Just, each scene of playitems playitem comprise the information (playing_order) of specifying the playback order of scene in the playitems playitem, the ID (file_ID) of the rest image identification information during as the image file group quoted in the montage and the default playback duration (default_duration) of each scene.Simultaneously, the default playback duration of each rest image can be same to each other or different to each other.

But under the situation of browsable slide show,, can in a scene, show a plurality of rest images in overlapping mode as under the situation of the slideshow of specifying the beginning playback duration.For example, if in scene [1], explaining file_id=1 and file_id=2 under the situation of Fig. 7, then in the image of file_id=1, show the image of file_id=2.In Fig. 7, the numeral file_id in the image.Though about the information of the display position of the image of the image of file_id=2 and file_id=1 can be explained in playlist, but this information also can be explained in being different from the file of playlist, perhaps can explain in the image file of being quoted by file_id=2.

Fig. 8 illustrates playlist shown in Figure 7 and the typical relation between the montage.Playlist is quoted the rest image in the montage.Clip information is represented the rest image quoted by playlist and the relation between its entity.Just, quote clip information, and obtain filename corresponding to this document ID from the image file group, to read and to reproduce the rest image of this document name according to the file ID that is used for identifying by the rest image of the montage of playlist indication.

(1-3-2) slideshow: rest image+voice data

But explanation is about the situation of the asynchronous reproducing audio data of browsable slide show now.But Fig. 9 illustrates the relation between playlist, clip information file and the audio stream of the browsable slide show that is used for asynchronous reproducing audio data.Though playlist is made of the playitems playitem of the playback path of expression rest image and the playitems playitem of the playback path of expression voice data, but under the situation of asynchronous reproducing audio data, different with the situation of Fig. 6, playlist is represented the playback path of voice data, and secondary playitems playitem is represented the playback path of rest image.

But in this browsable slide show, if the user enters next rest image by for example remote control commands player, thereby change the static playback duration of each rest image, then with unbroken mode reproducing audio data, because it is asynchronous with respect to the progress of slideshow.

Specify the structure of secondary playitems playitem of playback route of slideshow identical with the structure of the playitems playitem of the playback route of the appointment slideshow that has illustrated with reference to Fig. 7.Just, secondary playitems playitem by the playback order (playing_order) of scene in the playitems playitem, quote the required ID (file_id) of the file of image file group in the montage and the default playback duration (default_duration) of scene constitutes.

But in the playitems playitem of the audio playback route of appointment browsable slide show shown in Figure 9, explained the playback time started (IN_time) in the montage of quoting by playitems playitem and the montage of quoting by playitems playitem on the playback concluding time (OUT_time).

The playitems playitem of specifying the audio playback route was represented situation to the inner accessing points of the secondary audio stream (auxiliary audio stream) of montage according to timestamp under, clip information file is useful on found out the address information that begins address that the audio stream in the AV stream file of montage is decoded.

Just, the clip information file of being quoted by playitems playitem has the time started in each playback territory of statement and the table (EP_map of audio frequency) of the corresponding relation between the address.Therefore, reproducer converts the timestamp of appointment to read and reproduce the audio stream in target playback territory address.

The time started and the concluding time of resetting are to determine in the playitems playitem of specifying the audio playback route owing to reset here, therefore can stop slideshow in for example audio data playback concluding time.Perhaps, the voice data that can reproduce till the concluding time once more to be reproduced is with reproducing audio data repeatedly.

(1-4) structure of messaging device (recording equipment)

The following describes be used to write down the aforesaid playback time started that is used for realizing each rest image be the slideshow be scheduled to or only the playback order of rest image be the enforcement messaging device of the present invention of the data of the slideshow be scheduled to.

Figure 10 illustrates the block diagram of implementing messaging device 1 of the present invention.With reference to Figure 10, messaging device 1 comprises: Still Image Compression Coder 14 provides rest image from terminal 13 to it, and rest image is encoded; Audio coder 11 provides voice data from terminal 10 to it, and voice data is encoded; Controller 16, provide the information relevant by terminal 15 to it with the playback of content of slideshow, and provide image attributes information and audio attribute information from Still Image Compression Coder 14 and audio coder 11 to it respectively, to generate aforementioned playout tabulation and clip information; And register 17, slave controller 16 to its provide playlist and clip information with on recording medium with default format record playlist and clip information.

In the playback time started of each rest image is under the situation of being scheduled to, controller 16 receives the information relevant with playback duration (demonstration time) with the playback time started of each rest image as the information relevant with the playback of content of slideshow, as shown in Figure 4.Under the situation with the timing relationship reproducing audio data in slideshow, except the playback time started and playback duration (demonstration time) of each rest image, controller 16 also receives playback time started on the playitems playitem of expression rest image playback path as the audio playback temporal information, and receives as with reference to the information in the playback territory in the appointment audio stream that goes out and illustrate shown in Figure 6.The playback time started of rest image be not set and only its playback order be under the situation of set slideshow, as going out and the playback order and the default playback duration of controller 16 each rest images of reception be described with reference to shown in Figure 7.Under the situation of reproduction and the nonsynchronous voice data of slideshow, except the playback order and default playback duration of each rest image, controller 16 also receives the information of specifying the playback territory in the audio stream.Also from Still Image Compression Coder 14 to controller 16 size of data of each rest image is provided and such as the data of vertical and Horizontal number of pixels as image attributes information, with initiative and be included in the corresponding clip information shown in Figure 3 of each rest image in the image file group.

According to the information that is provided, controller 16 uses ID (file_id) initiative of explaining in clip information to represent the playlist of the playback path of aforementioned rest image and voice data.Controller 16 is also formulated the clip information (audio attribute information) of voice data, and wherein this information has the table (EP_map of voice data) of the corresponding relation between the minimum access unit (accessing points) of the playback duration of the voice data on the playitems playitem and audio stream.

Register 17 writes down clip information and playitems playitem on recording medium 18, simultaneously according to these information record data.Figure 11 illustrates the catalogue that write down and the illustrative structures of data file.In Figure 11, route 100 has the catalogue of BDAV110 and PICTURE120, and BDAV110 has the catalogue of PLAYLIST111, CLIPINF112 and STREAM113.Playlist 111 comprises that a plurality of play list file 111a are to 110c.CLIPINF112 comprises the clip information file 112a of audio stream and the clip information file 112b of image file group.STREAM113 comprises secondary audio stream (auxiliary audio stream) the file 113a as option.In addition, PICTURE120 for example comprises a plurality of image file group 120a that are made of one group of static picture document 121 to 125.

Figure 12 A and 12B illustrate the example of clip information and the data placement of relevant static picture document on recording medium (dish).In the present embodiment, reproducer (player) is with the order as the image file name (image mark information ID (file_id)) in Fig. 4 and the 7 shown present clip information, reads and reproduces static picture document.Just, under Still image data is read static picture document with player order is arranged in situation on the recording medium (dish), searches the required time of (seek) player data and can reduce to minimum.Therefore expectation can write Still image data with the order of reading static picture document on recording medium.

The recording operation of the recording processing equipment of present embodiment below is described.Figure 13 illustrates the flow chart that is used in the method for the recording operation initiative playlist of the present embodiment of messaging device.At first, 14 pairs of rest images that provide by terminal 13 of Still Image Compression Coder are encoded to generate view data, provide it to register 17 then.Still Image Compression Coder also sends to controller 16 with image attributes information.11 pairs of voice datas that provide by terminal 10 of audio coder are encoded and are sent to the audio stream of register 17 with generation.Still Image Compression Coder 14 also sends to stream attribute information controller 16.

With reference to Figure 13, controller 16 obtains the playback of content (step S1) of slideshow.Just, be under the situation of AV synchronous regime at slideshow and voice data, as mentioned above, controller receives playback time started of each rest image and playback duration and to have the playback duration information of the voice data that the mode of timing relationship reproduces with rest image.If opposite slideshow and voice data are not in the AV synchronous regime, then controller 16 receives information about the playback duration direction of the information of the playback order of each rest image and default playback duration and relevant voice data by terminal 15.

Then, controller 16 receives image attributes information (step S2) from Still Image Compression Coder 14, receives the audio stream attribute information such as the EP_map (step S3) of voice data simultaneously from audio coder 11.Then, controller 16 initiative clip information as with earlier figures as the relevant supplementary of attribute information (step S4).Just, register the attribute data of rest image with the image sequence that in slideshow, reproduces.In addition, the file_id that controller is quoted the image file of clip information formulates the playlist in the playback territory (playback path) of specifying slideshow with the external information that basis provides from the external world, and the playlist (step S5) of the playback path of initiative designated tone audio data.Controller 16 is command record device 17 recording played tabulation therein and clip information also.

Register 17 writes down playlist and the clip information by controller 16 initiatives on recording medium, simultaneously view data and the voice data that record is generated by Still Image Compression Coder 14 and audio coder respectively on recording medium.Register 17 recording image datas make and arrange this view data with the image file order in the playitems playitem that appears at clip information.

The messaging device as recording equipment of structure is managed by one or more static picture documents being focused on the image file group that produces in the file as mentioned above, while is as the information of clip information management such as identification information (file_id), wherein this information management is included in each rest image in this document, and uses the playitems playitem of specifying the reproduction of each rest image in the slideshow.Therefore, might write down the realization slideshow guarantees and for example interchangeability of prior art example 2 described live image recording equipments simultaneously.Just, provide rest image group file (image file group) to replace AV stream file in the live image.The clip information file that is used to quote the file in the image file group is provided, and by its playback of playlist order so that it can be with the form of moving image data with montage (message file) or playlist is the same uses.

(1-5) structure of information equipment (recording equipment)

Figure 14 is the block diagram that the messaging device that is used to be reproduced in the data that write down on the aforementioned recording equipment is shown.With reference to Figure 14, messaging device 20 comprises: sensing element 21 is used for from the recording medium sense data; Controller 22 provides the playlist and the clip information of being read by sensing element 21 to it; Rest image decoder 23 and audio decoder 26 provide Still image data and the voice data of being read by sensing element 21 to it; Frame buffer 24 is used for the rest image of temporary transient storage through decoding; And processor 25, be used to control the playback of rest image.

Controller 22 is with reference to ID (file_id) or the Still image data of playlist to obtain to reproduce, and rest image decoder 23 read by the Still image data of the ID appointment of rest image and to it decode.If reproducing the playback time started of rest image is not the slideshow of being scheduled to, then provides an order from the user to controller 22, thereby can obtain and read the ID of Still image data by the timing of user command by user interface 27.Do not having under the situation of user command, when recovery time of explaining in playlist (duration) or default playback duration (default_duration) past tense, controller 22 is carried out the operation and the read operation of obtaining rest image ID.

Controller 22 with reference to playlist to obtain the playback duration of the voice data that will reproduce.Controller also the clip information of reference audio stream obtaining address corresponding to the audio stream of playback duration, thereby order sensing element 21 is read the related audio data.

Describe the replay operations of this messaging device now in detail.Figure 15 is the flow chart that the replay operations in the present embodiment of messaging device is shown.In Figure 15, sensing element 21 reads playlist and clip information sends to controller 22 with the information of will be read.Controller 22 obtains the file_id of rest image of playitems playitem of playback path of the rest image of sign given playlist.The clip information of controller 22 reference picture file group is so that sensing element 21 is read static picture document (step S12) from the image file group.

Controller 22 also according to the playitems playitem in the audio playback path of representing playlist, obtains the audio playback time (step S13).Controller 22 is gone back the clip information of reference picture file group, the static picture document of representing with the aforementioned file_id that specifies by rest image, thus read static picture document (step S12) from sensing element 21.

Controller 22 also according to the playitems playitem of the playback path of representing playlist, obtains the audio playback time (step S13).Controller is also with reference to as the audio stream of secondary flow (auxiliary audio stream), begins address information that the flow data in the audio stream file is decoded to obtain.Then, controller is managed the control of reading voice data from the audio stream file by sensing element 21 according to the information of being obtained.

23 pairs of Still image data of reading at step S12 of rest image decoder are decoded (step S15), are input to frame buffer 24 with the data of will be decoded.26 pairs of voice datas of reading at step S14 of audio decoder are decoded (step S16), with the output decoder voice data.Controller 22 will be preset order and be published to processor 25 and frame buffer 24.Frame buffer 24 reproduces the image (step S17) that is stored in wherein when presetting according to this order.

At step S11, controller 22 obtains the file_id of rest image at next timing t 1 or t2.Timing t 1 is that the playback duration of the rest image of being pass by becomes moment when being longer than the playback duration of explaining in the associated scenario of the playitems playitem of the playback path of given playlist.Timing t 2 is the moment when receiving the order of switching rest image from user interface 27.When the playback of last rest image of playitems playitem finished, controller 22 stopped the playback of playlists.

Beginning regularly in the playback of each rest image shown in Fig. 4 and 6 is under the situation of being scheduled to, controller 22 can promptly be read file_id in the moment of the duration past tense described in the scene of playitems playitem in aforementioned timing t 1, reads corresponding rest image with order sensing element 21.The playback of specifying each rest image shown in Fig. 7 to 9 as the user is during the time started, and controller 22 can promptly be read next file_id in the moment that receives the order of switching rest image from the user in aforementioned timing t 2, to order reading of corresponding rest image.Under the situation that the rest image switching command is not provided, the time point of default default playback duration (default_duration) past tense can be made as reading regularly of next file_id.

In the messaging device as reproducer of structure as mentioned above, provide the two-layer conduct that constitutes by playlist and montage that is used to manage rest image and voice data to be used for realizing that slideshow is the form of the data of rest image successively reproducing.Owing to adopt rest image collection in the separate file management montage, the audio stream in the montage and, therefore might provide and be applied to live image record described in the aforementioned prior art example 2 and/or the identical form of data format that reproduces as the clip information file of its supplementary.Just, because image file group that is made of one or more rest images and the clip information file that is used for the managing image file group are provided in montage, specify the playback territory of slideshow by the playitems playitem of playlist, therefore can realize that slideshow is the continuous playback of a plurality of rest images, keep compatibility simultaneously with the messaging device of handling live image.

And reading the related time of searching can shorten by the order record rest image with the playback path of being explained in the playitems playitem of playlist.

Modification (1-6)

Among the embodiment, the one or more rest images that are included in the image file group are had different image file names, and come the managing image file group as the discrete images file set in the above.Replacedly, can be used as these static picture documents of single image file management.The following describes first the modification in implementing, wherein file management is included in one or more rest images in the image file group as single image.

In this modification, the image file of image file group is divided into a plurality of image file groups that comprise one or more rest images.The file that is called the rest image group below the file of these static picture document groups.Begin order assignment ID number from the beginning of the playback order of rest image group.

In that file management is included in this modification of the one or more rest images in the image file group as single image, might be with the rest image of performance simultaneously together in groups to manage as one group.In the above under the particular cases with reference to slideshow shown in Figure 8, two rest images of Zai Xianing are that file_id=1 and file_id=2 are arranged in one group simultaneously, and the rest image of file_id=3 is arranged in one group, and two rest images that reproduce simultaneously are that file_id=4 and file_id=5 are arranged in one group.

In this case, this structure is different from the structure of playlist shown in Figure 7.Figure 16 illustrates playlist of this modification and the relation between the montage.With reference to Figure 16, as Fig. 7, playlist is made of the playitems playitem of the playback path of expression rest image.Yet playitems playitem has page or leaf (Page) and replaces scene shown in Figure 7.It should be noted that scene shown in Figure 7 comprises the information of specifying the playback order of each scene in the playitems playitem, rest image identification information ID (file_id) and the default playback duration when quoting the image file group in the montage.It is to explain ID (file_id) as the identification information of each rest image group to replace ID (file_id) as the rest image identification information of scene that page or leaf in this modification is different from page or leaf part among the embodiment of front.In other respects, page or leaf has and the scene identical functions.Just, page or leaf comprises the default playback duration (default_duration) of information, the rest image group identity information ID (file_id) when quoting the image file group in the montage and each group of specifying the playback order of each page in the playitems playitem.

In the present embodiment, playlist refers again to the rest image in the montage.Clip information is specified the rest image quoted by playlist and the relation between its entity.Just, playlist is with reference to the rest image group identity information ID (group_id) of the rest image that is used for identifying montage.Clip information is specified according to rest image group identity information ID (group_id) address information of rest image on recording medium in groups.Reproducer obtains this address information to read and to reproduce rest image.

Figure 17 A illustrates clip information and the typical data arrangement of relevant static picture document on recording medium (dish) in the present embodiment shown in Figure 16 with 17B.As mentioned above, clip information comprises the address information (ads1, ads2, ads3) with the corresponding rest image in groups of each rest image group identity information ID (group_id).Rest image group data promptly are recorded on the recording medium with the order of rest image group identity information ID (group_id=1,2,3) with the playback order of playitems playitem.

Reproducer (player) is to appear at calling over and reproducing Still image data of rest image group identity information ID (group_id) in the clip information.With the image file group is that the situation of the upright image file of a component is compared, and by utilizing this static picture document structure, might reduce to be used for the quantity of the file system data of file management.

(2) second embodiment

The following describes the second embodiment of the present invention.In the above-described embodiments, the view data in the rest image of image file group or each the rest image group directly is recorded on the recording medium.In this second embodiment, view data is that the form with transport stream (TS) writes down.In that a plurality of rest images are multiplexing in a transport stream time, these rest images are undertaken multiplexing by register 17 described with reference to Figure 10.

(2-1) slideshow: rest image only

Figure 18 A and 18B illustrate the clip information and the data placement of relevant static picture document on recording medium (dish) of present embodiment respectively.At this slideshow is described once more, wherein the one or more rest images that reproduce are simultaneously managed as the rest image group, specify the playback order, and playback duration is that the playback duration (duration of rest image in the slideshow) of wherein each rest image is limited default playback duration.

In the multiplexing present embodiment in transport stream of the view data of each rest image group, clip information comprises that EP_map is the table of starting resource packet number (SPN_start) as the corresponding start address in the transport stream of specifying the identification information of rest image (group_id) and multiplexing rest image in groups in groups.Simultaneously, the source packet number is increasing the number that 1 mode offers each source grouping in the transfer stream file at every turn, and wherein the starting resource packet number in the transfer stream file is zero.

As above-mentioned first embodiment, multiplexing in stream the time when view data, recording equipment is according to the view data in playback order (reading order) the record rest image group.Reproducer (player) is read with the order that appears at the rest image group identity information ID (group_id) in this clip information and is reproduced Still image data.For this structure of static picture document, the structure of transport stream can be similar to the structure of the AV stream file of explanation in aforementioned prior art example 2 easily, thereby can use record and/or the reproducer with similar characteristics easily.

For modification shown in Figure 17 and embodiment shown in Figure 180,, can obtain to be similar to the advantageous effects of the situation of Figure 12 wherein with data reproduction order array data.Just, go up the arrangement Still image data by the order of reading static picture document with player at recording medium (dish), and write Still image data by order, can be minimized in and search in the player the related time of data with the static picture document that will read.

(2-2) slideshow: rest image and voice data

The situation of the slideshow of present explanation and the asynchronous reproducing audio data of slideshow.Figure 19 illustrates the playlist under the situation of the voice data in the asynchronous reproduction present embodiment.Playlist is made of the playitems playitem of the playback path of expression rest image and the playitems playitem of the playback path of expression voice data.It is playitems playitem that this slideshow is different from the playback path that part shown in Figure 9 is rest image, and the playback path of voice data is secondary playitems playitem.Therefore, in the present embodiment, secondary playitems playitem has the time started In-time of playback and the concluding time Out-time that resets, and the playback of quoting in the audio stream begins and the concluding time stamp of resetting.Playitems playitem comprises the page or leaf as each Still image data that constitutes slideshow.

Reproducer with reference to clip information to obtain and to reset the time started IN-time and the address information of the corresponding audio stream data of concluding time OUT-time on recording medium of resetting.Use this address information, reproducer is read and is reproduced this address information.The scheme of audio playback is similar to first embodiment shown in Figure 9.

Except being the information of demonstration with the playback path, can also with below be called the playback supplementary supplementary append to secondary playitems playitem and secondary project as the playback control information.Secondary playitems playitem in the present embodiment is additional to have the first information (SubPlayItem_type) as the playback supplementary, and the playback of the secondary playitems playitem of this information representation and the playback of playitems playitem are asynchronous.Secondary playitems playitem in the present embodiment is also additional to have a sign (second information) (is_repeat_SubPlayItem sign) as the playback supplementary, and this information representation still is only once reproduced by the audio stream playback territory that reset the time started IN-time and the concluding time OUT-time that resets represent by repeatedly reproducing.According to this first information SubPlayItem_type, reproducer determine secondary playitems playitem will with the asynchronous reproduction of playitems playitem.For example, if is_repeat_SubPlayItem is 0 or 1, the territory of then resetting is once reproduced respectively or repeatedly reproduced.

In preamble, suppose that these two kinds of playback supplementarys have the static data form and aid in secondary playitems playitem.Replacedly, these two kinds of playback supplementarys can adopt the command format of playback controls (so-called PBC) command format to be subordinated to secondary playitems playitem.For example, can replace indicating that is_repeat_SubPlayItem is to be subordinated to secondary playitems playitem with two kinds of supplementarys by utility command Repeat_SubPlayItem.

(3) the 3rd embodiment

The following describes the third embodiment of the present invention.In this 3rd embodiment, be among first embodiment of slideshow of above-mentioned Fig. 4 of being scheduled to as the playback duration of rest image or only specified Fig. 7 of playback order of rest image or the slideshow of Figure 16 in scene or page or leaf as described in, specifying the playback control information of single playback path is single playitems playitem, and the corresponding playitems playitem of number a plurality of and scene or page or leaf is provided.Represent playback path (a playback territory) by adopting each playitems playitem, this similar is in the structure of the playitems playitem in the messaging device described in the prior art example 2, in prior art example 2, provide the AV stream that is arranged in the group the playback territory (by the time a pair of IN-point (going into a little) on the axle and OUT-point (the going out a little) playitems playitem represented), thereby further improved compatibility.

(3-1) slideshow: rest image only

Figure 20 illustrates and specifies the playback duration (the lasting duration of lantern slide) of playback order and each lantern slide is limited slideshow, and specifically illustrate the relation between playlist, rest image and the playback duration, wherein use playitems playitem to replace scene shown in Figure 7 or page or leaf shown in Figure 19.In the present embodiment, each playitems playitem uses the playback time started IN_time as shown in figure 20 and the concluding time OUT_time that resets to specify each rest image of reproduction simultaneously or the rest image of rest image group.More particularly, each scene in the playitems playitem shown in Fig. 7 or 19 or page or leaf are specified default playback duration (demonstration duration) default_duration of the duration of each scene of expression or page or leaf, and in the present embodiment, playitems playitem 1 is equivalent to the page or leaf [1] of Figure 19, as shown in figure 20, and IN_time and OUT_time be made as t1 and t2 respectively.Therefore, the playback time length of being represented to t2 by t1 is equivalent to default playback duration d1 (default_duration).On the other hand, the IN_time of playitems playitem 2 and OUT_time are made as t2 and t3 respectively.Therefore, the playback time length of being represented to t3 by t2 is equivalent to default playback duration d2 (default_duration).And the IN_time of playitems playitem 3 and OUT_time are made as t3 and t4 respectively.Therefore, the playback time length of being represented to t4 by t3 is equivalent to default playback duration d3 (default_duration).

The IN_time of each playitems playitem and OUT_time represent the playback scope of AV stream, just, in the reproduction of AV stream from the PTS of IN_time Still image data up to the PTS of OUT_time.In the slideshow of type shown in Figure 20, when reproduce given playitems playitem from the PTS of IN_time during up to the Still image data of the PTS of OUT_time, player enters the reproduction of next playitems playitem automatically.

In playitems playitem shown in Figure 20, the default playback duration of rest image is limited.Yet, if the product survivor of playlist expectation is set as indefinite length with default playback duration, then can show that continuously the information that the information of reproduced picture is added to playitems playitem is made as indefinite length with default playback duration by indicate at playback concluding time OUT_time.As the situation of top prior art example 2 described messaging devices, the information as the playback supplementary newly can be added to playitems playitem.As for example shown in Figure 21, can be subordinated to playitems playitem as the sign Is_Playtime_Still of playback supplementary, wherein should the sign expression whether want the image of successively reproducing OUT_time.If this sign is_Playtime_Still is made as 1 (just, if default_duration is unlimited), then when the image of the PTS that has reproduced the playback concluding time OUT_time that is in playitems playitem, reproducer continues display image.In this case, under the situation except the next lantern slide that enters slideshow at the user command player, player does not enter the playback of next lantern slide.If the user command player enters next lantern slide, then player begins to reproduce next playitems playitem.

By making sign is_Playtime_Still be subordinated to playitems playitem, can in single playitems playitem, coexist playitems playitem and having the playitems playitem of unlimited default playback duration with limited default playback duration.Figure 21 illustrates the unlimited and limited example of the playback duration of playitems playitem 2 of the playback duration of playitems playitem 1 and playitems playitem 3.The playback duration of all playitems playitem also can be made as infinitely.

In preamble, the playback supplementary that expression continues the reproduced picture of demonstration OUT_time is the data that are subordinated to playitems playitem as the data of static state sign form.Replacedly, playback supplementary also can adopt the form of playback controls order (so-called PBC) to be subordinated to playitems playitem.Specifically, playback supplementary also can be used and for example order Still_PlayItem to be subordinated to playitems playitem.

The static picture document that is made of one or more rest images that Figure 20 and one or more rest image of 21 are quoted is recorded on the recording medium with the form of transport stream shown in Figure 180.The data address of the transport stream of being represented by the playback time started IN_time of playitems playitem and the concluding time OUT_time that resets can be obtained by the EP_map of reference clip information.Figure 22 and 23 schematically illustrated playlists and clip information thereof and be recorded in data on the recording medium.

Figure 22 illustrates the playback duration condition of limited of playitems playitem shown in Figure 20.In the static picture document of transport stream form, by multiplexing together ABCD0001.JPG and the transport stream formed of ABCD0001.PNG corresponding to the performance timestamp PTS from t1 to t2, the transport stream of being made up of multiplexing ABCD0002.JPG together is corresponding to the performance timestamp PTS from t2 to t3, and by multiplexing together ABCD0003.JPG and the transport stream formed of ABCD0003.PNG corresponding to the performance timestamp PTS from t3 to t4.In the PTS scope from t1 to t4, rest image and the figure or the captions that cover thereon are multiplexing on transport stream.

The EP_map that is recorded in the clip information file on the recording medium of being associated with the transport stream of static picture document is the table of the relation between the source packet number in the transport stream of the value of expression performance timestamp PTS and its expression.Just, the EP_map in the present embodiment preserves the value that the IN_time value by playitems playitem 1, playitems playitem 2 and playitems playitem 3 is the source packet number represented of t1, t2 and t3.It should be noted that, EP_map shown in Figure 180 is the table of the relation between the source packet number SPN_start that begins of the information of expression a plurality of rest image group identity information ID (Group_id) and current discussion among above-mentioned second embodiment, and EP_map shown in Figure 22 has the structure that is similar to the EP_map shown in the above-mentioned prior art example 2 in the present embodiment, just, the structure of the table of the corresponding relation between the source packet number SPN_start that begins of the timestamp of expression timestamp PTS_start of rest image and current discussion.

Reproducer (player) is read and is reproduced the Still image data of being quoted by playitems playitem, just, and by source packet number SPN_start data designated.Adopt this structure of static picture document, wherein transport stream structurally is same as the AV stream file of explanation in above-mentioned prior art example 2, can use record and/or reproducer with similar structures easily.

For playlist shown in Figure 22, the default playback duration of rest image is made as finite value, and wherein default playback duration is the time-domain by the playback time started IN_time of playitems playitem and the concluding time OUT_time appointment of resetting.On the other hand, playlist shown in Figure 23 comprises the playitems playitem that the default playback duration of rest image wherein is made as indefinite length.Default playback duration is for infinitely to be represented by the is_PlayList_Still that appends to playitems playitem.

The user can be under the situation of not waiting for the default playback duration past, perhaps is made as under the situation of infinitary value in the process of default playback duration midway the playback that the order reproducer enters next rest image at default playback duration.For example, if reproducer is reproducing playitems playitem 1, and the user command reproducer reproduces next rest image, and then reproducer begins to reproduce playitems playitem 2.Playback time started IN_time=t2 in this case.Recording equipment from the grouping of the represented source of the corresponding source of the t2 of EP_map packet number spn2, read and reproduce data.

Can use the information of information that the playback of the image of specifying OUT_time suspends and expression rest image duration to represent the default playback duration of the rest image of playitems playitem.

For example, use the information of above-mentioned sign is_PlayItem_Still, and will specify the information Still_duration of rest image duration to be added to the is_PlayItem_Still sign as the playback time-out of the image of expression OUT_time.Specifically, when sign is_PlayItem_Still was 1, its expression suspended the playback of OUT_time image, makes the duration of rest image to be specified by Still_duration.If the duration of rest image Still_duration is made as preset value, then the rest image duration can represent not have limit.For example, if the rest image duration of 8 bit values is 0xFF, then its expression rest image duration is unlimited, otherwise the value of Still_duration is specified the limit that has of rest image.The unit of rest image duration value can for example be second (sec).

If consider random access to optional playitems playitem, then the part of the transport stream of being quoted by each playitems playitem is not multiplexing with source grouping rank is more easily in transfer stream file, because the required data amount of reading of playback playitems playitem thereby can be minimized.For this reason, (system timing clock (SystemTimeClock) STC is independently for the part by the transport stream of each playitems playitem reference to form the synchronizing signal on transport stream basis.By this way, can make the transport stream part of quoting by each playitems playitem independent in transfer stream file simultaneously by multiplexing transport stream.

Clip information file shown in Figure 24 has the SequenceInfo (sequence information) that is similar to above-mentioned prior art example 2.SequenceInfo is the supplementary of clip information file, and is the table that is illustrated in the corresponding relation between the system timing clock call number (stc_id) of the source packet number (SPN_STC_start) of the continuous system timer clock STC that begins in the transfer stream file and this system timing clock STC.Source packet chain with continuous system timer clock STC is called STC-sequence (STC sequence).

In this case, except reset the time started IN_time and the concluding time OUT_time that resets, playitems playitem also has by the fiducial value to STC of these timestamp references (ref_to_stc_id), as shown in figure 24.Reproducer (player) uses EP_map and Sequence_Info to read the Still image data of being quoted by playitems playitem.

(3-2) slideshow: rest image+voice data

Each playback territory is in company with the slideshow of being represented by the playlist situation of reproducing audio data together.

(3-2-1) rest image of reproduced in synchronization and voice data

At first, situation with as shown in figure 22 rest image playlist reproduced in synchronization voice data is described.In above-mentioned first embodiment shown in Figure 6, determine the playback time started and the playback duration of each rest image in the slideshow.Secondary playitems playitem is used to represent the audio playback control information of the playback path of the voice data that reproduces with the playback synchronization of rest image.Though secondary playitems playitem can be as the replayed portion of voice data, but be multiplexed at rest image under the situation of transport stream, also can carry out multiplexingly synchronously with the voice data of rest image reproduced in synchronization,, and help to reset and handle because so only need read a stream with rest image.

Figure 25 be illustrated in multiplexing and rest image reproduced in synchronization in the transport stream voice data and with the playlist of the slideshow of the playback synchronization reproducing audio data of rest image.Under the situation of Figure 22, multiplexing one or more rest images in transport stream.In the present embodiment, multiplexing in transport stream with the audio stream of slideshow reproduced in synchronization in company with rest image.Use the EP_map of clip information, reproducer (player) is read Still image data and the voice data of being quoted by playitems playitem according to performance timestamp PTS, thereby reproduces and export rest image and voice data in the mode that has time relationship mutually.

The EP_map that the following describes Figure 22 to 25 points to two kinds of methods of the source grouping in the transfer stream file (static picture document).

In EP_map shown in Figure 26, point to by source packet number spn2 and to comprise (=t2) first video packets ' V ' of corresponding Still image data with the playback time started PTS of rest image.In this case, at multiplexing sub-picture information such as figure ' G ' or the captions ' S ' that cover (reproduced in synchronization) on the rest image in back by the video packets of EP_map appointment.

Comprise with the PTS of playback time started of rest image (=t2) corresponding Still image data first video packets ' V ' before, PAT (Program Association Table) and PMT (Program Map Table) as the system information of MPEG2 transport stream are multiplexed in the TS file, as shown in figure 27.The grouping that comprises PAT for example can be represented by the source packet number spn2 of EP_map.

(3-2-2) with the rest image of the asynchronous reproduction of playback of voice data

The following describes situation with the asynchronous reproducing audio data of playlist of rest image.But Figure 28 illustrates the wherein playlist of the browsable slide show of asynchronous reproducing audio data.Playlist is made of the secondary playitems playitem of the playback path of a plurality of playitems playitem of the playback path of specifying rest image and designated tone audio data.Be similar to second embodiment shown in Figure 19, the playback time started IN_time of secondary playitems playitem and the concluding time OUT_time that resets are stabbed by the playback time started in the audio stream respectively and the stamp expression of playback concluding time.

Reproducer with reference to clip information to obtain IN_time and the data address information of the corresponding audio stream of OUT_time on recording medium with secondary playitems playitem.Use this address information, reproducer is read and reproducing audio data.The scheme of audio playback is similar to first embodiment shown in Figure 9.As embodiment shown in Figure 19, the product survivor of playlist can be added to playitems playitem with the playback supplementary.Specifically, additional representation by the playback territory of the playback time started IN_time of audio stream and the concluding time OUT_time appointment of resetting by repeatedly reproduce still be only reproduced once sign (is_repeat_SubPlayItem sign) and appointment will with the information (SubPlayItem_type) of the secondary playitems playitem of the asynchronous reproduction of the playback of playitems playitem as the playback supplementary.The playback supplementary also can be as previously mentioned appends to secondary playitems playitem with the form of playback controls order.

In this case, recording equipment can reproduce secondary playitems playitem by following three kinds of methods.First method is alternately read each file with time-sharing format when the data of the audio stream file of reading static picture document that two files are promptly quoted by playitems playitem and being quoted by secondary playitems playitem.When recording medium is alternately read the data of these two files, reproducer reproduces rest image and voice data in this case.

Second method is at first read the total data of the audio stream file of being quoted by secondary playitems playitem, with the storage of will be read in the buffer storage of reproducer.Then, read the Still image data of quoting by playitems playitem from recording medium.Reproducer is read Still image data from recording medium, goes out voice data from the buffering memory read simultaneously, to reproduce rest image and voice data.

Third party's method is at first read the total data of the static picture document of being quoted by playitems playitem, with the storage of will be read in the buffer storage of reproducer.Then, read the audio stream of quoting by secondary playitems playitem from recording medium.Reproducer is read audio stream from recording medium, and when it goes out rest image from cushioning memory read, reproduces rest image and voice data.

Above second and third party's method respectively under the big situation of the byte-sized of the audio stream file of quoting by secondary playitems playitem and under the little situation of the byte-sized of the static picture document of quoting by secondary playitems playitem effectively.

As a concrete instance,, then before resetting, all files data can be read in the buffer storage if the order of magnitude of size of data is some Mbytes (Mbyte).If but audio playback is BGM (background music) and the playback that repeats secondary playitems playitem when using browsable slide show, then above-mentioned second method is effectively, because the size of data that bit rate is 256kbps continues about 65 seconds audio stream is approximately 2 Mbytes (Mbyte).

Player model under the situation that above-mentioned first method of explanation employing is now read.Figure 29 illustrates to adopt above-mentioned first block diagram of reading with the reproducer of reproducting method.Adopt this method, when the data of the audio transport stream packet of reading the main transport stream (static picture document) that two files are promptly quoted by playitems playitem (below be called main TS) from driver (recording medium) and quote (below be called audio TS), alternately read each file by secondary playitems playitem.To describe the structure of the transport stream of present embodiment subsequently in detail.

Reproducer is alternately read two files (main TS and audio TS) from recording medium, to reproduce rest image and voice data.The file data of being read by sensing element 31 carries out demodulation by demodulator-ECC decoder 32.Multiplex stream through demodulation is carried out error correction.The source grouped data of main TS file is cushioned by the read buffers 33 of main TS, and the source grouped data of audio TS file is cushioned by the read buffers 34 of audio TS.

To offer the player 35 (BDAV MPEG2 TS player model 1) of the main TS that will illustrate subsequently from the flow data that the read buffers 33 of main TS is read.Player 35 (transmission rate R when presetting of main TS _{TS_m}) will be with transmission rate R _MAXThe flow data of reading from the read buffers 33 of main TS outputs to PID (packet ID) filter (filter) 37 of main TS.To offer the audio data player 36 (BDAV MPEG2 TS player model 2) that to describe the back from the flow data that the read buffers 34 of audio TS is read.Audio data player 36 (transmission rate R when presetting _{TS_a}) will be with transmission rate R _AThe flow data of reading from the read buffers 34 of audio TS outputs to the voice data downstream PID filter 39 of downstream level.

The PID filter 37 of master data will be imported main TS distribution and output to the downstream decoder that each flows substantially according to PID (packet ID).Just, PSI (Program Specific Information) or the SI (information on services) with system information such as rest image (video), secondary image information such as figure and secondary captions, main TS is assigned to transmission buffer TB1, TB2 and TB _Sys1Simultaneously, SI also packetized (packetize) divides into groups to transmission, and can be demonstration with SIT (selection information table).The transmission grouping of rest image is with default speed Rx ₁Send to multiplexing buffer MB from transmission buffer TB1, therefore as flowing EB substantially with default speed Rbx ₁Transmit, thereby after by decoder D1 decoding, export.The transmission grouping of secondary image information is with default speed Rx ₂Send to buffer B2 from transmission buffer TB2, thereby after by decoder D2 decoding, export.The transmission grouping of system information is with default speed Rx _SysFrom transmission buffer TB _Sys1Be transferred to buffer B _Sys1Thereby, by decoder D _Sys1Export after the decoding.

In a similar fashion, the PID filter 38 of voice data will be imported the audio transmission flow distribution and output to the downstream decoder that each flows substantially according to PID (packet ID).Just, the transmission of audio frequency grouping is transferred to main buffer B4 with default speed from transmission buffer TB4, and output after by decoder D4 decoding.The transmission grouping of the system information of audio TS is with default speed Rx _Sys2From transmission buffer TB _Sys2Be transferred to buffer B _Sys2, therefore with default speed R _SysBe transferred to decoder D _Sys2, wherein it is decoded and exports.

Audio switch (audio frequency SW) 39 is installed in the PID filter 38 and transmission buffer TB4 and TB of voice data _SysBetween.But this audio switch 39 is in the situation of reproducing the slideshow of basic mode formula when for example shown in Figure 25 and reproduce between the situation of the slideshow of the browse mode shown in Figure 23 and 24 for example and carry out switching controls.Just, audio switch 39 comprises from the read buffers 33 of main TS provides data, is connected to the time basic mode formula switch SW of the PID filter 37 of master data to it _TBut, and data are provided, are connected to the browse mode switch SW of the PID filter 38 of voice data to it from the read buffers 34 of audio TS _BAudio switch switches between these switches audio stream is sent to transmission buffer TB4.For example, but under the situation of browsable slide show, but audio switch 39 is made as the browse mode switch SW _BThis side, in this case, the filter 38 of audio stream by voice data is provided to audio decoder D4 from the read buffers 34 of audio TS.When for example shown in Figure 25 under the situation of base slideshow, multiplexed audio stream on main TS wherein, basic mode formula switch SW when audio switch 39 is set as _TThis side, in this case, the filter 37 by master data is provided to transmission buffer TB4 or TB with audio stream from the read buffers 33 of main TS _Sys2

The basic decoder that flows of explanation now.Defined identical among the method for expressing of TBn, MB, EB, TBsys, Bsys, Rxn, Rbxn, Rxsys, Dn and Dsys and T-SCD (System Target Decoder) ISO/IEC13818-1 (MPEG2 system standard), and as described below:

TBn (n=1 to 5): the transmission buffer of basic stream

MB: the multiplexing buffer of video flowing

EB: the basic stream damper of video flowing

TBsys: the input buffer of the system information of just decoded program

Bsys: the main buffer in the System Target Decoder of the system information of just decoded program

Rx _n: the transmission rate of removing data from TBn

Rbx _n: the transmission rate (only effective) of removing PES grouping payload from MBn to video flowing

Rx _Sys: the transmission rate of removing data from TBsys

Dn: flow the decoder among the n substantially

D _Sys: the decoder relevant with the system information of just decoded program

The player 35 (BDAV MPEG2 TS player 1) of the main TS that explanation now is shown in Figure 29 and the player 36 (BDAV MPEG2 TS player 2) of voice data.Figure 30 A and 30B are the block diagrams that the player 36 of the player 35 of main TS and voice data is shown.

With reference to Figure 30 A, the source grouped data of reading from the main TS read buffers 33 of previous stage in the player 35 of main TS offers source depacketizer (depacketizer) 41 with bit rate Rmax, and wherein Rmax is the bit rate of the source stream of packets of main TS file.

Arrive timer clock counter 42 and be that to be used for the frequency from pulse oscillator 43 (27MHz crystal oscillator (X-tal)) output be the binary counter that the pulse of 27MHz is counted.Arrive the timer clock counter at time (i) output count value Arrival_time_clock (i).

Main TS and audio TS are by to comprise that the serial data that the source of stabbing the transmission grouping and the time of advent thereof is grouped into the unit forms.The source grouping comprises transmission grouping and arrival_time_stamp (the stamp time of advent) thereof (ATS).Arrival_time_stamp is the timestamp that the grouping of expression respective transmissions arrives the time of decoder.The time axle that the arrival_time_stamp that divides into groups according to each source that constitutes each stream forms is called base when arriving, and its clock is called ATC (arrival timer clock).

When the arrival_time_stamp of the current source grouping of reading from this main TS equals to arrive LSB side 30 bits of count value arrival_time_clock (i) of timer clock counter 42, divide into groups from source depacketizer 41 output source transmission packets.R _{TS_m}It is the bit rate of main TS.

In the player 36 of voice data, the source grouped data of reading from the audio TS read buffers 34 of previous stage is with bit rate R _ASend to source depacketizer 44, shown in Figure 30 B.Bit rate R _AIt is the bit rate of the source stream of packets of audio TS file.

Arrive player 35 work that timer clock counter 45 and pulse oscillator 46 are similar to main TS.Source depacketizer 44 is similar to player 35 work of main TS.Just, when the arrival_time_stamp of current source grouping equals to arrive LSB side 30 bits of count value arrival_time_clock (i) of timer clock counter 45, divide into groups from source depacketizer 44 output source transmission packets.R _{TS_A}It is the bit rate of audio TS.

But Figure 31 illustrates the notion of buffer model of the slideshow of browse mode.But in browse mode, when with R _UDSpeed when driver is alternately read the audio TS file of being quoted by playitems playitem of quoting as the main TS file of static picture document and by secondary playitems playitem, need to guarantee the bit rate R of the source stream of packets of main TS _MAXAnd the bit rate R of the source stream of packets of audio TS _AFor this reason, when after respectively by the Still Image Compression Coder 14 of Figure 10 and audio coder 11 codings, writing down main TS and audio TS, must apply restriction to the higher limit of each bit rate.

But Figure 32 A and 32B be illustrated in browse mode shown in Figure 29 slideshow during the figure of typical bit stealing amount of basic stream damper EB (video codes buffer) and audio code buffer B4.In Figure 32 A and 32B, ordinate is represented the buffer occupation rate of video codes buffer and the buffer occupation rate of audio code buffer, and abscissa is represented the system timing clock STC of main TS and audio TS.

In Figure 32 A, t input time from first video packets is represented in start delay _vUp to the time that buffering I image in basic stream damper EB is promptly decoded to timestamp (DTS).When but the user skips to next lantern slide in browse mode, begin to import aforementioned first video packets.In Figure 32 A and 32B, gradient k _EBThe input rate of expression video buffer EB, and gradient k _B4The input rate of expression audio buffer B4.Simultaneously, gradient k _EBBe zero and the constant time of video codes occupancy mean the time of reading auxiliary image information such as figure or captions.

If guarantee with bit rate R _MAXRead the source stream of packets of main TS, then can in the Video Decoder D1 of downstream level shown in Figure 29, decode, thereby will be in the default decoding time regularly through the rest image of decoding to rest image.And, if guarantee with bit rate R _ARead the source stream of packets of audio TS, then in the audio decoder D4 of downstream level shown in Figure 29, can in the default decoding time regularly, decode voice data.

But the schematically illustrated model that is used for reading simultaneously the method for main TS and audio TS of Figure 33 at the slideshow of browse mode.

Suppose that main TS and audio TS are arranged on the dish continuously.In this case, following main TS and the audio TS of alternately reading:

(1) reads preset data amount X from main TS;

(2) skip to the preset data position of audio TS;

(3) read preset data amount Y from audio TS;

(4) skip to the preset data position of main TS, and read preset data amount X from main TS.

The data volume X that reads from main TS in a read operation is the necessary size of main TS read buffers 33.The data volume Y that reads from audio TS in a read operation is the necessary size of audio TS read buffers 34.Below shown in equation the equation be used to calculate for the required size of the read buffers 34 of the read buffers 33 of main TS and audio TS is described:

x = R_{MAX} \times (2 \times Tj + \frac{y}{R_{UD}})

y = R_{A} \times (2 \times Tj + \frac{y}{R_{UD}})

Wherein, x is the data volume for the required size of the read buffers 33 of main TS=read from main TS by read operation;

Y is the data volume for the required size of the read buffers 34 of audio TS=read from audio TS by read operation;

T _j: the redirect time;

R _UDIt is the bit rate of reading from driver;

R _MAXIt is the bit rate of the source stream of packets of audio TS; And

R _AIt is the bit rate of the source stream of packets of audio TS.

For example, if the bit rate R that reads from driver _UDBe 54Mbps, the redirect time T _jBe 0.8 second, the bit rate R of the source stream of packets of audio TS _MAX=20Mbps, and the bit rate R of the source stream of packets of audio TS _ABe 640kbps, then the read buffers 33 required big or small x for main TS are 4.06 Mbytes, and are 0.176Mbps for the read buffers 34 required big or small y of audio TS.

(3-3) other examples of Still image data

In the explanation of reference Figure 23, the data format of rest image is JPEG, PNG.Yet data format also can be other Still image data forms such as MPEG2I image, GIF or JPEG2000.Figure 34 is illustrated in the situation of multiplexing MPEG2I image (in-frame encoding picture) on the transport stream.Specifically, Figure 34 illustrates playlist, the clip information when using I image (in-frame encoding picture) as Still image data and is recorded in data structure on the recording medium.This data structure is different from part shown in Figure 23 and only is that image is I image (in-frame encoding picture), and wherein the relation between playlist and EP_map and the transport stream is constant.In this case, can be as situation additional representation shown in Figure 28 secondary playitems playitem with respect to the audio data playback path of playlist.

In a similar manner, the data format of rest image is JPEG, PNG in the explanation of Figure 22.Yet, also can use Still image data form such as MPEG1I image, GIF or JPEG2000.And, in this case, can go up the multiplexed audio data at transfer stream file (static picture document) in the mode that is same as situation shown in Figure 25.

Below the EP_map of explanation Figure 34 points to two kinds of methods of the source grouping in the transfer stream file (static picture document).In transfer stream file shown in Figure 35, each I image begins with sequence head (sequence header), and, as the explanation of aforementioned prior art example 2, point to the grouping of first grouping that comprises the sequence head by EP_map.

In this case, at multiplexing figure ' G ' or the captions ' S ' that cover (reproduced in synchronization) on the rest image in back by the video packets of EP_map appointment.

In transfer stream file shown in Figure 36, the PAT and the PMT of multiplexing system information as the MPEG2 transport stream before the grouping of first byte that comprises the sequence head, and point to the grouping that comprises this grouping by EP_map.

If I image and the figure or the captions that cover thereon are multiplexed on the transport stream in transfer stream file (static picture document), the data structure that then is expressed as the I image can have any in following two kinds of structures.First kind of structure is that the EOS sign indicating number is directly followed a kind of like this structure after single I image.Second kind of structure is a kind of like this structure of rest image being encoded as video sequence, wherein a plurality of images that are equivalent to the playitems playitem playback duration encoded.Just, second kind of a kind of like this structure that structure is made up of I image, a plurality of P image (forward predictive coded image in the frame) and a plurality of B image (bidirectionally predictive coded picture in the frame).From the P image and the B image of I image prediction the rest image as video is encoded, therefore do not have prediction data, thereby use the so-called MPEG2 macro block of being skipped that these P images and B image are encoded.In above-mentioned first and second structures, be the sequence head before the I image.

The playitems playitem that is used for slideshow of present embodiment and as the described playitems playitem that is used to reproduce live image of above-mentioned prior art example 2 can coexist as single playlist.Thereby the user may enjoy the playback of live image and the playback of rest image in reproducing single playlist.

(3-4) structure of messaging device (recording equipment)

In above-mentioned the 3rd embodiment of the present invention shown in Figure 20 to 36, recording equipment (messaging device) can be constructed as first embodiment.Just, with reference to Figure 10, messaging device 1 comprises: Still Image Compression Coder 14 provides rest image so that this image is encoded by terminal 13 to it; Audio coder 11 provides rest image so that these data are encoded by terminal 11 to it; Controller 16 provides image attributes information and audio attribute information from Still Image Compression Coder 14 and audio coder 11 to it, to generate aforementioned playout tabulation and clip information; And register 17, slave controller 16 provides playlist and clip information to it, is used for record on such as the recording medium of blue light (Blu-ray), and is used on recording medium with default format record rest image and voice data.

In the playback time started of each rest image is under the situation of being scheduled to, and controller 16 receives the playback time started and playback duration (demonstration duration) the conduct information relevant with the playback of content of slideshow of each rest image.If as shown in figure 25 with slideshow reproduced in synchronization audio frequency, then controller receives playback time started and the playback duration (demonstration duration) with the voice data of each rest image reproduced in synchronization.If slideshow shown in Figure 21 as described above is not that set its playback order is only arranged is set slideshow for playback time started of each rest image, then controller receives the playback order and the default playback duration of each rest image.At slideshow is under the situation about reproducing with the slideshow of the nonsynchronous voice data of slideshow, except the playback order and default playback duration of each rest image, controller also receives the information in the playback territory in the expression audio stream, as shown in figure 28.Also provide the playback duration (PTS_start) of each image and corresponding source packet number (SPN_start) as image attributes information, with initiative and the corresponding clip information of EP_map shown in Figure 22 to controller 16.

According to the information that is provided, controller 16 is quoted the playback duration (PTS_start) of each image of explaining in this clip information, represents the playlist of the playback path of rest image and voice data with initiative.But under the situation of browsable slide show, the clip information (audio attribute information) of controller initiative voice data, it comprises the table (EP_map of voice data) of the relation between the address (accessing points) of minimum access unit of the playback duration of designated tone audio data and audio stream.

Register 17 writes down clip information and playitems playitem on recording medium 18, simultaneously according to these information record data.

The recording operation of the messaging device of present embodiment is described now.Figure 37 illustrates the method that is used at the recording operation initiative playlist of the messaging device of present embodiment.At first, 14 pairs of rest images that provide by terminal 13 of Still Image Compression Coder are encoded to generate view data, send it to register 17 then.Image attributes information is sent to controller 16.11 pairs of voice datas that provide by terminal 10 of audio coder are encoded to generate audio stream, provide it to register 17 then.Audio coder also sends to controller 16 with image attributes information.

With reference to Figure 37, controller 16 obtains the playback of content (step S21) of slideshow.Just, when slideshow and the mutual AV of voice data are synchronous, as mentioned above, controller receives the playback time started and playback duration and the information relevant with the playback duration of the voice data that reproduces in the mode that has timing relationship with it of each rest image.Mutually under the synchronous situation of AV, controller receives playback order and the default playback duration and the audio playback temporal information of each rest images by terminal 15 at slideshow and voice data.

Then, controller 16 receives image attributes information such as EP_map (step S22) from Still Image Compression Coder 14, receives the EP_map (step S23) of audio attribute information such as audio frequency simultaneously from audio coder 11.Controller 16 is according to the image attributes information initiative clip information conduct attribute information (step S24) relevant with transfer stream file (static picture document).Just, controller is registered in image replaying time (PTS_start) and the corresponding source packet number of reproducing in the slideshow (SPN_start) in EP_map.Controller also with reference to image replaying time (PTS_start) of the EP_map of clip information with the playlist according to the playback territory (playback path) of the external information initiative expression slideshow that provides from the external world, the playlist (step S25) in the audio data playback of initiative expression simultaneously path.In addition, controller 16 is gone back tabulation of command record device 17 recording played and clip information.

Register 17 is recorded in the playlist and the clip information of initiative in the controller 16 on recording medium 18, also be recorded in view data and the voice data that generates in Still Image Compression Coder 14 and the audio coder simultaneously on this recording medium.At this moment, register 17 recording occurring continuously transfer stream file (static picture document) on recording medium 18.

In the messaging device as recording equipment of constructing as mentioned above, as the transfer stream file of forming by the one or more rest images that concentrate on together in the file (static picture document), manage one or more rest images, as the information of clip information management EP_map, wherein the EP_map supervisory packet is contained in each rest image in this document simultaneously.Use the playitems playitem of specifying the playback of each rest image in the slideshow.Therefore, might write down the data that realize slideshow, keep compatibility simultaneously with the live image recording equipment of statement in aforementioned prior art example 2.Just, the AV stream file in the replacement live image provides the transfer stream file of rest image.By being provided for quoting the clip information file of the rest image in the transfer stream file, and by specifying it to reset by playlist, can with the same this montage (message file) and the playlist that use of montage (message file) that adopts the moving image data form with playlist.

(3-5) structure of messaging device (reproducer).

Can be similar to first embodiment as the messaging device of the recording equipment of present embodiment constructs.Just, with reference to Figure 14, messaging device 20 comprises: sensing element 21 is used for from the recording medium sense data; Controller 22 provides the playlist and the clip information of reading from sensing element 21 to it; Rest image decoder 23 and audio decoder 26 provide Still image data and the voice data of being read by sensing element 21 to it respectively; Frame buffer 24 is used for the rest image of temporary transient storage through decoding; And processor 25, be used to control the playback of rest image.

Controller 22 is with reference to the IN_time of playlist with the Still image data that obtains to reproduce, and rest image decoder 23 read by the Still image data of the IN_time appointment of obtaining Still image data and to it decode.It should be noted that, be made as in the unlimited slideshow at the playback duration that reproduces rest image, provide user command by user interface 27 to controller 22, thereby can obtain the IN_time of the Still image data of next reproducing to realize read operation by the timing of user command.Do not having under the situation of user command, the IN_time that obtains the Still image data of next reproducing is to realize read operation.

But under the situation of browsable slide show, controller 22 is with reference to the playback duration of playlist reproducing audio data to obtain.The clip information of controller 22 reference audio stream is read the related audio data to obtain corresponding to the audio stream address and the order sensing element 21 of playback duration.

Describe the operation of this messaging device now in detail.Figure 38 is the flow chart that the replay operations in the present embodiment of messaging device is shown.With reference to Figure 14, sensing element 21 reads playlist and clip information sends to controller with the information of will be read.Controller 22 obtains the IN_time (step S31) of the rest image of distinguishing the playitems playitem of specifying the rest image playback path in the playlist.The static picture document that controller 22 is represented with the IN_time that specifies by rest image with reference to the EP_map of clip information, thus static picture document (step S32) read by sensing element 21 from transfer stream file.

But under the situation of browsable slide show, controller 22 obtains the audio playback time (step S33) according to the playitems playitem of the appointment audio frequency playback path in the playlist.Controller 22 is with reference to the clip information of secondary audio stream (auxiliary audio stream), to obtain the address information of the stream in the audio stream file being decoded by its initiation.Then, controller is managed the control (step S34) of reading voice data by sensing element 21 according to the address information of being obtained.

At step S35,23 pairs of Still image data of reading at step S32 of rest image decoder are decoded, and will send to frame buffer 24 through the image of decoding.At step S36,26 pairs of voice datas of reading at step S14 of audio decoder are decoded, with the voice data of output through decoding.Controller 22 will be preset order and send to processor 25.Frame buffer 24 reproduces the image (step S37) that is stored in wherein when presetting according to this order.

At step S31, controller 22 obtains the IN_time of the rest image of the playitems playitem of next reproducing at timing x1 or x2, wherein regularly x1 is that default playback duration pass by by the institute of rest image of the playitems playitem of current reproduction, and regularly x2 is the moment that ought receive the order of switching rest image from user interface 27.When having reproduced last rest image of playitems playitem, the playback of playlist finishes.

Just, if the playback time started of each rest image shown in Figure 20 is scheduled to, then at timing x1,, read the IN_time of the rest image of the playitems playitem of next reproducing promptly in the moment in finite time past of the default_duration of playitems playitem.Then, controller 22 can issue commands to sensing element 21 to read the respective stationary image.If in the playitems playitem that is provided with unlimited default_duration as shown in figure 21, allow the switching of user instruction rest image, controller can be read the rest image of next reproduction such as the IN_time of playitems playitem in the moment that receives the user instruction that switches rest image, with reading of instruction respective stationary image.

The invention is not restricted to the foregoing description, and can in the scope that does not break away from purport of the present invention, change it as required.For example, though recording equipment separates with reproducer in the above-described embodiments, also can service recorder and/or reproducer.Though the foregoing description is quoted hardware configuration, this only is illustrative, and can realize optional processing by allowing CPU (CPU) carry out the corresponding computer program.In this case, this computer program can adopt the form that is recorded on the recording medium or the form by transmission medium such as Internet transmission to provide.

Industrial usability

The messaging device that describes in detail above comprises: attribute information initiative device, the image attributes information that is used for formulating each rest image of managing the one or more rest images that form the rest image collection; Playback control information initiative device, the playback control information that is used to formulate the expression playback path, wherein this playback path is specified the playback of the concentrated at least a portion rest image of this rest image; Tape deck is used for this rest image collection of record, the image attributes information and the playback control information of correspondence with it on recording medium; Transcriber is used for reading and reproducing rest image from recording medium; And control device, be used for according to playback control information reference picture attribute information with the control transcriber.Playback control information initiative device uses image attributes information initiative playback control information.Therefore, image attributes information and playback control information and rest image collection are recorded on the recording medium dividually, thereby, reading from tape deck and reproducing the rest image, can at first read image attributes information and playback control information, and can generate each rest image of rest image collection with preset order, can easily realize the continuous playback (so-called slideshow) of rest image like this.

Claims

1. messaging device comprises:

Attribute information initiative device is used to formulate the image attributes information of described each rest image that rest image that management is made of one or more rest images concentrates;

Playback control information initiative device, the playback control information that is used to formulate the playback path of specifying described rest image collection; And

Tape deck is used to the described playback control information of writing down described rest image collection, the described image attributes information that is associated with described rest image collection and being associated with described rest image collection; Wherein

It resets relevant with described rest image on being recorded in described recording medium according to described image attributes information by the rest image of described playback control information control.

2. messaging device according to claim 1, wherein said image attributes information comprise the pixel count on identification information, filename, size of data and vertical and the horizontal direction that is included in each concentrated rest image of described rest image.

3. messaging device according to claim 1, wherein said playback control information comprises the information of the playback time started of specifying each rest image, and the information of specifying the demonstration time of each rest image.

4. the information of resetting when messaging device according to claim 3, wherein said playback control information comprise a plurality of rest image of expression.

5. messaging device according to claim 3, the audio playback control information of the playback of the audio stream that reproduces simultaneously with described rest image is specified in the initiative of wherein said playback control information initiative device;

Described tape deck writes down described audio stream and corresponding audio playback control information thereof on described recording medium.

6. messaging device according to claim 5, the initiative of wherein said attribute information initiative device show the audio attribute information of the corresponding relation between the address in the performance timestamp of playback time started of the described audio stream described audio stream corresponding with it;

Described playback control information initiative device adopts described audio attribute information to formulate described audio playback control information.

7. messaging device according to claim 1, wherein said playback control information comprises the information of the playback order of specifying each rest image.

8. messaging device according to claim 7, wherein said playback control information comprises the information of the default demonstration time of specifying each rest image.

9. messaging device according to claim 7, wherein said playback control information are formulated the audio playback control information of device initiative expression playback path, playback time started when wherein this playback path is specified audio stream on the axle and playback concluding time;

10. messaging device according to claim 1, wherein said playback control information initiative device is according to external world's order initiative playback control information.

11. messaging device according to claim 1, wherein said tape deck writes down described rest image with the playback order of being represented by described playback control information.

12. messaging device according to claim 1, wherein said playback control information comprises the information of resetting when specifying a plurality of described rest image, and wherein said image attributes information is managed the rest image collection of being made up of the described rest image that reproduces simultaneously one by one for each rest image group that is made of one or more rest images that reproduce simultaneously.

13. messaging device according to claim 1 also comprises:

Multiplexer is used for described rest image collection is multiplexed into transport stream.

14. messaging device according to claim 13 also comprises:

Code device is used for described transport stream is encoded, thereby applies the default bit rate that restriction realizes described transport stream simultaneously.

15. messaging device according to claim 13, wherein said image attributes information comprise that expression is used for identifying the table of the corresponding relation between the address that its playback is controlled in the identification information of the rest image collection on shaft portion when identical and each rest image group of transport stream opening entry.

16. messaging device according to claim 1, the playback control information of the playback path of the playback of the audio stream that wherein said playback control information initiative device initiative expression control and described rest image reproduce simultaneously;

Described tape deck writes down described audio stream and respective audio playback control information thereof on described recording medium;

Described audio playback control information comprises second supplementary whether expression and nonsynchronous first supplementary of playback or the expression of described rest image want the described playback path of repetition.

17. messaging device according to claim 7, wherein said playback control information comprise playback time started of specifying each rest image and the information of resetting the concluding time.

18. messaging device according to claim 8, the default demonstration time of wherein said rest image is made as limited or infinitary value.

19. messaging device according to claim 13, wherein said image attributes information comprise the performance timestamp of the playback time started that shows each rest image and the table of the corresponding relation between the address in the flow data.

Has the supplementary that timing relationship reproduces 20. messaging device according to claim 19, wherein said multiplexer are multiplexing on described transport stream with each rest image.

Has the caption information that timing relationship reproduces 21. messaging device according to claim 19, wherein said multiplexer are multiplexing on described transport stream with each rest image.

Has the audio-frequency information that timing relationship reproduces 22. messaging device according to claim 19, wherein said multiplexer are multiplexing on described transport stream with each rest image.

23. messaging device according to claim 19, wherein said rest image is encoded in in-frame encoding picture.

24. messaging device according to claim 19, the audio playback control information of the playback path of the playback of the audio stream of wherein said playback control information initiative device initiative expression control and the asynchronous reproduction of described rest image;

25. messaging device according to claim 19, wherein said image attributes information comprise with corresponding to the relevant information of the system timing clock of described performance timestamp.

26. messaging device according to claim 17, wherein said playback control information comprise expression whether can continue to reproduce the described playback concluding time image first supplementary and under the situation that can continue display image by described first supplementary second supplementary of expression demonstration time.

27. messaging device according to claim 1, wherein said rest image collection and described image attributes information are objects, and are that the unit manages with the montage.

28. an information processing method comprises:

Attribute information initiative step, the image attributes information of described each rest image that the rest image that the initiative management is made of one or more rest images is concentrated;

Playback control information initiative step, the playback control information of the playback path of described rest image collection is specified in initiative; And

Recording step, the described playback control information of writing down described rest image collection, the described image attributes information that is associated with described rest image collection and being associated with described rest image collection; Wherein

29. information processing method according to claim 28, wherein said image attributes information comprise the pixel count on identification information, filename, size of data and vertical and the horizontal direction that is included in each concentrated rest image of described rest image.

30. information processing method according to claim 28, wherein said playback control information comprises the information of the playback time started of specifying each rest image, and the information of specifying the demonstration time of each rest image.

31. information processing method according to claim 30, the initiative of wherein said playback control information initiative step are specified and the audio playback control information of the playback path of the playback of the audio stream of described rest image reproduced in synchronization; And wherein

Described recording step writes down described audio stream and corresponding audio playback control information thereof on described recording medium.

32. information processing method according to claim 28, wherein said playback control information comprises the information of the playback order of specifying each rest image.

33. information processing method according to claim 32, the audio playback control information of wherein said playback control information initiative step initiative expression playback path, playback time started when wherein this playback path is specified audio stream on the axle and playback concluding time, and wherein

34. information processing method according to claim 28 wherein, in described recording step, writes down described rest image with the playback order by described playback control information appointment.

35. one kind is used to allow computer carry out the program of predetermined registration operation, described program comprises:

36. a messaging device comprises:

Transcriber is used for recording from it the rest image collection of being made up of one or more rest images, the described image attributes information that is associated with described rest image collection and at least a portion rest image of the described rest image collection that the recording medium reproducing of the described playback control information that is associated with described rest image collection is made of one or more described rest images; And

Control device is used for according to described playback control information, with reference to the described transcriber of described image attributes information Control;

Described image attributes information comprises that administrative institute states the information of each concentrated rest image of rest image;

The playback path of described rest image collection is represented in described playback control information; It is reset and to be associated with rest image on being recorded in described recording medium according to described image attributes information by the rest image of described playback control information control.

37. messaging device according to claim 36, wherein said image attributes information comprise the pixel count on identification information, filename, size of data and vertical and the horizontal direction that is included in each concentrated rest image of described rest image.

38. messaging device according to claim 36, wherein said playback control information comprises the information of the playback time started of specifying each rest image, and the information of specifying the demonstration time of each rest image.

39. according to the described messaging device of claim 38, wherein audio stream is recorded on the described recording medium with the audio playback control information of the playback path of the playback of representing the described audio stream that appointment and described rest image reproduce simultaneously;

Described transcriber reproduces described audio stream together in company with described rest image;

Described control device is controlled the playback of described rest image collection and described audio stream according to described playback control information and audio playback control information.

40. according to the described messaging device of claim 39, the audio playback control information that wherein records audio attribute information and use described audio attribute information to formulate;

Described audio attribute information comprises the table of the corresponding relation between the address in the performance timestamp of the playback time started that the shows described voice data described audio stream corresponding with it.

41. messaging device according to claim 36, wherein said playback control information comprises the information of the playback order of specifying each rest image.

42. according to the described messaging device of claim 41, wherein said playback control information comprises playback time started of specifying each rest image and the information of resetting the concluding time.

43. according to the described messaging device of claim 42, wherein said playback control information comprises the image replaying control information;

Described image replaying control information comprise expression whether can continue to reproduce the described playback concluding time image first supplementary and under the situation that can continue display image by described first supplementary second supplementary of expression demonstration time.

44. according to the described messaging device of claim 41, wherein said playback control information comprises the information of the default demonstration time of specifying each rest image.

45. according to the described messaging device of claim 41, wherein audio stream and audio playback control information represent to specify time the playback time started and the playback path of concluding time of resetting on the axle of described audio stream;

46. according to the described messaging device of claim 45, wherein said audio playback control information comprises this audio playback control information;

Described audio playback control information comprises whether expression and nonsynchronous first supplementary of playback and/or the expression of described rest image want repetition to be included in second supplementary of the described playback path in the described audio playback control information.

47. according to the described messaging device of claim 41, wherein said control device is determined the demonstration time of each rest image by user command.

48. messaging device according to claim 36, wherein said rest image collection comes record by multiplexing on transport stream.

49. according to the described messaging device of claim 48, the audio stream that the playback synchronization of multiplexing and described rest image is reproduced on described transport stream wherein.

50. messaging device according to claim 36, the main transport stream that wherein has described rest image collection is recorded on the described recording medium with the audio transport stream packet with voice data; And wherein

Described transcriber is alternately read described main transport stream and described audio transport stream packet with time-sharing format.

51. messaging device according to claim 36, wherein said rest image collection and described image attributes information are objects, and are that the unit manages with the montage.

52. an information processing method comprises:

Reproduce step, record at least a portion rest image of the described rest image collection of recording medium reproducing of the rest image collection that constitutes by one or more rest images and correspondence image attribute information and playback control information from it; And

Controlled step is according to described playback control information, with reference to the described reproduction step of described image attributes information Control;

Described playback control information comprises the information of the expression playback path that uses described image attributes information initiative, and described playback path is specified the playback of at least a portion rest image of described rest image collection.

53. according to the described information processing method of claim 52, wherein said image attributes information comprises the pixel count on identification information, filename, size of data and vertical and the horizontal direction that is included in each concentrated rest image of described rest image.

54. according to the described information processing method of claim 52, wherein said playback control information comprises the information of the playback time started of specifying each rest image, and the information of specifying the demonstration time of each rest image.

55. according to the described information processing method of claim 54, wherein the audio playback control information of the playback path of the described audio stream that reproduces simultaneously of audio stream and expression and described rest image is recorded on the described recording medium;

In described reproduction step, reproduce described audio stream together in company with described rest image; And wherein

In described controlled step, control the playback of described rest image collection and described audio stream according to described playback control information and audio playback control information.

56. according to the described information processing method of claim 55, wherein the audio playback control information of the described audio playback control information formation of audio attribute information and use is recorded on the described recording medium;

57. according to the described information processing method of claim 55, wherein said playback control information comprises the information of the playback order of specifying each rest image.

58. according to the described information processing method of claim 57, wherein audio stream and audio playback control information represent to specify time the playback time started and the playback path of concluding time of resetting on the axle of described audio stream;

Described reproduction step is reproduced described audio stream together in company with described rest image;

Described controlled step is controlled the playback of described rest image collection and described audio stream according to described playback control information and audio playback control information.

59. one kind is used to allow computer carry out the program of predetermined registration operation, described program comprises:

60. a messaging device comprises:

Attribute information initiative device, the image attributes information that is used for formulating each rest image of managing the one or more rest images that form the rest image collection;

Playback control information initiative device, the playback control information that is used to formulate the expression playback path, wherein said playback path is specified the playback of the concentrated at least a portion rest image of described rest image;

Tape deck is used for the described rest image collection of record, the described image attributes information and the playback control information of correspondence with it on recording medium;

Transcriber is used for reading and reproducing rest image from described recording medium; And

Control device is used for according to the described image attributes information of described playback control information reference to control described transcriber;

Described playback control information initiative device uses described image attributes information to formulate described playback control information.

61. according to the described messaging device of claim 60, wherein said image attributes information comprises the pixel count on identification information, filename, size of data and vertical and the horizontal direction that is included in each concentrated rest image of described rest image.

62. according to the described messaging device of claim 60, wherein said playback control information comprises the information of the playback time started of specifying each rest image, and the information of specifying the demonstration time of each rest image.

63. according to the described messaging device of claim 60, wherein said playback control information comprises the information of the playback order of specifying each rest image.

64. an information processing method comprises:

Attribute information initiative step, the image attributes information of each rest image in one or more rest images of initiative management formation rest image collection;

Playback control information initiative step, the playback control information of initiative expression playback path, wherein said playback path is specified the playback of the concentrated at least a portion rest image of described rest image;

Recording step, the described rest image collection of record, the described image attributes information and the playback control information of correspondence with it on recording medium;

Reproduce step, read and reproduce rest image from described recording medium; And

Controlled step, according to described playback control information with reference to described image attributes information to control described reproduction step;

Described playback control information initiative step uses described image attributes information to formulate described playback control information.

65. one kind is used to allow computer carry out the program of predetermined registration operation, described program comprises:

66. recording medium, record the rest image collection be made up of one or more rest images on it, be used to manage the image attributes information of each rest image that described rest image concentrates and the playback control information of using described image attributes information to form, described playback control information represents to specify the playback path of the playback of the concentrated at least a portion rest image of described rest image.