JP2008172421A - Recorder and method, reproducing apparatus and method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To prevent captions from being shifted from images or sounds. <P>SOLUTION: When a program provided with captions are recorded, one sentence of captions is taken as one line to assign line numbers to sentences of captions in order, and a caption information table 101 is created which associates the time elapsed from the recording start time with a line number and associates a program genre code of the program with a line number. When the program is reproduced, a genre of the program is discriminated by the program genre code, and images and sounds are reproduced from a time resulting from subtracting a delay amount set for the genre from a time elapsed. This invention is applicable to a device for recording and reproducing digital TV broadcast. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a recording apparatus and method, a playback apparatus and method, and a program, and in particular, when there is a caption corresponding to a video and a video, processing that does not cause a shift between the video and the caption can be performed. The present invention relates to a recording apparatus and method, a reproducing apparatus and method, and a program.

  In recent years, television broadcasting is switching from analog broadcasting to digital broadcasting. In addition, with the spread of digital broadcasting, a service called one-segment broadcasting is also spreading. There are also services that provide subtitles in such digital broadcasting.

  FIG. 1 is a diagram illustrating a configuration of an example of a recording / reproducing apparatus that receives, records, and reproduces a digital broadcast program. The recording / playback apparatus 1 shown in FIG. 1 includes a reception unit 11, a recording unit 12, a data recording unit 13, a playback unit 14, and an image display unit 15.

  An antenna 2 is connected to the recording / reproducing apparatus 1. A digital broadcast program is received by the antenna 2, and the received program is supplied to the receiving unit 11. The receiving unit 11 includes a conversion unit that converts a signal received by the antenna 2 into a digital signal, a tuner that extracts data of a program specified by the user, and the like.

  The recording unit 12 performs control for causing the data recording unit 13 to record program data supplied from the receiving unit 11. In this case, the data recorded in the data recording unit 13 is a stream file 31 of a program designated by the user. The reproduction unit 14 reads out the stream file 31 recorded in the data recording unit 13 and generates video data and audio data by executing processing such as encoding. If there is caption data, caption data is also generated.

  The video data and caption data generated by the playback unit 14 are supplied to the screen display unit 15, and the audio data is supplied to a speaker (not shown). The screen display unit 15 provides the user with a video based on the video data and a caption based on the caption data. (See Patent Document 1)

  With reference to the flowchart of FIG. 2, the recording operation of the recording / playback apparatus 1 shown in FIG. 1 will be described.

In step S1, it is determined whether recording is in progress. Since it is an operation at the time of recording, when it is determined that recording is not in progress, the processing of the flowchart in FIG. 2 is terminated. On the other hand, if it is determined in step S1 that recording is in progress, the process proceeds to step S2. In step S2, a TS (Transport Stream) packet is received. In step S3, a TS packet of a predetermined program received by the antenna 2 and selected by the receiving unit 11 is recorded as a stream file 31 by the recording unit 12 in the data recording unit 13.
JP 2005-303743 A

  The stream file 31 includes video data, audio data, and caption data, and the stream as it is is recorded in the data recording unit 13 as the stream file 31.

  By the way, what is provided to the user as subtitles is, for example, a speech such as a drama, or words spoken by the announcer according to the situation in the actual situation of sports broadcasting.

  Since the broadcast content of a drama or the like is determined by the time it is broadcast, it is possible to create subtitle data by the time it is broadcast and distribute it as a stream with the corresponding video data. Commonly referred to as recorded programs, etc., since the prerecorded programs can be created in advance, the subtitle data can be created in advance, so the video (audio) and subtitles match when provided to the user. It is possible to create programs.

  In the case of providing the user with words such as words spoken by the announcer in accordance with the actual situation of sports broadcasting, the caption data cannot be created before it is broadcast. Programs that are commonly referred to as live broadcasts, such as sports broadcasts and news programs, that cannot be recorded in advance, cannot be created in advance, so they are created during the broadcast and provided to users. Is done.

  Since caption data of a program such as a live broadcast is created during broadcasting, video data and audio data are first provided to the user side, and caption data corresponding to the video data and audio data is provided. That is, on the user side, the video and audio are provided in a state where they match, but only the subtitles are provided in a state shifted from the video and audio.

  As described above, the stream file 31 is recorded in the data recording unit 13 with the video data, the audio data, and the caption data included. This means that the subtitles are recorded with a deviation from the video and audio. For this reason, when such a stream file 31 is reproduced, the subtitles corresponding to the video and audio may be provided to the user in a state shifted from the video and audio.

  The present invention has been made in view of such circumstances, and is intended to reproduce subtitles corresponding to video and audio without shifting from the video and audio.

  The recording apparatus according to one aspect of the present invention includes an acquisition unit that acquires a transport packet of a program to be recorded, an extraction unit that extracts subtitle data from the transport packet acquired by the acquisition unit, Included in the transport packet is an elapsed time storage unit that temporarily stores an elapsed time from a time when acquisition of the transport packet by the acquisition unit is started to a time when the caption data is extracted by the extraction unit. The transport stream includes the program genre code storage means for temporarily storing the program genre code indicating the genre to which the program belongs, the subtitle data from the subtitle data, the elapsed time, and the program genre code. Subtitle information table that is referenced when playing back with the recorded video data. And a subtitle information table producing means for producing Le.

  The information processing apparatus further includes a delay amount table storage unit that stores a delay amount table in which the program genre code is associated with a delay amount of the caption data with respect to the video data, and the caption information table creation unit includes the program genre code storage unit. The delay amount associated with the stored program genre code can be read with reference to the delay amount table and described in the caption information table.

  In the delay amount table, the program genre code and priority are further associated with each other, and the program genre code stored in the program genre code storage means and the delay amount table are described. Whether or not the program genre codes match can be determined in the order of priority, and the delay amount can be read out.

  The information processing apparatus further includes a delay amount table storage unit that stores a delay amount table in which the program genre code is associated with a delay amount of the caption data with respect to the video data, and the caption information table creating unit is included in the program genre code storage unit. The delay amount associated with the stored program genre code is read with reference to the delay amount table, the delay amount is subtracted from the elapsed time, and the value is described in the caption information table. can do.

  In the delay amount table, the program genre code and priority are further associated with each other, and the program genre code stored in the program genre code storage means and the delay amount table are described. Whether or not the program genre codes match can be determined in the order of priority, and the delay amount can be read out.

  The recording method according to one aspect of the present invention includes an acquisition step of acquiring a transport packet of a program to be recorded, and an extraction step of extracting subtitle data from the transport packet acquired in the processing of the acquisition step. An elapsed time storage step for temporarily storing the elapsed time from the time when the acquisition of the transport packet was started in the process of the acquisition step to the time when the caption data was extracted in the process of the extraction step; A program genre code storage step for temporarily storing a program genre code indicating a genre to which the program belongs, included in the transport packet, and the subtitle data from the subtitle data, the elapsed time, and the program genre code. Along with the video data included in the port stream And a subtitle information table creation step of creating a subtitle information table referred to when.

  The program of one aspect of the present invention includes an acquisition step of acquiring a transport packet of a program to be recorded, an extraction step of extracting subtitle data from the transport packet acquired in the processing of the acquisition step, An elapsed time storage step for temporarily storing the elapsed time from the time when the acquisition of the transport packet was started in the process of the acquisition step to the time when the caption data was extracted in the process of the extraction step; A program genre code storage step for temporarily storing a program genre code indicating a genre to which the program belongs, included in the transport packet; and the subtitle data from the subtitle data, the elapsed time, and the program genre code Along with the video data included in the stream To execute processing including the subtitle information table creation step of creating a subtitle information table referred to when raw to the computer.

  In the recording apparatus and method and the program according to one aspect of the present invention, when a transport packet of a predetermined program is recorded, the caption data is a separate file, and a table in which information about the caption data is described is created. The The table describes information such as a delay amount for reproducing subtitle data without deviation from the video data when the subtitle data is reproduced together with other data, for example, video data.

  The reproduction apparatus according to one aspect of the present invention acquires subtitle data, video data provided to the user together with the subtitle data, and a subtitle information table referred to when the subtitle data and the video data are reproduced together. And subtitle data reproduction control means for controlling reproduction of the subtitle data, and when a predetermined subtitle is selected from the subtitles whose reproduction is controlled by the subtitle data reproduction control means, video data corresponding to the predetermined subtitle is selected. And a video data playback control for controlling the video data to be played back from the playback start location determined by the determination unit. Means.

  The subtitle information further comprises a delay amount table storage means for storing a program genre code representing the genre of the program that provided the subtitle data and a delay amount table in which a delay amount of the subtitle data with respect to the video data is associated. In the table, the elapsed time elapsed from the time when the acquisition of the data of the program was started to the time when the caption data was extracted and the program genre code are described in association with each other. Reads out a delay amount associated with the program genre code described in the caption information table from the delay amount table, and determines a value obtained by subtracting the delay amount from the elapsed time as the reproduction start location. Can be.

  In the delay amount table, the program genre code and priority are associated with each other, the program genre code stored in the caption information table, and the program genre described in the delay amount table. Whether the codes match can be determined in the order of priority, and the delay amount can be read out.

  In the caption information table, the elapsed time elapsed from the time when acquisition of the data of the program that provided the caption data was started to the time when the caption data was extracted, and the caption data for the video data The delay means reads at least the delay amount described in the caption information table, and determines a value obtained by subtracting the delay amount from the elapsed time as the playback start location. Can be.

  The subtitle information table describes at least the playback start location, and the determining means can determine the playback start location by reading the playback start location from the subtitle information table. .

  The reproduction method of one aspect of the present invention obtains subtitle data, video data provided to the user together with the subtitle data, and a subtitle information table referred to when the subtitle data and the video data are reproduced together. And a subtitle data reproduction control step for controlling reproduction of the subtitle data, and a subtitle selected for reproduction from the subtitle data controlled by the processing of the subtitle data reproduction control step. A determination step for determining a playback start location for starting playback of video data with reference to the caption information table, and control so that the video data is played back from the playback start location determined in the processing of the determination step Video data reproduction control step.

  The program according to one aspect of the present invention obtains subtitle data, video data provided to the user together with the subtitle data, and a subtitle information table referred to when the subtitle data and the video data are reproduced together. When a predetermined subtitle is selected from the subtitle data reproduction control step for controlling the reproduction of the subtitle data and the subtitle whose reproduction is controlled by the processing of the subtitle data reproduction control step, the video corresponding to the predetermined subtitle is selected. A determination step for determining a reproduction start location for starting data reproduction with reference to the caption information table, and a video for controlling the video data to be reproduced from the reproduction start location determined in the processing of the determination step And causing a computer to execute processing including a data reproduction control step.

  In the playback apparatus and method and program of the present invention, subtitle data and video data are played back based on a table created on the recording side. The table provided from the recording side describes at least numerical values used when subtitle data is reproduced without being shifted to video data.

  According to an aspect of the present invention, when recorded video data, audio data, and subtitle data are reproduced, subtitles corresponding to the video and audio can be reproduced without deviation from the video and audio.

  Embodiments of the present invention will be described below. Correspondences between constituent elements of the present invention and the embodiments described in the specification or the drawings are exemplified as follows. This description is intended to confirm that the embodiments supporting the present invention are described in the specification or the drawings. Therefore, even if there is an embodiment which is described in the specification or the drawings but is not described here as an embodiment corresponding to the constituent elements of the present invention, that is not the case. It does not mean that the form does not correspond to the constituent requirements. Conversely, even if an embodiment is described here as corresponding to a configuration requirement, that means that the embodiment does not correspond to a configuration requirement other than the configuration requirement. It's not something to do.

  The recording apparatus according to one aspect of the present invention (for example, the recording apparatus 52 in FIG. 4, the recording apparatus 20 in FIG. 20, or the recording / reproducing apparatus 401 in FIG. 30) acquires a transport packet of a program to be recorded. Means (for example, the reception control unit 71 in FIG. 4), extraction means (for example, the recording control unit 72 in FIG. 4) for extracting subtitle data from the transport packet acquired by the acquisition unit, and the acquisition unit The elapsed time storage means (for example, the table creation unit 73 in FIG. 4) temporarily stores the elapsed time from the time when the acquisition of the transport packet is started by the time when the caption data is extracted by the extraction means. ), And a program genre code recording temporarily storing a program genre code indicating the genre to which the program belongs, included in the transport packet. Reference is made when reproducing the subtitle data together with the video data included in the transport stream from the means (for example, the table creation unit 73 in FIG. 4) and the subtitle data, the elapsed time, and the program genre code Subtitle information table creation means (for example, the table creation unit 73 in FIG. 4) for creating a caption information table to be executed.

  A delay amount table storage unit (for example, a delay estimation value table storage unit 217 in FIG. 20) that stores a delay amount table in which the program genre code is associated with the delay amount of the caption data with respect to the video data is further provided. can do.

  The playback device according to one aspect of the present invention (for example, the playback device 53 in FIG. 5, the playback device 251 in FIG. 22, or the recording / playback device 401 in FIG. 30) includes caption data and video provided to the user together with the caption data. Data and acquisition means (for example, the input control unit 91 in FIG. 5) for acquiring a caption information table that is referred to when both the caption data and the video data are reproduced, and caption data for controlling reproduction of the caption data When a predetermined subtitle is selected from reproduction control means (for example, subtitle reproduction control unit 93 in FIG. 5) and subtitles whose reproduction is controlled by the subtitle data reproduction control means, video data corresponding to the predetermined subtitle is selected. A determination start unit (for example, a subtitle playback control unit 93 in FIG. 5) that determines a playback start location for starting playback of the video by referring to the subtitle information table, and the determination unit. Have been and a video data reproducing control means for the video data from the playback start position is controlled to be reproduced (e.g., subtitle reproduction control unit 93 and the video and audio reproduction control section 92 of FIG. 5).

  Delay amount table storage means for storing a delay amount table in which the program genre code representing the genre of the program that provided the caption data and the delay amount of the caption data with respect to the video data are associated (for example, the delay in FIG. 5). An estimated value table storage unit 94) can be further provided.

  Embodiments of the present invention will be described below with reference to the drawings.

[System configuration example]
FIG. 3 is a diagram showing a configuration of an embodiment of a system to which the present invention is applied. The system shown in FIG. 3 includes an antenna 51, a recording device 52, a playback device 53, and a display device 54.

  The system shown in FIG. 3 receives a digital television broadcast, records it, plays it back, and provides video, audio, etc. to the user. In the system shown in FIG. 3, when captions are provided by digital television broadcasting, the captions are provided to the user in a state that does not deviate from video and audio.

  The antenna 51 receives a digital television broadcast program and supplies data of the received program to the recording device 52. The recording device 52 selects and records program data instructed by the user from the data received by the antenna 51. The program recorded in the recording device 52 is supplied to the reproduction device 53 and reproduced. Of the reproduced data, data relating to video and subtitles is supplied to the display device 54. The display device 54 displays video and subtitles based on the supplied data.

  Here, the description will be continued on the assumption that a digital television broadcast program is received by the antenna 51. However, the program reception form, in other words, the program distribution form is limited to the form received by the antenna 51. The embodiment is not limited. For example, it may be distributed and received via a network such as the Internet.

  The recording device 52 and the playback device 53 may be connected by wire or may be connected wirelessly. The recording device 52 and the playback device 53 may be configured to exchange data via a network or the like. Furthermore, program data including video data and the like may be recorded on a predetermined recording medium by the recording device 52, and the data may be transferred by supplying the recording medium to the reproducing device 53.

[First Embodiment of Recording Apparatus]
FIG. 4 is a diagram illustrating an example of the internal configuration of the recording apparatus 52 according to the first embodiment. The recording device 52 includes a reception control unit 71, a recording control unit 72, a table creation unit 73, a data recording unit 74, a table storage unit 75, and a data output unit 76.

  The reception control unit 71 is connected to the antenna 51 (FIG. 3) and controls reception of a digital television broadcast program received by the antenna 51. The reception control unit 71 includes a tuner, and is configured to select a program instructed by the user from a plurality of programs supplied from the antenna 51 and supply the selected program to the recording control unit 72.

  The recording control unit 72 controls recording of data from the reception control unit 71 to the data recording unit 74. As will be described later, a transport stream packet (hereinafter referred to as a TS packet) is supplied from the reception control unit 71, and the recording control unit 72 extracts a subtitle data packet from the TS packet, The data recording unit 74 records the subtitle data file. Also, the video data and audio data included in the TS packet are recorded as a file (hereinafter referred to as a stream file as appropriate) different from the caption data.

  The data recording unit 74 records at least a caption data file and a stream file.

  The table creation unit 73 creates a table and records it in the table storage unit 75. Although detailed description regarding the created table will be described later, it is a table in which caption data and information such as elapsed time from the recording start time are associated with each other. Hereinafter, the table created by the table creation unit 73 is described as a caption information table.

  The table storage unit 75 stores at least a caption information table. Although the data recording unit 74 and the table storage unit 75 are illustrated separately in FIG. 4, the data recording unit 74 and the table storage unit 75 can also be configured as the same recording unit. The subtitle information table may be allocated and recorded.

  The data output unit 76 reproduces the stream file recorded in the data recording unit 74, the caption data file, and the caption information table stored in the table storage unit 75 when the playback device 53 requests the playback device 53. Control for output to 53 is performed.

  The data recording unit 74 and the table storage unit 75 may be configured by a recording medium that can be attached to and detached from the recording device 52, and the recording medium may be provided to the reproducing device 53 side. Sometimes, the data output unit 76 includes a predetermined drive that writes data to the recording medium and reads data from the recording medium.

[First Embodiment of Playback Apparatus]
Next, a description will be given of the playback device 53 corresponding to the recording device 52 of FIG. FIG. 5 is a diagram illustrating an internal configuration example of the playback device 53 according to the first embodiment. The playback device 53 includes an input control unit 91, a video / audio playback control unit 92, a caption playback control unit 93, a delay estimation value table storage unit 94, a display control unit 95, and an operation unit 96.

  The input control unit 91 controls the recording device 52 to acquire program data instructed by the user. The video / audio reproduction control unit 92 generates video data and audio data from the stream file whose input is controlled by the input control unit 91, supplies the video data to the display control unit 95, and a speaker (not shown). To the part that controls the sounding device.

  The subtitle reproduction control unit 93 generates subtitle data based on the subtitle data file whose input is controlled by the input control unit 91 and supplies the subtitle data to the display control unit 95. The subtitle reproduction control unit 93 refers to the delay estimation value table recorded in the delay estimation value table storage unit 94 when supplying subtitle data to the display control unit 95. The estimated delay value table storage unit 94 stores a table in which the delay time (delay amount) set according to the genre of the program is described.

  The subtitle reproduction control unit 93 refers to the subtitle information table whose input is controlled by the input control unit 91, and determines the delay amount according to the program genre described in the subtitle information table as the delay estimation value table storage unit 94. Is read from the estimated delay value table, and the control is performed so that captions are provided to the user in a state where the delay is made based on the delay amount.

  The display control unit 95 performs control so that a video based on the video data from the video / audio reproduction control unit 92 and a subtitle based on the subtitle data from the subtitle reproduction control unit 93 are displayed on the display device 54.

  The operation unit 96 is configured to include buttons that are operated when a cursor described later is moved. When the operation unit 96 is operated by the user, the operation information is supplied to the subtitle reproduction control unit 93, and the display of the subtitle and the cursor displayed on the display device 54 is the operation information. Controlled based on display.

[About subtitles]
In the following description, the description will be continued focusing on the processing of caption data handled by the recording device 52 and the playback device 53 described above. Here, the subtitles displayed on the display device 54 will be described based on the subtitle data. The display device 54 displays subtitles together with the video or displays only subtitles. FIG. 6 is a diagram illustrating an example of subtitles displayed on the display device 54.

  In the display example shown in FIG. 6, six lines of lines 1 to 6 are displayed. Line 1 is a subtitle "Tomorrow's weather." Line 2 has the subtitle "AA region will be fine." Line 3 is a subtitle “The minimum temperature is 15 ° C.”. Line 4 is a subtitle "The maximum temperature is 22 ° C." Line 5 is a subtitle "The probability of precipitation is less than 10% throughout the day." Line 6 is a subtitle that says, “In the BB region, there is a risk of rain in the mountains, but it will generally be fine.”

  Line 1 subtitles are displayed on the first line, Line 2 subtitles are displayed on the second line, Line 3 and Line 4 subtitles are displayed on the third line, Line 5 subtitles are displayed on the 4th line The subtitles on line 6 are displayed on the 5th and 6th lines. In the following description, the word “line number” is used as a word representing “1” such as line 1. For example, the notation “line number 1” means “line 1”.

  Here, one line is one sentence. For example, one sentence may be displayed in one line as in line 1, or may be displayed in two lines as in line 6. In addition, one or more sentences may be displayed on one line, and for example, two sentences may be displayed on one line, such as line 3 or line 4.

  For example, when subtitles are displayed at the same time as the video, there is a possibility that some restrictions are added to the display of the subtitles due to the relationship with the video, and only the display as shown in FIG. 6 is possible. By extracting and recording subtitle data, it is possible to display only subtitles. When only subtitles are displayed, there is no restriction on the relationship with the video, and for example, the size of characters can be increased or decreased, or the font can be changed according to user instructions. For example, when the size of a character is greatly changed, a sentence that was displayed in one line, such as line 1, may also be displayed over two lines, and the size of the character has been changed to be small. In some cases, for example, a sentence that has been displayed over two lines, such as line 6, may be displayed in one line.

  As will be described later, in the present embodiment, when only the caption is displayed on the display device 54, for example, the cursor 111 is displayed as shown in FIG. 7, and the cursor 111 moves between the lines. , Configured to be able to select a line.

  As shown in the upper part of FIG. 7, for example, the cursor 111 is located on the line 5 and is in a state of pointing to the first line of the fourth line. As shown in the lower part of FIG. There is a case where it is located on the line 6 and points to the second and fifth lines.

  As will be described later, when a predetermined sentence at which the cursor 111 is positioned is selected, reproduction from a portion of the video corresponding to the sentence is started. As described above, the cursor 111 is also used when designating the start point of video playback. Considering such a situation, the cursor 111 is controlled so as to be positioned at a predetermined sentence without interrupting the sentence as an option.

  As shown in FIG. 8, the cursor 111 is positioned on the line 6, but when only the first line of the fifth line is pointed, the cursor 111 is positioned halfway through the sentence. It will be. When the cursor 111 is positioned only halfway through such a sentence, it means that the cursor 111 is positioned only halfway through the choices, so it is considered an undesirable state. It is done. In other words, the cursor 111 is preferably displayed so as to point to one option within an appropriate range. In this case, since one option is one sentence, one sentence is displayed over a plurality of lines. Even for a sentence, the cursor 111 is positioned at the one sentence.

  That is, in the case of the present embodiment, since one line is set as one sentence, it may be controlled so that the cursor 111 is positioned on one line. As described above, in the present embodiment, one line = 1 sentence, and the description is continued assuming that the cursor 111 is positioned on one line.

  However, for example, as shown in FIG. 9, when the lines 3 and 4 are displayed, that is, when two sentences are displayed in one line, the cursor 111 may be displayed over two sentences. Whether or not to display the cursor 111 over two sentences will be described in detail later, for example, but when the time (elapsed time) when the caption data is acquired is the same or approximate, the cursor 111 is displayed in a plurality of sentences. This is possible by determining that control is performed so that the

  The case where subtitles are controlled in this way will be described below.

[Processing of the recording apparatus in the first embodiment]
Processing related to recording performed by the recording apparatus 52 shown in FIG. 4 will be described with reference to the flowcharts of FIGS.

  In step S31, the recording control unit 72 of the recording device 52 sets the line number to 1 as an initial setting. In step S32, it is determined whether recording is in progress. If it is determined in step S32 that the recording is not in progress, the processing of the flowchart relating to the recording processing shown in FIG. 10 is terminated. On the other hand, if it is determined in step S32 that recording is in progress, the process proceeds to step S33.

  In step S33, it is determined whether the recording start time has been acquired. The recording control unit 72 acquires the time when the recording is started at the time when the recording is started, starts timing from the recording start time as a starting point, and records the measured time as elapsed time in the caption information table. . Therefore, in step S33, it is determined whether or not the recording start time has been acquired. If not, the process proceeds to step S34. If it has been acquired, the process in step S34 is skipped. The process proceeds to step S35.

  In step S34, the current time is set as the recording start time. From this point, timekeeping is started.

  In step S35, a TS packet is received. The reception control unit 71 controls the reception of the TS packet of the program designated by the user from the TS packet supplied from the antenna 51 and supplies it to the recording control unit 72. In step S36, the recording control unit 72 causes the data recording unit 74 to record the supplied TS packet as a stream file.

  In step S37, it is determined whether or not the recorded TS packet is a TS packet including caption data. If it is determined in step S37 that the TS packet includes caption data, the process proceeds to step S38, and caption information table creation processing is executed. The caption information table creation process executed in step S38 will be described later with reference to the flowchart of FIG.

  On the other hand, if it is determined in step S37 that the TS packet does not include subtitle data, the process proceeds to step S39. When it is determined that the packet is not a TS packet including caption data, it is determined that the packet is a packet other than the caption packet. Examples of the packet other than the caption packet include a TS packet including video data and audio data. TS packet including the data of the TS packet itself, for example, a TS packet including information (program genre code) indicating what program is based on the supplied TS packet.

  In step S39, an information acquisition process is executed. The information acquisition process is a process for acquiring information required when creating the caption information table, and the information is acquired from a packet other than the TS packet including the caption data. The information acquisition process executed in step S39 will be described later with reference to the flowchart of FIG.

  When the caption information table creation process in step S38 or the information acquisition process in step S39 is completed, the process returns to step S32, and the subsequent processes are repeated. By repeating the process, caption data is accumulated for each line during recording, and a caption information table including information on the caption data is created.

With reference to FIG. 11, the caption information table creation process executed in step S38 will be described. In step S51, the table creation unit 73 acquires the current time. In step S52, the elapsed time is calculated. The elapsed time is calculated by the following equation.
(Elapsed time) = (Current time)-(Recording start time)
That is, the elapsed time is calculated by subtracting the recording start time acquired in step S34 from the current time acquired in step S51.

  In step S53, caption data is extracted from the TS packet. Since the TS packet includes data other than the caption data, only the data necessary for displaying the caption is extracted as the process of step S53. In step S54, the extracted caption data is recorded in the data recording unit 74 as a caption data file.

  In step S55, it is determined whether or not the program genre code and the end time of the program are temporarily stored. The program genre code and the end time are acquired and temporarily stored by performing the information acquisition process executed in step S39 (FIG. 10). There are cases where the program genre code and end time are not acquired, for example, when the recording of the program is started or when the program changes during recording (the genre of the program changes).

  Therefore, in step S55, it is determined whether or not the program genre code and the end time are temporarily stored. If it is determined in step S55 that the program genre code and the end time are temporarily stored, the process proceeds to step S56. If it is determined that the program genre code and the end time are not stored, the process proceeds to step S57.

  In step S56, it is determined whether or not the current time has passed the end time. By performing the process of step S56, for example, when recording of two different programs is instructed in succession, it is possible to determine whether or not the first program is switched to the second program. Become. By changing the program, the program genre code and end time of the first program temporarily stored are switched to the information of the second program. Therefore, it is possible to determine the switching of the program and acquire the information of the new program. You need to be able to do it.

  In addition, the temporarily stored program genre code may be an old program genre code. For example, even when one different program is not recorded continuously, the recording is ended after the recording of the first program is finished and the recording of the second program is started next. There is a possibility that the program genre code of the first program is stored as it is. Check whether the program genre code of the program recorded at that time is such that the processing is not continued even though the old program genre code is stored. In order to do so, the process of step S56 is performed.

  If it is determined in step S56 that the current time has passed the end time, the process proceeds to step S57. If it is determined that the current time has not passed the end time, the process proceeds to step S58.

  In step S57, the line number and the elapsed time are associated with each other and stored in the caption information table. Here, the caption information table will be described with reference to FIG. FIG. 13 is an example of the caption information table 101 created (updated) by the table creation unit 73 and recorded in the table storage unit 75.

  As shown in FIG. 13, the caption information table 101 is a table in which line numbers, caption data, elapsed time, and program genre codes are associated and managed. As described with reference to FIGS. 6 to 9, the line numbers are numbers assigned in order for each sentence from the start of recording when one sentence = 1 line. Recording starts and the first received sentence has a line number of 1. The line number is written in the line number column. That is, in this case, consecutive integers starting from 1 are written in each column.

  In the subtitle data column, information on the subtitle data such as the subtitle data itself corresponding to the line number, or a recording area in which the subtitle data is recorded is written. Here, in order to continue the description on the assumption that the caption data file is recorded in the data recording unit 74, the caption data corresponding to the line number in the data recording unit 74 is recorded in each column of the caption data in the caption information table 101. The description will be continued on the assumption that information for specifying the area or the like is described.

  The elapsed time column describes the elapsed time from the time when the recording was started to the time when the caption data was acquired.

  Information relating to the genre of a program to be recorded (herein, this information is referred to as a program genre code) is described in the program genre code column. The program genre code is included in the TS packet. Therefore, the program genre code is extracted from the TS packet and described in the caption information table 101.

  A program genre code attached to one program is not necessarily one, and a plurality of program genre codes may be attached to one program. When a plurality of program genre codes are extracted from the TS packet, the extracted plurality of program genre codes are described in the program genre code column.

  Returning to the flowchart of FIG. The process proceeds to step S57 when it is determined in step S56 that the current time has passed the end time of the program. The situation when such a determination is made is a situation where different programs are continuously recorded and when the program is switched. Or, when the recording of another program is started after the recording ends. In such a situation, it is necessary to describe the program genre code of the program newly targeted for recording in the caption information table 101.

  Therefore, since the program genre code stored at that time may be an old program genre code, if the program genre code is described in the caption information table 101, incorrect information will be described. Therefore, in step S57, information is described in the column corresponding to the line number and the column corresponding to the elapsed time in the caption information table 101, respectively.

  If it is determined in step S55 that the program genre code is not temporarily stored in step S57, the program genre code is not stored and there is no information to be written. Therefore, information other than the program genre code, that is, information is described in the column corresponding to the line number and the column corresponding to the elapsed time in the caption information table 101, respectively.

  As the line number, the number set at that time is described. The process related to the setting includes a process in which the initial setting is set to 1 in step S31 (FIG. 10) and a process in which the line number is incremented by 1 in step S59 which will be described later. Line numbers set by executing the process are described in the caption information table 101.

  As the elapsed time, the time calculated in step S52 is described in the caption information table 101.

  In step S57, information on the location where the caption data (subtitle data to be processed) corresponding to the described line number in the caption data file is recorded is described in the caption data column. .

  At the time when the process of step S57 is executed, the column of the program genre code in the caption information table 101 is blank. In the blank program genre code column, data is written when the program genre code is acquired in a later process (when the temporarily stored program genre code is updated). The process of acquiring the program genre code (the process of temporarily storing) is an information acquisition process executed in step S39 (FIG. 10), and the description thereof will be described later with reference to the flowchart of FIG.

  Returning to the description of the flowchart of FIG. 11, when information is described in the respective columns of the line number, the caption data, and the elapsed time in the caption information table 101 in step S57 as described above, Proceeding to S59, the line number is incremented by one. When the process of step S59 is completed, the process returns to step S32 (FIG. 10), and the process relating to the acquisition of new caption data is repeatedly performed.

  On the other hand, if it is determined in step S56 that the current time has not passed the end time, the process proceeds to step S58. In step S58, the line number, elapsed time, and program genre code are described in the caption information table 101. The process in step S58 is basically the same as the process executed in step S57, except that the program genre code is described in the caption information table 101.

  The process comes to step S58 when the program genre code and the end time are temporarily stored, and the current time has not passed the stored end time. Such a situation is a situation in which the program is not switched, and the stored program genre code and end time are information corresponding to the program being broadcast at that time. Therefore, in step S58, the program genre code is also written in the caption information table 101.

  When the process of step S58 is completed, the process proceeds to step S59, the line number is incremented by 1, the process is returned to step S32 (FIG. 10), and the subsequent processes are repeated.

  Next, the information acquisition process executed in step S39 will be described with reference to the flowchart of FIG.

  In step S71, it is determined whether or not the received TS packet includes program information. The process comes to step S71 when it is determined in step S37 (FIG. 10) that it is not a TS packet including caption data. If it is determined in step S71 that the program packet information is not included in the TS packet, it means that information to be extracted in the subsequent processing is not included. Therefore, the processing of the flowchart shown in FIG. The processing is returned to S32 (FIG. 10), and the subsequent processing is repeated.

  On the other hand, if it is determined in step S71 that the TS packet includes program information, the process proceeds to step S72. In step S72, it is determined whether or not the program information has already been acquired. If it is determined in step S72 that the program information has not yet been acquired, the process proceeds to step S73.

  In step S73, a program genre code and an end time are extracted from the TS packet as program information and temporarily stored. Thereafter, the process proceeds to step S74. In step S74, it is determined whether or not the caption information table 101 includes a column in which no program genre code is described. For example, when the process of step S57 (FIG. 11) described above is executed, at least one program genre code column is left blank in the caption information table 101.

  In step S74, it is determined whether or not such a blank is present in the caption information table 101. If it is determined in step S74 that the caption information table 101 has a field in which no program genre code is described, the process proceeds to step S75. In step S75, the program genre code temporarily stored in step S73 is described in a column where no program genre code is described.

  On the other hand, if it is determined in step S74 that there is no column in the caption information table 101 in which the program genre code is not described, the process of the flowchart shown in FIG. 12 is terminated, and the process proceeds to step S32 (FIG. 10). Is returned, and the subsequent processing is repeated.

  On the other hand, if it is determined in step S72 that the program information has already been acquired, the process proceeds to step S76, and the current time is acquired. In step S77, it is determined whether it is the program end time. In step S77, the current time acquired in the process of step S76 is compared with the end time of the program included in the already acquired program information (the temporarily stored end time) to determine whether it is the program end time. Is judged.

  If it is determined in step S77 that it is not the end time of the program, the process returns to step S32 (FIG. 10), and the subsequent processes are repeated. On the other hand, if it is determined that it is the end time of the program, in step S78, the program genre code and the end time are acquired and temporarily stored as program information in the same manner as in step S73. Note that the program information acquired in step S78 is information on the next program. Thereafter, the process is returned to step S32, and the subsequent processes are repeated.

  By executing such processing, the latest program information is controlled to be temporarily stored. Also, a caption information table 101 is created based on such program information, and caption data is recorded.

  By executing such processing, data as shown in FIG. 14 is recorded in the recording device 52. A stream file 121 and a caption data file 122 are recorded in the data recording unit 74 of the recording device 52, and a caption information table 101 is recorded in the table storage unit 75.

  The reproduction performed by the reproduction device 53 will be described based on such files and tables.

[Processing of the playback apparatus according to the first embodiment]
With reference to the flowcharts of FIGS. 15 to 17, processing related to playback performed by the playback device 53 (FIG. 5) will be described. As described with reference to FIGS. 6 to 9, the playback device 53 displays subtitles (text), and plays back video corresponding to the subtitles (sentences) instructed by the user among the displayed subtitles. Start. Here, a case where such processing is performed will be described as an example. Therefore, the flowchart of FIG. 15 is started as a premise when subtitle display is instructed.

  In step S <b> 111, the input control unit 91 of the playback device 53 acquires the caption data file 122 and the caption information table 101 from the recording device 52. At this time, the stream file 121 may also be acquired, or may be acquired when an instruction to reproduce the video included in the stream file 121 is given. Moreover, this acquisition process may be performed, for example, when a subtitle display is instructed by the user, or may be performed in advance at a time prior to the instruction from the user.

  Even if the data output unit 76 (FIG. 4) of the recording device 52 and the input control unit 91 of the playback device 53 are connected by wire, the caption data file 122 and the caption information table 101 are exchanged via the wire. Alternatively, the data output unit 76 (FIG. 4) and the input control unit 91 may be connected via a network such as the Internet, and the caption data file 122 and the caption information table 101 may be exchanged via the network.

  Further, the recording device 52 records the stream file 121, the caption data file 122, and the caption information table 101 on a recording medium (not shown) that is detachable from the recording device 52, and the recording medium is a playback device. By being attached to 53, the playback device 53 may acquire data.

  When the caption data file 122 and the caption information table 101 are acquired in step S111, the process proceeds to step S112, and the caption is displayed on the display device 54. The input control unit 91 of the playback device 53 supplies the acquired caption data file 122 and the caption information table 101 to the caption playback control unit 93. The subtitle reproduction control unit 93 generates subtitle data in the order of line numbers based on the acquired subtitle data file 122 and supplies the subtitle data to the display control unit 95.

  The display control unit 95 controls the display device 54 based on the supplied subtitle data, displays subtitles on the display device 54, and also displays the cursor 111. By performing such control, for example, as illustrated in FIG. 7, subtitles assigned with line numbers 1 to 6 are displayed, and the cursor 111 is displayed.

  In step S113, the position of the cursor 111 is set to 1. That is, the line number where the cursor 111 is located is set to 1 which is an initial value. For example, when a caption as shown in FIG. 7 is displayed, the position of the cursor 111 is set to 1, and the cursor 111 is positioned on the sentence “Tomorrow's weather” corresponding to the line number 1. It is assumed that

  In step S114, it is determined whether or not a command for instructing movement of the cursor 111 has been received. When the operation unit 96 is operated, the operation information, that is, the command is supplied to the caption reproduction control unit 93. Here, the command from the operation unit 96 is a command for moving the cursor 111 upward, a command for moving the cursor 111 downward, and playback of video corresponding to the subtitle where the cursor 111 is located. Suppose there is a command to instruct.

  The subtitle reproduction control unit 93 determines whether or not a command from the operation unit 96 has been received. When it is determined that the command has been received, the subtitle reproduction control unit 93 determines whether or not the command is a command for instructing movement of the cursor 111. By determining, the process in step S114 is performed.

  If it is determined in step S114 that a command for instructing movement of the cursor 111 has been received, the process proceeds to step S115, and whether or not the received command is a command for moving the cursor 111 upward. Is judged.

  If it is determined in step S115 that the received command is a command for moving the cursor 111 upward, the process proceeds to step S116, and whether or not the position of the cursor 111 is 1 ( Whether the line number is 1 or not is determined). If the cursor 111 is positioned on the sentence whose line number is 1, the cursor 111 cannot be moved up any further, so whether or not the cursor 111 can be moved up. Is determined in step S116.

  If it is determined in step S116 that the position of the cursor 111 is line number 1, the process returns to step S114, and a standby state is entered until a new command instruction is received. In such a case, since the cursor 111 is positioned on the top line and cannot be moved any further, the standby state is maintained without being processed. become. In such a situation, a process may be performed in which a message such as “cannot move up” is displayed to the user.

  On the other hand, if it is determined in step S116 that the position of the cursor 111 is not the line number 1, the process proceeds to step S117, and a process of moving the cursor 111 upward by one line is executed. That is, when the subtitle reproduction control unit 93 determines that the command from the operation unit 96 is an instruction to move the cursor 111 upward, the subtitle reproduction control unit 93 subtracts 1 from the line number where the cursor 111 is located, and subtracts 1 from the line number. By generating data so as to move the cursor 111 on the line number sentence and supplying it to the display control unit 95, the position of the cursor 111 displayed on the display device 54 is moved upward. . If necessary, processing such as subtitle scrolling is also performed.

  When the process of step S117 is completed, the process returns to step S114 and is in a standby state until an instruction for a new command is received.

  On the other hand, if it is determined in step S115 that the received command is not a command for moving the cursor 111 upward, the process proceeds to step S118, and whether the position of the cursor 111 is the last line. It is determined whether or not.

  The process comes to step S118 when the command from the operation unit 96 is a command for moving the cursor 111 downward. If the cursor 111 is positioned at the position of the last line, the cursor 111 cannot be moved any further, so it is determined in step S118 whether or not the situation is such that it cannot be moved downward. The Here, the last line is a line corresponding to the largest value of the line number described in the caption information table 101.

  If it is determined in step S118 that the position of the cursor 111 is the last line (maximum line number), the process returns to step S114, and a standby state is entered until a new command instruction is received. In such a case, since the cursor 111 is positioned on the bottom line, the cursor 111 cannot be moved any further, so that the standby state is maintained without being processed. become. Further, in such a state, a process may be performed in which a message such as “cannot move down” is displayed to the user.

  On the other hand, if it is determined in step S118 that the position of the cursor 111 is not the last line, the process proceeds to step S119, and a process for moving the cursor position downward by one line is executed. The process for moving the position of the cursor 111 downward by one line is basically performed in the same manner as the process for moving the position of the cursor 111 upward by one line in step S117. When the process of step S119 is completed, the process is returned to step S114, and is in a standby state until a new command instruction is received.

  Here, the description has been given on the assumption that the cursor 111 is moved line by line. However, when a mouse (not shown) is used to skip a line and select a desired subtitle, It is possible to appropriately change the processing flow so that the processing is performed so that the cursor 111 is moved to the subtitle selected by the user.

  On the other hand, if it is determined in step S114 that the received command is not a command for instructing the movement of the cursor, that is, a command for instructing the reproduction of the video corresponding to the subtitle where the cursor 111 is located. If it is determined, the process proceeds to step S120.

  In step S120, a video reproduction start process is executed. The video reproduction start process executed in step S120 will be described with reference to the flowchart of FIG.

  In step S131, when the subtitle playback control unit 93 determines that the command from the operation unit 96 is a command for instructing video playback, the subtitle playback control unit 93 recognizes the line number of the subtitle where the cursor 111 is located. In step S <b> 132, the subtitle reproduction control unit 93 reads the elapsed time corresponding to the recognized line number from the subtitle information table 101. Referring to FIG. 13 again, the subtitle information table 101 records line numbers and elapsed times in association with each other.

  For example, when the line number recognized in the process of step S131 is the line number 33, “00:14:40”, which is the elapsed time associated with the line number 33, is read out in the process of step S132. .

  In step S <b> 133, the caption reproduction control unit 93 reads a program genre code corresponding to the recognized line number from the caption information table 101. Referring to FIG. 13 again, in the caption information table 101, the program genre code is associated with the line number and the elapsed time.

  For example, when the line number recognized in the process of step S131 is the line number 33, “genre A, genre C”, which is the program genre code associated with the line number 33, is read out in the process of step S133. It is.

  As described above, when video reproduction is started, the elapsed time and the program genre code associated with the line number where the cursor 111 is located are read from the caption information table 101.

  In step S134, a delay time determination process is executed. The delay time determination process, which will be described later with reference to the flowchart of FIG. 17, is a process performed to prevent the video and subtitles corresponding to the video from shifting.

  Here, the fact that the video and the subtitle corresponding to the video are shifted will be described with reference to FIG. For comparison, the upper diagram in FIG. 18 shows a playback state (ideal broadcasting) mode that is originally desired. As shown in the upper diagram of FIG. 18, originally, the video of scene A, the audio of scene A, and the subtitles of scene A are preferably reproduced without deviation. In other words, the video, audio, and subtitles of the same scene are not shifted in time. For example, when performer A speaks something in the video, the audio that matches the speech (movement of the mouth) Is output, and the sound is converted into text and is preferably displayed as subtitles.

  The lower part of FIG. 18 shows the playback situation when the subtitles are shifted. As described above, for example, when the performer A speaks something in the video, the sound corresponding to the remark (movement of the mouth) is output, and the sound converted into text is displayed as subtitles. However, depending on the timing at which the text data of the text is generated, only the subtitle may be delayed with respect to the video or audio.

  For example, in the case of a program called live broadcast, where the recording and broadcasting of the program are performed at the same timing, the video and audio are recorded and broadcast at the same time, but the caption is the person who heard the recorded audio Is input by hand to a personal computer or the like, and caption data is generated and broadcast when it is generated. Therefore, since the caption data is broadcast at a later time than the video and audio, as shown in the lower diagram of FIG. 18, the video of the scene A and the audio of the scene A are broadcast without any deviation. The broadcast is delayed by a time T1 from the video and audio.

  As described above, it is not preferable that the subtitles corresponding to the video and the audio are displayed with being shifted from the video and the audio. In the present embodiment, as described above, only the subtitles of the broadcast program can be browsed, and when a desired subtitle is selected from the subtitles being browsed, the video corresponding to the subtitle is displayed. Playback starts. If this is explained with reference to FIG. 18, when only the subtitle of the scene A is displayed and the reproduction of the video and audio corresponding to the subtitle of the scene A is instructed, the time T1 is shifted. Subtitles are played along with video and audio.

  In other words, the video and audio from the time t1 are reproduced as the video and audio, and the subtitle that should be played at the time t0 is played along with the video and audio from the time t1. .

  In the present embodiment, control is performed so that there is no deviation of time T1 during reproduction. In other words, even if a subtitle for video and audio is displayed with a deviation from the video and audio during broadcasting, the subtitle is converted to video and audio when the program is recorded and played back. On the other hand, playback is performed in a state that is not shifted, that is, in an ideal broadcasting state as shown in the upper diagram of FIG.

  In order to perform reproduction so that there is no deviation, a delay time determination process is performed in step S134. This process is a process for determining how much delay time is present, that is, how much the value of the time T1 in the lower diagram of FIG. 18 is.

  By the way, as described above, subtitles deviate from video and audio in programs such as live broadcasts, and deviations do not necessarily occur in all programs. That is, for example, in a program in which video and audio are recorded before the broadcast time and caption data is also created in advance, such as a program called a recorded program, the video, audio, Since the subtitle data is prepared, there is no possibility that the subtitles are shifted from the video and audio at the time of broadcasting. Therefore, the subtitles are not shifted when the recorded program is recorded and reproduced.

  Moreover, even if the program is a live broadcast and there is a possibility that the subtitles are shifted, the shift time T1 differs depending on the program. For example, in live broadcasts such as sports broadcasts, when the words of live announcers are provided in subtitles, the announcer cannot know in advance what kind of words will be emitted, so the announcer will speak Since the subtitle data is created after that, the value of the deviation time T1 tends to be a large value.

  In addition, for example, there are news as live broadcasts, but in the case of providing live broadcasts of news, etc., the words of live announcers are provided in subtitles, basically the subtitle data is created after the announcer speaks the words. However, in the case of news, since the manuscript that is read aloud at the time of broadcasting is prepared before broadcasting, the language that the announcer utters during broadcasting is limited, and all subtitle data is based on the manuscript before broadcasting. It is possible to create only a part even if not. Therefore, the time T1 to be shifted tends to be a small value even if it is deviated.

  In this way, it is considered that the time T1 to be shifted differs depending on whether it is a live broadcast, whether it is a news broadcast or a live broadcast even if it is a live broadcast. Considering this, it can be seen that the time T1 to be shifted differs depending on the genre of the program. That is, for example, the news genre and the sports genre have different time T1 even if they are the same live broadcast, and the news genre and variety genre are different from the news due to the difference between live broadcast and recorded program. It is necessary to consider the time T1, and it is not necessary to consider the time T1 that deviates from the variety.

  For this reason, the time T1 to be shifted for each genre is different (the value may be the same), and the time T1 to be shifted is set in advance for each genre. The delay time (hereinafter, appropriately described as a delay amount) is determined.

  Thus, in order to determine the delay amount for each genre, the program genre code is described in the caption information table 101 (FIG. 13). Referring to the caption information table 101 shown in FIG. 13 again, for example, the program genre code of “genre A” and the program genre code of “genre B” are described in the program genre code column of line number 33. ing. Thus, a plurality of program genre codes may be attached to one program.

  For example, in the case of a documentary program related to sports, two different program genre codes, a program genre code “sports” and a program genre code “documentary”, are attached to one program.

  As described above, the delay amount is determined for each genre, but when a plurality of program genre codes are attached to one program, to which program genre code among the plurality of program genre codes It is necessary to determine whether to determine the amount of delay based on this. Here, priorities are assigned to program genre codes (genres), and when a plurality of program genre codes are attached, the delay amount is determined based on the program genre codes having higher priorities.

  FIG. 19 shows a table that takes this into consideration. The table shown in FIG. 19 is a delay amount estimated value table 151 that is referred to when determining the delay amount. The priority order, the program genre code, and the estimated delay value are described in association with each other. For example, the program genre code assigned with the priority “1” is “variety”, and the estimated delay value at the time of “variety” is “0”.

  Here, the delay estimation value is a delay amount (or time T1 to be shifted), and is a value obtained from an experimental result or the like in advance. For example, when the program genre code is news, the average delay time for subtitles being delayed with respect to the video in a program to which the program genre code “news” is attached is “−3” seconds. The program to which the genre code is attached means that it can be estimated that the caption is delayed by “−3” seconds with respect to the video.

  The estimated delay value table 151 shown in FIG. 19 is an example, and only an example in which only priority levels 1 to 4 are described as priorities is shown, and priority is given to other program genre codes not shown. The ranking is given and described in the delay estimation value table 151.

  The estimated delay value table 151 shown in FIG. 19 is recorded in the estimated delay value table storage unit 94 (FIG. 5). A mechanism for updating the estimated delay value table 151 may be provided. Further, a learning function may be provided so that the estimated delay value described in the estimated delay value table 151 is updated.

  Refer to the flowchart of FIG. 17 for the delay time determination process (the process of step S134 of FIG. 16) executed when the estimated delay value table 151 shown in FIG. 19 is recorded in the estimated delay value table storage unit 94. I will explain.

  In step S151, it is determined whether or not the program genre code read from the caption information table 101 in step S133 (FIG. 16) is variety. If there are a plurality of read program genre codes, it is determined whether or not a plurality of read program genre codes include a program genre code indicating variety. Similarly, in the following processing, when there are a plurality of read program genre codes, it is determined whether or not there is a program genre code of the genre to be processed.

  If it is determined in step S151 that the program genre code is variety, the process proceeds to step S155, and the delay amount is set to zero.

  On the other hand, if it is determined in step S151 that the program genre code is not a variety, the process proceeds to step S152, and it is determined whether or not the program genre code is documentary. If it is determined in step S152 that the program genre code is documentary, the process proceeds to step S155, and the delay amount is set to zero.

  On the other hand, if it is determined in step S152 that the program genre code is not a documentary, the process proceeds to step S153, and it is determined whether or not the program genre code is news. If it is determined in step S153 that the program genre code is news, the process proceeds to step S156, and the delay amount is set to -3.

  On the other hand, if it is determined in step S153 that the program genre code is not news, the process proceeds to step S154, and the delay amount is set to -8. As shown in FIG. 19, in the delay estimation value table 151, up to sports of priority 4 are described, and the read program genre code does not correspond to each genre of priority 1 to 3. As a result, when the process comes to step S154, it is determined that the program genre code is a sport. Therefore, -8, which is the estimated delay value assigned to the sport, is set as the delay amount.

  In this way, it is determined whether or not the program genre codes match in the priority order described in the delay estimated value table 151, and the delay estimated value set for the program genre code determined to match is: Set as a delay amount.

  When the delay amount is set in this way, the process proceeds to step S135 (FIG. 16).

  In step S135, the reproduction start location is determined. When the delay amount is determined, the subtitle playback control unit 93 of the playback device 53 determines the playback start location so that playback of the previous video and audio is started by the delay amount. Referring to the lower diagram of FIG. 18 again, the subtitle of scene A should be reproduced together with the video reproduced at time t0. However, for the reason described above, it is delayed by time T1, and no processing is performed. If not applied, playback starts with the video played back at time t1.

  In other words, the subtitle of the scene A reproduced from the time t1 corresponds to the video and audio of the scene A reproduced from the time t0. Therefore, if the subtitle of the scene A is reproduced while the video and audio from the time t0, which is the time T1 before the time t1, is reproduced, the subtitle corresponding to the video and audio is reproduced.

  Therefore, in step S135, the playback start location is determined so that playback of the previous video and audio is started by the determined delay amount. Specifically, the time at which the delay amount is subtracted from the elapsed time read in the process of step S132 is set as the reproduction start location. Here, “time when delay amount is subtracted from elapsed time” is described. However, for example, when a reproduction start location is determined by referring to delay estimation value table 151 as shown in FIG. Since the value described as the estimated delay value includes a negative value, it may be “the time when the delay amount is added from the elapsed time”. According to the value described in the estimated delay value table 151, It is possible to appropriately change so as to be subtracted or added.

  Referring to FIG. 13 again, for example, when the elapsed time of the line number 33 is “00:14:40” and the genre determined from the program genre code is sports, the delay amount is −8. Since it is set, the reproduction start location corresponding to the caption of line number 33 is set to “00; 14:32”. Therefore, in such a case, video and audio from the elapsed time “00; 14:32” are reproduced.

  In step S135, when the subtitle playback control unit 93 determines the playback start location, the subtitle playback control unit 93 advances the processing to step S136, and the video / audio playback control unit 92 starts playback of video and audio from the determined playback start location. To give instructions. By issuing such an instruction to the video / audio reproduction control unit 92, the video / audio reproduction control unit 92 starts reproduction of video and audio from the designated reproduction start location.

  In this way, video and audio from the previous time are played back in consideration of the delay time of subtitles, so that playback that causes subtitles to deviate from video and audio is prevented. Is possible.

[System in the Second Embodiment]
In the first embodiment described above, the delay amount is determined from the program genre code on the playback device 53 side. However, as the second embodiment, the delay amount is determined on the recording device 52 side, and the table is set. A mode of writing to the file will be described. Note that the description of the parts overlapping with the first embodiment will be made briefly.

  FIG. 20 is a diagram illustrating a configuration example of the recording apparatus 201 according to the second embodiment. The recording apparatus 201 illustrated in FIG. 20 includes a reception control unit 211, a recording control unit 212, a table creation unit 213, a data recording unit 214, a table storage unit 215, a data output unit 216, and a delay estimation value table storage 217. It is said that.

  20, the reception control unit 211, the recording control unit 212, the data recording unit 214, and the data output unit 216 are respectively the reception control unit 71 and the recording control of the recording device 52 illustrated in FIG. Since the configuration is the same as that of the unit 72, the data recording unit 74, and the data output unit 76, and the same processing is performed, description thereof will be omitted as appropriate.

  The table creation unit 213 creates a caption information table 231 as illustrated in FIG. 21, and the table storage unit 215 stores the caption information table 231 created by the table creation unit 213. In order to create the caption information table 231 illustrated in FIG. 21, the table creation unit 213 refers to the delay estimation value table 151 stored in the delay estimation value table storage unit 217. The estimated delay value table storage unit 217 stores the estimated delay value table 151 shown in FIG.

  The caption information table 231 will be described with reference to FIG. The caption information table 231 is a table in which line numbers, caption data, elapsed time, and delay amounts are described in association with each other. Compared to the caption information table 101 in the first embodiment shown in FIG. 13, the difference is that the delay amount is written in the caption information table 231 instead of the program genre code.

  For example, in FIG. 21, the delay amount of line number 1 is described as “0”, and the delay amount of line number 33 is described as “−8”. This delay amount is described in the caption information table 231 by performing a process described later.

  Since the delay amount is described in the caption information table 231 created on the recording device 201 side, the playback device side does not need to perform processing such as determining the genre from the program genre code and setting the delay amount. Therefore, the playback device has an internal configuration as shown in FIG.

  That is, the playback device 251 illustrated in FIG. 22 includes an input control unit 261, a video / audio playback control unit 262, a caption playback control unit 263, an operation unit 264, and a display control unit 265.

  22, the input control unit 261, the video / audio reproduction control unit 262, the subtitle reproduction control unit 263, the operation unit 264, and the display control unit 265 are respectively the reproduction device 53 illustrated in FIG. The input control unit 91, the video / audio reproduction control unit 92, the subtitle reproduction control unit 93, the operation unit 96, and the display control unit 95 have the same configuration and perform the same processing. That is, the playback device 251 shown in FIG. 22 has a configuration in which the estimated delay value table storage unit 94 is deleted from the playback device 53 shown in FIG.

  Processing performed by each of the recording apparatus 201 and the reproduction apparatus 251 having such a configuration will be described.

[Processing of Recording Apparatus in Second Embodiment]
Next, processing related to recording performed by the recording apparatus 201 will be described. Since the recording apparatus 201 performs basic processing based on the already described flowchart of FIG. 10, detailed description thereof is omitted. In the recording apparatus 201, the caption information table creation process performed in step S38 and the information acquisition process performed in step S39 are different from the processes of the recording apparatus 52 in the first embodiment, and each process will be described below. .

  FIG. 23 is a flowchart for explaining subtitle information table creation processing 2 (described as “2” for the sake of distinction from the subtitle information table creation processing in the first embodiment, hereinafter the same description is performed). It is.

  The processes in steps S201 to S207 and S210 are the same as the processes in steps S51 to S57 and S59 in FIG.

  If it is determined in step S206 that the current time has not passed the end time, the process proceeds to step S208. In step S208, a delay time determination process is executed. The processing comes to step S208 when the program genre code and the end time are temporarily stored, and the current time has not passed the stored end time. This situation means that the same program is being recorded, and the stored program genre code and end time are information corresponding to the program recorded at that time.

  In step S208, processing for determining a delay time is executed from the temporarily stored program genre code. The delay time determination process in step S208 is performed based on the flowchart of FIG. That is, the estimated delay value table storage unit 217 of the recording apparatus 201 (FIG. 20) stores the estimated delay value table 151 as shown in FIG. 19, and the table creation unit 213 includes the estimated delay value table storage unit. The process of the flowchart shown in FIG. 17 is executed with reference to the estimated delay value table 151 stored in the reference numeral 217.

  Since the processing of the flowchart shown in FIG. 17 and the estimated delay value table 151 shown in FIG. 19 have already been described, description thereof will be omitted.

  The process of the flowchart shown in FIG. 17 is a process executed by the playback device 53 in the first embodiment, but is performed on the recording device 201 side in the second embodiment. Thus, in the second embodiment, the delay time is determined on the recording apparatus 201 side.

  When the delay time (delay amount) is determined in step S208 (FIG. 23), the line number, the elapsed time, and the delay amount are associated and written to the caption information table 231 in step S209. The process in step S208 is basically the same as the process in step S58 in the flowchart of FIG. 11, except that a delay amount is written instead of the program genre code.

  In this way, the delay amount is written in the table created on the recording side. As described above, when the delay amount is written in the caption information table 231, the processing for acquiring information such as the program genre code, that is, the information acquisition processing executed in step S39 (FIG. 10) also includes the delay amount. The processing is performed on the recording apparatus side. Here, the information acquisition process (information acquisition process 2) performed in step S39 will be described with reference to the flowchart of FIG.

  The processing in steps S221 through S224 is the same as the processing in steps S71 through S74 in FIG. However, in step S224, it is determined whether or not there is a column in which the delay amount is not described in the caption information table 231.

  If it is determined in step S224 that there is a column in which the delay amount is not described in the caption information table 231, the process proceeds to step S225. In step S225, a delay time determination process is executed. Since this delay time determination process is performed in the same manner as the process of step S208 in the flowchart of FIG. 23, the description thereof is omitted.

  The delay amount obtained in step S225 is written in the caption information table 231 in step S226. In this way, the delay amount is written in the blank of the caption information table 231.

  The processing in steps S227 through S229 is the same as the processing in steps S76 through S78 in FIG.

  In this way, the caption information table 231 in which the delay amount is described is created and stored on the recording apparatus 201 side. Next, playback processing of the playback device 251 performed using the caption information table 231 will be described.

[Processing of the playback apparatus according to the second embodiment]
Next, processing related to playback performed by the playback device 251 will be described. Since the playback device 251 performs processing based on the flowchart of FIG. 15 already described, detailed description thereof is omitted. Since the playback device 251 differs from the playback device 53 in the first embodiment in the video playback start processing performed in step S120, the video playback start processing will be described below.

  FIG. 25 is a flowchart for explaining the processing 2 for starting video reproduction.

  The processes in steps S251 through S255 are basically the same as the processes in steps S131 through S133, S135, and S136 in the flowchart shown in FIG. That is, the playback device 251 in the second embodiment does not perform the delay time determination process that the playback device 53 in the first embodiment has executed in the process of step S134. It is assumed that the processing flow is omitted.

  Further, since the caption information table 231 shown in FIG. 21 is supplied to the playback device 251, the delay amount is read from the caption information table 231 in step S253. In step S254, the read start point is determined using the read delay amount and elapsed time.

  As described above, even if the recording device 201 creates the caption information table 231 in which the delay amount is described and the playback device 251 uses the caption information table 231 to perform playback, the same as in the first embodiment. Similarly, subtitles corresponding to video and audio can be reproduced without deviation from the video and audio.

[System according to the third embodiment]
In the second embodiment described above, the subtitle information table 231 in which the delay amount is described is created on the recording device 201 side, and further, the delay amount to the playback start location are set, and the set information is set. The playback start location may be described in the caption information table. Such a configuration will be described below as a third embodiment. Note that the description of the parts overlapping with the first embodiment and the second embodiment will be made briefly.

  FIG. 26 is a diagram illustrating an example of the caption information table 311 created and stored in the third embodiment. In the caption information table 311, line numbers, caption data, and playback start locations are associated with each other. Compared with the subtitle information table 301 shown in FIG. 26 and the subtitle information table 231 shown in FIG. 21, first, the subtitle information table 301 does not have a delay amount column provided in the subtitle information table 231. Further, the elapsed time column of the caption information table 231 is a reproduction start location column in the caption information table 301.

  Thus, the configuration of the recording device and the configuration of the playback device when the playback start location is described in the caption information table 301 are as shown in FIGS. 20 and 22, respectively. That is, in the case of the third embodiment, the content of the caption information table created by the table creation unit 213 (FIG. 20) is only different from that of the second embodiment, so the configuration of the recording apparatus is shown in FIG. Furthermore, the same configuration as that of the recording apparatus 201 in the second embodiment can be adopted. Also, a playback device corresponding to the recording device 201 can have the same configuration as the playback device 251 in the second embodiment shown in FIG.

  Therefore, here, the recording apparatus and the reproduction apparatus in the third embodiment are described as being configured similarly to the recording apparatus 201 and the reproduction apparatus 251 in the second embodiment, and the description has already been given. Omitted.

[Regarding Processing of Recording Apparatus in Third Embodiment]
Next, processing relating to recording performed by the recording apparatus 201 according to the third embodiment will be described. Since the recording apparatus 201 basically performs processing based on the flowchart of FIG. 10 already described, detailed description thereof is omitted. In the recording apparatus 201, the subtitle information table creation process performed in step S38 and the information acquisition process performed in step S39 are the processes of the recording apparatus 52 in the first embodiment or the recording apparatus 201 in the second embodiment. Each process will be described below.

  FIG. 23 is a flowchart for explaining the caption information table creation processing 3.

  Since the processes in steps S301 to S306 and S311 are the same as the processes in steps S51 to S56 and S59 in FIG.

  If it is determined in step S305 that the program genre code and the end time are not temporarily stored, or if it is determined in step S306 that the current time has passed the end time, the process proceeds to step S307. . In step S307, the line number and elapsed time are written in the caption information table 301.

  In this case, since the program genre code is not stored, or even if it is stored, it may be a program genre code of another program, the reproduction start location derived from the program genre code can be derived. Since this is not possible, the playback start location is not described in the caption information table 301 at this point. However, when the program genre code is acquired, the amount of delay is determined, the playback start location is determined, and the elapsed time is required to determine the playback start location. In step S307, playback is performed. The elapsed time is described in the subtitle information table 301 in the start location column instead of the playback start location.

  On the other hand, if it is determined in step S306 that the current time has not passed the end time, the process proceeds to step S308. In step S308, a delay time determination process is executed. In step S308, processing for determining a delay time is executed from the temporarily stored program genre code. The delay time determination process in step S308 is performed based on the flowchart of FIG. That is, as in the second embodiment, the delay estimation value table storage unit 217 of the recording apparatus 201 (FIG. 20) stores a delay estimation value table 151 as shown in FIG. Reference numeral 213 refers to the estimated delay value table 151 stored in the estimated delay value table storage unit 217, and executes the processing of the flowchart shown in FIG.

  Since the processing of the flowchart shown in FIG. 17 and the estimated delay value table 151 shown in FIG. 19 have already been described, description thereof will be omitted.

  When the delay time (delay amount) is determined in step S308 (FIG. 27), the reproduction start location is determined in step S309. The determination of the reproduction start location is performed in the same manner as the processing performed in step S135 in FIG. That is, the playback start location is determined by subtracting the delay amount from the elapsed time.

  In step S310, the line number and the reproduction start location are associated with each other and written in the caption information table 301. The processing in step S310 is basically the same as the processing in step S58 in the flowchart of FIG. 11, except that the playback start location is written instead of the elapsed time and the program genre code.

  For example, when the elapsed time of the line number 33 is “00:14:40” and the delay amount is determined to be “−8”, the reproduction start location is determined to be “00:14:32”, and this value Is described in the caption information table 301 (FIG. 26).

  In this way, the reproduction start location is written in the table created on the recording side. As described above, when the playback start location is written in the caption information table 301, the process of acquiring information such as the program genre code, that is, the information acquisition process executed in step S39 (FIG. 10) is also started. The location is determined on the recording apparatus side. Here, the information acquisition process (information acquisition process 3) performed in step S39 will be described with reference to the flowchart of FIG.

  The processing in steps S321 through S324 is the same as the processing in steps S71 through S74 in FIG. However, in step S324, it is determined whether or not there is a column in which the elapsed time is written at the reproduction start location of the caption information table 301.

  If it is determined in step S324 that there is a column in which the elapsed time is written at the reproduction start location of the caption information table 301, the process proceeds to step S325. In step S325, a delay time determination process is executed. Since this delay time execution process is performed in the same manner as the process of step S308 in the flowchart of FIG. 27, the description thereof is omitted.

  In step S325, the obtained delay amount and the elapsed time described in the caption information table 301 instead of the reproduction start location are used to determine the reproduction start location. In step S327, the determined reproduction start location is described in the column where the elapsed time is described.

  The processing in steps S327 through S329 is the same as the processing in steps S76 through S78 in FIG.

  In this way, on the recording device 201 side, the caption information table 301 in which the reproduction start location is described is created and stored. Next, playback processing of the playback device 251 performed using the caption information table 301 will be described.

[Processing of the playback apparatus according to the third embodiment]
Next, processing related to playback performed by the playback device 251 will be described. Since the playback device 251 performs processing based on the flowchart of FIG. 15 already described, detailed description thereof is omitted. The playback device 251 is different from the playback device 53 in the first embodiment or the recording device 201 in the second embodiment in the video playback start processing performed in step S120. This will be described below.

  FIG. 29 is a flowchart for explaining processing 2 for starting video reproduction.

  The processes in steps S351 and S353 are basically the same as the processes in steps S131 and S136 in the flowchart shown in FIG. That is, the playback device 251 according to the third embodiment performs the delay time determination processing that the playback device 53 according to the first embodiment has executed in the process of step S134 and processing related to determination of the playback start location. Absent.

  In step S352, the playback device 251 according to the third embodiment reads a playback start location corresponding to the recognized line number 33 from the caption information table 301. In this case, the reproduction start location is described in the caption information table 301. Since such a caption information table 301 is supplied from the recording device 201, the caption information table 301 can be referred to by referring to the supplied caption information table 301. The playback start location can be read out.

  In this way, the subtitle information table 301 in which the playback start location is described is created by the recording device 201, and playback is performed using the subtitle information table 301 by the playback device 251. Similarly to the second embodiment, it is possible to reproduce subtitles corresponding to video and audio without deviation from the video and audio.

[System according to the fourth embodiment]
In the first to third embodiments, it has been described that the recording device and the playback device are different from each other. In other words, a mode has been described in which a caption information table is created on the recording device side and a caption information table is used on the playback device side. As a fourth embodiment, a recording / reproducing apparatus that performs recording and reproduction in the same apparatus, and an apparatus that creates and uses a caption information table will be described.

  FIG. 30 is a diagram showing a configuration of an embodiment of the recording / reproducing apparatus 401. 30 includes a reception control unit 411, a recording control unit 412, a data recording unit 413, a video / audio reproduction control unit 414, a table creation unit 415, a table storage unit 416, a subtitle reproduction control unit 417, and a display. A control unit 418, an operation unit 419, and a delay estimation value table storage unit 420 are included.

  In the recording / reproducing device 401 shown in FIG. 30, the reception control unit 411, the recording control unit 412, the data recording unit 413, the table creation unit 415, and the table storage unit 416 are respectively configured to receive control of the recording device 52 shown in FIG. The configuration is basically the same as that of the unit 71, the recording control unit 72, the data recording unit 74, the table creation unit 73, and the table storage unit 75, and the same processing is performed.

  Further, in the recording / playback apparatus 401 shown in FIG. 30, the video / audio playback control unit 414, the caption playback control unit 417, the display control unit 418, the operation unit 419, and the delay estimated value table storage unit 419 are respectively shown in FIG. The audio / video reproduction control unit 92, the subtitle reproduction control unit 93, the display control unit 95, the operation unit 96, and the delay estimation value table storage unit 94 of the reproduction apparatus 53 shown in FIG. Process.

  In the recording / reproducing apparatus 401 shown in FIG. 30, any of the first to third embodiments can be applied. Depending on the applied form of the first to third embodiments, a caption information table created by the table creation unit 415 and stored in the table storage unit 416 is determined, and the delay estimated value table storage unit 420 A stored delay estimate table is determined.

  The operation of the recording / reproducing apparatus 401 shown in FIG. 30 can be performed basically in the same manner as the operation of the application mode of the first to third embodiments already described. Omitted.

  In any of the first to fourth embodiments, when a program including video, audio, and subtitles is provided, the program can be recorded and only the subtitles can be reproduced. Further, when a desired subtitle is selected while only the subtitle is being reproduced, reproduction of video and audio corresponding to the subtitle can be started. In addition, when video and audio corresponding to subtitles are played back, even when the program is recorded, even if it is a program in which the subtitles corresponding to video and audio deviate from the video and audio, it is played back without deviation during playback. It becomes possible to be made.

  In the above-described embodiment, it has been described that when a predetermined subtitle is selected, video and audio corresponding to the selected subtitle are reproduced. However, only one of video and audio is reproduced. You may make it. In the above-described embodiment, the digital television broadcast has been described as an example. However, the present invention can be applied to other broadcasts such as radio broadcasts. Further, the broadcast form may be a form via the Internet or the like.

  For example, in radio broadcasting, when audio and subtitles are provided, the audio and subtitles are recorded separately, the above-described subtitle information table is created, and the audio is referred while referring to the subtitle information table during playback. The present invention can also be applied to the case where the subtitles corresponding to the audio are reproduced without deviation.

[About recording media]
The series of processes described above can be executed by hardware or can be executed by software. When a series of processing is executed by software, the programs that make up the software execute various functions by installing a computer built into dedicated hardware or various programs. For example, it is installed from a program recording medium in a general-purpose personal computer or the like.

  FIG. 31 is a block diagram illustrating an example of a hardware configuration of a personal computer that executes the above-described series of processing by a program.

  In a computer, a CPU (Central Processing Unit) 501, a ROM (Read Only Memory) 502, and a RAM (Random Access Memory) 503 are connected to each other by a bus 504.

  An input / output interface 505 is further connected to the bus 504. The input / output interface 505 includes an input unit 506 made up of a keyboard, mouse, microphone, etc., an output unit 507 made up of a display, a speaker, etc., a recording unit 508 made up of a hard disk or nonvolatile memory, and a communication unit 509 made up of a network interface. A drive 510 for driving a removable medium 511 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is connected.

  As the CPU 501, a cell described in “Birth of Cell”, Nikkei Electronics, Nikkei BP, February 28, 2005, pages 89 to 117 can be employed.

  In the computer configured as described above, the CPU 501 loads the program recorded in the recording unit 508 to the RAM 503 via the input / output interface 505 and the bus 504 and executes the program, for example. Is performed.

  The program executed by the computer (CPU 501) is, for example, a magnetic disk (including a flexible disk), an optical disk (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.), a magneto-optical disk, or a semiconductor. The program is recorded on a removable medium 511 that is a package medium including a memory or the like, or provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

  The program can be installed in the recording unit 508 via the input / output interface 505 by attaching the removable medium 511 to the drive 510. Further, the program can be received by the communication unit 509 via a wired or wireless transmission medium and installed in the recording unit 508. In addition, the program can be installed in the ROM 502 or the recording unit 508 in advance.

  The program executed by the computer may be a program that is processed in time series in the order described in this specification, or in parallel or at a necessary timing such as when a call is made. It may be a program for processing.

  Further, in this specification, the system represents the entire apparatus constituted by a plurality of apparatuses.

  The embodiment of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present invention.

It is a figure which shows the structure of an example of the conventional recording / reproducing apparatus. It is a flowchart explaining the process at the time of the recording of the conventional recording / reproducing apparatus. It is a figure which shows the structure of one Embodiment of the system to which this invention is applied. It is a figure which shows the structure of one Embodiment of a recording device. It is a figure which shows the structure of one Embodiment of a reproducing | regenerating apparatus. It is a figure for demonstrating a caption. It is a figure for demonstrating a caption. It is a figure for demonstrating a caption. It is a figure for demonstrating a caption. It is a flowchart for demonstrating a recording process. It is a flowchart for demonstrating a caption information table creation process. It is a flowchart for demonstrating an information acquisition process. It is a figure for demonstrating a caption information table. It is a figure for demonstrating the recorded data. It is a flowchart for demonstrating reproduction | regeneration processing. It is a flowchart for demonstrating the process of a video reproduction start. It is a flowchart for demonstrating a delay time determination process. It is a figure for demonstrating the delay of a caption. It is a figure for demonstrating a delay estimated value table. It is a figure which shows the structural example of one Embodiment of a recording device. It is a figure for demonstrating another caption information table. It is a figure which shows the structure of one Embodiment of a reproducing | regenerating apparatus. It is a flowchart for demonstrating another subtitle information table creation process. It is a flowchart for demonstrating another information acquisition process. It is a flowchart for demonstrating the process of another video reproduction | regeneration start. It is a figure for demonstrating another caption information table. It is a flowchart for demonstrating another subtitle information table creation process. It is a flowchart for demonstrating another information acquisition process. It is a flowchart for demonstrating the process of another video reproduction | regeneration start. It is a figure which shows the structure of one Embodiment of a recording / reproducing apparatus. It is a figure for demonstrating a recording medium.

Explanation of symbols

  52 recording device, 53 playback device, 71 reception control unit, 72 recording control unit, 73 table creation unit, 74 data recording unit, 75 table storage unit, 76 data output unit, 91 input control unit, 92 video / audio reproduction control unit, 93 subtitle playback control unit, 94 delay estimation value table storage unit, 95 display control unit, 96 operation unit, 101 subtitle information table, 121 stream file, 122 subtitle data file, 151 delay estimation value table, 201 recording device, 211 reception control Unit, 212 recording control unit, 213 table creation unit, 214 data recording unit, 215 table storage unit, 216 data output unit, 217 delay estimation value table storage unit, 231 subtitle information table, 251 playback device, 261 input control unit, 262Video / audio playback control unit, 263 subtitle playback control unit, 264 operation unit, 265 display control unit, 311 subtitle information table, 401 recording / playback device, 411 reception control unit, 412 recording control unit, 413 data recording unit, 414 video / audio playback Control unit, 415 table creation unit, 416 table storage unit, 417 subtitle playback control unit, 418 display control unit, 419 operation unit, 420 delay estimation value table storage unit

Claims (14)

Obtaining means for obtaining a transport packet of a program to be recorded;
Extraction means for extracting subtitle data from the transport packet acquired by the acquisition means;
An elapsed time storage unit that temporarily stores an elapsed time from the time when the acquisition of the transport packet by the acquisition unit is started to the time when the caption data is extracted by the extraction unit;
A program genre code storage means for temporarily storing a program genre code indicating a genre to which the program belongs, included in the transport packet;
Subtitle information table creating means for creating a subtitle information table to be referred to when reproducing the subtitle data together with the video data included in the transport stream from the subtitle data, the elapsed time, and the program genre code; A recording apparatus comprising: A delay amount table storage means for storing a delay amount table in which the program genre code and the delay amount of the caption data with respect to the video data are associated;
The subtitle information table creation unit reads out a delay amount associated with the program genre code stored in the program genre code storage unit with reference to the delay amount table, and writes the delay amount in the subtitle information table. Item 2. The recording device according to Item 1. In the delay amount table, the program genre code and priority are further associated with each other, and
Whether or not the program genre code stored in the program genre code storage means matches the program genre code described in the delay amount table is determined in the order of priority, and the delay amount is read out. The recording apparatus according to claim 2. A delay amount table storage means for storing a delay amount table in which the program genre code and the delay amount of the caption data with respect to the video data are associated;
The subtitle information table creating means reads a delay amount associated with the program genre code stored in the program genre code storage means with reference to the delay amount table, and calculates the delay amount from the elapsed time. The recording apparatus according to claim 1, wherein the value is subtracted and the value is written in the caption information table. In the delay amount table, the program genre code and priority are further associated with each other, and
Whether or not the program genre code stored in the program genre code storage means matches the program genre code described in the delay amount table is determined in the order of priority, and the delay amount is read out. The recording apparatus according to claim 4. An acquisition step of acquiring a transport packet of a program to be recorded;
An extraction step of extracting caption data from the transport packet acquired in the processing of the acquisition step;
An elapsed time storage step for temporarily storing the elapsed time from the time when the acquisition of the transport packet was started in the process of the acquisition step to the time when the caption data was extracted in the process of the extraction step;
A program genre code storage step for temporarily storing a program genre code included in the transport packet and indicating a genre to which the program belongs;
A subtitle information table creating step for creating a subtitle information table to be referred to when reproducing the subtitle data together with the video data included in the transport stream from the subtitle data, the elapsed time, and the program genre code; Recording method. An acquisition step of acquiring a transport packet of a program to be recorded;
An extraction step of extracting caption data from the transport packet acquired in the processing of the acquisition step;
An elapsed time storage step for temporarily storing the elapsed time from the time when the acquisition of the transport packet was started in the process of the acquisition step to the time when the caption data was extracted in the process of the extraction step;
A program genre code storage step for temporarily storing a program genre code included in the transport packet and indicating a genre to which the program belongs;
A subtitle information table creating step for creating a subtitle information table to be referred to when reproducing the subtitle data together with the video data included in the transport stream from the subtitle data, the elapsed time, and the program genre code; A program that causes a computer to execute processing including Acquisition means for acquiring subtitle data, video data provided to the user together with the subtitle data, and a subtitle information table referred to when the subtitle data and the video data are reproduced together;
Subtitle data reproduction control means for controlling reproduction of the subtitle data;
When a predetermined subtitle is selected from the subtitles whose reproduction is controlled by the subtitle data reproduction control means, refer to the subtitle information table for a reproduction start location where the reproduction of video data corresponding to the predetermined subtitle is started. A determination means to determine
And a video data reproduction control unit that controls the video data to be reproduced from the reproduction start position determined by the determination unit. A delay amount table storing means for storing a program genre code representing a genre of the program that provided the subtitle data and a delay amount table in which a delay amount of the subtitle data with respect to the video data is associated;
In the caption information table, the elapsed time elapsed from the time when acquisition of the data of the program was started to the time when the caption data was extracted, and the program genre code are described in association with each other,
The determining means reads a delay amount associated with the program genre code described in the caption information table from the delay amount table, and sets a value obtained by subtracting the delay amount from the elapsed time as the reproduction start location. The playback apparatus according to claim 8. In the delay amount table, the program genre code and priority are associated and described,
The delay amount is read by determining whether or not the program genre code stored in the caption information table matches the program genre code described in the delay amount table in order of priority. 9. The recording apparatus according to 9. In the caption information table, the elapsed time elapsed from the time when acquisition of the data of the program that provided the caption data was started to the time when the caption data was extracted, and the caption data for the video data At least the amount of delay
The playback apparatus according to claim 8, wherein the determination unit reads the delay amount described in the caption information table and determines a value obtained by subtracting the delay amount from the elapsed time as the playback start location. In the caption information table, at least the playback start location is described,
The playback apparatus according to claim 8, wherein the determination unit determines the playback start location by reading the playback start location from the caption information table. Obtaining subtitle data, video data provided to the user together with the subtitle data, and a subtitle information table referred to when the subtitle data and the video data are reproduced together;
Subtitle data reproduction control step for controlling reproduction of the subtitle data;
When a predetermined subtitle is selected from the subtitles whose reproduction is controlled in the processing of the subtitle data reproduction control step, a reproduction start location for starting reproduction of video data corresponding to the predetermined subtitle is indicated in the subtitle information table. A decision step to determine by reference;
And a video data playback control step for controlling the video data to be played back from the playback start location determined in the processing of the determination step. Obtaining subtitle data, video data provided to the user together with the subtitle data, and a subtitle information table referred to when the subtitle data and the video data are reproduced together;
Subtitle data reproduction control step for controlling reproduction of the subtitle data;
When a predetermined subtitle is selected from the subtitles whose reproduction is controlled in the processing of the subtitle data reproduction control step, a reproduction start location for starting reproduction of video data corresponding to the predetermined subtitle is indicated in the subtitle information table. A decision step to determine by reference;
And a video data reproduction control step for controlling the video data to be reproduced from the reproduction start position determined in the determination step.

Images