JP2006279290A - Program recording apparatus, program recording method, and program recording program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology capable of particularizing a proper position as a reproduction start position corresponding to an interval of keywords appearing as caption data in the case that a chapter is provided to writing data by particularizing a time when the keyword appears from the caption data. <P>SOLUTION: A program recording apparatus is configured to include: a decoder for extracting caption data and video audio data from a caption data attached television signal in response to the caption data attached television signal supplied from a receiver for receiving caption broadcast; and a writing data generating apparatus for generating a chapter attached video audio recording medium on the basis of the caption data and the video audio data. Then the writing data generating apparatus is configured to include: a caption data analysis section for particularizing a chapter object time to generate an initial chapter information table; a chapter information table correction display section; and a writing image generating section for generating the chapter attached video audio recording medium. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a group recording apparatus, a program recording method, and a program recording program, and more particularly, to a group recording apparatus, a program recording method, and a program recording program for receiving a caption broadcast and adding a chapter when recording the caption broadcast. About.

  2. Description of the Related Art Program recorders capable of recording a predetermined program received by a broadcast receiving apparatus as digital data, such as a DVD recorder or an HDD recorder, have become widespread.

  In general, a conventional program recording apparatus records information on a program to be recorded (for example, a program name and recording time input by a user, hereinafter referred to as program information) on a recording medium, and at the time of reproduction. In addition, a function for allowing a user to recognize a recorded program by referring to the program information is installed. In addition, there is a program that can use the program information to cue (play a program selected by the user from the beginning). When playback is performed from a portion other than the beginning of the recorded program, it is necessary for the user to execute fast forward or rewind while referring to the video displayed on the screen.

  As a technique for reproducing a video from a location desired by a user without referring to a screen, a predetermined character string (hereinafter referred to as a keyword) is input, and a program recorded on the recording medium from the input character string. A technique for identifying the reproduction start location is known (for example, see Patent Document 1).

  In the technique described in Patent Document 1 (Japanese Patent Laid-Open No. 2000-287156), an MPEG2 encoding unit compresses and encodes AV data included in a television signal input from a tuner using the MPEG2 method, and outputs it to a recording unit is doing. The VBI data extraction unit extracts additional information included in the VBI of the television signal and outputs it to the recording unit. The recording unit 5 records the hard disk 7 in association with the MPG file and the VBI file. The search / playback unit searches the contents of the VBI file using the character string input by the user as a keyword, reads the MPG file corresponding to the matching line, etc., decodes it from the position of the line, and outputs it to the monitor .

  In addition, with the advancement of technology for broadcasting programs, so-called subtitle broadcast programs that transmit subtitle data corresponding to video / audio data for broadcasting are also increasing. A technique for recording caption broadcasts with a program recording device is known (see, for example, Patent Document 2).

  The technique described in Patent Document 2 (Japanese Patent Application Laid-Open No. 2004-289181) converts the content of character information extracted from a television broadcast wave into sub-picture data defined by the DVD video format. Sub-picture data is recorded on a DVD together with video and audio data.

  Further, as a technique for reproducing a recorded subtitle broadcast from an arbitrary position, for example, a technique described in Patent Document 3 (Japanese Patent Application Laid-Open No. 2004-080476) is known.

  In the technique described in Patent Document 3, when a program recording command is received from a user, a partial TS that constitutes the program output from the demultiplexer is written to the internal hard disk drive, and subtitle character data and its presentation time information Are created and linked with recorded programs and stored. When a video search command using subtitle characters is received, the character input screen is OSD displayed and character input is accepted. A subtitle character that matches or is similar to the input character is searched from the table, and a video at the presentation time of the subtitle character is reproduced.

  When subtitle broadcasts are recorded on a storage medium (for example, a DVD disc) with such a program recording apparatus, a delimiter for each chapter (hereinafter referred to as a chapter) for reproducing a video from a desired scene is given. There is.

  When applying the technique described in the above-mentioned patent document and specifying the part to which the chapter is added, if the keyword appears continuously in a short time in the program, the part to which the chapter is added is also continuously specified. . For this reason, it may be difficult to specify the optimum playback start location. Furthermore, when a keyword appears multiple times, the part to which a chapter is added is specified each time the keyword appears. If there is an upper limit on the number of chapters that can be assigned, the upper limit may be reached in the middle of the program, making it impossible to specify a desired playback start location.

  In the case of assigning chapters by specifying the time at which a keyword appears from subtitle data, there is a need for a technology that can identify an appropriate location as a playback start location even when the keyword appears continuously in a short time. ing. Furthermore, when there is an upper limit to the number of chapters that can be assigned, there is a demand for a technique that can assign chapters corresponding to the upper limit value.

  In addition, subtitle broadcast (hereinafter referred to as real-time subtitle broadcast) that converts audio in a program into subtitle characters in real time using a subtitle character converter provided in the broadcast station and broadcasts in accordance with the video is also realized. Yes. In real-time subtitle broadcasting, there is a time difference between the time when audio is output and the time when subtitles corresponding to the audio are displayed. Therefore, when a chapter is assigned using subtitle data of real-time subtitle broadcasting, desired audio may not be output from the reproduction start location specified by the chapter.

  There is a demand for a technique capable of appropriately assigning chapters even when normal subtitle broadcasting and real-time subtitle broadcasting are mixed and recorded.

JP 2000-287156 A JP 2004-289181 A JP 2004-080476 A

  The problem to be solved by the present invention is that when specifying a time at which a keyword appears from subtitle data and assigning a chapter to the data for writing, as a playback start location corresponding to an interval at which the keyword appears as a subtitle The object is to provide a technique capable of specifying an appropriate location.

  Furthermore, another problem to be solved by the present invention is a technique that can assign chapters corresponding to the upper limit value when there is an upper limit on the number of chapters that can be assigned to the write data. It is to provide.

  Furthermore, another problem to be solved by the present invention is to provide a technique capable of appropriately assigning chapters even when recording is performed by mixing normal subtitle broadcasting and real-time subtitle broadcasting.

  The means for solving the problem will be described below using the numbers used in [Best Mode for Carrying Out the Invention]. These numbers are added to clarify the correspondence between the description of [Claims] and [Best Mode for Carrying Out the Invention]. However, these numbers should not be used to interpret the technical scope of the invention described in [Claims].

In order to solve the above problems, a program recording apparatus described below is configured. The program recording device responds to the television signal with caption data (30) supplied from the receiving device (2) that receives the caption broadcast, and the caption data (31) from the television signal with caption data (30). And a decoder device (4) for extracting the video and audio data (32), and a writing image (39 with a chapter delimiter for cueing) based on the caption data (31) and the video and audio data (32). ) For generating data for writing (1). Here, the video / audio data (32) includes the video and audio of the subtitle broadcast.
Then, the writing data generation device (1) specifies a time at which a preset keyword is displayed as a caption as a chapter candidate time, and associates the keyword with the chapter candidate time to an initial chapter information table ( 33) The caption information table correction for generating the chapter information table (35) by correcting the chapter candidate time based on the subtitle data (31) analysis unit (12) and the initial chapter information table (33). And a writing image generating unit (14) for generating the chaptered video / audio recording medium (39).

The caption data (31) analysis unit (12) determines a time when the keyword newly appears when the keyword associated with the chapter candidate time appears again as a caption without exceeding a predetermined time. It is prohibited to specify the candidate time.
Further, the chapter information table correction unit (13) specifies a chapter setting time based on a time difference between the chapter candidate time and a time at which a sound corresponding to the keyword is output, and the chapter setting time, the keyword, Are associated with each other to generate the chapter information table (35).
Then, the writing image generation unit (14) attaches the chapter information to the writing video / audio data (34) based on the chapter setting time shown in the chapter information table (35), thereby adding the chapter. A video / audio recording medium (39) is generated.
By configuring the program recording apparatus as described above, it is possible to generate chapters using the subtitle data (31), and the audio output when the program is cued using the chapters. Deviation from data can be suppressed.

  In the program recording apparatus, the caption data (31) analysis unit (12) generates a record in which the keyword and the chapter candidate time are associated with each other, and configures the initial chapter information table (33). At this time, when the keyword associated with the chapter candidate time appears again as a caption after a predetermined time, the time at which the keyword newly appears is specified as a new chapter candidate time. Further, a new record is generated by associating a keyword appearance interval, which is a time difference between the chapter candidate time and the new chapter candidate time, the new chapter candidate time, and the keyword. In addition, when the total number of records exceeds a predetermined number, records with a short appearance interval are deleted, and new records are added to the initial chapter information table (33).

  In the program recording apparatus, it is preferable that the chapter information correction unit includes a voice recognition unit. The voice recognition unit executes voice recognition of the voice data included in the video / audio data for writing (34), and specifies the time when the keyword is output as voice as the keyword voice output time. The chapter information correcting unit corrects the chapter candidate time based on a time difference between the keyword voice output time and the chapter candidate time, and specifies the chapter setting time.

  In the program recording apparatus, it is preferable that the voice recognition unit functions to execute voice recognition in a predetermined time range using the chapter candidate time as a reference time. When the voice corresponding to the keyword is recognized by the voice recognition performed in the time range, the recognized time is specified as the keyword voice output time. Further, the chapter information correction unit, based on the time difference between the start time of the keyword speech recognition and the chapter candidate time when the speech corresponding to the keyword is not recognized by the speech recognition performed in the time range. The chapter setting time is specified by correcting the chapter candidate time.

  In the program recording apparatus, the voice recognition unit specifies a voice recognition start time for starting voice recognition based on a predetermined recognition time, and performs voice recognition within a predetermined time range from the specified voice recognition start time. It may be configured to have a function for executing. At that time, the chapter information table correction unit (13) corrects the chapter candidate time based on the correction time determined in advance based on the keyword voice output time obtained by the voice recognition, and sets the chapter setting time. Identify.

  The program recording apparatus preferably further includes an image processing unit that processes the video / audio data (32) to generate the video / audio data for writing (34). Here, the image processing unit generates program type information indicating whether the subtitle broadcast corresponding to the video / audio data (32) is a live broadcast program or a recorded broadcast program, and the program type information and the video / audio are displayed. The video / audio data for writing (34) is generated in association with the data (32). Then, the chapter information table correcting unit (13) corrects the chapter candidate time based on the program type information included in the video / audio data for writing (34) to specify the chapter setting time.

Moreover, it becomes possible to solve the said subject by performing program recording by the following methods. The method is a chain of the following actions, and the video / audio data (32) described therein includes video data and audio data of subtitle broadcasting.
To solve the above problem,
[A] In response to the television signal with caption data (30), extracting caption data (31) and video / audio data (32) from the television signal with caption data (30);
[B] identifying a time at which a preset keyword is displayed as a caption as a chapter candidate time, and associating the keyword with the chapter candidate time to generate an initial chapter information table (33);
[C] When the keyword associated with the chapter candidate time appears again as a caption without exceeding a predetermined time, it is prohibited to specify the time when the keyword newly appears as the chapter candidate time. When,
[D] A chapter setting time is specified based on a time difference between the chapter candidate time and a time at which sound corresponding to the keyword is output, and the chapter setting time and the keyword are associated with each other to determine the chapter information table (35). A step of generating
[E] Assigning the chapter information to the video / audio data for writing (34) based on the chapter setting time indicated in the caption data (31), the video / audio data (32), and the chapter information table (35). Then, the program recording method comprising the step of generating the chaptered video / audio recording medium (39) is executed.

In the program recording method, the step [b] preferably includes the following steps. The multiple steps are
Generating a record associating the keyword with the chapter candidate time to configure the initial chapter information table (33);
When the keyword associated with the chapter candidate time appears again as a caption after a predetermined time, the step of specifying the time when the keyword newly appears as a new chapter candidate time; and the chapter candidate time Generating a new record by associating a keyword appearance interval that is a time difference with the new chapter candidate time, the new chapter candidate time, and the keyword;
When the total number of records exceeds a predetermined number, the record with a short appearance interval is deleted and a new record is added to the initial chapter information table (33).

In the program recording apparatus, the [d] step preferably includes a plurality of steps. The multiple steps are
Executing voice recognition of voice data included in the video / audio data for writing (34) and specifying a time when the keyword is output as voice as a keyword voice output time;
The step of correcting the chapter candidate time based on a time difference between the keyword voice output time and the chapter candidate time.

In the program recording method, the step [d] may further include the following steps. Here, the multiple steps are:
Performing speech recognition in a predetermined time range with the chapter candidate time as a reference time;
When the voice corresponding to the keyword is recognized by the voice recognition performed in the time range, the recognized time is specified as the keyword voice output time;
When the speech corresponding to the keyword is not recognized by speech recognition performed in the time range, the chapter candidate time is corrected based on the time difference between the speech recognition start time of the keyword and the chapter candidate time. It is a step.

In the program recording method, the step [d] may further include the following steps. Here, the multiple steps are:
Specifying a voice recognition start time for starting voice recognition based on a predetermined recognition time, and executing voice recognition within a predetermined time range from the specified voice recognition start time;
This is a step of correcting the chapter candidate time based on a predetermined correction time for the keyword voice output time obtained by the voice recognition.

In the program recording method, the following steps are executed in addition to the steps [a] to [e] described above.
To solve the above problem,
[F] Program type information indicating whether the caption broadcast corresponding to the video / audio data (32) is a live broadcast program or a recorded broadcast program is generated, and the program type information and the video / audio data (32) are generated. Generating the video / audio data for writing (34) in association with each other;
[G] A program recording method including a step of correcting the chapter candidate time based on the program type information included in the video / audio data for writing (34) is executed.

Moreover, it is possible to solve the above problems by assembling the computer program shown below. The program responds to the television signal with caption data (30) supplied from the receiving means for receiving caption broadcast by the computer, and the caption data (31) and video / audio data from the television signal with caption data (30). (32) decoder function, and writing video / audio data generating means for generating a chaptered video / audio recording medium (39) based on the caption data (31) and the video / audio data (32). It is a program to let you. More specifically, the program is stored in the writing video / audio data generating means.
[A] receiving the caption data (31) and the video / audio data (32) supplied from the decoder means; and the video / audio data (32) includes video data and audio data of the caption broadcast. ,
[B] identifying a time at which a preset keyword is displayed as a caption as a chapter candidate time, and associating the keyword with the chapter candidate time to generate an initial chapter information table (33);
[C] When the keyword associated with the chapter candidate time appears again as a caption without exceeding a predetermined time, it is prohibited to specify the time when the keyword newly appears as the chapter candidate time. When,
[D] A chapter setting time is specified based on a time difference between the chapter candidate time and a time at which sound corresponding to the keyword is output, and the chapter setting time and the keyword are associated with each other to determine the chapter information table (35). Generating
[E] Assigning the chapter information to the video / audio data for writing (34) based on the chapter setting time indicated in the caption data (31), the video / audio data (32), and the chapter information table (35). A program recording program for executing a method comprising the step of generating data (39) to be written to the chaptered video / audio recording medium.

In the program recording program, the [b] step includes:
Generating a record associating the keyword with the chapter candidate time to configure the initial chapter information table (33);
When the keyword associated with the chapter candidate time appears again as a caption after a predetermined time, the step of specifying the time when the keyword newly appears as a new chapter candidate time; and the chapter candidate time Generating a new record by associating a keyword appearance interval that is a time difference with the new chapter candidate time, the new chapter candidate time, and the keyword;
When the total number of records exceeds a predetermined number, a step of deleting a record with a short appearance interval and adding a new record to the initial chapter information table (33) may be provided.

In the program recording program, the step [d] includes
Executing voice recognition of voice data included in the video / audio data for writing (34) and specifying a time when the keyword is output as voice as a keyword voice output time;
A step of correcting the chapter candidate time based on a time difference between the keyword voice output time and the chapter candidate time may be provided.

In the program recording program, the step [d] further includes:
Performing speech recognition in a predetermined time range with the chapter candidate time as a reference time;
When the voice corresponding to the keyword is recognized by the voice recognition performed in the time range, the recognized time is specified as the keyword voice output time;
When the speech corresponding to the keyword is not recognized by speech recognition performed in the time range, the chapter candidate time is corrected based on the time difference between the speech recognition start time of the keyword and the chapter candidate time. It may comprise a step.

In the program recording program, the [d] step further includes:
Specifying a voice recognition start time for starting voice recognition based on a predetermined recognition time, and executing voice recognition within a predetermined time range from the specified voice recognition start time;
The keyword speech output time obtained by the speech recognition may be corrected based on a predetermined correction time to correct the chapter candidate time.

In the program recording program, it is preferable that the program further causes the computer to function as image processing means for processing the video / audio data (32) to generate the video / audio data for writing (34). Then, the program is further stored in the writing video / audio data generating means.
[F] Program type information indicating whether the caption broadcast corresponding to the video / audio data (32) is a live broadcast program or a recorded broadcast program is generated, and the program type information and the video / audio data (32) are generated. Generating the video / audio data for writing (34) in association with each other;
[G] It is preferable that the program recording program execute a method including a step of correcting the chapter candidate time based on the program type information included in the video / audio data for writing (34).

  According to the present invention, when assigning chapters by specifying the time at which a keyword appears from subtitle data, even when the keyword appears continuously in a short time, it is possible to specify an appropriate location as a playback start location. it can.

  Furthermore, according to the present invention, when there is an upper limit to the number of chapters that can be assigned, chapters can be assigned corresponding to the upper limit value.

  Furthermore, according to the present invention, even when normal subtitle broadcasting and real-time subtitle broadcasting are mixed and recorded, chapters can be appropriately assigned.

  Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings. In the following description, the case where the program recording system in the present embodiment is a system that records received subtitle broadcasts on a DVD disc will be described as an example.

  FIG. 1 is a block diagram illustrating a configuration according to an embodiment of the present invention. Referring to FIG. 1, the digital recording system according to the present embodiment includes a DVD data generating device 1, a broadcast receiving device 2, an antenna 3, a caption broadcast decoder 4, an input device 5, a display device 6, and a DVD. The data writing device 7 is included. The DVD data generation device 1 is an information processing device that generates recording data in the program recording system of the present embodiment. In the following embodiments, the case where the DVD data generation device 1 is a personal computer will be exemplified, and description will be made in correspondence with the case where the present invention is realized using an information processing function normally provided in the personal computer. In the following embodiments, a case where a DVD disk is used as a recording medium for recording a received program will be described as an example.

  As shown in FIG. 1, the DVD data generation device 1 includes a transmission / reception unit 8, an arithmetic processing unit 9, a main storage unit 10, a plurality of information processing units (11 to 14), and a mass storage device. 15. In the present embodiment, the DVD data generation unit 14 includes a plurality of information processing function blocks (17 to 20). The mass storage device 15 includes a plurality of information storage units (21 to 26). As shown in FIG. 1, the functional blocks (8 to 15) provided in the DVD data generation device 1 are connected to each other via a bus 16. The details of each functional block constituting the DVD data generation device 1 will be described later.

  The broadcast receiving device 2 is a device having a function of receiving a caption broadcast and displaying the received broadcast on a predetermined display device. Referring to FIG. 1, a configuration in which the broadcast receiving device 2 receives a caption broadcast via an antenna 3 is illustrated. The broadcast receiving device 2 supplies the received caption broadcast 52 to the MPEG2 encoding unit 11. The MPEG2 encoding unit 11 specifies video / audio data from the caption broadcast and performs MPEG2 encoding.

  The caption broadcast decoder 4 is an apparatus that extracts caption data from the caption broadcast received by the broadcast receiving apparatus 2.

  The input device 5 is a device having a function such as a keyboard and a mouse that can input data to the main device. The display device 6 is a display device that displays information on a screen, such as a CRT display or a liquid crystal display device. The DVD data writing device 7 is a DVD drive capable of writing the writing DVD data supplied from the DVD data generating device 1 to a DVD disc.

  Below, each block which comprises the DVD data generation apparatus 1 is demonstrated. The transmission / reception unit 8 of the DVD data generation device 1 is a communication interface that converts data supplied from the outside of the DVD data generation device 1 into a format that allows information processing inside the DVD data generation device 1. The transmission / reception unit 8 in the present embodiment receives data related to the caption broadcast output from the caption broadcast decoder 4, converts the format of the data, and supplies the data to a predetermined functional block via the bus 16. Further, the transmission / reception unit 8 of the present embodiment may be configured to be connected to the input device 5 and the display device 6 so as to be able to transmit / receive to / from each device.

  The arithmetic processing unit 9 is a processing unit that controls various devices provided in the DVD data generation device 1 and processes data. In the present embodiment, the arithmetic processing unit 9 will be described corresponding to a case where it is a CPU (Central Processing Unit) provided in the DVD data generation device 1.

The main storage unit 10 is a storage medium that electrically stores data. The main storage unit 10 is used as a main memory when the arithmetic processing unit 9 executes software. In the present embodiment, the main storage unit 10
Will be described on the assumption that the data is a RAM (Random Access Memory) provided in the DVD data generation apparatus 1. Note that the main memory unit 10 in the present embodiment is not limited to a specific semiconductor memory device.

  The MPEG2 encoding unit 11 is a compressed image generating functional block that generates MPEG2 data corresponding to the MPEG2 standard in response to caption broadcasting (video / audio data) supplied from the legal transmission / reception device 2.

  The caption data analysis unit 12 is an information processing function block that analyzes the caption data in response to the caption data supplied from the caption broadcast decoder 4, and analyzes the received caption data as needed, Specify when matching subtitles are displayed. Details of the operation of the caption data analysis unit 12 will be described later.

  The chapter information table correction unit 13 is an information processing function block that performs correction for generating an optimum chapter when a chapter (chapter) is added to the writing DVD data based on the caption data.

  The DVD data generation unit 14 is an information processing function block that generates writing DVD data based on various data supplied from the MPEG2 encoding unit 11, the caption data analysis unit 12, and the chapter information table correction unit 13. As described above, the DVD data generation unit 14 includes the thumbnail image creation unit 17, the navigation data creation unit 18, the menu screen creation unit 19, and the write data creation unit 20.

  The thumbnail image creation unit 17 is an information processing function block that generates thumbnail images to be stored on the DVD disc. The navigation data creation unit 18 is an information processing function block that generates navigation data when writing MPEG2 data to a DVD disc. The menu screen creation unit 19 is an information processing function block that generates a menu screen to be stored in a DVD disc in response to creation of the DVD disc. The write data creation unit 20 is an information processing function block that generates write data for writing the MPEG2 data 34 to the DVD disk.

  The mass storage device 15 is an information storage device provided in the DVD data generation device 1. The mass storage device 15 in the present embodiment is preferably a storage device that can continue to hold information even when the supply of power to the DVD data generation device 1 is interrupted. Therefore, in the following embodiment, a description will be given corresponding to the case where the mass storage device 15 is a hard disk drive.

  As described above, the mass storage device 15 includes the keyword list storage unit 21, the maximum chapter information storage unit 22, the MPEG2 data storage unit 23, the DVD data storage unit 24, the chapter information table storage unit 25, and the correction. And a data storage unit 26.

The keyword list storage unit 21 is an information storage unit that stores keywords used when generating chapters. The keyword list storage unit 21 holds at least one keyword. In the following embodiment, it is assumed that the keyword list storage unit 21 holds a plurality of keywords, and the plurality of keywords can be read from each information processing unit. The keyword list is generated when a user manually inputs keywords as a list, or by automatically extracting performer names from EPG (electronic program guide) information. Is an information storage unit that stores the maximum number of chapters that can be assigned to a created DVD disc in the present embodiment. The maximum chapter information storage unit 22 stores the maximum number of chapters defined by the DVD standard and the maximum number of chapters set by the user. When specifying the upper limit of chapters to be assigned, the caption data analysis unit 12 refers to the maximum chapter information storage unit 22 and specifies the maximum number of chapters.

  The MPEG2 data storage unit 23 is an information storage unit that stores MPEG2 data output from the MPEG2 encoding unit 11. The DVD data storage unit 24 is an information storage unit that stores write data output from the DVD data generation unit 14. The chapter information table storage unit 25 is an information storage that stores an initial chapter information table 33 generated by the caption data analysis unit 12 and a chapter information table 35 generated by the chapter information table correction unit 13. The correction data storage unit 26 is an information storage unit that stores correction data used when the chapter information table correction unit 13 executes correction of the initial chapter information table 33.

  The detailed configuration in the present embodiment will be described below. FIG. 2 is a block diagram illustrating a configuration and a data flow in the program recording system of the present embodiment. As shown in FIG. 2, the caption broadcast decoder 4 is connected to the broadcast receiving device 2, the MPEG2 encoding unit 11, and the caption data analysis unit 12. The caption data analysis unit 12 is further connected to a chapter information table correction unit 13. The MPEG2 encoding unit 11 is connected to a thumbnail image creation unit 17, a navigation data creation unit 18, and a write data creation unit 20. The chapter information table correction unit 13 is further connected to a thumbnail image creation unit 17 and a navigation data creation unit 18. The thumbnail image creation unit 17 and the navigation data creation unit 18 are further connected to a menu screen creation unit 19. The navigation data creation unit 18 is connected to the write data creation unit 20. The write data creation unit 20 is connected to the above-described MPEG2 encoding unit 11, its thumbnail image creation unit 17, and the menu screen creation unit 19.

  Referring to FIG. 2, broadcast receiving apparatus 2 of the present embodiment outputs received broadcast data 30 corresponding to the reception of the broadcast. The broadcast receiving device 2 outputs video / audio data 32 to the MPEG2 encoding unit 11 and outputs subtitle data 31 to the subtitle data analyzing unit 12 based on the received broadcast data 30. The MPEG2 encoding unit 11 outputs MPEG2 data 34 based on the video / audio data 32 supplied from the caption broadcast decoder 4.

  The caption data analysis unit 12 outputs an initial chapter information table 33 based on the caption data 31 supplied from the caption broadcast decoder 4. The initial chapter information table 33 and the MPEG2 data 34 are supplied to the chapter information table correction unit 13. The chapter information table correction unit 13 outputs a chapter information table 35 based on each data, and supplies it to the thumbnail image creation unit 17 and the navigation data creation unit 18.

  The thumbnail image creation unit 17 outputs thumbnail image data 40 to the menu screen creation unit 19 based on the MPEG2 data 34 supplied from the MPEG2 encoding unit 11 and the chapter information table 35 supplied from the chapter information table correction unit 13. The navigation data creation unit 18 creates the navigation data 37 from the menu screen creation unit 19 and the write data creation based on the MPEG2 data 34 supplied from the MPEG2 encoding unit 11 and the chapter information table 35 supplied from the chapter information table correction unit 13. To the unit 20. The menu screen creation unit 19 outputs the menu screen data 38 to the write data creation unit 20 based on the navigation data 37 and the thumbnail image data 40. The writing data creation unit 20 generates chapter-added writing video / audio data 39 based on the MPEG2 data 34, the navigation data 37, and the menu screen data 38.

  The operation of subtitle data analysis 12 will be described below with reference to the drawings. FIG. 3 is a flowchart illustrating the operation of the caption data analysis unit 12 in the present embodiment. In the present embodiment, it is assumed that the operation shown in FIG. 3 starts when a program is recorded for writing on a DVD disc. In step S <b> 101 of FIG. 3, the caption data analysis unit 12 receives caption data 31 output from the caption broadcast decoder 4. In response to the received caption data 31, the caption data analysis unit 12 starts generating the initial chapter information table 33.

  In step S102, the caption data analysis unit 12 refers to the keyword list storage unit 21 of the mass storage device 15 in response to the start of the generation of the initial chapter information table. The caption data analysis unit 12 reads the keyword list obtained by the reference. Note that the keyword list stored in the keyword list storage unit 21 in advance is generated by a method such as a user's keyboard input or setting a character string selected based on EPG information as a keyword. The caption data analysis unit 12 identifies the time at which the caption corresponding to the keyword appears from the received caption data, and temporarily holds the keyword in association with the appearance time.

  In step S103, the caption data analysis unit 12 analyzes caption data corresponding to the passage of time. Based on the analysis, the caption data analysis unit 12 generates an initial chapter information table by associating the keyword with the appearance time when a preset keyword appears in the caption data. The caption data analysis unit 12 determines whether a keyword that has appeared before appears again in the process of generating the initial chapter information table. As a result of the determination, if the keyword has already appeared, the process proceeds to step S104. If no previously appearing keyword has appeared, the process proceeds to step S110.

  In step S <b> 104, the caption data analysis unit 12 specifies the appearance time of the already-displayed keyword. The caption data analysis unit 12 obtains a time interval (time difference) between the time when the keyword appeared as a caption last time and the time when it appeared this time based on the specified time. The caption data analysis unit 12 determines whether or not the obtained time interval exceeds a predetermined time (hereinafter referred to as chapter non-creation time T1), and if so, the process proceeds to step S105. If the obtained time difference does not exceed the chapter non-creation time T1, the process proceeds to step S110 without adopting the time when the keyword appears as a chapter. For example, it is assumed that a time of 5 seconds is set as the chapter non-creation time T1. Assuming that a preset keyword is displayed as a caption at “00:10:00”, it is displayed again as a caption within 5 seconds (from 00: 10: 0 to 00:10:05) from the appearance time. Even so, the caption data analysis unit 12 does not specify the time as the chapter candidate time.

  In step S105, the caption data analysis unit 12 sets the time when the keyword appears as the chapter candidate time, sets the time difference between the chapter candidate time and the time when the previous keyword appears as the time interval information, and sets the chapter candidate time and the time interval information as Is associated with the new chapter number and the initial chapter information table is updated. When the update is completed, the process proceeds to step S106.

  In step S106, in response to the update of the initial chapter information table, the caption data analysis unit 12 refers to the maximum chapter information storage unit 22 and reads the maximum chapter number information.

  In step S107, the caption data analysis unit 12 specifies the total number of chapters held in the initial chapter information table at the current time. The caption data analysis unit 12 compares the total number of chapters with the read maximum number of chapters. As a result of the comparison, if the total number of chapters does not exceed the maximum number of chapters, the caption data analysis unit 12 adds new chapter information to the initial chapter information table (step S108). If the total number of chapters exceeds the maximum number of chapters as a result of the comparison, the caption data analysis unit 12 updates the initial chapter information table by deleting the chapter with the same keyword appearance interval being the shortest ( Step S109).

  In step S110, the caption data analysis unit 12 determines whether or not all of the caption data analysis has been completed. As a result of the determination, if the analysis is not completed, the process returns to step S103. When the analysis is completed, the process proceeds to step S111. In step S111, the caption data analysis unit 12 outputs the generated initial chapter information table.

by this,
Hereinafter, a specific example of the initial chapter information table will be described, and the operation of the caption data analysis unit 12 and the configuration of the initial chapter information table will be described. In the following description of the embodiment, it is assumed that the set maximum number of chapters is “8”. FIG. 4 is a table illustrating the configuration of the initial chapter information table 33. Referring to FIG. 4, the initial chapter information table 33 is configured by associating a chapter number 41, a keyword 42, a chapter candidate time 43, and the same keyword interval 44. The initial chapter information table 33 shown in FIG. 4 illustrates a case where the first to eighth chapter numbers 41 are already used.

  The chapter number 41 is a number given each time a chapter candidate time is specified. The keyword 42 is a character string specified by the caption data analysis unit 12 based on the keyword list. The chapter candidate time 43 is a time when the keyword 42 is displayed as a caption based on the caption data. The same keyword interval 44 is a time difference between the time when the keyword subtitle is displayed and the time when the keyword is displayed again.

  FIG. 5 is a table illustrating the configuration of the update data 45 when a new keyword appears as a result of analyzing the caption data. Referring to FIG. 5, it is shown that the keyword “professional baseball” appears at 27 minutes 45 seconds from the analysis start time of the caption data. At this time, the caption data analysis unit 12 refers to the initial chapter information table 33, and the time when the keyword “professional baseball” appeared last time (00:12:20) and the current appearance time (00:27:45). From the above, the same keyword interval 44 is calculated.

  At this time, since the same number of chapter information as the maximum number of chapters in the initial chapter information table 33 is held, the caption data analysis unit 12 executes the process of step S109 in the flowchart of FIG. The caption data analysis unit 12 refers to the initial chapter information table 33 and identifies the chapter with the shortest appearance interval of the same keyword. Referring to FIG. 4, it is shown that the keyword “Prime Minister Koizumi” with the chapter number “3” at this time appears 15 seconds after the previous appearance. The caption data analysis unit 12 deletes the chapter information associated with the chapter number 3, adds the information indicated in the update data 45 as new chapter information, and updates the initial chapter information table 33.

  FIG. 6 is a table illustrating the configuration of the updated initial chapter information table 33a. Referring to FIG. 6, in the updated chapter information table 33a, information associated with chapter number 3 in the chapter information table 40 before update is deleted. In addition, each chapter information is carried along with the measure. Furthermore, as shown in FIG. 6, the time when the keyword “Prime Koizumi” appears after the keyword “Prime Minister Koizumi” of chapter number 2 becomes 15 minutes 50 seconds due to the deletion. Therefore, the caption data analysis unit 12 updates the same keyword interval 44 of the initial chapter information table 33a chapter number 5.

  This makes it possible to identify an appropriate location as a playback start location corresponding to the interval at which the keyword appears as a caption.

  FIG. 7 is a flowchart illustrating an operation in which the chapter information table correction unit 13 corrects the time at which a chapter is given. The correction is executed based on the initial chapter information table 33 supplied from the caption data analysis unit 12. In step S <b> 201 of FIG. 7, the chapter information table correction unit 13 reads the initial chapter information table supplied from the caption data analysis unit 12. In step S202, the chapter information table correction unit 13 reads the MPEG2 data 34 output from the MPEG2 encoding unit 11.

  In step S203, the speech recognition unit 13-1 of the chapter information table correction unit 13 starts speech recognition based on the chapter candidate time 43 indicated in the initial chapter information table 33 (or the initial chapter information table 33a). The time (hereinafter referred to as the voice recognition start time) is specified. As the speech recognition start time, a time earlier than a chapter candidate time by a predetermined time (hereinafter referred to as recognition time T2) is set. The voice recognition unit 13-1 starts voice recognition from the voice recognition start time, and executes voice recognition corresponding to the keyword until a predetermined time interval (voice recognition execution time 46) elapses.

  In the case of real-time caption broadcasting, there may be a time lag of about 5 to 10 seconds from when the sound is output until the caption corresponding to the sound is displayed. Therefore, if the recognition time T2 is set to 10 seconds, for example, the possibility that the speech corresponding to the keyword can be recognized (speech recognition rate) becomes higher than when speech recognition is executed from the chapter candidate time. . In addition, it is possible to further increase the voice recognition rate by delaying the voice recognition end time by a predetermined time from the chapter candidate time.

  In step S204, the voice recognition unit 13-1 determines whether voice data corresponding to the keyword has been recognized. As a result of the determination, if the voice data corresponding to the keyword can be recognized, the process proceeds to step S205. If the voice data corresponding to the keyword cannot be recognized, the process proceeds to step S206.

  In step S205, the chapter information table correction unit 13 specifies the time (keyword appearance time 47) when the voice data corresponding to the keyword appears based on the voice recognition by the voice recognition unit 13-1. In step S207, the chapter information table correction unit 13 corrects the chapter time corresponding to the keyword appearance time 47 and the correction time T3.

  In step S206, the chapter information table correction unit 13 corrects the chapter time corresponding to the voice recognition start time set in step S203 when the voice recognition unit 13-1 cannot recognize the voice. In step S208, the chapter information table correction unit 13 updates the chapter information table when the correction is completed.

  Here, the operation of the above-described flowchart will be described with reference to a specific example of the chapter information table for correction, and the operation of the chapter information table correction unit 13 and the configuration of the chapter information table will be described. FIG. 8 is a table illustrating the configuration of the correction chapter information table 50 including the speech recognition execution time 46. The correction chapter information table 50 is generated based on the initial chapter information table 33. In the following description, a case where the first correction time T2 is 10 seconds and the correction time T3 is 1 second will be exemplified.

  Referring to FIG. 8, the correction chapter information table 50 includes a keyword 42 and a speech recognition execution time 46 associated with the chapter candidate time 43. As shown in FIG. The correction chapter information table 50 specifies a time that is earlier than each chapter candidate time 43 by a first correction time T2 (10 seconds) as a voice recognition start time. In addition, a time 5 seconds later than each chapter candidate time 43 is specified as the voice recognition end time. The speech recognition unit 13-1 performs speech recognition for the time indicated by the speech recognition execution time 46 in the correction chapter information table 50, and identifies the time when the speech data corresponding to the keyword appears.

  FIG. 9 is a table exemplifying a configuration of the correction chapter information table 51 that holds the result of speech recognition (keyword appearance time 47) by the speech recognition unit 13-1 and the keyword to be recognized in association with each other. Referring to FIG. 9, the chapter information table correction unit 13 holds the result of speech recognition by the speech recognition unit 13-1 in association with each keyword 42 as a keyword appearance time 47.

  FIG. 10 shows a configuration of a chapter information table 35 that holds a chapter setting time 48 obtained by adding or subtracting the second correction time T3 from the keyword appearance time 47 and a keyword used for specifying the chapter in association with each other. It is an example table. Referring to FIG. 10, the chapter information table 35 retains the chapter setting time 48 obtained by further correcting the keyword appearance time 47 obtained by the voice recognition executed by the voice recognition unit 13-1 and the keyword 42 in association with each other. Yes.

  As described above, the chapter information table correction unit 13 corrects the time corresponding to the time difference between the chapter candidate time specified based on the caption data and the time when the audio of the MPEG2 data is output. Since chapters are assigned in accordance with the chapter setting times obtained by correction, when a recorded image is played back from any chapter, the problem that the sound is played from the middle is reduced. Is possible.

  FIG. 11 is a flowchart illustrating the operation of another embodiment in the correction executed by the chapter information table correction unit 13. Steps S201 and S202 shown in FIG. 11 are the same as the operations described with reference to FIG.

  In step S301 in FIG. 11, the chapter information table correction unit 13 determines whether or not the MPEG2 data 34 is generated from the caption data 31 in which the live broadcast program is recorded, based on the MPEG2 data 34 supplied from the MPEG2 encoding unit 11. Execute. As a result of the determination, if the MPEG2 data 34 is generated based on the caption data 31 recorded from the live broadcast program, the process proceeds to step S302. If the MPEG2 data 34 is generated corresponding to the recorded program, the process is performed. Advances to step S303. Here, in response to the reception of the MPEG2 data 34, the chapter information table correction unit 13 acquires the genre of the program from the EPG information, and executes the above determination based on the genre. For example, if the genre is news or sports, the process proceeds to step S302.

  In step S302, the chapter information table correction unit 13 performs correction corresponding to real-time caption broadcasting. In step S303, the chapter information table correction unit 13 executes correction for recording broadcast.

  Specifically, for example, when performing the correction corresponding to the real-time caption broadcast, the chapter information table correction unit 13 specifies the chapter setting time corresponding to the above-described recognition time T2, and executes the correction for the recording broadcast. When doing so, the chapter setting time is specified corresponding to the correction time T3.

  This makes it possible to specify the time for setting a chapter corresponding to the genre of the program.

  In the embodiment described above, the configuration of each device does not limit the configuration in the present invention. For example, the recording medium is not limited to a DVD disk, and the received subtitle broadcast may be recorded on a hard disk using an HDD recorder. Similarly, in the above-described embodiment, the case where the DVD data generation device 1 is a personal computer has been described as an example. However, this does not limit the configuration of the DVD data generation device 1 of the present invention. Absent. For example, the present invention can be realized by configuring a dedicated apparatus as the DVD data generating apparatus 1.

  In the above-described embodiment, the description has been made on the assumption that each information processing unit is a computer program (software). For example, an electronic circuit (hardware) corresponding to an arbitrary program is configured, The operation of this embodiment can be realized by operating the electronic circuit.

  In the above-described embodiment, the operations can be combined and executed within a range where there is no contradiction in the operation.

FIG. 1 is a block diagram illustrating the configuration of an embodiment of the present invention. FIG. 2 is a block diagram illustrating a configuration and a data flow according to the embodiment of this invention. FIG. 3 is a flowchart illustrating the operation of the data analysis unit in the embodiment of the present invention. FIG. 4 is a table illustrating the configuration of the initial chapter information table. FIG. 5 is a table illustrating new keywords. FIG. 6 is a table illustrating the configuration of a chapter information table generated corresponding to a new keyword. FIG. 7 is a flowchart illustrating the operation of the chapter information table correction unit according to the embodiment of the present invention. FIG. 8 is a table illustrating the configuration of the correction chapter information table. FIG. 9 is a table illustrating the configuration of the correction chapter information table. FIG. 10 is a table illustrating the configuration of the chapter information table. FIG. 11 is a flowchart illustrating another operation of the chapter information table correction unit.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... DVD data generation device 2 ... Broadcast receiving device 3 ... Antenna 4 ... Subtitle broadcast decoder 5 ... Input device 6 ... Display device 7 ... DVD data writing device 8 ... Transmission / reception unit 9 ... Arithmetic processing unit 10 ... Main storage unit 11 ... MPEG2 Encoding unit 12 ... Subtitle data analysis unit 13 ... Chapter information table correction unit 14 ... DVD data generation unit 15 ... Mass storage device 16 ... Bus 17 ... Thumbnail image creation unit 18 ... Navigation data creation unit 19 ... Menu screen creation unit 20 ... Write data creation unit 21 ... Keyword list storage unit 22 ... Maximum chapter information storage unit 23 ... MPEG2 data storage unit 24 ... DVD data storage unit 25 ... Chapter information table storage unit 26 ... Correction data storage unit 30 ... Received broadcast data 31 ... Subtitle data 32 ... Video / audio data 33, 33a ... Initial chapter information table 34 ... MPEG2 data 35 ... Chapter information table 37 ... Navigation data 38 ... Menu screen data 39 ... Chaptered video / audio recording medium 40 ... Thumbnail image data 41 ... Chapter number 42 ... Keyword 43 ... Chapter candidate time 44 ... Same keyword interval 45 ... Update data 46 ... voice recognition execution time 47 ... keyword appearance time 48 ... chapter setting times 50 and 51, correction chapter information table 52 ... subtitle broadcast T1 ... chapter non-creation time T2 ... recognition time T3 ... correction time

Claims (18)

In response to a television signal with caption data supplied from a receiving device that receives caption broadcasting, a decoder device that extracts caption data and video / audio data from the television signal with caption data, and the video / audio data are: Including the video and audio of the subtitle broadcast,
A writing data generating device for generating a chaptered video / audio recording medium based on the caption data and the video / audio data,
The write data generation device includes:
A caption data analysis unit that identifies a time at which a preset keyword is displayed as a caption as a chapter candidate time, and generates an initial chapter information table by associating the keyword with the chapter candidate time;
A chapter information table correction unit that corrects the chapter candidate time based on the initial chapter information table and generates a chapter information table;
An image generation unit for writing that generates the chaptered video and audio recording medium,
The caption data analysis unit
When the keyword associated with the chapter candidate time appears again as a caption without exceeding a predetermined time, it is prohibited to specify the time when the keyword newly appears as the chapter candidate time,
The chapter information table correction unit
Identifying the chapter setting time based on the time difference between the chapter candidate time and the time at which the sound corresponding to the keyword is output, generating the chapter information table by associating the chapter setting time with the keyword,
The writing image generation unit
A program recording apparatus that generates the chapter-added video / audio recording medium by adding the chapter information to video / audio data for writing based on the chapter setting time indicated in the chapter information table. The program recording apparatus according to claim 1,
The caption data analysis unit
Generate a record associating the keyword and the chapter candidate time to configure the initial chapter information table,
When the keyword associated with the chapter candidate time appears again as a caption after a predetermined time, the time when the keyword newly appears is specified as a new chapter candidate time,
Generating a new record by associating a keyword appearance interval, which is a time difference between the chapter candidate time and the new chapter candidate time, the new chapter candidate time, and the keyword;
When the total number of the records exceeds a predetermined number, the program recording device that deletes the record with a short appearance interval and adds a new record to the initial chapter information table. The program recording apparatus according to claim 2, wherein
The chapter information correction unit includes a voice recognition unit,
The voice recognition unit
Performing voice recognition of the voice data included in the video / audio data for writing to identify the time when the keyword is output as voice, as the keyword voice output time;
A program recording apparatus that corrects the chapter candidate time based on a time difference between the keyword voice output time and the chapter candidate time to identify the chapter setting time. The program recording apparatus according to claim 3, wherein
The voice recognition unit
Perform speech recognition in a predetermined time range with the chapter candidate time as a reference time,
When speech corresponding to the keyword is recognized by speech recognition performed in the time range, the recognized time is specified as the keyword speech output time,
When the voice corresponding to the keyword is not recognized by the voice recognition performed in the time range, the chapter candidate time is corrected based on the time difference between the time when the keyword voice recognition is started and the chapter candidate time. A program recording device that identifies the chapter setting time. The program recording apparatus according to claim 4, wherein
The voice recognition unit identifies a voice recognition start time for starting voice recognition based on a predetermined recognition time, executes voice recognition in a predetermined time range from the specified voice recognition start time,
The chapter information table correction unit
A program recording device that specifies the chapter setting time by correcting the chapter candidate time based on a predetermined correction time for the keyword voice output time obtained by the voice recognition. In the program recording device according to any one of claims 1 to 5,
And an image processing unit that processes the video / audio data to generate the video / audio data for writing,
The image processing unit generates program type information indicating whether a subtitle broadcast corresponding to the video / audio data is a live broadcast program or a recorded broadcast program, and associates the program type information with the video / audio data. Generating the video / audio data for writing;
The chapter information table correction unit
A program recording device that corrects the chapter candidate time based on the program type information included in the video / audio data for writing and identifies the chapter setting time. (A) extracting subtitle data and video / audio data from the television signal with subtitle data in response to the television signal with subtitle data; and the video / audio data includes video data and audio data of the subtitle broadcast. Including
(B) identifying a time at which a preset keyword is displayed as a caption as a chapter candidate time, and generating an initial chapter information table by associating the keyword with the chapter candidate time;
(C) When the keyword associated with the chapter candidate time appears again as a caption without exceeding a predetermined time, it is prohibited to specify the time when the keyword newly appears as the chapter candidate time. When,
(D) A chapter setting time is specified based on a time difference between the chapter candidate time and a time at which sound corresponding to the keyword is output, and the chapter information table is generated by associating the chapter setting time with the keyword. Steps,
(E) Based on the caption data, the video / audio data, and the chapter setting time indicated in the chapter information table, the chapter information is added to the video / audio data for writing to generate the chapter-added video / audio recording medium. A program recording method comprising the steps of: The program recording method according to claim 7,
The step (b)
Generating a record associating the keyword with the chapter candidate time and configuring the initial chapter information table;
When the keyword associated with the chapter candidate time appears again as a caption after a predetermined time, the step of specifying the time when the keyword newly appears as a new chapter candidate time; and the chapter candidate time Generating a new record by associating a keyword appearance interval that is a time difference with the new chapter candidate time, the new chapter candidate time, and the keyword;
When the total number of the records exceeds a predetermined number, a program recording method comprising: deleting a record with a short appearance interval and adding a new record to the initial chapter information table. The program recording apparatus according to claim 8, wherein
The step (d) includes:
Performing voice recognition of audio data included in the video / audio data for writing and specifying a time when the keyword is output as audio as a keyword audio output time;
A program recording method comprising: correcting the chapter candidate time based on a time difference between the keyword voice output time and the chapter candidate time. The program recording method according to claim 9, wherein
The step (d) further includes:
Performing speech recognition in a predetermined time range with the chapter candidate time as a reference time;
When the voice corresponding to the keyword is recognized by the voice recognition performed in the time range, the recognized time is specified as the keyword voice output time;
When the speech corresponding to the keyword is not recognized by speech recognition performed in the time range, the chapter candidate time is corrected based on the time difference between the speech recognition start time of the keyword and the chapter candidate time. A program recording method comprising the steps of: The program recording method according to claim 9, wherein
The step (d) further includes:
Specifying a voice recognition start time for starting voice recognition based on a predetermined recognition time, and executing voice recognition within a predetermined time range from the specified voice recognition start time;
A program recording method, comprising: correcting the chapter candidate time based on a predetermined correction time for the keyword voice output time obtained by the voice recognition. The program recording method according to any one of claims 7 to 11,
further,
(F) generating program type information indicating whether the subtitle broadcast corresponding to the video / audio data is a live broadcast program or a recorded broadcast program, and associating the program type information with the video / audio data for the writing Generating video and audio data;
(G) A program recording method comprising: correcting the chapter candidate time based on the program type information included in the video / audio data for writing. Decoder means for extracting caption data and video / audio data from the television signal with caption data in response to the television signal with caption data supplied from a receiving means for receiving caption broadcast on a computer;
A program that functions as a writing video / audio data generating means for generating a chaptered video / audio recording medium based on the caption data and the video / audio data,
In the video / audio data generating means for writing,
(A) receiving the subtitle data and the video / audio data supplied from the decoder means; the video / audio data includes video data and audio data of the subtitle broadcast;
(B) identifying a time at which a preset keyword is displayed as a caption as a chapter candidate time, and generating an initial chapter information table by associating the keyword with the chapter candidate time;
(C) When the keyword associated with the chapter candidate time appears again as a caption without exceeding a predetermined time, it is prohibited to specify the time when the keyword newly appears as the chapter candidate time. When,
(D) A chapter setting time is specified based on a time difference between the chapter candidate time and a time at which sound corresponding to the keyword is output, and the chapter information table is generated by associating the chapter setting time with the keyword. Steps,
(E) Based on the caption data, the video / audio data, and the chapter setting time indicated in the chapter information table, the chapter information is added to the video / audio data for writing to generate the chapter-added video / audio recording medium. A program recording program for executing a method comprising the steps. The program recording program according to claim 13,
The step (b)
Generating a record associating the keyword with the chapter candidate time and configuring the initial chapter information table;
When the keyword associated with the chapter candidate time appears again as a caption after a predetermined time, the step of specifying the time when the keyword newly appears as a new chapter candidate time; and the chapter candidate time Generating a new record by associating a keyword appearance interval that is a time difference with the new chapter candidate time, the new chapter candidate time, and the keyword;
When the total number of records exceeds a predetermined number, a program recording program comprising: deleting a record with a short appearance interval and adding a new record to the initial chapter information table. In the program recording program according to claim 14,
The step (d) includes:
Performing voice recognition of audio data included in the video / audio data for writing and specifying a time when the keyword is output as audio as a keyword audio output time;
A program recording program comprising: correcting the chapter candidate time based on a time difference between the keyword voice output time and the chapter candidate time. In the program recording program according to claim 15,
The step (d) further includes:
Performing speech recognition in a predetermined time range with the chapter candidate time as a reference time;
When the voice corresponding to the keyword is recognized by the voice recognition performed in the time range, the recognized time is specified as the keyword voice output time;
When the speech corresponding to the keyword is not recognized by speech recognition performed in the time range, the chapter candidate time is corrected based on the time difference between the speech recognition start time of the keyword and the chapter candidate time. A program recording program comprising the steps. In the program recording program according to claim 15,
The step (d) further includes:
Specifying a voice recognition start time for starting voice recognition based on a predetermined recognition time, and executing voice recognition within a predetermined time range from the specified voice recognition start time;
A program recording program comprising: correcting the chapter candidate time based on a predetermined correction time for the keyword voice output time obtained by the voice recognition. The program recording program according to any one of claims 13 to 17,
Said computer further
Function as image processing means for processing the video / audio data to generate the video / audio data for writing,
In the video / audio data generating means for writing,
(F) generating program type information indicating whether the subtitle broadcast corresponding to the video / audio data is a live broadcast program or a recorded broadcast program, and associating the program type information with the video / audio data for the writing Generating video and audio data;
(G) A program recording program that executes a method comprising: correcting the chapter candidate time based on the program type information included in the video / audio data for writing.

Images