JP4929128B2 - Recording / playback device - Google Patents

Description

  The present invention relates to a recording / reproducing apparatus for recording / reproducing program data having subtitle data.

  In recent broadcasting, digital broadcasting that broadcasts video as digital data has become mainstream. This digitization is said to enable new broadcasting services such as high image quality (high-definition broadcasting), multi-channel broadcasting, data broadcasting, broadcasting for mobile reception (cell phones, etc.).

  As a storage medium for digital TV broadcasting, it is possible to reserve a large number of programs such as optical disks such as DVD (Digital Versatile Disk) and hard disk drives (HDDs), and to edit and delete them quickly and easily. Digital storage media that can be used are used. As long as the capacity of the storage medium permits, a user can easily record a program of interest, and can easily view the program at his / her favorite time without being restricted by the broadcast time. Under such circumstances, since the viewable time is limited, the user wants to view the desired scene with the head.

  Patent Document 1 discloses a means for extracting a requested scene that seems to meet a user's request by taking out subtitle information multiplexed and stored together with video and performing a character string search or the like.

  Patent Document 2 discloses that leveling is performed based on the occurrence frequency of keywords and the like, and keywords of a certain level or higher are recorded on a recording medium as index information.

JP 2005-115607 A JP 2006-157108 A

  In the technique disclosed in Patent Document 1, subtitle information is accumulated, a requested scene that seems to meet the user's request is extracted as a candidate, and image analysis and audio analysis are performed on the candidate scene. A scene that is determined to satisfy is extracted. By using subtitles as described above, it is possible to save time and labor for manually creating information related to content as compared with the prior art.

  However, in Patent Document 1, when subtitle information that has been multiplexed and stored is extracted and searched, it takes time to search for packets that include subtitles, and thus it takes time to search for a scene. .

  Further, the technique disclosed in Patent Document 2 has a problem that leveling based only on the frequency of occurrence of keywords is not necessarily appropriate as an index depending on the content of the program.

  The present invention has been made to solve the above-described problems, and an object of the present invention is to play back a suitable index using subtitles when recording and playing back a digital broadcast program.

  In order to solve the above-described problems, an embodiment of the present invention may be configured as described in the claims, for example.

  According to the present invention, program data having caption data can be recorded and reproduced more suitably.

  Hereinafter, an embodiment according to the present invention will be described with reference to FIGS. 1 to 9.

  First, the configuration of a recording / playback apparatus according to an embodiment of the present invention will be described with reference to FIG.

  FIG. 1 is a block diagram showing the configuration of a recording / playback apparatus according to an embodiment of the present invention.

  As shown in FIG. 1, the recording / playback apparatus according to the present embodiment includes a recording / playback unit 101, a display device 102, an input device 103, a tuner 104, an antenna 105, a RAM 106, and an external storage device 107. ing.

  The recording / playback unit 101 is a part that records and plays back a broadcast program in the external storage device 107. The recording / playback unit 101 is divided into processing blocks for performing each process when recording or playing back a program.

  The display device 102 is a part that displays video and audio, and displays video and outputs audio when the recorded content is played back. The display device 102 is configured by, for example, a television or personal computer display or a liquid crystal panel.

  The input device 103 is a device in which a user operates the recording / playback device and inputs control information and data related to an operation input by the user. For example, a pointing device such as a remote controller, a keyboard, a mouse, a pen input device, or the like is used. It is realized by a device or a liquid crystal touch panel.

  The RAM 106 is a volatile memory, and is a storage device that stores temporary data and programs processed by the recording / playback unit 101.

  The tuner 104 is a part that selects and acquires broadcast program data from radio waves received from a broadcast station.

  The antenna 105 is a part that receives broadcast radio waves according to the band of digital broadcasting. For example, an antenna for digital terrestrial broadcasting receives UHF band radio waves.

  The external storage device 107 is a device having a large storage capacity, and is, for example, an optical disk such as a DVD or an HDD.

  Next, each processing block of the recording / playback unit 101 will be described. Each processing block may be, for example, software that operates on a general-purpose processor such as a CPU, or each block may be processed by dedicated hardware. Also, a device in which software and hardware are mixed may be used.

  As shown in FIG. 1, the recording / playback unit 101 includes a system control unit 110, a signal separation unit 111, a caption analysis unit 112, a program recording unit 113, a chapter generation unit 114, and a keyword list acquisition unit 115. , A playback position list acquisition unit 116, a program playback unit 117, and a video output unit 118.

  The system control unit 110 receives a user operation request via the input device 103 and controls the operation of each block of the recording / playback unit 101. In addition, it controls the operation of each block of the recording / playback unit 101 in recording and playing back programs.

  The signal separation unit 111 has a function of separating received broadcast data for each type of video data, audio data, caption text data, program information data, and the like and passing the separated broadcast data to other processing blocks. When there is a data transmission request from another processing unit, the designated data is transmitted to the request source. Further, broadcast program data received from the tuner 104 and recorded program data 121 stored in the external storage device 107 can be input to the signal separation unit 111.

  The reproduction position list acquisition unit 116 outputs a reproduction position list for the recorded program to the video output unit 118 according to an instruction from the system control unit 110.

  The program playback unit 113 acquires 121 recorded program data stored in the external storage device 107 of the program instructed by the user in accordance with an instruction from the system control unit 110, and inputs it to the signal separation unit 111. Thereafter, the video ES (described later) and the audio ES (described later) are obtained from the signal separation unit 111 and decoded, and the video and audio data are output to the video output unit 118.

  When there is a program recording request via the system control unit 110, the program recording unit 113 requests a data stream from the signal separation unit 111 and stores it as recorded program data 121 in the external storage device 107. To do. The program recording unit 113 may store the entire data stream as the recorded program data 121 according to the user's specification, or may store only the video ES and the audio ES by selecting them to reduce the storage area.

  The video output unit 118 receives the outputs of the playback position list acquisition unit 116 and the program playback unit 117, configures a screen, and outputs video and audio to the display device 102.

  Upon receiving a caption analysis request from the system control unit 110, the caption analysis unit 112 acquires a caption ES (described later) and a time stamp from the signal separation unit 111. Then, the subtitle ES is analyzed and stored as subtitle feature data 120 on the RAM 106.

  The chapter generation unit 114 outputs chapter data 123 to the external storage device 107 using the caption feature data 120 and the dictionary data 122.

  The caption feature data 120 is data that the caption analysis unit 112 analyzes the caption ES and stores in the RAM 106 in a unique format. Details of the caption feature data 120 will be described later.

  The external storage device 107 stores recorded program data 121, dictionary data 122, and chapter data 123.

  The dictionary data 122 is data in which a list of keywords to be output to the caption feature data 120 is arranged. However, the dictionary data 122 may not be included when the caption content data 120 is not analyzed, such as only processing when the blank section is detected. Further, it does not necessarily exist only in the external storage device 107, and may be acquired by means such as the Internet, broadcast waves, or flash memory. Or you may possess the structure which updates a dictionary from a user's operation history or EPG.

  The recorded program data 121 is program data including information such as video, audio, and captions.

  The chapter data 123 is data that holds information on keywords included in the caption for each program. Details of the chapter data 123 will be described later.

  Next, a data structure related to the program recording / playback method of the present embodiment will be described with reference to FIGS.

  FIG. 2 is a diagram illustrating a data structure of a data stream in digital broadcasting.

  FIG. 3 is a diagram showing the format of the caption text data 120.

  FIG. 4 is a diagram illustrating a data structure of the chapter data 123.

  In digital broadcasting, MPEG-2 TS (Transport Stream) is used as a transmission method. Video data, audio data, and all data used in data broadcasting are transmitted in a TS packet 201 shown in FIG.

  In particular, video data, audio data, and caption text data are encoded and compressed into ES (Elementary Stream), and become video ES 202, audio ES 203, and caption ES 204, respectively. These ESs are packetized in a PES (Packetized Elementary Stream) format to which a PES header 205 indicating display time information and the like is added. The PES header 205 includes a time stamp, and reproduction synchronization of each packet can be achieved by using this time stamp. As can be seen from FIG. 2, one PES packet may be created from the payloads of a plurality of TS packets.

  The signal separation unit 111 shown in FIG. 1 analyzes the data stream of FIG. 2 and separates it for each packet type.

  Next, the caption feature data 120 will be described with reference to FIG.

  The caption feature data 120 is stored in a table format of a time stamp 301 and caption type information 302 as shown in FIG.

  The time stamp 301 is a caption display time included in the PES header 205, and is displayed as a relative time from the recording start time.

  The caption type information 302 stores the result of analyzing the caption sentence 303 included in the caption ES 204. A method for analyzing and outputting text information included in the subtitle ES 204 will be described later.

  The caption feature data 120 is stored in a certain amount according to the capacity of the RAM 106. The caption analysis unit 112 monitors the amount of data stored in the caption feature data 120, and notifies the system control unit when it is determined that more than a predetermined amount of data has been stored in the RAM.

  Next, the chapter data 123 will be described with reference to FIG.

  The chapter data 123 is data generated for each program, and is used when a program is reproduced using an automatic chapter.

  The chapter data 123 has a hierarchical structure as shown in FIG. 4, and the highest layer is the top one chapter header 401, followed by a plurality of chapter sections 402 that may be included. Become.

  The chapter header 401 includes data that is an attribute of chapter data. Information including only one, for example, a recording start time and end time, and a unit of PTS (Presentation Time Stamp) that is a time indicated by the chapter, Program information and the like are included, and the total number of chapter sections 402 is included. In addition to the program information acquired from the EPG, additional information at the time of recording such as image quality setting may be added. Information such as chapter data version number and creation date / time may be stored.

  The chapter section 402 is created separately from other chapter sections based on differences in keyword attributes and keyword usefulness determination algorithms. For example, when the program categories are different, different chapter generation algorithms are used, so that chapter sections are created corresponding to the respective program categories. For example, since the category of sports program and the category of news program have different chapter generation algorithms, different chapter sections are created.

  Each chapter section is divided into a plurality of segments having a hierarchical structure, as shown in FIG. One chapter header 403 and a PTS section 404 that may be included in a plurality are successively formed at the top.

  The section header 403 is a segment indicating the attributes of the chapter section. The section header 403 can have, for example, a section ID 405, a section size 406, a PTS type 407, and a PTS number 408.

  The section ID 405 is an ID number indicating a section attribute, and is unique for each chapter section included in the same chapter data. Since the program playback apparatus that handles chapter data checks the section ID to determine how to use the chapter section, each chapter data of a plurality of programs uses the same section ID when the chapter generation algorithm is used. Is preferred.

  The section size 406 indicates the overall size of the segment. The PTS type 407 is a code for distinguishing the PTS expression method included in the PTS unit 404. An example of a PTS expression method will be described later. A PTS number 408 indicates the number of PTS parts included in the segment.

  The PTS unit 404 indicates a chapter position or a detected scene position. The storage method of the PTS unit 404 differs depending on the PTS type 407 included in the section header 403. For example, if type 1 is indicated in PTS 407, only the chapter position is stored, and if type 2 is indicated, it is stored as a pair of scene start / end times. .

  Next, processing of each unit of the program recording / playback method according to the embodiment of the present invention will be described with reference to FIGS.

  FIG. 5 is a flowchart illustrating a process in which the caption analysis unit 112 generates caption feature data.

  FIG. 6 is a flowchart showing details of subtitle feature data output details.

  FIG. 7 is a flowchart showing processing in which the chapter generator 114 generates chapter data.

  FIG. 8 is a flowchart showing processing at the time of program recording.

  FIG. 9 is a diagram showing an example of a user interface of a program playback screen for performing automatic chapter playback using subtitles.

  First, a process in which the caption analysis unit 112 generates caption feature data will be described with reference to FIG.

  The caption analysis unit 112 is instructed by the system control unit 110 to start processing for generating caption feature data.

  The chapter generation unit 112 first acquires the dictionary data 122 from the external storage device 107 (step 501). However, this step is omitted when the caption feature data is generated without using the dictionary data 122.

  Next, a caption ES and a time stamp are acquired (step 502). The caption ES is acquired from the signal separation unit 111 by analyzing the broadcast data shown in FIG. Similarly, the time stamp for the caption ES is acquired from the PES header 205.

  Next, the caption ES is analyzed to obtain one data unit (step 503). The data unit is one of the constituent elements of the caption ES described in the ARIB standard. When the caption ES includes caption sentences in multiple languages, the data unit is grouped as a separate data unit for each language. ing. The language type can be identified by the data group ID included in the data unit.

  Next, the data unit is analyzed and a decoding process is performed (step 504). A decoding process is performed to obtain the caption text 303 shown in FIG.

  Next, subtitle feature data output processing is performed using the subtitle sentence 303 acquired in step 504 and the time stamp acquired in step 502 (step 505). The caption feature data output process will be described in detail with reference to FIG.

  Next, it is determined whether or not there is an unprocessed data unit in the caption ES acquired in step 502. If there is an unprocessed data unit, the process returns to step 503 to process the next data unit. However, only data units including a specific language may be processed.

  Next, details of the subtitle feature data output process will be described with reference to FIG. First, it is determined whether or not the subtitle sentence 303 acquired in step 503 includes text (step 601).

  The data unit containing the string such as "hello ~" as shown in caption text 303 in FIG. On the other hand, control data related to the caption display method, such as changing the character color and erasing the displayed caption text, and symbol data rendered as a bitmap are included.

  If it is determined in step 601 that the subtitle sentence 303 is acquired in step 503 and includes a text portion, an effective keyword determination process is performed (step 602).

  In the effective keyword determination process, for example, it is determined whether or not each word data included in the dictionary data 122 or a detected word / phrase provided in the system from the beginning is included.

For example, in the case of a music program, the program is composed of a plurality of pieces of music, and a chapter is automatically added to the head of the music. In this step, it is determined whether or not a phrase (“next song please” etc.) assumed as a song break or a symbol such as “♪” displayed when music is played is determined.
Next, in the determination result in step 602, when it is determined that an effective keyword is included (step 603), it is output to the caption type information 302 (step 604). In step 601, the same processing is performed when it is determined in step 503 that the subtitle sentence 303 does not include a text portion.

  In order to store a plurality of types, for example, as shown in FIG. 3, the subtitle type information 302 expresses the content information of each type as a bit flag, which is encoded and stored in a decimal number or the like. For example, in the case of data including a text part, the first bit is set to 1. In the case of data including only the control code, the third bit is set to 1. In addition, when a keyword related to music is included, the second bit is set to 1. If any other keyword is included, any bit is set to 1. Similarly, regarding the bit map symbol and the like, the second bit of the symbol related to music is set to 1, and any bit is set to 1 to indicate that the bit map symbol is included.

  In the example of FIG. 3, when a caption ES including only control data such as a character color change is first acquired in the time stamp 3, the lower third bit is shown to indicate that only the control code is included. Set to 1. If you get a caption text data, including text, such as "Hello ~" The next time stamp 4, and 1 the lower first bit to have to contain the text part. Subsequently, when subtitle sentence data including a text part including a music symbol of “♪” is acquired in the time stamp 102, the lower 1st bit and the 2nd bit are set to 1 at the same time as including a text part and a keyword related to music. To do. Subsequently, assuming that the time stamp 299 includes a text portion such as “Please next song” and a keyword related to music, the lower bit and the second bit are simultaneously set to 1. Subsequently, when subtitle sentence data including a text part such as “this week's ranking” is acquired in the time stamp 802, it is determined that the dictionary keyword 122 includes a keyword such as “ranking”. Set eyes to 1 at the same time.

  As described above, the caption type information 302 simultaneously stores information indicating whether the type of caption text data and each keyword in the dictionary data 122 match. The subtitle type information 302 may be stored as a bit flag as shown in FIG. 3, but for example, when the dictionary data becomes huge, only the dictionary keyword number is used only when it is determined that it is included, not the bit representation. May be expressed as separate data. Further, as in the example, keywords detected in the same category such as “♪” and “next song please” are preferably assigned to the same bit in consideration of later processing in the chapter generation unit.

As described above, the output processing of the caption type information in step 604 is performed. Next, it is determined whether there is a non-adaptive effective keyword determination method (step 605). If it is not determined as a valid keyword in step 603, the process directly proceeds to step 605. If it is determined that the effective keyword determination method remains, the process returns to step 602 to apply the next keyword determination method. When a plurality of keyword determination methods are performed, the result is merged with the previous caption type information.
If it is determined in step 605 that all effective keyword determination methods have been performed, the process ends. If it is determined in step 601 that the text portion is not included, the output process to the caption type information in step 604 is performed, and then the process ends.

  Next, a process in which the chapter generation unit 114 generates chapter data will be described with reference to FIG.

  The chapter generation unit 114 is instructed by the system control unit 110 to start chapter data generation processing.

  The chapter generation unit 114 first acquires program information (step 701). The program information is an electronic program guide (EPG) for digital broadcasting, and is acquired from the signal separation unit 111 by analyzing the broadcast data and the recorded program data 121 shown in FIG.

  Next, the time stamp 301 and the caption type information 302 are acquired as one record for the caption feature data shown in FIG. 3 (702).

  Next, it is determined whether or not the extracted caption feature data matches the chapter extraction rule (step 703). The chapter extraction rule is a rule used to determine whether or not the input caption feature data 120 is a specific pattern. For one record acquired in step 702, the preceding and following caption type information and its time interval are set. evaluate.

  As an example, a chapter extraction rule for a music program will be described. In a music program, for example, a rule for setting a chapter at the beginning of a song is applied. Therefore, subtitle feature data including keywords related to music is found by evaluating subtitle feature data one record at a time. When caption feature data as shown in FIG. 3 is obtained, the time stamp 102 matches the condition. Next, the type and time interval of the next record of the matched subtitle feature data are evaluated. In the case of the caption feature data as shown in FIG. 3, the next record is a character string, and the time interval is 299-102 = 197 seconds. When the music keyword appears and the caption feature interval cannot be obtained at a certain interval or more, it is highly likely that the scene is a song scene, and therefore the data of the time stamp 102 matches the chapter extraction rule.

  Other chapter extraction rules can have a plurality of rules for each category of program. There are no rules for setting the appearance of dictionary keywords as chapters or character strings that seem to be CM sections by detecting the matching status with dictionary keywords possessed as feature data or by detecting certain sections without character strings. A rule is set such that a chapter is set at the head of the next character string portion when a section continues for a certain length or more. It is possible to apply a plurality of these rules.

  If it is determined in step 703 that the chapter extraction rule is met, it is output as chapter data (step 704). In the case of FIG. 3, since the data of the time stamp 102 matches the chapter extraction rule, the time stamp 102 is output to the PTS portion of the music program section with respect to the chapter data of FIG. When the rules of a plurality of categories are applied, they are output to the PTS sections in the matched category sections.

  Further, the PTS portion of the chapter data in FIG. 4 can store not only the start point of the chapter but also the start / end point by the expression of the PTS type 407. The PTS storage method is controlled by the chapter extraction rule for each category.

  After the chapter data is output in step 704 and if it is determined in step 703 that the chapter extraction rule does not match, it is determined whether or not the next caption feature data record exists (step 705). If it is determined that there is remaining caption feature data, the process returns to step 703 to evaluate the next record. If it is determined in step 705 that all the caption feature data has been processed, the chapter generation unit 114 ends the processing.

  Although the chapter extraction rule is not shown in FIG. 1, it may be held internally as control data of the chapter generation unit 114, or may be stored in the external storage device 107 and taken out as necessary.

  If there are many categories of the program and the amount of calculation for determining the chapter extraction rules and the chapter data 123 are large, the category may be applied to reduce the output category. For example, in the program information included in the EPG of digital broadcasting, a plurality of genre codes may be assigned to one program. Therefore, effective keyword determination may be performed by an algorithm suitable for the genre obtained from these genre codes, and output may be performed so that a separate chapter section 402 is configured for each genre code.

  It is not necessary to provide rules for all categories, and chapter extraction rules for common rule categories may be provided. For example, a chapter extraction rule is set such that a chapter is set only at the end position of a portion considered to be a CM section. For example, it is possible to apply common rules other than music programs.

  Next, processing of the recording / playback apparatus at the time of program recording will be described with reference to FIG.

  When the user instructs to record a program, the recorded program data 121 is output, and the caption feature data 122 and the chapter data 123 are generated according to the processing shown in FIG.

  First, the system control unit 110 instructs a transition to a program recording state by a reserved recording of a program or a recording instruction of a user. When receiving the broadcast data, the signal separation unit 111 performs a separation process on the broadcast data in the format shown in FIG. 2 based on the transfer request registered before analysis and recording (step 801), and the program recording unit 113. And the transfer processing of the desired data to the caption analysis unit 114 is performed. Then, the program recording unit records the recorded program data 121 in the external storage device 107 (step 802).

  On the other hand, the system control unit 110 determines whether or not automatic chaptering is performed according to the setting at the start of recording by the user or the recording method setting of the system (step 803). If it is determined that automatic chapter generation is ON, the caption ES 204 is input to the caption analysis unit 112, and the caption analysis unit 112 outputs the caption feature data 122 (step 804).

  When it is determined in step 803 that the automatic chapter is OFF, and after step 804 is finished, it is determined whether or not the program has ended (step 805). It is determined whether or not feature data has accumulated a predetermined amount or more (step 806). When a certain amount or more is accumulated, the chapter chapter generator 114 generates chapter data using the caption text data 122 on the RAM 106 (step 807), and ends the processing. If it is determined in step 806 that a predetermined amount or more has not been accumulated, the chapter chapter generator 114 does not perform the chapter data generation process, and ends the processing. If it is determined in step 805 that the program has not ended, the broadcast data reception wait state is entered again (step 808).

  Next, a user interface when the user performs automatic chapter reproduction using subtitles will be described with reference to FIG.

  The program playback screen 900 that can perform chapter playback according to the present embodiment includes a progress bar display unit 901, an automatic chapter playback method display unit 902, and a program video display unit 903.

  The program playback screen 900 on which automatic chapter playback of this embodiment can be performed is activated when the user instructs program playback via the input device 103.

  The progress bar display unit 901 displays a progress bar indicating the entire program length and a chapter playback position corresponding to the contents of the chapter data 124 of the program as a chapter position 904.

  When the program playback is instructed, the category information of the program is input to the playback position list acquisition unit 116. The reproduction position list acquisition unit 116 selects the chapter section 402 from the chapter data 123 of the program, and acquires all the PTS units included in the chapter section. Subsequently, the acquired PTS unit 609 is transferred to the video output unit 118. The video output unit 118 displays the playback position of the corresponding chapter of the acquired PTS unit 609 on the progress bar. Here, when the PTS unit is type 1 (appearance time type) in FIG. 4, the video output unit 118 displays only the appearance position in a color different from the reference color of the professional glass bar. On the other hand, when the PTS unit is type 2 in FIG. 6, the section surrounded by the start / end times is displayed in a color different from the reference color of the professional glass bar.

  The chapter data supports storage of a plurality of sections, and all categories supported by the system may be output when the chapter data is generated. The playback position list acquisition unit 116 specifies and specifies the chapter section 402 of the genre obtained from these genre codes according to the genre codes given to the program information included in the EPG of the digital broadcast, for example, at the time of program playback. A list of PTS units in the chapter section may be obtained.

  In this case, for example, when the category of the genre code includes the categories “music”, “news”, and “sports”, in the case of “music”, the chapter section 1 is acquired from the chapter sections 402, and “news” In this case, the chapter section 2 of the chapter sections 402 is acquired, and in the case of “sports”, the chapter section 3 to be acquired may be selected according to the genre code, such as acquiring the chapter section 3 of the chapter sections 402. . In this case, different chapters can be selected depending on the type of program, and reproduction using chapter positions more suitable for the program content can be performed.

  In addition, there is a possibility that a plurality of genres are included in the genre code given to the program information included in the EPG of digital broadcasting. In such a case, the playback position list acquisition unit 116 may investigate a part or all of the genre codes and acquire and display the PTS units of all the chapter sections that match the genre codes.

  In this case, for example, in the above example in which the type of the genre code is “music”, “news”, and “sports”, when both the “news” and “sports” are included in the genre code of a certain program, What is necessary is just to acquire both the chapter section 2 and the chapter section 3 among the chapter sections 402. In this case, when there are a plurality of types of codes in the genre code of the program program, it is possible to use all the chapters corresponding to both of the plurality of types.

  Alternatively, the search for the chapter section may be completed when the category included in the chapter data 124 is first found.

  In this case, for example, in the above-described example where the type of the genre code includes “music”, “news”, and “sports”, the genre code of a certain program includes both “news” and “sports”. If “news” is found, chapter section 2 of chapter sections 402 may be acquired. In this case, it is possible to perform processing more simply and at high speed.

  Alternatively, only the first genre code may be checked, and if it matches, the PTS unit of the corresponding chapter section may be acquired, and if not matched, the PTS unit of the chapter section for the common rule may be acquired. Also in this case, it is possible to perform processing more simply.

  Further, in addition to the chapter section for each genre code, a chapter section for the common rule may be prepared, and if the genre code is not found, the chapter section for the common rule may be acquired.

  Further, at the time of chapter generation by the chapter generation unit 114, for example, a category of the program is specified using a genre code given to program information included in an EPG of digital broadcasting, and a chapter is determined using a rule of the specific category. It may be generated. That is, the chapter generation rule may be changed according to the genre code given to the program information for generating the chapter at the time of chapter generation. In this case, it is possible to perform suitable reproduction for each category even when reproduction is performed without searching for a chapter section. That is, it is possible to reduce the amount of processing during reproduction while performing suitable reproduction for each category.

  An option screen for selecting a category according to the user's designation may be displayed. In that case, the PTS unit of the chapter section that matches the category is acquired.

  Also, for the convenience of the system, each chapter position acquired from the reproduction position list acquisition unit 116 is evaluated, and when the preceding and following chapters are at a predetermined interval or less, they are collected as one chapter. The method of grouping chapters may be simply grouped into chapters in a certain direction at the front or rear, but the method of grouping may be different for each program category. For example, in a music program, when the beginning position of a song and the CM position are displayed as chapters at the same time, if the beginning position of a song is detected immediately after the end of the CM, it is summarized at the beginning position of the song located behind, When displaying the chapter positions of the appearance positions included in the dictionary data 124 in other categories, the chapter positions may be collected in the preceding chapter.

  When the progress bar display unit 901 receives a jump request to the next chapter position of the user via the input device 103, the progress bar display unit 901 can jump to the chapter located at the rearmost position from the current reproduction position and reproduce it. Similarly, when a jump request to the previous chapter position is received, it is possible to jump from the current reproduction position to the chapter located closest to the front and reproduce it. However, when a jump request to the previous chapter position is received while playing a playback position within a certain time from the chapter position, the program jumps to the previous two chapters.

  The automatic chapter reproduction method display unit 902 shows the user how to operate the automatic chapter. For example, it is possible to display only when a program capable of automatic chapters is reproduced. Further, if it is deleted together with the progress bar display unit 901 after a certain time from the start of reproduction, the viewing screen can be prevented from being disturbed. It may be displayed again only when the user performs a special operation such as a jump request, fast forward or fast reverse.

  As described above, automatic chapter reproduction can be performed when the user selects program reproduction.

  Of the progress bar display unit 901 and chapter position 904, the one displayed only during automatic chapter playback or the automatic chapter playback method display unit 902 is so-called “chase playback”, that is, recording in the program recording unit and recording in the program playback unit. When playback is performed in parallel, it may be set not to display.

  The recording / playback apparatus according to the present embodiment analyzes caption data during recording and generates caption feature data 122, and generates chapter data 123 immediately after the recording. Sometimes the caption feature data 122 and the chapter data 123 may be generated.

  Further, the recording / playback apparatus according to the present embodiment stores the caption feature data having the caption type information instead of the caption text itself as shown in FIG. If it can be used, all subtitle text data may be stored and analyzed by the chapter generator 114. In addition, when the RAM capacity is small and the caption feature data 122 cannot be stored in the RAM during recording, the caption analysis unit 112 may restrict the caption feature data output. In such a case, the chapter generation unit 114 generates chapters up to the middle of the recorded program.

  The recording / playback apparatus according to the present embodiment generates the chapter data 123 from the digital broadcast caption data, but reflects the scene detection result other than the caption in the chapter data 123 by analyzing video and audio. May be. For example, you may make it output as another chapter section using the telop recognition result in a video, the CM detection result, etc.

  Further, when the recording / playback apparatus and recorded program data 121 in the embodiment are copied or moved from the external storage device 107 to another recording medium, the chapter data 123 may be moved simultaneously. For example, even in a playback-only player, by implementing the playback position acquisition unit 116, automatic chapter playback using subtitles becomes possible.

It is a block diagram which shows the structure of the video recording / reproducing apparatus concerning one Embodiment of this invention. It is a figure which shows the data structure of the data stream in digital broadcasting. It is a figure which shows the format of caption text data. It is a figure which shows the data structure of the chapter data 123. FIG. It is a flowchart which shows the process which the chapter production | generation part 114 produces | generates chapter data. It is a flowchart which shows the detail of a chapter data output process. It is a flowchart which shows the process at the time of program recording. It is a flowchart which shows the process at the time of program recording. It is a figure which shows the example of the user interface of the program reproduction screen which performs the chapter reproduction | regeneration using a subtitle.

Explanation of symbols

DESCRIPTION OF SYMBOLS 101 ... Recording / reproducing part, 102 ... Display apparatus, 103 ... Input device, 104 ... Tuner, 105 ... Antenna, 106 ... RAM, 107 ... External storage device,
DESCRIPTION OF SYMBOLS 110 ... System control part, 111 ... Signal separation part, 112 ... Subtitle analysis part, 113 ... Program recording part, 114 ... Chapter generation part, 116 ... Playback position list acquisition part, 117 ... Program reproduction part, 118 ... Video output part,
120 ... subtitle text data, 121 ... recorded program data, 122 ... dictionary data, 123 ... chapter data,
900: Program playback screen, 901: Progress bar display section, 902: Automatic chapter playback method display section, 903: Program video display section, 904: Chapter position.

Claims (5)

A signal separator that receives digital broadcasts and separates them according to the type of broadcast data;
A caption analysis unit that analyzes caption ES (Elementary Stream) input from the signal separation unit and generates caption feature data including caption type information including a type of a caption sentence and a display time;
A program recording unit that records the broadcast data input from the signal separation unit as recording data in a storage device;
Analyzing the caption feature data, generating chapter data for reproducing a program with a chapter designated by a user, and outputting the chapter data to the storage device;
A playback position list acquisition unit that searches a chapter position corresponding to a program category from the chapter data and acquires a playback position list;
A program playback unit that plays back the recorded data recorded in the storage device and performs playback to change the playback position to the playback position included in the playback position list acquired by the playback position list acquisition unit ;
The recording / playback apparatus, wherein the playback position list acquisition unit acquires each playback position list corresponding to a genre code attached to the program included in the digital broadcast. A signal separator that receives digital broadcasts and separates them according to the type of broadcast data;
A caption analysis unit that analyzes caption ES (Elementary Stream) input from the signal separation unit and generates caption feature data including caption type information including a type of a caption sentence and a display time;
A program recording unit that records the broadcast data input from the signal separation unit as recording data in a storage device;
Analyzing the caption feature data, generating chapter data for reproducing a program with a chapter designated by a user, and outputting the chapter data to the storage device;
A playback position list acquisition unit that searches a chapter position corresponding to a program category from the chapter data and acquires a playback position list;
A program playback unit that plays back the recorded data recorded in the storage device and performs playback to change the playback position to the playback position included in the playback position list acquired by the playback position list acquisition unit;
The recording / playback apparatus, wherein the program playback unit changes the playback position of the recorded data based on each playback position list corresponding to a genre code attached to the program included in the digital broadcast. A signal separator that receives digital broadcasts and separates them according to the type of broadcast data;
A caption analysis unit that analyzes caption ES (Elementary Stream) input from the signal separation unit and generates caption feature data including caption type information including a type of a caption sentence and a display time;
A program recording unit that records the broadcast data input from the signal separation unit as recording data in a storage device;
Analyzing the caption feature data, generating chapter data for reproducing a program with a chapter designated by a user, and outputting the chapter data to the storage device;
A playback position list acquisition unit that searches a chapter position corresponding to a program category from the chapter data and acquires a playback position list;
A program playback unit that plays back the recorded data recorded in the storage device and performs playback to change the playback position to the playback position included in the playback position list acquired by the playback position list acquisition unit;
The reproduction position list acquisition unit, when the genre code to be added to the program included in the digital broadcasting is a plurality of types, that both obtain a plurality of types of playback position list corresponding to the plurality of types of genre code A recording / playback device characterized. A signal separator that receives digital broadcasts and separates them according to the type of broadcast data;
A caption analysis unit that analyzes caption ES (Elementary Stream) input from the signal separation unit and generates caption feature data including caption type information including a type of a caption sentence and a display time;
A program recording unit that records the broadcast data input from the signal separation unit as recording data in a storage device;
Analyzing the caption feature data, generating chapter data for reproducing a program with a chapter designated by a user, and outputting the chapter data to the storage device;
A playback position list acquisition unit that searches a chapter position corresponding to a program category from the chapter data and acquires a playback position list;
A program playback unit that plays back the recorded data recorded in the storage device and performs playback to change the playback position to the playback position included in the playback position list acquired by the playback position list acquisition unit;
The program reproduction unit, when the genre code to be added to the program included in the digital broadcasting is a plurality of types, based on a list of both the plurality of types plurality of types corresponding to the genre code of the playback position list, A recording / reproducing apparatus, wherein a reproduction position of the recorded data is changed. A signal separator that receives digital broadcasts and separates them according to the type of broadcast data;
A caption analysis unit that analyzes caption ES (Elementary Stream) input from the signal separation unit and generates caption feature data including caption type information including a type of a caption sentence and a display time;
A program recording unit that records the broadcast data input from the signal separation unit as recording data in a storage device;
Analyzing the caption feature data, generating chapter data for reproducing a program with a chapter designated by a user, and outputting the chapter data to the storage device;
A playback position list acquisition unit that searches a chapter position corresponding to a program category from the chapter data and acquires a playback position list;
A program playback unit that plays back the recorded data recorded in the storage device and performs playback to change the playback position to the playback position included in the playback position list acquired by the playback position list acquisition unit;
The chapter generation unit changes a chapter generation rule according to a genre code attached to the program included in the digital broadcast.

Images