JP2010183295A - Apparatus for processing subtitle information for subtitle broadcasting including hidden information, program for processing subtitle information, and system for processing subtitle information - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an apparatus for processing subtitle information that keeps synchronous relationship between displayed information and hidden information, displays subtitle using the displayed information, and provides services that fulfill requests of viewers using the hidden information. <P>SOLUTION: The apparatus for processing subtitle information has: a broadcast receiving unit that receives information via broadcast wave; a subtitle information extraction unit that extracts subtitle information from the broadcast wave; a subtitle information selecting and extraction unit that selectively extracts displayed information and hidden information from the subtitle information; a display information processing unit that carried out a processing for displaying the subtitle based on the displayed information; and a hidden information processing unit that carries out a processing for providing additional service based on the hidden information. The subtitle information selecting and extraction unit transmits the display information selectively extracted from the closed cation information to the display information processing unit, and transmits the hidden information selectively extracted from the subtitle information to the hidden information processing unit. The display information and the hidden information are included in part of a subtitle information code that is a code string configuring the subtitle information. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a caption information processing device and a caption information processing system for caption broadcasting including non-display information, and more particularly, to a caption information processing device that processes caption information including non-display information and provides additional services or information. The present invention relates to a caption information processing program and a caption information processing system.

  Conventionally, in subtitle broadcasting, a broadcasting station has subtitle information including a character string code representing a character string to be displayed as a subtitle and a control code for performing display control of the character string to be displayed, such as coordinates, color, and background color. , Broadcast on the broadcast data superimposed on the broadcast data to be broadcast as caption broadcast data, the receiving device on the viewer side receives and demodulates the broadcast wave generated in this way, separates the caption broadcast data, The coordinates, color, background color, etc. of the character string are determined according to the control code, and the caption is displayed based on the character string represented by the character string code of the caption information.

  Even when displaying subtitles in digital broadcasting, a character code representing a character string to be displayed as a subtitle, and a control code for performing display control of the character string to be displayed such as coordinates, color, background color of the character string to be displayed, and the like The information on the language provided and information on whether to display or not are superimposed on the broadcast data to be broadcast and broadcast by broadcast waves. Then, information is processed from the broadcast wave generated in this way in accordance with the viewer's request, and if necessary, language information is acquired and subtitles are displayed (Non-Patent Documents 1 to 3). 5).

  In recent years, programs using Java (registered trademark) technology have been used for digital broadcasting, and are expected in the future (see particularly Non-Patent Documents 4 and 5). Many conventional programming languages were designed on the assumption that they were compiled into native code that depends on the platform such as the CPU, but Java technology was developed with attention to platform independence and compatibility between versions. It has been advanced. Therefore, unlike many conventional programming languages, the Java technology program is designed to be compiled into byte code which is an intermediate language and executed on a Java virtual machine (Java VM).

  According to this technology, a broadcast station transmits subtitle data, a program, and the like to a digital broadcast receiver as a Java virtual machine, so that the digital broadcast receiver on the viewer side can receive a Java application programming interface (hereinafter referred to as “Java”). A predetermined process can be performed on received subtitles, programs, and the like. Since a known technique can be used as a technique for operating a digital broadcast receiver capable of receiving a digital broadcast as a Java virtual machine, a detailed description thereof will be omitted.

ISO / IEC 13818-1: 2007, “Component Synchronization (PTS, DTS)” “Information technology—Generic coding of moving pictures and associated audio information: Systems”. Japan Radio Industry Association, “Data Broadcast Coding and Transmission Methods in Digital Broadcasting”, ARIB STD-B24 5.2 Edition “Part 1: Character Coding [8 Unit Code] [Subtitle / Character Super Coding] (Subtitles), Part 2: BML (Multimedia Content Layout), Part 3: Data Carousel (Broadcast Download) "June 6, 2008 EBU / ETSI, ETSI TS 102 822-3-1 v1.4.1 (2007-11), “Metadata for Broadcasting Content (Metadata Synchronization Method)”, “Broadcast and On-line Services: Search, select, and” rightful use of content on personal storage systems (“TV-Anytime”); Part 3: Metadata; Sub-part 1: Phase 1—Metadata schemas Japan Radio Industry Association, “Application Execution Environment in Digital Broadcasting”, ARIB STD-B23 Version 1.1, “Java Data Broadcasting (AIT Part of Application-Linked Native Code, Xlet Asynchronous Activation, Subtitle Character Code Conversion)”, 2004 February 5 JIS X 0221: 2007 “Character encoding used by Java (caption character encoding)”, JIS X 0221: 2007 “International encoding character set (UCS) —Information technology—Universal Multiple-Octet CodeCCS”

  However, the subtitle broadcast data includes not only subtitle information for displaying subtitles, but also information on the language provided and information on whether to display or not. It is not assumed that processing other than subtitle display such as adjustment of column coordinates, color, and background color is performed. For this reason, digital viewers can be used to meet the needs of viewers, such as raising interest in subtitles and content being broadcast to viewers who view subtitle broadcasts with a digital broadcast receiver, or making it easier to understand. There has been a problem that various accompanying additional services or information cannot be provided.

  Specifically, a broadcast wave broadcasted by subtitle broadcast includes a subtitle character string and information necessary for display control of the character string (hereinafter referred to as “display information”), but is a viewer as digital broadcast content. The information necessary for providing services or information that meets the demands of the user (hereinafter referred to as “non-display information”) was lacking. For this reason, in the digital broadcast receiver, processing other than subtitle display using subtitle information for subtitle broadcast, for example, specifying the content of the subtitle, the speaker who speaks the speech displayed in the subtitle, etc. It was not possible to cause the viewer's receiver to perform a typical process.

  The timing of subtitle broadcasting is extremely important. For example, if the timing for displaying subtitles does not match the video, there is a possibility that the viewer who views the program may be prevented from understanding the content. For this reason, although it is possible to consider a data broadcasting system that uses non-subtitle information other than subtitle information to transmit in a separate file while using subtitle information for subtitle broadcast, it is difficult to ensure synchronization. It has not been used. For example, even if it is attempted to broadcast non-display information in synchronization with subtitle information while superimposing it on broadcast data, subtitle broadcast data on which subtitle information is superimposed is generated as needed in a live broadcast program such as a news program. Then, it is difficult to synchronize the non-display information at an appropriate timing because the configuration of the apparatus is complicated, and the cost is high.

  As for data broadcasting, digital broadcasting has become mainstream, and advanced BS digital broadcasting is planned as next-generation satellite broadcasting. Today, it is as independent as possible on the platform of receivers for digital broadcasting receivers such as CPUs. High-function data broadcasting that can additionally provide various information and services by using this method is being studied.

  The present invention has been made in view of the above-described problems. With a simple configuration, the synchronization relationship between display information and non-display information is easily maintained, and subtitles are displayed using display information, while non-display is performed. It is an object of the present invention to provide a caption information processing device, a caption information processing program, and a caption information processing system that can provide a service or information that meets a viewer's request using information.

  According to the first aspect of the present invention, a broadcast receiving unit that receives subtitle broadcast data including non-display information via a broadcast wave, and a subtitle information extraction unit that extracts subtitle information from the broadcast wave received by the broadcast receiver. A subtitle information selection and extraction unit that selectively extracts display information and non-display information from the subtitle information extracted by the subtitle information extraction unit, and a display information processing unit that performs processing for displaying subtitles based on the display information And a non-display information processing unit that performs processing for providing an additional service based on non-display information, wherein the subtitle information selection and extraction unit displays the display information selectively extracted from the subtitle information Non-display information selectively sent from the subtitle information is sent to the non-display information processing unit, and the display information and the non-display information are code strings constituting the subtitle information. Subtitle information code Characterized in that it is included in part, to provide a subtitle information processing apparatus.

  With this configuration, the caption information processing apparatus of the present invention includes a broadcast receiving unit that receives caption broadcast data including non-display information via a broadcast wave, and caption information that extracts caption information from the broadcast wave received by the broadcast receiving unit. An extraction unit, a caption information selection extraction unit that selectively extracts display information and non-display information from the caption information extracted by the caption information extraction unit, and display information processing that performs processing for displaying captions based on the display information A non-display information processing unit that performs processing for providing an additional service based on the non-display information, and the subtitle information selection and extraction unit displays the display information selectively extracted from the subtitle information. The non-display information selectively extracted from the subtitle information is sent to the non-display information processing unit, and the display information and the non-display information are part of a subtitle information code that is a code string constituting the subtitle information. Included. Providing a service or information that responds to a viewer's request using non-display information while maintaining a synchronized relationship between display information and non-display information easily and displaying subtitles using display information. Can do.

  Furthermore, in the caption information processing device according to the present invention, the code representing the non-display information included in the caption information code is a code of a portion of the caption information code whose start position and end position are specified by a predetermined code. The non-display information processing unit may be configured to identify the code representing the non-display information based on the predetermined code and extract the non-display information.

  With this configuration, in addition to the above-described features, the caption information processing device according to the present invention converts a code representing non-display information included in the caption information code into a start position and an end position according to a predetermined code in the caption information code. The non-display information processing unit can identify the code representing the non-display information based on the predetermined code and extract the non-display information based on the predetermined code. The non-display information can be identified and extracted while easily maintaining the synchronization relationship between the display information and the non-display information.

  Furthermore, in the caption information processing device of the present invention, the non-display information processing unit includes a Java API (Java application programming interface) and a Java virtual machine, and the non-display information processing unit further includes the display information and A given Java program may be executed in synchronization with the non-display information.

  With this configuration, in addition to the above-described features, the closed caption information processing apparatus of the present invention further includes a Java API (Java application programming interface) and a Java virtual machine. Further, the unit can execute a given Java program according to the non-display information in synchronization with the display information, so that the synchronization relationship between the display information included in the caption information and the non-display information can be easily achieved with a simple configuration. While displaying subtitles using display information, and in a manner that is as independent of the viewer's digital broadcast receiver platform as possible, such as a CPU, using non-display information to meet the viewer's request Responding services or information can be provided.

  Furthermore, in the caption information processing device according to the present invention, the caption information selection / extraction unit extracts a part or all of the display information related to the non-display information together with the non-display information selectively extracted from the caption information. Sending to the non-display information processing unit, the non-display information processing unit further processes a part or all of the display information related to the non-display information, and performs a process for providing an additional service You may do it.

  With this configuration, in addition to the above-described features, the caption information processing device according to the present invention includes display information related to the non-display information, together with the non-display information selectively extracted from the subtitle information by the subtitle information selection / extraction unit. A part or all of the information is sent to the non-display information processing unit, and the non-display information processing unit further processes a part or all of the display information related to the non-display information to provide an additional service. Therefore, while maintaining the synchronization relationship between display information and non-display information easily and displaying subtitles using display information, not only non-display information but also display information related to non-display information as necessary A service or information that meets the viewer's request can be provided using a part or all of the information.

  Furthermore, in the caption information processing device of the present invention, the code representing the display information included in the caption information code, the code related to the non-display information is a second of the caption information codes. The non-display information processing unit is a code representing the display information on the basis of the second predetermined code, wherein the start information and the end position are specified by a predetermined code. The display information related to the non-display information may be extracted by identifying a code related to the non-display information.

  With this configuration, the caption information processing device of the present invention is a code representing display information included in the caption information code, but the code related to the non-display information is the second predetermined information in the caption information code. The non-display information processing unit is a code representing display information based on the second predetermined code, but is related to the non-display information. Since the display information related to the non-display information can be extracted by identifying the code, the display information related to the non-display information can be easily maintained with a simple configuration while maintaining the synchronization relationship between the display information and the non-display information. Can be identified and extracted.

  Furthermore, in the caption information processing device of the present invention, the non-display information processing unit includes a Java API (Java application programming interface) and a Java virtual machine, and the non-display information processing unit further displays the display information. The display information to be processed may be identified, and a given Java program may be executed in accordance with the display information to be processed by the non-display information.

  With this configuration, the caption information processing device of the present invention has a Java API (Java application programming interface) and a Java virtual machine in addition to the above-described features, and the hidden information processing unit Furthermore, although it is a code | symbol showing display information, since the display information made into a process target can be identified and a given Java program can be executed according to the display information which a non-display information makes a process object, it is a simple structure. The display information and the non-display information can be easily synchronized, and the display information is used to display subtitles. However, it is as independent as possible from the platform of the viewer's digital broadcast receiver such as a CPU. In this manner, a service or information that meets the viewer's request using non-display information can be provided.

  According to a second aspect of the present invention, a broadcast station that broadcasts subtitle broadcast data including non-display information via a broadcast wave, and a subtitle information processing apparatus that receives the subtitle broadcast data and processes subtitle information, In the closed caption information processing system, the broadcast station broadcasts the closed caption information including display information and non-display information superimposed on the closed caption broadcast data, and the closed caption information processing apparatus transmits the closed caption from the broadcast wave. A broadcast receiving unit that receives information, a caption information extracting unit that extracts caption information from broadcast waves received by the broadcast receiving unit, and display information and non-display information are selectively selected from the caption information extracted by the caption information extracting unit. A subtitle information selection / extraction unit that extracts information, a display information processing unit that performs processing for displaying subtitles based on display information, and a non-display information processing that performs processing for providing additional services based on non-display information The subtitle information selection and extraction unit sends display information selectively extracted from the subtitle information to the display information processing unit, and displays non-display information selectively extracted from the subtitle information. Provided is a caption information processing system, wherein the display information and the non-display information are transmitted to an information processing unit and are included in a part of a caption information code which is a code string constituting the caption information.

  With this configuration, the caption information processing system of the present invention includes a broadcast station that broadcasts caption broadcast data including non-display information via broadcast waves, a caption information processing apparatus that receives caption broadcast data and processes caption information, and , And the broadcast station broadcasts the caption information composed of display information and non-display information superimposed on the caption broadcast data, and the caption information processing apparatus receives the caption information from the broadcast wave. Broadcast receiving unit, subtitle information extracting unit for extracting subtitle information from broadcast waves received by the broadcast receiving unit, and subtitle information for selectively extracting display information and non-display information from the subtitle information extracted by the subtitle information extracting unit A selection extraction unit; a display information processing unit that performs processing for displaying subtitles based on display information; and a non-display information processing unit that performs processing for providing additional services based on non-display information. The subtitle information selection and extraction unit sends display information selectively extracted from the subtitle information to the display information processing unit, and sends non-display information selectively extracted from the subtitle information to the non-display information processing unit. Since the non-display information is included in a part of the subtitle information code which is a code string constituting the subtitle information, the display information can be used with a simple configuration while easily maintaining the synchronization relationship between the display information and the non-display information. Thus, while displaying subtitles, it is possible to provide a service or information that meets the viewer's request using non-display information.

  Furthermore, in the caption information processing system of the present invention, the non-display information processing unit includes a Java API (Java application programming interface) and a Java virtual machine, and is synchronized with the display information according to the non-display information. A given Java program may be executed. The given Java program may be, for example, a program created in Java that is broadcast by a broadcasting station as a data broadcast program.

  With this configuration, in the closed caption information processing system of the present invention, the non-display information processing unit has a Java API (Java application programming interface) and a Java virtual machine, and is given according to the non-display information in synchronization with the display information. Since the Java program can be executed, the synchronization relationship between the display information and the non-display information included in the caption information can be easily maintained with a simple configuration, while displaying the caption using the display information, It is possible to provide services or information that meet the viewer's request using non-display information in a manner that is as independent of the viewer's digital broadcast receiver platform as possible.

  According to a third aspect of the present invention, there is provided a caption information processing program for executing caption information processing, a broadcast receiving unit that receives caption broadcast data including non-display information via a broadcast wave, and the broadcast reception A subtitle information extraction unit that extracts subtitle information from broadcast waves received by the unit, a subtitle information selection extraction unit that selectively extracts display information and non-display information from the subtitle information extracted by the subtitle information extraction unit, and display information A display information processing unit that performs processing for displaying subtitles based on the information processing unit, and a non-display information processing unit that performs processing for providing additional services based on the non-display information. A computer that sends display information selectively extracted from the subtitle information to the display information processing unit and sends non-display information selectively extracted from the subtitle information to the non-display information processing unit. The display information and the non-display information are included in a part of a caption information code that is a code string constituting the caption information, thereby causing the computer to function as a digital broadcast receiving system. A closed caption information processing program is provided.

  With this configuration, the subtitle information processing program of the present invention is a subtitle information processing program for executing subtitle information processing, a broadcast receiving unit that receives subtitle broadcast data including non-display information via a broadcast wave, A subtitle information extraction unit that extracts subtitle information from broadcast waves received by the broadcast reception unit; and a subtitle information selection extraction unit that selectively extracts display information and non-display information from the subtitle information extracted by the subtitle information extraction unit; A display information processing unit that performs processing for displaying subtitles based on display information; and a non-display information processing unit that performs processing for providing supplementary services based on non-display information. The selection extraction unit sends display information selectively extracted from the caption information to the display information processing unit, and sends non-display information selectively extracted from the caption information to the non-display information processing unit. And the display information and the non-display information are included in a part of a caption information code that is a code string constituting the caption information, thereby allowing the computer to function as a digital broadcast receiving system. A service that responds to viewers' demands using non-display information while displaying subtitles using display information while maintaining the synchronized relationship between display information and non-display information easily with a simple configuration. Or you can provide information.

  Conventionally, subtitle data used in subtitle broadcasting can handle only data related to the display of subtitles and cannot handle data unrelated to display of additional semantic information for character strings given by subtitles. As described above, according to the present invention, with a simple configuration, the display information and the non-display information are easily maintained in synchronization, and the display information is used to display the subtitles. Services or information can be provided in response to viewer demand. Furthermore, it is also possible to provide services or information that meet the viewer's request using non-display information in a manner that is as independent of the viewer's digital broadcast receiver platform as possible, such as a CPU.

FIG. 3 is a schematic configuration diagram of a main part that generates caption broadcast data in the caption broadcast broadcasting device on the broadcast station side that configures the caption information processing system for caption broadcasting including the non-display information according to the first embodiment of the present invention. is there. It is a figure which shows an example of the data structure of the caption data used in the caption information processing system of the 1st Embodiment of this invention. It is a schematic block diagram of the caption information processing apparatus which is the principal part which processes caption broadcast data in the digital broadcast receiver by the side of the viewer which comprises the caption information processing system of the 1st Embodiment of this invention. It is a flowchart explaining the operation | movement which the caption information processing apparatus of FIG. 3 performs. It is a figure which shows an example of the data structure of the caption data used in the caption information processing system of the 2nd Embodiment of this invention. The block diagram of the application process part 25 of the caption information processing apparatus which comprises the caption information processing system of the 3rd Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
[First Embodiment]

  FIG. 1 is a schematic configuration diagram of a main part that generates subtitle broadcast data in a subtitle broadcast device on the broadcast station side that constitutes the subtitle information processing system according to the first embodiment.

  As shown in FIG. 1, the main part of the broadcast apparatus 10 that generates caption broadcast data is a broadcast data input part 11 that inputs broadcast data, a caption data input part 12 that inputs caption data, and a broadcast data input part 11. The multiplexing unit 14 that multiplexes the broadcast data input to the subtitle data and the subtitle data input to the subtitle data input unit 12, and performs processing such as modulation on the character broadcast data to which the subtitle data is added by the multiplexing unit 14. Thereafter, for example, a transmission unit 15 that broadcasts as a broadcast wave using an antenna (not shown) is provided.

  The broadcast data input to the broadcast data input unit 11 may include video data, audio data, and the like. In the present embodiment, subtitle data input to the subtitle data input unit 12 displays a character string code representing a character string to be displayed as a subtitle, coordinates, color, background color, and the like used in conventional subtitle broadcasting. Information for providing various additional services or information accompanying subtitle broadcasting is included in addition to subtitle information including control codes for performing display control of character strings.

  In the present embodiment, an example of the data structure of the caption data input to the caption data input unit 12 is shown in FIG.

  As shown in FIG. 2, subtitle data constituting the subtitle information includes control information 101 for designating display of a character string to be displayed as subtitles, specifying character string coordinates and colors, and character strings to be displayed as subtitles. Display information 103 consisting of character information 102 indicating non-display information, non-display information start code [A] 104 indicating the start of non-display information, non-display additional information 105, non-display information end code indicating the end of non-display information [/ Non-display information 110 including “A” 106. Here, the non-display information 110 including the non-display information start code [A] 104, the non-display additional information 105, and the non-display information end code [/ A] 106 is not interpreted as a display target and is selected and extracted later. The data is not sent to the display information processing unit 24 by the unit 23.

  In the example of FIG. 2, the non-display additional information 105 “50 sound line” is embedded by the non-display information start code [A] 104 and the non-display information end code [/ A] 106.

  FIG. 3 is a schematic configuration diagram of a caption information processing apparatus, which is a main part that processes caption broadcast data, in the digital broadcast receiver on the viewer side that constitutes the caption information processing system of the present embodiment.

  As shown in FIG. 3, the caption information processing device 20 receives a broadcast wave broadcast from a broadcast station using, for example, an antenna (not shown), and performs processing such as modulation, Broadcast data received and demodulated by the receiving unit 21 is demultiplexed to extract subtitle data having subtitle information, and display information and non-display from the subtitle data extracted by the demultiplexer 22 A selection extraction unit 23 that selectively extracts information, and a display information processing unit 24 that is connected to the display 26 and performs processing for displaying subtitles on the display 26 based on the display information extracted by the selection extraction unit 23. And an application processing unit 25 that performs processing for providing additional services or additional information based on the non-display information extracted by the selection extraction unit 23. The display information processing unit 24 may include a caption decoder, for example, and may decode the display information of the caption data so that the display information can be displayed on the subsequent display 26. For ease of explanation, the receiving unit 21 and the demultiplexing unit 22 have also been described. However, according to the present invention, the receiving unit 21 and the demultiplexing unit 22 are not essential for the caption information processing apparatus 20 and are selected and extracted. 23, the display information processing unit 24, and the application processing unit 25, and the character data input by the selection extraction unit 23 may be acquired by any method other than the reception unit 21 and the demultiplexing unit 22.

  FIG. 4 is a flowchart for explaining operations executed by the caption information processing apparatus 20 configured as described above. The operation of the caption information processing apparatus 20 will be described with reference to FIG. The following processing is executed by CPU control (not shown) included in the caption information processing device 20.

  First, the receiving unit 21 of the caption information processing apparatus 20 receives broadcast data using, for example, an antenna and performs processing such as modulation. The demultiplexing unit 22 demultiplexes the broadcast data processed by the receiving unit 21 and extracts caption data (step S101).

  Next, the selection extraction unit 23 processes the caption data extracted by the demultiplexing unit 22 to selectively extract display information and non-display information, and displays the display information on the display information processing unit 24. Information is sent to the application processing unit 25.

  More specifically, the selection extraction unit 23 first sends the caption data input from the demultiplexing unit 22 to the display information processing unit 24 as display information (step S102). The selection extraction unit 23 always determines whether or not the non-display information start code [A] 104 is detected (S103), and inputs the subtitles until it is determined that the non-display information start code [A] 104 is detected. Data is sent to the display information processing unit 24 as display information.

  If the selection extraction unit 23 determines that the non-display information start code [A] 104 has been detected, then the subtitle data input from the demultiplexing unit 22 is sent to the application processing unit 25 as non-display information (S104). The selection extraction unit 23 always determines whether or not the non-display information end code [/ A] 106 has been detected (S103), and continues to input until it is determined that the non-display information end code [/ A] 106 has been detected. The closed caption data is sent to the application processing unit 25 as non-display information.

  If the selection extraction unit 23 determines that the non-display information end code [/ A] 106 has been detected, the process returns to step S101, and the subtitle data input from the demultiplexing unit 22 is displayed again as display information in the display information processing unit 24. Send out (S101).

As described above, when the reception unit 21 receives the broadcast data including the caption data, the caption information processing device 20 according to the present embodiment extracts the caption data by the demultiplexing unit 22 and includes the caption data in the caption data by the selection extraction unit 23. Display information to be displayed is delivered to the display information processing unit 24, and non-display information is delivered to the application processing unit 25. The application processing unit 25 constitutes a non-display information processing unit.

  In this example, the application processing unit 25 thus receives the non-display information “50 sound line” from the selection extraction unit 23. The display information processing unit 24 decodes the display information. For example, when the display time given by the subtitle transmission protocol decoded by the receiver comes, the display information processing unit 24 outputs the decoded display information to the display 26 to display the subtitle. May be. The application processing unit 25 executes, for example, a predetermined program at this timing, and the content of the subtitle is “50-sound line” based on the non-display information “50-sound line”. For example, the additional service or information that allows the viewer to recognize in various methods such as video or audio may be provided in various methods such as video or audio. The hidden information may include a program or information for starting a given program.

  As described above, the caption information processing apparatus 20 according to the present invention includes a receiving unit 21 that receives information via a broadcast wave, a demultiplexing unit 22 that extracts caption data from the broadcast wave received by the receiving unit 21, and a demultiplexing unit. A selection extraction unit 23 that selectively extracts display information and non-display information from subtitle data extracted by the unit 22, and a display information processing unit 24 that processes the display information extracted by the selection extraction unit 23 and displays it as subtitles. And an application processing unit 25 that performs a process for providing an additional service based on the non-display information extracted by the selection extraction unit 23, and the display information and the non-display information are code strings that constitute subtitle data. The subtitle information code is included in a part of the subtitle information code so that the display information and the non-display information can be easily synchronized while the subtitle is displayed using the display information. It is possible to provide a service or information meet the needs of the viewer using a broadcast.

  In the above-described embodiment, the selection extraction unit 23 selectively extracts display information and non-display information from the caption data extracted by the demultiplexing unit 22, and displays the display information in the display information processing unit 24 as an application. Although the application processing unit 25 has been described as processing non-display information that is sent to the processing unit 25, the present invention is not limited to this. In order to provide a service or information desired by the viewer, for example, it is assumed that the application processing unit 25 needs related display information in addition to non-display information. The present invention is also applicable to such a case. In the following embodiment, a case will be described in which the selection extraction unit 23 sends not only non-display information but also part or all of display information related to non-display information to the application processing unit 25 as necessary.

[Second Embodiment]
In the caption information processing system according to the second embodiment, the data structure of caption data broadcast from the broadcasting device on the broadcasting station side and the selection extraction unit 23 include not only hidden information but also hidden information as necessary. Except for the point that part or all of the display information related to is sent to the application processing unit 25, it is almost the same as the caption information processing system of the first embodiment. The same reference numerals are given to the configurations substantially the same as those of the above-described embodiment, and the detailed description is omitted.

  In the present embodiment, an example of the data structure of the caption data input to the caption data input unit 12 of the broadcast apparatus 10 is shown in FIG.

  As shown in FIG. 5, subtitle data constituting subtitle information represents control information 101 for performing display control of a character string to be displayed by designating coordinates and colors of the character string to be displayed, and a character string to be displayed. Display information consisting of character information 102, non-display information start code [A] 104 indicating the start of non-display information, non-display additional information 105, non-display information end code [/ A] 106 indicating the end of non-display information In addition to the non-display information, the related display information start code [B] 107 indicating the start of the display information related to the non-display information, the related display information end code [/] indicating the end of the display information related to the non-display information B "108 is also included as non-display information. Along with non-display information start code [A] 104, non-display additional information 105, non-display information end code [/ A] 106, related display information start code [B] 107 and related display information end code [/ B] 108 Is not interpreted as a display target, and is not processed by the display information processing unit 24.

  In the example of FIG. 5, the non-display additional information 105 “speaker 1” is embedded by the non-display information start code [A] and the non-display information end code [/ A]. Furthermore, “speaker 1” specified by the non-display information start code [A] and the non-display information end code [/ A] by the related display information start code [B] and the related display information end code [/ B]. It is specified for which part of the caption data the non-display additional information 105 is displayed. In this example, the target area in the display information is specified by the related display information start code [B] and the related display information end code [/ B], followed by the non-display information start code [A] and the non-display information end. The relationship is clarified by the fact that the non-display information is designated by the code [/ A].

  The caption decoder included in the display information processing unit 24 includes a related display information start code [B], a related display information end code [/ B], a non-display information start code [A], and a non-display information end code [ / A] itself, and the non-display additional information 105 specified by the non-display information start code [A] and the non-display information end code [/ A] are not interpreted as display targets and are displayed on the display 26. There is no. On the other hand, the application processing unit 25 to which the non-display information is passed executes a predetermined program, and “speaker 1” designated by the non-display information start code [A] and the non-display information end code [/ A]. Specified by the related display information start code [B] and the related display information end code [/ B] from the display information “I want to eat more when I am hungry”. It is also possible to provide additional service or additional information for recognizing that the information is related to the display information “I want to eat more”.

  As described above, in the caption information processing apparatus according to the present embodiment, in addition to the features of the caption information apparatus according to the first embodiment, caption data broadcast from the broadcasting apparatus on the broadcasting station side is included in the caption information code. A code representing display information, but a code related to non-display information is configured by a code of a portion in which a start position and an end position are specified by a second predetermined code among subtitle information codes The selection extraction unit 23 of the caption information processing device 20 refers to the second predetermined code to display not only the non-display information but also part or all of the display information related to the non-display information as necessary. Since it is sent to the application processing unit 25, while maintaining the synchronization relationship between the display information and the non-display information easily and displaying the subtitles using the display information, not only the non-display information but also the non-display as necessary Display information related to information It is possible to provide a service or information meet the demands of viewers using some or all of the.

According to the present invention, the non-display information may include a Java program as one of information or a program for performing various processes using non-display data, or may be configured to start a given Java program. Also good. In the following embodiment, a case will be described in which the non-display information includes a Java program or includes information for starting a given Java program.
[Third Embodiment]

  A caption information processing system according to the third embodiment transmits / receives caption broadcast data using Java technology between a digital broadcast receiver on the broadcast station side and the viewer side, and an application processing unit executes an application program using a Java virtual machine. Is the same as the caption information processing system of the first embodiment or the caption information processing system of the second embodiment. The same reference numerals are given to the configurations substantially the same as those of the above-described embodiment, and the detailed description is omitted.

  In the present embodiment, the Java program executed by the application processing unit 25 is executed by the Java virtual machine independently of the platform of the digital broadcast receiver operated by the viewer. FIG. 6 shows an example of the software configuration of the application processing unit 25 of the caption information processing apparatus.

  As shown in FIG. 6, the application processing unit includes a Java data application A1, a Java class library A2, a Java virtual machine A3, a native code A4, a driver A5, an OSA6, and hardware A7. Yes. Although not limited to this, for example, an Xlet application may be used as the Java data application A1.

  The Java class library A2 includes an application management unit that collects programs related to application management, a transport stream (hereinafter referred to as “TS”) acquisition, a TS acquisition that collects programs related to transfer control, a transfer control unit, and an image / audio. AV (Audio Visual) playback control unit, which collects programs related to playback control of files, or DSM- which collects programs related to control of access to files and streams in the ISO / IEC 13818-6 digital interactive service, JMF (Java Media Framework) unit, ISO / IEC 13818-6 CC (Digital Storage Media-Command and Control) control unit, other MHP (Multimedia Home Platform) ) MHP library of related programs, extension libraries, for example, includes a PBP (Personal Basis Profile) Java library of programs on such 0.1.

  The native code A4 includes a DTV (Digital Television) middleware, a system management unit, a system common library, an I / O (input / output) control unit, and a graphics control unit. For example, Linux may be used as the OSA 6 on which the hardware A7 operates. The Java class library A2 and the native code A4 are linked by a Java Naive Interface (JNI). JNI is a Java API for using a native code program developed in another language (for example, C language, C ++ language, etc.) from a Java program, that is, from a program developed in the Java language to another language. This is an API for using a native code program (a program that can be executed as it is on a specific platform) developed in the above. This native code A4 absorbs the different operating environment for each receiver and operates the Java virtual machine. Accordingly, various services can be provided with a simple configuration using Java subtitle broadcast data and in a manner independent of the viewer's digital broadcast receiver platform.

  The caption information processing apparatus and caption information processing system according to various embodiments have been described above. The caption information processing apparatus of the present invention can be operated by a caption information processing program that includes a CPU and a memory and causes a general computer to function as the above-described units. The caption information processing apparatus program can be distributed via a communication line, or can be distributed by writing on a recording medium such as a CD-ROM.

DESCRIPTION OF SYMBOLS 10 Broadcast apparatus 11 Broadcast data input part 12 Subtitle data input part 14 Multiplexer 20 Subtitle information processing apparatus 21 Receiving part (broadcast receiving part)
22 Demultiplexer (Subtitle information extractor)
23 Selection extraction unit (caption information selection extraction unit)
24 Display processing unit (Display information processing unit)
25 Application processing unit (non-display information processing unit)
26 Display 101 Control information 102 Character information 103 Display information 104 Non-display information start code (predetermined code, start code)
105 Non-display additional information 106 Non-display information end code (predetermined code, end code)
107 Related display information start section (second predetermined code)
108 Related display information end part (second predetermined code)
110 Hidden information

Claims (9)

A broadcast receiving unit that receives subtitle broadcast data including non-display information via a broadcast wave;
A caption information extraction unit that extracts caption information from a broadcast wave received by the broadcast reception unit;
A caption information selection extraction unit that selectively extracts display information and non-display information from the caption information extracted by the caption information extraction unit;
A display information processing unit that performs processing for displaying subtitles based on display information;
A non-display information processing unit that performs processing for providing an additional service based on non-display information,
The subtitle information selection extraction unit sends display information selectively extracted from the subtitle information to the display information processing unit, and sends non-display information selectively extracted from the subtitle information to the non-display information processing unit. And
The display information processing apparatus according to claim 1, wherein the display information and the non-display information are included in a part of a caption information code which is a code string constituting the caption information. The code representing the non-display information included in the subtitle information code is configured by a code of a portion in which the start position and the end position are specified by a predetermined code in the subtitle information code,
2. The caption information processing apparatus according to claim 1, wherein the non-display information processing unit identifies a code representing the non-display information based on the predetermined code and extracts the non-display information. . The non-display information processing unit has a Java API (Java application programming interface) and a Java virtual machine,
The caption information processing apparatus according to claim 1, wherein the non-display information processing unit further executes a given Java program in accordance with the non-display information in synchronization with the display information. The subtitle information selection extraction unit sends part or all of the display information related to the non-display information to the non-display information processing unit together with the non-display information selectively extracted from the subtitle information,
The caption information processing apparatus according to claim 1, wherein the non-display information processing unit further performs a process for providing an additional service by processing a part or all of the display information related to the non-display information. . A code representing the display information included in the subtitle information code, but the code related to the non-display information has a start position and an end position specified by a second predetermined code in the subtitle information code Is constituted by the code of the part
The non-display information processing unit is a code representing the display information on the basis of the second predetermined code, and identifies a code related to the non-display information, and relates to the non-display information. 5. The caption information processing apparatus according to claim 4, wherein display information is extracted. The non-display information processing unit has a Java API (Java application programming interface) and a Java virtual machine,
The non-display information processing unit is a code representing the display information, and identifies display information to be processed, and executes a given Java program according to the display information to be processed by the non-display information. The closed caption information processing apparatus according to claim 5, wherein: A caption information processing system comprising: a broadcast station that broadcasts caption broadcast data including non-display information via broadcast waves; and a caption information processing device that receives the caption broadcast data and processes caption information,
The broadcast station broadcasts the caption information composed of display information and non-display information superimposed on the caption broadcast data,
The caption information processing apparatus
A broadcast receiver for receiving the caption information from the broadcast wave;
A caption information extraction unit that extracts caption information from a broadcast wave received by the broadcast reception unit;
A caption information selection extraction unit that selectively extracts display information and non-display information from the caption information extracted by the caption information extraction unit;
A display information processing unit that performs processing for displaying subtitles based on display information;
A non-display information processing unit that performs processing for providing an additional service based on non-display information,
The subtitle information selection extraction unit sends display information selectively extracted from the subtitle information to the display information processing unit, and sends non-display information selectively extracted from the subtitle information to the non-display information processing unit. And
The subtitle broadcast system, wherein the display information and the non-display information are included in a part of a subtitle information code that is a code string constituting the subtitle information. The non-display information processing unit has a Java API (Java application programming interface) and a Java virtual machine,
8. The closed caption information processing system according to claim 7, wherein a given Java program is executed according to the non-display information in synchronization with the display information. A caption information processing program for executing caption information processing,
A broadcast receiving unit that receives subtitle broadcast data including non-display information via a broadcast wave;
A caption information extraction unit that extracts caption information from a broadcast wave received by the broadcast reception unit;
A caption information selection extraction unit that selectively extracts display information and non-display information from the caption information extracted by the caption information extraction unit;
A display information processing unit that performs processing for displaying subtitles based on display information;
A non-display information processing unit that performs processing for providing an additional service based on non-display information,
The caption information selection extraction unit sends display information selectively extracted from the caption information to the display information processing unit, and sends non-display information selectively extracted from the caption information to the non-display information processing unit. Function as a digital broadcast receiver,
The display information and the non-display information are included in a part of a caption information code that is a code string constituting the caption information, thereby causing a computer to function as a digital broadcast receiving system. program.

Images