JP7206449B2 - Broadcast receiving terminal equipment - Google Patents

Description

The present invention relates to a broadcast receiving terminal device, and more particularly to a broadcast receiving terminal device adapted to a digital broadcasting service system.

2. Description of the Related Art In television broadcasting services, broadcasters use various techniques to add effects to the programs they provide in order to increase the interest of viewers. For example, in sports programs and the like, a technique is adopted in which the commentator synthesizes real-time images captured by a TV camera on site with an image of handwritten pen input by a commentator using a so-called touch panel computer, while the commentator explains this. ing. More specifically, in a golf program, the commentator superimposes the slope of the green, the direction of the grass grain, and the target putting line on the camera image by handwriting, and then explains it. ing.

For example, Patent Document 1 below is known as a technique for synthesizing such a camera image and a handwritten image. That is, Patent Literature 1 discloses an image synthesizing device that synthesizes a manually input image and an image captured by a camera in conjunction with the camera parameters of the camera.

On the other hand, in current television broadcasting services, programs are sometimes provided by audio multiplex broadcasting (for example, dual audio broadcasting) in which a plurality of sounds are multiplexed into one program. For example, under audio multiplexing, it is common for the commentator's voice in a program as described above to be broadcast using the primary audio channel, with alternatively switchable secondary audio channels for other commentators and guests. etc. will be explained while talking.

Japanese Patent Application Laid-Open No. 2007-323418

In a program using the technique of synthesizing a camera image and a handwritten pen-input image as described above, even if the viewer selects the sub-audio, for example, as shown in FIG. An image of handwritten pen input by an audio channel commentator is displayed. Therefore, under audio multiplex broadcasting, for viewers who have selected the sub-audio channel, the images that have been handwritten with a pen and inserted into the camera image have no relation to the content of the sub-audio and are meaningless. Sometimes I feel annoyed.

SUMMARY OF THE INVENTION In view of the above, an object of the present invention is to provide a broadcasting service capable of hiding an insert image that is not related to a selected audio channel in the display contents of a program provided to a viewer. .

More specifically, one of the objects of the present invention is to provide an audio channel (audio mode) selected by a viewer in a program in which camera video and other inserted images are superimposed and synthesized and provided to the viewer. It is an object of the present invention to provide a broadcast receiving terminal device and a display control method capable of displaying or hiding the insertion image in conjunction with the display.

Another object of the present invention is to provide a program in which a camera image and another insert image are superimposed and provided to a viewer, even if the insert image related to an audio channel is It is an object of the present invention to provide a broadcast receiving terminal device and a display control method capable of selectively displaying or hiding the inserted image.

The present invention for solving the above-mentioned problems includes the matters specifying the invention or the technical features described below.

According to one aspect of the present invention, there is provided a broadcast receiving terminal device adapted to a digital broadcast service using a broadcast signal based on a program stream in which a plurality of streams based on program material data constituting a program are multiplexed. The broadcast receiving terminal device is a front end that generates the program material data including at least video data, first audio data, second audio data, and character/graphic data based on the broadcast signal of the received program. a processing unit, a display control unit for controlling display of a program image on a screen of a display device based on display data, and audio based on either the first audio data or the second audio data is output from the speaker. The display control unit superimposes the character graphic data on the video data in conjunction with the output of either the first audio data or the second audio data selected according to the operation of the viewer. The display data is generated by synthesizing.

The front-end processing unit includes a demodulation unit that demodulates the broadcast signal into the program stream, and converts the demodulated program stream into at least a video stream, a first audio stream, a second audio stream, and a text/graphics stream. and a decoding unit for decoding the video stream, the first audio stream, the second audio stream, and the text/graphic stream.

When the first audio data is selected, the display control unit performs control such that the character graphic data is superimposed on the video data, and when the second audio data is selected. , the character graphic data is not superimposed on the video data.

Further, the display control unit controls not to superimpose the character/figure data on the video data when the viewer further performs the operation after the first audio data is selected. obtain.

Also, the present invention according to another aspect is a broadcast receiving terminal adapted for digital broadcast service. The broadcast receiving terminal device includes a front-end processing unit that generates at least video data, first audio data, second audio data, and character/graphic data based on a broadcast signal of a received program; a display control unit for controlling display of a program image in either the form or the second form on a screen of a display device; and a speaker for outputting sound based on either the first audio data or the second audio data and a voice control unit that controls to be output from. Here, the program image of the first form is an image including at least a moving image based on the video data and a character/graphic image based on the character/graphic data. Further, the program image of the second form is an image that includes the moving image but does not include the character/graphic image, and the display control unit controls that the sound based on the first audio data is output from the speaker. When controlled to be output, control is performed so that the program image of the first form is displayed on the screen. Further, the display control unit controls to display the program image of the second form on the screen when the sound based on the second audio data is controlled to be output from the speaker. do.

Further, the display control section may include a switching control section for controlling whether or not to output the character and graphic data, and a synthesizing section for synthesizing the video data and the character and graphic data. The switching control section may control to output the character graphic data to the synthesizing section when the voice based on the first audio data is controlled to be output from the speaker. Further, the switching control section may control not to output the character/graphic data to the synthesizing section when the sound based on the second audio data is controlled to be output from the speaker.

The character graphic data may include at least first character graphic data and second character graphic data. When the program control information generated based on the broadcast signal includes information designating the display of the character/graphic image in the first audio mode, the switching control unit converts the first character/graphic data to It can be controlled to output to the synthesizing unit.
When the program control information includes information designating the display of the character/graphic image in the second audio mode, the second character/graphic data is controlled to be output to the synthesizing unit .

Also, the present invention according to another aspect is a broadcast receiving terminal adapted for digital broadcast service. The broadcast receiving terminal device includes a front-end processing unit that generates at least video data, audio data, and character/graphic data based on a broadcast signal of a received program; A display control section for controlling display of a program image on a screen of a display device, and a sound control section for controlling sound based on the audio data to be output from a speaker. Here, the program image of the first type is an image including at least a moving image based on the video data and a character/graphic image based on the character/graphic data, and the program image of the second type is the moving image. is an image that contains but does not contain the character graphic image. Then, when the program is configured in either a monaural broadcasting system or a stereo broadcasting system, the display control unit responds to operation of an audio switching button of a remote controller associated with the broadcast receiving terminal device, Control is performed so that the program image of either the first form or the second form is selectively displayed on the screen.

Further, the display control section may include a switching control section for controlling whether or not to output the character and graphic data, and a synthesizing section for synthesizing the video data and the character and graphic data. The switching control section can control to switch whether or not to output the character/graphic data to the synthesizing section each time the voice switching button is operated.

Also, the present invention according to another aspect is a broadcast receiving terminal adapted for digital broadcast service. The broadcast receiving terminal device has a front-end processing unit that generates at least video data, first audio data, second audio data, text/graphic data, and program control information based on the broadcast signal of the received program. and a display control unit that controls to display the program image of either the first form or the second form on the screen of the display device, and the first audio data or the second audio data according to the audio mode and an audio processing unit that controls so that audio based on any of the audio data is output from the speaker. Here, the program image of the first type is an image including at least a moving image based on the video data and a character/graphic image based on the character/graphic data, and the program image of the second type is the moving image. is an image that contains but does not contain the character graphic image. Then, when the program control information includes information designating the display of the character/graphic image in the first audio mode, the display control unit causes the program image in the first form to be displayed on the screen. In addition to controlling, the audio processing unit controls such that the audio based on the first audio data is output from the speaker. On the other hand, when the program control information includes information designating the display of the character/graphic image in the second audio mode, the display control unit causes the program image in the first form to be displayed on the screen. In addition to controlling, the audio processing unit controls such that the audio based on the second audio data is output from the speaker.

Further, the display control section may include a switching control section for controlling whether or not to output the character and graphic data, and a synthesizing section for synthesizing the video data and the character and graphic data. The switching control section may control to output the character and graphic data to the synthesizing section when the program control information includes information designating display of the character and graphic image in the first audio mode. On the other hand, when the program control information includes information designating the display of the character/graphic image in the second audio mode, the character/graphic data may be controlled not to be output to the synthesizing unit.

The present invention is established as an invention of a method, and also as an invention of a computer program for causing a computer to execute the method and a recording medium recording the same.

In the present disclosure, "means" does not simply mean physical means, but also includes the case where the functions of the means are realized by software. Also, the function of one means may be realized by two or more physical means, or the functions of two or more means may be realized by one physical means.

In addition, in the present disclosure, the term "system" includes a logical assembly of multiple devices (or functional modules that implement specific functions), and each device or functional module is physically a single entity. It does not matter whether it is configured or configured as a separate object.

According to the present invention, it is possible to hide insert images that are not related to the selected audio channel in the display contents of the program provided to the viewer. In particular, in a program in which camera video and other inserted images are superimposed and provided to the viewer, the inserted image is displayed or hidden in conjunction with the audio channel (audio mode) selected by the viewer. be able to

Further, according to the present invention, in a program in which a camera image and another insert image are superimposed and provided to a viewer, even if the insert image is related to an audio channel, the viewer can select the insert image. can be selectively displayed or hidden.

Other technical features, objects, effects or advantages of the present invention will be made clear by the following embodiments described with reference to the accompanying drawings. The effects described in the present disclosure are exemplary and not limiting, and other effects may also exist.

FIG. 1 is a diagram for explaining an example of the overall scheme of the digital broadcasting service system according to the first embodiment of the present invention. FIG. 2 is a block diagram showing an example of a schematic configuration of a broadcaster system in a digital broadcasting service system according to one embodiment of the present invention. FIG. 3 is a block diagram showing an example of a schematic configuration of a broadcast receiving terminal device in the digital broadcast service system according to the first embodiment of the present invention. FIG. 4 is a flow chart showing an example of processing in the broadcast receiving terminal device of the digital broadcasting service system according to the first embodiment of the present invention. FIG. 5 is a diagram for explaining the transition of the setting state by the audio switching button in the broadcast receiving terminal device of the digital broadcasting service system according to the first embodiment of the present invention. FIG. 6 is a flow chart showing an example of processing in the broadcast receiving terminal device of the digital broadcasting service system according to the second embodiment of the present invention. FIG. 7 is a flow chart showing an example of processing in the broadcast receiving terminal device of the digital broadcasting service system according to the third embodiment of the present invention. FIG. 8 is a flow chart showing an example of processing in the broadcast receiving terminal device of the digital broadcasting service system according to the third embodiment of the present invention. FIG. 9 is a diagram for explaining the transition of the setting state by the sound switching button in the broadcast receiving terminal device of the digital broadcasting service system according to the third embodiment of the present invention. FIG. 10 is a flow chart showing an example of processing in the broadcast receiving terminal device of the digital broadcasting service system according to the fourth embodiment of the present invention. FIG. 11 is a block diagram showing an example of a schematic configuration of a broadcaster system in the digital broadcasting service system according to the fifth embodiment of the present invention. FIG. 12 is a block diagram showing an example of a schematic configuration of a broadcast receiving terminal device in a digital broadcast service system according to the fifth embodiment of the present invention. FIG. 13 is a flow chart showing an example of processing in a broadcast receiving terminal device in a digital broadcast service system according to the modification of the fifth embodiment of the present invention. FIG. 14 is a diagram for explaining an example of main audio and sub-audio under dual audio broadcasting for a program image displayed on the screen of the broadcast receiving terminal device.

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, embodiments of the present invention will be described with reference to the drawings. However, the embodiments described below are merely examples, and are not intended to exclude various modifications and application of techniques not explicitly described below. The present invention can be implemented in various modifications (for example, by combining each embodiment) without departing from the scope of the invention. In addition, in the description of the drawings below, the same or similar parts are denoted by the same or similar reference numerals. The drawings are schematic and do not necessarily correspond to actual dimensions, proportions, and the like. Even between the drawings, there are cases where portions with different dimensional relationships and ratios are included.

[First Embodiment]
In the present embodiment, in a digital broadcasting service using a broadcast signal based on a transmission stream in which a plurality of digital data streams constituting a program content are multiplexed, the audio mode of a broadcast receiving terminal device is set to a first audio mode (for example, a main audio mode). In the case of the audio mode), control is performed so that the character/graphic image is superimposed on the main moving image (for example, television camera image) that constitutes the program content image (program image) on the screen, and the audio When the mode is the second audio mode (for example, the sub-audio mode), control is performed so that the character/graphic image is not superimposed on the moving image. In the present disclosure, a program image in which a character/graphic image is superimposed on a moving image is referred to as a program image of the first form, and a program image in which a character/graphic image is not superimposed on a moving image is referred to as a program image of a second form. It is sometimes called

FIG. 1 is a diagram for explaining an example of the overall scheme of a digital broadcasting service system according to one embodiment of the present invention. As shown in the figure, the digital broadcasting service system 1 of this embodiment includes a broadcaster system 10 and a broadcast receiving terminal device 20 . In the following, the digital broadcasting service system 1 will be described by taking a terrestrial digital broadcasting service as an example, but it is not limited to this. It may be a satellite broadcasting service such as a broadcasting service. Alternatively, the digital broadcasting service system 1 may be a so-called cable television broadcasting service via a distributor C or an IPTV service using an IP network.

The broadcaster system 10 may be configured including broadcasting facilities for television broadcasting and radio broadcasting. Broadcaster system 10 is typically managed and operated by a licensed broadcaster (for example, a broadcasting station) or the like, but is not limited to this. Although not shown, the broadcaster system 10 performs broadcasting (for example, terrestrial digital broadcasting) by transmitting the program content stored in the transmission server to airwaves, for example, under the control of an automatic operation device.

Program content is packaged as a "program" that is organized along the time axis and viewed by viewers, and is sometimes used synonymously with "program" depending on the context. Program content can include main program content, secondary data broadcasting program content, and the like. A program content can be composed of a collection of various program material data (mono-media data) such as moving images (video), subtitles (and superimposed text), character/graphic images, and/or voice (audio), for example. The program material data is converted into, for example, a multiplexed digital data stream (hereinafter referred to as a "stream") conforming to the MPEG2 format, which is a high-compression encoding technique, and transmitted, but is not limited to this. An MPEG-2 transport stream (TS) is a form of stream consisting of a series of TS packets. From the viewpoint of transmission technology, a multiplexed stream is sometimes called a transmission stream. In this disclosure, streams or data associated with program content are sometimes referred to as "program streams" or "program data." The broadcaster system 10 generates a program stream by multiplexing each of a plurality of streams based on program material data with predetermined service information in accordance with program organization along the time axis, and further distributes this to a predetermined frequency band. After being modulated into a broadcast signal, it is emitted as a broadcast wave from a transmission base station 12 such as a radio tower toward a broadcast target area.

The audio broadcasting system for broadcast programs can be classified into monaural broadcasting (including so-called mono-stereo broadcasting) and audio multiplex broadcasting according to the usage of the audio channel. Broadcasting and dual audio broadcasting can be classified. A dual audio broadcast is a multiplex broadcast consisting of primary and secondary audio. This embodiment will be described on the premise of a program whose audio broadcasting method is dual audio broadcasting.

The broadcast reception terminal device 20 is a terminal device for viewers (users) to view programs provided by broadcasters. Broadcast receiving terminal device 20 can typically be a so-called television receiver or set-top box, but is not limited to this. In other words, the broadcast receiving terminal device 20 may be any device that has a function that allows the viewer to view desired programs. Examples include desktop computers, notebook computers, tablet computers, smart phones, feature phones, and other intelligent devices. It may be a computing device such as

FIG. 2 is a block diagram showing an example of the schematic configuration of the broadcaster system in the digital broadcasting service system according to the first embodiment of the present invention. As shown in the figure, the broadcaster system 10 includes a program operating device 110, an encoding unit 120, a character/graphic inserting unit 130, a program information generating unit 140, a multiplexing unit 150, a scrambling unit 160, It is composed of components such as a modulating section 170 and a transmitting section 180 .

The program operating device 110 outputs program material data constituting program content accumulated in a transmission server (not shown) to the encoding section 120 in accordance with program organization. In addition, the program operation device 110 outputs various control information (hereinafter referred to as “program control information”) regarding the program to the program information generating section 140 . The program control information includes, for example, information such as what kind of stream constitutes the program content and what kind of address information is given.

The encoding unit 120 encodes (compresses and encodes) various program material data to generate a stream. The encoding unit 120 includes, for example, a video encoding unit 121, a still image encoding unit 122, an audio encoding unit 123, a caption encoding unit 124, and a character graphic encoding unit 125.

The video encoding unit 121 encodes video (moving image/video) data relating to program content using, for example, codec conforming to the MPEG-2 video standard, thereby generating a PES format video stream. Video data related to program content is displayed as the main image (moving image) on the screen. contains video data. The video encoding section 121 outputs the generated video stream to the multiplexing section 150 .

Conventionally, for example, on the broadcaster side, a video stream obtained by superimposing text and graphic images input by a commentator using a tablet computer with a handwriting pen on an image captured by a television camera is It constitutes the display content (main moving image) of the program. In the present disclosure, as described below, such text and graphic images are treated as separate streams (text and graphic streams) from video streams based on images captured by a television camera, if necessary.

The still image encoding unit 122, for example, encodes still image data related to data broadcasting program content using a predetermined codec to generate a still image stream in PES format. The still image encoding unit 122 converts, for example, JPEG format still image data into video data in units of several seconds (eg, 30 seconds) and encodes it, thereby generating a pseudo still image stream. The still image encoding section 122 outputs the generated still image stream to the multiplexing section 150 .

The audio encoding unit 123 encodes audio (sound) data relating to program content using, for example, a codec conforming to the MPEG-2 audio standard, thereby generating a PES format audio stream. The audio streams may include a first audio stream and a second audio stream. The main audio stream corresponding to the main audio mode (main audio channel) is one form of the first audio stream, and the sub-audio stream corresponding to the sub-audio mode (sub-audio channel) is one form of the second audio stream. form. Audio encoding section 123 outputs the generated audio stream to multiplexing section 150 .

The subtitle encoding unit 124 encodes the subtitles and/or superimposed text data related to the program content according to, for example, the broadcasting subtitle file exchange format, thereby generating a PES format stream. Subtitle encoding section 124 outputs the generated subtitle stream to multiplexing section 150 .

The character/graphic encoding unit 125 receives character/graphic data input from the character/graphic inserting unit 130, which will be described later, and encodes it, thereby generating a PES format character/graphic stream. The character/graphics encoding unit 125 converts, for example, JPEG-format character/graphics data into video data in units of several seconds (eg, 30 seconds) and encodes it to generate a character/graphics stream. Character/graphic encoding section 125 outputs the generated character/graphic stream to multiplexing section 150 .

The character/graphic inserting unit 130 is an interface for inserting character/graphic data relating to program content into the program content. Character graphic data is image data representing characters and/or graphics, and should not be interpreted in a limited way. The character/graphics inserting unit 130 includes, for example, a touch panel computer operated by the staff who produce the program and the performers of the program. As an example, in the broadcasting of a sports program, the text/graphics inserting unit 130 accepts information input by a pen using a touch panel computer while a commentator is commenting on the program being broadcast. In other words, in the present disclosure, the character and graphic image, which was a part of the original video by being synthesized on the broadcaster side as before, can be made independent of the video on the viewer side as necessary. will be treated appropriately. Character/graphic inserting section 130 outputs the received character/graphic stream to character/graphic encoding section 125 . In this example, the character/graphic inserting unit 130 is configured as a separate component from the character/graphic encoding unit 125. may be configured.

The program information generation unit 140 generates a section format stream based on the program control information. The program control information includes, for example, information on programming. Program sequence information in MPEG-2 is one form of program control information. The program sequence information includes program specific information (PSI) and service information (SI) that complements this.

The multiplexing unit 150 generates multiplexed program streams (transmission streams) based on the various streams described above. A multiplexer is one form of multiplexer 150 . As mentioned above, MPEG-2 Transport Stream (TS) is a form of transport stream consisting of a series of TS packets. The multiplexer 150 outputs the generated program stream to the scrambler 160 .

A scrambler 160 scrambles the generated program stream using an encryption key. Scrambling is mainly performed to achieve limited reception for the purpose of rights protection of program content. Such a conditional access system is called CAS (Conditional Access System). The scrambler 160 outputs the scrambled program stream to the modulator 170 .

Modulator 170 digitally modulates the scrambled program stream to generate a broadcast signal in a predetermined frequency band assigned to each broadcaster. Modulation section 170 outputs the modulated broadcast signal to transmission section 180 .

The transmitter 180 emits the modulated broadcast signal as a broadcast wave from, for example, a radio tower toward a predetermined broadcast target area according to a predetermined broadcast output. Alternatively, the broadcast wave is emitted toward the broadcasting satellite S or the like and transmitted from the broadcasting satellite S to the ground. Alternatively, the transmission unit 180 can transmit the broadcast signal to a distributor C that operates cable television broadcasting services, for example.

Although not shown, the broadcaster system 10 may include components for providing data broadcast program content to viewers. Data relating to program content for data broadcasting may also be multiplexed within the program stream. The data broadcast program content may be linked content linked to the main program content, or may be independent content independent of this.

FIG. 3 is a block diagram showing an example of a schematic configuration of a broadcast receiving terminal device in the digital broadcast service system according to the first embodiment of the present invention. As shown in the figure, the broadcast receiving terminal device 20 includes, for example, a tuner/modulator 210, a descrambler 220, a separator 230, a decoder 240, an output controller 250, and a data broadcasting engine 260. , a control unit 270 and an operation receiving unit 280. FIG. Also, as shown in the figure, the broadcast receiving terminal device 20 is connected to a display device DSP and a speaker SPK as output devices.

The tuner/modulation unit 210 tunes (selects) a broadcast wave received by an antenna (not shown), extracts a desired broadcast signal, and demodulates it to obtain a program stream. The program stream at this stage is in a scrambled state. The tuner/modulator 210 also performs error correction processing when demodulating the program stream. In this example, tuner/modulation section 210 is configured as one component, but is not limited to this, and may be configured as separate components. Tuner/modulator 210 outputs the demodulated program stream to descrambler 220 .

The descrambler 220 descrambles (decodes) the demodulated program stream using a decoding key to restore the original multiplexed program stream. The decryption key is read, for example, from an IC card (not shown) called a CAS card attached to the broadcast receiving terminal device. The descrambler 220 outputs the descrambled program stream to the separator 230 .

Separator 230 separates the descrambled multiplexed program stream into streams. A demultiplexer is one form of demultiplexer 230 . The separating unit 230 outputs to the decoding unit 240, the data broadcasting engine 260, and/or the control unit 270 according to each stream separated from the program stream. For example, the separating unit 230 outputs the video stream, audio stream, caption stream, and text/graphic stream separated from the program stream to the decoding unit 240 , and outputs the stream for data broadcasting to the data broadcasting engine 260 . Also, the separation unit 230 outputs the separated program control information to the control unit 270 .

The decoding unit 240 decodes each stream to generate program material data constituting program content. The decoding unit 240 includes, for example, a video decoding unit 241, an audio decoding unit 242, a still image decoding unit 243, a caption decoding unit 244, and a text/graphics decoding unit 245.

The video decoding unit 241 decodes the video stream using, for example, codec conforming to the MPEG-2 video standard, thereby generating video data. The video decoding section 241 outputs the decoded video data to the output control section 250 . As will be described later, the video data input to the output control unit 250 is selectively superimposed with other data, converted into a video signal by a display driver (not shown), and output to the display device DSP. The display device displays the image of the program based on the video signal. The display device DSP is, for example, a liquid crystal display (LCD), an organic EL display (OELD), or the like, but is not limited thereto.

The still image decoding unit 243 decodes the still image stream to generate still image data. The still image decoding section 243 outputs the decoded still image data to the output control section 250 . The decoded still image data is displayed on the screen of the display device, for example, as a data broadcast image.

The audio decoding unit 242 decodes the audio stream according to, for example, the MPEG-2 audio standard, thereby generating audio data. As noted above, in this disclosure, audio streams may include a first audio stream and a second audio stream. Therefore, the audio decoding unit 242 generates first audio data corresponding to the main audio mode and second audio data corresponding to the sub audio mode based on the first audio stream and the second audio stream, respectively. can. At least one of the decoded first audio data and second audio data is output to an audio driver (not shown) via an audio selection unit 252, which will be described later, and further converted into an audio signal by the audio driver. The audio (voice) in the audible range is output from the speaker SPK.

The subtitle decoding unit 244 decodes the subtitle stream according to, for example, the broadcast subtitle file exchange format, thereby generating subtitle data. The subtitle decoding section 244 outputs the generated subtitle data to the output control section 250 . The caption data output to the output control unit 250 is selectively superimposed on the video data to form part of the display contents of the program.

The character/graphic decoding unit 245 decodes the character/graphic stream to generate character/graphic data. The character/graphic decoding unit 245 outputs the generated character/graphic data to the output control unit 250 . The character graphic data output to the output control unit 250 is selectively superimposed on the video data. In this embodiment, the text/graphic data is superimposed on the video data only in the main audio mode.

In the present disclosure, tuner/modulator 210, descrambler 220, separator 230, and decoder 240 form a front-end processor. That is, the front-end processing unit is understood as a component that generates various program material data (mono-media data) such as video data and audio data, program control information, etc. based on the received broadcast signal.

The output control section 250 controls output to the display device DSP and/or the speaker SPK under the control of the control section 270 . In the present disclosure, the output control unit 250 can be regarded as a component including a display control unit that controls output to the display device DSP and an audio control unit that controls output to the speaker SPK. Under the control of the control unit 270, the output control unit 250 outputs a program image of the first form in which a character/graphic image based on character/graphic data is superimposed on a moving image based on video data, or a character/graphic image is superimposed on a moving image. Control is performed so that any one of the program images of the second form that is not displayed is displayed on the screen of the display device DSP.

That is, under the control of the control unit 270, the display control unit in the output control unit 250 selectively and superimposes other program material data related to display with the video data to generate display data. Furthermore, the display control section converts the display data into a video signal of an appropriate format by the display driver, and drives the display device DSP based on the video signal so that the program image is displayed on the display device DSP.

Also, the audio control section in the output control section 250 selects and outputs at least one of the decoded first audio data and second audio data. Further, the audio control unit converts output audio data into an audio signal by an audio driver, thereby driving the speaker SPK.

In the same figure, as components of the output control unit 250, a video/still image switching unit 251, an audio selection unit 252, switches 253a and 253b, and a synthesizing unit 254 are illustrated. The moving image/still image switching section 251, the switches 253a and 253b, and the synthesizing section 254 are an example of configuring a display control section, and the audio selection section 252 is an example of configuring an audio control section.

A moving image/still image switching unit 251 selects and outputs either video data or still image data. The moving image/still image switching unit 251 selectively switches under the control of the data broadcasting engine 260, for example. Alternatively, the moving image/still image switching unit 251 may be configured to select both video data and still image data and output video data in which they are appropriately laid out in one screen.

The audio selector 252 selects and outputs the first audio data and/or the second audio data under the control of the controller 270 . In this embodiment, the audio selection unit 252 selects and outputs either the first audio data or the second audio data. Alternatively, the audio selection unit 252 selects and outputs both the first audio data and the second audio data in the case of program content configured as stereo broadcasting. As will be described later, in this embodiment, the selection operation of the audio selection unit 252 is controlled so as to be interlocked with the ON/OFF operation of the switch 253b.

The switch 253a switches whether or not to output caption data to the synthesizing section 254 under the control of the control section 270 . Also, the switch 253b switches whether or not to output the character graphic data to the synthesizing section 254 under the control of the control section 270. FIG. The switches 253a and 253b are one form of a switching control section.

The synthesis unit 254 superimposes video data (and/or still image data) with other program material data related to display, thereby generating display data. Synthesis of data is performed, for example, by alpha blending using a transparency information coefficient (alpha value). In this example, the synthesizer 254 includes a synthesizer 254a for synthesizing caption data with the video data, and a synthesizer 254b for synthesizing character graphic data with its output. When there is no output of caption data and/or character/graphic data, Null data is synthesized with the video data, so the output is the video data itself. The display data output from the synthesizer 254 is converted into a video signal by a display driver (not shown) and output to a display device.

The data broadcasting engine 260 decodes the separated data broadcasting stream, thereby generating display data for data broadcasting and a display control signal. Data broadcasting engine 260 analyzes the display control signal and controls moving image/still image switching section 251 based on the analysis result.

The operation reception unit 280 receives an operation instruction for the broadcast reception terminal device 20 from the viewer. For example, the viewer can give instructions to the broadcast receiving terminal device 20 by operating a remote controller at hand. The viewer's operation instructions include, for example, channel (broadcasting station) switching instructions, volume control instructions, data broadcast program content display/non-display instructions, caption display/non-display instructions, and audio mode switching instructions. . The viewer selectively switches the audio mode between the main audio mode and the sub-audio mode, for example, by pressing an audio switching button. Operation accepting portion 280 outputs the accepted operation instruction to control portion 270 .

The control unit 270 comprehensively controls the operation of the broadcast receiving terminal device 20 . The control unit 270 includes a processor module including a CPU, a memory module including various memories, and the like (not shown). Also, the control unit 270 can control the operation of the application installed in the broadcast receiving terminal device 20 under the control of the CPU. The application may be pre-installed in the broadcast receiving terminal device 20, or may be downloaded and installed by broadcast waves or via a communication network.

For example, the control unit 270 determines the audio broadcasting system of the selected program based on the program control information. In this embodiment, the control unit 270 determines whether or not the audio broadcasting method of the program is dual audio broadcasting based on the program control information. In addition, control unit 270 holds in memory the state of the current audio mode selected by the audio switching button.

Further, upon receiving an instruction to switch the audio mode via the operation receiving unit 280, the control unit 270 controls the audio selection unit 252 and the switch 253b. More specifically, in this embodiment, when the main audio mode is selected by an audio mode switching instruction, the control unit 270 selects the first audio data (the second audio data is not selected). In addition to controlling the audio selection unit 252 as above, the switch 253b is turned on so that the character/graphic data is output to the synthesizing unit 254. FIG. On the other hand, when the secondary audio mode is selected by the audio mode switching instruction, control unit 270 controls audio selection unit 252 to select the second audio data (the first audio data is not selected). At the same time, the switch 253b is turned off so that the character/graphic data is not output to the synthesizing unit 254. FIG.

FIG. 4 is a flow chart showing an example of processing in the broadcast receiving terminal device of the digital broadcasting service system according to the first embodiment of the present invention. More specifically, FIG. 1 shows an example of the flow of processing until the broadcast reception terminal device 1 provides the viewer with a program based on the received broadcast waves.

As shown in the figure, the broadcast receiving terminal device 20 tunes (selects) a broadcast wave received by an antenna (not shown) in a tuner/modulator 210, thereby extracting a desired broadcast signal. Furthermore, it demodulates this to obtain a scrambled program stream (S401). The scrambled program stream is output to the descrambler 220 .

Subsequently, the broadcast receiving terminal device 20 descrambles the demodulated program stream using the decryption key in the descrambler 220 to restore the original multiplexed program stream (S402). Furthermore, the broadcast receiving terminal device 20 separates the descrambled program stream into each stream by the separation unit 230 (S403). Each separated stream is output to the decoding unit 240 . As described above, the separated streams are, for example, a video stream, a first audio stream, a second audio stream, and at least one of a still image stream, a subtitle stream, and a text/graphics stream. can include A data broadcasting stream among the separated streams is output to the data broadcasting engine 260 .

The broadcast receiving terminal device 20 then decodes each separated stream in the decoding unit 240, thereby generating each program material data (S404). As described above, the program material data includes, for example, video data, first audio data, second audio data, and at least one of still image data, caption data, and character/graphic data. obtain. Note that in the present disclosure, the processing from S401 to S404 may be collectively referred to as "front-end processing".

The broadcast receiving terminal device 20 determines the audio broadcasting system of the selected program in the control unit 270 (S405). That is, based on the program control information, the control unit 270 determines whether the audio broadcasting system of the selected program is dual audio broadcasting consisting of main audio and secondary audio, or other audio broadcasting (monaural broadcasting/monaural broadcasting). stereo broadcasting).

When the broadcast receiving terminal device 20 determines that the audio broadcasting method is the dual audio broadcasting, it further determines whether the current audio mode is the main audio mode or the sub audio mode (S406). When the broadcast receiving terminal device 20 determines that the current audio mode is the main audio mode, it selects and outputs the first audio data and turns on the output of the character graphic data (S407). On the other hand, when the broadcast receiving terminal device 20 determines that the current audio mode is the sub-audio mode, it selects and outputs the second audio data and turns off the output of the character/graphic data (S408). .

Next, the output control unit 250 of the broadcast receiving terminal device 20 superimposes caption data and/or character/graphic data on the video data to generate display data (S409). If there is no caption data and/or character graphic data output, Null data is synthesized with the video data.

The broadcast receiving terminal device 20 controls so that a screen based on the output display data is displayed on the display device DSP, and based on the output audio data, the speaker SPK outputs sound in the audible range. control (S410).

In S405, when the broadcast receiving terminal device 20 determines that the audio broadcasting (monaural broadcasting/stereo broadcasting) is other than the dual audio broadcasting, caption data and/or text are added to the video data according to the current setting state. Graphic data are synthesized in a superimposed manner to generate display data (S409), and display and audio output are controlled (S410). Alternatively, as described in other embodiments, the broadcast receiving terminal device 20 may perform processing according to monaural broadcasting/stereo broadcasting.

The broadcast receiving terminal device 20 of this embodiment configured as described above selects the first audio data under the control of the control section 270 in the main audio mode, and outputs character/graphic data to the synthesizing section 254. Then, this is superimposed and combined with the video data. As a result, audio based on the first audio data is output from the speaker SPK, while a moving image (for example, video from a television camera) based on the video data is displayed on the display device DSP. A program image in a form (first form) in which (for example, an image input by handwriting with a pen) is superimposed is displayed. On the other hand, when the viewer selects the secondary audio mode by operating the audio switching button of the remote controller, the broadcast receiving terminal device 20 selects the second audio data under the control of the control unit 270, and also selects the text data. Turn off the output of shape data. As a result, the speaker SPK outputs audio based on the second audio data, while the display device DSP displays the program image in a form (second form) in which the character/graphic image is not superimposed on the moving image. be. Thus, the viewer can watch the program without the video being disturbed by text and graphics images unrelated to the audio.

[Second embodiment]
This embodiment is a modification of the first embodiment, in which the audio mode of the broadcast receiving terminal device is set to a specific audio mode (for example, main audio mode) in a digital broadcasting service using a broadcast signal based on a multiplexed transmission stream. ), the character/graphic image to be superimposed on the main moving image of the program on the screen (for example, TV camera image) is controlled so that the viewer can selectively switch between display and non-display. characterized by

That is, the broadcast receiving terminal device 20 of the present embodiment can switch the display/non-display of the character/graphic image together with the switching of the audio mode, for example, each time the audio switching button of the remote controller is operated by the viewer. Configured. More specifically, each time the audio switching button is pressed, the broadcast receiving terminal device 20 changes the state set by the audio switching button (hereinafter referred to as the "setting state") to the main audio mode, as shown in FIG. , the state ST1 permitting the display of the character/graphic image, the state ST2 not permitting the display of the character/graphic image in the main audio mode, and the state ST3 not permitting the display of the character/graphic image in the sub-audio mode. , control.

For this reason, in this embodiment, the control unit 270 stores the previous state of display/non-display of the audio mode and character/graphic image, that is, the state of the audio selection unit 252 and the switch 253b, for example, in a non-volatile memory (not shown). memorize to Such a function of storing and reproducing the immediately preceding state is sometimes called a last memory function.

For example, assume that the current setting state is state ST1. That is, the main sound is output from the speaker, and the character/graphic data superimposed on the moving image is displayed on the display device DSP. In state ST1, when the viewer presses the audio switching button once, the control unit 270 changes the setting state to state ST2. Therefore, the control unit 270 turns off the switch 253b without controlling the audio selection unit 252 in order to hide the character/graphic image while keeping the audio mode in the main audio mode. As a result, the main sound is output from the speaker, and the moving image on which the character/graphic image is not superimposed is displayed on the display device DSP.

Next, in state ST2, when the viewer presses the audio switching button once, the control unit 270 changes the setting state to state ST3. Therefore, the controller 270 controls the audio selector 252 to switch the audio mode from the main audio mode to the sub-audio mode. At this time, the switch 253b remains off. As a result, the sub-audio is output from the speaker, and the moving image on which the character/graphic image is not superimposed is displayed on the display device DSP.

Next, in state ST3, when the viewer presses the audio switching button once, the control unit 270 returns the setting state to state ST1. Therefore, the control section 270 controls the audio selection section 252 and turns on the switch 253b in order to switch the audio mode from the sub-audio mode to the main audio mode. As a result, the main sound is output from the speaker, and the character/graphic image superimposed on the moving image is displayed on the display device DSP.

FIG. 6 is a flow chart showing an example of processing in the broadcast receiving terminal device of the digital broadcasting service system according to the second embodiment of the present invention.

As shown in the figure, the broadcast reception terminal device 20 that has received the broadcast wave performs front-end processing (S601). That is, as described above, the broadcast receiving terminal device 20 tunes (selects) the received broadcast, extracts the desired broadcast signal, demodulates it, further descrambles it using the decryption key, and restores the multiplexed program stream. Subsequently, the broadcast receiving terminal device 20 separates the program stream into each stream, decodes each separated stream, and thereby generates each program material data. Also, the program control information is output to the control section 270 .

At this time, the control unit 270 of the broadcast receiving terminal device 20 determines the audio broadcasting system of the selected program (S602). That is, based on the program control information, the control unit 270 determines whether the audio broadcasting system of the selected program is dual audio broadcasting consisting of main audio and secondary audio, or other audio broadcasting (monaural broadcasting/monaural broadcasting). stereo broadcasting).

When the broadcast receiving terminal device 20 determines that the audio broadcasting method is the dual audio broadcasting, it then determines whether the current audio mode is the primary audio mode or the secondary audio mode (S603). When the broadcast receiving terminal device 20 determines that the current audio mode is the main audio mode, it then determines the current display state of the character/graphic image (S604).

When the broadcast receiving terminal device 20 determines that the current display state of the character/graphic image is display, it selects and outputs the first audio data and turns on the output of the character/graphic data (S605). On the other hand, when the broadcast receiving terminal device 20 determines that the current display state of the character/graphic image is non-display, it selects and outputs the first audio data and turns off the output of the character/graphic data. (S606).

On the other hand, when the broadcast receiving terminal device 20 determines in S603 that the current audio mode is the sub-audio mode, it selects and outputs the second audio data and turns off the output of character/graphic data (S607). .

Next, the output control unit 250 of the broadcast receiving terminal device 20 superimposes caption data and/or character/graphic data on the video data to generate display data (S608). If there is no caption data and/or character graphic data output, Null data is synthesized with the video data.

The broadcast receiving terminal device 20 controls so that a screen based on the output display data is displayed on the display device, and controls so that sound in the audible range is output from the speaker based on the output audio data. (S609).

In S602, when the broadcast receiving terminal device 20 determines that the audio broadcasting (monaural broadcasting/stereo broadcasting) is other than the dual audio broadcasting, subtitle data and/or text are added to the video data according to the current setting state. Graphic data are synthesized in a superimposed manner to generate display data (S608), and display and audio output are controlled (S609). Alternatively, as described in other embodiments, the broadcast receiving terminal device 20 may perform processing according to monaural broadcasting/stereo broadcasting.

The broadcast receiving terminal device 20 of this embodiment configured as described above operates to switch display/non-display of the character graphic image linked to the audio mode each time the audio switching button is operated. Therefore, the viewer can display or hide the text and graphic images even if they are associated with the audio mode.

[Third Embodiment]
This embodiment is a modification of the above-described embodiment, and in a digital broadcasting service using a broadcast signal based on a multiplexed transmission stream, the character/graphic image is in the first audio mode (for example, main audio mode) or in the second audio mode. In one of the audio modes (for example, the sub-audio mode), it is specified in advance to be superimposed with the main moving image of the program on the screen, and the broadcast receiving terminal device follows this and the on-screen Character graphics images are displayed in a superimposed manner together with the main moving images of the program.

In order to realize the digital broadcasting service of this embodiment, the broadcaster system 10 transmits program control information including descriptors indicating whether to display character/graphic images in the main audio mode or in the sub-audio mode. be included in the transmission. As an example, descriptors are defined in the EIT (Event Information Table) of the service information for designating whether the character/graphic image is to be displayed in the main audio mode or the sub-audio mode. The program information generation section 140 of the broadcaster system 10 generates a stream based on the program control information including such descriptors in the EIT, and outputs the stream to the multiplexing section 150 . The multiplexing unit 150 multiplexes each stream to generate and output a program stream.

The demultiplexer 230 of the broadcast receiving terminal device 20 outputs program control information obtained by demultiplexing such a multiplexed program stream to the controller 270 . The control unit 270 refers to the EIT in the program control information and controls the audio selection unit 252 and the switch 253b according to the EIT descriptor.

7 and 8 are flowcharts showing an example of processing in the broadcast receiving terminal device of the digital broadcasting service system according to the third embodiment of the present invention. 8 shows details of the process S703 shown in FIG.

As shown in FIG. 7, the broadcast reception terminal device 20 that has received the broadcast wave performs front-end processing (S701). That is, as described above, the broadcast receiving terminal device 20 tunes (selects) the received broadcast, extracts the desired broadcast signal, demodulates it, further descrambles it using the decryption key, and restores the multiplexed program stream. Subsequently, the broadcast receiving terminal device 20 separates the program stream into each stream, decodes each separated stream, and thereby generates each program material data. Also, the program control information is output to the control section 270 .

At this time, the control unit 270 of the broadcast receiving terminal device 20 determines the audio broadcasting system of the program being tuned in (S702). That is, based on the program control information, the control unit 270 determines whether the audio broadcasting system of the selected program is dual audio broadcasting consisting of main audio and secondary audio, or other audio broadcasting (monaural broadcasting/monaural broadcasting). stereo broadcasting).

When the broadcast receiving terminal device 20 determines that the audio broadcasting system is the dual audio broadcasting, the control unit 270 subsequently performs output control processing of character graphic data based on the audio mode and the program control information (S703). .

That is, in the output control process for character/graphic data, the broadcast receiving terminal device 20 determines which audio mode is currently in use, as shown in FIG. 8 (S801). When the broadcast receiving terminal device 20 determines that the current audio mode is the main audio mode, it then determines whether the descriptor of the program control information designates display in the main audio mode ( S802). When the broadcast receiving terminal device 20 determines that the descriptor of the program control information designates display in the main audio mode, it selects and outputs the first audio data and turns on the output of the character/graphic data. (S803). On the other hand, when the broadcast receiving terminal device 20 determines that the descriptor of the program control information specifies no display in the main audio mode (that is, specifies display in the sub-audio mode). , selects and outputs the first audio data, and turns off the output of character/graphic data (S804).

On the other hand, if the broadcast receiving terminal device 20 determines in S801 that the current audio mode is not the main audio mode (it is the sub-audio mode), then the program control information descriptor indicates that the sub-audio mode is displayed. is specified (S805). When the broadcast receiving terminal device 20 determines that the descriptor of the program control information designates display in the sub-audio mode, it selects and outputs the second audio data and turns on the output of the character/graphic data. (S806). On the other hand, when the broadcast receiving terminal device 20 determines that the descriptor of the program control information specifies no display in the secondary audio mode (that is, specifies display in the primary audio mode). , selects and outputs the second audio data, and turns off the output of the character/graphic data (S807).

Returning to FIG. 7, the broadcast receiving terminal device 20 superimposes caption data and/or character/graphic data on the video data to generate display data (S704). If there is no caption data and/or character graphic data output, Null data is synthesized with the video data. Subsequently, the broadcast receiving terminal device 20 controls so that the screen based on the display data to be output is displayed on the display device, and sound in the audible range is output from the speaker based on the audio data to be output. (S705).

In S702, when the broadcast receiving terminal device 20 determines that the audio broadcasting (monaural broadcasting/stereo broadcasting) other than the dual audio broadcasting is selected, caption data and/or text are added to the video data according to the current setting state. Graphic data are synthesized in a superimposed manner to generate display data (S704), and display and audio output are controlled (S705). Alternatively, as described in other embodiments, the broadcast receiving terminal device 20 may perform control according to dual audio broadcasting.

As described above, according to this embodiment, the character/graphic image is displayed on the screen of the broadcast receiving terminal device 20 only in the audio mode designated by the broadcaster. That is, when the character/graphic data is specified to be displayed in the main audio mode, the broadcast receiving terminal device 20 selects the first audio data only when the current audio mode is the main audio mode. At the same time, the character/graphic data is output to the synthesizing section 254 and superimposed on the video data. As a result, the audio based on the first audio data is output from the speaker SPK, and the image captured by the television camera is superimposed on the character/graphic image input by handwriting with a pen, for example, on the display device DSP. displayed. On the other hand, when the sub-audio mode is selected, the broadcast receiving terminal device 20 selects the second audio data and turns off the output of character/graphic data. As a result, the audio based on the second audio data is output from the speaker SPK, while the image captured by the television camera is displayed on the display device DSP, and the character/graphic image is no longer displayed.

Also, when the character/graphic data is specified to be displayed in the sub-audio mode, the broadcast receiving terminal device 20 selects the second audio data only when the current audio mode is the sub-audio mode. At the same time, the character/graphic data is output to the synthesizing section 254 and superimposed on the video data. As a result, the audio based on the second audio data is output from the speaker SPK, while the image captured by the television camera is superimposed on the character/graphic image input by, for example, the handwriting pen. displayed. On the other hand, when the broadcast receiving terminal device 20 is in the main audio mode, it selects the second audio data and turns off the output of character/graphic data. As a result, audio based on the second audio data is output from the speaker SPK, while the image captured by the television camera is displayed on the display device DSP, and the character/graphic image is no longer displayed.

(Modification)
As a modification of this embodiment, as shown in the second embodiment, the broadcast receiving terminal device 20 superimposes the main moving image of the program on the screen and displays it in response to the operation by the viewer. Control may be performed so that the character/graphic image can be selectively switched between display and non-display.

That is, the broadcast receiving terminal device 20 of the present embodiment is configured to switch the display/non-display of the character/graphic image together with the switching of the audio mode, for example, each time the audio switching button of the remote controller is operated by the viewer. . More specifically, each time the audio switching button is operated, the broadcast receiving terminal device 20 permits the display of the character/graphic image in the main audio mode in a state ST31, and permits the display of characters in the main audio mode, as shown in FIG. Control is performed so as to cyclically switch to the state ST32 in which the display of graphic images is not permitted, the state ST33 in which the display of character and graphic images is permitted in the sub-audio mode, and the state ST34 in which the display of character and graphic images is not permitted in the sub-audio mode. conduct.

For this reason, the control unit 270 stores the immediately preceding audio mode and display/non-display state of the character/graphic image, that is, the state of the audio selection unit 252 and the switch 253b in, for example, a non-volatile memory (not shown). , to realize the last memory function.

For example, it is assumed that the descriptor of the program control information of the selected program designates that the character/graphic image should be displayed in the sub-audio mode. It is also assumed that the current setting state is state ST31. Therefore, the main sound is output from the speaker SPK, and the moving image on which the character/graphic image is not superimposed is displayed on the display device DSP. In state ST31, when the viewer presses the audio switching button once, the control unit 270 changes the setting state to state ST32. In other words, the descriptor of the program control information does not permit the display of character/graphic images in the main audio mode. do not do. Therefore, there is no change in the output of the speaker SPK and the display of the character/graphic image on the display device DSP.

Next, in state ST32, when the viewer presses the sound switching button once, the control unit 270 changes the setting state to state ST33. In other words, the descriptor of the program control information permits the display of character/graphic images in the sub-audio mode. 252 is controlled to output the sub-audio, and the switch 253b is turned on. As a result, a sub-audio is output from the speaker, and a moving image on which the character/graphic image is superimposed is displayed on the display device DSP.

Next, in state ST33, when the viewer presses the sound switching button once, the control section 270 changes the setting state to state ST34. Therefore, the descriptor of the program control information permits the display of text and graphic images in the sub-audio mode. do. As a result, the sub-audio is output from the speaker SPK, and the moving image on which the character/graphic image is not superimposed is displayed on the display device DSP.

Next, in state ST34, when the viewer presses the sound switching button once, the control unit 270 returns the setting state to state ST31. Therefore, in order to switch the audio mode from the main audio mode to the sub-audio mode, the control unit 270 switches and controls the audio selection unit 252 to output the sub-audio. As a result, the main sound is output from the speaker SPK, and the moving image on which the character/graphic image is not superimposed is displayed on the display device DSP.

As described above, the broadcast receiving terminal device 20 operates to switch display/non-display of the character/graphic image linked to the audio mode each time the audio switching button is operated. Therefore, the viewer will be able to display or hide the text and graphic images, even those associated with the audio mode.

[Fourth embodiment]
This embodiment is a modification of the above embodiment, and in a digital broadcasting service using a broadcast signal based on a multiplexed transmission stream, programs are configured in either monaural or stereophonic audio broadcasting. In this case, in response to the operation of the audio switching button on the broadcast receiving terminal device, control is performed so that the character and graphic image is superimposed on the main moving image of the program on the screen (for example, the image of the television camera), or The feature is that control is performed so that the character/graphic image is not displayed on the screen.

That is, in the conventional broadcast receiving terminal device, the audio switching button provided on the remote controller is disabled (does not respond to operation) for programs of the monaural broadcasting system or the stereo broadcasting system. Therefore, the broadcast receiving terminal device 20 of the present embodiment switches display/non-display of the character/graphic image by using the audio mode switching button provided on the remote controller in the program of monaural broadcasting system or stereo broadcasting system. configured as

FIG. 10 is a flow chart showing an example of processing in the broadcast receiving terminal device of the digital broadcasting service system according to the fourth embodiment of the present invention. Such processing is executed when the program selected by the broadcast receiving terminal device 20 is either monaural broadcasting or stereo broadcasting. Since the processing by the broadcast receiving terminal device 20 is the same regardless of whether the program is in the monaural broadcasting system or the stereo broadcasting system, the following description will be given assuming that the program is in the monaural broadcasting system. Further, it is assumed that the setting state of the sound switching button of the broadcast receiving terminal device 20 is a state in which the character/graphic image is displayed and a state in which it is not displayed.

As shown in the figure, the broadcast reception terminal device 20 that has received the broadcast wave performs front-end processing (S1001). That is, as described above, the broadcast receiving terminal device 20 tunes (selects) the received broadcast, extracts the desired broadcast signal, demodulates it, further descrambles it using the decryption key, and restores the multiplexed program stream. Subsequently, the broadcast receiving terminal device 20 separates the program stream into each stream, decodes each separated stream, and thereby generates each program material data.

At this time, the control unit 270 of the broadcast receiving terminal device 20 determines the audio broadcasting system of the selected program (S1002). That is, based on the program control information, the control unit 270 determines whether the audio broadcasting system of the program being selected is monaural broadcasting/stereo broadcasting or dual audio broadcasting.

If the broadcast receiving terminal device 20 determines that the audio broadcasting system is monaural broadcasting/stereo broadcasting, then it determines whether the current setting state is display or non-display (S1003). When the broadcast receiving terminal device 20 determines that the current setting state is display, it turns on the output of character graphic data (S1004). On the other hand, when the broadcast receiving terminal device 20 determines that the current setting state is non-display, it turns off the output of character/graphic data (S1005). That is, in this embodiment, the broadcast receiving terminal device 20 does not switch the audio data to be output.

Next, the broadcast receiving terminal device 20 superimposes caption data and/or character/graphic data on the video data to generate display data (S1006). If there is no caption data and/or character graphic data output, Null data is synthesized with the video data.

The broadcast receiving terminal device 20 controls so that a screen based on the output display data is displayed on the display device, and controls so that sound in the audible range is output from the speaker based on the output audio data. (S1007).

In S1002, when the broadcast receiving terminal device 20 determines that the audio broadcasting system is not monaural broadcasting/stereo broadcasting, caption data and/or text/graphic data are superimposed on the video data according to the current setting state. and generate display data (S1006), and control display and audio output (S1007). As described in other embodiments, the broadcast receiving terminal device 20 may perform processing according to monaural broadcasting/stereo broadcasting.

As described above, according to the present embodiment, when a program is configured in either the monaural broadcasting system or the stereo broadcasting system, the viewer can hear the voice provided in the broadcast receiving terminal device 20 and/or the remote controller. By using the mode switching button, it is possible to superimpose the character/graphic image on the main moving image of the program on the screen, or hide the character/graphic image.

[Fifth Embodiment]
This embodiment is a modification of the above embodiment, and is compatible with each of a plurality of audio modes (for example, main audio mode and sub-audio mode) in a digital broadcasting service using broadcast signals based on multiplexed transmission streams. A stream based on text and graphic images is included in the transmission stream and broadcasted, and the text and graphic images corresponding to the selected audio mode are displayed superimposed on the main moving image on the screen of the broadcast receiving terminal device. Characterized by

FIG. 11 is a block diagram showing an example of a schematic configuration of a broadcaster system in the digital broadcasting service system according to the fifth embodiment of the present invention.

As shown in the figure, in the broadcaster system 10' of this embodiment, the character graphic inserting unit 130' generates first character graphic data and second character graphic data respectively corresponding to the main audio and the secondary audio. are output to the character/graphic encoding unit 125', and the character/graphic encoding unit 125' receives them and outputs the first character/graphic stream and the second character/graphic stream, respectively, as described in the above embodiment. is different from The multiplexer 150 multiplexes the first character/graphic stream and the second character/graphic stream together with other streams. Since other components are the same as those of the above embodiment, description thereof is omitted.

FIG. 12 is a block diagram showing an example of a schematic configuration of a broadcast receiving terminal device in a digital broadcast service system according to the fifth embodiment of the present invention.

As shown in the figure, in the broadcast receiving terminal device 20' of the present embodiment, the character/graphics decoding unit 245 decodes the first character/graphics stream and the second character/graphics stream separated from the program stream by the separation unit 230. The first character/graphic data and the second character/graphic data are output by decoding each data, and the character/graphic selection unit 255 is provided in place of the switch 253b. is different from

That is, under the control of the control unit 270, the character/graphic selection unit 255, in conjunction with the selection operation of the audio selection unit 252, sends either the first character/graphic data or the second character/graphic data to the synthesizing unit 254. Output. That is, when the viewer selects the main audio mode, under the control of the control section 270, the audio selection section 252 selects the first audio data, and the character/graphic selection section 255 selects the corresponding first audio data. Select the character graphic data of . On the other hand, when the viewer selects the secondary audio mode, under the control of the control section 270, the audio selection section 252 selects the second audio data, and the character/graphic selection section 255 selects the corresponding second audio data. Select the character graphic data of .

As described above, according to the present embodiment, since the broadcaster transmits the character/graphic data corresponding to each audio mode in the transmission stream, the character/graphic image corresponding to the audio mode selected by the viewer is transmitted. , is appropriately superimposed on the main moving image of the program on the screen.

That is, the character/graphic image is displayed on the screen of the broadcast receiving terminal device 20 only in the audio mode designated by the broadcaster. More specifically, when the current audio mode is the main audio mode, the broadcast receiving terminal device 20 selects the first audio data and the corresponding first character graphic data. are output to the synthesizing unit 254, and superimposed on the video data. As a result, audio based on the first audio data is output from the speaker SPK, while the first character/graphic image corresponding to, for example, the audio mode is superimposed on the video captured by the television camera on the display device DSP. A composite screen is displayed.

Further, when the current audio mode is the sub-audio mode, the broadcast receiving terminal device 20 selects the second audio data, selects the second character/graphic data, and outputs them to the synthesizing unit 254 . , is superimposed on the video data. As a result, audio based on the second audio data is output from the speaker SPK, while a second character/graphic image input by handwriting with a pen, for example, is superimposed on the image captured by the television camera on the display device DSP. A composite screen is displayed.

(Modification)
As a modification of the present embodiment, the broadcast receiving terminal device 20 switches the audio mode according to the operation by the viewer, and selectively displays the text and graphic images superimposed with the main moving image of the program on the screen. It may be controlled so that it can be switched to be displayed or hidden.

That is, the broadcast receiving terminal device 20 of the present embodiment switches the audio mode and displays the first character/graphic image or the second It is configured to switch display/non-display of any of the character/graphic images. In this case, the broadcast receiving terminal device 20 cyclically switches between the states ST31 to ST34 each time the voice switching button is operated, as shown in the modified example of the third embodiment (FIG. 9). control.

For example, assume that the current setting state is state ST31. Therefore, the main sound is output from the speaker SPK, and the moving image on which the first character/graphic image is superimposed is displayed on the display device DSP. In state ST31, when the viewer presses the audio switching button once, the control unit 270 changes the setting state to state ST32. Therefore, the control unit 270 turns off the character/graphic selecting unit 255 . As a result, the output from the speaker SPK remains the main sound, and the moving image on which the first character/graphic image is not superimposed is displayed on the display device DSP.

Next, in state ST32, when the viewer presses the sound switching button once, the control unit 270 changes the setting state to state ST33. Therefore, in order to switch the audio mode from the main audio mode to the secondary audio mode, the control unit 270 switches and controls the audio selection unit 252 to output the secondary audio, and at the same time, selects the second character graphic image. Controls the figure selection unit 255 . As a result, the sub-audio is output from the speaker SPK, and the moving image on which the second character/graphic image is superimposed is displayed on the display device DSP.

Next, in state ST33, when the viewer presses the sound switching button once, the control section 270 changes the setting state to state ST34. Therefore, the control unit 270 turns off the character/graphic selecting unit 255 . As a result, the output from the speaker SPK remains the sub-audio, and the moving image on which the second character/graphic image is not superimposed is displayed on the display device DSP.

Next, in state ST34, when the viewer presses the sound switching button once, the control unit 270 returns the setting state to state ST31. Therefore, in order to switch the audio mode from the main audio mode to the secondary audio mode, the control unit 270 switches and controls the audio selection unit 252 to output the secondary audio, and selects the character graphic image so that the first character graphic image is selected. It controls the selection unit 255 . As a result, the main sound is output from the speaker SPK, and the moving image on which the first character/graphic image is superimposed is displayed on the display device DSP.

Next, processing in the broadcast receiving terminal device of this embodiment will be described. The processing in the broadcast receiving terminal device is basically the same as the processing shown in FIG. 7, but the output control processing of character/graphic data in S703 is different. FIG. 13 is a flow chart showing an example of processing in the broadcast receiving terminal device of the digital broadcasting service system according to the fifth embodiment of the present invention. shows details of the output control process of .

That is, in the character graphic data output control process of the present embodiment, as shown in FIG. 13, the broadcast receiving terminal device 20 determines the current audio mode (S1301). When the broadcast receiving terminal device 20 determines that the current audio mode is the main audio mode, it then determines whether or not the setting state of the audio switching button designates display of the first character/graphic image. (S1302). When the broadcast receiving terminal device 20 determines that the setting state designates display of the first character/graphic image, it selects and outputs the first audio data and turns on the output of the first character/graphic data. (S1303). On the other hand, when the broadcast receiving terminal device 20 determines that the setting state specifies that the first character/graphic image should not be displayed, it selects and outputs the first audio data and displays the first character/graphic image. The output of the data and the second character graphic data is turned off (S1304).

On the other hand, if the broadcast receiving terminal device 20 determines in S1301 that the current audio mode is not the main audio mode (it is the secondary audio mode), then the setting state of the audio switching button is changed to that of the second character/graphic image. It is determined whether or not display is specified (S1305). When the broadcast receiving terminal device 20 determines that the setting state designates display of the second character/graphic image, it selects and outputs the second audio data and selects the second character/graphic data. Output (S1306). On the other hand, when the broadcast receiving terminal device 20 determines that the setting state specifies that the second character/graphic image should not be displayed (No in S1305), it selects and outputs the second audio data. The output of the first character graphic data and the second character graphic data is turned off (S1307).

As described above, the broadcast receiving terminal device 20 operates to switch display/non-display of the character/graphic image linked to the audio mode each time the audio switching button is operated. Therefore, the viewer can display or hide the text and graphic images even if they are associated with the audio mode.

Each of the above embodiments is an example for explaining the present invention, and is not intended to limit the present invention only to these embodiments. The present invention can be embodied in various forms without departing from the gist thereof.

For example, in the methods disclosed herein, steps, actions or functions may be performed in parallel or in a different order without conflicting results. The steps, acts and functions described are provided as examples only and some of the steps, acts and functions may be omitted or combined together without departing from the scope of the invention. one, and other steps, operations, or functions may be added.

In addition, although various embodiments are disclosed in this specification, specific features (technical matters) in one embodiment may be added to other embodiments or Certain features in the embodiments can be substituted and such forms are included in the gist of the invention.

DESCRIPTION OF SYMBOLS 1... Digital broadcasting service system 10... Broadcaster system 110... Program operation apparatus 120... Encoding part 121... Video encoding part 122... Still image encoding part 123... Audio encoding part 124... Subtitle encoding part 130... Character figure insertion part 140... Program information generation unit 150 Multiplexing unit 160 Scrambler 170 Modulation unit 180 Transmission unit 20 Broadcast receiving terminal device 210 Tuner/modulation unit 220 Descrambling unit 230 Separation unit 240 Decoding unit 250 Output control Section 251 Moving/Still Image Switching Section 252 Audio Selecting Section 253a, 253b Switch 254 Synthesizing Section 255 Text/Graphic Selecting Section 260 Data Broadcasting Engine 270 Control Section 280 Operation Receiving Section DSP Display Device SPK Speaker

Claims (7)

A broadcast receiving terminal device adapted for digital broadcasting services,
a front-end processing unit that generates at least video data, first audio data, second audio data, caption data, and text/graphic data based on a broadcast signal of a received program;
a display control unit for controlling display of the program image on the screen of the display device based on the display data;
an audio control unit that performs control so that audio based on either the first audio data or the second audio data is output from a speaker;
The display control unit superimposes the character graphic data on the video data in conjunction with the output of either the first audio data or the second audio data selected according to the operation of a viewer. to generate the display data;
Broadcast receiving terminal equipment. The display control unit
when the first audio data is selected, control is performed to superimpose the character graphic data on the video data;
controlling not to superimpose the text and graphic data on the video data when the second audio data is selected;
The broadcast receiving terminal device according to claim 1. The display control unit controls not to superimpose the character graphic data on the video data when the viewer performs the further operation after the first audio data is selected.
3. The broadcast receiving terminal device according to claim 1 or 2. A broadcast receiving terminal device adapted for digital broadcasting services,
a front-end processing unit that generates at least video data, first audio data, second audio data, caption data, and text/graphic data based on a broadcast signal of a received program;
a display control unit that controls so that the program image of either the first form or the second form is displayed on the screen of the display device;
an audio control unit that controls so that audio based on either the first audio data or the second audio data is output from a speaker according to the operation of an audio switching button of a remote controller by a viewer;
The program image of the first form is an image including at least a moving image based on the video data and a text and graphic image based on the text and graphic data,
The program image of the second form is an image that includes the moving image but does not include the character graphic image,
The display control unit
controlling to display the program image of the first form on the screen when the sound based on the first audio data is controlled to be output from the speaker;
When the sound based on the second audio data is controlled to be output from the speaker, the program image of the second form is controlled to be displayed on the screen;
Broadcast receiving terminal equipment. The display control unit
a switching control unit for controlling whether or not to output the character graphic data;
a synthesizing unit including a first synthesizing unit for synthesizing the video data and the subtitle data; and a second synthesizing unit for synthesizing the video data and the character graphic data;
5. The broadcast receiving terminal device according to claim 4. The switching control unit is
controlling to output the character graphic data to the second synthesizing unit when the voice based on the first audio data is controlled to be output from the speaker;
controlling not to output the character graphic data to the second synthesizing unit when the voice based on the second audio data is controlled to be output from the speaker;
The broadcast receiving terminal device according to claim 5. the character graphic data includes at least first character graphic data and second character graphic data;
The switching control unit is
When the program control information generated based on the broadcast signal includes information designating display of the character/graphic image in the first audio mode, the first character/graphic data is output to the second synthesizing unit. control to
when the program control information includes information designating display of the character/graphic image in the second audio mode, controlling to output the second character/graphic data to the second synthesizing unit;
The broadcast receiving terminal device according to claim 5.

Images