JP2004282137A - Television broadcast receiver - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a television broadcast receiver capable of displaying main information with attached information superimposed thereon in a way that viewing of the main information is not disturbed. <P>SOLUTION: The television broadcast receiver includes: an information separation means for separating a broadcast signal from a television broadcast station into the main information and the attached information; a superimposed region detection means for detecting a superimposed region object wherein an image of the attached information is superimposed on an image of the main information and the resulting information is displayed; a superimposition decision means for deciding a position of the superimposed region object at which the image of the attached information is superimposed and displayed on the basis of the superimposed region object detected by the superimposed region object detection means; and a superimposition processing means for superimposing the attached information on the main information and outputting the resulting information as broadcast program data. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to a digital television broadcast receiver having a function of superimposing and displaying data such as characters and images on a screen of a program being viewed.
[0002]
[Prior art]
2. Description of the Related Art In a digital television broadcasting system, data broadcasting is performed in which additional information such as images and audio data is superimposed on main information as a program and transmitted. In data broadcasting, a broadcaster that provides a broadcast program transmits additional information at the same time as the main information that is a program, and data transmitted as additional information includes information related to the program, which is broadcasted by the broadcast station. Information about other programs, advertisements, and emergency information such as earthquakes and tsunamis. The viewer can select viewing of the data broadcast by inputting the request signal.
[0003]
With reference to FIG. 19, an example of a conventional digital television broadcast receiver described in JP-A-2001-251565 will be described. This digital television broadcast receiver includes a receiving unit 301, an information separating unit 302, an additional information reproducing unit 314, a superimposing judging unit 316, a superimposing processing unit 318, an internal memory 320, and a user input unit 321. The internal memory 320 has an association table 320A of the time and the scene number of the main information, an association table 320B of the scene number and the additional information to be superimposed at that time, and an additional information storage unit 320C for storing the additional information.
[0004]
The receiving unit 301 decodes a broadcast signal from a broadcast station into a broadcast stream, and transmits the broadcast stream to the information separating unit 302. The information separation unit 302 separates the broadcast stream into a main information stream and an additional information stream, and transmits them to the superimposition processing unit 318 and the additional information reproduction unit 314, respectively. The additional information reproducing unit 314 extracts additional information image data and a superimposition parameter from the additional information stream, and transmits them to the internal memory 320. The superimposition determination unit 316 generates additional information image data to be superimposed on the main information from information from the internal memory 320 and the user input unit 321, and transmits the generated additional information image data to the superimposition processing unit 318. The superimposition processing unit 318 superimposes the main information stream from the information separation unit 302 and the additional information image data from the superimposition determination unit 316, and outputs it as broadcast program data.
[0005]
With reference to FIG. 20, the concept of a method of superimposing additional information on main information and displaying it on a screen in a conventional digital television broadcast receiver will be described. As shown in FIG. 20A, assume that a scene in which two persons are sitting and talking at a table is used as an image of main information. As shown in FIG. 20B, when the scene set in the internal memory 320 is displayed, the additional information is superimposed and displayed at the designated position 2001 in the image of the main information.
[0006]
In addition, a small image 2002 such as a button is displayed in the main information screen, and when a request to display additional information is input from the user input unit 321, the additional information can be displayed as an original large image. is there.
[0007]
[Patent Document 1]
JP 2001-251565 A
[Patent Document 2]
JP-A-11-164235
[0008]
[Problems to be solved by the invention]
In the related art, it is necessary to previously determine a superimposition position and a superimposition time at which additional information is superimposed on main information and displayed. Therefore, it is necessary to consider the superimposed position and time of the additional information while considering the scene of the main information so as not to hinder the viewing of the main information. However, in practice, additional information may be displayed at a position and time that hinder viewing of the main information.
[0009]
Even if a small image such as a button indicating the presence of the additional information is displayed instead of the additional information, such a small image is displayed at a fixed position in the main information. May interfere with
[0010]
An object of the present invention is to provide a digital television broadcast receiver capable of superimposing and displaying additional information on main information so as not to hinder viewing of the main information.
[0011]
An object of the present invention is to provide a digital television broadcast receiver which does not require the additional information provider to preset the superimposition position and superimposition time so as not to hinder viewing of the main information.
[0012]
[Means for Solving the Problems]
In general, television broadcast video has the following characteristics.
(1) Relatively important information tends to be displayed at the center of the screen, and relatively unimportant information tends to be displayed at the end of the screen.
(2) The part of the image of the main information, in which the amount of change in color gradation is spatially small, has a single-color configuration, and the importance of the information is often low.
(3) In a part of the image of the main information, where the amount of change in the color gradation is temporally small, the importance of the information is often low, such as the background.
(4) The high importance part and the low importance part of the image of the main information differ depending on the program content.
[0013]
According to the present invention, a portion considered to be less important in the main information is detected based on the characteristics of the image of the television broadcast, and the additional information is superimposed on the detected portion and displayed.
[0014]
According to the present invention, a television broadcast receiver includes an information separation unit that separates a broadcast signal from a television broadcast station into main information and additional information, and superimposes and displays an image of the additional information on an image of the main information. Superimposition region detecting means for detecting a superimposition region candidate for use; superimposition determination means for determining a position at which an image of additional information is superimposed and displayed from the superimposition region candidate detected by the superimposition region detection device; And superimposing processing means for superimposing the additional information and outputting it as broadcast program data.
[0015]
According to the present invention, in the television broadcast receiver, further, main information storage means for storing main information separated by the information separation means, and additional information storage means for storing additional information separated by the information separation means And
[0016]
Further, by adding the following function, more flexible handling of superimposition of additional information is possible.
(1) A parameter used for detecting a superimposed area of the additional information is changed based on the program contents of the main information and the additional information.
(2) When the main information and the additional information are stored data, it is possible to detect the superimposition region of the additional information by using the entire time data of each program.
[0017]
Further, by providing a means for the viewer to input conditions for superimposing the additional information on the main information, the additional information can be displayed without giving the viewer discomfort. Further, since the superimposed position of the additional information is automatically detected, the additional information sender does not need to consider the broadcast configuration of the main information, and can provide the additional information.
[0018]
BEST MODE FOR CARRYING OUT THE INVENTION
With reference to FIG. 1, the concept of a method of superimposing additional information on main information and displaying it on a screen in a digital television broadcast receiver according to the present invention will be described. As shown in FIG. 1A, a scene in which two people are sitting and talking at a table is assumed as an image of main information. As shown in FIG. 1B, an area candidate for displaying the additional information is detected from the image of the main information. As a region candidate for displaying the additional information, a region in which the color change is small in time or space or a region in which the amount of main information is small is selected. For example, an area B1 with a small temporal change in color such as a background, an area B2 with a small spatial change in color such as a table, and a peripheral portion B3 of the screen are selected.
[0019]
As shown in FIG. 1C, for example, an area B1 with a small change in color over time is selected as an area in which the additional information A1 of "Announcement of AB City" is displayed in a superimposed manner. An area B2 having a small spatial change in color is selected as an area where information A2 is superimposed and displayed. Although not shown, other additional information may be superimposed and displayed on the peripheral portion B3 of the screen. The additional information A1 and A2 include characters, images, and the like. FIG. 1D shows a screen on which the additional information A1 and A2 are superimposed and displayed on the main information.
[0020]
Thus, in this example, since the additional information is superimposed and displayed on an area where the color change is small in time or space or an area where the amount of main information is small, the additional information is added to the main information without hindering the viewer's viewing. Information can be superimposed and displayed.
[0021]
A first example of a digital television broadcast receiver according to the present invention will be described with reference to FIG. The digital television broadcast receiver of this example includes a receiving unit 101, an information separating unit 102, a main information reproducing unit 110, a spatial color change amount analyzing unit 111, a temporal color change amount analyzing unit 112, a main information processing unit 113, and additional information. It has a reproduction unit 114, a superimposition area detection unit 115, a superimposition determination unit 116, an additional information processing unit 117, a superimposition processing unit 118, an internal memory 120, and a user input unit 121. The internal memory 120 has an area detection parameter section 120A and an additional information superimposition parameter section 120B. The data recorded in the internal memory 120 can be changed according to a user command input through the user input unit 121.
[0022]
The receiving unit 101 decodes a broadcast signal from a broadcast station into a broadcast stream, and transmits it to the information separating unit 102. The information separation unit 102 separates a broadcast stream into a main information stream and an additional information stream. Although the additional information of this example includes character information and video information, unlike the additional information of the related art, it is not necessary to include the superposition position and the superimposition time of the additional information.
[0023]
The main information reproducing unit 110 converts the main information stream into main information color gradation data Mc, which is image data of each sheet, and converts the main information stream into a spatial color change amount analysis unit 111, a temporal color change amount analysis unit 112, The information is transmitted to the main information processing unit 113 and the superimposed area detection unit 115.
[0024]
The spatial color change amount analysis unit 111 compares the color of the reference pixel and the color of the adjacent pixel at a predetermined time based on the main information color gradation data Mc, and calculates the spatial color change amount Sc from the difference between the two. Based on the main information color gradation data Mc, the temporal color change amount analysis unit 112 compares the color of the reference pixel at a predetermined time with the past color, and calculates the temporal color change amount Tc from the difference between the two.
[0025]
The additional information reproducing unit 114 converts the additional information stream into additional information color gradation data Ac, which is image data, and transmits it to the superimposed area detection unit 115 and the additional information processing unit 117. At the same time, data such as the reception time of the additional information and the size of the image are transmitted to the superimposition region detection unit 115 and the superimposition determination unit 116.
[0026]
The superimposition region detection unit 115 detects a superimposition region candidate for each additional information based on the following parameters.
(1) Set value of area detection parameter section 120A
(2) Set value of additional information superimposition parameter section 120B
(3) Main information color gradation data Mc from main information reproducing section 110
(4) Spatial color change Sc from the spatial color change analyzer 111
(5) Temporal color change amount Tc from temporal color change amount analysis unit 112
(6) Additional information color gradation data Ac from additional information reproducing unit 114
(7) Reception time and size of image from additional information reproducing unit 114
[0027]
The superimposition region detection unit 115 transmits the detected superimposition region candidate data to the superimposition determination unit 216. The superimposition determination unit 116 receives the additional information reception time and the image size from the additional information reproduction unit 114, the superimposition area candidate data of each additional information from the superimposition area detection unit 115, and the superimposition area priority from the additional information superimposition parameter unit 120B. The position where the additional information is superimposed on the main information is determined, that is, the superimposition area is determined. The superimposition determination unit 116 transmits the determined superimposition region to the main information processing unit 113 and the additional information processing unit 117.
[0028]
The main information processing unit 113 processes the main information color gradation data Mc from the main information reproduction unit 110 into a form suitable for superimposition based on the condition from the superimposition determination unit 116. The additional information processing unit 117 processes the additional information color gradation data Ac from the additional information reproduction unit 114 into a form suitable for superimposition based on the condition from the superimposition determination unit 116. Finally, the superimposition processing unit 118 superimposes the processed main information color gradation data Mc and the additional information color gradation data Ac, and outputs the result as broadcast program data.
[0029]
With reference to FIG. 3, an example of calculation of the space color change Sc (X, Y, T) in the space color change analyzer 111 will be described. Here, the spatial color change amount Sc (X, Y, T) is defined as a numerical value of the color tone difference between the pixel at the coordinates (X, Y, T) at time T and the adjacent pixel. The coordinates (X, Y, T) are referred to as reference coordinates, and the pixel is referred to as a reference pixel.
[0030]
In the example of FIG. 3, the main information color gradation data of the reference pixel is Mc (X, Y, T), and the main information color gradation data of four pixels adjacent in the X coordinate direction and the Y coordinate direction is Mc (X + 1). , Y, T), Mc (X-1, Y, T), Mc (X, Y + 1, T) and Mc (X, Y-1, T). The spatial color change amount Sc (X, Y, T) includes main information color gradation data Mc (X + 1, Y, T), Mc (X-1, Y, T), Mc (X, Y + 1, T) and Mc (X, Y-1, T) and the absolute value of the difference between the main information color gradation data Mc (X, Y, T) of the reference pixel, and is expressed by the following equation.
[0031]
(Equation 1)
Mc (X, Y, T) = | Mc (X + 1, Y, T) -Mc (X, Y, T) | + | Mc (X-1, Y, T) -Mc (X, Y, T) | + | Mc (X, Y + 1, T) -Mc (X, Y, T) | + | Mc (X, Y-1, T) -Mc (X, Y, T) |
[0032]
It can be said that the larger this value is, the larger the spatial change of the color gradation is around the reference coordinates (X, Y, T). For example, the color gradation of a pixel at reference coordinates (X, Y, T) is 1, and the color gradation of pixels at coordinates (X-1, Y, T) and (X + 1, Y, T) adjacent in the X coordinate direction. Is 3 and 1, and the color gradation of pixels at coordinates (X, Y-1, T) and (X, Y + 1, T) adjacent in the Y coordinate direction are 2 and 1, and the spatial color change Sc (X, Y, T) is as follows.
[0033]
(Equation 2)
Sc (X, Y, T) = 2 + 0 + 1 + 0 = 3
[0034]
In this example, the spatial color change amount Sc (X, Y, T) is indicated by the absolute value of the color gradation difference between the reference pixel and four adjacent pixels in a single-color image. However, if the degree of color gradation change around a pixel can be quantified, such a calculation method need not be used. For example, the correction may be made by the following method.
(1) An image of a plurality of colors such as a color image (although it is a single color image in the example of FIG. 3).
(2) The number of adjacent pixels to be compared with the reference pixel is increased or decreased (in the example of FIG. 3, the number of adjacent pixels is compared with four adjacent pixels). The reference pixel is compared with a neighboring pixel instead of an adjacent pixel.
(3) Weighting is performed by pixels and gradations (though there is no weighting in the example of FIG. 3).
(4) The calculation method of the amount of color change between the reference pixel and the adjacent pixel is changed (although in the example of FIG. 3, the absolute value of the difference between the color gradations).
[0035]
Next, a calculation example of the temporal color change amount Tc (X, Y, T) in the temporal color change amount analysis unit 112 will be described with reference to FIG. Here, the temporal color change amount Tc (X, Y, T) is a value obtained by quantifying the color tone difference between the pixel at the time T and the pixel at a time earlier than that at a predetermined coordinate (X, Y). Defined to be. The coordinates (X, Y, T) are referred to as reference coordinates, and the pixel is referred to as a reference pixel.
[0036]
In the example of FIG. 4, the main information color gradation data of the reference pixel is Mc (X, Y, T), and the main information color gradation data of the pixel at the past time T-1 and T-2 is Mc (X , Y, T-1) and Mc (X, Y, T-2). The temporal color change amount Tc (X, Y, T) is the main information color gradation data Mc (X, Y, T-1), Mc (X, Y, T-2) of the pixel in the past two images. And the main information color gradation data Mc (X, Y, T) of the reference pixel.
[0037]
[Equation 3]
Tc (X, Y, T) = | Mc (X, Y, T) -Mc (X, Y, T-1) | + | Mc (X, Y, T) -Mc (X, Y, T-2 ) ｜
[0038]
It can be said that the larger this value is, the larger the temporal change of the color gradation of the pixel at the reference coordinates (X, Y, T) is. For example, the color gradation of the pixel at the reference coordinate (X, Y, T) at the time T is 2, the color gradation of the pixel at the coordinate (X, Y, T-1) at the time T-1 is 1, and the color gradation at the time T- Assuming that the color gradation of the pixel at the coordinates (X, Y, T-2) in 2 is 1, the temporal color change amount Tc (X, Y, T) is as follows.
[0039]
(Equation 4)
Tc (X, Y, T) = 1 + 1 = 2
[0040]
In this example, the temporal color change amount Tc (X, Y, T) is indicated by the absolute value of the color gradation difference between the reference pixel and the past two pixels in the monochrome image. However, as long as the degree of color gradation change over time of a pixel can be quantified, this method need not be used. For example, the correction may be made by the following method.
(1) A plurality of color images are formed like a color image (although the image in FIG. 4 is a single color image).
(2) (In the example of FIG. 4, the reference pixel and the past two pixels are compared) The number of past pixels to be compared with the reference pixel is increased or decreased.
(3) In the example of FIG. 4, only pixels in the past are used, but future pixels are used for detecting a color gradation change in accumulated data or the like.
(4) Weighting is performed by pixels and gradations (though there is no weighting in the example of FIG. 4).
(5) The method of calculating the amount of color change between the reference pixel and the past pixel is changed (although the absolute value of the color tone difference is used in the example of FIG. 4).
[0041]
An example of data recorded in the area detection parameter unit 120A will be described with reference to FIG. The following five parameters are recorded in the area detection parameter section.
(1) A superimposable area: an area in which additional information on an image of main information can be superimposed. In the first example of FIG. 5, the superimposable area is within 200 pixels from the four sides of the main information image. In the second example, the superimposable area is the four sides of the main information image. Is within 300 pixels. As shown in FIG. 7, the superimposable area is a frame-shaped portion along the edge of the image of the main information.
(2) Spatial color change average value Ave (Sc): Reference value or condition of the average spatial color change amount for all coordinates in area D
(3) Spatial color change amount variance Dist (Sc): a reference value or condition of the variance of the space color change amount for all coordinates in the area D
(4) Temporal color change average value Ave (Tc): Reference value or condition of average of temporal color change amounts for all coordinates in area D
(5) Temporal color change amount variance Dist (Tc): a reference value or condition of an average value of the temporal color change amount for all coordinates in the area D
[0042]
According to these conditions, the superimposition region detection unit 115 detects a superimposition region candidate. The values of these parameters can be changed by a user command input via the user input unit 121. In addition, here, these five parameters are shown as an example, but other parameters can also be used as long as the parameters indicate characteristics of the superimposed region. For example, (1) weighting of the average value of the color change amount from the center coordinates (X, Y), (2) recognition of a superimposable area used in a DP (Dynamic Programming) matching method or the like. Parameters such as a model for use.
[0043]
An example of data recorded in the additional information superimposition parameter unit 120B will be described with reference to FIG. The following parameters are recorded in the additional information superimposition parameter section.
(1) Superimposable average color tone difference: Reference value or condition of difference between main information average color tone Ave (Mc) and additional information average color tone Ave (Ac) in region D
(2) Additional information discoloration gradation: reference value or condition of color gradation amount of additional information image that may be changed to superimpose additional information on main information
(3) Additional information deformation amount: a reference value or condition of the additional information image deformation amount which may be changed to superimpose the additional information on the main information.
(4) Main information discoloration gradation: reference value or condition of color gradation amount of main information image which may be changed to superimpose additional information on main information
(5) Superimposition area priority: priority used for determining the superimposition area
[0044]
The superimposition determination unit 116 determines a superimposition position, that is, a superimposition area, using these parameters as superimposition references, and the superimposition area detection unit 115 uses these parameters to detect superimposition area candidates. These parameters can be changed by the user's instruction input via the user input unit 121, similarly to the area detection parameters. Also, here, these five parameters are shown as an example. For example, (1) additional information is displayed instantaneously, and the minimum superimposed display time for preventing the viewer from noticing the display of the additional information, and the like. It is also possible to use a parameter indicating a method of superimposing additional information.
[0045]
With reference to FIG. 7, an outline of a method of detecting a superimposition region candidate for superimposing the image AIG of the additional information on the image MIG of the main information in the superimposition region detection unit 115 will be described. The superimposition region detection unit 115 inputs the main information from the main information generation unit 110 and the additional information from the additional information reproduction unit 114. The image AIG of the additional information may be rectangular. First, the center coordinates are provisionally set in the superimposable area, and a plurality of areas D are created on the center coordinates. The area D is obtained by deforming the image of the additional information based on the size of the image of the additional information from the additional information reproducing unit 114 and the amount of additional information deformation from the additional information superimposing parameter unit 120B. Next, it is calculated whether or not these areas D satisfy predetermined conditions in the superimposable area from the area detection parameter unit 120A. A region D that satisfies the condition is a superimposition region candidate for superimposing the additional information on the main information.
[0046]
Further, in this example, the area D is rectangular, but by adding a parameter, the area D has a complex shape such as a star shape or a ring shape, or an area where the additional information includes a transparent color. It is also possible to handle various areas.
[0047]
The operation of the superimposed region detection unit 115 will be described with reference to FIG. In step 401, a process of detecting a superimposed region is started. The detection of the superimposition region is performed for each additional information. In step 402, the center coordinates (X, Y) are temporarily determined in the superimposable area specified by the area detection parameter unit 120A. Further, based on the additional information color gradation data Ac from the additional information reproducing unit 114, an additional information average color gradation Ave (Ac) which is an average color gradation of all pixels of the additional information is calculated. This calculation is performed to know the color characteristics of the entire additional information image in order to effectively arrange the additional information image. Here, the color characteristics of the additional information image data are to be grasped by the average value of the color gradations of all the pixels of the additional information. However, the method is not limited to this if the color characteristics of the additional information image data can be grasped.
[0048]
In step 403, the processing regarding the coordinates (X, Y) temporarily determined is started. In step 404, a region D for superimposing additional information is provisionally determined around the coordinates (X, Y). As described above, the size of the additional information superimposition region D is determined by the size of the additional information image from the additional information reproducing unit 114 and the amount of additional information deformation from the additional information superimposition parameter unit 120B. In this example, the coordinates (X, Y) are defined as the center coordinates of the area D, but the present invention is not limited to this as long as the position of the area D can be uniquely defined in the main information image. In step 405, the processing for the area D is started.
[0049]
In step 406, it is determined whether or not the area D centered on the coordinates (X, Y) exceeds the superimposable area set in the area detection parameter unit 120A. If the area D exceeds the superimposable area, the process proceeds to step 415. If the area D does not exceed the superimposable area, the process proceeds to step 407.
[0050]
In step 407, processing for all coordinates in the area D is started. In step 408, first, for all the coordinates in the region D, the spatial color change amount Sc, the temporal color change amount Tc, and the main information color gradation data Mc are respectively converted into the spatial color change amount analysis unit 111 and the temporal color change amount analysis unit 111. Called from the unit 112 and the main information reproducing unit 110. Next, the following parameters for the area D are calculated.
[0051]
(1) Average spatial color change Ave (Sc): average value of spatial color change Sc for all coordinates in area D
(2) Spatial color change amount variance Dist (Sc): a variance value of the spatial color change amount Sc for all coordinates in the area D
(3) Average temporal color change amount Ave (Tc): average value of temporal color change amount Tc for all coordinates in area D
(4) Temporal color change amount variance Dist (Tc): variance value of temporal color change amount Tc for all coordinates in region D
(5) Main information average color tone Ave (Mc): average value of main information color tone Mc for all coordinates in area D
[0052]
In this example, these five parameters are calculated. However, if the calculation for all coordinates in the area D and the parameters for detecting the superimposed area are defined, other values are calculated for detecting the superimposed area. It is also possible.
[0053]
In step 409, the four parameters Ave (Sc), Dist (Sc), Ave (Tc), and Dist (Tc) calculated in step 408 are defined by the area detection parameter unit 120A (FIG. 5). It is determined whether or not the above is satisfied. If satisfied, proceed to step 410; otherwise, proceed to step 415.
[0054]
In step 410, the processing of the average color gradation is started. In step 411, the main information average color tone Ave (Mc) in the area D calculated in step 408 is compared with the additional information average color tone Ave (Ac) calculated in step 402. The reason why the average color gradation of the main information image and the average color gradation of the additional information image are compared is to know the color characteristics of the entire image and to effectively arrange the additional information. Here, the color feature of the image data is to be grasped by the average value of the color gradation of all pixels, but the method is not limited to this if the color feature can be grasped.
[0055]
It is determined whether or not the difference value between the two satisfies the condition of the superimposable average color tone difference (FIG. 6) defined by the additional information superimposition parameter unit 120B. If so, the process proceeds to step 414; otherwise, the process proceeds to step 412.
[0056]
In step 412, it is determined whether there is any uncalculated color change. If there is an uncalculated color change, the process proceeds to step 413; otherwise, the process proceeds to step 415.
[0057]
In step 413, first, the main information and the additional information are discolored within the range of the main information discoloration gradation and the additional information discoloration gradation defined by the additional information superimposition parameter unit 120B (FIG. 6). Here, as a method of the color change processing, it is considered that the color gradation is similarly increased / decreased for all pixels of the main information image of the monochromatic image and the additional information image, but the following method is also conceivable.
[0058]
(1) A method of changing a weight to be changed for each color in a multi-color image of a color image
(2) A method of changing the weight in a region such that the color change is small at the center of the region and large at the end.
(3) A method of changing the main information based on the value of the main information color gradation data Mc and the additional information based on the value of the additional information color gradation data Ac in accordance with the color gradation of each pixel.
[0059]
Next, the main information average color tone Ave (Mc) in the area D calculated in step 408 and the additional information average color tone Ave (Ac) calculated in step 402 are added by the additional information superimposition parameter unit 120B. Recalculation is performed so as to satisfy the defined superimposable average color tone difference condition (FIG. 6), and the process returns to step 410 to perform the average color tone process again.
[0060]
In step 414, the center coordinates (X, Y), the area D, the amount of deformation of the additional information in the area D, the amount of discoloration of the main information and the additional information, the gradation difference between the main information and the additional information, and the like are registered. This is transmitted to the superimposition determination unit 116.
[0061]
At step 415, it is determined whether there is any uncalculated shape of the region D. That is, based on the additional information deformation amount of the additional information superimposition parameter section 120B, it is determined whether or not the area D can be further deformed. If there is an uncalculated one, that is, if the area D can be deformed, the shape of the area D is changed in step 416, and the process returns to step 405 to perform processing relating to the new area D after the change.
[0062]
If there is no uncalculated one, that is, if the area D cannot be further deformed, it is determined in step 417 whether the processing has been performed for all the coordinates of the superimposable area. If the process has been completed, the process proceeds to step 419, and the detection ends. If the process has not been completed, the process proceeds to step 418, the uncalculated coordinates are set to the center coordinates (X, Y), and the process returns to step 403. , The processing relating to the center coordinates (X, Y) is performed. FIG. 10 illustrates an example of the superimposed region candidate data obtained by the superimposed region detection unit 115.
[0063]
With reference to FIG. 9, a process of determining a superimposition region in the superimposition determination unit 116 will be described. In step 501, the process is started. In step 502, a sort process for obtaining the order used for determining the superimposed area is started. First, in step 503, it is determined whether or not a superimposition region candidate from the superimposition region detection unit 115 exists. If there is no superimposed region candidate, the process proceeds to step 511; otherwise, the process proceeds to step 504.
[0064]
Next, in step 504, the superimposition region candidates for all the additional information are sorted according to the superimposition region priority (FIG. 6) of the additional information superimposition parameter unit 120B. It determines the order after sorting.
[0065]
In step 505, a process of determining a superimposition position, that is, a superimposition region from the superimposition region candidate of each additional information is started. In step 506, processing for determining a superimposition area for each additional information is started. In step 507, among the superimposition region candidates of the additional information to be processed, the one with the highest rank after sorting is determined to be the most probable candidate, and the most prominent candidate competes with the superimposition region candidate of other additional information for the region. It is determined whether or not there is. If there is a conflict, the process proceeds to step 508; otherwise, the process proceeds to step 512.
[0066]
In step 508, it is determined whether the superposition area candidate of the most probable candidate has a lower rank after sorting than the superposition area candidate of other additional information of the competitor. If the most probable candidate has a lower ranking after sorting than the competing candidate, the process proceeds to step 509. If the ranked candidate is not lower than the competing candidate, the process proceeds to step 512.
[0067]
In step 509, it is determined whether or not other overlapping area candidates other than the current most probable candidate exist in the additional information to be processed. If another superimposition region candidate exists, the process proceeds to step 510; otherwise, the process proceeds to step 511. In step 510, the process returns to step 506 with another superimposed region candidate of the additional information to be processed as the most probable candidate.
[0068]
In step 511, it is determined that the superimposed area cannot be detected, and no additional information is output. At step 512, the most probable candidate is determined as a superimposition region of the additional information and output. In step 513, it is determined whether or not a superimposition region has been determined for all pieces of additional information. If the superimposition region has been determined for all the additional information, the process ends in step 515. If the superimposition region has not been determined for all the additional information, the process proceeds to step 514. Processing for determining an area is performed.
[0069]
This will be described with reference to FIGS. FIG. 10 shows an example of a superimposition region candidate for each piece of additional information detected by the superimposition region detection unit 115. The size of each of the images of the additional information 1, 2, and 3 is 100 × 50. The deformation information indicates a deformation amount of a superimposed region candidate for an image of 100 × 50. Two overlapping area candidates 101 and 102 are detected for the additional information 1, one overlapping area candidate 103 is detected for the additional information 2, and two overlapping area candidates 104 and 105 are detected for the additional information 3. Have been. The data of the additional information from the additional information reproducing unit 114 is attached to each superimposition area candidate.
[0070]
The process of determining a superimposition region in the superimposition determination unit 116 shown in FIG. 9 will be described with reference to the examples of FIGS. First, in order to generate a ranking to be used in the determination of the area conflict, the overlapping area candidates 101 to 105 are sorted (step 504). FIG. 11 shows the result of sorting the superimposition region candidates 101 to 105 according to the superimposition region priority (FIG. 6) of the additional information superimposition parameter unit 120B. The superimposition region candidates 101 to 105 are arranged in ascending order of the main information discoloration gradation which is the first condition. The three superimposition region candidates 101, 103, and 104 have the same main information discoloration gradation. Therefore, the three superimposition region candidates 101, 103 and 104 are arranged in ascending order of the additional information discoloration gradation which is the second condition. Thus, the order of all the superimposed region candidates is determined by continuing the sorting according to the conditions until there is no superimposed region candidate having the same order. If the order of all the superimposed region candidates can be determined, conditions other than the conditions described here may be used.
[0071]
The process of determining the superimposition area of the first additional information 1 will be described. Two superimposition region candidates 101 and 102 have been detected for the first additional information 1. The first superimposition region candidate 101 having a higher ranking after sorting is set as the most probable candidate. It is determined whether or not the most probable candidate has a region conflict with the overlapping region candidates of the additional information 2 and 3. The area competition can be determined by comparing the center coordinates of each superimposed area candidate with the size of the image. The first superimposition region candidate 101 as the most probable candidate competes with the second superimposition region candidate 102 and the superimposition region candidate 103 of the second additional information 2 for the region. Here, consideration is given to whether or not there is a region conflict with a superimposition region candidate of other additional information. Therefore, only the overlapping area candidate 103 of the second additional information 2 is targeted. The first superposition area candidate 101 as the most probable candidate has a lower rank than the superposition area candidate 103 of the second additional information 2. Therefore, the superimposed area of the first additional information 1 is not detected.
[0072]
The process of determining the superimposition area of the second additional information 2 will be described. As for the second additional information 2, only one overlapping area candidate 103 is detected. The superimposition region candidate 103 is set as the most probable candidate. It is determined whether or not the most probable candidate has a region conflict with the overlapping region candidates of other additional information 1 and 3. The overlapping area candidate 103 competes with the overlapping area candidates 101 and 102 of the first additional information 1 for an area. However, the superposition area candidate 103 as the most probable candidate has a higher ranking after sorting than the superposition area candidates 101 and 102 of the first additional information 1 of the competitor. Therefore, regarding the second additional information 2, the overlapping area candidate 103 is determined as the overlapping area.
[0073]
A process of determining a superimposition region of the third additional information 3 will be described. Two superimposed region candidates 104 and 105 have been detected for the third additional information 3. The first superimposed region candidate 104 having a higher ranking after sorting is set as the most probable candidate. It is determined whether or not this most probable candidate has a region conflict with the overlapping region candidates of the additional information 1 and 2. The first overlap region candidate 104 competes with the second overlap region candidate 105 for an area, but does not compete with another overlap information candidate overlap region candidate. Therefore, regarding the third additional information 3, the overlapping area candidate 104 is determined as the overlapping area.
[0074]
A second example of the digital television receiver according to the present invention will be described with reference to FIG. The digital television receiver of this example includes a receiving unit 201, an information separating unit 202, a main information input unit 203, a main information attribute extracting unit 204, a main information storage unit 205, an additional information input unit 206, and an additional information attribute extracting unit 207. , Additional information storage unit 208, main information reproduction unit 210, spatial color change amount analysis unit 211, temporal color change amount analysis unit 212, main information processing unit 213, additional information reproduction unit 214, superimposition area detection unit 215, superposition determination unit 216, an additional information processing unit 217, a superimposition processing unit 218, a superimposition record management unit 219, an internal memory 220, and a user input unit 221. The internal memory 220 has an area detection parameter section 220A, an additional information superimposition parameter section 220B, and an additional information management parameter section 220C. The data recorded in the internal memory 220 can be changed according to a user command input via the user input unit 221.
[0075]
The receiving unit 201 decodes a broadcast signal from a broadcast station into a broadcast stream, and transmits the broadcast stream to the information separating unit 202. The information separation unit 202 separates a broadcast stream into a main information stream and an additional information stream. The additional information of this example includes character information and video information as in the first example. However, unlike the additional information of the conventional example, the additional information need not include the superimposed position and the superimposed time of the additional information. Further, the additional information in this example includes not only still image information but also moving image information.
[0076]
The main information input unit 203 transmits the main information stream to the main information attribute extraction unit 204. If the main information needs to be stored, the main information is transmitted to the main information storage unit 205. The main information storage unit 205 outputs the stored main information data to the main information input unit 203 as needed.
[0077]
The additional information input unit 206 transmits the additional information stream to the additional information attribute extraction unit 207. If additional information needs to be stored, the additional information is transmitted to the additional information storage unit 208. The additional information storage unit 208 outputs the stored additional information data to the additional information input unit 206 as needed.
[0078]
The main information attribute extracting unit 204 extracts the attribute of the main information stream, transmits the extracted attribute to the internal memory 220, and transmits the main information stream to the main information reproducing unit 210. The additional information attribute extraction unit 207 extracts the attribute of the additional information stream, transmits it to the internal memory 220, and transmits the additional information stream to the additional information reproduction unit 214. The attributes of the main information and the additional information are transmitted to the area detection parameter unit 220A, the additional information superimposition parameter unit 220B, and used. Further, the additional information is transmitted to the additional information management parameter unit 220C, and is used for displaying and managing the additional information.
[0079]
The main information reproducing unit 210 converts the main information stream into main information color gradation data Mc, which is image data for each sheet, and converts it into a spatial color change amount analysis unit 211, a temporal color change amount analysis unit 212, The information is transmitted to the information processing unit 213 and the superimposed area detection unit 215.
[0080]
The space color change amount analysis unit 211 compares the color of the reference pixel and the color of the adjacent pixel at a predetermined time based on the main information color gradation data Mc, and calculates the space color change amount Sc from the difference between the two. The temporal color change amount analysis unit 212 compares the color of the reference pixel at a predetermined time with the past color based on the main information color gradation data Mc, and calculates the temporal color change amount Tc from the difference between the two.
[0081]
The additional information reproducing unit 214 converts the additional information into additional information color gradation data Ac, which is image data, and transmits it to the superimposed area detection unit 215 and the additional information processing unit 217. Further, the additional information reproducing unit 214 transmits data such as the image size of the additional information to the additional information management parameter unit 220C.
[0082]
The superimposition region detection unit 215 detects a superimposition region candidate for each additional information based on the following parameters.
(1) Set value of area detection parameter section 220A
(2) Set value of additional information superimposition parameter section 220B
(3) Additional information parameters of additional information management parameter section 220C
(4) Main information color gradation data Mc from main information reproducing section 210
(5) Spatial color change Sc from the spatial color change analyzer 211
(6) Temporal color change amount Tc from temporal color change amount analysis unit 212
(7) Additional information color gradation data Ac from additional information reproducing unit 214
[0083]
The superimposition region detection unit 215 transmits the detected superimposition region candidate data to the superimposition determination unit 216. The superimposition determining unit 216 receives the superimposition region candidate data of each additional information from the superimposition region detection unit 215, the superimposition region priority order from the additional information superimposition parameter unit 220B, the additional information reception time from the additional information management parameter unit 220C, and the like. The position where the additional information is superimposed on the information, that is, the superimposition area is determined. The superimposition determination unit 216 transmits the determined superimposition area to the main information processing unit 213 and the additional information processing unit 217.
[0084]
The main information processing unit 213 processes the main information color tone data Mc from the main information reproduction unit 210 into a form suitable for superimposition based on the condition from the superimposition determination unit 216. The additional information processing unit 217 processes the additional information color gradation data Ac from the additional information reproducing unit 214 into a form suitable for superimposition based on the condition from the superimposition determination unit 216. The superimposition processing unit 218 superimposes the processed main information color gradation data Mc and the additional information color gradation data Ac, and outputs the result as broadcast program data.
The superimposition recording management unit 219 records the output result for each additional information, and transmits it to the additional information management parameter unit 220C.
[0085]
In this example, compared to the first example, the main information data stored in the main information storage unit 205 is used as the main information, and the additional information data stored in the additional information storage unit 208 is used as the additional information. Is different. Therefore, in the present example, the following is possible.
[0086]
(1) An image that needs to guarantee a predetermined display period can be used as additional information. An example of a display period that needs to be guaranteed is a moving image, but a still image other than a moving image is provided with a predetermined display period. Such additional information is handled with the highest priority on display.
[0087]
The superimposition area detection unit 215 can detect the time during which the area for superimposition satisfies the superimposition condition of the additional information by using the accumulated main information of all times. This makes it possible to detect a superimposed region candidate for additional information for which a display period needs to be guaranteed.
[0088]
(2) The main information reproducing unit 210 can convert main information data at an arbitrary time into main information color gradation data Mc.
The method of calculating the spatial color change Sc and the temporal color change Tc in the spatial color change analysis unit 211 and the temporal color change analysis unit 212 is the same as in the first example, and the calculation example is shown in FIG. , And FIG. However, in the present example, unlike the first example, the spatial color change amount analysis unit 211 and the temporal color change amount analysis unit 212 can do the following.
(A) The spatial color change Sc and the temporal color change Tc at an arbitrary time in the main information are calculated.
(B) The main information color gradation data Mc from an arbitrary time to a future time can be used for calculating the temporal color change amount Tc.
As for the calculation method, the method is not limited to this example as long as the change amount of the color gradation can be quantified as in the first example.
[0089]
(3) By storing the additional information in the additional information storage unit 208, the additional information can be superimposed on the main information at an arbitrary time. That is, the time for superimposing the main information on the additional information can be arbitrarily selected. Further, by configuring the superimposition recording management unit 219 to automatically delete the additional information recorded in the additional information management parameter unit 220C, the trouble of the user deleting the additional information is eliminated.
[0090]
FIG. 13 shows an example of data recorded in the area detection parameter section 220A. The area detection parameters of this example include a superimposable area, a spatial color change average value Ave (Sc), a spatial color change amount variance Dist (Sc), a temporal color change average value Ave (Tc), and a temporal color change amount variance. It includes the reference value or condition of the value Dist (Tc) and is the same as the area detection parameter of the first example (FIG. 5). In this example, the area detection is performed in accordance with the attribute of the main information and the attribute of the additional information. The parameter settings 1 to 4 are changed.
[0091]
An example of data recorded in the additional information superimposition parameter unit 220B will be described with reference to FIG. The additional information superimposition parameter of this example includes a superimposable average color gradation difference, additional information discoloration gradation, additional information deformation amount, reference value or condition of main information discoloration gradation, and superimposition area priority. However, in this example, according to the attribute of the main information, the attribute of the additional information and the priority of the superimposition region, the superimposable average color gradation difference, the additional information discoloration gradation , The additional information deformation amount and the main information discoloration gradation condition settings 1 to 4, A, and B are changed.
[0092]
Note that the region detection parameter in FIG. 13 and the additional information superimposition parameter in FIG. 14 can be added or changed in the same manner as in the first example. Further, here, the area detection parameter is set according to the attribute of the main information and the attribute of the additional information. However, the parameter may be set only according to the attribute of each of the main information and the additional information. The parameter setting may be changed according to the state of the main information and the additional information such as the program name, the transmission destination of the main information and the additional information, and the reception date and time of the additional information.
[0093]
An example of data recorded in the additional information management parameter unit 220C will be described with reference to FIG. The additional information management parameters include the following examples.
(1) Additional information attribute: Indicates the content of the additional information.
(2) Issuer of additional information: Indicates the provider of the additional information.
(3) Video playback time: Indicates the video playback time included in the additional information. There are cases where only a still image is included.
(4) Additional information reception date and time: Indicates the date and time when the receiver received the additional information.
(5) Latest output time: indicates the latest time when the additional information is superimposed on the main information.
(6) Transmission time limit: Indicates the time during which the additional information can be superimposed on the main information.
(7) Elapsed transmission time: Indicates the total time up to the present when the additional information is superimposed on the main information.
[0094]
The additional information management parameters in FIG. 15 can be added or changed. The additional information management parameter is used for managing the additional information. For example, when the additional information transmission time limit is set, if the transmission elapsed time exceeds the additional information transmission time limit, processing such as not superimposing the additional information can be performed. In the case where the additional information is data stored in the additional information storage unit 208, processing such as deleting the additional information from the additional information storage unit 208 can be performed. This allows more flexible processing when superimposing the additional information on the main information.
[0095]
With reference to FIG. 16, an operation of the superimposition region detection unit 215 when the main information is data stored in the main information storage unit 205 will be described. In step 601, the process of detecting a superimposed area is started. The detection of the superimposition region is performed for each additional information. In step 602, the center coordinates (X, Y) are temporarily determined in the superimposable area specified by the area detection parameter unit 220A. In this example, a start time T at which the additional information is superimposed is temporarily set. Further, based on the additional information color gradation data Ac from the additional information reproducing unit 214, an additional information average color gradation Ave (Ac) which is an average color gradation of all pixels of the additional information is calculated. This example differs from the first example in FIG. 8 in that the start time T is temporarily determined.
[0096]
In step 603, processing relating to the provisionally determined center coordinates (X, Y) and start time T is started. In step 604, a region D for additional information superimposition is temporarily determined around the coordinates (X, Y). In this example, a period Tw in which additional information is superimposed is provisionally determined. The size of the area D for superimposition is determined by the size of the additional information image from the additional information reproducing unit 214 and the amount of additional information deformation from the additional information superimposition parameter unit 220B. Further, the period Tw is determined from the moving image reproduction time of the additional information management parameter unit 220C. In step 605, processing relating to the region D and the period Tw is started.
[0097]
In step 606, when the period Tw from the start time T is secured, it is determined whether or not the area D centered on the coordinates (X, Y) exceeds the superimposable area. If the area D exceeds the superimposable area, the process proceeds to step 607. If the area D does not exceed the superimposable area, the process proceeds to step 615.
[0098]
In step 607, a process for all coordinates in the area D in the period Tw is started. In step 608, first, the spatial color change amount Sc, the temporal color change amount Tc, and the main information color gradation data Mc for all the coordinates in the region D in the period Tw are converted into the spatial color change amount It is called from the color change amount analysis unit 212 and the main information reproduction unit 210. Next, the following parameters for the area D in the period Tw are calculated.
[0099]
(1) Average spatial color change Ave (Sc): average value of spatial color change Sc for all coordinates in region D during period Tw
(2) Spatial color change amount variance Dist (Sc): variance value of spatial color change amount Sc with respect to all coordinates in region D in period Tw
(3) Temporal color change amount average Ave (Tc): Average value of temporal color change amount Tc for all coordinates in region D during period Tw
(4) Temporal color change amount variance Dist (Tc): variance value of the temporal color change amount Tc for all coordinates in the area D during the period Tw
(5) Main information average color tone Ave (Mc): average value of main information color tone Mc for all coordinates in area D during period Tw
In this example, these five parameters are calculated. However, if the calculation for all coordinates in the area D in the period Tw and the parameters for detecting the superimposed area are defined, other parameters are detected for the superimposed area detection. It is also possible to calculate a value.
[0100]
At step 609, the four parameters Ave (Sc), Dist (Sc), Ave (Tc) and Dist (Tc) calculated at step 608 are defined by the area detection parameter unit 220A (FIG. 13). It is determined whether or not the above is satisfied. If satisfied, go to step 610; otherwise, go to step 615.
[0101]
In step 610, the processing of the average color gradation starts. In step 611, the main information average color tone Ave (Mc) in the area D calculated in step 608 is compared with the additional information average color tone Ave (Ac) calculated in step 602. I do. The reason why the average color gradation of the main information and the additional information is compared is to know the color characteristics of the entire image and to arrange the additional information effectively, as in the first example. The method is not limited to this if the features can be grasped.
[0102]
It is determined whether or not the difference value between the two satisfies the condition of the superimposable average color tone difference (FIG. 14) defined by the additional information superimposition parameter unit 220B. If so, the process proceeds to step 614; otherwise, the process proceeds to step 612. At step 612, it is determined whether there is any uncalculated color change. If there is one that has not been calculated for the discoloration, the process proceeds to step 613; otherwise, the process proceeds to step 615.
[0103]
In step 613, first, the main information and the additional information are discolored within the range of the additional information discoloration gradation and the main information discoloration gradation defined by the additional information superimposition parameter unit 220B (FIG. 14). Next, the main information average color tone Ave (Mc) in the area D calculated in step 608 and the additional information average color tone Ave (Ac) calculated in step 602 are added by the additional information superimposition parameter unit 220B. Recalculation is performed so as to satisfy the defined superimposable average color tone difference condition (FIG. 14), and the process returns to step 610 to perform the average color tone process again.
[0104]
In step 614, the start time T, the period Tw, and the region D in the period Tw are set as superimposable regions, and the center coordinates, the amount of deformation of the additional information in the region D, the amount of discoloration of the main information and the additional information, and the A gradation difference or the like is registered and transmitted to the superposition determination unit 216.
[0105]
In step 615, it is determined whether or not there is an uncalculated shape of the region D. That is, based on the additional information deformation amount of the additional information superimposition parameter section 220B, it is determined whether or not the area D can be further deformed. If there is an uncalculated one, that is, if the area D can be deformed, the shape of the area D is changed in step 616, and the process returns to step 605 to perform processing relating to the new area D after the change.
[0106]
If there is no uncalculated one, that is, if the area D cannot be deformed anymore, it is determined in step 617 whether the processing has been performed for all the coordinates of the superimposable area. If the process has been completed, the process proceeds to step 619. If the process has not been completed, the process proceeds to step 618. Uncalculated coordinates are set as center coordinates (X, Y), and the process returns to step 603. The processing related to (X, Y) is performed.
[0107]
In step 619, it is determined whether or not the processing has been completed for the time required for detection. If the processing has been completed, the process proceeds to step 621, and the detection processing ends. If the process has not been completed, the process proceeds to step 620, where the start time T is changed to the next time, and the process returns to step 603, where recalculation is performed from the coordinate and time processes.
[0108]
With reference to FIG. 17, a description will be given of a process of determining a superimposition region in superimposition determination section 116 when main information is data stored in main information storage section 205. In step 701, the process is started, and in step 702, a sort process for obtaining a ranking used for determining a superimposed area is started. First, in step 703, it is determined whether or not a superimposition region candidate at the current time T from the superimposition region detection unit 115 exists. If there is no superimposed region candidate, the process proceeds to step 712. If there is a superimposed region candidate, the process proceeds to step 704.
[0109]
In step 704, the additional information whose display period is guaranteed is removed, and the information is set as the display top priority. As described above, examples of guaranteeing the display period include (a) the additional information is a moving image that is being reproduced, and (b) the additional information is a still image. Is guaranteed, and the display period has not elapsed.
[0110]
Next, in step 705, the superimposition region candidates for all the additional information are sorted based on the superimposition region priority (FIG. 14) of the additional information superimposition parameter unit 220B and the parameter value of the additional information management parameter unit 220C. It determines the order after sorting. In this example, since the superimposition region priority differs depending on the attribute of the main information, the condition is changed according to the state of the main information.
In step 706, a process of determining a superimposition position, that is, a superimposition region from a superimposition region candidate of each additional information is started. The following processing is the same as in the first example of FIG.
[0111]
The concept of the program information of the BS digital television broadcast will be described with reference to FIG. The BS digital television broadcast program includes an EIT (Event Information Table), a PMT (Program Map Table), and program data. The EIT includes the following description (attribute) of the program that is the main information.
(1) Component content: distinction between video and audio
(2) Component type: description of video and audio types
(2) Major classification: Indicates a major classification of a program. For example, news, sports, information, dramas, movies, and the like.
(3) Medium classification: Indicates a more detailed classification from a large classification of a program. For example, in the case of "sports", it is baseball, soccer, golf, and the like.
(4) Event: ID corresponding to a program one-to-one
The PMT includes the following description (attribute) regarding emergency information that is additional information.
(1) Service type: Emergency broadcast channel ID
(2) Start / end flag: Indicates whether emergency information is broadcast.
(3) Signal type: Indicates the type of type 1 (earthquake) and type 2 (tsunami). (Rules 138 of the Radio Station Operating Regulations)
(4) Area code: Indicates the area for emergency information. (Rules 138 of the Radio Station Operating Regulations)
[0112]
In the BS digital television broadcast of FIG. 18, emergency information such as an earthquake and a tsunami is assumed as additional information. According to the present invention, not only emergency information but also various types of information such as CMs can be applied. is there.
[0113]
Although the embodiments of the present invention have been described above, the present invention is not limited to the above-described embodiments, and it is understood by those skilled in the art that various modifications can be made within the scope of the invention described in the claims. Let's do it.
[0114]
【The invention's effect】
According to the present invention, since the additional information is superimposed on a portion of the main information having a relatively small amount of information, there is an effect that the viewing of the main information is not hindered.
ADVANTAGE OF THE INVENTION According to this invention, since the area | region which superimposes additional information in the image of main information is automatically detected, there exists an effect that an additional information provider does not need to consider a superposition position and time according to the content of main information in advance. .
[0115]
According to the present invention, at the time of superimposing additional information, at least one piece of pixel information of the main information and the additional information is used to superimpose the additional information. is there.
[0116]
According to the present invention, a condition for superimposing additional information in an image of main information can be input by a viewer from an input unit, so that additional information can be superimposed according to the viewer's intention. There is.
According to the present invention, since the main information and the additional information are processed when the additional information is superimposed on the main information, there is an effect that the additional information can be superimposed more efficiently.
[0117]
According to the present invention, there is an effect that a region where additional information is superimposed can be detected at any time by using pixel information of arbitrary coordinates and arbitrary coordinates of accumulated main information. Also, when using the difference between pixels, there is an effect that not only the difference between adjacent pixels at an arbitrary time but also the difference from future coordinates from the arbitrary time can be used.
[0118]
According to the present invention, it is also possible to obtain information on how long the state of the area used for superimposing the additional information continues by using the information of the total time of the accumulated main information. As a result, there is an effect that a superimposition period can be guaranteed for the region.
[0119]
According to the present invention, it is possible to detect a region in which additional information for which a superimposition period is guaranteed is superimposed, and thus it is possible to superimpose a moving image on additional information.
According to the present invention, by extracting the attributes of the main information and the additional information and using them for the superposition of the additional information, there is an effect that the superimposition can be performed more flexibly.
[0120]
According to the present invention, by recording the result of superimposing the additional information, there is an effect that the superimposition of the additional information can be changed according to the time, the position, or the like displayed so far.
According to the present invention, by accumulating the additional information, it is possible to accumulate the additional information once and superimpose it on the main information at any time.
[0121]
ADVANTAGE OF THE INVENTION According to this invention, it is possible to eliminate the trouble of the user deleting the accumulated additional information by automatically managing the accumulated additional information using the record in which the additional information is superimposed. There is an effect.
[Brief description of the drawings]
FIG. 1 is an explanatory diagram for explaining a concept of a method of superimposing and displaying additional information on main information in a digital television broadcast receiver according to the present invention.
FIG. 2 is a diagram illustrating a configuration of a first example of a digital television broadcast receiver according to the present invention.
FIG. 3 is an explanatory diagram for describing a calculation example of a spatial color change amount Sc (X, Y, T) in a spatial color change amount analysis unit of the first example of the digital television broadcast receiver according to the present invention. .
FIG. 4 is an explanatory diagram for describing a calculation example of a temporal color change amount Tc (X, Y, T) in a temporal color change amount analysis unit of the first example of the digital television broadcast receiver according to the present invention. .
FIG. 5 is an explanatory diagram for describing parameters recorded in an area detection parameter section of the first example of the digital television broadcast receiver according to the present invention.
FIG. 6 is an explanatory diagram for describing parameters recorded in an additional information superimposing parameter unit of the first example of the digital television broadcast receiver according to the present invention.
FIG. 7 is an explanatory diagram for explaining the concept of a region D for superimposing additional information in the first example of the digital television broadcast receiver according to the present invention.
FIG. 8 is a flowchart for explaining processing in a superimposition region detection unit of the first example of the digital television broadcast receiver according to the present invention.
FIG. 9 is a flowchart illustrating a process in a superimposition determination unit of the first example of the digital television broadcast receiver according to the present invention.
FIG. 10 is a diagram illustrating an example of a superimposition region candidate used for processing in the superimposition determination unit of the first example of the digital television broadcast receiver according to the present invention.
11 is a diagram illustrating a result of sorting the example of the superimposition region candidates in FIG. 10 according to the superimposition region priority order in FIG. 6;
FIG. 12 is a diagram showing a configuration of a second example of a digital television broadcast receiver according to the present invention.
FIG. 13 is an explanatory diagram for describing parameters recorded in an area extraction parameter section of the second example of the digital television broadcast receiver according to the present invention.
FIG. 14 is an explanatory diagram for describing parameters recorded in an additional information superimposition parameter unit of the second example of the digital television broadcast receiver according to the present invention.
FIG. 15 is an explanatory diagram for describing parameters recorded in a storage management parameter section of the second example of the digital television broadcast receiver according to the present invention.
FIG. 16 is a flowchart for explaining processing of a superimposition region when main information is stored data in the second example of the digital television broadcast receiver according to the present invention.
FIG. 17 is a flowchart illustrating a process performed by a superimposition determination unit when main information is stored data in a second example of a digital television broadcast receiver according to the present invention.
FIG. 18 is an explanatory diagram for explaining the concept of program information of BS digital television broadcasting.
FIG. 19 is a diagram illustrating a configuration example of a conventional digital television broadcast receiver.
FIG. 20 is an explanatory diagram for explaining the concept of a method of superimposing and displaying additional information on main information in a conventional digital television broadcast receiver.
[Explanation of symbols]
101: receiving unit, 102: information separating unit, 110: main information reproducing unit, 111: spatial color change analyzing unit, 112: temporal color changing amount analyzing unit, 113: main information processing unit, 114: additional information reproducing unit, 115: superimposition area detection unit, 116: superimposition determination unit, 117: additional information processing unit, 118: superimposition processing unit, 120: internal memory, 121: user input unit, 201: reception unit, 202: information separation unit, 203 ... Main information input unit, 204: Main information attribute extraction unit, 205: Main information storage unit, 206: Additional information input unit, 207: Additional information attribute extraction unit, 208: Additional information storage unit, 210: Main information reproduction unit, 211 ... Spatial color change amount analysis unit, 212 time color change amount analysis unit, 213 main information processing unit, 214 additional information reproduction unit, 215 superimposition area detection unit, 216 superimposition determination unit, 217 additional information processing unit , 2 8 ... superimposition processing unit, 219 ... overlap recording management section, 220 ... internal memory, 221 ... user input unit

Claims (21)

Information separating means for separating a broadcast signal from a television broadcasting station into main information and additional information, and superimposition area detecting means for detecting a superimposition area candidate for superimposing and displaying an image of the additional information in an image of the main information Superimposition determining means for deciding a position for superimposing and displaying an image of additional information from a superimposition area candidate detected by the superimposition area detection means; and superimposing the additional information on the main information and using it as broadcast program data. And a superimposition processing unit for outputting. 2. The television broadcast receiver according to claim 1, further comprising: main information storage means for storing main information separated by said information separation means. 2. The television broadcast receiver according to claim 1, further comprising additional information storage means for storing the additional information separated by said information separation means. 3. The television broadcast receiver according to claim 1, wherein the superimposition area detection unit detects the superimposable area using pixel information of the main information. 4. 4. The television broadcast receiver according to claim 1, wherein said superimposition area detecting means detects said superimposable area using pixel information of said additional information. 3. The television broadcast receiver according to claim 1, further comprising: a spatial color change amount analyzing unit configured to calculate a spatial color change amount representing a spatial change of a pixel color from the pixel information of the main information. A television broadcast receiver, wherein the area detecting means selects an area having a small spatial color change amount obtained from the spatial color change amount analyzing means as the overlapping area candidate. 7. The television broadcast receiver according to claim 6, wherein the spatial color change amount analyzing means calculates a spatial color change amount from a color difference between adjacent pixels at a predetermined time from the pixel information of the main information. A television broadcast receiver characterized by the above-mentioned. 3. The television broadcast receiver according to claim 1, further comprising: a temporal color change amount analyzing unit configured to calculate a temporal color change amount representing a temporal change of a pixel color from the pixel information of the main information, A television broadcast receiver, wherein the area detecting means selects an area having a small temporal color change amount obtained from the temporal color change amount analyzing means, as the overlapping area candidate. 9. The television broadcast receiver according to claim 8, wherein the temporal color change amount analyzing means calculates a temporal color change amount from a difference between a color at a predetermined time and a past color in a predetermined pixel from the pixel information of the main information. A television broadcast receiver characterized by calculating. 3. The temporal color change analyzing means for calculating a temporal color change amount representing a temporal change of a color of a pixel from pixel information of main information stored in the main information storing means according to the television broadcast receiver of claim 2. A television color broadcast receiver, wherein the temporal color change amount analyzing means calculates a temporal color change amount from a difference between a color at a predetermined time and a future color in a predetermined pixel. 2. The television broadcast receiver according to claim 1, further comprising user input means for allowing a viewer to input a condition for superimposing and displaying the image of the additional information on the image of the main information. Receiving machine. 3. The receiver according to claim 1, further comprising main information processing means for processing the main information according to a condition, wherein the superimposition processing means superimposes additional information on the main information processed by the main information processing means. A television broadcast receiver characterized in that the television broadcast is output. 4. The receiver according to claim 1, further comprising additional information processing means for processing the additional information according to a condition, wherein the superimposition processing means superimposes the additional information processed by the additional information processing means on the main information. A television broadcast receiver characterized in that the television broadcast is output after being output. 2. The receiver according to claim 1, wherein the superimposition region detecting means selects, as the superimposition region candidate, a region where the difference between the average color gradation of the main information and the average color gradation of the additional information is larger than a predetermined value. Television broadcast receiver. 2. The television broadcast receiver according to claim 1, wherein the superimposition area determination means determines the superimposition area according to a predetermined priority when there are a plurality of superimposition area candidates for the additional information. 3. The receiver according to claim 1, wherein the superimposition region detecting means preferentially selects a superimposition region candidate for the additional information guaranteed to be superimposed on the main information and displayed during a predetermined display period. A television broadcast receiver, characterized in that: 17. The television broadcast receiver according to claim 16, wherein the additional information guaranteed to be displayed so as to be superimposed on the main information during the predetermined display period is moving image information. 4. The receiver according to claim 1, wherein at least one of a main information attribute extracting unit for extracting an attribute of the main information from the main information and an additional information extracting unit for extracting an attribute of the additional information from the additional information. The superimposition area detecting means includes a superimposition area candidate using at least one of an attribute of the main information extracted by the main information attribute extracting means and an attribute of the additional information extracted by the additional information attribute extracting means. A television broadcast receiver characterized by selecting: 4. The receiver according to claim 1, further comprising a superimposition record management unit that manages a record regarding superimposition of additional information, wherein the superimposition area detection unit performs recording regarding superimposition of the additional information managed by the superimposition record management unit. A television broadcast receiver characterized in that a superimposition area candidate is selected by using the television broadcast receiver. 20. The television broadcast receiver according to claim 19, wherein said superimposition record management means deletes a record relating to superimposition of additional information being managed. 4. The receiver according to claim 3, further comprising a superimposition record management unit that manages a record related to the superposition of the additional information, wherein the superimposition record management unit records the superposition of the accumulated additional information and the superimposition of the managed additional information. A television broadcast receiver characterized by being deleted.

Images