JP4788332B2 - Multi-channel display device - Google Patents

Description

  The present invention relates to a multi-channel display device that efficiently selects and outputs sound by analyzing received data and using meta information when receiving a plurality of moving images simultaneously.

  When receiving a plurality of programs at the same time, it is possible to display a plurality of programs on a display at the same time by storing individual programs in one frame buffer. On the other hand, multiple voices cannot be recognized simultaneously. For this reason, it is necessary to efficiently output one of the displayed moving images.

For such a situation, as one proposal, there has been proposed an apparatus in which a user selects one of displayed moving images with a mouse pointer and selects and reproduces the sound of the corresponding moving image. (For example, see Patent Document 1)
JP-A-5-113864

  In the conventional method, in order to select a sound by watching the video displayed by the user, it is possible to efficiently view a plurality of videos from a user's own rule of thumb for videos whose contents are known in advance. There is a possibility. However, it is usually difficult to select a sound efficiently on the spot by looking at a plurality of moving images that the user does not know, and often miss an important part of the moving image. The present invention solves the above-mentioned conventional problems. In addition to analyzing video and audio, it uses a meta information such as genre information to automatically determine a high-priority video from the displayed video. This is a multi-channel display device that selects the audio of the highest priority moving image.

The present invention receives a broadcast of a specified channel, and a plurality of receiving portions for outputting video and audio of the program, and meta information storage unit which stores meta information is information that involved in該番sets, a plurality of A first evaluation unit for calculating program priority information for a program of a plurality of channels being received from video and audio of a program output from the reception unit and meta information stored in the meta information storage unit; Based on the first video composition unit for selectively outputting the video of the channel of the program with the highest priority among the videos from the plurality of receiving units, and the program having the highest priority with the audio from the plurality of receiving units based on the priority information It is the multichannel display device provided with the 1st audio | voice selection part which selectively outputs the audio | voice of these channels.

The present invention also includes a first receiving unit that receives a channel of the highest priority program and outputs video and audio of the received program, and a plurality of designated sub-channels other than the channel received by the receiving unit. A second receiving unit that receives the channels in a time-division manner and outputs video and audio of the received plural programs; a channel of the highest priority program is set in the first receiving unit; a plurality of sub-channels, when the channel designation unit that sets the time interval of the division, the meta-information storage unit that stores the meta information related to該番set, the program video and audio output from the first receiving section From the video and audio of a plurality of programs output from the second receiving unit and the meta information stored in the meta information storage unit , a new highest priority program channel and a plurality of new sub channels And time-sharing time intervals as information The channel setting information output to channel specifying unit calculates the audio adjustment information for controlling channel audio output sub-channel priority information and a new priority for the program indicating the priorities of a plurality of channels of the new sub with A second evaluation unit, a video input to the first receiving unit as the highest priority program, and a video of a program of a plurality of sub channels of the second receiving unit are combined and output based on the subchannel priority information. This is a multi-channel display device including a video synthesizing unit and a second audio selection unit that controls and outputs audio of the highest priority program of the first receiving unit according to audio adjustment information.

  The multi-channel display device of the present invention analyzes the video and audio of a plurality of programs received at the same time, and calculates the importance of each program that changes every moment from the result and meta information such as genre information. Since the priority order of programs to be viewed mainly is determined, it is possible to automatically select a video display method for a plurality of programs and automatically select a sound to be reproduced from the programs. As a result, it is possible to efficiently view a plurality of programs by reducing the troublesomeness of the viewer's channel switching operation, and an important part of the program cannot be viewed due to the viewer forgetting to switch the program. There is a remarkable effect that can reduce the failure.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

(Embodiment 1)
FIG. 1 is a block diagram showing a configuration of a multi-channel display device according to Embodiment 1 of the present invention. In FIG. 1, the function of each block is as follows. Reference numeral 11 denotes a first receiving unit that detects a specific channel from TV radio waves received by an antenna and outputs video and audio data. Similarly, 12 is a second receiver, and 13 is a third receiver. The channel designation of these receiving units is performed by 14 first channel designating units. Reference numeral 15 denotes a first video synthesizing unit, which selectively outputs video data of programs of each channel obtained from each receiving unit or a plurality thereof simultaneously as display data. Reference numeral 16 denotes a first audio selection unit which selects and outputs the audio of the program of each channel obtained from each receiving unit. Reference numeral 17 denotes a first evaluation unit that analyzes video and audio data of each program received by each receiving unit, and uses channel information designated by the reservation or user and meta information from the 18 meta information storage unit to Outputs channel setting information to the one-channel designating unit 14, designates the main channel video in the first video synthesizing unit 15, and outputs program priority information for determining the output audio from the first audio selection unit To do.

Here, the flow of processing will be described in detail with reference to FIG.
The first receiving unit 11 receives the TV signal of the channel a (designated as Ch-a) statically designated from the first channel designating unit 14, and Ch-a_NTSC video data (also in the case of PAL) of the program of the channel. Similarly, Ch-a_voice data is output. For example, it is assumed that Ch-a_NTSC video data is a composite signal in which color data is superimposed on luminance data.
Similarly, the second receiver 12 outputs Ch-b_NTSC video data and Ch-b_audio data, and the third receiver 13 outputs Ch-c_NTSC video data and Ch-c_audio data.
Here, FIG. 2 is an example in which the video output from the first video synthesis unit is displayed on the display in the multi-channel display device according to the first embodiment of the present invention. In FIG. 2, the Ch-a program is displayed as the main video in the main display channel area, and the Ch-b and Ch-c programs are selected as the sub video and are displayed in the sub display channel area. It is an example.
When the output of the receiving unit is analog, this display is made by the first video composition unit 15. The first video composition unit 15 performs YC separation from the NTSC video data of each channel to calculate luminance data Y and color data C, and further performs matrix conversion and AD conversion (Analog to Digital Conversion), for example, 3 of light When R, G, B digital data as primary colors are generated and Ch-a has the highest priority according to program priority information from the first evaluation unit 17, Ch-a_NTSC video data, priority is displayed in the main display channel area. Ch-b and Ch-c_NTSC video data having lower ranks are subjected to resizing processing in the sub display channel area, and are synthesized and written in the frame buffer. It should be noted that writing using a unified memory widely used in personal computers is performed, and synthesis processing is performed on display output from the unified memory without writing to the frame buffer, and DA conversion (Digital to Analog Conversion) is performed. May be.
The program priority information is also input to the first audio selection unit 16, and Ch-a_audio data of the program with the highest priority is selected and output as audio data of the program of the main channel. Unlike video, audio output is not meaningful at the same time (for example, mixing or periodic switching) of a plurality of channels. For example, only audio data of the main channel is output.

  In recent years, the output of the receiving unit has been digitized, and in many cases, composite video or luminance Y, color differences RY, BY, Y, U, V, etc. are already digital data. In this case, there is a difference in whether the YC separation is provided in the reception unit or the video synthesis unit, but this configuration is not a problem.

  Next, an outline of the processing for calculating the program priority information and the channel setting information will be described with reference to FIG. FIG. 3 is a block diagram of the first evaluation unit 17, in which 31 is a first video analysis unit, 32 is a second video analysis unit, similarly 33 is a third video analysis unit, 34 is a first audio analysis unit, and 35 is Similarly, the second audio analysis unit 35 is a third audio analysis unit, and the output of each video and audio analysis unit is input to the comprehensive evaluation unit 37. The comprehensive evaluation unit 37 analyzes the results of each video and audio analysis unit, the reception channel statically designated by the user, EPG (Electronic Program Guide) information and user input of each reception channel obtained from the meta information storage unit 18 Program priority information and channel setting information are determined from meta information including genre information and time information.

  First, in the initial state, the main channel program and the sub-channel program are determined by user designation. As in the above example, the first receiving unit 11 is the channel a, and the second receiving unit 12 is the channel. b, the channel setting information is set so that the third receiving unit 13 becomes channel c, and similarly, the program priority information is also output from the first receiving unit 13 to the program of the main channel, the second and third receiving units. Is set as a sub-channel program.

Next, details of processing in the first evaluation unit 17 using the meta information of the meta information storage unit 18 will be described. First, the Ch-a_NTSC video data is input to the first video analysis unit 31. When the Ch-a_NTSC video data is an NTSC composite signal, the same processing as in the first video synthesis unit 15 is performed. YC separation is performed, and luminance data Y and color data C are calculated.
Next, using a method such as a histogram or luminance and color distribution in a divided area from luminance data Y and color data C, a scene change frame in which the scene changes greatly, a preset image or a minute time video The similarity is calculated by pattern matching, and the similarity is calculated in a series of Ch-a_NTSC video data.

  In addition, Ch-a_voice data is input to the first voice analysis unit 34, and using methods such as frequency analysis, power fluctuation, beat detection, etc., silence detection, stereo, human voice, excitement cheer, music section, environment Detect sound.

  Similarly, the second video analysis unit 32 analyzes Ch-b_NTSC video data, the second audio analysis unit 35 analyzes Ch-b_audio data, the third video analysis unit 33 analyzes Ch-c_NTSC video data, and the third The voice analysis unit 36 analyzes the Ch-c_voice data, and the analysis results of the first to third video analysis units and the analysis results of the first to third voice analysis units are all sent to the comprehensive evaluation unit 37. Entered.

The first comprehensive evaluation unit 37 first calculates the accuracy of the scene analysis result of each channel program. Note that the accuracy is a reliability or a certainty of whether or not the detection purpose is met. For example, in the CM detection, if the sound is silent and changes from monaural to stereo, it is highly possible that the sound has entered the CM. Also, the CM image is matched with the reference pattern stored in the meta information storage unit 18. The overall accuracy of entering the CM section is calculated.
In another example, it is confirmed from the EPG information of the channel stored in the meta information storage unit 18 that the program is a music program, and the music quality extracted by the voice analysis unit is BGM, or the performance of a performer or singer Is comprehensively determined, and the accuracy of whether it is a performance section of a performer or singer is calculated. Also, from the EPG information of the channel stored in the meta information storage unit 18, for example, it is a sports program, and information such as soccer, baseball, sumo, etc. is extracted, and the cheering from the voice analysis unit and the announcement of the announcer At the same time as obtaining the analysis results, the video analysis unit obtains analysis results such as soccer goal detection and baseball pitching detection, and comprehensively calculates the accuracy of swell (highlight).

  The first comprehensive evaluation unit 37 sets the main channel switching request setting previously set by the user (for example, when the program of the current main channel is CM, the sub-accuracy of the obtained plurality of accuracies. The setting of switching to the channel with the highest accuracy among the channels, the setting of switching to the main channel program when the sub channel is in the performance section, and when the program of the main channel ends, the program of the sub channel is set to the main channel If the main channel program is set as a different channel and set as a sub-channel program, etc., a combination of multiple accuracies of the above-mentioned programs of each channel, and weights and offsets are applied to the accuracies. Thus, the priority of each channel is determined and comprehensively determined, and program priority information and channel setting information are set.

  These program priority information and channel setting information are determined and executed by a logical expression or function expression with each accuracy or a state transition table.

FIG. 4 shows a state transition table used by the first comprehensive evaluation unit 37 when determining a program of a channel to be preferentially designated based on the current priority designation, that is, the main channel and the importance of the contents of each channel. It is an example.
Here, the meaning of each parameter is as follows.

<Input>
Chi: When channel setting change action of i-th receiver occurs “1”
Prog: “1” when there is no channel change, one of the programs in the receiving unit ends and the next program starts
Main i: “1” when the current main receiver output is the i-th receiver
CM i: “1” when the output of the i-th receiving unit is CM
Music i: The probability p _i that the output of the i th receiver is the performance section of a music program performer or singer
High i: Accuracy q _i that the output of the i-th receiver is a highlight section of a sports program
Senari i: the probability r _i that the output of the i th receiver is an important part of the drama program
α _i : Offset to the accuracy when the current main is the i-th receiver output x: Redundant and unreferenced (Don't care)
Ch1 + Ch2 + Ch3 = "1": At least one of Ch1 to Ch3 is "1"
<Output>
-: No change Here, Ch1 to Senar3 are input conditions, and "main channel transition" and "reception unit settings" are output. “Main channel transition” corresponds to program priority information, and “reception unit settings” correspond to channel setting information.
Also, as described above, importance is given for each accuracy. In this embodiment, the evaluation parameter CM is set to importance “1” when the accuracy exceeds a certain threshold, and other than that, For the evaluation parameter, importance = accuracy. The reason that the example of the state transition table in which CM is regarded as important is that when the program that the user is mainly viewing enters the CM section, the program of other channels is often viewed.

In this embodiment, the first receiving unit 11 receives a channel a: drama program, the second receiving unit 12 receives a channel b: baseball program, and the third receiving unit 13 receives a channel c: music program. Focusing on the detection of CM and which channel is currently the main channel, and in the drama program only the evaluation parameter Senar which is the importance as a drama, the importance evaluation parameter Music as the music It is assumed that the importance evaluation parameter High as a sport is not used for condition determination. Similarly, since it is baseball in the 2nd receiving part 12, only High and the 3rd receiving part 13 set only Music as importance other than CM. The program information is determined by learning based on EPG and analysis results from the past.
Hereinafter, determination of a channel to be prioritized using the state transition table and the processing flow thereof will be described in detail with reference to FIGS.

Here, when viewing a program of a plurality of channels in parallel, each case will be described assuming the following cases.
1) When viewing mainly the current main channel program and watching other programs with slightly lower priority 2) When viewing mainly a specific channel program (in the example, drama) 3) When all programs are to be viewed to the same extent, in any case, at the start of evaluation using the state transition table, the contents of the table are initialized, and a channel to be prioritized at the start is designated. (S-1)
Next, the time Tstart when switching to the current main channel is stored. (S-2)
First, a description will be given of <when the user wants mainly to watch the program of the current main channel>.
Assume that the comprehensive evaluation unit 37 is given high priority to the drama of the first receiving unit 11 as an initial setting for sending program priority information.

The drama program is channel output of the first receiver 11, and determining whether entered the CM section is an important part as a scenario of drama program Senar1: Request r _1. The accuracy r ₁ is determined by the first video analysis unit and the first audio analysis unit, the accuracy of the section where the exciting BGM is applied, the accuracy of the section where the specific actor appears, and the end time of the scheduled broadcast time. It is calculated based on the accuracy of the existing climax, the accuracy within Δt _{1 of the} CM scheduled time, the accuracy of the Δt ₂ section after the CM, etc. because there are many important parts before and after the CM. (S-3)
For the baseball program is a channel output of the second receiving section 12, and the decision of whether or not entered the CM section, is a highlight section of the sports program High2: determine the accuracy q _2. The accuracy q ₂ is the accuracy of the scene such as hit, home run, score, etc., the accuracy of excitement due to the cheering or the strength of the voice of the announcer's voice, etc. Calculation is performed by matching with a reference image or a reference voice in the voice analysis unit. (S-3)
The music program is channel output of the third receiver 13, a determination of whether or entered the CM section is an important section of the music program music3: Request p _3. Because it is music program, accuracy the probability p ₃ is a music section, accuracy musicians and singers among them is a favorite singer, is Song Title calculated by such as accuracy, it is a favorite song. (S-3)
Next, the comprehensive evaluation unit 37 refers to the state transition table of FIG. 4 to determine a channel with a high priority. Now, when the drama received by the first receiving unit 11 is mainly viewed as the initial state, the channel to be main is determined with α ₂ = 0 and α ₃ = 0. The reason why α ₂ = 0 and α ₃ = 0 is that the current main channel (in this example, the output of the first receiver 11 is the main) is given priority as much as possible to be the main channel.
Here, when the evaluation result is output that the drama program received by the first receiving unit 11 is not a CM section (CM1 = 0),
In the analysis results for the baseball program of the second receiving unit 12 and the music program of the third receiving unit 13, when both are not in the CM section, according to the transition of condition number 1, r ₁ + α ₁ , q ₂ and p It is determined that the program having the maximum value in ₃ is the highest priority channel (that is, the main channel).
When only the baseball program received by the second receiving unit 12 is in the CM section, the program having the maximum value of r ₁ + α ₁ and p ₃ is set as the highest priority channel according to the transition of condition number 7. Judge that.
-When only the music program received by the third receiving unit is in the CM section, the program having the maximum value of r ₁ + α ₁ , q ₂ is made the highest priority channel according to the transition of condition number 4 judge.
In the evaluation results for the baseball program of the second receiving unit 12 and the music program of the third receiving unit 13, if both are in the CM section, the drama program of the first receiving unit 11 is the highest in accordance with the transition of condition number 10. It is determined to continue as the priority channel.

On the other hand, when the analysis result is output when the drama program which is the current main channel received by the first receiving unit 11 enters the CM section (CM1 = 1),
In the evaluation results for each program of the second receiving unit 12 and the third receiving unit 13, if neither of them is in the CM section, the program having the maximum value in q ₂ and p ₃ is selected according to the transition of the condition number 11. It is determined that the channel has the highest priority.
If the evaluation result is obtained that the baseball program received by the second receiving unit 12 is also in the CM section, the music program received by the third receiving unit 13 according to the transition of the condition number 15 It is determined that the channel has been changed to the highest priority channel.
When the music program received by the third receiving unit 13 is in the CM section like the drama program, the baseball program received by the second receiving unit 12 has the highest priority according to the transition of the condition number 14 It is determined that the channel is changed.
If the analysis result is output that both the baseball program received by the second receiver 12 and the music program received by the third receiver are in the CM section, the drama of the first receiver 11 The program is determined to be continued as the highest priority channel.
After the main program is changed, for example, if the sports program of the reception channel of the second reception unit 12 is main, the transition of the condition numbers 2, 5, 8 and the like is made, and the music of the reception channel of the third reception unit 13 is changed. If the program is the main, the transition will be condition numbers 3, 6, 9, etc. (S-4)
Next, a description will be given of <when a program of a specific channel (in the example, a drama) is mainly viewed>.

When the main program is currently transferred from the main drama program of the first receiving unit 11 to the program received by the second receiving unit 12 or the third receiving unit 13, the state transition table of the present embodiment It is set to watch the program continuously. For example, in the condition number 2, the second receiving unit 12 is a sports program of the main channel, and no receiving unit is a CM section, but High2 in the sports program of the second receiving unit 12 is offset α ₂ (> 0) and q ₂ + α _2, and r ₁ and p ₃ are compared in magnitude.

Here, since it is a case where it is desired to return the drama program of the first receiving unit 11 to the main as much as possible, when the accuracy r ₁ is calculated, α ₁ (> 0) is added as an offset, and α ₂ = 0 always. , Α ₃ = 0. For example, in the condition number 2 described above, the magnitude comparison with q ₂ , r ₁ + α ₁ , and p ₃ is performed (S-4).

Next, <if you want to watch all programs to the same extent>, find r ₁ , q ₂ , and p ₃ at the start of reception, and output the highest receiving channel among them as the channel with the highest priority, The offset α ₁ = α ₂ = α ₃ = 0 is always set, and the same processing as in the above two cases is performed. (S-4)
It is determined whether the program of the highest priority channel determined according to the state transition table of FIG. 4 as described above changes from the program of the highest priority channel before the determination. If not changed, the process returns to step S-3. If changed, the process proceeds to the next step (S-5).

  However, here, the program of the highest priority channel determined by the state transition table may frequently change. For example, the result of comparing the “main channel transition” in condition numbers 1 to 3 changes one after another, and the drama program of the first receiving unit 11, the baseball program of the second receiving unit 12, and the third receiving unit 13 of It is necessary to avoid such a kind of transmission state in the case where music programs become programs of the main channel one after another. Therefore, the following steps are introduced.

If the current main channel program is different from the main main channel program according to the determination result of the state transition table, the current time (Tnow) is changed from the time (Tstart) when the program is switched to the current main channel program. The elapsed time until (Tnow-Tstart) is compared with the shortest switching allowable time (TMin), and the following determination is made (S-6).
If Tnow-Tstart ≦ TMin, the program of the current main channel is continued.
If Tnow-Tstart> TMin, the program of the channel of the determination result is changed as the highest priority program.

  Next, when one of the programs of the first receiving unit 11, the second receiving unit 12, and the third receiving unit 13 is finished and the channel of all receiving units is not changed and the next program is reached, the Prog = "1", and the state transition table of FIG. 4 is updated from the genre information of the new program.

  Finally, when not Ch1 + Ch2 + Ch3 = “1” as described above, channel setting information is set. The priority channel obtained in (S-4) is determined as the main channel (S-8).

  Further, when the reservation time is reached or the user forcibly switches any of the channels of the first receiving unit 11, the second receiving unit 12, and the third receiving unit 13, Ch1 + Ch2 + Ch3 = “1”. It becomes a state. Check this state. If Ch1 + Ch2 + Ch3 = “1”, the contents of the state transition table in FIG. 4 are initialized, and all the values of CMi, Musici, High, and Senari are updated (S-7).

  In the first evaluation unit 17 in this embodiment, each of the video analysis unit and the audio analysis unit is a reference image, a reference moving image, a reference cheer pattern, and a user information that are meta information stored in the meta information storage unit 18. The analysis is performed without referring to the user's preference and genre information. However, such information can be input to each analysis unit to improve the reliability of the analysis result to be obtained.

  Further, in order to improve speed, the analysis unit may be composed of only the audio analysis unit or only the video analysis unit. Further, it is possible to configure only the video analysis unit or only the audio analysis unit from the genre information of the received channel.

  FIG. 6 is a configuration diagram of the first evaluation unit 17 in which the number of video analysis units and audio analysis units is reduced. 6, 41 is a crossbar switch, 42 is a time division unit, a time division unit that outputs the input from the crossbar switch 41 in a time division manner, 43 is a first video analysis unit that is the same as 31 in FIG. Is a first audio analysis unit, 45 is a fourth video analysis unit that analyzes two multiplexed NTSC video data as inputs, and 46 is a fourth video analysis unit that similarly analyzes two multiplexed audio data. The voice analysis unit 47 is a second comprehensive evaluation unit. Both NTSC video data and audio data are data digitized by the receiving unit.

Another configuration and processing flow of the first evaluation unit 17 will be described with reference to FIG. First, the crossbar switch 41 is configured to output channel a data (Ch-a_NTSC video data and Ch-a_audio data) output from the first receiving unit 11 and channel b data (Ch-b_NTSC) output from the second receiving unit 12. Main channel data (channel a in the example) is selected from the video data and Ch-b_audio data) and the channel c data (Ch-c_NTSC video data and Ch-c_audio data) output from the third receiver 13. . Ch-a_NTSC video data of channel a data which is main channel data is connected to the first video analysis unit 43 and Ch-a_audio data is connected to the first audio analysis unit, and the first video analysis unit 43 performs video analysis. To do. Similarly, the first voice analysis unit 44 analyzes the Ch-a_voice data.
Further, the crossbar switch 41 selects two sub-channel data (in the example, channel b data and channel c data) and outputs them to the time division unit 42. The time division unit 42 alternately switches and outputs Ch-b_NTSC video data and Ch-c_NTSC video data at a frequency that is twice the digitized sampling rate of the reception unit. Similarly, Ch-b_voice data and Ch-c_voice data are alternately switched and output.

  Next, the fourth video analysis unit 45 receives two pieces of time-division video data, Ch-b_NTSC video data and Ch-c_NTSC video data, and analyzes each video data in time division. The obtained video analysis results are input to the second comprehensive evaluation unit 47.

  Similarly, the fourth voice analysis unit 46 receives two pieces of time-divided voice data, Ch-b_voice data and Ch-c_voice data, and analyzes each voice data by time division, and analyzes each voice. The result is input to the second comprehensive evaluation unit 47.

  The second comprehensive evaluation unit 47 is similar to the first comprehensive evaluation unit 37 described above, and the video and audio analysis results, meta information such as genre information of the meta information storage unit 18, and the main information set in advance by the user. From the channel switching request setting and the program content switching information on the same channel, the program priority information for switching the main and sub channel data and the channel setting information for channel setting of each receiving unit are output. . Further, the output of the crossbar switch 41 is determined based on the program priority information.

  If the analysis speed of the fourth video analysis unit 45 and the fourth audio analysis unit 46 is higher, the first video analysis unit 43 is included in the fourth video analysis unit 45, and similarly the first audio analysis unit 44 can be included in the fourth audio analysis unit 46, and the time division unit 42 can further reduce the number of components by multiplexing and outputting at a rate three times the data rate digitized by the reception unit. The crossbar switch 41 is necessary to distinguish between main and sub, but can be deleted by controlling the order of time-division output of channel data input by the time-division unit 42 or the like.

(Embodiment 2)
FIG. 7 is a block diagram showing a configuration of a multi-channel display device according to Embodiment 2 of the present invention. In FIG. 7, the function of each block is as follows. Reference numeral 71 denotes a fourth receiving unit, which detects a specific channel from TV radio waves received by an antenna and outputs video and audio data as in the first receiving unit 11 of FIG. 1 of the first embodiment. Similarly, 72 is a fifth receiving unit. The channel designation of these receiving units is performed by 73 second channel designation unit. Reference numeral 74 denotes a second video synthesizing unit that selectively outputs video data of each channel obtained from each receiving unit or a plurality of video data as display data simultaneously. Reference numeral 75 denotes a second audio selection unit that outputs the audio data of the fourth reception unit 71. Reference numeral 76 denotes a second evaluation unit that analyzes video and audio data received by each reception unit, and uses the channel information specified by the reservation and the user and the meta information of the meta information storage unit 77 to specify the second channel specification unit 73. Output priority channel setting information to. Further, the display priority order of the plurality of sub channels is given to the second video composition unit 74, and the volume adjustment information is given to the second audio selection unit.

  The fourth receiving unit 71 and the fifth receiving unit 72 output analog or digitized NTSC video data and audio data in the same manner as the receiving unit described in the first embodiment. Here, the fourth receiving unit 71 is always designated by the second channel designating unit 73 as the highest priority channel, that is, the main channel. On the other hand, the fifth receiving unit 72 outputs NTSC video data and audio data by switching a plurality of sub-channels in a time division manner according to the channel designation switched by the time division from the second channel designating unit 73. FIG. 8 shows an example in which video and audio of each of two channels (channel b and channel c) are multiplexed as sub channels. The reception interval of channel b is Tb, and the reception interval of channel c is Tc. These reception intervals Tb and Tc do not need to be Tb = Tc and Tb + Tc = constant, and the analysis result can be improved by changing according to the purpose as described later.

  Similar to the first video composition unit 15 in the first embodiment, the second video composition unit 74 performs YC separation or the like on the NTSC video from the fourth reception unit 71 that is the main channel, and then on the designated screen. Draw in the area. Regarding the sub channel, after separating the plurality of sub NTSC images time-divided from the fifth receiving unit 72, the sub channel priority information input from the second evaluation unit 76 is designated according to the priority. Draw in the area.

  The second audio selection unit 75 receives only the audio data from the fourth receiving unit 71 that is the main channel, and outputs the audio data after selecting the audio output such as mute by the volume adjustment information. In general, a personal computer or the like may perform other work while displaying TV images. In such a case, usually only the video is displayed, the TV sound is muted, and if the received program is a sport, it becomes a highlight or a musician or singer starts playing on a music program In this case, it is possible to mute the sound of the received program when it enters the CM section.

  Similarly to the first embodiment, the second evaluation unit 76 analyzes the video and audio of the main channel, and the analysis information obtained by analyzing the video and audio data input by time-division of a plurality of sub channels. The meta information storage unit 77 comprehensively determines meta information including genre information such as EPG, program time information, and user preference information, and user-specified channel information and channel priority information. The channel setting information for switching the main channel and the sub channel is output to the second channel designating unit 73. In addition, the sub-channel priority information is output to the second video composition unit 74 as information when priority order needs to be set for the sub-channel.

  An example of the configuration of the second evaluation unit 76 is shown in FIG. In FIG. 9, reference numeral 91 denotes an output of the fifth receiver 72, which is a channel audio separator that separates audio data of a plurality of sub-channels that are switched in a time division manner. Similarly, 92 is the output of the fifth receiver 72. It is a channel video separation unit that separates video data of a plurality of sub-channels that are switched and output in time division. 95 is a fifth video analysis unit that inputs one NTSC video of the sub-channel separated by the channel video separation unit 92, and 97 is a video that receives NTSC video of another sub-channel in the same manner. It is the 6th image analysis part which performs analysis. Reference numeral 96 denotes a fifth video analysis unit that performs audio analysis using one audio data of the sub-channel separated by the channel audio separation unit 91 as input, and 98 similarly analyzes audio data using the audio data of the other sub-channel as input. It is the 6th voice analysis part which performs.

  Reference numeral 93 denotes a first video analysis unit that is the same as 31 or 43 in the first embodiment, and 94 denotes a first audio analysis unit that is the same as 32 or 44. Reference numeral 99 denotes a third comprehensive evaluation unit. First, the video and audio of the main channel from the fourth receiving unit 71 are analyzed by the first video analyzing unit 93 and the first audio analyzing unit 94 as in the first embodiment, and the analysis result is the third evaluation. Input to the part 99.

On the other hand, the video data of the sub channel from the fifth receiving unit 72 is synchronized with the reception interval of the fifth receiving unit 72, that is, the channel switching timing (Tb, Tc) by the channel video separating unit 92. The channel video data is separated, and the channel b in the Tb section is input to the fifth video analysis unit 95 and the channel c in the Tc section is input to the sixth video analysis unit 97. Since only the discontinuous Tb section is input as the data of channel b, the fifth video analysis unit 95 analyzes the video with the set of thinned Tb sections, and the analysis result of the Tc section is the preceding and following Tb sections. Interpolation is performed based on the analysis result and the result is output to the third comprehensive evaluation unit 99. Also in the sixth video analysis unit 97, since only the discontinuous Tc section is input as the data of channel c, the video is analyzed with the set of thinned Tc sections, and the analysis result of the Tb section is Interpolation is performed from the analysis result of the Tb interval, and the result is output to the third comprehensive evaluation unit 99.
Similarly, the audio data of the sub channel from the fifth receiving unit 72 is received by the channel audio separating unit 91 in synchronization with the reception interval of the fifth receiving unit 72, that is, the channel switching timing (Tb, Tc). The voice data of the channel b in the Tb section is input to the fifth voice analysis unit 96, and the voice data of the channel c in the Tc section is input to the sixth voice analysis unit 98. Since only the discontinuous Tb interval is input as the audio data of the channel b, the fifth audio analyzing unit 95 analyzes the audio with the set of thinned Tb intervals, and the analysis result of the Tc interval is the preceding and following Tb. Interpolation is performed from the analysis result of the section, and the result is output to the third comprehensive evaluation unit 99. Also in the sixth voice analysis unit 98, since only the discontinuous Tc section is input as the voice data of the channel c, the voice is analyzed with the set of thinned Tc sections, and the analysis result of the Tb section is the front and back. Is interpolated from the analysis result of the Tb interval, and the result is output to the third comprehensive evaluation unit 99. The analysis contents are the same as those in the first embodiment.

  The comprehensive evaluation of the third comprehensive evaluation unit 99 is the same as that of the first embodiment, but since the fourth reception unit 71 is set to receive the main channel, the switching of the main channel is performed by the second video composition unit. This is performed not by 74 but by channel setting of the fourth receiving unit 71. Therefore, in the channel setting information, for example, when the main channel a is the sub and the sub channel b is the main, the channel b which was the sub channel of the fifth receiving unit 72 at the beginning. Is set in the fourth receiving unit 71, and information for setting the channel a which is the main of the fourth receiving unit 71 in the fifth receiving unit 72 is included.

  In addition, since the output of the fifth receiving unit 72 is output by time-dividing a plurality of channels, although the video and audio are interpolated by the second evaluation unit 76, the reliability of the evaluation is lowered. . Therefore, the third comprehensive evaluation unit 99 has a function of determining Tb and Tc from the evaluation results of the channels b and c, which are sub-channels, and includes information on Tb and Tc in the channel setting information. The video and audio of the channel audio separation unit 91 and the channel video separation unit 92 are separated by Tb and Tc. This is due to the following reason. For example, when the channel b evaluation result is higher than the channel c evaluation result, the appropriate Tb and Tc satisfying Tb> Tc are determined. Further, the video is evaluated in units of fields. For example, when one field is 1/60 seconds, evaluation at intervals of Tb <1/60 seconds is meaningless. On the other hand, it is considered that the evaluation is not small at 60 fields per second but evaluated at 30 fields per second. On the other hand, there is also a time interval in which the influence is small even if the sampling is thinned out with the minimum unit time. In addition, it is desirable to adjust the ratio of Tb and Tc and the respective values depending on the contents to be evaluated for video and audio.

  The third comprehensive evaluation unit 99 also gives priority to the sub-channels and outputs sub-channel priority information in order to change the display method of the second video composition unit. The sub-channel priority information is calculated from a comparison of the accuracy described in the column of “main channel transition” in the state transition table of FIG.

  The multi-channel display device according to the present invention can be efficiently viewed when a plurality of programs are simultaneously viewed, and is useful for a TV receiver and a personal computer equipped with a TV function. In addition, although the present invention describes TV reception data, as input, it is easy to simultaneously reproduce a plurality of media or to simultaneously reproduce a plurality of streams from the same medium. It is also useful for DVD recorders and hard disk recorders.

1 is a block diagram showing a configuration of a multi-channel playback device in Embodiment 1 of the present invention. FIG. 3 is an example diagram in which a video output from the first video synthesis unit of the multi-channel playback device in Embodiment 1 of the present invention is displayed on a display. The block diagram which shows the structure of the 1st evaluation part 17 of the multichannel reproducing | regenerating apparatus in Embodiment 1 of this invention. State transition diagram used in the first comprehensive evaluation unit of the first evaluation unit 17 of the multi-channel playback device in Embodiment 1 of the present invention Processing flow chart for determining a channel with high priority of the first comprehensive evaluation unit of the first evaluation unit 17 of the multi-channel playback device in Embodiment 1 of the present invention. The block diagram which shows another structure of the 1st evaluation part 17 of the multichannel reproducing | regenerating apparatus in Embodiment 1 of this invention. FIG. 3 is a block diagram showing a configuration of a multi-channel playback device in Embodiment 2 of the present invention. The figure of the time division video and time division audio which the 5th receiving part of the multichannel reproducing | regenerating apparatus in Embodiment 2 of this invention outputs The block diagram which shows the structure of the 2nd evaluation part 76 of the multichannel reproducing | regenerating apparatus in Embodiment 2 of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 1st receiving part 12 2nd receiving part 13 3rd receiving part 14 1st channel designation | designated part 15 1st image | video synthetic | combination part 16 1st audio | voice selection part 17 1st evaluation part 18 meta information storage part 31 1st image | video analysis part 32 Second video analysis unit 33 Third video analysis unit 34 First audio analysis unit 35 Second audio analysis unit 36 Third audio analysis unit 37 First comprehensive evaluation unit 41 Crossbar switch 42 Time division unit 43 First video analysis unit 44 First 1 audio analysis unit 45 4th video analysis unit 46 4th audio analysis unit 47 2nd comprehensive evaluation unit 71 4th reception unit 72 5th reception unit 73 2nd channel designation unit 74 2nd video synthesis unit 75 2nd audio selection unit 76 Second evaluation unit 77 Meta information storage unit 91 Channel audio separation unit 92 Channel video separation unit 93 First video analysis unit 94 First audio analysis unit 95 Fifth video analysis unit 96 Fifth audio analysis 97 The sixth image analyzer 98 sixth voice analysis unit 99 third comprehensive evaluation unit

Claims (1)

A first receiving unit that receives a broadcast and outputs video and audio of the received broadcast ;
A second receiver that receives a broadcast of a plurality of channels different from the channel received by the first receiver, and outputs video and audio of the received plurality of broadcasts in a time-sharing manner;
A channel information storage unit for storing channel information related to the channel received by the first reception unit and the second reception unit;
An evaluation unit that detects video and audio characteristics output by the first reception unit and the second reception unit and outputs an evaluation result;
The priority of the channel is determined based on the combination of the channel information and the evaluation result, and the highest priority is determined among the channels received by the first receiving unit and the second receiving unit. A channel designating unit that designates the first receiving unit to receive a broadcast of a designated channel, and designates the second receiving unit to receive a broadcast other than the channel determined to have the highest priority ; ,
A video synthesizing unit that preferentially outputs a video of a channel received by the first receiving unit over a video of a channel received by the second receiving unit;
An audio selection unit that outputs only the audio of the channel received by the first reception unit,
Multi-channel display device.

Images