JP2009055476A - System, method and program for simultaneously viewing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a plurality of viewers to easily grasp information of images and sounds of a plurality of pictures. <P>SOLUTION: A system for simultaneously viewing programs, when entering operations for selection of one of a plurality of pictures and display processing on the selected picture (S1 to S3), changes the display size of the picture of a display unit (S4) based upon the selection operation for the picture, the operation for the display processing on the picture, and the display state of the picture of the display unit. Consequently, the picture having its display area changed is displayed on the display unit together with other pictures. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a program simultaneous viewing system, a program simultaneous viewing method, and a program simultaneous viewing program that allow a plurality of viewers to view a plurality of programs at the same time.

  A standard television receiver has one receiver, and displays a program image of a reception channel received by the receiver on a display and outputs sound from a speaker. In this case, the viewer could not obtain information other than the reception channel selected at that time by the television receiver.

  On the other hand, there is a television receiver that has two or more receivers and has a function of simultaneously displaying a program image of two or more reception channels on a display (see Patent Document 1). There is also a television receiver having a function of displaying index images of two or more reception channels by changing the reception channel of one of the two or more receivers at regular intervals (patent) Reference 2).

JP-A-6-102851 JP 2005-33572 A

  As in the techniques described in Patent Documents 1 and 2 described above, a television receiver that simultaneously displays two or more program images or index images on a display needs to prepare a plurality of expensive video receivers.

  Furthermore, since the screen size is determined in advance, the display size of a plurality of screens cannot be arbitrarily changed according to the reception environment. On the other hand, there is an inconvenience that only the sound corresponding to the screen of one reception channel can be selected for the sound.

  Therefore, even when two or more viewers view the screens of a plurality of programs on a television receiver having such a display function, the display size of the screen cannot be changed. Only the sound of one receiving channel can be selected.

For this reason, there arises a problem that a plurality of viewers are not suitable for previewing a plurality of program screens.
Accordingly, an object of the present invention is to provide a program simultaneous viewing system, a program simultaneous viewing method, and a program simultaneous viewing program in which a plurality of viewers can easily acquire image and sound information on a plurality of screens. To do.

  The present invention displays a plurality of screens of a plurality of programs received via a plurality of receiving units on a display unit at the same time, and outputs audio to an audio output unit so that a plurality of viewers can simultaneously display a plurality of programs. The present invention is applied to a program simultaneous viewing system that can be viewed.

  The program simultaneous viewing system includes a plurality of input means for inputting any one of a plurality of screens and a display processing operation for the selected screen, a screen selecting operation from the input means, and a screen. And changing means for changing the display area of the screen in the display section based on the display processing operation and the display state of the screen in the display section, and displaying the screen whose display area has been changed by this changing means together with other screens Is displayed on the screen.

  Further, the present invention displays a plurality of screens of a plurality of programs received via a plurality of receiving units on the display unit at the same time, and outputs a sound to the audio output unit, thereby allowing a plurality of viewers to simultaneously The present invention is applied to a program simultaneous viewing method capable of viewing a program.

  This program simultaneous viewing method includes a plurality of input steps for selecting any one of a plurality of screens and inputting a display processing operation for the selected screen, a screen selecting operation from the input step, and a screen. A change step of changing the display area of the screen in the display section based on the display processing operation and the display state of the screen in the display section, and the screen whose display area has been changed by this change step together with other screens It is displayed on the display unit.

  Further, the present invention displays a plurality of screens of a plurality of programs received via a plurality of receiving units on the display unit at the same time, and outputs a sound to the audio output unit, thereby allowing a plurality of viewers to simultaneously The present invention is applied to a program simultaneous viewing program executed in a computer of a program simultaneous viewing system capable of viewing a program.

  The program simultaneous viewing program includes a plurality of input means for inputting any one of a plurality of screens and a display processing operation for the selected screen, a screen selecting operation from the input means, and a screen. And changing means for changing the display area of the screen in the display section based on the display processing operation and the display state of the screen in the display section, and displaying the screen whose display area has been changed by the changing means together with other screens Is displayed on the screen.

  According to the present invention, when a plurality of persons audition images and sounds by the large screen display unit and the sound output unit, the display size of each screen can be arbitrarily changed for each viewer according to the reception environment. There is an effect.

In addition, it is possible to automatically control the screen when the large screen is divided, combined, or enlarged into a plurality of screens.
In addition, it is possible to control the position where the sound image of the sound is localized when a plurality of persons audition the image and sound by the display unit and the sound output unit of a plurality of screens.

Hereinafter, an embodiment of the present invention will be described in detail with reference to FIGS.
The program simultaneous viewing system according to the present embodiment has a tuner that receives a plurality of programs, and controls a video signal and an audio signal received by the tuner so that a plurality of screens are displayed in a large screen. Can be displayed. Also, it is possible to output sound corresponding to the display state of each screen. As a result, you will be able to:

First, it is possible for one viewer to acquire various information by viewing a plurality of screens of programs of a plurality of reception channels displayed on the display.
Secondly, a plurality of viewers can share one large screen with a plurality of people by viewing a plurality of screens of programs of a plurality of receiving channels displayed on the display.

Here, let us consider the simultaneous audition of a plurality of programs by the second plurality of viewers. As long as the screen cannot be divided, the simultaneous trial listening of a plurality of programs by a plurality of viewers cannot be realized.
When considering dividing the screen, there are three cases: dividing the screen into less than the number of people, dividing the screen by the number of people, and dividing the screen more than the number of people.

  In the case of dividing the screen into less than the first number of people, it means that N (N is a natural number) people 1 reception channel audition. When the screen is divided into the second number of people, it means that one person listens to one receiving channel. When the screen is divided into more than the third number of people, this means that one person listens to N reception channels. In this embodiment, any number of screens can be divided, so that all patterns can be handled.

There are the following methods for dividing the screen.
That is, there are cases where an operation is performed on the main body of the system with a remote controller using infrared rays, an operation is performed on a touch panel incorporated in the main body of the system, and an operation is performed on a personal computer (PC).
As described above, various screen division methods are conceivable. Here, a case where an operation using a remote controller, which is one of them, is described.

In this operation method, first, the viewer selects which screen in the plurality of screens is desired to be divided by the remote controller. Secondly, in this screen selection, the screen to be divided is selected by moving the cursor to an arbitrary screen position in the screen using, for example, the jog dial of the remote controller.
Alternatively, screen selection can be performed by assigning numbers to a plurality of screens and selecting the numbers with the numeric keypad of the remote controller.

  Third, the main body of the system causes a cross cursor to appear on the selected screen. By moving the cursor with the left / right / up / down keys from the remote controller, the viewer determines where the screen is to be divided.

  Alternatively, the main body of the system uses the screen feature amount used when automatically changing the screen display size, which will be described later, to display the division position candidates on the display, and the viewer clicks the button of the number of reception channels corresponding to this. The division position is determined by pressing.

  Alternatively, in response to an input instruction from the viewer's remote control, the system main body adds a pointer on the screen, or the system main body checks the position pointed to by the remote control from the intensity of infrared rays and determines the division position. Then, the screen is divided according to the determined division position.

First, the screen division method will be described.
FIG. 1 is a flowchart showing screen division processing according to an embodiment of the present invention. FIG. 1 shows processing realized by the computer of the system main body executing a program simultaneous viewing program.

  In FIG. 1, first, one screen to be divided is selected and determined (step S1). Specifically, based on selection and determination operations from the remote controller, the system main body determines a screen to be divided among a plurality of screens displayed on the display.

  Next, a cursor for determining where to divide is displayed on the selected screen (step S2). Specifically, the system main body displays a cursor for designating the division position on the screen determined on the display.

  Here, the viewer moves the cursor to determine the division position (step S3). Specifically, based on the position designation and determination operation from the remote controller, the system main body determines the division position within the screen to be divided displayed on the display.

  Therefore, the screen size is changed according to the division position (step S4). Specifically, when the system main body divides the screen at the division position determined on the display, the system main body changes the screen size after the division. For example, the screen size is changed so as to keep the aspect ratio constant before and after the division.

  Then, it is determined whether there is another screen to be divided (step S5). Specifically, the system main body determines whether there is another screen division selection and determination operation from another remote controller. If there is another screen division selection and determination operation from another remote controller in the determination step S5, the process returns to step S1 and the processes and determinations from step S1 to step S5 are repeated.

  If there is no other screen division selection and determination operation from another remote controller in the determination step S5, the division is executed (step S6), and the process is terminated. That is, the system main body divides the screen to be divided with the screen size changed in step S4.

FIG. 2 is a diagram showing a division calculation method when the aspect ratio of the divided screen E1 is kept constant. 2A shows a screen of HD (High Definition) broadcasting, and FIG. 2B shows the case of a / b> 16/9 (9a / 16> b), that is, further horizontal compared to the HD size. FIG. 2C shows a case where a / b <16/9 (9a / 16 <b), that is, the vertical direction is longer than the HD size.
FIG. 2 shows a method for calculating the divided screen size when changing the screen size so as to keep the aspect ratio constant before and after the division as shown in step S4 of FIG.

  In the HD broadcast screen shown in FIG. 2A, the aspect ratio is X: Y = 16: 9. Here, at the division position (a, b), it is necessary to calculate the division screen size of each division screen E1, E2, E3, E4. Therefore, how to determine the size of the divided image while maintaining this ratio (X: Y = 16: 9) will be described below.

  As shown in FIG. 2B, in the case of 9a / 16> b (the side is longer), the left end position 1L of the divided screen E1 is a position of (a-16b / 9) / 2. Further, the right end position 1R of the divided screen E1 is a position of a- (a-16b / 9) / 2.

  Here, in the case of an HD size screen, 16: 9 = a: b holds because of the relationship between the vertical length b and the horizontal length a. That is, a = (16/9) b holds. Therefore, when a> (16/9) b, the split screen E1 has a longer side than the HD size screen.

  When the divided screen E1 is long in the horizontal direction, it is checked how much the horizontal screen E1 protrudes in the horizontal direction. Since the vertical b is fixed, the side of the divided screen E1 is (16/9) b, and when a> (16/9) b, a portion that protrudes horizontally is formed. The length that protrudes to the side is a- (16/9) b.

Here, since the center of the divided screen E1 is set to be displayed with priority, the length of the portion protruding from the left end position 1L is the same as the length of the portion protruding from the right end position 1R.
Accordingly, the left end position 1L is a position of (a-16b / 9) / 2. Further, the right end position 1R is a- (a-16b / 9) / 2.

As shown in FIG. 2C, when a / b <16/9 (9a / 16 <b), that is, when the vertical length is longer than the HD size, the upper end position 1U of the divided screen E1 is the same. Depending on the calculation method, the position is (b-9a / 16) / 2. Further, the lower end position 1D of the divided screen E1 is a position b- (b-9a / 16) / 2.
Thus, when a <(16/9) b, the divided screen E1 is longer in the vertical direction. At this time, the length of the portion of the split screen E1 that protrudes vertically is b- (9/16) a.

  Therefore, the upper end position 1U is a position of (b-9a / 16) / 2. The lower end position 1D is a position b- (b-9a / 16) / 2.

  FIG. 3 is a diagram showing a division calculation method when the aspect ratio of the divided screen E2 is kept constant. FIG. 3A shows an HD broadcast screen, that is, 9 (Xa) / 16 = b, and FIG. In the case of 9 (X-a) / 16> b, which is longer in the horizontal direction than HD broadcasting, FIG. 3C shows the case of 9 (X-a) / 16 <b, which is longer in the vertical direction than HD broadcasting. Yes.

  When calculated by the same method as that calculated in FIG. 2, when 9 (X-a) / 16> b shown in FIG. 3B, the left end position 2L of the divided screen E2 is ((X-a) -16b / 9. ) / 2 position. Further, the right end position 2R of the divided screen E2 is a position X-((X-a) -16b / 9) / 2.

  In addition, when 9 (Xa) / 16 <b, which is longer than the HD broadcast shown in FIG. 3C, the upper end position 2U of the divided screen E2 is (b-9 (Xa) / 16). / 2, The lower end position 2D of the divided screen E2 is the position b- (b-9 (Xa) / 16) / 2.

  FIG. 4 is a diagram showing a division calculation method when the aspect ratio of the divided screen E3 is kept constant. FIG. 4A is an HD broadcast screen, that is, 9a / 16 = (Y−b), and FIG. When 9a / 16> (Yb) is longer in the horizontal direction than HD broadcasting, FIG. 4C shows a case in which 9a / 16 <(Yb) is longer in the vertical direction than HD broadcasting.

  2 and 3, when 9a / 16> (Yb) shown in FIG. 4B, the left end position 3L of the divided screen E3 is (a-16 (Yb). ) / 9) / 2. Further, the right end position 3R of the divided screen E3 is a position of a- (a-16 (Yb) / 9) / 2.

  Also, when 9a / 16 <(Yb), which is longer than the HD broadcast shown in FIG. 4C, the upper end position 3U of the divided screen E3 is ((Yb) -9a / 16) / 2. Become position. Further, the lower end position 3D of the divided screen E3 is a position of Y-((Yb) -9a / 16) / 2.

  Similarly, FIG. 5 is a diagram showing a division calculation method when the aspect ratio of the divided screen E4 is kept constant. FIG. 5A shows an HD broadcast screen, that is, 9 (X−a) / 16 = (Y−b), and FIG. 5B shows 9 (X−a) / 16> (Y In the case of -b), FIG. 5C shows a case where 9 (Xa) / 16 <(Yb), which is longer in the vertical direction than HD broadcasting.

  When calculation similar to that in FIGS. 2 to 4 is performed, in the case of 9 (Xa) / 16> (Yb) illustrated in FIG. 5B, the left end position 4L of the divided screen E4 is ((Xa) − 16 (Yb) / 9) / 2. Further, the right end position 4R of the divided screen E4 is a position of X − ((X−a) −16 (Y−b) / 9) / 2.

  In the other case shown in FIG. 5C (the vertical direction is longer), the upper end position 4U of the divided screen E4 is a position of ((Y−b) −9 (X−a) / 16) / 2. Further, the lower end position 4D of the divided screen E4 is a position of Y − ((Y−b) −9 (X−a) / 16) / 2.

FIG. 6 is a diagram showing a division calculation method when the aspect ratio is not kept constant.
In FIG. 6, when the aspect ratio is not kept constant, the divided screen sizes of the divided screens E1, E2, E3, and E4 are as follows. That is, “horizontal: vertical” of the divided screen E1 becomes “a: b”. “Horizontal: vertical” of the divided screen E2 becomes “Xa: b”. In the divided screen E3, “horizontal: vertical” becomes “a: Yb”. “Horizontal: vertical” of the divided screen E4 becomes “Xa: Yb”. Therefore, the system main body resizes the screen to this size.

FIG. 7 is a block diagram showing a system configuration of a program simultaneous viewing system according to an embodiment of the present invention.
In FIG. 7, the program simultaneous viewing system includes each processing unit 12 that performs signal processing on an input signal 11 and a screen integration unit 18 that integrates the signal-processed signals for each screen and outputs an output signal 19 to a display (not shown). It has. The signals processed by each processing unit 12 are a video signal and an audio signal.

  Further, the program simultaneous viewing system analyzes the infrared signal received by the remote control light receiving unit 14 and the remote control light receiving unit 14 that receives an infrared signal related to the operation of the screen from the remote controller (remote controller) 13, and sends it to each processing unit 12. A remote control signal analysis unit 15 is provided.

  The simultaneous program viewing system includes a screen number management unit 16 that manages a screen number corresponding to the remote control ID screen corresponding signal 20 analyzed by the remote control signal analysis unit 15 and a screen number managed by the screen number management unit 16. A memory 17 for outputting the corresponding screen display position signal 21 to the screen integration unit 18 is provided.

Here, the remote control ID screen correspondence signal 20 is a signal for associating the identification number ID of each remote control 13 with the screen numbers given to a plurality of screens.
Further, the memory 17 has a memory read / write control unit for reading and writing signals. The memory 17 stores a program simultaneous viewing program so that a computer of the system main body (not shown) can be executed.

FIG. 8 is a configuration diagram of each processing unit during normal viewing.
In FIG. 8, each processing unit 12 includes a tuner 22 having a plurality of receiving units capable of selecting and simultaneously receiving a plurality of broadcast programs, and a plurality of video signals of a plurality of programs received by the tuner 22. And a size change processing unit 23 for changing the screen size.

  The tuner 22 acquires channel information 25 corresponding to the screen number from the memory 17 and receives a plurality of broadcast programs selected by the remote control analysis signal 24 from the remote control signal analysis unit 15. The size change processing unit 23 acquires screen size information 26 corresponding to the screen number from the memory 17, and changes the screen sizes of a plurality of broadcast programs received by the tuner 22.

  As a result, it is possible to perform a process of switching the screen to be displayed on the remote controller 13 while displaying the screens of a plurality of broadcast programs on the subsequent display during normal viewing. At this time, the number of screen divisions can be selected and changed as appropriate.

  FIG. 9 is a block diagram illustrating a system configuration for screen division. In the screen divided program simultaneous viewing system configuration of FIG. 9, only the parts different from the program simultaneous viewing system during normal viewing shown in FIG. 7 will be described.

  In FIG. 9, the screen divided program simultaneous viewing system includes a screen selection management unit 31 that manages screen selection, a screen size calculation unit 34 that calculates a screen size, and an image frame calculation unit 32 that calculates a screen frame. , A cursor position calculation unit 33 for calculating a cursor position, and an image frame & cursor generation unit 35 for generating an image frame and a cursor.

  The screen selection management unit 31 acquires the screen position from the memory 17 and supplies the selected sub-screen number 41 to the image frame calculation unit 32. The cursor position calculation unit 33 acquires the screen position from the memory 17 and supplies the selected child screen size 42 to the image frame & cursor generation unit 35.

The image frame calculation unit 32 supplies the position of the cursor and the position / size 43 of the child screen to the screen size calculation unit 34. The screen size calculation unit 34 supplies the number / position / size 44 of the new child screens after the division to the screen number management unit 16.
Each processing unit 12 has the same configuration as that during normal viewing.

In the screen division, the simultaneous program viewing system operates as follows.
The remote control signal analysis unit 15 receives the screen division signal from the remote control 13. When the remote control signal analysis unit 15 receives a screen division signal from the remote control 13, the screen selection management unit 31 selects a divided screen having a smaller screen number.

The screen selection management unit 31 loads the selected sub-screen number 41 from the memory 17 and outputs the screen position 21 of the screen number to the screen integration unit 18, so that the screen currently selected for the subsequent display is displayed. The image frame is superimposed on the screen.
Further, the screen selection management unit 31 stores the currently selected child screen in the memory 17 at that time. As the position of this child screen, the X and Y coordinates and the width and height are stored.

  Here, when the “next” button is pressed on the remote controller 13, the screen selection management unit 31 reads which screen is currently selected from the number 41 of the selected child screen acquired from the memory 17. Then, the screen position of the screen corresponding to the number obtained by adding 1 to the read screen number is read from the memory 17.

  On the other hand, when “RETURN” is pressed on the remote controller 13, the screen selection management unit 31 reads which screen is currently selected from the number 41 of the selected child screen acquired from the memory 17. Then, the screen position of the screen corresponding to the number obtained by subtracting 1 from the read screen number is read from the memory 17.

  The cursor position calculation unit 33 reads the screen position from the selected child screen size 42 acquired from the memory 17 and supplies the screen position to the image frame & cursor generation unit 35. The image frame & cursor generation unit 35 generates an image frame and a cursor corresponding to the screen position and supplies them to the image integration unit 18. Thereby, the selected image frame is displayed on a display (not shown).

  Here, when receiving a screen selection signal from the remote controller 13, the screen selection management unit 31 reads the currently selected screen number from the memory 17. Then, the image frame & cursor generation unit 35 generates a cursor so that the cursor is displayed at the center of the selected screen (see FIG. 10).

  Next, when the cursor is moved by the remote controller 13 and the screen division position is determined, the screen size calculation unit 34 is based on the cursor position acquired from the cursor position calculation unit 33 and the position / size 43 of the child screen. Calculate the screen size.

  The screen size calculation unit 34 calculates the screen size, and supplies the number / position / size 44 of the divided sub screens to the screen number management unit 16. Thereby, the screen number management unit 16 associates the screen number with the screen position and stores it in the memory 17. Then, the image integration unit 18 reads the divided child screens, synthesizes all the screens, and outputs them to a display (not shown).

FIG. 10 is a diagram showing the cursor position when the cursor is displayed in the middle of the image.
As shown in FIG. 10, the image frame & cursor generation unit 35 (see FIG. 9) displays the cursor position CS in the middle of the screen E. That is, the image frame & cursor generation unit 35 generates a cursor at the position (X / 2, Y / 2) and displays the cursor position CS in the middle of the screen E.
It should be noted that marks such as other figures and symbols can be used as long as the center of division can be understood instead of the cursor described above.

Next, screen combination will be described.
When combining screens, the following two cases can be considered. The first is a case where the screens are divided into more than the number of persons and combined, for example, when a program of a plurality of reception channels is being viewed but is no longer necessary. The second case is a case where the screen is reduced to the number of persons or less, that is, a case where the screens are combined in order to view a program on the same reception channel as other people.

  When the screens divided into more than the first number of people are combined, it means that from the state where the program preview of the N reception channel per person is performed, the program preview of the reception channel per person is approached. Reducing the screen to the number equal to or less than the second number of people means, for example, that N people are put into a program listening state of one receiving channel.

Since it is possible to combine the screens until the number of screens becomes one, it is possible to cope with all screen combining patterns shown below.
There are various ways to combine screens as in splitting. Here, the operation by the remote controller which is one of them will be described.

  The screen combining method is performed according to the following procedure. First, the viewer selects which screen he / she wants to combine in the screen. As a selection method of this screen, there are various methods such as a viewer selecting using a jog dial of a remote controller, or selecting a number with a numeric key by touching the number on the screen.

  The screen selected in this way is displayed as a mark, but is deselected when selected again. Here, if the selected screens are not adjacent to each other, the process becomes an error. Finally, the screens are combined by determining the selection.

FIG. 11 is a flowchart for explaining the screen combining process described above. FIG. 11 shows processing realized when the computer of the system main body executes the program simultaneous viewing program.
In FIG. 11, when the screen combining process is started, first, one of the divided screens is selected (step S11). Specifically, based on selection and determination operations from the remote controller, the system main body determines one screen among a plurality of screens displayed on the display.

  Next, a screen adjacent to the selected screen is selected (step S12). This adjacent screen is a screen that is combined with the selected screen. In this screen selection, a screen to be combined with the selection screen displayed on the display is determined based on selection and determination operations from the remote controller.

At this time, it is a condition to select a screen adjacent to the selected screen.
Next, it is determined whether there is another screen to be combined (step S13). That is, it is determined in the system main body whether or not there is a selection and determination operation from another remote controller.

  When it is determined in step S13 that there is another screen to be combined, the process returns to step S12, and the processing and determination from step S12 to step S13 are repeated, and it is determined that there is no other screen to be combined. Changes the screen size in combination (step S14). Specifically, the system main body combines the screen selected in step S11 and the screen selected in step S12 by changing the screen size, and ends the process.

  FIG. 12 is a diagram showing a joint calculation method when the aspect ratio is kept constant, and a joint calculation method when the screen ratio is changed and the aspect ratio is kept constant in step S14 of FIG. It is for explaining. FIG. 12A shows a case where the image is stored in a frame that can be displayed, and FIG.

  As shown in FIG. 12A, when the image is stored in a displayable frame, that is, when the combined screen is stored in both the image frame L1 and the image frame L2 when the screen F1 and the screen F2 are combined, the system main body is The position of the combined screen is calculated as will be described later with reference to FIGS.

As shown in FIG. 12B, when priority is given to the larger one that does not fit within the displayable frame, that is, when the screen F1 and the screen F2 are combined, the larger image frame L2 without fitting the combined screen into the image frame L1. Is preferentially placed in the image frame L3, the system main body calculates the position of the combined screen as will be described later with reference to FIGS.
Here, only the case where two screens F1 and F2 are selected will be described, but three or more screens are similarly calculated.

FIGS. 13A and 13B are diagrams showing a joint calculation method in a case where the aspect ratio is kept constant (contained in a frame that can be displayed). FIG. 13A shows a case where the sides are adjacent to each other, and FIG.
When adjacent to each other as shown in FIG. 13A (within a frame that can be displayed), that is, when combining the screen F1 and the screen F2 so as to be adjacent to each other horizontally, the combined screen is composed of the image frames L1 and L2. The system body calculates the position of the combined screen so that it fits in both. Here, the image frame L1 is within the range of (X1, Y1) to (X2, Y2), and the image frame L2 is within the range of (X3, Y3) to (X4, Y4).

  As shown in FIG. 13B, when vertically adjacent (contain in a displayable frame), that is, when the screen F1 and the screen F2 are combined so as to be vertically adjacent, the combined screen is combined with the image frame L1 and the image frame. The system body calculates the position of the combined screen so as to fit in both of L2. Also in this case, as in FIG. 13B, the image frame L1 is within the range from the upper left point (X1, Y1) to the lower right point (X2, Y2) of the screen F1, and the image frame L2 is the upper left point (X3, X3) of the screen F2. Y3) to the lower right point (X4, Y4).

  FIG. 14 is a diagram showing a connection calculation method when the aspect ratio is kept constant (within a frame that can be displayed) and the screens F1 and F2 that are adjacent to each other are combined. That is, FIG. 14 shows a calculation method of the combined screen size when the screen size is changed so as to keep the aspect ratio constant when combining the two screens shown in step S14 of FIG.

14A shows the case of Y1 <Y3 and Y2 <Y4 and Y3 <Y2 (G1 region), and FIG. 14B shows the case of Y1> Y3 and Y2 <Y4 and Y2> Y1 (G2 region).
As described above, when the aspect ratio is kept constant (contained in a displayable frame) and the screens F1 and F2 that are adjacent to each other are combined, as shown in FIG. 14 and FIG. Four patterns of combined screens G1, G2, G3, and G4 are conceivable.

  As described above, on an HD (High Definition: high resolution (high definition / high image quality)) broadcast screen, the aspect ratio is X: Y = 16: 9. First, in FIG. 14 and FIG. 15 to be described later, here, a method for calculating the combined screen size of each combined screen G1, G2, G3, G4 in the case of the original screens F1, F2 will be described. That is, a method for determining the size of the combined image while maintaining the aspect ratio (X: Y = 16: 9) of the HD broadcast screen will be described below.

In the case of Y1 <Y3 and Y2 <Y4 and Y2> Y3 (G1 region) shown in FIG. Y2-Y3) / 9) / 2], 1LY is the position of Y3. Further, 2RX at the lower right point (2RX, 2RY) of the combined screen G1 is [X4-((X-4X1) -16 (Y2-Y3) / 9) / 2], and 2RY is at the position of Y2.
Here, only the case of (X4-X1)> 16 (Y2-Y3) / 9 is described. In the opposite case, the calculation is performed in the same manner as the screen division process shown in FIGS.

In the case of Y1> Y3 and Y4> Y2 and Y2> Y1 (region G2) shown in FIG. 14B, 1LX of the upper left point (1LX, 1LY) of the combined screen G2 is [X1 + ((X4-X1) -16 ( Y2-Y1) / 9) / 2], 1LY is the position of Y1. Also, 2RX at the lower right point (2RX, 2RY) of the combined screen G2 is [X4-((X4-X1) -16 (Y2-Y1) / 9) / 2], and 2RY is at the position of Y2.
Here, only the case of (X4-X1)> 16 (Y2-Y1) / 9 is described. In the opposite case, the calculation is performed in the same manner as the screen division process shown in FIGS.

  Similarly to FIG. 14, FIG. 15 is a diagram showing a calculation method for combining two adjacent screens F1 and F2 when the aspect ratio is kept constant (within a frame that can be displayed). The difference from FIG. 14 is the positional relationship between the screen F1 and the screen F2. FIG. 15A shows Y1 <Y3 and Y2> Y4 and Y4> Y3 (G3 region), and FIG. 15B shows Y1> Y3 and Y2> Y4. And Y1 <Y4 (G4 region).

In the case of Y1 <Y3 and Y2> Y4 and Y4> Y3 (region G3) shown in FIG. 15A, 1LX of the upper left point (1LX, 1LY) of the combined screen G3 is [X1 + ((X4-X1) -16 ( Y4-Y3) / 9) / 2], 1LY is the position of Y3. Further, 2RX at the lower right point (2RX, 2RY) of the combined screen G3 is [X4-((X4-X1) -16 (Y-Y3) / 9) / 2], and 2RY is at the position of Y4.
Here, only the case of (X4-X1)> 16 (Y4-Y3) / 9 is described. In the opposite case, the calculation is performed in the same manner as the screen division process shown in FIGS.

In the case of Y1> Y3 and Y2> Y4 and Y1 <Y4 shown in FIG. 15B (G4 region), 1LX of the upper left point (1LX, 1LY) of the combined screen G4 is [X1 + ((X4-X1) -16 ( Y4-Y1) / 9) / 2], 1LY is the position of Y1. Further, 2RX at the lower right point (2RX, 2RY) of the combined screen G4 is [X4-((X4-X1) -16 (Y4-Y1) / 9) / 2], and 2RY is at the position of Y4.
Here, only the case of (X4-X1)> 16 (Y4-Y1) / 9 is described. In the opposite case, the calculation is performed in the same manner as the screen division process shown in FIGS.

Here, an area of one screen when the two screens F1 and F2 are combined will be described with reference to FIGS.
For example, in addition to the combined screen G1 of the area overlapping the screen F1 and the screen F2 shown in FIG. 14A, the case of the combined screen G2 of the area overlapping only the screen F1 as shown in FIG. 14B can be considered. Further, as shown in FIG. 15A, a combined screen G3 of an area overlapping only with the screen F2 and a combined screen G4 of an area overlapping with the screen F2 and the screen F1 as shown in FIG. 15B can be considered.

The area S1 of the combined screen G1 shown in FIG. 14A is S1 = (2RY-1LY) × (2RX-1LX) from FIG. 14A, so S1 = (Y2-Y3) × ((X4-X1) − (X4− X1) +16 (Y2-Y3) / 9)) = 16 (Y2-Y3) becomes 2/9.

14B, the area S2 of the combined screen G2 is S2 = (Y2-Y1) * ((X4-X1)-(X4-X1) +16 (Y2-Y1) / 9) = 16 (Y2 ^-Y1) is 2/9. Further, as shown in FIG. 15A, the area S3 of the combined screen G3 is S3 = (Y4-Y3) × ((X4-X1) − (X4-X1) +16 (Y4-Y3) / 9) = 16 (Y4 ^-Y3) is 2/9. Further, the area S4 of the combined screen G4 shown in FIG. 15B is S4 = (Y4-Y1) × ((X4-X1) − (X4-X1) +16 (Y4-Y1) / 9)) = 16 (Y4-Y1 ) is ^2/9.
Therefore, the system body compares the areas S1, S2, S3, and S4 of these combined screens G1, G2, G3, and G4, and determines in which region the combined screen is to be created.

  FIG. 16 is a diagram for explaining a calculation method for combining the two screens F1 and F2 in the case where the aspect ratio is kept constant but the larger one is prioritized without being within the displayable frame. FIG. 16B shows a case where they are next to each other vertically.

  In the case where the larger one is prioritized without being contained within the frame that can be displayed, and when the screen F1 and the screen F2 adjacent to each other are combined as shown in FIG. 16A, the system main body displays the combined screen as the screen F1. The position of the combined screen is calculated so that the image frame of the larger screen F2 is preferentially accommodated in the image frame L1 without being accommodated in the image frame (described later in FIG. 17).

As shown in FIG. 16B, when the vertically adjacent screens F1 and F2 are combined, the system main body gives priority to the image frame of the larger screen F1 without placing the combined screen in the image frame of the screen F2. The position of the combined screen is calculated so as to fit in the image frame L2 (described later in FIG. 20).
Here, a connection calculation method in the case of being adjacent to each other will be described. The same calculation is performed for the vertical case.

FIG. 17 is a diagram showing a calculation method for combining two screens F1 and F2 adjacent to each other in a case where the aspect ratio is kept constant (the larger one is given priority without being placed in a displayable frame). is there.
Here, the four patterns of the combined screens G1, G2, G3, and G4 shown in FIGS. 14 and 15 are collectively shown as a combined screen G5.

  1LX of the upper left point (1LX, 1LY) of the combined screen G5 is [X1 + ((X4-X1) -16 (max (Y2, Y4) -min (Y1, Y3)) / 9) / 2], 1LY is min The position is (Y1, Y3). Further, 2RX at the lower right point (2RX, 2RY) of the combined screen G5 is [X4-((X4-X1) -16 (max (Y2, Y4) -min (Y1, Y3)) / 9) / 2]. 2RY is at the position of max (Y2, Y4). This will be described below.

Here, the coordinates of the upper left point of the image frame L1 giving priority to the image frame of the larger screen F2 are (X1, min (Y1, Y3)), and the coordinates of the lower right point are (X4, max (Y2, Y4)). It becomes.
When the combined screen G5 is long horizontally, (X4−X1)> 16 (max (Y2, Y4) −min (Y1, Y3)) / 9. Therefore, 1LX of the upper left point (1LX, 1LY) of the combined screen G5 is [X1 + ((X4−X1) −16 (max (Y2, Y4) −min (Y1, Y3)) / 9) / 2], 1LY. Becomes min (Y1, Y3).

In addition, 2RX, [X4-((X4-X1) -16 (max (Y2, Y4) -min (Y1, Y3)) / 9) / 2] of the lower right point (2RX, 2RY) of the combined screen G5, 2RY becomes max (Y2, Y4).
Here, only the case of (X4−X1)> 16 (max (Y2, Y4) −min (Y1, Y3)) / 9 is described, as in the case where the image is contained in the displayable frame. In the opposite case, the calculation is performed in the same manner as the screen division process shown in FIGS.
Note that max (a, b) indicates a large number of a and b, and min (a, b) indicates a small number of a and b.

FIG. 18 illustrates a calculation method in the case where the aspect ratio is kept constant when priority is given to the larger one without being within the displayable frame, and particularly when two horizontally adjacent screens F1 and F2 are combined. FIG.
In FIG. 18, when the smaller screen F1 occupies a part of the area of the image frame L1, the combined screen G6 is obtained by keeping the aspect ratio constant and matching the image frame L2 of the larger screen F2. The part which protrudes from the screen F1 is made.

Therefore, it is necessary to change the screen size by using the size changing portions R1 and R2 as the portions of the combined screen G6 that protrude from the screen F1 up and down.
The calculation for changing the screen size of the size change portions R1 and R2 is performed in the same manner as the screen division processing shown in FIGS.

FIG. 19 is also a diagram showing a connection calculation method in the case where the aspect ratio is kept constant, as in FIG. 18, but in the case of FIG. 19, the small screen F1 is biased toward the upper part of the image frame L1.
Also in this case, since the smaller screen F1 occupies a part of the area of the image frame L1, the aspect ratio is kept constant to match the image frame L2 of the larger screen F2. Also in this case, the combined screen G7 has a portion protruding from the screen F1.

Therefore, it is necessary to change the screen size by setting the portion protruding from the screen F1 of the combined screen G7 as the size changing portion R3.
The calculation for changing the screen size of the size changing portion R3 is performed as follows.
First, the area ratio of the size change portion R3 and the portion obtained by removing the size change portion R3 from the entire combined screen G7 is obtained.

In this case, the size-changing portion R3 vs. the other portion becomes (X2-X1) × (Y4-Y2): [(X4-X1) (Y4-Y1)-(X2-X1) (Y4-Y2)]. .
Naturally, in the case of 16 (Y4-Y1) / 9> (X4-X1) as shown in FIG. 19, a large amount is generated in the horizontal direction, so the length (X4-X1) in the horizontal direction is the area. Divide by ratio and change the screen size within that range.
On the other hand, if the length is long, the length is divided in the same manner as the width and the size is changed.

FIG. 20 is a diagram showing a calculation method when the screens F1 and F2 are combined when the aspect ratio is not kept constant. FIG. 20A shows a case where two screens are adjacent to each other, and FIG. It shows a case where the screens are vertically adjacent.
As shown in FIG. 20A, when the two screens F1 and F2 are adjacent to each other, the portion of the combined screen G8 that protrudes from the larger screen F2 is the same as that in FIG. Change the size according to the calculation method.

FIG. 21 is a block diagram showing a system configuration for screen combination. 9 is different from the system configuration shown in FIG. 9 in that the screen adjacency determination unit 36 is provided.
In FIG. 21, the screen adjacency determination unit 36 determines whether or not the screens to be combined are adjacent to each other, and supplies the position / size 52 of the selected screen to the screen selection management unit 31.
The screen selection management unit 31 acquires information on the selected screen from the memory 17, supplies the selected screen number / selected number 51 to the image frame calculation unit 32 and writes it to the memory 17. .

  The image frame calculation unit 32 acquires information on the selected screen from the memory 17 from the memory 17 and writes the color 53 corresponding to the position / size / number of the selected child screens to the memory 17. The selected screen position / size 54 is supplied to the screen size calculator 34.

The screen size calculation unit 34 calculates the position / size 55 of the combined new child screen based on the selected screen position / size 54 and supplies it to the screen number management unit 16.
Other parts are the same as the block diagram showing the system configuration of the screen division shown in FIG. 9 described above.

The specific screen combining process is as follows.
That is, the remote control signal analysis unit 15 receives the screen combination signal from the remote control 13. When the remote control signal analysis unit 15 receives a screen division signal from the remote control 13 and has not yet selected a screen, the screen selection management unit 31 selects a lower screen number.

  The screen selection management unit 31 loads the selected sub-screen number 51 from the memory 17, and outputs the screen position 21 of the screen number to the screen integration unit 18, thereby selecting the screen currently selected for the subsequent display. The image frame is superimposed on the screen.

  Further, the screen selection management unit 31 stores the number of the currently selected child screen and the selected number 51 in the memory 17 at that time. This child screen position stores the X and Y coordinates and the width and height.

  Here, when the “next” button is pressed on the remote controller 13, the screen selection management unit 31 reads which screen is currently selected from the selected sub-screen number 51 acquired from the memory 17, and Add one to the screen number and read the screen position corresponding to the number from the memory 17 where the screen position is stored.

  On the contrary, when “RETURN” is pressed on the remote controller 13, the screen selection management unit 31 reads which screen is currently selected from the selected sub-screen number 51 acquired from the memory 17, and starts from that screen number. The number is reduced by one, and the screen position corresponding to the number is read from the memory 17 where the screen position is stored.

  The image frame calculation unit 32 calculates an image frame position that is selected as the screen position, and supplies the calculated image frame position to the image frame generation unit 25. The image frame generation unit 25 generates an image frame at the image frame position and outputs the generated image frame to the screen integration unit 18, thereby displaying the image frame superimposed on the currently selected screen on the subsequent display.

  Here, when the screen selection management unit 31 receives a signal for screen selection from the remote controller 13, the screen selection management unit 31 reads the currently selected screen number from the memory 17 in order to check which screen is selected.

  Next, when selecting the second and subsequent screens to be combined from the remote controller 13, the remote control signal analysis unit 15 receives the screen combination signal. When the remote control signal analysis unit 15 receives a screen division signal from the remote control 13 and has not yet selected a screen, the screen selection management unit 31 selects a lower screen number.

  The screen selection management unit 31 loads the second and subsequent selected child screen numbers 51 from the memory 17, and outputs the screen position 21 of the screen number to the screen integration unit 18. Display an image frame superimposed on the currently selected screen. Further, the screen selection management unit 31 stores the number of the currently selected child screen and the selected number 51 in the memory 17 at that time.

  Here, when the “Next” button is pressed on the remote controller 13, the screen selection management unit 31 selects which screen is currently selected from the second and subsequent selected child screen numbers 51 acquired from the memory 17. And the screen position corresponding to the number is read from the memory 17 where the screen position is stored. However, if the screen is already selected, add another number.

  On the other hand, when “RETURN” is pressed on the remote controller 13, the screen selection management unit 31 reads which screen is currently selected from the number 51 of the second and subsequent child screens acquired from the memory 17. The number is reduced by one from the screen number, and the screen position corresponding to the number is read from the memory 17 in which the screen position is stored. Similarly, if it is already selected, draw another number.

  Here, when the screen selection management unit 31 receives a signal for screen selection from the remote controller 13, the screen selection management unit 31 reads the currently selected screen number from the memory 17 in order to check which screen is selected. The screen adjacency determining unit 36 determines whether the screen is adjacent to the first selected one based on the coordinate position of the screen number.

In addition, the image frame calculation unit 32 also reads the color of the currently selected image frame from the memory 17 so that the color differs from the first one.
Next, when two or more screens to be combined are selected from the remote controller 13, the screen size calculator 34 calculates the screen size from the selected screens.

The screen size calculation unit 34 calculates the screen size and supplies the number / position / size 55 of the new child screens after the combination to the screen number management unit 16. Thereby, the screen number management unit 16 associates the screen number with the screen position and stores it in the memory 17.
As a result, a screen integrated at the position combined by the image integration unit 18 is generated, the entire screen is synthesized, and output to the subsequent display.

Next, a specific example of when to change the screen size will be described.
For example, by making it possible to change the size of the screen, if the viewer is interested in a program, the screen size can be increased and the sample can be listened to carefully.

In addition, it is difficult to watch a program of a receiving channel viewed by N people unless the screen is large.
In addition, there is a need to change the screen size to see how it looks. In such a case, it becomes necessary to change the size of the screen.

When the screen size is automatically determined, the following conditions can be considered as conditions for determining the screen size.
First, the screen size is changed according to the ratio of the volume to the divided screen (child screen).
Secondly, the screen size is changed depending on how many child screens are present relative to the child screens.

Third, when there are other people watching the same reception channel, the screen size is changed according to the number of the same screens being viewed.
Fourth, the screen size is changed according to the feature amount of the image.
Fifth, the screen size is changed according to the broadcast content.

  First, a case where the screen size is changed according to the volume ratio of each first sub-screen will be described. The volume of each sub-screen changes as content rises. For example, in a soccer game such as Japan vs. XXX country, the volume of the commentator increases during an action in front of the enemy team. In addition, the voice of the supporter (cheering) person becomes louder, and the volume (output volume) generally changes in addition to being operated by the remote controller.

  It is thought that it means that the interest of the person who actually appears improves. Therefore, due to the change, the system main body changes the screen size of each child screen in accordance with the ratio of the output volume of each child screen. Thereby, it becomes possible to make the program that the viewer is interested in a larger screen size.

  A case where the screen size is changed depending on the ratio of the number of child screens to each second child screen will be described. Although details have been described in the section of the division method, a child screen can be created in the child screen by further dividing the screen on each child screen. At that time, the system main body can be changed to a screen size that is easier to view by using the number of sub-screens in the sub-screen as a reference for size change.

  A case will be described in which the screen size is changed according to the number of the same screen being viewed when there is another person watching the program of the third same reception channel. By changing the reception channel of each child screen, there may be other screens displaying the same reception channel on the child screen in the large screen. At this time, for example, if the two reception channels are the same, the system main body can be auditioned at a double size simply by combining two screens.

  The following describes how the screen size is changed according to the feature amount of the fourth image. As the feature amount of the image, for example, the sharpness of the edge of the image, the hue, the noise, and the ratio of flatness can be considered.

  For example, if the system itself has a small tint (large saturation) and the screen size is reduced, and the reverse size increases, the viewing environment is improved and the viewer's feelings are calmed down. it can.

  Finally, a description will be given of how the screen size is changed according to the fifth broadcast content. For example, a viewer cannot read a telop that is synthesized and displayed on a program (OSD (on-screen display)) unless it has a certain size or more. Therefore, the system main body changes the size of the screen when the telop is extracted and the size falls below a certain size. As a result, characters such as telop are easy to see.

FIG. 22 is a flowchart showing a screen size change (automatic: volume ratio) process.
FIG. 22 shows processing realized when the computer of the system main body executes the program simultaneous viewing program.

  In FIG. 22, when the process of changing the screen size (automatic: volume ratio) is started (n = 1), first, the sound of the nth sub-screen in the screen is acquired (step S21). Specifically, the system main body acquires the audio signal of the child screen of each layer among the plurality of screens displayed on the display. That is, the system body refers to the screen number management unit 16 and acquires the volume for each screen / hierarchy.

  Here, it is determined whether or not there is a child screen in the next layer (step S22). Specifically, the system main body determines whether or not there are sub-screens in the second and subsequent layers based on the screen number of the screen number management unit 16.

  If there is a child screen in the next hierarchy in decision step S22, after processing n = n + 1 in step S23, the process returns to step S21 to repeat the process and judgment from step S21 to step S22, and the next hierarchy If there is no child screen, the magnitudes of the amplitudes of the acquired audio signals are compared (step S24). Specifically, the system main unit compares the amplitude levels of the acquired audio signals of the n-th sub screen in a certain period.

Next, the ratio is calculated for each layer (step S25). Specifically, the system main body calculates the volume ratio of the audio signal of the child screen for each hierarchy.
Then, the screen size is changed according to the obtained ratio (step S26). Specifically, the system body changes the screen size by the screen size calculation unit 34 so as to correspond to the volume ratio of the audio signal of the child screen for each layer.

FIG. 23 is a diagram illustrating a method for calculating the ratio between the volume and the screen.
In the volume-to-screen ratio calculation method shown in FIG. 23, the system main body acquires the amplitude An of the waveform of the audio signal input to the actual screen for each screen En, not just the volume of the sound for each screen. To do. Thereby, the system main body obtains the volume ratio of the amplitude An of the waveform of the audio signal for each screen En, and changes the screen size so as to correspond to the volume ratio.

FIG. 24 is a diagram showing an example in which the volume / screen ratio calculation method shown in FIG. 23 is applied to the first divided screen and the divided screen when one of the divided screens is further divided.
In the volume / screen ratio calculation method shown in FIG. 24, how the ratio is calculated using the amplitude obtained for each screen will be described.
First, the system main body acquires the amplitude An of the waveform of the audio signal for each screen En in a certain hierarchy. This is as described in FIG.

Here, if the screen is divided, the system main body acquires the maximum value in all the divided layers.
For example, each screen is divided into screen H1, screen H2, screen H3, and screen H4 in the first layer, and further, screen H2 is divided into screen H21, screen H22, screen H23, and screen H24 in the second layer. If it is done (number is a value indicating volume), the volume ratio of each screen will be as follows.

That is, the volume ratio for each screen in the first hierarchy (H1 to H4) is H1: H2 (H23): H3: H4 = 5: 10 (maximum value): 7: 3, as indicated by 71. Become.
The volume ratio for each screen in the second hierarchy (H21 to H24) is H21: H22: H23: H24 = 7: 6: 10: 9 as indicated by 72.

FIG. 25 is a diagram for explaining an example of a calculation method when the screen size is calculated in accordance with the volume ratio shown in FIG.
In the screen size calculation method shown in FIG. 25, how the screen size is calculated when the volume ratio is determined as H1: H2: H3: H4 = a: b: c: d (value indicating volume). The position where the size is changed will be described.

First, the coordinates (x, y1) and (x, Y2) of the center are indicated as follows: H1: H2: H3: H4 = xy1: (X−x) y2: x (Y−Y1) :( X−x) ( Y-y2) = a: b: c: d.
When the system body solves this, it becomes as follows.

  x = (a + c) X / (a + b + c + d), y1 = aY / (a + c), where a + c ≠ 0, y2 = bY / (b + d), where b + d ≠ 0.

  However, a + c = 0 and b + d = 0 do not occur simultaneously. Therefore, when a + c = 0, y1 = 0. When b + d = 0, y2 = 0.

FIG. 26 is a block diagram showing a system configuration for changing the screen size.
In FIG. 26, each processing unit 12 supplies a signal (video / audio) 61 for acquiring a feature value to the feature value calculation unit 37. The feature amount acquisition calculation unit 37 supplies each feature amount 63 calculated based on a signal (video / audio) 61 for acquiring the feature amount to the screen size calculation unit 34.

The screen size calculation unit 34 supplies the screen number management unit 16 with the screen size before and after the change and the position 62 calculated based on each feature amount 63. Each feature amount 63 indicates a volume, the number of sub-screens, a screen feature amount, and broadcast content.
Other parts are the same as the block diagram showing the system configuration of the screen division shown in FIG. 9 described above.

The specific processing for changing the screen size is as follows.
That is, when each feature quantity 63 is a volume, when this mode is set by the remote controller 13, the feature quantity calculation unit 37 extracts the volume as each feature quantity 63 and supplies it to the screen size calculation unit 34.

  The screen size calculation unit 34 refers to the screen number management unit 16 and calculates the screen size of the child screen for each screen / hierarchy based on the volume as each feature amount 63. At this time, the screen number management unit 16 reads the data of the child screen from the memory 17.

  Therefore, the screen size calculation unit 34 calculates a screen size that determines how to change the screen according to the volume of the acquired child screen. The screen number management unit 16 changes the correspondence between each screen and each screen size stored in the memory 17 based on the screen size.

Each processing unit 12 reads the calculated screen size of each screen, and adjusts the screen display position 21 stored in the memory 17.
As a result, a screen integrated at the position 21 combined by the image integration unit 18 is generated, and the entire screen is synthesized and output to the subsequent display.

  When each feature quantity 63 is the number of sub-screens, when this mode is set by the remote controller 13, the feature quantity calculation unit 37 extracts the number of sub-screens as each feature quantity 63 and supplies it to the screen size calculation unit 34. To do.

  The screen size calculation unit 34 refers to the screen number management unit 16 and calculates the screen size of the sub-screen for each screen / hierarchy based on the number of sub-screens as each feature amount 63. At this time, the screen number management unit 16 reads the data of the child screen from the memory 17.

  Therefore, the screen size calculation unit 34 calculates a screen size that determines how to change the screen according to the acquired number of sub-screens. The screen number management unit 16 changes the correspondence between each screen stored in the memory 17 and each screen size based on the screen size.

Each processing unit 12 reads the calculated screen size of each screen, and adjusts the screen display position 21 stored in the memory 17.
As a result, a screen integrated at the position 21 combined by the image integration unit 18 is generated, and the entire screen is synthesized and output to the subsequent display.

  When each feature quantity 63 is a screen feature quantity, when this mode is set by the remote controller 13, the feature quantity calculation unit 37 extracts the screen feature quantity as each feature quantity 63 and supplies it to the screen size calculation unit 34. .

  The screen size calculation unit 34 refers to the screen number management unit 16 and calculates the screen size of each child screen for each screen / hierarchy based on the screen feature amount as each feature amount 63. At this time, the screen number management unit 16 reads the data of the child screen from the memory 17.

  Therefore, the screen size calculation unit 34 calculates a screen size that determines how to change the screen based on the acquired screen feature amount. The screen number management unit 16 changes the correspondence between each screen stored in the memory 17 and each screen size based on the screen size.

Each processing unit 12 reads the calculated screen size of each screen, and adjusts the screen display position 21 stored in the memory 17.
As a result, a screen integrated at the position 21 combined by the image integration unit 18 is generated, and the entire screen is synthesized and output to the subsequent display.

  When each feature quantity 63 is broadcast content (telop), when this mode is set by the remote controller 13, the feature quantity calculation unit 37 extracts a telop as each feature quantity 63 and supplies it to the screen size calculation unit 34. .

  The screen size calculation unit 34 refers to the screen number management unit 16 and calculates the screen size of the child screen for each screen / hierarchy based on the telop as each feature amount 63. At this time, the screen number management unit 16 reads the data of the child screen from the memory 17.

  Therefore, the screen size calculation unit 34 calculates the screen size that determines how to change the screen according to the length of the acquired telop. The screen number management unit 16 changes the correspondence between each screen stored in the memory 17 and each screen size based on the screen size.

Each processing unit 12 reads the calculated screen size of each screen, and adjusts the screen display position 21 stored in the memory 17.
As a result, a screen integrated at the position 21 combined by the image integration unit 18 is generated, and the entire screen is synthesized and output to the subsequent display.

FIG. 27 is a configuration diagram of each processing unit for changing the screen size.
In FIG. 27, each processing unit 12 is basically not significantly different from the normal viewing shown in FIG. 8, but each processing unit 12 sends the video signal and the audio signal 61 to the feature amount calculation unit 37 in FIG. I need to send it. Thereby, the screen of the screen size calculated by the screen size calculation unit 34 is output by the size change processing unit 23 of each processing unit 12, and the screen integration unit 18 integrates the images after the size change and outputs them to the subsequent display. To do.

FIG. 28 is a flowchart showing a screen size (automatic: number of small screens) process.
FIG. 28 shows processing realized by the computer of the system main body executing the program simultaneous viewing program.

  In FIG. 28, when the process of changing the screen size (automatic: number of sub-screens) is started (n = 1), first, the number of sub-screens in the nth layer in the screen is acquired (step S31). Specifically, the system main body acquires the number of child screens in each layer among a plurality of screens displayed on the display. That is, when this mode is set by the remote controller 13, the system body reads the number of sub-screens from the screen number management unit 16.

  Here, it is determined whether or not there is a child screen in the next layer (step S32). Specifically, the system main body determines whether or not there are sub-screens in the second and subsequent layers based on the screen number of the screen number management unit 16.

  If there is a child screen in the next hierarchy in decision step S32, after processing n = n + 1 in step S33, the process returns to step S31 and repeats the process and judgment from steps S31 to S32 to repeat the next hierarchy. If there is no sub-screen, the number of sub-screens is added (step S34). Specifically, the system main body adds up the number of child screens of the acquired n-th layer child screens.

  Next, the ratio is calculated for each layer (step S35). Specifically, the system main body calculates the number of child screens for each layer and obtains the ratio.

  Then, the screen size is changed according to the obtained ratio (step S36). Specifically, the system body changes the screen size by the screen size calculation unit 34 so as to correspond to the ratio of the number of child screens for each layer.

  Here, the size is changed for each layer. At that time, the size is changed in order from the layer having the larger screen size (upper layer). For example, in the case of the screen of FIG. 24, the size of the screens H21, H22, H23, and H24 of the second layer is changed after the sizes of the screens H1, H3, and H4 of the first layer are changed.

FIG. 29 is a diagram illustrating a method of calculating the number of sub-screens.
When the screen is divided as shown in FIG. 29, the system main body calculates the number of sub-screens as follows.

  That is, the number of sub-screens 81 in the first layer (H1 to H4) is H1: H2: H3: H4 = 4: 7: 1: 1. Further, the number 82 of sub-screens in the upper left of the second hierarchy (H11 to H14) is H11: H12: H13: H14 = 1: 1: 1: 1.

Further, the upper right (H21 to H24) of the second layer is H21: H22: H23: H24 = 1: 4: 1: 1.
When the number of sub-screens is obtained in this way, the screen size is changed correspondingly in order from the first layer as described above.

FIG. 30 is a flowchart showing a screen size change (automatic: number of channels) process.
FIG. 30 shows processing realized when the computer of the system main body executes the program simultaneous viewing program.

  In FIG. 30, when the process of changing the screen size (automatic: number of channels) is started (n = 1), first, the number of channels of the child screen on the nth layer in the screen is acquired (step S41). Specifically, the system main body acquires the reception channel of the child screen of each layer among the plurality of screens displayed on the display.

That is, when this mode is set by the remote controller 13, the system body reads the reception channel of the sub-screen from the screen number management unit 16.
Here, it is determined whether or not there is a child screen in the next hierarchy (step S42). Specifically, the system main body determines whether or not there are sub-screens in the second and subsequent layers based on the screen number of the screen number management unit 16.

  If there is a child screen in the next hierarchy in decision step S42, after processing n = n + 1 in step S43, the process returns to step S41 and repeats the processes and judgments from step S41 to step S42. If there is no child screen, the number of acquired channels is added (step S44). Specifically, the system main body adds up the same number of received channels in the acquired n-th layer child screen.

  Next, the ratio is calculated for each layer (step S45). Specifically, the system main body calculates the ratio of the reception channels of the child screens for each layer and obtains the ratio.

  Then, the screen size is changed according to the obtained ratio (step S46). Specifically, the system body changes the screen size by the screen size calculation unit 34 so as to correspond to the ratio of the reception channels of the child screens for each layer.

FIG. 31 is a diagram showing a ratio from the number of channels. The number of channels indicates the number of the reception channel of the program received by the tuner 22 of each processing unit 12.
The ratio from the number of channels is obtained as follows.

  In FIG. 31, first, the number of channels of the entire screen is obtained. In this case, the number of channels “1” is two of the screen H11 and the screen H3. Further, the number of channels “4” is three of the screen H13, the screen H21, and the screen H221. Further, the number of channels “8” is two of the screen H12 and the screen H23.

  Further, the number of channels “10” is two of the screen H14 and the screen H224. The remaining channel number “2” is screen H4, channel number “3” is screen H24, channel number “6” is screen H222, and channel number “12” is screen H223, both of which are one. The number of channels of these entire screens can be obtained by counting the number of channels being received by the tuner 22. The required ratio is the ratio of these numbers.

  Also, apart from the entire screen, it is examined how many channels are the same for each child screen. This can be obtained by counting how many channels the program is shown on the sub-screen managed by the screen number management unit 16. For example, in the case of the child screens H1 to H4 in the first hierarchy, only the child screen H2 has two channel numbers “4” on the screen H21 and the screen H221.

  The sub-screens H11 to H14 and H21 to H24 in the second hierarchy, and the sub-screens H221 to H224 in the third hierarchy do not have the same number of channels. Everything is one. The system main body holds these ratios for each layer.

  The size changing method will be described below. When changing the screen size, first, when changing the screen size according to the number of reception channels, secondly, when the screens of the same reception channel are adjacent to each of the sub-screens, they are combined and changed. There are two cases of cases.

First, a case where the screen size is changed according to the number of first reception channels will be described.
First, the system main body has a correspondence table of the number of screens and screen positions. Specifically, the memory 17 in FIG. 26 stores a correspondence table between the number of screens and screen positions.

  This table corresponds to the number of screens of 1-100. At this time, using the example of FIG. 31 described above, the number of channels “1” is two, the number of channels “4” is three, the number of channels “8” is two, the number of channels “10” is two, and the remaining (4 channels) is one.

  Since there are a total of 13 sub-screens, the screen size calculator 34 acquires screen layout information corresponding to the number of channels “13” from the table in the memory 17 and determines the screen display position based on the screen layout information.

  Thereafter, if the number of channels is “1”, there are two screens, so the screen integration unit 18 performs a process of combining and displaying the two sub-screens H11 and H3. For the other channel numbers “4” and “8”, the screen integration unit 18 combines them in the same manner, and displays the combined screen on the subsequent display, so that the entire screen is brought to an approximate ratio of the number of channels. Can be divided.

FIG. 32 is a diagram illustrating a size changing method in the case where screens of the same channel are adjacent to each other and are changed by being combined.
Next, a description will be given of a case where the screens of the same channel are adjacent to each other for each second sub-screen and combined and changed.

For example, the case where the screens of the same channel are adjacent to each other is the screen H21 and the screen H221 having the number of channels “4” in the portion indicated by the combined size change 101.
When there is such a state indicated by the combined size change 101, the two screens are combined. The manner of coupling is as described above.

FIG. 33 is a block diagram showing another system configuration for changing the screen size.
An example in which the number of channels is used as the feature amount will be described.
In FIG. 33, a feature amount acquisition calculation unit 37 acquires a signal (channel) for acquiring a feature amount from the memory 17, calculates a channel number 113 that is a feature amount for each screen, and a screen size calculation unit. 34.

The screen size calculation unit 34 calculates the screen size based on the number of channels 113 that is the feature amount for each screen, and supplies the screen size and position 112 before and after the change to the screen number management unit 16.
Here, the number of the reception channel of the program received by the tuner 22 of each processing unit 12 is stored in the memory 17 together with the correspondence table between the number of screens and the screen position.
Other parts are the same as the block diagram showing the system configuration of the screen division shown in FIG. 9 described above.

  When each feature amount 113 is the number of channels, when this mode is set by the remote controller 13, the feature amount acquisition calculation unit 37 extracts the number of channels as each feature amount 113 and supplies it to the screen size calculation unit 34.

  The screen size calculation unit 34 refers to the screen number management unit 16 and calculates the screen size of the child screen for each screen / hierarchy based on the number of channels as each feature amount 113. At this time, the screen number management unit 16 reads the data of the child screen from the memory 17.

  Therefore, the screen size calculation unit 34 calculates the screen size that determines how to change the screen according to the number of channels of the acquired feature value. The screen number management unit 16 changes the correspondence between each screen stored in the memory 17 and each screen size based on the screen size.

Each processing unit 12 reads the calculated screen size of each screen, and adjusts the screen display position 21 stored in the memory 17.
As a result, a screen integrated at the position 21 combined by the image integration unit 18 is generated, and the entire screen is synthesized and output to the subsequent display.

FIG. 34 is a flowchart showing a screen size change (automatic: image feature amount) process.
FIG. 34 shows processing realized when the computer of the system main body executes the program simultaneous viewing program.

  In FIG. 34, when the process of changing the screen size (automatic: image feature amount) is started (n = 1), first, the image feature amount of the child screen on the nth layer in the screen is acquired (step S51). Specifically, the system main body acquires the image feature amount of the child screen of each layer among the plurality of screens displayed on the display.

That is, when this mode is set by the remote controller 13, the system body reads the image feature amount of the sub-screen from the screen number management unit 16.
Here, it is determined whether or not there is a child screen in the next hierarchy (step S52). Specifically, the system main body determines whether or not there are sub-screens in the second and subsequent layers based on the screen number of the screen number management unit 16.

  If there is a child screen in the next hierarchy in decision step S52, after processing n = n + 1 in step S53, the process returns to step S51 and repeats the processes and judgments from step S51 to step S52 to repeat the next hierarchy. If there is no sub-screen, the acquired image feature values are added together (step S54). Specifically, the system main body adds together the same image feature values of the acquired n-th sub-screen.

Next, the ratio is calculated for each layer (step S55). Specifically, the system main body calculates the ratio of the reception channels of the child screen for each layer.
Then, the screen size is changed according to the obtained ratio (step S56). Specifically, the system body changes the screen size by the screen size calculation unit 34 so as to correspond to the ratio of the image feature amount of the child screen for each layer.

A specific example of calculating the screen size ratio from the image feature amount will be described.
Focus on various feature values of the screen, and consider changing the screen size by obtaining the ratio. The method for changing the screen size is as shown in step S56 in FIG.

Here, how the ratio of the screen size is calculated from the feature amount will be described.
As the feature amount, first, the sharpness of the edge of the image, second, the saturation of the image, third, the noise of the image, fourth, the flatness ratio of the image, and the like can be considered.
A case where the sharpness of the edge of the first image is used as the feature amount will be described.

  In this case, the steepness of the edge of the image, that is, the degree of inclination of the edge of the image is detected. Since the slope is a difference between adjacent pixels, the slope is obtained by calculating the sum of absolute differences of adjacent pixels in all samples of one frame of the video signal and dividing it by the total number of samples. The obtained value is used as a feature amount. Equation 1 shows a formula for calculating the slope of the edge.

[Equation 1]
Σ (adjacent difference) / total number of samples

  It can be seen that the sharper the image edge is, the higher the frequency band is. Therefore, such a wideband input image is displayed on a screen having a wide area as much as possible, and conversely, a low band input image is displayed on a narrow screen. Display and process to display as wide a band as possible.

  The above-described feature amount is obtained on the entire screen, and when there are a plurality of sub-screens, the maximum value in the sub-screen is used. For example, only the luminance separated from the video signal can be used. The ratio of the luminance value for each screen is calculated as a feature amount.

  As an effect, when the image has a very steep edge, aliasing noise is conspicuous because the edge is glaring. Therefore, the aliasing noise can be reduced by increasing the screen size.

A case where the saturation of the second image is used as the feature amount will be described.
In this case, images with high saturation are not friendly to the viewer's eyes, so such images are displayed on a narrow screen, and conversely, images with low saturation that are gentle to the viewer's eyes are wider. Display on the range screen.

  For example, the saturation of the image is a value obtained by dividing the difference between the maximum value and the minimum value among the RGB values of the video signal at a certain point by the maximum value. In this case, the saturation is obtained with a value of 0 to 1. The above-described feature amount is obtained on the entire screen, and when there are a plurality of sub-screens, the maximum value in the sub-screen is used.

  Here, since it is desired to reduce the screen as the saturation of the image increases, a value obtained by subtracting the obtained saturation from 1 is used. The ratio of the obtained value for each screen is calculated as a feature amount. Formula 2 shows the calculation formula for the slope of saturation.

[Equation 2]
1-Σ (saturation) / total number of samples

A case where the noise of the third image is used as the feature amount will be described.
In this case, an image with a lot of noise is unsightly for the viewer, so it is displayed on a narrow screen, and an image with a little noise is displayed on a wide screen.

  For example, the image noise is obtained by dividing the sum of absolute differences between the luminance value Y (t) at the time t of the video signal and the luminance value Y (t−1) at the time t−1 by the total number of samples. However, in this case, since this value becomes large in a portion where the movement is large, only a place where the difference absolute value is small to some extent is adopted. For example, only a difference absolute value of 5 or less is employed.

  In this case, since the screen is desired to be smaller as the noise of the image is larger, a value obtained by subtracting the obtained noise from 5 is used. The ratio of the obtained value for each screen is calculated as a feature amount. Equation 3 shows the calculation formula of noise.

[Equation 3]
5-Σ (Y (t) -Y (t-1)) / total number of samples

A case where the flatness ratio of the fourth image is used as the feature amount will be described.
In this case, the higher the flatness ratio, the smaller the area is displayed on the screen, and vice versa. This is due to the demand of the viewing environment of the viewer who wants to see a screen that changes in a wider area.

  For example, for the flatness ratio of the image, the system main body obtains the change amount DR of the pixel value in a certain region when the target pixel of the video signal is viewed. When the change amount DR of the pixel value is small, for example, when the change amount DR of the pixel value is 10 or less, the system body assumes that the image is flat, counts the samples, and divides by the total number of samples.

  The value of the flatness ratio of the image at this time is 0-1. Here, the change amount DR of the pixel value is a so-called dynamic range and indicates a difference between the maximum value and the minimum value of the pixel value in a certain region.

Accordingly, a place where the pixel value change amount DR is small is a place where the difference between the maximum value and the minimum value is small.
Here, when it is assumed that the change amount DR of the pixel value is 10 or less, 10 indicates a value when the pixel value is expressed by 8 bits.

  That is, when the pixel value changes from 0 to 255, if the amount of change (DR) in a certain region is 10 or less, the region is hardly changed, so that it can be determined that the image is flat.

Since this numerical value of 10 is an example, if the condition is made stricter, if this numerical value is reduced, a certain region only corresponds to a flatter portion.
Here, since the larger the ratio is, the smaller the screen is, the value obtained by subtracting the obtained ratio from 1 is used. The obtained value is calculated as a ratio. Equation 4 shows a formula for calculating the flatness ratio of the image.

[Equation 4]
1−Σ (where DR in a certain region is small) / total number of samples

  As an effect, a screen with a large flat rate is considered to have a small amount of information. Therefore, a larger amount of information can be acquired by assigning a screen with a larger area to a screen with a larger amount of information.

  In this example, it is assumed that such various image feature amounts are detected in the signal processing process in each processing unit 12 of the video signal and stored in the memory 17.

FIG. 35 is a flowchart showing a screen size change (automatic: broadcast content) process.
FIG. 35 shows processing realized when the computer of the system main body executes the program simultaneous viewing program.

  In FIG. 35, when the process of changing the screen size (automatic: broadcast content) is started (n = 1), first, a telop of the child screen at the nth layer in the screen is acquired (step S61). Specifically, the system main body acquires a telop of a child screen of each layer among a plurality of screens displayed on the display.

That is, when this mode is set by the remote controller 13, the system main unit reads the sub-screen telop from the screen number management unit 16.
Here, it is determined whether or not there is a child screen in the next hierarchy (step S62). Specifically, the system main body determines whether or not there are sub-screens in the second and subsequent layers based on the screen number of the screen number management unit 16.

  If there is a child screen in the next hierarchy in decision step S62, after processing n = n + 1 in step S63, the process returns to step S61 and repeats the process and judgment from step S61 to step S62 to repeat the next hierarchy. If there is no child screen, it is checked what the acquired telop size is (step S64). Specifically, the system main body obtains the telop size for each acquired child screen of the nth layer.

  Then, the screen size is changed according to the obtained telop size (step S65). Specifically, the system main body changes the screen size by the screen size calculation unit 34 so as to correspond to the subtitle telop size for each layer.

Here, it is assumed that the telop for each screen detected as follows is stored in the memory 17 in advance.
That is, when detecting the telop size, the system main body checks where the binary edge is in the screen, and by checking the range (rectangle) when the binary edge exists, Ask for.

Specifically, the telop size is obtained as follows.
First, a search is made for where the difference between adjacent pixels of the video signal is large. This is because there are many telop positions at the top, bottom, left and right of the screen.
Secondly, it is checked whether the pixel difference is about the same in the periphery.

Third, if the pixel difference is about the same in the periphery, a wider area is examined to see how much such a difference is distributed.
Fourth, when the range (rectangle) is long in the horizontal direction, the vertical size is the size of the telop, and conversely when it is long in the vertical direction, the horizontal size is the size of the telop.

The screen size change method is as follows.
That is, when the screen size is changed when the size of the telop is known, the system main body changes the first method when changing the size of only the telop, and secondly, the screen size is adjusted in accordance with the size of the telop. There are two possible ways to change

A case where the size of only the first telop is changed will be described.
Since the size of the rectangle is known, the system body is enlarged using a well-known image interpolation technique. At that time, the system body is enlarged to a size that exceeds the size that is easy to see. The size is dealt with by first allowing the viewer to input as an initial value.

  At that time, if the screen does not fit, it may cross over to the next screen. Or, when it is impossible to straddle, it is dealt with by increasing the size of the child screen.

Next, a case where the screen size is changed according to the size of the second telop will be described.
The system main body acquires the input screen size indicating how many times the screen size should be enlarged from the size of the telop.

When the input size is a and the reference size is b, the enlargement ratio is b / a. The reference size is first input by the user as an initial value.
Specifically, the system main body acquires the position of the telop. The system body changes the center position of the zoom depending on whether the position is up, down, left, or right. For example, if the position of the telop is down, the system body enlarges around the middle below.

  Since the system main body can acquire the position of the screen from the memory 17, it calculates using the numerical value. When the screen is enlarged, the extent of the portion that protrudes from the image frame so far is calculated from the screen size of the enlargement ratio.

  Since the system itself knows which screen is above, below, left, and right of the screen position, it reduces the size of the adjacent screens by the amount that protrudes.

FIG. 36 is a flowchart showing the screen enlargement process.
FIG. 36 is a flowchart showing screen enlargement processing according to one embodiment of the present invention. FIG. 36 shows processing realized when the computer of the system main body executes the program simultaneous viewing program.

  In FIG. 36, first, one screen to be enlarged is selected and determined (step S71). Specifically, based on selection and determination operations from the remote controller, the system main body determines a screen to be enlarged among a plurality of screens displayed on the display.

  Next, the center position and the enlargement size for determining where and how much the selected screen is to be enlarged are determined (step S72). Specifically, the system main body displays a cursor on the screen determined on the display, determines the specified center position, and determines the specified enlargement size.

  Here, the viewer moves the cursor to determine the enlargement position. Specifically, based on the position designation and determination operation from the remote controller, the system main body determines the division position within the screen to be enlarged displayed on the display.

  Therefore, the process of the part which protruded from the image frame by enlarging is performed (step S73). Specifically, when the screen is enlarged at the enlargement position and the enlargement size determined on the display, the system main body changes the screen size of the portion protruding from the image frame after enlargement. For example, the screen size is changed so as to keep the aspect ratio constant before and after the division.

  Then, it is determined whether there is another screen to be enlarged (step S74). Specifically, the system main body determines whether there is another screen enlargement selection and determination operation from another remote controller.

If there is another screen enlargement selection and determination operation from another remote controller in the determination step S74, the process returns to step S71, and the processes and determinations from step S71 to step S74 are repeated.
In the determination step S74, when there is no other screen enlargement selection and determination operation from another remote controller, the process ends.

FIG. 37 is a block diagram showing a system configuration of enlarged display.
In FIG. 37, the screen selection management unit 31 supplies the selected child screen number 121 to the image frame calculation unit 32 and the cursor position calculation unit 33.

  The cursor position calculation unit 33 obtains the selected child screen size 122 from the memory 17 and calculates the cursor position based on the acquired child screen size 122, and obtains the cursor position, the child screen position / size, and the enlargement ratio 123. This is supplied to the enlarged size calculation unit 38.

  The enlargement size calculation unit 38 calculates the screen position / size based on the cursor position, the position / size of the child screen, and the enlargement rate 123, and sets the enlargement center position / enlargement rate / screen position / size 124 to the screen size calculation unit. 34.

The screen size calculation unit 34 calculates the screen position / size 124 based on the enlargement center position / magnification rate, and supplies the screen position / size 124 to the screen number management unit 16.
Other parts are the same as the block diagram showing the system configuration of the screen division shown in FIG. 9 described above.

FIG. 38 is a configuration diagram of each processing unit for enlarged display.
The size change processing unit 23 is a processing unit that resizes the image of the input video signal from the size 123 and the enlargement ratio / enlargement center position 124 acquired from the memory 17.
Others are the same as during normal viewing.

Here, the specific operation of the enlarged display is as follows.
The remote control signal analysis unit 15 receives a screen enlargement signal from the remote control 13. When the remote control signal analysis unit 15 receives a screen enlargement signal from the remote control 13 and the screen selection management unit 31 has not yet selected a screen, the screen selection management unit 31 selects a smaller screen number.

The screen selection management unit 31 loads the selected sub-screen number 121 from the memory 17, and outputs the screen position 21 of the screen number to the screen integration unit 18, thereby selecting the screen currently selected for the subsequent display. The image frame is superimposed on the screen.
Further, the screen selection management unit 31 stores the currently selected child screen in the memory 17 at that time. This child screen position stores the X and Y coordinates and the width and height.

  Here, when the “Next” button is pressed on the remote controller 13, the screen selection management unit 31 reads which screen is currently selected from the number 121 of the selected child screen acquired from the memory 17. Add one to the screen number and read the screen position corresponding to the number from the memory 17 where the screen position is stored.

  Conversely, when “RETURN” is pressed on the remote controller 13, the screen selection management unit 31 reads which screen is currently selected from the selected sub-screen number 121 acquired from the memory 17, and starts from that screen number. The number is reduced by one, and the screen position corresponding to the number is read from the memory 17 where the screen position is stored.

  Then, the cursor position calculation unit 33 reads the screen position from the size 122 of the selected child screen acquired from the memory 17 and supplies it to the image frame & cursor generation unit 35. The image frame & cursor generation unit 35 generates an image frame and a cursor corresponding to the screen position and supplies them to the image integration unit 18. As a result, an image frame that is selected at that position is displayed on the subsequent display.

  Here, when the screen selection management unit 31 receives a signal for screen selection from the remote controller 13, the screen selection management unit 31 reads the currently selected screen number from the memory 17 in order to check which screen is selected. At this time, the image frame & cursor generation unit 35 generates a cursor so that the cursor is displayed at the center of the selected screen (see FIG. 10).

  Next, when the cursor is moved from the remote controller 13 and the screen enlargement position is determined by the remote controller 13, the image frame & cursor generation unit 35 superimposes a translucent screen on the screen in order to determine the enlargement size.

Here, when the cursor is moved and the screen enlargement center position is determined by the remote controller 13, the semi-transparent image frame size is changed in conjunction with adjustment of the enlargement ratio by the remote controller 13.
Based on the cursor position acquired from the cursor position calculation unit 33, the cursor position of the sub-screen position / size 123, and the enlargement ratio, the screen size calculation unit 34 calculates the screen size.

  The screen size calculation unit 34 calculates the screen size and supplies the screen number management unit 16 with the enlargement center position / enlargement ratio / screen position / size 124. As a result, when the enlargement ratio is determined, the screen number management unit 16 associates the screen number with the screen position, and stores this in the memory 17. Further, the image frame & cursor generation unit 35 processes the image frame of the protruding portion as described above.

  As a result, a screen integrated at the position where the screen added by moving the cursor is read by the image integration unit 18 is generated, the entire screen is synthesized, and output to the subsequent display.

FIG. 39 is a diagram showing the size when the enlargement ratio is changed.
In FIG. 39, when the enlargement ratio for enlarging the original image J1 (X, Y) to the image J2 is changed, the enlargement center is set to (m, n), and the enlargement ratio is set to r, the enlargement is performed. X1, X2, Y1, and Y2 of the subsequent image J2, as indicated by 131, X1 = (1-r) m, X2 = (Xm) r + m, Y1 = (1-r) n, Y2 = ( Y−n) expressed as r + n.

Next, the processing of the protruding part will be described.
When the image is enlarged, the processing of the portion that protrudes from the image frame before the enlargement is as follows.

  First, the image frame & cursor generation unit 35 displays the same translucent image as when the enlargement ratio is determined. Then, the screen size calculation unit 34 calculates a portion that protrudes from the area before enlargement, and the image frame & cursor generation unit 35 displays the portion in a translucent manner. At this time, the screen size calculation unit 34 changes the peripheral image size.

  Further, when the protruding portion is not displayed, the screen size calculation unit 34 calculates the portion protruding from the area up to the enlargement, and the image frame & cursor generation unit 35 does not display the portion.

By enlarging the screen in this way, the following effects can be obtained.
First, when a program of a receiving channel that does not appear on the edge of the screen is selected, the center of the screen is enlarged so that the viewer can watch the program in a larger size.

  Further, by enlarging and displaying the part of interest to the viewer, the part of interest can be viewed in detail. At this time, a well-known high-density conversion capable of high-quality interpolation processing can be used as means for enlarging.

  In addition, as described in the screen division and combination, there are various operation methods for enlarging the screen. Here, the operation by the remote controller 13 which is one of them will be described.

First, the viewer selects which screen on the screen he wants to enlarge.
Second, as a screen selection method, for example, the viewer selectively moves the screen using a jog dial. Alternatively, a number may be selected on the screen and the number may be selected using a numeric keypad.

Thirdly, the system main body displays a cursor indicating the center and the screen size on the selected screen, and uses it to determine where and how much to enlarge.
Fourthly, the system main body may be enlarged so that the portion outside the screen is not simply displayed (deleted).

Fifth, by enlarging the system main body, a transparent display may be performed for a portion of the screen that overlaps another screen.
In addition, by enlarging the screen, the processing for the overlapped portion is as follows.
That is, the system main body may make both overlapping screens translucent.

Further, the enlarged screen may not be displayed (deleted). Also, both overlapping screens may be mixed and displayed.
For the overlapped portion, basically, a small screen size may be preferentially displayed, and if there is a movement, the moving one may be preferentially displayed. By this operation, an enlargement operation can be performed.

Next, an image control operation using the remote controller 13 will be described.
This is an operation method related to the remote controller 13 that can control the divided sub-screens.

By using the remote controller 13, it is possible to control the change of the channel of the child screen, the change of the volume of the child screen, the screen division of the child screen, and the combination of the divided images of the child screen.
In this case, how to associate the remote controller (child remote controller) with the screen will be described below.

There are the following methods for automatically assigning the child remote control to the child screen.
First, there is a method of assigning a screen closest to the position by detecting the position of the remote control, that is, the viewer.
Secondly, there is a method of detecting the position of the remote controller, that is, the viewer, and assigning the farthest screen when the position is close to the screen.

  A method of allocating a screen closest to the position by detecting the position of the first remote controller, that is, the viewer will be described. There are several ways to detect the position of the remote control, ie the viewer.

  The first is to determine the position of the remote control that can generate a directional radio wave from the screen main body of the display and to catch the radio wave by scanning the direction in which the system main body emits the radio wave. Is the method.

  Second, by having a plurality of remote control light receiving portions in an array in the lower horizontal direction of the screen main body of the display, the intensity of the infrared command in the light receiving portion when the remote control is operated is different. This is a method of obtaining the position by using the intensity relatively.

Here, the position detection using the second method will be described.
For example, a plurality of partitions are prepared in the lower horizontal direction of the screen of the display, and the remote control light receiving unit is disposed therebetween. The system body determines the direction of the remote control based on the relative intensity of the infrared command from the remote control.

  When the system main body knows the position of the remote control, it can determine which screen is closest to the remote control from the screen and assign the screen to the child remote control.

Next, a method of detecting the position of the second remote controller, that is, the viewer, and assigning the farthest screen when the position is close to the screen will be described.
Assume that the position of the remote control is obtained as described in the explanation of the first method. At that time, the system main unit selects the screen farthest from the position of the remote control and assigns the screen and the remote control.

The first method is a audition style in which the viewer sees the screen almost straight, while the second method is a preview style in which the viewer often sees the screen at an angle. If the viewer looks straight, it is easier for the viewer to see, but if the viewing environment is bad and the eyes are likely to get worse, the system main body may display a message so that the second method is recommended.
Only the relative position detection in the horizontal direction has been described, but if the same operation is performed in the vertical direction, the position in the height direction can be acquired.

  As described above, the assignment of the screen and the child remote controller has been described. Conversely, when the assignment is to be canceled, the system main body need only be released by pressing the release button on the remote controller.

  Further, when changing the assignment with the child remote controller to another screen, the change can be made by automatically determining the screen to be assigned by the same operation without canceling.

  Furthermore, it is necessary to control the sound field in order for a plurality of people to listen to a program. This is because if you can hear the audio that other people are listening to, you will be distracted and you will not be able to concentrate on the screen.

As a method conceivable in such a case, there are a method realized by using a directional speaker and a method realized by performing audio signal processing.
Here, the implementation will be described using the first directional speaker.

First, the system main body obtains the relative position of the child screen to the assigned child remote controller screen.
Second, the system main body controls the sound so as to match the position of the child remote controller.

A specific voice control method is as follows.
The method for acquiring the position of the remote control is as described above. It is assumed that there is a viewer at that position. The system itself delivers audio to its viewers, but it can be realized by using technology that delivers sound to a very narrow area using ultrasound, such as an audio spotlight.

  Thereby, the sound that the viewer wants to hear is delivered only to the position of the viewer having the child remote control.

  This allows the system itself to identify each audition location even when multiple people on the large screen are listening to a program on a different receiving channel, so the sound suitable for the location of each viewer can be identified from the large screen. It can be seen that each of them can be auditioned without interference.

  However, it can be imagined that if the distance between the test listeners is too close, it cannot be performed well due to the interference of sound. To cope with such a case, it is necessary to create a more special environment.

  For example, there is a method using a system that uses headphones, which is an environment that can only be heard by individuals. Therefore, it is necessary to provide a headphone terminal on the child remote controller and to enable voice exchange between the child remote controller and the screen wirelessly.

  This radio may be performed using, for example, short-range radio communication such as Bluetooth. Alternatively, it is synonymous to add a wireless function to the headphones themselves and perform direct data communication with the system body. However, when communicating directly with the system main unit through headphones, it is necessary to determine in advance which screen the headphones support.

Further, when there are a plurality of child remote controllers, a master remote controller for controlling them may be prepared.
The following can be considered as functions of the master remote controller in this case.

  That is, when a child remote controller used by another viewer is taken out, only the child remote controller can control a screen corresponding to the child remote controller. Therefore, in this case, the screen can be controlled by the master remote controller.

In addition, the sound of a person who operates a specific child remote controller can be auditioned with headphones.
The relationship between the master remote controller and the child remote controller at this time is such that the upper master remote controller of the plurality of child remote controllers can always control the screen.

  Needless to say, the present invention is not limited to the above-described embodiment, and can be appropriately changed without departing from the gist of the present invention.

It is a flowchart which shows the screen division | segmentation process by one embodiment of this invention. FIG. 2A is a diagram showing a division calculation method when the aspect ratio is kept constant, FIG. 2A is an HD broadcast screen, FIG. 2B is a case of 9a / 16> b (the side is longer), and FIG. 2C is another case ( The vertical one is longer). FIG. 3A is a diagram showing a division calculation method when the aspect ratio is kept constant, FIG. 3A is an HD broadcast screen, FIG. 3B is a case where 9 (Xa) / 16> b (the horizontal direction is longer), and FIG. Is the other case (longitudinal is longer). FIG. 4A is a diagram showing a division calculation method when the aspect ratio is kept constant, FIG. 4A is an HD broadcast screen, FIG. 4B is a case of 9a / 16> (Yb) (horizontal is longer), and FIG. The other case (longitudinal is longer). FIG. 5A is a diagram showing a division calculation method when the aspect ratio is kept constant, FIG. 5A is an HD broadcast screen, and FIG. 5B is a case of 9 (Xa) / 16> (Yb) (the horizontal is longer). ), FIG. 5C is the other case (longitudinal is longer). It is a figure which shows the division | segmentation calculation method when an aspect ratio is not kept constant. It is a block diagram which shows the system configuration | structure of the program simultaneous viewing-and-listening system by one embodiment of this invention. It is a block diagram of each processing unit during normal viewing. It is a block diagram which shows the system structure of a screen division | segmentation. It is a figure which shows the cursor position in the case of displaying a cursor in the middle of an image. It is a flowchart which shows a screen coupling | bonding process. FIG. 12A is a diagram showing a coupling calculation method when the aspect ratio is kept constant. FIG. 12A shows a case where the aspect ratio is kept within a displayable frame, and FIG. FIGS. 13A and 13B are diagrams illustrating a joint calculation method in a case where the aspect ratio is kept constant (contained in a frame that can be displayed). FIG. 13A shows a case in which the aspect ratio is horizontally adjacent, and FIG. FIG. 14A is a diagram illustrating a joint calculation method when the aspect ratio is kept constant (contains in a displayable frame—adjacent to the side), and FIG. 14A illustrates a case where Y1 <Y3, Y2 <Y4, and Y2 <Y3 (region of G1) FIG. 14B shows a case where Y1> Y3 and Y2 <Y4 and Y2> Y1 (G2 region). FIG. 15A is a diagram showing a joint calculation method when the aspect ratio is kept constant (contains in a displayable frame—adjacent to the side), and FIG. 15A shows a case where Y1 <Y3 and Y2> Y4 and Y4> Y3 (region of G3) FIG. 15B shows a case where Y1> Y3, Y2> Y4, and Y1> Y4 (G4 region). FIGS. 16A and 16B are diagrams illustrating a joint calculation method in a case where the aspect ratio is kept constant (priority is given to a larger one without being placed in a displayable frame). FIG. 16A shows a case where the sides are adjacent to each other, and FIG. is there. It is a figure which shows the joint calculation method in the case of keeping an aspect ratio constant (it does not fit in the frame which can be displayed, and gives priority to the larger one-it adjoins horizontally). It is a figure which shows the joint calculation method in the case of keeping an aspect ratio constant (it does not fit in the frame which can be displayed, and gives priority to the larger one-it adjoins horizontally). It is a figure which shows the connection calculation method in the case of keeping an aspect ratio constant. It is a figure which shows the coupling | bonding calculation method when an aspect ratio is not kept constant, FIG. 20A is a case where it adjoins horizontally, FIG. 20B is a case where it adjoins vertically. It is a block diagram which shows the system configuration | structure of a screen coupling | bonding. It is a flowchart which shows a screen size change (automatic: volume ratio) process. It is a figure which shows the volume and the ratio calculation method of a screen. It is a figure which shows the example which applied the volume and the screen ratio calculation method with respect to the divided screen. It is a figure which shows the calculation method of screen size. It is a block diagram which shows the system configuration | structure of a screen size change. It is a block diagram of each process part of a screen size change. It is a flowchart which shows a screen size change (automatic: number of small screens) process. It is a figure which shows the calculation method of the number of subscreens. It is a flowchart which shows a screen size change (automatic: channel number) process. It is a figure which shows the ratio from the number of channels. It is a figure which shows the size change method in the case of combining and changing when the screen of the same channel is adjacent for every child screen. It is a block diagram which shows the other system structure of a screen size change. It is a flowchart which shows a screen size change (automatic: image feature-value) process. It is a flowchart which shows a screen size change (automatic: broadcast content) process. It is a flowchart which shows a screen expansion process. It is a block diagram which shows the system configuration | structure of an enlarged display. It is a block diagram of each process part of an enlarged display. It is a figure which shows the size when an enlargement ratio is changed.

Explanation of symbols

  E1 to E4 ... split screen, 11 ... input signal, 12 ... each processing unit, 13 ... remote control, 14 ... remote control light receiving unit, 15 ... remote control signal analysis unit, 16 ... screen number management unit, 17 ... memory, 18 ... screen integration , 19 ... Output signal, 20 ... Remote control ID screen compatible signal, 21 ... Position signal, 22 ... Tuner, 23 ... Size change processing unit, 24 ... Remote control analysis signal, 25 ... Channel signal, 26 ... Size signal, 31 ... Screen Selection management unit, 32 ... Image frame calculation unit, 33 ... Cursor position calculation unit, 34 ... Screen size calculation unit, 35 ... Image frame and cursor generation unit, 41 ... Number of selected child screen, 42 ... Selected The size of the child screen, 43 ... the position of the cursor and the position / size of the child screen, 44 ... the number / position / size of the new child screen after the division, F1-F4, G1-G9 ... the combined screen, 36 ... next to the screen Determining section 51 ... Number of selected sub-screen / number of selected 52 ... Position / size of selected screen 53 ... According to position / size / number of selected sub-screen 54 ... Selected screen position / size, 55 ... Position / size of new child screen after combination, 61 ... Signal for acquiring feature quantity (video / audio), 62 ... Screen size before and after change 63 ... feature amount (volume, number of sub-screens, screen feature amount, broadcast content), 111 ... signal (channel) for acquiring feature amount, 112 ... screen size and position before and after change, 113 ... feature amount (Number of channels), 38 ... enlargement size calculation unit, 121 ... the number of the selected child screen, 122 ... the size of the selected child screen, 123 ... the position of the cursor and the position / size and enlargement ratio of the child screen, 124 ... Zoom center position And expansion rate and the screen position and size

Claims (20)

A plurality of viewers can simultaneously view a plurality of programs by simultaneously displaying a plurality of screens of a plurality of programs received via a plurality of receiving units on the display unit and outputting sound to the audio output unit. In the simultaneous program viewing system that can
A plurality of input means for inputting a selection of any one of the plurality of screens and a display processing operation on the selected screen;
Based on the selection operation of the screen from the input means, the operation of the display processing of the screen, and the display state of the screen in the display unit, changing means for changing the display area of the screen in the display unit;
With
A program simultaneous viewing system characterized in that a screen whose display area has been changed by the changing means is displayed on the display unit together with other screens. In the program simultaneous viewing system according to claim 1,
The screen display processing operation from the input means is a screen division processing operation,
When the change of the display area of the screen in the display unit by the changing means is a division of the display area of the screen,
A program simultaneous viewing system, wherein the screen is divided so that the aspect ratio of the screen divided by the changing means and the screen displayed on the display unit before division is kept constant. The program simultaneous viewing system according to claim 2,
When the width of the screen in which the display area is divided by the changing unit is long with respect to the aspect ratio of the screen displayed on the display unit before the division, the divided screen so as to keep the aspect ratio constant. Change the left and right ends of
When the divided screen is long, both the upper and lower ends of the divided screen are changed so as to keep the aspect ratio constant. In the program simultaneous viewing system according to claim 3,
The program simultaneous viewing system characterized in that the change of the left and right ends of the divided screen or the change of the upper and lower ends is performed based on an operation of designating the center of the screen to be divided from the input means. In the program simultaneous viewing system according to claim 1,
The screen display processing operation from the input means is a screen combining processing operation,
When the change of the display area of the screen in the display unit by the changing means is a combination of the display areas of the screen,
A program simultaneous viewing system, characterized in that the screen is divided so that the aspect ratio of the screen combined with the display area by the changing means and the screen displayed on the display unit before combining is kept constant. The program simultaneous viewing system according to claim 5,
The aspect ratio of the screen displayed on the display unit before combining is when the side of the screen combined with the display area by the changing unit is long, and any of the screens displayed on the display unit before combining is displayed. When fit within the display area of the screen, change the left and right ends of the combined screen to keep the aspect ratio constant,
When the combined screen is long in length and fits within the display area of any screen displayed on the display unit before the combination, the combination is performed so as to keep the aspect ratio constant. A program simultaneous viewing system characterized by changing the upper and lower ends of the screen. The program simultaneous viewing system according to claim 5,
Either of the screens displayed on the display unit before combining, when the width of the screen combined with the display area by the changing means is long with respect to the aspect ratio of the screen displayed on the display unit before combining. When the image is not within the display area of the screen, the combination is performed so as to keep the aspect ratio constant, giving priority to the display area of the larger screen displayed on the display unit before the combination. Change the left and right ends of the
If the combined screen is long and does not fit within the display area of any screen displayed on the display unit before combining, the larger one displayed on the display unit before combining A simultaneous program viewing system characterized in that the upper and lower ends of the combined screens are changed so as to keep the aspect ratio constant by giving priority to being within the display area of the screen. In the program simultaneous viewing system according to claim 7,
The display unit before combining when the side of the screen combined with the display area by the changing means is long and does not fit within the display area of any screen displayed on the display unit before combining. The display size of the upper and lower parts that do not fit in the display area of the combined smaller screen is changed to match the display area of the larger vertical screen displayed in
When the combined screen is long and does not fit within the display area of any screen displayed on the display unit before combining, the horizontal displayed on the display unit before combining is displayed. The program simultaneous viewing system characterized by changing the display size of the left and right portions that cannot be accommodated in the display area of the combined smaller screen in accordance with the display area of the larger screen. In the program simultaneous viewing system according to claim 1,
The image display processing operation from the input means is a screen display size change processing operation,
When the change of the display area of the screen in the display unit by the changing means is a change of the display size of the display area of the screen,
The simultaneous viewing system for a program, wherein the display size of the screen on the display unit is changed by the changing unit based on a feature amount of each screen. The program simultaneous viewing system according to claim 9,
The feature amount of each screen is a volume ratio for each screen when outputting sound to the sound output unit, and the display size of the screen is changed according to the volume ratio. To watch programs simultaneously. The program simultaneous viewing system according to claim 9,
The feature amount of each screen is the number of child screens for each screen hierarchy in the display unit, and the size of the screen display size is changed in accordance with the size of the child screens. Viewing system. The program simultaneous viewing system according to claim 9,
The feature amount of each screen is the number of channels of the sub screen of the screen in the display unit, and the size of the screen display size is changed corresponding to the number of the same number of channels. system. In the program simultaneous viewing system according to claim 12,
When the screens having the same number of channels are adjacent to each other, the adjacent screens are combined to change the size of the screen display size. The program simultaneous viewing system according to claim 9,
The feature amount of each screen is the feature amount of the display image of the screen in the display unit, and the display size of the screen is changed in accordance with the feature amount of the display image. Simultaneous viewing system. The program simultaneous viewing system according to claim 9,
The feature amount of each screen is a telop synthesized and displayed on the screen in the display unit, and the display size of the screen is changed according to the length of the telop. In the program simultaneous viewing system according to claim 1,
The image display processing operation from the input means is a screen enlargement processing operation,
When the change of the display area of the screen in the display unit by the changing means is an enlargement of the display area of the screen,
The program simultaneous viewing system, wherein the display area is enlarged by the changing means based on an operation of enlargement processing of the screen. In the program simultaneous viewing system according to claim 16,
The program simultaneous viewing system characterized in that the operation of the enlargement processing of the screen includes an enlargement ratio and an enlargement center position. In the program simultaneous viewing system according to claim 1,
The plurality of input means are remote controllers for the change means for controlling a display unit and a sound output section on the main body side, and the plurality of input means are controlled by the change means based on operation inputs from the plurality of input means. A program simultaneous viewing system characterized in that a relative position with respect to a display unit on the main body side is obtained, and a position where a sound image for performing an image display processing operation is controlled at the obtained relative position. A plurality of viewers can simultaneously view a plurality of programs by simultaneously displaying a plurality of screens of a plurality of programs received via a plurality of receiving units on the display unit and outputting sound to the audio output unit. In the simultaneous program viewing method that can be
A plurality of input steps for inputting a selection of any one of the plurality of screens and a display processing operation on the selected screen;
Based on the screen selection operation from the input step, the screen display processing operation, and the display state of the screen in the display unit, a change step for changing the display area of the screen in the display unit;
Including
A program simultaneous viewing method characterized in that a screen whose display area has been changed by the changing step is displayed on the display unit together with other screens. A plurality of viewers can simultaneously view a plurality of programs by simultaneously displaying a plurality of screens of a plurality of programs received via a plurality of receiving units on the display unit and outputting sound to the audio output unit. A program simultaneous viewing program executed in a computer of a program simultaneous viewing system capable of:
In the computer,
A function of performing a plurality of inputs for selecting any one of the plurality of screens and inputting a display processing operation on the selected screen;
A function of changing the display area of the screen in the display unit based on the selection operation of the screen, the operation of the display process of the screen, and the display state of the screen in the display unit;
A function for displaying the display area on the display unit together with other screens;
A program for simultaneously viewing programs characterized by realizing the above.

Images