JP4720321B2 - Information processing apparatus and method, and program - Google Patents

Description

  The present invention relates to an information processing apparatus, method, and program, and in particular, is configured by dividing all effective display areas of a display screen when each of a plurality of contents is displayed on a plurality of divided screens constituting the display screen. The present invention relates to an information processing device and method, and a program that can provide a user-friendly and comfortable display by changing the size of a plurality of divided screens according to the presentation priority of content. .

  Conventionally, in a television receiver, when only one content can be displayed, when confirming the content of a desired channel, it is necessary to make a round of all the channels, which is not immediate. , The contents of each channel may change during channel operation.

  On the other hand, in order to allow the user to efficiently confirm the content of the desired channel, the content of the plurality of channels is displayed in, for example, a two-screen split display, a four-screen split display, or the multiple-screen split display shown in FIG. For example, there is a television receiver in which a screen is divided and displayed in a fixed form.

  In the example of FIG. 1, display screens 1 to 4 are shown as examples of the standard multi-screen split display.

  The display screen 1 is composed of screens 1-1 to 1-9 each having a size equal to one of the display screen 1 divided into nine equal parts. The display screen 2 is composed of screens 2-1 to 2-16 each having a size corresponding to one of the display screen 2 divided into 16 equal parts. The display screen 3 includes a main screen 3-1 having a size corresponding to four of the display screens 3 divided into nine and sub-screens 3-2 to 3-6 each having a size of one. ing. The display screen 4 has a main screen 4-1 having a size corresponding to four of the display screens 4 equally divided into 16 and a size corresponding to one each arranged so as to surround the main screen 4-1. Sub-screens 4-2 to 4-13.

  That is, in the equally divided display screens 1 and 2 such as 9 divisions and 16 divisions, for example, display channels 3 and 4 can be combined with a plurality of divided division screens, for example, any channel. The content was displayed in parallel to emphasize the content.

  As another example of the multiple screen split display, in a video conference system or a communication device that performs video chat with a plurality of communication partners, as shown in FIG. In addition, there is also a method in which the arrangement method is displayed on each divided screen set in advance according to the usage (see Non-Patent Document 1).

  In the example of FIG. 2, display screens 11 to 14 are shown as examples of a multi-screen split display having a size and an arrangement so that a communication partner's video can be easily recognized.

  The display screen 11 includes a medium size screen 11-1 arranged at the center and three small size screens 11-2 to 11-4 arranged side by side at the bottom of the screen 11-1. The display screen 12 is a medium-sized screen 12-1 to 12-3 arranged like a three-way mirror, and a small-sized screen 12-4 arranged in the lower center of the screen 12-1 to 12-3. It is configured.

  The display screen 13 includes a medium size screen 13-1 arranged at the center and screens 13-2 to 13-7 arranged vertically on the left and right sides of the screen 13-1. The display screen 14 includes a screen 14-1 displayed on the entire screen, and small-sized screens 14-2 to 14-7 that are arranged so as to overlap the left and right ends on the screen 14-1. .

  That is, the screens configured in these display screens 11 to 14 are set in advance in size and arrangement according to usage.

“IChat AV”, Monthly Mac Power, ASCII Inc., issued June 1, 2005, June issue, p.84

  As described above, conventionally, there has been a method for displaying contents of a plurality of channels at a time in a television receiver, a communication device, or the like.

  However, in the display screens 1 to 4 in FIG. 1, since the divided screens for displaying the contents of each channel are divided in a fixed pattern, this does not apply to the case where the number of channels is arbitrarily changed or the fixed divided pattern. In some cases, optimal display could not be performed.

  For example, even if the user requests a strong display request for a predetermined channel among a plurality of channels, since the ratio of each divided screen is fixed, the display of various users is displayed in the plurality of channels. It has been difficult to provide a display corresponding to the request, that is, an easy-to-see and comfortable display for the user.

  In addition, in the display screens 11 to 14 in FIG. 2, the size and arrangement of each divided screen adjusted according to the intended use are set in advance. Therefore, even in these cases, it is difficult to cope with an arbitrary number of channels and to change the size of each channel individually. Therefore, it is difficult to provide a user with an easy-to-see and comfortable display.

  Further, in the case of the display screen 12 of FIG. 2, since a sense of depth is obtained by arranging like a three-sided mirror, a wasteful area where nothing is displayed is generated in the effective display area of the display screen 12. I was sorry.

  The present invention has been made in view of such a situation, and when displaying a plurality of contents, by efficiently using an effective display area and performing display according to the presentation priority for each content, It is an object to provide a user with an easy-to-see and comfortable display.

An information processing apparatus according to an aspect of the present invention calculates presentation priorities of a plurality of contents respectively displayed on a plurality of divided screens that configure the display screen without gaps based on request information according to a user operation. A priority calculation unit, a presentation information setting unit that sets the sizes of the plurality of divided screens according to the presentation priority of the plurality of contents calculated by the priority calculation unit, and the presentation information setting unit. In accordance with the divided screen with the size set, video adjusting means for adjusting the video data of the content displayed on the divided screen, and superimposing the video data of the plurality of contents adjusted by the video adjusting means, a video superimposing means for outputting an image data corresponding to the display screen, the position of the split screen size is set by the recommendation setting means, the divided picture As hear sound of the content to be displayed on an information processing apparatus and an audio adjustment unit for adjusting the audio data of the content to be displayed on the split screen.

  In the information processing apparatus according to one aspect of the present invention, when the size set by the presentation information setting unit is changed, the position is changed from the position of the divided screen of the size before the change to the position of the divided screen of the size after the change. One end of the divided screen frame can be moved to the position of the divided screen of the changed size later than the other end so as to fly in the direction opposite to the moving direction. .

  In the information processing apparatus according to the aspect of the present invention, the presentation setting unit further sets specific information for allowing the user to specify the content of the content to be displayed on the divided screen, and the video adjustment unit includes: Furthermore, the video data corresponding to the specific information set by the presentation setting means can be superimposed on the video data of the content.

In the information processing apparatus according to one aspect of the present invention, the presentation information setting unit uniquely determines the sizes of the plurality of divided screens according to the presentation priority of the plurality of contents calculated by the priority calculation unit. The size of each of the plurality of divided screens can be set by changing the value for setting to .

  In the information processing apparatus according to one aspect of the present invention, the priority calculation unit can calculate the presentation priority of the plurality of contents based on metadata included in the plurality of contents.

  The information processing apparatus according to one aspect of the present invention can further include a content receiving unit that receives content of a communication partner from another information processing apparatus that communicates with each other via a network. In this case, the plurality of contents include the content of the communication partner received by the content receiving means, and the metadata includes a request based on the operation of the communication partner as metadata of the content of the communication partner. Contains information.

  The information processing apparatus according to one aspect of the present invention can further include signal receiving means for receiving a broadcast signal. In this case, the plurality of contents include contents corresponding to the broadcast signal received by the signal receiving means.

  The information processing apparatus according to one aspect of the present invention can further include content acquisition means for acquiring content from an information providing apparatus connected to a network. In this case, the plurality of contents include contents acquired by the contents acquisition unit.

An information processing method or program according to an aspect of the present invention provides a presentation priority of a plurality of contents respectively displayed on a plurality of divided screens that configure the display screen without a gap based on request information according to a user operation. A priority calculation step of calculating the plurality of divided screens according to the presentation priority of the plurality of contents calculated by the processing of the priority calculation step, A video adjustment step for adjusting video data of content displayed on the divided screen according to the divided screen whose size is set by the processing of the presentation information setting step, and a plurality of contents adjusted by the processing of the video adjustment step by superimposing the video data, a video superimposing step of outputting image data corresponding to the display screen, the Hisage From the processing position of the dividing screen size is set by the setting step, the as audio content to be displayed on the split screen can be heard, and a sound adjusting step of adjusting the audio data of the content to be displayed on the divided screen An information processing method or a program for causing a computer to perform processing .

In one aspect of the present invention, based on request information according to a user operation, presentation priorities of a plurality of contents respectively displayed on a plurality of divided screens that configure the display screen without gaps are calculated and calculated. The sizes of the plurality of divided screens are respectively set according to the presentation priority of the plurality of contents. Then, the video data of the content displayed on the divided screen is adjusted according to the divided screen with the size set, and the video data corresponding to the display screen is superimposed on the adjusted video data of the plurality of contents. There is output from the position of the split screen size is set such that said audio contents to be displayed on the split screen can be heard, the adjustment of the audio data of the content to be displayed on the split screen Ru performed.

  The network is a mechanism in which at least two devices are connected and information can be transmitted from one device to another device. Devices that communicate via a network may be independent devices, or may be internal blocks that constitute one device.

  The communication is not only wireless communication and wired communication, but also communication in which wireless communication and wired communication are mixed, that is, wireless communication is performed in one section and wired communication is performed in another section. May be. Further, communication from one device to another device may be performed by wired communication, and communication from another device to one device may be performed by wireless communication.

  According to one aspect of the present invention, it is possible to provide an easy-to-see and comfortable display to a user by efficiently using an effective display area.

  Embodiments of the present invention will be described below. Correspondences between the configuration requirements of the present invention and the embodiments described in the detailed description of the present invention are exemplified as follows. This description is to confirm that the embodiments supporting the present invention are described in the detailed description of the invention. Accordingly, although there are embodiments that are described in the detailed description of the invention but are not described here as embodiments corresponding to the constituent elements of the present invention, It does not mean that the embodiment does not correspond to the configuration requirements. Conversely, even if an embodiment is described here as corresponding to a configuration requirement, that means that the embodiment does not correspond to a configuration requirement other than the configuration requirement. It's not something to do.

An information processing apparatus according to an aspect of the present invention is an information processing apparatus (for example, the content presentation control apparatus 31-1) that performs processing for displaying a plurality of contents on a display screen (for example, the display screen 201 in FIG. 4). A plurality of divided screens (for example, the divided screens 211-1 to 211 -N in FIG. 7) that configure the display screen without gaps based on the request information according to the user operation. ) A priority calculation unit (for example, the presentation priority calculation unit 102 in FIG. 4) that calculates the presentation priority of the plurality of contents displayed respectively, and the presentation of the plurality of contents calculated by the priority calculation unit. A presentation information setting unit (for example, the presentation balance setting unit 103 in FIG. 4) that sets the sizes of the plurality of divided screens according to the priority, and the presentation information setting unit According to the divided screen whose size is set by the video adjusting unit (for example, the video adjusting unit 121-1 in FIG. 5) for adjusting the video data of the content displayed on the divided screen, the video adjusting unit adjusts the video data. The size is set by the video superimposing means (for example, the video mixer unit 56 in FIG. 3) that superimposes the video data of the plurality of contents and outputs the video data corresponding to the display screen, and the presentation setting means. Audio adjustment means (for example, audio adjustment unit 122-1 in FIG. 5) that adjusts audio data of the content displayed on the divided screen so that the audio of the content displayed on the divided screen can be heard from the position of the divided screen. an information processing apparatus including and.

  In the information processing apparatus according to one aspect of the present invention, when the size set by the presentation information setting unit is changed, the divided screen before the change (for example, the divided screen 211-3 in the display state SS1 in FIG. 9). The divided screen (for example, the divided screen 211 in the display state SS2 in FIG. 9) while moving to the position of the divided screen of the size after the change (for example, the divided screen 211-3 in the display state SS3 in FIG. 9). -3) One end of the frame moves to the position of the divided screen of the changed size with a delay from the other end so as to fly in the direction opposite to the moving direction.

  In the information processing apparatus according to the aspect of the present invention, the presentation setting unit further sets specific information for allowing the user to specify the content of the content to be displayed on the divided screen, and the video adjustment unit includes: Furthermore, video data corresponding to the specific information set by the presentation setting means (for example, video data of the OSD video t1 in FIG. 7) can be superimposed on the video data of the content.

  The information processing apparatus according to one aspect of the present invention is connected to a communication partner from another information processing apparatus (for example, the content presentation control apparatus 31-2) that communicates with each other via a network (for example, the network 32 in FIG. 3). The content receiving means (for example, the communication unit 73 in FIG. 3) for receiving the content can be further provided. In this case, the plurality of contents include the content of the communication partner received by the content receiving means, and the metadata includes a request based on the operation of the communication partner as metadata of the content of the communication partner. Contains information.

  The information processing apparatus according to one aspect of the present invention can further include signal receiving means (for example, the tuner 51 in FIG. 3) that receives a broadcast signal. In this case, the plurality of contents include contents corresponding to the broadcast signal received by the signal receiving means.

  An information processing apparatus according to an aspect of the present invention includes a content acquisition unit (for example, a content acquisition unit (for example, a provision server 33 in FIG. 3)) connected to a network (for example, the network 32 in FIG. 3). A content acquisition unit 71) can be further provided. In this case, the plurality of contents include contents acquired by the contents acquisition unit.

An information processing method or program according to one aspect of the present invention causes a computer to perform an information processing method of an information processing apparatus that performs processing for displaying a plurality of contents on a display screen, or processing for displaying a plurality of contents on a display screen. In the program, on the basis of request information according to the user's operation, a priority calculation step for calculating presentation priorities of a plurality of contents respectively displayed on a plurality of divided screens that constitute the display screen without gaps (for example, FIG. 15 step S15) and a presentation information setting step for setting the sizes of the plurality of divided screens according to the presentation priority of the plurality of contents calculated by the processing of the priority calculation step (for example, FIG. 15). Step S18), and a split screen whose size is set by the processing of the presentation information setting step Accordingly, a video adjustment step (for example, steps S31 to S34 in FIG. 17) for adjusting the video data of the content displayed on the divided screen, and the video data of the plurality of contents adjusted by the processing of the video adjustment step. From the position of the divided screen whose size has been set by the process of the video superimposing step (for example, step S35 in FIG. 17) for superimposing and outputting the video data corresponding to the display screen, and the process of the presentation setting step, The computer performs an information processing method or process including an audio adjustment step (for example, step S53 in FIG. 18) for adjusting the audio data of the content displayed on the divided screen so that the audio of the content displayed on the screen can be heard. It is a program to make .

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 3 shows a configuration example of an information processing system to which the present invention is applied.

  In the example of FIG. 3, the content presentation control device 31-1 operated by the user A and the content presentation control device 31-2 operated by the user B are connected to a network 32 represented by the Internet.

  Hereinafter, the content presentation control devices 31-1 and 31-2 are also collectively referred to as the content presentation control device 31 when it is not necessary to distinguish them individually. In this example, only two content presentation control devices 31 are shown, but an arbitrary number of content presentation control devices 31 are connected to the network 32.

  The network 32 is not limited to a wired line but may be configured wirelessly. The network 32 is also connected with a distribution server 33 that provides content video (still image, moving image) data, audio data, and the like to the accessed content presentation control device 31. Any number of distribution servers 33 are also connected to the network 32. Hereinafter, video data and audio data are collectively referred to as content data.

  Furthermore, this information processing system includes a terrestrial broadcasting station 34 that broadcasts content by digital terrestrial waves, and a BS (Broadcasting Satellite) digital broadcasting (communication) satellite 35, and content of the content by BS digital satellite broadcasting waves. A satellite broadcasting station (not shown) for broadcasting is configured.

  The content presentation control device 31-1 receives content from the content presentation control device 31 (the content presentation control device 31-2 in the example of FIG. 3) or the distribution server 33 via the network 32, Acquire content included in broadcast signals received from the terrestrial broadcasting station 34 or the BS digital broadcast satellite 35, or read out the stored content and use those content as channels for all effective display areas on the display screen. Are respectively displayed in a plurality of display areas (hereinafter referred to as divided screens). That is, all effective display areas of the display screen are configured with a plurality of divided screens without any gaps.

  At this time, the content presentation control device 31-1 changes the size of the divided screen that displays the content of each channel according to the presentation priority of the plurality of channels, and the content corresponding to the divided screen of the changed size. Are displayed respectively.

  Here, the channel in the example of FIG. 3 represents the content to be displayed. For example, content received from the distribution server 33 via the network 32 (hereinafter referred to as distribution content), terrestrial broadcast station 34, BS Content (hereinafter referred to as broadcast content) included in the broadcast signal received from the digital broadcast (communication) satellite 35, content received from the content presentation control device 31-2 of the communication partner via the network 32 (hereinafter referred to as communication) Depending on the user's operation from the content of the other party), content such as stored still images, moving images, games (hereinafter referred to as stored content), real-time content input from the video / audio input unit 64, etc. Selected.

  Note that content acquired from another device (not shown) connected to the network 32 (for example, a recording / recording device), a still image recorded on a package medium (recording medium) attached to a drive (not shown), Content such as moving images and games can also be selected.

  The content presentation control device 31-1 includes a tuner 51, a channel data supply unit 53, a presentation balance control unit 54, a presentation balance adjustment unit 55, a video mixer unit 56, an audio mixer unit 57, an input / output interface 58, and a user information input unit 61. , A video output unit 62, an audio output unit 63, and a video / audio input unit 64.

  The channel data supply unit 53, the presentation balance control unit 54, the video mixer unit 56, and the audio mixer unit 57 include a user information input unit 61 and a video output unit that are appropriately attached to the input / output interface 58 via the input / output interface 58. 62, an audio output unit 63, and a video / audio input unit 64.

  The tuner 51 receives a broadcast signal from the terrestrial broadcast station 34 or the BS digital broadcast satellite 35 via the antenna 52, and outputs the broadcast signal selected from the broadcast signal to the content acquisition unit 71 of the channel data supply unit 53. To do. Note that the tuner 51 includes a plurality of tuners, and can simultaneously receive broadcast signals from a plurality of stations. The tuner 51 may be configured to receive not only digital terrestrial waves and BS digital broadcast waves, but also analog terrestrial waves and CS (Communication Satellite) digital broadcast waves.

  The channel data supply unit 53 includes a content acquisition unit 71, a content storage unit 72, and a communication unit 73. Under the control of the presentation balance control unit 54, content data (videos) of a plurality of contents desired by the user. Data, audio data) is supplied to the presentation balance adjustment unit 55 as data of a predetermined channel. Further, the channel data supply unit 53 supplies corresponding content metadata to the presentation balance control unit 54 as metadata of a predetermined channel.

  The content acquisition unit 71 acquires content data of the broadcast content included in the broadcast signal from the tuner 51 and metadata (for example, EPG (Electronic Program Guide) information, etc.) regarding the content of the broadcast content. Further, the content acquisition unit 71 acquires the content data of the distribution content and the metadata of the distribution content from the distribution server 33 via the network 32.

  The content acquisition unit 71 outputs the acquired broadcast content and content data of the distribution content as data of a predetermined channel to the presentation balance adjustment unit 55, respectively, and metadata corresponding to the acquired broadcast content and the distribution content, The metadata is supplied to the presentation balance control unit 54 as metadata of a predetermined channel. These content data and metadata are stored in the content storage unit 72 as necessary.

  In the content storage unit 72, content data of broadcast or distribution content and its metadata are recorded by the content acquisition unit 71, or content data received from the other content presentation control device 31-2 by the communication unit 73 and The metadata is recorded, or the content data composed of the video and audio of the user A input from the video / audio input unit 64 and the metadata thereof are recorded, so that music, still images, videos, Content data of stored content such as games and its metadata are stored.

  The content storage unit 72 reads the content data of the accumulated content desired by the user, supplies it to the presentation balance adjustment unit 55 as data of a predetermined channel, reads the metadata corresponding to the content, and stores the metadata of the predetermined channel Is supplied to the presentation balance control unit 54.

  The communication unit 73 communicates with another content presentation control device 31 (for example, the content presentation control device 31-2) via the network 32, and the content data of the communication partner content from the other content presentation control device 31. And the content data of the communication partner is supplied to the presentation balance adjusting unit 55 as data of a predetermined channel, and the metadata corresponding to the content is presented as metadata of the predetermined channel This is supplied to the balance control unit 54.

  In the content metadata of the communication partner, for example, a communication partner (for example, a degree of viewing request for a channel displaying the content of the user A, which is input to the content presentation control device 31-2 in response to the operation of the user B (for example, User B) request information is also included.

  In addition, the communication unit 73 provides the content presentation control device 31-2 connected to the network 32 as the content data of the user A input from the video / audio input unit 64 and the presentation balance control unit 54 as metadata thereof. The request information of the user (user A) for the channel for displaying the content of user B is transmitted.

  Note that the number of communication partners is not limited to one, and the communication unit 73 can communicate with a plurality of other content presentation control devices 31 connected to the network 32 and display the contents of a plurality of communication partners.

  Content selection information, which is information for selecting content to be displayed as a channel, is input to the presentation balance control unit 54 from the user information input unit 61 based on the operation of the user A.

  Based on the content selection information, the presentation balance control unit 54 controls each unit of the channel data supply unit 53 to acquire content data (video data, audio data) and metadata of the user's desired content, and the user's desired content. The content balance data is supplied to the presentation balance adjustment unit 55 as data of a predetermined channel, and the metadata of the content desired by the user is supplied to the presentation balance control unit 54 as metadata of the predetermined channel.

  The presentation balance control unit 54 receives user request information indicating the degree of viewing request for a predetermined channel based on the operation of the user A from the user information input unit 61, and the content acquisition unit 71, content storage unit 72 and metadata of each content are input from the communication unit 73 and the like.

  The presentation balance control unit 54 acquires user request information based on the operation of the user A and metadata of each content, and sets presentation priorities of a plurality of channels based on the acquired user request information and metadata, respectively. Depending on the calculated presentation priority, the size of the split screen of each channel, the position of the split screen on the display screen, the position of the content displayed on the split screen, transparency, magnification, corresponding audio volume, sound quality, etc. Then, control information for controlling the presentation balance adjustment unit 55 is set, and the set control information is supplied to the presentation balance adjustment unit 55.

  The presentation balance control unit 54 supplies the user request information to the communication unit 73 when the user request information for the channel for displaying the content of the communication partner is input.

  The presentation balance adjusting unit 55 includes video data of a plurality of channels (channel (ch) 1 to channel (ch) N in the example of FIG. 3) from the content acquisition unit 71, the content storage unit 72, the communication unit 73, and the like. And voice data are input. The presentation balance adjustment unit 55 adjusts the input video data and audio data of the plurality of channels according to the control information supplied from the presentation balance control unit 54, and outputs the adjusted video data to the video mixer unit 56. Then, the adjusted audio data is output to the audio mixer unit 57.

  In the example of FIG. 3, although not shown, video data and audio data of real-time content input from the video / audio input unit 64 may also be directly input, adjusted, and output as channel data.

  The video mixer unit 56 superimposes the adjusted video data of the plurality of channels, and causes the video output unit 62 to display a display screen constituted by the divided screens of the plurality of channels via the input / output interface 58. The audio mixer unit 57 synthesizes the audio data of the adjusted plurality of channels, and outputs audio composed of audio of at least one channel from the audio output unit 63 via the input / output interface 58.

  The user information input unit 61 includes, for example, a remote controller, a mouse, or a touch panel, and supplies an operation signal corresponding to a user operation to the presentation balance control unit 54 via the input / output interface 58.

  Specifically, the user operates the user information input unit 61 to select content to be displayed as a channel from among broadcast content, distribution content, communication partner content, and stored content. The user information input unit 61 supplies content selection information to the presentation balance control unit 54 in response to the user operation. The user information input unit 61 supplies user request information for a predetermined channel to the presentation balance control unit 54 in response to a user operation.

  The video output unit 62 is configured by a display device (display) such as an LCD (Liquid Crystal Display) or a PDP (Plasma Display Panel), and the video input from the video mixer unit 56 via the input / output interface 58. A display screen corresponding to the data (that is, a display screen composed of divided screens of a plurality of channels) is displayed.

  The audio output unit 63 includes, for example, a stereo speaker, a headphone stereo, and the like, and outputs audio corresponding to the stereo audio data input from the presentation balance adjustment unit 55 via the input / output interface 58.

  The video / audio input unit 64 is configured with, for example, a video camera and the like, captures the video of the user A, collects the audio around the user A, and converts the video data corresponding to the captured video to the collected audio. Corresponding audio data (that is, user A content data) is output to the content storage unit 72 or the communication unit 73 of the channel data supply unit 53 via the input / output interface 58.

  Note that the configuration example of the content presentation control device 31-2 is the same as the configuration example of the content presentation control device 31-1, and thus the description thereof is omitted.

  The content presentation control device 31 in the example of FIG. 3 includes, for example, a television receiver, a personal computer, a mobile phone, other PDA (Personal Digital Assistant) devices, AV (Audio Visual) devices, household appliances, and the like. CE (Consumer Electronics) equipment can also be used.

  FIG. 4 shows a configuration example of the presentation balance control unit 54 of FIG. In the example of FIG. 4, the communication unit 73 includes a user content receiving unit 91 that receives content data and metadata of a communication partner from another content presentation control device 31 connected to the network 32, and the network 32. It is comprised by the user content transmission part 92 which transmits the content data and its metadata of the user A with respect to the other content presentation control apparatus 31 connected to.

  The presentation balance control unit 54 includes an information acquisition unit 101, a presentation priority calculation unit 102, and a presentation balance setting unit 103.

  The information acquisition unit 101 controls each unit of the channel data supply unit 53 based on the content selection information from the user information input unit 61, and stores content data (video data, audio data) and metadata of a user's desired content. And obtaining the content data of the user-desired content as data of a predetermined channel to the presentation balance adjustment unit 55, and the metadata of the user-desired content as the metadata of the predetermined channel as an information acquisition unit 101.

  The information acquisition unit 101 receives user request information for a predetermined channel input from the user information input unit 61, metadata of broadcast or distribution content input from the content acquisition unit 71 as metadata of each channel, content storage The metadata of the stored content input from the unit 72 and the request information of the communication partner that is the metadata of the communication partner content input from the user content receiving unit 91 are acquired, and the obtained information is calculated as a presentation priority. To the unit 102.

  When the user request information for the channel displaying the content of the communication partner is input, the information acquisition unit 101 transmits the user request information to the user content transmission unit 92 as metadata corresponding to the content of the user A. Supply.

  The presentation priority calculation unit 102 is supplied with at least one of user request information for a predetermined channel and metadata of each channel from the information acquisition unit 101. The presentation priority calculation unit 102 calculates the presentation priority of a plurality of channels based on the request information and metadata supplied from the information acquisition unit 101, and supplies the calculated presentation priority to the presentation balance setting unit 103. To do. At this time, the presentation priority calculation unit 102 calculates the presentation priority by normalizing it according to the number of channels (for example, it is calculated so as to be 100% in total).

  Specifically, the presentation priority calculation unit 102 gives priority to “emergency” and “breaking news” among user preference information such as user A's interest and preference, or words included in the metadata, for example. Priority word information that is word information is stored in advance.

  When only broadcast, distribution, and storage content is selected as the content to be displayed as a channel, the presentation priority calculation unit 102 sets each channel (broadcast, distribution, and storage content) supplied from the information acquisition unit 101. The presentation priority of a plurality of channels is calculated based on the metadata and the stored user preference information or priority word information. When only communication partner content is selected as content to be displayed as a channel, the presentation priority calculation unit 102 requests each communication partner, which is metadata of communication partner content supplied from the information acquisition unit 101. Based on the information, the presentation priority of a plurality of channels is calculated.

  When broadcast, distribution, and stored content and communication partner content are selected as content to be displayed as a channel, the presentation priority calculation unit 102 receives communication partner request information supplied from the information acquisition unit 101. Accordingly, when the request level of the communication partner is high, the presentation priority is calculated so that the channel displaying the communication partner content is higher than each channel displaying the broadcast, distribution, and stored content, and communication is performed. When the request of the other party is low, the presentation priority is calculated so that the channel displaying the communication partner content is lower than the channel displaying the broadcast, distribution, and stored content.

  Note that when the user request information for a predetermined channel is supplied from the information acquisition unit 101, the presentation priority calculation unit 102 receives the user request information regardless of what type of content is displayed as the channel. The presentation priority is calculated so that the presentation priority of the target channel is maximized over the channel on which any other content is displayed.

  The presentation balance setting unit 103 determines the size (ie, area) of the divided screen of each channel, the position of the divided screen on the display screen, and the division according to the presentation priority of the plurality of channels calculated by the presentation priority calculating unit 102. Set the control information for each channel to adjust the video data and audio data of each channel, such as the position of the content to be displayed on the screen, transparency, magnification, corresponding audio volume, sound quality, etc., and control information for each set channel Is supplied to the presentation balance adjustment unit 55.

  In addition, the presentation balance setting unit 103 also displays specific information for displaying in a partial area of the divided screen and allowing the user to specify the contents (contents) of each channel as control information. 55. This specific information is information for the user to specify (understand) the content of the content displayed on the channel, such as a broadcast program channel number, content name, broadcast station name, or communication partner name.

  FIG. 5 shows a configuration example of the presentation balance adjustment unit 55 of FIG.

  In the example of FIG. 5, the presentation balance adjustment unit 55 receives a channel (ch) 1 to a channel (ch) N (N ≧ 1) from any of the content acquisition unit 71, the content storage unit 72, and the communication unit 73. Video data and audio data are respectively input.

  The presentation balance adjustment unit 55 includes presentation balance adjustment units 55-1 to 55-N, and acquires content according to control information of a corresponding channel from the presentation balance control unit 54 (presentation balance setting unit 103). The video data and audio data of each channel input from any of the unit 71, the content storage unit 72, and the communication unit 73 are adjusted.

  In the example of FIG. 5, the presentation balance adjustment units 55-4 to 55-N-1 are basically the same as the presentation balance adjustment units 55-1 to 55-3 and the presentation balance adjustment unit 55-N. Since it is a configuration, its illustration and description are omitted.

  The presentation balance adjustment unit 55-1 adjusts the video data of channel 1 in accordance with the control information of channel 1, and outputs the adjusted video data to the video mixer unit 56. The audio data is adjusted according to the control information of channel 1 and the adjusted audio data is output to the audio mixer unit 57.

  The presentation balance adjustment unit 55-2 adjusts the video data of channel 2 in accordance with the control information of channel 2, and outputs the adjusted video data to the video mixer unit 56. The audio data is adjusted according to the control information of channel 2, and the adjusted audio data is output to the audio mixer unit 57.

  The presentation balance adjustment unit 55-3 adjusts the video data of channel 3 in accordance with the control information of channel 3, and outputs the adjusted video data to the video mixer unit 56. The audio data is adjusted according to the control information of the channel 3 and the adjusted audio data is output to the audio mixer unit 57.

  The presentation balance adjustment unit 55 -N adjusts the video data of the channel N according to the control information of the channel N, and the video adjustment unit 121 -N that outputs the adjusted video data to the video mixer unit 56. The audio data is adjusted according to the control information of channel N, and the adjusted audio data is output to the audio mixer unit 57.

  The video mixer unit 56 superimposes the adjusted video data of N channels from the video adjustment units 121-1 to 121-N, and outputs the superimposed video data via the input / output interface 58 to the video output unit 62. Output to. As a result, the video output unit 62 displays a display screen composed of divided screens of N channels.

  The audio mixer unit 57 synthesizes the adjusted N channels of audio data from the audio adjustment units 122-1 to 122 -N, and the synthesized audio data is input to the audio output unit 63 via the input / output interface 58. Output to. As a result, a sound composed of sound of at least one channel is output from the sound output unit 63.

  In the following description, when there is no need to individually distinguish the video adjustment units 121-1 to 121 -N and the audio adjustment units 122-1 to 122 -N, the video adjustment unit 121 and the audio adjustment unit 122 are simply used. Called.

  FIG. 6 shows a configuration example of the video adjustment unit 121 and the audio adjustment unit 122 of FIG.

  In the example of FIG. 6, from the presentation balance control unit 54 (presentation balance setting unit 103), the size of the divided screen of the target channel, the position of the divided screen on the display screen, the position of the content displayed on the divided screen, transparency, magnification, Specific information or the like is supplied to the video adjustment unit 121 and the audio adjustment unit 122 as control information of the target channel.

  The video adjustment unit 121 includes a transparency adjustment unit 141, a size adjustment unit 142, an OSD (On Screen Display) adjustment unit 143, and a position adjustment unit 144.

  The transparency adjustment unit 141 sets the transparency of the video data of a predetermined channel input from any of the content acquisition unit 71, the content storage unit 72, and the communication unit 73 for the corresponding channel set by the presentation balance setting unit 103. The video data adjusted according to the control information (for example, the transparency of the content displayed on the divided screen) and adjusted in transparency are output to the size adjustment unit 142.

  The size adjustment unit 142 sets the size of the video data from the transparency adjustment unit 141 to control information of the corresponding channel set by the presentation balance setting unit 103 (for example, the size of the divided screen, the center position of the content displayed on the divided screen) The image is scaled or masked to adjust the size of the display target in the video data, and the size-adjusted video data is output to the OSD adjustment unit 143.

  The OSD adjustment unit 143 is a size adjustment unit according to the control information of the corresponding channel set by the presentation balance setting unit 103 (for example, the specific information for specifying the center position of the content displayed on the divided screen and the content). Adjustment for adding OSD video data to the video data from 142 is performed. That is, the OSD adjustment unit 143 generates OSD video data according to the control information of the corresponding channel, adds (superimposes) the generated OSD video data to a predetermined area of the video data from the size adjustment unit 142, and The video data added with the video data is output to the position adjustment unit 144. This superposition ratio (transmittance) can be changed.

  The position adjustment unit 144 corresponds to the control information of the corresponding channel set by the presentation balance setting unit 103 (for example, the size of the divided screen, the position of the divided screen on the display screen, and the position of the content displayed on the divided screen). The presentation (display) position is adjusted by moving the position of the video data from the OSD adjustment unit 143 or applying a mask, and the video data with the presentation position adjusted is output to the video mixer unit 56.

  On the other hand, the audio adjustment unit 122 includes a volume adjustment unit 151, a sound quality adjustment unit 152, and a sound source position adjustment unit 153.

  The volume adjustment unit 151 sets the volume of audio data of a predetermined channel input from any of the content acquisition unit 71, the content storage unit 72, and the communication unit 73 for the corresponding channel set by the presentation balance setting unit 103. The audio data adjusted according to the control information and adjusted in volume is output to the sound quality adjustment unit 152. That is, the volume adjustment unit 151 adjusts the volume so that the volume is set according to the presentation priority by the presentation balance setting unit 103.

  The sound quality adjustment unit 152 adjusts the sound quality of the audio data from the volume adjustment unit 151 according to the control information of the corresponding channel set by the presentation balance setting unit 103, and the sound data whose sound quality has been adjusted is adjusted to the sound source position. Output to the unit 153. That is, the sound quality adjustment unit 152 adjusts the sound quality so that the clarity is set according to the presentation priority by the presentation balance setting unit 103.

  The sound source position adjustment unit 153 determines that the sound source position of the audio data from the sound quality adjustment unit 152 is the position of the divided screen on the display screen as the sound source position according to the control information of the corresponding channel set by the presentation balance setting unit 103. The sound data adjusted so that the sound source position is adjusted is output to the sound source position adjusting unit 153.

  In the example of FIG. 6, processing is performed in the order of transparency adjustment, size adjustment, OSD adjustment, and position adjustment, but the order of video adjustment processing is not limited thereto. Further, the configuration of the output video adjustment unit 121 is not limited to the example of FIG. That is, it may be configured by any one of the transparency adjustment unit 141, the size adjustment unit 142, the OSD adjustment unit 143, and the position adjustment unit 144, and further, other video data such as a blur and a noise filter. Something to be adjusted may be added.

  The same applies to the audio adjustment unit 122, and the order and configuration of the volume adjustment unit 151, the sound quality adjustment unit 152, and the sound source position adjustment unit 153 are not limited.

  Next, the video data and audio data adjustment method of the video adjustment unit 121 and the audio adjustment unit 122 will be described in detail with reference to FIG. Hereinafter, description will be given using the display screen 201 including divided screens 211-1 to 211 -N configured by dividing all effective display areas into N pieces. That is, the display screen (effective display area) 201 is configured by the divided screens (display areas) 211-1 to 211 -N without gaps (so that there is no useless effective display area).

  In the example of FIG. 7, the video corresponding to the video data v1 to vN of the N channels 1 to N and the video data v1 to vN adjusted by the video adjustment unit 121 are adjusted in order from the top. Through the display screen 201 including the divided screens 211-1 through 211-N on which the video corresponding to vN-1 and the video corresponding to the adjusted video data v1-1 through vN-1 are displayed, respectively, and the audio data a1 through aN. The audio corresponding to the adjusted audio data a1-1 to aN-1 adjusted by the audio adjusting unit 122 and the audio corresponding to the audio data a1 to aN of N channels 1 to N are shown.

  In the case of the example in FIG. 7, equal presentation priority is calculated for each of the N channels, and the presentation balance setting unit 103 divides each channel to display according to the equal presentation priority. Other control information (display screen 201) is set so that the sizes (horizontal sizes) of the screens 211-1 to 211-N are set evenly, and video data is optimally presented on each divided screen of the set size. The position of the corresponding split screen and the channel specific information (in this case, the channel number, etc.) are also set and supplied to the corresponding video adjustment unit 121.

  Therefore, the video adjustment unit 121-1 displays the video data v1 corresponding to the channel 1 on the divided screen 211-1 positioned at the left end of the display screen 201 in accordance with the control information from the presentation balance setting unit 103. Make adjustments. For example, the video adjustment unit 121-1 has a video corresponding to the OSD video t <b> 1 indicating the channel number “1” below the area so that the area displayed on the divided screen 211-1 in the video data v <b> 1 is the center. Data is added (superimposed), and after that, in the video data v1, a region other than the region displayed on the divided screen 211-1 is masked to adjust the video data v1, and the adjusted video data v1-1 is Output to the video mixer unit 56.

  Similarly, the video adjustment unit 121-2 displays the video data v2 of channel 2 on the right side of the split screen 211-1 of the display screen 201 in accordance with the control information from the presentation balance setting unit 103. -2 is adjusted for display. For example, the video adjustment unit 121-2 has a video corresponding to the OSD video t2 indicating the channel number “2” at the lower part of the area such that the area displayed on the divided screen 211-2 in the video data v2 is the center. After the data is added, the video data v2 is adjusted by masking the area other than the area displayed on the divided screen 211-2 in the video data v2, and the adjusted video data v2-1 is converted into the video mixer unit. To 56.

  In accordance with the control information from the presentation balance setting unit 103, the video adjustment unit 121-3 transfers the video data v3 of channel 3 to the divided screen 211-3 that is located on the right side of the divided screen 211-2 of the display screen 201. Make adjustments to display. For example, the video adjustment unit 121-3 has a video corresponding to the OSD video t3 indicating the channel number “3” below the area so that the area displayed on the divided screen 211-3 in the video data v3 is the center. After the data is added, in the video data v3, a region other than the region displayed on the divided screen 211-3 is masked to adjust the video data v3, and the adjusted video data v3-1 is converted into the video mixer unit. To 56.

  The video adjustment unit 121 -N performs adjustment for displaying the video data vN of the channel N on the divided screen 211 -N positioned at the right end of the display screen 201 in accordance with the control information from the presentation balance setting unit 103. . For example, the video adjustment unit 121-3 has a video corresponding to the OSD video tN indicating the channel number “N” below the area so that the area displayed on the divided screen 211-N in the video data vN is the center. After the data is added, the video data vN is adjusted by masking the area other than the area displayed on the divided screen 211-N in the video data vN, and the video data vN-1 after adjustment is converted to the video mixer unit 56. Output to.

  The video mixer unit 56 superimposes the video data v1-1 to vN-1 output from the video adjustment units 121-1 to 121-N, and displays the display screen 201 corresponding to the superimposed video data on the video output unit 62. Display.

  As a result, the display screen 201 configured by the divided screens 211-1 to 211 -N having an equal size is displayed on the video output unit 62. In each of the divided screens 211-1 to 211 -N, videos corresponding to the video data v <b> 1-1 to vN- 1 after adjustment of a plurality of channels are displayed.

  Note that, in the divided screens 211-1 to 211 -N of the display screen 201 in FIG. 7, the display of the video data v <b> 1-1 to vN- 1 itself is omitted for convenience of explanation, but by each video adjustment unit 121. OSD images t1 to tN added in accordance with channel specific information are respectively displayed.

  In the example of FIG. 7, the presentation balance setting unit 103 also sets the volume of each channel equally according to the equal presentation priority, and also displays the display screen 201 as control information in each audio adjustment unit 122. The position of the corresponding split screen, volume, etc. are supplied. That is, the volume set according to the presentation priority corresponds to the size of each divided screen.

  Therefore, the audio adjusting unit 122-1 has a volume corresponding to the set volume (that is, the size of the divided screen 211-1) according to the control information from the presentation balance setting unit 103. In addition, the volume and the sound source position of the audio data a1 of the channel 1 are adjusted so that the sound can be heard from the position of the divided screen 211-1 on the display screen 201, and the adjusted audio data a1-1 is output to the audio mixer unit 57. .

  Similarly, the audio adjustment unit 122-2 is configured such that the audio of the channel 2 is in accordance with the set volume (that is, the size of the divided screen 211-2) according to the control information from the presentation balance setting unit 103. The volume and sound source position of the audio data a2 of channel 2 are adjusted so that the sound can be heard from the position of the divided screen 211-2 on the display screen 201, and the adjusted audio data a2-1 is output to the audio mixer unit 57. To do.

  The audio adjusting unit 122-3 has a volume corresponding to the volume of the channel 3 (that is, the size of the divided screen 211-3) according to the control information from the presentation balance setting unit 103, and Then, the volume and sound source position of the audio data a3 of the channel 3 are adjusted so that the sound can be heard from the position of the divided screen 211-3 on the display screen 201, and the adjusted audio data a3-1 is output to the audio mixer unit 57.

  The audio adjustment unit 122-N has a volume corresponding to the set volume (that is, the size of the divided screen 211-N) according to the control information from the presentation balance setting unit 103, and Then, the volume and sound source position of the audio data aN of the channel N are adjusted so that the sound can be heard from the position of the divided screen 211-N on the display screen 201, and the adjusted audio data aN-1 is output to the audio mixer unit 57.

  The audio mixer unit 57 synthesizes the audio data a1-1 to aN-1 output from the audio adjustment units 122-1 to 122-N and causes the audio output unit 63 to output audio corresponding to the synthesized audio data. .

  Thereby, from the audio output unit 63, the audio corresponding to the audio data a1-1 to aN-1 after the adjustment of the plurality of channels has a size corresponding to the size of each of the divided screens 211-1 to 211-N. It is output so that it can be heard from the position of each of the divided screens 211-1 to 211 -N.

  FIG. 8 shows another example of the display screen 201 of FIG.

  In the example of FIG. 8, the video corresponding to the video data v1 to vN of the N channels 1 to N and the video data v1 to vN after adjustment of the video data v1 to vN are adjusted by the video adjustment unit 121 in order from the top. Through the display screen 201 including the divided screens 211-1 through 211 -N on which the video corresponding to vN-2 and the video corresponding to the adjusted video data v1-2 through vN-2 are displayed, respectively, and the audio data a1 through aN. The audio corresponding to the adjusted audio data a1-2 to aN-2 adjusted by the audio adjusting unit 122 and the audio corresponding to the N channel 1 to N audio data a1 to aN are shown.

  In the case of the example of FIG. 8, a distribution occurs in the presentation priority that is equal in the example of FIG. 7, the presentation priority of the channel 1 is lower than the example of FIG. 7, and the presentation priority of the channel 3 is A display screen 201 when the presentation priority of channel N is slightly higher is shown.

  Here, since the presentation priority is normalized according to the number of channels as described above with reference to FIG. 4 (for example, set to be 100% in total), channel 1 and channel 3 and the presentation priority of channels other than channel N are also slightly changed according to the change of the presentation priority of channel 1, channel 3, and channel N. For example, channel 2 is slightly higher than the example of FIG.

  Therefore, the presentation balance setting unit 103 changes the control information such as the size of all the divided screens, the presentation position of the divided screens changed according to the size, and the volume according to the changed presentation priority, and the video adjustment. Are supplied to the unit 121 and the audio adjustment unit 122.

  Specifically, the presentation balance setting unit 103 makes the size (horizontal size, that is, area) of the divided screen 211-1 of channel 1 narrower than that in the example of FIG. Further, the size of the divided screen 211-N of the channel N is larger than that of the example of FIG. 7 and the volume of the channel 3 is larger than that of the example of FIG. The control information is changed so as to be a little wider than the case and the volume of the channel N is slightly increased, and is supplied to the video adjustment unit 121 and the audio adjustment unit 122.

  Correspondingly, the video adjustment units 121-1 to 121-N change the video data v1 to vN of the corresponding channels according to the control information from the presentation balance setting unit 103, as in the example of FIG. Adjustments for displaying on the divided screens 211-1 to 211 -N whose sizes have been changed according to the presentation priority are performed, and the adjusted video data v1-2 to vN-2 are respectively output to the video mixer unit 56. To do.

  The video mixer unit 56 superimposes the video data v1-2 to vN-2 output from the video adjustment units 121-1 to 121-N, and displays the display screen 201 corresponding to the superimposed video data on the video output unit 62. Display.

  Thereby, the video output unit 62 displays the video corresponding to the adjusted video data v1-2 to vN-2 of the plurality of channels, and the horizontal size (area) is changed according to the presentation priority. A display screen 201 composed of divided screens 211-1 to 211 -N is displayed.

  On the other hand, the audio adjusting units 122-1 to 122 -N, according to the control information from the presentation balance setting unit 103, the audio of the corresponding channel is changed with the volume level changed as in the example of FIG. 7. In addition, the volume and the sound source position of the audio data are adjusted so that the sound can be heard from the position of the divided screen whose horizontal size has been changed, and the adjusted audio data a1-2 to aN-2 are output to the audio mixer unit 57, respectively. To do.

  The audio mixer unit 57 synthesizes the audio data a1-2 to aN-2 output from the audio adjustment units 122-1 to 122-N and causes the audio output unit 63 to output audio corresponding to the synthesized audio data. .

  As a result, the audio output unit 63 changes the horizontal size of the audio corresponding to the audio data a1-2 to aN-2 after the adjustment of the plurality of channels according to the presentation priority, and is changed along with the size change. It is output so that it can be heard from the positions of the divided screens 211-1 to 211 -N.

  That is, in the example of FIG. 8, compared to the divided screens 211-1 to 211 -N shown in FIG. Depending on the presentation priority, the split screen 211-2 with a slightly larger horizontal size, according to the higher presentation priority, the split screen 211-3, with a larger horizontal size, and slightly higher A display screen 201 composed of divided screens 211-N having a slightly larger horizontal size is displayed according to the presentation priority.

  Then, for the user who is viewing the display screen 201 in FIG. 8, the volume of the divided screen 211-1 whose horizontal size is reduced according to the lowered presentation priority is set according to the lowered presentation priority. The voice corresponding to the audio data a1-2 whose size is reduced is heard, and the presentation priority slightly increased from the position of the split screen 211-2 where the horizontal size is slightly increased according to the presentation priority slightly increased. Accordingly, the voice corresponding to the voice data a2-2 whose volume is slightly increased is heard.

  Similarly, the audio data a3-2 whose volume is increased according to the increased presentation priority from the position of the divided screen 211-3 whose horizontal size is increased according to the increased presentation priority. From the position of the split screen 211-N where the horizontal size is slightly increased according to the presentation priority that is slightly higher, the volume is increased slightly according to the presentation priority that is slightly increased. A voice corresponding to the voice data aN-2 is heard.

  As described above, according to the presentation priority for each channel, the display size (that is, the display area) of the divided screen that displays the channel is changed and displayed. It is possible to provide an easy-to-see display screen according to the situation.

  Furthermore, as the presentation priority corresponding to the display area of the divided screen, by using the presentation priority for each channel normalized (for example, set to be 100% in total), any number of channels can be used. Even in such a case, it is possible to realize display with various display balances.

  Further, the divided screens 211-1 to 211 -N in FIGS. 7 and 8 are configured using the entire effective display area of the display screen 201. This makes it possible to efficiently present video data without wasting an effective display area.

  In addition, when changing the size (that is, the display area) of the divided screens 211-1 to 211 -N according to the change in the presentation priority described above, an audiovisual special effect (effect) that effectively represents the transition. ) Can also be added.

  Next, with reference to FIGS. 9 and 10, an example of an audiovisual special effect that represents a transition in size of the divided screens 211-1 to 211 -N on the display screen 201 will be described.

  In the example of FIG. 9, three display states SS1 to SS3 of divided screens 211-1 to 211 -N on the display screen 201 are shown. In the example of FIG. 10, the divided screen 211 on the display screen 201 is shown. Three display states SS4 to SS6 from −1 to 211-N are shown.

  As described above with reference to FIG. 7, the display state SS1 is the display state of the display screen 201 when the presentation priority is calculated equally for each channel and the equal size is set for each divided screen. Represents. In the display screen 201 of the display state SS1, each of the divided screens 211-1 to 211-N is configured with an equal size.

  The display state SS2 represents the display state of the display screen 201 during the transition from the divided screens 211-1 to 211-N in the display state SS1 to the divided screens 211-1 to 211-N in the display state SS3.

  In the display screen 201 of the display state SS2, the equal size is set for the frames of the divided screens arranged on the left side of the left frame of the divided screen 211-3 including the left frame of the divided screen 211-3. Display state SS3 in which the highest presentation priority is calculated for channel 3 (that is, the largest size is set for the divided screen of channel 3) from the position of the frame of each divided screen in display state SS1 Is moved in the direction of arrow L1 (left in the figure) to the position of the frame of each divided screen.

  Here, the dotted line in the display screen 201 represents the lower end portion when the upper end portion and the lower end portion of the frame of each of the divided screens 211-1 to 211 -N are simultaneously moved in the movement direction.

  That is, in the display state SS2, the upper end portion and the lower end portion of the frame of each divided screen are not moved in the moving direction at the same time, and as shown by the dotted line, the lower end portion of the left frame of the divided screen 211-3 is It moves behind its upper end so that it moves in the direction opposite to the arrow L1 that is the moving direction. Similarly, on the left side of the divided screen 211-3, the left frame of the divided screen 211-3 and the direction of the arrow L1. The lower end portion of the left frame of the split screen 211-2 that moves to the left also moves behind the upper end portion so as to fly in the direction opposite to the arrow L1.

  In addition, on the display screen 201 in the display state SS2, including the right frame of the divided screen 211-3, the frames of the divided screens arranged on the right side of the right frame of the divided screen 211-3 are each in the display state SS1. From the position of the frame of the divided screen to the position of the frame of each divided screen in the display state SS3, it moves in the direction of arrow R1 (right in the figure).

  At this time, as indicated by the dotted line, the lower end portion of the right frame of the divided screen 211-3 moves behind the upper end portion so that it moves in the direction opposite to the arrow R1 that is the moving direction. Furthermore, on the right side of the divided screen 211-3, the lower end portion of the right frame of each divided screen that moves in the direction of the arrow R1 together with the right frame of the divided screen 211-3 also has its upper end so that it flutters in the direction opposite to the arrow R1. It is moving behind the department.

  In the display state SS2, the degree of delay from the upper end of the lower end of each divided screen frame increases as the amount of movement increases.

  In the display state SS3, the presentation priority is calculated for each channel so that the presentation priority for the channel 3 is the highest, and the display screen 201 when the largest size is set for the divided screen of the channel 3 is displayed. Indicates the display state. That is, on the display screen 201 in the display state SS3, the divided screen 211-3 is displayed in the largest horizontal size.

  The display state SS4 represents the display state of the display screen 201 during the transition from the divided screens 211-1 to 211-N in the display state SS3 to the divided screens 211-1 to 211-N in the display state SS5.

  In the display screen 201 in the state SS4, each frame of each divided screen 211 is set to the largest size in the divided screen of the channel N from the position of the display state SS3 in which the largest size is set in the divided screen of the channel 3. It has moved in the direction of arrow L2 (left in the figure) to the position of the display state SS5.

  At this time, as indicated by the dotted line, the lower end portion of the left frame of the divided screen 211-N moves behind the upper end portion so as to fly in the direction opposite to the arrow L2, and similarly the divided screen The lower end portion of the left frame of each divided screen 211 that moves in the direction of the arrow L2 along with the left frame of the divided screen 211-N on the left side of the 211-N also lags behind the upper end portion so as to fly in the direction opposite to the arrow L2. Has moved.

  Note that the degree of delay from the upper end of the lower end of each divided screen frame in the display state SS4 increases as the movement amount increases, as in the display state SS2.

  In the display state SS5, the presentation priority is calculated for each channel so that the presentation priority for the channel N is the highest, and the largest size is set for the divided screen of the channel N. Indicates the display state. That is, on the display screen 201 in the display state SS5, the divided screen 211-N is displayed in the largest horizontal size.

  The display state SS6 represents the display state of the display screen 201 during the transition from the divided screens 211-1 to 211-N in the display state SS5 to the divided screens 211-1 to 211-N in the display state SS1.

  In the display screen 201 in the state SS6, each frame of each divided screen 211 is set to an equal size in all the divided screens from the position of the display state SS5 in which the largest size is set in the divided screen of the channel N. It has moved in the direction of arrow R2 (right in the figure) to the position of the display state SS1.

  At this time, as indicated by the dotted line, the lower end portion of the left frame of the divided screen 211-N moves behind the upper end portion so as to fly in the direction opposite to the arrow R2, and similarly, the divided screen The lower end of the left frame of each divided screen 211 that moves in the direction of the arrow R2 along with the left frame of the divided screen 211-N on the left side of the 211-N is also delayed from the upper end thereof so as to fly in the direction opposite to the arrow L2. Has moved.

  Note that the degree of delay from the upper end of the frame of each divided screen in the display state SS6 increases as the movement amount increases, as in the display state SS2.

  As shown in the display state SS2, the display state SS4, and the display state SS6, the change of the size (area) of the split screens 211-1 to 211-N is also displayed, so that the split screen is displayed. The size can be changed gradually rather than suddenly, and a comfortable viewing environment can be provided to the user.

  In addition, the lower end portion of the moving frame of each divided screen in the display state SS2, the display state SS4, and the display state SS6 moves behind the upper end portion in a direction opposite to the moving direction. That is, the moving frame of each divided screen in the display state SS2, the display state SS4, and the display state SS6 is as if the curtain on the actual window is opened and closed by the user's hand. The part moves so as to fly in the direction opposite to the moving direction.

  In this way, by moving the frame of each divided screen in the display state SS2, the display state SS4, and the display state SS6 so that the curtains flutter, for example, because the property is functional, the blind is In contrast to being a business element, in the case of a curtain, it is possible to provide a user with a homely impression and familiarity.

  This audiovisual special effect includes, for example, time information during transition from the display state SS1 to the display state SS3, and the size, position, and frame shape of the divided screen corresponding to the time information as control information. Corresponding to this, the position adjusting unit 144 is realized by adjusting the video data according to the divided screen corresponding to the control information, for example, for each supplied time information. .

  FIG. 11 is a diagram for explaining an adjustment method for optimally displaying video data on each of the divided screens constituting the display screen.

  In the upper part of FIG. 11, original videos 251a to 253a corresponding to the video data before adjustment are shown. That is, when the video data before adjustment is displayed on the video output unit 62 as it is, the video 251a in which the user A is located in the center, the original video 252a in which the user B is located to the right of the center, and the user C are displayed. The original video 253a in which the user D is located in the center is displayed.

  However, when displaying on a plurality of divided screens constituting the display screen, only a part of each of the original videos 251a to 253a is displayed in the video data.

  For example, when the divided screen displaying the original video 251a is located at the leftmost end of the display screen composed of a plurality of divided screens, the corresponding area in the video data (that is, the original video) The leftmost area of 251a) may be displayed. However, depending on the position of the subject in the video, for example, the user A located in the center may be hardly displayed like the original video 251a.

  In such a case, the video adjustment unit 121 applies the original video 251a to 253a so that each user displayed on the original video 251a to 253a in FIG. 11 is optimally displayed on the corresponding divided screen. Make the following adjustments:

  That is, in the case of the original video 251a, the video adjustment unit 121 masks the regions M1-1 and M1-2 other than the region E1 having the size of the divided screen with the center position C1 of the original video 251a as the center. The video data corresponding to 251a is optimally adjusted. Thereby, video data corresponding to the optimized video 251b is obtained.

  Similarly, in the case of the original image 252a, the image adjustment unit 121 moves to the right from the center position of the original image 252a, and the region M2 other than the region E2 having the size of the divided screen around the position C2 where the user B is displayed. The video data corresponding to the original video 252a is optimally adjusted so as to mask −1 and M2-2. As a result, video data corresponding to the optimized video 252b is obtained.

  On the other hand, in the case of the original video 253a, the user C and the user D cannot fit in the area E3 having the size of the divided screen. Therefore, in the case of the original video 253a, the video adjustment unit 121 performs reduction in the left-right direction around the center position C3 of the original video 253a, and then the regions M3-1 and M3- other than the region E3 having the size of the divided screen. The video data corresponding to the original video 253a is optimally adjusted so that 2 is masked. Thereby, video data corresponding to the optimized video 253b is obtained.

  Thereafter, the presentation (display) position of the video data is further adjusted so that the positions C1 to C3 in the optimized video 251b to 253b are aligned with the center position of each divided screen on the display screen, and the adjusted video Data is superimposed by the video mixer 56.

  As a result, as shown in FIGS. 12 and 13, the video output unit 62 has display screens 271 to 274 each including divided screens on which the adjusted videos 251 c to 253 c corresponding to the adjusted video data are displayed. Is displayed.

  12 and 13 show examples of display screens composed of divided screens on which video corresponding to the video data after adjustment is displayed.

  The display screens 271 to 274 in the examples of FIGS. 12 and 13 are divided screens 281-1 to 281-8 in which all effective display areas are divided into eight horizontal areas and eight channels 1 to 8 are respectively displayed. For example, the contents of the video data corresponding to the original videos 253a, 251a, and 252a in FIG. 11 are selected as the channels 2, 3, and 6, respectively.

  Therefore, hereinafter, the display screens 271 to 274 will be described in order using the channels 2, 3, and 6. Although illustration and description are omitted, it is assumed that other predetermined contents are selected for channels 1, 4, 5, 7, and 8. Further, for the sake of convenience of explanation, although explanation thereof is omitted, also in these display screens 271 to 274, channels as characteristic information superimposed on the respective video data are provided below the respective divided screens 281-1 to 281-8. Numbered OSD video is displayed.

  In the example of FIG. 12, the divided screens 281-1 to 281-8 in the display screens 271 and 272 are arranged in the order set in advance.

  On the display screen 271, equal presentation priority is calculated for the eight channels, and each of the divided screens 281-1 to 281-8 set to an equal size according to the presentation priority includes Each of the video images of the content corresponding to the video data optimally adjusted according to the equally divided screens 281-1 to 281-8 is displayed.

  Specifically, the video data of the original video 253a is optimally adjusted so that the user D is displayed on the split screen 281-2 as a channel 2 on the split screen 281-2 of an equal size, Further, an adjusted image 253c corresponding to the image data whose position has been adjusted is displayed. In this case, the horizontal reduction is not performed, and the presentation position of the video data is adjusted so that the right end position in the optimized video 253b matches the right end position of the divided screen 281-2.

  In the equally sized split screen 281-3, the video data of the original video 251a is optimally adjusted and the position is adjusted so that the user A is displayed in the center on the split screen 281-3 as the channel 3. The adjusted video 251c corresponding to the video data is displayed. In this case, the horizontal reduction is not performed, and the presentation position of the video data is adjusted so that the position C1 in the optimized video 251b matches the center position of the divided screen 281-3.

  In the equally sized divided screen 281-6, the video data of the original video 252a is optimally adjusted and the position is further adjusted so that the user A is displayed in the center on the divided screen 281-6 as the channel 6. The adjusted video 252c corresponding to the video data is displayed. In this case, the reduction in the horizontal direction is not performed, and the presentation position of the video data is adjusted so that the position C2 in the optimized video 252b and the center position of the divided screen 281-6 are combined.

  When the display screen 271 configured as described above is displayed, for example, when request information of the channel 3 is input from the user information input unit 61 by a user operation, the presentation priority for the channel 3 is maximum. The presentation priorities of channels 1 to 8 are calculated so that As a result, the video output unit 62 displays a display screen 272 corresponding to the presentation priority for the channel 3 calculated to the maximum.

  On the display screen 272, the presentation priority of the channel 3 among the eight channels is calculated to the maximum, and each of the divided screens 281-1 to 281-8 set to a size corresponding to the presentation priority is displayed on the display screen 272. The video of the content corresponding to the video data optimally adjusted according to the divided screens 281-1 to 281-8 of the set size is displayed.

  Specifically, the divided screen 281-2 having a size smaller than that of the display screen 271 is omitted because of the small size of the divided screen 281-2. An adjusted image 253c corresponding to the image data whose data is optimally adjusted and whose position is further adjusted is displayed. Further, since the display of the divided screen 281-6 whose size is smaller than that of the display screen 271 is omitted because of the small size of the divided screen 281-6, the video data of the original video 252a is optimally adjusted as the channel 6. Then, an adjusted image 252c corresponding to the image data whose position is further adjusted is displayed.

  In the divided screen 281-3 set to the maximum size according to the presentation priority, the user A is displayed in the center on the divided screen 281-3 having the maximum size as the channel 3. The adjusted image 251c corresponding to the image data in which the image data is optimally adjusted and the position is adjusted is displayed. In this case, the mask area at the time of adjustment is minimized, and the presentation position of the video data is adjusted so that the position C1 in the optimized video 251b matches the center position of the divided screen 281-3. .

  When the display screen 272 configured as described above is displayed, for example, when request information of the channel 6 is input from the user information input unit 61 by a user operation, the presentation priority for the channels 3 and 6 is displayed. The presentation priorities of channels 1 to 8 are calculated so that both of them become large. As a result, on the video output unit 62, a display screen 273 corresponding to the presentation priority for the channels 3 and 6 calculated so as to be both large is displayed.

  Here, in the display screens 273 and 274 in the example of FIG. 13, among the split screens 281-1 to 281-8, the split screens of the channels where the request information is frequently input by the user's operation are the display screens. Are set in advance so as to be adjacent to each other.

  In the display screen 273, the presentation priority of both the channel 3 and the channel 6 among the eight channels is greatly calculated, and the divided screens 281-1 to 281- 28 set to a size according to the presentation priority. 8, video of content corresponding to video data optimally adjusted according to the divided screens 281-1 to 281-8 having a set size is displayed.

  In addition, in the display screen 273, since the request information of the channel 3 and the channel 6 is input more frequently than the channels 4 and 5, the divided screens 281-4 and 281-5 on which the channels 4 and 5 are displayed are displayed. The position of the divided screen 281-6 for displaying the channel 6 is displayed adjacent to the divided screen 281-3 for displaying the channel 3.

  Specifically, since the display of the divided screen 281-2 having substantially the same size as that of the display screen 272 is omitted because of the small size of the divided screen 281-2, the video data of the original video 253a as channel 2 is displayed. Is adjusted and the adjusted video 253c corresponding to the video data whose position is further adjusted is displayed.

  The divided screen 281-3 is set as the channel 3 in the divided screen 281-3 that is set to be larger together with the divided screen 281-6 of the channel 6, that is, the smaller size than the case of the display screen 272 that is the maximum size. Then, the video data of the video 251a is optimally adjusted so that the user A is displayed in the center, and the adjusted video 251c corresponding to the video data whose position is further adjusted is displayed.

  In the divided screen 281-6 that is set to be larger together with the divided screen 281-3 of the channel 3, that is, larger than the size of the display screen 272, and further moved to a position adjacent to the divided screen 281-3. As the channel 6, the adjusted video 252c corresponding to the video data in which the video data of the original video 252a is optimally adjusted and the position is adjusted so that the user B is displayed in the center on the split screen 281-6. It is displayed.

  When the display information 273 configured as described above is displayed, for example, when request information for higher channel 2 is input from the user information input unit 61 by a user operation, the presentation priority of channel 2 is displayed. However, the presentation priorities of channels 1 to 8 are calculated so as to be slightly higher than the presentation priorities for channels 3 and 6. As a result, on the video output unit 62, a display screen 274 corresponding to the presentation priority for the channel 2 calculated so as to be larger than the channels 3 and 6 is displayed.

  In the display screen 274, among the eight channels, the presentation priority of channels 2, 3, and 6 is large, and among them, the presentation priority of channel 2 is calculated to be slightly higher than that of channels 3 and 6. In each of the divided screens 281-1 to 281-8 set to a size according to the presentation priority, the video data optimally adjusted according to the divided screens 281-1 to 281-8 of the set size, respectively. The video of the content corresponding to is displayed.

  Specifically, in the divided screen 281-2 having a larger size than that of the display screen 273, the original video 253a is displayed so that the users C and D are displayed on the divided screen 281-2 in the center as the channel 2. The adjusted image 253c corresponding to the image data whose image data is optimally adjusted and whose position is further adjusted is displayed. In this case, as described above with reference to FIG. 11, the reduction in the horizontal direction is performed, and the position of the optimized image 253b and the center position of the divided screen 281-2 match the position C3 of the image data. The presentation position has been adjusted.

  The original video 251a is displayed so that the user A is displayed in the center on the divided screen 281-3 as the channel 3 on the divided screen 281-3 set to be smaller than the size on the display screen 273 according to the presentation priority. The adjusted video 251c corresponding to the video data whose video data is optimally adjusted and whose position is further adjusted is displayed. In this case, the horizontal reduction is not performed, and the presentation position of the video data is adjusted so that the position C1 in the optimized video 251b matches the center position of the divided screen 281-3.

  In the divided screen 281-6 set smaller than the size in the display screen 273 according to the presentation priority, the original video 252a is displayed so that the user B is displayed in the center on the divided screen 281-6 as the channel 6. The adjusted image 252c corresponding to the image data that has been optimally adjusted and further adjusted in position is displayed. In this case, the reduction in the horizontal direction is not performed, and the presentation position of the video data is adjusted so that the position C2 in the optimized video 252b matches the center position of the divided screen 281-6.

  In the display screen 274, the request information of the channels 2, 3, and 6 is input more frequently than in the channel 1, but in the display screen 273, the position of the divided screen 281-2 that displays the channel 2 is displayed. However, since it was displayed side by side with the divided screen 281-3 that displays channel 3, the arrangement order of the divided screens has not been changed.

  As described above, depending on the presentation priority, not only the size of the split screen can be changed, but also the video data to be displayed can be adjusted so as to be optimal in the split screen whose size has been changed. It is possible to suppress a situation where the user does not know what is being displayed on the divided screen where the display area is reduced compared to the case where one channel is displayed on the entire display screen.

  That is, for example, in the content of the communication partner, because the communication partner is often displayed in the center of the video data, for example, if the display center is set to the center in advance, no matter how the size of the split screen Since the information (communication partner) displayed on the divided screen can be grasped even when the size of the screen is reduced, a comfortable display can be provided to the user.

  In addition, as described above, the display order of the divided screens can be changed, so that, for example, the display priority is higher and the size is increased between two divided screens corresponding to two channels. It is possible to suppress that the divided screen corresponding to the channel having a low presentation priority and a small size prevents the comfortable viewing of the divided screen having the high presentation priority.

  As described above, a comfortable content viewing environment can be provided to the user.

  Furthermore, with reference to FIG. 14, another example of the video data adjustment method and a display screen on which the adjusted video data is displayed will be described.

  The upper part of FIG. 14 shows an original video 301a corresponding to the video data before adjustment. That is, when the video data before adjustment is displayed on the display screen as it is, the original video 301a on which the landscape is drawn is displayed on the display screen.

  In the case of the original video 301a, the video adjustment unit 121 optimizes the video data corresponding to the original video 301a so as to mask the area M4 other than the area E4 of the original video 301a corresponding to the position of the divided screen on the display screen. adjust. Thereby, video data corresponding to the optimized video 301b is obtained.

  In the case of the optimized video 301b, the presentation position is not adjusted as in the optimized videos 251b to 253b, and the video data of the optimized video 301b is superimposed on other video data. As a result, the area E4 of the optimized video 301b is displayed as it is on the divided screen 321-1 constituting the display screen 311.

  The display screen 311 is composed of divided screens 321-1 to 321-3 in which all effective display areas are divided into three, and three channels 1 to 3 are respectively displayed. In this case, the content of the original video 301a is selected as the channel 1, the content of the original video 251a in FIG. 11 is selected as the channel 2, and the content of the original video 252a in FIG.

  In the display screen 311, the presentation priority is calculated as channel 1> channel 2> channel 3, and according to these presentation priorities, the size of the divided screen 321-1> the size of the divided screen 321-2> divided. The size of the screen 321-3 is set.

  Specifically, on the divided screen 321-1, an optimized video 301b in which the video data of the image 301a is optimally adjusted is displayed as channel 1. In this case, the presentation position of the optimized video 301b is not adjusted, and the area E4 of the optimized video 301 is displayed on the divided screen 321-1 at the same position.

  The split screen 321-2 corresponds to video data in which the video data of the video 251a is optimally adjusted and the position is adjusted so that the user A is displayed in the center on the split screen 321-2 as the channel 2. The adjusted image 251c to be displayed is displayed. In this case, the reduction in the horizontal direction is not performed, and the presentation position of the video data is adjusted so that the position C1 in the optimized video 251b matches the center position of the divided screen 321-2.

  The split screen 321-3 corresponds to the video data in which the video data of the video 252a is optimally adjusted and the position is adjusted so that the user B is displayed in the center on the split screen 321-3 as the channel 3. The adjusted image 252c to be displayed is displayed. In this case, reduction in the horizontal direction is performed, and the presentation position of the video data is adjusted so that the position C2 in the optimized video 252b matches the center position of the divided screen 321-3.

  As described above, the region of the video data corresponding to the position of the divided screen on the display screen may be displayed as it is without adjusting the position of the video data in the divided screen.

  As another example of the original video 301a, the video adjustment unit 121 masks the area M5 other than the areas E5-1 and E5-2 of the original video 301a corresponding to the position of the divided screen on the display screen. The video data corresponding to the original video 301a is optimally adjusted. Thereby, video data corresponding to the optimized video 301c is obtained.

  In the case of the optimized video 301c, the video data of the optimized video 301c is superimposed on the other video data without adjusting the presentation position as in the case of the optimized video 301b. As a result, the area E5-1 and the area E5-2 of the optimized video 301c are displayed as they are on the divided screens 331-1 and 331-2 constituting the display screen 312.

  In the display screen 312, all effective display areas are divided into three, a divided screen 331-1 in which channel 1 is displayed, a divided screen 332 in which channel 2 is displayed, and a divided screen 331 in which channel 1 is displayed. 2, the content of the video 301 a is selected as the channel 1, and the content of the original video 251 a in FIG. 11 is selected as the channel 2.

  In the display screen 312, equal presentation priorities are calculated for channels 1 and 2, and divided screens 331-1, 332, and 331-2 having an equal size are set according to the presentation priorities. Has been.

  That is, on the display screen 312, the display data of both the leftmost divided screen 331-1 and the rightmost divided screen 331-2 corresponds to the video data in which the video data of the image 301a is optimally adjusted as the channel 1. An optimized video 301c is displayed. In this case, the presentation position of the optimized video 301c is not adjusted, and the areas E5-1 and E5-2 of the optimized video 301c are displayed as they are on the split screens 331-1 and 331-2. .

  On the other hand, in the divided screen 321-2, the video data of the video 251a is optimally adjusted so that the user A is displayed in the center on the divided screen 321-2 as the channel 2, and the video data whose position is further adjusted. A post-adjustment video 251c corresponding to is displayed. In this case, the reduction in the horizontal direction is not performed, and the presentation position of the video data is adjusted so that the position C1 in the optimized video 251b matches the center position of the divided screen 321-2.

  As described above, it is possible to display the content of one channel on a plurality of divided screens.

  In the above description, the divided screens are configured by dividing the display screen so that they do not overlap each other, but the divided screens may be configured to overlap each other. In this case, the split screen of the channel with high presentation priority may be displayed over the split screen of the channel with low presentation priority without making both transparent, or either or both Can be transmitted according to the presentation priority.

  Next, content presentation control processing of the content presentation control device 31 will be described with reference to the flowchart of FIG.

  The user operates the user information input unit 61 to select one or more contents to be displayed as a channel from broadcast contents, distribution contents, communication partner contents, and stored contents. The user information input unit 61 supplies content selection information to the information acquisition unit 101 of the presentation balance control unit 54 in response to this user operation.

  Based on the content selection information from the user information input unit 61, the information acquisition unit 101 corresponds to each unit of the channel data supply unit 53 (content acquisition unit 71, content storage unit 72, and user content reception unit 91 of the communication unit 73. ) To obtain desired content of the user.

  For example, when the BS digital satellite broadcast wave content is selected by the user as channel 4, the content acquisition unit 71 controls the tuner 51 and the antenna 52 in step S11 in response to an instruction from the information acquisition unit 101. The broadcast signal of the desired content from the BS digital broadcast satellite 35 is acquired via the, and the content data of the broadcast content included in the broadcast signal from the tuner 51 is supplied to the presentation balance adjustment unit 55 as the data of the channel 4. To do.

  At this time, the content acquisition unit 71 supplies the metadata of the broadcast content included in the broadcast signal from the tuner 51 to the information acquisition unit 101 as the metadata of the channel 4.

  Further, for example, when a desired stored content is selected by the user as the channel 2, the content storage unit 72 receives the content data of the user-desired stored content in step S11 in response to an instruction from the information acquisition unit 101. The data is read and supplied to the presentation balance adjustment unit 55 as channel 2 data, and the metadata corresponding to the content is read out and supplied to the information acquisition unit 101 as the metadata of channel 2.

  Further, for example, when the content of the communication partner (user B) is selected by the user as the channel 3, the user content receiving unit 91 receives another instruction via the network 32 in response to an instruction from the information acquisition unit 101. Communication is performed with the content presentation control device 31 (for example, the content presentation control device 31-2), and in step S11, the content data and the metadata of the content of the communication partner from the other content presentation control device 31 are received and communicated. The content data of the other party is supplied as channel 3 data to the presentation balance adjustment unit 55, and metadata corresponding to the content is supplied as channel 3 metadata to the information acquisition unit 101.

  In step S12, the information acquisition unit 101 acquires the metadata of each channel from at least one of the content acquisition unit 71, the content storage unit 72, and the user content reception unit 91, and presents the acquired metadata of each channel. It supplies to the priority calculation part 102.

  In step S13, the presentation priority calculation unit 102 determines whether request information of the communication partner has been acquired. In other words, the presentation priority calculation unit 102 determines whether the metadata of a predetermined channel includes request information of a communication partner as metadata from the user content reception unit 91. If it is determined in step S13 that the request information of the communication partner has been acquired, the presentation priority calculation unit 102 proceeds to step S14 and determines whether the request information of the user has been acquired.

  For example, the user operates the user information input unit 61 to instruct a predetermined channel having a strong viewing request among a plurality of channels. The user information input unit 61 supplies user request information for a predetermined channel to the information acquisition unit 101 in response to a user operation, and the information acquisition unit 101 presents the user request information for the predetermined channel to the presentation priority. It is supplied to the calculation unit 102.

  In response to this, the presentation priority calculation unit 102 determines in step S14 that the user request information for the predetermined channel has been acquired, proceeds to step S15, and stores the request information and metadata of the user and the communication partner. Based on this, the presentation priority of the plurality of channels is calculated, and the calculated presentation priority of the plurality of channels is supplied to the presentation balance control unit 103.

  If it is determined in step S14 that the request information of the user has not been acquired, the presentation priority calculation unit 102 proceeds to step S16, and presents a plurality of channels based on the request information and metadata of the communication partner. The degree of presentation is calculated, and the presentation priority of the calculated plurality of channels is supplied to the presentation balance control unit 103.

  On the other hand, when it is determined in step S13 that the request information of the communication partner has not been acquired, the presentation priority calculation unit 102 proceeds to step S17, and based on the metadata (only) of each channel, a plurality of channels. Presentation priority is calculated, and the calculated presentation priority of a plurality of channels is supplied to the presentation balance control unit 103.

  In step S18, the presentation balance control unit 103 determines the size (ie, area) of the divided screen of each channel and the divided screen on the display screen according to the presentation priority of the plurality of channels calculated by the presentation priority calculating unit 102. Set the control information for each channel to adjust the video data and audio data of each channel such as the position of the content, the position of the content displayed on the split screen, transparency, magnification, corresponding audio volume, sound quality, etc. Each control information is supplied to the video adjustment unit 121 and the audio adjustment unit 122 of the corresponding channel.

  When the control information from the presentation balance control unit 103 is input, the video adjustment unit 121 executes video adjustment output processing in step S19. This video adjustment output process will be described later in detail with reference to FIG.

  The size of the video data to be displayed on the divided screen so as to be optimally displayed on the divided screen of the set size according to the control information of each channel from the presentation balance control unit 103 by the video adjustment output processing in step S19. The transparency, the presentation position, the addition of specific information, and the like are adjusted, and the adjusted video data of each channel is supplied to the video mixer unit 56. The video data of the plurality of channels is superimposed by the video mixer unit 56 and output to the video output unit 62.

  Thereby, as shown in FIG. 16 to be described later, the video output unit 62 displays a display screen composed of the divided screens of the respective channels. In other words, on the display screen, the video corresponding to the video data of each channel adjusted to be suitable for the split screen of a size corresponding to the presentation priority of each channel is displayed on the split screen of each channel.

  On the other hand, when the control information from the presentation balance control unit 103 is input, the audio adjustment unit 122 executes an audio adjustment output process in step S20. This audio adjustment output process will be described later in detail with reference to FIG.

  As a result of the video adjustment processing in step S20, the volume, sound quality, sound source position, and the like of the audio data can be heard from the position of the divided screen of the set size according to the control information of each channel from the presentation balance control unit 103. The adjusted audio data of each channel is supplied to the audio mixer unit 57. Then, audio data of a plurality of channels is synthesized by the audio mixer unit 57 and output to the audio output unit 63.

  As a result, as described above with reference to FIG. 7, the audio output unit 63 has a plurality of channels so that the audio of the corresponding channel can be heard from the position of the divided screen of the size corresponding to the presentation priority of each channel. Channel audio is output.

  After step S20, the process returns to step S11, and the subsequent processes are repeated. That is, the content presentation control process of FIG. 15 is repeated until the user gives an instruction to turn off the power of the content presentation control device 31.

  Next, the video adjustment output processing in step S19 in FIG. 15 will be described with reference to the flowcharts in FIGS.

  FIG. 16 shows an example of a display screen displayed on the video output unit 62. The display screens 351 to 353 shown in FIG. 16 include eight divided screens 361-1 to 361-8 configured using all the effective display areas.

  In the display screen 351, equal presentation priorities are calculated for the eight channels, and each of the divided screens 361-1 to 361-8 set to an equal size according to the presentation priority includes Each of the content images corresponding to the video data optimally adjusted according to the equally sized divided screens 361-1 to 361-8 is displayed.

  Specifically, in the equally-sized divided screen 361-2, for example, the size of the video data of the stored content is optimally adjusted as the channel 2, and the content of the channel 2 (that is, the content of “drama”) is adjusted. Video data corresponding to the OSD video indicated as “drama” for allowing the user to specify the content is superimposed, and the stored content corresponding to the video data whose position is adjusted is displayed.

  In the equally divided screen 361-3, for example, the size of the video data of the content of the communication partner is optimally adjusted as the channel 3, and the contents of the channel 3 (that is, “User B” as the communication partner) The video data of the OSD video indicated as “user B” for allowing the user to identify the content) is superimposed, and the content of the communication partner corresponding to the video data whose position has been adjusted is displayed. .

  In the equally divided screen 361-4, for example, the size of video data of (BS) broadcast content is optimally adjusted as channel 4, and the content of channel 4 (that is, the broadcast content of “BS”). OSD video data indicated as “BS” for allowing the user to specify the broadcast content corresponding to the video data whose position has been adjusted is displayed.

  Although illustration and description are omitted, for channels 1, 5 to 8, the OSD video indicated by “AA”, the OSD video indicated by “CC”, the OSD video indicated by “EE”, and “DD”, respectively. Other predetermined content specified by the OSD video indicated by "" and the OSD video indicated by "BB" are selected.

  When the display screen 351 configured as described above is displayed, for example, request information for the channel 3 is input via the user information input unit 61 and the information acquisition unit 101 by a user operation. The presentation priority calculation unit 102 determines in step S14 in FIG. 15 that the user request information has been acquired. In step S15, the presentation priority for the channel 3 is determined based on the request information of the user and the communication partner and the metadata. The presentation priority of channels 1 to 8 is calculated so as to maximize the degree, and the calculated presentation priority is supplied to the presentation balance setting unit 103.

  In step S16, the presentation balance setting unit 103 determines that the size of the divided screen 361-3 is another divided screen according to the presentation priority of the channels 1 to 8 calculated so that the presentation priority for the channel 3 is maximized. The size, the presentation position, and the like of the divided screens 361-1 to 361-8 are set as control information so that the presentation position is in the center of the display screen 351.

  At this time, as described above with reference to FIGS. 9 and 10, the presentation balance setting unit 103 divides the divided screen set from the equally sized divided screen 361-3 to be larger than the other divided screens. The time information during the transition to the screen 361-3 and the size, position, frame shape, etc. of the divided screen corresponding to the time information are also set as control information, and the set control information is supplied to the video adjustment unit 121.

  When the control information is supplied from the presentation balance setting unit 103, the video adjustment unit 121 starts the video adjustment output process of FIG. In FIG. 17, the case of the video adjustment unit 121-3 that adjusts the video data of channel 3 will be described.

  Video data of the content of the communication partner is input as the channel 3 input from the communication unit 73 to the transparency adjustment unit 141 of the video adjustment unit 121-3.

  In step S31, the transparency adjustment unit 141 adjusts the transparency of the video data of channel 3 according to the control information of channel 3 set by the presentation balance setting unit 103. In this case, since the control information regarding transparency is not set, the video data is output to the size adjustment unit 142 as it is.

  In step S <b> 32, the size adjustment unit 142 adjusts the size of the video data of the channel 3 in accordance with the control information of the channel 3. That is, the size adjusting unit 142 obtains an area having the size of the divided screen 361-3 around a predetermined position of the video data, masks the area other than the area, adjusts the size of the video data, and adjusts the adjusted video. The data is output to the OSD adjustment unit 143.

  In step S33, the OSD adjustment unit 143 generates video data corresponding to the OSD video indicating “user B” that is the specific information of the content of the communication partner of the channel 3 according to the control information of the channel 3, and the size. It is added (superimposed) to the video data from the adjustment unit 142, and the superimposed video data is output to the position adjustment unit 144. That is, the OSD adjustment unit 143 adds the OSD video information to the video data at a predetermined superposition ratio around the predetermined position in the video data from the size adjustment unit 142. This superposition ratio can also be set to increase the transparency of the OSD video information.

  In step S <b> 34, the position adjustment unit 144 adjusts the presentation position of the video data of channel 3 according to the control information of channel 3, and outputs the video data whose presentation position has been adjusted to the video mixer unit 56. That is, the position adjustment unit 144 adjusts the presentation position of the video data so that the predetermined position that is the center of the video data is aligned with the center position of the divided screen 361-3.

  At this time, in the example of FIG. 16, the position adjustment unit 144 further sets the size, position, frame shape, etc. of the divided screen corresponding to the time information for the video data for each time information during the transition. A corresponding mask is applied to adjust the video data, and the adjusted video data is output to the video mixer unit 56. Actually, this adjustment process is executed until the transition is completed.

  The processes in steps S31 to S34 described above are also executed in the video adjustment units 121-1, 121-2, 121-4 to 121-8 that adjust the video data of channels 1, 2, 4 to 8. As a result, the video data of the channels 1 to 8 that are optimally adjusted to be displayed in the sizes of the divided screens 361-1 to 361-8 are input to the video mixer unit 56.

  In step S35, the video mixer unit 56 superimposes the video data of each channel 1 to 8, outputs the superimposed video data to the video output unit 62, and ends the video adjustment output process.

  Thus, the display screen 352 is displayed on the video output unit 62 until the transition is completed.

  The display screen 352 is divided from the size of the split screen 361-3 of the display screen 351, which is an equal size, to the size of the split screen 361-3 of the display screen 353 set larger than the other split screens. A transition for increasing the size of the screen 361-3 (that is, a transition in which the divided screen 361-3 moves from the position of the divided screen 361-3 on the display screen 351 to the position of the divided screen 361-3 on the display screen 353) is displayed. Has been.

  In the display screen 352, the frame of each divided screen arranged on the left side of the left frame of the divided screen 361-3 including the left frame of the divided screen 361-3 is set to an equal size for all channels. Move in the direction of the arrow L3 (left in the figure) from the position of the frame of each divided screen on the display screen 351 to the position of the frame of each divided screen on the display screen 353 having a large size set for the channel 3 is doing.

  At this time, similarly to the example of FIG. 9 described above, as shown by the dotted line, the lower end portion of the left frame of the divided screen 361-3 has its upper end so that it flutters in the direction opposite to the arrow L3 that is the moving direction. Similarly, on the left side of the divided screen 361-3, the lower end portion of the left frame of the divided screen 361-3 that moves in the direction of the arrow L3 together with the left frame of the divided screen 361-3 is also an arrow. It moves behind its upper end so as to fly in the opposite direction to L3.

  In addition, in the display screen 352, including the right frame of the divided screen 361-3, the frame of each divided screen arranged on the right side of the right frame of the divided screen 361-3 is the frame of each divided screen in the display screen 351. The position moves from the position to the position of the frame of each divided screen of the display screen 353 in the direction of the arrow R3 (right in the figure).

  At this time, as indicated by the dotted line, the lower end portion of the right frame of the divided screen 361-3 moves behind the upper end portion so as to move in the direction opposite to the arrow R3 that is the moving direction, and similarly In addition, the lower end portion of the right frame of each divided screen that moves in the direction of the arrow R3 together with the right frame of the divided screen 361-3 on the right side of the divided screen 361-3 also has its upper end portion so that it flutters in the direction opposite to the arrow R3. Moving more late.

  As described above, the transition of the change in the size of the divided screen is displayed, and the display screen 353 is displayed on the video output unit 62 after a predetermined time has elapsed, that is, after the transition display is completed.

  In each of the divided screens 361-1 to 361-8 whose sizes are set according to the presentation priority of the eight channels calculated so that the presentation priority for the channel 3 is the highest on the display screen 353, respectively. The content (image) corresponding to the video data that is optimally adjusted according to the divided screens 361-1 to 361-8 of the same size is displayed.

  That is, the split screen 361-2 is substantially the same size as the display screen 351, but the presentation position on the display screen 353 is set to the left according to the high presentation priority for the channel 3. On the divided screen 361-2, the stored content corresponding to the video data adjusted to be suitable for the presentation position set to the left on the display screen 353 is displayed.

  The split screen 361-3 is set to be larger in size than the display screen 351 according to the presentation priority for the channel 3, and the display position on the display screen 353 is set at the center. On the screen 361-3, the content of the communication partner corresponding to the video data adjusted to suit the size and presentation position of the split screen 361-3 is displayed.

  The split screen 361-4 has a smaller size than the display screen 351 according to the presentation priority level for the channel 3, and the presentation position on the display screen 353 is set to the right. The split screen 361-4 The broadcast content corresponding to the video data adjusted to be suitable for the size of the display screen 353 and the presentation position set to the right is displayed.

  As described above, the presentation priority is calculated based on the user request information or the content metadata, and the divided screen size and the presentation position on the display screen are changed and displayed according to the calculated presentation priority. As a result, the user can view a plurality of contents with a desired balance simply by operating a remote controller, a touch panel, or the like to strongly request viewing of a predetermined channel.

  In addition, when the size of the divided screen is changed, the transition of the position of the divided screen is displayed as if the curtain is fluttering, so that it is possible to provide the user with a home-like impression and a sense of familiarity. .

  As described above, a comfortable viewing environment can be provided to the user.

  Next, the audio adjustment output process in step S20 in FIG. 15 will be described with reference to the flowchart in FIG.

  When the control information is supplied from the presentation balance setting unit 103, the audio adjustment unit 122 starts the audio adjustment output process of FIG. In FIG. 18, the case of the audio adjustment unit 122-3 that adjusts the audio data of channel 3 will be described.

  Audio data of the content of the communication partner is input as the channel 3 input from the communication unit 73 to the volume adjustment unit 151 of the audio adjustment unit 122-3.

  In step S51, the volume adjusting unit 151 adjusts the volume of the audio data of the channel 3 according to the control information of the channel 3 set by the presentation balance setting unit 103, and the audio data whose volume is adjusted is converted into the sound quality adjusting unit. It outputs to 152. That is, the volume adjustment unit 151 adjusts the volume so that the volume is set according to the presentation priority by the presentation balance setting unit 103.

  In step S52, the sound quality adjusting unit 152 adjusts the sound quality of the sound data from the volume adjusting unit 151 according to the control information of the channel 3 set by the presentation balance setting unit 103, and the sound data whose sound quality has been adjusted is used as the sound source. The data is output to the position adjustment unit 153. That is, the sound quality adjustment unit 152 adjusts the sound quality so that the clarity is set according to the presentation priority by the presentation balance setting unit 103.

  In step S53, the sound source position adjustment unit 153 adjusts the sound source position of the sound data from the sound quality adjustment unit 152 according to the control information of the channel 3 set by the presentation balance setting unit 103, and the sound whose sound source position is adjusted. The data is output to the audio mixer unit 57. That is, the sound source position adjustment unit 153 adjusts the audio data of channel 3 so that the position of the divided screen on the display screen becomes the sound source position.

  The processing in steps S51 to S53 described above is also executed in the audio adjustment units 122-1, 122-2, 122-4 to 122-8 that adjust the audio data of channels 1, 2, 4 to 8. As a result, the optimally adjusted audio data of the channels 1 to 8 is input to the audio mixer unit 57.

  In step S <b> 54, the audio mixer unit 57 combines the audio data of the channels 1 to 8 and outputs the combined video data to the audio output unit 63.

  As a result, as described above with reference to FIGS. 7 and 8, the audio output unit 63 outputs audio adjusted so that the audio of the corresponding channel can be heard from the position of the divided screen on the display screen.

  In the example of FIG. 18, the audio data of channels 1 to 8 is adjusted and synthesized so that it can be heard from the position of the corresponding divided screen, and output. However, the adjustment output method of audio data is as follows. For example, only the audio data of the channel with the highest presentation priority may be adjusted and output, or the audio data of the channel whose presentation priority is higher than a predetermined threshold value. It is also possible to adjust and output only.

  As described above, not only video data but also audio data can be adjusted according to the presentation priority or the position of the divided screen whose size is set according to the presentation priority.

  Thereby, the user can hear the sound of the desired content from the position of the divided screen on which the content is displayed. That is, a comfortable voice environment can be provided.

  In the above description, an example of a display screen constituted by a plurality of divided screens obtained by dividing the effective display area horizontally has been described, but the screen dividing method is not limited to horizontal division.

  FIG. 19 is a diagram illustrating another example of the display screen output from the video output unit 62. In the example of FIG. 19, display screens 401 to 403 are shown. Note that the display screens 401 to 403 differ only in the direction of movement of the frames of the divided screens. Therefore, the audiovisual special effects similar to those of the display screen 201 described above with reference to FIGS. 9 and 10 are added. You can also

  The display screen 401 includes divided screens 411-1 to 411-N for displaying N channels, in which the effective display area is divided vertically into N. On the right side of the video displayed on the divided screens 411-1 to 411-N, an OSD video is included to specify the content of the channel (in this case, the channel number).

  For example, if the presentation priority of the channel 3 is increased and the size of the divided screen 411-3 of the channel 3 is set to be large, the frame of the divided screen 411-3 is moved up and down as indicated by the arrows U1 and D1. Accordingly, the frame and position of other divided screens move up or down accordingly.

  The display screen 402 is composed of divided screens 421-1 to 421-N for displaying N channels, in which the effective display area is divided into diagonally downward N pieces. In the center of the video displayed on the divided screens 421-1 to 421-N, an OSD video is included to specify the contents of the channel (in this case, the channel number).

  For example, when the presentation priority of the channel 3 is increased and the size of the divided screen 421-3 of the channel 3 is set to be large, the frame of the divided screen 411-3 is displayed at the upper left as shown by the arrows U2 and D2. The frame and position of other divided screens move in the upper left or lower right direction accordingly.

  In the case of the display screen 403, the video output unit 62 includes a display formed on a circular table, for example, and the display screen 403 divides the display area into N pieces in a sector shape with the center of the circular display as an axis. The divided screens 431-1 to 431-N for displaying the N channels are configured.

  In the example of FIG. 19, the communication partner displayed on the divided screen (in the example of FIG. 19, the divided screen 431-3) positioned in front of the divided screen of the display screen 403 by the user A. Talking with the other party while watching the video.

  On the center side of the video displayed on the divided screens 431-1 to 431-N, an OSD video is included for specifying the contents of the channel (in this case, the channel number).

  For example, when the presentation priority of the channel 3 is increased and the size of the divided screen 431-3 of the channel 3 is set to be large, the frame of the divided screen 431-3 is a circle as shown by the arrows U3 and D3. It spreads in the left-right direction along the circumference, and accordingly, the frames and positions of the other divided screens move in the left-right direction along the circumference.

  As described above, by using a split screen obtained by dividing the display screen by a method other than horizontal splitting, for example, a content image is displayed on a split split screen that is horizontally split, such as content in which characters are arranged horizontally. It is possible to provide a display screen with high visibility to the user when displaying content that is easy to understand when displayed on a vertically divided screen rather than when displaying In addition, display of various contents can be supported.

  In the above description, an example in which a two-dimensional display screen is displayed on the video output unit 62 has been described. However, as shown in FIG. Type video output device 441 or hemispherical video output device 442 may be used.

  FIG. 20 is a diagram illustrating another configuration example of the video output unit 62. In the example of FIG. 20, for example, an omnidirectional video output device 441 that outputs an omnidirectional video to a screen 451 that extends in all directions, and a hemispherical video output that outputs video to a screen 452 formed in a hemispherical shape. A device 442 is shown.

  The omnidirectional video output device 441 displays, for example, an omnidirectional video image captured by a omnidirectional camera or the like on a screen 451 formed over the inner circumference of a cylinder. By covering the periphery of the user A located at the center of the cylinder with an image, the user A is provided with a high sense of realism (immersive feeling).

  The screen 451 is composed of divided screens 461-1 to 461-N in which the effective display area is divided into N along the circumference, and the divided screen 461-1 is similar to the above-described example of the two-dimensional display screen. It is also possible to display the content of each channel on each of ˜461-N.

  In the example of FIG. 20, the omnidirectional video output device 441 formed in a cylinder is shown, but it may be configured to be formed in a spherical surface.

  The hemispherical video output device 442 displays an image on a screen 452 formed on the inner surface of a hemispherical shape that is a shape obtained by dividing a sphere in half. Like the omnidirectional video output device 441, the hemisphere It is possible to provide the user A who views the video from the center of the screen with a high sense of presence (immersive feeling) covered with the video displayed on the screen 452.

  This screen 452 is composed of divided screens 471-1 to 471-4 in which the effective display area is divided into N (in this case, 4), and the divided screen 471 is similar to the above-described example of the two-dimensional display screen. It is also possible to display the contents of each channel on -1 to 471-4.

  That is, the present invention can be applied not only to a two-dimensional display screen but also to an omnidirectional video output device 441, a hemispherical video output device 442, and the like.

  Therefore, comfortable viewing of content is also provided in the omnidirectional video output device 441 and the hemispherical video output device 442.

  As described above, when the contents of a plurality of channels are presented, the display size (that is, the display area) of the divided screen for displaying the channels is changed and displayed according to the presentation priority for each channel. Therefore, it is possible to provide the user with an easy-to-see display screen according to the user's purpose.

  In the above description, the content presentation control apparatus 31 that can acquire various types of content such as broadcast content, distribution content, stored content, and content of a communication partner can be used. However, the types of content are not limited to these, and it is not always necessary to acquire all of the plurality of types of content.

  Therefore, the present invention provides a device that does not have a network communication function but has a function of receiving a broadcast signal, a device that has a recording function and a broadcast signal reception function, or a communication partner and a mutual content via a network. The present invention is also applied to a device having a communication function for transmitting / receiving.

  That is, in the case of an apparatus having a video reception function for receiving a broadcast signal, a plurality of broadcast contents (television broadcast programs) can be optimally displayed according to the user's request level, metadata, and the like. In addition, for example, in the case of a device with a recording function and a broadcast signal receiving function, not only a plurality of broadcast contents but also recorded contents can be optimally displayed according to the user's request level, metadata, etc. Can do.

  Furthermore, in the case of an apparatus having a communication function for transmitting and receiving content to and from each other via a network, the contents of a plurality of communication partners can be optimally displayed according to the degree of user request.

  As described above, the present invention can be applied to television receivers, personal computers, mobile phones, other PDA devices, and CE devices such as AV devices and household appliances that can present content. Can do.

  The series of processes described above can be executed by hardware or can be executed by software. When a series of processing is executed by software, a program constituting the software may execute various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a program recording medium in a general-purpose personal computer or the like.

  FIG. 21 is a block diagram showing an example of the configuration of a personal computer 501 that executes the above-described series of processing by a program. A CPU (Central Processing Unit) 511 executes various processes according to a program stored in a ROM (Read Only Memory) 512 or a storage unit 518. A RAM (Random Access Memory) 513 appropriately stores programs executed by the CPU 511 and data. These CPU 511, ROM 512, and RAM 513 are connected to each other by a bus 514.

  An input / output interface 515 is also connected to the CPU 511 via the bus 514. The input / output interface 515 is connected to an input unit 516 including a keyboard, a mouse, and a microphone, and an output unit 517 including a display and a speaker. The CPU 511 executes various processes in response to commands input from the input unit 516. Then, the CPU 511 outputs the processing result to the output unit 517.

  A storage unit 518 connected to the input / output interface 515 includes, for example, a hard disk, and stores programs executed by the CPU 511 and various data. A communication unit 519 communicates with an external device via a network such as the Internet or a local area network.

  Further, the program may be acquired via the communication unit 519 and stored in the storage unit 518.

  A drive 520 connected to the input / output interface 515 drives a removable medium 521 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and drives the program or data recorded therein. Get etc. The acquired program and data are transferred to and stored in the storage unit 518 as necessary.

  Note that the form of the program is not particularly limited as long as the above-described series of processes can be executed as a whole. For example, the module configuration may include a module corresponding to each of the blocks described above, a module in which some or all of the functions of several blocks are combined, or the functions of the blocks are divided. It may be a module configuration made up of modules. Or the program which has only one algorithm may be sufficient.

  As shown in FIG. 21, a program recording medium for storing a program that is installed in a computer and can be executed by the computer is a magnetic disk (including a flexible disk), an optical disk (CD-ROM (Compact Disc-Read Only). Memory), DVD (Digital Versatile Disc), a magneto-optical disk, a removable medium 521 which is a package medium made of a semiconductor memory, or the like, a ROM 512 in which a program is temporarily or permanently stored, or a storage unit 518 It is comprised by the hard disk etc. which comprise. The program is stored in the program recording medium using a wired or wireless communication medium such as a local area network, the Internet, or digital satellite broadcasting via a communication unit 519 that is an interface such as a router or a modem as necessary. Done.

  Here, in this specification, the processing steps for describing a program for causing a computer to perform various types of processing do not necessarily have to be processed in time series according to the order described in the flowchart, but in parallel or individually. This includes processing to be executed (for example, parallel processing or processing by an object).

  Further, the program may be processed by a single computer, or may be distributedly processed by a plurality of computers. Furthermore, the program may be transferred to a remote computer and executed.

  In the present specification, the term “system” represents the entire apparatus constituted by a plurality of apparatuses.

  22 to 33 are diagrams showing an example of a monitor television receiver that displays a display screen according to an embodiment of the present invention. That is, the monitor television receiver is an example of the configuration of the video display unit 62 in FIG. 3, and is configured using, for example, a flat display such as an LCD or a PDP.

  FIG. 22 is a front view. In FIG. 22, a display screen of the energized state is shown. FIG. 23 is a rear view. FIG. 24 is a plan view. Since the bottom view is the same as the plan view, it is omitted. FIG. 25 is a right side view. Since the left side view is the same as the right side view, it is omitted.

  FIG. 26 is a first front view showing a changing state. FIG. 27 is a second front view showing a changed state. FIG. 28 is a third front view showing a changing state. FIG. 29 is a fourth front view showing a changed state. FIG. 30 is a fifth front view showing a changing state.

  That is, as shown in the front view, in the normal display state, a plurality of divided screens are displayed equally. A plurality of content screens are displayed on a plurality of divided screens, and specific information (for example, channel numbers, content names, etc.) for allowing the user to specify the contents of the plurality of contents is displayed at the bottom of each divided screen. ) Is displayed.

  In the normal display state, when the third split screen from the left is selected by the user, as shown in the first and second front views, the changing state is changed according to the user's selection. The screen display changes to the changed state. In addition, when the rightmost divided screen is selected by the user in a state where the second front view is changed, as shown in the third and fourth front views, the change is made according to the user's selection. The screen display changes to the changed state by transitioning the inside state.

  Further, in the state where the fourth front view is changed, when the user gives an instruction for equal display, as shown in the fifth front view and the front view, the state being changed is changed according to the user's selection. Transitions and the screen display changes to the changed state.

  FIG. 31 is a first reference diagram illustrating a display example. FIG. 32 is a second reference diagram illustrating a display example of a changing state. FIG. 33 is a third reference diagram illustrating a display example of the changed state.

  That is, as shown in the first reference diagram, the display screen is composed of N divided screens without any gaps, and videos of different contents are displayed on the respective divided screens. Also, below the content video, channel numbers for allowing the user to identify the corresponding content are displayed.

  In the state of the first reference diagram, when the third divided screen from the left is selected by the user, the display screen changes the state of the second reference diagram and changes to the state of the third reference diagram. That is, as shown in the second reference diagram, when the left frame of the third split screen from the left moves to the left and the right frame moves to the right, the lower ends of the left and right frames are As shown by the dotted lines, each moves in a direction opposite to the moving direction with a delay from the movement of the upper end portions of the left and right frames, and finally, as shown in the third reference diagram. In addition, the area of the third divided screen from the left changes so as to increase.

  Also, at this time, as shown in the second reference diagram, when the third divided screen from the left moves in accordance with the change in the third divided screen from the left, when the frame moves, The lower end of the frame moves behind the movement of the upper end of the frame, as indicated by the dotted lines, so as to fly in the direction opposite to the moving direction, and is finally represented in the third reference diagram. As described above, in accordance with the change in the area of the third divided screen from the left, the areas of the divided screens other than the third one from the left also change.

  In the above description, the monitor television receiver is used. However, as long as a plurality of content videos are displayed, the present invention can be applied to a monitor included in a personal computer or a portable terminal.

It is a figure which shows the example of the conventional multiple screen division | segmentation display. It is a figure which shows the other example of the conventional multiple screen division | segmentation display. It is a figure which shows the structural example of the information processing system of this invention. It is a block diagram which shows the structural example of the presentation balance control part of FIG. It is a block diagram which shows the structural example of the presentation balance adjustment part of FIG. It is a block diagram which shows the structural example of the video adjustment part of FIG. 5, and an audio | voice adjustment part. It is a figure which shows the example of a display of a display screen. It is a figure which shows the other example of a display of the display screen of FIG. It is a figure explaining the audiovisual special effect showing the transition of the display state of a display screen. It is a figure explaining the audiovisual special effect showing the transition of the display state of a display screen. It is a figure explaining the adjustment method of video data and audio | voice data. It is a figure which shows the example of the display screen on which the image | video corresponding to the image data after adjustment is displayed. It is a figure which shows the other example of the display screen on which the image | video corresponding to the image data after adjustment is displayed. It is a figure explaining the further another example of the adjustment method of video data, and the display screen on which the video data after adjustment is displayed. It is a flowchart explaining the content presentation control processing of the content presentation control apparatus of FIG. It is a figure explaining the image adjustment output process of the image adjustment part of FIG. It is a flowchart explaining the image | video adjustment output process of step S19 of FIG. It is a flowchart explaining the audio | voice adjustment output process of step 20 of FIG. It is a figure which shows the other example of a display screen. It is a figure which shows the other structural example of the video output part of FIG. It is a block diagram which shows the structural example of the personal computer to which this invention is applied. It is a front view of the monitor television receiver which displays the display screen of this invention. It is a rear view. It is a top view. It is a right view. It is the 1st front view showing the state under change. It is the 2nd front view showing the changed state. It is the 3rd front view showing the state under change. It is the 4th front view showing the changed state. It is a 5th front view showing the state under change. FIG. 10 is a first reference diagram illustrating a display example. It is a 2nd reference figure which shows the example of a display of the state in change. It is a 3rd reference figure which shows the example of a display of the changed state.

Explanation of symbols

  31-1, 31-2 Content presentation control device, 32 network, 33 distribution server, 34 terrestrial broadcasting station, 35 BS digital broadcasting satellite, 51 tuner, 53 channel data supply unit, 54 presentation balance control unit, 55 presentation balance adjustment Unit, 56 video mixer unit, 57 audio mixer unit, 58 input / output interface, 61 user information input unit, 62 video output unit, 63 audio output unit, 64 video audio input unit, 71 content acquisition unit, 72 content storage unit, 73 Communication unit, 101 information acquisition unit, 102 presentation priority calculation unit, 103 presentation balance setting unit, 121, 121-1 to 121-N video adjustment unit, 122, 122-1 to 122-N audio adjustment unit, 141 transparency adjustment Part, 142 Size adjustment part, 143 OSD adjustment part 144 positioning unit, 151 volume control, 152 sound quality adjustment section, 153 a sound source position adjustment section

Claims (10)

In an information processing apparatus that performs processing for displaying a plurality of contents on a display screen,
Priority calculation means for calculating presentation priorities of a plurality of contents respectively displayed on a plurality of divided screens that constitute the display screen without gaps based on request information according to user operations;
Presentation information setting means for setting the sizes of the plurality of divided screens according to the presentation priority of the plurality of contents calculated by the priority calculation means;
Video adjusting means for adjusting video data of content displayed on the divided screen according to the divided screen whose size is set by the presentation information setting means;
Video superimposing means for superimposing video data of a plurality of contents adjusted by the video adjusting means, and outputting video data corresponding to the display screen ;
Audio adjusting means for adjusting audio data of the content displayed on the divided screen so that the audio of the content displayed on the divided screen can be heard from the position of the divided screen whose size is set by the presentation setting means. Information processing device. When the size set by the presentation information setting means is changed, one end of the frame of the divided screen while moving from the position of the divided screen of the size before the change to the position of the divided screen of the size after the change The information processing apparatus according to claim 1, wherein the unit moves to a position of the divided screen having the changed size after the other end so as to fly in a direction opposite to the moving direction. The presentation setting means further sets specific information for allowing the user to specify the content of the content to be displayed on the divided screen,
The information processing apparatus according to claim 1, wherein the video adjustment unit further superimposes video data corresponding to the specific information set by the presentation setting unit on the video data of the content.   The presentation information setting unit changes a value for uniquely setting the sizes of the plurality of divided screens according to the presentation priority of the plurality of contents calculated by the priority calculation unit. And set the size of each of the plurality of split screens.
  The information processing apparatus according to claim 1. The information processing apparatus according to claim 1, wherein the priority calculation unit calculates a presentation priority of the plurality of contents based on metadata included in the plurality of contents. A content receiving means for receiving the content of the communication partner from other information processing apparatuses that communicate with each other via the network;
The plurality of contents include content of a communication partner received by the content receiving means,
The information processing apparatus according to claim 5, wherein the metadata includes request information based on an operation of the communication partner as metadata of the content of the communication partner. It further comprises signal receiving means for receiving a broadcast signal,
The information processing apparatus according to claim 1, wherein the plurality of contents include content corresponding to a broadcast signal received by the signal receiving unit. It further comprises content acquisition means for acquiring content from the information providing device connected to the network,
The information processing apparatus according to claim 1, wherein the plurality of contents include content acquired by the content acquisition unit. In an information processing method of an information processing apparatus that performs processing for displaying a plurality of contents on a display screen,
A priority calculating step for calculating presentation priorities of a plurality of contents respectively displayed on a plurality of divided screens that configure the display screen without gaps based on request information according to a user operation;
A presentation information setting step of setting the sizes of the plurality of divided screens according to the presentation priority of the plurality of contents calculated by the processing of the priority calculation step;
A video adjustment step for adjusting video data of content displayed on the divided screen according to the divided screen whose size is set by the processing of the presentation information setting step;
A video superimposing step of superimposing video data of a plurality of contents adjusted by the processing of the video adjusting step and outputting video data corresponding to the display screen ;
An audio adjustment step for adjusting audio data of the content displayed on the divided screen so that the audio of the content displayed on the divided screen can be heard from the position of the divided screen whose size is set by the processing of the presentation setting step; An information processing method including: A program for causing a computer to perform processing for displaying a plurality of contents on a display screen,
A priority calculating step for calculating presentation priorities of a plurality of contents respectively displayed on a plurality of divided screens that configure the display screen without gaps based on request information according to a user operation;
A presentation information setting step of setting the sizes of the plurality of divided screens according to the presentation priority of the plurality of contents calculated by the processing of the priority calculation step;
A video adjustment step for adjusting video data of content displayed on the divided screen according to the divided screen whose size is set by the processing of the presentation information setting step;
A video superimposing step of superimposing video data of a plurality of contents adjusted by the processing of the video adjusting step and outputting video data corresponding to the display screen ;
An audio adjustment step for adjusting audio data of the content displayed on the divided screen so that the audio of the content displayed on the divided screen can be heard from the position of the divided screen whose size is set by the processing of the presentation setting step; A program that causes a computer to perform processing including

Images