WO2014208268A1

WO2014208268A1 - Video content display device and video content display method

Info

Publication number: WO2014208268A1
Application number: PCT/JP2014/064318
Authority: WO
Inventors: 正宏塩井; 伊藤　典男; 毅金子; 久雄熊井; 敦稔〆野; 琢也岩波
Original assignee: シャープ株式会社
Priority date: 2013-06-24
Filing date: 2014-05-29
Publication date: 2014-12-31
Also published as: JPWO2014208268A1

Abstract

A video content display device equipped with: a display unit which displays video content and an application screen; and a display layout determination unit which, when the aspect ratio of the display unit and the aspect ratio of the video content differ, determines the display layout in accordance with a prescribed rule so as to display the application screen in a margin generated when the video content is displayed in full-screen mode while the aspect ratio of the video content is maintained.

Description

Video content display apparatus and video content display method

The present invention relates to an apparatus for displaying video content and an application screen.

It has been a long time since digital broadcasting, in which video and audio are compressed as digital data and multiplexed, is put into practical use. In recent years, applications that present information about programs and performers while watching broadcast programs, and applications that exchange information related to programs with remote people in cooperation with SNS (Social Networking Service) are the same screen as broadcast Efforts to display are being made.

There are various applications on the Internet, but they are often written in the language of HTML (HyperText Markup Language), so the application displayed together with the broadcast video may also be an application written in HTML. desired.

By the way, in order to display the application screen on the same screen while the broadcast video is displayed on the entire receiver screen, the application screen must be superimposed on the broadcast video. The location where the application screen is displayed is specified from the viewpoint of where the best viewing is performed when the image is superimposed.

In current digital broadcasting, video content with a 16: 9 aspect ratio is broadcast, and a receiver generally has a screen with a 16: 9 aspect ratio.

However, there are displays with aspect ratios other than 16: 9, specifically 16:10 or 21: 9, and such a display performs full screen display while maintaining the aspect ratio of the broadcast video. And a margin is generated on the screen.

Even when an application screen is displayed on such a display, the display position of the application screen is set assuming a general 16: 9 aspect ratio screen. Therefore, it must be displayed superimposed on the broadcast video.

Therefore, in Patent Document 1, the minimum display size of the broadcast video screen is set, and the broadcast video screen is reduced on the receiver side so that the broadcast video screen and the application screen do not overlap based on the information on the display size of the application. A technique for determining and displaying a size, a display position, and a display position of an application screen is described.

In HTML, it is possible to apply an optimal style sheet for each environment of a display device. For example, a layout for a 16: 9 display, a layout for a 16:10 display, and a 21: 9 display The layouts for 16:10 and 21: 9 displays are prepared so that applications are arranged in the respective margin portions, so that the margin portions are displayed on the 16:10 and 21: 9 displays. Applications can be displayed on the screen.

Japanese Patent Publication “JP 2013-009334”

However, in the case of the correspondence of Patent Document 1, there is a problem that the broadcast video is reduced and displayed.

In addition, in the case of dealing with the application of the optimal style sheet for each environment of the display device, it is troublesome to specify the layout for all environments, and it is not possible to handle the aspect ratio display that came out later. There is a point.

In order to solve the above-described problem, the first means of the present invention provides a display unit that displays video content and an application screen, an aspect ratio of the display unit, and an aspect ratio of the video content that are different from each other. A display layout determining unit that determines a display layout according to a predetermined rule so that the application screen is displayed in a margin portion generated when the video content is displayed on the entire screen while maintaining the ratio. To do.

The second means is that in the first means, the predetermined rule is that the application screen is displayed in the margin portion only when the size of the application screen fits in the margin portion, and otherwise, It is a rule that determines a display layout so that the application screen is displayed at a specified position.

According to a third means, in the first means, if the size of the application screen fits in the margin part, the application screen is displayed in the margin part as it is when the size of the application screen fits in the margin part. In this case, the application screen is a rule for determining a display layout so that the application screen is reduced so as to fit in the blank portion and displayed in the blank portion.

The fourth means is characterized in that, in the first means, a display control information analysis unit for analyzing information on conditions for determining the display layout is further provided.

According to a fifth means, in the fourth means, the condition information for determining the display layout is information indicating whether or not the application screen can be moved to the margin part, and reduced display. It is characterized by including at least one of information indicating whether or not this is possible and information indicating the size of reduction to be allowed.

A sixth means is a video content display method for displaying video content and an application screen on a display unit, the step of displaying the video content on the display unit, and the video content on the display unit not being displayed. A step of calculating a size of a margin part, a step of analyzing a display position of the application screen, a display size of the application screen and the margin part, and determining a display layout; and the display unit displays the application screen according to the display layout. And a step of displaying the information.

According to the present invention, the broadcast video is not reduced on a display with an aspect ratio other than 16: 9, and the application screen is not superimposed on the broadcast video, so that the broadcast can be easily viewed.

It is a block diagram which shows schematic structure of an example of the video content display apparatus which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the flow of the process according to the 1st rule which determines the display layout in the video content display apparatus of this invention. It is a figure which is displaying the video content and application of an aspect ratio of 16: 9 on a display of an aspect ratio of 16: 9. It is a figure which is displaying the video content and application of an aspect ratio of 16: 9 on a display of an aspect ratio of 16:10. It is a figure which is displaying the video content and application of an aspect ratio of 16: 9 on a display of an aspect ratio of 21: 9. It is another figure which is displaying the video content and application of a 16: 9 aspect ratio with the display of a 21: 9 aspect ratio. It is a flowchart which shows the flow of the process according to the 2nd rule which determines the display layout in the video content display apparatus of this invention. It is a figure which is displaying the video content and application of an aspect ratio of 16: 9 on a display of an aspect ratio of 16: 9. It is a figure which is displaying the video content and application of an aspect ratio of 16: 9 on a display of an aspect ratio of 16:10. It is a figure which is displaying the video content and application of an aspect ratio of 16: 9 on a display of an aspect ratio of 16:10. It is a flowchart which shows the flow of the process according to the 3rd rule which determines the display layout in the video content display apparatus of this invention. It is a figure which is displaying the video content and application of an aspect ratio of 16: 9 on a display of an aspect ratio of 16:10. It is a figure which is displaying the video content and application of an aspect ratio of 16: 9 on a display of an aspect ratio of 16: 9. It is a figure which is displaying the video content and application of an aspect ratio of 16: 9 on a display of an aspect ratio of 16:10. It is a figure which is displaying the video content and application of an aspect ratio of 16: 9 on a display of an aspect ratio of 16:10. It is a figure which is displaying the video content and application of an aspect ratio of 16: 9 on a display of an aspect ratio of 16:10. It is a block diagram which shows schematic structure of an example of the video content display apparatus which concerns on the 3rd Embodiment of this invention. It is a flowchart which shows the flow of a process at the time of determining a display layout according to the display control information in the video content display apparatus of this invention. It is a flowchart which shows the flow of a process at the time of determining a display layout according to another display control information in the video content display apparatus of this invention. It is a block diagram which shows schematic structure of an example of the video content apparatus which concerns on the 4th Embodiment of this invention.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[Embodiment 1]
FIG. 1 is a block diagram showing a schematic configuration of an example of a video content display apparatus according to the first embodiment of the present invention.

As shown in the figure, the video content display device 1001 includes a control unit 101, a video content reception unit 102, an application acquisition unit 103, an application information analysis unit 104, a display layout determination unit 105, and a display unit 106. ing.

The control unit 101 is a functional unit for controlling the entire video content display device 1001.

The video content receiving unit 102 is a part that is connected to a digital broadcast tuner (not shown), a communication network, or a recording medium that stores the content, receives the content including the video data, and acquires the video data. Since video data is generally encoded, the decoding is also performed in this part.

Also, in order to realize an application related to a program, information related to the application (application start / end information, information on a server distributing the application, etc., hereinafter referred to as application control information) is multiplexed on the broadcast video. Therefore, the information is extracted in this part.

The application acquisition unit 103 is a part that connects to a communication network (not shown) and acquires an application to be operated on the video content display device 1001. Information on the destination from which the application is acquired may be acquired from the above-described application control information, or the information on the acquisition destination in the display device is pre-listed and owned, and may be selected from there, or the user May be acquired by directly inputting the acquisition destination address. Further, the application to be operated may be configured to be multiplexed with content including video data received by the video content receiving unit 102 and extracted from the content.

The application information analysis unit 104 is a part that analyzes information about the application acquired by the application acquisition unit 103. This information includes the display position and display size of the application screen. These may be included in the application itself, or may be included in the application control information described above.

The display layout determination unit 105 is a part that determines the screen layout of the video received by the video content reception unit 102 and the application acquired by the application acquisition unit 103. Specifically, the display layout determination unit 105 displays the video display screen according to a predetermined rule. This is a part for determining the position, display size, display position and display size of the application screen.

The display unit 106 is a part that outputs a screen according to the layout of the video display screen and the application screen determined by the display layout determination unit 105.

In order to play back the content on the video content display device, the content distribution device may generate the video content and related applications and distribute the video content to the video content display device.

In the following description, the video content is assumed to be 16: 9 assuming digital broadcasting and the display is 16: 9, 16:10, and 21: 9. However, the aspect ratio is not particularly limited. The video content may be standard definition TV 4: 3, digital cinema 256: 135, other aspect ratios, and display aspect ratios of 4: 3, 5: 4, etc. Aspect ratio.

In addition, there are devices that display horizontally when held horizontally, and display vertically when held vertically, such as smartphones and tablets, but when such devices had a 16: 9 display, When displaying broadcast video content, in horizontal display, the full screen is displayed without changing the aspect ratio of the broadcast video and there is no margin, and in vertical display, the full screen is displayed without changing the aspect ratio of the broadcast video. The normal display method is that the portion is almost half of the screen.

When applied to such a device, the horizontal display time is interpreted as a 16: 9 display, and the vertical display time is interpreted as a 9:16 display, so that an optimum layout is determined in each case. good.

When a 16:10 display is provided, the horizontal display is interpreted as a 16:10 display and the vertical display is interpreted as a 10:16 display, which is optimal for each case. The layout may be determined. It should be noted that the same interpretation may be applied even when a display having another aspect ratio is provided.

As described above, the display layout determination unit 105 determines the display position and display size of the video display screen and the display position and display size of the application screen according to a predetermined rule in order to automatically determine the layout. Since there can be several rules as the predetermined rule, the rules are listed below.

The first rule is that when a full screen is displayed while maintaining the aspect ratio of the video content, a display in which a blank portion is generated, the application screen is moved to the blank portion and displayed. The display layout will be determined.

FIG. 2 is a diagram showing the first rule as a flowchart.

First, in S01, the video content is received and displayed on the full screen while maintaining the aspect ratio.

Next, the process proceeds to S02, and the size of the margin part where the video content is not displayed on the display is calculated.

Next, the process proceeds to S03 and an application is acquired.

Next, the process proceeds to S04, and the display position and display size of the acquired application screen are analyzed.

Next, the process proceeds to S05, the application screen is displayed in the margin, and the process ends.

Since a plurality of applications may be acquired, in that case, the process returns to S03 and the process for the next application is performed. When the next application is displayed in the margin portion, it may be displayed in an empty area in the margin portion.

When displaying multiple applications in the margin part, if the margin part is horizontally long, it should be arranged in the right direction sequentially from the left, and if it is vertically long, it may be arranged in the downward direction sequentially from the top. Absent. Further, it may be displayed centered when arranged, or may be displayed with left justification or top justification, but is not limited thereto.

The order in which these applications are arranged may be the order in which the applications are acquired, the raster scan order of the upper left coordinates of the display position specified for each application, and the priority of the arrangement order should be set in advance. Alternatively, the user may rearrange them after arranging them in a predetermined order, or the rearrangement order may be defined based on past user rearrangement information.

If a plurality of applications cannot be arranged in the margin, some applications may be displayed first, and then the applications to be displayed may be changed according to the user's operation. For example, when an operation that moves to the right in a row and moves to the right (such as pressing the right button, flicking to the right, or scrolling to the right) is performed, the applications displayed on the left end are erased, and By shifting to the left and displaying the next application that has not been displayed at the right end one after another, all the applications may be displayed. Here, the application to be displayed is changed from the user operation as a starting point, but the application to be displayed may be changed every certain time.

Alternatively, the application may be displayed gradually by performing scroll display according to the amount of movement instruction.

Alternatively, instead of displaying a plurality of applications side by side, they may be switched one after another at a certain time interval and displayed in the margin, or they may be switched one after another by a user operation instead of a certain time. Alternatively, when the timing of switching the display contents in each application occurs, the application may be displayed, or the application to be displayed may be switched in combination.

Also, a combination of displaying a plurality of applications side by side and switching a plurality of applications may be displayed. That is, when there are six applications, two applications may be displayed first, then three applications may be displayed, and finally one application may be displayed.

Also, translucent colors may be used so that the video can be seen even when the application is superimposed on the video, but such a modification is not necessary when displaying in the margin part. May be omitted, or automatic correction may be performed to increase the color saturation or brightness of the application screen. Further, the margin color may be set to a color opposite to the application color so that the application to be displayed stands out.

FIG. 3 is a diagram in a case where a 16: 9 aspect ratio video content C1 and an application C2 are displayed on a 16: 9 aspect ratio display having a horizontal width of 1920 pixels and a vertical width of 1080 pixels.

Since the aspect ratio of the video content and the display is the same, when the video content is displayed on the full screen, there is no blank space.

Therefore, the application is displayed superimposed on the video content at the designated position. This figure is an example in which the upper left coordinate of the application is set near the origin. In the HTML world, the application display position and display size are generally specified by the CSS (Cascading Style Sheet) top property and left property, and the width and height properties are specified by the width property and height property. However, it is not limited to this.

FIG. 4 is a 16: 9 aspect ratio display of 16: 9 on a 16: 9 display with a 16: 9 aspect ratio with a horizontal width of 1920 pixels and a vertical width of 1200 pixels. It is a figure in case the video content C3 and the application C4 are displayed.

Since the aspect ratio of the display is longer than the aspect ratio of the video content, when the video content is displayed on the full screen, a margin is generated in the vertical direction. In the example in this figure, the horizontal width is 1920 pixels and the vertical length is below the video content. The video content is displayed so as to generate a margin part P1 having a width of 120 pixels.

Here, according to the first rule, the application screen is moved to the blank portion and displayed, so that the application C4 is displayed in the blank portion P1.

Here, the application C4 is displayed with the left margin of the margin part P1, but it may be displayed with the center or right justification, or these may be designated.

FIG. 5 shows a content displayed on a 16: 9 display as shown in FIG. 3 on a 21: 9 aspect ratio display with a horizontal width of 2560 pixels and a vertical width of 1080 pixels, and an aspect ratio of 16: 9. It is a figure in case the video content C5 and the application C6 are displayed.

Since the aspect ratio of the display is longer than the aspect ratio of the video content, when the video content is displayed on the full screen, a margin is generated in the left-right direction. In the example of this figure, the horizontal width is 640 pixels, and the vertical width The video content is displayed so as to generate a margin part P2 having a width of 1080 pixels.

Here, according to the first rule, the application screen is moved to the blank portion and displayed, so that the application C6 is displayed in the blank portion P2.

Here, the application C6 is displayed with the upper margin of the margin part P2, but it may be displayed with the center margin or the lower margin, or may be designated.

FIG. 6 shows a content displayed on a 16: 9 aspect ratio display as shown in FIG. 3 on a 21: 9 aspect ratio display with a horizontal width of 2560 pixels and a vertical width of 1080 pixels. It is a figure of another example in case the video content C7 of the aspect ratio and the application C8 are displayed.

Unlike the case of FIG. 5, the video content is displayed so that margins P3 and P4 having a horizontal width of 320 pixels and a vertical width of 1080 pixels are generated on the left and right of the video content.

The margin may be on either side as in FIG. 5, or it may be the same area on both sides as in FIG. 6, or the margin of the area allocated unevenly on both sides. It may be a part.

Further, in the case of FIG. 6, whether the application C8 is displayed in the left or right margin may be determined by setting of the display device, or may be specified by the user.

Up to now, it has been described that the application is moved uniformly to the margin part, but instead of moving uniformly, it can be specified whether to move to the margin part for each application by the user's designation or advance setting etc. You may do it. The designation may be such that whether or not the application can be moved can be set in units such as a program, a channel, and a broadcast time zone.

Also, depending on the type of application, whether to move or where to move may be determined. The type of application may be a menu, news, weather forecast, or performer information display. These types may be included in the application control information, or the information may be included in the application itself. As a method of including information in the application itself, the type of the application may be determined from tags and attributes indicating the meaning of the section tag, nav tag, and article tag in the HTML syntax that describes the application. The type of application may be set using the tag or attribute.

As a destination, it may be determined whether a certain type of application is preferentially displayed at the left end or upper end, or displayed in the center, and the order of arrangement when arranging in a row is preferred. It may be used at any time.

Also, if the broadcast video is displayed as a small screen instead of being displayed on the full screen, and the location where the application is displayed is designated as a position that does not overlap with the broadcast video, it will bother to move to the margin. You don't have to.

Also, another application may be operating in the margin. For example, a channel tuning or video adjustment application built in the display device is running in advance, or in cooperation with the application in the display device, a high-function remote control function can be performed on a mobile terminal such as a tablet at hand. There is a case where an application called a companion application that provides information or displays information related to a viewing program is operating on a blank portion instead of on a mobile terminal. When such an application is operating, other applications may be displayed in another area of the margin part, but may not be moved to the margin part.

In addition, when the margin part exists below the broadcast video display part, only the application located below the certain threshold position is moved to the lower margin part, so that the threshold position is exceeded. The application located on the upper side may be displayed as it is without moving, or when the margin part exists on the right side of the broadcast video display part, it is located on the right side of a certain threshold position. Only the application may be moved to the right margin, and the application located on the left side of the threshold position may be displayed as it is without moving.

This threshold value may be determined in advance by the display device, may be set by the user, or may be included in the application control information described above.

FIG. 8 is a diagram in a case where a video content C9 and an application C10 having an aspect ratio of 16: 9 are displayed on a display having an aspect ratio of 16: 9.

FIG. 9 shows the content displayed as shown in FIG. 8 on a 16: 9 aspect ratio display, and the 16:10 aspect ratio video content C11 and application C12 on a 16:10 aspect ratio display. FIG.

Unlike the case of FIG. 4, the display size of the application C12 has a shape that protrudes from the margin P5.

According to the first rule, the screen is displayed as shown in FIG. 9, but when the application screen spans the blank portion and the video screen in this way, there may be a sense of incongruity, so the second rule is the aspect of the video content. For a display that produces a margin when the full screen is displayed with the ratio maintained, if the application screen is the size that fits in the margin, a rule is set to move to the margin and display according to that rule. The layout will be determined.

FIG. 7 is a diagram showing the second rule as a flowchart.

Since S01 to S04 are the same processing as the flowchart of the first rule in FIG. 2, description thereof is omitted.

After S04, the process proceeds to S11, where the display size of the application screen is compared with the size of the margin part to determine whether the application fits in the margin part.

If it is determined that it will fit, the process proceeds to S12, the application is displayed in the margin, and the process is terminated.

If it is determined that it does not fit, the process proceeds to S13, the application is displayed as usual, and the process is terminated.

Since a plurality of applications may be acquired, in that case, the process returns to S03 and the process for the next application is performed. When the next application is displayed in the blank area, it may be displayed in the blank area.

In addition, when an application screen does not fit in the margin part, the application screen may be displayed as usual, or an application that is displayed in the margin part so that the area of the application displayed in the margin part is maximized. You may change the application displayed normally.

Or, if you set the priority to move to the margin part in the application and move to the margin part in order of priority, if an application does not fit in the margin part, the application with lower priority after that will be the margin part The application may not be moved, or if there is an application having a size that fits in the margin portion with low priority, the application may be moved to the margin portion.

FIG. 10 shows the content displayed as shown in FIG. 8 on a display with an aspect ratio of 16: 9, and video content C13 with an aspect ratio of 16: 9 on a display with an aspect ratio of 16:10 according to the second rule. And application C14 is displayed.

In this case, since the display size of the application C14 does not fit in the margin part P6, the application C14 is displayed at the designated position without moving to the margin part P6.

According to the second rule, the screen is displayed as shown in FIG. 10, but in this case, the blank portion is not used and a wasteful area is created. Therefore, as a third rule, in the case of a display in which a margin portion is generated when a full screen display is performed while maintaining the aspect ratio of the video content, if the application screen has a size that fits in the margin portion, the size of the margin remains as it is. Set the rule that the application screen is reduced to fit in the margin part and displayed in the margin part when the size does not fit in the part, and the display layout is determined according to the rule. I will do it.

FIG. 11 is a diagram showing the third rule as a flowchart.

Since S01 to S04 and S11 to S12 are the same as the flowchart of the second rule in FIG. 7, description thereof is omitted.

If it is determined in S11 that the application does not fit in the blank portion, the process proceeds to S21, the application screen is reduced to fit in the blank portion, the screen is displayed in the blank portion, and the process ends.

Also, when a certain application screen does not fit in the margin, only that application screen may be reduced, or all already displayed application screens may be reduced.

Also, when a plurality of application screens are reduced and displayed, the same reduction ratio may be used, or the character size may be reduced to the same size.

Or, if the application is reduced from a large screen size to a predetermined size and the other application still does not fit in the margin area, then the application is reduced in order, such as the next reduction from the screen size application to the predetermined size. Thus, it may be reduced until all applications can be displayed.

FIG. 12 shows the content displayed on the 16: 9 aspect ratio display as shown in FIG. 8 on the 16:10 aspect ratio display according to the third rule on the 16:10 aspect ratio display. It is a figure in the case of displaying the video content C15 and the application C16 having an aspect ratio of 16: 9.

In this case, since the display size of the application C16 does not fit in the margin portion P7, the application C16 is reduced to fit in the margin portion P7 and displayed in the margin portion P7.

In FIG. 12, the application C16 is reduced with the same aspect ratio, but only the direction that does not fit may be reduced. That is, in this case, the application C16 may be reduced only in the vertical direction.

Also, the application is usually composed of figures and characters, but it may be possible to prevent the characters from becoming difficult to see by increasing the reduction rate of the figures and reducing the reduction rate of the characters.

Also, as for the characters, the necessary display size may be reduced by leaving important characters and not displaying other characters. Examples of important characters include characters with heading and title tags, characters with large font sizes, and characters that stand out with modifications such as bold, but are not limited to these. good.

Also, the required display size may be reduced by reducing the character display area and performing scroll display to display the entire character.

Also, as described here, the display size may be reduced by combining some of the reduction in the character size itself, non-important character non-display, and scroll display.

By the way, depending on the application screen size and the size of the margin part, even if the application screen is displayed, the margin part may remain large. In that case, the application screen may be enlarged and displayed to make the application easier to see.

In addition, when a character string of supplementary information of an application that is not normally displayed is included, the blank portion may be used effectively by displaying the character string.

[Embodiment 2]
The display size of the application is not constant and may change midway.

For example, the display content may be changed by a user operation, the display content may be changed according to time, or the content to be displayed may be added or updated.

The following describes how to change the display layout in such a case.

FIG. 13 is a display having a 16: 9 aspect ratio, and displays the video content C17 and the application C18a having an aspect ratio of 16: 9. From the situation (A), the application C18a has the applications C18b, C18c, and C18d. It is a figure when it becomes an application comprised by three elements, and the display size changes and it will be in the condition of (B).

The element is a block specified by using a div tag or the like in the HTML syntax, and is not limited to the div tag, but may be anything as long as it can define the block.

In FIG. 13, the display size is changed by changing the number of elements constituting the application. However, even if the number of elements is not changed, the display size may be changed.

FIG. 14 shows the content displayed as shown in FIG. 13 on a 16: 9 aspect ratio display, and the 16:10 aspect ratio video content C19 and application C20a on a 16:10 aspect ratio display. FIG. 11 is a diagram when the application C20a is changed to an application composed of the three elements C20b, C20c, and C20d from the situation (C), and the display size is changed to the situation (D).

If the size of the application changes and extends downward as shown in FIG. 13, it protrudes downward on the screen and becomes invisible. Therefore, all the applications are displayed by extending upward without extending downward. To be.

FIG. 15 shows the content displayed as shown in FIG. 13 on a 16: 9 aspect ratio display, and the 16: 9 aspect ratio video content C21 and application C22a on a 16:10 aspect ratio display. Another example of the case where the application C22a becomes an application composed of the three elements of the applications C22b, C22c, and C22d and the display size is changed from the situation (E) in FIG. FIG.

As shown in FIG. 14, when the size of the application changes, if the application is stretched upward, a part of the application is superimposed on the video content. Therefore, the arrangement of elements constituting the application is changed from the vertical direction to the horizontal direction. If it is found that rearrangement fits in the margin part, the application is displayed in the margin part by rearranging in the horizontal direction.

Here, it is within the margin part without being reduced, but if it does not fit within the margin part even if it is rearranged in the horizontal direction, it may be reduced to fit in the margin part.

FIG. 16 shows the content displayed as shown in FIG. 13 on a 16: 9 aspect ratio display, and the 16:10 aspect ratio video content C23 and application C24a on a 16:10 aspect ratio display. (G), the application C24a becomes an application composed of three elements C24b, C24c, and C24d, and the display size has changed. First, the first element C24b is displayed (H). Then, the second element C24c is displayed after the user's operation or a certain period of time has elapsed, and the situation of (I) is reached, and further, the third element C24d is displayed after the user's operation or the certain period of time has elapsed ( It is a figure at the time of becoming the situation of J).

As shown in FIG. 15, when the size of the application is changed, if the arrangement of the application elements is rearranged from the vertical direction to the horizontal direction and displayed in the margin portion, the display may be reduced in some cases. Then, it may become too small and difficult to see.

Therefore, in FIG. 16, the application is excessively reduced by displaying the next element after the user's operation and the elapse of a certain time, and displaying all the elements by repeating it. It prevents it from becoming difficult to see.

[Embodiment 3]
FIG. 17 is a block diagram showing a schematic configuration of an example of a video content apparatus according to the third embodiment of the present invention. The video content display apparatus 2001 is different from the block diagram of the first embodiment in FIG. 1 in that a display control information analysis unit 201 is added.

The display control information analysis unit 201 is a part that analyzes information on conditions regarding a preset layout when the layout determination unit 105 determines the layout of the video screen and the application screen.

The information may be set in the HTML syntax describing the application by using a unique extension tag or attribute, or information to that effect is set in the application control information described above. Alternatively, information to that effect may be set in SI / PSI information describing program information.

In the description of FIG. 4, in the case of a display in which a blank portion is generated when a full screen is displayed while maintaining the aspect ratio of the video content, the first rule is that the application screen is moved to the blank portion and displayed. According to the above description, the application C4 is moved to the margin portion P1 and displayed.

However, depending on the application, there may be a problem if the display position is moved without permission. For example, if there is an application that displays information about each performer when multiple performers are displayed, information about the performer is presented beside the video of each performer being displayed. If the application is not displayed, the viewer does not know which information is related to whom.

That is, such an application can be said to be an example in which a malfunction occurs when it is moved to the margin.

Therefore, it may be possible to determine whether or not movement is possible on the display device side by adding to each application information indicating whether or not it is possible to move and display the margin.

In addition, it is not a method of adding information indicating whether or not to move to the margin part for display to all applications, and only the application that can move to the margin part is moved to the margin part and displayed. The display device interprets that the application to which the information was added can be moved to the blank portion, and interprets that the information cannot be moved to the blank portion if the information is not added. Such a method may be used.

Conversely, only for applications that cannot be moved to the margin part, information that prohibits moving to the margin part is added. On the display device side, the application to which the information has been added is added to the margin part. A method may be used in which it is interpreted that the portion cannot be moved, and if the information is not added, the portion is interpreted as being movable.

In addition, if there is no margin part, information indicating that the application is not displayed is added, so that it is not displayed on the terminal without the margin part, but is not displayed superimposed on the broadcast video. Sometimes it is possible to prevent the application from being overlaid.

FIG. 18 is a diagram showing a process of determining a layout according to the above information as a flowchart.

After S04, the process proceeds to S31, and it is determined whether or not information indicating whether the application can be moved to the margin is added.

If it is determined that it has been added, the process proceeds to S32, the application is displayed in the margin, and the process ends.

If it is determined that it has not been added, the process proceeds to S33, the application is displayed as usual, and the process ends.

Since a plurality of applications may be acquired, in that case, the process returns to S03 and the process for the next application is performed.

In the description of FIG. 12, in the case of a display in which a margin portion is generated when the entire screen is displayed while maintaining the aspect ratio of the video content, which is the third rule, when the application screen has a size that fits in the margin portion, The size of the application C16 is reduced by following the rule that the application screen is reduced to fit in the margin part and displayed in the margin part when the size is not fit. It is described that the display is moved to the blank portion P7.

However, some applications may be difficult to see if they are reduced too much.

Therefore, it may be possible to determine whether or not reduction display is possible on the display device side by adding information indicating whether or not reduction display is possible to each application.

FIG. 19 is a diagram showing a process of determining a layout according to the above information as a flowchart.

If it is determined in S11 that the application does not fit in the margin, the process proceeds to S41, and it is determined whether or not information indicating whether the application can be displayed in a reduced size is added.

If it is determined that it has been added, the process proceeds to S42, the application is reduced and displayed in the margin, and the process ends.

If it is determined that it has not been added, the process proceeds to S43, the application is displayed as usual, and the process ends.

Further, it may be information indicating a limit at the time of reduction, that is, not a binary value indicating whether or not reduction display is allowed, but may be reduced to a predetermined reduction level.

The reduction limit may be indicated by a ratio, may be indicated by an actual size when displayed on the display, or the vertical direction and the horizontal direction may be set independently.

Also, instead of the information indicating whether or not to reduce the display, information that may be reduced is added, and if there is no such information, it may be interpreted that the image cannot be reduced or reduced. A method may be used in which information that it should not be added is added, and if there is no such information, it can be interpreted that the image can be reduced.

[Embodiment 4]
FIG. 20 is a block diagram showing a schematic configuration of an example of a video content apparatus according to the fourth embodiment of the present invention. The video content display device 3001 is different from the block diagram of the first embodiment in FIG. 1 in that a main screen display unit 301 and a sub screen display unit 302 are added instead of the display unit 106.

The main screen display unit 301 is a part that displays a screen to be displayed on the main screen among the layouts of the video screen and the application screen determined by the layout determination unit 105.

The sub-screen display unit 302 is a part for displaying a screen to be displayed on the sub-screen among the layout of the video screen and the application screen determined by the layout determining unit 105.

Previously, the entire screen of the display device was regarded as a single screen, but the area that performs full screen display while maintaining the aspect ratio of the broadcast video may be regarded as the main screen, and the remaining blank space may be regarded as the sub screen. .

Further, a browser that is a function for displaying an application described in HTML may be provided in each of the main screen browser and the sub screen browser, and may operate independently.

In this case, a normal 16: 9 display application is used as a main screen application, and an application that is displayed in a different area that is set separately is used as a sub screen application. The main screen application and the sub screen application communicate with each other. However, the processing of the other application may be performed according to the result of the processing of one application. Specifically, the display content of the main screen application may be changed or display ON / OFF control may be performed according to the operation of the sub screen application by the user.

In addition, heretofore, a method for displaying various applications in an area for displaying a full screen while maintaining the aspect ratio of the broadcast video on the screen of one display device and an area for the other margin is described. However, a plurality of display devices may be connected to one display device, and one of the display devices may be used as the output destination of the main screen display unit, and another display device may be used as the output destination of the sub screen display unit. .

Also, instead of a display device directly connected by a cable or the like, another device that has been paired via a network may be handled as one of the display devices.

(Additional notes)
The application control information is not limited to the case where the broadcast control video is multiplexed and distributed. For example, application control information may be distributed via communication instead of being distributed over broadcast video, or one of different application control information may be distributed over broadcast video and the other distributed via communication. May be.

When one of the different application control information is distributed on the broadcast video and distributed, and the other is distributed via communication, the application information analysis unit 104 can transmit the application control information distributed via broadcast and the application distributed via communication. Analyze control information. Specifically, the two pieces of application control information are compared, and if they are different information, one of the pieces of information is selected, and the selection result is set as new application control information.

For example, information indicating that the application may be moved and displayed in the blank area is added to the application control information distributed via broadcasting, and the application is moved to the blank area for application control information distributed via communication. If information that prohibits display is added, information indicating that the application described in the application control information distributed via broadcast may be moved to the margin as new application control information And the application is displayed outside the broadcast video.

In the above example, when the application control information via the broadcast is different from the application control information via the communication, the application control information via the broadcast has been selected, but it is sufficient if the display position of the application can be controlled based on both application control information, For example, it is not limited to a specific selection method such as selecting any application control information on the receiver side and controlling the display position of the application. Also, considering the device characteristics on the receiver side, for example, if the application screen is displayed small on a high-resolution mobile terminal, the display size of the corresponding application may be enlarged and displayed at the receiver's discretion. Good.

The present invention can be used for all devices that display video contents and applications.

DESCRIPTION OF SYMBOLS 1001 ... Video content display apparatus 101 ... Control part 102 ... Video content receiving part 103 ... Application acquisition part 104 ... Application information analysis part 105 ... Display layout determination part 106 ... Display part 2001 ... Video content display apparatus 201 ... Display control information analysis part 3001 ... Video content display device 301 ... Main screen display unit 302 ... Sub screen display unit

Claims

A display for displaying video content and an application screen;
When the aspect ratio of the display unit is different from the aspect ratio of the video content, the application screen is displayed in a margin portion generated when the video content is displayed on the full screen while maintaining the aspect ratio. A display layout determining unit that determines a display layout according to the rules of
A video content display device comprising:
The predetermined rule is to display the application screen in the margin only when the size of the application screen fits in the margin, and to display the application screen in a designated position otherwise. The video content display apparatus according to claim 1, wherein the rule determines a display layout.
The predetermined rule is that when the size of the application screen fits in the margin part, the application screen is displayed as it is in the margin part, and otherwise, the application screen is displayed in the margin part. 2. The video content display apparatus according to claim 1, wherein the video content display apparatus is a rule for determining a display layout so that the display layout is reduced so as to be displayed and displayed in the blank portion.
2. The video content display apparatus according to claim 1, further comprising a display control information analysis unit that analyzes information on conditions for determining the display layout.
The information on the condition for determining the display layout includes information indicating whether the application screen can be moved to the margin, information indicating whether the display can be reduced, or permission 5. The video content display apparatus according to claim 4, further comprising at least one of information indicating a size of reduction to be performed.
A video content display method for displaying video content and an application screen on a display unit,
Displaying the video content on the display unit;
Calculating a size of a margin part in which the video content is not displayed in the display unit;
Analyzing the display position of the application screen, the display size of the application screen and the margin part, and determining a display layout;
And displaying the application screen on the display unit according to the display layout.