JP2013254232A - Display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device for properly and effectively laying out each image in accordance with a user's needs when displaying a plurality of images.SOLUTION: In a display device 10 for laying out a plurality of images (video/graphics), a storage unit 19 prestores information on a weight to be assigned to each region of an image partitioned into a plurality of regions, and a layout control unit 20 executes layout processing for laying out each image on the basis of the information on the weight stored in the storage unit 19.

Description

  The present invention relates to a display device, and more particularly to a display device that performs layout of a plurality of images.

  Some display devices such as a television broadcast receiver and a monitor for a personal computer have a multi-window function. The multi-window function is a function for simultaneously displaying a plurality of windows for displaying video and the like.

  Some display devices having such functions allow the user to adjust the position of each window. In addition, there is a method in which a user selects a desired layout from predetermined window layouts, and each window is displayed in the selected layout (see, for example, Patent Document 1). Furthermore, there is a display device that automatically determines a layout so that overlapping of windows is reduced in order to reduce the burden on the user (see, for example, Patent Document 2).

JP-A-6-149521 JP-A-9-73384

  However, among the videos displayed in the window, there are videos in which important information is often displayed and videos in which important information is rarely displayed are assumed. For example, in news videos, subtitles and telops are often displayed at the top and bottom of the video, but it is considered that important information is rarely displayed in the right and left ends of the video.

  In the prior arts of Patent Documents 1 and 2 described above, since the difference in the importance of information displayed on each part of the video is not taken into consideration at all, it is said that the layout according to the user's needs is not properly and effectively performed. There's a problem.

  In view of the above circumstances, an object of the present invention is to provide a display device capable of appropriately and effectively laying out each image in accordance with user needs when displaying a plurality of images. .

  In order to solve the above problems, a first technical means of the present invention is a display device that performs layout of a plurality of images, and stores information on weights assigned to each region of the image divided into a plurality of regions. And a layout control unit that performs layout of each image based on weight information stored in the storage unit.

  According to a second technical means of the present invention, in the first technical means, the plurality of areas are set according to a type of each image.

  According to a third technical means of the present invention, in the first or second technical means, the weight is set according to a type of each image.

  According to a fourth technical means of the present invention, in any one of the first to third technical means, the layout control unit extracts only an area where the weight is larger than a predetermined value in each image, and extracts each area. The layout is performed.

  According to a fifth technical means of the present invention, in any one of the first to third technical means, the layout control unit allows an area where the weight is smaller than a predetermined value to be hidden in each image. However, the layout of each image is performed.

  According to a sixth technical means of the present invention, in any one of the first to fifth technical means, the layout control unit enlarges the image when there is an image whose character size is smaller than a predetermined size. It is characterized by displaying.

  According to a seventh technical means of the present invention, in the sixth technical means, the layout control unit is configured such that a center of each image is displayed when the display positions of the plurality of images overlap as a result of the enlarged display of the images. The display position of at least one of the plurality of images is moved so that the positions are separated from each other.

  According to an eighth technical means of the present invention, in the seventh technical means, the layout control unit is configured to display at least one of the plurality of images until the display position of the area where the weight is smaller than a predetermined value is not displayed off the screen. The display position of one image is moved.

  According to a ninth technical means of the present invention, in the sixth to eighth technical means, the layout control unit is configured to display the weight when the display positions of the plurality of images overlap as a result of the enlarged display of the images. An image to be displayed with priority is selected based on the information.

  According to a tenth technical means of the present invention, in the ninth technical means, the layout control section preferentially displays an image to be displayed based on the area information of the portion where the display position overlaps and the weight information. It is characterized by selecting.

  According to the present invention, the storage unit stores weight information assigned to each area of the image divided into a plurality of areas, and performs layout of each image based on the stored weight information. Therefore, when displaying a plurality of images, each image can be laid out appropriately and effectively in accordance with the needs of the user.

It is a figure which shows an example of a structure of the display apparatus which concerns on embodiment of this invention. It is a figure which shows an example of the weight allocated with respect to each area | region of each image | video / graphics. It is a figure which shows an example of a screen layout. It is a figure which shows an example of a screen layout. It is a figure which shows an example of the similarity between screen layouts. It is a figure which shows the outline | summary of a video / graphics layout setting process. It is a flowchart which shows an example of the process sequence of the window display process which concerns on embodiment of this invention. It is a figure explaining whole non-overlapping display, partial non-overlapping display, and duplication display. It is a flowchart which shows an example of the process sequence of the layout process shown in FIG. It is a figure explaining the area of the image | video / graphics displayed on each window. It is a flowchart which shows an example of the process sequence of the partial non-overlapping layout process shown in FIG. It is a flowchart which shows an example of the process sequence of the partial non-overlapping layout process shown in FIG. It is a flowchart which shows an example of the process sequence of the enlarged layout process shown in FIG. It is a figure explaining the method of eliminating the contradiction of the overlap of a window.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram illustrating an example of a configuration of a display device 10 according to an embodiment of the present invention. The display device 10 includes tuner units 11a and 11b, video signal receiving unit 12, video information detection units 13a to 13c, browser unit 14, renderer unit 15, video scaling units 16a to 16c, graphic scaling units 17a and 17b, and graphic information detection. Unit 18, storage unit 19, layout control unit 20, video / graphics superimposing unit 21, and display unit 22.

  The tuner units 11a and 11b are tuners that receive television broadcast signals from an antenna (not shown). The video signal receiving unit 12 is a processing unit that receives a video signal output from the external device 30. The external device 30 is a device such as an HDD (Hard Disk) recorder, a DVD (Digital Versatile Disc) recorder, or a BD (Blu-ray Disc) recorder that can output video.

  The video information detection units 13a and 13b are processing units that detect video information from broadcast signals received by the tuner units 11a and 11b. Video information is information such as video genre, format, resolution, and aspect ratio. The video information detection units 13 a and 13 b output the extracted information to the layout control unit 20. The video information detection unit 13 c is a processing unit that detects the video information from the video signal output by the external device 30 and outputs the detected information to the layout control unit 20.

  The browser processing unit 14 is a processing unit that performs display control of a web page. For example, when the browser processing unit 14 receives a web page display request from a user via an input device such as a remote control device (not shown), the browser processing unit 14 displays graphic data for displaying the web page via the network 31. Not received from the server device. Then, the browser processing unit 14 outputs the received graphic data to the graphic scaling unit 17a.

  The renderer unit 15 is a processing unit that reads graphic data such as an instruction manual of the display device 10 stored in the storage unit 19 and outputs the read graphic data to the graphic scaling unit 17b.

  The video scaling units 16a and 16b extract the video signal from the broadcast signals received by the tuner units 11a and 11b, and are displayed by the extracted video signal based on the video enlargement / reduction instruction from the layout control unit 20. A processing unit for enlarging / reducing video.

  The video scaling unit 16 c is a processing unit that performs an enlargement / reduction process of the video displayed by the video signal received by the video signal receiving unit 12 based on the video enlargement / reduction instruction from the layout control unit 20.

  The graphic scaling unit 17a is a processing unit that performs enlargement / reduction processing of a graphic displayed by the graphic data output by the browser processing unit 14. The graphic scaling unit 17 a is a processing unit that performs enlargement / reduction processing of a graphic displayed by the graphic data output from the renderer unit 15.

  The graphic information detection unit 18 is a processing unit that detects information on the resolution and aspect ratio of the graphic displayed by the graphic data acquired by the browser processing unit 14 and the renderer unit 15.

  The storage unit 19 is a storage device such as a memory or a hard disk device that stores various data handled by the display device 10. For example, the storage unit 19 is allocated to each area of graphic data such as an instruction manual of the display device 10 and each video / graphics (video / graphics corresponds to an image in the claims). The weight information, the screen layout information of each window, the similarity between screen layouts, and the like are stored. These pieces of information are set in advance as default information, or set by a user who uses the display device 10.

  FIG. 2 is a diagram illustrating an example of weights assigned to each area of each video / graphics. The weight is appropriately assigned according to the type of video / graphics. The type of video / graphics is determined based on program genre information included in the broadcast signal, control signals from the external device 30, the browser processing unit 14, and the renderer unit 15.

  FIG. 2A shows a video 40 with captions. Subtitles are displayed in response to a subtitle display request from a user, and often contain high-value information. In the case of such an image 40, the weights at the center and the lower part where the subtitles are displayed are set large, and the weights at the other parts are set small.

  For example, in FIG. 2A, a weight of 10 is set for the central portion 40a and the lower region 40a of the video 40, and the left and right regions 40b and 40c having a width of 1/5 of the video 40, A weight of 5 is set for the upper region 40d having a height of 1/10.

  Similarly, a news image 41 is shown in FIG. Subtitles and telops are often displayed above or below the news video 41, and the contents displayed there are often highly valuable. Therefore, in the example of FIG. 2B, a weight of 10 is set for the central portion 41a of the video 41, and a weight of 2 is set for the left and right regions 41b and 41c having a width of 1/5 of the video 41. Is set.

  FIG. 2C shows a movie image 42. In the movie image 42, black areas 42 b and 42 c may be generated above and below the image 42 because the aspect ratio of the display area does not match the aspect ratio of the image. Since this black area contains no information, in the example of FIG. 2C, a smaller weight is set than the other areas. Specifically, a weight of 1 is set for the upper and lower black areas 42b and 42c of the video 42, a weight of 10 is set for the central portion 42a of the video 42, and the width of the video 42 is 1/5. A weight of 5 is set for the left and right areas 42d and 42e.

  FIG. 2D shows the graphics 43 of the web browser. In web browsers, there is no particular tendency for important information to be displayed at fixed positions. However, a search engine keyword input field and the like are displayed at the top of the web browser. In addition, the user often does not see the entire web browser at the same time, but often scrolls the upper part of the web browser.

  Therefore, in the example of FIG. 2D, a weight of 10 is set for the upper region 43a having the height of 3/5 of the graphics 43, and the lower portion of the graphics 43 having the height of 2/5. A weight of 4 is set for the area 43b.

  FIG. 2E shows a normal video 44 other than the above. In the normal video 44, important information tends to be displayed at the center of the video 44 and is rarely displayed at the edge of the screen. Therefore, in the example of FIG. 2E, a weight of 10 is set for the central area 44 a of the video 44, and the left and right areas 44 b and 44 c having a width of 1/5 of the video 44 and the video 44 A weight of 5 is set for the upper and lower regions 44d, 44e having a height of 1/5.

  In this embodiment, video / graphics included in each window is laid out based on such weight information. Thereby, an appropriate layout according to the characteristics of the video / graphics is made.

  Next, screen layout information and similarity information between screen layouts will be described. 3 and 4 are diagrams showing examples of the screen layout. FIG. 3 shows a screen layout when there are two windows, and FIG. 4 shows a screen layout when there are three windows. Each window displays video and graphics. Here, the case where the number of windows is two and three will be described, but the same processing is possible even when the number of windows is four or more.

  When there are two windows, there are a screen layout in which two windows are arranged horizontally as shown in FIG. 3A and a screen layout in which two windows are arranged vertically as shown in FIG. 3B.

  In FIG. 3, W and H indicate the width and height of the display screen, respectively. Further, p in FIG. 3A indicates the width of the left window, and q in FIG. 3B indicates the height of the upper window. These parameters are stored in the storage unit 19 as screen layout information when there are two windows.

  When there are three windows, there are window layouts as shown in FIGS. 4A to 4F. As in the case of FIG. 3, W and H indicate the width and height of the display screen, respectively. P, q, r, and s are parameters indicating the dimensions of each window. These parameters are stored in the storage unit 19 as screen layout information when there are three windows.

  FIG. 5 is a diagram illustrating an example of the similarity between screen layouts. FIG. 5 shows the similarity between screen layouts when the number of windows increases from two to three. Specifically, the screen layouts 50a and 50b shown in FIG. 3 and the screen layout shown in FIG. The similarity between 51a-51f is shown. Here, the information in parentheses in FIG. 5 is information on a position where a new window is arranged in the screen layout including the three windows shown in FIG.

  For example, considering the case where the screen layout 50a shown in FIG. 3A is changed to the screen layout 51a shown in FIG. 4A, the similarity between the screen layout 50a and the screen layout 51a is new. 7 when the right window is arranged at the upper right of the screen layout 51a in FIG. 4A, and 6 when the right window is arranged at the lower right. Note that the similarity increases as the two screen layouts become similar.

  This similarity information is referred to when a new window display instruction is issued and the screen layout is changed. The process for changing the screen layout will be described in detail later.

  Returning to the description of FIG. 1, when a new window is displayed, the layout control unit 20 lays out the video / graphics layout displayed in each window based on the weight information stored in the storage unit 19. Set up.

  FIG. 6 is a diagram showing an overview of video / graphics layout setting processing. FIG. 6 shows a case where the screen layout including two windows 60a and 60b is changed to a screen layout including three windows 61a to 61c.

  Here, it is assumed that video / graphics 70a and 70b are displayed in the windows 60a and 60b, and that the video / graphics 70b includes a character area 71b. In addition, video / graphics 70a and 70b are displayed in the windows 61a and 61b, and video / graphics 70c including a character area 71b is newly displayed in the window 61c. Further, it is assumed that the aspect ratio of the video / graphics 70a to 70c does not change even when the screen layout is changed.

  When the user gives an instruction to add a new window 70c, the layout control unit 20 uses the current layout based on the screen layout information described in FIG. 4 and the screen layout similarity information described in FIG. The screen layout 51a shown in FIGS. 4A to 4F is a screen layout that is similar to the screen layout that is displayed and that maximizes the sum of the display areas of each video / graphics. Select from ~ 51f.

  The windows 61a to 61c and the video / graphics 70a to 70c are displayed according to the screen layout selected by the layout control unit 20, as shown in FIG. This display process will be described in detail later.

  When the character size of the character areas 71b and 71c included in the windows 70b and 70c is smaller than a predetermined size, the windows 61b and 61c and the windows 61b, The video / graphics 70b and 70c included in 61c are enlarged and displayed. Thereby, it can prevent that the size of a character becomes small too much.

  When the display positions of the video / graphics 70a to 70c overlap due to this enlarged display, the layout control unit 20 refers to the information on the weight assigned to each area of each video / graphics 70a to 70c, and / In a region where the display positions of the graphics 70a to 70c overlap, layout processing such as preferentially displaying the video / graphics 70a to 70c set with a higher weight is performed. As a result, it is possible to prevent a more important area from being displayed. This layout process will be described in detail later.

  The video / graphics superimposing unit 21 generates an image in which the video and graphics output by the video scaling units 16 a to 16 c and the graphics scaling units 17 a and 17 b are arranged in the screen layout set by the layout control unit 20. The processing unit outputs the image data to the display unit 22. The display unit 22 is a display device such as a liquid crystal display that displays an image based on the data output from the video / graphics superimposing unit 21.

  Next, an example of a processing procedure of window display processing according to the embodiment of the present invention will be described. FIG. 7 is a flowchart showing an example of the processing procedure of the window display processing according to the embodiment of the present invention.

  First, the layout control unit 20 of the display device 10 determines whether or not an instruction to display a new window has been received from the user by operating a remote control device or the like (step S101). If the display instruction has not been received (NO in step S101), the determination process in step S101 is repeated until the display instruction is received.

  When a display instruction is received (YES in step S101), the layout control unit 20 is included in the currently displayed window from the video information detection units 13a to 13c, the browser processing unit 14, or the renderer unit 15. Information on the type of video / graphics and information on the type of video / graphics included in the newly added window are acquired (step S102).

  Then, the layout control unit 20, based on the weight information stored in the storage unit 19 in association with the video / graphics type information, as shown in FIG. A weight is set for each area (step S103).

  Thereafter, the layout control unit 20 determines whether the display pattern is set to the entire non-overlapping display, the partial non-overlapping display, or the overlapping display. This display pattern is set in advance by the user.

  FIG. 8 is a diagram for explaining overall non-overlapping display, partial non-overlapping display, and overlapping display. The whole non-overlapping display refers to displaying so that the positions of the windows 61a to 61c do not overlap as shown in FIG. Here, in each of the windows 61a to 61c, the video / graphics 70a to 70c are arranged so as to be displayed in the maximum area without changing the aspect ratio.

  In the partial non-overlapping display, as shown in FIG. 8B, only the areas 72a to 72c having a weight greater than a predetermined value are extracted in each video / graphics, and the extracted areas 72a to 72c are not overlapped. It means to display. In the example of FIG. 8B, only the regions 72a to 72c having a weight greater than 5 are extracted. Similarly to the case of FIG. 8A, the extracted areas 72a to 72c are arranged in the windows 61a to 61c so that the extracted areas 72a to 72c are displayed in the maximum area without changing the aspect ratio.

  As shown in FIG. 8C, the overlapping display means that an area whose weight is not more than a predetermined value in each video / graphics is not displayed because the display position overlaps with each other video / graphics. Is displayed while displaying each video / graphics 71a-71c. Here, with respect to the region where the display positions overlap, a region having a large weight is preferentially displayed.

  Returning to the description of FIG. 7, when the display pattern is the whole non-overlapping display, the layout control unit 20 executes the layout process as described in FIG. 8A (step S <b> 105). If the display pattern is a partial non-overlapping display, the layout control unit 20 executes a partial non-overlapping layout process as described with reference to FIG. 8B (step S106). If the display pattern is overlapping display, the layout control unit 20 executes the overlapping layout processing as described with reference to FIG. 8C (step S107). The layout process, the partial non-overlapping layout process, and the overlapping layout process will be described in detail later.

  After the process of step S105, step S106, or step S107, the layout control unit 20 determines whether or not the video / graphics includes a character area and the character size is equal to or smaller than a predetermined value ( Step S108).

  If the video / graphics includes a character area and the character size is equal to or smaller than a predetermined value (YES in step S108), the layout control unit 20 performs the enlarged layout as described with reference to FIG. Processing is executed (step S109). This enlarged layout process will be described in detail later.

  Thereafter, the display unit 22 displays each window including video / graphics according to the layout set by the layout control unit 20 (step S110). Then, this window display process ends.

  Next, an example of the processing procedure of the layout processing shown in FIG. 7 will be described. FIG. 9 is a flowchart illustrating an example of a processing procedure of the layout processing illustrated in FIG.

  First, the layout control unit 20 reads the screen layout information described in FIG. 4 and the similarity information described in FIG. 5 from the storage unit 19 (step S201). Then, the layout control unit 20 selects a screen layout used for display from the screen layouts as shown in FIG. 4 (step S202).

  Specifically, the layout control unit 20 refers to the similarity information described with reference to FIG. 5, and is similar to the screen layout used for display at that time from the screen layouts described with reference to FIG. 4. A screen layout having a degree equal to or greater than a predetermined value is selected (step S202).

  Thereafter, the layout control unit 20 determines whether or not a plurality of screen layouts have been selected (step S203). If only one screen layout has been selected (NO in step S203), this layout process ends. In this case, each window is displayed using the selected screen layout.

  When a plurality of screen layouts are selected (YES in step S203), the layout control unit 20 is included in the window currently displayed from the video information detection units 13a to 13c, the browser processing unit 14, or the renderer unit 15. Information on the aspect ratio of the video / graphics to be displayed and information on the aspect ratio of the video / graphics included in the newly added window are acquired (step S204). Then, the layout control unit 20 calculates the sum of the areas of the video / graphics displayed in each window (step S205).

FIG. 10 is a diagram for explaining the area of video / graphics displayed in each window. FIG. 10 shows a window 80 and a video / graphics 81 displayed in the window 80. Here, the width and height of the window 80 are w _i and h _i (1 ≦ i ≦ M: M is the number of windows), respectively, and the aspect ratio of the video / graphics 81 is a _i .

In FIG. 10 _(A), satisfying the relationship of a _{i w} i ≦ _h i, and an example of a video / graphics 81 having the largest area is shown. FIG. 10B shows an example of a video / graphics 81 that satisfies the relationship of a _i w _i > h _i and has the maximum area.

The area S _i of the video / graphics 81 in this case is calculated using the following equation.
S _{i (the} case of _{a i w i ≦ h i)} (w i, h i, a i) = a i w i 2
_{S i (w i, h i} , a i) = h i 2 / a i ( the case of _{a i} w _{i> h i)}

Furthermore, the sum S _j (1 ≦ j ≦ N: N is the number of screen layouts) of video / graphics areas included in each screen layout j as shown in FIG.
S _j = ΣS _i
It becomes. Here, Σ is the sum of i.

Returning to the description of FIG. 9, after the process of step S205, the layout control unit 20 selects the screen layout having the largest area sum _Sj as the screen layout to be used for display (step S206). Ends. The video / graphics display is performed in the maximum area described above in the window laid out in this screen layout.

  Next, an example of the processing procedure of the partial non-overlapping layout processing shown in FIG. 7 will be described. FIG. 11 is a flowchart illustrating an example of a processing procedure of the partial non-overlapping layout processing illustrated in FIG.

  First, the layout control unit 20 extracts an area having a weight greater than a predetermined value in the video / graphics displayed in each window (step S301). Then, as described with reference to FIG. 8B, the layout control unit 20 executes a layout process for laying out the extracted regions (step S302), and the partial non-overlapping layout process ends. In this case, as shown in FIG. 8B, an area having a weight less than a predetermined value is not displayed.

  This layout process is similar to the layout process in the whole non-overlapping display described with reference to FIG. 9, and the entire video / graphics is targeted for layout, or an area having a weight greater than a predetermined value in the video / graphics The only difference is whether the target of the layout.

  Next, an example of the processing procedure of the overlapping layout processing shown in FIG. 7 will be described. FIG. 12 is a flowchart illustrating an example of a processing procedure of the partial non-overlapping layout processing illustrated in FIG.

  First, the layout control unit 20 extracts an area having a weight greater than a predetermined value in the video / graphics displayed in each window (step S401). Then, the layout control unit 20 executes a layout process for laying out each extracted region by the same process as the process described in FIG. 8B or FIG. 11 (step S402).

  Here, since only the extracted area having a weight larger than the predetermined value is laid out so that the display positions do not overlap, the weight is less than the predetermined value (for example, less than 6) as shown in FIG. The display positions of a part of the area overlap.

  For this reason, the layout control unit 20 compares the weights of the regions whose display positions overlap each other (step S403). Then, the layout control unit 20 performs layout of each window so that a window including a region having a greater weight is displayed preferentially (step S404), and this overlapping layout process ends.

  Next, an example of the processing procedure of the enlarged layout process shown in FIG. 7 will be described. FIG. 13 is a flowchart illustrating an example of a processing procedure of the enlarged layout processing illustrated in FIG.

  First, the layout control unit 20 enlarges the video / graphics whose character size is equal to or smaller than a predetermined value until the character size reaches a predetermined value (step S501). When the video / graphics is enlarged, the window including the video / graphics is also enlarged. Further, the enlarged window is laid out so that the edge thereof coincides with the edge of the screen as shown in FIG. 8C, for example.

  Then, the layout control unit 20 determines whether or not there is a contradiction in the video / graphics overlap due to the enlargement (step S502). Overlapping contradiction means that in a region where the display positions overlap each other, a region with a small weight is displayed preferentially over a region with a large weight.

  If there is no contradiction in the video / graphics overlap (NO in step S502), the enlarged layout process ends. If there is a contradiction in the video / graphics overlap (YES in step S502), the layout control unit 20 assigns each video / graphics so that the center position of the video / graphics in which the contradiction occurs is separated. Move (step S503).

For example, in the window 80 shown in FIG. 10A, when the height a _i w _i of the video / graphics 81 is smaller than the height h _{i of the} window 80, the video / graphics 81 can be moved up and down. It becomes possible. Further, in the window 80 shown in FIG. 10B, when the width h _i / a _i of the video / graphics 81 is smaller than the width w _{i of the} window 80, the video / graphics 81 can be moved left and right. It is.

  By moving the video / graphics in each window in this way, the center position of the video / graphics in which there is a contradiction in the overlap can be moved away, and an important area can be prevented from being displayed. it can. Hereinafter, an example of this process will be described in detail.

  FIG. 14 is a diagram for explaining a method for eliminating contradiction in overlapping windows. FIG. 14A shows three windows 61a to 61c and an image 90a, graphics 90b, and image 90c included in the windows 61a to 61c. Here, since the weight of the rightmost area of the video 90a is 5, and the weight of the leftmost area of the video 90c displayed in preference to the video 90a is 2, there is a contradiction in the overlap.

  Therefore, as shown in FIG. 14B, the image 90a is moved so that the center position of the image 90a is separated from the center position of the image 90c. Even after the movement of the video 90a, the area of the video 90c having a weight of 2 is displayed in preference to the central portion of the video 90a having a weight of 10, thus causing a contradiction. This elimination method will be described later.

  Returning to the description of FIG. 13, the layout control unit 20 determines whether or not a contradiction still occurs in the video / graphics overlap after the process of step S503 (step S504). If the video / graphics overlap contradiction is resolved (NO in step S504), the enlarged layout process ends.

  If the video / graphics overlap contradiction still exists (YES in step S504), the layout control unit 20 determines that the weight is equal to or less than a predetermined value (for example, 5 or less) as shown in FIG. The video / graphics is moved while allowing the display position of the area to be off the screen and not displayed (step S505). Thereby, it is possible to prevent a more important area from being hidden.

  Then, the layout control unit 20 determines whether or not there is a contradiction in the video / graphics overlap even after this movement (step S506). If the video / graphics overlap contradiction is resolved (NO in step S506), the enlarged layout process ends.

  When the video / graphics overlap contradiction still exists (YES in step S506), the layout control unit 20 calculates the display priority of each video / graphics (step S507).

For example, the display priority P _i for video / graphics _i (1 ≦ i ≦ M: M is the number of video / graphics) is calculated by the following equation.
P _i = ΣA _j × w _j

Here, Σ is the sum of j (1 ≦ j ≦ K: K is the number of weights set in video / graphics i). In addition, w _j is a weight set in the video / graphics, and A _j is an area of a weight w _j where the display position overlaps with another video / graphics.

For example, in the video 90a in FIG. 14C, only the display position of the area with the right weight of 5 overlaps with the other video 90c, and the other areas are the display positions of the other graphics 90b and video 90c. There is no overlap. For example, it is assumed that the area of the region where the display positions overlap is 20. In this case, since the weight of that region in the image 90a is 5, the priority _{P 1} of the display image 90a is
P ₁ = 0 × 5 + 0 × 10 + 20 × 5 = 100
It becomes.

In the graphics 90b, only the lower area has the display position overlapping with the image 90c, and other areas do not overlap the display position with the other images 90a and 90c. For example, it is assumed that the area of the region where the display positions overlap is 200, and the weight of the overlapping region in the graphics 90b is 4. In this case, the priority _{P 2} of the display of graphics and 90b is,
P ₂ = 0 × 10 + 200 × 4 = 800
It becomes.

In addition, priority _{P 3} of the display of the image 90c is,
P ₃ = 20 × 2 + 200 × 10 = 2040
It becomes.

Returning to the explanation of FIG. 13, after the process of step S507, the layout control section 20 sets the layout to greater priority P _i of the display is preferentially displayed (step S508). In the above example, the layout control unit 20 sets the layout so that the video 90c having the highest display priority is displayed preferentially. Thereby, it is possible to prevent a more important area from being hidden. Thereafter, the enlarged layout process ends.

  Here, the layout process based on the display priority is performed after the video / graphics moving process in step S503 or step S505. However, in step S502, it is determined that there is a contradiction in the video / graphics overlap. In such a case, the layout process may be executed.

  The present invention is not limited to the above-described embodiments, and various modifications and corrections can be made without departing from the scope of the present invention.

DESCRIPTION OF SYMBOLS 10 ... Display apparatus, 11a, 11b ... Tuner part, 12 ... Video signal receiving part, 13a-13c ... Video information detection part, 14 ... Browser part, 15 ... Renderer part, 16a-16c ... Video scaling part, 17a, 17b ... Graphic scaling unit, 18 ... Graphic information detection unit, 19 ... Storage unit, 20 ... Layout control unit, 21 ... Video / graphics superimposition unit, 22 ... Display unit, 30 ... External device, 31 ... Network, 40, 41, 42 , 44 ... Video, 40a to 40d, 41a to 41c, 42a to 42e, 43a, 43b, 44a to 44e, 72a to 72c ... Area, 43 ... Graphics, 50a, 50b, 51a to 51f, ... Screen layout, 60a, 60b, 61a-61c, 80 ... window, 70a-70c, 81, 90a-90c ... video Graphics, 71b, 71c ... character area.

Claims (10)

A display device that performs layout of a plurality of images,
A storage unit that stores information on weights assigned to each region of the image divided into a plurality of regions;
A layout control unit that performs layout of each image based on the weight information stored in the storage unit;
A display device comprising:   The display device according to claim 1, wherein the plurality of areas are set according to a type of each image.   The display device according to claim 1, wherein the weight is set according to a type of each image.   The display according to any one of claims 1 to 3, wherein the layout control unit extracts only a region where the weight is larger than a predetermined value in each image, and performs layout of each extracted region. apparatus.   4. The layout control unit according to claim 1, wherein the layout control unit performs layout of each image while allowing an area where the weight is smaller than a predetermined value in each image to be hidden. The display device described in 1.   The display device according to claim 1, wherein when there is an image in which a character size is smaller than a predetermined size, the layout control unit displays the image in an enlarged manner.   When the display positions of the plurality of images are overlapped as a result of the enlarged display of the images, the layout control unit is configured to display the display positions of at least one of the plurality of images so that the center positions of the images are separated from each other. The display device according to claim 6, wherein the display device is moved.   The layout control unit moves a display position of at least one of the plurality of images until a display position of an area where the weight is smaller than a predetermined value is off the screen and is not displayed. The display device described in 1.   The layout control unit selects an image to be preferentially displayed based on the weight information when the display positions of the plurality of images overlap as a result of the enlarged display of the image. The display apparatus of any one of Claims 6-8.   The display device according to claim 9, wherein the layout control unit selects an image to be preferentially displayed based on information on an area of the portion where the display positions overlap and the weight.

Images