JP2010026021A - Display device and display method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a new and improved technology which displays a plurality of moving images so that they may simultaneously, clearly be seen. <P>SOLUTION: A display device 10 includes: a master screen processing part having a moving image inputting part 130a which receives input of moving image information which becomes the base of first moving images; one or more slave screen processing parts having moving image inputting parts 130b-130d which receive moving image information which becomes the base of second moving images; a blend processing part which acquires mask image information, which mask information storage parts 170b-170d store, and conducts processing, in which respective pixel values are added according to transmittance, which is set to the mask image information for respective pixels which correspond to each other in the first and second moving images, for the respective second moving images, to generate third moving images; and a moving image output part 190 which outputs the third moving images to a monitor. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a display device and a display method. Specifically, it relates to a technique for efficiently viewing a plurality of videos.

  As TV broadcasting multi-channel technology and Internet video distribution technology become widespread, the number of videos that users can easily watch has increased dramatically. For this reason, a technique for efficiently viewing a plurality of moving images is desired.

  As a technique for efficiently viewing a plurality of moving images, for example, there is a technology for specifying a moving image by searching for a moving image that matches a search condition registered in advance. However, the user generally determines whether or not he / she wants to watch a moving image carefully based on an impression of actually viewing a part of the moving image. Therefore, there is a problem that the moving image that the user decides to watch carefully does not always match the search condition.

  There is also a technique for displaying a plurality of moving images simultaneously (see, for example, Patent Document 1). According to this technique, the user can determine whether or not he / she wants to watch a moving image carefully based on an impression of actually viewing a part of the moving image. Furthermore, the user often wants to watch only a part of the moving image, not the entire moving image from the beginning to the end. According to this technique, it is possible to view other moving images while a portion other than a portion that is desired to be viewed is being reproduced by so-called Nagara viewing. In particular, it is considered effective to display a moving image that the user has decided to watch carefully, and to display other moving images small. Here, a large screen is referred to as a parent screen, and a small screen is referred to as a child screen.

JP-A-9-163260

  However, the technique for displaying a plurality of moving images simultaneously has a problem that a part of the parent screen is hidden by the child screen. In order to prevent such a phenomenon, the parent screen may be reduced. However, since the parent screen is reduced, there is a problem that it is difficult to see the parent screen.

  The present invention has been made in view of the above problems, and an object of the present invention is to provide a new and improved technique capable of simultaneously displaying a plurality of moving images in an easily viewable manner.

  In order to achieve the above object, according to an aspect of the present invention, a display device includes a moving image input unit that receives input of moving image information that is a source of a first moving image, and a display size of the first moving image on a monitor. A parent screen processing unit having a scaler unit that sets a predetermined size and a position moving unit that sets a display position of the first moving image on the monitor to a predetermined position is provided.

  Further, the display device includes a mask image information storage unit that stores mask image information in which the transmittance when the second moving image is the foreground and the first moving image is the background is set for each pixel constituting the second moving image; A video input unit that receives input of video information that is the basis of the second video, a scaler unit that sets a display size of the second video on the monitor to a predetermined size smaller than the display size of the second video, One or a plurality of sub-screen processing units each having a position moving unit that sets a display position of the two moving images on a monitor to a predetermined position where the second moving image entirely overlaps a part of the first moving image.

  Further, the display device acquires the mask image information stored in the mask image information storage unit, and adds each pixel value according to the transmittance set in the mask image information for each corresponding pixel in the first moving image and the second moving image. A blending processing unit that performs the matching process on each second moving image to generate the third moving image, and a moving image output unit that outputs the third moving image to the monitor is provided. Such a display device is provided.

The blend processing unit described above, when the transmittance is α,
(Pixel value of the first moving image) × (1−α) + (pixel value of the second moving image) × α (1)
It is also possible to perform a process of adding the pixel values.

  In the mask image information described above, 1 is set as the transmittance α of the pixels in the predetermined region out of the predetermined region and other regions included in the second moving image, and the transmittance α of the pixels in the other region is set. It is good also as 0 being set as.

  The predetermined area described above may be an area surrounded by a substantially circle or an ellipse.

  An intermediate region further exists as a region sandwiched between the predetermined region and the other region described above, and the transmittance of the pixels in the intermediate region gradually decreases as the pixel closer to the predetermined region approaches the other region. It is good as well.

  Each of the one or more small-screen processing units described above may further include an image recognition unit that recognizes a face area from the second moving image and changes the transmittance of the mask image information using the face area as a predetermined area. .

  The image recognition unit described above may gradually change the transmittance when changing the transmittance of the mask image information.

  The parent screen processing unit described above further includes an image recognition unit that recognizes a character area from the first moving image and notifies a value indicating the character area to each of the position moving units of one or more sub-screen processing units. Each position moving unit of the plurality of small-screen processing units may set the display position of the second moving image on the monitor to a position that does not overlap the character area.

  Each position moving unit of the one or more small-screen processing units described above gradually changes the transmittance when setting the display position of the second moving image on the monitor so as not to overlap the character area. The second moving image before the display position change may be gradually erased, and the second moving image after the display position change may be gradually displayed.

  According to the present invention, it is possible to simultaneously display a plurality of moving images in an easy-to-view manner.

  Exemplary embodiments of the present invention will be described below in detail with reference to the accompanying drawings. In the present specification and drawings, components having substantially the same functional configuration are denoted by the same reference numerals, and redundant description is omitted.

<< About general display device >>
First, an outline of a general display device will be described.

  FIG. 1 is a diagram illustrating an outline of a general display device (divided display method). As shown in FIG. 1, a main screen 910a, a first child screen 920, a second child screen 930, and a third child screen 940 are displayed on a screen 900 of a general display device (divided display method). Yes. As described above, when the first child screen 920, the second child screen 930, and the third child screen 940 are displayed so as not to overlap the parent screen 910a, the parent screen 910a is displayed in a small size.

  FIG. 2 is a diagram for explaining the outline of a general display device (small-screen superposition method). As shown in FIG. 2, a main screen 910b, a first child screen 920, a second child screen 930, and a third child screen 940 are displayed on a screen 900 of a general display device (child screen superimposing method). ing. In this way, when the first child screen 920, the second child screen 930, and the third child screen 940 are displayed so as to overlap the parent screen 910a, a part of the parent screen 910b is not displayed.

<< Configuration of display device >>
First, the configuration of the display device according to the present embodiment will be described.

  FIG. 3 is a diagram illustrating a configuration of the display device according to the present embodiment. As illustrated in FIG. 3, the display device 10 includes a moving image input unit 130a to 130d, a scaler unit 140a to 140d, a position moving unit 160a to 160d, a mask information storage unit 170a to 170d, a blend processing unit 180, And a moving image output unit 190. Further, the operation input unit 110, the control unit 120, the image recognition units 150a to 150d, and the like may be provided. The display device 10 includes a monitor (not shown), and a moving image is displayed on a screen of the monitor (not shown). FIG. 3 shows an example in which a four-screen moving image is displayed. However, the configuration is not particularly changed even if the number of screens is changed.

  Here, the moving image input unit 130a, the scaler unit 140a, the image recognition unit 150a, the position moving unit 160a, and the mask information storage unit 170a function as a parent screen processing unit. In addition, the moving image input unit 130b, the scaler unit 140b, the image recognition unit 150b, the position moving unit 160b, and the mask information storage unit 170b function as a small screen processing unit. Similarly, the moving image input unit 130c, the scaler unit 140c, the image recognition unit 150c, the position movement unit 160c, and the mask information storage unit 170c function as a small screen processing unit. In addition, the moving image input unit 130d, the scaler unit 140d, the image recognition unit 150d, the position movement unit 160d, and the mask information storage unit 170d function as a small screen processing unit. It is assumed that at least one parent screen processing unit exists and one or more child screen processing units exist. Further, as will be described later, the parent screen processing unit and the sub screen processing unit can be switched by an instruction from the user.

  The moving image input unit 130a has a function of accepting input of moving image information that is the basis of the first moving image. The moving image input units 130b to 130d have a function of receiving input of moving image information that is the basis of the second moving image. The moving image input units 130b to 130d accept different inputs as the second moving image, but may accept the input of the same moving image.

  The scaler unit 140a sets the display size of the first moving image on the monitor (not shown) to a predetermined size. The scalers 140b to 140d set the display size of the second moving image on the monitor (not shown) to a predetermined size smaller than the display size of the second moving image. As shown below, for example, the display size of the first moving image on the monitor (not shown) is set to 1 time, and the display size of the second moving image on the monitor (not shown) is set to 1/3 times.

  The position moving unit 160a sets a display position of the first moving image on a monitor (not shown) to a predetermined position. The position moving units 160b to 160d set the display position of the second moving image on the monitor (not shown) to a predetermined position where the entire second moving image overlaps a part of the first moving image. As shown below, for example, the display position of the first moving image on the monitor (not shown) is the center, and the display size of the second moving image on the monitor (not shown) is the lower left, middle lower, lower right, etc.

  The mask information storage units 170a to 170d store mask image information in which the transmittance when the second moving image is the foreground and the first moving image is the background is set for each pixel constituting the second moving image. As the mask image information, holding of information of the mask image (alpha value image) set by the control unit 120 is held.

  In the mask image information, a value indicating that the second moving image is displayed is set as the transmittance of the pixels in the predetermined region among the predetermined region and the other region included in the second moving image. A value indicating that the first moving image is displayed may be set as the transmittance of the pixels. The predetermined area may be an area surrounded by a substantially circle or an ellipse.

  The blend processing unit 180 acquires mask image information stored in the mask information storage units 170a to 170d. In addition, the blend processing unit 180 performs a process of adding the pixel values according to the transmittance set in the mask image information for each corresponding pixel in the first moving image and the second moving image for each second moving image. 3 videos are generated.

  When the transmittance is α, the blend processing unit 180

  (Pixel value of the first moving image) × (1−α) + (pixel value of the second moving image) × α (1)

  It is also possible to perform a process of adding the pixel values. This is a so-called alpha blend process. The pixel value is not particularly limited as long as it is a pixel value, and is, for example, a value indicating color, a value indicating luminance, or the like.

  In the mask image information, 1 is set as the transmittance α of the pixels in the predetermined region out of the predetermined region and other regions included in the second moving image, and 0 as the transmittance α of the pixels in the other region. May be set. The predetermined area may be an area surrounded by a substantially circle or an ellipse.

  An intermediate region further exists as a region sandwiched between the predetermined region and the other region, and the transmittance of the pixels in the intermediate region decreases stepwise as the pixel closer to the predetermined region approaches the other region. Also good.

  The moving image output unit 190 outputs the third moving image to a monitor (not shown).

  The control unit 120 performs processing such as initial value setting and value change for the scaler units 140a to 140d, the image recognition units 150a to 150d, the position moving units 160a to 160d, and the mask information storage units 170a to 170d. Further, a mask is generated from the image recognition result. The control unit 120 is configured by, for example, a microcomputer.

  The operation input unit 110 receives an input of an operation from the user and outputs the operation that has received the input to the control unit 120 as investigation information.

  The image recognition units 150a to 150d perform presence detection and position detection of important objects such as people and characters from a moving image. In particular, the image recognition units 150b to 150d recognize the face area from the second moving image, and change the transmittance of the mask image information using the face area as a predetermined area. The image recognition units 150b to 150d may gradually change the transmittance when changing the transmittance of the mask image information.

  The image recognizing unit 150a may recognize a character area from the first moving image, and notify each of the position moving units 160b to 160d of the child screen processing unit of a value indicating the character area. If it does in this way, position moving parts 160b-160d should just set the display position on the monitor (not shown) of the 2nd animation to the position which does not overlap with a character field.

  The position moving units 160b to 160d may gradually change the transmittance when setting the display position of the second moving image on the monitor (not shown) to a position that does not overlap the character area. Thus, the second moving image before the display position change is gradually erased, and the second moving image after the display position change is gradually displayed.

《About supplementary explanation of blend processing unit》
A supplementary explanation will be given for the blend processing section.

  FIG. 4 is a diagram for supplementarily explaining the blend processing unit according to the present embodiment. The main screen 210 (moving image in which no mask is specified) is treated as a background. The first child screen 220, the second child screen 230, and the third child screen 240 (moving images with masks) are treated as foregrounds. The foreground and background are subjected to blend processing (for example, alpha blend processing) in units of pixels. In the alpha blending process, if the alpha value of the pixels of the mask image is 80%, for example, as shown in equation (1), the foreground is blended at a ratio of 80% and the background is 20%.

<< Flow of processing executed by display device >>
A flow of processing executed by the display device according to the present embodiment will be described.

  FIG. 5 is a diagram illustrating a flow of processing executed by the display device according to the present embodiment. As shown in FIG. 5A, as an overall flow, first, the control unit 120 performs initial setting (step S101). In this initial setting, initial settings are made for the scaler units 140a to 140d, the image recognition units 150a to 150d, the position moving units 160a to 160d, and the mask information storage units 170a to 170d. Thereafter, the control unit 120 performs input 1 mask change (step S102), input 2 mask change (step S103), input 3 mask change (step S104), and input 4 mask change (step S105). Thus, the mask image is dynamically changed for inputs 1 to 4. Here, input 1 to input 4 indicate the moving images that the moving image input units 130a to 130d have received.

  The control unit 120 determines whether or not there is a parent-child change instruction from the user (step S106). In this determination, the operation information output from the operation input unit 110 is determined. When it is determined that there is no parent-child change instruction from the user (“No” in step S106), the control unit 120 proceeds to step S108. When it is determined that there is a parent-child change instruction from the user (“Yes” in step S106), the control unit 120 performs parent-child change (step S107), and proceeds to step S108.

  The control unit 120 determines whether or not the power is turned off (step S108). When determining that the power is not turned off (“No” in step S108), the control unit 120 returns to step S102. When determining that the power is turned off (“Yes” in step S108), the control unit 120 ends the processing of the entire flow.

  As shown in FIG. 5B, as an initial setting, the control unit 120 sets the input 1 as the “parent screen” (step S201). In addition, the control unit 120 displays the scaler (scaling ratio) as “1: 1” without being enlarged or reduced. By setting the position movement to “center”, the input 1 is displayed on the entire screen. In addition, the control unit 120 sets the image recognition to “none”, so that no recognition result is output. In addition, the control unit 120 sets the mask to “None” so that the blend processing unit 180 handles the background.

  The control unit 120 sets the input 2 as a “child screen” (step S202). In addition, the control unit 120 reduces the input 2 to 1/3 in the vertical and horizontal directions by setting the scaler (scaling ratio) to “1/3”. By setting the position movement to “lower left”, input 2 is displayed at the lower left of the screen. In addition, the control unit 120 sets an “initial value” described in the explanation of each use example later for the image recognition and the mask.

  The control unit 120 sets the input 3 as a “child screen” (step S203). In addition, the control unit 120 reduces the input 3 to 1/3 in the vertical and horizontal directions by setting the scaler (scaling ratio) to “1/3”. By setting the position movement to “middle lower”, the input 2 is displayed at the lower center of the screen. In addition, the control unit 120 sets an “initial value” described in the explanation of each use example later for the image recognition and the mask.

  The control unit 120 sets the input 4 as a “child screen” (step S204). In addition, the control unit 120 reduces the input 4 to 1/3 in the vertical and horizontal directions by setting the scaler (scaling ratio) to “1/3”. By setting the position movement to “lower right”, input 2 is displayed at the lower right of the screen. In addition, the control unit 120 sets an “initial value” described in the explanation of each use example later for the image recognition and the mask.

  As shown in FIG. 5C, as the mask change, the control unit 120 determines whether or not there is a mask change according to the change in the recognition result obtained from the image recognition units 150a to 150d ( Step S301). If it is determined that there is no mask change (“No” in step S301), the mask change process is terminated. If it is determined that there is a mask change (“Yes” in step S301), the mask is changed from the recognition result (step S302), and the mask change process is terminated.

About mask
An example of a mask according to this embodiment will be described.

  FIG. 6 is a diagram illustrating an example of a mask according to the present embodiment. The uniform mask 310 is a mask image used when blending with a uniform transmittance. In the example shown in FIG. 6A, the uniform mask 310 is composed of a translucent region 340 (for example, a region with a transmittance of 50%).

  The reference mask 320 is a mask image used when an appropriate image recognition result cannot be obtained. In the example shown in FIG. 6B, the sub-screen display area 370 is an area having a transmittance of 100% (100% sub-screen side is displayed). In addition, the main screen display area 350 is an area having a transmittance of 0% (100% main screen side is displayed). The intermediate region 360, which is the boundary portion, is subjected to gradients, and the transmittance changes gradually (smoothly). The reason why the shape of the child screen display area 370 is a horizontally long ellipse is to make the vicinity of the center of the horizontally long screen of the child screen more clearly visible.

  The recognition mask 330 is a mask image that is automatically generated based on the image recognition result. In the example shown in FIG. 6C, like the reference mask 320, the small-screen display area 370 has a transmittance of 100% and the parent screen display area 350 has a transmittance of 0%. Two vertically long ovals are arranged when two people are photographed and are surrounded by vertically long ellipses in accordance with the faces of the persons. The sub-screen display area 370 also moves following the movement of the person.

<Example of uniform mask usage>
An example of using the uniform mask according to this embodiment will be described.

  FIG. 7 is a diagram showing a usage example of the uniform mask according to the present embodiment. The uniform mask 310 is always set without using image recognition. Since the translucent region 340 is uniformly blended with the parent screen 210 at a transmittance of 50%, the parent screen 210 and the child screen indicated by the translucent region 340 are displayed on the screen 200 so that both can be seen.

<Reference mask usage example>
An example of use of the reference mask according to the present embodiment will be described.

  FIG. 8 is a diagram illustrating a usage example of the reference mask according to the present embodiment. The reference mask 320 is always set without using image recognition. As shown in FIG. 8, it can be seen that by setting an appropriate reference mask 320, it is possible to display a superposed multiple screen that is easy to see to some extent on both the parent screen 210 and the child screen.

  In this case, an additional description will be given regarding the flowchart shown in FIG. “None” is set in the image recognition settings of the inputs 2 to 4. For the masks of inputs 2 to 4, a “reference mask” is set. Regarding the mask change, since no image recognition is performed, there is no change operation. (Always reference mask)

About recognition mask
A recognition mask according to this embodiment will be described.

  FIG. 9 is a diagram illustrating a recognition mask according to the present embodiment. The image recognition units 150a to 150d output the face area 380 from the input moving image as a recognition result (see FIG. 9A). The control unit 120 generates a mask pattern (recognition mask 330) using the recognition result (see FIG. 9B). Furthermore, by applying a two-dimensional filter, the control unit 120 generates a mask pattern (recognition mask 330) having an intermediate region 360 in which the transmittance gradually changes (smoothly) (see FIG. 9C).

  In order to insert and display a person appearing on the child screen on the parent screen, a method of accurately cutting out the shape of the person can be considered. However, this method requires highly accurate recognition. By using an ellipse as a mask pattern, good insertion display is possible even with recognition that is not highly accurate.

  Depending on the movement of the person, the recognition results of the image recognition units 150a to 150d change every moment. If the mask to be used is linked directly to the recognition result, the mask pattern vibrates in accordance with the movement, resulting in an image that is difficult to see. Therefore, by applying a time axis filter (filter in the image frame direction) to the generated mask, vibrations and the like are reduced and the display becomes easy to see.

  Depending on the image, the image recognition units 150a to 150d may not recognize anything. In such a case, the child screen can be appropriately superimposed on the parent screen by using the reference mask 320.

《Recognition mask usage example》
A usage example of the recognition mask according to the present embodiment will be described.

  FIG. 10 is a diagram illustrating a usage example of the recognition mask according to the present embodiment. In this example, it is possible to effectively display only important objects in the child screen by recognizing a person or the like using image recognition and arranging an elliptical mask pattern at a position according to the recognition result. The intermediate region 360, which is the boundary portion of the elliptical mask pattern, is graded similarly to the reference mask 320 so that the transmittance gradually (smoothly) changes. As shown in FIG. 9, it can be seen that by using a mask according to the image recognition result, it is possible to display a superimposed-type multi-screen display that is easier to see compared to the usage example of the reference mask 320.

  In this case, an additional description will be given regarding the flowchart shown in FIG. In the image recognition settings for inputs 2 to 4, “person position detection” is set. For the masks of inputs 2 to 4, “recognition mask” is set as an initial value. Regarding the mask change, a mask is generated from the result of image recognition, and the contents of the mask information storage units 170a to 170d are rewritten.

《Instructions for changing parent and child by user》
A parent-child replacement instruction by the user according to the present embodiment will be described.

  When such a parent-child screen superimposed display is performed, the user may want to enlarge the child screen. In that case, in the flowchart shown in FIG. 5, by changing the setting for moving image input, the parent and child are switched. For example, when the input 1 is displayed as the parent screen and the input 3 is displayed as the child screen, when the input 1 and the input 3 are switched, the settings for the input 1 and the input 3 performed in the initial setting are switched. , Parent and child are switched. For example, when the user inputs an instruction to display the input 3 on the parent screen to the operation input unit 110, the operation input unit 110 receives operation information indicating that the input 3 is designated as the parent screen to the control unit 120. Is output.

《Countermeasures for character super on the main screen》
A countermeasure to the superimpose on the main screen according to the present embodiment will be described.

  FIG. 11 is a diagram for explaining countermeasures against the superimpose on the main screen according to the present embodiment. On the parent screen, there may be a character superimposition such as a time display of a broadcasting station or a score display of a sports broadcast (see the parent screen 910b shown in FIG. 11). At this time, if a sub-screen is displayed on the character superimposition, it becomes difficult to see the character superimposition. As a countermeasure in such a case, character recognition is set as an image recognition setting for the parent screen (input 1 in the flowchart shown in FIG. 5). When the image recognition unit 150a of the parent screen recognizes the character, the character superimposition can be easily seen by changing the display position of the child screen (second child screen 930) so as to avoid the position.

  When the sub-screen display position is automatically changed, it may be possible to give the user a sense of incongruity if the sub-screen display position is automatically moved instantaneously. As a countermeasure, it is possible to reduce the uncomfortable feeling by fading out the child screen at the old position by gradually changing the transmittance and fading in the child screen at the new position by gradually changing the transmittance. is there.

<< Effects produced by this embodiment >>
As described above, it is possible to display an easily viewable multi-screen by superimposing a child screen on the parent screen using a mask. A relatively easy-to-view multi-screen display is possible even with superimposition using a fixed reference mask without using recognition. Even with existing broadcast receivers, many scalers and alpha blenders have already been adopted, so the difficulty level is not high.

  By using image recognition, multi-screen display that is easier to see is possible. In recent years, image recognition has come to be used in many digital cameras and camcorders. This recognition technology can be applied to a display device.

  By using easy-to-view multi-screen display, it becomes easy to view a large number of (or many) large-volume video contents by multi-channel broadcasting, Internet video distribution, etc. at the same time. This makes it easy to view a plurality of (or many) moving image contents with high efficiency by displaying the contents to be noticed and their scenes in a large image frame by switching between the parent and the child.

<< Variation of this embodiment >>
In the above, preferred embodiments of the present invention have been described with reference to the accompanying drawings. However, it goes without saying that the present invention is not limited to such examples. It will be apparent to those skilled in the art that various changes and modifications can be made within the scope of the claims, and these are naturally within the technical scope of the present invention. Understood.

It is a figure explaining the outline | summary of a general display apparatus (division display system). It is a figure explaining the outline | summary of a general display apparatus (small-screen superimposition system). It is a figure which shows the structure of the display apparatus which concerns on this embodiment. It is a figure explaining supplementary about the blend process part which concerns on this embodiment. It is a figure which shows the flow of the process which the display apparatus which concerns on this embodiment performs. It is a figure which shows the example of the mask which concerns on this embodiment. It is a figure which shows the usage example of the uniform mask which concerns on this embodiment. It is a figure which shows the usage example of the reference | standard mask concerning this embodiment. It is a figure explaining the recognition mask which concerns on this embodiment. It is a figure which shows the usage example of the recognition mask which concerns on this embodiment. It is a figure explaining the countermeasure to the character superposition of the main screen concerning this embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Display apparatus 110 Operation input part 120 Control part 130a-130d Movie input part 140a-140d Scaler part 150a-150d Image recognition part 160a-160d Position moving part 170a-170d Mask information storage part 180 Blend process part 190 Movie output part 200 Screen 210 parent screen 220 first child screen 230 second child screen 240 third child screen 310 uniform mask 320 reference mask 330 recognition mask 340 translucent region 350 parent screen display region 360 intermediate region 370 child screen display region 380 face region 900 screen 910a Parent screen 910b Parent screen 920 First child screen 930 Second child screen 940 Third child screen

Claims (10)

A video input unit that receives input of video information that is the basis of the first video;
A scaler unit that sets a display size of the first moving image on the monitor to a predetermined size;
A position moving unit that sets a display position of the first moving image on the monitor to a predetermined position;
A main screen processing unit having
A mask image information storage unit that stores mask image information in which the transmittance in the case where the second moving image is the foreground and the first moving image is the background is set for each pixel constituting the second moving image;
A video input unit that receives input of video information that is the basis of the second video;
A scaler unit that sets a display size of the second moving image on the monitor to a predetermined size smaller than a display size of the second moving image;
A position moving unit that sets a display position of the second moving image on the monitor at a predetermined position where the entire second moving image overlaps a part of the first moving image;
One or more sub-screen processing units having:
Processing for acquiring mask image information stored in the mask image information storage unit and adding each pixel value according to the transmittance set in the mask image information for each pixel corresponding to the first moving image and the second moving image For each of the second videos to generate a third video,
A video output unit for outputting the third video to the monitor;
A display device comprising: The blend processing unit
When the transmittance is α,
(Pixel value of the first moving image) × (1−α) + (pixel value of the second moving image) × α (1)
The process of adding the pixel values is performed by
The display device according to claim 1. The mask image information is
Of the predetermined area and other areas included in the second moving image, 1 is set as the transmittance α of the pixels in the predetermined area, and 0 is set as the transmittance α of the pixels in the other area. Being
The display device according to claim 2. The predetermined area is:
An area surrounded by a substantially circle or an ellipse,
The display device according to claim 3. An intermediate region further exists as a region sandwiched between the predetermined region and the other region, and the transmittance of the pixels in the intermediate region increases as the pixel approaches the other region from a pixel close to the predetermined region. Go down,
The display device according to claim 4. Each of the one or more sub-screen processing units includes:
6. The image recognition unit according to claim 1, further comprising: an image recognition unit that recognizes a face area from the second moving image and changes the transmittance of the mask image information using the face area as the predetermined area. Display device. The image recognition unit
When changing the transmittance of the mask image information, gradually change the transmittance,
The display device according to claim 6. The parent screen processing unit
An image recognition unit for recognizing a character region from the first video and notifying each of the position moving units of the one or more sub-screen processing units of a value indicating the character region;
Each position moving unit of the one or more sub-screen processing units is
The display position of the second moving image on the monitor is set to a position that does not overlap the character area.
The display device according to claim 1. Each position moving unit of the one or more sub-screen processing units is
When the display position of the second moving image on the monitor is set to a position that does not overlap the character area, the second moving image before the display position change is gradually erased by gradually changing the transmittance. , Gradually display the second video after changing the display position,
The display device according to claim 8. The main screen processing unit
A step of accepting input of video information as a basis of the first video;
Setting a display size of the first moving image on a monitor to a predetermined size;
Setting a display position of the first moving image on the monitor to a predetermined position;
Run
One or a plurality of mask image information storage units that store mask image information in which the transmittance when the second moving image is the foreground and the first moving image is the background is set for each pixel constituting the second moving image The child screen processing part of
Receiving an input of video information that is a source of the second video;
Setting a display size of the second moving image on the monitor to a predetermined size smaller than a display size of the second moving image;
Setting the display position of the second moving image on the monitor to a predetermined position where the entire second moving image overlaps a part of the first moving image;
Run
Blend processing section
The mask image information stored in the mask image information storage unit is acquired, and each pixel value is calculated for each pixel corresponding to the first moving image and the second moving image according to the transmittance set in the mask image information. , Performing a process of adding the calculated pixel values for each of the second moving images to generate a third moving image,
The video output section
A display method for executing the step of outputting the third moving image to the monitor.

Images