JP2008154075A - Video processor, and control method, program and storage medium thereof - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide technology for properly synthesize video contents for output based on a result by authenticating a display which is an output destination of a plurality of video contents. <P>SOLUTION: The video processor is characteristically provided with: an acquisition means for acquiring a plurality of video images; and a composition means for selecting the video image for synthesis based on the result by authenticating the display at a destination to which the plurality of video images are attempted to be output and necessity/unnecessity of content protection of each of the plurality of video images and composing the plurality of video images by layout based on the number of selected video images. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a video processing apparatus that outputs video data to a display.

  In order to prevent illegal use of digitized video content, for example, content protection technology is required. For example, when outputting video content via HDMI (High Definition Multimedia Interface), the technology of HDCP (High Bandwidth Digital Protection) can be used.

  When video content that requires content protection (hereinafter referred to as premium content) is output to a display via HDMI, the video content is output only to an HDCP-authenticated display, thereby illegally copying the video content. Can be protected.

  On the other hand, with an increase in the screen size of the display, it is possible to use such a manner that a video obtained by combining a plurality of video contents (hereinafter referred to as a multi-window video) is displayed on a single display screen for viewing.

Furthermore, the spread of usage forms in which a multi-window video is displayed on a plurality of displays and viewed by a plurality of users can be considered.
JP 2000-83022 A JP 2006-108961 A JP 2004-95159 A

  Consider the case where multi-window video contains video content that needs content protection. In this case, premium video content is excluded from the compositing targets for displays that are not HDCP authenticated. Then, it is necessary to generate and output a multi-window video in which only video content that does not require content protection (hereinafter referred to as free video content) is synthesized.

  However, conventionally, it has not been sufficiently considered how to perform the composite display in such a case.

  The present invention has been made to solve the above problem, and provides a technique for appropriately synthesizing video content to be output based on the result of authenticating a display to which a plurality of video contents are to be output. The main purpose is to do.

  In order to solve the above problem, according to the video processing apparatus of the present invention, the result of authenticating the acquisition means for acquiring a plurality of videos, the display to which the plurality of videos are to be output, and the plurality of videos And a synthesis unit that selects a video to be synthesized based on the necessity of content protection and synthesizes the plurality of videos in a layout based on the number of selected videos.

  According to the above configuration, the video content to be output can be appropriately combined based on the result of authenticating the display that is the output destination of the plurality of video content.

(Example 1)
FIG. 1 is a diagram illustrating a configuration of a video processing apparatus 100 according to the present embodiment.

  The main control unit 101 controls the entire video processing apparatus 100 based on a computer program stored in a built-in FLASH ROM or the like.

  The communication control unit 102 controls communication with an external device via a network (wired or wireless). For example, video content from an external device is received via a network and stored in the memory unit 103 as stream data.

  The memory unit 103 includes an SDRAM and a memory controller, controls access to the SDRAM from each part of the video processing apparatus 100, and stores data used by each part of the video processing apparatus 100 in the SDRAM.

  The tuner 104 receives a digital broadcast signal via an antenna (not shown).

  The demodulator 105 demodulates the digital broadcast signal from the tuner 104 into stream data.

  The stream decoder 106 decodes the stream data from the demodulating unit 105 or the stream data received via the network and stored in the memory unit 103, and classifies the video data, audio, section data, and the like into the memory unit 103. To remember.

  Further, the stream decoder 106 determines whether or not the content protection of each stream is necessary with reference to copy control information (hereinafter referred to as CCI: Copy Control Information) of the video stream and the audio stream.

  For example, if the CCI is a value indicating “copying possible without restriction”, it is determined that the stream does not require content protection. If the CCI is a value indicating “copy prohibited” or “only one generation can be copied”, it is determined that the stream needs to be protected.

  The video presentation unit 108 is notified of the result of determining the necessity of content protection in each stream.

  Based on the notified determination result, the video presentation unit 108 controls the output to the display so that the content of the video generated from the stream is protected.

  In other words, video generated from a stream that requires content protection is output only to a display that is HDCP authenticated. In addition, video generated from a stream that does not require content protection is output to a display regardless of the presence or absence of HDCP authentication.

  The video decoder 107 decodes the video stream stored in the memory unit 103 based on the encoding method (for example, MPEG2) and stores the decoded video data in the frame memory in the memory unit 103.

  Here, the video decoder 107 is configured to be capable of simultaneously decoding a plurality of video streams. For example, a video input via the tuner 104 and a video input via the communication control unit 102 are simultaneously decoded, and each decoded video data is stored in a frame memory in the memory unit 103.

  Further, the main control unit 101 extracts graphic data from the section data and the like stored in the memory unit 103, decodes this, and draws the decoded graphic data in the frame memory in the memory unit 103.

The video presentation unit 108 performs processing such as scaling and synthesis on the video data in the frame memory in the memory unit 103, and then outputs the processed data to the display 112 via HDMI.
The audio decoder 109 decodes the audio stream stored in the memory unit 103 based on the encoding method (for example, MPEG2 AAC), and outputs the decoding result to the speaker 111 via the audio presentation unit 110.

  FIG. 2 is a diagram illustrating an example of the configuration of the video presentation unit 108 and the video data flow. Reference numerals 205, 206, and 207 in the figure denote frame memories. The graphic data decoded by the main control unit 101, the video data of premium video content input from the tuner 104, and the video data of free video content input from the communication control unit 102 are written in the frame memories 205, 206, and 207, respectively. It is.

  In the figure, reference numerals 208, 209, and 210 denote plain memories. 208 is a plane memory for drawing graphic data, and 209 and 210 are plane memories for drawing video data. The plurality of plane memories have different uses.

  The scaler 201 enlarges or reduces the data in the frame memories 205, 206, and 207 at a specified scaling rate, and draws the data in the plane memories 208, 209, and 210. When the video stream input from the tuner 104 or the communication control unit 102 is an interlaced signal, it is converted into a progressive signal by a processing unit (not shown) and written into the plane memory.

  The combining unit 202 combines arbitrary plane memories from the plane memories 208, 209, and 210. The order of overwriting at the time of composition is in order of the plane memory 208 for storing graphic data, the plane memory 209 for storing video data, and the plane memory 210 for storing video data.

  Each plane memory has a configuration in which transparency information (α value) can be set on a pixel basis, and data of a lower plane memory can be displayed with a desired transmittance. . The HDMI output unit 203 outputs the synthesized video synthesized by the synthesis unit 202 to the display via HDMI.

  The HDCP control unit 204 communicates with a display connected via HDMI, and determines whether or not the display is an HDCP authenticated display. For an HDCP-authenticated display, the synthesized video from the synthesis unit 202 is encrypted and output.

  In the example of FIG. 2, the premium video content from the frame memory 206 and the free video content from the frame memory 207 are drawn in the plane memory 209. As described above, a multi-window video having a plurality of video windows can be configured by drawing a plurality of video contents in the plane memories 209 and 210 for drawing the video data.

  FIG. 3 shows an example of layout information when a video window is drawn in the plane memory in this embodiment.

  Reference numeral 301 denotes layout information when one video window exists on the display screen, and indicates that the video window 303 is drawn with the width w1 and the height h1 starting from the coordinates (x1, y1).

  Reference numeral 302 denotes layout information when there are two video windows on the display screen. In this information, a video window 304 having a width w2 and a height h2 starting from the coordinates (x2, y2) and a video window 305 having a width w3 and a height h2 starting from the coordinates (x2, y3) are drawn. It is shown that.

  In order to draw a video window in a desired layout on the plane memory, the main control unit 101 designates information related to the layout to the scaler 201.

  For example, when drawing two video windows like the plane memory 209, the main control unit 101 designates the following information to the scaler 201. That is, the size information (width and height) of the premium video content from the frame memory 206 and the coordinate information (starting point coordinate, width and height) of the video window 304, the size information of the free video content from the frame memory 207 and the video window. The coordinate information 305 is designated.

  Based on these specifications, the scaler 201 draws the premium video content from the frame memory 206 in the video window 304 of the plain memory and the free video content from the frame memory 207 in the video window 305 of the plain memory.

  When drawing one video window like the plane memory 210, the main control unit 101 designates the following information to the scaler 201. That is, the size information of the free video content from the frame memory 207 and the coordinate information of the video window 303 are designated.

  The scaler 201 draws premium video content from the frame memory 207 on the video window 303 of the plain memory based on these designations.

  Here, if the connected display (the display to which content is to be output) is not HDCP-authenticated, the main control unit 101 notifies the stream decoder 106 of information on whether or not content protection is necessary. Excluded). Then, a multi-window video with only free video content must be output to the display.

  At this time, the main control unit 101 switches layout information to be used depending on whether or not the connected display is HDCP authenticated.

  In the example of FIG. 2, the HDCP-authenticated display 213 has two video windows for outputting the premium video content from the frame memory 206 and the free video content from the frame memory 207. Therefore, the plane memory 209 is drawn based on the layout information 302.

  The plane memory 209 drawn based on the layout information 302 is combined with the plane memory 208 on which graphic data is drawn and is output to the display 213.

  Since only the free video content from the frame memory 207 is output to the display 214 that is not HDCP-authenticated, there is only one video window, so the plane memory 210 is drawn based on the layout information 301.

  The plane memory 210 drawn based on the layout information 301 is combined with the plane memory 208 on which graphic data is drawn and is output to the display 213.

  As described above, when the number of video windows in the multi-window video changes depending on whether or not the connected display is HDCP-authenticated, the main control unit 101 responds to the number of video windows in the multi-window video. Select layout information. In the layout in the above-described composition, the display area of each video is wider as the number of selected videos is smaller.

  Next, display output processing of the video processing apparatus 100 in the present embodiment will be described with reference to the flowchart of FIG.

  First, in step S401, video content that is a candidate to be displayed on the display 112 is acquired or selected.

  In the following description, it is assumed that the premium video content input from tuner 104 and the free video content input from communication control unit 102 are selected to be displayed on display 112 at the same time by a user operation.

  In step S402, it is determined whether the connected display 112 is HDCP-authenticated. If the determination is affirmative, the process proceeds to step S404. If the determination is negative, the process proceeds to step S407.

  In step S404, layout information corresponding to the number of video contents to be displayed is selected. Here, since it is determined in step S402 that the display 112 is HDCP-authenticated, premium video content can also be output.

  Accordingly, since the number of video contents to be displayed is 2, the layout information 302 is selected.

  In step S405, based on the selected layout information 302, scaling drawing on the plane memory 209 and video composition of the plane memory 208 and the plane memory 209 are started.

  In step S406, the synthesized multi-window video 211 is output to the display 213 via HDMI. At this time, the multi-window video 211 is encrypted and output based on HDCP.

  In step S407, since it is determined in step S402 that the display 112 is not HDCP-authenticated, a determination is made to exclude premium video content from the video content to be displayed.

  In step S408, layout information corresponding to the number of video contents to be displayed is selected. Here, since the number of video contents to be displayed is 1 as determined in step S407, the layout information 301 is selected.

  In step S409, based on the selected layout information 301, scaling drawing on the plane memory 210 and video composition of the plane memory 208 and the plane memory 210 are started.

  In step S410, the synthesized multi-window video 212 is output to the display 213 via HDMI.

  Note that the determination of whether or not HDCP authentication is performed is configured to be periodically executed at predetermined intervals. If the determination result is different from the previous time, the processing of S404 to S406, or depending on the result, The processing of S407 to S410 is executed.

  As described above, in the first embodiment, video content to be combined is selected based on whether or not the display connected to the video processing device 100 is HDCP authenticated. Furthermore, the layout for synthesizing the video content is controlled according to the number of the selected video content.

  As a result, even if the display is not HDCP-authenticated and the premium video content is excluded from the composition target, the display area in which the premium video content is to be displayed is allocated to the free video content, so that a multi-window video that is easy to view for the viewer is displayed. Can do.

(Example 2)
Next, the second embodiment will be described, but only portions different from the first embodiment will be described below.

  FIG. 5 is a diagram illustrating a configuration of the video processing apparatus 100 according to the second embodiment.

  The difference from the configuration of the video processing apparatus 100 shown in FIG. 1 is that the video presentation unit 108 is provided with an output interface (HDMI) to the display 113 in addition to an output interface (HDMI) to the display 112.

  That is, the video presentation unit 108 has two HDMI output interfaces and can output video to the display 112 and the display 113 simultaneously.

  That is, the synthesizing unit 202 in the video presentation unit 108 generates two or more synthesized videos (211 and 212) from the plane memories 208, 209, and 210 in parallel, and the synthesized videos 211 and 212 are displayed on the displays 213 and 214, respectively. Can be output.

  Next, the display output process of the video processing apparatus 100 according to the second embodiment will be described with reference to the flowchart of FIG.

  First, in step S601, video content to be displayed on the display 112 and the display 113 is acquired or selected.

  In step S602, it is determined whether the display 112 and the display 113 are both HDCP-authenticated. If it is determined that both are HDCP-authenticated, the process proceeds to step S603.

  In step S603, a composite video including premium video content is generated (the same processing as in steps S404 and S405 in FIG. 4 of the first embodiment is performed), and the composite video is output to the display 112 and the display 113. .

  The data flow at this time is shown in FIG. In FIG. 7, FIG. 2 (using the same reference numerals as in FIG. 2) shown in the first embodiment is used, and two displays in which the composite video 211 including the premium video content 207 is HDCP authenticated (FIG. 7). 213 and 214) are shown.

  In step S604, it is determined whether both the display 112 and the display 113 are displays that are not HDCP-authenticated. If it is determined that both are not HDCP-authenticated, the process proceeds to step S605.

  In step S605, a synthesized video that does not include premium video content is generated (the same processing as in steps S407, S408, and S409 in FIG. 4 of the first embodiment is performed), and the synthesized video is output to the display 112 and the display 113. To do.

  The data flow at this time is shown in FIG. FIG. 8 uses FIG. 2 shown in the first embodiment (using the same reference numerals as in FIG. 2), and the composite video 212 that does not include the premium video content 207 is output to two displays that are not HDCP-authenticated. It shows a state.

  If it is determined in step S604 that the display 112 is a display that has been HDCP authenticated and the display 113 is a display that is not HDCP authenticated (213 and 214 in FIG. 8), the process proceeds to step S606.

  In step S606, a composite video including premium video content is generated (the same processing as steps S404 and S405 in FIG. 4), and a composite video not including premium video content is generated (steps S407, S408, and S409 in FIG. 4). A similar process is performed.

  The composite video including the premium video content is output to the HDCP-authenticated display 112, and the composite video not including the premium video content is output to the non-HDCP authenticated display 113.

  The data flow at this time is shown in FIG. In FIG. 9, FIG. 2 shown in the first embodiment (the same reference numerals as those in FIG. 2 are used) is used. The composite video 211 including the premium video content 207 is output to the HDCP-authenticated display (213 in FIG. 9), and the composite video 212 not including the premium video content is output to the display (214 in FIG. 9) not HDCP-authenticated. Show.

  As described above, in the second embodiment, when the video processing apparatus 100 outputs multi-window video to a plurality of displays at the same time, video content to be combined is selected based on whether or not HDCP authentication is performed for each display. . Furthermore, the layout for synthesizing the video content is controlled according to the number of the selected video content.

  As a result, when a multi-window video including premium video content is output to a display that is HDCP authenticated and a display that is not HDCP authenticated at substantially the same time, an easy-to-view video with content protection is displayed even on a display that is not HDCP authenticated.

(Example 3)
Next, Example 3 as a modification of Example 2 will be described.

  In the second embodiment, the free video content 207 is drawn in the plane memory 209 and the plane memory 210. Therefore, it is necessary to secure a large memory bandwidth of the memory unit 103, which may be an obstacle when the device configuration of the video processing device 100 is applied to a low-cost device.

  In the second embodiment, the usage of the two plane memories 209 and 210 for rendering video is respectively used as a plane memory for rendering video output to a display that is HDCP authenticated, and a plane for rendering video output to a display that is not HDCP authenticated. Was in memory.

  In the third embodiment, the use of two plane memories for rendering video is a plane memory for rendering premium video content and a plane memory for rendering free video content, thereby solving the above problem. .

  FIG. 10 shows an example of the configuration and video data flow of the video presentation unit 108 in the third embodiment.

  1001 to 1014 in FIG. 10 correspond to 201 to 214 in FIG. A video window (1015 in the example of FIG. 10) of premium video content (1006 in the example of FIG. 10) is drawn in the plane memory 609. In the plain memory 610, a video window (1017 in the example of FIG. 10) of free video content (1007 in the example of FIG. 10) is drawn.

  Since the video window 1015 and the video window 1016 are combined into a composite video 1011 having two video windows, when the video window is drawn in the plane memory, the video window 1015 and the video window 1016 are based on the layout information 302 when there are two video windows. Drawn.

  That is, when the video window 1015 is drawn in the plane memory 1009, the video window 1015 is drawn based on the coordinate information (starting point coordinates, width, and height) of the video window 304 in the layout information 302.

  When the video window 1016 is drawn in the plane memory 1010, the video window 1016 is drawn based on the coordinate information (starting point coordinates, width, and height) of the video window 305 in the layout information 302.

  Also, in the area corresponding to the video window 304 of the layout information 302 in the plane memory 610, an alternative image window 1017 in which another alternative image prepared in advance is drawn.

For example, appropriate information can be provided to the viewer by setting the substitute image to indicate that “premium video content cannot be displayed”.
When the video window 1015 is drawn in the plane memory 1009, the video window 1015 is drawn in a non-transparent manner so that the corresponding area in the plane memory 1010 whose overwrite order is lower after the composition is not shown through.

  As a result, the substitute image window 1017 is not projected and displayed on the composite video 1011 from the plane memories 1008, 1009, and 1010.

  Further, in the synthesized video 1011 from the plane memories 1008, 1009, and 1010, the synthesis process is performed so that the video window 1016 is displayed.

  Reference numeral 1008 denotes a plane memory for drawing graphic data. Reference numeral 1009 denotes a plain memory for rendering premium video content. Reference numeral 1010 denotes a plain memory for rendering free video content.

  The synthesized video 1011 obtained by synthesizing the plane memories 1008, 1009, and 1010 is output to an HDCP authenticated display (613 in the example of FIG. 10).

  A composite video 1012 obtained by synthesizing the plane memory 1008 for drawing graphic data and the plane memory 1010 for drawing free video content is output to a display that is not HDCP authenticated (614 in the example of FIG. 10).

  Next, the display output process of the video processing apparatus 100 according to the third embodiment will be described with reference to the flowchart of FIG.

  First, in step S1101, video content to be displayed on the display 112 and the display 113 is selected.

  In step S1102, it is determined whether both the display 112 and the display 113 are HDCP authenticated. If it is determined that both are HDCP authenticated, the process proceeds to step S1103.

  In step S1103, a composite video including premium video content (for example, the composite video 1011 in FIG. 10) is generated, and the composite video is output to the display 112 and the display 113.

  In step S1104, it is determined whether both the display 112 and the display 113 are displays that are not HDCP-authenticated. If it is determined that both are not HDCP-authenticated, the process proceeds to step S1105.

  In step S1105, a composite video that does not include premium video content (for example, the composite video 1012 in FIG. 10) is generated, and the composite video is output to the display 112 and the display 113.

  If it is determined in step S1104 that the display 112 is an HDCP authenticated display and the display 113 is not a HDCP authenticated display, the process advances to step S1106.

  In step S1106, a composite video including premium video content (for example, composite video 1011 in FIG. 10) and a composite video not including premium video content (for example, composite video 1012 in FIG. 10) are generated.

  Then, the composite video including the premium video content is output to the HDCP-authenticated display 112, and the composite video not including the premium video content is output to the non-HDCP authenticated display 113.

  As described above, in the third embodiment, the use of the two plane memories for drawing video includes the first plane memory for drawing premium video content and the second plane memory for drawing free video content. did.

  Then, the first plane memory and the second plane memory are combined and output for an HDCP-authenticated display, and the second plane memory is output for a display that is not HDCP-authenticated.

  As a result, it is possible to obtain the effect as in the second embodiment while reducing the memory bandwidth to be used.

  In the third embodiment, when a multi-window video including premium video content is displayed on a display that is not HDCP-authenticated, the free video content is not displayed largely as in the second embodiment.

  However, since the substitute image window is displayed in the area where the premium video content is to be displayed, it is possible to provide more appropriate information to the viewer while balancing the screen layout.

(Modification)
The present invention may be applied as a part of a system constituted by a plurality of devices or may be applied to a part of an apparatus constituted by one device.

  Further, the present invention is not limited only to the apparatus and method for realizing the above-described embodiments.

  For example, it is within the scope of the present invention to supply a program code of software for realizing the above embodiments to a computer (CPU or MPU) in the system or apparatus. Further, the case where the above embodiment is realized by causing the computer of the system or apparatus to operate the various devices according to the program code is also included in the scope of the present invention.

  In this case, the program code of the software itself realizes the function of the above embodiment. That is, the program code itself and a means for supplying the program code to the computer, specifically, a storage medium storing the program code (a medium storing the program code in a state in which the program code can be read from the computer) are also provided. It is included in the category of the invention.

  As a storage medium for storing such a program code, for example, a floppy (registered trademark) disk, hard disk, optical disk, magneto-optical disk, CD-ROM, DVD, magnetic tape, nonvolatile memory card, ROM, or the like may be used. it can.

  The present invention is not limited to the case where the functions of the above-described embodiments are realized by controlling various devices according to only the program code. For example, the case where the above embodiment is realized in cooperation with an OS (operating system) running on a computer or other application software is also included in the scope of the present invention.

  Further, the present invention includes a case where the CPU or the like provided in the function expansion board performs part or all of the actual processing based on the instruction of the program code stored in the memory provided in the function extension board of the computer. included.

The figure which shows the structure of the video processing apparatus 100 in Example 1. FIG. The figure which shows the structure and image | video data flow of the image | video presentation part 108 in Example 1. FIG. The figure which shows an example of the layout information at the time of drawing a video window to plane memory Flowchart of video processing apparatus 100 in Embodiment 1 The figure which shows the structure of the video processing apparatus 100 in Example 2. FIG. Flowchart of video processing apparatus 100 in the second embodiment. The figure which shows an example of the video data flow in Example 2. The figure which shows an example of the video data flow in Example 2. The figure which shows an example of the video data flow in Example 2. The figure which shows the structure and image | video data flow of the image | video presentation part 108 in Example 3. FIG. Flowchart of video processing apparatus 100 in Embodiment 3

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Video processing apparatus 101 Main control part 102 Communication control part 103 Memory part 104 Tuner 105 Demodulation part 106 Stream decoder 107 Video decoder 108 Video presentation part 109 Audio | voice decoder 110 Audio | voice presentation part 111 Speaker 112 Display

Claims (8)

Acquisition means for acquiring a plurality of videos;
Based on the result of authenticating the previous display to output the plurality of videos and the necessity of content protection of each of the plurality of videos, the video to be synthesized is selected, and based on the number of selected videos An image processing apparatus comprising: a combining unit that combines the plurality of images with a layout.   2. The video processing apparatus according to claim 1, wherein, in the composition layout, the display area of each video is widened as the number of selected videos is small. The video processing apparatus has output means for outputting the video generated by the synthesizing means to two or more displays.
If the result of authenticating the two or more displays is not the same, the synthesizing unit generates a video having a different layout for each result of the authentication,
The video processing apparatus according to claim 1, wherein the output unit outputs a video synthesized with a layout according to the authentication result. The synthesizing unit draws, among the plurality of videos, a video that requires content protection in the first synthesis memory, a video that does not require content protection and another image prepared in advance in the second synthesis memory,
When the result of the authentication is the first result, the second synthesis memory is the synthesis target except the first synthesis memory,
When the result of the authentication is the second result, the first synthesized memory and the second synthesized memory are targeted for synthesis, and the other image is overwritten by the video drawn in the first synthesized memory. The video processing apparatus according to claim 1, wherein control is performed so that   The video processing apparatus according to claim 1, wherein the authentication is determined based on HDCP. An acquisition process for acquiring multiple images;
Based on the result of authenticating the previous display to output the plurality of videos and the necessity of content protection of each of the plurality of videos, the video to be synthesized is selected, and based on the number of selected videos And a synthesizing step of synthesizing the plurality of videos with a layout.   The computer program for making a computer perform each process of Claim 6.   A computer-readable storage medium storing the computer program according to claim 7.

Images