JP4960433B2 - Image processing apparatus, receiving apparatus, and display apparatus - Google Patents

Description

  The present invention relates to an image processing technique, and more particularly to an image processing device, a receiving device, and a display device that perform image processing on both moving images and still images.

  In recent years, as the resolution of an image increases, the resolution of a display panel itself such as a liquid crystal panel also increases, and a resolution exceeding full HD (High Definition) (for example, 3840 × 2160) is displayed. There is something that can be done.

  In Patent Document 1, when a 2048 × 1536 high-resolution still image is displayed on the display, even if the graphic card only supports still images with a resolution up to 1024 × 768, the input still image A technique is disclosed in which a high-resolution still image is displayed by dividing an image into four images having a resolution of 1024 × 768 and then connecting the still images and displaying the images on a display.

JP 11-119722 A

  By the way, when a moving image is displayed at a resolution exceeding full HD (High Definition), since the image is normally expanded by scaling processing, the displayed moving image is displayed at a resolution exceeding pure HD (High Definition). Do not mean.

  When a still image or a moving image is received from the outside and displayed on a liquid crystal panel or the like as in a television receiver, the still image is also subjected to scaling processing like the moving image. For example, in the case of a configuration (set top box and liquid crystal panel, etc.) in which a receiving device that receives a still image or moving image from the outside and a display device such as a liquid crystal panel that displays the received still image or moving image are separated, The devices are connected with a cable corresponding to HDMI (High-Definition Multimedia Interface), a still image is transmitted with the same resolution as a moving image, and a scaling process is performed on the screen.

  Unlike the moving image, the above-described still image such as EPG (Electronic Program Guide) can generate still images with various resolutions inside the receiving apparatus. Therefore, it is also possible to physically generate a still image having a resolution exceeding full HD.

  However, with a cable that supports HDMI, the maximum image resolution that can be transmitted is full HD resolution, and still images with resolutions exceeding full HD cannot be transmitted as they are. There was a problem that only still images with HD resolution could be displayed.

  The present invention has been made in view of the above, and an object thereof is to provide an image processing device, a receiving device, and a display device capable of displaying a still image having a resolution exceeding full HD.

Images it is processing device according to an embodiment of the present invention mediate a receiving device for outputting a stream including a first video resolution of the frame and the first resolution still image frames, the transmission of the stream transmission A display device connected to the receiving device via a means and capable of displaying a moving image and a still image having a second resolution higher than the first resolution, the image processing device comprising: The receiving device divides the still image of the second resolution to generate a plurality of divided still images of the first resolution, and the plurality of divided still images in a stream of moving image frames of the first resolution. Multi-processing means for outputting a stream with inserted frames, and the display device displays display means for displaying at least one of a moving image and a still image at the second resolution, A scaling processing means for converting a moving picture having a resolution of 1 to the second resolution; a storage control means for storing in the storage means a frame of the moving picture converted to the second resolution by the scaling processing means; and the receiving apparatus when receiving the first video resolution of the frame output from, along with displays on the display unit of this receiving video frame is converted into the second resolution by said scaling means, wherein when receiving the first resolution frame division still picture output from the receiving apparatus, the storage means the stored second video resolution frame to be displayed on at least one said display unit and then, a switching means for displaying a still image of a plurality of divided still images of the second resolution frame were synthesized on the display means, Ru comprising a.

  According to the present invention, there is an effect that it is possible to provide an image processing device, a receiving device, and a display device capable of displaying a still image having a resolution exceeding full HD.

It is the block diagram which showed the structure of the broadcast receiver concerning 1st Embodiment. It is a block diagram which shows the functional structure of the receiver shown in FIG. 1, a transmission cable, and a panel. It is a figure which shows the example in which a multiplexing circuit divides | segments a still image. It is a figure which shows the example in which a multiplexing circuit outputs a moving image and a still image for every flame | frame. It is a figure which shows the example in case a video scaling process part performs the scaling process of a moving image. It is a block diagram which shows the functional structure of the receiver and panel which concern on 2nd Embodiment. It is a figure which shows the example in case a multiplexing circuit outputs division | segmentation position information in addition to a still image and an identification signal. It is a figure which shows the example at the time of displaying a still image superimposed on the upper part (or lower half) part of the flame | frame of a moving image. It is a figure which shows the physical structure of the video memory shown in FIG. It is a figure which shows a mode until a blend process part superimposes and displays a moving image and a still image. It is a block diagram which shows the structure which shows the functional structure of the receiver and panel which concern on 3rd Embodiment. It is a figure which shows the example in the case of outputting the composite moving image which applied the update still image part to the still moving image part. It is a figure which shows the example in case a blend process part displays a restored moving image and a restored still image on a display part.

  Exemplary embodiments of an image processing apparatus, a receiving apparatus, and a display apparatus according to the present invention are explained in detail below with reference to the accompanying drawings.

(First embodiment)
FIG. 1 is a block diagram showing a configuration of a broadcast receiver 1000 according to the present embodiment. As shown in FIG. 1, the broadcast receiver 1000 includes a receiving device 100, a transmission cable 200, a panel 300, and an antenna 400. In the following, a broadcast receiver is shown as an example of an image processing apparatus as an embodiment of the present invention. However, an apparatus other than a broadcast receiver having the same function can be applied.

  The receiving device 100 receives video (moving image) broadcast via the antenna 400 or generates graphics (still image). The transmission cable 200 mediates the transmission of the above-described moving image or still image between the receiving apparatus 100 and the panel 300. The panel 300 displays the transmitted moving image or still image. The antenna 400 receives radio waves from the outside.

  FIG. 2 is a block diagram showing functional configurations of the receiving device 100, the transmission cable 200, and the panel 300 described above. First, the receiving apparatus 100 will be described.

  As illustrated in FIG. 2, the receiving device 100 includes a video receiving unit 101, a video processing unit 102, a graphics drawing processing unit 103, and a multiplexing circuit 104.

  The video receiving unit 101 converts the radio wave received by the antenna 400 into a broadcast signal, and decodes the converted broadcast signal. Then, the video reception unit 101 outputs the decoded broadcast signal to the video processing unit 102. The broadcast signal converted by the video receiving unit 101 includes program information such as a broadcast time of the moving image and a summary of the program content in addition to a video signal indicating the video data (moving image).

  The video processing unit 102 performs conversion processing such as progressive scan conversion on the broadcast signal decoded by the video receiving unit 101, and converts full HD (High Definition) video data (moving image) with a resolution of 1920 × 1080, It outputs to the multiplexing circuit 104 mentioned later.

  When receiving a request to display a still image on the panel 300 from an external remote controller (not shown) or the like, the graphics drawing processing unit 103 reads program information from the broadcast signal converted by the video receiving unit 101, for example, Then, graphics (still image) such as EPG (Electronic Program Guide) is generated, and the generated still image is output to the multiplexing circuit 104 described later. It is assumed that the resolution of the still image generated by the graphics drawing processing unit 103 is 3840 × 2160.

  Upon receiving the moving image output from the video processing unit 102 described above, the multiplexing circuit 104 divides the received moving image into frames and outputs them to the transmission cable 200. Further, when the multiplexing circuit 104 receives the still image generated by the graphics rendering processing unit 103, the received still image is an image having a resolution that can be transmitted by the transmission cable 200 (for example, an image having a resolution of 1920 × 1080). And the divided still image is output to the transmission cable 200.

  FIG. 3 is a diagram illustrating an example in which the multiplexing circuit 104 divides a still image. As illustrated in FIG. 3, the multiplexing circuit 104 generates a still image G1 having a resolution of 3840 × 2160 generated by the graphics rendering processing unit 103 and four still images G1-a to G1-d having 1920 × 1080. Divide into images. Then, the divided still images G1-a to G1-d are sequentially output to the transmission cable 200.

  As described above, the multiplexing circuit 104 outputs the moving image output from the video processing unit 102 for each frame without being divided, and the transmission cable 200 can transmit the still image generated by the graphics drawing processing unit 103. The image is divided according to the resolution, and the divided still image is output to the transmission cable 200.

  FIG. 4 is a diagram illustrating an example in which the multiplexing circuit 104 outputs a moving image and a still image. As shown in FIG. 4, the multiplexing circuit 104 sequentially outputs each of the moving images M1 to M3 for each frame, and then sequentially outputs the divided still images G1 to G4. In the example shown in FIG. 4, for example, when a user is viewing a moving image, switching is performed so that a still image G1 such as an EPG is viewed at the timing when the frame of the moving image M3 is transmitted, and then the moving images M4 to M7 are again displayed. This is when viewing.

  Further, when outputting the divided still image, the multiplexing circuit 104 outputs an identification signal S1 indicating that the output image is a still image. That is, the multiplexing circuit 104 outputs only a moving image when outputting a moving image, and outputs the still image and the identification signal S1 when outputting a still image. In the example illustrated in FIG. 4, the multiplexing circuit 104 outputs the subsequent moving images M4 to M7 after outputting the still image G4 and the identification signal S1. Subsequently, returning to FIG. 2, the transmission cable 200 will be described.

  The transmission cable 200 is a cable defined by the HDMI (High-Definition Multimedia Interface) standard, and transmits a full HD moving image or still image having a resolution of 1920 × 1080, and an identification signal S1. Next, the panel 300 will be described.

  As shown in FIG. 2, the panel 300 includes a video scaling processing unit 301, a video memory 302, a graphics configuration processing unit 303, a graphics memory 304, a blend processing unit 305, and a display unit 306. It consists of

  The video scaling processing unit 301 determines whether a moving image frame or a still image frame is transmitted by identifying the presence or absence of the identification signal S1. If the video scaling processing unit 301 determines that the identification signal S1 has not been transmitted, that is, that a moving image frame has been transmitted, the video scaling processing unit 301 performs a scaling process and stretches the transmitted moving image.

  FIG. 5 is a diagram illustrating an example when the video scaling processing unit 301 performs a scaling process of a moving image. As shown in FIG. 5, when the video scaling processing unit 301 receives moving images M1 to M4 having a resolution of 1920 × 1080 from the transmission cable 200 for each frame, the moving images M′1 to M ′ having a resolution of 3840 × 2160 are sequentially provided. '4 is subjected to scaling processing and output to the video memory 302 described later.

  The video memory 302 stores the moving images (M′1 to M′4) subjected to the scaling processing output from the video scaling processing unit 301 described above.

  Similarly to the video scaling processing unit 301, the graphics configuration processing unit 303 determines whether a moving image frame or a still image frame is transmitted by identifying the presence or absence of the identification signal S1. When it is determined that the identification signal S1 has been transmitted, that is, the still image has been transmitted, the graphics configuration processing unit 303 receives the divided still images in the order received (for example, G1 in the example shown in FIG. 2). -A to G1-d) in order to restore the still image G1 before division. Then, the restored still image G1 is output to the graphics memory 304 and the identification signal S1 is output.

  In the present embodiment, each of the video scaling processing unit 301 and the graphics configuration processing unit 303 identifies whether or not the identification signal S1 has been transmitted. For example, the identification signal S1 is identified. An identification unit may be provided. In this case, the processing load on the video scaling processing unit 301 and the graphics configuration processing unit 303 is reduced, and the determination of the identification signal S1 is performed in one place. Therefore, the scaling process or the combination of the divided images is performed more efficiently. It can be carried out.

  Returning to FIG. 2, the graphics memory 304 stores the still image (G1) having the resolution of 3840 × 2160 and the identification signal S1 restored by the graphics configuration processing unit 303 described above.

  The blend processing unit 305 determines whether or not the identification signal S1 is stored in the graphics memory 304 described above. If the blend processing unit 305 determines that the identification signal S 1 is stored, the blend processing unit 305 reads the still image stored in the graphics memory 304 and outputs the still image to the display unit 306.

  If the blend processing unit 305 determines that the identification signal S <b> 1 is not stored in the graphics memory 304, the blend processing unit 305 reads the moving image stored in the video memory 302 and outputs it to the display unit 306.

  As described above, the video receiving unit 101 of the receiving apparatus 100 receives a video signal from the outside, the video processing unit 102 outputs a moving image in which the video signal is converted to the full HD resolution, and the graphics rendering processing unit 103 is externally input. In response to the instruction, a still image with a resolution exceeding the full HD resolution is output, and the multiplexing circuit 104 generates a divided still image by dividing the still image with a resolution exceeding the full HD resolution into the full HD resolution. Divided still images and full HD resolution videos are output for each frame, the display unit 306 of the panel 300 displays video and still images with resolutions exceeding the full HD resolution, and the video scaling processing unit 301 is full HD. The video of the resolution is expanded, and the graphics composition processing unit 303 restores the divided still image to a still image with a resolution exceeding the resolution of full HD, and blend processing Since the display unit 306 displays a video with full HD resolution expanded 305 and a still image with a resolution exceeding the restored full HD resolution, even when the still image is transmitted along with the video. A still image with a resolution exceeding full HD can be displayed.

(Second Embodiment)
In the first embodiment described above, when switching between a moving image and a still image as an image to be displayed on the display panel, the still image is divided into resolutions that can be transmitted, so that the still image is full HD. Even in the case of a resolution exceeding that, it was decided to display with that resolution. However, there is a case where a still image is displayed as an OSD (On Screen Display) or the like on a part of the moving image so as to be superimposed on the moving image. Therefore, in such a case, a case will be described in which a moving image and a still image are displayed in an overlapping manner while appropriately controlling the moving image displayed together with the still image.

  FIG. 6 is a block diagram showing a functional configuration of receiving apparatus 600 and panel 700 according to the second embodiment. The receiving apparatus 600 according to the second embodiment is different from the graphics drawing processing unit 603 different from the graphics drawing processing unit 103 in the first embodiment and the multiplexing circuit 104 in the first embodiment. The first receiving apparatus 100 is different from the first receiving apparatus 100 in that a multiplexing circuit 604 is provided and a storage unit 605 is further provided.

  Further, the panel 700 according to the second embodiment includes a video scaling processing unit 701 that is different from the video scaling processing unit 301 in the first embodiment, and a video that is different from the video memory 302 in the first embodiment. A memory 702, a graphics configuration processing unit 703 different from the graphics configuration processing unit 303 in the first embodiment, a graphics memory 704 different from the graphics memory 304 in the first embodiment, and a first The panel 300 according to the first embodiment is different from the panel 300 according to the first embodiment in that the blend processing unit 705 is different from the first embodiment. In the following description, the same components as those in the first embodiment described above are denoted by the same reference numerals and description thereof is omitted.

  The graphics drawing processing unit 603 performs processing similar to the processing in the first embodiment, and displays a still image superimposed on the moving image while the moving image is displayed from an external remote controller (not shown) or the like. When the request is received, position information for displaying a still image on the moving image from the storage unit 605 described later (for example, the position of the still image with respect to the entire frame of the moving image. For example, if the still image is a rectangle, the coordinates of each vertex thereof) And the generated still image and position information are output to the multiplexing circuit 604.

  The multiplexing circuit 604 performs processing similar to the processing in the first embodiment, and also reads the position information received from the graphics drawing processing unit 603 when dividing a still image, and determines the position of the divided still image. The division position information shown is obtained. For example, when a rectangular still image is divided into four, each vertex coordinate of each divided still image is obtained, and each vertex coordinate of each obtained still image is output.

  At this time, the multiplexing circuit 604 outputs the division position information prior to the divided still image. That is, the division position information is output together with the moving image of the previous frame for transmitting the still image. The reason is that, as will be described later, when the video scaling processing unit 701 outputs a previous frame moving image (described later) to the video memory 702, it is determined whether to output a moving image to the frame buffer 7021.

  FIG. 7 is a diagram illustrating an example in which the multiplexing circuit 604 outputs division position information in addition to the still image and the identification signal S1. As shown in FIG. 7, the multiplexing circuit 604 outputs division position information together with the previous frame moving image (described later) before outputting the divided still image and the identification signal S1. In such a case, for example, as shown in FIG. 8, when the user is viewing the moving image M <b> 13, still images G <b> 11 and G <b> 12 are placed on the upper (or lower half) portion of the frame of the moving image M <b> 13. This is a case where both the moving image M13 and the still images G11 and G12 are viewed.

  The storage unit 605 is a storage medium such as a memory that stores position information indicating a position for displaying a still image on a moving image. As described above, the position information is, for example, the coordinates of each vertex when the still image is a rectangle, and is determined in advance. Subsequently, returning to FIG. 6, the panel 700 will be described.

  The video scaling processing unit 701 of the panel 700 performs processing similar to the processing in the first embodiment, and switches the output destination of the scaled moving image depending on whether or not the identification signal S1 is transmitted. To do.

  Specifically, the video scaling processing unit 701 determines whether or not the division position information is transmitted together with the moving image. If it is determined that the division position information is transmitted, the video scaling processing unit 701 Then, scaling processing is performed, and the result is output to a frame buffer 7021 of the video memory 702 described later. For example, in the example illustrated in FIG. 7, the moving image M13 transmitted together with the division position information is output to the frame buffer 7021. In this way, a moving image that is transmitted together with the division position information and subjected to the scaling process is referred to as a previous frame moving image.

  The video memory 702 stores the same content as the processing in the first embodiment, and controls the output of a moving image to be displayed overlaid on a still image.

  FIG. 9 is a diagram illustrating a physical configuration of the video memory 702. As shown in FIG. 9, the video memory 702 includes a frame buffer 7021 and a switching circuit 7022.

  The frame buffer 7021 stores the above-described previous frame moving image when the video scaling processing unit 701 determines that the division position information has been transmitted.

  As will be described later, when receiving the identification signal S1 output from the graphics configuration processing unit 703, the switching circuit 7022 reads the previous frame moving image from the frame buffer 7021 and outputs it to the blend processing unit 705.

  When the switching circuit 7022 has not received the identification signal S1 output from the graphics configuration processing unit 703, the switching circuit 7022 outputs the moving image output from the video scaling processing unit 701 to the blend processing unit 705.

  Returning to FIG. 6, the graphics configuration processing unit 703 performs processing similar to the processing in the first embodiment, determines whether or not the division position information is transmitted, and transmits the division position information. If it is determined that the image is divided, the division position information is read, the divided still images are sequentially restored, and the restored still images are output to the graphics memory 704.

  In addition, the graphics configuration processing unit 703 reads the transmitted division position information, obtains position information indicating a position for displaying the still image before division on the moving image, and stores the obtained position information in the graphics memory 704. Output.

  The graphics memory 704 stores the same content as the content in the first embodiment, and also stores the position information described above.

  The blend processing unit 705 performs the same processing as the processing in the first embodiment, reads the position information stored in the graphics memory 704, and receives it from the video memory 702 at the position indicated by the read position information. An image in which the previous frame moving image and the still image stored in the graphics memory 704 are superimposed (hereinafter referred to as a superimposed image) is generated and output to the display unit 306.

  FIG. 10 is a diagram illustrating an example of a flow until the blend processing unit 705 performs the above-described processing. In the example illustrated in FIG. 10, the moving image M13 is described as the previous frame moving image transmitted together with the division position information. First, when receiving the previous frame moving image M13 transmitted by the transmission cable 200, the video scaling processing unit 701 stores the previous frame moving image M13 in the frame buffer 7021.

  After that, the graphics configuration processing unit 703 reads the division position information (the division position information of the still image G11 in the example illustrated in FIG. 10) transmitted together with the previous frame moving image M13, and then the still image G11 that is sequentially transmitted thereafter. , The division position information of the still image G12, the still image G12 is read, the still image before the division is restored, the position information indicating the position for displaying the still image before the division on the moving image is obtained, and the still image before the division is obtained. The image and the position information are stored in the graphics memory 704.

  Then, the blend processing unit 705 reads the previous frame moving image M13 stored in the frame buffer 7021, further reads the position information stored in the graphics memory 704, and reads the previous frame moving image M13 and the graphics memory 704. A superimposed image MG1 is generated by superimposing the stored still image before division, and is output to the display unit 306.

  At this time, while reading the still images G11 and G12 from the graphics memory 704, the blend processing unit 705 repeatedly reads out the moving image M13 of the previous frame from the frame buffer 7021 to generate the superimposed image MG1, and displays the display unit. 306 is output. Accordingly, the number of times the divided still images are transmitted (that is, the number of times the identification signal S1 is transmitted. In the example shown in FIG. 10, two frames of the still images G11 and G12 are transmitted. ), The blend processing unit 705 generates the superimposed image MG1 and outputs it to the display unit 306.

  As described above, the storage unit 605 stores the position information indicating the position at which the still image having the resolution exceeding the full HD is displayed on the moving image having the full HD resolution, and the video memory 702 is superimposed on the still image having the resolution exceeding the full HD. The previous frame moving image that is a full HD resolution moving image to be displayed is stored, and the graphics rendering processing unit 603 instructs the external to display a still image having a resolution exceeding the full HD on the moving image having the full HD resolution from the outside. When received, the still image having a resolution exceeding full HD and the position information stored in the storage unit 605 are output, and the multiplexing circuit 604 reads the position information and places the divided still image on the moving image having the full HD resolution. When the division position information indicating the position to be displayed is obtained, the obtained division position information and the divided still image are output, and the video scaling processing unit 701 receives the division position information, The kailing-processed moving image is output to the video memory 702, and the graphics configuration processing unit 703 restores the divided still image to a still image having a resolution exceeding full HD based on the division position information, and further, the position based on the division position information. The information is obtained, and the still image with the resolution exceeding the restored full HD and the obtained position information are output. Based on the position information, the blend processing unit 705 generates the still image and the previous frame having the resolution exceeding the restored full HD. Since the superimposed image in which the moving image is superimposed is displayed on the display unit 306, a still image having a resolution exceeding full HD can be displayed even when the moving image and the still image are displayed in an overlapping manner.

(Third embodiment)
In the second embodiment described above, when a moving image and a still image are displayed as an image to be displayed on the panel 300, the moving image of the next frame is not displayed while the still image is displayed. By displaying the moving image of the frame, the moving image and the still image are displayed in an overlapping manner while appropriately controlling the moving image displayed together with the still image. However, for a user, when a still image is displayed and the operation is in a stationary state while a moving image is being displayed, there may be a case where a sense of reality is impaired. Therefore, in such a case, a case will be described in which a moving image and a still image are displayed on the panel 300 while using a still portion of the moving image.

  FIG. 11 is a block diagram showing a configuration showing a functional configuration of receiving apparatus 800 and panel 900 according to the third embodiment. A receiving apparatus 800 according to the third embodiment includes a video processing unit 802 that is different from the video processing unit 102 in the second embodiment, and a graphic that is different from the graphics rendering processing unit 103 in the second embodiment. This configuration is different from the first receiving apparatus 100 in that it includes a multiplexing circuit 804 different from the multiplexing circuit 604 in the second embodiment.

  Further, the panel 900 according to the third embodiment includes a video scaling processing unit 901 that is different from the video scaling processing unit 701 in the second embodiment and a video that is different from the video memory 702 in the second embodiment. Graphics in the second embodiment different from the memory 902, the graphics configuration processing unit 903 different from the graphics configuration processing unit 703 in the second embodiment, and the graphics memory 704 in the second embodiment This is different from the panel 300 according to the first embodiment in that it includes a memory 904 and a blend processing unit 905 that is different from the blend processing unit 705 in the second embodiment. In the following description, the same components as those in the first embodiment described above are denoted by the same reference numerals and description thereof is omitted.

  The video processing unit 802 performs processing similar to the processing in the second embodiment, specifies a range of a still portion (hereinafter referred to as a still moving image portion) in a moving image, and identifies the specified still moving image portion. Information indicating the range (for example, coordinates indicating the extension of the area of the still video portion (when the still video range is a rectangle, coordinates of each vertex of the rectangle), etc., hereinafter referred to as still video portion information). Output.

  The graphics configuration processing unit 803 performs processing similar to the processing in the second embodiment, determines whether a part or all of the still image has been updated to a new image, and determines one of the still images. If it is determined that all or part of the image has been updated, the range of the updated portion (hereinafter referred to as an updated still image portion) is specified. Information indicating the identified updated still image portion and the range of the updated still image portion (for example, coordinates indicating the extension of the area of the updated still image portion, as in the case of the still moving image portion. Hereinafter, updated still image portion information. .) Is output.

  The multiplexing circuit 804 performs processing similar to the processing in the second embodiment, and also includes the still moving image portion information output from the video processing portion 802 and the updated still image portion output from the graphics configuration processing portion 803. When the information is received, the still video part information and the updated still picture part information are compared, the part of the still video part range is replaced with the updated still picture part, and the still video part information and the updated still picture part information described above are replaced. At the same time, it is output to the transmission cable 200.

  In this way, a moving image in which the still image portion of the moving image is replaced with the updated still image portion of the still image is hereinafter referred to as a composite moving image. The reason why the multiplexing circuit 804 outputs both the still video part information and the updated still picture part information together with the composite video is that the still video part and the updated still picture part always match, as will be described later. Not limited to this, a restored moving image and a restored still image (both described later) cannot be generated.

  When outputting the above-described composite moving image, the size of the updated still image portion range may exceed the size of the still moving image portion range. In such a case, the moving image output to the transmission cable 200 may exceed the resolution of 1920 × 1080 that the transmission cable 200 can transmit.

  In such a case, when the multiplexing circuit 804 replaces the range portion of the still moving image portion with the updated still image portion, the size of both ranges is compared, and the range of the updated still image portion is determined to be small. Only when this is done, a part of the still video part may be replaced with the updated still picture part.

  Further, the multiplexing circuit 804 can also output a composite moving image by dividing the number of times. That is, the multiplexing circuit 804 first compares the size of both ranges, and when it is determined that the range of the updated still image portion is large, it counts the number of pixels included in the range of the updated still image portion. The updated still image portion is divided into a plurality of frames of still images so that the number of pixels obtained is equal to or less than the resolution of 1920 × 1080 that can be transmitted by the transmission cable 200. After that, the multiplexing circuit 804 applies a part of the divided updated still image part to the still moving picture part and outputs one composite moving picture, and another composite part in which the remaining updated still picture part is assigned to the moving picture of the other frame. It is also possible to output a movie.

  FIG. 12 illustrates an example in which the video processing unit 802 described above specifies a still moving image portion, the graphics configuration processing unit 803 specifies an updated still image portion, and the multiplexing circuit 804 outputs a composite moving image to the transmission cable 200. FIG.

  As shown in FIG. 12, first, the video processing unit 802 specifies still moving image portions g1 and g2 in the moving image M21 subjected to conversion processing such as progressive scan conversion. Then, the moving image M21 including the specified still moving image portions g1 and g2 and the updated still image portion information of the still moving image portions g1 and g2 are output to the multiplexing circuit 804.

  Note that there is no limitation on the method by which the video processing unit 802 specifies the still moving image part. When both pixel values are equal, the portion may be specified as a still moving image portion.

  In addition, the graphics configuration processing unit 803 identifies the updated still image units g′1 and g′2 from the still image G21, the identified updated still image units g′1 and g′2, and the updated still image unit. Information is output to the multiplexing circuit 804. The method for specifying the updated still image portion is the same as the method for specifying the still moving image portion described above.

  Then, the multiplexing circuit 804 outputs a composite moving image M ′ 21 in which the updated still image portions g ′ 1 and g ′ 2 received from the graphics configuration processing unit 803 are added to the moving image M 21 received from the video processing unit 802. Next, returning to FIG. 11, the video scaling processing unit 901 will be described.

  The video scaling processing unit 901 performs the same processing as the processing in the second embodiment, scales the composite moving image transmitted by the transmission cable 200, and sets the portion corresponding to the updated still image portion as the still moving image portion information. Then, a moving image (hereinafter referred to as a restored moving image) replaced with the still moving image portion acquired from the previous frame moving image is generated, and the generated restored moving image and still moving image portion information are output to the video memory 902.

  The video memory 902 stores the same content as the content in the second embodiment, and also stores the restored moving image and the still moving image portion information output from the video scaling processing unit 901 described above.

  The graphics configuration processing unit 903 performs processing similar to the processing in the second embodiment, reads the updated still image portion information transmitted together with the composite moving image, and cuts out the updated still image portion from the composite moving image. Then, the graphics configuration processing unit 903 converts the extracted updated still image portion into a portion corresponding to the updated still image portion of the still image (that is, the still image before being updated) stored in the graphics memory 904. An overwritten (updated) still image (hereinafter referred to as a restored still image) is generated, and the generated restored still image is output to the graphics memory 904.

  The graphics memory 904 stores the same content as that in the second embodiment, and also stores the restored still image output from the graphics configuration processing unit 903 and the updated still image unit information.

  The blend processing unit 905 performs processing similar to the processing in the second embodiment, reads the restored moving image from the video memory 902, and displays the read restored moving image on the panel 300. Also, the blend processing unit 905 reads the restored still image from the graphics memory 904 and displays the read restored still image on the panel 300.

  FIG. 13 is a diagram illustrating a state from when the above-described composite moving image is transmitted until a restored moving image and a restored still image are generated.

  As shown in FIG. 13, when the composite video M′21 and the still video part information are transmitted from the transmission cable 200, the video scaling processing unit 901 causes the updated still picture part g′1 in the composite video M′21. , The moving images m1 and m2 other than g′2 are cut out.

  Then, the video scaling processing unit 901 includes, from the previous frame moving image M20 stored in the frame buffer 9021 of the video memory 902, a portion of the still moving image portion g1 corresponding to the updated still image portions g′1 and g′2. Cut out g2. Further, the video scaling processing unit 901 replaces the updated still image portions g′1 and g′2 in the scaled composite moving image M′21 with the cut out still moving image portions g1 and g2, and restores the restored moving image M ″ 21. Is output to the video memory 902.

  On the other hand, when the composite moving image M′21 and the updated still image information are transmitted from the transmission cable 200, the graphics configuration processing unit 903 updates the updated still image portions g′1 and g′2 in the composite moving image M′21. Cut out.

  Then, the graphics configuration processing unit 903 cuts out a portion corresponding to the updated still image portions g′1 and g′2 in the still image stored in the graphics memory 904, and updates the still image portion g′1. , G′2 to generate a restored still image and output it to the graphics memory 904. Then, the blend processing unit 905 displays the restored moving image M ″ 21 and the restored still image G ′ 21 on the panel 300.

  As described above, the video processing unit 802 further specifies a still moving image portion that is a still portion in the moving image converted to the full HD resolution, outputs still moving image portion information indicating a range of the still moving image portion, and displays the graphic. The image drawing processing unit 803 further identifies an updated still image portion that is an updated portion of a still image having a resolution that exceeds the resolution of full HD, and the range of the identified updated still image portion and the updated still image portion Updated still image portion information is output, and the multiplexing circuit 804 generates a composite moving image in which at least a part of the still moving image portion of the full HD resolution moving image is replaced with the updated still image portion. The moving image information and the updated still image portion information are output, and the video scaling processing unit 901 scales the composite moving image and puts the portion corresponding to the updated still image portion in the still moving image portion acquired from the previous frame moving image. The graphics construction processing unit 903 reads the updated still image part information to obtain the updated still picture part from the composite video, and obtains a still picture with a resolution exceeding the restored full HD resolution. In this case, the updated still image is output to the updated still image unit, and the blend processing unit 905 displays the restored moving image and the restored still image on the display unit 306, so that the moving image and the still image are displayed in an overlapping manner. However, it is possible to display a still image having a resolution exceeding full HD without impairing the sense of reality.

  It should be noted that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the above embodiments. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

  DESCRIPTION OF SYMBOLS 1000 ... Broadcast receiver, 100, 600, 800 ... Receiver, 101 ... Video receiver, 102, 802 ... Video processor, 103, 603, 803 ... Graphics drawing processor, 104, 604, 804 ... Multiplex circuit, 200 ... Transmission cable, 300, 700, 900 ... Panel, 301, 701, 901 ... Video scaling processor, 302, 702, 902 ... Video memory, 303, 703, 903 ... Graphics configuration processor, 304, 704, 904 ... graphics memory, 305, 705, 905 ... blend processing section, 306 ... display section, 400 ... antenna, 605 ... storage section, 7021 ... frame buffer, 7022 ... switching circuit.

Claims (5)

A receiving device that outputs a stream including a first resolution moving image frame and a first resolution still image frame; and a transmission unit that mediates transmission of the stream; An image processing apparatus comprising: a display device capable of displaying a moving image and a still image of a second resolution that is higher than the resolution of 1;
The receiving device is:
Dividing the second resolution still image to generate a plurality of first resolution divided still images, and inserting the plurality of divided still image frames into the stream of the first resolution moving image frames A multi-processing means for outputting the processed stream,
The display device
Display means for displaying at least one of a moving image and a still image at the second resolution;
Scaling processing means for converting the moving image of the first resolution to the second resolution;
Storage control means for storing in the storage means a frame of the moving image converted to the second resolution by the scaling processing means;
When receiving the first video resolution of the frame output from the receiving apparatus to be displayed on said display means the received video frame is converted into the second resolution by the scaling processing unit together, when receiving the first resolution of the division still picture of the frame output from the receiving device, at least one said display means a video frame of the stored in the storage unit second resolution after displaying, the switching means for displaying a still image of a plurality of divided still images of the second were synthesized frame resolution on the display means,
Images processing device Ru comprising a. The switching means receives a frame of the divided still image having the first resolution output from the receiving device and then generates a still image having the second resolution by combining the frames of the divided still image. The image processing apparatus according to claim 1, wherein a frame of the moving image having the second resolution stored in the storage unit is displayed on the display unit. The receiving apparatus further comprises means for outputting an identification signal indicating that the frame of the divided still image has been output,
It said switching means, an image processing apparatus according to switch the row cormorants請 Motomeko 1 or 2 based on the identification signal. The said receiving apparatus used with the image processing apparatus as described in any one of Claims 1-3. The said display apparatus used with the image processing apparatus as described in any one of Claims 1-3.

Images