JP2017228884A - Image processing device, display device, and control method for image processing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To execute processing according to restriction even when the restriction on an order of image processing occurs, and to perform the processing in an efficient order when there is not the restriction on the order of the processing.SOLUTION: An image processing device 300A comprises: a black belt insertion section 152 adding addition image data of a size corresponding to a difference between resolution or an aspect ratio of an image based on input image data and resolution or an aspect ratio of a liquid crystal panel to the input image data; and a shape correction section 154A adding addition image data of a size corresponding to a difference between the resolution or the aspect ratio of the image based on the input image data and resolution or an aspect ratio set to synthesized image data. Processing for adding the addition image data is executed by the black belt insertion section 152 or processing for adding the addition image data by the shape correction section 154A according to whether or not superimposed image data are synthesized at a position of the addition image data added to the input image data or the synthesize image data.SELECTED DRAWING: Figure 4

Description

  The present invention relates to an image processing device, a display device, and a control method for the image processing device.

Conventionally, when the resolution of the input image data is different from the set resolution, the input image data is enlarged or reduced to match the resolution of the display (see, for example, Patent Document 1).
Conventionally, when the resolution of the input image data is different from the set resolution, a so-called black belt is sometimes added to the input image data (see Patent Document 2).

JP-A-8-137444 JP 2008-98693 A

However, when combining or adding other image data to the input image data, there is a case where processing contention, that is, processing order becomes a problem.
The present invention has been made in view of the above circumstances, and even if there is a case where a restriction is imposed on the order of processing, the process can be executed in accordance with this restriction. An object is to provide an image processing device, a display device, and a control method for the image processing device that can perform processing in order.

In order to achieve the above object, an image processing apparatus of the present invention is an image processing apparatus that outputs output image data having a set resolution or aspect ratio based on input image data, wherein the image processing apparatus superimposes on the input image data. A combining unit that combines image data and outputs combined image data; and additional image data having a size corresponding to a difference between the resolution or aspect ratio of the image based on the input image data and the set resolution or aspect ratio. The first addition unit to be added to the input image data, and the additional image data having a size corresponding to the difference between the resolution or aspect ratio of the image based on the input image data and the set resolution or aspect ratio. A second addition unit to be added to the image data, and a position of the additional image data to be added to the input image data or the composite image data; Depending on whether or not the superimposed image data is combined, the process of adding the additional image data by the first adding unit or the process of adding the additional image data by the second adding unit is executed. It is characterized by.
According to the present invention, the addition unit that performs the process of adding the additional image data to the first addition unit or the second addition unit according to whether or not the superimposed image data is synthesized at the position of the additional image data. Switch. Therefore, after the superimposed image data is synthesized with the input image data, when the order of the process of adding the additional image data is an efficient process order, the superimposed image data is synthesized at the position of the additional image data, etc. If there is a restriction on the order of processing, the processing can be executed corresponding to this restriction. Moreover, if there is no restriction | limiting in the order of a process, it can process in an efficient order.

In the image processing apparatus, when the superimposed image data is synthesized at a position of the additional image data added to the input image data or the synthesized image data, the first adding unit includes: When the process of adding the additional image data is executed and the superimposed image data is not combined with the position of the additional image data added to the input image data or the combined image data, the second adding unit A control unit that executes a process of adding the additional image data is provided.
According to the present invention, the control unit determines whether the superimposed image data is synthesized at the position of the additional image data added to the input image data or the synthesized image data, and the first addition unit or the second addition unit is determined. A process of adding additional image data to the unit.
Accordingly, the control unit determines whether or not the superimposed image data is combined at the position of the additional image data added to the input image data or the combined image data, and based on the determination result, the first addition unit or the second A process of adding additional image data to the adding unit can be executed.

Further, the present invention is the image processing apparatus, further comprising a storage unit, wherein the first addition unit writes the input image data to the storage unit, and adds the additional image data to the input image data read from the storage unit. In addition, the second addition unit functions as a first processing unit that performs a first process on the composite image data, adds the additional image data to the composite image data after the first process, and It writes in a memory | storage part, It is characterized by the above-mentioned.
According to the present invention, when the second adding unit performs the first process and writes the composite image data in the storage unit, the additional image data can be added to the composite image data. Therefore, it is not necessary to write the composite image data in the storage unit or read the composite image data from the storage unit only to add the additional image data to the composite image data, and the bus connected to the storage unit is not required. An increase in bandwidth load can be suppressed.

Further, the present invention is the image processing apparatus, further comprising a storage unit, wherein the first addition unit writes the input image data to the storage unit, and adds the additional image data to the input image data read from the storage unit. In addition, the second adding unit functions as a first processing unit that reads the composite image data written in the storage unit and performs a first process on the read composite image data. The additional image data is added to the later composite image data and output.
According to the present invention, when the second addition unit reads the composite image data from the storage unit and performs the first process, the additional image data can be added to the composite image data. Therefore, it is not necessary to write the composite image data in the storage unit or read the composite image data from the storage unit only to add the additional image data to the composite image data, and the bus connected to the storage unit is not required. An increase in bandwidth load can be suppressed.

In the image processing apparatus according to the aspect of the invention, the control unit includes a second processing unit that writes the input image data to the storage unit and performs a second process on the input image data read from the storage unit. Is characterized in that when the additional image data is added to the first addition unit, execution of the processing of the second processing unit is restricted.
According to the present invention, in order to add the additional image data to the input image data, when the process of writing the input image data into the storage unit or reading the input image data from the storage unit is performed, Since execution of the process is restricted, an increase in bandwidth load on the bus connected to the storage unit can be suppressed.

The display device of the present invention is a display device for displaying output image data having a set resolution or aspect ratio on a display unit based on input image data, and synthesizes superimposed image data with the input image data. A combined unit for outputting combined image data, and additional image data having a size corresponding to a difference between the resolution or aspect ratio of the image based on the input image data and the set resolution or aspect ratio as the input image data. A first addition unit to be added, and the additional image data having a size corresponding to the difference between the resolution or aspect ratio of the image based on the input image data and the set resolution or aspect ratio is added to the composite image data. The additional image data is added by the second addition unit and the second addition unit, and the combination unit combines the superimposed image data. And the display unit that displays the output image data as the output image data, or added to the input image data or the composite image data. The process of adding the additional image data by the first adding unit according to whether or not the superimposed image data is synthesized at the position of the additional image data to be added, or the additional image by the second adding unit A process of adding data is executed.
According to the present invention, the addition unit that performs the process of adding the additional image data to the first addition unit or the second addition unit according to whether or not the superimposed image data is synthesized at the position of the additional image data. Switch. Therefore, after the superimposed image data is synthesized with the input image data, when the order of the process of adding the additional image data is an efficient process order, the superimposed image data is synthesized at the position of the additional image data, etc. If there is a restriction on the order of processing, the processing can be executed corresponding to this restriction. Moreover, if there is no restriction | limiting in the order of a process, it can process in an efficient order.

According to another aspect of the present invention, there is provided a control method for an image processing apparatus for outputting output image data having a set resolution or aspect ratio based on input image data, wherein the output image data is superimposed on the input image data. A synthesis step of synthesizing image data and outputting synthesized image data; and additional image data having a size corresponding to a difference between the resolution or aspect ratio of the image based on the input image data and the set resolution or aspect ratio. The first addition step to be added to the input image data, and the additional image data having a size corresponding to the difference between the resolution or aspect ratio of the image based on the input image data and the set resolution or aspect ratio. A second adding step for adding to the image data, and added to the input image data or the composite image data. The position of the additional image data, the superimposed image data depending on whether the synthesis, characterized by adding the additional image data by said first addition step or the second addition step.
According to the present invention, the additional image data is added in the first addition step or the additional image data is added in the second addition step depending on whether or not the superimposed image data is synthesized at the position of the additional image data. Switch what to do. Therefore, after the superimposed image data is synthesized with the input image data, when the order of the process of adding the additional image data is an efficient process order, the superimposed image data is synthesized at the position of the additional image data, etc. If there is a restriction on the order of processing, the processing can be executed corresponding to this restriction. Moreover, if there is no restriction | limiting in the order of a process, it can process in an efficient order.

The block diagram which shows the structure of a projector. The figure which shows the image data to which black belt image data was added. The figure which shows the state which overlapped OSD image data on the black belt image data. 1 is a block diagram showing a configuration of an image processing apparatus according to a first embodiment. The flowchart which shows operation | movement of a control part. The block diagram which shows the structure of the image processing apparatus of 2nd Embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

[First Embodiment]
FIG. 1 is a block diagram illustrating a configuration of a projector (display device) 100 according to the first embodiment.
The projector 100 is connected to an external image supply device 200 such as a personal computer or various video players, and projects an image based on an image signal supplied from the image supply device 200 onto a projection target.
Examples of the image supply device 200 include a video playback device, a DVD (Digital Versatile Disk) playback device, a TV tuner device, a CATV (Cable television) set-top box, a video output device such as a video game device, a personal computer, and the like. Can be used. Further, the projection target may be an object that is not uniformly flat, such as an outer wall of a building, or may be an object that is not uniformly flat, such as a screen SC. In the present embodiment, a case where the projection target is the screen SC will be described as an example.

The projector 100 includes an interface unit (hereinafter, the interface is abbreviated as I / F) 140 as an interface connected to the image supply apparatus 200.
The I / F unit 140 includes a connector for connecting a cable and an I / F circuit (both not shown), and inputs an image signal supplied from the image supply apparatus 200 connected via the cable. The I / F unit 140 extracts image data from the input image signal and outputs the extracted image data to the image processing unit 150A. Image data output from the I / F unit 140 to the image processing unit 150A is hereinafter referred to as image data D. The image data D corresponds to “input image data” of the present invention.

The interface provided in the I / F unit 140 may be, for example, an interface for data communication such as Ethernet (registered trademark), IEEE 1394, USB, and RS-232C. The interface of the I / F unit 140 may be an interface for image data such as MHL (registered trademark), HDMI (registered trademark), DisplayPort, or the like.
Further, the I / F unit 140 may include a VGA terminal to which an analog image signal is input and a DVI (Digital Visual Interface) terminal to which digital image data is input as a connector. Further, the I / F unit 140 includes an A / D conversion circuit, and when an analog image signal is input via the VGA terminal, the analog image signal is converted into image data by the A / D conversion circuit. D is output to the image processing unit 150A.

The projector 100 includes a display unit 110 that forms an optical image and projects the image onto the screen SC.
The display unit 110 includes a light source unit 111, a light modulation device 112, and a projection optical system 113.
The light source unit 111 includes a light source such as a xenon lamp, an ultra high pressure mercury lamp, an LED (Light Emitting Diode), or a laser light source. The light source unit 111 may include a reflector and an auxiliary reflector that guide light emitted from the light source to the light modulation device 112. Further, the light source unit 111 includes a lens group for increasing the optical characteristics of the projection light, a polarizing plate, a light control element that reduces the amount of light emitted from the light source on the path to the light modulation device 112 (both shown) Abbreviation) may be provided.

  The light source unit 111 is driven by the light source driving unit 121. The light source driving unit 121 is connected to the internal bus 180. The light source driving unit 121 turns on and off the light source of the light source unit 111 under the control of the control unit 170.

  The light modulation device 112 includes, for example, three liquid crystal panels 115 corresponding to the three primary colors RGB. The light emitted from the light source unit 111 is separated into three color lights of RGB and is incident on the corresponding liquid crystal panel 115. The three liquid crystal panels 115 are transmissive liquid crystal panels 115, and modulate the transmitted light to generate image light. The image light modulated by passing through each liquid crystal panel 115 is combined by a combining optical system such as a cross dichroic prism and emitted to the projection optical system 113.

The light modulation device 112 is driven by the light modulation device driving unit 122. The light modulator driving unit 122 is connected to the internal bus 180.
The light modulator driving unit 122 drives the corresponding liquid crystal panel 115 based on the output image data input from the image processing unit 150 </ b> A, and draws an image on each liquid crystal panel 115. The output image data will be described later.

  The projection optical system 113 includes a lens group that projects the image light modulated by the light modulation device 112 toward the screen SC and forms an image on the screen SC. Further, the projection optical system 113 may include a zoom mechanism that enlarges or reduces a projected image projected on the screen SC and a focus adjustment mechanism that performs focus adjustment.

  The projector 100 includes a wireless communication unit 130. The wireless communication unit 130 is connected to the internal bus 180. The wireless communication unit 130 includes an antenna (not shown), an RF (Radio Frequency) circuit, and the like, and performs wireless communication with an external device under the control of the control unit 170. The wireless communication system of the wireless communication unit 130 may be, for example, a wireless LAN (Local Area Network), Bluetooth (registered trademark), UWB (Ultra Wide Band), near field communication such as infrared communication, or wireless using a cellular phone line. A communication method can be adopted.

The projector 100 includes an operation panel 133 and an input processing unit 137. The input processing unit 137 is connected to the internal bus 180.
The operation panel 133 functioning as a user interface is provided with various operation keys and a display screen constituted by a liquid crystal panel.
When an operation key on the operation panel 133 is operated, the input processing unit 137 outputs an operation signal corresponding to the operated key to the control unit 170. Further, the operation panel 133 is integrally formed with a touch sensor that detects contact with the operation panel 133. The input processing unit 137 detects the position of the operation panel 133 touched by the user's finger or the like as an input position, and outputs an operation signal corresponding to the detected input position to the control unit 170. Further, the input processing unit 137 displays various screens on the operation panel 133 based on the control signal input from the control unit 170.

  Further, the projector 100 has a remote controller 5 used by the user. The remote controller 5 includes various buttons, and transmits an infrared signal corresponding to the operation of these buttons. In the main body of the projector 100, a remote control light receiving unit 135 that receives an infrared signal emitted from the remote control 5 is disposed. The remote control light receiving unit 135 receives an infrared signal transmitted from the remote control 5. The input processing unit 137 decodes the infrared signal received by the remote control light receiving unit 135, generates an operation signal indicating the operation content in the remote control 5, and outputs the operation signal to the control unit 170.

  The projector 100 includes an image processing system. This image processing system is configured around a control unit 170 that controls the entire projector 100 in an integrated manner, and further includes a storage unit 160, an image processing unit 150A, and a frame memory 157. Each unit constituting the image processing system is connected to each other via an internal bus 180 so that data communication is possible. The frame memory 157 corresponds to the “storage unit” of the present invention.

The image processing unit 150A determines the resolution and aspect ratio of the image data D input from the I / F unit 140, whether it is a still image or a moving image, and attributes such as a frame rate if it is a moving image. The image processing unit 150A outputs the determined attribute of the image data D to the control unit 170 as attribute information. The image processing unit 150A develops the acquired image data D in the frame memory 157, and performs image processing on the developed image data D. Image processing executed by the image processing unit 150A includes, for example, frame interpolation, black band insertion, OSD (On Screen Display) image addition, shape correction, frame rate conversion, and the like. Details of these processes will be described later. The image processing unit 150A can also perform image processing other than these, for example, color conversion, color unevenness correction, gamma correction, zoom processing, luminance correction processing, and the like. The detailed configuration of the image processing unit 150A will be described with reference to FIG.
The image processing unit 150A reads the image data subjected to the image processing from the frame memory 157, and outputs the image data to the light modulation device driving unit 122 as output image data.

  The storage unit 160 is an auxiliary storage device such as a hard disk device, for example. The storage unit 160 may be replaced with a flash memory capable of storing a large amount of information or an optical disc such as a CD (Compact Disc), a DVD (Digital Versatile Disc), or a BD (Blu-ray (registered trademark) Disc). . The storage unit 160 stores application programs executed by the control unit 170 and various data.

The control unit 170 includes a CPU, a ROM, and a RAM (all not shown) as hardware. The ROM is a non-volatile storage device such as a flash ROM, and stores a control program and data. The RAM constitutes a work area of the CPU. The CPU expands the control program read from the ROM to the RAM, and executes the expanded control program to control each unit of the projector 100.
The control unit 170 includes a projection control unit 171 and a black belt control unit 172 as functional blocks. These functional blocks are realized by executing a control program expanded in the RAM.

The projection control unit 171 controls each unit of the projector 100 to control projection of an image on the screen SC.
Specifically, the projection control unit 171 controls the light modulation device driving unit 122 to draw an image on the liquid crystal panel 115. Further, the projection control unit 171 controls the light source driving unit 121 to turn on the light source of the light source unit 111 and adjust the luminance of the light source. As a result, image light emitted from the light source and modulated by the light modulation device 112 is projected onto the screen SC by the projection optical system 113.

When the resolution of the image data D is smaller than the panel resolution of the liquid crystal panel 115, the black band control unit 172 causes the image processing unit 150A to execute the black band addition process.
The black band addition process is a process of adding black band image data (hereinafter referred to as black band image data K) to the image data D, and setting the resolution and aspect ratio of the image data D to which the black band image data K is added, This is processing to match the panel resolution and aspect ratio of the liquid crystal panel 115. More specifically, the number of pixels in the vertical direction of the image data D to which the black band image data K is added is matched with the number of pixels in the vertical direction of the liquid crystal panel 115, and the image data D to which the black band image data K is added. This is a process for matching the number of pixels in the horizontal direction to the number of pixels in the horizontal direction of the liquid crystal panel 115. The panel resolution of the liquid crystal panel 115 corresponds to the “set resolution” of the present invention, and the aspect ratio of the liquid crystal panel 115 corresponds to the “set aspect ratio” of the present invention.
The black belt image data K is black image data indicating a non-display area where no image is displayed. The black belt image data K corresponds to the “additional image data” of the present invention, but the additional image data is not limited to the black belt image data K. For example, the color of the additional image data is not limited to black and is not limited to a single color. Further, the additional image data may be image data having a predetermined pattern set in advance.

Further, the black band control unit 172 calculates the size of the black band image data K to be added to the image data D. The black band control unit 172 adds the black band image data K to the image data D while maintaining the resolution and aspect ratio of the image data D, and the resolution and aspect of the image data D to which the black band image data K is added. The ratio is matched with the panel resolution and aspect ratio of the liquid crystal panel 115. The black band control unit 172 sets the size corresponding to the difference between the resolution or aspect ratio of the image data D and the panel resolution or aspect ratio of the liquid crystal panel 115 as the size of the black band image data K added to the image data D. calculate. The panel resolution of the liquid crystal panel 115 is information on the total number of pixels defined by the number of pixels in the horizontal direction (number of dots) and the number of pixels in the vertical direction (number of dots). The resolution of the image data D is information on the total number of pixels defined by the number of pixels in the horizontal direction (number of dots) and the number of pixels in the vertical direction (number of dots) of the image data D constituting one frame.
For example, the black band control unit 172 calculates the difference between the number of pixels in the horizontal direction of the liquid crystal panel 115 and the number of pixels in the horizontal direction of the image data D, and adds black band image data to the horizontal direction of the image data D. The horizontal size (number of pixels) of K is determined. Similarly, the black band control unit 172 calculates the difference between the number of vertical pixels of the liquid crystal panel 115 and the number of vertical pixels of the image data D, and adds the black band image to the vertical direction of the image data D. The vertical size (number of pixels) of the data K is determined.

FIG. 2 shows a case where black belt image data K is added above and below the image data D. FIG. 3 shows a case where black belt image data K is added to the top, bottom, left and right of the image data D.
The position of the black belt image data K added to the image data D is set in advance according to the resolution of the image data D and the panel resolution of the liquid crystal panel 115. Alternatively, the user may select a position for displaying the black belt image data K by operating the operation panel 133. For example, in the example shown in FIG. 2, the black belt image data K is added to the upper and lower sides of the image data D. For example, the black belt image data K may be added only to the lower side of the image data D.

FIG. 4 is a block diagram illustrating a configuration of the image processing apparatus 300A. The image processing apparatus 300 </ b> A is an apparatus configured by a part of the apparatuses that constitute the projector 100. The image processing apparatus 300A includes an image processing unit 150A, a frame memory 157, and a black belt control unit 172.
The image processing unit 150A includes a frame interpolation unit 151, a black band insertion unit 152, an OSD synthesis unit 153, a shape correction unit 154A, and a frame rate conversion unit 155A. The OSD synthesis unit 153 corresponds to the “synthesis unit” of the present invention. The black belt insertion portion 152 corresponds to the “first addition portion” of the present invention. In the first embodiment, the shape correction unit 154A corresponds to a “second addition unit” and a “first processing unit” of the present invention. The frame interpolation unit corresponds to the “second processing unit” of the present invention.

  Image data D is input from the I / F unit 140 to the frame interpolation unit 151. The frame interpolation unit 151 is set on or off by the black band control unit 172. When set to OFF, the frame interpolation unit 151 does not perform processing on the input image data D, and outputs the input image data D to the black band insertion unit 152 as it is.

In addition, when set to ON, the frame interpolation unit 151 writes the input image data D into the frame memory 157 and executes frame interpolation processing. The frame interpolation process executed by the frame interpolation unit 151 corresponds to the “second process” of the present invention.
When executing the frame interpolation process, the frame interpolation unit 151 reads, for example, image data D for two frames from the frame memory 157. In the following, among the read image data D for two frames, the first image data D in the display order of the display unit 110 is referred to as first image data D, and the image data D in the later display order is second image data D. That's it. The frame interpolating unit 151 synthesizes the mixed image data D for the two read frames while adjusting the composite ratio, thereby obtaining intermediate image data (hereinafter referred to as intermediate image data D) for the read two frames of image data D. Is generated. The frame interpolation unit 151 outputs the first image data D, the intermediate image data D, and the second image data D to the subsequent black band insertion unit 152 in this order. Hereinafter, the first image data D, the intermediate image data D, and the second image data D output from the frame interpolation unit 151 to the black band insertion unit 152 are referred to as image data D without particular distinction.

  Image data D that has undergone frame interpolation processing or image data D that has not undergone frame interpolation processing is input to the black band insertion unit 152 from the frame interpolation unit 151.

The black band insertion unit 152 is set on or off by the black band control unit 172.
When the black band control unit 172 determines that the resolution of the image data D input to the image processing unit 150A is smaller than the panel resolution of the liquid crystal panel 115, the black band control unit 172 executes black band addition processing.
First, the black belt control unit 172 represents the OSD image data (hereinafter referred to as OSD image data P. The “superimposed image data” of the present invention) in the image data D based on the operation setting received by the operation panel 133. .)) Is determined to be combined. When the OSD image data P is synthesized, the black belt control unit 172 specifies a position where the OSD image data P set by the operation setting received from the operation panel 133 or the initial setting is synthesized. In this embodiment, since the OSD image data P is synthesized using the frame memory 157, the black belt control unit 172 specifies the position where the OSD image data P is synthesized based on the position (coordinates) on the frame memory 157. To do. The frame memory 157 has a storage area in which a plurality of storage elements are arranged at equal intervals in the vertical direction and the horizontal direction, and one pixel corresponds to one coordinate. The position (coordinates) on the frame memory 157 is specified by, for example, coordinates having the origin at the upper left of the storage area. The OSD image data P is image data for setting various functions of the projector 100 and image data for adjusting the image quality of an image displayed by the projector 100. The OSD image data P is combined with the image data D by the OSD combining unit 153.

  If the black band control unit 172 determines that the OSD image data P is to be combined with the image data D, at least a part of the combination position where the OSD image data P is combined and the additional position where the black band image data K is added. It is determined whether or not. More specifically, the black band control unit 172 develops the image data D, the black band image data K, and the OSD image data P on the frame memory 157, and configures one frame of image data to be drawn on the liquid crystal panel 115. In this case, it is determined whether or not the black belt image data K and the OSD image data P developed at the same coordinates in the frame memory 157 exist. FIG. 3 shows a state in which the OSD image data P is combined with the black belt image data K added to the image data D.

When it is determined that at least a part of the combination position of the OSD image data P and the addition position of the black band image data K overlap, the black band control unit 172 causes the black band insertion unit 152 to execute the black band addition process. . That is, before the OSD combining unit 153 combines the OSD image data P, the black band inserting unit 152 adds the black band image data K to the image data D, and the OSD combining unit 153 adds the black band image data K. The OSD image data P is combined with the image data D thus obtained.
Further, when the black band control unit 172 causes the black band insertion unit 152 to execute the black band addition process, the black band control unit 172 sets the frame interpolation unit 151 to off and restricts the execution of the frame interpolation process. Since the black band addition process is a process performed along with the writing or reading of the image data D to / from the frame memory 157, the bandwidth load on the bus connecting the image processing unit 150A and the frame memory 157 increases. For this reason, the black belt control unit 172 sets other processing that causes writing and reading of image data to and from the frame memory 157, that is, frame interpolation processing executed by the frame interpolation unit 151 in this embodiment, to be off. Thus, an increase in the bandwidth load on the bus is suppressed.

  If the black band control unit 172 determines that at least a part of the combination position of the OSD image data P and the additional position of the black band image data K does not overlap, the black band control unit 172A performs black band addition processing on the shape correction unit 154A. Let When the combination position of the OSD image data P does not overlap at least a part of the addition position of the black band image data K, it is not necessary to add the black band image data K to the black band insertion unit 152 in the previous stage of the OSD composition unit 153. . Further, as described above, the black band addition process is a process in which the bandwidth load on the bus increases with the writing or reading of image data to or from the frame memory 157. For this reason, the black band control unit 172 executes this other process when writing the image data D to the frame memory 157 by a process other than the black band adding process or reading the image data D from the frame memory 157. Causing the functional unit to execute black band addition processing. In this embodiment, when the shape correction unit 154A is selected as a block for executing the black band addition processing, and the shape correction unit 154A executes the shape correction processing and writes the shape-corrected image data D in the frame memory 157, The black band addition process is executed. As a result, an increase in bus bandwidth load due to black band addition processing can be suppressed.

The black band control unit 172 sets the black band insertion unit 152 to off when the black band insertion unit 152 does not execute the black band addition process. Also, the black band control unit 172 sets the black band insertion unit 152 to ON and adds the black band image data K to the black band insertion unit 152 when the black band insertion unit 152 executes black band addition processing. The information of the additional position to be output is output. The additional position information is information indicating coordinates on the frame memory 157 where the black belt image data K is synthesized.
When the black band insertion unit 152 is set to OFF by the black band control unit 172, the black band insertion unit 152 does not perform processing on the image data D input from the frame interpolation unit 151, and the input image data D is directly subjected to OSD synthesis. Output to the unit 153.
Also, the black band insertion unit 152 writes the image data D input from the frame interpolation unit 151 in the frame memory 157 when turned on by the black band control unit 172. Then, when reading the written image data D from the frame memory 157, the black band inserting unit 152 replaces the read data with the black data when reading the data from the coordinates of the frame memory 157 indicated by the additional position information. The band image data K is added to the image data D and output to the OSD composition unit 153.

  The OSD synthesis unit 153 receives image data D with the black band image data K added thereto or image data D without the black band image data K added thereto from the black band insertion unit 152. Hereinafter, the image data D is referred to as image data D without particular distinction. The OSD combining unit 153 executes a combining process for combining the OSD image data P with the image data D.

The OSD synthesis unit 153 is set to on or off by the black belt control unit 172.
When the OSD image data P is to be combined with the image data D by the setting received through the operation panel 133 or the initial setting, the black belt control unit 172 sets the OSD combining unit 153 to ON. Further, the black belt control unit 172 outputs information on a synthesis position specifying a position (coordinates) on the frame memory 157 where the OSD image data P is synthesized to the OSD synthesis unit 153.

  When the OSD composition unit 153 is set to OFF, the OSD composition unit 153 does not perform processing on the image data D input from the black band insertion unit 152 and outputs the input image data D to the shape correction unit 154A as it is. In addition, when the OSD composition unit 153 is set to ON and an OSD image composition instruction and composition position information are input from the black belt control unit 172, first, the OSD image data P stored in the frame memory 157 is stored. Is read. Then, the OSD synthesis unit 153 synthesizes the OSD image data P at the position (coordinates) indicated by the synthesis position information with respect to the image data D input from the black band insertion unit 152. The OSD synthesis unit 153 outputs the synthesized image data (synthesized image data) to the shape correction unit 154A.

The shape correction unit 154A receives image data D obtained by synthesizing the OSD image data P or image data D not synthesized by the OSD image data P from the OSD synthesis unit 153. Hereinafter, the image data D is referred to as image data D without particular distinction.
The shape correction unit 154A corrects the shape of the image based on the image data D based on the correction parameter input from the black belt control unit 172 in order to correct distortion of the projection image projected by the projector 100 onto the screen SC. . Hereinafter, the processing performed by the shape correction unit 154A is referred to as shape correction processing. The shape correction process corresponds to the “first process” of the present invention. The shape correcting unit 154 </ b> A corrects the shape of the image data D and writes the image data D with the corrected shape in the frame memory 157.

Further, the shape correction unit 154A has a function of executing a black band addition process for adding the black band image data K to the image data D.
When the black belt control unit 172 determines that at least a part of the addition position of the black belt image data K and the combination position of the OSD image data P do not overlap, the black correction control unit 172 executes black band addition processing. Instruct.
When the execution of the black band addition process is instructed, the shape correction unit 154A adds the black band image data K to the shape-corrected image data D, and the image data D with the black band image data K added to the frame memory 157. Write.

  The frame rate conversion unit 155A converts the frame rate of the image data D by reading the image data D from the frame memory 157 a plurality of times. For example, the shape correction unit 154A writes the image data D to the frame memory 157 at a frequency of 60 Hz, and the frame rate conversion unit 155A reads the image data D of one frame four times in succession, thereby changing the frequency of the image data D to 4 Double 240 Hz, that is, the frequency at which the light modulator driving unit 122 drives the liquid crystal panel 115.

FIG. 5 is a flowchart showing the operation of the black belt control unit 172.
The projector 100 receives the image signal supplied from the image supply device 200 by the I / F unit 140. The I / F unit 140 extracts the image data D from the received image signal, and outputs the extracted image data D to the image processing unit 150A.

  When the image processing unit 150A receives the image data D, the image processing unit 150A sets the resolution, aspect ratio, whether the image is a still image or a moving image, and attributes such as a frame rate in the case of a moving image. judge. The image processing unit 150A outputs the determined attribute to the control unit 170 as attribute information.

  The black belt controller 172 determines whether or not the resolution and the aspect ratio of the image data D have changed based on the input attribute information (step S1). When it is determined that the resolution and the aspect ratio of the image data D have not changed (step S1 / NO), the black band control unit 172 ends this processing flow. If the black band controller 172 determines that the resolution or aspect ratio of the image data D has changed (step S1 / YES), whether the resolution of the image data D is smaller than the panel resolution of the liquid crystal panel 115 or not. Is determined (step S2).

In the case of negative determination (step S2 / NO), the black band control unit 172 sets the frame interpolation unit 151 on (step S5) and sets the black band insertion unit 152 off (step S6). Further, the black band control unit 172 does not instruct the shape correction unit 154A to execute the black band addition process (step S7).
When the resolution of the image data D is the same as or larger than the panel resolution of the liquid crystal panel 115, it is not necessary to execute the black band addition process. For this reason, the black band control unit 172 sets the black band insertion unit 152 to OFF (step S6), and does not instruct the shape correction unit 154A to execute the black band addition process (step S7). Further, since the black band insertion unit 152 does not execute the black band addition process, the frame interpolation unit 151 is caused to execute the frame interpolation process (step S5).

  Further, when the black band control unit 172 determines that the resolution of the image data D is smaller than the panel resolution of the liquid crystal panel 115 (step S2 / YES), the setting is to synthesize the OSD image data P with the image data D. Is determined (step S3). When it is determined that the OSD image data P is not combined with the image data D (step S3 / NO), the black band control unit 172 sets the frame interpolation unit 151 on (step S8) and turns off the black band insertion unit 152. (Step S9). Further, the black belt control unit 172 instructs the shape correction unit 154A to execute the black band addition process (step S10). That is, since the OSD image data P is not combined with the image data D, the black band control unit 172 selects the shape correction unit 154A as a block for executing the black band addition process.

  When the determination in step S3 is affirmative (step S3 / YES), whether or not at least a part of the combination position where the OSD image data P is combined and the additional position where the black belt image data K is added overlaps. Is determined (step S4). When the determination in step S4 is negative (step S4 / NO), the black band control unit 172 sets the frame interpolation unit 151 on (step S8) and sets the black band insertion unit 152 off (step S9). ). Further, the black belt control unit 172 instructs the shape correction unit 154A to execute the black band addition process (step S10). Since the combination position of the OSD image data P and the addition position of the black band image data K do not overlap, it is not necessary for the black band insertion unit 152 to execute the black band addition process. Therefore, the black band control unit 172 selects the shape correction unit 154A as a block for executing the black band addition process, and causes the frame interpolation unit 151 to perform the frame interpolation process.

  When the determination in step S4 is affirmative (step S4 / YES), the black band control unit 172 sets the frame interpolation unit 151 to off (step S11) and sets the black band insertion unit 152 to on ( Step S12). Further, the black band control unit 172 does not instruct the shape correction unit 154A to execute the black band addition process (step S13). Since at least a part of the combination position of the OSD image data P and the addition position of the black band image data K overlap, the black band insertion unit 152 provided before the OSD composition unit 153 is caused to execute the black band addition process. There is a need. Therefore, the black band control unit 172 selects the black band insertion unit 152 as a block for executing the black band addition process, and sets the frame interpolation unit 151 to off.

As described above, the projector 100 according to the first embodiment to which the image processing apparatus, the display apparatus, and the control method of the image processing apparatus of the present invention are applied is based on the image data D, and the panel resolution or aspect ratio of the liquid crystal panel 115. An image processing unit 150A that outputs output image data having a resolution or aspect ratio that matches the above.
The image processing unit 150A includes an OSD synthesis unit 153, a black belt insertion unit 152, and a shape correction unit 154A. The OSD combining unit 153 outputs image data D obtained by combining OSD image data P. The black band insertion unit 152 adds black band image data K having a size corresponding to the difference between the resolution or aspect ratio of the image based on the image data D and the resolution or aspect ratio of the liquid crystal panel 115 to the image data D. The image processing unit 150A adds the black band image data K to the position of the black band image data K to be added to the image data D by the black band insertion unit 152 depending on whether or not the OSD image data P is combined. Or a process of adding the black belt image data K by the shape correction unit 154A.
Therefore, after the OSD image data P is combined with the image data D, the OSD image data is added at the position of the black belt image data K in the case where the processing order of adding the black belt image data K is an efficient processing order. When there is a restriction on the processing order, such as when P is synthesized, the processing can be executed in accordance with this restriction. Moreover, if there is no restriction | limiting in the order of a process, it can process in an efficient order.

The image processing apparatus 300 </ b> A includes a black belt control unit 172. The black band control unit 172 adds black band image data K to the black band insertion unit 152 when the OSD image data P is synthesized at the position of the black band image data K added to the image data D. Is executed. Further, the black band control unit 172 adds the black band image data K to the shape correction unit 154A when the OSD image data P is not combined with the position of the black band image data K added to the image data D. Is executed.
Therefore, the black band control unit 172 determines whether or not the OSD image data P is combined with the position of the black band image data K added to the image data D, and based on the determination result, the black band insertion unit 152. Alternatively, the process of adding the black belt image data K to the shape correction unit 154A can be executed.

The image processing apparatus 300 </ b> A includes a frame memory 157. The black band insertion unit 152 writes the image data D to the frame memory 157 and adds the black band image data K to the image data D read from the frame memory 157. The shape correction unit 154A functions as a processing unit that performs shape correction on the image data D obtained by combining the OSD image data P. In addition, the shape correction unit 154A adds the black belt image data K to the shape-corrected image data D and writes it in the frame memory 157.
Therefore, it is not necessary to write the image data D into the frame memory 157 or read out the image data D from the frame memory 157 just to add the black belt image data K to the image data D. For this reason, an increase in the bandwidth load of the bus connected to the frame memory 157 can be suppressed.

The image processing apparatus 300 </ b> A includes a frame interpolation unit 151 that writes the image data D to the frame memory 157 and performs frame interpolation on the image data D read from the frame memory 157. The black belt control unit 172 restricts the execution of the processing of the frame interpolation unit 151 when adding the black belt image data K to the black belt insertion unit 152.
Therefore, in order to add the black belt image data K to the image data D, when performing the process of writing the image data D into the frame memory 157 or reading the image data D from the frame memory 157, the frame interpolation unit 151 Since processing is limited, an increase in bandwidth load on the bus connected to the frame memory 157 can be suppressed.

[Second Embodiment]
A second embodiment of the present invention will be described. FIG. 6 is a block diagram illustrating a configuration of the image processing unit 150B of the second embodiment.
In the first embodiment, when the black band adding unit 152 does not execute the black band adding process, the shape correcting unit 154A is caused to execute the black band adding process. In the second embodiment, when the black band adding unit 152 does not execute the black band adding process, the frame rate converting unit 155B executes the black band adding process. In the second embodiment, the frame rate conversion unit 155B corresponds to the “second addition unit” and the “first processing unit” of the present invention.
In the image processing unit 150B of the second embodiment, a shape correction unit 154B and a frame rate conversion unit 155B are connected, and background information is input from the shape correction unit 154B to the frame rate conversion unit 155B. This background information is information indicating the position of the black band image data added to the image data D after shape correction by the shape correction unit 154B. For example, coordinates indicating the position of the frame memory 157 to which the black band image data is added. It is data.

  When the black band control unit 172 instructs execution of the black band addition process, the frame rate conversion unit 155B converts the image data in the frame memory 157 specified by the background information according to the background information input from the shape correction unit 154B. At the time of reading, black belt image data is added in place of the image data read from the frame memory 157 and output to the light modulator driving unit 122.

  As described above, in the image processing apparatus 300B of the second embodiment to which the image processing apparatus, the display apparatus, and the control method of the image processing apparatus of the present invention are applied, the frame rate conversion unit 155B is written in the frame memory 157. When the composite image data is read and frame rate conversion is performed, black belt image data is added to the read composite image data. Therefore, when black band image data is added to the composite image data by the frame rate conversion unit 155B, it is not necessary to write or read the composite image data in the frame memory 157 just to add the black band image data. For this reason, an increase in the bandwidth load of the bus connected to the frame memory 157 can be suppressed.

The first and second embodiments described above are preferred embodiments of the present invention. However, the present invention is not limited to this, and various modifications can be made without departing from the scope of the present invention.
For example, in the first and second embodiments described above, when black band image data is added to the input image data by the black band insertion unit 152, the frame interpolation unit 151 is restricted from executing the frame interpolation process. When the black band image data is added to the input image data by the black band insertion unit 152, the process for limiting the execution is not limited to the frame interpolation process, and the data is written to or read from the frame memory 157. Any function that executes the process may be used. For example, the execution of the overdrive process may be restricted instead of the frame interpolation process.
The overdrive process is a process for speeding up the response in the intermediate gradation of the liquid crystal panel 115 based on an instruction from the control unit 170. Specifically, the pixel value is adjusted so that a larger voltage than usual is applied to the pixel set to the intermediate gradation, and the adjusted image data is output to the light modulation device driving unit 122 of the display unit 110. It is processing. By this overdrive processing, it is possible to reduce afterimages when a fast moving image (moving image) is displayed.

  In the above-described embodiment, the light modulation device 112 that modulates the light emitted from the light source has been described by taking as an example a configuration using three transmissive liquid crystal panels corresponding to RGB colors. The invention is not limited to this. For example, a configuration using three reflective liquid crystal panels may be used, or a method in which one liquid crystal panel and a color wheel are combined may be used. Alternatively, a system using three digital mirror devices (DMD), a DMD system combining one digital mirror device and a color wheel, or the like may be used. When only one liquid crystal panel or DMD is used as the light modulation device, a member corresponding to a synthetic optical system such as a cross dichroic prism is unnecessary. In addition to the liquid crystal panel and the DMD, any light modulation device capable of modulating light emitted from the light source can be employed without any problem.

  In addition, each functional unit of the projector 100 illustrated in FIG. 1 indicates a functional configuration, and a specific mounting form is not particularly limited. That is, it is not always necessary to mount hardware corresponding to each function unit individually, and it is of course possible to adopt a configuration in which the functions of a plurality of function units are realized by one processor executing a program. In addition, in the above embodiment, a part of the function realized by software may be realized by hardware, or a part of the function realized by hardware may be realized by software. In addition, the specific detailed configuration of each other part of the projector 100 can be arbitrarily changed without departing from the gist of the present invention.

  The processing unit of the flowchart shown in FIG. 5 is divided according to the main processing contents in order to make the processing of the black belt control unit 172 of the projector 100 easy to understand. The present invention is not limited by the name. Further, the processing of the black belt control unit 172 can be divided into more processing units according to the processing contents, or can be divided so that one processing unit includes more processing. Further, the processing order of the above flowchart is not limited to the illustrated example.

  DESCRIPTION OF SYMBOLS 5 ... Remote control, 100 ... Projector (display apparatus), 111 ... Light source part, 112 ... Light modulation apparatus, 113 ... Projection optical system, 115 ... Liquid crystal panel, 121 ... Light source drive part, 122 ... Light modulation apparatus drive part, 130 ... Wireless communication unit, 133 ... operation panel, 135 ... remote control light receiving unit, 137 ... input processing unit, 140 ... I / F unit, 150A ... image processing unit, 150B ... image processing unit, 151 ... frame interpolation unit (second processing unit) , 152 ... Black band insertion part (first addition part), 153 ... OSD synthesis part (synthesis part), 154A, 154B ... Shape correction part (second addition part, first processing part), 155A ... Frame rate conversion part 155B: Frame rate conversion unit (second addition unit, first processing unit), 157 ... Frame memory (storage unit), 160 ... Storage unit, 170 ... Control unit, 171 ... Projection control unit, 172 ... Black Control unit (control unit), 180 ... internal bus, 200 ... image supply device, 300A, 300B ... image processing apparatus.

Claims (7)

An image processing apparatus that outputs output image data having a set resolution or aspect ratio based on input image data,
A combining unit that combines the input image data with superimposed image data and outputs combined image data;
A first addition unit for adding additional image data having a size corresponding to a difference between the resolution or aspect ratio of the image based on the input image data and the set resolution or aspect ratio to the input image data;
A second addition unit for adding the additional image data having a size corresponding to the difference between the resolution or aspect ratio of the image based on the input image data and the set resolution or aspect ratio to the composite image data;
Processing for adding the additional image data by the first addition unit according to whether or not the superimposed image data is synthesized at the position of the additional image data added to the input image data or the synthesized image data Or an image processing apparatus for executing the process of adding the additional image data by the second adding unit. When the superimposed image data is synthesized at the position of the additional image data added to the input image data or the synthesized image data, the first adding unit is caused to execute a process of adding the additional image data. ,
Control for causing the second addition unit to execute a process of adding the additional image data when the superimposed image data is not synthesized at the position of the additional image data added to the input image data or the synthesized image data The image processing apparatus according to claim 1, further comprising a unit. A storage unit,
The first addition unit writes the input image data to the storage unit, adds the additional image data to the input image data read from the storage unit,
The second addition unit functions as a first processing unit that performs a first process on the synthesized image data, adds the additional image data to the synthesized image data after the first process, and stores the added image data in the storage unit. The image processing apparatus according to claim 1, wherein writing is performed. A storage unit,
The first addition unit writes the input image data to the storage unit, adds the additional image data to the input image data read from the storage unit,
The second addition unit functions as a first processing unit that reads the composite image data written in the storage unit and performs a first process on the read composite image data, and the first processing unit after the first process The image processing apparatus according to claim 1, wherein the additional image data is added to the composite image data and output. A second processing unit that writes the input image data to the storage unit and performs a second process on the input image data read from the storage unit;
5. The image processing apparatus according to claim 3, wherein when the additional image data is added to the first addition unit, the control unit restricts execution of the processing of the second processing unit. 6. . A display device that displays output image data of a set resolution or aspect ratio on a display unit based on input image data,
A combining unit that combines the input image data with superimposed image data and outputs combined image data;
A first addition unit for adding additional image data having a size corresponding to a difference between the resolution or aspect ratio of the image based on the input image data and the set resolution or aspect ratio to the input image data;
A second addition unit for adding the additional image data having a size corresponding to the difference between the resolution or aspect ratio of the image based on the input image data and the set resolution or aspect ratio to the composite image data;
The additional image data is added by the second addition unit, and the synthesized image data obtained by synthesizing the superimposed image data by the synthesis unit, or the synthesized image data to which the additional image data is added by the second addition unit. The display unit to be displayed as the output image data,
Processing for adding the additional image data by the first addition unit according to whether or not the superimposed image data is synthesized at the position of the additional image data added to the input image data or the synthesized image data Or a process of adding the additional image data by the second adding unit. A control method for an image processing apparatus that outputs output image data having a set resolution or aspect ratio based on input image data,
A combining step of combining the input image data with superimposed image data and outputting combined image data;
A first addition step of adding additional image data having a size corresponding to a difference between the resolution or aspect ratio of the image based on the input image data and the set resolution or aspect ratio to the input image data;
And a second addition step of adding the additional image data having a size corresponding to the difference between the resolution or aspect ratio of the image based on the input image data and the set resolution or aspect ratio to the composite image data. And
Depending on whether the superimposed image data is synthesized at the position of the additional image data added to the input image data or the synthesized image data, the addition is performed by the first addition step or the second addition step. A method for controlling an image processing apparatus, comprising adding image data.

Images