JP5029892B2 - Image processing apparatus, image processing method, and program - Google Patents

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program, and in particular, using a first display device such as an LCD (Liquid Crystal Display) that displays an image, for example, has characteristics different from those of the first display device. The present invention relates to an image processing apparatus, an image processing method, and a program capable of reproducing a state in which an image is displayed on a second display device such as a PDP (Plasma Display Panel).

  As display devices for displaying image signals, there are various display devices such as CRT (Cathode Ray Tube), LCD, PDP, organic EL (Electroluminescence), and projector.

  For example, for PDP, when the line of sight follows a moving pixel on the display screen, the amount of light entering each retinal position is calculated, and new subfield data is generated from the output data, thereby producing a false contour. There has been proposed a method for suppressing the occurrence of (see, for example, Patent Document 1).

JP 2000-39864 A

  By the way, since the display characteristics differ depending on the display device, a difference in the characteristics (display characteristics) of the display device is a big problem in monitoring for checking whether the image signal is in an appropriate viewing state (display state). That is, even if a certain image signal is displayed on the LCD and monitored, it is difficult to confirm how the image signal looks when displayed on the PDP.

  Therefore, in order to perform monitoring in consideration of the characteristics of a plurality of display devices, it is necessary to prepare as many display devices as necessary, leading to an increase in the scale of the monitoring system.

  In addition, the PDP is a display device that realizes multi-gradation display by controlling one sub-field to be in either a light emitting state or a non-light emitting state by configuring one field of an input image signal with a plurality of subfields. It is.

  Therefore, when a moving image is displayed, if a person's line of sight follows a moving object or the like in the image, the displayed image may be different from the image visible to the human depending on the light emission pattern of the subfield. . However, in the PDP, the only way to check how the moving image actually looks is to display the moving image on the PDP and visually check it. It was difficult.

  The present invention has been made in view of such a situation. For example, in a second display device such as a PDP having characteristics different from those of the first display device using the first display device such as an LCD. This makes it possible to reproduce the state in which the image is displayed.

An image processing apparatus or program according to one aspect of the present invention displays an image on a second display device having characteristics different from those of the first display device, using the first display device that displays an image. In an image processing apparatus that reproduces image data or a program that causes a computer to function as an image processing apparatus, motion detection means that detects image motion from an input image signal, and subfield expansion that expands the input image signal into a plurality of subfields Means,
  When the person views the input image signal displayed on the second display device from the direction of movement detected by the motion detection means and the light emission pattern of the subfield developed by the subfield development means. A light amount integrating unit that artificially calculates a light amount integrated into the retina and generates an output image signal using the light amount as a pixel value, and the sub-field expanding unit converts the input image signal for each pixel. The light intensity integrating means expands the plurality of sub-fields with the direction perpendicular to the display surface displaying the input image signal as the time direction in the second display device. A pixel of interest in a display model in which the display of the input image signal by the second display device is modeled with fields arranged in the time direction By integrating the amount of light in the light amount integration region according to the light emission pattern of the subfield, the region extending in the direction of the movement of the pixel of interest as a cross-section, as a light amount integration region for integrating the amount of light, In calculating the pixel value of the pixel of interest, in the display model, an area extending in a time direction in a length corresponding to the light emission amount of the subfield in the cross-sectional area of the pixel on the display surface, As a pixel subfield region, an occupation ratio, which is a ratio of the light amount integration region in the pixel subfield region, is multiplied by the light emission amount according to the light emission pattern of the subfield corresponding to the pixel subfield region. The amount of influence of the pixel subfield region that affects the pixel value of the pixel of interest is For each of the plurality of subfields, for each motion corresponding to the position of each pixel within the search range for detecting motion, integrating all the affected light amounts obtained for all the field subfield regions A table in which the occupancy ratio is registered, with respect to the relative position of each pixel in the search range with respect to the pixel of interest as a reference, and the subfield, the region of the pixel at the relative position as a cross-section, and Using a table in which the occupation ratio occupied by the light amount integration region in the pixel subfield region extending in the time direction by a length corresponding to the light emission amount of the subfield is registered, An image processing device for obtaining an occupation ratio of each pixel subfield for the target pixel from the table, Or it is a program for functioning a computer as an image processing apparatus.

An image processing method according to an aspect of the present technology uses a first display device that displays an image, and reproduces a state in which the image is displayed on a second display device having characteristics different from those of the first display device. In the processing method, a motion detection step of detecting a motion of an image from an input image signal, a subfield expansion step of expanding the input image signal into a plurality of subfields, and a direction of the motion detected in the motion detection step, From the light emission pattern of the subfield developed in the subfield development step, the amount of light integrated into the retina is simulated when a person views the input image signal displayed on the second display device. A light amount integrating step for generating an output image signal having the light amount as a pixel value, and the subfield developing step includes The input image signal is developed into a plurality of subfields having different light emission amounts for each pixel, and the light amount integration step has a direction perpendicular to a display surface on which the input image signal is displayed in the second display device. In the display model in which the display of the input image signal by the second display device is modeled by arranging the plurality of subfields in the time direction as a time direction, a region of a target pixel of interest is a cross section, and The region extending in the direction of movement of the target pixel is used as a light amount integration region for integrating the amount of light, and the light amount in the light amount integration region is integrated according to the light emission pattern of the subfield, whereby the pixel value of the target pixel In the display model, the pixel area of the display surface is a cross section, and the subfield is calculated in the time direction. A region extending by a length corresponding to the amount of emitted light is defined as a pixel subfield region, and the subfield corresponding to the pixel subfield region is set to an occupation ratio that is a ratio occupied by the light amount integration region in the pixel subfield region. By multiplying the light emission amount according to the light emission pattern of the pixel subfield region, the influence light amount of the pixel subfield region affecting the pixel value of the target pixel is obtained for all the pixel subfield regions, and the pixel subfield A table in which the occupancy ratios for each of the plurality of subfields are registered for each movement corresponding to the position of each pixel in the search range for detecting the movement by integrating the influence light amounts obtained for all the areas. And the relative position of each pixel within the search range with respect to the pixel of interest and each sub The area occupied by the light amount integration region occupies the pixel subfield region having a cross section of the pixel region at the relative position and extending in a time direction by a length corresponding to the light emission amount of the subfield. In this image processing method, a table in which a ratio is registered is used to obtain an occupation ratio of each pixel subfield for the target pixel from the table for the movement of the target pixel.

In one aspect as described above, the motion of the image is detected from the input image signal, while the input image signal is developed into a plurality of subfields. Then, the amount of light integrated into the retina when the person views the input image signal displayed on the second display device is calculated in a pseudo manner from the direction of image movement and the light emission pattern of the subfield. Then, an output image signal having the light amount as a pixel value is generated. In this case, when the input image signal is developed into a plurality of subfields, the input image signal is developed into a plurality of subfields having different light emission amounts for each pixel. Further, in the generation of the output image signal, the second display device includes the second sub-fields arranged in the time direction, with the direction perpendicular to the display surface displaying the input image signal as the time direction. In a display model that models the display of the input image signal by a display device, a light amount integration that integrates a light amount in a cross-section of the region of interest of the pixel of interest and that extends in the direction of movement of the pixel of interest As a region, the pixel value of the target pixel is calculated by integrating the light amount in the light amount integration region according to the light emission pattern of the subfield.
Specifically, in the display model, a region of the pixel on the display surface is a cross section, and a region extending in the time direction by a length corresponding to the light emission amount of the subfield is defined as a pixel subfield region. The pixel subfield is obtained by multiplying the occupation ratio, which is the ratio of the light intensity integration area in the pixel subfield area, by the light emission amount according to the light emission pattern of the subfield corresponding to the pixel subfield area. The influence light quantity corresponding to the area affecting the pixel value of the target pixel is obtained for all the pixel subfield areas, and the influence light quantities obtained for all the pixel subfield areas are integrated.
In addition, for each motion corresponding to the position of each pixel within the search range for detecting motion, a table in which the occupation ratio for each of the plurality of subfields is registered, the reference pixel being the reference For each of the relative position of each pixel in the search range and each subfield, the pixel having a cross section of the region of the pixel at the relative position and extending in the time direction by a length corresponding to the light emission amount of the subfield Using a table in which the occupation ratio occupied by the light amount integration area in the subfield area is registered, the occupation ratio of each pixel subfield is obtained for the target pixel from the table for the movement of the target pixel.

  According to one aspect of the present invention, a state in which an image is displayed on a second display device such as a PDP having characteristics different from those of the first display device can be reproduced using the first display device such as an LCD. it can.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 shows a configuration example of a first embodiment of an image processing apparatus to which the present invention is applied.

  The input image signal Vin is supplied to the motion detection unit 100 and the subfield development unit 200.

  FIG. 2 shows a configuration of the motion detection unit 100 of FIG. The motion detection unit 100 detects the motion vector of each pixel from the input image signal Vin as the line of sight for each pixel when the person views the input image signal Vin.

  The input image signal Vin is supplied to the correlation calculation circuit 101 and the delay circuit 102. The correlation calculation circuit 101 performs correlation calculation between the input image signal Vin of the current field and the input image signal of the previous field delayed by one field by the delay circuit 102.

  FIG. 3 shows the operation of the correlation calculation.

  The correlation calculation circuit 101 sets a block BL centered on the target pixel in the target pixel of the current field. The block BL is, for example, a 5 × 5 pixel block. Then, the correlation operation circuit 101 sets a search range centered on the same position as the block BL in the current field in the previous field delayed by the delay circuit 102. The search range is, for example, an area corresponding to −8 to +7 pixels in the horizontal and vertical directions with reference to the same position as the block BL in the current field. Then, the correlation operation circuit 101 calculates, for example, the sum of absolute differences between pixel values between the block BL and each candidate block within the search range and the same size as the block BL. The calculation obtained as an evaluation value for evaluating the correlation is performed as a correlation calculation, and the calculation result in each candidate block is supplied to the line-of-sight determination circuit 103.

  Returning to FIG. 2, the line-of-sight determination circuit 103 detects the position of the candidate block from which the calculation result of the minimum value is obtained from the calculation results supplied from the correlation calculation circuit 101 as the motion vector of the target pixel. Here, the position of the candidate block is a relative position from the block BL as shown in FIG. The line-of-sight determination circuit 103 determines the direction of the motion vector of the pixel of interest as the direction of the line of sight when the person looks at the pixel of interest, that is, the direction (gaze direction) mv along which the line of sight of the person viewing the current field follows. .

  In the correlation calculation circuit 101, a block BL is set for each pixel of interest, but the current field is first divided into 5 × 5 pixel blocks, and the line-of-sight direction (motion vector) is obtained for each block. The same line-of-sight direction may all be applied. In addition, in the correlation calculation with each candidate block in the search range, an evaluation value may be obtained by applying a certain weight to the absolute difference value in the pixel near the target pixel. In this case, the correlation between pixels in the vicinity of the pixel of interest is heavily evaluated.

  FIG. 5 shows a configuration example of the subfield expansion unit 200 of FIG.

  The subfield development unit 200 generates a light emission pattern of each subfield when the input image signal Vin is displayed on the PDP.

  Before describing the operation of the subfield developing unit 200, a multi-gradation display method in the PDP will be described. The PDP divides one field into a plurality of subfields, and performs multi-gradation display by changing the weight of luminance of light emission in each subfield.

  FIG. 6 shows a configuration example of subfields in the PDP. In FIG. 6, one field is divided into eight subfields SF1, SF2, SF3, SF4, SF5, SF6, SF7, and SF8, and each of the subfields SF1 to SF8 has a different luminance weight (light quantity). Each subfield SF1 to SF8 includes an address period in which each pixel is set to emit light or not to emit light, and a light emission period in which pixels set to emit light in the address period are caused to emit light.

  If the luminance weight of each subfield SF1 to SF8 is, for example, 1, 2, 4, 8, 16, 32, 64, 128, 256 gradations from 0 to 255 can be obtained by combining these subfields SF1 to SF8. Can be realized.

  Since an actual PDP is configured in a two-dimensional plane, an image displayed by the PDP is a three-dimensional model diagram composed of pixel positions X and Y in the PDP and subfields in the time direction T as shown in FIG. Expressed.

Returning to FIG. 5, the input image signal Vin is supplied to the subfield allocation circuit 201. The subfield assignment circuit 201 represents the pixel value of one field of the input image signal Vin using the following equation (1). N _i is light emission information indicating non-light emission or light emission of the subfield SF # i and is 0 or 1.

1 × N ₁ + 2 × N ₂ + 4 × N ₃ + 8 × N ₄ + 16 × N ₅ + 32 × N ₆ + 64 × N ₇ + 128 × N ₈
... (1)

  Here, the subfield structure of the PDP to be displayed is composed of eight subfields SF1 to SF8 as in the case shown in FIG. 6, and the luminance weights of the subfields SF1 to SF8 are set to 1, 2, respectively. 4, 8, 16, 32, 64, and 128. The following description is based on this structure.

Then, the subfield allocation circuit 201 supplies the value of emission information N _i for each pixel to the light-emitting decision circuit 202. The light emission determining circuit 202 generates light emission control information SF representing the light emission pattern of the subfield, with Ni _i being 1 for light emission and 0 for no light emission.

  For example, when a certain pixel value of the input image signal Vin is “7”, light emission control information SF that assigns the subfields SF1, SF2, and SF3 to emit light and the other to emit no light is generated. Further, for example, when a certain pixel value of the input image signal Vin is “22”, light emission control information SF that assigns the subfields SF2, SF3, and SF5 to emit light and the other to emit no light is generated.

  FIG. 8 shows a configuration of the light amount integrating unit 300 of FIG. In the light amount integrating unit 300, when the input image signal Vin is displayed on the PDP, an image having the light amount integrated in the human retina as a pixel value is visible to the human eye when the input image signal is displayed in the PDP. In other words, it is generated and output as a pseudo image.

  Before explaining the operation of the light quantity integrating unit 300, the way in which an image is seen based on the line-of-sight direction and the light emission pattern, which is unique to the PDP, will be explained.

  FIG. 9 shows the boundary between the pixel values 127 and 128 of the subfield where the horizontal axis is the pixel position X (Y) and the vertical axis is the time T, and the shaded subfield emits light. Indicates a subfield to be executed.

  When the image is not moving, the person's line-of-sight direction is a direction AA ′ parallel to the time direction T on the vertical axis, and the light emission of the subfield is correctly integrated in the human retina. 128 is recognized correctly.

  However, if the image moves to the left by one pixel in one field, the human eye (line of sight) follows the movement, so the line of sight is a direction BB ′ that is not parallel to the time direction T on the vertical axis. The light emission of the field is not integrated in the human retina, and a black line is recognized between the pixel values 127 and 128. Conversely, if the image moves one pixel in one field in the right direction, the human eye follows the movement, so the line-of-sight direction becomes a direction CC ′ that is not parallel to the time direction T on the vertical axis, and the subfield Is excessively integrated into the human retina, and a white line is recognized between the pixel values 127 and 128.

  As described above, in the PDP, a driving method using subfields may cause a phenomenon in which a displayed image differs from an image visible to the human eye depending on the viewing direction and the light emission pattern of the subfield. Yes, commonly known as moving image pseudo contour.

  Returning to FIG. 8, the line-of-sight direction mv of each pixel detected by the motion detection unit 100 and the light emission control information SF generated by the subfield development unit 200 are supplied to the light amount integration region determination circuit 301.

  The light amount integration region determination circuit 301 converts the input image signal Vin into a PDP from the line-of-sight direction mv detected by the motion detector 100 and the light emission control information SF representing the light emission pattern of the subfield generated by the subfield development unit 200. When displayed, a light amount integration region for artificially reproducing the light amount integrated in the human retina is determined for each pixel. That is, as shown in FIG. 10, a light amount integration region having a cross-sectional area of one pixel is set for the target pixel in the detected line-of-sight direction.

  Further, the light amount integration region determination circuit 301 integrates the light amount in each subfield SF # i in accordance with the ratio of the light emission and non-light emission regions of each subfield in the light amount integration region. For example, in the case of FIG. 10, when the ratio of the light emitting and non-light emitting areas in the subfield SF8 is 7: 1, the amount of light integrated in the subfield SF8 is 128 × 1 ÷ (7 + 1) = 16. Similarly, the light amount integration region determination circuit 301 calculates the amount of light integrated in all the subfields SF1 to SF8 and supplies it to the light amount integration circuit 302.

  The light amount integrating circuit 302 obtains the sum of the light amounts of the subfields SF1 to SF8 from the light amount integrating region determining circuit 301, and sets it as the pixel value in the target pixel. Then, the light amount integrating circuit 302 generates an output image Vout by performing the same processing on all the pixels.

  Further, the processing of the light amount integration region determination circuit 301 and the light amount integration circuit 302 can be simply performed as follows.

  That is, in FIG. 10, the larger one is adopted in the ratio of the light emitting and non-light emitting regions of each subfield. In this case, the subfield SF8 emits no light and the light amount is 0, the subfield SF7 emits light and the light amount is 64, and the sum of the results in all the subfields is the pixel value of the target pixel.

  Since an actual PDP is configured in a two-dimensional plane, an image displayed by the PDP is a three-dimensional model diagram including pixel positions X and Y in the PDP and subfields in the time direction T as shown in FIG. Expressed.

  As described above, the image processing apparatus shown in FIG. 1 uses the line-of-sight direction for each pixel from the input image signal Vin and the light emission pattern of the subfield when displayed on the PDP. An image with the amount of light integrated into the retina as a pixel value is generated as an image that is visible to the person viewing the image displayed on the PDP, so the input image signal Vin is displayed on the PDP and the image viewed by the person Can be reproduced in a pseudo manner.

  FIG. 12 shows a configuration example of the second embodiment of the image processing apparatus to which the present invention is applied.

  In general, in the PDP, in order to suppress the moving image pseudo contour, the gradation to be used is limited, and in order to obtain a gradation, the difference between the pixel value of the input image and the displayed image An error diffusion process that assigns pixels, a dither process that expresses an apparent gradation, and the like are performed using a spatio-temporal pattern of a plurality of pixel values. The image processing apparatus shown in FIG. 12 reproduces, in a PDP that displays the input image signal Vin, an image that is visible to the human eye when the error diffusion process or dither process is performed.

  In FIG. 12, the input image signal Vin is supplied to the motion detection unit 100 and the gradation conversion unit 400. The configuration of the motion detection unit 100 is the same as that of FIG.

  FIG. 13 shows a configuration example of the gradation conversion unit 400 of FIG.

  The input image signal Vin is added to a display gradation error Vpd, which will be described later, in an arithmetic unit 405 to become a pixel value (gradation) Vp, which is supplied to the gradation conversion circuit 402.

  The gradation conversion circuit 402 converts the gradation (pixel value) Vp of the input pixel into another gradation Vpo according to the gradation conversion table 403. That is, when 0, 1, 3, 7, 15, 31, 63, 127, and 255 are used as gradations that are unlikely to generate moving image pseudo contours, the gradation conversion table 403 uses the above-described gradations and The apparent gray scale (dither gray scale) expressed by the temporal and spatial distribution of the gray scale used is set.

  The gradation conversion circuit 402 uses only the gradation set in the gradation conversion table 403, and the difference between the input gradation Vp and the gradation Vp among the gradations in the gradation conversion table 403 is determined. Is replaced with the smallest gradation Vpo and output. The gradation Vpo that is the output of the gradation conversion circuit 402 is supplied to the dither conversion circuit 404, and the calculator 406 obtains a difference from the gradation Vp that is the input of the gradation conversion circuit 402, thereby displaying A gradation error Vpd is obtained, and is delayed by one pixel in the horizontal direction by the delay circuit 401, and is added to the pixel value of the next input image signal Vin by the calculator 405. Expressing the gradation difference thus converted with the gradation of the surrounding pixels is called error diffusion processing.

  The dither conversion circuit 404 performs a dither process (dither conversion) that represents an apparent gradation according to a temporal and spatial distribution of the gradation to be used. An operation example of the dither conversion circuit 404 is shown in FIG. In the dither conversion circuit 404, for example, if there is an area to be displayed with a gradation of 4, gradations are distributed using the gradations 3 and 7 to be used as shown in FIG. In this way, the gradation value is averaged to the human eye, and the gradation value is seen as 4.

  Returning to FIG. 12, as described above, the gradation conversion unit 400 converts the input image signal Vin into the image signal Vd that is actually used for display, and supplies it to the subfield development unit 200. The configurations of the subfield developing unit 200 and the light amount integrating unit 300 are the same as those in FIG.

  That is, in the image processing apparatus of FIG. 12, the gradation conversion unit 400 outputs an image visible to human eyes as a pseudo image based on the actually displayed gradation. In this case, the motion detection unit 100 detects (determines) the line of sight from the input image signal Vin. However, when the appearance of the gradation converted by the gradation conversion unit 400 is not significantly different from the input image signal Vin, the direction of the line of sight Therefore, there is no problem even with such a configuration. The gradation conversion unit 400 may be anything that converts the input image signal Vin into the image signal Vd used for display. For example, a technique described in Japanese Patent Application Laid-Open No. 2004-138383 may be used.

  FIG. 15 shows a configuration example of a third embodiment of an image processing apparatus to which the present invention is applied.

  In this image processing apparatus, the pixel (image signal) Vd that is the output of the gradation conversion unit 400 is supplied to the motion detection unit 100. In this case, the motion detection unit 100 detects the line of sight (gaze direction) based on the image signal to be actually displayed. Therefore, the line of sight when the limited gradation, diffusion error, and dither itself are visually detected is detected, and the gradation conversion unit 400 can visually recognize the gradation based on the actually displayed gradation. An image can be output as a pseudo image.

  In FIG. 15, the configurations of the motion detection unit 100, the subfield development unit 200, the light amount integration unit 300, and the gradation conversion unit 400 are the same as those in FIG.

  FIG. 16 shows a configuration example of a fourth embodiment of an image processing apparatus to which the present invention is applied.

  The input image signal Vin is supplied to the gradation conversion unit 400 and converted into an image signal Vd used for display. The image signal Vd used for display is supplied to the visual correction unit 500.

  FIG. 17 shows a configuration example of the visual correction unit 500. The visual correction unit 500 artificially corrects the image signal Vd used for display into an image (image signal) that appears to the human eye. The image signal Vd used for display is supplied to the dither correction circuit 501. The dither correction circuit 501 artificially corrects the gradation displayed by dither to the apparent gradation. That is, when the dither gradation is used as shown in FIG. 14, the gradation is corrected as shown in FIG. 18 on the assumption that the gradation values are averaged for human eyes. The dither-corrected image Vmb is supplied to the diffusion error correction circuit 502.

  The diffusion error correction circuit 502 artificially corrects an error diffused to pixels around the target pixel to an apparent gradation. That is, the diffusion error correction circuit 502 assumes that the difference (error) from the input image signal Vin is diffused in the dither-corrected image signal Vmb, and corrects the diffused error. For example, as shown in FIG. 19, it is assumed that the error of the pixel whose image signal Vmb is 90 is the difference from the input image signal Vin in the pixel whose right image signal Vmb is 110, and 110−105 = 5 is diffused. The corrected error is added to the image signal Vmb to output a visually corrected image signal Vm. Similarly, the same processing is performed for all pixels.

  As described above, in the visual correction unit 500, the gradation converted by the gradation conversion unit 400 is artificially corrected as a gradation when visible to the human eye, and the corrected image signal is used as the motion detection unit 100. To supply. Therefore, the line of sight is detected based on a pseudo image when the limited gradation, diffusion error, and dither are visible to the human eye, and the gradation converter 400 based on the actually displayed gradation. An image that is visible to the human eye can be obtained in a pseudo manner. The configurations of the motion detection unit 100, the subfield development unit 200, the light amount integration unit 300, and the gradation conversion unit 400 in FIG. 16 are the same as those in FIG.

  As described above, in the image processing apparatuses of FIGS. 1, 12, 15, and 16, when an image is displayed on the PDP, an image visible to the human eye is simulated from the light emission pattern of the subfield and the line-of-sight direction. Can be obtained. For this reason, when an arbitrary image signal is displayed on the PDP on a display device different from the PDP, an image visible to the human eye can be displayed in a pseudo manner. That is, for example, using a first display device such as an LCD, CRT, organic EL, or projector, reproduces a state in which an image is displayed on a second display device such as a PDP having characteristics different from those of the first display device. The display of the second display device can be emulated using the first display device having characteristics different from those of the second display device.

  Although FIG. 6 is used as an example of the PDP subfield structure, the number of subfields and the luminance weight of each subfield may be arbitrary.

  FIG. 20 is a flowchart for explaining processing of the image processing apparatus of FIG.

  In step ST100, the input image signal Vin is input to the image processing apparatus. Next, in step ST200, the motion detection unit 100 sequentially uses the field (or frame) of the input image signal Vin as a target field, detects a motion vector for each target field, and determines the direction of the motion vector. Determined as the line-of-sight direction.

  FIG. 21 is a flowchart illustrating the motion (vector) detection process in step ST200.

  In step ST201, the input image signal Vin of the field of interest is input to the motion detection unit 100. Next, in step ST202, the motion detection unit 100 sequentially selects pixels constituting the target field as the target pixel, and sets a block having a predetermined size centered on the target pixel as the target block. Then, the motion detection unit 100 performs a correlation operation between the target block of the target field and a candidate block within a predetermined search range one field before. Next, in step ST203, the motion detection unit 100 determines whether the calculation has been completed for all candidate blocks. If completed, the process proceeds to step ST204. If not completed, the process returns to step ST202 and continues the process. In step ST204, the motion detection unit 100 detects a position of a candidate block having the highest correlation among candidate blocks (a candidate block having the smallest sum of absolute difference values) as a motion vector, and the motion vector is detected as a target pixel. Is determined as the line-of-sight direction mv. In step ST205, the motion detection unit 100 outputs the line-of-sight direction mv.

  Returning to FIG. 20, in the next step ST300, the subfield developing unit 200 generates light emission control information SF representing the light emission pattern of the subfield when the field of interest of the input image signal Vin is displayed on the PDP.

  FIG. 22 is a flowchart for generating light emission control information SF representing the light emission pattern of the subfield in step ST300.

  In step ST301, the target field of the input image signal Vin is input to the subfield developing unit 200. Next, in step ST302, the subfield development unit 200 expresses the field of interest of the input image signal Vin by the sum of the luminance weights of the subfields of Expression (1) to obtain the light emission information Ni. Next, in step ST303, the subfield developing unit 200 generates light emission control information SF representing the light emission and non-light emission patterns of each subfield of the field of interest based on the light emission information Ni. In step ST304, subfield developing section 200 outputs light emission control information SF representing the light emission pattern of the subfield.

  Returning to FIG. 20, in the next step ST400, the light amount integrating unit 300 corresponds to the amount of light integrated in the human retina (image visible to the human eye) when the field of interest of the input image signal Vin is displayed on the PDP. The image signal Vout to be generated is generated in a pseudo manner.

  FIG. 23 is a flowchart showing the integration of the amount of light in step ST400.

  In step ST401, the line-of-sight direction mv in each pixel of the target field detected in step ST200 and the light emission control information SF of the subfield of the target field generated in step ST300 are input to the light amount integrating unit 300. Next, in step ST402, each pixel of the target field is sequentially selected as the target pixel in the light amount integration unit 300, and a light amount integration region in which the light amount is integrated is determined according to the line-of-sight direction mv of the target pixel. In step ST403, the light amount integrating unit 300 integrates the light amount of the subfield that emits light within the light amount integrating region determined in step ST402 based on the light emission pattern represented by the issue control information SF, and calculates the pixel value of the target pixel. As a result, an output image (signal) Vout composed of the pixel values is generated. In step ST404, the light amount integrating unit 300 outputs the output image Vout.

  Returning to FIG. 20, in the next step ST500, for example, the LCD as the second display device (not shown) displays the generated output image Vout.

  FIG. 24 is a flowchart for explaining processing of the image processing apparatus of FIG.

  In step ST110, as in step ST100 of FIG. 20, the input image signal Vin is input. Next, in step ST210, the motion vector for each pixel, and thus the line-of-sight direction mv, is detected. The operation in step ST210 is the same as that in step ST200 in FIG. Next, in step ST310, the gradation conversion unit 400 performs gradation conversion that is performed when a PDP is displayed.

  FIG. 25 is a flowchart showing the gradation conversion operation in step ST310.

  In step ST311, the input image signal Vin is input to the gradation converting unit 400. Next, in step ST312, in the gradation conversion unit 400, the input image signal Vin is converted into an image signal Vp by adding an error diffused from the surrounding images. Next, in step ST313, the gradation conversion unit 400 converts the gradation of the image signal Vp according to the gradation conversion table 403 (FIG. 13). Next, in step ST314, the gradation conversion unit 400 calculates an error (display gradation error) Vpd between the image signal Vp before gradation conversion and the image signal Vpo after conversion. Next, in step ST315, the gradation conversion unit 400 performs dither conversion of the image signal Vpo. In step ST316, the gradation converting unit 400 outputs the image signal obtained by the dither conversion as the image signal Vd subjected to the gradation conversion.

  Returning to FIG. 24, in the next step ST410, the same processing as step ST300 in FIG. 20 is performed on the image signal Vd converted in step ST310. Also, the following steps ST510 and ST610 are the same as steps ST400 and ST500 in FIG.

  FIG. 26 shows a flowchart for explaining the processing of the image processing apparatus of FIG.

  In FIG. 26, in steps ST120, ST220, ST320, ST420, ST520, and ST620, except that the visual line direction (motion vector) is detected in the next step ST320 for the image signal Vd converted in step ST220. The same processing as in steps ST110, ST310, ST210, ST410, ST510, and ST610 in FIG. 24 is performed.

  FIG. 27 shows a flowchart for explaining the processing of the image processing apparatus of FIG.

  In step ST130, the input image signal Vin is input as in step ST120 of FIG. Next, in step ST230, an image signal Vd whose gradation is converted is generated as in the case of FIG. Next, in step ST330, visual correction is performed on the image signal Vd converted in step ST320. Thereafter, in steps ST430, ST530, ST630, and ST730, processing similar to that in steps ST320, ST420, ST520, and ST620 in FIG. 26 is performed.

  FIG. 28 is a flowchart showing the visual correction operation in step ST330. In step ST331, the image signal Vd is input to the visual correction unit 500. Next, in step ST332, the visual correction unit 500 corrects the image signal Vd according to the visual effect of dither. Next, in step ST333, the visual correction unit 500 artificially corrects the influence of the error diffused to surrounding pixels, and generates an image signal Vm. In step ST334, the visual correction unit 500 outputs the image signal Vm.

  As described above, in the image processing apparatuses of FIGS. 1, 12, 15, and 16, when an image is displayed on the PDP, an image visible to the human eye is simulated from the light emission pattern of the subfield and the line-of-sight direction. Generate automatically. For this reason, when an arbitrary image signal is displayed on the PDP on a display device different from the PDP, an image visible to the human eye can be displayed in a pseudo manner.

  Next, the details of the processing of the light quantity integrating unit 300 in FIG. 1 will be described. Before that, the display of an image by the PDP will be described again.

  As shown in FIGS. 7 and 11, the display of an image by the PDP is expressed by a three-dimensional model diagram including pixel positions X and Y in the PDP and subfields in the time direction T.

  FIG. 29 shows a model obtained by modeling the display of an image by the PDP (hereinafter referred to as a display model as appropriate).

  Here, FIG. 29 is a view similar to FIGS. 7 and 11 described above.

  In the display model, eight subfields SF1 to SF8 are arranged in the direction of time T, with the direction perpendicular to the XY plane as the display surface for displaying the input image signal Vin in the PDP as the direction of time T.

  The XY plane as the display surface has, for example, the upper left point on the display surface as the origin, the left to right direction as the X direction, and the top to bottom direction as the Y direction.

  In the light amount integrating unit 300 (FIG. 1), the pixel of the input image signal Vin displayed on the PDP (the pixel of the image corresponding to the input image signal Vin displayed on the PDP according to the input image signal Vin) is sequentially selected as the target pixel. In the display model, the region of the pixel of interest has a cross-section, and the region extending in the line-of-sight direction mv (the direction of the motion vector detected for the pixel of interest) in the pixel of interest is used as the light amount integration region for performing light amount integration. The pixel value of the target pixel is calculated by integrating the light amount in the light amount integration region according to the light emission pattern of the subfield represented by the light emission control information SF.

  That is, as shown in FIG. 29, the light amount integrating unit 300 has a cross section of the pixel area of the display surface of the display model and has a length corresponding to the light emission amount of the subfield SF # i in the direction of time T. A cuboid-shaped region (space) extending only as a pixel subfield region, and the light emission pattern of the subfield SF # i corresponding to the pixel subfield region is set to an occupation ratio that is a ratio of the light amount integration region in the pixel subfield region The pixel subfield region affects the pixel value of the target pixel by multiplying the light emission amount L according to (whether the pixel subfield region of the subfield SF # i emits light or not). The influence light amount of the minute is obtained for all the pixel subfield regions through which the light amount integration region passes.

  Then, the light amount integrating unit 300 calculates the integrated value as the pixel value of the target pixel by integrating the influence light amount obtained for all the pixel subfield regions through which the light amount integrating region passes.

  Hereinafter, the details of the method of calculating the pixel value of the target pixel using the display model by the light amount integrating unit 300 will be described.

  FIG. 30 shows an example of a pixel of the display model.

  In the display model, the pixel is, for example, a rectangular region having both horizontal and vertical lengths of 1. In this case, the area of the pixel region is 1 (= 1 × 1).

  In the display model, the position of the pixel (pixel position) is represented by the upper left coordinates of the pixel. In this case, for example, as shown in FIG. 30, for the pixel having the pixel position (X, Y) of (300,200) (as a rectangular area), the coordinates of the upper left point are (300,200), The coordinates of the point are (301,200). The coordinates of the lower left point are (300, 201), and the coordinates of the lower right point are (301, 201).

  Note that, for example, the upper left point of the pixel in the display model is hereinafter referred to as a reference point as appropriate.

  FIG. 31 shows a light amount integration region in the display model.

For example, assuming that the pixel at the pixel position (x, y) is the pixel of interest, the pixel of interest (subject to be reflected in) at time T = α is the motion vector (v _x , v _y ) during the time T _f. And move to a position (x + v _x , y + v _y ) at time T = β (= α + T _f ).

In this case, the locus drawn when the rectangular region as the region of the pixel of interest moves from the position (x, y) to the position (x + v _x , y + v _y ) is the light amount integration region (space). Become.

Now, if the cross section of the light amount integration area, that is, the area of the pixel of interest moving from the position (x, y) to the position (x + v _x , y + v _y ) is called a cross-section area (plane), the cross-section area Is an area having the same shape as the pixel area, and therefore has four vertices.

Of the four vertices of the cross-sectional area at any time T = t (α ≦ t ≦ β) between time α and β, the upper left, upper right, lower left, and lower right points (vertices) are respectively Assuming A, B, C, and D, the upper left point A moves from position (x, y) to position (x + v _x , y + v _y ) during time T _f . The coordinates (X, Y) of the point A at time t are (x + v _x (t−α) / T _f , y + v _y (t−α) / T _f ).

In addition, since the upper right point B is a point away from the point A by +1 in the X direction, the coordinate (X, Y) of the point B at time t is (x + v _x (t−α) / T _f + 1, y + v _y (t−α) / T _f ). Similarly, since the lower left point C is a point away from the point A by +1 in the Y direction, the coordinate (X, Y) of the point C at time t is (x + v _x (t−α) / T _f , y + v _y (t-α) / T _f +1), and the lower right point D is a point away from point A by +1 in the X direction and +1 in the Y direction The coordinates (X, Y) of the point D at time t are (x + v _x (t−α) / T _f +1, y + v _y (t−α) / T _f +1).

  FIG. 32 shows a cross-sectional area at time T = t.

  Since the cross-sectional area having the points A to D as vertices is not deformed, it includes one or more reference points (when projected onto the XY plane) at an arbitrary time T = t. In FIG. 32, one reference point (a, b) is included in the cross-sectional area.

  Here, there may be a plurality of reference points in the cross-sectional area, which will be described later.

  In addition, the cross-sectional area moves with the passage of time T, thereby changing the position of the reference point in the cross-sectional area. It can be understood that it is moving with the passage of T. Then, as the reference point moves as time T elapses, the reference point in the cross-sectional area may be changed to (another reference point). This case will also be described later.

In the cross-sectional area, the straight line L _X that passes through the reference point (a, b) and is parallel to the X axis and the straight line L _Y that is parallel to the Y axis are the boundaries of the pixels that make up the display model. Needs to be performed for each region obtained by dividing the cross-sectional region by the straight lines L _X and L _Y (hereinafter, appropriately referred to as a divided region).

In FIG. 32, the reference point (a, b) is inside the cross-sectional area (part other than the boundary), and therefore, the cross-sectional area is divided into four divided areas S ₁ , S ₂ , S ₃ , and S ₄ . Divided. In FIG. 32, a reference point (a, b) upper right region of the divided region S _1, a reference point (a, b) upper left area of the divided region S _2, reference point (a, b) a lower left region is divided area S _3, upper right region of the reference point (a, b) is a divided area S _4, are respectively.

The area (S _i ) of the divided region S _i (i = 1, 2, 3, 4) at time T = t is expressed by the following equations (1) to (4).

・・・（１）

... (1)

・・・（２）

... (2)

・・・（３）

... (3)

・・・（４）

... (4)

Now, of the eight subfields SF1 to SF8 of the display model (FIG. 29), a certain subfield SF # j is set as the target subfield SF # j, and the cross-sectional area is set as the target subfield SF # j. Pass between time T = _sfa and time T = _sfb .

The light quantity integration region as a locus drawn when the cross-sectional region passes through the target subfield SF # j is equal to the combination of the locus drawn by each of the divided regions S ₁ to S ₄ at the time of passing.

Now, of the light intensity integrating region, a portion of the region as a trajectory divided area S _i draws (solid to cross the divided area S _i), when the fact that the division stereoscopic V _i, the volume of the divided solid V _i ( V _i ) can be obtained by integrating the divided region S _i from time t _sfa to t _sfb according to the following equations (5) to (8).

・・・（５）

... (5)

・・・（６）

... (6)

・・・（７）

... (7)

・・・（８）

... (8)

  Here, the reference point (a, b) is not changed when the cross-sectional area passes through the target subfield SF # j (when the cross-sectional area starts to pass through the target subfield SF # j, It is assumed that the reference point (a, b) existing in the area continues to exist in the cross-sectional area until the cross-sectional area passes through the target subfield SF # j.

On the other hand, in the display model, when the volume of a pixel field region (FIG. 29) that is a rectangular solid extending in the direction of time T with the pixel region taken as a cross section in the target subfield SF # j is V, the pixel field region And the volume (V _i ) of the divided solids V ₁ , V ₂ , V ₃ , and V _{4 have} the relationship of Equation (9).

・・・（９）

... (9)

The divided solid V _i, which is a part of the light amount integration region, occupies a part of a certain pixel field region of the target subfield SF # j, and if the occupation ratio is referred to as an occupation ratio, the occupation ratio is V It is expressed by _i / V and can be obtained from the equations (5) to (9).

Now, assuming that the pixel field area of the target subfield SF # j in which the divided solid V _i occupies a part is the occupied pixel field area, the occupied pixel field area (the amount of light) becomes the pixel value of the target pixel. The amount of light affected (hereinafter referred to as “influence light amount” as appropriate) can be obtained by multiplying the occupation ratio V _i / V by the light amount SF _Vi of the occupied pixel field region.

Here, the light amount SF _Vi of the occupied pixel field region is set to the luminance weight L of the focused subfield SF # j when the occupied pixel field region of the focused subfield SF # j emits light. When the occupied pixel field area of the field SF # j is not emitting light (not emitting light), it is set to 0. Note that light emission / non-light emission in the occupied pixel field region of the target subfield SF # j is recognized from the light emission pattern represented by the light emission control information SF supplied from the subfield developing unit 200 (FIG. 1) to the light amount integrating unit 300. Can do.

The amount of light that affects the pixel value of the target pixel (the amount of light of the target subfield SF # j) (the amount of light of the target subfield SF # j) P _SFL , _j is the divided solid V ₁ , V ₂ , V ₃ , And V ₄ each occupy a part of the occupied pixel field area influence light intensity SF _V1 × V ₁ / V, SF _V2 × V ₂ / V, SF _V3 × V ₃ / V, and SF _V4 × V ₄ / V Since it is the sum, it can be obtained from equation (10).

・・・（１０）

... (10)

In the light quantity integrating unit 300 (FIG. 1), P _SFL , ₁ to P _SFL , ₈ are obtained for each pixel of interest by the eight subfields SF1 to SF8 according to Expression (10). Then, in the light quantity integrating unit 300, P _SFL , ₁ to P _SFL , ₈ by the _eight subfields SF1 to SF8 are integrated, and the integrated values P _SFL , ₁ + P _SFL , ₂ +... + P _SFL , ₈ is the pixel value of the target pixel. Note that finding the integrated value P _SFL , ₁ + P _SFL , ₂ +... + P _SFL , _{8 is} to obtain the influence light quantity of all the pixel subfield areas through which the light quantity integration area passes and integrate the influence light quantity. Is equivalent to

  By the way, as for the cross-sectional area that moves with the lapse of time T, as described above, when there are a plurality of reference points in the cross-sectional area, or the reference point in the cross-sectional area is changed to (another reference point). There is a case. Such a case will be described with reference to FIGS. 33 and 34.

  33 and 34 show a cross-sectional area that moves within the display model as time T passes, with the pixel at the position (x, y) of the display model as the pixel of interest.

  FIG. 34 is a diagram following FIG.

In FIG. 33 and FIG. 34, the pixel at the pixel position (x, y) is the pixel of interest, and the pixel of interest (subject to appear in) is a motion vector (+2, 2, from time T = t _sfa to time T = t _sfb . -1) moves to the position (x + 2, y-1).

  As described above, in the cross-sectional area that is the area of the target pixel moving from the position (x, y) to the position (x + 2, y-1), the cross-sectional area and the pixel area of the display model ( When the positions (viewed from the XY plane) completely match, the four vertices of the pixel region exist in the cross-sectional region as reference points.

  That is, for example, in the cross-sectional area at the position (x, y) when the movement is started (the cross-sectional area where the position of the upper left vertex is the position (x, y)), the point (x, y), the point ( There are four reference points, x + 1, y), point (x, y + 1), and point (x + 1, y + 1).

  As described above, when there are a plurality of reference points in the cross-sectional area, for example, one reference point in the line-of-sight direction mv (the direction of the motion vector detected for the target pixel) in the target pixel is the pixel of the target pixel. It is selected as a reference point used to obtain a value (hereinafter referred to as “reference point of interest” as appropriate).

  That is, for example, when the X component of the motion vector representing the line-of-sight direction mv at the target pixel is greater than 0 (sign is positive) and the Y component is 0 or less (Y component is 0 or the sign is negative). Of the four reference points (x, y), (x + 1, y), (x, y + 1), and (x + 1, y + 1) , y) is selected as the reference point of interest.

  Further, for example, when the X component of the motion vector representing the line-of-sight direction mv at the target pixel is 0 or less and the Y component is 0 or less, four reference points (x, y), (x + 1, y) , (x, y + 1) and (x + 1, y + 1), the upper left reference point (x, y) is selected as the target reference point.

  Further, for example, when the X component of the motion vector representing the line-of-sight direction mv at the target pixel is 0 or less and the Y component is greater than 0, four reference points (x, y), (x + 1, y ), (x, y + 1), and (x + 1, y + 1), the lower left reference point (x, y + 1) is selected as the target reference point.

  For example, when the X component and the Y component of the motion vector representing the line-of-sight direction mv at the target pixel are both greater than 0, four reference points (x, y), (x + 1, y), Of (x, y + 1) and (x + 1, y + 1), the lower right reference point (x + 1, y + 1) is selected as the reference point of interest.

  In FIG. 33, since the motion vector representing the line-of-sight direction mv at the target pixel is the vector (+2, −1), the upper right reference point (x + 1, y) is selected as the target reference point.

After the attention reference point (x + 1, y) is selected as described above, the cross-sectional area is divided into the four divided regions S ₁ described in FIG. 32 by the attention reference point (x + 1, y). , S ₂ , S ₃ , and S ₄ , and therefore, unless the cross-sectional area moves in the line-of-sight direction mv, a new reference point is included in the cross-sectional area. According to (1) to (10), the pixel value of the target pixel can be obtained.

  On the other hand, when a new reference point is included in the cross-sectional area by moving the cross-sectional area in the line-of-sight direction mv, for the new reference point, as in the case described above, A new attention reference point is selected again, thereby changing the attention reference point.

  That is, for example, in FIG. 33, at time T = γ, the X coordinate x + 1 of the position of the cross-sectional area coincides with the X coordinate x + 1 of the position of the pixel of the display model. A new reference point (x + 2, y) is included.

  In this case, a new reference point is selected again for the new reference point (x + 2, y), but in this case, the new reference point is only the reference point (x + 2, y). So, the reference point (x + 2, y) is selected as a new attention reference point, so that the attention reference point is changed from the reference point (x + 1, y) to the reference point (x + 2, y). Changed to

  As described above, the Y coordinate of the position of the cross-sectional area coincides with the Y coordinate of the pixel position of the display model, and as a result, a new reference point is included in the cross-sectional area. The attention reference point is changed.

  FIG. 34 shows a cross-sectional area after the attention reference point is changed, that is, after a new attention reference point (x + 2, y) is selected.

After the new attention reference point is selected, the cross-sectional area can be divided into four divided areas by the new attention reference point as in the case described with reference to FIG. In FIG. 34, the cross-sectional area is divided into four divided areas S ₁ ′, S ₂ ′, S ₃ ′, and S ₄ ′.

  After selection of a new reference point of interest, when the cross-sectional area moves in the line-of-sight direction mv and a new reference point is included in the cross-sectional area, the new reference point is used as a target. In the same manner as described above, a new attention reference point is selected again, and thereby the attention reference point is changed.

In FIG. 34, at time T = t _sfb , the X coordinate x + 2 of the position of the cross-sectional area coincides with the X coordinate x + 2 of the pixel position (x + 2, y-1) of the display model. , The Y coordinate y-1 of the position of the cross-sectional area matches the Y coordinate y-1 of the pixel position (x + 2, y-1) of the display model. Reference points (x + 2, y-1), (x + 3, y-1), and (x + 3, y) are included.

  If the cross-sectional area moves after that, select from the three new reference points (x + 2, y-1), (x + 3, y-1), and (x + 3, y) As described above, a new attention reference point is selected again.

As described above, by reselecting (changing) the target reference point, the occupation ratio in which the light amount integration region occupies the occupied pixel field region (FIG. 29), that is, the light amount integration region in the occupied pixel field region is changed. Occupied part (this part corresponds to the above-mentioned divided solid, so this part is hereinafter referred to as a divided solid part as appropriate) V _ε volume (V _ε ) and occupied pixel field region V volume (V) The ratio V _ε / V can be obtained.

That is, for example, as shown in FIG. 33 and FIG. 34, the cross-sectional area is _changed from position (x, y) to position (X + 2, y−1) from time T = t _sfa to time T = t _sfb. When moving and passing through the target subfield SF # j, if the target reference point is changed only once at time T = γ, for example, the position (x + 1) of the target subfield SF # j , y-1), the volume (V _ε ) of the divided solid portion V _ε occupied by the light quantity integration region in the occupied pixel field region having the cross section as the pixel region can be obtained by Expression (11).

・・・（１１）

(11)

Here, in the expression (11), as shown in FIG. 33, S ₁ is between time T = t _sfa and time T = γ when the reference point (x + 1, y) is the reference point of interest. Represents the area of the divided region on the pixel region at the position (x + 1, y-1) in the cross section of the occupied pixel field region. Further, as shown in FIG. 34, S ₂ ′ is an occupied pixel field region between time T = γ and time T = t _sfb when the reference point (x + 2, y) is the reference point of interest. Represents the area of the divided region on the pixel region at the position (x + 1, y-1) in the cross section.

As shown in Expression (11), the divided solid portion V occupied by the light amount integration region in the occupied pixel field region whose cross section is the region of the pixel at a certain position (X, Y) in the target subfield SF # j. The volume of _ε (V _ε ) is the integration interval, the interval in which the reference point of interest is changed (in the formula (11), from time T = t _sfa to time T = γ, and from time T = γ to time T = t _sfb ), and integrate the area of the divided area (areas S ₁ and S ₂ ′ in equation (11)) on the pixel area that is the cross section of the occupied pixel field area Can be obtained.

Then, the occupation ratio V _ε / V in which the light amount integration region occupies the occupied pixel field region is the volume (V _ε ) of the divided solid portion V _ε occupied by the light amount integration region in the occupied pixel field region. It can be obtained by dividing by the volume (V) of V.

After obtaining the occupation ratio V _ε / V, as described with reference to FIGS. 31 and 32, the occupation ratio V _i / V is multiplied by the light quantity of the occupation pixel field area, thereby obtaining the light quantity of the occupation pixel field area (the light quantity of the occupation pixel field area). ) Can affect the amount of light that affects the pixel value of the pixel of interest (influence light amount). Then, the influence light amount of all the pixel subfield regions through which the light amount integration region passes is obtained, and the influence light amount can be integrated to obtain the pixel value of the target pixel.

Next, as shown in Expression (11), in order to obtain the volume (V _ε ) of the divided solid portion V _ε occupied by the light amount integration region in the occupied pixel field region, the time at which the reference point of interest is changed (In Expression (11), time γ) (hereinafter referred to as a change time as appropriate) is required.

  To change the reference point of interest, the X coordinate of the cross-sectional area position matches the X coordinate of the pixel position of the display model, or the Y coordinate of the cross-sectional area position is the Y coordinate of the pixel position of the display model Occurs when it matches y-1. Therefore, the change time can be obtained as follows.

That is, for example, as shown in FIG. 31 described above, the pixel at the pixel position (x, y) is the target pixel, and the cross-sectional area at the position (x, y) at time T = α is the time. During T _f , it moved by the amount of motion represented by the motion vector (v _x , v _y ), and moved to the position (x + v _x , y + v _y ) at time T = β (= α + T _f ) And

In this case, the change time T _cx as the time when the X coordinate of the position of the cross-sectional area coincides with the X coordinate of the pixel position of the display model is expressed by Expression (12).

・・・（１２）

(12)

Here, the X component v _x of the motion vector takes an integer value.

Further, the change time T _cy as the time when the Y coordinate of the position of the cross-sectional area coincides with the Y coordinate of the position of the pixel of the display model is expressed by Expression (13).

・・・（１３）

... (13)

Here, it is assumed that the Y component v _y of the motion vector takes an integer value.

When the X component v _x of the motion vector is a value other than 0, every time the time T becomes the change time T _cx obtained according to the equation (12), the reference point that was the reference reference point immediately before A point obtained by adding +1 or -1 to the X coordinate of becomes a new attention reference point (reference point after change). That is, when the X component v _x of the motion vector is positive, a point obtained by adding 1 to the X coordinate of the reference point that was the reference point just before becomes a new reference point, and the X component v of the motion vector _{When x} is negative, a point obtained by decrementing the X coordinate of the reference point that was the attention reference point immediately before by −1 becomes a new attention reference point.

Similarly, when the Y component v _y of the motion vector is a value other than 0, every time the time T reaches the change time T _cy obtained according to the equation (13), the reference that was the reference point just before A point obtained by adding +1 or -1 to the Y coordinate of the point becomes a new reference point of interest. That is, when the Y component v _y of the motion vector is positive, the point obtained by adding +1 to the Y coordinate of the reference point that was the reference point immediately before becomes the new reference point, and the Y component v of the motion vector _{When y} is negative, a point obtained by subtracting the Y coordinate of the reference point that was the attention reference point immediately before is −1 becomes a new attention reference point.

In addition, when the change times T _cx and T _cy are equal, both the X coordinate and the Y coordinate of the reference point that was the reference reference point immediately before, as described above, the point that is +1 or −1, It becomes a new attention reference point.

Here, in FIGS. 33 and 34, at time T = t _sfa, position (x, y) cross-section area at the can, during a time T _f, the motion vector _{(v x, v y) =} (+ 2, -1), and moves to the position (x + 2, y-1) at time T = t _sfb (= t _sfa + T _f ).

33 and 34, the time T = γ is the change time T _cx when the variable N in the equation (12) is 1, and in the equation (12), T _f = t _sfb −t _sfa , N = By setting 1 and v _x = + 2, the change time T _cx = γ can be obtained according to the equation (t _sfb -t _sfa ) × 1 / | +2 |.

  Next, with reference to the flowchart of FIG. 35, the details of the light amount integration processing in step ST400 of FIG. 20 described in FIG. 23 will be further described.

  In step ST1001, the line-of-sight direction mv in each pixel of the field of interest detected in step ST200 of FIG. 20 is supplied from the motion detection unit 100 (FIG. 1) to the light amount integrating unit 300 and generated in step ST300 of FIG. The light emission control information SF representing the light emission pattern of the subfield of the target field is supplied from the subfield developing unit 200 (FIG. 1) to the light amount integrating unit 300.

  Here, step ST1001 corresponds to step ST401 in FIG.

  Thereafter, the process proceeds from step ST1001 to step ST1002, and in the light amount integration section 300 (FIG. 8), the light amount integration region determination circuit 301 is a pixel that has not yet been selected as a target pixel among the pixels constituting the target field. Is selected as the target pixel, and the process proceeds to step ST1003.

  In step ST1003, the light amount integration region determination circuit 301 sets a reference point that is an initial (first) reference point from the reference points of the display model based on the line-of-sight direction mv at the target pixel for the target pixel ( The process proceeds to step ST1004.

  In step ST1004, as described in Expression (12) and Expression (13), the light amount integration region determination circuit 301 obtains a change time at which the target reference point changes for the target pixel, and at each change time, a new time is obtained. A reference point that is a target reference point is obtained, and the process proceeds to step ST1005.

  In step ST1005, the light amount integration region determination circuit 301 uses the line-of-sight direction mv at the target pixel, the change time obtained in step ST1004, and the reference point that becomes a new reference point at each change time, and integrates the light amount. Find the area.

That is, in step ST1005, the light amount integration region determination circuit 301 uses the line-of-sight direction mv at the target pixel, the change time, and the reference point that becomes a new target reference point at each change time, thereby providing eight subfields. For each of SF1 to SF8, the volume (V _i ) of the divided solid portion V _i (equation (10)) occupied by the light amount integration region of the target pixel in the occupied pixel field region is obtained. Here, eight subfields SF1 to SF8 region combined all portions V _i of the resulting division stereoscopic each, the light-intensity integrating region.

In step ST1005, the light amount integration region determination circuit 301 further obtains an occupation ratio V _i / V in which the light amount integration region of the target pixel occupies the occupied pixel field region for each of the eight subfields SF1 to SF8. Proceed to ST1006.

In step ST1006, the light amount integration region determination circuit 301 sets the light amount of the occupied pixel field region to the occupation ratio V _i / V in which the light amount integration region of the target pixel occupies the occupied pixel field region for each of the eight subfields SF1 to SF8. By multiplying SF _Vi , as described in the equation (10), the amount of light (influenced light amount) P _SFL , ₁ to P _SFL , in which the occupied pixel field region (the amount of light) affects the pixel value of the target pixel ₈ is obtained and supplied to the light amount integrating circuit 302.

The light amount SF _Vi of the occupied pixel field area of the subfield SF # j is set to the luminance weight L of the subfield SF # j when the subfield SF # j emits light, and the subfield SF # j When j is not emitting light (non-emitting), it is set to 0. The light amount integration region determination circuit 301 recognizes light emission / non-light emission of the subfield SF # j from the light emission pattern represented by the light emission control information SF supplied from the subfield development unit 200 (FIG. 1).

  Here, the above steps ST1002 to ST1006 correspond to step ST402 in FIG.

Thereafter, the process proceeds from step ST1006 to step ST1007, and the light amount integration circuit 302 integrates the influence light amounts P _SFL , ₁ to P _SFL , ₈ from the light amount integration region determination circuit 301 to thereby obtain the pixel value of the target pixel. The processing proceeds to step ST1008.

  Here, step ST1007 corresponds to step ST403 in FIG.

  In step ST1008, the light amount integration region determination circuit 301 determines whether all the pixels constituting the target field have been set as the target pixel.

  If it is determined in step ST1008 that all the pixels constituting the target field have not yet been set as the target pixel, the process returns to step ST1002, and the light amount integration region determination circuit 301 selects among the pixels constituting the target field. One of the pixels not yet selected as the target pixel is newly selected as the target pixel, and the same processing is repeated thereafter.

  If it is determined in step ST1008 that all the pixels constituting the field of interest are the target pixel, the process proceeds to step ST1009, and the light amount integrating circuit 302 focuses on all the pixels constituting the field of interest. An output image Vout composed of pixel values obtained as pixels is output.

  Here, step ST1009 corresponds to step ST404 in FIG.

  Next, FIG. 36 shows another configuration example of the light amount integrating unit 300 of FIG.

  In the figure, portions corresponding to those in FIG. 8 are denoted by the same reference numerals, and description thereof will be omitted below as appropriate.

  36 is the same as that in FIG. 8 in that a light amount integration circuit 302 is provided, but instead of the light amount integration region determination circuit 301 in FIG. 8, a light amount integration value table storage is provided. 8 is different from the case of FIG. 8 in that a unit 303 and a light amount integration region selection circuit 304 are provided.

  36 uses a table in which the line-of-sight direction mv is associated with the occupation ratio (hereinafter, referred to as a light amount integrated value table as appropriate), and the pixel of interest is occupied based on the line-of-sight direction mv of the pixel of interest. A ratio is required.

  That is, in FIG. 36, the light amount integrated value table storage unit 303 stores a light amount integrated value table.

The line-of-sight direction mv at each pixel in the field of interest is supplied from the motion detection unit 100 (FIG. 1) to the light quantity integrated value table storage unit 303. The light amount integrated value table storage unit 303 sequentially sets the pixels constituting the target field as the target pixel, and sets the occupation ratio associated with the line-of-sight direction mv of the target pixel supplied thereto to the light amount integrated region of the target pixel. Is read from the light amount integrated value table as the occupation ratio V _i / V occupying the occupied pixel field region and supplied to the light amount integrated region selection circuit 304.

  As described above, the light amount integration region selection circuit 304 is supplied with the occupation ratio from the light amount integration value table storage unit 303, and from the subfield development unit 200 (FIG. 1), the light emission pattern of the subfield of the field of interest. The light emission control information SF to be expressed is supplied.

The light amount integration region selection circuit 304 recognizes light emission / non-light emission of the occupied pixel field region of the subfield SF # j from the light emission pattern represented by the light emission control information SF from the subfield development unit 200. Further, when the occupied pixel field region of the subfield SF # j emits light, the light amount integration region selection circuit 304 uses the light amount SF _Vi of the occupied pixel field region as the luminance weight of the subfield SF # j. When L is set and the occupied pixel field area of the subfield SF # j is not emitting light (not emitting light), the light quantity SF _Vi of the occupied pixel field area is set to 0.

Then, the light amount integration region selection circuit 304 sets the occupancy ratio V _i / V in which the light amount integration region of the target pixel occupies the occupied pixel field region from the light amount integration value table storage unit 303 for each of the eight subfields SF1 to SF8. By multiplying the light amount SF _Vi of the occupied pixel field region, as described in the equation (10), the light amount (influenced light amount) of the occupied pixel field region (its light amount) affects the pixel value of the target pixel. P _SFL , ₁ to P _SFL , ₈ are obtained and supplied to the light amount integrating circuit 302.

  FIG. 37 schematically shows a light amount integrated value table stored in the light amount integrated value table storage unit 303 of FIG.

In the integrated light quantity value table, pixels for each of the eight subfields SF1 to SF8 obtained in advance by calculation with respect to the line-of-sight direction mv as a motion vector that can be detected by the motion detection unit 100. And the occupation ratio V _i / V occupying the occupied pixel field area is stored in association with each other.

  That is, the integrated light quantity value table is prepared for each line-of-sight direction mv. Therefore, if the search range of the motion vector as the line-of-sight direction mv is, for example, a range of 16 × 16 pixels as will be described later, and the line-of-sight direction mv can take 256 ways, only 256 light quantity integration value tables are available. Exists.

In the integrated light quantity value table for one line-of-sight direction mv, the occupation ratios V _i / V for each of the eight subfields SF1 to SF8 are registered, and thereby, the line-of-sight direction mv and 8 for the line-of-sight direction mv are registered. The occupation ratios V _i / V for the two subfields SF1 to SF8 are associated with each other.

  FIG. 37 shows a light amount integrated value table for one certain line-of-sight direction mv.

  The light quantity integrated value table for one line-of-sight direction mv is, for example, a table in which the horizontal axis is the subfield SF # j and the vertical axis is the relative position [x, y] from the target pixel.

  In this embodiment, since there are eight subfields SF1 to SF8, columns corresponding to the eight subfields SF1 to SF8 are provided on the horizontal axis of the light quantity integrated value table.

  Further, the x coordinate and the y coordinate of the relative position [x, y] on the vertical axis of the light quantity integrated value table represent a position in the X direction and a position in the Y direction, respectively, with the position of the target pixel as a reference (origin). For example, the relative position [1,0] represents the position of the pixel adjacent to the right of the target pixel. For example, the relative position [0, −1] represents the position of the pixel adjacent to the target pixel.

  Now, suppose that the search range of the motion vector as the line-of-sight direction mv is, for example, a range of 16 × 16 pixels from −8 pixels to +7 pixels in both the X direction and the Y direction centering on the target pixel. Since there are 256 movement lights from [-8, -8] to [7, 7] with respect to the target pixel as the moving light that the target pixel moves during one field, A column corresponding to each of the 256 relative positions [x, y] is provided.

When the line-of-sight direction mv is represented by a certain motion vector MV, in the light quantity integrated value table for the line-of-sight direction MV, a column of a certain subfield SF # j in a row of a certain relative position [x, y] is displayed. In the subfield SF # j, in which the region of the pixel whose relative position from the target pixel is represented by [x, y] is a cross section when the line-of-sight direction mv of the target pixel is represented by the motion vector MV. Occupied pixel field region B _{SF # j [x, y]} is set to the occupation ratio R _{SF # j [x, y]} (V _i / V in equation (10)) occupied by the light amount integration region of the target pixel, or equation ( V _epsilon / V) of the V _epsilon divided by the volume of the occupied pixel field region V (V) of 11), it is registered obtained in advance by calculation.

Note that the occupied pixel field region _{BSF # j [x, y]} of the subfield SF # j having a cross section of the region of the pixel whose relative position from the target pixel is represented by _{[x, y]} When the light amount accumulation area does not pass (when the occupied pixel field area B _{SF # j [x, y]} and the light intensity accumulation area of the target pixel do not overlap), the occupied pixel field area B _{SF # j [x, y]} Occupancy ratio R _{SF # j [x, y]} occupied by the light amount integration region of the target pixel is set to 0.

Here, when the line-of-sight direction mv at the target pixel is represented by, for example, a motion vector (1, -1), the light amount integration region of the target pixel is a 16 × 16 pixel search range centered on the target pixel. In the subfield SF1, the region of the target pixel in the occupied pixel field region (256 × 8 occupied pixel field regions) of each of the subfields SF1 to SF8 having a cross section as a cross section is shown. Or eight occupied pixel field regions _{BSF1 [0,0]} to _{BSF8 [0,0] of} each of SF8, and eight subfields SF1 to SF8 each having a cross section of a pixel adjacent to the right of the target pixel. It occupied pixel field region B _{SF1 [1, 0]} no B _{SF8 [1, 0],} and cross-section of the pixel adjacent to the upper side of the pixel of interest, the sub-fields SF1 to SF8 each of the eight occupied pixel field Region B _{SF1 [0, -1]} to B _{SF8 [0, -1],} and a pixel adjacent to the upper right of the pixel of interest and cross subfields SF1 to SF8 8 amino occupied pixel field region of each B _{SF1 It} passes only _{[1, -1] or BSF8 [1, -1]} and does not pass through other occupied pixel field areas.

Therefore, the light amount integration region of the target pixel in the eight occupied pixel field regions B _{SF1 [0,0]} to B _{SF8 [0,0]} of each of the subfields SF1 to SF8 having the cross section of the region of the target pixel. The volume of the part that passes through (the part of the divided solid) (V _{i in} Expressions (5) to (9)) is adjacent to V _{SF1 [0,0]} to V _{SF8 [0,0]} and to the right of the _target pixel Of the eight occupied pixel field regions _{BSF1 [1,0]} to _{BSF8 [1,0]} of each of the subfields SF1 to SF8, whose cross section is the pixel to be processed, Eight occupied pixel field regions B _{SF1 [} each of the subfields SF1 to SF8 having a volume of V _{SF1 [1,0]} to V _{SF8 [1,0]} and a cross section of a pixel adjacent to the target pixel _{. 0, -1]} to B _{SF8 [0,} of _-1], the volume of the portion light-intensity integrating region of the pixel of interest passes, V _{SF1 [0, -1]} to V _{SF8 [0, -1],} And cross the pixel adjacent to the upper right eye pixels, the subfields SF1 to SF8 each of the eight occupied pixel field region B _{SF1 [1, -1]} to B _{SF8 [1, -1]} of the pixel of interest If the volume of the part through which the light intensity integration region passes is expressed as V _{SF1 [1, -1]} to V _{SF8 [1, -1]} , respectively, the line-of-sight direction mv is the motion vector (1, -1). In the light amount integrated value table represented for the line-of-sight direction mv, the occupation ratios R _{SF1 [0,0]} to R _{SF8 [0,0]} are values V _{SF1 [0,0]} / V to V _{SF8 [0, 0]} / V, the occupation ratio R _{SF1 [1,0]} to R _{SF8 [1,0]} is the value V _{SF1 [1,0]} / V to V _{SF8 [1,0]} / V, the occupation ratio R _{SF1 [0, -1] thru} R _{SF8 [0, -1]} have values V _{SF1 [0, -1]} / V _thru V _{SF8 [0, -1]} / V and the occupation ratio R _{SF1 [1,- 1]} to R _{SF8 [1, -1]} are values V _{SF1 [1, -1]} / V to V _{SF8 [1, -1]} / V, respectively, and the other occupation ratios are all 0. It has become.

  The light amount integrated value table storage unit 303 (FIG. 36) registers each of the eight subfields SF1 to SF8 registered in the light amount integrated value table for the line-of-sight direction mv at the target pixel and 256 relative positions [−8, − A total of 8 × 256 occupancy ratios for each of [8] to [7,7] are read and supplied to the light quantity integration region selection circuit 304.

The light quantity integration region selection circuit 304 selects an occupation ratio with a value other than 0 from the occupation ratios from the light quantity integration value table storage unit 303, and sets the corresponding light quantity SF _Vi to the occupation ratio with a value other than 0. The influence light quantity is obtained by multiplication.

Here, the light quantity integration region selection circuit 304 selects an occupation ratio with a value other than 0 from the occupation ratios from the light quantity integration value table storage unit 303, and the value corresponds to an occupation ratio with a value other than 0. The amount of influence light is _calculated by multiplying the amount of light SF _Vi to be used. However, for the occupation ratio of 0, the amount of influence SF is multiplied by any amount of light SF _Vi. Therefore, the light quantity integration region selection circuit 304 does not particularly select an occupation ratio with a value other than 0 from the occupation ratios from the light quantity integration value table storage unit 303, and the occupation ratio from the light quantity integration value table storage unit 303. By multiplying each of these by the corresponding light amount SF _Vi , it is possible to obtain the influence light amount.

  Next, with reference to the flowchart of FIG. 38, the details of the light amount integration processing by the light amount integration unit 300 of FIG. 36 will be described.

  In step ST1011, the line-of-sight direction mv at each pixel of the field of interest is supplied from the motion detection unit 100 (FIG. 1) to the light amount integrated value table storage unit 303 of the light amount integrating unit 300, and the light emission pattern of the subfield of the field of interest Is supplied from the sub-field development unit 200 (FIG. 1) to the light amount integration region selection circuit 304 of the light amount integration unit 300.

  Thereafter, the process proceeds from step ST1011 to step ST1012, and the light amount integrated value table storage unit 303 selects one of the pixels constituting the target field that has not yet been selected as the target pixel as the target pixel. Then, the process proceeds to step ST1013.

In step ST1013, the light amount integrated value table storage unit 303 stores all occupation ratios R registered therein from the light amount integrated value table for the line-of-sight direction mv of the target pixel in the line-of-sight direction mv from the motion detection unit 100. _{SF # j [x, y]} is read out and supplied to the light quantity integration region selection circuit 304, and the process proceeds to step ST1014.

In step ST1014, the light amount integration region selection circuit 304 sets the occupation pixel field region B _{SF # j [x, y]} corresponding to the occupation ratio R _{SF # j [x, y]} from the light amount integration value table storage unit 303 _. By multiplying the light amount SF _j , a light amount (influenced light amount) that the occupied pixel field region B _{SF # j [x, y]} (of the light amount) affects the pixel value of the target pixel is obtained, and the light amount integrating circuit 302 is obtained. Supply.

Incidentally, the light amount SF _j of the occupied pixel field region of the sub-field SF # j, when the sub-field SF # j is emitting light is the weight L of the luminance of the subfield SF # j, the sub-field SF # When j is not emitting light (non-emitting), it is set to 0. The light quantity integration region selection circuit 304 recognizes light emission / non-light emission of the subfield SF # j from the light emission pattern represented by the light emission control information SF supplied from the subfield development unit 200 (FIG. 1).

  Thereafter, the process proceeds from step ST1014 to step ST1015, and the light amount integrating circuit 302 obtains the pixel value of the target pixel by integrating all the influence light amounts from the light amount integrating region selecting circuit 304, and the process proceeds to step ST1016. move on.

  In step ST1016, the light amount integration region selection circuit 304 determines whether or not all of the pixels constituting the target field are the target pixels.

  If it is determined in step ST1016 that all of the pixels constituting the target field have not yet been set as the target pixel, the process returns to step ST1012, and the light amount integrated value table storage unit 303 stores the pixels constituting the target field. One of the pixels that has not yet been selected as the target pixel is newly selected as the target pixel, and the same processing is repeated thereafter.

  If it is determined in step ST1016 that all the pixels constituting the field of interest are the pixel of interest, the process proceeds to step ST1017, and the light amount integrating circuit 302 focuses on all the pixels constituting the field of interest. An output image Vout composed of pixel values obtained as pixels is output.

  Next, the series of processes described above can be performed by dedicated hardware or by software. When a series of processing is performed by software, a program constituting the software is installed in a general-purpose computer or the like.

  Therefore, FIG. 39 shows a configuration example of an embodiment of a computer in which a program for executing the series of processes described above is installed.

  The program can be recorded in advance on a hard disk 1105 or a ROM 1103 as a recording medium built in the computer.

  Alternatively, the program is stored temporarily on a removable recording medium 1111 such as a flexible disk, a CD-ROM (Compact Disc Read Only Memory), an MO (Magneto Optical) disk, a DVD (Digital Versatile Disc), a magnetic disk, or a semiconductor memory. It can be stored permanently (recorded). Such a removable recording medium 1111 can be provided as so-called package software.

  The program is installed in the computer from the removable recording medium 1111 as described above, or transferred from the download site to the computer wirelessly via a digital satellite broadcasting artificial satellite, LAN (Local Area Network), The program can be transferred to a computer via a network such as the Internet, and the computer can receive the program transferred in this way by the communication unit 1108 and install it in the built-in hard disk 1105.

  The computer includes a CPU (Central Processing Unit) 1102. An input / output interface 1110 is connected to the CPU 1102 via a bus 1101, and the CPU 1102 operates an input unit 1107 including a keyboard, a mouse, a microphone, and the like by the user via the input / output interface 1110. When a command is input as a result, the program stored in a ROM (Read Only Memory) 1103 is executed accordingly. Alternatively, the CPU 1102 may be a program stored in the hard disk 1105, a program transferred from a satellite or a network, received by the communication unit 1108 and installed in the hard disk 1105, or a removable recording medium 1111 attached to the drive 1109. The program read and installed in the hard disk 1105 is loaded into a RAM (Random Access Memory) 1104 and executed. Thereby, the CPU 1102 performs processing according to the above-described flowchart or processing performed by the configuration of the above-described block diagram. Then, the CPU 1102 outputs the processing result from the output unit 1106 configured with an LCD (Liquid Crystal Display), a speaker, or the like, for example, via the input / output interface 1110 as necessary, or from the communication unit 1108. Transmission and further recording on the hard disk 1105 are performed.

  Here, in this specification, the processing steps for describing a program for causing a computer to perform various types of processing do not necessarily have to be processed in time series according to the order described in the flowchart, but in parallel or individually. This includes processing to be executed (for example, parallel processing or processing by an object).

  Further, the program may be processed by a single computer, or may be processed in a distributed manner by a plurality of computers. Furthermore, the program may be transferred to a remote computer and executed.

  The embodiment of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present invention.

It is a block diagram which shows the structural example of 1st Embodiment of the image processing apparatus to which this invention is applied. 3 is a block diagram illustrating a configuration example of a motion detection unit 100. FIG. It is a figure explaining motion detection. It is a figure explaining motion detection. 3 is a block diagram illustrating a configuration example of a subfield expansion unit 200. FIG. It is a figure which shows the structural example of a subfield. It is a figure which shows the structural example of a subfield. 3 is a block diagram illustrating a configuration example of a light amount integrating unit 300. FIG. It is a figure explaining generation | occurrence | production of a pseudo contour. It is a figure which shows a light quantity integration area | region. It is a figure which shows a light quantity integration area | region. It is a block diagram which shows the structural example of 2nd Embodiment of the image processing apparatus to which this invention is applied. 3 is a block diagram illustrating a configuration example of a gradation conversion unit 400. FIG. FIG. 6 is a diagram for explaining the operation of a dither conversion circuit 404. It is a block diagram which shows the structural example of 3rd Embodiment of the image processing apparatus to which this invention is applied. It is a block diagram which shows the structural example of 4th Embodiment of the image processing apparatus to which this invention is applied. 3 is a block diagram illustrating a configuration example of a visual correction unit 500. FIG. FIG. 6 is a diagram for explaining the operation of a dither correction circuit 501. FIG. 6 is a diagram for explaining the operation of a diffusion error correction circuit 502. It is a flowchart explaining operation | movement of 1st Embodiment of the image processing apparatus to which this invention is applied. It is a flowchart explaining the process of a motion detection. It is a flowchart explaining the process which expand | deploys an image to a subfield. It is a flowchart explaining the process which integrates light quantity. It is a flowchart explaining operation | movement of 2nd Embodiment of the image processing apparatus to which this invention is applied. It is a flowchart explaining the process which converts a gradation. It is a flowchart explaining operation | movement of 3rd Embodiment of the image processing apparatus to which this invention is applied. It is a flowchart explaining operation | movement of 4th Embodiment of the image processing apparatus to which this invention is applied. It is a flowchart explaining the process of visual correction. It is a figure which shows a display model. It is a figure which shows the pixel of a display model. It is a figure which shows the light quantity integration area | region in a display model. It is a figure which shows a cross-sectional area | region. It is a figure which shows the cross-sectional area | region which moves within the display model with progress of the time T. FIG. It is a figure which shows the cross-sectional area | region which moves within the display model with progress of the time T. FIG. It is a flowchart explaining the process of integrating | accumulating light quantity. FIG. 10 is a block diagram illustrating another configuration example of the light amount integrating unit 300. It is a figure which shows a light quantity integrated value table. It is a flowchart explaining the process of integrating | accumulating light quantity. It is a block diagram which shows the structural example of one Embodiment of the computer to which this invention is applied.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 100 Motion detection part, 101 Correlation operation circuit, 102 Delay circuit, 103 Eye-gaze determination circuit, 200 Subfield expansion part, 201 Subfield allocation circuit, 202 Light emission determination circuit, 300 Light quantity integration part, 301 Light quantity integration area determination circuit, 302 Light quantity Integrating circuit, 303 light amount integrated value table storage unit, 304 light amount integrated region selecting circuit, 400 gradation converting unit, 401 delay circuit, 402 gradation converting circuit, 403 gradation converting table, 404 dither converting circuit, 405, 406 computing unit 500 visual correction unit, 501 dither correction circuit, 502 diffusion error correction circuit, 1101 bus, 1102 CPU, 1103 ROM, 1104 RAM, 1105 hard disk, 1106 output unit, 1107 input unit, 1108 communication unit, 11 9 Drive, 1110 output interface, 1111 removable recording medium

Claims (6)

In an image processing apparatus for reproducing a state in which an image is displayed on a second display device having characteristics different from those of the first display device, using the first display device that displays an image,
Motion detection means for detecting the motion of the image from the input image signal;
Subfield expansion means for expanding the input image signal into a plurality of subfields;
When the person views the input image signal displayed on the second display device from the direction of movement detected by the motion detection means and the light emission pattern of the subfield developed by the subfield development means. , the amount of light integrated on the retina artificially calculated, have a light quantity integrating means for generating an output image signal for the amount of light as the pixel value,
The subfield expansion means expands the input image signal into a plurality of subfields having different light emission amounts for each pixel,
In the second display device, the light amount integrating unit includes the plurality of subfields arranged in the time direction with a direction perpendicular to a display surface on which the input image signal is displayed in the second display device as a time direction. In the display model in which the display of the input image signal is modeled, a region of the target pixel of interest is a cross section, and a region extending in the direction of movement of the target pixel is used as a light amount integration region for integrating the amount of light. In calculating the pixel value of the target pixel by integrating the light amount in the light amount integration region according to the light emission pattern of the subfield,
In the display model, the pixel subfield region is defined as a pixel subfield region in which a region of the pixel on the display surface is a cross section and extends in the time direction by a length corresponding to the light emission amount of the subfield. The pixel subfield region is multiplied by the light emission amount according to the light emission pattern of the subfield corresponding to the pixel subfield region to the occupation ratio that is the ratio occupied by the light amount integration region in the pixel subfield region. For each of the pixel subfield regions, the amount of influence light that affects the pixel value of
Accumulating the influence light amount obtained for all the pixel subfield regions,
A table in which the occupation ratio for each of the plurality of subfields is registered for each motion corresponding to the position of each pixel in the search range for detecting motion, and the search range based on the target pixel The pixel subfield of the relative position of each of the pixels and each subfield is a cross section of the region of the pixel at the relative position and extends in the time direction by a length corresponding to the light emission amount of the subfield An image processing apparatus for obtaining an occupation ratio of each pixel subfield for the target pixel from the table for the movement of the target pixel, using a table in which the occupation ratio occupied by the light amount integration area in the area is registered . The image processing apparatus according to claim 1, wherein the first display device is a display device other than a PDP (Plasma Display Panel). The image processing apparatus according to claim 1, wherein the first display device is a CRT (Cathode Ray Tube), an LCD (Liquid Crystal Display), an organic EL (Electroluminescence), or a projector. The image processing apparatus according to claim 1, wherein the second display device is a PDP (Plasma Display Panel). In an image processing method for reproducing a state in which an image is displayed on a second display device having a characteristic different from that of the first display device, using the first display device that displays an image,
A motion detection step for detecting the motion of the image from the input image signal;
A sub-field expansion step of expanding the input image signal into a plurality of sub-fields;
When a person views the input image signal displayed on the second display device from the direction of motion detected in the motion detection step and the light emission pattern of the subfield developed in the subfield development step. A light amount integrating step for artificially calculating a light amount integrated into the retina and generating an output image signal having the light amount as a pixel value ;
Only including,
The sub-field expanding step expands the input image signal into a plurality of sub-fields having different light emission amounts for each pixel,
The light amount integrating step is performed by the second display device in which the second display device has the plurality of subfields arranged in the time direction, with the direction perpendicular to the display surface displaying the input image signal as the time direction. In the display model in which the display of the input image signal is modeled, a region of the target pixel of interest is a cross section, and a region extending in the direction of movement of the target pixel is used as a light amount integration region for integrating the amount of light. In calculating the pixel value of the target pixel by integrating the light amount in the light amount integration region according to the light emission pattern of the subfield,
In the display model, the pixel subfield region is defined as a pixel subfield region in which a region of the pixel on the display surface is a cross section and extends in the time direction by a length corresponding to the light emission amount of the subfield. The pixel subfield region is multiplied by the light emission amount according to the light emission pattern of the subfield corresponding to the pixel subfield region to the occupation ratio that is the ratio occupied by the light amount integration region in the pixel subfield region. For each of the pixel subfield regions, the amount of influence light that affects the pixel value of
Accumulating the influence light amount obtained for all the pixel subfield regions,
A table in which the occupation ratio for each of the plurality of subfields is registered for each motion corresponding to the position of each pixel in the search range for detecting motion, and the search range based on the target pixel The pixel subfield of the relative position of each of the pixels and each subfield is a cross section of the region of the pixel at the relative position and extends in the time direction by a length corresponding to the light emission amount of the subfield An image processing method for obtaining an occupancy ratio of each pixel subfield for the target pixel from the table for the movement of the target pixel, using a table in which the occupancy ratio occupied by the light amount integration area in the area is registered . In a program for causing a computer to function as an image processing apparatus that reproduces a state in which an image is displayed on a second display device having characteristics different from those of the first display device, using the first display device that displays an image.
Motion detection means for detecting the motion of the image from the input image signal;
Subfield expansion means for expanding the input image signal into a plurality of subfields;
When the person views the input image signal displayed on the second display device from the direction of movement detected by the motion detection means and the light emission pattern of the subfield developed by the subfield development means. , A program for causing a computer to function as a light amount integrating unit that artificially calculates a light amount integrated into the retina and generates an output image signal having the light amount as a pixel value ;
The subfield expansion means expands the input image signal into a plurality of subfields having different light emission amounts for each pixel,
In the second display device, the light amount integrating unit includes the plurality of subfields arranged in the time direction with a direction perpendicular to a display surface on which the input image signal is displayed in the second display device as a time direction. In the display model in which the display of the input image signal is modeled, a region of the target pixel of interest is a cross section, and a region extending in the direction of movement of the target pixel is used as a light amount integration region for integrating the amount of light. In calculating the pixel value of the target pixel by integrating the light amount in the light amount integration region according to the light emission pattern of the subfield,
In the display model, the pixel subfield region is defined as a pixel subfield region in which a region of the pixel on the display surface is a cross section and extends in the time direction by a length corresponding to the light emission amount of the subfield. The pixel subfield region is multiplied by the light emission amount according to the light emission pattern of the subfield corresponding to the pixel subfield region to the occupation ratio that is the ratio occupied by the light amount integration region in the pixel subfield region. For each of the pixel subfield regions, the amount of influence light that affects the pixel value of
Accumulating the influence light amount obtained for all the pixel subfield regions,
A table in which the occupation ratio for each of the plurality of subfields is registered for each motion corresponding to the position of each pixel in the search range for detecting motion, and the search range based on the target pixel The pixel subfield of the relative position of each of the pixels and each subfield is a cross section of the region of the pixel at the relative position and extends in the time direction by a length corresponding to the light emission amount of the subfield Using a table in which the occupation ratio occupied by the light amount integration area in the area is registered, the occupation ratio of each pixel subfield is obtained for the target pixel from the table for the movement of the target pixel.
Program .

Images