JP2011040001A - Image processing apparatus, image processing method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing apparatus, method and a program, which copies image data without deteriorating reproducibility of an image. <P>SOLUTION: The image processing apparatus has: a storage means that stores image data composed of a plurality of groups; a flag saving means that saves a flag corresponding to each of the plurality of groups; and a copy means that copies a part of the image data stored in the storage means into a different storage location. In copying a part of the image data stored in the storage means into the storage location that is away in a horizontal direction by an odd number of pixels, the copy means copies each of the groups, based on the flag corresponding to each of the groups contained in a part of the copied image data. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an image processing apparatus, an image processing method, and a program for copying image data.

  With the development of the network, an environment that can connect to the network everywhere has been established. For this reason, a client server system is practically used in which a server device connected via a network performs processing for operations input to the client device by reducing functions and reducing the weight as much as possible so that the client device can be used everywhere. It ’s becoming a reality.

  In such a client server system, the operation information input to the client device is transmitted to the server device via the network, and the server device receives the operation information and performs processing based on the operation information. Screen image data as a result of the processing is transmitted from the server device to the client device via the network, and the client device outputs this screen image data by a video output device connected to the client device.

  At this time, depending on the data size of the screen image data and the degree of network congestion, there may be a delay between the time when the operation information is input to the client apparatus and the time when the screen reflecting the operation information is output.

  Therefore, in order to reduce this delay, the data size of the screen image data transmitted from the server device to the client device should be as small as possible. Therefore, various methods for reducing the data size of transmitted screen image data have been adopted. For example, a method such as differential transmission is used in which only the portion changed from the previously generated screen image data is transmitted. Furthermore, the data size is reduced by compressing the data to be transmitted.

  In order to reduce the data size, for example, a method of transmitting RGB format data after converting it to YUV422 format data is used in the server device. In the RGB format data, each color of R, G, and B is expressed by 8 bits per pixel, so that a total data size of 8 + 8 + 8 = 24 bits per pixel is required. On the other hand, the data in the YUV422 format separates the color into luminance Y and two color differences U and V, and the luminance Y has one data for each pixel, and the color differences U and V are two in the horizontal direction. One data is prepared for each pixel. Therefore, the data size per pixel is 8 + 4 + 4 = 16 bits. That is, by converting RGB format data into YUV422 format data, the data size is compressed to 16/24 = 2/3 times.

  Thus, for example, in Patent Document 1, RGB format data is converted to YUV format data and then transmitted to the display device. In the display device, YUV format data is converted back to RGB format data and displayed. A method is disclosed. By doing so, it is possible to increase the transfer rate of image data and to realize low power consumption.

JP 2004-361498 A

  In the differential transmission method, in general, when the window portion is moved on the screen as shown in FIG. 1, as shown in FIG. 2, the area on the screen is changed, that is, the window portion before the movement and the window after the movement. The difference data of the area including the part is transmitted from the server device to the client device. However, if the image of the moving window part does not change, it is not necessary to send the difference data for the entire area including the window part before moving and the window part after moving.

  If the image of the window portion does not change, the image of the window portion before movement that is already stored in the client device may be used as the image of the window portion after movement. That is, for the window part after the movement, the image data of the window part before the movement may be copied to the storage position of the window part after the movement on the screen image data stored in the client device. Then, only the difference data of the window part before movement is transmitted from the server device, and the window part before movement is rewritten to this difference data on the screen image data stored in the client apparatus. An image can be generated. As shown in FIG. 3, the screen image after the window portion is moved simply by transmitting the position information before the movement of the window portion, the information about the destination of the window, and the difference data at the position of the window portion before the movement. Data can be generated on the client device side.

  Here, the position information before the movement of the window portion may be a combination of the coordinates of the upper left end point and the coordinates of the lower right end point of the window portion, or the coordinates of the upper left end point and the size of the window portion (the length of the window portion in the horizontal direction). And the length in the vertical direction). That is, it is only necessary to transmit four numerical data as information before the window portion is moved. As the information on the movement destination of the window portion, for example, a vector connecting the coordinates of the upper left end point of the window portion before the movement and the coordinates of the upper left end point of the window portion after the movement, that is, a movement vector may be transmitted. That is, as the information on the movement destination of the window portion, it is only necessary to transmit two numerical data that are coordinate values of the movement vector.

  Therefore, instead of transmitting the difference data at the position of the window portion after movement, it is only necessary to transmit six numerical data, and the data size of the data to be transmitted can be considerably reduced.

  However, when the screen image data stored in the client device is in the YUV422 format, a problem may occur when copying the screen image data. The YUV422 format data includes only one color difference U and V data for two horizontal pixels. For this reason, as shown in FIG. 4, YUV422 format image data forms one group of two horizontal pixels. That is, in FIG. 4, the pixel corresponding to the luminance Y1 is reproduced by the luminance Y1 and the color differences U12 and V12, and the pixel corresponding to the luminance Y2 is reproduced by the luminance Y2 and the color differences U12 and V12. , Y2 and color differences U12 and V12 cannot be reproduced unless they are copied as one group in the arrangement order as shown in FIG. Here, FIG. 4 is a diagram illustrating an example of a state in which a horizontal component having data in the YUV422 format is stored. There are various possible orders for storing the luminance Y and the color differences U and V other than the order shown in FIG.

  Since the data structure is a group of 2 pixels in the horizontal direction, there is no problem when copying the data to a position separated by an even number of pixels in the horizontal direction, but the data is separated by an odd number of pixels in the horizontal direction. Problems occur when copying to a different location. For example, FIG. 5 is a diagram illustrating a case where only one pixel is copied to the right pixel. At this time, in the case of the data structure shown in FIG. 4, as shown in FIG. 5, each piece of data is written in two storage areas. Y3 is written in the location where Y4 was stored, V34 was written in the location where U34 was stored, Y4 was written in the location where Y5 was stored, and U34 was written in the location where V56 was stored.

  When the stored image data is displayed on the screen, the stored image data is read out and converted back to the RGB format, but when copied as shown in FIG. 5, there are two problems when converting to the RGB format. is there. One problem is that the color difference U is stored at a location where the color difference V is to be stored, and the color difference V is stored at a location where the color difference U is to be stored. Another problem is that the color difference U and color difference V belonging to one group are generated based on different pixel information. Therefore, when the copied image data is read out as shown in FIG. 5, the reproduced image becomes an image having a considerably poor reproducibility that is considerably different from the image before the movement.

  FIG. 5 shows a case where the copy area starts with an even number of pixels, that is, a case where the copy area starts with the first pixel of the group. However, as shown in FIG. 6, the copy area may start from an odd number of pixels. At this time, as shown in FIG. 6, the same problem as described above occurs when copying to a position separated by an odd number of pixels. Cases where problems occur are summarized in the following table.

  When copying a copy area starting from an odd pixel to a place separated by an even number of pixels, another problem arises in the end group of the copy area. In this case, for example, it may be rewritten with difference data or the like.

  As described above, when the position information and the movement information of the window part are transmitted and the image data of the window part before movement stored in the YUV422 format is used as the image data of the window part after movement, the horizontal window A problem arises when the movement of the portion is an odd number of pixels.

  However, in Patent Document 1, consideration is given to a method of transmitting the position information and movement information of the window part and using the image data of the window part before movement as the image data of the window part after movement. Not doing.

  SUMMARY An advantage of some aspects of the invention is that it provides an image processing apparatus, an image processing method, and a program for copying image data without impairing image reproducibility.

  In order to solve the above problems, an image processing apparatus according to the present invention includes a storage unit that stores image data including a plurality of groups, a flag storage unit that stores a flag for each of the plurality of groups, and a storage unit. Copy means for copying a part of the stored image data to a different storage position, and the copy means at a storage position separated by an odd number of pixels in the horizontal direction from a part of the image data stored by the storage means. When copying, each group is copied based on a flag for each group included in a part of the image data to be copied.

  The image processing method according to the present invention includes a storage step of storing image data composed of a plurality of groups, a flag storage step of storing a flag for each of the plurality of groups, and the image data stored in the storage step A copy step of copying a portion of the image data to a different storage location, wherein the copy step copies a portion of the image data stored by the storage step to a storage location separated by an odd number of pixels in the horizontal direction. Each group is copied based on a flag for each group included in a part of the image data to be copied.

  The program according to the present invention is stored in the image processing apparatus in storage means for storing image data composed of a plurality of groups, flag storage means for storing a flag for each of the plurality of groups, and the storage means. A copy unit that copies a part of the image data to a different storage position, and the copy unit copies a part of the image data stored by the storage unit to a storage position that is separated by an odd number of pixels in the horizontal direction. Further, each group is copied based on a flag for each group included in a part of the image data to be copied.

  According to the present invention, image data can be copied without impairing image reproducibility.

It is a figure explaining the movement of a window part. It is a figure which shows the area | region of the difference data at the time of the movement of a window part. It is a figure which shows the area | region of the difference data at the time of using a movement vector in the movement of a window part. It is a figure which shows the arrangement order of the horizontal direction of the data of a YUV422 format. It is a figure explaining the process which copies the data of a YUV422 format only to 1 pixel. It is a figure explaining the process which copies the data of a YUV422 format only to 1 pixel. It is a figure which shows the structure of the image processing apparatus which concerns on embodiment of this invention. It is a figure explaining the processing operation in the image processing apparatus which concerns on embodiment of this invention. It is a figure explaining the processing operation in the image processing apparatus which concerns on embodiment of this invention. It is a figure explaining the process in the image processing apparatus which concerns on embodiment of this invention. It is a figure explaining the processing operation in the image processing apparatus which concerns on embodiment of this invention. It is a figure explaining the processing operation in the image processing apparatus which concerns on embodiment of this invention. It is a figure explaining the processing operation in the image processing apparatus which concerns on embodiment of this invention. It is a figure explaining the processing operation in the image processing apparatus which concerns on embodiment of this invention. It is a figure explaining the processing operation in the image processing apparatus which concerns on embodiment of this invention. It is a figure explaining the processing operation in the image processing apparatus which concerns on embodiment of this invention. It is a figure explaining the processing operation in the image processing apparatus which concerns on embodiment of this invention. It is a figure explaining the process in the image processing apparatus which concerns on embodiment of this invention. It is a figure explaining the process in the image processing apparatus which concerns on embodiment of this invention. It is a figure explaining the process in the image processing apparatus which concerns on embodiment of this invention.

  Next, embodiments for carrying out the present invention will be described in detail with reference to the drawings.

  FIG. 7 is a diagram showing the configuration of the image processing apparatus according to the embodiment of the present invention. The controller 1, the frame buffer 2, and the flag memory 3 are configured. It is assumed that the client device in the client server system includes such an image processing device.

  The frame buffer 2 stores image data. That is, the frame buffer 2 functions as a storage unit that stores image data. For example, as shown in FIG. 4, image data in the YUV422 format is stored. In the case of the client device in the client server system, image data transmitted from the server device is stored in the frame buffer 2.

  The control unit 1 executes processing such as copying of image data stored in the frame buffer 2. That is, the control unit 1 functions as a copy unit that copies image data. The flag memory 3 stores a flag to be referred to when the control unit 1 performs image data copy processing. That is, it functions as a flag storage unit that stores a flag. This flag is prepared for each group of two pixels constituting the image data in the YUV422 format stored in the frame buffer 2. When copying the image data in the YUV422 format stored in the frame buffer 2, the control unit 1 checks the flag for the group to be copied, and performs the copy process according to the rule corresponding to the checked flag.

  There are various types of flags stored in the flag memory 3. Here, first, consider the case where there are two types of flags. That is, consider a case where the flag stored in the flag memory 3 is 1 bit. At this time, the flag memory 3 stores a flag indicating 0b or 1b.

  Here, as shown in FIG. 4, the flag for the groups arranged in the correct order is set to 0b.

  Next, a rule corresponding to when the flag stored in the flag memory 3 is 0b is determined. Here, for example, when copying the data of the group whose flag is stored in the flag memory 3 to a position separated by an odd number of pixels, the luminance Y on the left side of the group and the pixel corresponding to the luminance Y are always obtained. The data is copied so that the color differences U and V related to the same group are included.

  FIG. 8 shows a case where a group whose flag is 0b, that is, a group arranged in the correct order, is copied with only one pixel on the right, and FIG. 9 is a group whose flag is 0b, This shows a case where data arranged in the correct order is copied with only one pixel on the left.

  For example, in FIG. 8, the data of groups 1 to 4 whose flag is 0b is copied to the right by only one pixel. At this time, the luminance Y on the left side of each group is copied to the position of the luminance Y on the right side of each group. That is, when copying with only one pixel to the right, the luminance Y on the left side of the group does not change even after copying. Therefore, U and V do not need to be rewritten when copying is performed according to the above rules. That is, as shown in FIG. 7, the color difference V12 is stored at the position of the color difference V12 as it is after copying.

  As shown in FIG. 8, when the data of groups 1 to 4 whose flag is 0b is copied to the right by only one pixel, the data is not in the correct order in groups 1 to 5. However, unlike the case shown in FIG. 5, even after copying, the color difference U is stored in the position where the color difference U should be stored, and the color difference V is stored in the position where the color difference V should be stored, and belongs to one group. Copying is performed so that the color difference U and the color difference V are generated based on the same pixel information. For this reason, two problems that occur when copying as shown in FIG. 5 are solved.

  In the groups 2 to 4 after copying, there remains a problem that the pixels corresponding to the luminance Y on the left side and the pixels related to the color differences U and V are different. However, in the YUV422 format, the luminance Y is the most important when reproducing an image. Regarding the color differences U and V, the color difference U and the color difference V are stored in the respective storage positions, and the color difference U and the color difference V belonging to one group are generated based on the information of the same pixel. If so, it will not be a problem when reproducing the image. For this reason, with respect to groups 2 to 4, the data arrangement order is an arrangement order with high image reproducibility. However, in order to show that the order is not correct, the flags of groups 2 to 4 are rewritten from 0b to 1b.

  In Group 1 and Group 5 corresponding to both ends of the copy area after copying, the order of the luminance Y is not correct, so there is a high possibility that it will be quite different from the original image. Therefore, at both ends of the copy area, for example, difference data for both ends is transmitted from the server device, and rewritten by this difference data. FIG. 10 is a diagram illustrating data when the data of the groups at both ends of the copy area is rewritten with the difference data. At this time, since the rewritten data is arranged in the correct order at both ends of the copy area, the flag is set to 0b.

  In FIG. 9, the data of groups 2 to 5 whose flag is 0b are copied to the left with only one pixel. At this time, the luminance Y3 on the left side of the group 2 is copied to the position of the luminance Y2 on the right side of the group 1. That is, when copying with only one pixel on the left, the group to which the luminance Y on the left side of the group is copied changes. Therefore, when copying is performed according to the above rules, U and V are each copied to the left group.

  Also in FIG. 9, as in FIG. 8, in the copy area, groups other than the groups at both ends have the data arranged in an order of high image reproducibility. Therefore, as in FIG. 8, the flags for the groups other than the groups at both ends in the copy area are rewritten from 0b to 1b. Also in FIG. 9, since the groups at both ends of the copy area are in a data reordering order with poor reproducibility, for example, rewriting with difference data or the like is performed and the flag is left at 0b. To do.

  As shown in FIGS. 8 and 9, copying to a position separated by an odd pixel of 3 or more is performed by copying to a pixel that is only one pixel and then copying to a position separated by an even number of pixels as shown in FIGS. It can be carried out. When copying to a position separated by an even number of pixels, the group is copied as it is, so the data arrangement order in the group does not change before and after copying. Therefore, even when the group having the flag 0b is copied to a position separated by an odd pixel of 3 or more, the groups other than the groups at both ends in the copy area are the same as the groups 2 to 3 in FIGS. In order. Then, the arrangement order of the data of the groups at both ends of the copy area is an arrangement order with poor reproducibility. Therefore, as in FIGS. 8 and 9, the flags for the groups other than the groups at both ends in the copy area are rewritten from 0b to 1b, and the groups at both ends of the copy area are rewritten with, for example, difference data, The flag is set to 0b.

  As shown in FIGS. 8 and 9, the color differences U and V belonging to the group whose flag is rewritten to 1b are color differences related to the pixel corresponding to the luminance Y on the right side. When the group in the arrangement order is copied to a position separated by an odd number of pixels, the luminance Y on the right side of the group is copied to the left side of the group. Therefore, when copying is performed so that the luminance Y on the right side of the group and the color difference related to the pixel corresponding to the luminance Y are in the same group, the order should return to the correct order.

  Therefore, when copying the data of the group whose flag is 1b stored in the flag memory 3 to a position separated by an odd number of pixels, there is always a relationship between the luminance Y on the right side of the group and the pixel corresponding to this luminance Y. The data is copied so that the color differences U and V to be in the same group.

  For example, FIG. 11 shows a case where data in the state of FIG. 9 is copied with only one pixel on the right and a case where data is copied with only one pixel on the left. As shown in FIG. 11, in the copy area, data other than the groups at both ends are arranged in the correct order. In addition, the arrangement order of the data of the groups at both ends of the copy area is an arrangement order with poor reproducibility. Therefore, the flags for the groups other than the groups at both ends in the copy area are rewritten from 1b to 0b, and the groups at both ends of the copy area are rewritten with, for example, difference data, and the flag is set to 0b.

  Copying the data in the state of FIG. 9 to a position separated by an odd pixel of 3 or more is copied to a pixel that is only one pixel as shown in FIG. This can be done by copying to a different location. When copying to a position separated by an even number of pixels, the group is copied as it is, so the data arrangement order in the group does not change before and after copying. Therefore, even when the data in the state of FIG. 9 is copied to a position separated by an odd number of pixels of 3 or more, the data of the groups other than the groups at both ends in the copy area are in the correct order, and both ends of the copy area The arrangement order of the data of the group is an order of poor reproducibility. Therefore, also in this case, the flags for the groups other than the groups at both ends in the copy area are rewritten from 1b to 0b, and the groups at both ends of the copy area are rewritten with, for example, difference data, and the flag is set to 0b. I will decide.

  In this way, two types of flags indicating the arrangement order of groups are prepared. (1) When copying data of a group whose flag is 0b to a position separated by an odd number of pixels, the luminance Y on the left side of the group is always set. And copy the data so that the color differences U and V related to the pixel corresponding to the luminance Y are in the same group, rewrite the flag from 0b to 1b, and (2) change the data of the group whose flag is 1b to odd pixels When copying to a position separated by an amount, the data is always copied so that the luminance Y on the right side of the group and the color differences U and V related to the pixels corresponding to this luminance Y are in the same group, and the flag is set to 1b. By rewriting from 0 to 0b, image data can be copied with high image reproducibility even when data arranged in the correct order is copied to a position separated by an odd number of pixels. It is possible. In addition, if the data arranged in the correct order is copied twice to a position separated by an odd number of pixels, the data returns to the correct order, so that the image quality may deteriorate even if the copy process is repeated several times. Disappear.

  It should be noted that (1) when copying the data of the group whose flag is 0b to a position separated by an odd number of pixels, always the luminance Y on the right side of the group and the color differences U and V related to the pixel corresponding to this luminance Y Are copied so that they become the same group, the flag is rewritten from 0b to 1b, and (2) when copying the data of the group whose flag is 1b to a position separated by an odd number of pixels, always Data may be copied so that the left luminance Y and the color differences U and V related to the pixel corresponding to the luminance Y are in the same group, and the flag may be rewritten from 1b to 0b.

  Next, consider a case where there are three types of flags. That is, consider a case where the flag stored in the flag memory 3 is 2 bits. At this time, for example, a flag indicating 00b, 01b, or 10b may be stored in the flag memory 3.

  Here, as shown in FIG. 4, the flag for the groups arranged in the correct order is set to 00b.

  When copying a group having the flag 00b stored in the flag memory 3 to the right by an odd number of pixels, the difference between the luminance Y on the right side of the group and the pixel corresponding to the luminance Y is always obtained. Data is copied so that U and V are in the same group. For example, FIG. 12 shows a case where data arranged in the correct order is copied with only one pixel on the right. In FIG. 12, as in the case of the two types of flags, the data of the groups other than the groups at both ends in the copy area are arranged in order of good image reproducibility, and the order of the data of the groups at both ends of the copy area is The order is poorly reproducible. However, since data in groups other than the groups at both ends in the copy area are not arranged in the correct order, the flag is rewritten from 00b to 01b. Also, at this time, the groups at both ends of the copy area are rewritten with, for example, difference data, and the flag is left at 00b.

  As shown in FIG. 12, the copy to the position separated by an odd number of pixels of 3 or more on the right is performed after copying to a pixel that is only one pixel on the right, and further to the position separated by an even number of pixels on the right. This can be done by copying. When copying to a position separated by an even number of pixels, the group is copied as it is, so the data arrangement order in the group does not change before and after copying. Therefore, even when a group with the flag 00b is copied to the right by an odd number of pixels of 3 or more, the data in groups other than the groups at both ends in the copy area are arranged in a sequence with good image reproducibility. The arrangement order of the data of the groups at both ends of the copy area is an order of poor reproducibility. Accordingly, as in the case of FIG. 12, the flags of the groups other than the groups at both ends in the copy area are rewritten from 00b to 01b, and the groups at both ends of the copy area are also rewritten with, for example, difference data, etc. And the flag is set to 00b.

  When copying a group in which the flag stored in the flag memory 3 is 00b to a position left by an odd number of pixels to the left, the color difference relating to the luminance Y on the left side of the group and the pixel corresponding to the luminance Y is always obtained. Data is copied so that U and V are in the same group. For example, FIG. 13 shows a case where data arranged in the correct order is copied with only one pixel on the left. In FIG. 13, as in the case of the two types of flags, the data in the groups other than the groups at both ends in the copy area is in an order in which image reproducibility is good, and the data in the groups at both ends in the copy area is The order is poorly reproducible. However, data in groups other than the groups at both ends in the copy area are not arranged in the correct order. Also, the arrangement order of data of groups other than the groups at both ends in the copy area in FIG. 12 is different. Therefore, at this time, the flags of the groups other than the groups at both ends in the copy area are rewritten from 00b to 10b. Also, at this time, the groups at both ends of the copy area are rewritten with, for example, difference data, and the flag is left at 00b.

  As shown in FIG. 13, the copy to the position left by an odd pixel of 3 or more on the left is performed after copying to the pixel that is only one pixel on the left, and further to the position separated by an even pixel on the left. This can be done by copying. When copying to a position separated by an even number of pixels, the group is copied as it is, so the data arrangement order in the group does not change before and after copying. Therefore, even when a group with the flag 00b is copied to the left by a distance of 3 or more odd pixels, the data of the groups other than the groups at both ends in the copy area are arranged in order of good image reproducibility. The arrangement order of the data of the groups at both ends of the copy area is an order of poor reproducibility. Therefore, as in the case of FIG. 13, the flags of the groups other than the groups at both ends in the copy area are rewritten from 00b to 10b, and the groups at both ends of the copy area are also rewritten with, for example, difference data, etc. And the flag is set to 00b.

  As shown in FIG. 12, the color differences U and V belonging to the group whose flag is rewritten to 01b are color differences related to the pixel corresponding to the luminance Y on the left side. When the group in the arrangement order is copied to a position separated by an odd number of pixels, the luminance Y on the left side of the group is copied to the right side of the group. Therefore, if copying is performed so that the luminance Y on the left side of the group and the color difference related to the pixel corresponding to the luminance Y are in the same group, the order should return to the correct order.

  Therefore, when a group having the flag 01b stored in the flag memory 3 is copied to a position separated by an odd number of pixels, the luminance Y on the left side of the group and the color difference related to the pixel corresponding to the luminance Y are always obtained. Data is copied so that U and V are in the same group.

  For example, FIG. 14 shows a case in which a group having a flag of 01b is copied with only one pixel on the right, and FIG. 15 is a group having a flag of 01b with only one pixel on the left. The case where copying was performed is shown. As shown in FIGS. 14 and 15, in the copy area, data other than the groups at both ends are arranged in the correct order. In addition, the arrangement order of the data of the groups at both ends of the copy area is an arrangement order with poor reproducibility. Therefore, the flags for the groups other than the groups at both ends in the copy area are rewritten from 01b to 00b, and the groups at both ends of the copy area are rewritten with, for example, difference data, and the flag is left as 00b. To.

  As shown in FIGS. 14 and 15, copying to a position separated by an odd pixel of 3 or more is performed by copying to a pixel that is only one pixel and then copying to a position separated by an even number of pixels. It can be carried out. When copying to a position separated by an even number of pixels, the group is copied as it is, so the data arrangement order in the group does not change before and after copying. Therefore, even when a group whose flag is 01b is copied to a position separated by an odd number of pixels equal to or greater than 3, the data of the groups other than the groups at both ends in the copy area are in the correct arrangement order, and the groups at both ends of the copy area The data is arranged in a poorly reproducible order. Therefore, as in the case of FIGS. 14 and 15, the flags of the groups other than the groups at both ends in the copy area are rewritten from 01b to 00b. The flag is changed to 00b.

  As shown in FIG. 13, the color differences U and V belonging to the group whose flag is rewritten to 10b are color differences related to the pixel corresponding to the right luminance Y. When the group in the arrangement order is copied to a position separated by an odd number of pixels, the luminance Y on the right side of the group is copied to the left side of the group. Therefore, if copying is performed so that the luminance Y on the right side of the group and the color difference related to the pixel corresponding to the luminance Y are in the same group, the order should return to the correct order.

  Therefore, when a group having the flag 10b stored in the flag memory 3 is copied to a position separated by an odd number of pixels, the luminance Y on the right side of the group and the color difference related to the pixel corresponding to the luminance Y are always obtained. Data is copied so that U and V are in the same group.

  For example, FIG. 16 shows a case in which a group with a flag of 10b is copied to the right with only one pixel, and FIG. 17 shows a group with a flag of 10b to have only one pixel on the left. The case where copying was performed is shown. As shown in FIGS. 16 and 17, in the copy area, data other than the groups at both ends are arranged in the correct order. Also, the arrangement order of the data of the groups at both ends of the copy area is an arrangement order with poor image reproducibility. Therefore, the flags for the groups other than the groups at both ends in the copy area are rewritten from 10b to 00b, and the groups at both ends of the copy area are rewritten with, for example, difference data, and the flag is left as 00b. To.

  As shown in FIGS. 16 and 17, copying to a position separated by an odd pixel of 3 or more is performed by copying to a pixel that is only one pixel and then copying to a position separated by an even number of pixels. It can be carried out. When copying to a position separated by an even number of pixels, the group is copied as it is, so the data arrangement order in the group does not change before and after copying. Therefore, even when a group with the flag 10b is copied to a position separated by an odd number of pixels of 3 or more, the data in the groups other than the groups at both ends in the copy area are in the correct order, and the groups at both ends of the copy area The data is arranged in a poorly reproducible order. Therefore, as in the case of FIGS. 16 and 17, the flags of the groups other than the groups at both ends in the copy area are rewritten from 10b to 00b. The flag is changed to 00b.

  In this way, three types of flags indicating the arrangement order of the groups are prepared. (1) When the flag is 00b, when copying to the right by an odd number of pixels, always copy the luminance on the right side of the group Data is copied so that the color differences U and V related to the pixel corresponding to Y and the luminance Y are in the same group, and the flag is rewritten from 00b to 01b. (2) When the flag is 00b, When copying to a position separated by an odd number of pixels, the data is always copied so that the luminance Y on the left side of the group and the color differences U and V related to the pixels corresponding to the luminance Y are in the same group, and the flag Is changed from 00b to 10b, and (3) when a group whose flag is 01b is copied to a position separated by an odd number of pixels, the luminance Y on the left side of the group always corresponds to this luminance Y. Data is copied so that the color differences U and V related to the pixels are in the same group, the flag is rewritten from 01b to 00b, and (4) the group whose flag is 10b is copied to a position separated by an odd number of pixels. Is always correct by copying the data so that the luminance Y on the right side of the group and the color differences U and V related to the pixel corresponding to this luminance Y are in the same group, and rewriting the flag from 10b to 00b. Even when the data arranged in order is copied to a position separated by an odd number of pixels, the image data can be copied with high image reproducibility. In addition, if the data arranged in the correct order is copied twice to a position separated by an odd number of pixels, the data returns to the correct order, so that the image quality may deteriorate even if the copy process is repeated several times. Disappear.

  (1) When the flag is 00b, when copying to a position separated by an odd number of pixels to the right, the luminance Y on the left side of the group and the color difference U related to the pixel corresponding to this luminance Y are always When data is copied so that V is in the same group, the flag is rewritten from 00b to 01b, and (2) when the flag is 00b, when copying to the left position by an odd number of pixels, always The data is copied so that the luminance Y on the right side of the group and the color differences U and V related to the pixel corresponding to the luminance Y are in the same group, the flag is rewritten from 00b to 10b, and (3) the flag is 01b When copying a group to a position separated by an odd number of pixels, the luminance Y on the right side of the group and the color differences U and V related to the pixel corresponding to the luminance Y are always in the same group. When the data is copied, the flag is rewritten from 01b to 00b, and (4) when the group whose flag is 10b is copied to a position separated by an odd number of pixels, always the luminance Y on the left side of the group and this luminance Y The data may be copied so that the color differences U and V related to the pixels corresponding to 1 are in the same group, and the flag may be rewritten from 10b to 00b.

  As described above, when copying is performed to a position separated by an odd number of pixels, the arrangement order of the data of the groups at both ends of the copy area becomes an arrangement order with poor image reproducibility. Therefore, it is preferable that the data is arranged in the copy area so that there is no end group as much as possible. That is, it is preferable that the groups having the same flag are distributed as continuously as possible. Therefore, when a group whose flag is not 0b or 00b, that is, a group whose data is not in the correct order, is rewritten with another image data, the following is performed.

  For example, as shown in FIG. 18, it is assumed that the flags of groups 1, 2, 3, 4, and 5 are 1b. At this time, the data of the groups 3 and 4 in FIG. 18 are replaced with the difference data corresponding to the groups 3, 4 and 5 as shown in FIG. At this time, as shown in FIG. 20, the difference data is replaced after being arranged in the order corresponding to the flag 1b.

  As described above, when the difference data is written in the corresponding groups 3, 4, and 5 without being rearranged, the flag changes from 1 b to 0 b between the group 2 and the group 3. At this time, when the area including the groups 1 to 5 is copied to a position separated by an odd number of pixels, the groups 2 and 3 are also arranged in a poorly reproducible order as in the end of the copy area. However, by doing the above, the group with the same flag can be replaced with new differential data while continuing as much as possible, and the group that becomes the end of the copy area that causes a problem when copying Can be prevented.

(Below this is the version of the figure in parentheses in Figure 20 as the figure in Figure 20.)
As described above, when copying is performed to a position separated by an odd number of pixels, the arrangement order of the data of the groups at both ends of the copy area becomes an arrangement order with poor image reproducibility. Therefore, it is preferable that the data is arranged in the copy area so that there is no end group as much as possible. That is, it is preferable that the groups having the same flag are distributed as continuously as possible. Therefore, when a group whose flag is not 0b or 00b, that is, a group whose data is not in the correct order, is rewritten with another image data, the following is performed.

  For example, as shown in FIG. 18, it is assumed that the flags of groups 1, 2, 3, 4, and 5 are 1b. At this time, the data of groups 2, 3, 4, and 5 in FIG. 18 are replaced with difference data corresponding to groups 3, 4, and 5 as shown in FIG. At this time, as shown in FIG. 20, the difference data is replaced after being arranged in the order corresponding to the flag 1b.

As described above, when the difference data is written in the corresponding groups 3, 4, and 5 without being rearranged, the flag changes from 1 b to 0 b between the group 2 and the group 3. At this time, when the area including the groups 1 to 5 is copied to a position separated by an odd number of pixels, the groups 2 and 3 are also arranged in a poorly reproducible order as in the end of the copy area. However, by doing the above, the group with the same flag can be replaced with new differential data while continuing as much as possible, and the group that becomes the end of the copy area that causes a problem when copying Can be prevented.
(This is the end of the version shown in the parenthesis in Fig. 20 as the diagram in Fig. 20.)

  The present invention has been described above by the preferred embodiments of the present invention. While the invention has been described with reference to specific embodiments thereof, various modifications and changes can be made to these embodiments without departing from the broader spirit and scope of the invention as defined in the claims. is there.

  For example, the processing operation in the above-described embodiment can be executed by hardware, software, or a combined configuration of both.

  When processing by software is executed, the program is loaded from a ROM (Read Only Memory) storing a program recording a processing sequence to a memory (RAM) in a computer incorporated in dedicated hardware. The program can be read and executed, or the program can be installed and executed on a general-purpose computer capable of executing various processes.

  For example, the program can be recorded in advance on a hard disk or ROM as a recording medium. Alternatively, the program is stored on a removable recording medium such as a magnetic disk such as a floppy (registered trademark) disk, an optical disk such as a CD (Compact Disc) or DVD (Digital Versatile Disc), or a magneto-optical disk such as an MO (Magneto Optical) disk. It is possible to store (record) temporarily or permanently.

  Such a removable recording medium can be provided as so-called package software.

  The program is installed on the computer from the above-described removable recording medium, transferred wirelessly from the download site to the computer, or transferred to the computer via a network such as a LAN (Local Area Network) or the Internet. On the other hand, the computer can receive the transferred program and install it on a recording medium such as a built-in hard disk.

  In addition to being executed in time series in accordance with the processing operations described in the above embodiment, the processing capability of the apparatus that executes the processing, or a configuration to execute in parallel or individually as necessary Is also possible.

  In the image processing apparatus according to the present invention, the flag stored by the flag storage unit may include two types of flag states, a first flag state and a second flag state.

  In the image processing apparatus according to the present invention, the image data stored by the storage means is data in the YUV422 format, and each of the plurality of groups includes two pixels related to the respective color differences U and V. When the copy means copies a part of the image data stored by the storage means to a storage position separated by an odd number of pixels in the horizontal direction, the flag for the group included in the part of the image data to be copied is In the first flag state, copying is performed so that the luminance Y on the left side of the group and the color differences U and V related to the pixels corresponding to the luminance Y are in the same group, and the luminance Y belongs after the copying A group included in a part of the image data to be copied by rewriting the flag for the group to the second flag state When the corresponding flag is in the second flag state, copying is performed so that the luminance Y on the right side of the group and the color differences U and V related to the pixels corresponding to the luminance Y are in the same group, and after the copying, The flag for the group to which the luminance Y belongs may be rewritten to the first flag state.

  In the image processing apparatus according to the present invention, the flag stored by the flag storage unit may include three types of flag states: a first flag state, a second flag state, and a third flag state. Also good.

  In the image processing apparatus according to the present invention, the image data is data in the YUV422 format, each of the plurality of groups is configured by two pixels related to the respective color differences U and V, and the copying unit includes: When a part of the image data stored by the storage means is copied to the storage position separated by an odd number of pixels in the horizontal direction to the right, a flag for the group included in the part of the image data to be copied is the first flag. In the state, copying is performed so that the luminance Y on the right side of the group and the color differences U and V related to the pixels corresponding to the luminance Y are in the same group, and a flag for the group to which the luminance Y belongs after the copying. The flag for a group included in a part of the image data to be copied is changed to the second flag state. When the flag state is 2, copying is performed so that the luminance Y on the left side of the group and the color differences U and V related to the pixels corresponding to the luminance Y are the same group, and the group to which the luminance Y belongs after the copying When the flag for the group included in a part of the image data to be copied is in the third flag state, the flag Y on the right side of the group corresponds to the luminance Y and the luminance Y. Copying is performed so that the color differences U and V related to the pixels to be included are in the same group, and after the copying, the flag for the group to which the luminance Y belongs is rewritten to the first flag state, and the image data stored by the storage means When copying a part of the image data to the storage position left by an odd number of pixels in the horizontal direction, When the flag for the group to be turned is in the first flag state, copying is performed so that the luminance Y on the left side of the group and the color differences U and V related to the pixels corresponding to the luminance Y are in the same group, After copying, the flag for the group to which the luminance Y belongs is rewritten to the third flag state, and when the flag for the group included in a part of the image data to be copied is the second flag state, Copying is performed so that the luminance difference Y and the color differences U and V related to the pixels corresponding to the luminance Y are in the same group, and after the copying, the flag for the group to which the luminance Y belongs is rewritten to the first flag state, When the flag for the group included in a part of the image data to be copied is in the third flag state, the group Copying is performed so that the color difference U and V related to the pixel corresponding to the luminance Y are in the same group, and the flag for the group to which the luminance Y belongs is set to the first flag state after the copying. You may make it rewrite to.

  In the image processing apparatus according to the present invention, the copy unit copies a part of the image data stored by the storage unit to a storage position separated by an odd number of pixels in the horizontal direction, and then horizontally copies the copied image data. Data in the end group in the direction may be rewritten with data arranged in the order corresponding to the first flag state.

  In the image processing apparatus according to the present invention, when the copy unit rewrites a part of the image data stored in the storage unit with new image data, the part of the image data has the same flag flag state. May be rewritten so that the new image data is arranged in the order corresponding to the flag state.

1 Control unit 2 Frame buffer 3 Flag memory

Claims (9)

Storage means for storing image data composed of a plurality of groups;
Flag storage means for storing a flag for each of the plurality of groups;
Copy means for copying a part of the image data stored in the storage means to a different storage position;
The copy means, when copying a part of the image data stored by the storage means to a storage position separated by an odd number of pixels in the horizontal direction, based on a flag for each group included in the part of the image data to be copied. An image processing apparatus for copying each of the groups.   The image processing apparatus according to claim 1, wherein the flag stored by the flag storage unit includes two types of flag states, a first flag state and a second flag state. The image data stored by the storage means is YUV422 format data,
Each of the plurality of groups includes two pixels related to the respective color differences U and V,
When the copy means copies a part of the image data stored by the storage means to a storage position separated by an odd number of pixels in the horizontal direction, a flag for the group included in the part of the image data to be copied is When the flag state is 1, copying is performed so that the luminance Y on the left side of the group and the color differences U and V related to the pixels corresponding to the luminance Y are the same group, and the group to which the luminance Y belongs after the copying When the flag for the group included in a part of the image data to be copied is in the second flag state, the flag Y on the right side of the group corresponds to the luminance Y and the luminance Y. Copying is performed so that the color differences U and V related to the pixels to be grouped are in the same group, and after the copying, the group to which the luminance Y belongs The image processing apparatus according to claim 2, wherein the rewriting in the first flag state flag for.   2. The image processing according to claim 1, wherein the flag stored by the flag storage means includes three types of flag states: a first flag state, a second flag state, and a third flag state. apparatus. The image data is YUV422 format data,
Each of the plurality of groups includes two pixels related to the respective color differences U and V,
The copying means includes
When a part of the image data stored by the storage means is copied to the storage position separated by an odd number of pixels in the horizontal direction to the right, a flag for the group included in the part of the image data to be copied is the first flag. In the state, copying is performed so that the luminance Y on the right side of the group and the color differences U and V related to the pixels corresponding to the luminance Y are in the same group, and a flag for the group to which the luminance Y belongs is copied after the copying. When the flag for a group included in a part of the copied image data is rewritten to the second flag state and the flag corresponding to the luminance Y on the left side of the group is set to the pixel corresponding to the luminance Y. Copying is performed so that the related color differences U and V are in the same group, and after the copying, the flag for the group to which the luminance Y belongs is copied. To the first flag state, and when the flag for the group included in a part of the image data to be copied is the third flag state, the right side luminance Y of the group and the pixel corresponding to the luminance Y Are copied so that the color differences U and V related to the same group become the same group, and after the copying, the flag for the group to which the luminance Y belongs is rewritten to the first flag state,
When a part of the image data stored by the storage means is copied to the storage position left by an odd number of pixels in the horizontal direction to the left, a flag for a group included in the part of the image data to be copied is the first flag. In the state, copying is performed so that the luminance Y on the left side of the group and the color differences U and V related to the pixels corresponding to the luminance Y are in the same group, and after the copying, a flag for the group to which the luminance Y belongs is set. When the flag for the group included in a part of the copied image data is rewritten to the third flag state and the second flag state, the luminance Y on the left side of the group and the pixel corresponding to the luminance Y are set. Copying is performed so that the related color differences U and V are in the same group, and the flag for the group to which the luminance Y belongs is copied after the copying. To the first flag state, and when the flag for the group included in a part of the image data to be copied is the third flag state, the right side luminance Y of the group and the pixel corresponding to the luminance Y 5. The image according to claim 4, wherein copying is performed so that the color differences U and V relating to the same group are in the same group, and the flag for the group to which the luminance Y belongs is rewritten to the first flag state after the copying. Processing equipment.   The copy means copies a part of the image data stored by the storage means to a storage position separated by an odd number of pixels in the horizontal direction, and then transfers the data of the end group in the horizontal direction of the copied image data to the first position. 6. The image processing apparatus according to claim 2, wherein the image processing apparatus is rewritten with data arranged in an arrangement order corresponding to one flag state.   When the copy means rewrites a part of the image data stored by the storage means with new image data, if the part of the image data is a part of an area having the same flag flag state, the copy means The image processing apparatus according to any one of claims 1 to 6, wherein the image data is rewritten so as to be in an arrangement order corresponding to the flag state. A storing step for storing image data composed of a plurality of groups;
A flag storing step for storing a flag for each of the plurality of groups;
A copy step of copying a portion of the image data stored in the storage step to a different storage location;
The copy step is based on a flag for each group included in a part of the image data to be copied when copying a part of the image data stored in the storage step to a storage position separated by an odd number of pixels in the horizontal direction. And an image processing method for copying each of the groups. The image processing device
Storage means for storing image data composed of a plurality of groups;
Flag storage means for storing a flag for each of the plurality of groups;
Function as copy means for copying a portion of the image data stored in the storage means to a different storage location;
The copy means, when copying a part of the image data stored by the storage means to a storage position separated by an odd number of pixels in the horizontal direction, based on a flag for each group included in the part of the image data to be copied. A program for copying each group.

Images