JP2012220674A - Image processing device, image processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To substantially reduce an instantaneous change in brightness that possibly causes discomfort.SOLUTION: A multiple speed part 104 multiplies image data by N (where N is a natural number). A black insertion zone determination part 103 determines a black image zone being a zone for displaying a black image and an original image zone being a zone for displaying the image data for plural sub-frames generated by the multiple speed part 104. A QR code-inserting coordinate position calculation part 102 calculates an inserting-position of code information in the plural sub-frames. A black image zone QR code insertion part 107 inserts the code information into the inserting-position in the black image zone.

Description

  The present invention relates to a technique for generating an image in which code information is inserted.

  In recent years, the size of the display has been increased, and as an electronic advertisement, a display is often installed at a high position such as the second floor or the rooftop that is easily noticed by many people. When QR codes are displayed on these electronic advertisements, in order to read the codes with a portable camera having a short focal length, it is necessary to display a large code size, and there is a problem that an advertisement display area is reduced. On the other hand, in Patent Document 1, for example, a QR code is displayed on the entire screen at a rate of one frame every several tens of frames, thereby making it difficult for the viewer to recognize the code with the naked eye. It is disclosed. Thereby, it is possible to increase the QR code display area without affecting the advertisement display area.

JP 2006-128900 A

  However, the technique disclosed in Patent Document 1 has a problem that when a QR code is displayed in one frame on the entire screen, an instantaneous change (flickering) in screen brightness is visually recognized, giving the viewer a sense of discomfort.

  Therefore, an object of the present invention is to greatly reduce an instantaneous luminance change that gives a sense of incongruity.

  An image processing apparatus according to the present invention includes N-times speed means for N-times speed (N: natural number) of image data, and a black image area that is an area for displaying a black image in a plurality of subframes generated by the N-times speed means. Determining means for determining an original image area that is an area for displaying the image data; calculating means for calculating an insertion position of code information in the plurality of subframes; and code information at the insertion position in the black image area. It has the 1st insertion means to insert, It is characterized by the above-mentioned.

  According to the present invention, it is possible to greatly reduce an instantaneous luminance change that gives a sense of incongruity.

1 is a diagram illustrating a configuration of an image processing apparatus according to a first embodiment of the present invention. It is a figure for demonstrating the QR code display method at the time of inserting a black image in a full screen. It is a figure for demonstrating the process which divides | segments a black image insertion area | region into several frames. It is a figure for demonstrating the process by the side of the liquid crystal display which displays a QR code, and the process by the side of the portable camera which images it when a black image area | region is divided | segmented vertically between sub-frames. It is a flowchart which shows the process of the image processing apparatus which concerns on the 1st Embodiment of this invention. It is a figure which shows the structure of the image processing apparatus which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows the process of the image processing apparatus which concerns on the 2nd Embodiment of this invention.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments to which the invention is applied will be described in detail with reference to the accompanying drawings.

  First, a first embodiment of the present invention will be described. FIG. 1 is a diagram showing a configuration of an image processing apparatus according to the first embodiment of the present invention. In FIG. 1, reference numeral 101 denotes a QR code generation unit. Reference numeral 102 denotes a QR code insertion coordinate position calculation unit. Reference numeral 103 denotes a black insertion area determination unit. Reference numeral 104 denotes a double speed portion. Reference numeral 105 denotes a black insertion portion. Reference numeral 106 denotes an original image area offset adjustment unit. Reference numeral 107 denotes a black image region QR code insertion unit. Reference numeral 108 denotes a black image region QR code saturation amount adjustment unit.

  The QR code generation unit 101 generates a QR code from data (hereinafter referred to as content information) that is a source of encoding input from the outside. Note that the present invention can be applied not only to the QR code but also to geometrical code information. The black insertion area determination unit 103 determines an area into which a black image is inserted (hereinafter referred to as a black image insertion area). The QR code insertion coordinate position calculation unit 102 calculates coordinate information (hereinafter referred to as a QR code insertion coordinate position) indicating the QR code insertion position from the QR code and the black image insertion area. The double speed unit 104 doubles the 60 Hz input image data to 120 Hz. The black insertion unit 105 inserts a black image into the black image insertion region determined by the black insertion region determination unit 103. Hereinafter, the area in which the black image is inserted is referred to as a black image area. In addition, although the double speed part 104 in this embodiment is converting into 2 times speed, it is not restricted to this, This invention is applicable when converting into N times speed (N: natural number).

  The original image area offset adjustment unit 106 performs offset adjustment on the pixel at the QR code insertion coordinate position in the original image area. At that time, when the original image area offset adjustment unit 106 integrates the luminance of the pixel value of the QR code insertion coordinate position in the original image area and the pixel value of the QR code in the black image area, the viewer selects the original image. Adjust the offset so that you can see correctly. The black image region QR code insertion unit 107 and the black image region QR code saturation amount adjustment unit 108 draw a QR code in the black image region and output it as output image data. Note that the black image region QR code insertion unit 107 is an application example of the first insertion unit, and the original image region offset adjustment unit 106 is an application example of the second insertion unit.

  Hereinafter, a QR code display method when a black image is inserted in the entire screen will be described with reference to FIG. Reference numerals 201 and 202 in FIG. 2A denote the first and second frames of 60 Hz input image data. The double speed unit 104 performs double speed processing on 60 Hz input image data, and generates 120 Hz sub-frames 203 to 206 shown in FIG. That is, a first subframe 203 and a second subframe 204 are generated from the first frame 201, and a first subframe 205 and a second subframe 206 are generated from the second frame 202. The black insertion unit 105 inserts a black image into the black image insertion region determined by the black insertion region determination unit 103 for each of the subframes 203 to 206. Here, the second subframes 204 and 206 are processed to insert black over the entire surface. As a result, full-black subframes as shown by 207 and 208 in FIG. 2C are generated.

  FIG. 2D shows an example in which a QR code is inserted in the black image area. The black region QR code insertion unit 107 converts the pixel value at the QR code insertion coordinate position calculated by the QR code insertion coordinate position calculation unit 102 in FIG. Replace with. As a result, as shown at 209 and 210 in FIG. 2D, a QR code with a gray background is drawn in the black image region. In this embodiment, the half value of the dynamic range is set to gray and used as the pixel value of the background portion of the QR code. However, it is not necessary to set the value as described above, and encoding is performed on the portable camera side that is the imaging device. Any value is possible as long as possible. The QR code to be inserted is desirably large as long as it can be displayed in the black image area. As a result, the QR code is greatly displayed on the screen at a rate of one frame per two frames. Therefore, when the QR code displayed on the liquid crystal display is imaged by the portable camera, it is possible to secure the shooting distance and increase the sampling frequency of the frame on which the QR code is displayed.

However, when the display shown in FIG. 2D is visually recognized with an integrated luminance of 120 Hz, the QR code portion appears to float brightly. In other words, the pixel value visually recognized by humans is divided into two types of values as shown in Equations 1 and 2.
QR code display partial integrated luminance value = (pixel value of input image data + pixel value of QR code) / 2
Integral luminance value other than QR code display portion = (pixel value of input image data + 0) / 2 Equation 2

  Equation 1 shows the integrated luminance value in the QR code display portion. Since the input image data and the gray QR code are alternately displayed in the QR code display part, the integrated luminance value to be visually recognized is an average value of the pixel value of the input image data and the pixel value of the gray QR code. Become. Equation 2 shows the integrated luminance value of the part other than the QR code display part. Since the input image data and the black image are alternately displayed in the portion other than the QR code display portion, the integrated luminance value to be viewed is an average value of the pixel value of the input image data and the pixel value of the black image. .

As is clear from the comparison between Expression 1 and Expression 2, since Expression 1 has a brighter value than Expression 2, there is a problem that the QR code portion is brightly floated and visually recognized. In order to deal with this problem, as indicated by 211 and 212 in FIG. 2 (e), the pixels of the original image area corresponding to the QR code display part of the black image area are not covered Offset adjustment is performed so as to be equal to the integrated luminance value. Specifically, the original image area offset adjustment unit 106 performs offset adjustment by subtracting the pixel value of the QR code from the pixel value of the input image data corresponding to the QR code insertion coordinate position. This offset adjustment processing is shown in Equation 3.
Integrated luminance value of QR code display portion after offset adjustment = [(pixel value of input image data−pixel value of QR code) + pixel value of QR code] / 2

Thus, the integrated luminance value of the QR code display portion is an equation equivalent to the integrated luminance value in the portion other than the QR code display portion shown in Equation 2. However, in Expression 3, when the pixel value of the input image data is smaller than the pixel value of the QR code, the value calculated by the original image area offset adjustment unit 106 is negative, the pixel value is clipped to 0, and the minus value The value will be lost. Here, the black image region QR code saturation amount adjusting unit 108 adjusts the negative saturation amount with respect to the QR code when the QR code is inserted by the black image region QR code insertion unit 107. Specifically, the black image region QR code saturation amount adjustment unit 108 is based on the second subframe 204 output from the double speed unit 104 and the QR code insertion coordinate position calculated by the QR code insertion coordinate position calculation unit 102. The negative saturation amount generated in the first subframe 211 is calculated. The black image region QR code insertion unit 107 inserts a value obtained by subtracting the saturation amount from the QR code pixel value as a QR code pixel value. The black image region QR code saturation amount adjustment unit 108 performs this process only when it is determined that a minus has occurred in the first subframe. The QR code pixel value calculated by the above processing is shown in Equation 4.
QR code pixel value after saturation amount adjustment = QR pixel value + (Pixel value of input image data−Pixel value of QR code) = Pixel value of input image data Equation 4

When a negative saturation amount is generated by the offset adjustment of the first subframe, the pixel value displayed in the QR code display portion of the original image area of the first subframe is 0, so that the QR when the negative saturation amount is generated is displayed. The integrated luminance value of the code display portion is expressed by Equation 5.
Integral luminance value in QR code display portion when negative saturation amount after offset adjustment occurs = (0 + pixel value of input image data) / 2.

  As a result, the integral luminance value in the QR code display portion becomes an equation equivalent to the integral luminance value of the portion other than the QR code display portion shown in Equation 2 even when a negative saturation amount occurs, and the QR code display portion is brightly visible. The input image data can be displayed without being displayed.

  FIG. 3 is a diagram for explaining a process of dividing a black image area for one frame into a plurality of subframes. Reference numerals 301 and 302 shown in FIG. 3A are the first and second frames of 60 Hz input image data. The double speed unit 104 performs double speed processing on 60 Hz input image data, and generates 120 Hz sub-frames 303 to 306 shown in FIG. The black insertion unit 105 inserts a black image into the black image insertion region determined by the black insertion region determination unit 103 in FIG. 1 for each of the subframes 303 to 306. As shown in FIG. 3C, the black image insertion area in the present embodiment is an area obtained by vertically dividing the black image between subframes. In the first subframes 307 and 309, a black image is inserted in the left half of the screen, and in the second subframes 308 and 310, a black image is inserted in the right half of the screen.

  The black image area QR code insertion unit 107 inserts a QR code into the black image area as indicated by reference numeral 311 in FIG. The original image area offset adjustment unit 106 offsets the QR code to the original image area as indicated by 312 in FIG. Thus, two QR codes in the black image area and two offset QR codes in the original image area are arranged vertically. The QR code insertion method and offset adjustment are the same as those described with reference to FIG. As a result, the QR code is displayed on all frames displayed on the liquid crystal display, and the QR code is always displayed even on the screen during the frame update during the line sequential scanning of the liquid crystal display.

  Here, the processing described above will be described in detail with reference to FIG. FIG. 4 is a diagram for explaining the processing on the liquid crystal display side for displaying the QR code and the processing on the portable camera side for capturing the image when the black image region is divided vertically between the subframes as described above. FIG. Reference numerals 401 to 408 denote liquid crystal displays that display QR codes by this method. The frame rate is 120 Hz. Reference numerals 409, 414, and 419 denote sampling timings of the portable camera. Since the frame rate of the liquid crystal display and the frame rate of the portable camera are asynchronous, the above three types of phase states are described as an example. The frame rate of the portable camera is 30 Hz. Note that the shutter speed needs to be sufficiently faster than the frame rate in a line sequential scan hold type display such as a liquid crystal display. In the case of an impulse type display such as plasma, in order to capture impulse light emission, the shutter speed must be faster than the frame rate and somewhat slower.

  In the phase state of 409, the portable camera images the display screen of the liquid crystal display at the timings indicated by 410 and 411. The captured image data is image data in which a QR code is displayed on the left half indicated by 412, and the QR code is normally extracted as indicated by 413. In the phase state of 414, the portable camera images the display screen of the liquid crystal display at the timings indicated by 415 and 416. The captured image data is image data in which a QR code is displayed on the right half indicated by 417, and the QR code is normally extracted as indicated by 418. In the phase state 419, the portable camera images the display screen of the liquid crystal display at the timings indicated by 420 and 421. The screen imaged at this timing is a screen in which the frame is being updated on the liquid crystal display as indicated by 422, but the QR code is normally extracted as indicated by 423.

  The image data captured at the timing 420 is image data being updated from the 424 frame to the 425 frame. If the imaging timing is the first update, the image data updated to the middle of the upper half of the screen is captured as shown in the frame 426, and the QR code displayed at the lower left can be extracted. If the imaging timing is almost in the middle of the update, the image data updated up to the center of the screen is captured as indicated by the frame 427, and the lower left and upper right QR codes can be extracted. If the imaging timing is the last one of the update, as shown in the frame 428, the image data updated to the middle of the lower half of the screen is captured, and the QR code displayed on the upper right can be extracted.

  As described above, the black image area is divided between subframes, and QR codes are inserted in two vertically, so that QR codes are displayed in all frames, and frames are being updated during line sequential scanning of the liquid crystal display. In this screen, the QR code is always displayed. As a result, the portable camera can take an image of the screen on which the QR code is drawn, regardless of which frame or line is being updated, so that the time until the QR code is acquired can be greatly reduced. In addition, although the case where QR code is inserted in two vertical lengths is taken as an example here, the number of QR codes inserted in the vertical direction may be any number.

  FIG. 5 is a flowchart showing processing of the image processing apparatus according to the first embodiment. Hereinafter, the processing of the image processing apparatus according to the first embodiment will be described with reference to FIG.

  In step S101, the black insertion region determination unit 103 determines a black image insertion region. Here, the black image insertion region may be determined so that the black image is inserted over the entire second subframe, or the black image may be inserted divided into each subframe. In step S102, the QR code generation unit 101 generates a QR code from content information input from the outside. In step S103, the QR code insertion coordinate position calculation unit 102 calculates a QR code insertion coordinate position based on the black image insertion area and the QR code. In step S104, the double-speed unit 104 performs double-speed processing on 60 Hz input image data to generate a 120-Hz subframe. In the present embodiment, the double speed is used. However, any double speed, that is, N double speed (N is an arbitrary integer) may be used.

  In step S105, the image processing apparatus determines whether or not the pixel of the input image data currently being processed is a pixel in the black image insertion area determined in step S101. If the pixel of the input image data currently being processed is a pixel in the black image insertion area, the process proceeds to step S106. On the other hand, if the pixel of the input image data is not a pixel in the black image insertion area, the process proceeds to step S110.

  In step S106, the image processing apparatus determines whether or not the pixel of the input image data currently being processed is the pixel at the QR code insertion coordinate position calculated in step S103. If the pixel of the input image data currently being processed is a pixel at the QR code insertion coordinate position, the process proceeds to step S107. On the other hand, if the pixel of the input image data currently being processed is not a pixel at the QR code insertion coordinate position, the process proceeds to step S109.

  In step S107, the black image region QR code saturation adjustment unit 108 obtains a difference between the pixel value of the input image data currently being handled and the pixel value of the QR code. As a result, when the difference is negative, that is, underflow occurs, the black image region QR code saturation amount adjustment unit 108 calculates the absolute value of the difference as the saturation amount. When no underflow occurs, the saturation amount is zero. In step S108, the black image region QR code insertion unit 107 subtracts the saturation amount calculated in step S107 from the pixel value of the QR code, and outputs the current pixel to be processed as a QR code pixel. In step S109, the black insertion unit 105 outputs the currently processed pixel as black.

  In step S110, the image processing apparatus determines whether or not the pixel of the input image data currently being processed is the pixel at the QR code insertion coordinate position calculated in step S103. If the pixel of the input image data currently being processed is a pixel at the QR code insertion coordinate position, the process proceeds to step S111. On the other hand, if the pixel of the input image data currently being processed is not a pixel at the QR code insertion coordinate position, the process proceeds to step S113. Note that when the pixel of the input image data currently being processed is a pixel at the QR code insertion coordinate position, the pixel to be processed is a QR code offset adjustment pixel in the original image area.

  In step S111, the original image area offset adjustment unit 106 calculates a value obtained by subtracting the pixel value of the QR code from the pixel value of the input image data currently being processed as the pixel value of the output image data. In step S115, the original image area offset adjustment unit 106 determines whether an underflow has occurred. If an underflow has occurred, the process proceeds to step S112. On the other hand, if underflow has not occurred, the process skips step S112.

  In step S112, the original image area offset adjustment unit 106 clips the pixel value to zero. In step S113, the image processing apparatus outputs the pixel value of the input image data currently being processed as the pixel value of the output image data. In step S114, the image processing apparatus determines whether or not processing for one frame (two subframes) has been completed. When the process for one frame is completed, the process returns to step S104. On the other hand, if the processing for one frame has not been completed, the processing returns to step S105.

  As described above, in the present embodiment, since the QR code is inserted into the black image area and displayed for each frame, it is possible to greatly reduce an instantaneous luminance change that gives a sense of incongruity. Furthermore, since the QR code is not visually recognized by the human eye by utilizing the integrated luminance visual effect, it is possible to increase the code area without worrying about the advertisement area.

  By the way, when displaying a screen in which only one frame includes a QR code in several tens of frames, there is a problem that acquisition on the portable camera side is difficult for the following reason. First, when the frame rate of the display and the frame rate of the portable camera are compared, generally the frame rate of the display is often higher. From this, for example, when a 60 Hz display screen is captured with a 30 Hz portable camera, a frame in which a QR code is not displayed may be captured. In recent years, taking into account the trend toward higher frame rates (120 Hz and 240 Hz) of displays, it can be said that it is more difficult to capture QR codes. Furthermore, in the case of a liquid crystal display, the video signal is updated on a line-by-line basis by line-sequential scanning, so even if a frame displaying a QR code can be captured, the frame is often being updated and the QR code is normal. It is difficult to capture images. For the above reason, it can be said that the QR code acquisition success rate is never high.

  In such a case, even if imaging is attempted again, if the QR code is displayed only at a rate of one frame per several tens of frames, it is estimated that it takes a long time to correctly capture the QR code. For example, when a QR code is displayed for only one frame per second on the liquid crystal display side, once QR code imaging fails, the timing at which the QR code can be captured next is one second later. As described above, considering that the QR code acquisition success rate is not high, many retries occur until the QR code can be imaged, and as a result, it takes a lot of time.

  On the other hand, in the present embodiment, by dividing and displaying the black area, it is possible to give the QR code to all the frames, and it is possible to display the QR code even when the frame is being updated in the line sequential scanning. . Therefore, according to the present embodiment, the QR code acquisition success rate on the portable camera side is greatly increased. Therefore, the QR code display area can be increased without reducing the advertisement display area, and the code can be easily acquired on the portable camera side.

  Next, a second embodiment of the present invention will be described. In the first embodiment, when the saturation amount generated in the original image area is subtracted from the pixel value of the QR code, the pixel value of the QR code approaches black and the encoding process cannot be normally performed on the portable camera side. The case happens. The second embodiment has a configuration that can cope with such a case.

  FIG. 6 is a diagram showing a configuration of an image processing apparatus according to the second embodiment of the present invention. In FIG. 6, reference numerals 101 to 108 are the same as the same reference numerals in FIG. Reference numeral 601 denotes an intra-frame high-luminance display area search unit. Reference numeral 602 denotes a QR code display area loss rate calculation unit. Reference numeral 603 denotes an in-content analysis result determination unit. Reference numeral 604 denotes a content analysis / determination result storage unit. Reference numeral 605 denotes a gamma adjustment unit.

  First, input image data is input to the gamma adjustment unit 605. At the time of initial content reproduction, the gamma adjustment unit 605 does not perform gamma adjustment and passes the input image data as it is to the subsequent block. As will be described later, the gamma adjustment unit 605 is used to increase the brightness of the entire screen only when it is determined that the QR code is difficult to encode on the portable camera side after the content reproduction ends. The intra-frame high-intensity display area search unit 601 searches for a display area in which one or more pixels having a pixel value greater than or equal to a predetermined value are present in a frame. That is, the intra-frame high-intensity display area search unit 601 has a frequency of the saturation amount adjustment occurring in the display area where the underflow occurs less frequently when the offset adjustment is performed in the original image area, that is, in the black image area. Search for a small display area. For example, when black patterns are concentrated on the edge of the input image data, the display area from the center of the screen is searched. The intra-frame high-intensity display area search unit 601 uses the maximum size QR code vertex coordinates (hereinafter referred to as QR code vertex coordinates) that can be displayed in a display area where the amount of saturation adjustment is small, or the display area. The QR code vertex coordinates of the maximum size that can be displayed are output.

  The QR code display area loss rate calculation unit 602 corrects the position of the saturation in the QR code display area indicated by the QR code vertex coordinates and the amount of saturation when the QR code is drawn correctly on the portable camera side. Find the percentage of unencoded areas. That is, the QR code display area loss rate calculation unit 602 obtains the loss rate of the QR code. The QR code generation unit 101 determines an error correction level based on the QR code loss rate, and generates a QR code. According to the QR code standard, four levels of correction are defined. Level L is 7%, Level M is 15%, Level Q is 25%, Level H is up to 30%. Restoration is possible. As the level increases, the QR code pitch becomes narrower and more complex, and the recognition rate of the portable camera decreases. Therefore, the QR code generating unit 101 selects an optimum error correction level according to the QR code loss rate that occurs in the saturation amount adjustment. For example, if the place where the QR code is inserted is an image that is entirely bright, saturation adjustment does not occur, so the QR code loss rate is low and level L is applied. On the other hand, if there are black spots or black lines in the insertion location, saturation adjustment occurs, so the error correction level is raised to cope with it. However, even if the optimum QR code display area is selected, the QR code loss rate may exceed 30%. In such a case, the QR code generating unit 101 sets the error correction level to the maximum level H and generates a QR code. The analysis / determination result storage unit 604 for each content records a status as to whether or not the QR code displayed in each frame can be encoded on the portable camera side with a QR code loss rate of 30% as a threshold. The processing after QR code generation is the same as in the first embodiment. The QR code insertion coordinate position calculation unit 102 calculates the QR code insertion coordinate position based on the QR code generated by the QR code generation unit 101 and the display area determined by the intra-frame high-luminance display area search unit 601. The original image area QR code insertion unit 107 and the original image area offset adjustment unit 106 perform QR code insertion and offset adjustment processing on the black image area and the original image area and output the result.

  After the content reproduction is completed, the in-content analysis result determination unit 603 analyzes and determines the status recorded in the analysis / determination result storage unit 604 for each content. Specifically, for example, when a black object passes through a bright background, a QR code that cannot be encoded for a moment is generated. However, if it is a very short time during content playback (for example, 1 second or less), frames that can be encoded are displayed continuously after 1 second. The On the other hand, if a black object is always displayed at a fixed position and still occupies a large part of the advertising area, such as when displaying a still image advertisement, or if the entire screen is dark, the saturation amount is large in the majority of the screen. Adjustment will occur. Therefore, even with the above method, encoding on the portable camera side is severe and it is determined that there is a problem. If there is no problem based on the determination result, the process ends. On the contrary, if there is a problem, the QR code size adjustment and gamma adjustment are performed at the next reproduction. For example, when a black object is displayed large in the center in the still image advertisement shown in the example, the QR code is reduced and displayed in an empty area at the edge of the screen so that the QR code loss rate is 30% or less. . When the entire screen is dark, gamma adjustment is performed to increase the brightness of the entire screen to reduce the frequency of occurrence of saturation adjustment. Since the QR code size reduction process leads to a reduction in the QR code recognition rate, and the gamma adjustment leads to a deterioration in image quality, the configuration of determining the presence or absence of implementation after content content analysis is used as a final adjustment means. However, with regard to the QR code size adjustment, if the QR code loss rate is within 30% with a slight reduction, the intra-frame high-intensity display area search unit 601 determines an appropriate code size at the time of the first playback. It doesn't matter.

  Hereinafter, processing of the image processing apparatus according to the second embodiment will be described with reference to FIG. FIG. 7 is a flowchart showing processing of the image processing apparatus according to the second embodiment.

  In step S201, the black insertion area determination unit 103 determines a black image insertion area. At this time, it may be determined to insert a black image over the entire second subframe, or it may be determined to divide into each subframe and insert a black image. In step S202, the gamma adjustment unit 605 performs gamma adjustment on the input image data to increase the brightness of the entire screen. Note that gamma adjustment is not performed at the time of initial content reproduction, and the analysis result after content reproduction is determined, and gamma adjustment is performed. In step S203, the intra-frame high-intensity display area searching unit 601 searches for a high-intensity display area in the frame of the input image data, that is, a display area having a high ratio of pixel values, and can display the display area in the display area. The QR code vertex coordinates of the maximum size or the QR code vertex coordinates of the maximum size that can be displayed including the display area are determined.

  In step S204, the QR code display area loss rate calculation unit 602 determines the ratio of pixels in which saturation occurs in the QR code display area indicated by the QR code vertex coordinates, that is, the QR code in the display area in the black image area. QR code loss rate at the time of insertion is calculated. At the same time, the analysis / determination result storage unit 604 for each content records the status of whether or not encoding is possible on the portable camera side with a maximum allowable value of 30% of the QR code loss rate as a threshold value. In step S205, the QR code generating unit 101 determines an error correction level based on the calculated QR code loss rate.

  In step S206, the QR code generating unit 101 generates a QR code with the determined error correction level. In step S207, the QR code insertion coordinate position calculation unit 102 calculates a QR code insertion coordinate position based on the display area calculated in step S203 and the QR code generated in step S206. In step S208, the double speed unit 104 generates a 120 Hz subframe from the 60 Hz input image data by double speed processing.

  In step S209, the image processing apparatus determines whether the pixel of the input image data currently being processed is a pixel in the black image insertion area determined in step S201. If the pixel of the input image data currently being processed is a pixel at the QR code insertion coordinate position, the process proceeds to step S210. On the other hand, if the pixel of the input image data currently being processed is not a pixel at the QR code insertion coordinate position, the process proceeds to step S211.

  In step S210, the image processing apparatus displays a black image or a QR code in consideration of saturation. The details of step S210 are the same as steps S106 to S109 of FIG. In step S <b> 211, the image processing apparatus displays the input image data or the input image data subjected to offset adjustment. The details of step S211 are the same as steps S110 to S113 of FIG.

  In step S212, the image processing apparatus determines whether or not processing for one frame (two subframes) has been completed. When the process for one frame is completed, the process proceeds to step S213. on the other hand. If the processing for one frame has not been completed, the processing returns to step S209.

  In step S213, the image processing apparatus determines whether the reproduction of the content has ended. When the reproduction of the content is finished, the process proceeds to step S214. On the other hand, if the reproduction of the content has not ended, the process returns to step S202. In step S214, the in-content analysis result determination unit 603 analyzes the status indicating whether encoding is possible for one content recorded in step S204. If it is determined as a result of the analysis that it is difficult to encode on the portable camera side, in step S202, the gamma adjustment unit 605 changes the gamma adjustment amount at the next content reproduction. Furthermore, in step S202, the QR code generating unit 101 changes the size of the display area of the QR code.

  As described above, according to the second embodiment, even when the saturation amount generated in the original image area is subtracted from the QR code pixel value, the encoding failure rate on the portable camera side is suppressed and displayed. It becomes possible.

  The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. is a process to be executed.

  101: QR code generation unit, 102: QR code insertion coordinate position calculation unit, 103: Black insertion region determination unit, 104: Double speed unit, 105: Black insertion unit, 106: Original image region offset adjustment unit, 107: Black image region QR code insertion unit, 108: black image region QR code saturation amount adjustment unit, 601: intra-frame high-luminance display region search unit, 602: QR code display region loss rate calculation unit, 603: in-content analysis result determination unit, 604: Content analysis / determination result storage unit

Claims (11)

N-times speed means for N times the image data (N: natural number);
A determining unit that determines a black image region that is a region for displaying a black image and an original image region that is a region for displaying the image data in a plurality of subframes generated by the N-times speed unit;
Calculating means for calculating an insertion position of code information in the plurality of subframes;
An image processing apparatus comprising: first insertion means for inserting code information at the insertion position in the black image region.   The image processing apparatus according to claim 1, further comprising second insertion means for inserting an image corresponding to the code information at the insertion position in the original image area.   The image processing apparatus according to claim 2, wherein the image corresponding to the code information is an image obtained by subtracting a pixel value of the code information from a pixel value at the insertion position of the original image area.   When the pixel value of the code information is larger than the pixel value of the original image area, the first insertion unit subtracts the difference between the pixel value of the original image area and the pixel value of the code information. The image processing apparatus according to claim 3, wherein information is inserted.   5. The image processing apparatus according to claim 1, wherein the determining unit determines the black image area so as to divide a black image for one frame in the plurality of subframes. 6. .   The image processing apparatus according to claim 5, wherein the first insertion unit inserts a plurality of pieces of the code information into the divided black image region. Search means for searching for a region where the luminance satisfies a predetermined condition in the frame of the image data;
In the area searched by the search means, calculating means for calculating a ratio of pixels having a pixel value of the code information larger than the pixel value of the original image area;
The image processing apparatus according to claim 1, further comprising a generation unit configured to generate the code information at an error correction level corresponding to the ratio calculated by the calculation unit. Based on the ratio calculated by the calculation means, analysis means for analyzing whether or not the code information can be encoded by an imaging device that images the code information;
The image processing apparatus according to claim 7, further comprising a size adjusting unit that adjusts a size of the code information based on an analysis result by the analyzing unit.   The image processing apparatus according to claim 8, further comprising a gamma adjustment unit that performs gamma adjustment of the image data based on an analysis result by the analysis unit. An image processing method executed by an image processing apparatus,
N-times speed step for image data N times speed (N: natural number);
A determination step of determining a black image region that is a region for displaying a black image and an original image region that is a region for displaying the image data in a plurality of subframes generated by the N-times speed step;
A calculation step of calculating insertion positions of code information in the plurality of subframes;
An image processing method comprising: an insertion step of inserting code information at the insertion position in the black image region. N-times speed step for image data N times speed (N: natural number);
A determination step of determining a black image region that is a region for displaying a black image and an original image region that is a region for displaying the image data in a plurality of subframes generated by the N-times speed step;
A calculation step of calculating insertion positions of code information in the plurality of subframes;
A program for causing a computer to execute an insertion step of inserting code information at the insertion position in the black image area.

Images