JP2012231422A - Glare removal device and glare removal method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a glare removal device and a glare removal method.SOLUTION: The glare removal device comprises first and second light sources provided separately. The device acquires a first image with the first light source turned on and the second light source turned off, acquires a second image with the first light source turned off and the second light source turned on, removes a first glare region from a first image to generate a first corrected image, removes a second glare region from a second image to generate a second corrected image, and generates a combined image of the first and second corrected images.

Description

  The present invention relates to a video processing apparatus and a video processing method, and more particularly to a glare removal apparatus and a glare removal method.

  The user outputs the projection to the screen using a real projector (Document Camera) to provide teaching or posting applications. However, in order to improve the sharpness of the image projected by the projector in use, all users reduce the environmental light source. At this time, the brightness of the image output by the actual projector should be reduced along with it. Became. If the light source in the usage environment is too low, there is a risk that the adjustment limit of the automatic exposure (Auto Exposure) of the real projector will be exceeded, and the video brightness output by the real projector will be too low, and the resolution of the output video It affects the sharpness.

  At this time, the user may turn on the light source device attached to the real projector so as to improve the environmental illuminance in the image range of the real projector.

  When a user illuminates a document using a real projector, if the light source device is turned on when the surface is a bright paper material, the image output by the real projector will always appear in a very bright white area (overexposed). Region) appears, and this region is called a glare region.

  The glare region is also referred to as overexposure due to the fact that the light source of the light source device illuminates paper with a bright surface, and the light source is reflected by the sensor in the lens due to the bright surface material to generate glare.

  Therefore, one embodiment of the present invention provides a glare removal apparatus and a glare removal method that solve a glare problem.

  According to an embodiment of the present invention, the glare removing apparatus includes a first light source, a second light source, a video acquisition device, a video processing unit, and a video combining unit, of which a second The light source and the first light source are provided separately. When the first light source is turned on and the second light source is turned off, the image acquisition device can acquire the first image from the object, and when the first light source is turned off and the second light source is turned on, The video acquisition device can acquire the second video from the object. The video processing unit can remove the first glare area in the first video to generate the first modified video, and remove the second glare area in the second video to A modified video can be generated. The image combining unit can combine the first and second modified images to generate a combined image.

  The glare removal apparatus may further include a video edge contrast unit. The image edge contrast unit can remove a connection line (stitch line) due to the connection from the combined image.

  The glare removing apparatus may include a projection apparatus. The projection device projects the combined image, and more specifically, the projection device can project the combined image with the combined lines removed.

  The first and second videos acquired by the video acquisition device are both in RGB format, and the video processing unit includes a video conversion module, an identification module, and a removal module. The video conversion module can convert the first and second videos in RGB format into first and second videos in YCbCr format. The identification module determines that an area where Y in the first video is higher than the first scheduled luminance value and the Cb and Cr density offset amounts are within the first scheduled range is the first glare area. In addition, it can be determined that the area where Y in the second video is higher than the second predetermined luminance value and the Cb and Cr density offset amounts are within the second predetermined range is the second glare area. The removal module removes the first glare region from the first image to obtain a first modified image, and removes the second glare region from the second image, You can get a modified video.

  Further, the image acquisition device has a lens, and the first and second light sources are symmetrically provided on both sides of the lens. The object may have a material with a bright surface.

  According to yet another embodiment of the present invention, there is provided a glare removal method comprising: (a) acquiring a first image from an object when emitting a first light source and turning off a second light source; A second image is acquired from an object when the light source is turned off and the second light source is caused to emit light, and the first and second light sources are separated from each other, and (b) the first Removing a first glare region in the first video to generate a first modified video and removing a second glare region in the second video to generate a second modified video And (c) combining the first and second modified images to generate a combined image.

  The glare removal method may further include step (d). In step (d), the combined line can be removed from the combined video.

  The glare removal method may include step (e). In step (e), the combined image can be projected, and more specifically, the combined image from which the combination line has been removed in step (e) can be projected.

  The first and second images acquired by the image acquisition device are both in RGB format. In step (b), the first and second images in RGB format are converted into the first and second images in YCbCr format. And the region where Y in the first video is higher than the first predetermined luminance value and the density offset amount of Cb and Cr is within the first predetermined range is the first glare region. And determining that the area where Y in the second image is higher than the second scheduled luminance value and the Cb and Cr density offset amounts are within the second scheduled range is the second glare area. Subsequently, the first glare area is removed from the first video to obtain the first modified video, and the second glare area is removed from the second video to obtain the second To get a modified video.

As described above, the glare removing apparatus and the glare removing method of the present invention have significant features and beneficial effects as compared with the conventional technology. According to the technical scheme, considerable technical progress can be achieved, the industrial utility has a wide range of utility values, and at least the following characteristics.
1. Using the opening / closing sequence of the light sources on both sides, the images can be acquired sequentially, and the position and range of the glare can be automatically detected, and both images are combined into a new image to remove the glare. Output the video.
2. When a user uses a light source, a glare prevention sheet (diffusion sheet) can be attached to the product in order to achieve the glare prevention effect, but the technical solution of the present invention can be used to save the cost of the glare prevention sheet. Can achieve the goal of reducing costs.
3. It can improve convenience for the user, can be used quickly, and does not require any special anti-glare sheet or light source direction adjustment.

  Hereinafter, the above description will be described in detail according to embodiments, and the present invention will be further described.

The following description of the drawings is intended to facilitate understanding of the above and other objects, features, advantages, and embodiments of the present invention.
It is a block diagram of the glare removal apparatus by one Example of this invention. FIG. 2 is a block diagram illustrating a video processing unit of FIG. 1 according to an embodiment of the present invention. It is a flowchart of the glare removal method by one Example of this invention. FIG. 6 is a diagram illustrating image combination according to an exemplary embodiment of the present invention.

  For a more complete description of the present invention, reference may be made to the accompanying drawings and various embodiments described below, in which like numerals indicate the same or similar elements. On the other hand, well-known elements and steps are not described in the examples, avoiding unnecessary restrictions on the present invention.

  In the embodiments and claims, “one” and “the” may refer to a single or a plurality, unless specifically limited to an article.

  As used herein, “about”, “approximately” or “approximately” modifies the quantity of any minor change, however, these minor changes do not change their nature. Unless specifically stated in the embodiment, the numerical error range modified by “about”, “approximately” or “approximately” is generally allowed to be within 20%, preferably within 10%, More preferably, it is within 5%.

  In practice, there are three ways to solve the glare problem. The first type of method adjusts the angular direction of the light source so that the light irradiating the surface of a bright document is not reflected into the lens so that the image is not overexposed. However, with this method, the luminance of the video intermediate area is reduced and it is difficult to escape the glare area. The second type of method can reduce the generation of glare by adding a glare prevention sheet (diffusion plate) to the light source device to diffuse the light source to a uniform surface light source. However, the addition of a diffuser plate that effectively achieves the glare prevention effect increases the cost, and many of the diffuser plates are protected by patents and are difficult to obtain and use. In the third type, an antiglare sheet is placed on the surface of a bright paper, thereby reducing the reflected light intensity when the light source irradiates the antiglare sheet, thereby achieving the effect of removing glare. However, since the glare prevention sheet is not a transparent material, the sharpness of characters or images of a paper document is reduced during use.

  In view of the above, the technical aspects of the present invention are a glare removal apparatus and a glare removal method that can be applied to a real projector or widely applied to related technical stages. Particular mention is made that the glare problem can be solved by the technical solution of the present invention without requiring an antiglare sheet. A specific embodiment of the present invention will be described below with reference to FIGS.

  FIG. 1 is a block diagram of a glare removing apparatus 100 according to an embodiment of the present invention. As shown in FIG. 1, the glare removal apparatus 100 includes a first light source 110, a second light source 112, a video acquisition device 120, a video processing unit 130, and a video combining unit 140.

  On the framework, the first light source 110 and the second light source 112 are provided separately from each other, the video acquisition device 120 is connected (coupled) to the video processing unit 130, and the video processing unit 130 is connected to the video combining unit 140. Connected.

  When the glare removal apparatus 100 is used, when the first light source 110 is turned on and the second light source 112 is turned off, the image acquisition device 120 acquires the first image from the object 190, but the first light source 110 When turning off and causing the second light source 112 to emit light, the image acquisition device 120 acquires a second image from the object 190, and the surface of the object 190 may have a bright material or similar reflective properties. . The video processing unit 130 removes the first glare area in the first video to generate a first modified video, and removes the second glare area in the second video, Can generate a modified video. The image combining unit 140 may combine the first and second modified images so as to generate a combined image. As a result, the glare area is removed from the combined image, and the glare problem is solved.

  After the first modified image and the second modified image are combined, a combined line may be generated, and the combined line has a difference in brightness between the two images, and after being combined, The glare removal apparatus 100 may further include an image edge comparison unit 150 due to a significant luminance difference at the stitched portion of the image. It is a video edge comparison unit 150 in terms of the framework. In use, the image edge comparison unit 150 removes the combined line from the combined image by combining the two image edges, and combines the two modified images without the combined line.

  In order to output an image without glare, the glare removal apparatus 100 may include a projection apparatus 160. In view of the framework, the projection device 160 is coupled to the image edge comparison unit 150. In use, the projection device 160 is used to project a combined image. Preferably, the projection device 160 projects the combined image from which the connection line is removed, and projects the image onto a screen, for example, to provide teaching, posting, or various uses.

  In addition, the video acquisition device 120 includes a lens 122. On the framework, the first light source 110 and the second light source 112 may be provided symmetrically on both sides of the lens 122, for example, provided on both the left and right sides or the upper and lower sides, and the first and second glare regions overlap. To avoid imperfection of combined video. It should be noted that the same light source luminance on both sides can be made close to each other by a symmetrical design.

  In the glare removing apparatus 100, each of the first light source 110 and the second light source 112 may be a light emitting diode device, a cold cathode fluorescent lamp, or another light emitting element. The video acquisition device 120 may be a camera, a video sensor, or a similar device, and the projection device 160 may be a projector or a similar device.

  The image processing unit 130, the image combination unit 140, the image edge comparison unit 150, and the like as described above may be software, hardware, and / or firmware. For example, if execution speed and accuracy are the most important considerations, then fundamentally, hardware and / or firmware is the primary choice, and adaptable design is the most important consideration. In addition, the software is selected as the main, or simultaneously, the software, hardware and firmware are used in cooperation. The examples given above should not be divided into superiority and inferiority, but it should be understood that those skilled in the art will appropriately select specific embodiments of these units according to demand.

  If the person has ordinary knowledge in the technical field, each unit is named by its execution function only for the purpose of making the technology of the present plan clearer and easier to understand. It should be understood that this is not a limitation. It is an embodiment of the present invention that each unit is matched to one unit or divided into a plurality of units, or the function of any unit is changed to another unit and executed.

  FIG. 2 is a block diagram illustrating the video processing unit 130 of FIG. 1 according to an embodiment of the present invention. As shown in FIG. 2, the video processing unit 130 includes a video conversion module 132, an identification module 134, and a removal module 136. In the framework, the video acquisition device 120 is connected to the video conversion module 132, the video conversion module 132 is connected to the identification module 134, and the identification module 134 is connected to the removal module 136.

  In practice, the first and second images acquired by the image acquisition device 120 are both in RGB format, and the image conversion module 132 converts the first and second images in RGB format into the first and second images in YCbCr format. It can be converted into 2 images.

The identification module 134 determines that the area where Y in the first video is higher than the first scheduled luminance value and the Cb and Cr density offset amounts are within the first scheduled range is the first glare area. In addition, it can be determined that the area where Y in the second video is higher than the second scheduled luminance value and the Cb and Cr density offset amounts are within the second scheduled range is the second glare area. For example, the density offset amounts of Cb and Cr satisfy the following relational expression.
x = c (| Cb−a | + | Cr−b |),
However, a, b, and c are all parameters.

  Actually, the specific values of the first scheduled luminance value, the second scheduled luminance value, the first scheduled range, and the second scheduled range are appropriate according to the actual situation by the designer or other staff. Can be set. For example, the first scheduled luminance value may be the same as the second scheduled luminance value, and the first scheduled range may be the same as the second scheduled range.

  The removal module 136 removes the first glare region from the first image to obtain a first modified image, and removes the second glare region from the second image, A second modified video can be acquired.

  FIG. 3 is a flow diagram of a monitoring method 200 according to another embodiment of the present invention. The monitoring method 200 is used to monitor a plurality of cameras, and as shown in FIG. 3, steps 201 to 212 (if the steps referred to in the present embodiment do not specifically describe the order, all are actual. The order of the order can be adjusted according to demand, and it may be executed simultaneously or partially). The hardware device that performs these steps has already been specifically disclosed in the above embodiments and will not be described again here.

  In step 201, the first and second light sources are enabled, and the 3A function (3A is a generic name of Auto Focus, Auto White Balance, and Auto Exposure) of the video acquisition device can be temporarily prohibited. In step 202, the first light source can be turned on and the second light source can be turned off, and in step 203, a first image can be acquired from the object. In step 204, the first light source can be turned off and the second light source can be turned on, and then, in step 205, a second image can be acquired from the object. In step 206, both the first and second light sources can emit light. In steps 207-209, the first glare region in the first image is removed to generate a first modified image, and the second glare region in the second image is removed to obtain the second Can generate a modified video.

  Specifically, in step 207, the first and second images in the RGB format can be converted into the first and second images in the YCbCr format. In step 208, it is determined that the area where Y in the first video is higher than the first scheduled luminance value and the Cb and Cr density offset amounts are within the first scheduled range is the first glare area. In addition, it can be determined that the area where Y in the second video is higher than the second predetermined luminance value and the Cb and Cr density offset amounts are within the second predetermined range is the second glare area. In step 209, a first glare area is removed from the first video to obtain a first modified video, and a second glare area is removed from the second video to obtain a second correction. Can be obtained.

  In step 210, the first and second modified images can be combined to generate a combined image. In step 211, the combined line can be removed from the combined image, and in step 212. The combined image can be projected, and preferably in step 212, the combined image from which the connection lines have been removed is projected and projected onto a screen, for example, for teaching, posting, or various uses.

  In practice, the glare removal method 200 can be used for still images, and when the user performs the image glare removal function, the method can be used to remove the glare images and output the images.

  When applied to still images, the movement detection function may be increased. When the user executes the video glare removal function, the above method is also used to remove the glare video and output the video, and perform the video detection operation on the video to detect whether the video changes. However, if there is a change, it indicates that the user converts the object, and after the image is not changed stably, the image glare removal function can be automatically executed to output the image with the glare removed.

  The glare removal method 200 can be used for dynamic images (moving images). Using the image output frequency of the image sensor and the frequency of both light sources alternating blinking, the two cooperate with each other to blink the light source that the human eye does not feel. It is also possible to output an image from which glare has been removed by the above method.

  The glare removal method 200 can be performed by a computer system, and some functions may be stored in a computer-readable memory medium as a computer program. The glare removal method 200 is executed.

  FIG. 4 is a diagram illustrating image combination according to an embodiment of the present invention. As shown in FIG. 4, after removing the first glare region 312 from the first image 310 and removing the second glare region 322 from the second image 320, combining is performed to remove the glare. Can be obtained.

  Although the present invention has been disclosed in the preferred embodiments as described above, it is not intended to limit the present invention in any way, and various variations and modifications can be made by those skilled in the art without departing from the spirit and field of the present invention. Can be added. Therefore, the protection scope of the present invention is based on the contents specified in the claims.

100 glare removal device, 110 first light source, 112 second light source, 120 image acquisition device, 122 lens, 130 image processing unit, 132 image conversion module, 134 identification module, 136 removal module, 140 image combination unit, 150 image Edge contrast unit, 160 projector, 190 object, 200 glare removal method, 201-212 steps, 310 first image, 312 first glare region, 320 second image, 322 second glare region, 330 Video

Claims (9)

A first light source;
A second light source provided separately from the first light source;
When the first light source is caused to emit light and the second light source is turned off, a first image is acquired from the object, and when the first light source is turned off and the second light source is caused to emit light, the object A video acquisition device for acquiring a second video from:
Removing a first glare region in the first image to produce a first modified image, and removing a second glare region in the second image to produce a second modified image A video processing unit for generating video;
A glare removing apparatus comprising: a video combining unit that combines the first and second modified videos to generate a combined video; The first and second videos acquired by the video acquisition device are both in RGB format, and the video processing unit is
A video conversion module for converting the first and second videos in the RGB format into first and second videos in the YCbCr format;
Determining that an area where Y in the first video is higher than a first predetermined luminance value and a density offset amount of Cb and Cr is in the first predetermined range is the first glare area; and An identification module that determines that an area in which Y in the second video is higher than a second predetermined luminance value and a Cb and Cr density offset amount is within the second predetermined range is the second glare area. When,
Removing the first glare region from the first image to obtain the first modified image, and removing the second glare region from the second image; The glare removal apparatus according to claim 1, comprising: a removal module that acquires a second modified image.   The glare removal apparatus according to claim 1, wherein the image acquisition device includes a lens, and the first and second light sources are provided symmetrically on both sides of the lens. A video edge contrast unit that removes a combined line from the combined video;
The glare removal apparatus according to claim 1, further comprising: a projection device that projects the combined image from which the combination line is removed.   The glare removal apparatus according to claim 1, further comprising a projection device that projects the combined image. (A) when the first light source is turned on and the second light source is turned off, the first image is acquired from the object, the first light source is turned off and the second light source is turned on; Obtaining a second image from the object, wherein the first and second light sources are provided separately from each other;
(B) removing a first glare region in the first image to generate a first modified image and removing a second glare region in the second image; Generating a modified video; and
(C) combining the first and second modified images to generate a combined image. (D) removing a combined line from the combined image;
The glare removal method according to claim 6, further comprising: (e) projecting the combined image from which the combination line has been removed.   The method of claim 6, further comprising projecting the combined image. The first and second images acquired by the image acquisition device are both in RGB format, and step (b)
Converting the first and second images in the RGB format into first and second images in the YCbCr format;
Determining that an area where Y in the first video is higher than a first predetermined luminance value and a density offset amount of Cb and Cr is in the first predetermined range is the first glare area; and Determining that a region where Y in the second video is higher than a second predetermined luminance value and a density offset amount of Cb and Cr is within the second predetermined range is the second glare region; ,
Removing the first glare region from the first image to obtain the first modified image, and removing the second glare region from the second image; Acquiring a second modified video;
The glare removal method according to claim 6 comprising:

Images