KR101324224B1 - Video presenting system having image adjusting function - Google Patents

Abstract

According to the present invention, in a system in which an embedded system for controlling a device is mounted on an actual imager which is an optical image electronic device, a real image having an image adjustment function for adjusting luminance levels and colors internally without a separate measurement / evaluation device It's about the system. A real image system having an image adjusting function includes: real image means for generating a live image and outputting a live image, an external input image, and a document / multimedia image as a display signal; And embedded means for transmitting an image input from the outside and a document / multimedia image to the real image means through periodic communication with the real image means, wherein the embedded means includes any frame obtained from a live image received from the real image means. A luminance level measuring / adjustment unit for extracting a luminance signal from the luminance level, comparing the luminance level reference value transmitted from the real image means with the extracted luminance signal, and changing the luminance level reference value according to the luminance signal; And a color measurement / adjustment unit for extracting a color signal from a frame of the live image after adjusting the luminance level, and comparing the extracted color signal with the color reference value transmitted from the real image means to change the color signal to a color reference value.

Luminance level measurement / adjustment, color measurement / adjustment

Description

Video presenting system having image adjusting function

According to the present invention, in a system in which an embedded system for controlling a device is mounted on an actual imager which is an optical image electronic device, a real image having an image adjustment function for adjusting luminance levels and colors internally without a separate measurement / evaluation device It is about the system.

Optical imaging equipment must undergo a separate adjustment process when shipped. There is a need for a process for adjusting the quality deviation caused by mechanical deviation such as analog CCD sensitivity, zoom / focus mechanism of the video camera lens, and aperture, and typical processes include initial luminance level, color adjustment, and focus adjustment. This is necessary because the real imager is also an optical imaging device.

Optical imaging equipment generally uses serial data lines to operate programs on a PC to perform the adjustment process in a manner that is manipulated by production line operators. In addition, a separate device such as analog evaluation equipment (vectorscope, waveform) is needed to measure the video signal.In case of products using high resolution CCD (high resolution real-time imager, etc.) instead of NTSC / PAL system, standardization of VGA signal Since no measurement equipment is used, it is necessary to connect to an analog measurement equipment for TV using a scan converter that downscales a VGA signal and converts it into an NTSC / PAL signal. It may be required.

In addition, since the process proceeds to the sensory test of the operator, there is a possibility of deviation and error due to the skill and error of the operator.

The biggest problem of the prior art is that the complicated connection with the measurement / evaluation equipment, the connection with the PC, and the use of the adjustment software running on the PC are difficult. Therefore, when the A / S of an already released product occurs, adjustment is performed in the field. There is a problem that the process is impossible.

The technical problem to be solved by the present invention is to build a self-adjustment algorithm based on the data of the digital luminance level and color data obtained internally without a separate measurement / evaluation equipment to reduce the overall adjustment time, reduce logistics costs, It is to provide a real image system with image control to improve quality control and customer satisfaction.

A real image system having an image adjusting function for solving the technical problem to be achieved by the present invention comprises: real image means for generating a live image and outputting the live image, an external input image, and a document / multimedia image as a display signal; And embedded means for transmitting an image and a document / multimedia image input from the outside to the real image means through periodic communication with the real image means, wherein the embedded means is obtained from a live image received from the real image means. A brightness level measurement / adjustment unit for extracting a brightness signal from the predetermined arbitrary frame, and comparing the extracted brightness signal with the brightness level reference value transmitted from the real image means and changing the brightness level reference value according to the brightness signal; And a color measurement / adjustment unit which extracts a color signal from the frame of the live image after adjusting the luminance level, and compares the color reference value transmitted from the real image means with the extracted color signal to change the color signal to the color reference value. It may include.

In the present invention, the luminance level measuring / adjustment unit comprises: a luminance signal extracting unit for extracting a luminance signal from an arbitrary frame obtained from a live image received from the real image means; A calculator for calculating an average value, a maximum value, and a minimum value of the extracted luminance signal; And a luminance level adjusting unit for adjusting the calculated average value to the luminance level reference value transmitted from the real image means and storing the adjustment value if the difference between the calculated maximum value and minimum value is less than or equal to a predetermined value.

The method may further include a sampling unit configured to down sample the extracted luminance signal.

The method may further include a graph output unit configured to display a graph of an average value, a maximum value and a minimum value of the calculated luminance signal, and a numerical value of the adjustment result of the luminance level adjusting unit.

The color measurement / adjustment unit may include: a color signal extracting unit extracting a color signal from a frame of a live image in which the luminance level is adjusted; A virtual vector space generator for generating a virtual vector space including arbitrary color coordinates; A counter for counting coordinates of a corresponding color gamut when the calculated color signal is included in the color gamut; And a color adjusting unit for adjusting the phase and amplitude values of the color signals displayed in the color region of the virtual vector space to the reference phase values and amplitude values transmitted from the real image means, and storing the adjustment values.

In the present invention, the color adjusting unit may use an average value of phase and amplitude values of the color signal displayed in each color region of the virtual vector space.

The method may further include a graph output unit configured to display a color signal counted in the color region of the virtual vector space and a numerical value of the adjustment result of the color adjusting unit as a graph.

As described above, according to the present invention, since the luminance level and the color data are internally digitized / quantized through digital image processing without additional measurement / evaluation equipment, productivity can be improved while reducing costs.

It is also possible to minimize self-adjustment algorithms based on the acquired digital data, minimizing the possibility of maneuvering errors and reducing overall adjustment time.

In addition, the remote A / S center or the user can directly perform the piloting process, which can be used to reduce logistics costs, quality control, and customer satisfaction.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

1 is a view showing a real image system having an image adjusting function according to the present invention, which includes a real image means 1 having an embedded means and a display unit 2 displaying an object image.

In the present invention, the real image means 1 is a key as an image sensing unit 11, lighting devices 12a, 12b, props 13, lock buttons 14, subjects 15, input means 16 An input unit 16a, a mouse 16b, a remote controller 16c, and a remote receiver 17 are included.

The image sensing unit 11 capable of moving back and forth and rotating includes an optical system and a photoelectric conversion unit. An optical system for optically processing light from a subject includes a lens unit and a filter unit. A photoelectric conversion unit of a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) converts light incident from a subject through an optical system into an electrical analog signal.

The user can press the lock button 14 to move the post 13. Another illuminating device is built in the lower part of the image pick-up 15. The key input unit 16a or the mouse 16d is used to control the operation of each unit such as the image sensing unit 11 and the illumination devices 12a and 12b by the user's operation. On the other hand, the user can control the driving of each part such as the image sensing unit 11 and the illuminating devices 12a and 12b by operating the remote controller 16c and inputting the control signal to the remote receiving unit 17. [

A light box 18 is used for image adjustment according to the present invention, i.e. for measuring and adjusting standard brightness and color data. The 3100K standard viewer is used to secure the uniformity of the reference light source, but the viewer does not use the viewer to recalibrate existing products. If the program is set for a light box other than the viewer mode for readjustment, the reference level optimized for the light box brightness is changed, and then the brightness level adjustment and the color adjustment process can be performed.

FIG. 2 is an internal configuration diagram of a real image system having an image adjusting function disclosed in FIG. 1, which includes a real image means 100 and an embedded means 200.

In the present invention, the real image means 100 includes an image sensing unit 11, a key input unit 16a as the input unit 16, a remote controller 16c, a digital signal processor (DSP) 110, a first SDRAM (synchronous). dynamic random access memory (120), field programmable gate array (FPGA) 130, video graphic array (VGA) engine 140, and microcomputer 150.

In the present invention, the embedded means 200 is a mouse 16b as the input means 16, portable storage 210, network 223, the second SDRAM 230, graphics engine 240, CPU core (core) ) 250, a speaker 260, a luminance level measurement / adjustment unit 270, and a color measurement / adjustment unit 280.

The microcomputer 160 of the real image pickup means 100 and the CPU core 250 of the embedded means 200 transmit and receive data through periodic communication and periodically transmit data of up to 48 bytes Exchange.

First, the image sensing unit 11 will be described. The image sensing unit 11 optically processes light from the subject 18a and converts the light into an analog signal.

The DSP 110 converts the live video signal of the object 18a converted from the video sensing unit 11 into a digital signal and performs various signal processing for display. The DSP 110 removes a black level due to a dark current generated in a CCD or CMO sensitive to a temperature change, and performs gamma correction to encode information according to nonlinearity of the human vision. The DSP 110 performs CFA interpolation for interpolating a Bayer pattern embodied with RGA and GGB lines of gamma-corrected predetermined data into RGB lines. The DSP 110 converts the interpolated RGB signals into YUV signals, edge compensation for filtering the Y signals by the high-pass filter, and color compensation of the U and V signals using the standard color coordinate system Corrects the color correction, and removes these noises.

In the first SDRAM 120 as a frame memory, a live video signal processed by the DSP 110 is stored on a frame-by-frame basis.

The FPGA 130 is a memory control unit and provides a live image stored in the first SDRAM 120 to the VGA engine 140 on a frame-by-frame basis.

The VGA engine 140 converts the image received from the FPGA 130 into a composite image signal, and converts the document / multi-idea file image received from the embedded means 200 into a composite image signal. The VGA engine 140 performs signal processing for scaling or frame rate conversion of the frame image received from the FPGA 130 and the document / multimedia image received from the embedded unit 200, Into a video signal. In another embodiment, the VGA engine 140 displays a sub-image (e.g., a live image) in a virtual window of a predetermined size transmitted from the embedded means 200 and then displays the main image (e.g., document / ).

The microcomputer 150 controls the operation of the entire real image means 100 and periodically communicates with the embedded means 200. In particular, the microcomputer 150 stores reference values for luminance level adjustment and color adjustment, and outputs them at the request of the embedded means 200. In addition, when the dual display is provided, the microcomputer 150 receives a video display request signal from the key input unit 16a and the remote controller 16c, and receives an external video signal and a video graphic signal output from the VGA engine 140. In addition, any two images of the document / multimedia image signal output from the embedded means 200 are controlled to be dual output to two display units (not shown). In addition, the microcomputer 150 controls the VGA engine 140 to overlay the live image received from the FPGA 130 and the document / multimedia image received from the embedded means 200. In another embodiment, the microcomputer 150 displays a sub image (eg, a live image) in a virtual window of a predetermined size received from the embedded means 200, and then displays the main image (eg, a document / multimedia image). The VGA engine 140 is controlled to be overlaid.

The removable portable storage 210 stores a document / multimedia file image, the network 220 receives a document / multimedia file image from the outside, or a document / multimedia file And transmits the file image.

The second SDRAM 230 stores an image in the portable storage unit 210 or stores a document / multimedia file image received from the network 203 under the control of the CPU core 250 and receives A still image or a moving image for one live image is stored.

The graphic engine 240 receives the document / multimedia file image stored in the second SDRAM 230 under the control of the CPU core 250, converts the document / multimedia file image into a digital image, and outputs the converted digital image to the VGA engine 140.

The CPU core 250 controls the operation of the entire embedded means 200 and periodically communicates with the microcomputer 150 of the real image means 100. In particular, the CPU core 250 controls a series of operations for performing the image automatic adjustment function.

The luminance level measurement / adjustment unit 270 extracts a luminance signal from an arbitrary frame obtained from a live image received from the micom 150 of the real image means 100, and extracts the luminance level reference value and the extracted luminance level reference value from the micom 150. The luminance signals are compared and the luminance level reference value is changed according to the luminance signals. Details of the luminance level measuring / adjusting unit 270 will be described below with reference to FIGS. 3 and 4.

The color measurement / adjustment unit 280 extracts the color signal from the frame of the live image after adjusting the luminance level, compares the color reference value transmitted from the microcomputer 150 with the extracted color signal, and changes the color signal to the color reference value. Details of the color measurement / adjustment unit 280 will be described below with reference to FIGS. 5 and 6.

First, the brightness level measurement / adjustment unit 270 will be described with reference to FIGS. 3 and 4. In the present invention, the luminance level measurement / adjustment unit 270 includes an image acquisition unit 271, a luminance signal extraction unit 272, a sampling unit 273, a calculation unit 274, a graph output unit 275, and a luminance level adjustment unit ( 276). In order to adjust the brightness level, the brightness level measurement / adjustment unit 270 is controlled by the CPU core 250, and the CPU core 250 periodically communicates with the microcomputer 150 of the real image means 100 to receive various data. The brightness level adjusting process of the brightness level measuring / adjusting unit 270 is displayed on the display unit 2 under the control of the CPU core 250 and the microcomputer 150.

The image acquisition unit 271 obtains an arbitrary frame of digital image data transmitted from the FPGA 130 of the real image means 100 to the CPU core 250 of the embedded means 200.

The luminance signal extractor 272 extracts only the luminance signal for each line from the frame acquired by the image acquirer 271. The digital image data of the frame obtained by the image acquisition unit 271 uses YUV2 (YCbCr 4: 2: 2: format) in which luminance (Y) data and chrominance component (CbCr) are implemented to implement 2 pixels for each 32 bits. Have. The luminance signal extractor 272 extracts the luminance signal from this digital image data. The extracted luminance signal is the same as the monochrome bitmap (8-bit) signal, so that the luminance distribution of the entire pixel data can be known.

The calculator 273 calculates an average value, a maximum value, and a minimum value from the extracted luminance signal. The calculated average value, maximum value and minimum value may be displayed on the display unit 2.

The sampling unit 274 down-samples the extracted luminance signal. Displaying all the luminance signals for all the pixels takes a lot of time because of limited resources of the CPU core 250. Therefore, the luminance signal output to the display unit 2 is sampled and output. It is displayed on the screen in units of horizontal lines, and the user can select whether to obtain it once in 2/4/8/16/32/64 lines based on the vertical line and output it to the screen. 1280 × 960, 1280 × 720, 1024 × It can be set to automatically select according to the input resolution such as 768.

The graph output unit 275 graphs and outputs the calculated average value, maximum value, and minimum value to the display unit 2. 4 shows an example of graphing and outputting the calculated average value, maximum value, and minimum value. This digitized and quantified numerical value allows an intuitive approach and database of the distribution and pattern of the input image that was not possible in the analog waveform monitoring.

According to FIG. 4, the luminance signal according to the current level is displayed on the screen, and the average value, the minimum value, and the maximum value are also displayed. In the real image display capable of multimedia output, the display and the live image of FIG. 4 can be simultaneously output on one display unit 2 screen using an expressive overlay function, so that an operator can work while watching only one display unit 2. Provide convenience. In addition, in the case of a physical imager capable of dual image output, it has a scalability to output a live image to one display unit and a screen of FIG. 4 to another display unit.

The luminance level adjusting unit 276 adjusts the calculated average value to the luminance level reference value transmitted from the microcomputer 150 of the real image means if the difference between the calculated maximum value and minimum value is less than or equal to a predetermined value and stores the adjustment value.

The brightness level adjusting unit 276 determines whether the difference between the minimum value and the maximum value of the current frame is a predetermined value, for example, 90 or less. If the brightness level is less than 90, the brightness level controller 276 determines that the light box does not fill the live screen. Move). This process is repeated until the difference between the minimum and maximum is less than or equal to 90. When the difference between the minimum value and the maximum value of the current frame is 90 or more, the average value currently calculated is compared with the reference value transmitted to the CPU core 250 through the microcomputer 150 of the real image means 100. Here, the comparison value means an AE value. The brightness level adjusting unit 276 adjusts the gain of the reference value, that is, the AE value, until the calculated average value falls within the reference value. When the calculated average value falls within the reference value, the corresponding AE gain value is stored as the reference value and the luminance level adjustment is completed.

Next, the color measurement / adjustment unit 280 will be described with reference to FIGS. 5 and 6. In the present invention, the color measurement / adjustment unit 280 may include an image acquisition unit 281, a color difference signal extraction unit 282, a virtual vector space generation unit 283, a counter 284, a graph output unit 275, and a color difference adjustment unit ( 276). For color adjustment, the color measurement / adjustment unit 270 is controlled by the CPU core 250, and the CPU core 250 periodically communicates with the microcomputer 150 of the real image means 100 to receive various data. The color adjustment process of the color measurement / adjustment unit 270 is displayed on the display unit 2 under the control of the CPU core 250 and the microcomputer 150.

The image acquisition unit 281 obtains an arbitrary frame of digital image data transmitted from the FPGA 130 of the real image means 100 to the CPU core 250 of the embedded means 200.

The color difference signal extractor 282 extracts only the color difference signal from the frame acquired by the image acquirer 281. Digital color difference signals, sometimes expressed as RY and BY signals, have a value in the range of -128 to 127, one for every two pixels, and implement graphs with RY as the X axis and BY as the Y axis around the origin (0, 0). do. This can lead to results similar to those shown in conventional analog vector scopes. Or, based on this, the math function can be linked to obtain the magnitude (amplitude, saturation) and direction (phase, hue) of the quantized / quantized vector. These vectors are averaged and applied to automated calibration.

The virtual vector space generation unit 283 pre-generates a two-dimensional graph of a virtual vector space, for example, 256 × 256 space, including arbitrary color gamut coordinates.

The counter 284 increments the coordinate value when the color difference data having the coordinate is generated. The reason for using this method is to display the density. When the density is displayed, it is possible to visually determine where the chrominance component is concentrated. Therefore, the intuitive advantages of the analog vector scope can be digitally displayed. You can transfer it as is.

When displaying density data according to coordinates, weights are displayed for each density to display colors differently. For example, 0 is displayed as Black, 1 to 8 as Dark Gray, 9 to 16 as Gray, 17 to 24 as Light Gray, and 25 or more as White.

The graph output unit 275 displays a color signal counted in the color region of the virtual vector space and a numerical value of the adjustment result of the color adjusting unit as a graph.

6A shows a digital vector scope of the color measurement / adjustment unit 280 immediately after the luminance level adjustment operation of the real imager. Since the color adjustment operation assumes that the vector average of all the color difference components of the input data converges to the origin, it is distributed in the center as shown in FIG. 5A. Each of the Red, Magenta, Yellow, Green, Cyan, and Blue areas is pre-applied the phase and size of the color vector. If the corresponding color of the color bar chart is located in the rectangle, the color is judged to be correct.

The color adjusting unit 276 adjusts the phase and amplitude values of the color signals displayed in the color gamut of the virtual vector space to the reference phase values and amplitude values transmitted from the microcomputer 150 of the real image means 100, and stores the adjustment values. do.

When the luminance level adjustment is completed, the color adjusting unit 276 inserts a color bar chart and adjusts the brightness value so that the white clip of the color bar is located at the color reference. The process of adjusting the brightness such that the white clip of the color bar is located at C.Ref of FIG. 6B is a process of finding an appropriate exposure in which the color in the color bar chart is not saturated or degraded. To do this, give C.Ref guidelines and adjust the brightness so that the top of the white clip is in the guidelines. 6B illustrates an example in which color adjustment preparations are completed.

When the color adjustment preparation 276 is completed, the color adjustment unit 276 obtains a vector average for each color area, and ends after outputting an adjustment failure message to the user if each vector average is out of margin or not measurable. However, if each vector average is within the margin value, it is checked whether it is in the valid region based on the vector average value of each color region. Adjust to come. When all the colors are in the effective area by sequentially repeating each color area, the changed amplitude / phase value is saved and color adjustment is completed. When the chrominance component vector is in the specification region, the average vector is displayed graphically as shown in FIG. 6C to indicate that the adjustment is completed.

When the average of each color area is averaged, the effective area is averaged when a certain number of points are distributed within a predetermined number of 32 x 32 pixels. If there are not seven valid areas, the color bar chart is incorrectly positioned or not inserted. If the sum of the vector averages distributed near the origin does not converge at the origin, the process proceeds on the assumption that the white balance is not properly adjusted. Stop

When the average value of each distribution is close to the color reference area, it is determined as the average value of the corresponding color color, and the amplitude / phase values are sequentially changed in the order of Red, Cyan, Yellow, Blue, Magenta, and Green. The difference between the current vector and the reference vector is converted to the amplitude / phase value of the microcomputer 150, and then moved once to center the micro-adjustment. First, if the number of valid color difference coordinate components in the color reference area is greater than or equal to a certain number, the pass judgment is made. Secondly, the average of the corresponding coordinate components is calculated to make the final pass decision if the average is within the mean and error range of the reference area. do.

In order to adjust the color, there should be a color bar chart (not shown) adapted to the light box 18. The color bar chart is placed on the light box 18 and color adjustment is performed.

1 is a view showing a real image system having an image adjustment function according to the present invention.

2 is an internal block diagram of the system disclosed in FIG.

3 is a detailed view of the luminance level measurement / adjustment unit of FIG. 2.

4 is a diagram illustrating an example of measuring a luminance level in FIG. 3.

5 is a detailed view of the color measurement / adjustment unit in FIG. 2.

6 is a diagram illustrating an example of color measurement in FIG. 5.

Claims (7)

Real image means for generating a live image and outputting the live image, an external input image, and a document / multimedia image as a display signal; And And embedded means for transmitting an image and a document / multimedia image input from the outside through the periodic communication with the physical image means to the physical image means, The embedded means A luminance signal extracting unit for extracting a luminance signal from an arbitrary frame obtained from the live image received from the real image means, a calculating unit for calculating an average value, a maximum value and a minimum value of the luminance signal, and the maximum value and the minimum value A luminance level measuring / adjusting unit including a luminance level adjusting unit for adjusting the average value to the luminance level reference value transmitted from the real image means and storing the adjustment value if the difference is less than a predetermined value; And A color measurement / adjustment unit for extracting a color signal from the frame of the live image after adjusting the luminance level, and comparing the extracted color signal with the color reference value transmitted from the real image means to change the color signal to the color reference value Real image system having an image adjustment function, characterized in that it comprises a. delete The method of claim 1, And a sampling unit which down-samples the extracted luminance signal. The method of claim 3, And a graph output unit for displaying a graph of average values, maximum and minimum values of the calculated luminance signals, and numerical values of adjustment results of the luminance level adjusting unit. 2. The method of claim 1, wherein the color measurement / adjustment unit A color signal extracting unit extracting a color signal from a frame of the live image whose luminance level is adjusted; A virtual vector space generator for generating a virtual vector space including arbitrary color coordinates; A counter for counting coordinates of a corresponding color gamut when the calculated color signal is included in the color gamut; And And adjusting a phase and an amplitude value of a color signal displayed in the color region of the virtual vector space to a reference phase value and an amplitude value transmitted from the real image means, and storing a adjustment value. Real image system with functions. The method of claim 5, wherein the color adjustment unit And an average value of phase and amplitude values of color signals displayed in each color region of the virtual vector space. The method according to claim 6, And a graph output unit configured to graphically display a color signal counted in the color region of the virtual vector space and a result of adjustment of the color adjusting unit as a graph.

Images