KR20170129982A - Apparatus for processing image data - Google Patents
Apparatus for processing image data Download PDFInfo
- Publication number
- KR20170129982A KR20170129982A KR1020160059922A KR20160059922A KR20170129982A KR 20170129982 A KR20170129982 A KR 20170129982A KR 1020160059922 A KR1020160059922 A KR 1020160059922A KR 20160059922 A KR20160059922 A KR 20160059922A KR 20170129982 A KR20170129982 A KR 20170129982A
- Authority
- KR
- South Korea
- Prior art keywords
- image data
- dimensional image
- pixel
- value
- height value
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/60—Editing figures and text; Combining figures or text
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T15/00—3D [Three Dimensional] image rendering
- G06T15/005—General purpose rendering architectures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/361—Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20212—Image combination
- G06T2207/20221—Image fusion; Image merging
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Graphics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
Abstract
Description
The present invention relates to an image data processing apparatus, and more particularly, to an image data processing apparatus for generating a three-dimensional (3D) image by combining two-dimensional image data and three-dimensional image data.
Dimensional image data and three-dimensional image data for a desired area by using a scanner or the like, and then these three-dimensional image data and three-dimensional image data are combined and processed into three-dimensional image data to obtain three A video data processing device for outputting a 2D image to a display device such as a liquid crystal display device has been developed and commercialized.
Therefore, the user does not go to a desired place himself, but attaches a video data processing device to a robot or the like, and acquires a three-dimensional image of a place that is difficult to access or a place desired by the user.
However, using such an image data processing device, a 3D image acquired for a place with poor visibility such as underwater or night is not good in quality, and it is difficult to accurately grasp the terrain for a desired position or secure a view field do.
Therefore, when the image data processing apparatus is used to grasp the terrain and ensure visibility of the place, when a work using equipment such as a robot is performed, a collision accident occurs between the devices due to a poor image quality, Accurate landforms can not be grasped, causing problems such as crashes and equipment failure.
There is a disadvantage in that it is necessary to scan a desired place while moving the corresponding equipment according to a forward scan method when performing a scan operation for a desired place, and a long scan time is required.
SUMMARY OF THE INVENTION Accordingly, the present invention has been made to solve the above-mentioned problems occurring in the prior art.
Another aspect of the present invention is to shorten the image data acquisition time and the image data processing time.
According to an aspect of the present invention, there is provided an image data processing apparatus including a two-dimensional image data storage unit for storing two-dimensional image data that is color image data for each pixel, a three- Dimensional image data stored in the two-dimensional image data storage unit, and extracting background sub-pixels from the two-dimensional image data stored in the two-dimensional image data storage unit, Dimensional image data stored in the three-dimensional image data storage unit, a pixel-by-pixel unit for each pixel group having a predetermined matrix structure stored in the three-dimensional image data storage unit, To determine whether or not a line is connected between two adjacent pixels in the row direction while moving in the row direction and the column direction to generate a mesh for a plurality of pixels A first average height value which is an average height value of a plurality of pixels belonging to each pixel group and a second average height value which is an average height value of other pixels excluding pixels located in the middle of the plurality of pixels belonging to each pixel group A correction requesting pixel is determined for a pixel group whose difference exceeds a set value and the height value of the correction requesting pixel is adjusted to an average value of the first average height value and the second average height value to correct the height value, Dimensional image data and outputting the three-dimensional image data by combining the background-corrected two-dimensional image data and the height-corrected three-dimensional image data on a pixel-by-pixel basis, And a coupling portion.
The three-dimensional image processor calculates a difference between a minimum height value and a maximum height value among a plurality of height values of a plurality of pixels included in each pixel group. If the difference between the calculated height values is less than a set value, It is preferable not to connect the lines between two adjacent pixels in the row direction when the difference in the calculated height value exceeds the set value.
The three-dimensional image processing unit may remove a redundant line such that a plurality of lines are formed between the same pixels and one line is formed between the corresponding pixels.
Preferably, the 3D image processor compares a height value of each pixel belonging to the pixel group with a reference value, and determines a pixel whose height value exceeds a reference value as a correction requesting pixel.
Wherein the two-dimensional image processor calculates an average gray-level value of pixels of the object excluding the background sub-pixels from the image data for two-dimensional, generates a complementary gray-level value for a complementary color of the color corresponding to the calculated average gray- Wherein the image combining unit receives the complementary color tone value applied from the two-dimensional image processing unit and has the same positional information as the background sub-pixel in the image data for height-corrected three-dimensional image supplied from the three- Dimensional background sub-pixel is set as the complementary color gradation value to generate background-adjusted three-dimensional image data, and the three-dimensional background sub-pixel is set with the gradation value of the three- It is desirable to apply contrast differently to the color of a pixel.
According to this aspect, the resolution of the obtained three-dimensional image is improved to accurately grasp the terrain of the place, and the image data acquisition time and the image data processing time are shortened, thereby increasing the satisfaction of the user.
1 is a schematic block diagram of an image data processing apparatus according to an embodiment of the present invention.
FIG. 2 is a diagram illustrating an operation process of the two-dimensional image processing unit and the image combining unit shown in FIG. 1. Referring to FIG.
3 is a view showing an example of a filter mask in an image data processing apparatus according to an embodiment of the present invention.
4 is a diagram schematically illustrating a process of generating a mesh by sequentially moving a filter mask from three-dimensional image data of one frame in an image data processing apparatus according to an embodiment of the present invention.
FIG. 5 is a diagram schematically illustrating a process of generating a mesh in a triangle shape from three-dimensional image data of one frame in an image data processing apparatus according to an embodiment of the present invention.
6 is a view for explaining the principle of mesh formation in three-dimensional image data of one frame of an image data processing apparatus according to an embodiment of the present invention.
7 is a view for explaining a principle of noise elimination performed in a three-dimensional image processing unit of an image data processing apparatus according to an embodiment of the present invention.
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.
It is to be understood that when an element is referred to as being "connected" or "connected" to another element, it may be directly connected or connected to the other element, but it should be understood that there may be other elements in between do. On the other hand, when an element is referred to as being "directly connected" or "directly connected" to another element, it should be understood that there are no other elements in between.
Hereinafter, an image data processing apparatus according to an embodiment of the present invention will be described with reference to the accompanying drawings, and the image data processing apparatus according to the present example can be used by being attached to a scanner or the like.
1, the image data processing apparatus according to the present embodiment includes a two-dimensional
Dimensional image data obtained from the two-dimensional
In this example, the image data for two-dimensional image data includes red image data obtained by the operation of the two-dimensional
Accordingly, the two-dimensional image storage unit 410 stores image data (i.e., tone values) for a plurality of pixels arranged in a matrix structure obtained by the operation of the two-dimensional
The three-dimensional image data is generated by an operation (for example, photographing operation) of the three-dimensional
Accordingly, the three-dimensional
The two-dimensional
The operation states of these light sources are controlled by the operation of the
However, in an alternative example, in order to obtain two-dimensional image data at night or at night in which a field of view can not be secured due to a shortage of the light source, the two-dimensional
Therefore, the type of the light source used in the two-dimensional
The three-dimensional
At this time, the
The two-dimensional
At this time, the three-dimensional
The
At this time, the size of the two-dimensional image data of one frame made up of the plurality of pixels arranged in the matrix structure acquired by the two-dimensional
Accordingly, each pixel has position information indicating that it is located in a few rows and a few columns, a tone value corresponding to the two-dimensional image data, and a height value corresponding to the three-dimensional image data, Values are stored in a storage unit (not shown) so as to correspond to each other.
Then, the two-dimensional image data stored in the storage unit 410 is processed, the three-dimensional image data stored in the
The
The
The
As shown in FIG. 1, a
However, the
The operation of the image data processing apparatus having such a structure will be described.
First, the operation of the
2 (a)) stored in the two-dimensional image data storage unit 410, the two-dimensional
The two-dimensional
In order to determine the pixels of the background portion, the two-dimensional
When the background subpixel for each pixel of one frame is determined, the two-dimensional
Next, the two-dimensional
Next, the two-dimensional
In this example, the set value may be a gray value corresponding to gray.
At this time, the order of calculating the complementary color gradation value and setting the gradation value of the background sub-pixel to the set value can be changed.
As described above, when the complementary tone values and the image data for background-corrected two-dimensional are generated, the two-dimensional
As described above, the two-dimensional image data uses the two-dimensional image data to generate the complementary tone values and the background-corrected two-dimensional image data.
Next, the operation of the three-dimensional
3D image data stored in the three-dimensional image
Then, the three-dimensional
As shown in FIG. 4, the reference pixel is a pixel [PX (2,2)] located in the second row and the second column, but the present invention is not limited thereto and the position of the reference pixel may be changed if necessary. Also, in the case of this example, the height value processing operation for the pixels located in the first row and the first column is excluded, but is not limited thereto.
As described above, when a plurality of (e.g., nine) pixels defined by the filter mask are determined, the three-dimensional
The 3D mesh generation process will be described in more detail with reference to FIG.
In FIG. 6, for convenience, the size of the filter mask is a 3 × 1 matrix structure. For example, a 3-dimensional mesh is generated by moving a pixel unit in a row direction and a column direction in units of a pixel group of a 3 × 1 matrix structure.
Each pixel P1-P9 shown in FIG. 6 is displayed based on the height value.
Therefore, the pixel located closest to the three-dimensional
6A, first, the minimum height value and the maximum height value are determined among the respective height values of the pixels P1-P3 included in the first pixel group G11, and the minimum height value and the maximum height (P1-P2) and (P2-P3) adjacent to each other in the row direction if the difference between the calculated height values is less than the set value, ].
However, when the calculated difference in height value exceeds the set value, line connection between two adjacent pixels [(P1-P2), (P2-P3)] in the row direction in the corresponding pixel group G11 is not performed.
In this way, the line matching operation of the pixels belonging to all the pixel groups for the frame is performed.
6B shows a case in which the filter mask is shifted by one pixel in the row direction and a line between two adjacent pixels [(P2-P3), (P3-P4)] in the row direction belonging to the newly generated pixel group G12 Show connection status.
6C is a diagram showing a pixel group G13 generated when the filter mask is moved by one pixel in the row direction in the state of FIG. 6B. In this pixel group G13, , And the difference between the minimum height value and the maximum height value among the pixels P3-P5 exceeds the set value but not less than the set value. Therefore, the line of [P3-P4, P4-P5] The connection is not made and the mesh is not formed.
In the case of FIG. 6C, the line connection between two pixels P3-P4 adjacent in the row direction is performed in the case of the previous pixel group G12.
The height values of the pixels P5-P7 belonging to the pixel group G14 formed in the case of FIG. 6 (d) satisfy the line connecting condition, so that the two pixels [(P5-P6), P7).
By the operation of the three-
Next, the three-dimensional
Then, the three-dimensional
For the noise removing operation, the three-dimensional
Then, a difference (e.g., an absolute value) between the first average height value and the second average height value is calculated, and it is determined whether or not the calculated difference set value is exceeded.
Therefore, if the determined error value exceeds the set value, it is determined that a correction is required in which the height value of at least one of the pixels constituting the pixel group G21 is not normal.
In order to determine a pixel requiring correction, the third-dimensional
If the correction-requiring pixel is determined in the corresponding pixel group G21, the three-dimensional
Therefore, as shown in Fig. 7C, the correction request pixel Pr is corrected to the pixel Pr 'in the height value, and in the case of (d), due to the correction of the height value of the correction request pixel Ps , And the pixel Ps' corrected in height.
When the height value-corrected three-dimensional image data is corrected through the above process, the three-dimensional
In this manner, when the complementary color gradation value and the background correction two-dimensional image data are applied from the two-dimensional
That is, the
Next, the
As a result, the color of the corresponding pixel becomes brighter as it approaches the three-dimensional
Finally, the
While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It belongs to the scope of right.
110: two-dimensional light source unit 120: three-dimensional light source unit
210: two-dimensional image acquisition unit 220: three-dimensional image acquisition unit
300: control unit 310: two-dimensional image processing unit
320: a three-dimensional image processing unit 330:
410: Two-dimensional image data storage unit 420: Two-dimensional image data storage unit
500: Output section
Claims (5)
A three-dimensional image data storage unit for storing three-dimensional image data having a height value for each pixel,
Dimensional image data stored in the two-dimensional image data storage unit to generate background image correction two-dimensional image data by setting the tone value of the extracted background subpixel as a set value and outputting Dimensional image processing unit,
Dimensional image data stored in the three-dimensional image data storage unit, whether or not line connection between two adjacent pixels in the row direction is performed while moving in the row direction and the column direction on a pixel-by-pixel basis for each pixel group having a predetermined matrix structure A first average height value which is an average height value of a plurality of pixels belonging to each pixel group and a second average height value which is a difference between the first average height value of the pixels belonging to each pixel group The correction requesting pixel is determined for the pixel group whose difference between the second average height value, which is the average height value, exceeds the set value, and the height value of the correction requesting pixel is determined as the average value of the first average height value and the second average height value A three-dimensional image processing unit for generating and outputting image data for three-dimensionally correcting the height by adjusting the height value, and
And an image combining unit for combining the background-corrected two-dimensional image data and the height-corrected three-dimensional image data for each pixel to output three-dimensional image data,
And an image processing unit for processing the image data.
The three-dimensional image processor calculates a difference between a minimum height value and a maximum height value among a plurality of height values of a plurality of pixels included in each pixel group. If the difference between the calculated height values is less than a set value, And does not connect the line between two adjacent pixels in the row direction when the difference in the calculated height value exceeds the set value.
Wherein the three-dimensional image processing unit removes overlapping lines such that a plurality of lines are formed between the same pixels and one line is formed between the corresponding pixels.
Wherein the three-dimensional image processing unit compares a height value of each pixel belonging to the pixel group with a reference value and determines a pixel whose height value exceeds a reference value as a correction requiring pixel.
Wherein the two-dimensional image processor calculates an average gray-level value of pixels of the object excluding the background sub-pixels from the image data for two-dimensional, generates a complementary gray-level value for a complementary color of the color corresponding to the calculated average gray-
Wherein the image combining unit receives the complementary color tone value applied from the two-dimensional image processing unit and has the same positional information as the background sub-pixel in the image data for height-corrected three-dimensional image supplied from the three- Dimensional background sub-pixel is set as the complementary color gradation value to generate background-adjusted three-dimensional image data, and the three-dimensional background sub-pixel is set with the gradation value of the three- Apply different contrasts to the color of a pixel
Image data processing device.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020160059922A KR20170129982A (en) | 2016-05-17 | 2016-05-17 | Apparatus for processing image data |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020160059922A KR20170129982A (en) | 2016-05-17 | 2016-05-17 | Apparatus for processing image data |
Publications (1)
Publication Number | Publication Date |
---|---|
KR20170129982A true KR20170129982A (en) | 2017-11-28 |
Family
ID=60811101
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020160059922A KR20170129982A (en) | 2016-05-17 | 2016-05-17 | Apparatus for processing image data |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR20170129982A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110895550A (en) * | 2018-09-13 | 2020-03-20 | 北京京东尚科信息技术有限公司 | Method and device for processing acquired data |
-
2016
- 2016-05-17 KR KR1020160059922A patent/KR20170129982A/en active IP Right Grant
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN110895550A (en) * | 2018-09-13 | 2020-03-20 | 北京京东尚科信息技术有限公司 | Method and device for processing acquired data |
CN110895550B (en) * | 2018-09-13 | 2024-01-12 | 北京京东尚科信息技术有限公司 | Method and device for processing acquired data |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5973707B2 (en) | 3D endoscope device | |
TWI594018B (en) | Wide angle stereoscopic image display method, stereoscopic image display device and operation method thereof | |
WO2013073028A1 (en) | Image processing device, three-dimensional image display device, image processing method and image processing program | |
US20090079733A1 (en) | Apparatus, method, and computer program product for processing three-dimensional images | |
KR20160121798A (en) | Hmd calibration with direct geometric modeling | |
JP2009524349A (en) | Adjustment method of stereoscopic display system | |
KR101574914B1 (en) | Model-based stereoscopic and multiview cross-talk reduction | |
JP2009080578A (en) | Multiview-data generating apparatus, method, and program | |
US20100079578A1 (en) | Apparatus, method and computer program product for three-dimensional image processing | |
RU2017101484A (en) | METHOD AND DEVICE FOR FORMING A THREE-DIMENSIONAL IMAGE | |
US20190139261A1 (en) | Camera parameter calculation apparatus, camera parameter calculation method, and recording medium | |
JP2006287592A (en) | Image generating device, electronic equipment, and image generation method and program | |
JP2013527932A5 (en) | ||
CN111869202B (en) | Method for reducing crosstalk on autostereoscopic displays | |
JP2013527932A (en) | Autostereoscopic display and manufacturing method thereof | |
CN110662012A (en) | Naked eye 3D display effect optimization drawing arranging method and system and electronic equipment | |
US9202305B2 (en) | Image processing device, three-dimensional image display device, image processing method and computer program product | |
CN108307185B (en) | Naked eye 3D display device and display method thereof | |
CN107730554A (en) | The scaling method and device of face battle array structure light imaging system | |
CN104079913A (en) | Sub-pixel arrangement method and device for compatibility of raster stereoscopic displayer with 2D and 3D display modes | |
KR101454780B1 (en) | Apparatus and method for generating texture for three dimensional model | |
JP4867709B2 (en) | Display distortion measuring apparatus and display distortion measuring method | |
KR20170129982A (en) | Apparatus for processing image data | |
JP5711104B2 (en) | Image display apparatus, method, program, and image processing apparatus | |
US20140313199A1 (en) | Image processing device, 3d image display apparatus, method of image processing and computer-readable medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
E701 | Decision to grant or registration of patent right |