KR101801841B1 - Apparatus and method for processing image - Google Patents
Apparatus and method for processing image Download PDFInfo
- Publication number
- KR101801841B1 KR101801841B1 KR1020150158171A KR20150158171A KR101801841B1 KR 101801841 B1 KR101801841 B1 KR 101801841B1 KR 1020150158171 A KR1020150158171 A KR 1020150158171A KR 20150158171 A KR20150158171 A KR 20150158171A KR 101801841 B1 KR101801841 B1 KR 101801841B1
- Authority
- KR
- South Korea
- Prior art keywords
- optical field
- image
- data
- resolution
- dimensional image
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
Abstract
A data acquiring unit for acquiring light field data for displaying a viewpoint image of the object viewed from different viewpoints and two-dimensional image data for displaying a two-dimensional image of the object; And an image processing unit for generating up-sampled optical field data for displaying a view image having a resolution of a two-dimensional image based on the optical field data and the two-dimensional image data, and an image processing method therefor .
Description
The present disclosure relates to an apparatus and method for processing optical field data containing different point-in-time information of an object.
In recent years, a three-dimensional display technology capable of expressing images more realistically and effectively has been applied in various fields such as movies, games, advertisements, medical images, education, and military. A variety of techniques are being explored in order to enable a person who is the object of three-dimensional display to experience the same stereoscopic effect as that experienced in a real environment.
According to the embodiments, an image processing apparatus and method for generating light field data for displaying a viewpoint image with improved resolution are provided.
The image processing apparatus according to the first aspect includes: a data acquisition unit for acquiring optical field data for displaying a viewpoint image of an object viewed from different viewpoints and two-dimensional image data for displaying a two-dimensional image of the object; And an image processing unit for generating up-sampled optical field data for displaying a view image having a resolution of a two-dimensional image based on the optical field data and the two-dimensional image data.
The image processing unit may perform interpolation on the optical field data corresponding to the resolution of the two-dimensional image, combine the optical field data interpolated in the frequency domain with the two-dimensional image data, Data can be generated.
The image processing apparatus may further include an optical field microscope for acquiring an optical field image of the object through a microscope and a lens array and acquiring a two-dimensional image through a microscope, Acquire optical field data, and acquire two-dimensional image data from the obtained two-dimensional image.
The data acquiring unit may acquire optical field data from an area of interest of the optical field image and acquire 2D image data from an area of the 2D image corresponding to the area of interest.
Further, the optical field microscope can acquire an optical field image and a two-dimensional image, respectively, at a synchronized time point.
The image processing apparatus may further include a display unit that displays a viewpoint image having a resolution of a two-dimensional image, and the image processor may display the viewpoint having a resolution of the two-dimensional image using the up- Images can be generated.
According to a second aspect of the present invention, there is provided an image processing method comprising: obtaining optical field data for displaying a viewpoint image of an object viewed from different viewpoints and two-dimensional image data for displaying a two-dimensional image of the object; And generating up-sampled optical field data for displaying a view image having a resolution of a two-dimensional image based on the optical field data and the two-dimensional image data.
According to another aspect, there is provided a computer-readable recording medium on which a program for implementing the above-described method is recorded.
According to embodiments of the present invention, by generating up-sampled optical field data using optical field data and two-dimensional image data, a viewpoint image with improved resolution or image quality can be provided.
The present invention may be readily understood by reference to the following detailed description and the accompanying drawings, in which reference numerals refer to structural elements.
1 is a block diagram illustrating an image processing apparatus according to an exemplary embodiment of the present invention.
FIG. 2 is a diagram for explaining contents in which the image processing section generates upsampled optical field data, according to an embodiment.
3 and 4 show a more specific embodiment in which the image processing section generates the upsampled optical field data.
5 illustrates a view image generated from upsampled optical field data, according to one embodiment.
6 is a view showing an image processing apparatus according to another embodiment.
Figure 7 shows one embodiment of a light field microscope.
8 is a diagram for explaining an image processing method performed by the image processing apparatus according to an embodiment.
The terms used in this specification will be briefly described and the present invention will be described in detail.
While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term, not on the name of a simple term, but on the entire contents of the present invention.
When an element is referred to as "including" an element throughout the specification, it is to be understood that the element may include other elements, without departing from the spirit or scope of the present invention. Also, the terms "part," " module, "and the like described in the specification mean units for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software .
Throughout the specification, when a part is referred to as being "connected" to another part, it includes not only "directly connected" but also "electrically connected" with another part in between . Also, when an element is referred to as "comprising ", it means that it can include other elements as well, without departing from the other elements unless specifically stated otherwise.
Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention.
1 is a block diagram illustrating an
The
The
In addition, the
The
FIG. 2 is a diagram for explaining contents in which the
The
In addition, the
The
Subsequently, the
3 and 4 show a more specific embodiment in which the
The
The
4, the
Subsequently, the
Accordingly, the
5 illustrates a view image generated from upsampled optical field data, according to one embodiment.
In FIG. 5, the
As shown in FIG. 5, the
6 is a diagram showing an
The
The
The
FIG. 7 shows an embodiment of the
The
The
The
The
The
The
The
6 may acquire the optical field data for displaying the view image from the optical field image acquired by the
According to another embodiment, the
The
The
8 is a diagram for explaining an image processing method by the
The method shown in FIG. 8 can be performed by the respective components of the
In step s810, the
In addition, the
According to one embodiment, the
According to one embodiment, the
According to one embodiment, the
In step s820, the
According to one embodiment, the
More specifically, the
Accordingly, the
The apparatus according to the above embodiments may include a processor, a memory for storing and executing program data, a permanent storage such as a disk drive, a communication port for communicating with an external device, a touch panel, a key, The same user interface device, and the like. Methods implemented with software modules or algorithms may be stored on a computer readable recording medium as computer readable codes or program instructions executable on the processor. Here, the computer-readable recording medium may be a magnetic storage medium such as a read-only memory (ROM), a random-access memory (RAM), a floppy disk, a hard disk, ), And a DVD (Digital Versatile Disc). The medium is readable by a computer, stored in a memory, and executable on a processor.
This embodiment may be represented by functional block configurations and various processing steps. These functional blocks may be implemented in a wide variety of hardware and / or software configurations that perform particular functions. For example, embodiments may include integrated circuit components such as memory, processing, logic, look-up tables, etc., that may perform various functions by control of one or more microprocessors or other control devices Can be employed. Similar to how components may be implemented with software programming or software components, the present embodiments may be implemented in a variety of ways, including C, C ++, Java (" Java), an assembler, and the like. Functional aspects may be implemented with algorithms running on one or more processors. In addition, the present embodiment can employ conventional techniques for electronic environment setting, signal processing, and / or data processing. Terms such as "mechanism", "element", "means", "configuration" may be used broadly and are not limited to mechanical and physical configurations. The term may include the meaning of a series of routines of software in conjunction with a processor or the like.
The specific implementations described in this embodiment are illustrative and do not in any way limit the scope of the invention. For brevity of description, descriptions of conventional electronic configurations, control systems, software, and other functional aspects of such systems may be omitted. Also, the connections or connecting members of the lines between the components shown in the figures are illustrative of functional connections and / or physical or circuit connections, which may be replaced or additionally provided by a variety of functional connections, physical Connection, or circuit connections.
In this specification (particularly in the claims), the use of the terms " above " and similar indication words may refer to both singular and plural. In addition, when a range is described, it includes the individual values belonging to the above range (unless there is a description to the contrary), and the individual values constituting the above range are described in the detailed description. Finally, if there is no explicit description or contradiction to the steps constituting the method, the steps may be performed in an appropriate order. It is not necessarily limited to the description order of the above steps. The use of all examples or exemplary terms (e. G., The like) is merely intended to be illustrative of technical ideas and is not to be limited in scope by the examples or the illustrative terminology, except as by the appended claims. It will also be appreciated by those skilled in the art that various modifications, combinations, and alterations may be made depending on design criteria and factors within the scope of the appended claims or equivalents thereof.
Claims (13)
A data acquiring unit acquiring optical field data for displaying a viewpoint image of a first resolution viewed from an object at different viewpoints, and two-dimensional image data for displaying a two-dimensional image of a second resolution representing the object; And
And an image processor for generating up-sampled optical field data for displaying the viewpoint image of the second resolution based on the optical field data and the two-dimensional image data,
Wherein the second resolution is higher than the first resolution,
Wherein the image processing unit comprises:
Performing interpolation on the optical field data corresponding to the second resolution, combining the interpolated optical field data on the frequency domain with the two-dimensional image data, and generating the up-sampled optical field data , Image processing device.
An optical field microscope for acquiring an optical field image of the object through a microscope and a lens array, and acquiring the two-dimensional image through the microscope,
Wherein the data obtaining unit comprises:
Obtaining the optical field data from the optical field image,
And acquires the two-dimensional image data from the obtained two-dimensional image.
Wherein the data obtaining unit comprises:
Obtaining the optical field data from a region of interest of the optical field image,
And acquires the two-dimensional image data from the region of the two-dimensional image corresponding to the region of interest.
In the optical field microscope,
And obtains the optical field image and the two-dimensional image, respectively, at a point in time when the two images are synchronized.
And a display unit for displaying the viewpoint image of the second resolution,
Wherein the image processing unit comprises:
And generates the viewpoint image of the second resolution using the up-sampled optical field data.
Acquiring optical field data for displaying a viewpoint image of a first resolution viewed from an object at different points in time, and two-dimensional image data for displaying a two-dimensional image of a second resolution representing the object; And
And generating up-sampled optical field data for displaying the viewpoint image of the second resolution based on the optical field data and the two-dimensional image data,
Wherein the second resolution is higher than the first resolution,
Wherein the generating comprises:
Performing interpolation on the optical field data corresponding to the second resolution; And
Combining the interpolated light field data and the two-dimensional image data on the frequency domain to generate the up-sampled optical field data.
Acquiring an optical field image of the object through a microscope and a lens array, and acquiring the 2D image through the microscope,
Wherein the obtaining of the optical field data and the two-
Acquiring the optical field data from the optical field image, and obtaining the two-dimensional image data from the obtained two-dimensional image.
Wherein the obtaining of the optical field data and the two-
Acquiring the optical field data from an area of interest of the optical field image and obtaining the 2D image data from an area of the obtained 2D image corresponding to the area of interest.
Wherein the step of acquiring the light field image and the two-
And acquiring the optical field image and the two-dimensional image at a synchronized time.
Generating a viewpoint image of the second resolution using the upsampled optical field data; And
And displaying the viewpoint image of the second resolution.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150158171A KR101801841B1 (en) | 2015-11-11 | 2015-11-11 | Apparatus and method for processing image |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150158171A KR101801841B1 (en) | 2015-11-11 | 2015-11-11 | Apparatus and method for processing image |
Publications (2)
Publication Number | Publication Date |
---|---|
KR20170055242A KR20170055242A (en) | 2017-05-19 |
KR101801841B1 true KR101801841B1 (en) | 2017-11-27 |
Family
ID=59049677
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020150158171A KR101801841B1 (en) | 2015-11-11 | 2015-11-11 | Apparatus and method for processing image |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101801841B1 (en) |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101563729B1 (en) * | 2008-10-10 | 2015-10-27 | 삼성전자주식회사 | Apparatus and method for processing image to generate high resolution image |
-
2015
- 2015-11-11 KR KR1020150158171A patent/KR101801841B1/en active IP Right Grant
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101563729B1 (en) * | 2008-10-10 | 2015-10-27 | 삼성전자주식회사 | Apparatus and method for processing image to generate high resolution image |
Also Published As
Publication number | Publication date |
---|---|
KR20170055242A (en) | 2017-05-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR101978896B1 (en) | Stereo rendering system | |
US10373362B2 (en) | Systems and methods for adaptive stitching of digital images | |
JP5887267B2 (en) | 3D image interpolation apparatus, 3D imaging apparatus, and 3D image interpolation method | |
US10715791B2 (en) | Virtual eyeglass set for viewing actual scene that corrects for different location of lenses than eyes | |
US9386300B2 (en) | Portable device and method for controlling the same | |
US9049423B2 (en) | Zero disparity plane for feedback-based three-dimensional video | |
RU2519518C2 (en) | Stereoscopic image generator, method for stereoscopic image generator, and programme | |
WO2014160342A1 (en) | Low latency stabilization for head-worn displays | |
CN108259883B (en) | Image processing method, head-mounted display, and readable storage medium | |
KR20130138177A (en) | Displaying graphics in multi-view scenes | |
WO2013067683A1 (en) | Method and image acquisition system for rendering stereoscopic images from monoscopic images | |
JP2014011574A (en) | Image processing device, imaging device, image processing method, and program | |
EP2787735A1 (en) | Image processing device, image processing method and program | |
KR102450236B1 (en) | Electronic apparatus, method for controlling thereof and the computer readable recording medium | |
CN113168235A (en) | Gaze-driven video recording | |
WO2018052859A1 (en) | Flat digital image sensor | |
US10148931B2 (en) | Three-dimensional video image display processing device, video information recording medium, video information providing server, and recording medium storing a program | |
CN107483915B (en) | Three-dimensional image control method and device | |
US20180041751A1 (en) | Information processing apparatus, information processing method, and storage medium | |
JP2011199556A (en) | Stereoscopy imaging device, stereoscopic signal generator, and program | |
KR101801841B1 (en) | Apparatus and method for processing image | |
Kuo et al. | Perspective-Correct VR Passthrough Without Reprojection | |
Liu et al. | Dynamic mapping for multiview autostereoscopic displays | |
KR101614121B1 (en) | Apparatus and method for displaying integrated image | |
Alonso | Stereoscopic 3d-scene synthesis from a monocular camera with an electrically tunable lens |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
A201 | Request for examination | ||
E902 | Notification of reason for refusal | ||
E902 | Notification of reason for refusal | ||
E701 | Decision to grant or registration of patent right | ||
GRNT | Written decision to grant |