KR101653353B1 - Method for representing virtual 3-Dimensional image based on virtual 3-Dimensional application in smart-phone - Google Patents
Method for representing virtual 3-Dimensional image based on virtual 3-Dimensional application in smart-phone Download PDFInfo
- Publication number
- KR101653353B1 KR101653353B1 KR1020150042664A KR20150042664A KR101653353B1 KR 101653353 B1 KR101653353 B1 KR 101653353B1 KR 1020150042664 A KR1020150042664 A KR 1020150042664A KR 20150042664 A KR20150042664 A KR 20150042664A KR 101653353 B1 KR101653353 B1 KR 101653353B1
- Authority
- KR
- South Korea
- Prior art keywords
- image
- virtual
- display
- light source
- photographed
- Prior art date
Links
Images
Classifications
-
- H04N13/0011—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
-
- H04N13/0402—
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
- H04W88/02—Terminal devices
Abstract
Description
The present invention relates to a virtual 3D display method based on a smartphone virtual 3D display application, and more particularly, to a smart 3D virtual display application based on a smart phone virtual 3D display method for allowing a user to arbitrarily adjust the position and intensity of a light source, Based virtual 3D presentation method.
In order to impose a realistic three-dimensional effect on a two-dimensional screen, a method of constructing a three-dimensional screen through a pipeline of a conventional three-dimensional graphics is generally used. This requires realistic modeling, texture representation, shading, and so on of real objects or objects.
In order to express reality realistically by using such conventional three-dimensional graphics, a lot of processes and efforts must be imposed. Therefore, it is general that an advertisement about a real object utilizes a still image, a moving image, and the like. However, in this case, there is a disadvantage that it can not give a three-dimensional stereoscopic effect.
Therefore, in order to realize realistic images, it is necessary to use techniques to increase the intuitiveness by using images photographed with real photographs, and to minimize the manufacturing cost and time in production.
There are video based lighting techniques for this. Image-based lighting is an attempt to model the reflection characteristics of real objects, and modeling of the reflection characteristics is indispensable to generate realistic scenes. In most cases, however, the reflective characteristics of the modeled object are very complex and very difficult to represent.
Accordingly, in the related art, the present invention focuses on the fact that, when the image-based lighting technique is performed in a smart phone by receiving image information of an image, the reflection characteristic of the object surface can be expressed using BRDF data In principle, if the BRDF data is measured on the object surface, accurate scene generation is possible. However, since BRDF data measurement also requires a lot of time and cost, there is a limit to utilize it. Therefore, the technology development to overcome these limitations is proposed I want to.
[Related Technical Literature]
1. A system and method for converting a three-dimensional object represented by a triangular mesh into a Dosurface representation method (Patent Application No. 10-2012-0022397 number)
2. REPRESENTATION AND RECORDING SYSTEM FOR DEPTH INFORMATION OF 3D OBJECT (Patent Application No. 10-2012-0020216)
3. SYSTEM AND METHOD FOR REPRESENTING 3D CONVEX OBJECT USING GEOMETRIC TEXTURE (Patent Application No. 10-2011-0038514)
SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and it is an object of the present invention to provide a method of displaying a 3D display by measuring a BRDF data from a plurality of scene images without directly measuring the BRDF data, And to provide a virtual 3D display method based on a smart phone virtual 3D display app to overcome the limitations of a large amount of time and cost in the case of image modeling and image remodeling.
In addition, since the present invention uses images directly, it does not require complicated geometric information, can save time and cost for measuring BRDF data, and allows the user to arbitrarily adjust the position and intensity of the light source, To provide a virtual 3D display application-based virtual 3D representation method for a smartphone.
In addition, since the present invention can represent a rotation at a fixed time when a photographing form of a video image is a panorama image or a sphere image, a smart phone Virtual 3D display App-based virtual 3D presentation method.
However, the objects of the present invention are not limited to the above-mentioned objects, and other objects not mentioned can be clearly understood by those skilled in the art from the following description.
In order to achieve the above object, a smartphone virtual 3D display app based virtual 3D display system according to an embodiment of the present invention constructs a radiance map from at least two or more scene images and then measures BRDF data from the radiance map A cloud-based server system (10) for performing image modeling to represent a 3D display, And reconstructs the reconstructed image by using the
In order to achieve the above object, a smartphone virtual 3D display app-based virtual 3D display method according to an embodiment of the present invention is a method of displaying a virtual 3D display app based on a smartphone, in which a cloud-based
After the second step, when the virtual 3D display application 30a of the
If the intensity of the light source and the position of the light source are given as the light source parameter information for each light source, the virtual 3D display application 30a compresses the light source using the coefficients (coefficient parameters) obtained in the light source modeling process The BRDF data is reconstructed, the radiance map is reconstructed using the reconstructed BRDF data, and then the actual RGB image is generated and represented through the tone mapping method for the radiance map.
The smartphone virtual 3D display app-based virtual 3D display method according to the embodiment of the present invention constructs a radiance map from a plurality of scene images without directly measuring the BRDF data and measures BRDF data therefrom In the case of image modeling and image remodeling to represent a 3D display, it provides an effect of overcoming limitations that require a lot of time and cost of measurement.
That is, since the image is directly used, the time and cost for measuring BRDF data can be reduced without requiring complicated geometric information, and the user can arbitrarily adjust the position and intensity of the light source, This provides a possible effect.
In addition, according to another embodiment of the present invention, a smart 3D virtual display application-based virtual 3D representation method is a method of representing a rotation at a fixed time when a photographing form of a video image is a panorama image or a sphere image So that it provides a high-quality visualization effect due to a change in realistic illumination.
1 is a diagram illustrating a virtual 3D display system based on a smartphone virtual 3D display app according to an embodiment of the present invention.
2 is a diagram showing a
3 is a diagram for explaining the structure of a data packet for image information transmitted from the cloud-based
4 is a diagram illustrating a process performed by the cloud-based
5 is a diagram illustrating a process performed by the
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a detailed description of preferred embodiments of the present invention will be given with reference to the accompanying drawings. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.
In the present specification, when any one element 'transmits' data or signals to another element, the element can transmit the data or signal directly to the other element, and through at least one other element Data or signal can be transmitted to another component.
1 is a diagram illustrating a virtual 3D display system based on a smartphone virtual 3D display app according to an embodiment of the present invention. Referring to FIG. 1, a virtual 3D display application based virtual 3D display system of a smartphone displays objects / objects in a virtual 3D form in a
The virtual 3D display app 30a is a program for expressing a virtual 3D display and is an app program for designing an object / object to be displayed in 3D by using depth and lighting on a liquid crystal screen of a
The
The cloud-based
Accordingly, the virtual 3D display app 30a of the
2 is a diagram showing a
3 is a diagram for explaining the structure of a data packet for image information transmitted from the cloud-based
The cloud-based
The light source modeling for virtual 3D representation by the cloud-based
Referring to FIG. 4, the steps related to the light source modeling performed by the cloud-based
[Step 1 (step 1-1): radiance map sampling process]
The cloud-based
Thereafter, the cloud-based
Here, the radiance map can be obtained by fixing the camera and photographing an object with different exposure times at a predetermined interval in the horizontal direction and the vertical direction.
[Step 2 (stetp 1-2): Bidirectional Reflectance Distribution Function (BRDF) measurement procedure]
Since the characteristics of the surface of the object / object are information reflected from the light source, the BRDF data is necessary for the
Accordingly, the cloud-based
[Step 3 (stetp 1-3): Data Compression Process]
The BRDF data obtained in the second step is inefficient because it actually requires a lot of storage space. Therefore, the cloud-based
The mathematical methods for storing compressed BRDFs are described in Brian's method (C. Brian, M. Nelson and S. Rebecca, "Bidirectional reflection functions from surface bump maps," In Computer Graphics, SIGGRAPH87, vol.21, -281, 1987.) The Brian method is a method for efficiently storing compressed BRDF data by using spherical harmonics. The position of the light source is varied to obtain coefficients using previously obtained BRDF data, The coefficient is again used to obtain BRDF data at an arbitrary position.
The light source reconfiguration process of the
That is, the virtual 3D display application 30a of the
[Step 1 (step 2-1): Radiance map reconstruction process]
When the intensity of the light source and the position of the light source are given as the light source parameter information for the arbitrary light source, the virtual 3D display app 30a restores the compressed BRDF data using the coefficient (coefficient parameter) obtained in the third step of the light source modeling And then reconstructs a new radiance map by using it.
[Step 2-2: Scene Rendering Process]
The virtual 3D display application 30a creates an actual RGB image through the tone mapping method for the new radiance map acquired in the first step. At this time, in order to change the actual brightness to the brightness of the screen, the virtual 3D display app 30a must consider two aspects, namely, visualization and contrast control.
First, the visualization that the virtual 3D display application 30a should be displayed on the screen for an object / object actually displayed and the brightness in the real world have a brightness value in a wide range. Therefore, When the brightness value is changed to the brightness value on the upper side, it is the contrast of contrast which should be contrasted with the brightness value displayed on the UI screen.
In order to satisfy these two requirements, the virtual 3D display application 30a uses an adaptive histogram method (GJ Ward, H. Rushmeier and C. Piatko, "A " Technical Report, LBNL-39882, Lawrence Berkeley National Laboratory, 1997.).
For the reconstructed image, the virtual 3D display application 30a displays a variety of images in the
That is, in order to provide a stereoscopic effect to a video creator who provides an image to a cloud-based
In addition, the contents of the present invention can extract the same information through the stereoscopic camera existing in the image photographing step. In other words, if the proposed algorithm is acquired simultaneously through two cameras with different time differences, a stereoscopic effect through binocular disparity may be provided.
In this case, it is possible to provide the stereoscopic image and the realistic brightness according to the illumination, so that the
The present invention can also be expressed as a computer-readable code on a computer-readable recording medium. A computer-readable recording medium includes all kinds of recording apparatuses in which data that can be read by a computer system is stored.
Examples of the computer-readable recording medium include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and also expressed in the form of a carrier wave (for example, transmission over the Internet) .
The computer readable recording medium may also be distributed over a networked computer system so that computer readable code can be stored and executed in a distributed manner. And functional programs, codes, and code segments for representing the present invention can be easily inferred by programmers of the art to which the present invention pertains.
As described above, preferred embodiments of the present invention have been disclosed in the present specification and drawings, and although specific terms have been used, they have been used only in a general sense to easily describe the technical contents of the present invention and to facilitate understanding of the invention , And are not intended to limit the scope of the present invention. It is to be understood by those skilled in the art that other modifications based on the technical idea of the present invention are possible in addition to the embodiments disclosed herein.
10: Cloud-based server systems
20: Network
30: Smartphone
30a: Virtual 3D display app
30b: Virtual 3D display
Claims (4)
The smartphone 30 is provided with a depth and a light that are virtually applied to an image photographed at various angles, and corresponds to a screen designed to allow a user to feel three-dimensional when viewing the naked eye. A stereoscopic image display range 2a using brightness and contrast difference and depth, an image display unit 3a for displaying an image photographed at various angles in various directions and angles, A virtual 3D display 30b in which an illumination device 4a for illuminating an image is separately formed;
The virtual 3D display 30b displays object and object information, displays a virtual 3D image, displays company information, receives image-modeled image information by the cloud-based server system 10, reconstructs it, The image obtained by photographing the image from various angles on the image display unit 3a among the stereoscopic image display range 2a using brightness and contrast difference and depth using the virtual 3D display 30b can be displayed in various directions A virtual 3D display app 30a for displaying and controlling the lighting device 4a, which is expressed to move at an angle, and applies illumination to an image taken at various angles; And a virtual 3D display system based on a smartphone virtual 3D display app,
In order for the cloud-based server system 10 to transmit image information to the smartphone 30 through the communication network 20, the image information 1 (image photographed from the front side), image information 2 (image photographed from the upper side) 3 images (images photographed from the back side), the light source exposure time is different from one viewpoint in order to obtain an image photographed at a differentiated angle according to the position and brightness of the light source and an image photographed at different brightness A first step of acquiring a plurality of input images obtained;
The cloud-based server system 10 can obtain one radiance map from the acquired image information 1 to image information 3, and generates all the radiance maps for each light source exposure time, A second step of obtaining an object by photographing an object with different exposure times in a horizontal direction and a vertical direction at a light source;
The cloud-based server system 10 has been proposed by Tien-Tsin Wong (Tien-Tsin Wong method: TT Wong, PA Heng, SH Or and WY Ng, "Image-based Rendering with controllable Illumination", In 8th EUROGRAPHICS (See Workshop on Rendering, pp. 13-22, 1997), and acquiring BRDF data from the radiance map obtained in the step 2;
The cloud-based server system 10 adopts the spherical harmonic compression method to compress and store the BRDF data. The BRDF data obtained by the spherical harmonic compression method is used as input data to obtain and store a coefficient, The mathematical method for storing the compressed BRDF is used in the Brian method (C. Brian, M. Nelson and S. Rebecca, "Bidirectional reflection functions from surface bump maps, "In Computer Graphics, SIGGRAPH87, vol.21, pp. 273-281, 1987);
The virtual 3D display application 30a restores the compressed BRDF data using the intensity of the light source for any light source given as the light source parameter information, the position of the light source, and the coefficient (coefficient parameter) obtained in the fourth step, A fifth step of reconstructing a new radiance map;
The virtual 3D display application 30a creates an actual RGB image through the tone mapping method on the new radiance map acquired in the fifth step and the virtual 3D display application 30a uses the image information 4 and the image information 5 Adaptive Histogram Method by Controlling Exposure Time (GJ Ward, H. Rushmeier and C. Piatko, "A visibility matching tone reproduction operator for high dynamic range scenes," Technical Report, LBNL-39882, Lawrence Berkely National Laboratory, A sixth step in which the actual brightness is changed to the brightness of the screen while satisfying the visualization and the contrast control;
The virtual 3D display application 30a displays the virtual 3D display 30b on the image representation unit 3a among the stereoscopic image display range 2a using the brightness and the contrast difference and depth for the reconstructed image A seventh step of expressing the image photographed at various angles by the program method so as to move the image in various directions and angles and controlling and expressing the illumination device 4a for applying the illumination to the images photographed at various angles, The light source modeling for the virtual 3D representation by the cloud-based server system 10 and the light source reconstruction of the smartphone 30 receiving the light source modeling data for the virtual 3D representation by the cloud- A virtual 3D display app based on a smart phone.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150042664A KR101653353B1 (en) | 2015-03-26 | 2015-03-26 | Method for representing virtual 3-Dimensional image based on virtual 3-Dimensional application in smart-phone |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020150042664A KR101653353B1 (en) | 2015-03-26 | 2015-03-26 | Method for representing virtual 3-Dimensional image based on virtual 3-Dimensional application in smart-phone |
Publications (1)
Publication Number | Publication Date |
---|---|
KR101653353B1 true KR101653353B1 (en) | 2016-09-01 |
Family
ID=56942773
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
KR1020150042664A KR101653353B1 (en) | 2015-03-26 | 2015-03-26 | Method for representing virtual 3-Dimensional image based on virtual 3-Dimensional application in smart-phone |
Country Status (1)
Country | Link |
---|---|
KR (1) | KR101653353B1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR101976801B1 (en) * | 2019-02-08 | 2019-05-09 | 주식회사 인포인 | System Providing 3D Video Optimization And Compression |
US20220123848A1 (en) * | 2019-01-21 | 2022-04-21 | Nec Corporation | Wireless communication quality visualization system, wireless communication quality visualization device, and measurement apparatus |
KR102577793B1 (en) * | 2022-07-22 | 2023-09-12 | 주식회사 트리플 | System for generating 3D product showcase |
Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20130085051A (en) * | 2010-12-01 | 2013-07-26 | 알까뗄 루슨트 | Method and devices for transmitting 3d video information from a server to a client |
-
2015
- 2015-03-26 KR KR1020150042664A patent/KR101653353B1/en active IP Right Grant
Patent Citations (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20130085051A (en) * | 2010-12-01 | 2013-07-26 | 알까뗄 루슨트 | Method and devices for transmitting 3d video information from a server to a client |
Non-Patent Citations (1)
Title |
---|
김모곤, 김성진, 정순기, "라디안스 맵을 이용한 광원 모델링", 정보과학회 논문지 - 시스템 및 이론, 제28권 제9·10호, pp. 491-498(2001.10.)* * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20220123848A1 (en) * | 2019-01-21 | 2022-04-21 | Nec Corporation | Wireless communication quality visualization system, wireless communication quality visualization device, and measurement apparatus |
KR101976801B1 (en) * | 2019-02-08 | 2019-05-09 | 주식회사 인포인 | System Providing 3D Video Optimization And Compression |
KR102577793B1 (en) * | 2022-07-22 | 2023-09-12 | 주식회사 트리플 | System for generating 3D product showcase |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN114119839B (en) | Three-dimensional model reconstruction and image generation method, equipment and storage medium | |
CN105704479B (en) | The method and system and display equipment of the measurement human eye interpupillary distance of 3D display system | |
WO2012132234A1 (en) | Image rendering device for rendering entire circumferential three-dimensional image, image rendering method, and image rendering program | |
TW201706734A (en) | Method and device for encoding three-dimensional scenes which include transparent objects in a holographic system | |
JP7201869B1 (en) | Generate new frames with rendered and unrendered content from the previous eye | |
JP2016018560A (en) | Device and method to display object with visual effect | |
KR101885090B1 (en) | Image processing apparatus, apparatus and method for lighting processing | |
CN107390379A (en) | A kind of nearly eye hologram three-dimensional display system and display methods | |
KR101653353B1 (en) | Method for representing virtual 3-Dimensional image based on virtual 3-Dimensional application in smart-phone | |
Matsubara et al. | Light field display simulation for light field quality assessment | |
US20230075050A1 (en) | Kernel reshaping-powered splatting-based efficient image space lens blur | |
CN107846584B (en) | The adaptive desktop synchronized projection method of virtual reality based on scene management development library | |
EP3057316B1 (en) | Generation of three-dimensional imagery to supplement existing content | |
CN109214979B (en) | Method and apparatus for fusing objects in panoramic video | |
JP2023505235A (en) | Virtual, Augmented, and Mixed Reality Systems and Methods | |
US20230274494A1 (en) | Cropping for efficient three-dimensional digital rendering | |
JP7387029B2 (en) | Single-image 3D photography technology using soft layering and depth-aware inpainting | |
EP4068216A1 (en) | 3d digital model surface rendering and conversion | |
US11941782B2 (en) | GPU-based lens blur rendering using depth maps | |
JP7447266B2 (en) | View encoding and decoding for volumetric image data | |
Zhou | Accurate depth based post-processing for perception enhancement in real time three-dimensional graphics | |
KR102654323B1 (en) | Apparatus, method adn system for three-dimensionally processing two dimension image in virtual production | |
JP7419908B2 (en) | Image processing system, image processing method, and program | |
CN117173314B (en) | Image processing method, device, equipment, medium and program product | |
JP2004200784A (en) | Three-dimensional video terminal device, program and recording medium |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
E701 | Decision to grant or registration of patent right | ||
GRNT | Written decision to grant | ||
FPAY | Annual fee payment |
Payment date: 20190604 Year of fee payment: 4 |