KR20230016781A - A method of producing environmental contents using AR/VR technology related to metabuses - Google Patents

Abstract

A VR content generating system according to the present invention includes: an imaging part installed in an image generating device and acquiring the 2D image of a target item by photographing the target item from various angles; a server for receiving the 2D image, providing a 3D image editing environment, and generating the edited 3D image as VR content; and a terminal for transmitting the 2D image captured by the imaging part to the server and transmitting an image editing command.

Description

A method of producing environmental contents using AR/VR technology related to metabuses}

The present invention relates to a VR content creation system, and more particularly, to a VR content creation system capable of generating and providing VR content by receiving a plurality of 2D images of objects photographed from various angles from a user.

VR (Virtual Reality) refers to a technology that provides a 3D environment created by a computer so that people can experience as if they are interacting with a real environment. Recently, VR technology is being applied and developed in various fields such as video, advertisement, medical care, and education beyond the field of entertainment and games.

In the case of advertising, conventional two-dimensional flat images are provided to consumers through images or videos, and consumers select products they want through images or videos. However, in this method, the product purchase decision is made by looking only at one side of the product prepared by the advertisement producer, and the difference between the delivered product and the purchased product significantly deteriorates, and even returns of the product occur.

Recently, technologies for producing advertisements using virtual reality are being developed in order to more effectively inform consumers of products.

Publication No. 2002-0005336 proposes an advertising method that can find an advertising product using virtual reality modeling, and outputs a virtual three-dimensional space having information on a moving route on a screen, each point It is configured to display an advertisement selection window by category, select an advertisement, and display the corresponding advertisement.

As an example of another advertisement using VR, the advertisement technique in virtual reality space of Laid-open Patent Publication No. 2000-0037114 provides users with a virtual space in the form of a house in real life on the Internet and uses actual product models provided by advertisers. It is providing users with the ability to decorate the inside of their homes using items containing the logos or product names of advertisers and companies.

An object of the present invention is to provide a VR content creation system capable of generating VR content by converting a 2D image captured by a user into a 3D image.

An object of the present invention is to provide a VR content creation system capable of checking products from various viewpoints in a virtual reality space.

The problem to be solved by the present invention is not limited to the above-mentioned problem. Other technical problems not mentioned will be clearly understood by those skilled in the art from the following description.

The VR content creation system according to the present invention includes an imaging unit mounted on an image generating device and acquiring 2D images of a target product by photographing a target product from various angles, receiving the 2D image, providing a 3D image editing environment, and editing the image. It comprises a server for generating VR content from the 3D image, and a terminal for transmitting the 2D image captured by the imaging unit to the server and transmitting an image editing command.

In addition, the image generating device includes a turntable installed on the upper side of the body, a “c” shaped turntable installed on the side of the body and rotating based on a horizontal axis of the side, and a turntable installed on the turntable and the upper center of the turntable It consists of a camera holder and a control unit, which are installed so as to face the upper center of the turntable at all times when the rotary table rotates.

The server of the VR contents creation system according to the present invention includes a user information unit receiving user identification information and target product identification information, a database for recording user information, 2D images, 3D images, and VR contents, and a user terminal to 2D images. It includes an editing screen providing unit providing an editing screen for the object, and a VR contents generating unit converting 3D images into VR contents.

In addition, the editing screen provision unit consists of a viewer editing module and an object correction module. The viewer editing module performs functions of image rotation, rotation direction adjustment, and rotation axis adjustment, and the object correction module performs functions of removing object background and image color correction. do.

In addition, the object background removal is composed of an image sharpening step, a binarization step, an apparent line detection step, and a background separation step, and the user is provided to select an algorithm for detecting the apparent line.

According to the present invention, the user's satisfaction with VR content can be improved by allowing the user to directly edit the captured product image.

In addition, a plurality of images taken while rotating the product from various angles can be displayed as a 3D image at the speed and angle desired by the user, so that the user can examine the side of the product that the user wants to see, increasing customer satisfaction.

In addition, since the background image excluding the product can be removed from the captured image, the degree of concentration on the product in the provided VR content can be increased.

In addition, detailed description of the product can be added by providing a tag at a specific position of the rotating product.

1 shows a VR content creation system according to the present invention.
2 shows an image generating device equipped with an imaging unit according to the present invention.
3 illustrates a position where an image of a target article is captured using an image generating device.
4 shows a server according to the present invention.
5 shows an edit screen providing unit according to the present invention.
6 shows a background removal process according to the present invention.

The mounting portion is positioned at the first height. When the tentable stops after rotating 10 degrees, the camera captures an image of the target object at the first height. The turntable then rotates another 10 degrees. When the rotation of the turntable and the imaging of the camera are repeated and the turntable completes one rotation, all 36 captured images are acquired at the first height. In this way, when all images are captured at the first height, the controller raises the camera holder to a second height higher than the first height. The turntable rotates once, and when all 36 captured images are acquired at the second height, the camera holder is raised from the second height to the third height.

In the present invention, the turntable rotates at intervals of 10 degrees and then stops, and then imaging is performed as an embodiment, but the turntable may be driven to continuously rotate without stopping. In this case, imaging may be performed by setting an imaging mode of a camera installed in the camera holder to a continuous shooting mode. In addition, in the case of capturing an image of the lower part of the target article, after installing a transparent support on the top of the turntable, the target article may be placed on the upper part of the transparent support and image pickup may be performed.

3 shows imaging positions. When the unit height is set to 8, multiple imaging is performed from the lowest position, the first height C1, to the highest position, the eighth height C8. Referring to the drawing, it shows that the target article is captured from various angles at a fifth height (C5). Each point represents an imaging angular position.

In imaging according to the present invention, background imaging may be performed prior to such a target object. Background imaging refers to imaging without placing an object on the turntable. The background imaging is performed while the turntable is stopped, and one background imaging image is acquired at each height (C1 to C8). In the drawing, H1 to H8 indicate points where background imaging is performed. After background imaging has been performed, the target object is placed on top of the turntable and target object imaging is started. The background imaging may be used for image processing to separate a background from a 2D image. For example, an image of only the target article may be obtained by overlapping a captured image of the target article with a captured background image and then deleting the background from the detected image of the target article.

The captured image of the target product may include identification information including captured location information. For example, if the captured image is ITG_P025_256.jpg, ITG is the target product identification code, 025 means an angle captured at a height of 25 degrees from the direct downward direction, and 256 is the 256th image among images captured at a height of 25 degrees indicates that

In the present invention, as a captured image of a target product, imaging using an image generating device has been described as an embodiment, but the captured image of the target product can be obtained using another type of image generating device without necessarily being limited thereto. .

In addition, the captured image according to the present invention can acquire the captured image of the target product even when the user captures images from various angles using the portable terminal. In this case, the user may capture a plurality of captured images along the periphery of the target product in a state in which the location of the target product is fixed.

As described above, it is sufficient to acquire images obtained by capturing a target product from various angles and different directions in the captured image according to the present invention.

The 2D images captured in this way are transmitted to the terminal. The terminal transmits and receives data to and from the server. The terminal may be a smart phone, a PDA, a laptop computer, or a user PC.

Meanwhile, instead of the camera coupled to the camera holder, a terminal including a camera may be coupled.

The 2D image captured by the imaging unit is transmitted to the server along with user information through the terminal. The server 200 converts the captured 2D image into a 3D image and creates VR content. The server receives 2D images from terminals. Also, the server receives a user command from the terminal. The server converts 2D images according to user commands and creates VR contents. The server may output the generated VR contents to the terminal according to the request of the terminal.

4 shows a server according to the present invention.

The server 200 includes a user information unit 210, a database 220, an editing screen providing unit 230, and a VR contents generating unit 240.

The user information unit 210 receives user identification information and target product identification information from the user's terminal. The user information unit is connected to a database and displays user-related content.

The user identification information may include a user's ID. The user ID is associated with the user's name, email, phone number, and the like. The target product identification information may include a target product identification code, a height angle, and an image index.

The database 220 records user information, 2D images, converted 3D images, and VR contents received from the user's terminal.

The editing screen providing unit 230 receives the 2D image stored in the database and provides the editing screen to the user terminal. When the editing is completed according to the user's input command, the VR content generating unit 240 converts the 3D image into VR content. convert The converted VR contents are stored in the database.

5 shows an editing screen providing unit according to the present invention.

The editing screen providing unit 230 according to the present invention includes a viewer editing module 231 and an object correction module 232 . The viewer editing module 231 is composed of an image rotation function, a rotation direction adjustment function, and a rotation axis adjustment function. The image rotation function provides a function of rotating a target item in a VR image by a user's touch operation or drag operation. The rotation direction adjusting function determines the rotation direction of the viewer. For example, when dragging from left to right on the screen, an image viewed from the right side of the target item is displayed accordingly. At this time, a speed of dragging from left to right may be detected, and a display function may be provided in proportion to the speed of rotation from left to right.

On the other hand, it is not easy to place the target object at the exact central point of the turntable. Accordingly, the axis of rotation adjustment function adjusts the axis of rotation so that the plurality of 2D images captured have the same center of imaging, and the object included in the final VR image It is adjusted so that there is no shaking even when the article is rotated. Accordingly, a stable and balanced rotation viewer can be provided.

The object correction module includes an object background removal function and an image color correction function. The object background removal function performs a function of removing a background excluding a target item from a captured image. A detailed description of this will be given later.

The image color correction function compensates for shade and blurred parts included in the image. This correction increases the color tone and contrast to obtain a clear image. For example, color correction may be implemented by applying effects such as a smart filter, a miniature filter, a tilt shift filter, and the like.

The image color correction function may be selectively applied before and after the background removal function to perform image correction. When the image color correction function is performed before the background removal function, the image color correction function may be performed as a preprocessing step for clearly distinguishing a boundary line for removing the background. In addition, when the image color correction function is performed after the background removal function, the image color correction function makes the target product have a vivid and clear visual effect, giving a feeling of looking at a three-dimensional real object on the screen.

6 shows a background removal process according to the present invention.

The background removal function according to the present invention may include an image sharpening step, a binarization step, an outline detection step, and a background separation step.

The image sharpening and binarization steps are performed as preprocessing steps for detecting an outline. The sharpening step sharpens the original image in order to separate the object from the background. For example, after a blur process is performed on the entire captured image, a clear image is corrected through color contrast. This makes clear the boundary of the background of the target article.

The binarization step removes RGB information from the captured image and extracts it using contrast information, which simplifies the amount of processing and shortens the amount of calculation in subsequent image processing. For example, the black-and-white image may be converted into an 8-bit image. After the binarization step, a miscellaneous processing process may be performed. Accordingly, the boundary between the target article and the background can be easily obtained.

In the detecting of the outline, a part in which a discontinuous difference in brightness and density of pixels is abrupt is detected as an outline. The detection of the outline may be performed using a Sobel edge algorithm or a Canny edge algorithm. Such an algorithm can be selected by the user on the edit screen of the terminal. In particular, outline detection using the Sobel edge operator shows detection performance that is sensitive to brightness, although the calculation speed is slow.

In the present invention, as an outline detection step, an outline is detected using a Sobel edge operator. The Sobel edge operator calculates the derivatives in the X and Y directions using a vertical mask and a horizontal mask, and combines the derivatives in the X and Y directions, respectively, to obtain the edge size (E(x,y)) at the point (x, y) and the slope direction (θ) are obtained. In the present invention, the Sobel boundary value is set to a low boundary value. A low boundary value includes multiple images around the outline, so a lot of computation is required, but the boundary can be clearly extracted. The direction of the slope is rounded to a plurality of divided angular directions for later steps. When the detection of the outline is completed in this way, the inside of the outline is defined as the target article area, and the outside of the outline is defined as the background area. In the background separation step, an image including only the target object is obtained by removing a region defined as a background. The background is deleted from the original image by overlapping the image in which the outline is detected from the original image and then deleting the image outside the detected outline.

When background separation is complete, a series of 2D images are created as one 3D image. Specifically, imaging of one target item combines a plurality of 2D images as a 3D image of one target item. The combined image has a visual effect as if it is viewed as a 3D image of the target product according to the user's input command.

For example, when a user drags with a finger using a terminal, a predetermined number of images are continuously output according to the dragged distance.

When editing is completed in this way, the edited 3D image is converted into VR content. The conversion generates a VR content file from a 3D image using user identification information and target item identification information of user information. The user can connect to the server through the terminal, download VR content, and use it for advertisement. For target product images used in conventional advertisements, it is necessary to determine whether or not to purchase a product by looking at only a few target product images photographed at a set angle. VR content according to the present invention allows consumers to observe a product in a desired location and direction, thereby increasing their understanding of the target product.

In the above, the present invention has been described in detail through specific embodiments, but the present invention is not limited to the above embodiments, and various modifications are possible by those skilled in the art within the scope of the technical idea of the present invention.

Claims (1)

image generating device;
an imaging unit mounted on the image generating device and acquiring 2D images of the target article by photographing the target article from various angles;
A server receiving the 2D image, providing a 3D image editing environment, and generating the edited 3D image as VR content; and
A terminal for transmitting the 2D image captured by the imaging unit to the server and transmitting an image editing command;
The server includes an editing screen providing unit providing an editing screen for a 2D image to the terminal, and the editing screen providing unit includes a viewer editing module, wherein the viewer editing module rotates an image, adjusts a rotation direction, and controls a plurality of 2D images. VR content creation system, characterized in that performing a rotation axis adjustment function for adjusting the rotation axis so that they have the same imaging center.

Images