KR20200117447A - Apparatus and method for providing interior film design service using virtual reality - Google Patents

Abstract

The present invention relates to an interior film design service providing apparatus and a method thereof and, more specifically, to an apparatus for providing an interior film design service using a virtual reality technology and a method thereof. In addition, according to the present invention, the interior film design service providing method using a head mounted display comprises the steps of: displaying a virtual interior space through a user interface provided on the head mounted display; detecting a rotation angle of the head or face of a user wearing the head mounted display, and setting a viewpoint corresponding to the gaze of the user on the virtual interior space; providing an interior film design service for the virtual interior space based on the movement of the viewpoint; and providing the interior film design service for the virtual interior space based on the movement of the viewpoint.

Description

Method and device for providing interior film design service using virtual reality {APPARATUS AND METHOD FOR PROVIDING INTERIOR FILM DESIGN SERVICE USING VIRTUAL REALITY}

The following embodiments relate to an apparatus and method for providing an interior film design service, and more specifically, to an apparatus and method for providing an interior film design service using virtual reality technology.

In general, interior materials (including film and sheet paper) are used for various purposes such as interior flooring of buildings, furniture finishing materials, and wallpaper for the purpose of interior decoration, and are relatively inexpensive and easy to process. Easy to install with adhesive.

In addition, as products of various designs composed of various shapes and shapes are released, they are attached to a large area of the room to make the space presentation more cozy and elegant in composing the interior of the room, while also providing a decorative effect.

Among these interior materials, the interior film has a certain thickness and width according to its intended use, and is manufactured in a form wound on a roll with a predetermined length in a state in which a predetermined design (pattern) is designed on its surface. In order to promote or explain the product to contractors or general consumers, the interior film produced in this way is cut into a certain size to produce a sample interior film, and then the interior film sample book is separately produced by attaching the interior film for the sample to the cover. Or, it is taking a method of providing a sample interior film produced in a certain size to consumers through a communication network.

It would be good if an embodiment in which such an interior film was used as a finishing material for the furniture was provided using virtual reality.

Publication No. 10-2017-0024933 Publication No. 10-2002-0000704

One embodiment proposes an apparatus and method for providing an interior film design service that improves the user's operation convenience and the user's real sense of reality by using a head mounted display.

Specifically, one embodiment proposes an apparatus and method for providing an interior film design service for a virtual interior space using a user's gaze by applying a virtual reality technology based on a head mounted display.

According to an embodiment, a method for providing an interior film design service using a head mounted display includes: displaying a virtual interior space through a user interface provided on the head mounted display; Setting a viewpoint corresponding to the user's gaze on the virtual interior space by detecting a rotation angle of the user's head or face on which the head mounted display is worn; Providing an interior design service for the virtual interior space based on the movement of the viewpoint; And providing an interior film design service for the virtual interior space based on the movement of the viewpoint.

In addition, the present invention provides an interior film design service providing apparatus used in a head mounted display, comprising: a display unit for displaying a virtual interior space through a user interface provided on the head mounted display; A setting unit configured to set a viewpoint corresponding to the user's gaze on the virtual interior space by detecting a rotation angle of a user's head or face on which the head mounted display is worn; And a providing unit that provides an interior design service and an interior film design service for the virtual interior space based on the movement of the viewpoint.

Embodiments may propose an apparatus and method for providing an interior film design service that improves the user's operation convenience and the real sense of reality felt by the user by using a head mounted display.

Specifically, one embodiment may propose an apparatus and method for providing an interior film design service for a virtual interior space using a user's gaze by applying a virtual reality technology based on a head mounted display.

1 is a diagram illustrating a head mounted display on which an apparatus for providing an interior film design service is mounted according to an exemplary embodiment.
2 is a diagram illustrating a user interface in which a virtual interior space is displayed according to an exemplary embodiment.
3A to 3E are diagrams illustrating a user interface for providing an interior film design service for a virtual interior space according to an exemplary embodiment.
4 shows a deep learning system using image patterning based on a convolutional neural network.
5 is a diagram illustrating a block configuration of a patterning module used in a deep learning system using image patterning based on a convolutional neural network according to an embodiment of the present invention.
6 is a flow chart showing a method of providing an interior film design service according to an embodiment.
7 is a block diagram showing an apparatus for providing an interior film design service according to an embodiment.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. However, the present invention is not limited or limited by the embodiments. In addition, the same reference numerals shown in each drawing denote the same member.

In addition, terms used in the present specification are terms used to properly express preferred embodiments of the present invention, which may vary depending on the intention of users or operators, or customs in the field to which the present invention belongs.

Accordingly, definitions of these terms should be made based on the contents throughout the present specification.

1 is a diagram illustrating a head mounted display on which an apparatus for providing an interior film design service is mounted according to an exemplary embodiment.

Referring to FIG. 1, an apparatus for providing an interior film design service 110 according to an embodiment is mounted inside or outside the head mounted display 100, or connected to the head mounted display 100, so that the head mounted display 100 Provides interior film design service to users who are worn. Hereinafter, a case where the interior film design service providing device 110 is mounted inside the head mounted display 100 will be described.

The head mounted display 100 may include a lens 120 and a display panel 130 disposed to correspond to each of the user's left and right eyes, and a mount 140 for fixing the lens 120 and the display panel 130. have.

However, the present invention is not limited or limited thereto, and the head mounted display 100 may be formed in various structures that provide a virtual reality image to a user.

The interior film design service providing device 110 provides interior film design services through a user interface provided to the head mounted display 100. Hereinafter, the user interface may be provided in the form of a virtual reality image through the lens 120 and the display panel 130 included in the head mounted display 100. A detailed description of this will be described below.

Therefore, the interior film design service providing apparatus 110 according to an embodiment provides an interior film design service using a user interface provided on the head mounted display 100, thereby providing the user's operational convenience and the user's actual sense of reality. Can be improved.

2 is a diagram illustrating a user interface in which a virtual interior space is displayed according to an exemplary embodiment.

Referring to FIG. 2, an apparatus for providing an interior film design service according to an embodiment displays a virtual interior space 210 through a user interface 200 provided on a head mounted display. Hereinafter, the user interface 200 may be provided in the form of a virtual reality image through a lens and a display panel included in the head mounted display, and may be provided to each of the user's left and right eyes according to the structure of the head mounted display.

Here, the virtual interior space 210 is a space that is a target of an interior film design service to be described later, and may be provided as a realistic virtual reality image as seen by the user in an actual interior space according to the movement of the user's head or face. have. For example, the interior film design service providing device predicts the user's gaze by detecting the rotation angle of the user's head or face using the head tracking function of the head mounted display, and provides a realistic sense of the user's gaze based on the predicted gaze. The virtual interior space 210 may be provided to a user through the user interface 200.

Accordingly, the interior film design service providing apparatus sets a viewpoint corresponding to the predicted user's gaze on the virtual interior space 210 as described above, so that the movement of the viewpoint (in this case, the viewpoint is the user's head or face). It provides an interior film design service for the virtual interior space 210 on the basis of (can adaptively move according to the movement of). Here, the movement of the viewpoint includes a gesture in which the viewpoint stays for a predetermined time in a specific area of the virtual interior space 210 or a virtual interior object disposed in the virtual interior space 210 or a gesture in which the viewpoint moves in the virtual interior space. I can. However, the present invention is not limited or limited thereto, and various gestures or a specific pattern formed by repeating gestures may be used as the motion of the viewpoint. A detailed description thereof will be described with reference to FIGS. 3A to 3C and 4A to 4D.

In addition, the apparatus for providing an interior film design service may display an object 211 corresponding to a viewpoint in the virtual interior space 210 so that a user may recognize the viewpoint. Hereinafter, since the object 211 corresponding to the viewpoint represents a viewpoint, the viewpoint is described with reference numerals of the object 211 corresponding to the viewpoint.

3A to 3E are diagrams illustrating a user interface for providing an interior film design service for a virtual interior space according to an exemplary embodiment.

3A to 3C, the apparatus for providing an interior film design service according to an embodiment arranges a virtual interior object based on the movement of the viewpoint 311 in the virtual interior space 310 displayed on the user interface 300. By ordering and moving, interior design services can be provided.

Specifically, referring to FIG. 3A, the apparatus for providing an interior film design service may display an object selection inventory 320 through the user interface 300. Here, the object selection inventory 320 is modeled so that actual interior accessories (e.g., interior furniture and products such as sofas, chairs, tables, frames, cabinets, or bookshelves) are optimized for virtual reality (a head that provides a virtual reality image). A plurality of virtual interior objects (data data suitable for the mound display) may be stored and constructed in advance.

For example, the interior film design service providing apparatus may display the object selection inventory 320 on the user interface 300 when the movement 312 of the viewpoint 311 matches a preset object selection inventory calling pattern. have.

For a more specific example, when the preset object selection inventory call pattern is a pattern that moves left and right for a preset time (eg, 2 seconds), the movement 312 of the viewpoint 311 is a pattern that moves left and right for a preset time. If matched, the interior film design service providing apparatus may display the object selection inventory 320 on the user interface 300.

In addition, referring to FIG. 3B, the apparatus for providing an interior film design service may select a virtual interior object 321 based on movements 313 and 314 of the viewpoint 311 on the object selection inventory 320.

For example, when the movement 313 of the viewpoint 311 is a gesture that moves on the object selection inventory 320, the interior film design service providing apparatus may move the viewpoint 311 on the object selection inventory 320 as if the cursor moves. A plurality of virtual interior objects displayed in may be passed. In addition, when the movement 314 of the viewpoint 311 is a gesture of staying for a preset time (eg, 2 seconds) in the virtual interior object 321 among a plurality of virtual interior objects displayed on the object selection inventory 320 , The interior film design service providing device may select a virtual interior object 321. However, the present invention is not limited or limited thereto, and various gestures may be used as the movements 313 and 314 of the viewpoint 311 considered in the process of selecting the virtual interior object 321, and the predetermined specific pattern described above is It can also be used.

When the virtual interior object 321 is selected as described above, the interior film design service providing apparatus may arrange the virtual interior object 321 in the virtual interior space 310 as shown in FIG. 3C. Although not shown in the drawings, the interior film design service providing apparatus additionally performs a process of allowing the user to confirm the selected virtual interior object 321 (similarly, a confirmation process based on the movement of the viewpoint 311), It is possible to improve reliability in a process in which the virtual interior object 321 is arranged.

In addition, referring to FIG. 3C, the apparatus for providing an interior film design service may move the virtual interior object 321 based on movements 315, 316, and 317 of the viewpoint 311.

For example, when the movement 315 of the viewpoint 311 is a gesture of staying for a preset time (eg, 2 seconds) in the virtual interior object 321 arranged in the virtual interior space 310, interior film design service is provided. The device may select the virtual interior object 321, and when the subsequent movement 316 of the viewpoint 311 is a gesture of moving on the virtual interior space 310, the interior film design service providing device is the selected virtual interior object The 321 may be moved according to the movement of the viewpoint 311. Thereafter, when the movement 317 of the viewpoint 311 is a gesture of staying for a preset time in a specific area of the virtual interior space 310, the interior film design service providing device is the virtual interior object 321 that has been moved to the specific area. Can be fixed to a specific area. Likewise, various gestures may be used as the movements 315, 316, and 317 of the viewpoint 311 considered in the process of moving the virtual interior object 321, and the predetermined specific pattern described above may be used. .

Although not shown in the drawing, the interior film design providing apparatus may remove the virtual interior object 321 disposed in the virtual interior space 310 according to the movement of the viewpoint 311. In this case, the interior film design providing apparatus selects the virtual interior object 321 according to the movement of the viewpoint 311 as described above, and then selects a specific area on the user interface 300 (eg, an area such as a trash bin in a PC). ), the virtual interior object 321 disposed in the virtual interior space 310 may be removed.

As described above, the apparatus for providing interior film design service according to an exemplary embodiment arranges, removes or moves the virtual interior object 321 in the virtual interior space 310 based on the movement of the viewpoint 311 in the user interface 300. , It is possible to improve the user's operation convenience and the real feeling that the user actually feels.

In addition, the apparatus for providing interior film design not only arranges or removes the virtual interior object 321 in the virtual interior space 310, but also provides a virtual interior disposed in a specific area of the virtual interior space 310 or the virtual interior space 310. The object 321 can be changed.

Meanwhile, referring to FIGS. 3D to 3E, an apparatus for providing an interior film design service according to an exemplary embodiment provides a virtual interior film based on the movement of the viewpoint 311 in the virtual interior space 310 displayed on the user interface 300. By placing and moving objects, interior film design services can be provided.

Specifically, referring to FIG. 3D, the apparatus for providing an interior film design service may display a film object selection inventory 320 ′ through the user interface 300. Here, the film object selection inventory 320 ′ is modeled so that the interior film attached to interior accessories (eg, interior furniture and products such as sofas, chairs, tables, frames, cabinets, or bookshelves) is optimized for virtual reality (virtual A plurality of virtual interior film objects (data data suitable for a head mounted display providing a real image) may be stored and constructed in advance.

For example, when the motion 312 of the viewpoint 311 coincides with a preset film object selection inventory calling pattern, the interior film design service providing apparatus displays the film object selection inventory 320 ′ on the user interface 300. Can be displayed.

For a more specific example, when the preset film object selection inventory call pattern is a pattern that moves left and right for a preset time (eg, 2 seconds), the movement 312 of the viewpoint 311 is a pattern that moves left and right for a preset time. If matched with, the interior film design service providing apparatus may display a film object selection inventory 320 ′ on the user interface 300.

In addition, referring to FIG. 3E, the apparatus for providing an interior film design service may select a virtual interior film object 321 ′ based on movements 313 and 314 of the viewpoint 311 on the film object selection inventory 320 ′. .

For example, when the motion 313 of the viewpoint 311 is a gesture moving on the film object selection inventory 320', the interior film design service providing device may have a film object selection inventory as the viewpoint 311 moves a cursor. 320') may pass through a plurality of virtual interior film objects. In addition, the motion 314 of the viewpoint 311 is a preset time (eg, 2 seconds) in the virtual interior film object 321 ′ among a plurality of virtual interior film objects displayed on the film object selection inventory 320 ′. In the case of a staying gesture, the interior film design service providing device may select the virtual interior film object 321'. However, the present invention is not limited or limited thereto, and various gestures may be used as the movements 313 and 314 of the viewpoint 311 considered in the process of selecting the virtual interior film object 321 ′. Patterns may also be used.

When the virtual interior film object 321 ′ is selected as described above, the interior film design service providing apparatus may attach the virtual interior film object 321 ′ to the corresponding interior prop of the virtual interior space 310.

Although not shown in the drawings, the interior film design service providing apparatus provides a similar film object selection inventory consisting of similar patterns for the selected virtual interior film object 321 ′, allowing the user to follow the processes shown in FIGS. 3D and 3E. Similarly, a virtual interior-like film object can be selected from the similar film object selection inventory.

Here, the interior film design service providing apparatus may implement similar patterns for virtual interior film objects as a deep learning system using image patterning based on a convolutional neural network, and a detailed description will be described with reference to FIG. 4.

The apparatus for providing interior film design as described above may remove the virtual interior film object 321 ′ attached to the interior props of the virtual interior space 310 according to the movement of the viewpoint 311. In this case, the interior film design providing apparatus selects the virtual interior film object 321 ′ according to the movement of the viewpoint 311 as described above, and then selects a specific area on the user interface 300 (eg, the trash bin in the PC). The virtual interior film object 321' disposed in the virtual interior space 310 may be removed by moving to the same area).

As described above, the apparatus for providing an interior film design service according to an embodiment arranges or removes the virtual interior film object 321 ′ in the virtual interior space 310 based on the movement of the viewpoint 311 in the user interface 300. By moving, it is possible to improve the user's operation convenience and the real feeling that the user actually feels.

In addition, the interior film design providing apparatus not only arranges or removes the virtual interior film object 321 ′ in the virtual interior space 310, but also arranges in a specific area of the virtual interior space 310 or the virtual interior space 310. The virtual interior film object 321' may be changed.

4 shows a deep learning system using image patterning based on a convolutional neural network.

As shown in FIG. 4, a deep learning system using image patterning based on a convolutional neural network according to an embodiment of the present invention includes: an image input unit 412 for inputting a plurality of interior film images; A patterning module 414 for generating a plurality of interior film images received from the image input unit 412 into a plurality of patterned pattern images; A CNN learning unit 416 based on a convolutional neural network (CNN) for learning a plurality of interior film images received from the image input unit 412 and pattern images received from the patterning module 414; A CNN execution unit 430 receiving learning information from the CNN learning unit 416 and a plurality of interior film images received from the image input unit 412; And a final classification unit 440 that receives image information from the CNN execution unit 430 and classifies a plurality of interior film objects of the image information according to similar patterns.

More specifically, as shown in FIG. 4, input information obtained through the image input unit 412 and the patterning module 414 in the deep learning system according to the embodiment of the present invention corresponds to the input unit of the structure of the CNN, and the CNN The learning unit 416 and the CNN execution unit 430 correspond to an output unit that outputs pattern images and weight information.

That is, for each input information, a value obtained by applying a weight obtained through learning to the input information and a value obtained by applying a pattern weight to the pattern information in which the relationship between the input information is patterned are obtained and added. Then, the summed values that exist as many as the number of inputs are finally summed to obtain output information.

Here, deep learning technology is an artificial intelligence (AI) technology that enables computers to think and learn like humans, and enables machines to learn and solve complex nonlinear problems by themselves based on artificial neural network theory.

Deep learning is a technology in which the human brain learns a machine to discern objects by imitating the information processing method that distinguishes objects after discovering patterns in numerous data.

When deep learning technology is applied, computers can recognize, infer, and judge by themselves even if a person does not set all judgment criteria, and it can be widely used for voice, image recognition, and photo analysis.

In other words, deep learning is a machine learning that attempts high-level abstractions (summarizing key contents or functions in a large amount of data or complex data) through a combination of several nonlinear transformation methods. learning) is defined as a set of algorithms, and can be said to be a branch of machine learning that teaches computers how people think in a large framework.

When there is any data, it is represented in a form that can be understood by a computer (for example, in the case of an image, pixel information is expressed as a column vector, etc.), and a lot of research (how to express better) to apply it to learning. And how to create a model to learn them), and as a result of this effort, various deep learning techniques such as deep neural networks, convolutional deep neural networks, and deep belief networks are being used in computer vision, speech recognition, It is applied to fields such as natural language processing and voice/signal processing, and shows cutting-edge results.

In particular, the importance of deep learning technology in the field of image recognition and object recognition, which is a major field of computer vision, is emerging. Like the automatic speech translation and expansion of the automatic speech recognition field, the image classification field is automatic image captioning. It is expanding into a more challenging field called captioning. Automated image captioning is a field that uses deep learning as a core technology, and examples of application include a car-mounted computer that is learned through deep learning to understand a 360° camera screen.

In addition, convolutional neural networks (CNNs) are specialized in processing 2D images and have been mainly used for recognition problems.The first is a basic key feature, and the first is a local receptive field to capture part of the image. The emphasis was placed on extracting features to represent, and second, in that weights representing these features can be shared across the entire image area, a huge number of parameters can be reduced and features can be shared regardless of the location of the image. It has the advantage of being.

The third characteristic is that as the process of creating an upper layer by stacking one layer and reducing the number of nodes is repeated, the generalization becomes more advanced toward the higher layer. As deep learning has recently received a lot of attention, studies on deep structuring CNNs such as convolutional deep belief networks (deep CNN) layered with convolutional RBM (restricted Boltzmann machine) have been conducted, and have excellent performance in object recognition and classification in images Is showing.

As described above, in order to solve the problem of poor quality of learning information due to various environmental problems, an embodiment of the present invention classifies and combines input images into pattern images that are robust to each environment, and then learns them. In addition to improving the quality of image learning information, which is vulnerable to shaking, illuminance, noise, reduction in recognition rate, etc., errors that may occur in the process of extracting features from each layer of a convolutional neural network (CNN) can be corrected. , In that different patterns can be applied for each layer, a deep learning system using image patterning based on a convolutional neural network (CNN) that can acquire higher quality learning information is provided.

In addition, the image input unit 412 illustrated in FIG. 4 is a device that is connected to a camera and directly receives a plurality of interior film images, or receives and inputs from a wireless network or an Internet network, and directly receives an image photographed through the camera. It is also possible to receive and input or receive an image through a mobile device or a PC through a wireless network or an Internet network. By receiving images through such various routes, various environments and a large amount of image data perform a function as big data, so that more accurate and high-level image learning data can be obtained through the learning device according to the embodiment of the present invention. You will be able to.

5 is a diagram illustrating a block configuration of a patterning module 414 used in a deep learning system using image patterning based on a convolutional neural network according to an embodiment of the present invention.

As shown in FIG. 5, the patterning module 414 includes: a pattern classification unit 414a for classifying the interior film image received from the image input unit 412 into a plurality of pattern images; And a pattern combination unit 414b that receives and combines at least one pattern image from the pattern classification unit 414a to generate a combined image.

In addition, the pattern image classified by patterning the input image by the patterning module 414 applied to the embodiment of the present invention is a local binary pattern image, a local ternary pattern image, A robust pattern image may be obtained in response to a specific environmental condition by using an image pattern processing technique such as a local derivative pattern image and a local tetra pattern image.

Meanwhile, in the above, the interior film design service providing device provides a similar film object selection inventory consisting of similar patterns for the selected virtual interior film object 321 ′, allowing the user to be similar to the process shown in FIGS. 3D and 3E. Similar film object selection The virtual interior-like film object was selected from the inventory, but unlike the selected virtual interior film object and similar film object selection consisting of similar patterns, the similar interior films provided in the inventory were sequentially attached to the interior props, respectively. An interior film design service for changing a virtual interior film object may be provided based on the movement of the viewpoint 411 on the similar interior film of.

For example, when the movement 412 of the viewpoint 411 is a gesture of moving in the virtual interior space 410, the interior film design service providing device may move the viewpoint 411 on the virtual interior space 410 as if the cursor moves. You can make it go around.

In addition, when the movement 413 of the viewpoint 411 is a gesture of staying for longer than a preset time (eg, 2 seconds) on a similar interior film attached to the virtual interior object 420 previously arranged in the virtual interior space 410, The interior film design service providing device may select a similar interior film that stays the longest.

6 is a flow chart showing a method of providing an interior film design service according to an embodiment.

Referring to FIG. 6, a method of providing an interior film design service is performed by an interior film design service providing device mounted on a head mounted display or connected to a head mounted display and using a head mounted display.

The interior film design service providing apparatus displays a virtual interior space through a user interface provided on the head mounted display (510).

Then, the interior film design service providing apparatus detects a rotation angle of the user's head or face on which the head mounted display is worn, and sets a viewpoint corresponding to the user's gaze on the virtual interior space (520).

In step 520, the apparatus for providing an interior film design service may display an object corresponding to a viewpoint in the virtual interior space.

After that, the interior film design service providing apparatus provides an interior design service for a virtual interior space based on the movement of the viewpoint (530).

In this case, the movement of the viewpoint may include a gesture in which the viewpoint stays for a predetermined time in a specific area of the virtual interior space or a virtual interior object disposed in the virtual interior space, or a gesture in which the viewpoint moves in the virtual interior space.

For example, in step 530, the apparatus for providing an interior film design service displays an object selection inventory in which a plurality of virtual interior objects are stored through a user interface, and then selects a virtual interior object based on the movement of a viewpoint on the object selection inventory. , Virtual interior objects can be placed in the virtual interior space. Here, the object selection inventory may be built in advance by storing a plurality of virtual interior objects modeled so that actual interior props are optimized for virtual reality.

In this case, the apparatus for providing an interior film design service may display the object selection inventory on the user interface when the movement of the viewpoint coincides with a preset object selection inventory calling pattern.

In addition, the interior film design service providing apparatus may move the virtual interior object based on the movement of the viewpoint.

Meanwhile, in step 540, the interior film design service providing apparatus according to an embodiment arranges and moves a virtual interior film object based on the movement of a viewpoint in the virtual interior space displayed on the user interface, thereby providing interior film design service. I can.

6 is a block diagram showing an apparatus for providing an interior film design service according to an embodiment.

Referring to FIG. 6, an apparatus for providing an interior film design service includes a display unit 610, a setting unit 620, and a providing unit 630.

The display unit 610 displays a virtual interior space through a user interface provided on the head mounted display.

The setting unit 620 sets a viewpoint corresponding to the user's gaze in the virtual interior space by detecting the rotation angle of the user's head or face on which the head mounted display is worn. In addition, the setting unit 620 may display an object corresponding to a viewpoint in the virtual interior space.

The provider 630 provides an interior design service for a virtual interior space based on the movement of the viewpoint.

In this case, the movement of the viewpoint may include a gesture in which the viewpoint stays for a predetermined time in a specific area of the virtual interior space or a virtual interior object disposed in the virtual interior space, or a gesture in which the viewpoint moves in the virtual interior space.

For example, the providing unit 630 displays an object selection inventory in which a plurality of virtual interior objects are stored through a user interface, selects a virtual interior object based on the movement of a viewpoint on the object selection inventory, Interior objects can be placed. Here, the object selection inventory may be built in advance by storing a plurality of virtual interior objects modeled so that actual interior accessories are optimized for virtual reality.

In this case, the providing unit 630 may display the object selection inventory on the user interface when the movement of the viewpoint matches a preset object selection inventory calling pattern.

Also, the providing unit 630 may move the virtual interior object based on the movement of the viewpoint.

For another example, the providing unit 630 may provide an interior film design service by arranging and moving a virtual interior film object based on a movement of a viewpoint in a virtual interior space displayed on a user interface.

The apparatus described above may be implemented as a hardware component, a software component, and/or a combination of a hardware component and a software component. For example, the devices and components described in the embodiments include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable array (FPA), It may be implemented using one or more general purpose computers or special purpose computers, such as a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications executed on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to the execution of software. For the convenience of understanding, although it is sometimes described that one processing device is used, one of ordinary skill in the art, the processing device is a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that it may include. For example, the processing device may include a plurality of processors or one processor and one controller. In addition, other processing configurations are possible, such as a parallel processor.

The software may include a computer program, code, instructions, or a combination of one or more of these, configuring the processing unit to behave as desired or processed independently or collectively. You can command the device. Software and/or data may be interpreted by a processing device or to provide instructions or data to a processing device, of any type of machine, component, physical device, virtual equipment, computer storage medium or device. , Or may be permanently or temporarily embodyed in a transmitted signal wave. The software may be distributed over networked computer systems and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be known and usable to those skilled in computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -A hardware device specially configured to store and execute program instructions such as magneto-optical media, and ROM, RAM, flash memory, and the like. Examples of the program instructions include not only machine language codes such as those produced by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate as one or more software modules to perform the operation of the embodiment, and vice versa.

As described above, although the embodiments have been described by the limited embodiments and drawings, various modifications and variations are possible from the above description by those of ordinary skill in the art. For example, the described techniques are performed in a different order from the described method, and/or components such as a system, structure, device, circuit, etc. described are combined or combined in a form different from the described method, or other components Alternatively, even if substituted or substituted by an equivalent, an appropriate result can be achieved.

Therefore, other implementations, other embodiments, and claims and equivalents fall within the scope of the claims to be described later.

100: head mounted display 200: user interface

Claims (15)

In the method of providing an interior film design service using a head mounted display,
Displaying a virtual interior space through a user interface provided on the head mounted display;
Setting a viewpoint corresponding to the user's gaze on the virtual interior space by detecting a rotation angle of the user's head or face on which the head mounted display is worn;
Providing an interior film design service for the virtual interior space based on the movement of the viewpoint; And
An interior film design service providing method comprising the step of providing an interior film design service for the virtual interior space based on the motion of the viewpoint. The method of claim 1,
Providing an interior design service for the virtual interior space
Displaying an object selection inventory in which a plurality of virtual interior objects are stored through the user interface;
Selecting a virtual interior object based on the motion of the viewpoint on the object selection inventory; And
An interior film design service providing method comprising the step of arranging the virtual interior object in the virtual interior space. The method of claim 2,
An interior film design service providing method further comprising moving the virtual interior object based on the motion of the viewpoint. The method of claim 2,
Displaying an object selection inventory in which a plurality of virtual interior objects are stored through the user interface
And displaying the object selection inventory on the user interface when the motion of the viewpoint coincides with a preset object selection inventory calling pattern. The method of claim 2,
In the object selection inventory, the plurality of virtual interior objects modeled so that actual interior props are optimized for virtual reality are stored and built in advance. The method of claim 1,
An interior film design service providing method further comprising displaying an object corresponding to the viewpoint in the virtual interior space. The method of claim 1,
Providing an interior film design service for the virtual interior space
Displaying a film object selection inventory in which a plurality of virtual interior film objects are stored through the user interface;
Selecting a virtual interior film object based on the motion of the viewpoint on the film object selection inventory; And
An interior film design service providing method comprising the step of disposing the virtual interior film object in the virtual interior space. The method of claim 7,
After the step of selecting a virtual interior film object based on the motion of the viewpoint on the film object selection inventory, a similar film object selection inventory consisting of similar patterns is provided for the selected virtual interior film object to allow the user to An interior film design service providing method further comprising the step of selecting a virtual interior-like film object from the selection inventory. The method of claim 7,
After the step of selecting a virtual interior film object based on the motion of the viewpoint on the film object selection inventory,
Selecting the selected virtual interior film object and similar film object consisting of similar patterns After attaching the similar interior films provided in the inventory to interior props in sequence, based on the movement of the viewpoint for each similar interior film, a virtual interior similar film object Interior film design service providing method further comprising the step of changing. The method according to claim 8 or 9,
A method for providing interior film design services in which similar patterns for the virtual interior film object are implemented by a deep learning system using image patterning based on a convolutional neural network. In the interior film design service providing device used in the head mounted display,
A display unit for displaying a virtual interior space through a user interface provided on the head mounted display;
A setting unit configured to set a viewpoint corresponding to the user's gaze on the virtual interior space by detecting a rotation angle of a user's head or face on which the head mounted display is worn; And
An interior film design service providing device comprising a providing unit that provides an interior design service and an interior film design service for the virtual interior space based on the motion of the viewpoint. The method of claim 11,
The provision unit
Displaying an object selection inventory in which a plurality of virtual interior objects are stored through the user interface, selecting a virtual interior object based on the movement of the viewpoint on the object selection inventory, and placing the virtual interior object in the virtual interior space , Interior film design service provider. The method of claim 11,
The provision unit
Display a film object selection inventory in which a plurality of virtual interior film objects are stored through the user interface, select a virtual interior film object based on the movement of the viewpoint on the film object selection inventory, and select an interior accessory of the virtual interior space. An interior film design service providing device for attaching the virtual interior film object. The method of claim 13,
The provision unit
An interior film design service providing device that allows a user to select a virtual interior-like film object from the similar film object selection inventory by providing a similar film object selection inventory consisting of similar patterns for the selected virtual interior film object. The method of claim 13,
The provision unit
Selecting the selected virtual interior film object and similar film object consisting of similar patterns After attaching the similar interior films provided in the inventory to interior props in sequence, based on the movement of the viewpoint for each similar interior film, a virtual interior similar film object Interior film design service providing device to change.

Images