KR102315514B1 - VR Vision Service System to Prevent Failure Cost - Google Patents

Abstract

The present invention relates to a VR vision service system for preventing failure costs and a service method using the same, and more particularly, to a 360-degree image through three-dimensional modeling of a product or building identical to the size and shape of an actual product. It relates to a VR vision service system and a service method using the same for preventing cost of failure by displaying and confirming.

Description

VR Vision Service System to Prevent Failure Cost and Service Method Using It {VR Vision Service System to Prevent Failure Cost}

The present invention relates to a VR vision service system for preventing failure costs and a service method using the same, and more particularly, to display and check a product or a building identical to the size and shape of an actual product as a 360-degree image through 3D modeling. It relates to a VR vision service system for preventing failure costs and a service method using the same.

As a prior art, Korean Patent Registration No. 1036228 discloses an evaluation data storage unit for storing various data; and a road landscape design VR evaluation system including an evaluation system controller in which hardware and software are implemented to control overall system operation, wherein the evaluation system controller uses a VR technique in which main landscape resources around the road are inputted. and demonstrated online, and a means for judging an evaluation score for each evaluation index into which a plurality of evaluation indicators including at least one of a landscape indicator and an emotional indicator for landscape evaluation of the demonstrated routes are input. display the landscape evaluation for the routes, the optimal route is selected among the routes by means of judging the landscape assessment for the routes, and the linear plan of the selected optimal route is displayed online through the virtual reality method. and the landscape for the linear plan by means of synthesizing the evaluation score for each evaluation index input with evaluation indicators including at least one of a landscape indicator and an emotional indicator for evaluating the landscape of the linear plan demonstrated above. It is to be evaluated, and the linear plan is selected by means of judging the landscape evaluation for the linear plan.

However, this VR evaluation technology is a means of synthesizing evaluation scores using virtual reality techniques, and is a passive viewing VR product with no room for user events to be input.

A conventional invention, Korean Patent Application Laid-Open No. 2006-0086668, describes a content management device that generates product content based on product data produced according to a product design plan, and applies an event operation generated from a predetermined input device to the product content to operate it. ; and a VR viewer server that displays the product content transmitted from the content management device as a three-dimensional image, analyzes an event generated from the input device, and transmits it to the content management device.

However, when the design form or UI design is changed, the change can be immediately reflected in the product content, but there is a problem that cannot accommodate the action of the active user who simply evaluates the product expressed in a 3D image.

Korean Patent No. 1036228 Korea Patent Publication No. 2006-0086668

The present invention has been made to solve the above problems, and the present invention displays product content identical to the size and shape of an actual product on a VR viewer server, and operates VR content to minimize failure costs according to the occurrence of an event, The purpose is to provide a VR vision service system for preventing failure costs that can be modified while giving VR content data a variety of virtual and real-world feel and visual effects.

In order to solve the above problem, the present invention stores VR content data for preventing the cost of failure, and prevents the cost of failure by storing motion information related to the VR content data, an event signal according to the motion information, or a function according to the event signal content data module; a VR input module that searches for the motion information according to a user's motion and generates an event signal according to the motion information; a VR function module that executes a function according to the event signal input through the VR input module or executes a function according to correction information; a VR correction request module for generating correction request information through the VR input module; a VR correction function module that generates correction information according to the correction request information transmitted through the VR correction request module and transmits it to the VR function module; a module for transmitting the correction information data to a server; a VR viewer module that generates the motion information corresponding to the event signal of the VR input module and displays the corresponding VR content data or functions according to the correction information in chronological order; It includes a VR server that controls the modules.

The VR correction request module displays a correction function list, a correction function location, a correction function price, or a correction function through the VR viewer module.

The interior object of the failure cost prevention content data is an image of at least one of a door, a switch, a wallpaper, a flooring material and furniture, and a bathroom.

The VR input module generates a desired menu event in a VR viewer module that displays the corresponding VR content data using a handijoystick or a motion controller, modifies or replaces the VR content data according to the event, and displays it on the VR viewer module do.

A VR headset that is connected to the VR input module and generates input information includes one of a 3D motion sensor, an accelerometer, an inclinometer, or a laser rangefinder.

The VR server uses a machine learning model of any one of artificial neural network, support vector machine, and autoregressive cumulative moving average to arrange VR content data corresponding to event signals in time series.

The present invention includes the steps of designing a scenario for motion and motion content by time flow;

preparing motion by loading VR content for minimizing failure cost through the content module and the VR viewer server;

generating an event signal that a user responds to VR content for minimizing failure cost through a VR input device;

generating VR content data corresponding to the event signal through the VR viewer server;

displaying the VR content data in chronological order;

and analyzing the VR content data through the VR viewer server.

The step of displaying the VR content data in chronological order includes:

storing VR content data for preventing failure cost through a failure cost prevention content data module, and storing motion information related to the VR content data, an event signal according to the motion information, or a function according to the event signal;

retrieving the motion information according to a user's motion through a VR input module, and generating an event signal according to the motion information;

executing a function according to the event signal input through the VR input module or executing a function according to correction information through a VR function module;

generating correction request information through the VR input module through the VR correction request module;

generating, by the VR correction function module, correction information according to the correction request information transmitted through the VR correction request module and transmitting the correction information to the VR function module;

generating, by the VR viewer module, the motion information corresponding to the event signal of the VR input module, and displaying the corresponding VR content data or functions according to the correction information in chronological order;

The present invention made as described above makes it possible to quickly produce a prototype through the VR function and to communicate with customers quickly, thereby reducing the revision period.

In addition, the present invention can reduce the time, money, and opportunity cost (failure cost) required for making a prototype.

In addition, the present invention can prevent an increase in social costs (government funds made of taxes) in the time, money, and opportunity costs of the client by failing to make an actual prototype.

The present invention is intended to give VR contents data a variety of virtual sensations and visual effects, such as material effects, lighting effects, and ambient environment effects. You can create a sense of closeness, you can build a lot of experience environments at a relatively low cost, and content can be used indefinitely once created. not added separately.

1 a, b, and c are diagrams showing a VR experience system according to the prior art.
2 is a view showing a detailed configuration of a VR vision service system for preventing cost of failure according to an embodiment of the present invention.
3 is a diagram showing a function execution step using the VR vision service system for preventing cost of failure according to an embodiment of the present invention.
4 is a view showing types of VR content data according to another embodiment of the present invention.
5 is a view showing VR content data that reproduces the operation of the shower in the model house according to another embodiment of the present invention.
6 is a view showing a step of operating the shower in the model house with a motion controller according to another embodiment of the present invention.

In order to fully understand the present invention, preferred embodiments of the present invention will be described with reference to the accompanying drawings. Embodiments of the present invention may be modified in various forms, and the scope of the present invention should not be construed as being limited to the embodiments described in detail below. This example is provided to more completely explain the present invention to those of ordinary skill in the art. Accordingly, the shape of elements in the drawings may be exaggerated to emphasize a clearer description. It should be noted that the same members in each drawing are sometimes shown with the same reference numerals. In addition, detailed descriptions of well-known functions and configurations that are determined to unnecessarily obscure the gist of the present invention will be omitted.

As shown in FIG. 2 , the present invention includes a VR headset 11 , a motion controller 12 , a VR module 20 , a VR server 30 , and the like.

The present invention can use a conventional VR headset 11, motion controller 12, VR module 20, VR server 30, etc. It has the feature of minimizing the cost of failure by making it possible to display and confirm a product or building that is the same size and shape of the actual product as a 360-degree image through 3D modeling.

Techniques for controlling the motion of objects in the virtual environment made of the 360-degree image are based on the motion (direction) of the object in the virtual environment according to a scale factor generated based on the motion of the motion controller 12 held by the user. , rotation angle, etc.).

For example, it has a configuration that can easily move or rotate heavy furniture or the like with a small movement.

According to an embodiment of the present invention, a VR headset 11 , a motion controller 12 , a VR module 20 , a VR server 30 , a VR expert terminal, a client terminal, etc. are connected through a network.

The present invention is a device for providing a reality virtual reality to a user by projecting and displaying a 360-degree front, rear, left and right image through a VR viewer module 26, and is connected to a VR headset 11 in the form of a general HMD (head mounted device). It can project 360 degree images.

The VR headset 11 may include a 3D motion sensor, an accelerometer, an inclinometer, and a laser range finder, such as distance information for reaching a specific VR interior, general furniture information, and event information (front, rear, left, right). movement information, and explanatory information) and can be directly compared and confirmed.

In this case, even when the user wearing the VR headset 11 is exposed to a 360-degree image, it is possible to freely move around the virtual reality world while selecting various pieces of information displayed in the air in real time.

For example, the VR viewer module 26 calculates the properties of an object placed in the model house space and displays it as a 360-degree image, and the user moves in the model house space through the VR headset 11 or uses the internal object Seeing Reality You can experience virtual reality.

The motion controller 12 may include at least one key that can be received according to a user action, and in addition, a touchpad formed on the exterior of the motion controller 12 may be further provided.

In addition, according to an embodiment, the motion controller 20 may further include at least one sensor capable of detecting the movement of the user's hand.

The electronic device 10 may receive a user input input through the motion controller 12 and/or information about the motion of the motion controller 12 , and may perform an operation corresponding thereto.

Additionally, the present invention may display menu information through digital signage without the VR headset 11 and the motion controller 12 and display an animated reality virtual reality.

For example, a scene in which a user presses an action button of a shower in the shower room and takes a shower can be stored as an animation viewed from a third-party point of view through the VR viewer module 26 and checked later (see FIG. 5 ).

In addition, a function for generating an event signal allowing the user to access the toilet according to the motion information toward the toilet and opening the toilet lid according to the event signal is executed.

In addition, the user who has executed this function transmits the correction request information to the VR correction request module through the VR input device so that the VR function module can add the function of measuring weight to the general toilet.

The VR input device may be controlled by an additional VR communication processor.

Specifically, a 360-degree image of the inside and outside of at least one building generated through three-dimensional modeling is provided, and as a specific object is located within the field of view of a user who has the motion controller 12, the 360-degree image An event corresponding to the movement of the motion controller 12 is displayed in the image, and VR content data of the VR server 30 is displayed in response to the movement of the motion controller 12 within the user's field of view. It is combined or moved to display a 360-degree image through the VR module 20 .

In addition, when the motion controller 12 generates an event in the interior object in the 360-degree image, and provides a 360-degree image in which the VR content data (eg, interior object) is moved or combined, the motion controller In response to the user input for the function key provided in (12), if the 360-degree image currently being output corresponds to the outside of the building, a map GUI for complex information is provided, and the currently output 360-degree image is displayed inside the building In the case of corresponding to , it is possible to provide a map GUI for the structure information of the building.

In this case, the VR viewer module 26 may display an optional image or text through the VR communication processor as a method of transmitting the correction request information using the VR input device. This also allows you to delete certain features. Alternatively, position, rotation, scale, and material corresponding to properties of a 360-degree image may be modified.

Meanwhile, the VR server 30 is a server that receives request information through the client terminal 10 , selects a VR expert, and provides a service to the VR expert terminal for payment by grade.

The VR server 30 allows a user wearing a VR headset 11 to check a 360-degree image and select a 360-degree image production VR expert who can optimally produce the requested information and store it.

The VR server 30 may receive its own selection criteria to select a VR expert corresponding to the request information using machine learning based on big data, or may select a VR expert by the user's selection .

The VR server 30 may differentiate the payment by dividing the grade according to the transaction amount of the selected VR expert.

That is, the VR server 30 is a time series using a machine learning model of any one of artificial neural networks, support vector machine (SVM), and autoregressive integrated moving average (ARIMA). By using big data analysis methods, it is possible to prepare its own selection criteria or to classify and commission VR experts according to the transaction amount or grade.

For example, the VR server 30 uses a support vector machine to classify an animation image of VR content data corresponding to an event signal, enabling time-series arrangement through pattern recognition and data analysis.

Therefore, it is possible to experience reality virtual reality using objects arranged in the front, rear, left and right 360 degree image space created by receiving the recommendation of an optimized VR expert through the VR server 30 .

At this time, as shown in FIG. 4 , the user uses the VR headset 11 and the motion controller 12 to select the properties of the object, such as position, rotation, scale, and material. can be modified in real time and requested to be modified by a VR expert.

Hereinafter, an application example applied to an actual VR modeling work as an embodiment of the present invention will be described in detail.

In order to reduce the cost of VR modeling failure according to an embodiment of the present invention, a method of observing and correcting a 360-degree image produced by a VR expert before manufacturing a prototype is used.

First, by accessing the VR server 30 through the client terminal, the request information for selecting a VR expert who creates a work that can check the VR 360-degree image according to mold, injection, and PCB work or building interior or furniture arrangement is registered and saved to start the service.

Through the VR server 30, each VR expert is selected according to the mold, injection, and PCB work and 3D modeling work corresponding to the request information.

At this time, when selecting a model for prototyping, the 3D modeling sketch drawing (or unfinished drawing) submitted as a reference by the client may be transmitted to the VR expert through the web page.

The VR expert is notified of the contents of the request through the VR server 30 , and if the VR expert is a VR expert, the VR expert is selected through the quotation, delivered to the VR server 30 and stored.

In addition, even if the number of tasks is the same, if the task is very high-level VR modeling, a certain amount of weight can be added for each confirmed task for the VR expert in charge.

The VR server 30 notifies the selected VR expert terminal of the start of the work and receives confirmation of the completion of the VR work from the VR expert terminal.

The VR server 30 transmits the completed work to the client terminal, calculates the VR expert's grade, and the grade is calculated according to the transaction or transaction amount, and the VR server 30 is The service is completed by proceeding with the payment for each VR expert grade (by VR service grade) to the VR expert terminal.

For example, when a combination event of the first VR content data and the second VR content data is generated through the VR input module 22 , furniture and a building are combined with each other among the VR content data displayed on the VR viewer module 26 . When an input event for changing the angle at which the user views the furniture is generated, the angle of the VR content data is changed and a new changed screen is shown to the user or the selected VR expert, and evaluation and corrections are made to the VR viewer module 26 ) to minimize the user's failure cost.

Hereinafter, a method using the VR vision service system for preventing the cost of failure for implementing the present invention will be described in detail with reference to FIG. 3 and the like.

First, we design a scenario for motion and motion content by time flow.

And prepare motion by loading VR content for minimizing failure cost through the content module and VR viewer server.

Through the VR input device, a user generates an event signal that responds to VR content for minimizing the cost of failure.

Subsequently, VR content data corresponding to the event signal is generated through the VR viewer server.

The VR content data is displayed in chronological order, and the VR content data is analyzed through the VR viewer server.

Before the additional chronological display method, VR content data is stored through the failure cost prevention content data module, and motion information related to the VR content data or an event signal according to the motion information or a function according to the event signal is stored, , retrieves the motion information according to the user's motion through the VR input module, generates an event signal according to the motion information, and executes a function according to the event signal input through the VR input module through the VR function module or executes a function according to the correction information, generates correction request information through the VR input module through the VR correction request module, and the VR correction function module performs correction according to the correction request information transmitted through the VR correction request module A method of generating information and transmitting it to the VR function module, and the VR viewer module generates the motion information corresponding to the event signal of the VR input module and displays the corresponding VR content data or functions according to the correction information in chronological order This is included.

For example, as shown in FIGS. 5 and 6 , a method of displaying functions according to shower information by animation in chronological order is included.

The terminal connected to the VR server 30 according to various embodiments of the present invention is, for example, a VR headset equipped with a smartphone, an AR headset, a smartphone capable of playing animation, a video signal, and an event detected in the mobile terminal. HMD (Head Mounted Display), tablet PC, mobile phone, video phone, e-book reader, desktop PC, laptop PC, netbook computer including a display unit for displaying notification information to notify the occurrence of , a workstation, a server, a PDA, a portable multimedia player (PMP), and at least one of a wearable device.

For example, it is possible to experience virtual reality (eg, animation) using the image processing technology of a smartphone or tablet PC without the above-described VR headset 11 and motion controller 12 .

In addition, the HMD is characterized in that it has a function to reduce the system load by detecting the part that the wearer of the VR headset is currently looking at with eye tracking technology, and lowering the quality of the rest by increasing the graphic only in the corresponding area.

The eye-tracking technology includes the steps of determining a gaze direction of the user, determining the direction of the user's head of the wearable device through a motion detection system, and the like.

In this case, the VR server 30 is a 360 degree image processor and may include one or more of a central processing unit, a VR application processor, and a VR communication processor.

The VR server 30 may, for example, execute operations or data processing (eg, VR expert matching, etc.) related to control and/or communication of at least one other component of the above-described terminals 10 and 30 . have.

The memory or database included in the VR server 30 may include volatile and/or non-volatile memory. For example, it may store instructions or data related to at least one other component.

The network used in the present invention is a specific communication protocol, for example, 5G, 4G, long-term evolution (LTE), LTE Advance (LTE-A), code division multiple access (CDMA), wideband CDMA (WCDMA). , UMTS (universal mobile telecommunications system), WiBro (Wireless Broadband), or GSM (Global System for Mobile Communications) may use at least one wireless communication.

Also, wireless communication may include, for example, short-range communication. Short-range communication, for example, may include at least one of wireless fidelity (WiFi), Bluetooth (Bluetooth), near field communication (NFC), magnetic stripe transmission (MST), or global navigation satellite system (GNSS). .

11: VR Headset
12: motion controller
20: VR module
30: VR Server

Claims (8)

a failure cost prevention content data module 21 for storing VR content data for preventing failure cost, and storing motion information related to the VR content data, an event signal according to the motion information, or a function according to the event signal;
a VR input module 22 for retrieving the motion information according to the user's motion and generating an event signal according to the motion information;
a VR function module 23 for executing a function according to the event signal input through the VR input module or executing a function according to correction information;
a VR correction request module 24 for generating correction request information through the VR input module;
a VR correction function module 25 that generates correction information according to the correction request information transmitted through the VR correction request module and transmits it to the VR function module;
a VR viewer module 26 that generates the motion information corresponding to the event signal of the VR input module and displays the corresponding VR content data or functions according to the correction information in chronological order;
VR server 30 for controlling the modules; includes,
The VR headset 11 connected to the VR input module 22 to generate input information includes one of a 3D motion sensor, an accelerometer, an inclinometer, or a laser range finder,
The VR server 30 uses a machine learning model of any one of an artificial neural network, a support vector machine, and an autoregressive cumulative moving average method to time-series the VR content data corresponding to the event signal,
The VR input module 22 generates a desired menu event to the VR viewer module 26 that displays the corresponding VR content data using a handy joystick or a motion controller, and modifies or replaces the VR content data according to the event. displayed on the VR viewer module 26,
The VR headset 11 detects the part currently being viewed by the VR headset wearer through the eye tracking function through the 3D motion sensor, accelerometer, inclinometer, or laser range finder, and generates the luminance of graphics only in the corresponding area. It raises above the political level and lowers the quality below a certain level for the rest.
The VR server 30 allows a user wearing a VR headset 11 to check a 360-degree image and select a 360-degree image production VR expert who can optimally produce the requested information and store it,
The VR server 30 may receive its own selection criteria to select a VR expert corresponding to the request information using machine learning based on big data, or select a VR expert by the user's selection,
The VR server 30 transmits the 360-degree image production VR expert's completed 360-degree image work requested by the user's request information to the client terminal, calculates the VR expert's grade, and the calculation of the grade is A VR vision service system for preventing failure costs, characterized in that the transaction is made according to a transaction or transaction amount, and the VR server (30) proceeds with the payment for each level of the VR expert to the terminal of the VR expert. delete According to claim 1,
The VR modification request module 24,
A VR vision service system for preventing failure costs, characterized in that the correction function list, the correction function location, the correction function price, or the correction function are displayed through the VR viewer module. According to claim 1,
The VR vision service system for preventing cost of failure, characterized in that the interior object of the content data for preventing cost of failure is an image of at least one of a door, a switch, wallpaper, flooring, furniture, and a bathroom. delete delete delete delete

Images