KR102630775B1 - Apparatus and method for verifiing prototypes based on xr - Google Patents

Abstract

It relates to a prototype verification device and method based on virtual convergence technology (XR), comprising a network unit for communication connection to a user terminal, a memory for storing the user's virtual prototype data, and a processor for controlling the network unit and memory, and the processor When a virtual prototype verification request is received from the user terminal, the user's virtual prototype data is extracted from the memory, a three-dimensional virtual prototype and its verification menu window are provided in a virtual space based on the virtual prototype data, and the verification is performed. A 3D virtual prototype is verified through a user selection input in a menu window, and the verification result of the 3D virtual prototype is provided to the user terminal.

Description

XR-based prototype verification device and method {APPARATUS AND METHOD FOR VERIFIING PROTOTYPES BASED ON XR}

This disclosure relates to a prototype verification device, and more specifically, prototype verification based on virtual convergence technology (XR), which can provide prototype virtualization service, interaction demonstration and exhibition service, and prototype broadcast service based on virtual convergence technology (XR). It relates to devices and methods.

In general, prospective entrepreneurs and entrepreneurs need to prototype the idea of the product they want to develop and verify it.

In this way, prospective entrepreneurs and entrepreneurs need a series of processes to develop product ideas from 2D sketches to 3D data that can be manufactured, and a lot of communication is needed to verify the ideas.

In addition, prospective entrepreneurs and start-ups need a process to quickly virtualize and visualize their initial product development ideas in 3D to share and verify them.

However, in the non-face-to-face environment after COVID-19, many communication problems arose during product development, and a large amount of budget and effort were required to produce prototypes to verify ideas.

In other words, due to the many stages of prototype production for verification before the actual product is mass-produced, many prospective entrepreneurs and start-ups faced the problem of requiring a lot of effort (communication cost) and money.

Therefore, there is a need for the development of a prototype verification device that can reduce the time and cost of producing a prototype, enable effective prototype verification, and provide non-face-to-face exhibition and promotional services suitable for a non-face-to-face environment.

Republic of Korea Patent Publication No. 10-2015-0003963 (January 12, 2015)

One purpose of the present disclosure to solve the problems described above is to provide a 3D virtual prototype in a virtual space based on the user's virtual prototype data, a prototype virtualization verification service, an interaction demonstration and exhibition service, and a prototype broadcast service. The goal is to provide a prototype verification device and method based on virtual convergence technology (XR) that can provide.

The problems to be solved by the present disclosure are not limited to the problems mentioned above, and other problems not mentioned can be clearly understood by those skilled in the art from the description below.

A prototype verification device according to an embodiment of the present disclosure for solving the above-described problem includes a network unit for communication connection to a user terminal, a memory for storing the user's virtual prototype data, and a processor for controlling the network unit and memory. And, when a virtual prototype verification request is received from the user terminal, the processor extracts the user's virtual prototype data from the memory and provides a three-dimensional virtual prototype and its verification menu window in virtual space based on the virtual prototype data. And, the 3D virtual prototype is verified through a user selection input in the verification menu window, and the verification result of the 3D virtual prototype is provided to the user terminal.

In an embodiment, when extracting the virtual prototype data, when a virtual prototype verification request is received from the user terminal, the processor provides a list of the user's virtual prototypes uploaded in advance, and verifies the user's virtual prototypes from the list. When a desired virtual prototype is selected, virtual prototype data corresponding to the selected virtual prototype is extracted from the memory.

In an embodiment, when providing the verification menu window, the processor is characterized in that it provides a verification menu window including a size and shape verification menu of the virtual prototype, a material verification menu, and an assembly and movement verification menu. do.

In an embodiment, when a user input for selecting a size and shape verification menu of the virtual prototype is received, the processor verifies whether the size, shape, and combination of parts of the 3D virtual prototype are the same as the prototype at the time of design. It is characterized by

In an embodiment, when a user input for selecting a material verification menu of the virtual prototype is received, the processor verifies the material in various lighting environments by applying a specific material to each part of the 3D virtual prototype. .

In an embodiment, the processor verifies the appearance of the three-dimensional virtual prototype and the assembly and movement of internal mechanical parts when a user input for selecting a menu for verifying assembly and movement of the virtual prototype is received. Do it as

In an embodiment, when an interaction demonstration and exhibition request is received from the user terminal, the processor extracts the user's virtual prototype data from the memory and creates the three-dimensional virtual prototype in a virtual studio space based on the virtual prototype data. It is characterized by demonstration and exhibition.

In an embodiment, when demonstrating and displaying the 3D virtual prototype, the processor checks whether there is a request to share the 3D virtual prototype, and if there is a request to share the 3D virtual prototype, the processor It is characterized by creating a dynamic link for sharing.

In an embodiment, when a prototype broadcast request is received from the user terminal, the processor extracts the user's virtual prototype data from the memory, demonstrates the 3D virtual prototype in a virtual studio space based on the virtual prototype data, and It is characterized by providing the function of displaying and broadcasting a desired screen in real time during the demonstration and exhibition of the 3D virtual prototype.

A prototype verification method according to an embodiment of the present disclosure includes receiving a virtual prototype verification request from a user terminal, extracting virtual prototype data of the user when a virtual prototype verification request is received from the user terminal, and extracting the virtual prototype data from the user. Providing a 3D virtual prototype and its verification menu window in a virtual space based on data, verifying the 3D virtual prototype through a user selection input in the verification menu window, and verifying the verification result of the 3D virtual prototype. It is characterized by including the step of providing to the user terminal.

A computer program that provides a method of providing a collaborative service according to another embodiment of the present disclosure to solve the above-described problem is combined with a computer as hardware and stored in a medium to perform one of the above-described methods.

In addition to this, another method for implementing the present disclosure, another system, and a computer-readable recording medium recording a computer program for executing the method may be further provided.

As described above, according to the present disclosure, a 3D virtual prototype can be provided in a virtual space based on the user's virtual prototype data, and a prototype virtualization verification service, interaction demonstration and exhibition service, and prototype broadcast service can be provided.

Additionally, the present disclosure can reduce cost, effort, and time due to product development process improvement.

In other words, this disclosure not only helps to substantially save the cost, effort, and time of prospective entrepreneurs, entrepreneurs, and small business owners who want to develop products by effectively verifying the initial idea stage of product development, but also helps to save the size and shape of the prototype. Prototype production costs can be minimized by providing a soft mock-up stage to quickly check the design, etc., and a design mock-up stage to check the color, material, etc.

Additionally, this disclosure can provide virtual convergence technology that anyone (general public or non-experts) can use in the post-corona era.

In other words, the present disclosure provides a tool that can directly increase the efficiency of communication to anyone who needs to quickly make decisions based on 3D data, and provides a tool that can be used to directly increase the efficiency of communication between users who want to develop a product and a prototype manufacturer. It can also be used effectively in face-to-face communication.

In addition, this disclosure can lead to future manufacturing in the 4th industrial era by digitally transforming the prototype production process, and collect, analyze, and utilize meaningful information by digitizing and accumulating a series of product development processes. A system can be established, and it can contribute to the development of non-face-to-face industries such as support for customized online sales channels for small business owners and smart stores and workshops.

The effects of the present disclosure are not limited to the effects mentioned above, and other effects not mentioned may be clearly understood by those skilled in the art from the description below.

1 is a schematic diagram illustrating a prototype verification device according to the present disclosure.
Figure 2 is a block diagram for explaining the configuration modules of the processor of the present disclosure.
3 to 6 are diagrams for explaining the process of providing a prototype verification service according to the present disclosure.
7 to 10 are diagrams for explaining the process of providing interaction demonstration and exhibition service according to the present disclosure.
11 to 14 are diagrams for explaining a process for providing a prototype broadcast service according to the present disclosure.
Figure 15 is a flowchart for explaining the prototype verification method according to the present disclosure.

The advantages and features of the present disclosure and methods for achieving them will become clear by referring to the embodiments described in detail below along with the accompanying drawings. However, the present disclosure is not limited to the embodiments disclosed below and may be implemented in various different forms. The present embodiments are merely provided to ensure that the disclosure is complete and to provide a general understanding of the technical field to which the present disclosure pertains. It is provided to fully inform those skilled in the art of the scope of the present disclosure, and the present disclosure is defined only by the scope of the claims.

The terminology used herein is for the purpose of describing embodiments and is not intended to limit the disclosure. As used herein, singular forms also include plural forms, unless specifically stated otherwise in the context. As used in the specification, “comprises” and/or “comprising” does not exclude the presence or addition of one or more other elements in addition to the mentioned elements. Like reference numerals refer to like elements throughout the specification, and “and/or” includes each and every combination of one or more of the referenced elements. Although “first”, “second”, etc. are used to describe various components, these components are of course not limited by these terms. These terms are merely used to distinguish one component from another. Therefore, it goes without saying that the first component mentioned below may also be the second component within the technical spirit of the present disclosure.

Unless otherwise defined, all terms (including technical and scientific terms) used in this specification may be used with meanings commonly understood by those skilled in the art to which this disclosure pertains. Additionally, terms defined in commonly used dictionaries are not interpreted ideally or excessively unless clearly specifically defined.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the attached drawings.

Prior to explanation, the meaning of terms used in this specification will be briefly explained. However, since the explanation of terms is intended to aid understanding of the present specification, it should be noted that if it is not explicitly described as limiting the present disclosure, it is not used in the sense of limiting the technical idea of the present disclosure.

1 is a schematic diagram illustrating a prototype verification device according to the present disclosure.

As shown in FIG. 1, the prototype verification device 100 according to the present disclosure includes a network unit 150 for communication connection to the user terminal 200, a memory 130 for storing the user's virtual prototype data, and a network unit. It may include a processor 110 that controls 150 and memory 130.

Here, the user terminal 200 may be a mobile device including augmented reality glasses, a smart phone, a tablet PC, a laptop, a personal digital assistant (PDA), etc. All mobile devices (mobile devices or handheld devices) such as the like may be included.

In some cases, the user terminal 200 may include at least one of a mobile device and a fixed device that displays an augmented reality (AR) image, a virtual reality (VR) image, and a mixed reality (MR) image.

As an example, the user terminal 200 may be a fixed type TV such as a Personal Computer (PC) 24, Network TV, Hybrid Broadcast Broadband TV (HBBTV), Smart TV, or Internet Protocol TV (IPTV). There are standing devices, mobile devices (mobile devices or handheld devices) such as smart phones, tablet PCs (26), notebooks (22), and personal digital assistants (PDAs). All can be included.

In addition, the network connecting communication between the prototype verification device 100 and the user terminal 200 of the present disclosure includes both wired and wireless networks, and supports various communication standards or protocols for pairing or/and data transmission and reception. Commonly referred to as a communication network.

These wired/wireless networks include all communication networks that are currently or will be supported in the future according to the standard, and can support one or more communication protocols for them.

These wired/wireless networks include, for example, USB (Universal Serial Bus), CVBS (Composite Video Banking Sync), Component, S-Video (analog), DVI (Digital Visual Interface), HDMI (High Definition Multimedia Interface), Networks and communication standards or protocols for wired connections such as RGB and D-SUB, Bluetooth, RFID (Radio Frequency Identification), infrared data association (IrDA), UWB (Ultra Wideband), and Zigbee (ZigBee), DLNA (Digital Living Network Alliance), WLAN (Wireless LAN) (Wi-Fi), Wibro (Wireless broadband), Wimax (World Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), LTE/LTE -It can be formed by a network for wireless connection, such as Long Term Evolution/LTE-Advanced (A) or Wi-Fi Direct, and its communication standards or protocols.

Additionally, the prototype verification device 100 of the present disclosure can support e-mail, web browsing, applications, etc. through such wired/wireless networks.

In addition, the prototype verification device 100 of the present disclosure can use a standardized general-purpose OS (Operating System) and Web OS, and can support various services or applications on a general-purpose OS kernel or Linux kernel. It is possible to process adding, deleting, amending, updating, etc., and through this, a more user-friendly environment can be created and provided.

In addition, the prototype verification device 100 of the present disclosure can receive and process external input, for example, an external input such as HDMI (High-Definition Multimedia Interface), Playstation, or Xbox (X). All devices such as gaming devices such as -Box, smart phones, tablet PCs, printing devices such as pocket photos, smart TVs, Blu-ray devices, etc. It can be included.

In addition, the prototype verification device 100 of the present disclosure provides a portal server that provides a web page, web content or web service, and advertising data. Advertising server that provides content, content server that provides content, SNS server that provides SNS (Social Network Service), service server provided by the manufacturer, VoD (Video on Demand) ), an MVPD (Multichannel Video Programming Distributor) for providing streaming services, a service server that provides paid services, etc.

Additionally, the network unit 150 of the present disclosure may include at least one of a wireless communication module, a mobile communication module, a wireless Internet module, a short-range communication module, and a location information module.

As an example, the wireless communication module may enable wireless communication between the prototype verification device 100 and the user terminal 200 or between the prototype verification device 100 and a participant terminal.

In addition, the mobile communication module uses technical standards or communication methods for mobile communication (e.g., Global System for Mobile communication (GSM), Code Division MultiAccess (CDMA), Code Division MultiAccess 2000 (CDMA2000), and EV-DO ( Enhanced Voice-Data Optimized or Enhanced Voice-Data Only), Wideband CDMA (WCDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term (LTE-A) It is possible to transmit and receive wireless signals with at least one of a base station, an external terminal, and a server on a mobile communication network built according to (Evolution-Advanced), etc.).

Here, the wireless signal may include various types of data according to voice call signals, video call signals, or text/multimedia message transmission and reception.

Next, the wireless Internet module refers to a module for wireless Internet access and is configured to transmit and receive wireless signals in a communication network based on wireless Internet technologies.

Wireless Internet technologies include, for example, WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance), WiBro (Wireless Broadband), and WiMAX (Worldwide). These include Interoperability for Microwave Access), HSDPA (High Speed Downlink Packet Access), HSUPA (High Speed Uplink Packet Access), LTE (Long Term Evolution), and LTE-A (Long Term Evolution-Advanced).

Next, the short-range communication module is for short-range communication and includes Bluetooth (BluetoothTM), RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee, and NFC (Near). Field Communication), Wi-Fi (Wireless-Fidelity), Wi-Fi Direct, and Wireless USB (Wireless Universal Serial Bus) technology can be used to support short-distance communication.

In addition, the location information module is a module for acquiring the location (or current location) of the prototype verification device 100, and examples thereof include a Global Positioning System (GPS) module, a Wireless Fidelity (WiFi) module, and a beacon module. .

For example, when the prototype verification device 100 utilizes a GPS module, it acquires its own location using signals sent from GPS satellites and provides the obtained location information to a plurality of user terminals 200 and participant terminals. can do.

As another example, when using a Wi-Fi module, the prototype verification device 100 acquires its own location based on information from the Wi-Fi module and a wireless AP (Wireless Access Point) that transmits or receives wireless signals. And, the acquired location information may be provided to a plurality of user terminals 200 and participant terminals.

As another example, the prototype verification device 100 acquires its own location by receiving inaudible sound waves from a specific area using a microphone, and provides the obtained location information to a plurality of user terminals 200 and participant terminals. You may.

In addition, the memory 130 of the present disclosure stores user virtual prototype data, prototype virtualization verification service, interaction demonstration and exhibition service, and a program for providing prototype broadcast service, a plurality of user terminal information, participant terminal information, etc. You can.

In addition, the memory 130 may be a flash memory type, a hard disk type, a multimedia card micro type, or a card type memory (for example, SD or XD memory, etc.). ), RAM (Random Access Memory), SRAM (Static Random Access Memory), ROM (Read-Only Memory, ROM), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic It may include at least one type of storage medium among memory, magnetic disk, and optical disk. The server abnormality detection device may operate in relation to web storage that performs a storage function of the memory 130 on the Internet. The description of the memory described above is only an example and is not limited thereto.

Next, the processor 110 of the present disclosure may be composed of one or more cores, and may include a central processing unit (CPU), a general purpose graphics processing unit (GPGPU), and tensor processing of a computing device. It may include a processor for data analysis, such as a tensor processing unit (TPU).

Additionally, the processor 110 may read the computer program stored in the memory 130 and perform data processing to provide a prototype virtualization verification service, an interaction demonstration and exhibition service, and a prototype broadcast service.

Additionally, the present disclosure may further include an output unit and an input unit.

The output unit of the present disclosure may display a user interface (UI) for providing prototype verification results, and may display any form of information generated or determined by the processor 110 and any form of information received by the network unit 150. Information in the form of can be output.

The output unit of the present disclosure includes a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT LCD), an organic light-emitting diode (OLED), and a flexible display (flexible display). It may include at least one of a display) and a 3D display. Some of these display modules may be transparent or light-transmissive so that the outside can be viewed through them. This may be referred to as a transparent display module, and representative examples of transparent display modules include TOLED (Transparent OLED).

In addition, the input unit of the present disclosure may receive a user input, and the input unit may include keys and/or buttons on a user interface or physical keys and/or buttons for receiving user input. A computer program for controlling the display according to embodiments of the present disclosure may be executed according to user input through the unit.

The input unit of the present disclosure may receive a signal by detecting a user's button operation or touch input, or may receive a voice or movement of the user through a camera or microphone and convert it into an input signal. For this purpose, speech recognition technology or motion recognition technology can be used.

The input unit of the present disclosure may be implemented as an external input device connected to a prototype verification device. For example, the input device may be at least one of a touch pad, a touch pen, a keyboard, or a mouse for receiving user input, but this is only an example and is not limited thereto.

The input unit of the present disclosure can recognize user touch input and may have the same configuration as the output unit.

As an example, the input unit may be composed of a touch screen implemented to receive a user's selection input. The touch screen may be a contact capacitive type, an infrared light sensing type, a surface ultrasonic wave (SAW) type, a piezoelectric type, or a resistive type. Any one of the methods may be used. The detailed description of the touch screen described above is merely an example according to an embodiment of the present invention, and various touch screen panels may be employed in the prototype verification device 100. The input unit configured as a touch screen may include a touch sensor. The touch sensor may be configured to convert changes in pressure applied to a specific part of the input unit or capacitance generated in a specific part of the input unit into an electrical input signal. The touch sensor may be configured to detect not only the location and area of the touch, but also the pressure at the time of touch. When there is a touch input to the touch sensor, the corresponding signal(s) are sent to the touch controller. The touch controller may process the signal(s) and then transmit corresponding data to processor 110. Accordingly, the processor 110 can recognize which area of the input unit has been touched.

Meanwhile, when a virtual prototype verification request is received from the user terminal 200, the processor 110 of the present disclosure extracts the user's virtual prototype data from the memory 130 and creates a three-dimensional virtual prototype in virtual space based on the virtual prototype data. and its verification menu window are provided, the 3D virtual prototype is verified through user selection input in the verification menu window, and the verification result of the 3D virtual prototype can be provided to the user terminal 200.

When extracting virtual prototype data, the processor 110 provides a pre-uploaded list of the user's virtual prototypes when a virtual prototype verification request is received from the user terminal 200, and selects the virtual prototype to be verified from the user's virtual prototype list. When a prototype is selected, virtual prototype data corresponding to the selected virtual prototype can be extracted from the memory 130.

Here, when providing a virtual prototype list, the processor 110 may provide a virtual prototype list in which thumbnail images of the user's virtual prototypes are arranged.

As an example, thumbnail images of a user's virtual prototypes may be classified into categories for each prototype.

Additionally, the processor 110 may provide a public or private selection field for each virtual prototype and determine whether the corresponding virtual prototype is public or private according to a user input for selecting the public or private selection field.

As an example, the processor 110 may provide an SNS sharing selection field for each virtual prototype and determine whether to share the corresponding virtual prototype through SNS according to a user input of selecting the SNS sharing selection field.

Next, when providing a 3D virtual prototype, the processor 110 may provide the 3D virtual prototype in a virtual space using an asset runtime loader.

As an example, the processor 110 loads virtual prototype data having a universal format file including GLTF, FBX, and OBJ into a virtual space, and imports at least one 3D animation included in the virtual prototype data to create a 3D virtual prototype. Prototypes can be provided.

In addition, when providing a 3D virtual prototype, the processor 110 provides a user interface that allows movement, rotation, and enlargement of the 3D virtual prototype using a PBR (Physically Based Render)-based viewer. A user menu may be provided that allows changing shading modes, including full rendering and wire frame mode.

Next, when providing a verification menu window, the processor 110 may provide a verification menu window including a size and shape verification menu of the virtual prototype, a material verification menu, and an assembly and movement verification menu.

Here, when a user input for selecting a size and shape verification menu of the virtual prototype is received, the processor 110 may verify whether the size, shape, and combination of parts of the 3D virtual prototype are the same as the prototype at the time of design.

In some cases, when a user input for selecting a material verification menu of a virtual prototype is received, the processor 110 may apply a specific material to each part of the 3D virtual prototype to verify the material in various lighting environments.

As another case, the processor 110 may verify the appearance of the 3D virtual prototype and the assembly and movement of the internal mechanical parts when a user input for selecting a menu for verifying the assembly and movement of the virtual prototype is received.

Additionally, when verifying a 3D virtual prototype, the processor 110, if the user-selected input is a request to verify the size and shape of the virtual prototype, verifies the shape and ratio of the 3D virtual prototype at various angles within the virtual space. It provides the ability to move, rotate, and enlarge the virtual prototype, and provides a virtual ruler function to measure the size of the components of the 3D virtual prototype.

Next, when verifying a 3D virtual prototype, if the user-selected input is a request to verify the material of the virtual prototype, the processor 110 uses PBR (Physically Based Render)-based realtime graphics to enable realistic verification of the prototype in virtual space. ) A material library is provided, and the real-time graphics material library can provide the function of changing the PBR material for each part of the 3D virtual prototype and the function of changing properties for each PBR material.

Here, the processor 110 may provide a function for changing properties for each PBR material, including color, roughness, metallic, normal map, etc., but this is only an embodiment. It is not limited to this.

Additionally, when verifying a 3D virtual prototype, the processor 110 may provide a real-time lighting control function in the virtual space and a virtual environment change function if the user-selected input is a request to verify the material of the virtual prototype.

Here, the processor 110 creates a virtual environment in which the 3D virtual prototype is located through real-time lighting control functions including lighting brightness, lighting color, lighting spread, shadow control functions, and 3D environment and 3D image support. A function to change the virtual environment may be provided, but this is only an example and is not limited thereto.

In addition, when verifying a 3D virtual prototype, the processor 110, if the user-selected input is a request to verify the material of the virtual prototype, writes the user's text information on all or part of the 3D virtual prototype in the virtual space and creates an annotation. ), a multimedia data linkage function that links 3D virtual prototype data and multimedia data, and a convenience function for prototype verification, including a communication assistance function through 3D line drawing.

Here, the processor 110 provides an annotation insertion function including a function for inputting and displaying user text in the virtual space and a function for linking a text box at an accurate position in the virtual space, and inserts a YouTube video, a PDF document, and a web page into the virtual space. It provides a function for linking multimedia materials that work together in space, and can provide communication assistance functions including three-dimensional line drawings that support change in thickness and color.

Next, when providing the verification result of the 3D virtual prototype, the processor 110 includes a first verification result for size and shape verification of the virtual prototype, a second verification result for material verification of the virtual prototype, and a first verification result for verification of the size and shape of the virtual prototype. At least one of the third verification results for assembly and movement verification is generated and stored in the memory 130, and at least one of the first verification result, the second verification result, and the third verification result is generated at the user terminal 200. ) can be provided.

Here, when the processor 110 receives a verification result request from the user terminal 200, the processor 110 checks the verification type based on the verification result request, and determines the verification type among the first verification result, the second verification result, and the third verification result. A verification result corresponding to can be provided to the user terminal 200.

Next, when an interaction demonstration and exhibition request is received from the user terminal 200, the processor 110 extracts the user's virtual prototype data from the memory 130 and creates a 3D virtual prototype in the virtual studio space based on the virtual prototype data. It can be demonstrated and displayed.

Here, when demonstrating and displaying a 3D virtual prototype, the processor 110 provides a 3D virtual prototype real-time interlocking function considering the cross-platform environment to demonstrate and display the 3D virtual prototype in a plurality of different user terminal environments. can do.

In addition, when demonstrating and displaying a 3D virtual prototype, the processor 110 implements a variable user interface by considering the characteristics of the user terminal, including resolution, and renders the 3D virtual prototype by considering the performance of the user terminal. It can be optimized.

In addition, when demonstrating and displaying a 3D virtual prototype, the processor 110 checks whether there is a request for sharing the 3D virtual prototype, and if there is a request for sharing the 3D virtual prototype, a dynamic link for sharing the 3D virtual prototype is provided. can be created.

Here, the processor 110 uses its own domain name to create a dynamic link for sharing the 3D virtual prototype, a 3D virtual prototype viewer access function through a secure link, and a 3D virtual prototype linked to SNS. It can provide prototype sharing function, dynamic link period limit setting function, and dynamic link password setting function.

In addition, when the 3D virtual prototype is shared, the processor 110 transmits an invitation link to the participant terminal that wishes to share the 3D virtual prototype, and allows the 3D virtual prototype to be shared based on two-way communication with the participant terminal through the invitation link. Experience services can be provided.

Here, the processor 110 can provide an experience service of the 3D virtual prototype based on two-way communication including product disassembly and assembly, material and lighting change, and voice chat.

In addition, the processor 110 provides a cross-platform network simultaneous connection function, a voice chat function, and a presentation and editing rights management function so that multiple user terminals and a plurality of participant terminals located in remote locations domestically and abroad can connect simultaneously. It may be possible.

Next, when a prototype broadcast request is received from the user terminal 200, the processor 110 extracts the user's virtual prototype data from the memory 130 and demonstrates and demonstrates a 3D virtual prototype in a virtual studio space based on the virtual prototype data. It is possible to provide the function of displaying a 3D virtual prototype and broadcasting the desired screen in real time during the exhibition.

Here, when live broadcasting a 3D virtual prototype, the processor 110 produces a VR broadcast linkage mode function including full screen mode, Live logo display, and UI/UX selective hiding function and a broadcast-related function panel. It is possible to provide a function to link content broadcasting, including YouTube, etc.

In addition, the processor 110 can provide an input signal switching function that switches at least four input signals (HDMI Input) from various devices and media depending on the user's situation when live broadcasting a 3D virtual prototype. .

Here, the processor 110 provides at least four HDMI signal input processing functions and a separate PC app for broadcast control, and can selectively transmit a 3D virtual prototype screen through a switcher while linking VR and AR broadcasts.

Additionally, when live broadcasting a 3D virtual prototype, the processor 110 can provide a two-way communication function in which remote network users connected to the virtual space through various devices can express their opinions in real time during the AR broadcast.

Here, the processor 110 may provide a cross-platform based two-way event synchronization function.

As an example, the two-way event synchronization function includes an event real-time synchronization function for conducting virtual events including real-time voting, sending cheering and encouragement messages during VR and AR broadcasts, and participants aggregating event participation data to create a bar graph. and a function to display in a three-dimensional form including a pie graph.

As such, the present disclosure can provide a 3D virtual prototype in a virtual space based on the user's virtual prototype data, and provide a prototype virtualization verification service, interaction demonstration and exhibition service, and prototype broadcast service.

Additionally, the present disclosure can reduce cost, effort, and time due to product development process improvement.

In other words, this disclosure not only helps to substantially save the cost, effort, and time of prospective entrepreneurs, entrepreneurs, and small business owners who want to develop products by effectively verifying the initial idea stage of product development, but also helps to save the size and shape of the prototype. Prototype production costs can be minimized by providing a soft mock-up stage to quickly check the design, etc., and a design mock-up stage to check the color, material, etc.

Additionally, this disclosure can provide virtual convergence technology that anyone (general public or non-experts) can utilize in the post-corona era.

In other words, the present disclosure provides a tool that can directly increase the efficiency of communication to anyone who needs to quickly make decisions based on 3D data, and provides a tool that can be used to directly increase the efficiency of communication between users who want to develop a product and a prototype manufacturer. It can also be used effectively in face-to-face communication.

In addition, this disclosure can lead to future manufacturing in the 4th industrial era by digitally transforming the prototype production process, and collect, analyze, and utilize meaningful information by digitizing and accumulating a series of product development processes. A system can be established, and it can contribute to the development of non-face-to-face industries such as support for customized online sales channels for small business owners and smart stores and workshops.

Figure 2 is a block diagram for explaining the configuration modules of the processor of the present disclosure.

As shown in FIG. 2, the processor 110 of the present disclosure may include a prototype virtualization module 112, an interaction demonstration and exhibition module 114, and a prototype broadcast module 116.

Here, the prototype virtualization module 112 can identify potential problems not visible on the drawing by testing the exact size, shape, material, and assembly of the virtual prototype.

As an example, the prototype virtualization module 112 includes a first verification function to verify the size and shape of the virtual prototype, a second verification function to verify the material of the virtual prototype, and a third verification function to verify the assembly and movement of the virtual prototype. It can perform its function.

The prototype virtualization module 112 can verify whether the size, shape, and combination of parts of the 3D virtual prototype are the same as the prototype at the time of design through a first verification function that verifies the size and shape of the virtual prototype.

In addition, the prototype virtualization module 112 can verify the material in various lighting environments by applying a specific material to each part of the 3D virtual prototype through a second verification function that verifies the material of the virtual prototype.

Additionally, the prototype virtualization module 112 can verify the appearance of the 3D virtual prototype and the assembly and movement of the internal mechanical parts through a third verification function that verifies the assembling and movement of the virtual prototype.

In addition, the interaction demonstration and exhibition module 114 can realistically demonstrate the user's prototype library anytime, anywhere and easily share it to communicate with experts and potential customers.

As an example, the interaction demonstration and exhibition module 114 may perform a prototype demonstration function, a prototype sharing function, and an interaction-based mutual communication function.

The interaction demonstration and exhibition module 114 uses the prototype demonstration function to display virtual prototypes registered in the 3D web library anytime, anywhere in various device environments (PC, mobile phone, smart pad, VR, AR, MR device). You can check and demonstrate the same in .

In addition, the interaction demonstration and exhibition module 114, through the prototype sharing function, shares its 3D prototype data and prototype data library with distant experts, mentors, and demanders at home and abroad through a web address (URL). So that you can check it immediately.

In addition, the interaction demonstration and exhibition module 114 demonstrates an immersive virtual prototype in web, mobile, and XR environments by sending an invitation link (URL) to physically distant experts and demanders through an interaction-based interactive communication function. , invited participants can also experience the prototype based on two-way interaction (product disassembly and assembly, material and lighting changes, voice chat, etc.).

Next, the prototype broadcasting module 116 can utilize the produced 3D virtual prototype and provide an AR broadcasting linkage tool that can promote the product in an immersive way to various experts and potential customers.

Here, the prototype broadcasting module 116 can perform a real-time AR live broadcasting function, an input signal switching function, and an AR broadcasting user interaction function.

As an example, the prototype broadcasting module 116 can perform a function of broadcasting a desired screen in real time during a prototype verification, exhibition, or demonstration situation through a real-time AR live broadcasting function.

Additionally, the prototype broadcasting module 116 can be configured to switch at least four input signals (HDMI Input) from various devices and media depending on the user's situation through the input signal switching function.

In addition, the prototype broadcasting module 116 can provide a two-way communication function through the AR broadcasting user interaction function, which allows remote network users connected to the virtual space with various devices during AR broadcasting to express their opinions in real time.

3 to 6 are diagrams for explaining the process of providing a prototype verification service according to the present disclosure.

As shown in FIGS. 3 to 6, the present disclosure provides a prototype verification service to test the exact size, shape, material, and assembly of the virtual prototype to eliminate potential problems not visible in the drawing. It can be figured out.

As shown in FIG. 3, the present disclosure can upload a 3D virtual prototype to a virtual space using an asset runtime loader.

As an example, the present disclosure loads virtual prototype data having a universal format file including GLTF, FBX, and OBJ into a virtual space, and imports at least one 3D animation included in the virtual prototype data to create a 3D virtual prototype. can be provided.

In addition, the present disclosure provides a user interface capable of moving, rotating, and enlarging a 3D virtual prototype using a PBR (Physically Based Render)-based viewer, and provides full rendering and wireframe mode. A user menu capable of changing shading modes, including frame mode, can be provided.

Additionally, the present disclosure may provide a virtual prototype list in which the user's virtual prototype thumbnail images are arranged.

As an example, thumbnail images of a user's virtual prototypes may be classified into categories for each prototype.

In addition, the present disclosure provides a public or private selection field for each virtual prototype, and can determine whether the corresponding virtual prototype is public or private according to a user input of selecting the public or private selection field.

As an example, the present disclosure provides an SNS sharing selection field for each virtual prototype, and can determine whether to share the corresponding virtual prototype through SNS according to the user input of selecting the SNS sharing selection field.

As shown in FIG. 4, in the present disclosure, if the user selection input is a request to verify the size and shape of the virtual prototype, the 3D virtual prototype is moved and rotated to confirm the shape and ratio of the 3D virtual prototype at various angles in the virtual space. and zoom functions, and may provide a virtual ruler function to measure the size of components of a 3D virtual prototype.

Next, as shown in FIG. 5, the present disclosure provides a PBR (Physically Based Render)-based realtime graphics material library to enable realistic prototype confirmation in virtual space when the user-selected input is a request for material verification of the virtual prototype. , the real-time graphics material library can provide the function of changing PBR material for each part of a 3D virtual prototype and changing properties for each PBR material.

Here, the present disclosure may provide a function for changing properties for each PBR material, including color, roughness, metallic, normal map, etc., but this is only an example and is limited thereto. It doesn't work.

Additionally, the present disclosure can provide a real-time lighting control function and a virtual environment change function in a virtual space when the user-selected input is a request for material verification of a virtual prototype.

Here, the present disclosure is to change the virtual environment in which the 3D virtual prototype is located through real-time lighting control functions including lighting brightness, lighting color, lighting spread, shadow control functions, and 3D environment and 3D image support. A virtual environment change function may be provided, but this is only an example and is not limited thereto.

In addition, the present disclosure provides an annotation insertion function that inserts an annotation by writing the user's text information in all or part of the 3D virtual prototype in the virtual space when the user-selected input is a request to verify the material of the virtual prototype, and a 3D virtual prototype. Prototype verification convenience functions can be provided, including a multimedia data linking function that links prototype data and multimedia data, and a communication assistance function through 3D line drawing.

Here, the present disclosure provides an annotation insertion function including a function for inputting and displaying user text in a virtual space and a function for linking a text box at an accurate position in the virtual space, and inserting a YouTube video, PDF document, or web page into the virtual space. It provides a function for linking multimedia materials that work together, and can provide communication assistance functions including three-dimensional line drawings that support changing thickness and color.

Next, as shown in FIG. 6, in the present disclosure, if the user-selected input is a request for verifying the assembly and movement of the virtual prototype, the assembly and movement test of the prototype can be performed through an automatic assembly function.

7 to 10 are diagrams for explaining the process of providing interaction demonstration and exhibition service according to the present disclosure.

As shown in Figures 7 to 10, the present disclosure provides an interaction demonstration and exhibition service, so that the user's prototype library can be realistically demonstrated anytime, anywhere and easily shared to communicate with experts and potential customers. .

As shown in FIG. 7, in the present disclosure, a 3D virtual prototype can be demonstrated and displayed by uploading the user's virtual prototype data to a virtual studio space.

In addition, the present disclosure can provide a 3D virtual prototype real-time interworking function considering a cross-platform environment to demonstrate and display the 3D virtual prototype in a plurality of different user terminal environments.

Here, the present disclosure implements a variable user interface by considering the characteristics of the user terminal, including resolution, and optimizes rendering of the 3D virtual prototype by considering the performance of the user terminal.

And, as shown in FIG. 8, the present disclosure can check whether there is a request to share the 3D virtual prototype, and if there is a request to share the 3D virtual prototype, a dynamic link for sharing the 3D virtual prototype can be created.

Here, the present disclosure uses its own domain name to create a dynamic link for sharing a 3D virtual prototype, a 3D virtual prototype viewer access function through a secure link, and sharing of a 3D virtual prototype linking SNS. It can provide functions, dynamic link period limit setting function, and dynamic link password setting function.

In addition, as shown in FIG. 9, in the present disclosure, when a 3D virtual prototype is shared, an invitation link is sent to the participant terminal that wishes to share the 3D virtual prototype, and 3D communication is based on two-way communication with the participant terminal through the invitation link. A virtual prototype experience service can be provided.

Here, the present disclosure can provide an experience service of the 3D virtual prototype based on two-way communication including product disassembly and assembly, material and lighting change, and voice chat.

In addition, the present disclosure may provide a cross-platform network simultaneous connection function, a voice chat function, and a presentation and editing rights management function so that a plurality of user terminals and a plurality of participant terminals located in remote locations domestically and abroad can connect simultaneously. .

11 to 14 are diagrams for explaining a process for providing a prototype broadcast service according to the present disclosure.

As shown in FIGS. 11 to 14, the present disclosure is an AR broadcast that utilizes the produced 3D virtual prototype by providing a prototype broadcast service and can promote the product in an immersive way to various experts and potential customers. Linkage tools can be provided.

As shown in FIG. 11, the present disclosure can provide a function for real-time live broadcasting of a desired screen during a demonstration and exhibition situation of a 3D virtual prototype.

Here, the present disclosure provides VR broadcast linkage mode functions including full screen mode, Live logo display, and UI/UX selective hiding functions and broadcast-related function panel production, and links content broadcasts including YouTube, etc. function can be provided.

In addition, as shown in FIG. 12, the present disclosure can provide an input signal switching function that switches at least four input signals (HDMI Input) of various devices and media depending on the user's situation.

Here, the present disclosure provides at least four HDMI signal input processing functions and a separate PC app for broadcast control, and can selectively transmit a 3D virtual prototype screen through a switcher during VR and AR broadcast linkage.

In addition, as shown in FIGS. 13 and 14, the present disclosure provides a two-way communication function in which remote network users connected to the virtual space with various devices during AR broadcasting express their opinions in real time when live broadcasting a 3D virtual prototype. can do.

Here, the present disclosure can provide a cross-platform based two-way event synchronization function.

As an example, the two-way event synchronization function includes an event real-time synchronization function for conducting virtual events including real-time voting, sending cheering and encouragement messages during VR and AR broadcasts, and participants aggregating event participation data to create a bar graph. and a function to display in a three-dimensional form including a pie graph.

Figure 15 is a flowchart for explaining the prototype verification method according to the present disclosure.

As shown in FIG. 15, the present disclosure can receive a virtual prototype verification request from a user terminal (S10).

And, in the present disclosure, when a virtual prototype verification request is received from the user terminal, the user's virtual prototype data can be extracted (S20).

here,. In this disclosure, when a virtual prototype verification request is received from a user terminal, a list of the user's virtual prototypes uploaded in advance is provided, and when a virtual prototype to be verified is selected from the user's virtual prototype list, virtual prototype data corresponding to the selected virtual prototype is provided. can be extracted from memory.

Next, the present disclosure can provide a 3D virtual prototype and its verification menu window in a virtual space based on virtual prototype data (S30).

Here, the present disclosure may provide a verification menu window including a size and shape verification menu, a material verification menu, and an assembly and movement verification menu of the virtual prototype.

Next, in the present disclosure, the 3D virtual prototype can be verified through user selection input in the verification menu window (S40).

Here, in the present disclosure, when a user input for selecting a size and shape verification menu of a virtual prototype is received, it is possible to verify whether the size, shape, and combination of parts of the 3D virtual prototype are the same as the prototype at the time of design.

In addition, in the present disclosure, when a user input for selecting a material verification menu of a virtual prototype is received, a specific material can be applied to each part of the 3D virtual prototype to verify the material in various lighting environments.

In addition, the present disclosure can verify the appearance of the 3D virtual prototype and the assembly and movement of the internal mechanical parts when a user input for selecting a menu for verifying the assembly and movement of the virtual prototype is received.

In addition, the present disclosure can provide the verification results of the 3D virtual prototype to the user terminal (S50).

Here, the present disclosure provides at least one of the first verification results for size and shape verification of the virtual prototype, the second verification result for material verification of the virtual prototype, and the third verification result for assembly and movement verification of the virtual prototype. One can be generated and stored in the memory, and at least one of the first verification result, the second verification result, and the third verification result may be provided to the user terminal.

In addition, in the present disclosure, when an interaction demonstration and exhibition request is received from a user terminal, the user's virtual prototype data can be extracted from the memory and a 3D virtual prototype can be demonstrated and displayed in a virtual studio space based on the virtual prototype data.

In addition, the present disclosure can check whether there is a request to share the 3D virtual prototype and, if there is a request to share the 3D virtual prototype, create a dynamic link for sharing the 3D virtual prototype.

In addition, in this disclosure, when a prototype broadcast request is received from a user terminal, the user's virtual prototype data is extracted from the memory, a 3D virtual prototype is demonstrated and displayed in a virtual studio space based on the virtual prototype data, and the 3D virtual prototype is displayed. It is possible to provide the function of real-time live broadcasting of desired screens during demonstration and exhibition situations.

The method according to an embodiment of the present disclosure described above may be implemented as a program (or application) and stored in a medium in order to be executed in combination with a server, which is hardware.

The above-mentioned program is C, C++, JAVA, machine language, etc. that can be read by the processor (CPU) of the computer through the device interface of the computer in order for the computer to read the program and execute the methods implemented in the program. It may include code coded in a computer language. These codes may include functional codes related to functions that define the necessary functions for executing the methods, and include control codes related to execution procedures necessary for the computer's processor to execute the functions according to predetermined procedures. can do. In addition, these codes may further include memory reference-related codes that indicate at which location (address address) in the computer's internal or external memory additional information or media required for the computer's processor to execute the above functions should be referenced. there is. In addition, if the computer's processor needs to communicate with any other remote computer or server in order to execute the above functions, the code uses the computer's communication module to determine how to communicate with any other remote computer or server. It may further include communication-related codes regarding whether communication should be performed and what information or media should be transmitted and received during communication.

The storage medium refers to a medium that stores data semi-permanently and can be read by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. Specifically, examples of the storage medium include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, etc., but are not limited thereto. That is, the program may be stored in various recording media on various servers that the computer can access or on various recording media on the user's computer. Additionally, the medium may be distributed to computer systems connected to a network, and computer-readable code may be stored in a distributed manner.

The steps of the method or algorithm described in connection with the embodiments of the present disclosure may be implemented directly in hardware, implemented as a software module executed by hardware, or a combination thereof. The software module may be RAM (Random Access Memory), ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), Flash Memory, hard disk, removable disk, CD-ROM, or It may reside on any type of computer-readable recording medium well known in the art to which this disclosure pertains.

Above, embodiments of the present disclosure have been described with reference to the attached drawings, but those skilled in the art will understand that the present disclosure can be implemented in other specific forms without changing its technical idea or essential features. You will be able to understand it. Therefore, the embodiments described above should be understood in all respects as illustrative and not restrictive.

Claims (10)

A network unit for communication connection to the user terminal;
Memory to store the user's virtual prototype data;
Including a processor that controls the network unit and memory,
The processor,
When a virtual prototype verification request is received from the user terminal, the user's virtual prototype data is extracted from the memory, a 3D virtual prototype and its verification menu window are provided in a virtual space based on the virtual prototype data, and the verification menu window is provided. Verifies the 3D virtual prototype through user selection input, and provides verification results of the 3D virtual prototype to the user terminal,
The processor,
When providing the verification menu window, a verification menu window including a size and shape verification menu, a material verification menu, and an assembly and movement verification menu of the 3D virtual prototype is provided,
The processor,
When a user input for selecting the size and shape verification menu of the 3D virtual prototype is received, it is verified whether the size, shape, and combination of parts of the 3D virtual prototype are the same as the prototype at the time of design,
The processor,
When a user input for selecting a size and shape verification menu of the 3D virtual prototype is received, the function to move, rotate, and enlarge the 3D virtual prototype within the virtual space is provided, and the size of the component parts of the 3D virtual prototype is provided. Provide a virtual ruler to measure,
The processor,
When a user input for selecting a material verification menu of the 3D virtual prototype is received, a specific material is applied to each part of the 3D virtual prototype to verify the material in various lighting environments,
The processor,
Adjusting the brightness, color, spread, and shadow of the lighting in the lighting environment, and changing the virtual environment in which the 3D virtual prototype is placed,
The processor,
When verifying the material of the 3D virtual prototype, it provides an annotation insertion function and a function to link data of the virtual prototype with multimedia materials,
The processor,
When a user input for selecting a menu for verifying assembly and movement of the 3D virtual prototype is received, the assembly and movement of the external appearance and internal mechanical parts of the 3D virtual prototype are verified,
A first verification result for size and shape verification of the 3D virtual prototype, a second verification result for material verification of the 3D virtual prototype, and a third verification result for assembly and movement verification of the 3D virtual prototype. A prototype verification device provided to the user terminal. According to claim 1,
The processor,
When extracting the virtual prototype data, when a virtual prototype verification request is received from the user terminal, a list of the user's virtual prototypes uploaded in advance is provided, and when the virtual prototype to be verified is selected from the user's virtual prototype list, the selected A prototype verification device characterized in that it extracts virtual prototype data corresponding to the virtual prototype from the memory. delete delete delete delete According to claim 1,
The processor,
When a request for interaction demonstration and exhibition is received from the user terminal, the user's virtual prototype data is extracted from the memory, and the three-dimensional virtual prototype is demonstrated and displayed in a virtual studio space based on the virtual prototype data. Verification device. According to clause 7,
The processor,
When demonstrating and displaying the 3D virtual prototype, check whether there is a request to share the 3D virtual prototype, and if there is a request to share the 3D virtual prototype, create a dynamic link for sharing the 3D virtual prototype. Featured prototype verification device. According to claim 1,
The processor,
When a prototype broadcast request is received from the user terminal, the user's virtual prototype data is extracted from the memory, the 3D virtual prototype is demonstrated and displayed in a virtual studio space based on the virtual prototype data, and the 3D virtual prototype is displayed. A prototype verification device characterized by providing the function of real-time live broadcasting of the desired screen during demonstration and exhibition situations. A prototype verification method performed by a processor, comprising:
Receiving a virtual prototype verification request from a user terminal;
When a virtual prototype verification request is received from the user terminal, extracting the user's virtual prototype data;
providing a 3D virtual prototype and its verification menu window in a virtual space based on the virtual prototype data;
Verifying a 3D virtual prototype through a user selection input in the verification menu window; and
Providing verification results of the 3D virtual prototype to the user terminal,
The processor,
When providing the verification menu window, a verification menu window including a size and shape verification menu, a material verification menu, and an assembly and movement verification menu of the 3D virtual prototype is provided,
The processor,
When a user input for selecting the size and shape verification menu of the 3D virtual prototype is received, it is verified whether the size, shape, and combination of parts of the 3D virtual prototype are the same as the prototype at the time of design,
The processor,
When a user input for selecting a size and shape verification menu of the 3D virtual prototype is received, the function to move, rotate, and enlarge the 3D virtual prototype within the virtual space is provided, and the size of the component parts of the 3D virtual prototype is provided. Provide a virtual ruler to measure,
The processor,
When a user input for selecting a material verification menu of the 3D virtual prototype is received, a specific material is applied to each part of the 3D virtual prototype to verify the material in various lighting environments,
The processor,
Adjusting the brightness, color, spread, and shadow of the lighting in the lighting environment, and changing the virtual environment in which the 3D virtual prototype is placed,
The processor,
When verifying the material of the 3D virtual prototype, it provides an annotation insertion function and a function to link data of the virtual prototype with multimedia materials,
The processor,
When a user input for selecting a menu for verifying assembly and movement of the 3D virtual prototype is received, the assembly and movement of the external appearance and internal mechanical parts of the 3D virtual prototype are verified,
A first verification result for size and shape verification of the 3D virtual prototype, a second verification result for material verification of the 3D virtual prototype, and a third verification result for assembly and movement verification of the 3D virtual prototype. A prototype verification method characterized in that it is provided to the user terminal.

Images