KR102328714B1 - Composite reality driving system using assembling 3D structure and composite reality driving method using the same - Google Patents

Abstract

A purpose of the present invention is to provide a composite reality driving system using an assemblable 3D structure for driving VR/AR/MR content using 3D structure created by a user, and a composite reality driving method using the same. According to the present invention, a composite reality driving system using an assemblable 3D structure comprises: a 3D marker unit that is pre-assembled into a 3D structure by a user to function as a 3D marker; and an electronic device configured to display augmented reality, virtual reality, or composite reality content corresponding to the 3D marker when the 3D marker unit is directed in a specific direction and recognized as a 3D marker.

Description

Composite reality driving system using assembling 3D structure and composite reality driving method using the same

The present invention relates to a complex reality driving system for simultaneously or simultaneously driving virtual reality and augmented reality and a method using the same, and more particularly, to a complex reality driving system using an assembleable three-dimensional structure and a mixed reality driving method using the same is about

In recent years, development of realistic content using virtual reality, augmented reality, or mixed reality, which is a combined method thereof, is increasing.

Immersive content has the characteristics of being applied to a wide range of fields due to the advantages of increasing the user's immersion compared to general content, reducing the cost of information delivery compared to the traditional method, and being applicable to any field.

Due to the characteristics of these immersive content, the need for content development that combines heterogeneous sales in various content consumption areas such as history, tourism, education, and games is increasing.

In particular, in the case of history education, in order to enhance the educational effect, the method of using existing content that has no choice but to indirectly experience the remaining cultural assets or historical sites is being replaced by realistic educational content.

However, in the case of historical educational contents, there were limitations to the existing method of executing VR/AR/MR contents using photos to increase the educational effect, and users made a model of cultural assets and experienced VR/AR/MR through direct experience. By allowing participants to participate in MR contents, there is a need for development of a new concept complex reality driving system to increase the educational effect.

Patent Document 1: Publication No. 10-2019-0025391 (published on: March 11, 2019) Patent Document 2: Registered Patent No. 10-1989969 (Announcement Date: 2019.06.11) Patent Document 3: Registered Patent No. 10-2049773 (Announcement Date: 2019.11.22)

The present invention devised by the above necessity is a three-dimensional assemblable three-dimensional structure in which a user directly creates an assemblable three-dimensional structure that implements a cultural property in a miniature, and drives VR/AR/MR contents using the three-dimensional structure created by the user. An object of the present invention is to provide a mixed reality driving system using a structure and a mixed reality driving method using the same.

In order to achieve the above object, a complex reality driving system using an assembleable three-dimensional structure according to an embodiment of the present invention includes: a three-dimensional marker unit pre-assembled into a three-dimensional structure by a user to function as a three-dimensional marker; and an electronic device configured to display augmented reality, virtual reality, or mixed reality content corresponding to the three-dimensional marker when the three-dimensional marker is directed in a specific direction and recognized as the three-dimensional marker.

In this case, the three-dimensional marker unit is separated into the plurality of parts on a part plate on which the shapes of the plurality of parts constituting the three-dimensional structure are pre-printed, and by assembling the separated parts with each other, It is a three-dimensional structure constituting a miniature cultural property including feature points.

In this case, the part plate, the shape of the part constituting the miniature cultural property is printed on the surface, and may be composed of a paper material compressed in multiple ways.

On the other hand, the characteristic point of the cultural heritage may be composed of characters, figures, shapes, shapes, colors, and combinations thereof obtained from actual cultural assets.

Meanwhile, the electronic device includes a camera module for optically recognizing the 3D marker unit, a display module for displaying the 3D marker unit recognized by the camera module on a screen, and information related to the 3D marker unit. An information providing module, an AR/VR execution module that executes augmented reality and virtual reality related to the 3D marker unit to overlap and display on the display module, and image reproduction for displaying an image related to the 3D marker unit on the display module It includes a module, a control module for overall controlling their operation, and a communication module for communicating with an external server.

In this case, the control module controls to image the three-dimensional structure as a subject by the camera module, and displays the three-dimensional structure on the display module. When the displayed three-dimensional structure is recognized as a marker, the information When menu information is displayed on the display module through a providing module and a content request related to augmented reality or virtual reality is received by a user, the augmented reality content or virtual reality content is transmitted to the display module through the AR/VR execution module You can control the display.

The complex reality driving method using the complex reality driving system using the assembleable three-dimensional structure according to another embodiment of the present invention includes a three-dimensional marker unit and the three-dimensional (3D) marker that are pre-assembled into a three-dimensional structure by a user to function as a three-dimensional marker. An electronic device configured to display augmented reality, virtual reality, or mixed reality contents corresponding to the three-dimensional marker when the marker unit is directed in a specific direction and recognized as the three-dimensional marker; Using a mixed reality driving system, the electronic device comprising: optically recognizing the 3D marker unit by a camera module; displaying the 3D marker unit recognized by the camera module on a screen; displaying an information menu related to the three-dimensional marker unit; executing augmented reality or virtual reality related to the 3D marker unit and executing augmented reality or virtual reality content through the display module when a user requests to execute virtual reality or augmented reality through the information menu; and reading the image related to the augmented reality or virtual reality content when the user requests to display the image through the information menu, and then displaying the read image through the display module.

In this case, the executing of the virtual reality or augmented reality content may include: displaying at least one virtual reality content execution menu for executing the virtual reality content on the screen on which the 3D marker unit is displayed so as to overlap; when one of the virtual reality content execution menus is selected, converting the screen on which the 3D marker unit is displayed to the virtual reality content screen related to the selected execution menu; and when the user moves the electronic device upward, downward, left, or right on the virtual reality content screen, a content screen changed with respect to the virtual reality content screen in response to the movement is displayed through the display module.

On the other hand, in the step of executing the virtual reality or augmented reality content, if there is an augmented reality execution request through the information menu, the augmented reality content stored in advance on the screen on which the 3D marker unit is displayed is superimposed in a semi-transparent or opaque manner. display, and the augmented reality content is dynamic content.

On the other hand, in the displaying of the image, if there is an image display execution request through the information menu, when the virtual reality or augmented reality content is being executed, the corresponding virtual reality or augmented reality content is stopped, and the three-dimensional marker A pre-stored past image of the cultural property recognized by the department is displayed through the display module.

According to various embodiments of the present disclosure, the effect of experiential education on the cultural heritage can be increased by making a three-dimensional marker for driving the complex reality content by directly assembling the miniature of the cultural property by the user,

In addition, by intuitively providing various information about the cultural heritage in various ways such as virtual reality, augmented reality, and mixed reality content using a three-dimensional assembly of cultural assets that can be assembled by the user, the effect of increasing user convenience is achieved. perform

1 is a block diagram for illustratively explaining a complex reality driving system using an assembleable three-dimensional structure according to an embodiment of the present invention;
2 is a view for explaining the three-dimensional marker unit shown in FIG. 1 by way of example;
3 is a view for explaining the assembly plate of the three-dimensional marker shown in FIG. 2 by way of example;
4 is a view for illustratively explaining a state in which all assembly parts are separated from the assembly plate shown in FIG. 3;
5 is a view for explaining by way of example another type of three-dimensional marker unit according to an embodiment of the present invention;
6 is a view for explaining the assembly plate of the three-dimensional marker shown in FIG. 5 by way of example;
7 is a view for illustratively explaining a state in which all assembly parts are separated from the assembly plate shown in FIG. 6;
8 is a view for explaining an electronic device according to an embodiment of the present invention by way of example;
9 is a view for explaining an example of imaging a 3D marker unit using an electronic device according to an embodiment of the present invention;
10 is a view for explaining a process of recognizing a 3D marker unit in the electronic device shown in FIG. 9 by way of example;
11 is a view exemplarily showing the three-dimensional marker unit shown in FIG. 10 and a related virtual reality content menu;
12 to 14 are views exemplarily explaining virtual reality content executed by selecting one of the virtual reality content menus shown in FIG. 11;
15 is a view exemplarily illustrating an example of displaying an image related to a three-dimensional marker unit according to an embodiment of the present invention;
16 is a diagram exemplarily illustrating a process of scanning augmented reality content using a three-dimensional marker unit according to another embodiment of the present invention;
17 is a view exemplarily showing a process of executing augmented reality content corresponding to the three-dimensional marker unit shown in FIG. 16;
18 is a view exemplarily showing an example of displaying augmented reality content overlaid on the 3D marker shown in FIG. 17;
19 is a diagram exemplarily showing an example of dynamically displaying augmented reality content on the 3D marker unit shown in FIG. 18;

Hereinafter, a preferred embodiment of the present invention will be described with reference to the drawings. The embodiments described below may be variously changed in design within the scope of the technical spirit of the present invention, and even the design-changed scope falls within the scope of the present invention within the technical spirit of the present invention.

1 is a block diagram for illustratively explaining a complex reality driving system using an assembleable three-dimensional structure according to an embodiment of the present invention. Referring to FIG. 1 , a complex reality driving system using an assembleable three-dimensional structure includes a three-dimensional marker unit 100 and an electronic device 200 , and the electronic device 200 performs wired/wireless communication with the web server 300 . can be connected through

When the three-dimensional marker unit 100 is assembled by a user and configured in a three-dimensional form, it functions as a three-dimensional marker for executing VR/AR/MR. According to various embodiments of the present disclosure, the three-dimensional marker unit 100 may be configured to indicate national cultural properties, local cultural properties, historical sites, and various monuments. Here, the 3D marker unit 100 has a technical feature in that it can be assembled by a user, and when the assembly of the 3D marker unit 100 is completed, it may become a miniature representing a historical monument. The three-dimensional marker unit 100 may include at least one feature point capable of expressing a historical souvenir.

The electronic device 200 includes a camera module for optically recognizing the 3D marker unit, a display module for displaying the 3D marker unit recognized by the camera module on a screen, an information providing module for displaying information related to the 3D marker unit, 3 AR/VR execution module that executes augmented reality and virtual reality related to the dimensional marker unit and superimposes it on the display module, and an image reproduction module that displays images related to the 3D marker unit on the display module, and controls their overall operation and a communication module for communication with a control module and an external web server.

The web server 300 is connected to the electronic device 200 through a wired/wireless network and exchanges data and information. The web server 300 operates as an application operating server that stores applications installed in the electronic device 200 or stores AR/VR/MR contents, or stores member information and subscription information when operating under a membership system. The web server 300 may provide a new version of the application to the electronic device 200 according to a user's request, and may provide newly added AR/VR/MR content. In addition, the web server 300 may add and register information on the new type of three-dimensional marker unit 100 to the database, and may receive, store, and analyze log information about the unrecognized marker unit.

FIG. 2 is a view for explaining the three-dimensional marker unit shown in FIG. 1 by way of example. Referring to FIG. 2 , the three-dimensional marker unit 100 is a three-dimensional marker composed of a miniature form of a traditional temple. The three-dimensional marker unit 100 may be completed by being assembled by a user after each component is separated from a component plate to be described below. This three-dimensional marker unit 100-1 is a traditional temple (eg, Dongguksa: Dongguksa) was founded in 1909 by a Japanese monk Seonungbulgwan, and was operated by single monks for 36 years during the Japanese colonial period. This temple has a painful history of returning to the arms of the Republic of Korea after liberation on August 15, 1945. Thus, it has passed through the Korean Empire and the Japanese colonial period to the present day. As the only Japanese-style temple left in Korea, Daeungjeon and Yosachae Unlike Korea, which has a splendid dancheong, the eaves and many windows on the outer wall of the Daeungjeon show Japanese colors.The main temple of Seonunsa, Gochang, the 24th parish of the Jogye Order, was built in 2003. It was designated as National Registered Cultural Property No. 64 in July. The original name of Dongguksa Temple was Geumgangseonsa, which is a miniature form of Jodongseonsa Temple, which was founded in 1909 by a Japanese monk, Naejeonbulgwan, when he opened Pogyoso in Gunsan. The three-dimensional marker unit 100 in the miniature format may recognize the corresponding marker unit in a specific direction and execute the VR/AR/MR application.

FIG. 3 is a view for exemplarily explaining the assembly plate of the three-dimensional marker unit shown in FIG. 2 . Referring to FIG. 3 , the assembly plate 100-1 of the three-dimensional marker unit is a set of two assembly plates composed of a left plate (see FIG. 3(a)) and a right plate (see FIG. 3(b)). Depending on the embodiment, it may be composed of two or more assembly plates.

The assembly plate is configured so that various pre-printed parts can be easily separated. Each part is separated from the assembly plate and assembled with other parts to constitute the three-dimensional marker part 100 .

FIG. 4 is a view for explaining a state in which all assembly parts are separated from the assembly plate shown in FIG. 3 . Referring to FIG. 4 , when all parts are separated and parts connected to each other are assembled together, the three-dimensional marker unit 100 is completed. The assembly plate shown in FIG. 4 is printed with a unique number for each part, and assembly is performed for each part using each unique number. However, each unique number does not mean the order of assembly.

5 is a diagram for illustratively explaining another type of 3D marker unit according to an embodiment of the present invention. Referring to FIG. 5 , the three-dimensional marker unit 100 is a three-dimensional marker composed of a local historic site in a miniature form. The three-dimensional marker unit 100 may be completed by being assembled by a user after each component is separated from a component plate to be described below. This three-dimensional marker unit 100-1 is a regional historic site (eg, Gunsan Port in the 1930s: a port in Gunsan-si, Jeollabuk-do. Even before the opening of the port, it was a center of joun and a rice collecting center. (Rice accounted for about 90%) in a miniature form. The three-dimensional marker unit 100 in the miniature format may recognize the corresponding marker unit in a specific direction and execute the VR/AR/MR application. In addition, the complex reality driving system using the assembleable three-dimensional structure according to an embodiment of the present invention can express the characteristic points representing the Gunsan Port of the past (Gunsan Port in the 1930s) in any one or more ways of VR/AR/MR contents. have.

FIG. 6 is a view for exemplarily explaining the assembly plate of the three-dimensional marker unit shown in FIG. 5 . Referring to FIG. 6 , the assembly plate 100-1 of the three-dimensional marker unit is a set of two assembly plates composed of an upper plate (see FIG. 6(a)) and a lower plate (see FIG. 6(b)). Depending on the embodiment, it may be composed of two or more assembly plates.

The assembly plate shown in FIG. 6 is colored with a unique color for each part, and this coloring may serve as a unique feature for recognizing the three-dimensional marker unit 100 when the assembly is completed. In addition, the assembly plate is configured so that various pre-printed parts can be easily separated. Each part is separated from the assembly plate and assembled with other parts to constitute the three-dimensional marker part 100 .

7 is a view for exemplarily explaining a state in which all assembly parts are separated from the assembly plate shown in FIG. 6 . Referring to FIG. 7 , when all parts are separated and parts connected to each other are assembled together, the three-dimensional marker unit 100 is completed. A unique number is printed around each part, and assembly is made for each part using each unique number. However, each unique number does not mean the order of assembly.

8 is a diagram for explaining an electronic device according to an embodiment of the present invention. Referring to FIG. 8 , the electronic device 200 includes a camera module 210 , a display module 220 , an information providing module 230 , an AR/VR execution module 240 , an image reproducing module 250 , and a control module ( 260 ) and a communication module 270 .

The camera module 210 operates in an optical manner, and functions to capture a three-dimensional marker unit, which is a subject, and extract feature points of the corresponding three-dimensional marker unit. The camera module 210 captures at least one feature point among the shape, shape, color, character, symbol, and picture of the three-dimensional marker unit 100, and converts the captured feature point into an electrical signal to the control module 260. transmit

The display module 220 performs a function of displaying the 3D marker unit 100 recognized by the camera module 210 . The display module 220 may further include a display display function such as a liquid crystal display or OLED and a touch panel unit to detect an external input and also function as an input device.

The information providing module 230 generates various types of information for displaying information related to the 3D marker unit 100 through the display module 220 . The information providing module 230 may provide a menu button for selecting an AR/VR/image display function. Also, the information providing module 230 may provide detailed information on AR/VR/MR content to the user through the display module 220 .

The AR/VR execution module 240 performs a function of generating augmented reality and virtual reality contents so that the augmented reality and virtual reality contents related to the 3D marker unit 100 are overlapped and displayed on the display module 220 . The AR/VR execution module 240 may call pre-stored AR content and VR content and provide it to the user through the display module 220 . Alternatively, the AR/VR execution module 240 generates modified AR/VR contents by changing the contents of the already-running AR/VR contents in response to a user's manipulation, and displays the generated modified AR/VR contents on the display module 220 ) can be provided to users.

The image reproduction module 250 may read an image related to the currently executed 3D marker unit 100 from a storage module (not shown), and provide the read image data to the user through the display module 220 . The image reproduction module 250 may be provided as a static image, a dynamic image, an animation, a flash, a sound, and a combination thereof.

The control module 260 includes overall operations of the camera module 210 , the display module 220 , the information providing module 230 , the AR/VR execution module 240 , the image reproduction module 250 , and the communication module 270 , etc. to control

The control module 260 may be configured as a single board computer including at least one MPU, APU, CPU, and the like. The control module 260 includes various input/output interfaces, through which various external devices may be connected to expand functions. The control module 260 may monitor the operation of each module, and when an exception occurs, stop the operation of the VR/AR application to execute the exception processing. The control module 260 may collect log information related to a user's control command, an execution result of an application, and the like, and detect whether the application and the system operate normally based thereon.

The communication module 270 may exchange data with the external server 300 in a wired/wireless communication method according to the control of the control module 260 . The communication module 270 may transmit a request signal for requesting VR/AR content to the external server 300 and receive a VR/AR content data signal from the external server 300 .

9 is a view for explaining an example of imaging a 3D marker unit using an electronic device according to an embodiment of the present invention. Referring to FIG. 9 , the user assembles and completes the three-dimensional marker unit 100 and places it on the desk. The user uses the electronic device 200 to take an image by pointing the 3D marker unit 100 placed on the desk at a predetermined angle. At this time, when the electronic device 200 recognizes the 3D marker unit 100 , it automatically executes the VR/AR application pre-installed in the electronic device 200 , and 3 The dimension marker unit 100 is displayed to the user through the display module 220 .

FIG. 10 is a diagram for exemplarily explaining a process of recognizing a 3D marker unit in the electronic device shown in FIG. 9 . Referring to FIG. 10 , an actual image of the 3D marker unit 100 may be displayed on the display module 220 of the electronic device 200 . When the 3D marker unit 100 is displayed on the display module 220 of the electronic device 200 and a VR/AR application is executed, the 3D marker unit 100 is recognized, and the VR/AR A menu of an application may be provided to the user through the display module 220 .

11 is a diagram exemplarily illustrating a 3D marker unit shown in FIG. 10 and a related virtual reality content menu. Referring to FIG. 11 , the information providing module 230 displays various types of information superimposed on the image of the 3D marker unit 100 and provides it to the user. The information providing module 230 provides an execution button selection menu 230-1, a movement and question menu 230-2, a content information menu 230-3, and the like.

In addition, the AR/VR execution module 240 may execute the virtual reality content by displaying the virtual reality content menu 240 - 1 that can select the virtual reality content superimposed on the image of the 3D marker unit 100 . let it be If any one of the virtual reality content menus 240 - 1 executed by the AR/VR execution module 240 is selected, it is converted to a connected virtual reality screen by the selected menu.

12 to 14 are diagrams exemplarily illustrating virtual reality content executed by selecting one of the virtual reality content menus shown in FIG. 11 . FIG. 12 is a portion of VR contents for a corresponding place prepared in advance corresponding to the virtual reality menu selected in FIG. 11 . When the electronic device 200 is moved in the X-axis or Y-axis direction in FIG. 12 , continuous VR content is displayed on the moving screen through the display module 220 .

FIG. 13 shows VR contents converted by rotating the electronic device 200 in the X-axis direction in the screen state shown in FIG. 12 . FIG. 14 shows VR contents converted by rotating the electronic device 200 in the -X-axis direction in the screen state shown in FIG. 12 . The user may continuously experience the VR content screen through the display module 220 by moving the electronic device 200 along the Y-axis or the -Y-axis.

15 is a view exemplarily illustrating an example of displaying an image related to a 3D marker unit according to an embodiment of the present invention. Referring to FIG. 15 , when a past photo menu is selected by the user from among the execution button selection menu 230-1 provided by the information providing module 230, image information associated with the corresponding 3D marker unit 100 may be displayed through the display module 220 . In FIG. 15 , since the 3D marker unit 100 is content for Dongguksa in Gunsan, the electronic device 200 provides the user with an image of Dongguksa in the past by displaying it through the display module 220 .

16 is a diagram exemplarily illustrating a process of scanning augmented reality content using a 3D marker unit according to another embodiment of the present invention. Referring to FIG. 16 , when an augmented reality button is selected from among the execution button selection menus 230-1 provided by the information providing module 230 or when a VR/AR application is first executed according to settings, augmented reality content is executed. A scanning operation is performed to

FIG. 17 is a diagram exemplarily illustrating a process of executing augmented reality content corresponding to the 3D marker unit shown in FIG. 16 . Referring to FIG. 17 , after scanning of the 3D marker unit 100 is completed, AR content related to the 3D marker unit 100 is displayed through the display module 220 . In this case, the AR/VR execution module 240 may notify the user that the augmented reality is being executed by displaying the AR content 240 - 1 to be superimposed on the 3D marker unit 100 .

FIG. 18 is a diagram exemplarily showing an example of displaying augmented reality content overlaid on the 3D marker shown in FIG. 17 . Referring to FIG. 18 , the electronic device 200 displays the augmented reality content 240 - 2 generated by the AR/VR execution module 240 to be superimposed on the 3D marker unit 100 . In this case, the augmented reality content 240 - 2 may be expressed not only as static content but also as dynamic content and content in the form of a combination thereof. For example, FIG. 18 shows a state of high tide in Gunsan Port in the 1930s.

19 is a diagram exemplarily illustrating an example of dynamically displaying augmented reality content on the 3D marker unit shown in FIG. 18 . Referring to FIG. 19 , the augmented reality content 240 - 2 may be expressed not only as static content but also as dynamic content and content in the form of a combination thereof. For example, FIG. 19 dynamically expresses an example in which low tide and high tide are switched in Gunsan Port in the 1930s.

On the other hand, even though it has been described that all components constituting the embodiment of the present invention are combined or operated as one, the present invention is not necessarily limited to this embodiment. That is, within the scope of the object of the present invention, all the components may operate by selectively combining one or more. In addition, although all of the components may be implemented as one independent hardware, some or all of the components are selectively combined to perform some or all functions of the combined components in one or a plurality of hardware program modules It may be implemented as a computer program having Codes and code segments constituting the computer program can be easily deduced by those skilled in the art of the present invention. Such a computer program is stored in a computer-readable non-transitory computer readable media, read and executed by the computer, thereby implementing an embodiment of the present invention.

Here, the non-transitory readable recording medium refers to a medium that stores data semi-permanently and can be read by a device, not a medium that stores data for a short moment, such as a register, cache, memory, etc. . Specifically, the above-described programs may be provided by being stored in a non-transitory readable recording medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, and the like.

In the above, preferred embodiments of the present invention have been illustrated and described, but the present invention is not limited to the specific embodiments described above, and it is common in the technical field to which the present invention pertains without departing from the gist of the present invention as claimed in the claims. Various modifications may be made by those having the knowledge of, of course, and these modifications should not be individually understood from the technical spirit or perspective of the present invention.

100: three-dimensional marker unit 200: electronic device
210: camera module 220: display module
230: information providing module 240: VR / AR execution module
250: image playback module 260: control module
270: communication module 300: web server

Claims (10)

In a complex reality driving system using an assembleable three-dimensional structure,
a three-dimensional marker unit pre-assembled into a three-dimensional structure by a user to function as a three-dimensional marker; and
and an electronic device configured to display augmented reality, virtual reality, or mixed reality contents corresponding to the three-dimensional marker when the three-dimensional marker unit is directed in a specific direction and recognized as the three-dimensional marker;
The three-dimensional marker unit is separated into the plurality of parts in a part plate on which the shapes of the plurality of parts constituting the three-dimensional structure are pre-printed, and by assembling the separated parts with each other, including characteristic points of cultural properties A complex reality driving system using an assembleable three-dimensional structure, characterized in that it is a three-dimensional structure constituting a miniature cultural property.
delete According to claim 1,
The component plate is a complex reality driving system using an assembleable three-dimensional structure, characterized in that the shape of the parts constituting the miniature cultural property is printed on the surface, and is composed of a multi-compressed paper material.
According to claim 1,
The characteristic point of the cultural heritage is a complex reality driving system using an assembleable three-dimensional structure, characterized in that it consists of characters, figures, shapes, shapes, colors, and combinations thereof obtained from actual cultural assets.
According to claim 1,
The electronic device provides a camera module for optically recognizing the 3D marker unit, a display module for displaying the 3D marker unit recognized by the camera module on a screen, and information for displaying information related to the 3D marker unit A module, an AR/VR execution module that executes augmented reality and virtual reality related to the three-dimensional marker unit and overlaps and displays the display module, an image reproduction module that displays an image related to the three-dimensional marker unit on the display module; A complex reality driving system using an assembleable three-dimensional structure, characterized in that it comprises a control module for overall controlling their operation and a communication module for communication with an external server.
6. The method of claim 5,
The control module controls to image the three-dimensional structure as a subject by the camera module, and displays the three-dimensional structure on the display module. When the displayed three-dimensional structure is recognized as a marker, through the information providing module Displaying menu information on the display module, and when receiving a content request related to augmented reality or virtual reality by a user, control to display the augmented reality content or virtual reality content on the display module through the AR/VR execution module A complex reality driving system using an assembleable three-dimensional structure, characterized in that.
In order to function as a three-dimensional marker, the shape of a plurality of parts constituting a three-dimensional structure is separated into the plurality of parts on a pre-printed part plate by a user, and the separated parts are assembled with each other to include a characteristic point of cultural property A three-dimensional marker unit composed of a miniature cultural property that In a complex reality driving method using a complex reality driving system using an assembleable three-dimensional structure comprising an electronic device,
The electronic device may include: optically recognizing the 3D marker unit by a camera module;
displaying the 3D marker unit recognized by the camera module on a screen;
displaying an information menu related to the three-dimensional marker unit;
executing augmented reality or virtual reality related to the 3D marker unit when a user requests to execute virtual reality or augmented reality through the information menu to execute augmented reality or virtual reality content through the display module;
When there is a user's image display execution request through the information menu, reading the image related to the augmented reality or virtual reality content, and then displaying the read image through the display module; Assemblyable three-dimensional structure comprising a A mixed reality driving method using a mixed reality driving system using
8. The method of claim 7,
The step of executing the virtual reality or augmented reality content comprises:
displaying at least one virtual reality content execution menu for executing the virtual reality content to be superimposed on the screen on which the 3D marker unit is displayed;
when one of the virtual reality content execution menus is selected, converting the screen on which the 3D marker unit is displayed to the virtual reality content screen related to the selected execution menu; and
When the user moves the electronic device upward, downward, left, or right on the virtual reality content screen, a content screen changed with respect to the virtual reality content screen in response to the movement is displayed through the display module. A mixed reality driving method using a mixed reality driving system using a dimensional structure.
8. The method of claim 7,
The step of executing the virtual reality or augmented reality content comprises:
If there is an augmented reality execution request through the information menu, the augmented reality content stored in advance on the screen on which the 3D marker unit is displayed is displayed so as to be superimposed in a semi-transparent or opaque manner,
The augmented reality content is a complex reality driving method using a complex reality driving system using an assembleable three-dimensional structure, characterized in that the dynamic content.
8. The method of claim 7,
In the step of displaying the image, when there is a request to execute image display through the information menu, when the virtual reality or augmented reality content is being executed, the corresponding virtual reality or augmented reality content is stopped;
A mixed reality driving method using a complex reality driving system using an assembleable three-dimensional structure, characterized in that the display module displays the previously stored past images of the cultural assets recognized by the three-dimensional marker unit.

Images