KR20170058025A - Virtual history experience system with Age-specific cultural image and thereof method - Google Patents

Abstract

The present invention relates to a virtual history experience system having an era-specific cultural asset videos and a method for producing era-specific cultural asset videos wherein videos of historic sites, museums, cultural assets, life of ordinary people and noble people for each era, traditional food for each era, and traditional fairy tales are provided to enable a user to experience the same, and the videos linked to users motion are provided as the virtual history experience system has a user interface and a 3D game engine. According to the method for producing era-specific cultural asset videos, buildings, indoor spaces, articles, personal characters of cultural assets for each era are produced into Max formats by performing three-dimensioning using a 3Ds ma system, and a 3D virtual reality (VR) image is generated in a unity system by using the buildings, the indoor spaces, the articles, and the personal characters produced into the three-dimensional Max formats. The unity system generates a video in which a personal character takes action in accordance with a predetermined scenario in each building. In the video, explanation for the action of the personal character is provided as sound or texts. The personal character is one from a king, a queen, a court lady, a maid of honor, and a retainer. The building is one from a royal main building, a royal office building, and a royal bed room. The scenario shows life of a king or a queen in one from the royal main building, the royal office building, and the royal bed room.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a virtual history experience system,

The present invention provides a user experience in a virtual space by providing not only heritage sites, museums and cultural properties but also life of ordinary people and nobility, traditional foods of different ages and traditional fairy tale by time, , A virtual history experience system equipped with video images of cultural properties of different ages and a method of producing video images of cultural properties by period, which provide images linked to user's movements.

In general, the site refers to the site where the remains are located. The museum collects archaeological data, historical artifacts, artifacts, and other academic materials, displays them to the public for preservation, display, and facilities for academic research and social education. It says.

In addition, cultural property refers to objects with excellent value created by cultural activities, and refers to folk cultural properties, natural monuments, historical sites, and scenic spots. In the present invention, cultural assets are collectively referred to as folk cultural properties, natural monuments, historic sites, and scenic spots.

Virtual reality is similar to the reality created by artificial intelligence using computers, but stimulates the user's five senses through a virtual (imagined) environment or situation created, not actual, , Which is called the immersive multimedia that freely brings the boundaries between reality and imagination.

The development of related devices in the field of virtual reality is proceeding fast, but the contents to be implemented are not abundant. Therefore, it is urgent to develop competitive One Source Mulltiuse contents. In particular, there is a need for a method of processing and providing information on various cultural property information of Korea for domestic and foreign people.

For example, the Changdeokgung Palace was built in 1405 by the Taejong in the east of Kyungbok Palace, named "Changdeokgung", followed by Jinseonmun in 1411, Gwangcheon Bridge, and Donghwamun in 1412. After the appearance of the palace, the Changdeokgung was transformed into ash with the other palace. After that, most of the major burials, such as the 10th anniversary of the Kwanghae Army, were restored in 1609. In 1623, most of the buildings were destroyed except for the rehabilitation, and the reconstruction was completed only after 1647 The kings of the past are mostly seen in Changdeok Palace. In Dec. 1704 (Sukjong 30), a large company was established. In 1776 (Yeongjo 52), the Kyujanggak was erected in September, and in 1782 (Jeongjo 6) In 1917, the civil war was lost, and many buildings such as Gyeongbok Palace in Gyeongbok Palace, Gangnyeonjeon in front of it, and the East and West Gate in front of it were restored to Changdeok Palace in 1918, During the Japanese colonial period, the buildings were mostly demolished and only some major buildings were left. Currently, Changdeok Palace is composed of algebraic area centering on the main hall of victory, the settlement area centering on the sacred sacred place and the main hall, the area of the noon of the east, and the area beyond the northern hill.

Likewise, Changdeokgung has many cultural properties and palaces in it, and its appearance is different in the times.

Therefore, it is demanded to experience not only the present Changdeokgung but also the original Changdeokgung which has a different appearance in the times, and it is also desired to see the cultural properties such as other palaces in Changdeokgung while walking in Changdeokgung, It is also desired to experience what everyday life the people living in the Changdeokgung have been eating and living, and to experience what food is on the table of nobles and ordinary people of each age.

In the prior art, Korean Patent Laid-Open Publication No. 2000-0054149 and Korean Patent Registration No. 10-0403942 disclose a three-dimensional virtual tour which allows a user to view a place through a mouse scroll method in a virtual space using a three- System or a system for implementing a moving picture when an object is selected within a three-dimensional virtual space.

However, Korean Patent Publication No. 2000-0054149 and Korean Patent Registration No. 10-0403942 disclose that only the current cultural heritage sites and the like can be browsed through the mouse scroll system, I can not see the lifestyle of the time, and I also feel lively and immersive.

In another prior art, Korean Patent No. 10-1021634 relates to a system and method for learning history contents in a three-dimensional manner according to a specific scenario in learning history using a network, and also relates to a history community The present invention relates to a system for allowing a user to freely move from a virtual space based on history to a space for history learning to perform historical learning. The history learning apparatus of the Korean Patent No. 10-1021634 processes specific game data from the history learning DB so that the game data can be displayed on the game screen on the user terminal in the web server, And a history learning database storing game data for realizing a game based on historical data classified by age and theme.

In the game progression of the Korean Patent No. 10-1021634, a game progress character to be used in a game is set on a game screen displayed on a user terminal, and a setting method is a method in which a character provided by a user avatar according to a number And the game is performed by the set character. The game execution method moves along the movement path of the map in which an arbitrary character is displayed on the game screen by the number of the dice when the die is thrown against an arbitrary character. Each character's game progression is preceded by a character that receives a large number in numerical order, followed by a die cast for character setting.

The Korean Patent No. 10-1021634 can not only see the present cultural heritage as it is, but also can not see the life scenes of the times, and also the liveliness and the immersion are also lowered .

Therefore, the present invention provides a user experience in a virtual space by providing not only historical sites, museums and cultural properties but also life of ordinary people and aristocrats, traditional foods of different ages and traditional fairy tale, The present invention provides a virtual history experience system having video images of cultural properties of different ages and a method of producing images of cultural property videos of different ages.

Generally, the reason why a person feels stereoscopic (perspective) is that when the brain finally makes a judgment by the parallax caused by falling apart with a slight interval, a three-dimensional feeling is felt, and another reason is called a concealment The phenomenon also creates a sense of perspective, which is the phenomenon where objects that are obscured by multiple objects overlap each other. A distant object has a perspective that feels closer to a smaller object, a relative density of objects farther away that appears more closely packed, and a distant object appears to move slowly while moving, while a nearby object appears to move faster Exercise paralysis.

 Among them, the principle of stereoscopic image production is mainly based on binocular disparity. One way to utilize this is to use two cameras to take images with parallax, then to use 3D graphics tools, and to convert existing 2D images.

The principle of taking two images with two cameras is to take two images horizontally and horizontally with two cameras at regular intervals. The method of taking is divided into parallel method and cross method. The intersection method can be used to adjust the angle between the two cameras so that the position of the object can be projected or invisible. The parallel method is a method of taking parallel images without giving an angle between the cameras. .

If these methods are to make the images of the real world look like 3D, there are no physical constraints when making them using the 3D graphic tool, and the image processing can be performed more easily. You just need to add one more camera to do the same modeling as before.

Therefore, in the present invention, a virtual 3D camera is added to the 3D unity engine to create a 3D stereoscopic image capable of experiencing an immersive virtual reality by interlocking the HMD with the binocular parallax method.

It is an object of the present invention to provide a video, not only for historical sites, museums, and cultural properties, but also for the living of ordinary people and nobility, traditional foods of different ages, And a 3D game engine to provide a video interlocking with a movement of a user, a virtual history experience system having a video material of a cultural property of each time, and a method of producing a video image of a cultural property video by time.

Another technical problem to be solved by the present invention is to not only allow the user to walk in a virtual space according to the shape of the historical sites and cultural properties of each era, but also to display the moving images in the historical sites and cultural properties A virtual history experience system equipped with video images of cultural properties of different ages that can be viewed as an image linked to a user's movement, and a method of producing video images of cultural property videos of each age.

Another object of the present invention is to provide a method and a system for modeling a time of generation of a living image of an ordinary people and an aristocracy, , A modeled object is embodied with a material, and an image is created to make the finished object surface conform to the Unwarp coordinate system such as three-dimensional feeling and color, and it is possible to provide a more realistic object such as a historical site, a museum, A virtual history experience system equipped with video material of periodical cultural properties, and a method of producing a video material of a cultural property of each age.

In order to solve the above problems, the present invention creates a Max format in which a building, an interior, a small object, and a character of an age-specific cultural property are rendered into three dimensions using a 3Ds Max system, A method for producing a VR (Virtual Reality) image in a Unity system using a building, a room, a props, and a character created by a dimensionized Max format, And an image in which the character character operates according to a predetermined scenario in each building, wherein the description of the operation of the character character is provided as sound or phrase.

The character character is one of a king, a queen, an emperor, a lady, or a servant, and the building is characterized by being one of blackout, translation, deposition, and sponsorship.

 The scenario is made to represent the life of a king or queen in one of the blackout, the warp, the settling, the backing.

The props include hanging scroll, holy chest, screen, and table. When the props are provided in the 3D VR image, a description of the props is provided as sound or phrase.

 The scenario is made to represent the number of the king in one of the blackout, the warp, and the settling, and a description of the king's table is provided as sound or phrase when the king's table is provided in the 3D VR image.

A scene and a scene are generated by converting a scene created by animating the character into a Unity file from a Max format file obtained by three-dimensionally creating a scene by disposing a small object and a character character in the interior of the building.

The placement of the props and character characters in the interior of the building is performed by reading the building location set by the user on the terrain of the building in the cultural property in the 3Ds max system and applying a predetermined texture on the terrain ; In the 3Ds Max system, loading the prefabricated building based on the ascertained data and placing the building in the building location on the terrain; In the 3Ds Max system, 3D modeling is performed on the basis of the ascertained data, and the indoor and small objects that have been prepared are read, placed at predetermined positions, and 3D characters are modeled based on the ascertained data. And arranging the image data at a preset position.

In addition, the virtual history experience system having video images of the cultural properties of the present invention includes a display unit mounted on the head and having an eyeglass shape, and outputs a three-dimensional image received through the HMD controller to a glasses- A head mounted display (HMD) for detecting movement of the user's head (head tracking information) or movement of the eyeball and transmitting the motion to the HMD controller; An HMD controller for transmitting an image received from a user terminal to a head mounted display and transmitting head movement or eye movement received from the head mounted display to a user terminal; Receiving from the main server an image of the cultural property of the time, receiving the movement of the head or the eyeball from the HMD controller, and selecting, from among the images received from the main server, the face of the user or the movement of the eyeball, A user terminal for transmitting an image corresponding to a direction in which a line of sight is directed to an HMD controller; And a main server storing images of cultural properties of different ages in a database.

The virtual history experience system further includes an administrator terminal for generating images of the cultural property by the time, storing the images in the main server, and updating or deleting images of the cultural property stored in the main server.

The images of the cultural property of the time set by the user on the user terminal are displayed on the head mounted display, and the user views the image as if walking through the cultural property video by the time using a mouse or a joystick.

The virtual history experience system equipped with the video material of the present invention of the present invention and the method of producing the video material of the cultural property of the time of the present invention can be applied not only to historical sites, museums and cultural properties, but also to the lives of ordinary people and nobility, And provides a user interface and a 3D game engine so that the user can interact with the movement of the user.

In other words, the present invention not only allows the user to walk in a virtual space according to the shape of the place where the historical sites and cultural properties have been owned by the ages, but also displays the moving images of the living places in the historical sites and cultural properties, Can be seen as a video.

In addition, the present invention can be applied to modeling of images, such as historical sites, museums and cultural properties, as well as the lives of ordinary people and nobility, traditional foods of different ages, By embedding the material on the object and implementing the image to make the finished object surface conform to the Unwarp coordinates of the three-dimensional feeling, color, etc., it has objects such as more historical sites, museums and cultural properties.

1 is a schematic block diagram of a virtual history experience system having video images of cultural properties of different ages according to an embodiment of the present invention.
FIG. 2 is an explanatory diagram for explaining the general steps of the method for producing a cultural property video according to the present invention.
Fig. 3 shows an example of producing the topography of Changdeokgung from satellite photos of Changdeokgung Palace.
Fig. 4 shows an example in which a terrain is manufactured and a texture is applied to the terrain.
Fig. 5 shows an example of a full-angle restored to 3D data and a state in which the restored full-angle is placed on the terrain.
FIG. 6 shows an example of indoor mapping sources according to the created indoor mapping sources and indoor mapping sources according to modeling.
FIG. 7A is an explanatory diagram for explaining a process of producing various animated characters using various man and woman characters in each cultural property of each era and using the produced man and woman characters.
FIG. 7B is an example of various male and female characters.
Fig. 8 shows an example of a morning ward of a king reproduced in 3D based on story telling.
Fig. 9 shows an example of terrain fabrication, full-scale layout, and 3D real-time content creation.
FIG. 10 shows examples of production of a source source, conversion to an FBX file, placement of imported data, animation, and effect presentation.
FIG. 11 shows the production of a cultural property video according to an embodiment of the present invention.
FIG. 12 shows the production of a cultural property video according to another embodiment of the present invention.
FIG. 13 shows the production of a cultural property video by time according to another embodiment of the present invention.
FIG. 14 is an explanatory diagram for implementing a scene according to camera movement.
15 is an explanatory diagram for explaining generation of a subtitle according to the position of the camera.
16 is an explanatory view for explaining fade-in according to the movement of the camera.
17 is an explanatory diagram for explaining a method of three-dimensionally providing a method using positive parallax to two cameras.
18 is an example of an image taken with a 2D camera.
FIG. 19 is an example of an image taken with a 3D camera.
20 is an example of a Changdeok Palace VR contents storyboard according to an embodiment of the present invention.
21 and 22 are examples of images showing the daily life of a king in Changdeok Palace according to an embodiment of the present invention.
FIG. 23 shows an example of images output to the HMD and images output to the user terminal, showing images of the daily life of a king in Changdeok Palace according to an embodiment of the present invention.

A virtual history experience system having a video material of an age-specific cultural property of the present invention, and a method of producing a video material of a cultural property material by time will be described in detail with reference to the accompanying drawings.

1 is a schematic block diagram of a virtual history experience system having video images of cultural properties of different ages according to an embodiment of the present invention.

A head mounted display (HMD) 110 is mounted on a head and includes a display unit having an eyeglass shape, and displays a three-dimensional image received from the user terminal 300 through the HMD controller 200 on the user's eyes Shaped display unit. Also, the head mounted display (HMD) 110 detects movement of a user's head (face) or movement of an eyeball, and provides the user's terminal 300 with an HMD controller 200, Detects the direction of the user's face or line of sight according to the movement of the user's head or eyes, and provides a surrounding image corresponding to the direction. Here, the surround image refers to an image spreading in all directions (for example, front, back, left, right, up, down) about the HMD 110.

The HMD controller 200 transmits the image (i.e., display information) received from the user terminal 300 to the HMD 110 and transmits the motion of the head (i.e., head tracking information) detected by the HMD 110, Or the movement of the eyeball to the user terminal 300, and allows the user to adjust the image, volume, and the like provided to the HMD 110 according to the user.

The user terminal 300 receives the image of the cultural property predetermined by the user from the main server 400 and displays the image of the user's face or the face of the user according to the movement of the user's head And provides the HMD 110 with an image corresponding to the direction of the line of sight through the HMD controller 200. [ The user terminal 300 may further include a mouse (not shown) or a joystick (not shown) or a key input unit (not shown), and may be connected to a mouse (not shown), a joystick (not shown) May indicate that the user is moving forward or backward or forward or backward in the forward direction.

The user terminal 300 may be any one of a personal computer, a portable computer, a smart phone, a smart pad, an electronic blackboard, and a PC game machine.

The main server 400 stores the image of the cultural property of the period received from the administrator terminal 500 in the database and provides the image of the cultural property of the predetermined period to the user terminal 300 at the request of the user terminal 300.

In the present invention, the user accesses the main server 400 through the Internet from the user terminal 300 at the beginning of use, joins members, installs a predetermined application program received from the main server 400 to the user terminal 300 do.

The administrator terminal 500 generates images of cultural properties of different ages by the administrator and stores them in the main server 400. The administrator manages to update, delete, or store images of cultural properties of different ages through the administrator terminals 500 . In addition, the administrator manages the member of the administrator terminal 500.

In this case, the HMD 110 and the HMD controller 200 can be omitted, and the 3D image of the cultural property can be viewed through the user terminal 300.

Hereinafter, a method of producing a cultural property video image according to the present invention will be described.

FIG. 2 is an explanatory diagram for explaining the general steps of the method of producing a cultural property video of the present invention, and includes an animation production step and a 3D real-time VR image production step.

The animation production step includes a modeling step, a mapping step, a rigging step, and an animation step, which will be described later. The modeling step, the rigging step, and the animation step are mainly performed in 3Dsmax. Mapping and texture production are performed in Photoshop.

In the 3D real-time VR image production step, the data of the 3D modeling produced at the animation production stage, that is, the data of the 3D modeling produced at 3Dsmax, is exported and converted, and the 3D game engine is manufactured using Unity And outputs 3D real-time VR images accordingly.

First, the animation production step will be described.

In the present invention, restoration points of cultural properties are set through historical records, and VR images (contents) of cultural properties are created using the 3D virtual reality technology according to the set restore points. In other words, 3D modeling is performed through existing hyperlinks, 3D real-time content is generated from the 3D real-time content, and a virtual experience system is constructed using 3D real-time content. This is not only an efficient and efficient alternative to the physical and economic limitations of physical (architectural) restoration, but also a building of a primary database for actual restoration.

For example, the Changdeokgung Palace can be constructed as a reconstruction point from the Dongwoedo Island (National Treasure No. 249), which was constructed by drawing the building layout and building form around 1830.

First, we detect the shape and size of the whole topography of the cultural property, the inclination, etc. from the satellite photographs about the location of the cultural property, and make the overall topography of the cultural property by using it. It is possible to use an existing application program.

For example, as shown in Fig. 3, the topography of Changdeokgung can be produced from satellite photos of Changdeokgung Palace. 3 (a) is an enlarged view of the portion of Changdeok Palace in the satellite image of FIG. 3 (a), and shows the shape and size of the terrain of Changdeokgung, And the like. As shown in FIG. 3 (c), the shape, size and slope of the terrain of Changdeokgung are inputted from a predetermined application program for creating a building or the like on a virtual screen, and the terrain of Changdeokgung is set 3 (e), a terrain set by superimposing satellite photographs of Changdeokgung Palace is constructed.

Next, we construct the terrain of a certain building (foreground) in the cultural property, set the location of the building (foreground), and apply the texture (texture) on the terrain.

For example, as shown in FIG. 4, a terrain can be produced and a texture can be applied to the terrain. The terrain is produced as shown in FIGS. 4 (a) and 4 (b), and a texture is applied to the terrain as shown in FIGS. 4 (c), 4 (d) and 4 (e).

Next, based on the ascertained data, the building to be climbed on the terrain is made and the completed building is placed on the terrain.

For example, as shown in FIGS. 5A to 5D, an entire angle (for example, a recognition gap) is restored with 3D data, and as shown in FIGS. 5E to 5I, (Authorization ceremony) on the terrain.

Next, 3D virtual restoration is performed for small objects placed indoors and indoors in a building (full angle) on the basis of the proof data. That is, 3D-based modeling of small objects placed in the room and inside the building (full angle) is performed to produce a mapping source.

For example, an indoor mapping source as shown in FIGS. 6A to 6E is created, and the created indoor mapping source is applied to the 3D-based model, that is, in FIG. 6F to FIG. Can be applied together.

Next, various male and female characters in the cultural property of the time are produced based on the hyperlink, and an image containing the animations of the male and female characters according to a predetermined scenario is produced.

This is because, as shown in FIG. 7A, the male and female characters are modeled on the basis of the hyperlinked data, the mapping is performed so that the skin of the modeled male and female characters is applied, and the joints are created in the male and female characters Rigging is performed. When the character setting is completed in this manner, animation and animation are created by applying facial expressions and motions to the male and female characters according to predetermined scenarios previously set, and the animation, the building (full angle) And a predetermined image is completed.

FIG. 7B is an example of various male and female characters. In each building (foreground) of each cultural property in each era, various characters, that is, men and women characters having various dresses, may exist.

Each building of the cultural heritage of each era has a storytelling to be delivered when 3D VR contents are made, and scenarios are created accordingly, and the characters of men and women can be changed according to scenarios.

For example, the storytelling of 3D VR contents of power outage, turnover, settling, and sponsorship of Changdeokgung can be as shown in Table 1.

Area Contents 1. Don Hwang Moon It was first built in 1412 and the 12th year of Taejong in front of Changdeokgung Palace. It is a two-storey pavilion type wooden building. It is the largest of the palace gates. 2. Gwacheon It is the oldest stone remaining in the present palace and was designated as treasure No. 1762 in 2012. This water is called the 川 because it acts as a boundary to distinguish the inside and outside of the palace. In 1411, I set my legs on Geumcheon, and it was called "Gimcheon Bridge" because it was located on a stream flowing like silent water. 3. Accreditation Exhibition  It was built in 1405 and Taejong 5 years together with the founding of Changdeok Palace. It was the place where I performed important national ceremonies such as the ceremony of the king, the servants of the servants, and the meeting of foreign ambassadors. 4. Selection Ceremony Various meetings such as morning coordination meeting, work report, national seminar contest were held every day here as the official office room where the king saw daily work with senior officials. At the time of its founding, it was called Cho Geonjeong, and in 1461, it changed its name to Yeomjeonjeon, which means that politics should be given in 7th year of King Sejo. It is the only heavenly building that remains in the present palace. It is currently designated as Treasure No. 814. 5. Syringe The sacred hall is the actual central building where the king stayed most. The present sacred party was moved to Gangnyeonjeon in Gyeongbokgung while recovering its loss in 1917 in 1920. It is designated as Treasure No. 815. 6. Control The contrast is the formal settlement of Changdeokgung, the living room of the queen. There are a lot of adjoining buildings in the vicinity of the baseball game, among them, the scene of the tragedy in which the government of the provincial government was established in 1910 by holding the last meeting. 7. Injury
Each company He called the governments established in the palace specifically to assist the king in close proximity. In the western part of the court, there were drugstores, ogdang (Hongmungwan), a courtroom on the east, and a cabinet (Kyujanggak), a Buddhist temple, a Buddhist temple, All of them were proxies with a close proximity to the king, and the various departments were concentrated and complex like a maze. However, during the Japanese occupation, all the angles fell and turned into roads and lawns. The existing buildings were restored in 2004. 8. Appearance It was the first central garden of the patronage, a relatively open place, not only for relaxation but also for academic and educational purposes. Kyujanggak and Seohyangkang were used for the royal library, and in the movie theater, they took a special past examination in which the king was present. The blooming of the lotus bloom is designated as the Treasure 1763 in 2012 in the form of a single flower blooming in the pond. The bloom is also designated Treasure No. 1769 in 2012. 9. Raw material Hyeonjong, the wage of the 24th generation, greeted the daughter of Kim Jae-cheong with the father Kyoung-bin, and placed it in 1847 along with Suh Jae-hee and the following year. Namsan was a study and adoration of Hwangjong, Seobokhun was a dwelling place of Kyungbin, and the lecture room was a house for the Sunwon queen, which was compared to the King. This area was designated Treasure No. 1764 in 2012.

In the animation, an image of living in a cultural property such as a king or a queen can be made into a 3D VR image, such as a scene in which a wage in a settling or the like takes place. When a user selects a predetermined object in the virtual image, A description of a given object is provided together with sound or text.

For example, as shown in FIG. 8, a 3D VR image of a morning wage of a wager can be created in a ward of a ward, and only a wartime image of a wage may be displayed as shown in FIG. 8 (a) ), It is possible to show a scene in which the wage holds Sura. As shown in (b) to (d) of FIG. 8, it is possible to check the food of the wage by the ward before the ward tastes each food, and to produce a video showing the wage afterwards.

Also, when the user selects (clicks) the screen image, the screen image is either a screen image, a screen image, a wish screen, or a desk screen.

For example, as in FIG. 8 (e), an explanation is displayed that the selected Surageun is half of the crew, the crew half is in the center, and the kings and queens are the traumas. Alternatively, as shown in FIG. 8 (f), the selected Sura Shang is the half of the wish, the wish circle is placed in front of the manufacturing Shang-gong, .

In the present invention, the indoor mapping source, the proprietary mapping source, the male and female characters, and the like can be made into a Max format which is made into 3D (3Dimension) using Autodesk 3ds Max, A virtual experience system can be constructed as a Unity 3D platform considering the result of the Maxim format which is 3Dimensioned, considering the sound, the landscape and environment, the usefulness of system construction, and the user interface. That is, the virtual history experience system of the present invention includes a 3D game engine created using Unity. Here, the system (computer) in which 3ds max (i.e., 3Dsmax) is driven can be referred to as a 3ds max system.

Here, Unity is an integrated authoring tool for creating interactive content such as 3D video games, architectural visualization, and real-time 3D animation. Here, the system (computer) to which the unity is applied is called the unity system.

In addition, Autodesk 3ds Max (or Autodesk 3ds Max, or 3D Studio Max) is the design software for 3D computer graphics developed in Autodesk Media and Entertainment, and is used primarily in entertainment. 3ds Max supports many functions such as modeling, animation, and rendering, making it useful for 3D animation, VFX, and games.

The following describes the 3D real-time VR image production step, that is, the 3D real-time VR image content production applied to the virtual experience system.

To do this, real-time rendering is performed. It creates 3D modeling using 3d max, and exports the data of the 3D modeling thus created to fbx to create a virtual reality (VR) environment from the unity 3D engine. Here, FBX (Filmbox) is a proprietary file format (.fbx) used to provide interoperability between digital content creation applications, such as Autodesk 3ds Max.

This is a process of outputting the 3D data developed in real time to limited computer resources, which is the most important technology in the virtual reality. Since general images (movies, animations, TV) are outputted as 2d images, However, since the real-time renderer is computed and recorded in real time as 3D data, it can be manipulated as user-friendly.

The virtual reality basically takes interaction with the user as a basic factor, and can not be considered in a non-rendering video technique using a camera or a free rendering technique requiring a long calculation time. Therefore, 3D space implementation of virtual reality depends entirely on real-time rendering technology, so it is possible to generate sensible contents by applying Unity 3D real-time rendering method.

VR images of various cultural contents created by using Unity 3D platform can be used as a source of One Source Multi-Use.

 The following describes the creation of virtual terrain. To do this, we first import the fbx data (import fbx file) and create an external virtual terrain, which is created with the Unity 3D terrain but uses the 2D tile source to optimize the data. Next, a natural object (tree) object is created and placed, and also the placed foreground and background are grouped (prefab). Then, the tone and balance of the background full light and the material shader of the arranged object data are set and completed. Here, a unity process pipeline is used. In addition, a height map, which is one of the 3D virtual terrain production techniques, is used, and the position information value of the mesh vertex is transformed into the 3D maxZ axis and the unity 3D: y axis, Make the terrain.

Fig. 9 shows an example of terrain fabrication, full-scale layout, and 3D real-time content creation.

9 (a) shows the construction of the terrain using the unity 3D terrain, Fig. 9 (b) shows the arrangement of the full angle on the terrain, and Fig. 9 (c) It shows the production of 3D real-time contents using video.

As shown in FIG. 10, the 3D max modeling of the cultural property (for example, Changdeokgung) is converted into real time contents FPS files and converted into real time 3D contents. 10 (a) shows an example of production of a source source, Fig. 10 (b) shows an example of converting into FBX file, Fig. 10 (c) shows arrangement of imported data, (d) show examples of animation and effect presentation.

In the present invention, in data conversion and storage, data for utilization of real-time contents (general-purpose engine_unity 3D) is converted into 3D modeling and mapped data is converted into a unity-use data format.

The 3D real-time content of the present invention can be utilized as a source of One Source Multi-Use source. That is, in the present invention, all platforms of PC, Android, iPhone, Web, Xbox, Ps3, and Wii can be built in one engine.

The scene creates an interior of a building (full-size), places objects and characters in the prepared room, performs character animation and scene testing, and converts a file created with 3D max into a Unity file.

Figs. 11 to 13 show the production of a cultural property video by time. Figs. 11 to 13A show an example in which an interior room of an entire angle is manufactured, Figs. 11 to 13B show an example in which objects and characters are arranged in the prepared room, Figs. 11 to 13C Are examples of character animation and scene test, and FIGS. 11 to 13 (d) show an example of converting a file created with 3D max into a unity file.

 In unity, the environment is created and directed, that is, the image is converted in consideration of sound, landscape, and environment. Fig. 11 (d) shows the image of Fig. 11 (c) being transformed to indicate the night of sediment depended on the horon, and Fig. 12 (d) 13 (d) shows the position of the subordinate in front of the king in the image of FIG. 13 (c).

FIGS. 12 to 13E illustrate examples in which an environment is created and produced in Unity, in which sound or characters (phrase, text) describing a situation or a historical meaning together with an image are output.

In the present invention, the 3D real-time content is displayed as a virtual reality, and effects, events, and system parts necessary for the application are created. In order to facilitate the work, the prefabs and scripts are used to continuously use Can be produced.

Here, the prefab is one kind of asset, which is saved in a project view as a reusable game object, and the prefab can be added to a plurality of scenes or a plurality of scenes, and a prefab is added to the scene An instance is created. In addition, game objects created in the scene can be stored in the prefab.

Prefabs can bring camera movements, GUIs, and scene transitions, making them prefabs easy to use without any extra work or tutorials.

As for the camera work, it can be applied to the program using commercial Itween to conveniently use the natural camera walking that corresponds to the user's eyes.

14A is a drawing (screen shot) for explaining the movement of the camera, FIG. 14B is a script setting screen for setting a moving path of the camera, and FIG. It is an example of programming a moving scene.

 In FIG. 14 (a), the camera moves along the blue path shown in the screen shot, and a new script is created as shown in FIG. 14 (b) for convenience of operation. In FIG. 14 (b), the I Tween Path script is a script that helps to easily implement a path. The Move script is a script portion that directly uses the I Tween. Among these script items, Where Path Name is the name of the Itween Path, Time is the time (in seconds) it takes to go through the Path node, and LookTime is the number of seconds that the camera rotates toward the object you are looking at .

In FIG. 14C, the function called MoveTo of the Itween function for moving the camera is called at the moment when the scene starts. Here, the object to be watched by the camera is the target, the method of moving is the path, and the time taken to move is the time, which is a linear movement type. LookTimer is a parameter that indicates whether the camera looks at the subject once per second as it moves.

In the GUI, that is, in the caption, a GUI event is generated at the moment when the camera arrives at a predetermined position (for example, the hexahedral position in FIG.

As shown in (a) of FIG. 15, the camera may be formed in a format in which a description accompanies the scrolling background at the moment when the camera reaches the corresponding position (the center of the dotted line). For example, Can be provided.

As shown in FIG. 15B, the active state of the GUI is changed to true at the moment when the camera enters the collision trigger (for example, the hexahedral position in FIG. 15) and is displayed on the screen.

In scene switching, when the camera reaches a predetermined position (for example, a rectangular parallelepiped position indicated by a dotted line in FIG. 16A), the camera fades in for a delay time , So that the user can move to the next scene. In some cases, you can give a loading screen to show during the waiting time when loading a scene with a long loading time, such as a query scene, without giving a fade-in effect. The fade-in effect can be created by placing a transparent GUI window on the camera screen and then gradually changing the color as the alpha value increases according to the predetermined color and delay. In some cases, a fade out can be used.

For example, when the camera reaches the corresponding position (rectangular parallelepiped position indicated by the dotted line) as shown in FIG. 16A, a dark screen is displayed as shown in FIG. 16C, (Fade in gradually in FIG. 16 (b)) for a predetermined delay time, and goes to the next scene.

FIG. 16D is an example of a program for judging whether or not the next scene starts. In other words, declare a temporary variable, frametime, to be used when the scene starts, and a boolen value to judge the next scene.

In other words, as soon as the camera enters the collision trigger (the rectangular shape of the dotted line in FIG. 16 (a)), a Fade object is created to start the screen Fade effect. The screen fades in for Color, delay time. Alternatively, you can set the Boolean value to true to add frame time until frametime becomes larger than the delay and allow the next scene to load when the frame time grows larger than the delay.

16 (e) shows a camera change code when the camera arrives at the trigger. That is, when the camera reaches the trigger, it changes the active state of the current camera to false, changes the active state of the next camera to true, and changes the screen to the next camera. Add a Fade in or Fade Out system because it can produce awkward scenes when sudden changes occur in camera switching or scene switching.

With respect to the Fade in class of the present invention, a transparent GUI window is displayed on the screen, and then the delay time is given to overlay the transparent GUI with the set color until the delay time is reached, thereby gradually increasing the alpha value to darken the screen

HMD equipment commercially available as HMD 110 may be used in the present invention. For example, mybud can be used, and mybird has a resolution of 1280 x 720, which causes dizziness when high quality is used, which is why we set the appropriate Frames Per Second (FPS) Adjust the graphic quality and make it.

A high frame rate should be maintained in order to solve the problem of latency caused by the graphic update rate and the afterimage in the HMD 110. [ In the present invention, the graphics are simplified so that the frame rate does not fall below the reference (60 fps), and the users do not need to look around quickly.

In the method of providing an image in cooperation with the HMD 100 (i.e., HMD interlocking programming), a method using the parallax is applied. That is, the reason why the human being feels a three-dimensional feeling is that when the brain finally makes a judgment based on the parallax caused by the separation of the two eyes with a slight gap, the three-dimensional feeling is felt. use.

As shown in FIG. 17, two cameras are installed, and the image is shot with the average difference of 65 mm, which is an adult distance. In other words, the parallax between the left camera and the right eye camera is about 6 cm. The basic setting operation such as camera work uses a 2D camera and then a 3D camera as the last operation. In other words, when two HMDs are installed and the adult binocular disparity of about 6cm is floated, each rendered screen is divided into left and right images by using rendering method, and it is possible to experience 3D stereoscopic image virtual reality when using HMD

FIG. 18 (a) illustrates a range taken by one camera, and FIG. 18 (b) shows an example of a result taken with a 2D camera. Fig. 19 (a) illustrates a range (3D camera) taken by two cameras, and Fig. 18 (b) shows an example of a result of a 2D camera.

The virtual history experience system with video material of the present invention of the present invention and the method of producing the video material of the cultural property of each age are related to the virtual reality based experiential content and have a synergy effect of interest, The experience effect can be improved. Especially, in order to improve simulated nausea caused by cognitive dissonance occurring in HMD device, it improves out focus and motion blur effect and applies format for stable screen configuration through various camera tests. Time difference of left eye camera and right eye camera To apply 3D programming to 3D stereoscopic images

In other words, the Out Focus effect has a more pronounced and stereoscopic effect when the depth of field is changed. However, in HMD environment, when the effect is used, the discordance becomes more severe, It causes nausea. In addition, the motion blur (residual image) effect overlaps with the head-tracking effect due to the reaction delay of the HMD device, thereby inducing simulation nausea.

FIG. 20 is an example of a VR contents storyboard of Changdeok Palace according to an embodiment of the present invention, FIGS. 21 and 22 are examples of images showing the daily life of a king in Changdeok Palace according to an embodiment of the present invention, Shows an example of images output to the HMD and images output to the user terminal in the image showing the daily life of the king in Changdeokgung according to an embodiment of the present invention.

110: head mounted display (HMD) 200: HMD controller
300: user terminal 400: main server
500: administrator terminal

Claims (10)

The buildings, the interior, the small objects and the character characters of the cultural property of the times are created in the Max format which is made into a three dimensional shape by using the 3Ds Max system, (VR) image in a Unity system using a small character, a small character, and a character,
In a unity system, an image in which a character character operates according to a predetermined scenario in each building is provided, and an explanation of the operation of the character character is provided as sound or phrase in the image. How to make a video. The method according to claim 1,
Wherein the character character is one of a king, a queen, an emperor, a lady, and a servant, and the building is one of an electric power, a warp, a settling, and a support. 3. The method of claim 2,
Wherein said scenario is made to represent the life of a king or queen in one of an electrostatic, a warped, a settled, or a sponsored manner. 3. The method of claim 2,
Small items include hanging scroll, holy call, folding screen, and dinner table,
Wherein the description of the props is provided as sound or phrase when the props are provided in the 3D VR image. 3. The method of claim 2,
The scenario is made to represent the number of the king in one of the electrostatic,
Wherein the description of the king's table is provided as sound or phrase when the king's table is provided in the 3D VR image. 6. The method according to any one of claims 1 to 5,
A scene and a scene are generated by converting a scene created by animating the character into a Unity file from a Max format file obtained by three-dimensionally creating a scene, How to make a video of a star castle. The method according to claim 6,
Arranging small objects and character characters in the interior of the building,
In the 3Ds Max system, reading the building location set by the user on the terrain of the building in the cultural property, and applying a preset texture on the terrain;
In the 3Ds Max system, loading the prefabricated building based on the ascertained data and placing the building in the building location on the terrain;
In the 3Ds Max system, 3D modeling is performed on the basis of the ascertained data, and the indoor and small objects that have been prepared are read, placed at predetermined positions, and 3D characters are modeled based on the ascertained data. At a predetermined set position;
The method according to any one of claims 1 to 3, Dimensional image received through the HMD controller is output to the display unit of the eyeglass shape, and motion of the user's head (head tracking information) or eye movement is detected, and the HMD controller A head mounted display (HMD);
An HMD controller for transmitting an image received from a user terminal to a head mounted display and transmitting head movement or eye movement received from the head mounted display to a user terminal;
Receiving from the main server an image of the cultural property of the time, receiving the movement of the head or the eyeball from the HMD controller, and selecting, from among the images received from the main server, the face of the user or the movement of the eyeball, A user terminal for transmitting an image corresponding to a direction in which a line of sight is directed to an HMD controller;
A main server storing images of cultural properties of different ages in a database;
And a virtual history experience system including video images of cultural properties of different ages. The method according to claim 1,
An administrator terminal for creating images of the cultural property of different ages and storing the images in the main server and updating or deleting images of the cultural property of the time stored in the main server;
The virtual history experience system includes video images of cultural properties of different ages. The method according to claim 1,
Wherein the visual image of the cultural property of the user set by the user on the user terminal is displayed on the head mounted display and the image is viewed as if the user walks through the cultural property video by the time using a mouse or a joystick. Virtual History Experience System.

Images