KR102192540B1 - System for providing interactive content - Google Patents

Abstract

The present invention relates to a system for providing interactive content based on virtual reality and augmented reality. An objective of the present invention is to provide a system for providing interactive content which can provide a variety of content based on virtual reality and augmented reality. According to an embodiment of the present invention, the system for providing interactive content based on virtual reality and augmented reality comprises: an interactive model including a sensor to sense a gesture of a user and an identifier to load interactive content realized in virtual reality and augmented reality; a user terminal to scan the identifier to transmit content request information for interactive content linked to the interactive model to an interactive content providing server, and receive the interactive content from the interactive content providing server to output the interactive content; the interactive content providing server to transmit the interactive content linked to the interactive model to the user terminal based on the received content request information; and cardboard for virtual reality allowing the user terminal to be mounted thereon, and providing a virtual reality environment to display the interactive content.

Description

Interactive content providing system {SYSTEM FOR PROVIDING INTERACTIVE CONTENT}

The present application relates to an interactive content providing system.

As the tourist population increases, the content provided to tourists is also increasing. Conventional tourist information content has been provided with a tourist map indicating the location of tourist attractions, restaurants, and accommodations. Since these tourist maps only show brief information, there may be some restrictions for tourists to go to their destinations with only the map.

On the other hand, recently, contents providing information on tourist attractions in virtual reality have been developed. Such virtual reality contents are provided through an information guide terminal installed around a tourist attraction or at an entrance to a tourist attraction. Tourists can receive information on tourist attractions through virtual reality contents through an information guide terminal before entering a tourist attraction, but there is a problem that accessibility is not easy due to the nature of a fixed information guide terminal.

In addition, not only education and learning, but also contents such as games are provided as contents based on virtual reality and augmented reality, but the development is related to contents development technology that communicates with users or actively responds to user actions and gestures. The level is not good enough.

The technology behind the present application is disclosed in Korean Patent Application Publication No. 2016-0082154.

The present application is to solve the problems of the prior art described above, and an object of the present invention is to provide an interactive content providing system capable of providing various contents based on virtual reality and augmented reality through an interactive model capable of interacting with a user.

The present application is to solve the problems of the prior art described above, and an object of the present invention is to provide an interactive content providing system capable of providing various types of interactive content according to interactive models such as tourism information, education and learning, and the like.

However, the technical problems to be achieved by the embodiments of the present application are not limited to the technical problems as described above, and other technical problems may exist.

As a technical means for achieving the above technical problem, the virtual reality and augmented reality-based interactive content providing system according to an embodiment of the present application includes an identifier for loading interactive content implemented in virtual reality and augmented reality, and a user's gesture An interactive model including a sensor that detects, scans the identifier and transmits content request information for interactive content linked to the interactive model to an interactive content providing server, and receives and outputs the interactive content from the interactive content providing server A user terminal, an interactive content providing server that transmits the interactive content linked to the interactive model to the user terminal based on the received content request information, and the user terminal is mounted, and the interactive content is displayed. It may include a cardboard for virtual reality providing an environment.

According to an embodiment of the present application, the interactive content has a plurality of types linked with different interactive models, the type being a first type linked to tourism content for a tourist attraction, a human organ structure and action It may include a second type associated with educational content and a third type associated with entertainment content for fan service motions of entertainers.

According to an embodiment of the present application, the first type interactive model is provided as an image card, the image card is a three-dimensional image of a tourist area, and the three-dimensional image is an identifier corresponding to a plurality of tourist attractions included in the tourist area. And a piezoelectric sensor for sensing a user's touch, the second type interactive model is provided as a human body model, and the third type interactive model is provided as a character model of an entertainer, and the human body model and the character model are part It may include a piezoelectric sensor, an acceleration sensor, and an infrared sensor provided separately.

According to an embodiment of the present application, the user terminal recognizes the identifier of the interactive model and generates the content request information, and transmits the content request information to the interactive content providing server, and the content request information A communication unit for receiving a corresponding interactive content and an output unit for outputting the interactive content based on virtual reality and augmented reality, wherein the communication unit receives touch sensing information from the interactive model and transmits it to the interactive content providing server, and the Interactive content changed according to the touch sensing information can be received in real time.

According to an embodiment of the present application, the communication unit provides the interactive content by receiving first touch detection information generated based on a touch gesture of touching a tourist attraction in the 3D image of the user from the first type interactive model. Transmits to a server, and receives interactive content including detailed information of the tourist attraction corresponding to the first touch detection information from the interactive content providing server, and the output unit outputs detailed information of the tourist attraction in augmented reality. I can.

According to an embodiment of the present application, the communication unit accesses each portion of the human body model, a touch gesture by touching each portion of the human body model from the second type interactive model, a movement gesture to move each portion of the human body model, and Receives second touch detection information generated based on at least one of the access gestures and transmits it to the interactive content providing server, and receives interactive content including an action of a human body corresponding to the second touch detection information, The output unit may output an action of the human body by at least one of the touch gesture, the movement gesture, and the approach gesture as augmented reality.

According to an exemplary embodiment of the present application, the communication unit accesses each portion of the character model, a touch gesture by touching each portion of the character model from the third type interactive model, a movement gesture to move each portion of the character model, and Receives third touch detection information generated based on at least one of the access gestures and transmits it to the interactive content providing server, and receives interactive content including an action of a human body corresponding to the third touch detection information, The output unit may output a fan service motion of a celebrity by at least one of the touch gesture, the movement gesture, and the approach gesture as augmented reality.

The above-described problem solving means are merely exemplary and should not be construed as limiting the present application. In addition to the above-described exemplary embodiments, additional embodiments may exist in the drawings and detailed description of the invention.

According to the above-described problem solving means of the present application, it is possible to provide an interactive content providing system capable of providing various contents based on virtual reality and augmented reality through an interactive model capable of interacting with a user.

According to the above-described problem solving means of the present application, it is possible to provide an interactive content providing system capable of providing various types of interactive content according to interactive models such as tourism information, education and learning, and the like.

1 is a diagram showing a configuration of an interactive content providing system according to an embodiment of the present application.
2 is a diagram showing a configuration of a user terminal of an interactive content providing system according to an embodiment of the present application.
3 is a diagram illustrating an example of an image card of an interactive content providing system according to an embodiment of the present application.
4 is a diagram illustrating an example of a screen outputting a first type of interactive content of an interactive content providing system according to an embodiment of the present application.
5 is a diagram illustrating an example of a human body model of an interactive content providing system according to an embodiment of the present application.
6 is a diagram illustrating an example of a screen outputting a second type of interactive content of the interactive content providing system according to an embodiment of the present application.
7 is a diagram illustrating an example of a character model of an interactive content providing system according to an embodiment of the present application.
8 is a diagram illustrating an example of a screen outputting a third type of interactive content of the interactive content providing system according to an embodiment of the present application.

Hereinafter, exemplary embodiments of the present application will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art may easily implement the present application. However, the present application may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, parts not related to the description are omitted in order to clearly describe the present application, and similar reference numerals are attached to similar parts throughout the specification.

Throughout this specification, when a part is said to be "connected" with another part, this includes not only the case that it is "directly connected", but also the case that it is "electrically connected" with another element interposed therebetween. do.

Throughout this specification, when a member is positioned "on", "upper", "upper", "under", "lower", and "lower" of another member, this means that a member is located on another member. It includes not only the case where they are in contact but also the case where another member exists between the two members.

Throughout the specification of the present application, when a certain part "includes" a certain component, it means that other components may be further included rather than excluding other components unless specifically stated to the contrary.

1 is a diagram showing a configuration of an interactive content providing system according to an embodiment of the present application.

Referring to FIG. 1, an interactive content providing system based on virtual reality and augmented reality may include an interactive model 100, a user terminal 200, and an interactive content providing server 300.

The interactive model 100 may include an identifier for loading interactive content implemented in virtual reality and augmented reality, and a sensor that detects a user's gesture. The interactive model 100 may be provided in various types according to the provided interactive content, and for example, may be provided as an image card 110, a human body model 120, and a character model 130 of an entertainer. The interactive model 100 according to each type may include different identifiers associated with the type of interactive content. The identifier may include at least one of a QR code, an image, a polygon, and a texture.

The user terminal 200 may generate content request information for interactive content linked to the interactive model by scanning an identifier of the interactive model. Also, the user terminal 200 may transmit the generated content request information to the interactive content providing server, and may receive and output the interactive content from the interactive content providing server. The interactive content providing server 300 may transmit the interactive content associated with the interactive model to the user terminal 200 based on the content request information received from the user terminal 200. The virtual reality cardboard 400 may provide a virtual reality environment so that a smart terminal 200 is mounted and a virtual reality-based tourism content and a tourism map are displayed. For example, the cardboard 400 for virtual reality may include a plurality of lenses LENS for correcting binocular parallax. According to an embodiment of the present application, the interactive content may include virtual reality content and augmented reality content including 360-degree omnidirectional images.

The interactive model 100, the user terminal 200, and the interactive content providing server 300 may be connected through a network. For example, the user terminal 200 may include a smartphone, a smart pad, and a smart TV. , PCS (Personal Communication System), GSM (Global System for Mobile communication), PDC (Personal Digital Cellular), PHS (Personal Handyphone System), PDA (Personal Digital Assistant), IMT (International Mobile Telecommunication)-2000, It may include all types of wireless communication devices such as Code Division Multiple Access (CDMA)-2000, W-Code Division Multiple Access (W-CDMA), and Wireless Broadband Internet (Wibro) terminals.

In addition, the network refers to a wired and wireless connection structure capable of exchanging information between respective nodes such as a terminal and a server, and examples of such networks include a 3rd Generation Partnership Project (3GPP) network, and Long Term Evolution (LTE). ) Network, 5G network, WIMAX(World Interoperability for Microwave Access) network, Internet, LAN(Local Area Network), Wireless LAN(Wireless Local Area Network), WAN(Wide Area Network), PAN(Personal Area Network) , A Bluetooth network, a satellite broadcasting network, an analog broadcasting network, and a Digital Multimedia Broadcasting (DMB) network, but are not limited thereto.

2 is a diagram showing a configuration of a user terminal of an interactive content providing system according to an embodiment of the present application.

Referring to FIG. 2, the user terminal 200 may include a scan unit 210, a communication unit 220, and an output unit 230. The scan unit 210 may generate content request information by recognizing the identifier of the interactive model 100. The scanning unit 210 may recognize and scan the identifier through the camera module of the user terminal 200, and may generate content request information for requesting content associated with the interactive model based on the recognized identifier. . The communication unit 220 may transmit content request information to the interactive content providing server 300 and may receive interactive content corresponding to the content request information from the interactive content providing server 300. In addition, the communication unit 220 may receive touch sensing information from the interactive model, transmit it to the interactive content providing server 300, and receive the interactive content changed according to the touch sensing information from the interactive content providing server in real time.

Interactive content may have a plurality of types associated with different interactive models. Exemplarily, the plurality of types are the first type (type 1 interactive content) associated with tourism content for tourist attractions, and the second type (type 2 interactive content) associated with educational content about the structure and action of human organs. And a third type (third type interactive content) associated with entertainment content for a fan service motion of an entertainer. Referring to FIG. 1, the interactive model (first interactive model) associated with the first type may be an image card 110, and the interactive model (second interactive model) associated with the second type is a human body model 120. Can be The interactive model (third interactive model) associated with the third type may be a character model 130. The interactive content providing server 300 can grasp the type of the interactive model identified by the user terminal 200 through the identifier through the content request information received from the user terminal 200, and obtain interactive content for the corresponding type interactive model. It can be provided to the user terminal 200. The output unit 230 may output interactive content based on virtual reality and augmented reality. For example, when the user scans the identifier of the interactive model through the user terminal 200, the interactive content corresponding to the interactive model may be received from the interactive content providing server 300 and output.

3 is a diagram illustrating an example of an image card of an interactive content providing system according to an embodiment of the present application.

Referring to FIG. 3, the image card 110 of the interactive model 100 may include an identifier 114 (for example, a QR code) associated with a tourist area image for a tourist area and information for identifying a tourist area. have. For example, the image card 110 may include a postcard or a business card. In addition, the tourist area image may be a map image for the tourist area. For example, the tourist area image may be a map image divided into cities, provinces, districts, and counties, but is not limited thereto. In addition, the tourist area image included in the image card 110 may be a 3D map image. The tourist area image may be formed as a 3D map image showing the difference in elevation of the corresponding tourist area. For example, the 3D map image may be a 3D map image that provides a three-dimensional effect by protruding or depressing an area by reflecting a difference in elevation of a corresponding tourist area from a satellite photo of a tourist area. Therefore, compared to a map image of a two-dimensional plane, it is possible to give a user a sense of reality and fun.

Further, referring to FIG. 3, the image card 110 may include identifiers for a plurality of tourist attractions included in the tourist area. The identifiers 111, 112, and 113 may be recognized by the scan unit 210 of the user terminal 200. As shown in FIG. 3, the identifiers 111, 112, and 113 may be identifiers for tourist attractions included in the tourist area. For example, a tourist attraction may mean a cultural property, a historical site, an amusement park, a stadium, and the like, and the identifier may include a name, mutual information, and location information about the tourist attraction. In addition, the tourist area image 110 may display the name or symbol of the tourist attraction so that the user can visually recognize the tourist attraction. In addition, the user terminal 200 scans the identifier 114 of the image card 110 and retrieves information on tourist areas and tourist attractions from the interactive content providing server 300 through interactive contents implemented in virtual reality and augmented reality. Can be provided.

The image card 110, that is, the first type interactive model, may include a piezoelectric sensor that senses a user's touch. A plurality of piezoelectric sensors may be provided, and may be provided inside the image card 110 corresponding to the position of the identifier for the tourist attraction of the image card 110. The user may take a touch gesture of pressing the tourist attraction on the image card 110, and the image card 110 may sense the touch gesture through a piezoelectric sensor provided at the location of the tourist attraction that the user pressed. Also, the image card 110 may generate first touch detection information based on a touch gesture. The communication unit 210 may receive first touch detection information generated based on a touch gesture of touching a tourist attraction in the user's 3D image from the first type interactive model and transmit it to the interactive content providing server 300.

4 is a diagram illustrating an example of a screen outputting a first type of interactive content of an interactive content providing system according to an embodiment of the present application.

When the identifier of the interactive model is scanned through the user terminal 200, the interactive content providing server 300 transmits the interactive content associated with the interactive model to the user terminal 200, and the output unit of the user terminal 200 ( 230) may output the received interactive content. At this time, when the user makes a touch gesture of pressing a specific tourist attraction in the image card 110, the interactive content providing server 300 receives the first touch detection information generated based on the touch gesture of the user touching the specific tourist attraction. It can be received through the user terminal 200. Thereafter, the interactive content providing server 300 may transmit interactive content including detailed information 420 of the tourist attraction to the user terminal 200. Referring to FIG. 4, the output unit 230 may output detailed information 420 of a tourist attraction as augmented reality.

As another example, the output unit 230 may output the user input marker 410 on the interactive content. The user can use the user input marker 410 even when the user wears the cardboard 400 for virtual reality. An input intended by the user, that is, an input for loading detailed information of a tourist attraction, may be performed based on the user's movement. Referring to FIG. 4, the user input marker 410 may be fixed to an area (eg, the center) of the interactive content. In addition, the user terminal 200 may detect the user's movement through a gyro sensing function provided by the user terminal 200, and the output unit 230 responds to the user's gaze based on the detected user's movement ( You can output interactive content to provide 360-degree content). For example, when a user wants to load detailed information of a tourist attraction while wearing a virtual reality cardboard 400 equipped with a user terminal, the user may contact the tourist attraction with a fixed user input marker 410. When the user input marker 410 is in contact with a tourist attraction by movement of the user, the communication unit 220 recognizes the intention to receive detailed information of the tourist attraction, and the communication unit 220 requests detailed information request information. It may be generated and transmitted to the interactive content providing server 300. The interactive content providing server 300 transmits interactive content including detailed information of the tourist attraction (ie, changed interactive content) to the user terminal 200 based on the detailed information request information, and the output unit 230 It is possible to provide detailed information of tourist attractions by outputting changed interactive content including detailed information of attractions in real time.

5 is a diagram illustrating an example of a human body model of an interactive content providing system according to an embodiment of the present application.

Referring to FIG. 5, the second type interactive model may be provided as a human body model 120. The human body model 120 may include a piezoelectric sensor, an acceleration sensor, and an infrared sensor provided for each part. For example, the sensor may be provided inside the human body model 120 corresponding to the position of body parts such as head, arm, and leg, and in particular, the infrared sensor 122 corresponds to the position of the mouth. It may be provided inside. In addition, the human body model 120 may include an identifier 121 for loading the second type interactive content linked to the educational content on the structure and action of the human body. As described above, the scanning unit 210 scans the identifier 121 of the human body model 120 to generate content request information, and the communication unit 220 transmits the content request information to the interactive content providing server 300 The interactive content providing server 300 may receive a second type of interactive content linked to educational content on the structure and function of human organs.

6 is a diagram illustrating an example of a screen outputting a second type of interactive content of the interactive content providing system according to an embodiment of the present application.

In the second type of interactive content illustrated in FIG. 6, the organ structure of the human body may be implemented as augmented reality. The second type interactive model, that is, a human body model, is generated based on at least one of a touch gesture that touches each part of the human body model, a movement gesture that moves each part of the human body model, and an approach gesture that approaches each part of the human body model. Second touch detection information may be generated. For example, when a user's hand, object, etc., is taken to approach the mouth of the human body model 120, the human body model 120 may detect the approach gesture through an infrared sensor provided in the mouth. . In addition, the human body model 120 may generate second touch detection information based on the approach gesture. The approach gesture refers to a gesture of feeding food to the human body model. The communication unit 210 may receive second touch sensing information from the second type interactive model and transmit it to the interactive content server 300. The output unit 230 may output an action of a human body by at least one of a touch gesture, a movement gesture, and an approach gesture as augmented reality, and output the changed interactive content in real time. Specifically, the interactive content server 300 provides the user terminal 200 with a second type of interactive content (changed interactive content) including a process in which food is digested in each organ in response to an access gesture feeding food to the human body model. In addition, the output unit 230 may output the changed interactive content in real time. In this way, by providing interactive content that implements the digestive action of the human body in augmented reality in connection with the actual model, it is possible to induce interest in human body learning.

In addition, in the second type of interactive content, changes in the brain according to human stimulation may be implemented in augmented reality. For example, when a user makes a touch gesture of touching an arm of the human body model 120, the interactive content providing server 300 transmits a second type of interactive content including flashing of the parietal lobe in response to a tactile sense. ) Can be provided. As another example, when a user makes a touch gesture of turning an arm of a human body model, a touch gesture of turning an arm is detected by an acceleration sensor provided in the arm, and the interactive content providing server 300 responds to the movement of the arm. The second type of interactive content including flashing may be provided to the user terminal 200. In addition, the second type of interactive content may include a thinking icon for each of creative thinking such as picture music and logical thinking such as calculation and memorization. The user can perform an input by clicking the icon through the user input marker, and based on this, the interactive content providing server 300 is interactive content in which the brain acting in creative thinking flashes or the brain acting in logical thinking flashes. Content can be provided to the user terminal 200.

7 is a diagram illustrating an example of a character model of an interactive content providing system according to an embodiment of the present application.

Referring to FIG. 7, the third type interactive model may be provided as a character model 130. The character model 130 may include a piezoelectric sensor, an acceleration sensor, and an infrared sensor provided for each part. For example, the sensor may be provided inside the human body model 130 corresponding to the position of body parts such as the head 132, arms, and legs. In addition, the character model 130 may include an identifier 131 for loading the third type interactive content associated with entertainment content for fan service motion. As described above, the scanning unit 210 generates content request information by scanning the identifier 131 of the character model 130, and the communication unit 220 transmits the content request information to the interactive content providing server 300 The interactive content providing server 300 may receive a third type of interactive content associated with entertainment content for a fan service motion.

8 is a diagram illustrating an example of a screen outputting a third type of interactive content of the interactive content providing system according to an embodiment of the present application.

In the third type of interactive content illustrated in FIG. 8, a fan service motion of an entertainer may be implemented in augmented reality. The fan service motion may be a motion that responds with various comments, actions, and facial expressions in response to a user's touch on the character model 130. The third interactive model, that is, the character model 130, is based on at least one of a touch gesture for touching each part, a moving gesture for moving each part of the character model 130, and an approach gesture approaching each part of the character model. Third touch detection information may be generated.

For example, when the user touches the head 132 of the character model 130, the touch gesture may be detected through a piezoelectric sensor provided in the head 132 portion. In addition, the character model 130 may generate third touch detection information based on a touch gesture. The touch gesture refers to a gesture of touching the head of the character model 130. The communication unit 210 may receive third touch detection information from the third type interactive model and transmit it to the interactive content server 300. The interactive content server 300 may provide a third type of interactive content (changed interactive content) including a fan service motion in response to a touch of the head to the user terminal 200, and the output unit 230 may provide a touch gesture, A fan service motion of an entertainer by at least one of a movement gesture and an approach gesture may be output as augmented reality, and the changed interactive content may be output in real time. As such, it can be used as a differentiated and more realistic character product through interactive contents that provide fan services based on gestures such as touch and approach of each part in connection with the character model.

According to an embodiment of the present disclosure, the interactive content server 300 may provide interactive content in which different types of interactive content are linked by fusing at least two of the first type to the third type interactive content. For example, when the identifier of the first type interactive model is scanned through the user terminal 200, the first type interactive content may be output. That is, tourism content for a certain tourist attraction may be output through the user terminal 200. At this time, when the identifier of the third type interactive model is scanned through the user terminal 200, the third type interactive content and the first type interactive content are fused to display a celebrity implemented in augmented reality introducing the tourist attraction. have. For example, in the case of a tourist attraction, such as a national park, where a number of cultural assets and historical sites exist, an entertainer implemented as augmented reality on interactive content is an interactive explaining specific information of each cultural asset each time a user visits the cultural asset. Content can be provided.

As another example, in the case of fusion of type 2 interactive content and type 1 interactive content, the user terminal 200 of a user who visits a tourist attraction such as a museum or a science exhibition can be used to create a type 1 interactive model linked to the tourist attraction. When the identifier is scanned and the identifier of the second type interactive model is scanned, interactive content related to education (not only human body action, but also educational content related to the tourist attraction may be included) is output at each spot of the tourist attraction. I can.

In addition, the interactive content providing server 300 scans a map or digital identifier of a tourist attraction, and scans the identifier of the second type interactive model or the third interactive model, and sends the fused interactive content as described above to the user terminal 300. Can provide. For example, when a map of a tourist attraction or a digital identifier (eg, a QR code) posted online in connection with the tourist attraction is scanned through the user terminal 200, and the identifier of the second type interactive model is scanned, , As described above, the interactive content providing server 300 may provide the user terminal 200 with interactive content outputting entertainers describing specific information of a corresponding tourist attraction.

According to an embodiment of the present application, the interactive content providing server 300 may calculate content recommendation information by constructing a pattern calculation model based on unsupervised learning that inputs touch sensing information for each part of the interactive model. Unsupervised learning refers to an algorithm that learns while analyzing or clustering the data itself, not building data for learning. The interactive content providing server 300 may calculate a touch pattern based on touch sensing information and cluster the touch pattern based on a clustering algorithm.

For example, a logistic regression algorithm, a random forest algorithm, a support vector machine (SVM) algorithm, a decision making algorithm, and a clustering algorithm may be used as the clustering algorithm for unsupervised learning. In addition to the above-described algorithm, the pattern calculation unit 120 also uses clustering algorithms such as Extra Tree algorithm, XG Boost algorithm and Deep Learning algorithm, K-means clustering algorithm, and SOM (Self-Organizing-Maps) algorithm EM & Canopy algorithm. Unsupervised learning can be performed. The Random Forest algorithm is an algorithm that averages each prediction result into one outcome variable by composing a forest of numerous Decision Trees, and the SVM algorithm determines the classification to which the data belongs by dividing the largest boundary in the data distribution space. It is a non-probabilistic algorithm. The Extra Tree algorithm is similar to the Random Forest, but the speed is faster than the Random Forest, and the XGBoost algorithm is a boost method that applies the result of the XGBoost Tree to the next tree if the Tree of the Random Forest is independent. Deep Learning Algorithm is an algorithm that learns by controlling the influence of the pattern of variables on the result based on a multi-layered Neural Network with weights. In addition, the K-means clustering algorithm is a traditional classification technique that repetitively subdivides the target group into K clusters based on the average value (similarity) of the distance, and the SOM algorithm uses the input pattern of the training set as a weight. It is a technique of learning and clustering. In addition, the EM & Canopy algorithm refers to a method of clustering by updating parameter values through an iterative process starting from the one with the maximum possibility with a given initial value.

The interactive content providing server 300 may include a database for recording first touch detection information, second touch detection information, and third touch detection information of each interactive model transmitted from the user terminal 200. The interactive content providing server 300 may utilize pre-stored touch sensing information as an input of the clustering algorithm. The interactive content providing server 300 may detect a touch pattern based on unsupervised learning in which information on a history of users touching the interactive model (touch detection information) is input. In addition, touches of areas mainly input by users may be clustered. As the size of the cluster according to the touch pattern increases, it may be a part that users mainly touch and a part that wants to receive content. For example, in the case of an image card, when the cluster by the touch of a specific tourist attraction is large, the interest of the tourist attraction may be high. Therefore, when the group of touch patterns is larger than a preset size, the interactive content providing server 300 generates new content recommendation information that considers the creation of new interactive content in the corresponding portion and provides it to the administrator of the interactive content providing server 300. I can. The administrator of the interactive content providing server 300, who has been provided with the new content recommendation information, may consider creating new interactive content, thereby providing richer interactive content to the user.

The foregoing description of the present application is for illustrative purposes only, and those of ordinary skill in the art to which the present application pertains will be able to understand that it is possible to easily transform it into other specific forms without changing the technical spirit or essential features of the present application. Therefore, it should be understood that the embodiments described above are illustrative in all respects and not limiting. For example, each component described as a single type may be implemented in a distributed manner, and similarly, components described as being distributed may also be implemented in a combined form.

The scope of the present application is indicated by the claims to be described later rather than the detailed description, and all changes or modified forms derived from the meaning and scope of the claims and their equivalent concepts should be construed as being included in the scope of the present application.

100: interactive model
110: image card
120: manikin
130: character model
200: user terminal
210: scan unit
220: communication department
230: output
300: interactive content providing server
400: cardboard for virtual reality

Claims (7)

In a virtual reality and augmented reality-based interactive content providing system,
An interactive model including an identifier for loading interactive content implemented in virtual reality and augmented reality and a sensor for detecting a user's gesture;
A user terminal, which scans the identifier and transmits content request information for interactive content associated with the interactive model to an interactive content providing server, and receiving and outputting the interactive content from the interactive content providing server;
An interactive content providing server that transmits the interactive content associated with the interactive model to the user terminal based on the received content request information; And
A cardboard board for virtual reality that is equipped with the user terminal and provides a virtual reality environment so that the interactive content is displayed,
Including,
The interactive content,
It has multiple types linked to different interactive models,
The above types include the first type linked to tourism content for tourist attractions, the second type linked to educational content on the structure and action of human organs, and the third type linked to entertainment content for the fan service motion of entertainers. ,
The first type interactive model is equipped with an image card,
The image card is a three-dimensional image of a tourist area, and the three-dimensional image includes an identifier corresponding to a plurality of tourist attractions included in the tourist area, and includes a piezoelectric sensor for sensing a user's touch,
The second type interactive model is provided as a human body model, and the third type interactive model is provided as a celebrity character model,
The human body model and the character model includes a piezoelectric sensor, an acceleration sensor, and an infrared sensor provided for each part. delete delete The method of claim 1,
The user terminal
A scanning unit that generates the content request information by recognizing the identifier of the interactive model;
A communication unit for transmitting the content request information to the interactive content providing server and receiving interactive content corresponding to the content request information;
An output unit that outputs the interactive content based on virtual reality and augmented reality,
Including,
The communication unit receives touch sensing information from the interactive model, transmits it to the interactive content providing server, and receives the interactive content changed according to the touch sensing information in real time. The method of claim 4,
The communication unit receives first touch detection information generated based on a touch gesture of touching a tourist attraction in the 3D image of the user from the first type interactive model and transmits it to the interactive content providing server,
Receive interactive content including detailed information of the tourist attraction corresponding to the first touch detection information from the interactive content providing server,
The output unit to output detailed information of the tourist attraction in augmented reality, interactive content providing system. The method of claim 4,
The communication unit responds to at least one of a touch gesture for touching each part of the human body model from the second type interactive model, a moving gesture for moving each part of the human body model, and an approach gesture approaching each part of the human body model. Receives the second touch detection information generated based on and transmits it to the interactive content providing server,
Receiving interactive content including an action of a human body corresponding to the second touch detection information,
The output unit outputs an action of a human body by at least one of the touch gesture, the movement gesture, and the approach gesture as augmented reality. The method of claim 4,
The communication unit responds to at least one of a touch gesture by touching each part of the character model from the third type interactive model, a moving gesture to move each part of the character model, and an approach gesture approaching each part of the character model. Receives the generated third touch detection information and transmits it to the interactive content providing server,
Receiving interactive content including an action of a human body corresponding to the third touch detection information,
The output unit outputs a fan service motion of a celebrity by at least one of the touch gesture, the movement gesture, and the approach gesture as augmented reality.

Images