KR20210019235A - System and method for providing user responsive sensor-based experience content - Google Patents

Abstract

The present invention relates to a system and a method for providing participant-responsive sensor-based experience content. The present invention includes: a database performing cumulative storage of a space-specific scenario and an experience content control signal depending on a participant reaction condition, a participant reaction result, and a participant position; a sensor module tracking the real-time position of a participant with a beacon and a sensor and recognizing a participant reaction including the participant′s biometric signal and motion; an arithmetic module generating detailed information setting including the size, definition, type, output time, and duration of experience content including AR, VR, and a hologram installed in each space in accordance with the participant reaction recognized at the sensor module and the space-specific scenario; and an output module generating experience content reflecting the detailed information setting and outputting the generated experience content.

Description

Participant responsive sensor-based experience content provision system and method {SYSTEM AND METHOD FOR PROVIDING USER RESPONSIVE SENSOR-BASED EXPERIENCE CONTENT}

Regarding the participant responsive sensor-based experience content provision system and method, specifically, for the creation of user-customized responsive content that proceeds through the achievement of scenarios and conditions, various tangible types according to the participant's behavior and location information within the content worldview The present invention relates to a system and method for generating tangible content that induces active interaction between a participant and content by reacting a device.

Unless otherwise indicated herein, the content described in this section is not prior art to the claims of this application, and inclusion in this section is not admitted to be prior art.

The tangible content service industry is a technology field that is rapidly growing due to the advent of 5G communication technology and the development of VR and AR technologies, and the related industry has been growing rapidly in terms of scale and sales since 2015. However, in the conventional tangible content providing service, most simple and repetitive content is provided, and devices and content are simply arranged in an experience space without a special subject.

Such simple participant responsive experience content reduces the revisit rate of visitors who have already experienced the content due to the short life of the content, and requires high production and management costs when replacing content to maintain the revisit rate. In addition, referring to (a) of FIG. 1, in order to experience haptic content including AR and VR, goggles, joysticks, and heavy HMD or multiple recognition devices must be mounted on the body.

In addition, in general, space and infrastructure are required to develop tangible content, and interaction between tangible devices and participants must be performed. Currently, there are not many types of spaces and devices that provide these functions and effects, and they are very expensive, which is a great burden on development. In addition, there is a limitation in content planning according to the current haptic space, infrastructure, and devices, and conventional contents are narrow in planning as simple haptic video, flight, shooting, and sports games, and only passive reactions of participants are induced. There is a situation.

1. Korean Patent Registration No. 10-1638063 (2016.07.04) 2. Korean Patent Registration No. 10-1905272 (2018.09.28)

The participant responsive sensor-based experience content providing system and method according to the embodiment provides responsive and customized experience content that induces active participation of participants in order to improve profits and expand the base of haptic content. In addition, by reacting various haptic devices according to the participant's behavior and location information within the system's worldview, it provides a new way of haptic content that induces active interaction between the participant and the contents.

Participant responsive sensor-based experience content providing system according to an embodiment includes a database for accumulating and storing experience content control signals according to spatial scenarios, participant reaction conditions, participant reaction results, and participant positions; A sensor module for tracking a participant's real-time location through a beacon and a sensor, and recognizing a participant's reaction including a biological signal and motion of the participant; To create detailed information settings including size, clarity, type, output time and duration of experience content including AR, VR, and hologram installed in each space according to space scenarios and participants' reactions recognized by the sensor module. Calculation module; And an output module generating experience content reflecting detailed information settings and outputting the generated experience content. Includes.

The content generation method of the participant responsive sensor-based experience content providing system according to another embodiment includes the steps of: (A) storing scenario, participant information, and reaction condition information in a database of an integrated control server; (B) controlling lighting, door locks, and sounds installed in the space according to the scenario and participant reaction and condition detection result stored in the integrated control server, and generating participant responsive content; (C) outputting the content generated by the integrated control server according to the scenario, conditions and participants' reactions, and tracking the participant's reaction information and biometric information exposed to the content; (D) analyzing the participant reaction information and biometric information tracked by the integrated control server, reflecting it in the scenario, and controlling detailed information of the participant-responsive content according to the tracked biometric information; Includes.

The participant responsive sensor-based experience content providing system and method according to the embodiment significantly extends the life of the content and increases the revisit rate by deriving various results according to the participant's response. In addition, when replacing the scenario of the experience content providing system, existing devices and interiors are recycled to reduce costs and shorten the replacement time. In addition, in the embodiment, a more advanced participant-responsive AR content can be generated by tracking the participant reaction according to the detailed content setting and analyzing the correlation.

In addition, in the embodiment, as shown in (b) of FIG. 1, since the real-time location of the participant is recognized through beacons and sensors, heavy HMD (Head Mounted Display) or multiple recognition devices like existing VR, AR, MR contents There is no need to mount the product on the body, so the service preparation time is shortened. In addition, since the player participating in the tangible system only needs to possess one sensor, the inconvenience and weight of wearing personal equipment can be completely eliminated, and there are no inconveniences for motion and restrictions on space.

In addition, through embodiments, various haptic devices are reacted according to the participant's behavior and location information to induce active interaction between the participant and the content, and AR (Augmented Reality), VR (Virtual Reality), MR (Mixed Reality), five senses It can be implanted into interactive content, tangible screen content, and spatial display content. This eliminates the restrictions on the use of the system and maximizes the satisfaction of participants according to the content response.

The effects of the present invention are not limited to the above effects, and should be understood to include all effects that can be inferred from the configuration of the invention described in the detailed description or claims of the present invention.

1 is a diagram comparing participants in a system for providing experience content according to the prior art and an embodiment
2A is a diagram for explaining the main functions of a participant responsive sensor-based experience content providing system according to an embodiment
2B is a diagram showing the configuration of a system for providing participant responsive sensor-based experience content according to an embodiment
3 is a view showing a data processing block of the integrated control server 100 according to an embodiment according to the embodiment
4 is a diagram showing a process of tracking a participant's location and identifying participant's biometric information of a sensor and a beacon according to an embodiment
5 is a view showing an example of use of a participant responsive sensor-based experience content providing system according to an embodiment
6 is a diagram for explaining an example of actual participation in an experience content providing system
7 is a diagram showing a data processing process of an experience content providing system according to an embodiment

Advantages and features of the present invention, and a method of achieving them will become apparent with reference to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in a variety of different forms, only the present embodiments are intended to complete the disclosure of the present invention, and the general knowledge in the technical field to which the present invention pertains. It is provided to completely inform the scope of the invention to those who have it, and the invention is only defined by the scope of the claims. The same reference numerals refer to the same elements throughout the specification.

In describing embodiments of the present invention, if it is determined that a detailed description of a known function or configuration may unnecessarily obscure the subject matter of the present invention, a detailed description thereof will be omitted. In addition, terms to be described later are terms defined in consideration of functions in an embodiment of the present invention, which may vary according to the intention or custom of participants or operators. Therefore, the definition should be made based on the contents throughout this specification.

2A is a view for explaining the main functions of the participant-responsive sensor-based experience content providing system according to an embodiment.

Referring to Figure 2a, the participant responsive sensor-based experience content providing system according to the embodiment is provided in various ways according to the participant's behavior and location information within the world view of the content in order to generate customized responsive content for the experiencer through the achievement of scenarios and conditions. By reacting haptic devices, haptic contents are created that induce active interaction between participants and contents. Specifically, the scenario, player information, and condition information are stored in the integrated control server, and condition checks such as the user's correction position input or detected by the user, whether the mission is resolved in the scenario and whether a clue has been obtained, and the user location information , Controls a sensory device that generates experience content by tracking biometric information and reaction information. In addition, by controlling environmental information such as lighting and door lock sound in the space where the system is installed, participants can experience the content more realistically in an appropriate environment when outputting experience content including AR, VR, MR, and hologram. .

2B is a diagram showing the configuration of a participant-responsive sensor-based experience content providing system according to an embodiment.

Referring to FIG. 2B, a participant-responsive sensor-based experience content providing system according to an embodiment may include an integrated control server 100, a transceiver 200, and a beacon and sensor 300 installed in a space. The integrated control server 100 generates motion information, biometric information, location, location tracking information of the participant recognized by the beacon and sensor 300 from the transceiver 200, and experience content corresponding to a previously stored scenario, and outputs it to the participant. Allows you to experience experience content. In the embodiment, the participant wears a wearable position sensor that recognizes beacons on the wrist, etc. so that his or her location information can be identified.

The transceiver 200 receives the participant's location and location tracking information from the beacon, and receives participant reaction information including the participant's biometric information, motion information, and facial expression information from other sensors. In an embodiment, the transceiver 200 determines the validity of the received participant reaction information, location information, and location tracking information, and transmits the validated participant reaction information and location information to the integrated control server 100.

The integrated control server 100 identifies participant reaction information and location information received from the transceiver 200, generates participant responsive content according to a previously stored scenario and condition, and controls it.

3 is a diagram showing a data processing block of the integrated control server 100 according to an embodiment according to the embodiment.

Referring to FIG. 3, the integrated control server 100 according to the embodiment may include a database 110, a sensor module 130, an operation module 150, an output module 170, and a feedback module 190. I can. The database 110 accumulates and stores a scenario for each experiential space, a response condition of a participant, and a control signal according to the participant's location.

The sensor module 150 tracks the real-time position of the participant through beacons and sensors, and recognizes the participant's reaction including the participant's bio-signal and motion. In addition, the sensor module 130 individually recognizes the movement and reaction of each participant when several participants enter a specific space. In addition, the sensor module 130 recognizes the position coordinates of the participant through the received signal strength and the received beacon of the beacon and tracks the participant's position.

The calculation module 150 includes the size, clarity, type, output time and duration of the participant responsive content installed in each space according to the space-specific scenario and participant reaction and condition information recognized by the sensor module 130. Create a configuration. In an embodiment, the calculation module 150 generates detailed information of the participant responsive content so that AR content corresponding to a previously stored scenario flow is continuously output to a plurality of spatial blocks. In addition, when receiving location information for each participant from the sensor module 130, the calculation module 150 verifies the validity of the received location data, and transmits the verified location data to the output module.

The output module 170 generates participant responsive content reflecting detailed settings, and outputs participant responsive content.

The feedback module 190 tracks the participant follow-up reaction including motion, facial expression, and biometric information of the participant who checked the output participant responsive content, and analyzes the correlation between the tracked participant follow-up reaction and the output participant responsive content. The analysis result is accumulated and stored, and the analysis result is reflected in the detailed information setting of the participant responsive content. In addition, in the embodiment, the feedback module 190 compares the participant's response and the actual participant response included in the pre-stored expected scenario, the sound, size, and the participant response result for the time of appearance of the output participant responsive content, and the participant age and participant gender. The size of the participant's response and the degree of interaction are identified and analyzed.

The participant responsive sensor-based experience content providing system and method according to the embodiment sets in advance a plurality of participant expected responses to participant responsive output contents and scenarios and a response scenario for each expected response, and the participant according to the previously stored expected response. When biometric information, motion, and location of are detected, the participant responsive output content generation is controlled according to the set response scenario.

4 is a diagram illustrating a process of tracking a participant's location and identifying participant's biometric information by sensors and beacons according to an embodiment.

Referring to FIG. 4, as shown in (a) of FIG. 4, in the related art, only the distance information between the participant and the sensor was measured with an infrared sensor, whereas in the embodiment, a signal between the wearable location recognition sensor and the beacon worn by the participant Through the intensity measurement, the direction of the participant and the degree of approaching the separation distance can be identified. In the embodiment, by more accurately recognizing participant information through wearable devices and beacons, user-customized responsive content that proceeds through achievement of scenarios and conditions is generated. In addition, by controlling the devices in an integrated manner according to the location and direction of the participant, the scenario and conditions, and allowing the devices configured in the system to react according to the exact viewpoint and location, the player's experience can be maximized.

5 is a view showing an example of use of a participant responsive sensor-based experience content providing system according to an embodiment.

5, the operation module 150 of the participant responsive sensor-based experience content providing system according to the embodiment controls detailed information of the lighting, door lock system, and sound module according to a pre-stored scenario and participant reaction to respond to participants. It allows the output of the content to be delivered to the participants in a more realistic way. In addition, once the conventional experience space is installed, there are many difficulties in moving, replacing, and dismantling. In particular, in the case of a room escape cafe, installation is expensive, and recycling is almost impossible according to scenario modification. However, the participant responsive sensor-based experience content according to the embodiment is produced in the form of an independent module for convenient installation and movement by modularizing the device, so that the location of the device can be moved, removed, and added easily according to the scenario change. do. In addition, through the embodiment, space recycling is maximized through scenario branching, and various scenarios can be applied to one device space, thereby providing various content experience-type contents.

In addition, it is possible to organize contents having various branches according to the behavior of participants in the same contents, and to block space. In an embodiment, through the blockage of space, several space blocks may be arranged in a continuous form in accordance with the flow of the scenario to form one integrated experience space.

In addition, haptic devices are added to each space block according to themes such as time, season, and place.

It enables effective placement and enhances the sense of immersion to participants through cinematic directing through lighting and sound control. In addition, each spatial block can be provided as each independent content, so the application type can be determined according to the service environment.

6 is a diagram for explaining an example of actual participation in an experience content providing system.

Referring to FIG. 6, the experience content providing system according to the embodiment may implement various types of play. As shown in Fig. 6(a), one participant directly performs one content in one space, or consists of a personal play form, or as shown in (b), one content is two people in one space. More than one player may be configured to proceed through collaboration. In addition, as shown in (c), it is possible to implement a single content in one space in a way that several people each play.

Hereinafter, a method of providing tangible content will be described in order. Since the function (function) of the haptic content providing method according to the embodiment is essentially the same as the function of the integrated control server and the system for controlling haptic content, a description overlapping with FIGS. 1 to 6 will be omitted.

7 is a diagram illustrating a data processing process of an experience content providing system according to an embodiment.

In the embodiment, in step S10, scenario, participant information, and reaction condition information are stored in a database.

In step S30, environmental information installed in the space, including lighting, door lock, and sound, is controlled according to the stored scenario, participant reaction and condition detection result, and participant responsive content is generated.

In step S50, the generated content is output according to the scenario and conditions and the participant's reaction, and reaction information and biometric information of the participant exposed to the content are tracked.

In step S70, the tracked participant reaction information and biometric information are analyzed, reflected in the scenario, and detailed information of the participant responsive content is controlled according to the tracked biometric information. In the embodiment, experience content including AR, VR, MR, and hologram may be controlled according to a user's correction location, a mission solution result registered in a scenario, and a clue acquisition process.

Step S70 according to the embodiment includes the steps of tracking a participant's follow-up reaction including motion, facial expression, and biometric information of the participant who checks the output participant responsive content; Analyzing a correlation between the tracked participant's follow-up reaction and the output experience content, and accumulating and storing the analysis result; And feedbacking the analysis result to be reflected in the participant responsive content detailed information setting. It may include. In addition, in the embodiment, the comparison result of the participant reaction included in the pre-stored expected scenario with the actual participant reaction, the result of the participant reaction to the sound and volume of the output experience content, the time of appearance, and the response size and interaction according to the participants' age group and participant gender. By grasping and analyzing the degree, it is possible to provide customized content for participants according to the participants' gender, age, and reaction level.

The disclosed contents are only examples, and various changes can be made by those of ordinary skill in the art without departing from the gist of the claims claimed in the claims, so the scope of protection of the disclosed contents is It is not limited to the examples.

Claims (11)

In the participant responsive sensor-based experience content providing system,
A database for accumulating and storing experience content control signals according to spatial scenarios, participant reaction conditions, participant reaction results, and participant positions;
A sensor module for tracking a participant's real-time location through a beacon and a sensor, and recognizing a participant's reaction including a biological signal and motion of the participant;
Generate detailed information settings including size, clarity, type, output time and duration of experience content including AR, VR, and hologram installed in each space according to the space scenarios and participants' reactions recognized by the sensor module An operation module to perform; And
An output module generating experience content reflecting the detailed information setting and outputting the generated experience content; Participant responsive sensor-based experience content providing system including a.
The system of claim 1, wherein the participant responsive sensor-based experience content providing system
Tracking the participant's follow-up reaction including motion, facial expression, and biometric information of the participant who checked the outputted experience content, analyzing the correlation between the tracked participant follow-up reaction and the outputted experience content, accumulating and storing the analysis result, and the analysis A feedback module that allows the result to be reflected in detailed experience content information setting; Participant responsive sensor-based experience content providing system, characterized in that it further comprises.
The method of claim 2, further comprising: the feedback module; silver
Participant reactions included in pre-stored predicted scenarios and actual participant reaction comparison results, participant reaction results for the volume and timing of the content output, participant reaction size and degree of interaction according to participant age group and participant gender Participant responsive sensor-based experience content providing system, characterized in that it is identified and analyzed.
According to claim 1, The calculation module; silver
Participant responsive sensor-based experience content providing system, characterized in that generating detailed information of the experience content so that experience content corresponding to a previously stored scenario flow is continuously output to a plurality of spatial blocks.
According to claim 1, The sensor module; silver
Participant responsive sensor-based experience content providing system, characterized in that when multiple participants enter a specific space, each participant's movement and reaction are individually recognized.
The method of claim 1, wherein the calculation module
When receiving location information for each participant from the sensor module, the validity of the received location data is verified and the verified location data is transmitted to the output module.
The method of claim 1, wherein the sensor module
A participant-responsive sensor-based experience content providing system, characterized in that the participant's location coordinates are recognized and the participant's location is tracked through the received signal strength and the received beacon of the beacon.
The system of claim 1, wherein the participant responsive sensor-based experience content providing system
When a plurality of participants' expected responses to the output experience content, reaction conditions, and scenarios and a response scenario for each expected response are set in advance, and when the participant's biometric information, motion, and location are detected according to the previously stored expected response, the set Participant responsive sensor-based experience content providing system, characterized in that controlling the generation of experience content according to a response scenario.
The content creation method of the participant responsive sensor-based experience content providing system
(A) storing scenario, participant information, and reaction condition information in the database of the integrated control server;
(B) controlling lights, door locks, and sounds installed in the space according to the stored scenario and participant reaction and condition detection result in the integrated control server, and generating participant responsive content;
(C) outputting the content generated by the integrated control server according to the scenario and condition and the participant's reaction, and tracking reaction information and biometric information of the participant exposed to the content;
(D) analyzing the tracked participant reaction information and biometric information in an integrated control server, reflecting it in a scenario, and controlling detailed information of the participant-responsive content according to the tracked biometric information; Experience content generation method comprising a.
The method of claim 9, wherein the step (D); Is
Tracking the participant's follow-up reaction including motion, facial expression, and biometric information of the participant who checked the output participant responsive content, analyzing the correlation between the tracked participant follow-up reaction and the output experience content, and accumulating and storing the analysis result, The method of generating experience content, characterized in that feedback is provided so that the analysis result is reflected in the participant responsive content detailed information setting.
The method of claim 10, wherein the step (D); Is
Participant reactions included in pre-stored expected scenarios and actual participant reaction comparison results, participant reaction results for the sound, volume, and timing of the displayed AR contents, and participant reaction size and interaction level according to participant age group and participant gender. Analyzing; Experience content creation method further comprising a.

Images