KR102177283B1 - System and Method for Supporting content creation and editing using HCI for Fence Mending - Google Patents

Abstract

The present invention is to create content using HCI for improving interpersonal relations so that stories can be set and changed by placing objects in a desired location and assigning animations to use content using HCI (Human Computer Interaction). And a system and method that supports editing, which analyzes and converts the coordinate system configuration and vertex of content components stored and provided in a content database and UI module, so that they can be used for storytelling-based content editing. Object conversion application module to be interlocked; Supports to create and edit VR content to be played in the form of a simulation of a past situation based on story information input using content components provided through the object conversion application module Storytelling-based content editing module; Content that controls the creation of VR content that reproduces the user's past viewpoint as it is by playing the VR content produced and edited in the storytelling-based content editing module according to the time flow in Unity It includes; a control module.

Description

System and method for supporting content creation and editing using HCI for improving interpersonal relationships {System and Method for Supporting content creation and editing using HCI for Fence Mending}

The present invention relates to content utilization using HCI (Human Computer Interaction), and specifically, an HCI for improving interpersonal relations that enables story setting and change by controlling interaction while placing an object in a desired position and assigning an animation. It relates to a system and method for supporting the production and editing of used content.

Virtual Reality (VR), Augmented Reality (AR), and Merged Reality (MR) that will lead the next generation of Human Computer Interaction (HCI) (or Information and Communications Technologies (ICT)) are from ancient times. Although it is a technology, it has been receiving great attention recently due to the wearable craze.

Such VR/AR/MR is in any field and is changing the technology world with scary momentum, just as smartphones and drones turn into market trends.

In particular, VR/AR/MR is a trend that is not currently applied to entertainment video game machines, but is expanding its application range to CAD/CAM (computer design and manufacturing).

VR/AR/MR is expected to bring convenience in life by allowing users to know the core contents without actual experience such as virtual performance, furniture arrangement, and home inspection, and Northwestern University in the U.S. has VR/AR/MR for medical research such as cancer treatment. MR technology is applied, and Matsushita is developing programs such as a chair massager and bicycle exercise that apply VR/AR/MR technology to a video recorder (VCR).

As such, VR/AR/MR is a virtual reality that can replace real experiences, and when relationships and psychological counseling with people can be healed using VR/AR/MR, the convergence of IT technology, psychology, and healing are multidisciplinary. It is expected that the synergy effect can be exhibited through this, and research is required accordingly.

However, in order to use content that applies VR/AR/MR technology in the field of relationships with people and psychological counseling, the user's story is reflected in the VR/AR/MR content production stage, and the produced VR/MR Additional changes are made by reflecting the user's story in AR/MR contents, but there is still a limit to commercialization due to insufficient technology development.

Some technologies for controlling the reproduction of virtual reality content are being developed according to changes in the user's progress direction, progress speed, and gaze, but this is limited to the game field, so there is a limitation in terms of usability. (Public Patent No. 10- 2018-0002426)

In addition, there is a technology that infers the type of relationship between a service user or object's neighbors and fuses the relationship network of the service user or object based on the relationship type with the coaching service, but this is different from reflecting the user story. No. 10-2016-0000446)

As another technology, there is a technology for changing a virtual object at the request of a user, but this is also different from the reflection of the user's story, so the contents applied with VR/AR/MR technology in the field of relationship with people and psychological counseling are used. It is not enough to follow. (Registration Patent No. 10-1782045)

As another technology, there is a technology including a configuration of loading and synchronizing base contents stored in a content database with a variable object and a voice using user's storytelling. This is a problem of the inability to apply contents created by external tools, limitations of application due to the absence of a configuration for controlling the playback of traumatic content, limitations of the application of user interaction due to the absence of a configuration for face tracking, and evaluation and feedback configuration. There is a problem in commercialization as there is a limitation in reflecting and changing user stories due to the absence of the user's story (Public Patent No. 10-2018-0100843).

Therefore, it is possible to reflect the template story and all the stories of users (content creators, professional counselors, and consultants), and users through application of contents created with external tools, application of sufficient user interaction technology, evaluation and feedback configuration By making it possible to reflect and change stories, it is possible to flexibly edit and produce VR contents, and development of new technologies for use in various fields is required.

Republic of Korea Patent Publication No. 10-2018-0100843 Korean Patent Registration No. 10-1782045 Republic of Korea Patent Publication No. 10-2018-0002426

The present invention is to solve the problem of the content utilization field technology applying the VR/AR/MR technology of the prior art, and it is possible to set and change a story by controlling interaction while placing objects in a desired location and assigning animation. The purpose of this is to provide a system and method that supports the production and editing of contents using HCI for improving interpersonal relationships.

The present invention is a template story, reflecting all the stories of users (content creators, professional consultants, counseling targets), allowing flexible editing and production of contents, and of contents using HCI for improving interpersonal relationships so that they can be used in various fields Its purpose is to provide a system and method that supports production and editing.

The present invention creates and edits content using HCI for improving interpersonal relationships to create content exclusively for interpersonal relationship improvement using objects necessary to reproduce the user's past experience, and to have a function as a content editor used for relationship improvement Its purpose is to provide a system and method that supports

The present invention supports the creation and editing of content using HCI for improving interpersonal relations so that content in a new context can be produced only with numeric input values such as coordinates and time scheduling for objects without user storytelling. It is an object to provide a system and method to perform.

The present invention provides a system and method that supports the creation and editing of content using HCI for improving interpersonal relationships so that a developer can create content in the form of additional editing using a content template that can be provided in advance. There is a purpose.

The present invention increases the objectivity and accuracy of evaluation by constructing a numerical and statistical information-centered evaluation system such as the number of content experiences and repetition section playback history, and uses AI based on accumulated statistical values to improve interpersonal relationships. The purpose of this is to provide a system and method that supports the production and editing of content using HCI for improving interpersonal relationships so that the trend can be analyzed.

The present invention makes it possible to apply contents made with external tools so that objects developed in various 3D object creation tools can be used, thereby ensuring convenience and diversity of object development, contents using HCI for improving interpersonal relations. Its purpose is to provide a system and method to support the production and editing of

The present invention makes it possible to elaborately arrange human objects, background objects, and voices using input user's past situation information (memory, statements, and other information), so that content to be reproduced in the form of a simulation of the past situation It is an object of the present invention to provide a system and method that supports the production and editing of content using HCI for improving interpersonal relationships so that users can edit the content.

The present invention allows a developer who creates a content to place various objects during editing and make detailed adjustments while experiencing them in the device to create content that reproduces a more elaborate past situation, or to modify an object immediately required whenever there is a requirement. The purpose of this is to provide a system and method that supports the production and editing of content using HCI to improve interpersonal relationships.

The present invention tracks facial expressions by performing a user's face tracking, collects the types of emotions from the facial expressions, and implements an interaction function between the user and the human object in which the facial expression of the human object in the content responds accordingly to improve the user's experience. Its purpose is to provide a system and method that supports the production and editing of content using HCI for improving interpersonal relations so as to have a positive effect on increasing immersion and improving interpersonal functions.

Other objects of the present invention are not limited to the objects mentioned above, and other objects that are not mentioned will be clearly understood by those skilled in the art from the following description.

The system supporting content creation and editing using HCI for improving interpersonal relations according to the present invention to achieve the above object is a coordinate system configuration and point of content components stored in a content database and UI module and provided. ) To be used for storytelling-based content editing by analyzing and transforming the object conversion application module; based on the story information input using the content components provided through the object conversion application module Storytelling-based content editing module that supports the creation and editing of VR content to be played in the form of a simulation of the situation; VR content created and edited in the storytelling-based content editing module is played within Unity according to time A content control module that controls the creation of VR content that reproduces the user's past viewpoint as it is; a scene rendering module that controls the playback speed for a specific point of the VR content and renders it so that section repetition is possible; Included while playing VR content And an interaction module that enables detailed movement control and object modification of existing objects, and enables a user experiencing VR content to interact with objects in the content.

Here, evaluation and analysis centered on numerical and statistical information such as the number of VR content experiences, repetitive section playback history, and the number of VR content generated per individual are performed, and the user's past experience and content use history are accumulated and statistically created to become a trauma. It characterized in that it further comprises an evaluation and feedback system for limiting the reproduction of the possible content.

In addition, the content database and UI module have a content database dedicated UI for loading 3D objects and storing and loading VR content being edited, and store background objects and variable objects used for content creation and editing, and previously produced content. It is characterized in that the included content components are stored, and the stored content components are provided to a storytelling-based content editing module through an object conversion application module.

In addition, the content database and the UI module include background objects and variable objects used for content creation and editing, and a content storage unit for storing pre-produced content, and background objects and variable objects stored in the content storage unit when VR content is created. Content DB that manages a content database dedicated UI to support loading 3D objects and saving and loading VR content being edited through the basic element providing unit that provides basic elements for the content and previously produced content, and the basic element providing unit It characterized in that it includes a dedicated UI module.

The object and VR content changed by the storytelling-based content editing module are stored again in the content database and UI module, and the object and VR content stored in the content database and UI module are each object's ID, coordinates, applied animation, and animation. It is characterized in that it is stored in a form including the holding time.

In addition, the content DB-dedicated UI module includes a function to display 3D objects stored so far in a tree form by category, and a function to load and view only each object separately.In the case of VR contents, the creation date and title are used as captions. It is characterized in that it supports the function of including and showing the content and partially playing the content as needed.

In addition, the object conversion application module includes a 3D object file format read unit for reading formats of background objects and variable objects used for content creation and editing stored in a content database and UI module, and previously produced contents, and a 3D object file format. A coordinate conversion unit that analyzes the coordinate system configuration of the background objects and variable objects read from the lead unit and the previously produced contents and converts them into a coordinate system that can be linked with Unity so that it can be used for storytelling-based content editing, and a background object and It is characterized by including a vertex conversion unit that analyzes a difference in a method of expressing a vertex of variable objects and pre-produced contents and converts it so that it can be accurately ported into Unity.

In addition, the storytelling-based content editing module includes a viewer module that creates an object created with an external tool as a unique object ID in Unity, and then configures an editing screen for placing and editing the object, and a general action and It characterized in that it comprises a scheduler (Scheduler) module for setting the timing and length setting for connecting voice or taking objects.

In addition, the Viewer module includes an inventory generation module that stores an object instance including all objects, actions, and animations for a background object, and creates an inventory for sending it to a slot, and a slot Including an object creation module that is implemented in a dedicated script file and creates an object by performing each function on inputs input to the slot, and an item placement module that places objects on the editing screen of the VR content editor tool. It features.

In addition, the scheduler module includes a panel event processing unit that processes information on input Actions and Takes, item deletion, cursor movement control (Cursor Move), content playback (Play), and content playback stop (Stop). A user event processing unit that processes information related to, a data processing unit that sets cursor position information as an initial position and creates an Item Dictionary when a specific content is first created in the scheduler, a cursor position calculation unit that calculates the cursor position, and It characterized in that it comprises a stopwatch (Stop Watch) for setting the timing, and a UI management unit that supports a scheduler view under control of a view controller (View Resolution Controller).

In addition, the content control module uses a state transition diagram providing unit that implements an animation of VR content to be produced as a flow chart or a state transition diagram, and a state transition diagram provided by the state transition diagram providing unit in Unity. It characterized in that it comprises an animation operation performing unit for generating VR content that reproduces the user's past viewpoint as it is by playing it according to the passage of time.

In addition, the interaction module is an editing interaction module that arranges VR objects and makes detailed adjustments when an object arrangement request signal for placing various VR objects and a signal for detailed adjustment are input during editing of creating VR contents. And, the user performs an interaction function between the user and the VR human object, which tracks the facial expression by performing the user's face tracking, collects the types of emotions from the facial expression, and makes the facial expression of the human object in the VR content react accordingly. It characterized in that it comprises a function module, an HMD for providing VR content to a user, and a content providing means including a display device.

In addition, the evaluation and feedback system includes a demonstration number collection unit that collects VR content experience count information for evaluation based on numerical and statistical information, a repetition section history collection unit that collects repetition section playback history information, and The number of generated contents information collection unit that collects information on the number of VR contents, statistical processing of information on the number of collected VR contents experiences, repetition section playback history, and the number of VR contents created per person, and visualizing the results A statistics and visualization processing unit that is output by accumulating and statistically accumulating a user's content use history, a content playback limiting unit that limits the playback of content that may become trauma, and an AI by accumulating the results output from the statistics and visualization processing unit. It is characterized by including a cumulative result AI analysis unit that performs analysis and provides information to know the influence or trend that has had on improving interpersonal relationships.

In addition, in the process of limiting the reproduction of content that can be trauma, the evaluation and feedback system automatically selects a case in which many words that can be trauma are included in the script for writing a content story as primary unplayable content. It is characterized in that, while experiencing VR content, the user's pupil movements and reactions are accumulated and scored, and content that exceeds a threshold score is restricted from repeatedly playing.

The method for supporting content creation and editing using HCI for improving interpersonal relations according to the present invention for achieving another object is to determine the coordinate system configuration and vertex of the content components stored and provided in the content database and the UI module. An object transformation application step of analyzing and transforming it to be used for storytelling-based content editing and linking with Unity; based on the story information input using the content components provided through the object transformation application step, Storytelling-based content editing step that supports the production and editing of VR content to be played in the form of a simulation for the user; VR content created and edited in the storytelling-based content editing step is played in Unity according to time Content control step of controlling to generate VR content that reproduces the past viewpoint as it is; Scene rendering step of rendering to enable playback speed adjustment and section repetition of a specific point of VR content; And an interaction step of allowing detailed movement control and object modification of objects, and allowing a user experiencing VR content to interact with an object in the content.

Here, the object conversion application step includes a 3D object file format reading step of reading the format of background objects and variable objects used for content creation and editing stored in the content database and UI module, and the previously produced content, and a 3D object file A coordinate conversion step that analyzes the coordinate system configuration of the background objects and variable objects read in the format read step, and the previously produced contents, and converts them into a coordinate system that can be linked with Unity so that it can be used for storytelling-based content editing, and a background object And a vertex conversion step of analyzing a difference in a method of expressing a vertex of variable objects and pre-produced contents, and converting it to be accurately ported into Unity.

In the storytelling-based content editing step, an object created with an external tool is created as a unique object ID in Unity, and then an editing screen is constructed in which an object can be placed and edited, and a general action and a voice are connected. It characterized in that it comprises a step for setting the timing and length setting for taking the object.

And the step of configuring the editing screen is the inventory creation step of creating an inventory to store all objects, actions, and object instances containing animations for the background object and send them to the slot, and the slot An object creation step of creating an object by performing respective functions on inputs implemented in a dedicated script file and input to the slot, and an item placing step of arranging the object on the editing screen of the VR content editor tool. do.

And in the inventory creation step, an item consisting of an item name, item 3d (object), and item 2d (picture) is first created, and for slot creation, an item created in the Item Databases script to obtain an inventory script function. The steps of importing lists, designating the x and y number of slots, the size of the slots, and the size of the blanks that make up the inventory in Unity, and the double for statement in the inventory based on the imported item list Including the step of creating a slot to be displayed in the editing window, designating the location of the created slot according to the size of the specified slot and the size of the blank, making sure that one item per slot is entered based on the item list, and Item 3d object information and name are entered, and item 2d is used as a UI.

In the object creation step, object creation is implemented through a UI that reacts differently according to mouse focusing, clicking, and wheel rotation, and when the mouse is clicked while coming to the slot of the editing screen, the location information of the mouse is used to determine the position. The object is created so that the 3D object in the item list exists on the actual screen.

And through the ItemSetUI in the item placement stage, if you place the mouse on the object created on the screen or click the object, the toggle change script and the outline setting script are interlocked to change the outline color of the object, and the object and the user can interact. It is notified that it is possible, and the information of the item clicked while creating the VR content is stored in the script, and through these functions, the items constituting the VR content are manipulated.

And when the mouse is placed on the created object on the screen or when the object is clicked, the toggle change script and the outline setting script are interlocked with each other, and the object is placed at the position selected by resetting coordinates by the'Replace' command signal, or'Delete' 'Delete the object selected by the command signal, reset the size of the object by the'SizeControl' command signal, save the animation information selected by the'ActionInsert' command signal, or select the Take folder by the'Takes' command signal It is characterized in that the voice selection is performed.

And at the stage of setting the timing and length setting of connecting a general action with a voice or taking an object, when a specific content is first created in the scheduler module, the cursor position information is set as the initial position and an Item Dictionary is created. And, Item Dictionary integrates and manages Action and Take into one Item, so that Action and Take management can be processed at once without separating them.

The system and method for supporting the production and editing of contents using HCI for improving interpersonal relations according to the present invention as described above has the following effects.

First, it is possible to actively use it to improve interpersonal relations by placing objects in a desired position and controlling interaction while assigning animations to enable story setting and change.

Second, it is possible to flexibly edit and produce the content by reflecting all the stories of the template story and users (content creators, professional counselors, and consultants) and to be used in various fields.

Third, it is possible to create content exclusively for improving interpersonal relations by using objects necessary to reproduce the user's past experience, and implement a function as a content editor used for relation improvement.

Fourth, even without the user's storytelling, it is possible to create a new context content with only numerical input values such as coordinates and time scheduling for objects.

Fifth, content can be created in the form of additional editing using a content template that can be provided by a developer in advance.

Sixth, by establishing an evaluation system centered on numerical and statistical information such as the number of content experiences and repetition section playback history, the objectivity and accuracy of the evaluation are improved, and the influence or tendency to improve interpersonal relationships using AI based on accumulated statistical values Can be analyzed.

Seventh, it is possible to apply contents made with external tools, so that objects developed in various 3D object creation tools can be used, so that convenience and diversity of object development can be secured.

Eighth, by using the input user's past situation information (memory, statements, and other information), human objects, background objects, and voices can be precisely arranged, so that content to be reproduced in the form of a simulation of the past situation is provided. You can edit it.

Ninth, developers who create content can place various objects during editing and make detailed adjustments while experiencing them in the device to create content that reproduces more sophisticated past situations, or make necessary object modifications immediately whenever there is a requirement. can do.

Tenth, after tracking facial expressions by performing user's face tracking and collecting the types of emotions from these facial expressions, the interaction function between the user and the human object in which the facial expression of the human object in the content reacts is implemented to improve the user's experience. It should have a positive effect on increasing immersion and improving interpersonal skills.

1 is a configuration diagram of a system supporting the production and editing of content using HCI for improving interpersonal relations according to the present invention
2 is a detailed configuration diagram of a content database and a UI module
3 is a detailed configuration diagram of an object conversion application module
4 is a detailed configuration diagram of a viewer module of a storytelling-based content editing module
5 is a block diagram showing a slot creation process after building an item list of an inventory generation module
6 is a block diagram showing a process from inventory generation to slot generation
7 is a block diagram showing an object creation process in an object creation module of a viewer module
8 is a block diagram showing a process before an ItemSetUI script is operated in an item placement module of a viewer module
9 is a block diagram showing the operation of ItemSetUI
10A and 10B are a detailed configuration diagram of a scheduler module of a storytelling-based content editing module and a configuration diagram of an item view
11A and 11B are configuration diagrams showing an example of a detailed configuration diagram and a state transition diagram of a content control module
12 is a detailed configuration diagram of an evaluation and feedback system

Hereinafter, a preferred embodiment of a system and method supporting the production and editing of content using HCI for improving interpersonal relations according to the present invention will be described in detail as follows.

Features and advantages of the system and method for supporting the production and editing of content using HCI for improving interpersonal relations according to the present invention will become apparent through detailed descriptions of each embodiment below.

1 is a block diagram of a system supporting the production and editing of content using HCI for improving interpersonal relationships according to the present invention.

And FIG. 2 is a detailed configuration diagram of a content database and a UI module, and FIG. 3 is a detailed configuration diagram of an object conversion application module.

In the following description,'content' is a virtual reality (VR) or augmented reality (AR) that uses HCI (Human Computer Interaction) or ICT (Information and Communications Technologies)). Or mixed reality (Merged Reality: MR) content, but is not limited to this.

In addition, it has been described that the system and method for supporting the production and editing of content using HCI according to the present invention can be applied to the field of improving interpersonal relationships, but this is not limited to this as an example of the field of application. It is natural that it can be applied to.

The system and method for supporting the production and editing of content using HCI for improving interpersonal relations according to the present invention is to control interaction while placing objects in a desired position and assigning animations to enable story setting and change. It is intended to be useful in the field of improvement.

The present invention may include a configuration for flexibly editing and producing content by reflecting all stories of a template story and a user (content creator, professional counselor, counselor).

The present invention may include a configuration for creating content exclusively for improving interpersonal relationships by using objects necessary to reproduce a user's past experience, and implementing a function as a content editor used for relationship improvement.

The present invention may include a configuration in which content of a new context can be produced even with only numeric input values such as coordinates and time scheduling for an object without user storytelling.

The present invention may include a configuration for creating content in the form of additional editing using a content template that can be provided by a developer in advance.

The present invention may include an evaluation system centered on numerical and statistical information such as the number of content experiences and repetition section playback history.

The present invention makes it possible to apply contents made by external tools, so that objects developed in various 3D object creation tools can be used, and by using input user's past situation information (memory, statements, other information) It may include a configuration that allows the object, the background object, and the voice to be precisely arranged so that the content to be played back can be edited in a form such as a simulation of a past situation.

The present invention allows a developer who creates a content to place various objects during editing and make detailed adjustments while experiencing them in the device to create content that reproduces a more elaborate past situation, or to modify an object immediately required whenever there is a requirement. It may include a configuration for doing.

The present invention includes a configuration for implementing an interaction function between a user and a human object in which the expression of the human object in the content reacts after tracking an expression by performing a user's face tracking and collecting the types of emotions from the expression. can do.

Specifically, the system supporting the production and editing of content using HCI for improving interpersonal relations according to the present invention is a content database for high-speed 3D object loading and convenient storage and loading of VR content being edited, as shown in FIG. Background objects and variable objects used for content creation and editing, and a content database and UI module 10 that stores previously produced content, and background objects and variables stored in the content database and UI module 10 with a dedicated UI Based on the object conversion application module 20 that analyzes the coordinate system configuration of objects and previously produced contents and the method of handling points, and allows them to be linked with Unity so that they can be used for storytelling-based content editing, and input user's story information A storytelling-based content editing module 30 that creates and edits VR content to be played in the form of a simulation of the past situation, and an animation of VR content to be produced to express specific motions tailored to the user's storytelling. A content control module 40 that implements a flow chart or a state transition diagram and controls it to create VR content that reproduces the user's past view as it is by playing it according to the time flow in Unity, and Unity A scene rendering module 50 that renders the VR content created in the inside of the VR content to be played, adjusts the playback speed for a specific point of the VR content, and enables section replay, and the objects included while playing the VR content in detail. Interaction that allows users to move and adjust to create VR content that reproduces more elaborate past situations or make necessary object modifications immediately whenever there is a requirement, and allows users experiencing VR content to interact with objects in the content. An evaluation analysis centered on numerical and statistical information such as the action module 60, the number of VR content experiences (number of times played), the repetition section playback history, and the number of VR content generated per individual And, it includes an evaluation and feedback system (70) for limiting the reproduction of traumatic content by accumulating and statisticalizing the user's past experience and content use history.

Here, although not shown in FIG. 1, a content database and UI module 10, an object conversion application module 20, a storytelling-based content editing module 30, a content control module 40, a scene rendering module 50, It may further include control means for controlling the interaction module 60, the evaluation and feedback system 70, which control means to control the interaction while placing the object in a desired position and assigning an animation to set a story and Control command signals for controlling the changeable operation are transmitted to each component block so that the command is executed.

The VR content production method up to now has been written similarly to the film production method for a fixed story.

The system that supports the production and editing of content using HCI for improving interpersonal relations according to the present invention can flexibly edit and produce all the stories of the provided template stories and users (content creators, professional counselors, and consultants) as VR contents. There are features that can be.

For example, a photo?事? It is a photo editing tool (corresponding to a system that supports the production and editing of content using HCI for improving interpersonal relationships according to the present invention), and the first photo input is provided by the user (content database and UI module 10). It is similar to the concept of (corresponding to the provision of background objects and variable objects and pre-produced content provided through)

Just as a filmmaker creates content by capturing the story he wants to shoot, VR content creators use the system that supports the production and editing of contents using HCI for improving interpersonal relations according to the present invention. You can create exclusive content (or ordered content).

Therefore, the system supporting the production and editing of contents using HCI for improving interpersonal relations according to the present invention has an interaction module 60, rather than a function that allows an experienced person to move or touch specific contents within VR contents. It focuses on interacting while creating VR content by placing objects in desired locations and assigning animations.

In addition, the system supporting the production and editing of content using HCI for improving interpersonal relations according to the present invention can create a completely new situation as VR content without user storytelling, and coordinates for objects, time scheduling, etc. It is possible to support the creation of one VR content with only a numeric input value, and VR content can be created in the form of additional editing using a VR content template that can be provided in advance by a developer.

In particular, the system supporting the production and editing of content using HCI for improving interpersonal relations according to the present invention is not focused on human judgment, but is evaluated and feedback centered on numerical and statistical information such as the number of VR content experiences and repetition section playback history. Establish a system and evaluate based on Rule-Based Evaluation using this number and statistical information, and then, if sufficient statistics are accumulated, objectivity is secured by analyzing the influence or trend that has on improving interpersonal relationships using AI. I made it possible.

In addition, the detailed configuration of the content database and the UI module 10 is as follows.

As shown in FIG. 2, a content storage unit 11 that stores background objects and variable objects used for content creation and editing, and previously produced content, and a developer who will create VR content loads a previously developed 3D object. The background object and variable objects stored in the content storage unit 11 and the basic element providing unit 12 providing basic elements related to the previously produced content so that they can be properly arranged and given animation, and the basic element providing unit ( 12), and a content DB exclusive UI module 13 that manages a content database exclusive UI for supporting fast loading of 3D objects and convenient storage and loading of VR content being edited.

The system supporting the production and editing of contents using HCI for improving interpersonal relations according to the present invention enables a developer who will create VR contents to load a previously developed 3D object, properly place it, and give an animation. The VR content developed in this way reproduces the user's past scenes like a video or movie.

That is, the more 3D objects developed and stored in advance, the more diverse VR contents that can be created. Therefore, there are several categories of 3D objects, and each category includes a number of 3D objects.

Human objects are also divided into male/female and created by age. Furniture is also made for each type, and there is a need to create and store a wide variety of background locations.

These objects are loaded and applied to the storytelling-based content editing module 30, and must be resaved as an object of a different type according to the changed content through detailed adjustment of the object. Not only objects but also VR content itself can be stored in a form including ID, coordinates, applied action (animation), and animation retention time of each object, which is also processed by the content database and UI module 10.

In addition, the content database and UI module 10 includes a content DB-dedicated UI module 13 that manages a content database-only UI for fast loading of 3D objects and convenient storage and loading of VR content being edited.

The UI module 13 for exclusive use of the content DB includes a function to display 3D objects stored so far in a tree form by category, and a function to load and view only each object separately, and in the case of VR contents, the creation date and title are captioned. It includes and supports the function to partially play the content as needed.

In addition, the detailed configuration of the object conversion application module 20 is as follows.

As shown in FIG. 3, a 3D object file format read unit 21 for reading background objects and variable objects used for content creation and editing stored in a content database and UI module 10, and formats of previously produced contents, 3D object file format Coordinates that analyze the coordinate system configuration of background objects and variable objects read from the read unit 21, and the coordinate system of previously produced contents, and convert them into a coordinate system that can be linked with Unity so that they can be used for storytelling-based content editing. It includes a conversion unit 22 and a vertex conversion unit 23 that analyzes differences in the way of expressing vertices of background objects, variable objects, and previously produced contents, and converts them so that they can be accurately ported into Unity. .

A system supporting the production and editing of contents using HCI for improving interpersonal relations according to the present invention must be able to create contents that can recall past scenes.

At this time, several types of 3D objects are required, and these objects must be created in a format usable in a VR graphic tool called Unity, and have a coordinate system that can be linked with Unity.

3D objects can be created with various tools, but each tool has different file formats and coordinate systems, so 3D objects developed from these tools are directly transferred to a system that supports content creation and editing using the UI according to the present invention based on Unity. It is quite difficult to apply.

Accordingly, the system supporting the production and editing of content using the UI according to the present invention is provided with the object conversion application module 20 to solve this.

The common point of tools that can develop 3D objects is that they have a three-dimensional coordinate system and that they are composed of objects centered on vertices.

In consideration of such matters, the object conversion application module 20 is implemented to analyze and convert the coordinate system configuration and point handling method of 3D objects centering on 3D Max, Maya, and CAD3d.

The object conversion application module 20 reads three types of file formats created with three tools, 3D Max, Maya, and CAD3d, for example, and allows the coordinate system of the tool and Unity (the creation and editing of contents using the UI according to the present invention). It plays a role of converting the difference in coordinate system used in the supported system) and also converting the difference in the way points are represented, and accurately porting it into Unity.

The present invention makes it possible to utilize objects developed in various 3D object creation tools through the object conversion application module 20, and to secure convenience and diversity of object development.

And a detailed configuration of the storytelling-based content editing module 30 will be described as follows.

The storytelling-based content editing module 30 is a module that enables a person object, a background object, and a voice to be elaborately arranged using the input user's past situation (memory, statement, and other information). It is editing VR contents to be played in the form of simulation of past situations.

The storytelling-based content editing module 30 creates and edits VR content to be played back in the form of a simulation of a past situation based on the input user's story information, and an object created with an external tool is a unique object ID in Unity. Viewer module (30a), which composes an editing screen that can be created and then placed and edited, and for setting timing and length of connecting general actions and voices or taking objects. It includes a scheduler (Scheduler) module (30b).

The viewer module 30a and the scheduler module 30b play the most important role for the function as an editor, and VR content created in the storytelling-based content editing module 30 is the content control module 40 ) To the scene rendering module 50 and reproduced.

The user's story information is input in the form of a script, and this story information is used by the VR content creator using the viewer module 30a and the scheduler module 30b of the storytelling-based content editing module 30. It is input in a form that reproduces the situation.

It can be used in a form similar to various graphic creation tools, but it is entered in a form in which 　 scripted 　 story information is listed based on the time axis.

The viewer module 30a is used to arrange and adjust various 3D objects appearing in the story information, and the scheduler module 30b determines the temporal order and maintenance time of the behavior (animation) of the 3D objects arranged in this way.

An input signal processing means for processing input signals input during the storytelling-based content editing process through the viewer module 30a and the scheduler module 30b may be further provided.

The detailed configuration of the viewer module of the storytelling-based content editing module is as follows.

4 is a detailed configuration diagram of a viewer module of a storytelling-based content editing module.

As shown in FIG. 4, the viewer module 30a stores all objects, actions, and object instances including animations for background objects and creates an inventory for sending them to a slot. Editing of an inventory generation module 31, an object creation module 32 that is implemented in a slot-only script file and creates an object by performing each function on the inputs input to the slot by the user, and the VR content editor tool It includes an item placement module 33 that serves to place objects on the screen.

The inventory generated by the inventory generation module 31 is a storage for storing object instances including all objects, actions, and animations for background objects and sending them to slots.

To create an inventory, you must first create an item and connect it.

An item consists of the item name, item 3d (object), and item 2d (picture).

Slot creation consists of the following process.

5 is a block diagram showing a process of creating a slot after building an item list of an inventory generation module, and FIG. 6 is a block diagram showing a process from generating an inventory to creating a slot.

The inventory script function fetches the list of items created by the Item Databases script.

In Unity, you can specify the x and y number of slots, the size of the slot, and the size of the blanks that make up the inventory.

Based on the imported item list, the inventory executes a double for statement to create a slot to be displayed in the editing window.

It designates the location of the created slot according to the size of the designated slot and the amount of space, and one item is entered for each slot based on the item list.

In addition, item 3d object information and name are entered in the slot, and item 2d is used as UI.

And the object creation process in the object creation module 32 will be described in detail as follows.

7 is a block diagram showing an object creation process in the object creation module 32 of the viewer module.

Object creation in the object creation module 32 is implemented in a script file exclusively for slots, and an object is created by performing each function on inputs input to this slot.

It is implemented through a UI that reacts differently depending on mouse focusing, clicking, and wheel rotation.

For example, when the mouse is clicked while being placed on the slot of the editing screen, an object is created at that location using the location information of the mouse.

That is, the 3D object in the item list is made to exist on the actual screen.

In addition, the item placement module (ItemSetUI) 33 will be described in detail as follows.

FIG. 8 is a block diagram showing a process before an ItemSetUI script is operated in an item placement module of a viewer module, and FIG. 9 is a block diagram showing a process of an ItemSetUI operation.

The item placement module 33 plays a role of arranging objects on the editing screen of the VR content editor tool. When a mouse is placed on an object created on the screen or an object is clicked, the toggle change script and the outline setting script are interlocked with each other. It changes the color of the outline of the object and informs that the user can interact with this object.

8 shows the operation process before the item placement module 33 is started. In the script of the item placement module 33, information on the item clicked while creating the VR content is stored, and through these functions, the VR content You can manipulate various items (objects) that will compose.

9 shows the operation process of ItemSetUI. When a mouse is placed on an object created on the screen or an object is clicked, the toggle change script and the outline setting script are interlocked with each other, and the position selected by resetting coordinates by the'Replace' command signal To place an object in, delete the selected object by the'Delete' command signal, reset the size of the object by the'SizeControl' command signal, save the animation information selected by the'ActionInsert' command signal, or'Takes 'Including the operation of selecting a Take folder by a command signal and performing voice selection.

In addition, the detailed configuration of the scheduler module 30b of the storytelling-based content editing module 30 is as follows.

10A and 10B are a detailed configuration diagram of a scheduler module of a storytelling-based content editing module and a configuration diagram of an item view.

The scheduler module 30b is a module for connecting a general action and a voice or setting a timing and setting a length for taking an object.

The scheduler module 30b includes a panel event processing unit 34 that processes information on input Actions and Takes, item deletion, cursor movement control (Cursor Move), content playback (Play), and content playback stop. A user event processing unit 35 that processes information about (Stop), a data processing unit 36 that sets cursor position information as an initial position when a specific content is first created in the scheduler and creates an Item Dictionary, and a cursor position. It includes a cursor position calculation unit 38 that calculates, a stop watch 39 that sets timing, and a UI management unit 37 that supports a scheduler view under control of a view resolution controller. .

When a specific content is first created in the scheduler module 30b, cursor position information is set as an initial position and an Item Dictionary is created. Item Dictionary integrates and manages Action and Take into one Item so that Action and Take management can be processed at once without separating them.

In addition, a ListView is created and the Timer is initialized by setting the time to 0 seconds, and the playback start time of VR content is set to 0 seconds, and the action (animation) times of the remaining objects can be calculated relatively.

When information on Action and Take is input in the panel event processing unit 34, they are added to the Item Dictionary by combining them into Items, and creating and adding Item View.

Item View is in the form of a bar and includes a name, a delete button, and a time information bar.

Here, the Item View is largely composed of an Item Summary (item summary) and an Item Time Bar (item execution time information), as shown in FIG. 10B.

The item summary is established when the item is initially created.

Item execution time information changes according to the size and position of the animation bar. The item execution time information refers to the animation duration time for the item, and the time can be set by adjusting the size as desired in the UI part of the scheduler module.

In addition, the detailed configuration of the content control module 40 is as follows.

11A and 11B are diagrams illustrating a detailed configuration diagram and a state transition diagram of a content control module.

As shown in FIG. 11A, the content control module 40 includes a state transition diagram providing unit 41 and a state transition diagram providing unit 41 for implementing animation of VR content to be produced as a flow chart or a state transition diagram. ), by using the state transition diagram provided in Unity to play according to the passage of time in Unity, and an animation operation execution unit 42 to generate VR content that reproduces the user's past viewpoint as it is.

In order to express specific movements tailored to the user's storytelling, basic movements are created in advance as animations in tools that can create 3D objects (ex. 3D MAX, Maya, etc.).

Thereafter, in the storytelling-based content editing module 30, various animations are created by connecting basic motions of objects.

At this time, the API in Unity called Mecanim is used.

In an embodiment of the present invention, a mecanim is used, and a UI having a state transition diagram is included so that the VR content creator can conveniently use it.

By using a state transition diagram including such a UI, objects in the content can be controlled precisely and accurately.

That is, it is possible to implement the animation of the VR content to be produced as a flow chart or a state transition diagram, and play it in Unity according to the time flow, thereby creating VR content that reproduces the user's past viewpoint as it is.

In addition, a detailed description of the scene rendering module 50 according to the present invention is as follows.

In the system that supports the production and editing of content using HCI for improving interpersonal relations according to the present invention, not only does not just play VR content created in Unity, it is necessary to see the reproduction of the past point of view to improve interpersonal relations. You should be able to play a certain point repeatedly.

Therefore, the scene rendering module 50 has a UI for a user for repetitive experience and renders it so that the playback speed of the VR content can be adjusted and section repetitive replay can be performed.

And the interaction module 60 will be described in detail as follows.

The interaction module 60 includes an editing interaction module 60a that allows a developer creating VR content to place various VR objects during editing and make detailed adjustments while experiencing them in a VR device, and an editing interaction module 60a for experiencing VR content. It includes a user interaction module 60b for allowing a user to interact with an object in the content, an HMD for providing VR content to the user, and a content providing means 60c including a display device.

The editing interaction module 60a enables detailed movement and control of objects included while playing VR content, thereby creating VR content that reproduces more sophisticated past situations, or making necessary object modifications immediately whenever there is a requirement. To be.

The user interaction module 60b performs a function of allowing a user experiencing VR content to interact with an object in the content.

A function of moving another object through the user interaction module 60b is implemented by using a large increase in immersion when another object is moved during VR content experience.

The interaction module 60 performs the user's face tracking to track the facial expression, collects the types of emotions from the facial expressions, and accordingly performs an interaction function between the user and the VR human object in which the facial expression of the human object in the VR content reacts. Perform.

To this end, the system supporting the production and editing of content using HCI for improving interpersonal relations according to the present invention may further include an imaging device for face tracking of a user and a user face recognition means.

In addition, the detailed configuration of the evaluation and feedback system 70 is as follows.

12 is a detailed configuration diagram of an evaluation and feedback system.

The evaluation and feedback system 70 includes a demonstration count collection unit 71 that collects VR content experience count (number of times played) information for evaluation based on numerical and statistical information, and a repeat section history that collects repetition section playback history information. The collection unit 72, the number of generated contents information collection unit 73 that collects information on the number of VR contents generated per individual, the number of experiences of the collected VR contents (the number of times played), the repetition section playback history, the individual Statistics and visualization processing unit 74 that performs statistical processing of information on the number of VR contents generated per unit and visualizes and outputs the result, and plays content that can become trauma by accumulating and statisticalizing the user's content use history A cumulative result AI that provides information that allows you to know the influence or trend on improving interpersonal relationships by accumulating the results output from the content playback restriction unit 75 and the statistics and visualization processing unit 74 to limit It includes an analysis unit 76.

Here, the content reproduction limiting unit 75 accumulates and statisticalizes the user's past experience and the history of using the system that supports the production and editing of contents using HCI for improving interpersonal relations according to the present invention, which can become a trauma. Restricting the playback of content.

This does not use human judgment, but automatically limits the case in which a large number of extreme words are included in the script for writing the content story to the primary non-playable content, and the user's eye movement and reaction during VR content experience. It is accumulated and scored, and content that exceeds the threshold score is restricted from repeatedly playing.

This restriction of content reproduction is intended to prevent the content for improving interpersonal relationships from adversely affecting the user.

In addition, the method of supporting the production and editing of content using HCI for improving interpersonal relations according to the present invention is largely analyzed and transformed by analyzing and converting the coordinate system configuration and vertex of the content components stored and provided in the content database and UI module. An object transformation application step in which this can be used for storytelling-based content editing, and a simulation form for a past situation based on the story information input using the content components provided through the object transformation application step The storytelling-based content editing step that supports the production and editing of VR content to be played back, and the VR content created and edited in the storytelling-based content editing step are played in Unity according to the time flow, and the user's past view The content control step of controlling to create VR content that reproduces as it is, adjusting the playback speed for a specific point of the VR content, and rendering the scene so that section repetition is possible, and the included while playing the VR content. It includes an interaction step of allowing detailed movement control and object modification of objects, and allowing users experiencing VR content to interact with objects in the content.

The system and method for supporting the production and editing of content using HCI for improving interpersonal relations according to the present invention described above is to enable story setting and change by controlling interaction while placing objects in a desired position and assigning animations. I did it.

The present invention allows flexible editing and production of content by reflecting all stories of a template story and a user (content creator, professional counselor, counselor) and can be used in various fields, and in particular, the past experience of the user. It is to create content exclusively for improving interpersonal relationships by using objects necessary to reproduce, and to have a function as a content editor used for relationship improvement.

As described above, it will be understood that the present invention is implemented in a modified form without departing from the essential characteristics of the present invention.

Therefore, the specified embodiments should be considered from a descriptive point of view rather than a limiting point of view, and the scope of the present invention is shown in the claims rather than the above description, and all differences within the scope equivalent thereto are included in the present invention. It will have to be interpreted.

10. Content database and UI module
20. Object conversion application module
30. Storytelling-based content editing module
40. Content Control Module
50. Scene Rendering Module
60. Interaction Module
70. Evaluation and Feedback System

Claims (23)

Background objects and variable objects used for content creation and editing stored in the content database and UI module, and a 3D object file format lead section that reads the format of previously produced content, and a background object read from the 3D object file format lead section. A coordinate conversion unit that analyzes the coordinate system composition of variable objects and previously produced contents and converts it into a coordinate system that can be linked with Unity so that it can be used for storytelling-based content editing, background objects and variable objects, and previously produced contents An object conversion application module including a vertex conversion unit that analyzes a difference in a method of expressing vertices of the fields and converts them so that they can be accurately ported into Unity;
A storytelling-based content editing module that supports creating and editing VR content to be played in a simulation form for a past situation based on story information input using content components provided through the object conversion application module;
A content control module for controlling the VR content produced and edited by the storytelling-based content editing module to be reproduced in Unity according to a time flow to generate VR content that reproduces the user's past viewpoint as it is;
A scene rendering module for rendering to enable playback speed adjustment and section replay of a specific point of VR content;
Interpersonal, comprising: an interaction module that enables detailed movement control and object modification of objects included while playing VR content, and enables a user experiencing VR content to interact with objects in the content; A system that supports content creation and editing using HCI for relationship improvement. The method of claim 1, wherein evaluation and analysis centered on numerical and statistical information such as the number of VR content experiences, repetition section playback history, and the number of VR content generated per individual are performed,
Content creation and editing using HCI for improving interpersonal relationships, characterized in that it further includes an evaluation and feedback system that limits the reproduction of traumatic content by accumulating and statisticalizing the user's past experience and content use history Systems that support it. The method of claim 1, wherein the content database and UI module,
It has a content database exclusive UI for loading 3D objects and saving and loading VR content being edited,
Background objects and variable objects used for content creation and editing, and content components including previously produced content are stored, and the stored content components are provided to a storytelling-based content editing module through an object conversion application module. A system that supports the creation and editing of content using HCI to improve interpersonal relationships. The method of claim 3, wherein the content database and UI module,
A content storage unit that stores background objects and variable objects used for content creation and editing, and previously produced content,
A basic element providing unit that provides basic elements for the background objects and variable objects stored in the content storage unit and the previously produced contents when creating VR contents;
Content using HCI for improving interpersonal relations, characterized in that it includes a UI module exclusively for content DB that manages a content database exclusive UI for supporting loading of 3D objects and storage and loading of VR content being edited through the basic element providing unit A system that supports production and editing. The method of claim 1, wherein the object and VR content changed by the storytelling-based content editing module are stored again in a content database and a UI module,
Creation and editing of content using HCI for improving interpersonal relationships, characterized in that objects and VR content stored in the content database and UI module are stored in a form including the ID, coordinates, applied animation, and animation retention time of each object Systems that support it. The method of claim 4, wherein the content DB dedicated UI module,
3D objects stored so far are displayed in a tree form by category, and only each object can be separately loaded and viewed. In the case of VR contents, the creation date and title are included as captions, and the contents are displayed as needed. A system that supports content creation and editing using HCI for improving interpersonal relationships, characterized in that it supports a function that can be partially played. delete The method of claim 1, wherein the storytelling-based content editing module,
A viewer module that creates an object created with an external tool with a unique object ID in Unity and configures the editing screen to place and edit the object afterwards,
It supports the creation and editing of content using HCI for improving interpersonal relations, characterized by including a scheduler module for setting timing and length setting for connecting general actions and voices or taking objects. System. The method of claim 8, wherein the viewer module,
An inventory creation module that creates an inventory to store all objects, actions, and object instances including animations for background objects and send them to slots,
An object creation module that is implemented in a slot-only script file and creates an object by executing each function for inputs input to the slot;
A system that supports content creation and editing using HCI for improving interpersonal relationships, comprising: an item placement module that arranges objects on the editing screen of a VR content editor tool. The method of claim 8, wherein the scheduler module,
A panel event processing unit that processes information about input Action and Take,
A user event processing unit that processes information on item deletion, cursor movement control, content playback (Play), and content playback stop (Stop),
A data processing unit that sets the cursor position information as the initial position when a specific content is first created in the scheduler and creates an Item Dictionary;
A cursor position calculator that calculates the cursor position;
Stop Watch to set the timing,
A system supporting content creation and editing using HCI for improving interpersonal relationships, comprising: a UI management unit supporting a scheduler view under the control of a view controller (View Resolution Controller). The method of claim 1, wherein the content control module,
A state transition diagram providing unit that implements the animation of VR content to be produced as a flow chart or state transition diagram,
Interpersonal, characterized in that it includes an animation operation performing unit that enables creation of VR content that reproduces the user's past viewpoint as it is by playing it in Unity according to the time flow using the state transition diagram provided by the state transition diagram providing unit. A system that supports content creation and editing using HCI for relationship improvement. The method of claim 1, wherein the interaction module,
An editing interaction module for placing VR objects and making detailed adjustments when an object placement request signal for placing various VR objects and a signal for detailed adjustment are input during editing of creating VR content;
A user interaction module that performs an interaction function between a user and a VR human object that tracks the facial expression by performing the user's face tracking, collects the types of emotions from the facial expression, and reacts the facial expression of the human object in the VR content accordingly. and,
A system supporting content creation and editing using HCI for improving interpersonal relations, comprising: an HMD for providing VR content to a user and a content providing means including a display device. The method of claim 2, wherein the evaluation and feedback system,
A demonstration count collection unit that collects VR content experience count information for evaluation based on numerical and statistical information,
A repetition section history collection unit that collects repetition section reproduction history information,
A generated content number information collection unit that collects information on the number of VR content generated per individual;
Statistics and visualization processing unit that performs statistical processing of information on the number of experiences of collected VR content, the history of repetitive section playback, and the number of VR content generated per individual, and visualizes and outputs the result;
A content playback limiting unit that limits the playback of content that may become trauma by accumulating and statisticalizing the user's content usage history;
HCI for improving interpersonal relations, characterized in that it comprises a cumulative result AI analysis unit that accumulates the results output from the statistics and visualization processing unit and performs AI analysis to provide information that can know the influence or trend affecting the improvement of interpersonal relationships. A system that supports the production and editing of contents using. The method of claim 2 or 13, wherein the evaluation and feedback system restricts playback of content that may become trauma,
Automatically limiting the case where many words that can be trauma are included in the script for writing the content story to the primary non-playable content,
It supports the creation and editing of contents using HCI for improving interpersonal relations, characterized in that the user's pupil movements and reactions are accumulated and scored while experiencing VR contents, and content that exceeds the threshold score is restricted from repeatedly playing. system. Background objects and variable objects used for content creation and editing stored in the content database and UI module, and the 3D object file format read step that reads the format of the previously produced content, and the background object read from the 3D object file format read step. The coordinate conversion step of analyzing the coordinate system composition of variable objects and previously produced contents and converting them into a coordinate system that can be linked with Unity so that it can be used for storytelling-based content editing, background objects and variable objects, and previously produced contents An object transformation application step including a vertex transformation step of analyzing a difference in a manner of expressing vertices of the fields and transforming them so that they can be accurately ported into Unity;
A storytelling-based content editing step of supporting creation and editing of VR content to be played in a simulation form for a past situation based on story information input using content components provided through the object conversion application step;
A content control step of controlling the VR content produced and edited in the storytelling-based content editing step to generate VR content that reproduces the user's past viewpoint as it is by playing back the VR content produced and edited in Unity according to a time flow;
A scene rendering step of rendering to enable playback speed adjustment for a specific point of VR content and section repetition;
Interpersonal, comprising: an interaction step of allowing a user experiencing VR content to interact with objects in the content, allowing detailed movement control and object modification of objects included while playing VR content; A method of supporting content creation and editing using HCI for relationship improvement. delete The method of claim 15, wherein the storytelling-based content editing step,
Creating an object created with an external tool with a unique object ID in Unity, and configuring an editing screen for placing and editing the object afterwards,
A method of supporting content creation and editing using HCI for improving interpersonal relationships, comprising steps for setting timing and length setting of connecting a general action with a voice or taking an object. The method of claim 17, wherein configuring the editing screen comprises:
An inventory creation step of creating an inventory for storing all objects, actions, and object instances containing animations for background objects and sending them to the slot;
An object creation step of creating an object by executing each function for inputs that are implemented in a slot-only script file and input to the slot, and
A method of supporting content creation and editing using HCI for improving interpersonal relations, comprising the step of placing an item on an editing screen of a VR content editor tool. The method of claim 18, wherein in the inventory generation step,
To create an item consisting of the item name, item 3d (object), and item 2d (picture) first, and to create a slot,
The step of fetching the item list created in the Item Databases script to obtain the inventory script function,
Steps to specify the x number and y number of slots, the size of slots, and the size of blanks that make up the inventory within Unity,
Based on the imported item list, the inventory includes the step of creating a slot to be displayed in the editing window by executing a double for statement,
Designate the location of the created slot according to the size of the specified slot and the size of the blank, and make sure that one item is entered for each slot based on the item list,
A method of supporting content creation and editing using HCI for improving interpersonal relationships, characterized in that item 3d object information and name are entered in a slot and item 2d is used as a UI. The method of claim 18, wherein the object creation in the object creation step,
It is implemented through a UI that reacts differently according to mouse focusing, clicking, and wheel rotation, and when the mouse is clicked while coming to the slot of the editing screen, the 3D object in the item list is created by using the location information of the mouse to create an object at that location. A method of supporting the production and editing of contents using HCI for improving interpersonal relationships, characterized in that the is made to exist on the actual screen. The method of claim 18, through the ItemSetUI in the item placement step,
When the mouse is placed on an object created on the screen or when an object is clicked, the toggle change script and the outline setting script are linked to each other to change the outline color of the object and inform that the user can interact with this object.
In the script, information on the clicked item while creating VR content is stored, and through these functions, the items that constitute the VR content are manipulated to support the creation and editing of content using HCI to improve interpersonal relationships. How to. The method of claim 21, wherein when a mouse is placed on an object created on the screen or an object is clicked, the toggle change script and the outline setting script are interlocked with each other,
Position the object at the position selected by resetting coordinates by the'Replace' command signal, delete the object selected by the'Delete' command signal, reset the size of the object by the'SizeControl' command signal, or the'ActionInsert' command A method of supporting content creation and editing using HCI for improving interpersonal relationships, characterized in that animation information selected by a signal is stored or a Take folder is selected by a'Takes' command signal to perform voice selection. The method of claim 17, wherein in the step of connecting a general action and a voice or setting a timing and setting a length of a take,
When a specific content is first created in the scheduler module, the cursor position information is set as the initial position and an Item Dictionary is created,
Item Dictionary supports the creation and editing of content using HCI for improving interpersonal relationships, characterized in that Action and Take are integrated and managed as a single item so that Action and Take management can be processed at once without separating them. How to.

Images