KR20170130869A - System for providing the interactive media and method thereof - Google Patents

Abstract

The present invention relates to a system and a method for providing interactive media. The system for providing interactive media according to an embodiment of the present invention comprises: an interactive media producing platform for producing media by using a scenario inputted from the outside, and inserting at least one interactive function with regard to the scenario into the media to produce interactive media; a server for storing the interactive media and meta data for the interactive function; a smart device for receiving an interactive function selected and inputted by a user; and an interactive player for playing the interactive media and providing an interactive function corresponding to selected information when the selected information on the interactive function is received from the smart device while the interactive media is being played.

Description

TECHNICAL FIELD The present invention relates to an interactive media providing system and a method of operating the same,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an interactive media technology, and more particularly, to a system and an operation method for creating and providing an image based on an interaction function between a user and a media.

Personalization due to the proliferation of smart devices As personalized content becomes popular, individuals produce their own contents. The produced video contents are shared on the web through video services such as 'YouTube' and 'Vimeo'. These video services are more accessible to more than a billion people, with millions of hours of video viewing and billions of views each day, thanks to the easy accessibility of 'YouTube' as if they were on TV.

Today, the media environment is changing to the so-called 'convergence phenomenon' in which individual media that existed independently from each other converge and fuse due to the emergence of computers and the Internet based on digital technologies. The phenomenon of media convergence has been developed as the production and dissemination of images (interactive media, interactive media) based on interaction between various types of users and media.

Convergence phenomenon of media refers to a product or service based on a digital computer system in which contents such as text, movies, music, games, and animations respond to user's actions. This includes augmented reality, interaction between a human and a computer, There is a close relationship with the miner.

More specifically, for example, by combining a website with a video game, a user can talk to each user while playing a video game through a social networking website, and share a game record. In addition, studies related to interactive media, such as a system that interacts with augmented reality contents through TV set-top boxes and smart devices, and an ad content that interacts with product information with viewers called rich media, have been conducted from the past.

As described above, the image produced in the interactive media production environment operates according to the user's actions and responses by using various sensors such as user's motion, voice recognition, and touch. However, the existing interactive media has a limited range of contents, and there are restrictions on the environment in which the sensors for recognizing the user's actions and voices are installed separately or in a specific device.

An object of the present invention is to provide a hybrid web-app based interactive media providing system and method capable of interacting with image contents and users in accordance with user's preferences in a personalized image content and one-media era .

According to an aspect of the present invention, there is provided an interactive media providing system for creating media using a scenario input from the outside, inserting at least one interactive function for the scenario into the media, An interactive media production platform for generating interactive media, a server for storing the interactive media and metadata for the interactive functions, a smart device for selectively receiving an interactive function from a user, and a player for playing the interactive media, And an interactive player for providing the interactive function corresponding to the received selection information when the selection information of the interactive function is received from the smart device.

According to an embodiment of the present invention, a user-customized interactive media capable of developing a variety of stories from one story to another can be provided not only in a specific environment composed of various sensors but also in a web and a user's smart device, It is possible to produce various interactive media according to the user's preference without having to build a specific environment that uses expensive equipment only by the story production ability of the image creator.

1 is a block diagram of an interactive media providing system according to an embodiment of the present invention;
2 is a reference diagram for explaining a process of producing an interactive medium according to an embodiment of the present invention;
3 is a diagram illustrating a service configuration of an interactive media production platform according to an embodiment of the present invention;
4 is a diagram illustrating an interactive functional response through a smart device of a user according to an embodiment of the present invention.
FIG. 5 is a detailed diagram illustrating communication between an interactive player and a smart device according to an embodiment of the present invention; FIG.
FIG. 6 is a diagram illustrating states of objects, arrays, and values represented in a JSON official homepage according to an embodiment of the present invention; FIG.
7 is a diagram illustrating a screen configuration of an interactive player executed in a web browser according to an embodiment of the present invention;
8 is a view illustrating a recording screen for confirming communication with a web socket server according to an embodiment of the present invention;
9 is a diagram illustrating an execution screen of an interactive function in a smart device according to an embodiment of the present invention;

BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. And is provided to fully convey the scope of the invention to those skilled in the art, and the present invention is defined by the claims. It is to be understood that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification. It is noted that " comprises, " or "comprising," as used herein, means the presence or absence of one or more other components, steps, operations, and / Do not exclude the addition.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals are given to the same or similar components, and in the following description of the present invention, Detailed explanations of the detailed description will be omitted when the gist of the present invention can be obscured.

1 is a block diagram of an interactive media providing system according to an embodiment of the present invention.

1, an interactive media providing system according to an embodiment of the present invention includes a web browser 100 including a interactive media production platform 110 and an interactive player 120, a web server 210, And a server 200 including a server 220 and a smart device 300.

When the user logs in through the web server 210 in the web browser 100 and the smart device 300, the interactive player 120 transmits an ID value The data transmitted from the web socket server 220 is received and received.

The interactive media production platform 110 performs media production using the scenario input by the image creator and inserts an interactive function suitable for the scenario, and then generates content of the interactive function as metadata. The metadata about the interactive function is stored as an interactive medium together with the media created in the database 230 of the server 200 through the web server 210. [ Here, the interactive media is a screen for the user to change the story of the image by selecting the story of the image or to provide a feeling that the event of the image can be shared by the user.

The interactive media stored in the server 200 is transmitted to the interactive player 120 at the request of the user through the web browser, and the user can view the interactive media played through the interactive player 120. The interactive player 120 includes a metadata parser 121 for analyzing metadata and an interaction handler for interacting with the smart device 300 through the web socket server 220 through the metadata analysis result 123).

When the interactive media is played back, the user's smart device 300 operates according to the story of the video played in the interactive player 120, and the application that can respond to the interactive function is operated. Thus, the user can enjoy the interactive media. To this end, the smart device 300 includes a metadata parser 301 for analyzing metadata received through the web socket server 220, and an interaction unit for interacting with the interactive player 120 through the web socket server 220. [ A download manager 305 for downloading resources necessary for the download, and an interaction handler 303.

The interactive media production platform 110 can produce an image using a scenario according to the operation of the image creator, and insert an interactive function suitable for the scenario. To this end, the interactive media production platform 110 may include an image authoring tool 111 and an interactive authoring tool 113.

Hereinafter, a process for producing an interactive medium according to an embodiment of the present invention will be described with reference to FIG.

First, when scenario-based scenarios are input by an input operation of a video creator, the interactive media production platform 110 accesses a web browser to search for image content on the web.

Accordingly, the image creator can create a new image by editing the searched image. For example, when an arbitrary image is selected by the image creator among the searched images. Place the video on the storyboard, edit it, and play it.

For example, the interactive media production platform 110 edits (203) the content to be selected by the user according to the IF, ELSE IF, and GOTO control commands 202 selected by the image creator in each scene of the storyboard 201, Produce the story of the story that changes according to the choice. Accordingly, the user is provided with the function of viewing the selection screen 204 for determining the direction of the story during the image viewing and selecting and viewing the image of the story desired by the user.

In addition, the interactive media production platform 110 can use the interactive authoring tool 113 to insert an interactive function (interactive function) with the user into the image according to the creator's intention according to the manipulation of the image creator. For example, the image creator can add various interactive functions to provide sharing and participation of the user in the story progressed through the image 205. When the interactive function is selected, the interactive media production platform 110 sets the start time and the end time of the interactive function, and sets the detailed function of the interactive function. Here, the interactive function may be a telephone function, a text message function, Morse code function 206, 207, or the like.

Through this process, interactive media can be produced and provided with the ability to interact with users' smart devices and enjoy various interactive media.

Meanwhile, for this operation, the interactive media production platform 110 may include a configuration as shown in FIG. For example, the interactive media production platform 110 communicates with a single physical server through a REST service, and logically includes a web server, a project management REST service, a TTS conversion REST service, a content management REST service, an OpenAPI REST service.

The Main-website 111_1 provides the UI of the Web browser, and the REST service (Node-rest service) 111_2 manages the video creation project data and processes the video project inquiry, modification, and storage. The TTS-converted REST service (TTS-rest-service) 111_3 performs a function of requesting the speech recognition (TTS) server to convert text to speech, and the content management REST service (cms-rest-service) 111_4 It manages the contents necessary for video creation and processes the contents inquiry, upload, modification and so on. The OpenAPI REST service (opendata-rest-service) 111_5 handles the existing OpenAPI interworking function for interworking with the OpenAPI among the interactive functions.

Then, the user selects an interactive media to be viewed through the smart device 300, and the interactive player 120 confirms whether the user's smart device 300 is registered from the server 200 in order to reproduce the image . If not registered, the process of registering the smart device 300 and installing a dedicated app may be performed. If the selection of the interactive function is received through the smart device 300 of the user installed with the dedicated app while the interactive media is played and viewed using the interactive player 120 in the web environment such as PC or IPTV, May communicate with the smart device 300 of the user through the web socket server 220 of the server 200 in real time to provide an interaction function between the user and the media.

Accordingly, the user's smart device 300 can receive the operation message of the corresponding image from the web socket server 220 and operate the interactive function. The user selects and interacts with the interactive function, You can appreciate it.

At this time, as shown in FIG. 4, the interactive operation is a bidirectional scheme or a unidirectional scheme. In the bidirectional method, when the user selects the answer requested by the web socket server 220, the result is reflected in the interactive player 120, and a branch of the story such as IF, ELSE IF, or GOTO is designated, The contents can be reflected. The unidirectional method can be used for unilaterally operating the smart device 300 such as a text message or a Morse code.

FIG. 5 is a detailed structural diagram of communication between an interactive player and a smart device according to an embodiment of the present invention, and shows a process of transmitting metadata for interaction.

When the user selects an interactive medium to be viewed, the interactive player 120 requests metadata of the corresponding media from the web server 210 of the server 200 and parses the metadata. The interactive handler 123 of the interactive player 120 transmits the corresponding resource to the smart device 300 through the web socket server 220. [ And the like. The metadata parser 121 of the smart device 300 requests the resource file via the download manager 305 to the web server 210 in the HTTP manner and downloads the resource before the media is reproduced.

In addition to the parsed data, the interactive player 120 operates the interactive function corresponding to the time designated by the media creator through the interactive handler 123, and transmits the interaction metadata to the smart device 300 . The smart device 300 parses the interaction metadata transmitted at the designated time in the interactive player 120 and operates the interactive metadata through the interactive handler 303. The smart device 300 uses the various sensors to transmit the user's response to the interactive player 120

Meanwhile, as in the embodiment of the present invention, separate metadata is required to specify settings for interactive functions in a general media file without special equipment or encoding. The metadata includes the execution time of the interactive function and the respective setting information. The metadata language is created in the form of JavaScript Object Notation (JSON), an object format created in JavaScript format. JSON is one of the languages that describe the structure of data. A similar example is XML (eXtensible Markup Language).

The interactive media providing system according to an embodiment of the present invention is a system capable of interacting with the smart device 300 in a web environment and can be continuously added if there is an idea of a new interactive function. The form of the metadata also provides a large framework, and the details of the configuration should be a structure that can be specified by the developer developing the interactive function. So, we chose JSON, which is more manageable in the web environment because it has a much simpler structure than XML and is a subset of JavaScript object notation. JSON is based on two structures: a collection of name / value pairs, and an ordered list of values. Collection types are usually implemented in programming languages such as object, record, struct, dictionary, hash table, list with key, associative array, etc. Ordered lists of values are array, vector and list.

According to the embodiment of the present invention, an object and an array are used, and the metadata of the interactive media includes an object containing each interaction setting in one large array. The contents of the object are defined based on 'mode', which is the name of the interaction, and 'time', which means the start time of the interaction.

FIG. 6 is a state diagram of object, array, and value represented in the JSON official homepage. The object is an unordered SET of name / value pairs and starts with '{' and ends with '}' : '(colon), and separates name / value pairs with', '(comma). An array begins with '[', ends with ']', and separates array values with ',' (comma). The value in array can be string, number, true, false, null, object, or array.

Here, the first object in an array of '[', 'and'] is the phone number and the name, voice, and profile picture that are assigned to the smart device at a certain time, and the second object can be applied to the advertisement media. This is the metadata that pops up the Notification Notification with the address that can connect to the website related to the desired message and advertisement at the specific time on the smart device.

As described above, the web-based interactive media providing system according to the embodiment of the present invention is made of HTML5 and JavaScript, and the back-end uses Apache and PHP. The database stored in the server 200 is MySQL.

At this time, the interactive media production platform 110 executed by the web browser provides an editing function for selecting the image development according to the user's reaction in the screen for interactive media production. At this time, video creation is defined as one project, and it provides movie editing function of storyboard form, and it is possible to edit video length, apply effects, and input interactive functions. Interactive functions, such as telephone, video story selection, and push messages, are created in JSON format and stored in the database along with the original video.

In addition, the screen configuration of the interactive player 120 executed in the web browser according to the embodiment of the present invention may be composed of a player, a server, an interactive connection status, and a video list as shown in FIG. The interactive player 120 parses the interactive connection state and metadata before the moving picture is reproduced, and applies it to the interactive handler. At the time it is stored in the metadata, it attempts to interact with the smart device through the interactive handler and responds to the command to return.

When the interactive player 120 is executed, the interactive player 120 can communicate with the smart device 300 while accessing the web socket server 220. As shown in FIG. 8, a recording screen for confirming communication with the web socket server 220 is provided, so that each user can confirm the commands requested to the server 200. You can download an interactive resource to your smart device before playing the video with 'mode': 'call_down', with the 'test' account accessing 'test' on your smart device with an account called 'android_test' request. 'mode': Pass the desired message to the smart device via 'push' and command the phone interaction via 'mode': 'call'. When the smart device 300 receives a call, it informs the user that the call is received through 'accept_call': 'true', commands the user to determine the story of the video through 'mode': 'branch' The content of the moving picture is changed.

Meanwhile, the smart device 300 according to the embodiment of the present invention is manufactured based on Android Version 5.0 (Lollipop), and is connected to a web socket when an application is logged in. The screen of the smart device 300 shown in FIG. 9 is a screen for selecting an interactive resource file download request, a push message, a phone call, and a story selection through the login and download manager, and operating through the recording shown in FIG. This is an example of implementing a web socket-based interactive media system according to an embodiment of the present invention, and it is possible to further implement an interactive function based on a developer's idea based on a real-time communication method, and thus can be extended in the future.

As described above, according to the embodiment of the present invention, the interactive media can be provided not only in a specific environment composed of various sensors, but also in a user-customized interactive media capable of developing a variety of stories from one story to another, Thus, various interactive media can be produced in accordance with the user's preference without having to build a specific environment using expensive equipment only by the story production ability of the image creator.

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, It is to be understood that the invention may be embodied in other specific forms. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive. The scope of the present invention is defined by the appended claims rather than the detailed description, and all changes or modifications derived from the scope of the claims and their equivalents should be construed as being included within the scope of the present invention.

100: Web Browser 110: Interactive Media Production Platform
120: interactive player 200: server
210: Web server 220: Web socket server
300: Smart device

Claims (1)

An interactive media production platform for creating media using scenarios input from the outside and inserting at least one interactive function for the scenario into the media to generate interactive media;
A server for storing the interactive media and the metadata for the interactive function;
A smart device that receives input from the user and selects an interactive function; And
An interactive player for playing the interactive media and providing an interactive function corresponding to the received selection information when the selection information of the interactive function is received from the smart device while playing the interactive media;
And an interactive media providing system.

Images