KR102344580B1 - Providing method, apparatus and computer-readable medium of providing a content control interface through interworking with an open type display device and a user terminal - Google Patents

Abstract

Provided is a technology for maximizing an advertisement effect through content and the like. According to one embodiment of the present invention, the method for providing a content control interface through interworking of an open-type display device and a user terminal comprises: a recognition step of transmitting recognition information to a content management server; a terminal interworking step of performing interworking of the user terminal and the content management server by using the recognition information transmitted by the recognition step; a controller execution step of receiving a web address for a virtual controller from the content management server and executing a controller to be output in the user terminal by using the received web address when the terminal interworking step is effectively completed; and a controller using step of transmitting an input signal to the content management server and controlling content output in the open-type display device according to user input for the virtual controller output from the user terminal.

Description

Method, device, and computer-readable medium for providing a content control interface through interworking with an open display device and user terminal }

The present invention relates to a technology for enabling a user terminal near the display device to be used as a controller for content control when interactive interactive type content output to a display device is output, and more specifically, an open-type display accessible by a large number of users For controllable content output from the device, the user can use a web-based controller that can immediately control the content nearby, thereby increasing the interest in content use and maximizing the advertising effect through the content. It's about technology to do it.

Recently, various content services using user terminals such as smartphones have been provided. In particular, recently, by using a smartphone to control various electronic devices, a service including a function to control contents available through the device in the mobile phone when an application is installed remotely without a separate terminal is provided. .

For example, LG's 'ThinQ' service provides a service that allows you to operate various contents using a smartphone by outputting a control panel of an electronic device or a control screen of various contents that can be used in the electronic device to a smartphone. are doing

Representative prior arts for such a service include, for example, Korean Patent Application No. 10-2014-0167590. In the prior art, after mapping the input function of the smart terminal and the control signal to the electronic device, a virtual controller is output to the smart terminal, and a technology is provided to enable the control of the electronic device according to the user input to the controller, have.

These technologies are very convenient in that a user can run a virtual controller on a smart phone through an application or the like without a separate control terminal, and control an electronic device through the executed controller.

However, this has a disadvantage in that the control target device and controllable content are very limited in that the control is simply performed through a user terminal paired with a single electronic device. In particular, this is a content that has been recently variously serviced. When outputting content that is installed in a public place and controllable through an open display device that allows multiple users to check the content, users need a separate terminal or motion recognition for this content. It has been pointed out that there is a problem in that it cannot be used to enable control without the need to use advanced equipment such as equipment.

Since the content output from such an open-type display device is not continuously used by a large number of users, but one-time access to the device, the outputted content is controlled to participate in content use. There is a problem in that too much cost is consumed in using a dedicated terminal temporarily rented for participation or in using the content when an inaccurate motion recognition device is separately installed.

Accordingly, the present invention is devised to solve the above-mentioned problems, and for content output from the above-described open-type display device, users can use a separate operation terminal or expensive motion for content capable of interactive interaction that can be manipulated by the user. Without using recognition equipment, it is possible to conveniently manipulate the content using the terminal it owns, so that it is possible to use the advertisement effect or various services through the corresponding content, thereby increasing the participation of users in content use. At the same time, it aims to provide technology that can maximize the marketing effect through this.

In order to achieve the above objects, a method for providing a content control interface through interworking with an open display device and a user terminal according to an embodiment of the present invention is provided so that a plurality of users can check output content by being installed outside, and interactively a recognition step of transmitting the recognition information to a content management server that controls content output to the open display device when receiving recognition information from a recognition means included in an open type display device that outputs interactive content; A terminal interworking step of interworking between the user terminal and the content management server by requesting the content management server to perform a process of linking the content management server and the user terminal using the recognition information transmitted by the recognition step ; When the terminal interworking step is effectively completed, a controller that receives a web address for a virtual controller capable of controlling the content from the content management server and executes the controller to be output from the user terminal using the returned web address execution phase; and transmits an input signal from an input means for a controller executed and output by the controller execution step to the content management server, and is transmitted to the open display device according to a user input to the virtual controller output from the user terminal. and using a controller to control the output content.

Preferably, the controller is configured with different manipulation interfaces according to the content, and in the controller execution step, a web address for a controller having a manipulation interface configured differently for each content is returned from the content management server.

The recognition means is any one of a two-dimensional code attached to an outer surface of the open-type display device and a two-dimensional code output to one of an output area of content being output to the open-type display device, and the recognition step includes: It is preferable to read the recognition information from the two-dimensional code according to the recognition result of the user terminal for the two-dimensional code.

The recognition means is a communication means capable of transmitting and receiving data through short-distance communication with the short-distance data transmission means of the open-type display device, and the recognizing step is data included in the content output to the open-type display device, and the short-distance data transmission It is also possible to receive the recognition information transmitted through the means through the communication means.

In the controller execution step, when there are a plurality of virtual controllers capable of controlling one content, a web address for a controller selection interface capable of selecting a controller is returned, and the controller selection interface is configured using the returned web address. a selection menu execution step to be executed; and transmits the input for the controller selection interface output by the selection menu execution step to the content management server, and receives information on a web address for a controller selected according to the input from the content management server, It is preferable to include; a controller selection step of outputting a controller selected using a web address from the user terminal.

After completion of the execution of the controller execution step and the controller use step, the log information storage step of transmitting and storing identification information and user identification information on the controller used in the user terminal to the content management server; desirable.

In the controller execution step, when the terminal interworking step is effectively completed, the user identification information is transmitted to the content management server according to the execution result of the terminal interworking step, and the content management server is used in the user terminal corresponding to the user identification information a log information inquiry step to select identification information for a controller that has been used; The identification information for the controller selected by the log information inquiry step and the web address for each controller are returned and output to the output means, and the web address is accessed according to the selection input from the input means for any one of the output controllers. It is preferable to include; a controller selection step of outputting a controller corresponding to the selection input from the user terminal.

The controller execution step may include: a controller output step of executing a first controller configured as a basic interface to be output from a user terminal as a controller corresponding to the returned web address; and when receiving an edit input to the control means constituting the first controller, edits the first controller according to the edit input, and uses the second controller that is the edited first controller as the final controller when receiving the edit completion input It is preferable to include; a controller editing step of setting it to be possible.

In the step of using the controller, a reactive content output step of outputting an event occurrence result to the user terminal when an event occurs as the content output to the open-type display device is controlled according to a user input to the virtual controller; desirable.

Meanwhile, the apparatus for providing a content control interface through interworking with an open display device and a user terminal according to an embodiment of the present invention is installed outside so that a plurality of users can check output content, and interactive interaction type content is output. a recognition unit that, upon receiving recognition information from a recognition unit included in the open display device, transmits the recognition information to a content management server that controls content output to the open display device; a terminal interworking unit for interworking between the user terminal and the content management server by requesting the content management server to perform a process for interworking the content management server and the user terminal using the recognition information transmitted by the recognition unit; When the interworking of the user terminal and the content management server through the terminal interworking unit is effectively completed, a web address for a virtual controller capable of controlling the content is returned from the content management server, and the controller using the returned web address a controller execution unit executing to be output through an output means of the user terminal; and by transmitting an input signal from an input means for a controller executed and output by the controller execution unit to the content management server, according to an input through an input means for a virtual controller output from an output means of the user terminal and a controller using unit configured to control the content output to the open-type display device.

According to the present invention, when the user terminal receives the content output from the open-type display device and the recognition information from the recognition means capable of recognizing the device, it transmits it to the content management server, and transmits a key requesting control thereto. Then, according to this, the content management server provides web access information for the virtual controller for the corresponding content so that the virtual controller is output to the output means of the user terminal according to the web access, and through the controller operation through the input means It functions to enable control over content.

According to this, when controlling one-time contents, a controller implemented as an API through web access is very convenient using a terminal such as a user's smartphone, without using a separate terminal or high-cost equipment such as motion recognition equipment. This has the effect of enabling interaction with the content.

Furthermore, according to the present invention, the virtual controller is implemented as a web API, etc. without the need to install a separate application, and by providing access information therefor, the user terminal does not need to install any programs and manages contents very quickly By enabling a virtual controller to be used through interworking with a server, there is an effect of enabling one-time content control while using the resources of the user terminal to a minimum.

In addition, by providing different controllers for each content, it is possible to provide an optimal feeling of operation for various content, thereby increasing user convenience.

Through this, users can only check the content through an open display device that can check advertisements while passing by, and the user can participate in content control as an interaction for this, thereby improving the accessibility and using the display device. It is possible to provide a wide variety of outputted contents, and at the same time, there is an effect of maximizing the marketing effect through this.

1 to 4 are flowcharts illustrating a functional flow of a method for providing a content control interface through interworking with an open display device and a user terminal according to an embodiment of the present invention.
5 is a block diagram of an apparatus for providing a content control interface through interworking with an open type display apparatus and a user terminal according to an embodiment of the present invention;
6 is a view showing examples of a controller capable of output according to the implementation of each embodiment of the present invention.
7 and 8 are diagrams for explaining a flow of installing and executing a content controller through a user terminal according to an implementation of each embodiment of the present invention;
9 to 11 are diagrams for explaining examples of interfaces output to a user terminal according to the implementation of each embodiment of the present invention;
12 is an example of an internal configuration of a computing device according to an embodiment of the present invention.

Hereinafter, various embodiments and/or aspects are disclosed with reference to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth to provide a thorough understanding of one or more aspects. However, it will also be recognized by one of ordinary skill in the art that such aspect(s) may be practiced without these specific details. The following description and accompanying drawings set forth in detail certain illustrative aspects of one or more aspects. These aspects are illustrative, however, and some of various methods may be employed in the principles of the various aspects, and the descriptions set forth are intended to include all such aspects and their equivalents.

As used herein, “embodiment”, “example”, “aspect”, “exemplary”, etc. may not be construed as an advantage or advantage in any aspect or design described above over other aspects or designs. .

Also, the terms "comprises" and/or "comprising" mean that the feature and/or element is present, but excludes the presence or addition of one or more other features, elements, and/or groups thereof. should be understood as not

Also, terms including an ordinal number such as 1st, 2nd, etc. may be used to describe various elements, but the elements are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

In addition, in the embodiments of the present invention, unless otherwise defined, all terms used herein, including technical or scientific terms, are those commonly understood by those of ordinary skill in the art to which the present invention belongs. have the same meaning. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and unless explicitly defined in an embodiment of the present invention, an ideal or excessively formal meaning is not interpreted as

1 to 4 are flowcharts illustrating a functional flow of a method for providing a content control interface through interworking with an open display device and a user terminal according to an embodiment of the present invention, and FIG. 5 is an open display according to an embodiment of the present invention. A block diagram of a device for providing a content control interface through interworking with a user terminal, FIG. 6 is a diagram showing examples of a controller capable of outputting according to the implementation of each embodiment of the present invention, FIGS. 7 and 8 are views of each embodiment of the present invention A diagram for explaining a flow of installing and executing a content controller through a user terminal according to implementation, FIGS. 9 to 11 are diagrams for explaining examples of interfaces output to a user terminal according to the implementation of each embodiment of the present invention . In the following description, one or more drawings will be simultaneously referenced for description of each embodiment or each configuration of the present invention.

1 to 4, the method for providing a content control interface through interworking with an open type display device and a user terminal according to an embodiment of the present invention is installed outside and provided so that a plurality of users can check output content, When the recognition information is received from the recognition means included in the open type display device on which the interactive interaction type content is output, the recognition step (S10) of transmitting the recognition information to the content management server that controls the content output on the open type display device is performed. .

In the following description, a method of providing a content control interface through interworking with an open display device and a user terminal according to each embodiment of the present invention is described below for each configuration or hardware of a user terminal having the same or similar configuration to the computing device shown in FIG. 12 . It will be understood that the enemy components are performed as each function is performed. In this case, the user terminal may refer to a mobile terminal, such as a smart phone, a smart pad, or a tablet PC, which is preferably located near the open display device and is owned by users who want to participate in the control of content output from the device. The user terminal may be configured to transmit/receive data to and from the display device described above, a content management server to be described later, or other various devices through a wired/wireless local or long-distance communication network such as Wi-Fi, Bluetooth, beacon, NFC, 2G to 5G, and the like.

In addition, the user terminal may include a processor, a memory, and input means and output means for performing various functions to be described later. The output means includes a display device and an audio output means, and the input means includes a means capable of acquiring visual or audio data such as a camera and a microphone, or a button-type input means, a touch input sensing means in an input/output integration means such as a touch screen, etc. can be configured.

In the present invention, the open-type display device refers to a display device that can output various image contents, such as games and event images, including TVs, LED billboards, etc. installed in shopping malls, streets, buildings, and the like. In particular, as described above, it is preferable that the device is installed in an open place so that a large number of people can check the corresponding content according to the installed place and characteristics. However, any device capable of controlling content according to the performance of the function of the present invention may be included in the display device of the present invention. That is, when using the service of the present invention at home or indoors, a TV installed at home or indoors may also be included in the open display device of the present invention. In conclusion, in the open display device of the present invention, the content output by the device is controlled by the manipulation of the user terminal either directly with the user terminal owned by the users or a separate application for content control is not installed. It can be understood to refer to all devices that become

In the present invention, the content of the interactive interaction type, that is, the content referred to in the present invention, is the content output from the open-type display device, and according to the operation according to the user's input to the virtual controller output from the user terminal by the function to be described later. It refers to all responsive content in which content is controlled and the controlled result is output to an open display device or a user terminal. For example, it will be understood that contents output for a chat interface, a game, a participatory event, etc. are included in the contents in the present invention.

In the present invention, the recognition means is a kind of information storage means included in the open-type display device, and as described above, means all means for allowing the user terminal to receive recognition information. For example, a two-dimensional code output to the open-type display device 30 shown in FIG. 5 or attached to an outer surface of the display device, or a two-dimensional code being output to a region of the content C1 being output to the display device (31) may be any one of. In this case, as shown in FIG. 1 , users perform functions such as photographing for a recognition means such as a camera 15 attached to their user terminal 10 , Recognition information, which is information included therein, is read.

Meanwhile, in the present invention, the recognition means includes all means capable of transmitting recognition information including identification information of an open display device or content, such as separate NFC, beacon, and Bluetooth, to the user terminal 10 in addition to the above-described two-dimensional code, etc. will be understood as a concept.

That is, unlike the two-dimensional code 31 described above, in another embodiment of the present invention, the recognition means is a communication means capable of transmitting and receiving data through short-distance data transmission means and short-range communication of the open-type display device 30, In this case, in step S10, it is also possible to receive, through a communication unit, recognition information transmitted through a short-distance data transmitting unit as data included in the content output to the open-type display device.

In order to proceed with this flow, referring to FIG. 7 , users are output to one area of the content screen 300 output through the display device through the two-dimensional code recognition screen 100 included in the user terminal, etc. The two-dimensional code 301 as a part of the image content is recognized, and recognition information is read therefrom.

At this time, the read recognition information, that is, the recognition information received by the user terminal in step S10, includes, for example, identification information of an open display device or content, or a web address (URL or character address) to be accessed to control the content. it means. In this case, the web address to be accessed is the online to be accessed for executing the web page or web program for the service according to the function of the present invention operated through the content management server that performs authentication for the user terminal and controls the content. It means the address information for connection on the network. It is often referred to as a web address or the like, but will be referred to as a web address in the following description.

In the present invention, transmitting the recognition information to the content management server refers to a function of transmitting recognition information prior to or simultaneously with the function of step S20 to the content management server in charge of outputting and managing content for a plurality of open display devices. do. In this case, in transmitting the recognition information, as described above, as the web address for accessing the content management server is accessed, the information of the user terminal is included in the access request information and transmitted, and in this case, the web address is the address for controlling the content. In this case, the corresponding recognition information is automatically utilized and a process of accessing the content management server is included. In addition, the recognition information is directly transmitted to the content management server, and the content management server uses the recognition information and the IP, Serial Number, etc. of the user terminal included in the transmission data packet of the data to be output from any display device to any user terminal. It includes the process of identifying that recognition information has been transmitted to control the content to be used.

When step S10 is performed, the user terminal requests the content management server to perform a process of linking the content management server and the user terminal using the recognition information transmitted by the recognition step S10, and the user terminal and the content management server are interlocked Performs the terminal interworking step (S20) to perform.

As described above, when the recognition information is transmitted, a signal requesting to perform the above-described step S20 may be transmitted either directly to the content management server or indirectly according to an attempt to access the above-described web address.

In this case, after the user terminal makes such a request, it waits for a response from the content management server, and the content management server checks the validity of the identification information of the user terminal or the individual authentication process of the user connected through the user terminal. By linking the user terminal or the user terminal itself used by the user account validly authenticated through the content management server, the access or use of the content is approved so that the content output by the display device can be controlled later. .

An important feature of the present invention is that the user terminal is not interlocked with the above-described open display device through a complicated process or paired to enable data transmission and reception, and the content management server that remotely controls the content output from the open display device and the user terminal. that is linked. To be precise, when web addresses included in the recognition information to be accessed for interworking are managed differently according to each content, it is a configuration included in the content management server and is linked to an interface for controlling each content.

Accordingly, when it is necessary to interwork with each device individually, the decrease in usability due to the process that the user has to perform to use simple contents such as Bluetooth pairing or USB connection becomes very complicated is reduced to the web address according to the very simple action in step S10. The connection is made so that the user terminal can control the interactive interactive content output through the open display device through a very simple process such as access to the network.

When step S20 is effectively completed, the user terminal returns a web address for a virtual controller capable of controlling content from the content management server, and executes the controller to be output from the user terminal using the returned web address. (S30) is performed.

Executing so that the controller is output from the user terminal using the returned web address means that the web program page (or web API) corresponding to the web address is linked to the content management server by accessing the returned web address to the user terminal. etc.) will be understood to include all processes that allow the virtual controller to be executed and implemented in the user terminal based on the web through the process of executing it in the user terminal.

After step S30, the user terminal transmits the input signal from the input means for the controller executed and outputted in step S30 to the content management server, and according to the user's input to the virtual controller output from the user terminal, an open display A controller use step (S40) to control the content output to the device is performed.

That is, when an input by a specific action of the user terminal to the virtual controller output by the web program is performed, the virtual controller executed on the web program selects a pre-stored control command to match the input performed in the user terminal and transmits the corresponding control command to the content management server, and the content management server controls the content by using it.

Of course, thereafter, a reactive content output step (not shown) of outputting a content control result to the user terminal may be further performed. In particular, the reactive content output step may be understood as a concept including a process of outputting a result obtained by controlling the content to the open display device itself, and a process of separately providing each result for each user terminal and outputting the result to the user terminal.

As described above, the controller output by step S30 may be configured in various ways to be optimized for content control, for example. That is, for example, when the content is social media content for information sharing, such as chatting content between users located on the display device, a text input window, an interface for inputting a specific image, etc. are provided to the user terminal as a virtual controller for the content. can be output. Meanwhile, when the content is content such as a game, which will be described in the following embodiments, a controller interface for manipulating a character or the like in the corresponding game may be output.

Meanwhile, even in the same game, a wide variety of virtual controllers may be configured as shown in FIGS. For example, if a four-way action control such as drawing a doll or a soccer game is required and there is an action execution menu according to an action, a controller as shown in FIG. 6(a) will be required. On the other hand, when two-way action control such as a side scroll action is required, a controller as shown in FIGS. 6 (b) and 6 (c) may be suitable according to a control interface for the character. Alternatively, in the case of a quiz or the like, since any one of the multiple-choice views is simply selected, an interface as shown in FIG. 6(d) may be suitable.

That is, the controller is configured with different manipulation interfaces according to the content, and in the controller execution step (S30), it is preferable to return a web address for a controller having a different manipulation interface configured for each content from the content management server. .

At this time, receiving a web address for a controller having a differently configured operation interface is understood as configuring a web address for a virtual controller for the corresponding content in advance in the content management server and returning the web address to the user terminal will be That is, it is set so that the shape of the controller is determined in advance according to the content.

Meanwhile, as shown in FIGS. 6 (b) and (c) according to the two-way action control such as the above-described horizontal scroll action, a plurality of virtual controllers capable of controlling one content may be set to exist. That is, in this case, a plurality of web addresses to be accessed for the above-described virtual controller may be set, and different types of controllers may be used for each set web address.

In this case, in order to select a web address for the controller from among a plurality of the user terminal, for example, as shown in FIG. 2 , a web address for a controller selection interface through which a controller can be selected is returned, and the returned web address is used to execute the selection menu execution step (S31) of executing the controller selection interface.

An example of this is shown in the user terminal screen 130 of FIG. 9 . That is, on the controller selection interface screen 130 , users check the schematic interface configuration information 131 or identification information about a virtual controller that can be used to control the corresponding content.

Thereafter, the user terminal transmits the input for the controller selection interface output by the selection menu execution step S31 to the content management server, and returns information on the web address for any one controller selected according to the input from the content management server A controller selection step (S32) of allowing one selected controller to be output from the user terminal by using the received and returned web address is executed.

That is, on the screen 130 of FIG. 9 , users may perform an input to select the selection menu 132 as an input to the selection interface, and when the corresponding input is transmitted to the content management server, By using the identification information of the controller according to the input, a web address for the controller corresponding to the identification information is returned.

Meanwhile, in the present invention, when using the same or different content in different open display devices or in one display device, users may want to use a controller they are familiar with. In order to respond to the needs of these users, first, after performing steps S30 and S40, the user terminal transmits and stores identification information about the controller used in the user terminal and user identification information to the content management server. A storage step (not shown) may be further performed.

After that, when step S30 is performed, when the terminal interworking step S20 is effectively completed, the user terminal transmits user identification information to the content management server according to the result of the terminal interworking step, so that the content management server is the user A log information inquiry step (S33) of selecting identification information for a controller that has been used in the user terminal corresponding to the identification information is performed.

Thereafter, the identification information for the controller selected by the log information inquiry step and the web address for each controller are returned and output to the output means, and the web address is accessed according to the selection input from the input means for any one of the output controllers Thus, the controller selection step (S34) is performed so that the controller corresponding to the selection input is output from the user terminal.

An example of this is shown in FIG. 10 . FIG. 10 is an example of a controller selection interface screen 140 similar to that of FIG. 9 . At this time, on the usage history controller screen 142 , users check the controllers CU1 and CU2 that they have used before, and any of them One controller can be selected through steps S33 and S34 and reused for content control.

Of course, like the available controller screen 141 of FIG. 10 , steps S31 and S32 mentioned in the description of FIG. 9 may be concurrently performed concurrently with steps S33 and S34, and through this, users control the corresponding content. In order to do this, you can check the available controllers and the controllers you have used, so that you can select the best controller for you.

On the other hand, if it takes some time to use the content, or if the user is very sensitive to the configuration of the controller, he or she may want to configure the controller to be customized.

In order to satisfy such a user's need, in another embodiment of the present invention, in step S30 executed in the user terminal, as a controller corresponding to the returned web address, the first controller configured as a basic interface is output from the user terminal The controller output step (S35) to be executed is performed first. In the present invention, the first controller refers to the configuration of the controller initially set by all the content management servers mentioned in the concept of the above-described controller, or a UI or UX in which the configuration is implemented.

Thereafter, when receiving an edit input to the control means constituting the first controller, the user terminal edits the first controller according to the edit input, and when receiving the edit completion input, sets the edited second controller, which is the first controller, to the final controller A controller edit step (S36) of setting it to be available as .

That is, if the incorporation interface 150 shown in FIG. 11 is checked, the information 151 on the configuration of the basic controller output by step S35 is output, and the information will also be initially output to the edit menu 152 . . At this time, the users can edit the controller from the initial configuration 153 to the configuration 154 they want by adjusting the position of the direction manipulation key or the configuration or position of the action input key, for example, through the execution of step S36. have. After the editing is completed in this way, the user can control the content with the controller they want through the second controller that is stored when the completion menu is selected. Of course, in addition to editing the above-described position, size, configuration, etc. of the key, it will be possible to change the output form of the direction key, change the icon, change the color, and the like.

When the selection of the controller is completed, the step of outputting S40 and/or reactive content may be performed as described above. An example of this is shown in FIG. 8 .

Referring to the content screen 300 shown in (a) of FIG. 8 , different users may simultaneously access the content management server 20 , and at this time, the controller 110 that is output to the screen 100 of one user terminal , and a user's input to the corresponding controller 110 may be performed.

At this time, the corresponding input is not directly transmitted to the display device, but is transmitted to the content management server 20 that controls the output of the content screen 300 , and the content management server corresponds to the controller and generates the character 301 of the user U1 . ), the control command is executed so as to be operated in response to the corresponding control command, and the manipulation of the character 301 according to the executed control command is executed in the content screen 300 . Of course, the other characters 302 will be operated by performing functions of other user terminals with respect to the above-described example.

At this time, for example, the result of the movement of the character and the action of the character 301 being executed in the content screen 300 is an example of the above-described reactive content output step.

In addition, referring to (b) of FIG. 8 , the reactive content output step includes a concept of outputting a screen 120 for the result of occurrence of the corresponding event to the user terminal when a specific event occurs as a result of content control. can be understood For example, as shown in (b) of FIG. 8 , in the drawing game, the user manipulates the characters 301 and 302 through the controller 110 while checking the screen 300 , and it is determined that a certain product has been drawn. In this case, an event notification for the acquisition of the corresponding product is output on the screen 120 so that the user can check whether the user has acquired what product or whether a specific mission has been successful/failed.

That is, the reactive content output step is a process of outputting an event generated on the content screen 300 from the user terminal in the opposite direction to the flow of controlling the output in the content screen 300 according to the input of the user terminal described above. can be understood to mean For example, in addition to the above-described examples, a case of outputting a haptic response such as vibration to the user terminal when a vehicle collides with another vehicle in a racing game or the like may be included.

According to various embodiments of the present invention as described above, when controlling one-time contents, it does not use expensive equipment such as a separate terminal or motion recognition equipment, and it is very convenient through a web connection using a terminal such as a user's smartphone. There is an effect of enabling interaction with content by using a controller implemented as an API or the like.

Furthermore, according to the present invention, the virtual controller is implemented as a web API, etc. without the need to install a separate application, and by providing access information therefor, the user terminal does not need to install any programs and manages contents very quickly By enabling a virtual controller to be used through interworking with a server, there is an effect of enabling one-time content control while using the resources of the user terminal to a minimum.

In addition, by providing different controllers for each content, it is possible to provide an optimal feeling of operation for various content, thereby increasing user convenience.

Through this, users can only check the content through an open display device that can check advertisements while passing by, and the user can participate in content control as an interaction for this, thereby improving the accessibility and using the display device. It is possible to provide a wide variety of outputted contents, and at the same time, there is an effect of maximizing the marketing effect through this.

5 is a block diagram of a content control interface providing apparatus 10 (hereinafter referred to as 'device of the present invention') through interworking with an open type display apparatus and a user terminal according to an embodiment of the present invention. In the following description, unnecessary descriptions overlapping with those previously described with respect to FIGS. 1 to 4 and FIGS. 6 to 12 will be omitted.

Referring to FIG. 5 , the apparatus 10 of the present invention can be understood to be the same device as the user terminal 10 described above, and the recognition unit 11 , the terminal interworking unit 12 , and the controller according to the performance of the functions. It includes an execution unit 13 and a controller using unit 14, terminal-side recognition means such as a camera 15 for recognizing the recognition means 31, and an input means 16 for performing controller confirmation and operation input ) and output means 17 may be included.

In addition, the device 10 of the present invention controls the content C1 output from the open display device 30 that is connected to the content management server 20 and the server 30 controls the output in order to perform its function. will do

Meanwhile, a reactive content output unit (not shown) for performing the function of the above-described reactive content output step may be further included as an additional configuration.

The recognition unit 11 is installed outside, is provided so that a plurality of users can check the output content, and receives recognition information from the recognition means 31 included in the open display device 30 that outputs interactive interaction type content. At the time, it performs a function of transmitting the recognition information to the content management server 20 that controls the content output to the open display device 30 . That is, it will be understood as a configuration that performs all functions mentioned in the description of the above-described step S10.

The terminal interworking unit 12 requests the content management server 20 to perform a process of linking the content management server 20 and the user terminal 10 using the recognition information transmitted by the recognition unit 11 to the user. It performs a function of performing interworking between the terminal 10 and the content management server 20 . That is, it will be understood as a configuration that performs all functions mentioned in the description of the above-described step S20.

The controller executor 13 is a virtual virtual machine capable of controlling content from the content management server 20 when the interworking between the user terminal 10 and the content management server 20 through the terminal linking unit 12 is effectively completed. It receives a web address for the controller, and performs a function of executing the controller to be output through the output means 17 of the user terminal 10 using the returned web address. That is, it will be understood as a configuration that performs all the functions mentioned in the description of steps S30 and S31 to S36 described above.

The controller use unit 14 transmits an input signal from the input unit for the controller executed and output by the controller execution unit !3 to the content management server 20, and the output unit 17 of the user terminal 10 ), performs a function of controlling the content output to the open display device 30 according to an input through the input means 16 to the virtual controller. It will be understood as a configuration that performs all functions mentioned in the description of the above-described step S40.

12 illustrates an example of an internal configuration of a computing device according to an embodiment of the present invention, and in the following description, descriptions of unnecessary embodiments that overlap with those of FIGS. 1 to 11 will be omitted. do it with

12, the computing device 10000 includes at least one processor 11100, a memory 11200, a peripheral interface 11300, an input/output subsystem ( It may include at least an I/O subsystem) 11400 , a power circuit 11500 , and a communication circuit 11600 . In this case, the computing device 10000 may correspond to a user terminal connected to the tactile interface device (A) or the aforementioned computing device (B).

The memory 11200 may include, for example, a high-speed random access memory, a magnetic disk, an SRAM, a DRAM, a ROM, a flash memory, or a non-volatile memory. have. The memory 11200 may include a software module, an instruction set, or other various data required for the operation of the computing device 10000 .

In this case, access to the memory 11200 from other components such as the processor 11100 or the peripheral device interface 11300 may be controlled by the processor 11100 .

Peripheral interface 11300 may couple input and/or output peripherals of computing device 10000 to processor 11100 and memory 11200 . The processor 11100 may execute a software module or an instruction set stored in the memory 11200 to perform various functions for the computing device 10000 and process data.

The input/output subsystem 11400 may couple various input/output peripherals to the peripheral interface 11300 . For example, the input/output subsystem 11400 may include a controller for coupling a peripheral device such as a monitor, keyboard, mouse, printer, or a touch screen or sensor as needed to the peripheral interface 11300 . According to another aspect, input/output peripherals may be coupled to peripheral interface 11300 without going through input/output subsystem 11400 .

The power circuit 11500 may supply power to all or some of the components of the terminal. For example, the power circuit 11500 may include a power management system, one or more power sources such as batteries or alternating current (AC), a charging system, a power failure detection circuit, a power converter or inverter, a power status indicator, or a power source. It may include any other components for creation, management, and distribution.

The communication circuit 11600 may enable communication with another computing device using at least one external port.

Alternatively, as described above, if necessary, the communication circuit 11600 may include an RF circuit to transmit and receive an RF signal, also known as an electromagnetic signal, to enable communication with other computing devices.

The embodiment of FIG. 12 is only an example of the computing device 10000, and the computing device 11000 may omit some components shown in FIG. 12 or further include additional components not shown in FIG. 12, or 2 It may have a configuration or arrangement that combines two or more components. For example, a computing device for a communication terminal in a mobile environment may further include a touch screen or a sensor in addition to the components shown in FIG. 12 , and may include various communication methods (WiFi, 3G, LTE) in the communication circuit 1160 . , Bluetooth, NFC, Zigbee, etc.) may include a circuit for RF communication. Components that may be included in the computing device 10000 may be implemented in hardware including an integrated circuit specialized for one or more signal processing or applications, software, or a combination of both hardware and software.

Methods according to an embodiment of the present invention may be implemented in the form of program instructions that can be executed through various computing devices and recorded in a computer-readable medium. In particular, the program according to the present embodiment may be configured as a PC-based program or an application dedicated to a mobile terminal. The application to which the present invention is applied may be installed in the user terminal through a file provided by the file distribution system. For example, the file distribution system may include a file transmission unit (not shown) that transmits the file in response to a request from the user terminal.

The device described above may be implemented as a hardware component, a software component, and/or a combination of the hardware component and the software component. For example, the devices and components described in the embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), It may be implemented using one or more general purpose or special purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. A processing device may also access, store, manipulate, process, and generate data in response to execution of the software. For convenience of understanding, although one processing device is sometimes described as being used, one of ordinary skill in the art will recognize that the processing device includes a plurality of processing elements and/or a plurality of types of processing elements. It can be seen that can include For example, the processing device may include a plurality of processors or one processor and one controller. Other processing configurations are also possible, such as parallel processors.

Software may comprise a computer program, code, instructions, or a combination of one or more thereof, which configures a processing device to operate as desired or is independently or collectively processed You can command the device. The software and/or data may be any kind of machine, component, physical device, virtual equipment, computer storage medium or device, to be interpreted by or to provide instructions or data to the processing device. may be permanently or temporarily embody in The software may be distributed over networked computing devices, and stored or executed in a distributed manner. Software and data may be stored in one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded in the medium may be specially designed and configured for the embodiment, or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic such as floppy disks. - includes magneto-optical media, and hardware devices specially configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter or the like. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

As described above, although the embodiments have been described with reference to the limited embodiments and drawings, various modifications and variations are possible for those skilled in the art from the above description. For example, the described techniques are performed in an order different from the described method, and/or the described components of the system, structure, apparatus, circuit, etc. are combined or combined in a different form than the described method, or other components Or substituted or substituted by equivalents may achieve an appropriate result. Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the following claims.

Claims (11)

It relates to a method of providing a content control interface through interworking with an open display device implemented as a user terminal including one or more processors and one or more memories for storing instructions executable by the processor, and the user terminal,
When the recognition information is received from the recognition means included in the open display device installed outside and provided so that a plurality of users can check the output content, the interactive interaction type content is output, the recognition information is output to the open display device Recognizing the content to be transmitted to a content management server that controls the content;
A terminal interworking step of interworking between the user terminal and the content management server by requesting the content management server to perform a process of linking the content management server and the user terminal using the recognition information transmitted by the recognition step ;
When the terminal interworking step is effectively completed, a controller that receives a web address for a virtual controller capable of controlling the content from the content management server and executes the controller to be output from the user terminal using the returned web address execution phase; and
The input signal from the input means for the controller executed and output by the controller execution step is transmitted to the content management server, and outputted to the open display device according to the user input to the virtual controller output from the user terminal Including; using a controller to control the content to be
The controller is configured with different operation interfaces according to the content,
The controller execution step is
A method of providing a content control interface through interworking with an open display device and a user terminal, characterized in that a web address for a controller having a manipulation interface configured differently for each content is returned from the content management server.
delete According to claim 1,
The recognition means,
Any one of a two-dimensional code attached to the outer surface of the open-type display device and a two-dimensional code output to one of an output area of content being output to the open-type display device,
The recognition step is
A method for providing a content control interface through interworking with an open display device and a user terminal, characterized in that reading the recognition information from the two-dimensional code according to a result of the user terminal's recognition of the two-dimensional code.
According to claim 1,
The recognition means,
It is a communication means capable of transmitting and receiving data through short-distance data transmission means and short-range communication of the open-type display device,
The recognition step is
Providing a content control interface through interworking with an open-type display device and a user terminal, characterized in that the recognition information transmitted through the short-distance data transmission means is received through the communication means as data included in the content output to the open-type display device Way.
The method of claim 1,
The controller execution step is
When there are a plurality of virtual controllers capable of controlling one content, a selection menu execution step of receiving a web address for a controller selection interface capable of selecting a controller and executing the controller selection interface using the returned web address ; and
The input for the controller selection interface output by the selection menu execution step is transmitted to the content management server, information on a web address for a controller selected according to the input is returned from the content management server, and the returned web A method of providing a content control interface through interworking with an open display device and a user terminal, comprising: a controller selection step of outputting a controller selected using an address from the user terminal.
The method of claim 1,
After completion of the execution of the controller execution step and the controller use step, a log information storage step of transmitting and storing identification information and user identification information on the controller used in the user terminal to the content management server; A method of providing a content control interface through interworking with an open display device and a user terminal, characterized in that.
7. The method of claim 6,
The controller execution step is
When the terminal interworking step is effectively completed, the user identification information is transmitted to the content management server according to the result of the terminal interworking step, and the content management server provides information on the controller used in the user terminal corresponding to the user identification information. log information inquiry step to select identification information;
The identification information for the controller selected by the log information inquiry step and the web address for each controller are returned and output to the output means, and the web address is accessed according to the selection input from the input means for any one of the output controllers. A method of providing a content control interface through interworking with an open display device and a user terminal, comprising: a controller selection step of outputting a controller corresponding to a selection input from the user terminal.
According to claim 1,
The controller execution step is
A controller corresponding to the returned web address, comprising: a controller output step of executing a first controller configured as a basic interface to be output from a user terminal; and
Upon receiving an edit input to the control means constituting the first controller, the first controller is edited according to the edit input, and upon receiving the edit completion input, the second controller that is the edited first controller can be used as the final controller A method of providing a content control interface through interworking with an open-type display device and a user terminal, characterized in that it comprises;
According to claim 1,
The step of using the controller is
An open-type display apparatus comprising: a reactive content output step of outputting an event occurrence result to a user terminal when an event occurs as content output to the open-type display apparatus is controlled according to a user's input to a virtual controller; and a method of providing a content control interface through interworking with a user terminal.
To an apparatus for providing a content control interface through interworking with an open display device and a user terminal implemented as a computing device including one or more processors and one or more memories for storing instructions executable by the processor,
When the recognition information is received from the recognition means included in the open display device installed outside and provided so that a plurality of users can check the output content, the interactive interaction type content is output, the recognition information is output to the open display device Recognition unit for transmitting to a content management server that controls the content to be;
a terminal interworking unit for interworking between the user terminal and the content management server by requesting the content management server to perform a process for interworking the content management server and the user terminal using the recognition information transmitted by the recognition unit;
When the interworking between the user terminal and the content management server through the terminal interworking unit is effectively completed, a web address for a virtual controller capable of controlling the content is returned from the content management server, and the controller using the returned web address a controller execution unit executing to be output through an output means of the user terminal; and
The input signal from the input means for the controller executed and output by the controller execution unit is transmitted to the content management server, and according to the input through the input means for the virtual controller output from the output means of the user terminal, the Including; a controller using unit to control the content output to the open display device;
The controller is configured with different operation interfaces according to the content,
The controller execution unit,
An apparatus for providing a content control interface through interworking with an open display device and a user terminal, characterized in that receiving a web address for a controller having a manipulation interface configured differently for each content from the content management server.
A computer-readable recording medium comprising:
The computer-readable recording medium stores instructions for causing a computing device to perform the following steps, the steps of:
When the recognition information is received from the recognition means included in the open display device installed outside and provided so that a plurality of users can check the output content, the interactive interaction type content is output, the recognition information is output to the open display device Recognizing the content to be transmitted to a content management server that controls the content;
a terminal interworking step of requesting the content management server to perform a process of interworking the content management server and the user terminal using the recognition information transmitted by the recognition step to perform interworking between the user terminal and the content management server;
When the terminal interworking step is effectively completed, a controller that receives a web address for a virtual controller capable of controlling the content from the content management server and executes the controller to be output from the user terminal using the returned web address execution phase; and
The input signal from the input means for the controller executed and output by the controller execution step is transmitted to the content management server, and outputted to the open display device according to the user input to the virtual controller output from the user terminal Including; using a controller to control the content to be
The controller is configured with different operation interfaces according to the content,
The controller execution step is
The computer-readable recording medium of claim 1, wherein a web address for a controller having an operation interface configured differently for each content is returned from the content management server.

Images