KR20090074810A - Contents robot coupled with broadcasting contents and method for controlling thereof - Google Patents

Abstract

The present invention relates to a content robot that operates in association with broadcast content and a control method thereof. According to the present invention, a viewer watching broadcast content can experience the broadcast content more realistically through the content robot. In addition, the viewer has an effect of increasing the realism of the broadcast content by interacting with the characters appearing in the broadcast content.

Description

Content robot coupled with broadcasting contents and method for controlling Technical Field

The present invention relates to a content robot that operates in association with broadcast content and a control method thereof.

Recently, standard technology has been adopted for domestic digital broadcasting, and digital broadcasting has been partially implemented. Since digital broadcasting has an advantage in that the image signal and the data signal can be transmitted together, not only a simple image transmission but also a data signal related to an image such as a movie and subtitles that can be viewed on a computer can be transmitted together.

However, in the conventional digital broadcasting, only a video signal, an audio signal, and a data signal for data broadcasting are transmitted in a transport stream. The viewer then watched the broadcast content on a flat screen only through a television or a computer.

Therefore, the viewer should generally receive the broadcast content transmitted from the broadcasting station while watching only the flat television screen in order to watch the broadcast content. As a result, it is difficult for the viewer to concentrate on watching the broadcast content for a long time, becomes easily bored, and difficult to interact with the broadcast content, for example, to interact with, touch, and hug an animation character.

In addition, since viewing the broadcast content for a long time causes vision deterioration, it is necessary to distract the viewer's gaze.

In addition, when there are rhythms to be followed while watching broadcast contents, some passive children may not easily follow the rhythms without encouraging their surroundings.

In addition, there is a problem that the user side should use a device with a limited input such as a remote control when transmitting two-way content, which is the biggest advantage of digital broadcasting such as IPTV.

Technical challenge

It is an object of the present invention to provide a content robot that provides more realistic content to viewers watching broadcast content and performs an operation associated with broadcast content to more freely perform bidirectional transmission of the content, and a control method thereof. .

Technical solution

Content robot according to an embodiment of the present invention includes a timer for outputting time information; A communication unit receiving sync data for synchronizing the timer with a broadcast content output time and interlocking data representing an operation associated with the broadcast content; A controller for comparing the output time information with a time stamp recorded in the interlocking data and selecting interlocking data in which a time stamp matching the time information is recorded; And a driver configured to perform an operation associated with the broadcast content in response to the selected companion data.

According to an aspect of the present invention, there is provided a method of controlling a content robot, the method comprising: receiving sync data for synchronizing a timer with a broadcast content output time and interlocking data representing an operation associated with the broadcast content; Synchronizing the timer with the broadcast content output time using the sync data; Comparing the time information output by the synchronized timer with a time stamp recorded in the interworking data; Selecting interlocking data in which a time stamp matching the time information is recorded; And performing an operation associated with the broadcast content in response to the selected coordinated data.

A set-top box for a content robot according to an embodiment of the present invention comprises: a receiver configured to receive a stream including a broadcast content, a content robot control program, and interlocking data representing an operation associated with the broadcast content; A decoding unit for decoding the received stream; Middleware to execute the decoded content robot control program; And a transmitter configured to transmit the interworking data collected by the content robot control program to a content robot.

Broadcast content including video or audio; A content robot control program for controlling the operation of the content robot; And interlocking data representing an operation of the content robot associated with the broadcast content, may be stored in a computer-readable recording medium.

Favorable effect

According to the present invention, a viewer watching broadcast content can experience the broadcast content more realistically through the content robot.

According to the present invention, the viewer has an effect of increasing the realism of the broadcast content by interacting with the characters appearing in the broadcast content.

The present invention can replace the characters of the broadcast content with a content robot to extend the existing broadcast content that is limited in the television screen to the outside of the screen.

In addition, it may be difficult for a passive toddler to follow the rhythm or song of the broadcast content, and a friendly-looking content robot may be encouraged to follow the rhythm or song, thereby improving the learning effect of a younger viewer. .

The present invention can disperse attention even with a content robot, unlike the conventional broadcast content playback in which only the television screen is watched, thereby preventing vision deterioration due to long time viewing.

In addition, the present invention can be implemented by adding a content robot control program and linked data to the stream without greatly modifying the existing broadcast stream.

According to the present invention, the viewer can more easily and intuitively transmit user input through a content robot having a familiar appearance.

1 is a block diagram of a broadcasting system according to an embodiment of the present invention.

2 is a conceptual diagram illustrating broadcast transmission according to an embodiment of the present invention.

3 is a conceptual diagram illustrating a configuration of a transport stream of a real-time broadcast according to an embodiment of the present invention.

4 is a conceptual diagram illustrating a configuration of a transport stream of a VOD broadcast according to another embodiment of the present invention.

5 is a block diagram of a set-top box according to an embodiment of the present invention.

6 is a block diagram of a content robot according to an embodiment of the present invention.

7 is a conceptual diagram illustrating a packet structure of interworking data according to an embodiment of the present invention.

8 is a flowchart illustrating a content robot control method according to an embodiment of the present invention.

Embodiment for Invention

Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of a broadcasting system according to an embodiment of the present invention.

As shown in FIG. 1, a broadcasting station 1 or a content provider is connected to a broadcast content including a video signal or an audio signal, a content robot control program for controlling the operation of the content robot 5, and a broadcast content. The interlocking data expressing the operation of the content robot 5 is transmitted to the client through a network, terrestrial wave, cable or satellite.

The broadcast station 1 encodes the broadcast content through a predetermined encoding, and transmits a transport stream including the encoded broadcast content to the client.

The set top box 2 or the computer 3 decodes the broadcast content included in the transport stream and transmits it to the television 4. Then, the content robot 5 is controlled by executing the content robot control program included in the transport stream. The coordinated data is transmitted to the content robot 5 by the executed content robot control program.

2 is a conceptual diagram illustrating broadcast transmission according to an embodiment of the present invention.

As shown in FIG. 2, the broadcasting station 1 combines a broadcast content including a video signal and an audio signal with a data signal including interlocking data and a content robot control program into a transport stream and transmits the same to a client.

The video signal and the audio signal are encoded through the video encoder 31 and the audio encoder 32, respectively, and the encoded video signal and the audio signal, that is, the broadcast content are combined with the data signal through the program stream multiplexer 33. And a broadcast stream is generated.

The broadcast stream in which the broadcast content and the data signal are combined is generated for each TV channel, and the broadcast stream for each TV channel is combined into one transport stream through the transport stream multiplexer 34.

The content robot used in the detailed description of the present invention is a robot that performs a predetermined operation in conjunction with the broadcast content.

In addition, the content robot control program used in the detailed description of the present invention is a control program that is executed in the set top box 2 or the computer 3 to control the operation of the content robot.

In addition, the interlocking data used in the detailed description of the present invention is motion information representing an operation of the content robot performed in association with the broadcast content or media information associated with the broadcast content, that is, video and audio information.

3 is a conceptual diagram illustrating a configuration of a transport stream in a real time broadcast according to an embodiment of the present invention.

As shown in FIG. 3, a transport stream according to an embodiment of the present invention includes a video signal, an audio signal, and a data signal.

As described above, the video signal and the audio signal represent one broadcast content.

The data signal may include a content robot control program 41 for controlling the content robot 5 and interlocked data representing an operation of the content robot associated with the broadcast content.

According to an embodiment of the present invention, the interworking data may include motion information 42 representing the motion of the content robot 5 and media information 43 output by the content robot 5.

The media information 43 may include image information output by a display provided in the content robot 5 or audio information output by a speaker.

According to an embodiment of the present invention, when broadcast content is transmitted to a client in real time broadcasting, even if a viewer selects a broadcast channel at any point in time, the content robot control program 41 and interworking data 42 and 43 are received. The content robot control program 41 and the interworking data 42 and 43 may be repeatedly transmitted so as to be able to do so.

Preferably, since the motion information 42 of the interworking data has a small data size, motion information for the entire broadcast content may be repeatedly transmitted.

Preferably, since the media information 43 of the companion data has a large data size, motion information for a part of the corresponding broadcast content may be divided and transmitted.

For example, as shown in FIG. 3, the media information may be divided into a plurality of sub media information such as media information # 1, media information # 2, and media information # 3, and transmitted in different time zones. Each of the sub media information is media information associated with broadcast content corresponding to each transmission time zone and does not include media information of a time zone that has already passed.

According to an embodiment, the sub voice information may be repeatedly transmitted a predetermined number of times. In FIG. 3, each sub-voice information is repeatedly transmitted three times.

According to an embodiment of the present invention, the transport stream synchronizes the timer included in the content robot 5 in addition to the video signal and the audio signal representing the above-mentioned broadcast content, the content robot control program, and the interlocking data. The system may further include an event signal that provides event timing such as start, pause, stop, and end of the operation of the robot 5.

That is, as shown in Figure 3, the event signal, for example, the event # 1 to event # 9 is included in the transport stream, the time information output by the timer of the content robot 5 to be described later outputs the broadcast content output time. Can be synchronized with.

In addition, the event signal may provide timing information at which an operation event of the content robot 5 is executed. For example, when the event # 3 shown in FIG. 2 is a signal relating to an event of moving the right arm of the content robot 5, the set-top box 2 receives the event # 3 and transmits the event # 3 by the content robot control program. When the event # 3 is transmitted to the content robot 5, the content robot 5 may perform an operation of moving the right arm at the timing of receiving the event # 3.

4 is a conceptual diagram illustrating a configuration of a transport stream of a VOD broadcast according to another embodiment of the present invention.

As shown in FIG. 4, unlike the real-time broadcast of FIG. 3, in the case of VOD broadcast, the broadcast content is transmitted and reproduced at the time when the user selects the broadcast content.

Accordingly, the content robot control program 51 and the interlocking data 52 and 53 may not be periodically transmitted but may be transmitted once at the time when transmission is started.

However, according to an exemplary embodiment, when the data size of the media information 53 is large, the media information 53 may be divided into a plurality of sub-voice information and transmitted in different time zones.

Each sub-voice information is media information associated with broadcast content corresponding to each transmission time zone and does not include media information of a time zone that has already passed.

5 is a block diagram of a set-top box according to an embodiment of the present invention.

As shown in FIG. 5, the set-top box 2 according to an exemplary embodiment of the present invention may include a receiver configured to receive a stream including broadcast content, a content robot control program, and linked data representing an operation associated with the broadcast content. 21), the decoding unit 22 for decoding the received stream, the middleware 23 for executing the decoded content robot control program and the interlocking data collected by the content robot control program to the content robot 5; It includes a transmitting unit for transmitting.

The receiver receives the stream sent as shown in FIG. 3 or 4. The stream includes broadcast content, a content robot control program for controlling the content robot 5, and linked data representing an operation performed by the content robot 5 in association with the broadcast content.

The decoding unit 22 decodes the received stream according to a predetermined decoding algorithm.

The decoded broadcast content is transmitted to the client's television and provided to the viewer in video or audio.

The decoded content robot control program is executed by the middleware 23 embedded in the set-top box 2 or installed in the set-top box 2 and executed by itself to control the operation of the content robot 5. According to an embodiment, when the content robot 5 is provided with a display means capable of displaying an image, the content robot control program may control the displayed image.

The decoded interlocking data is transmitted to the content robot 5 by the executed content robot control program.

The middleware 23 executes the decoded content robot control program. According to an embodiment of the present invention, the middleware 23 may automatically download the content robot control program and automatically execute the control program automatically or by receiving a user input. According to an embodiment, the content robot control program may be installed in the set-top box 2 and executed by itself.

The executed content robot control program downloads the coordinated data and transmits it to the content robot 5.

As illustrated in FIG. 3, the companion data may be included in a broadcast stream and received from a broadcast station together with broadcast content. In some embodiments, the companion data may be separately downloaded from an external server separately from the broadcast content. That is, the broadcast content may be transmitted through a transport stream from a broadcasting station, and the companion data may be separately downloaded from a server of another service company, not a broadcasting station.

According to an embodiment of the present invention, the content robot control program may generate and transmit an operation start signal and an operation end signal of the content robot.

As a result, the content robot 5 may receive the generated operation start signal to start a series of motions associated with the broadcast content, or may initiate output of a series of voices and images associated with the broadcast content. have.

On the contrary, the content robot 5 may end the output of the series of motions, voices, and images by receiving the generated motion termination signal.

According to an embodiment, the content robot control program may generate and transmit sync data for synchronizing a timer included in the content robot with an output time of the broadcast content.

As a result, the time information output by the timer included in the content robot 5 and the output time of the broadcast content are synchronized so that the content robot 5 desires the motion information and the media information included in the interworking data. Can be done accurately.

According to an embodiment, the content robot control program transmits an event signal included in a transport stream to the content robot 5 to synchronize a timer included in the content robot 5 with an output time of the broadcast content. In addition, the content robot 5 may provide timing information of an operation to be performed, for example, a motion, an image output, or an audio output.

The content robot control program is extracted from the stream by the middleware 23 and downloaded to the set top box (2). Preferably, the set-top box 2 of the present invention may be configured to drive JAVA Xlet. Accordingly, the content robot control program may also be produced based on JAVA Xlet, but the present invention is not limited thereto. It can be produced in various ways according to the programming language constituting the box.

The transmitter 24 transmits the coordinated data extracted by the content robot control program to the content robot 5.

The transmission unit 24 of the set-top box 2 and the communication unit of the content robot 5 may be connected by wire or wirelessly to transmit and receive data.

6 is a block diagram of a content robot according to an embodiment of the present invention.

Hereinafter, the configuration of the content robot shown in FIG. 6 will be described in conjunction with a flowchart describing a control method of the content robot shown in FIG. 8.

As shown in FIG. 6, the content robot 5 according to an embodiment of the present invention may include a timer 11 for outputting time information, sync data for synchronizing the timer with a broadcast content output time, and the broadcast content. Communication unit 12 for receiving the interlocking data representing the operation of the operation, the control unit for comparing the output time information and the time stamp recorded in the interlocking data, and selects the interlocking data recorded with the time stamp matching the time information (13) and a driver 14 for performing an operation associated with the broadcast content in response to the selected interlocking data.

The timer 11 is provided inside the content robot 5 to output predetermined time information.

According to an embodiment, since the time information output by the timer 11 may have an error with the output time of the broadcast content, the sync data may be received from the set-top box 2 to be synchronized with the output time of the broadcast content. Can be.

As described above, the sync data is generated by the content robot control program executed by the middleware of the set top box 2.

Therefore, the content robot 5 may perform a series of operations associated with broadcast content accurately at the required time.

The communication unit 12 receives the sync data and the interworking data from the set top box 2 (step S81).

According to an embodiment, the received sync data and the interworking data may be stored in the storage unit 16.

As described above, the timer 11 is synchronized with the output time of the broadcast content, that is, the playback time, using the received sync data (step S82).

According to an embodiment of the present invention, the sync data may be generated based on event information included in a broadcast stream for transmitting the broadcast content. That is, the content robot 5 may receive event information included in the broadcast stream and synchronize time information output by the timer with the output time of the broadcast content.

The controller 13 compares time information output by the synchronized timer with a time stamp recorded in the received interlocking data. Then, the interlocking data in which a time stamp coinciding with the time information is recorded is selected to control the driving unit 14 to perform a predetermined operation corresponding to the interlocking data.

7 is a conceptual diagram illustrating a packet structure of interworking data according to an embodiment of the present invention.

As shown in FIG. 7, the communication unit 12 receives a plurality of interworking data from the set top box 2.

According to an embodiment, the communication unit 12 may receive interworking data for the entire broadcast content once. The received interlocked data is stored in the storage unit 16.

The interworking data 71 may include a time field, an ID field, a motion code field, and a media data field.

According to an embodiment of the present invention, the controller 13 compares the time information output by the synchronized timer 11 with the time stamp recorded in the time field of the interlocking data 71 (step S83).

When the time information and the time stamp coincide with each other as a result of the comparison (step S84), the control unit 13 selects the interlocking data in which the time stamp matching the time information of the timer 11 is recorded (step S85). The driver 14 may control to perform an operation corresponding to the interlocked data (step S86).

For example, when the time information output by the current timer 11 is 6 seconds, since the time stamp included in the last interlocking data 75 of the interlocking data shown in FIG. 7 is 6 seconds, the controller 13 The last interlocking data 75 is selected and the driving unit 16 is controlled based on this.

According to an embodiment, the companion data may include motion information or voice information representing a part of a scenario of the broadcast content.

For example, if the broadcast content is an animation in which characters A, B, and C appear, the coordinated data may include motion information and voice information representing a part of a scenario of the animation, for example, motion and dialogue of character C. have.

Accordingly, the content robot 5 which has received the interlocking data may perform the motion and dialogue of the character C in animation in synchronization with the animation.

According to an embodiment, two or more content robots 5 may be connected to the set top box 2 to perform some or all of the scenarios. For example, when the content robot A and the content robot B are connected to the set top box 2, each content robot can perform the motion and dialogue of the characters A and B of the animation.

According to an embodiment, the plurality of content robots may be connected in series without being connected to the set top box 2. That is, one content robot is connected to the set top box 2, and the other content robot is connected to the communication unit 12 of the content robot connected to the set top box to transmit and receive data.

In some embodiments, the interworking data may further include ID information.

As shown in FIG. 7, the linkage data includes an ID field, and compares ID information recorded in the ID field with ID information assigned to the content robot 5 to match the ID information of the content robot. Only interworking data including ID information may be enabled.

According to an embodiment of the present invention, the companion data may include predetermined gesture information or voice information that interacts with the video or audio included in the broadcast content.

For example, when the broadcast content is an English education program, the content robot 5 responds to the instructor's instruction or pronunciation in response to the instructor's instruction or pronunciation in the English education program. The interlocking data may include predetermined gesture information or voice information so as to output a voice to be followed.

For example, as shown in FIG. 7, the first interlocking data 71 and the second interlocking data 72 include motion information expressing "failure," and the third interlocking data 73 and four. The first interlocking data 74 may include voice information saying "hello".

If the broadcast content is an English education program and the instructor salutes the broadcast content for 1 second, the content robot that receives the first interlocking data 71 and the second interlocking data 72, that is, the content. Robots A and B may be greeted with the instructor to operate to interact with the broadcast content.

In addition, when the instructor of the broadcast content says "hello" in 2 seconds of the playback time, the content robots A and B that have received the third interlocking data 73 and the fourth interlocking data 74 are the broadcast content output time. It may be operated to interact with the broadcast content by replying "hello" at 3 seconds of the playing time.

The driver 14 performs a series of operations associated with the broadcast content in response to the companion data.

According to an embodiment, the driving unit 14 may include a motor unit 141 for moving the joint of the content robot 5, a light emitting unit 142 for emitting the predetermined light, and a speaker unit for outputting the predetermined voice ( 143).

The motor unit 141 drives the joint of the content robot 5. For example, by moving five joints such as the neck joint, the shoulder joint, and the leg joint of the content robot 5 in a predetermined direction, the content robot 5 performs a series of operations associated with broadcast contents.

The light emitting unit 142 is provided in the content robot 5 to emit a predetermined light. For example, it is provided in the eye portion of the content robot 5 to perform a series of light outputs associated with the broadcast content.

The speaker unit 143 is provided in the content robot 5 to output a predetermined voice. For example, dialogue of a character appearing in the broadcast content, interjection of interaction with the broadcast content, and the like may be output as voice.

According to an embodiment of the present invention, the content robot 5 may further include an input unit 15 that receives an input of a user in response to an operation performed by the broadcast content or the content robot 5.

For example, when the content robot 5 reaches out to the user, that is, the viewer of the broadcast content, the user may shake hands by holding the hand of the content robot 5. In this case, the content robot 5 may detect a user holding the content robot's hand and output a predetermined feedback, for example, a voice of “welcome”.

According to an embodiment of the present invention, the input unit 15 may include a touch sensor unit that senses a user's touch, a voice identification unit that recognizes a voice, a motion sensor unit that detects a user's movement, and the user enters the content robot 5. ) May include a gyro sensor unit or an acceleration sensor unit that detects a hug or shake.

In this case, the controller 13 may output a predetermined feedback in response to the input of the user, for example, a laughter sound output by the speaker unit 143 when the user hugs the content robot 5. Can be provided to

The above-described content robot control method of the present invention may be produced as a program for execution on a computer and stored in a computer-readable recording medium.

In addition, the broadcast content, the content robot control program for controlling the operation of the content robot, and the interlocking data representing the motion of the content robot associated with the broadcast content may be stored in a computer-readable recording medium.

The computer readable recording medium includes all kinds of storage devices in which data that can be read by a computer system is stored. Examples of computer-readable recording media include ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

Although the present invention has been described through the above embodiments, the above embodiments are merely intended to illustrate the spirit of the present invention, and the present invention is not limited thereto. Those skilled in the art will appreciate that various modifications may be made to the embodiments described above. The scope of the invention is defined only by the interpretation of the appended claims.

Claims (21)

A timer for outputting time information; A communication unit configured to receive sync data for synchronizing the timer with a broadcast content output time and interworking data representing an operation associated with the broadcast content; A controller for comparing the output time information with a time stamp recorded in the interlocking data and selecting interlocking data in which a time stamp matching the time information is recorded; And A driver configured to perform an operation associated with the broadcast content in response to the selected coordinated data; Content robot comprising a. The method of claim 1, The interlocking data includes content information or voice information representing part of a scenario of the broadcast content. The method of claim 1, The interlocking data includes a content gesture or voice information that interacts with an image or sound included in the broadcast content. The method of claim 1, The interworking data includes ID information. And the control unit compares the ID information with the ID information of the content robot and selects interlocking data including ID information that matches the ID information of the content robot. The method of claim 1, wherein the driving unit A motor unit moving a joint of the content robot; Light emitting unit for emitting a predetermined light; And A speaker unit for outputting a predetermined voice; Content robot comprising a. The method of claim 1, And an input unit configured to receive a user input in response to the broadcast content or an operation associated with the broadcast content. The method of claim 6, The controller controls the driver to provide a predetermined feedback in response to the user input. The method of claim 1, The sync data is generated based on the event information included in the broadcast stream for transmitting the broadcast content. Receiving sync data synchronizing a timer with a broadcast content output time and interlocking data representing an operation associated with the broadcast content; Synchronizing the timer with the broadcast content output time using the sync data; Comparing time information output by the synchronized timer with a time stamp recorded in the interworking data; Selecting interlocking data in which a time stamp matching the time information is recorded; And Performing an operation associated with the broadcast content in response to the selected coordinated data; Content robot control method comprising a. The method of claim 9, The coordinated data includes a content robot control method including motion information or voice information representing a part of the scenario of the broadcast content. The method of claim 9, The interlock data includes a predetermined gesture information or voice information interacting with the video or audio included in the broadcast content. The method of claim 9, The interworking data includes ID information. After the receiving step, Comparing the ID information with ID information of the content robot; And selecting the interlocking data including ID information corresponding to the ID information of the content robot. The method of claim 9, wherein the performing of the operation associated with the broadcast content comprises moving a joint of the content robot, emitting a predetermined light, or outputting a predetermined voice. The method of claim 9, And receiving a user input in response to an operation associated with the broadcast content or the broadcast content of the content robot. The method of claim 14, Providing predetermined feedback in response to the user input. The method of claim 9, And the sync data is generated based on event information included in a broadcast stream for transmitting the broadcast content. Broadcast content including video or audio; A content robot control program for controlling the operation of the content robot; And Interlocking data representing an operation of the content robot associated with the broadcast content; Recording medium comprising a. The method of claim 17, And the content robot control program generates an operation start signal and an operation end signal of the content robot. The method of claim 17, And the content robot control program generates sync data for synchronizing a timer included in the content robot with an output time of the broadcast content. The method of claim 17, The coordinated data includes motion information or voice information representing a part of a scenario of the broadcast content. The method of claim 17, The interlocking data includes predetermined gesture information or audio information that interacts with the video or audio included in the broadcast content.

Images