JP4778344B2 - Interactive content presentation apparatus and interactive content presentation program - Google Patents

Description

  The present invention relates to an interactive content presentation device and an interactive content presentation program, and more particularly, to an interactive content presentation device and an interactive content presentation program for realizing high-precision effects at the time of transition between content and interactive scenes.

  Conventionally, when a viewer asks a question to a program host while watching a content such as a program, it is possible to obtain an answer to the question by interrupting the program and directly interacting with the program host. There are various mechanisms (for example, see Patent Document 1).

In the technique disclosed in Patent Document 1, the viewer has a function of interacting with the viewer asynchronously while viewing the Push-type program, and the contents of the program are questioned even while viewing the Push-type program. If you want to know more detailed information, you can search for Pull-type program information and move between Push-type programs and Pull-type programs.
JP 2003-219391 A

  By the way, in the conventional method, program generation data for generating a program (content) set in advance on the production side and dialog scene generation data for performing a conversation scene are described in a common format. Both use the same program / dialog generation engine. As a result, it is possible to continue the relationship between the set of programs and props that have been viewed until now, and the performers.

  However, at the time of transition to the conversation scene with the program host, there is no means for processing what program scene is presented to the viewer, and there is discontinuity in the transition between the program scene and the conversation scene. Occurred and the scene transition could not be performed smoothly. Therefore, when the transition to the conversation scene is made during the program, there is not enough production, so the flow of the entire program is uncomfortable.

  The present invention has been made in view of the above-described problems, and it is an object of the present invention to provide an interactive content presentation apparatus and an interactive content presentation program for realizing high-precision effects at the time of transition between content and interactive scenes. And

  In order to solve the above problems, the present invention employs means for solving the problems having the following characteristics.

Invention described in claim 1, in interactive content presentation device you come dialogue scene to perform answer interactively to questions from the audience based on presented content, preset content generated Content script for reproducing the content from data , content generation means for generating content information metadata for each scene in the content, content information metadata obtained by the content generation means, and interrupt input from the viewer based on the real-time content script of a point in time is a dialogue scene generation means for generating a dialogue scene scripts, and a reproducing means for reproducing the interactive content by the content script and dialogue scene scripts, said reproducing means , Interrupt from the viewer The content script being reproduced at the time of input is extracted as the real-time content script, and the dialog scene generation means is the content information metadata obtained by the content generation means or the reproduction means obtained by the reproduction means Corresponding to the content of the real-time content script, one is selected from a plurality of preset effect change data, and the dialog scene script is generated using the selected effect change data .

According to the first aspect of the present invention, the transition between the content and the conversation scene can be performed smoothly. Therefore, it is possible to realize a highly accurate effect. In addition, since the transition between the content and the conversation scene can be smoothly performed for each scene, it is possible to accurately inherit the contents of the different effects for each scene. In addition, since the content of the content currently being played back can be accurately acquired, switching to the conversation scene can be performed smoothly without a sense of discomfort to the viewer. Furthermore, the range of the production in the conversation scene can be expanded by using the production change data. In addition, the production of various dialogue scenes can be realized, and the dialogue can be made more attractive. Therefore, it is possible to realize a highly accurate effect at the time of transition between the content and the conversation scene.

  The invention described in claim 2 has switching control means for switching the content script or the interactive scene script and outputting it to the reproduction means based on the presence or absence of the interrupt input from the viewer or the input content. And

  According to the second aspect of the present invention, the transition between the contents and the conversation scene can be smoothly performed without any sense of incongruity to the viewer based on the presence or absence of the interrupt input from the viewer or the input content.

  According to a third aspect of the present invention, in the dialog scene, when question data for the content being played back is input from the viewer, dialog generation corresponding to the question data is performed from a plurality of preset dialog generation data. It has a search means for extracting data.

  According to the invention described in claim 3, the answer data desired by the viewer can be extracted with high accuracy by the search means, and the conversation scene can be generated with high accuracy based on the extracted answer data.

The invention described in claim 4, wherein the dialogue scene generation means, before based on the logger content information metadata, and generates a script that inherits a performance before switching to the dialogue scene.

According to the fourth aspect of the present invention, when the conversation scene is generated, the effect of the content being reproduced that has been output can be inherited and used as it is. For this reason, it is possible to output a dialogue scene using an effect that allows an image, video, audio, or the like to be produced in the content from a dialogue in which the performer simply speaks. In addition, the conversation using effective production as a program makes the conversation scene more diverse and fun. Therefore, it is possible to realize a highly accurate effect at the time of transition between the content and the conversation scene.

The invention described in claim 5, a computer, an interactive content presentation program for causing to function as each unit included in the interactive content presentation device according to any one of claims 1 to 4.

According to the fifth aspect of the present invention, it is possible to realize a highly accurate effect at the time of transition between the content and the conversation scene. In addition, interactive content can be easily presented by installing an execution program in a computer.

  According to the present invention, it is possible to realize a highly accurate effect at the time of transition between content and a conversation scene.

<Outline of the present invention>
In the present invention, for example, in the production and viewing of content such as a TV program, when a program performer directly asks the program performer that he / she wondered while viewing the content, the program performer becomes a viewer's dialogue partner. When presenting an answer to a question, an answer with an effect is made by using information of a program that has been viewed so far, thereby enabling effective dialogue.

  Specifically, according to the present invention, when the program generation engine generates a program script using the program generation data, program information metadata is also generated and added to the program script. Also, when shifting from program viewing to dialogue, a dialogue script that can smoothly connect to the immediately preceding program scene is generated from this metadata. Thereby, in any program scene, it is possible to smoothly transition to a conversation scene, and it is possible to generate a conversation scene to which more various effects are added.

  In the following, a preferred embodiment of the interactive content presentation apparatus and interactive content presentation program of the present invention having the above-described features will be described in detail with reference to the drawings.

  In the present embodiment, program content is used as an example of interactive content. Furthermore, in the present embodiment, TVML (TV program Marking Language) is used as an example of a script used for program generation and presentation. Here, TVML is an object-based description language for producing a television program. TVML describes video and audio of a TV program divided into materials and scripts (production contents). When a program script is described, software that runs on a personal computer or the like reads it and instantly reads the TV program. It can be viewed (presented) as a program. The present invention is not limited to TVML, and an expression format other than TVML may be used.

  Furthermore, an interactive program presentation apparatus as an embodiment of the present invention described below has a function of an automatic program production apparatus (TV 4U). The TV 4U downloads a script of a program produced on the producer side, an arbitrary program production engine to the script, materials used for the produced program, etc. from a server etc., and uses CG (Computer Graphics), voice synthesis, etc. By playing the program, the viewer can view it.

  The above-described program production engine is a CG character such as a program presenter or a performer appearing in a program or a unit of one operation in a program such as “title display”, “zoom-in”, “CG character operation”, etc. Events are defined in advance, and by using this program production engine, it is possible to efficiently realize program production of a predetermined genre such as news, variety, sports, and drama.

<Interactive Content Presentation Device: Functional Configuration>
FIG. 1 is a diagram illustrating an example of a functional configuration of the interactive content presentation apparatus. An interactive content presentation apparatus 10 shown in FIG. 1 includes an input unit 11, an output unit 12, a storage unit 13, a program generation unit (content generation unit) 14, a dialogue scene generation unit 15, and a switching control unit 16. The reproduction means 17, the search means 18, and the control means 19 are configured.

  The input unit 11 receives an input of a program playback instruction from a viewer (user) or the like, or a question sentence for moving to a conversation scene. Note that the input unit 11 includes a pointing device such as a keyboard and a mouse, and a voice input interface such as a microphone.

  Further, the output unit 12 displays and outputs the contents of the instruction input by the input unit 11 and the contents of the program and the conversation scene reproduced based on the instruction contents. The output unit 12 includes a display, a speaker, and the like.

  The storage means 13 includes a TVML script data group for program setup, a program generation data (template), a dialog response dictionary (response script) including dialog generation data (template), a TVML script group, etc., wired or wireless in advance. Obtained from a server (not shown) connected by a communication network or the like.

  The storage means 13 stores a program production engine, a script, a material, a program TVML script generated by the program generation means 14, a dialog TVML script generated by the dialog scene generation means 15, and the like. The storage means 13 is a collection of character information, image information, and other information, and is systematically configured so that such information can be searched.

  The program generation means 14 is a program generation engine that generates a script for a program based on program generation data based on a preset effect. Specifically, the program generation means 14 generates a TVML script (program TVML script) as a script for the program.

  The program generation unit 14 generates a TVML script for program setup and a program content script in which the program content is described as the program TVML script. TVML script for program setup is what kind of studio set, prop, lighting, and performer as a program (including relationships between performers (gender, age, personality, occupation (singer, commentator, comedian, etc.)) A TVML script for specifying initial setting information of a program such as whether to use sound is described.

  The program generation unit 14 outputs the TVML script generated as a program to the switching control unit 16. Further, the program generation unit 14 generates program information metadata from a TVML script generated as a program. The generated metadata is data described in a predetermined description format such as an XML (extensible Markup Language) format.

  The program generation unit 14 outputs the extracted program information metadata to the dialogue scene generation unit 15. Note that the program information metadata may be added to the above-described program TVML script and output to the playback means 17 via the switching control means 16.

  The dialog scene generation means 15 extracts the corresponding dialog generation data from the storage means 13 based on the dialog contents from the viewer and the program information metadata obtained from the program generation means 14, and for the dialog scene. It is a dialog generation engine that generates a script for. Specifically, the dialogue scene generation means 15 generates a TVML script (dialog TVML script) as a dialogue script. That is, the dialog scene generation means 15 generates a dialog content script in which the dialog content is described as a dialog TVML script.

  Here, a real-time TVML script of the program being reproduced by the reproducing means 17 and being reproduced by the output means 12 is input to the dialogue scene generating means 15. Therefore, the dialog scene generation means 15 uses the program information metadata and the real-time TVML script at the time when the interrupt trigger is applied to the program used by the viewer, and the dialog to which the effect suitable for the program scene at the time of the interrupt is added. Generate a TVML script.

  In addition, when the user inputs production change data for changing the production scene in the dialogue scene, the dialogue scene generation means 15 generates the dialogue scene including the information on the production change data in the information described above. To do.

  Further, the switching control means 16 switches between the program TVML script generated by the program generation means 14 and the conversation TVML script generated by the conversation scene generation means 15 in response to an interrupt trigger from the viewer. The script is output to the reproduction means 17. Further, the switching control means 16 receives the program TVML script from the program generation means 14 when there is no viewer input from the input means 11 for a predetermined time or more, or when an instruction input for performing a preset end is performed. Switch to input.

  The playback unit 17 plays back the program TVML script generated by the program generation unit 14 or the dialog TVML script generated by the dialog scene generation unit 15. Note that, when the program TVML script includes the above-described program information metadata, the reproducing unit 17 generates a program using normal metadata excluding the metadata portion. Further, the playback unit 17 extracts the TVML script of the content being played back when the viewer receives an interrupt input, and outputs the extracted real-time TVML script to the dialog scene generation unit 15.

  Note that the reproduction means 17 has a function of a TVML player or the like. The TVML player is software that can read a script described in TVML and output video and audio of a program in real time. In addition, the TVML player generates a studio set with real-time CG, and a CG character such as a program presenter or a performer appearing in the CG studio set speaks the speech described in the TVML script with synthesized speech and acts. It has a function to display the place.

  In addition, the TVML player also generates video and audio for programs by generating video playback, title display and superimpose with character fonts and images, BGM playback with audio data file playback, synthesized voice narration, etc. in real time. It has the function to do. The playback means 17 can play back an efficient and highly accurate program and a conversation scene by using these functions.

  The search means 18 searches the data group stored in the storage means 13 based on the contents of question data, dialogue data, voice data, etc. input by the input means 11 and extracts corresponding answers. The search means 18 generates the question data from the character string or tag information included in the input data such as question data, dialogue data, and voice input when searching the data included in the storage means 13, and the generated question Search data based on the data.

  The control means 19 controls the entire functional configuration of the interactive content presentation device 10. Specifically, the control unit 19 causes the program generation unit 14 to generate a TVML script for a program based on an instruction from the viewer through the input unit 11, or causes the search unit 18 to search based on question data or the like. In addition, based on the answer data obtained by the search, the dialog scene generation means 15 performs control such as generating a TVML script for dialog.

  In the interactive content presentation device 10 described above, the storage unit 13 is included in the external device, and the external device connected via a communication network (wired or wireless) such as a LAN (Local Area Network) is accessed. Then, desired data may be acquired or various data may be accumulated.

<Specific examples of content presentation>
Next, a specific example of content presentation using the interactive content presentation device 10 described above will be described with reference to the drawings. FIG. 2 is a diagram illustrating an example of a flow up to presentation of a program or a dialogue scene.

  First, when a normal program is presented to the viewer 21, a program TVML script is generated from the program generation data 22 stored in the storage unit 13 by the program generation unit 14. In addition, the program generation unit 14 outputs program information metadata described by defining a unique tag corresponding to the generated program TVML script to the dialogue scene generation unit 15.

  Here, the program TVML script generated by the program generation means 14 is reproduced by the TVML player as the reproduction means 17 via the switching control means 16, and the reproduced program is displayed by the output means 12. Let the user 21 view it.

  Here, when there is a question from the viewer 21 while watching the program, for example, as shown in FIG. 2, when an input means 11 such as an interactive microphone or an interactive keyboard is used as an interrupt trigger, An interrupt trigger is output to the switching control unit 16 and the TVML player 17, and the conversation content from the input unit 11 is output to the conversation scene generation unit 15.

  The switching control means 16 switches between the program TVML script and the interactive TVML script by an interrupt trigger signal. Further, the TVML player extracts a real-time TVML script of the currently played program, and outputs the extracted real-time TVML script to the dialogue scene generation means 15.

  The dialogue scene generation unit 15 searches the dialogue generation data 23 based on the question data included in the dialogue contents using the program information metadata and the real-time TVML script at the time when the interruption trigger occurs, and extracts the extracted answer data. An interactive TVML script to which an effect suitable for the program scene at the time of interruption is added is generated. Next, in the generated interactive TVML script, the interactive scene is reproduced by the TVML player via the switching control means 16, and video and audio are output by the output means 12 such as a display.

  When the viewer ends the question, the switching control means is configured by inputting a preset instruction indicating interruption end by the input means 11 or by not performing the instruction by the input means 11 for a predetermined time or more. 16 can reproduce the following program using the program TVML script from the program generating means 14. Therefore, the transition between the content such as a program and the conversation scene can be performed smoothly, and a highly accurate effect can be realized.

<Program generation data>
Here, program generation data (script data) in the present invention will be described with reference to the drawings.

  FIG. 3 is a diagram illustrating a description example of program generation data. For convenience, line numbers are assigned to the left side of FIG. As shown in FIG. 3, the program generation data is described in the XML format. Also, in the data, for example, what program / dialog generation engine is used, the title and subtitle of the program, the dialogue that the performer speaks in the program, the name of the image, sound, and video data used in the program The production style is defined by defining a unique tag.

  Specifically, in FIG. 3, the (01) line describes the XML sentence declaration, and the (03) line describes the program to be used and the file name of the dialog generation engine. Line (04) describes the title of the program, line (05) describes the subtitle of the program, and lines (07) and (08) describe the lines spoken by the performers. In line (09), the name of an image file to be displayed by taking-off as one of the effects is described. The program generation data 22 as described above is stored in the storage unit 13 together with material data such as images and videos in accordance with the effects and contents of the program.

<Program generation means>
Next, the processing content of the program generation means 14 is demonstrated using figures. FIG. 4 is a diagram illustrating an example of the processing content of program generation. In FIG. 4, a program generation engine is used as the program generation unit 14. FIG. 4 shows an example of input text of metadata of program generation data to be input for the program generation process (FIG. 4 (a)), and meta data of a template TVML script group set in advance to generate a scene with effects. A data example (FIG. 4B), a program TVML script example generated by the program generation means 14 (FIG. 4C), and a program information metadata example (FIG. 4D) are shown. For convenience, a row number is assigned to the left side of each metadata.

  The example of the template script shown in FIG. 4B is a script example in the case where the <fullimage> tag exists in the program generation data shown in FIG. As shown in FIG. 4, in the program generation engine, by inputting the information of the program generation data into a template script having a program configuration corresponding to the tag based on the tag information of the program generation data (FIG. 4A), A TVML script is generated. Furthermore, in the present invention, metadata information regarding the scene of the TVML script is added as shown in FIG.

  More specifically, information such as what kind of scene the TVTV script set generates as a program scene is added to the TVTV script set as program scene metadata. The program scene metadata is described in XML format.

  That is, in the present invention, metadata for generating program information metadata shown in the (01) and (02) lines in FIG. 4B is stored in the template. The positions of these metadata may be before or after the conventional template scripts (03) and (04), or between the template scripts.

  Based on this metadata, the program generation means 14 outputs a TVML script as shown in FIG. 4C and program information metadata as shown in FIG. Here, the (01) to (06) lines of the TVML script and the program information metadata are scripts having the same contents as the program information metadata, and the script set is the third in the (01) line. It shows that it is a scene, (02) indicates that the camera is not specified in the cut-out image display on the (02) line, (03) indicates that it is a talking scene and is narrated by the narration, (04 ) Line indicates that the program is the main part, (05) Line indicates that a description is being performed, (06) Line is a still image used, and BGM is not used Is generated. Therefore, the contents of each scene can be read based on the contents defined in the (01) and (02) lines of the template TVML script as shown in FIG.

  Note that the data defined by the template TVML script is not limited to the metadata shown in FIG. FIG. 5 is a diagram illustrating an example of metadata that can be defined in the present embodiment. As shown in FIG. 5, for example, a desired content is selected from various settings such as a studio, lighting, props, character, camera, sound, moving image, title, and the like to generate a script. The type of metadata is not limited to this, and can be set as appropriate according to the type of content.

<First Dialog Scene Generation Example by Dialog Scene Generation Unit>
Next, the operation content of the dialogue scene generation means in the present invention will be described with reference to the drawings. FIG. 6 is a diagram for explaining a first interactive scene generation example in the present invention. FIG. 6 shows an example of program information metadata used when generating a conversation scene (FIG. 6A), an example of metadata of a real-time TVML script (FIG. 6B), and an example of metadata of dialog data ( FIG. 6 (c)) is shown.

  In the example shown in FIG. 6, there is an interrupt process from a viewer or the like during the generation of a program related to mushrooms (boletus mushrooms), and an interactive scene that introduces dishes using the mushrooms is generated.

  First, the program generation unit 14 outputs the program information metadata (FIG. 6A) generated together with the program TVML script to the dialogue scene generation unit 15. Here, when there is an interruption process from a viewer or the like during viewing (reproduction) of the program, the metadata of the real-time TVML script that has been reproduced by the reproduction means 17 up to the present time triggered by the interruption. (FIG. 6B) is output to the dialogue scene generating means 15. The metadata shown in FIGS. 6A and 6B described above may be given a scene number for identifying a scene.

  The dialog scene generation means 15 can know from the input program information metadata that the program scene is a scene where “the program scene is a still image cut out and narrated”.

  At this time, it can be seen that the scene of the program being played when the viewer interrupts the scene is a scene in which the narration is inserted after the still image is taken out. Therefore, even after entering the conversation mode at the time of interruption, the conversation scene in which the narrator becomes the viewer's conversation partner as it is based on the information obtained by the real-time TVML script and the contents of the conversation data (FIG. 6C). A TVML script can be generated.

  Here, FIG. 7 is a diagram for explaining an output example of the dialogue scene TVML script based on FIG. FIG. 8 is a diagram for explaining an actual screen example of the conversation scene corresponding to FIG. In the example shown in FIG. 7, the program information metadata shown in FIG. 6A has already been input, and the program information metadata indicates that “the program scene is a still image cut-off and has narration”. Can be recognized. At this time, as shown in FIG. 8 (a), a cut-out image described in the program TVML script and a narration "This is porcini mushroom" are output.

  Here, when there is an interrupt process from the viewer but there is no content of the question, for example, when the start of input of voice or characters is used as an interrupt trigger, the message at the start of the dialogue is shown in FIG. ), Metadata for starting a conversation scene such as “<text> yes, what? </ Text>” is set in advance, and the conversation scene TVML script “narration: talk (name) = Narrator, text = “Yes, what is it?” ”Is generated to prompt the viewer to input the question content (FIG. 8B).

  Further, when the question content is input from the viewer by the input means 11, the dialog generation data is searched based on the input content, and the dialog scene as shown in FIG. 7B is based on the extracted dialog data. TVML script (title: display (type = imagefile, filename = “dish001.jpg”), narration: Talk (name = narrator, text = “is a risotto”), narration: Talk (name = artrator = name = artrate ... ")) etc., and generates and outputs a dialogue scene TVML script (FIG. 8 (c)).

  In FIG. 7B, an example of a dialogue template script at the time of narration that is set in advance is described in the dialogue scene generation means 15, and for example, an image tag is included in the dialogue data extracted by the search. When input, it is set to display an image with a title command and to narrate when a text tag is input. Thereby, as shown in FIG.8 (c), the switching of a screen and the narration by the same person (voice) are realizable.

  In this way, the dialog scene generation means 15 sets the dialog scene to be generated according to the content (tag) of the dialog generation data, thereby not only displaying the dialog generation data but also making it more seamless to the viewer. An interactive scene can be presented by simple switching. Therefore, it is possible to realize a highly accurate effect at the time of transition between the content and the conversation scene.

<Second Dialog Scene Generation Example by Dialog Scene Generation Unit>
Next, the operation content of the dialogue scene generation means in the present invention will be described with reference to the drawings. FIG. 9 is a diagram for explaining a second dialog scene generation example in the present invention. FIG. 10 is a diagram for explaining an actual screen example of the conversation scene corresponding to FIG.

  9, similar to FIG. 6, an example of program information metadata used when generating a conversation scene (FIG. 9A), a real-time TVML script metadata example (FIG. 9B), a dialog An example of metadata of data (FIG. 9C) and an example of metadata of an interactive scene TVML script (FIGS. 9D1 and 9D2) are shown.

  The content of the program used in the second interactive scene generation example shows an example of a scene in which two performers are explaining using inset images in the studio when there is an interrupt trigger from the viewer ing. In this case, one of the performers is in charge of speaking in the dialogue scene, and the dialogue data image is used as an inset image. As described above, by using the program information metadata at the time of interruption, a conversation scene can be generated in accordance with the scene at the time of interruption.

  That is, in the second dialog scene generation example shown in FIG. 9, the program information metadata (FIG. 9A) indicates that “the program scene is a studio 2 shot, using an embedded still image, and two performers. , One of them, Mattsu is explaining ”.

  Here, as shown in FIG. 10 (a), if one of the performers (Mattsu) is explaining a mushroom (Porcini) and there is an interrupt process from a viewer or the like, the real-time TVML script The metadata “character: talk (name = Matsutsu text =“ This is a porcini mushroom ”) is input to the dialogue scene generation means 15.

  In addition, in the interrupt process from the viewer or the like, if the contents of the question are not clear, as shown in FIG. 9 (d1), a conversation scene is started by the same performer (Mattsu) as described above. Generate a script that In this case, a template that allows the performer to explain is used as an inset image display in addition to the generated content described above. That is, as shown in FIG. 10 (b), the same performer outputs a voice saying "Yes, what?" At this time, the performer may be operated simultaneously with the sound.

  Further, when any processing is performed based on the question data from the viewer, the dialogue scene generation data 23 is searched based on the contents, and the corresponding dialogue data is extracted, and is shown in FIG. 9 (d1). Such an interactive scene TVML script is generated, and answer data for the question data is displayed to the viewer. As a result, as shown in FIG. 10C, it is possible to smoothly realize screen switching and a conversation scene by the same person (voice). Therefore, it is possible to realize a highly accurate effect at the time of transition between the content and the conversation scene.

<Third Dialog Scene Generation Example by Dialog Scene Generation Unit>
Next, the operation content of the dialogue scene generation means in the present invention will be described with reference to the drawings. FIG. 11 is a diagram for explaining a third interactive scene generation example in the present invention. FIG. 12 is a diagram for explaining an example of an actual screen of the conversation scene corresponding to FIG.

  In FIG. 11, similar to FIG. 9, an example of program information metadata (FIG. 11A) used when generating a conversation scene, an example of metadata of a real-time TVML script (FIG. 11B), a dialog An example of metadata of data (FIG. 11C) and an example of metadata of an interactive scene TVML script (FIGS. 11D1 and 11D2) are shown.

  Further, in FIG. 11, production change data 31 including production contents such as performers and studio sets is input in order to make the production completely different at the time of transition to the dialogue scene. Thereby, it is possible to provide the viewer with a conversation scene that is completely different from the program.

  The effect change data 31 may be stored in the storage unit 13 described above, and the dialog scene generation unit 15 may arbitrarily select it, or the viewer may set a dialog character, studio set, or the like. Good. Furthermore, specific data is extracted from the plurality of effect change data 31 based on the content of the metadata included in the program information metadata obtained from the program generation means 14 and the content of the real-time TVML script obtained from the reproduction means 17. The generated data can be created.

  In addition, a flag indicating whether the effect change data is valid or invalid may be provided for each extracted dialogue generation data, and the effect change data may be directly described in the dialog generation data. Thereby, a viewer can be made to present with the production | presentation matched with the producer's intention of dialog production | generation data. Thus, for example, dialogue data contains a dialogue for women such as “I ’m wearing a wedding dress” or “I wore a wedding dress”, but in a dialogue scene, a male character hits the dialogue. As a result, it is possible to realize the display of a conversation scene with a high-precision production without giving the viewer a sense of incongruity.

  According to the above-described third dialog scene generation, when a performer explains as a program as shown in FIGS. 12A to 12D (FIG. 12A), an interrupt trigger from the viewer If there is, the screen is switched by wiping or the like based on the effect change data 31 (FIG. 12B).

  Thereafter, a conversation scene as shown in FIGS. 12C and 12D can be realized by a character for the conversation scene (BOB in FIG. 12).

  Note that the dialog scene generation example in the present invention is not limited to this. For example, a combination of a plurality of the first to third generation examples described above is used to produce a dialog scene according to the input metadata tag and content. It can be changed and presented to the viewer.

  With the configuration described above, it is possible to smoothly transition between the content and the conversation scene. Specifically, it is possible to grasp the scene information at the time when the interrupt trigger occurs and the real-time TVML script at that time as information for generating the interactive scene, including information on the program that has been generated so far.

  As a result, it is possible to generate an interactive scene with an effect corresponding to the scene at the time of interruption, while leaving the scene of the program being viewed as it is. In addition, the conversation scene can be smoothly connected to the scene of the program being watched. In addition, it is possible to improve the effect of the production by generating a conversation scene with an effect that does not exist in the program that was being viewed.

  Therefore, any dialogue scene can be generated without breaking down as a program. Furthermore, after the dialogue, it is possible to smoothly connect and return to the production of the original program. As a result, the range of productions possible in the conversation scene is expanded, and the conversation becomes more attractive.

  Here, the interactive content presentation device 10 can provide interactive content according to the present invention with the dedicated device configuration described above, but generates an execution program that can cause a computer to execute the processing in each configuration, For example, interactive content presentation processing can be realized by installing a program in a general-purpose personal computer, server, or the like.

<Hardware configuration>
Here, an example of a hardware configuration of an executable computer in the present invention will be described with reference to the drawings. FIG. 13 is a diagram showing an example of a hardware configuration capable of realizing the interactive content presentation process according to the present invention.

  13 includes an input device 41, an output device 42, a drive device 43, an auxiliary storage device 44, a memory device 45, a CPU (Central Processing Unit) 46 for performing various controls, and a network connection device. 47, which are connected to each other by a system bus B.

  The input device 41 has a pointing device such as a keyboard and a mouse operated by the viewer, and inputs various operation signals such as execution of a program from the viewer. The output device 42 has a display for displaying various windows and data necessary for operating the computer main body for performing processing according to the present invention, and displays the program execution progress, results, and the like by the control program of the CPU 46. can do.

  In the present invention, the execution program installed in the computer main body is provided by the recording medium 48 such as a CD-ROM. The recording medium 48 on which the program is recorded can be set in the drive device 43, and the execution program included in the recording medium 48 is installed in the auxiliary storage device 44 from the recording medium 48 via the drive device 43.

  The auxiliary storage device 44 is storage means such as a hard disk, and can store an execution program in the present invention, a control program provided in a computer, and the like, and can perform input / output as necessary.

  The CPU 46 performs various calculations and data input / output with each hardware component based on a control program such as an OS (Operating System) and an execution program read from the auxiliary storage device 44 and stored in the memory device 45. Each process can be realized by controlling the process of the entire computer. Further, the CPU 46 can acquire various types of information necessary during execution of the program from the auxiliary storage device 44, and can store processing results and the like.

  The network connection device 47 obtains an execution program from another terminal connected to the communication network by connecting to a communication network or the like, or the execution result obtained by executing the program or the execution in the present invention The program itself can be provided to other terminals.

  With the hardware configuration as described above, the interactive content presentation processing can be realized efficiently at a low cost without requiring a special device configuration. Further, by installing the program, the above interactive content presentation process can be easily realized.

<Example of interactive content presentation processing procedure>
Next, the interactive content presentation processing procedure by the execution program in the present invention will be described with reference to a flowchart. FIG. 14 is a flowchart showing an example of interactive content presentation processing in the present invention. FIG. 14 uses “program” as an example of interactive content, but the present invention is not limited to this.

  In FIG. 14, first, program generation data to be provided to the viewer is input (S01), a program TVML script is generated (S02), and program information metadata corresponding to the program TVML script is generated (S03).

  Next, the program is reproduced based on the program reproduction script obtained in the process of S02 (S04), and the program is presented to the viewer to be viewed by the viewer (S05). Here, it is determined whether or not an interrupt trigger is input from a viewer or the like during the reproduction of the program (S06). If an interrupt trigger is input (YES in S06), the current mode is switched to the interactive mode. A real-time TVML script that is a script of a program (scene) output (reproduced) to the viewer is acquired (S07). Next, the question data from the viewer is acquired (S08), and the data (answer data) as the answer is searched from the dialogue generation data accumulated in advance based on the description content of the question data (S09). .

  Next, a TVML script for dialogue is generated based on the dialogue generation data that is the acquired answer data (S10), the dialogue is reproduced based on the generated script (S11), and the dialogue scene is presented to the viewer. (S12).

  Here, it is determined whether or not the dialogue is ended (S13). Specifically, the determination is made when there is no input from the viewer for a predetermined time or more or whether there is an input of instruction information for ending the preset conversation scene from the viewer.

  If the dialogue is not terminated (NO in S13), the process returns to S08 and the above-described processing in the dialogue scene is repeated. If the dialogue is to be ended (YES in S13), or if no interrupt trigger is input in the process of S06 (NO in S06), it is determined whether or not to end the reproduction of the program (S14).

  Here, when the reproduction of the program is not finished (NO in S14), the process returns to S02, a program TVML script corresponding to the next scene of the program is generated, and the above-described processing is repeated. If the program reproduction is to be ended (YES in S14), the interactive content presentation process is ended.

  As described above, the content presentation processing can be easily realized by the interactive content presentation program. Also, by installing the execution program in the computer, the interactive content presentation processing according to the present invention can be easily realized in other terminals. Note that the script described above is not limited to the TVML script, and may be another script.

  As described above, according to the present invention, it is possible to realize a highly accurate effect at the time of transition between content and a conversation scene. Specifically, it is possible to grasp the scene information at the time when the interrupt trigger occurs and the real-time TVML script at that time as information for generating the interactive scene, including information on the program that has been generated so far.

  As a result, it is possible to generate an interactive scene with an effect corresponding to the scene at the time of interruption, while leaving the scene of the program being viewed as it is. In addition, it is possible to smoothly connect to the scene of the program being watched. Furthermore, it is possible to generate a dialogue scene with a presentation that does not exist in the program that was being viewed. Therefore, it is possible to produce various interactive scenes.

  Therefore, any dialogue scene can be generated without breaking down as a program. Furthermore, after the dialogue, it is possible to smoothly connect and return to the production of the original program. As a result, the range of productions possible in the conversation scene is expanded, and the conversation becomes more attractive. In addition, the content in this invention is not limited to a program, It can apply to all content, such as a moving image, a music, a movie, and text information.

  Although the preferred embodiment of the present invention has been described in detail above, the present invention is not limited to the specific embodiment, and various modifications, within the scope of the gist of the present invention described in the claims, It can be changed.

It is a figure which shows an example of a function structure of an interactive content presentation apparatus. It is a figure of an example for demonstrating the flow to presentation of a program or a dialog scene. It is a figure which shows the example of a description of program production | generation data. It is a figure of an example for demonstrating the processing content of a program production | generation. It is a figure which shows an example of the metadata which can be defined in this embodiment. It is a figure for demonstrating the 1st example of a conversation scene production | generation in this invention. It is a figure for demonstrating the output example of the dialogue scene TVML script based on FIG. It is a figure for demonstrating the example of an actual screen of the dialog scene corresponding to FIG. It is a figure for demonstrating the 2nd example of a conversation scene production | generation in this invention. It is a figure for demonstrating the example of an actual screen of the conversation scene corresponding to FIG. It is a figure for demonstrating the 3rd example of a conversation scene production | generation in this invention. It is a figure for demonstrating the example of an actual screen of the conversation scene corresponding to FIG. It is a figure which shows an example of the hardware constitutions which can implement | achieve the interactive content presentation process in this invention. It is a flowchart which shows an example of the interactive content presentation process in this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Interactive content presentation apparatus 11 Input means 12 Output means 13 Accumulation means 14 Program generation means 15 Dialog scene generation means 16 Switching control means 17 Playback means 18 Search means 19 Control means 21 Viewer 22 Program generation data 23 Dialog generation data 31 Production Change data 41 Input device 42 Output device 43 Drive device 44 Auxiliary storage device 45 Memory device 46 CPU
47 Network connection device 48 Recording medium

Claims (5)

In the interactive content presentation device we present a dialogue scene to carry out the answers in an interactive format to a question from the audience on the basis of the presented content,
A content script for reproducing the content from preset content generation data, content generation means for generating content information metadata for each scene in the content , and
Dialog scene generating means for generating a dialog scene script based on content information metadata obtained by the content generating means and a real-time content script at the time when an interrupt input is received from the viewer;
Replay means for replaying interactive content using the content script and the conversation scene script ;
The playback means extracts the content script being played back at the time when there is an interrupt input from the viewer as the real-time content script,
The dialogue scene generation means is configured to select one of a plurality of preset effect change data corresponding to the content information metadata obtained by the content generation means or the real-time content script obtained by the reproduction means. And the interactive scene script is generated using the selected effect change data .   2. The interactive type according to claim 1, further comprising: a switching control unit that switches the content script or the interactive scene script to output to the reproducing unit based on presence or absence of an interrupt input from the viewer or input content. Content presentation device.   In the dialog scene, when question data for the content being played back is input from the viewer, search means for extracting dialog generation data corresponding to the question data from a plurality of preset dialog generation data. The interactive content presentation apparatus according to claim 1 or 2, wherein The dialogue scene generation means includes
Before Based on Kiko content information metadata, interactive content presentation device according to any one of claims 1 to 3, characterized in that to generate scripts that inherits a performance before switching to the dialogue scene . The interactive content presentation program for functioning a computer as each means which the interactive content presentation apparatus of any one of Claims 1 thru | or 4 has .