JP2020017844A - Content distribution system, content distribution method, and content distribution program - Google Patents

Abstract

To provide a content distribution system, a content distribution method, and a content distribution program that can cause a robot device to speak in synchronization with reproduction of video content with a simple configuration.SOLUTION: A content distribution system 1 includes a timing detection processing unit 103 that detects a switching timing of switching from an image D1 to an image D2 in a video content C1, an utterance time calculation processing unit 104 that calculates a comment time required for reproducing an utterance comment M1 corresponding to the image D1 to be uttered by a robot device 30A, a silent time calculation processing unit 105 that calculates a silent time corresponding to the image D1 on the basis of the switching timing and the comment time, and a control unit 100 that causes a robot device 30B to speak an utterance comment M2 corresponding to the image D2 on the basis of the silence period.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a content distribution system, a content distribution method, and a content distribution program.

  2. Description of the Related Art In recent years, there has been known an apparatus in which a robot apparatus operates or emits a sound in conjunction with a signage content displayed on a display device to draw attention to the signage content.

  In order to make the robot device speak or dance in conjunction with the signage content displayed on the display device, for example, the signage content and the robot operation pattern script are separately transferred in advance to the display device and the robot device, respectively. It had to be kept and was troublesome.

  Furthermore, in order to synchronize the signage content with the operation of the robot device, carefully perform an operation start instruction operation of the robot device in synchronization with the start timing of the signage content reproduction, or operate the robot device in synchronization with the reproduction time of the signage content. It is very troublesome, for example, that it is necessary to set in advance to start.

  Therefore, as a conventional technique, for example, when a person is detected by a person detection process, based on a face image recognized from a captured image obtained by an imaging unit, the image is output from the image forming unit by a reaction of the detected person. There has been proposed a digital signage device that outputs audio contents having contents different from the contents of display contents to be displayed (see Patent Document 1).

  With this configuration, it is possible to output audio content having a content different from the content of the display content based on the result of the human detection processing without previously setting the output timing of the display content and the audio content to match. This enables content output that can attract people's interest.

JP 2017-59916 A

  However, according to the technology disclosed in Patent Document 1, there is a problem that operation control for outputting display content (video content) becomes complicated.

  An object of the present invention is to provide a content distribution system, a content distribution method, and a content distribution program that allow a robot apparatus to utter in synchronization with reproduction of video content with a simple configuration.

  A content distribution system according to one aspect of the present invention is a content distribution system including a display device that reproduces video content including a plurality of images, and an utterance device that utters an utterance comment corresponding to the video content, A timing detection unit for detecting a switching timing of switching from a first image to a second image in the video content, and an utterance for calculating an utterance time required for reproducing the first utterance comment corresponding to the first image to be uttered by the utterance device; A silence period determining unit that calculates a silence period corresponding to the first image based on a time determination unit, the switching timing detected by the timing detection unit, and the speech time calculated by the speech time determination unit. And the second based on the silent time calculated by the silent time determining unit. The second utterance comment corresponding to the image and a speech unit for utterance to the speech unit.

  In a content distribution method according to another aspect of the present invention, in a video content including a plurality of images reproduced by a display device, a step of detecting a timing of switching from a first image to a second image, and causing the utterance device to utter. Calculating an utterance time required to reproduce the first utterance comment corresponding to the first image; a silence time corresponding to the first image based on the detected switching timing and the calculated utterance time And causing the speech device to utter a second speech comment corresponding to the second image based on the calculated silence period.

  A content distribution program according to another aspect of the present invention includes a step of detecting a timing of switching from a first image to a second image in video content including a plurality of images reproduced by a display device, and causing the speech device to speak. Calculating an utterance time required to reproduce the first utterance comment corresponding to the first image; a silence time corresponding to the first image based on the detected switching timing and the calculated utterance time And a step of causing the speech device to utter a second speech comment corresponding to the second image based on the calculated silence period.

  According to the present invention, it is possible to cause the robot apparatus to speak in synchronization with the reproduction of the video content with a simple configuration.

FIG. 1 is a diagram showing a schematic configuration of a content distribution system according to the first embodiment of the present invention. FIG. 2 is a functional block diagram illustrating a configuration of the content distribution device according to the first embodiment of the present invention. FIG. 3 is a functional block diagram illustrating a configuration of the display device according to the first embodiment of the present invention. FIG. 4 is a functional block diagram illustrating a configuration of the robot device according to the first embodiment of the present invention. FIG. 5 is an explanatory diagram showing a registration screen in the robot operation / utterance editing software of the content distribution system according to the first embodiment of the present invention. FIG. 6 is an explanatory diagram showing a setting screen in the robot operation / utterance editing software of the content distribution system according to the first embodiment of the present invention. FIG. 7 is an explanatory diagram showing a registration screen in the robot operation / utterance editing software of the content distribution system according to the first embodiment of the present invention. FIG. 8 is an explanatory diagram showing a setting screen in the robot operation / utterance editing software of the content distribution system according to the first embodiment of the present invention. FIG. 9 is an explanatory diagram showing a setting screen in the robot operation / utterance editing software of the content distribution system according to the first embodiment of the present invention. FIG. 10 is an explanatory diagram showing a setting screen in the robot operation / utterance editing software of the content distribution system according to the first embodiment of the present invention. FIG. 11 is an explanatory diagram showing a setting screen in the robot operation / utterance editing software of the content distribution system according to the first embodiment of the present invention. FIG. 12 is an explanatory diagram showing a registration screen in the robot operation / utterance editing software of the content distribution system according to the first embodiment of the present invention. FIG. 13 is an explanatory diagram showing a setting screen in the robot operation / utterance editing software of the content distribution system according to the first embodiment of the present invention. FIG. 14 is an explanatory diagram showing a setting screen in the robot operation / utterance editing software of the content distribution system according to the first embodiment of the present invention. FIG. 15 is an explanatory diagram showing a setting screen in the robot operation / utterance editing software of the content distribution system according to the first embodiment of the present invention. FIG. 16 is an explanatory diagram showing a setting screen in the robot operation / utterance editing software of the content distribution system according to the first embodiment of the present invention. FIG. 17 is an explanatory diagram illustrating a registration screen in the robot operation / utterance editing software of the content distribution system according to the first embodiment of this invention. FIG. 18 is an explanatory diagram showing a registration screen in the robot operation / utterance editing software of the content distribution system according to the first embodiment of the present invention. FIG. 19 is a flowchart illustrating an example of a procedure of a process in which the display device according to the first embodiment of the present invention transmits robot operation data to the robot device. FIG. 20 is an explanatory diagram showing the switching timing of the image of the video content and the utterance timing of the utterance comment according to the comparative example. FIG. 21 is an explanatory diagram showing the switching timing of the image of the video content and the utterance timing of the utterance comment according to the first embodiment of the present invention. FIG. 22 is an explanatory diagram showing a registration screen in the robot operation / utterance editing software of the content distribution system according to the second embodiment of the present invention. FIG. 23 is an explanatory diagram showing a setting screen in the robot operation / utterance editing software of the content distribution system according to the second embodiment of the present invention. FIG. 24 is an explanatory diagram showing a setting screen in the robot operation / utterance editing software of the content distribution system according to the second embodiment of the present invention. FIG. 25 is an explanatory diagram showing a registration screen in the robot operation / utterance editing software of the content distribution system according to the second embodiment of the present invention. FIG. 26 is an explanatory diagram showing a registration screen in the robot operation / speech editing software of the content distribution system according to another embodiment of the present invention. FIG. 27 is an explanatory diagram showing a setting screen in the robot operation / utterance editing software of the content distribution system according to another embodiment of the present invention.

  Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. Note that the following embodiments are examples embodying the present invention, and do not have characteristics that limit the technical scope of the present invention.

[First Embodiment]
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.

  FIG. 1 is an explanatory diagram showing the configuration of the content distribution system according to the first embodiment of the present invention. FIG. 2 is a block diagram showing a configuration of a content distribution device constituting the content distribution system. FIG. 3 is a block diagram showing a configuration of a display device constituting the content distribution system. FIG. 4 is a block diagram showing a configuration of a robot device constituting the content distribution system.

[Content distribution system configuration]
As shown in FIG. 1, a content distribution system 1 according to the first embodiment includes a display device 20 communicably connected to a robot device 30, and a display device 20 communicably connected to the display device 20. And a content distribution device 10 that distributes content. In the content distribution system 1, the content distribution device 10 distributes (transmits) video content data and robot operation data to the display device 20. The display device 20 receives the video content data and the robot operation data, and transmits the robot operation data to the robot device 30 when reproducing the video content. The robot device 30 operates by receiving the robot operation data.

  The display device 20 included in the content distribution system 1 may be a single display device or a plurality of display devices. Further, the number of robot devices 30 included in the content distribution system 1 may be one or a plurality of robot devices. FIG. 1 shows one display device 20 and two robot devices 30A and 30B as an example. In the following description, when the robot devices 30A and 30B are not distinguished, they are referred to as “robot device 30”. The robot device 30 is an example of the speech device of the present invention. The speech device of the present invention is not limited to a robot device, but includes various information processing devices capable of outputting voice.

  The content distribution device 10 and the display device 20 are not limited to one computer, and may be a computer system in which a plurality of computers operate in cooperation. In addition, various processes executed by the content distribution device 10 and the display device 20 may be executed in a distributed manner by one or a plurality of processors.

  Hereinafter, a characteristic configuration of each device configuring the content distribution system 1 according to the first embodiment will be described with reference to the drawings.

  As shown in FIG. 2, the content distribution device 10 includes a control unit 100 that controls operation processing in each unit, a communication unit 110 that performs communication connection with the display device 20, and an operation for an editing operator to perform an editing operation. A display unit 115 for displaying a screen and a setting screen (all described later), a video content data registration unit 120, a robot operation data registration unit 130, a data transmission unit 140, and a storage unit 150 are provided.

  The video content data registration unit 120 registers content data (hereinafter, video content data d1) corresponding to video content to be output to the display device 20. The video content includes a plurality of images having different scenes (concepts). For example, the video content related to the Hawaii travel advertisement includes an "image representing the scenery of Hawaii", an "image introducing a dolphin", an "image introducing a beach", and the like. When the editor selects a desired video content, the video content data registration unit 120 registers the video content data d1 corresponding to the video content. When the video content data d1 is reproduced on the display device 20, these images are sequentially displayed.

  The robot operation data registration unit 130 registers operation data for operating the robot device 30 (hereinafter, referred to as robot operation data d2). When the editing operator performs an operation setting (described later) of the robot device 30, the robot operation data registration unit 130 registers the robot operation data d2 corresponding to the operation setting.

  The data transmission unit 140 transmits the data from the content distribution device 10 to the display device 20. Specifically, the data transmission unit 140 transmits the video content data d1 and the robot operation data d2 to the designated display device 20.

  Here, the video content data d1 includes a still image file or a moving image file. The robot operation data d2 includes an operation file or a voice (utterance comment) file. When the robot operation data d2 is reproduced in the robot device 30, for example, an utterance comment corresponding to the image of the video content is output as a voice.

  The storage unit 150 stores a control program 151 for controlling processing of each unit of the content distribution device 10, a signage program editing software 152, and a robot operation / utterance editing software 153. The storage unit 150 includes a video content data storage area 154 for storing video content data d1 reproduced on the display device 20, and a robot operation data storage area 155 for storing robot operation data d2 for operating the robot device 30. .

  The control unit 100 includes control devices such as a CPU, a ROM, and a RAM. The CPU is a processor that executes various arithmetic processes. The control unit 100 controls the content distribution device 10 by executing the control program 151, the signage program editing software 152, and the robot operation / utterance editing software 153 stored in the storage unit 150 in advance by the CPU.

  Specifically, as shown in FIG. 2, the control unit 100 includes a reception processing unit 101, a display processing unit 102 (an example of a display control unit of the present invention), a timing detection processing unit 103 (an example of a timing detection unit of the present invention). ), A speech time calculation processing unit 104 (an example of the speech time determination unit of the present invention), and a silence time calculation processing unit 105 (an example of the silence time determination unit of the invention). The control unit 100 functions as each processing unit by executing various processes according to the control program 151, the signage program editing software 152, and the robot operation / utterance editing software 153. Further, the control unit 100 may include an electronic circuit that realizes a part or a plurality of processing functions of each of these processing units.

  The reception processing unit 101 receives various operations by the editing operator, for example, an editing operation of video content, an operation setting of the robot device 30, and the like. The display processing unit 102 causes the display unit 115 to display an operation screen and a setting screen for performing various operations.

  The timing detection processing unit 103, the utterance time calculation processing unit 104, and the silence time calculation processing unit 105 execute various processes when setting the operation of the robot device 30. Specific processing will be described later.

  As shown in FIG. 3, the display device 20 includes a control unit 200 that controls operation processing in each unit, a communication unit 210 that performs communication connection with the content distribution device 10 and the robot device 30, a display unit 220, and a storage unit 230. And

  The control unit 200 transmits the robot operation data d2 distributed from the content distribution device 10 to a predetermined robot device 30 when the video content corresponding to the video content data d1 distributed from the content distribution device 10 is reproduced (displayed). .

  The storage unit 230 stores a control program 231 for controlling processing of each unit of the display device 20 and signage reproduction software 232. The storage unit 230 includes a video content data storage area 233 for storing video content data d1 to be reproduced on the display device 20, and a robot operation data storage area 234 for storing robot operation data d2 for operating the robot device 30.

  As illustrated in FIG. 4, the robot device 30 includes a control unit 300 that controls operation processing in each unit, a communication unit 310 that performs communication connection with the display device 20, a voice output unit 320, and a storage unit 330. ing.

  The control unit 300 controls the operation based on the robot operation data d2 transmitted from the display device 20 when the video content is reproduced on the display device 20.

  The storage unit 330 stores a control program 331 for controlling operation processing of the robot device 30 and the like. The storage unit 330 also includes a robot operation data storage area 332 that stores robot operation data d2 for operating the robot device 30.

  The robot device 30 may be configured such that the outer shape is a doll-shaped robot. Specifically, the robot device 30 includes, for example, a head, a torso, an arm, and a leg, and the head is configured to be able to rotate in a vertical direction and a horizontal direction, and the arm is configured to move in a vertical direction. A lifting operation may be configured. Further, the head may be provided with a portion corresponding to the eyes, mouth, and the like constituting the face.

[Configuration of content distribution device]
In the content distribution device 10, video content (signage content) to be distributed to the display device 20 is edited. Editing of the video content is performed by the signage program editing software 152. The editing of the video content can be realized by a known technique. Here, it is assumed that the well-known signage program editing software 152 generates the video content data d1.

  In the content distribution device 10, the operation settings of the robot device 30 for operating the robot device 30 are edited. FIG. 5 is an explanatory diagram showing the registration screen 11 in the robot operation / utterance editing software 153 of the content distribution system according to the first embodiment. The display processing unit 102 displays the registration screen 11 on the display unit 115.

  The robot operation / speech editing software 153 is software for performing operation settings of the robot device 30. The editing operator edits and registers the operation of the robot device 30 and the contents of the utterance using the robot operation / utterance editing software 153. Robot operation / utterance editing software 153 generates robot operation data d2.

  The registration screen 11 shown in FIG. 5 includes a display device registration column 12a for registering the display device 20 for reproducing the video content, and a content registration column 12d for registering the video content to be reproduced on the registered display device 20. And an image display column 12c for displaying a plurality of images included in the registered video content in a thumbnail format. For example, the editing operator presses a registration button 12b in the display device registration column 12a, selects a desired display device 20 from the plurality of display devices 20, and registers the desired display device 20 in the display device registration column 12a. Further, the editing operator presses a registration button 12e of the content registration field 12d, selects a desired video content from a plurality of video contents, and registers it in the content registration field 12d.

  Further, the registration screen 11 shown in FIG. 5 includes a robot device registration column 13a for registering the robot device 30 to be operated based on the robot operation data d2 with respect to the first robot device 30, and a registered robot device 30. (For example, the robot device 30A) and a setting column 13c (an example of a setting column of the present invention) for setting the content of the utterance. Note that an utterance comment M1 uttered (reproduced) by the robot device 30A is displayed in the setting column 13c. The registration screen 11 also includes a robot device registration column 14a for registering the robot device 30 to be operated based on the robot operation data d2 for the second robot device 30, and a registered robot device 30 (for example, the robot device 30). 30B) and a setting column 14c for setting the contents of the utterance. Note that an utterance comment M2 uttered (reproduced) by the robot device 30B is displayed in the setting field 14c.

  For example, the editing operator presses a registration button 13b of the robot device registration field 13a, selects a desired robot device 30A from the plurality of robot devices 30, and registers the desired robot device 30A in the robot device registration field 13a. Further, the editing operator presses a registration button 14b in the robot device registration field 14a, selects a desired robot device 30B from the plurality of robot devices 30, and registers the desired robot device 30B in the robot device registration field 14a. Further, the editing operator can press the add button 15 to register the third and subsequent robot apparatuses 30.

  The editing operator calls a setting screen 21 (described later) by pressing (for example, double-clicking) an area within the frame of the setting field 13c, and performs operation setting of the robot device 30A on the setting screen 21. Further, the editor presses (eg, double-clicks) the area within the frame of the setting field 14c to call a setting screen 21 (described later), and performs operation setting of the robot device 30B on the setting screen 21.

  When the registration of the video content and the operation setting of the robot device 30 are completed, the editing operator presses the transmission button 16 on the registration screen 11. Thereby, the data transmission unit 140 of the content distribution device 10 transmits the video content data d1 and the robot operation data d2 to the display device 20. When the editing operator presses the end button 17 on the registration screen 11, the processing by the robot operation / utterance editing software 153 ends.

[Robot device operation settings]
A procedure for performing the operation setting of the robot device 30 on the setting screen 21 will be described with a specific example.

  FIG. 6 is an explanatory diagram showing the setting screen 21 in the robot operation / utterance editing software 153 of the content distribution system according to the first embodiment. The robot device 30 performs an operation and an utterance for each set operation. On the setting screen 21, the operation and the contents of the utterance are set for each operation.

  On the setting screen 21, an operation name setting column 22 for setting a name (operation name) of an operation setting created for the robot device 30, and an operation for setting operation timing (operation timing and utterance timing) of the robot device 30 are set. A position setting field 23, a robot setting field 24 for setting the robot device 30 to be operated, a comment setting field 25 for inputting an utterance comment to be uttered (reproduced) by the set robot device 30, and a speed at which the utterance comment is uttered , A pre-silence time setting column 27 for setting a time (pre-silence time) from the start of the operation to the start of the utterance of the utterance comment, and the end of the utterance of the utterance comment. From the end of the utterance of the utterance comment, and a post-utterance silence time setting column 28 for setting a time from the end of the operation to the end of the operation (rear silence time). A silent time automatic calculation button 29 for calculating the time until the image (scene) of the image content is switched and setting the calculated time as the post-silence time; an operation setting field 31 for setting the content to be operated by the robot device 30; ,including.

  Each of the setting columns 22 to 31 is set and input by the editing operator. For example, the editing operator selects “first” or “after (created operation name)” in the operation position setting column 23. In addition, the editing operator selects a desired robot (“Robot 1”, “Robot 2”, etc.) from the plurality of registered robots in the robot setting field 24. Each registered robot is associated with a model and an IP address of the robot device 30. Further, the editing operator selects “fast”, “normal” or “slow” in the speed setting field 26. In addition, the editing operator selects “bow”, “wave”, “kick”, “ever live”, or “none” in the operation setting column 31.

  The setting screen 21 also includes a time at which the robot device 30 starts to utter the utterance comment (comment start time), a time at which the robot device 30 ends the utterance of the utterance comment (comment end time), Displays the time (comment time) required to utter (reproduce) the utterance comment and the total time (operation time) required to perform the operation. Each time is displayed by the display processing unit 102 based on the information set in each of the setting columns 22 to 31. The comment start time and the comment end time indicate the elapsed time from the start of the reproduction of the video content.

  Further, the setting screen 21 includes a start image display column 32 and an end image display column 33 for displaying an image (captured image) captured at a predetermined timing in the video content. The display processing unit 102 displays the captured image of the video content displayed on the display device 20 at the time when the operation starts, in the start image display column 32. In addition, the display processing unit 102 displays a captured image of the video content displayed on the display device 20 in the end image display column 33 when a time obtained by adding the silence time to the comment end time has elapsed.

  First, the editing operator registers the display device 20, the robot device 30, and the video content on the registration screen 11 shown in FIG. Here, as shown in FIG. 7, "display device 1" (see reference numeral P1), "robot 1" (see reference numeral R1), "robot 2" (see reference numeral R2), and "Hawaii travel advertisement" (reference numeral C1) Reference) has been selected and registered. Note that “display device 1” corresponds to the display device 20, “robot 1” corresponds to the robot device 30A, and “robot 2” corresponds to the robot device 30B. The display processing unit 102 displays a thumbnail image of the image D1 of the first scene of the video content C1 in the image display field 12c of the registration screen 11. Image D1 is an example of a first image of the present invention. The robot device 30A is an example of a first utterance device of the present invention, and the robot device 30B is an example of a second utterance device of the present invention.

  Next, the editing operator presses an area within the frame of the setting column 13c shown in FIG. 7 in order to perform operation setting of the robot device 30A. Then, a setting screen 21 shown in FIG. 6 is displayed. The setting screen 21 may be displayed on the same screen adjacent to the registration screen 11, or the registration screen 11 may be in a non-display state and only the setting screen 21 may be displayed.

  On the setting screen 21 shown in FIG. 6, for example, the editing operator inputs “operation 001” in the operation name setting field 22, selects “first” in the operation position setting field 23, and selects “robot” in the robot setting field 24. "1" is selected, "normal" is selected in the speed setting field 26, and "0 second" is input in the front silence time setting field 27 and the rear silence time setting field 28. When the reception processing unit 101 acquires the information input by the editing operator, the display processing unit 102 performs display based on the information (see FIG. 8). As shown in FIG. 8, a captured image of the image D1 is displayed in the start image display column 32. A preset value (initial setting value) may be automatically input to the speed setting field 26, the preceding silent time setting field 27, and the rear silent time setting field 28.

  The timing detection processing unit 103 detects a switching timing at which the image D1 switches to the next image (image D2) based on the registered video content C1. Image D2 is an example of the second image of the present invention. The control unit 100 calculates the time from when the image D1 is displayed to when the image D2 is displayed based on the switching timing, and uses the calculated time as the operation time of the “operation 001” (for example, “1 minute 0 second”). )). Thereby, as shown in FIG. 8, "1 minute 0 second" is displayed as the operation time. Since “operation 001” is the first operation, “0 second” is displayed as the comment start time.

  Next, edit the worker, in the setting screen 21 shown in FIG. 8, for example, "Hello, today will introduce the Hawaii tour." In the comment setting column 25 as the utterance comment M1 to enter the, the operation setting column 31 Enter "bow" (see FIG. 9). The utterance comment M1 is an example of the first utterance comment of the present invention. The display processing unit 102 displays the comment start time, the comment end time, the comment time, and the operation time on the setting screen 21.

  Here, the speech time calculation processing unit 104 calculates a comment time (an example of the speech time of the present invention) required for reproducing the speech comment M1. For example, the utterance time calculation processing unit 104 calculates the comment time based on the number of characters of the utterance comment M1 and the comment speed in the speed setting column 26 (an example of the utterance speed of the present invention). Here, the calculated comment time is set to “55 seconds”. In the first operation “operation 001”, the comment end time is “55 seconds”, like the comment time. The display processing unit 102 displays the respective times on the setting screen 21 as shown in FIG.

  Further, the display processing unit 102 displays the captured image of the image at the time when the time obtained by adding the silence time to the comment end time has elapsed in the end image display column 33 (see FIG. 10). Here, the silence time has not yet been set, and the timing (comment end time) at which the utterance (playback) of the utterance comment M1 ends is the operation time (“1 minute 0 second”) of “operation 001”. Since it is before the timing, the display processing unit 102 displays the captured image of the image (image D1) before switching to the image D2 in the end image display column 33. Here, the image D1 displayed in the end image display column 33 has the same scene (concept) content as the image D1 displayed in the start image display column 32. That is, a captured image of the image D1 of the scenery of Hawaii is displayed.

  Next, the editing operator presses the silent time automatic calculation button 29 on the setting screen 21 shown in FIG. Then, the silence time calculation processing unit 105 calculates a silence time corresponding to the image D1 based on the switching timing detected by the timing detection processing unit 103 and the comment time calculated by the utterance time calculation processing unit 104. I do. For example, the silence time calculation processing unit 105 determines the difference (“5 seconds”) between the operation time (“1 minute 0 seconds”) and the comment time (“55 seconds”) as the silence time corresponding to the image D1. Set.

  When the silence time is calculated, the display processing unit 102 sets the silence time (“5 seconds”) in the post-silence time setting column 28 as shown in FIG. In addition, the display processing unit 102 determines the image at the time when the time (“1 minute 0 seconds”) obtained by adding the silence time (“5 seconds”) to the comment end time (“55 seconds”) in the video content has elapsed. The captured image of (image D2) is displayed in the end image display column 33 (see FIG. 11).

  Through the above processing, the operation setting of “operation 001” of the robot device 30A is completed. The editing operator presses the “add / edit” button when performing the operation setting of the robot device 30 subsequently.

  When the editing operator presses the “add / edit” button, the display processing unit 102 updates the registration screen 11 and displays it on the display unit 115. For example, as shown in FIG. 12, the display processing unit 102 displays the utterance comment M1 of “operation 001” in the setting field 13c on the registration screen 11. Further, the display processing unit 102 displays the thumbnail image of the image D1 and the setting column 13c including the utterance comment M1 side by side on the registration screen 11. Further, the display processing unit 102 displays a thumbnail image of the next image D2 in the image display field 12c of the registration screen 11.

  On the registration screen 11 shown in FIG. 12, the editing operator presses an area in the frame of the setting column 14c to perform, for example, operation setting of the robot device 30B. Then, a setting screen 21 shown in FIG. 6 is displayed.

  On the setting screen 21 shown in FIG. 6, for example, the editing operator inputs “operation 002” in the operation name setting field 22, inputs “next to operation 001” in the operation position setting field 23, and enters the robot setting field 24. , "Normal" is input in the speed setting field 26, and "0 second" is input in the front silent time setting field 27 and the rear silent time setting field 28. When the reception processing unit 101 acquires the input information, the display processing unit 102 performs a display based on the information (see FIG. 13). In addition, as shown in FIG. 13, a captured image of the image D2 is displayed in the start image display column 32.

  The timing detection processing unit 103 detects a switching timing at which the image D2 switches to the next image (image D3) based on the registered video content C1. The control unit 100 calculates the time from when the image D2 is displayed to when the image D3 is displayed based on the switching timing, and uses the calculated time as the operation time of “operation 002” (for example, “40 seconds”). Set to. Accordingly, “40 seconds” is displayed as the operation time as shown in FIG. Also, since “operation 002” is the next operation after “operation 001”, “1 minute 0 second” is displayed as the comment start time.

  Next, on the setting screen 21 shown in FIG. 13, the editing operator inputs, for example, “You can see dolphins in this tour.” "Wave your hand" is input (see FIG. 14). The utterance comment M2 is an example of the second utterance comment of the present invention. The display processing unit 102 displays the comment start time, the comment end time, the comment time, and the operation time on the setting screen 21.

  The utterance time calculation processing unit 104 calculates the comment time based on the number of characters of the utterance comment M2 and the comment speed in the speed setting column 26. Here, the calculated comment time is “30 seconds”. In this case, the comment end time is “1 minute 30 seconds”. The display processing unit 102 displays the respective times on the setting screen 21 as shown in FIG.

  Further, the display processing unit 102 displays the captured image of the image at the time when the time obtained by adding the silence time to the comment end time has elapsed in the end image display column 33 (see FIG. 15). Here, the silence time has not yet been set, and the timing (comment end time) at which the utterance (playback) of the utterance comment M2 ends is greater than the timing at which the operation time (“40 seconds”) of “operation 002” ends. Since it is before, the display processing unit 102 displays the captured image of the image (image D2) before switching to the image D3 in the end image display column 33. Here, the image D2 displayed in the end image display column 33 has the same scene (concept) content as the image D2 displayed in the start image display column 32. That is, a captured image of the image D2 introducing the dolphin is displayed.

  Next, the editing operator presses a silent time automatic calculation button 29 on the setting screen 21 shown in FIG. Then, the silence time calculation processing unit 105 calculates a silence time corresponding to the image D2 based on the switching timing detected by the timing detection processing unit 103 and the comment time calculated by the speech time calculation processing unit 104. I do. For example, the silence time calculation processing unit 105 sets a difference (“10 seconds”) between the operation time (“40 seconds”) and the comment time (“30 seconds”) as a silence time corresponding to the image D2. .

  When the silence time is calculated, the display processing unit 102 sets the silence time (“10 seconds”) in the post-silence time setting column 28 as shown in FIG. Also, the display processing unit 102 determines whether or not the time (“1 minute and 40 seconds”) obtained by adding the silence time (“10 seconds”) to the comment end time (“1 minute and 30 seconds”) in the video content has elapsed. Is displayed in the end image display column 33 (see FIG. 16).

  Through the above processing, the operation setting of “operation 002” of the robot device 30B is completed. The editing operator presses the “add / edit” button when performing the operation setting of the robot device 30 subsequently.

  When the editing operator presses the “add / edit” button, the display processing unit 102 updates the registration screen 11 and displays it on the display unit 115. For example, as shown in FIG. 17, the display processing unit 102 displays the utterance comment M2 of “operation 002” in the setting field 14c on the registration screen 11. Further, the display processing unit 102 displays the thumbnail image of the image D2 and the setting column 14c including the utterance comment M2 side by side on the registration screen 11. Further, the display processing unit 102 displays a thumbnail image of the next image D3 in the image display field 12c of the registration screen 11. Thereafter, the above processing is repeated, and the operation setting of the robot devices 30A and 30B for the video content C1 is performed. Thereby, the robot operation data d2 corresponding to the video content data d1 is created.

  FIG. 18 is an explanatory diagram illustrating an example of the registration screen 11 when the operation settings of the robot devices 30A and 30B corresponding to the video content C1 have been completed. In FIG. 18, the width of the display frame of each of the utterance comments M1, M2, and M3 corresponding to each of the images D1, D2, and D3 in the setting column 13c corresponds to each of the operations “operation 001”, “operation 002”, and “operation 003”. Is set to a length corresponding to the operation time.

  When the editing operator presses the send button 16 on the registration screen 11 shown in FIG. 18, the data transmission unit 140 of the content distribution device 10 displays the video content data d1 and the robot operation data d2 corresponding to the operation setting. Transmit to the device 20. The robot operation data d2 includes robot operation / speech files f1, f2, and f3 corresponding to the operation settings of “operation 001”, “operation 002”, and “operation 003” set by the above-described processing.

  According to the registration screen 11 shown in FIG. 18, the editing operator determines the switching timing of the plurality of images D1, D2, and D3 included in the video content C1, and the utterance comment M1 corresponding to each of the images D1, D2, and D3. The contents of M2 and M3 can be easily grasped.

[Display processing of video content by display device]
In the display device 20, the video content data d1 of the registered video content C1 is executed.

  The display device 20 executes the video content data d1 of the video content C1 stored in the video content data storage area by the signage reproduction software 232, and transfers the robot motion data d2 stored in the robot motion data storage area 234 to the robot device 30A. , 30B. Specifically, the display device 20 executes the reproduction process of the video content data d1, transmits the robot operation / speech files f1 and f3 corresponding to “operation 001” and “operation 003” to the robot device 30A, The robot operation / speech file f2 corresponding to “operation 002” is transmitted to the robot device 30B.

  In the display device 20, the video content C1 is displayed (reproduced) on the display unit 220 by executing the video content data d1. In addition, for the specific display processing of the video content on the display device 20, a known technique can be applied.

[Transmission processing of robot operation data by display device]
Here, an example of a procedure of a process in which the display device 20 transmits the robot operation data d2 to the robot device 30 will be described with reference to a flowchart of FIG. It is assumed that the robot operation data d2 includes the robot operation / utterance files f1, f2, and f3.

  First, when the display device 20 executes a communication process with, for example, the robot device 30A (“Robot 1”), the display device 20 reads the robot operation / speech file f1 (step S101). Next, the display device 20 determines whether or not the robot ID (IP address) is registered in the read robot operation / speech file f1 (step S102).

  When the robot ID is registered in the read robot operation / speech file f1 (S102: YES), the display device 20 displays the operation data (operation file) of the robot 1 (robot device 30A) from the read robot operation / speech file f1. ) Is extracted (step S103).

  On the other hand, when the robot ID is not registered in the read robot operation / speech file f1 (S102: NO), the operation processing of the robot 1 ends.

  In step S104, the display device 20 extracts utterance data (an utterance file) of the robot 1 (the robot device 30A) from the read robot operation / utterance file f1. Next, the display device 20 establishes a connection with the connection destination robot 1 (step S105), and transmits the motion data and the utterance data (step S106). Finally, the display device 20 ends the connection with the robot 1 (step S107). The display device 20 performs the above-described processing on the robot 2 as well.

  As described above, the communication processing of the robot operation data d2 from the display device 20 to the robot device 30 is executed.

[Robot device operation processing]
The robot device 30 is controlled by the signage reproduction software 232 to output an operation and an utterance based on the robot operation data d2 transmitted from the display device 20.

  Specifically, when the video content data d1 is executed (reproduced) on the display device 20, the robot motion data d2 (robot motion / speech files f1 and f3) is transmitted from the display device 20 to the robot device 30A. Then, the robot operation data d2 (robot operation / speech file f2) is transmitted from the display device 20 to the robot device 30B.

  The robot devices 30A and 30B are controlled to execute the robot operation / speech file of the robot operation data d2 transmitted from the display device 20. The robot device 30A executes the robot operation / speech file f1, the robot device 30B executes the robot operation / speech file f2, and then the robot device 30A executes the robot operation / speech file f3. Each robot device 30 operates according to the operation data of the robot operation / speech file, and outputs (utters) a voice according to the utterance data.

  As described above, in the content distribution system 1, the content distribution device 10 distributes the video content data d1 and the robot operation data d2 to the display device 20, and the display device 20 reproduces the video content C1 when the robot device 30A, The robot operation data d2 is transmitted to 30B. Thus, the operations and utterances of the robot devices 30A and 30B can be executed in synchronization with the video content C1 reproduced by the display device 20. In addition, well-known technology can be applied to specific operation processing and speech processing in the robot device 30.

  The utterance processing unit of the present invention (an example of the utterance unit of the present invention) executes a process of causing the robot device 30 to utter an utterance comment, and may be realized by the control unit 200 of the display device 20. May be realized by the control unit 300 of the robot device 30. For example, the control unit 200 of the display device 20 causes the robot device 30A to utter an utterance comment M1 corresponding to the image D1, and thereafter, after the silence time calculated by the silence time calculation processing unit 105 has elapsed, the control unit 200 corresponds to the image D2. The utterance comment M2 is uttered by the robot device 30B.

  According to the content distribution system 1 according to the first embodiment, the robot device 30 causes the utterance comments M1, M2, and M3 to be uttered appropriately in synchronization with the switching timing of the images D1, D2, and D3 included in the video content C1. be able to. In addition, the content distribution device 10 transmits the video content data d1 and the robot operation data d2 to the display device 20. Since the content distribution device 10 does not control the operation timing of the robot device 30, the configuration of the content distribution system 1 is simplified. Can be

  FIG. 20 is an explanatory diagram showing the switching timing of the images D1, D2, and D3 of the video content C1 and the utterance timing of the utterance comments M1, M2, and M3 according to the comparative example. As shown in FIG. 20, when the silence time is not properly set, after the utterance comment M1 is uttered (reproduced), before the image is switched from the image D1 to the image D2, the utterance comment M2 corresponding to the image D2. Is started (reproduced). This causes a problem that the display content of the display device 20 differs from the utterance content of the robot device 30.

  On the other hand, according to the content distribution system 1 according to the first embodiment, the silent time calculation processing unit 105 determines, for example, the comment time of the utterance comment M1 corresponding to the image D1 and the switching timing at which the image D1 is switched to the image D2. , A predetermined silence period is calculated. Then, the robot device 30 utters the utterance comment M2 at the utterance timing based on the calculated silence period. For example, as shown in FIG. 21, at the timing when the image D1 is switched to the image D2 and the display of the image D2 starts, the utterance of the utterance comment M2 is started. Thus, with a simple configuration, the display timing at which the display device 20 displays an image and the timing at which the robot device 30 utters an utterance comment corresponding to the image can be matched. That is, with a simple configuration, it is possible to cause the robot apparatus to speak in synchronization with the reproduction of the video content.

[Second embodiment]
A content distribution system 1 according to the second embodiment will be described. The description of the same configuration as that of the first embodiment is omitted.

  In the content distribution system 1 according to the second embodiment, when the editing operator registers the video content C1 on the registration screen 11 shown in FIG. 5, as shown in FIG. The thumbnail images of all the images D1, D2, and D3 included in the video content C1 are displayed in the eleventh image display column 12c. In addition, the display processing unit 102 performs “cell 1-1” and “cell 1-2” included in the setting column 13c of the operation setting of the robot device 30A (“robot 1”) corresponding to each of the images D1, D2, and D3. , “Cell 1-3”, and “Cell 2-1”, “Cell 2-2” included in the setting column 14c of the operation setting of the robot device 30B (“Robot 2”) corresponding to each of the images D1, D2, and D3. "And" Cell 2-3 "are displayed. The display processing unit 102 generates thumbnail images of all the images D1, D2, and D3, “cell 1-1”, “cell 1-2”, “cell 1-3” included in the setting column 13c, and the setting column 14c. , "Cell 2-1", "cell 2-2", and "cell 2-3" are displayed side by side. The operation settings of the robot devices 30A and 30B can be registered in each cell.

  In FIG. 22, the width of each cell is set to a length corresponding to the operation time of the operation setting corresponding to the images D1, D2, and D3.

  The editing operator presses “Cell 1-1” shown in FIG. 22 to perform the operation setting of the robot device 30A. Then, a setting screen 41 shown in FIG. 23 is displayed. “Cell 1-1” is automatically input to the cell name column 42 of the setting screen 41, and “Robot 1” is automatically input to the robot setting column 44. Further, the display processing unit 102 displays the captured image of the image D1 in the start image display column 52, and displays the captured image of the image D2 in the end image display column 53.

  Further, the timing detection processing unit 103 detects the switching timing based on the registered video content C1, and the control unit 100 determines the operation time of the “cell 1-1” (for example, “1 minute”) based on the switching timing. 0 seconds ").

  The silence time calculation processing unit 105 calculates a silence time corresponding to the image D1 based on the switching timing and the comment time calculated by the speech time calculation processing unit 104. Here, since the utterance comment has not been input yet, the comment time is “0 second”, and “1 minute 0 second” is displayed on the setting screen 41 as the silence time.

  Next, edit the worker, in the setting screen 41 shown in FIG. 23, for example, "Hello, today will introduce the Hawaii tour." In the comment setting column 45 as the utterance comment M1 to enter the, the operation setting field 51 "Do bow" is input (see FIG. 24). The display processing unit 102 displays the comment start time, the comment end time, the comment time, and the operation time on the setting screen 41. In addition, the silence time calculation processing unit 105 determines the silence time (“55 minutes”) corresponding to the image D1 based on the switching timing (the operation time (“1 minute 0 seconds”)) and the comment time (“55 seconds”). "5 seconds") is calculated. The display processing unit 102 displays the respective times on the setting screen 41 as shown in FIG.

  By the above processing, the operation setting of “cell 1-1” of the robot device 30A is completed. The editing operator presses the “add / edit” button when performing the operation setting subsequently.

  When the editing operator presses the “add / edit” button, the display processing unit 102 updates the registration screen 11 and displays it on the display unit 115. For example, as shown in FIG. 25, the display processing unit 102 displays the utterance comment M1 in “cell 1-1” in the setting field 13c of the registration screen 11.

  In the registration screen 11 shown in FIG. 25, the editing operator presses “cell 2-2” in the setting column 14c to perform operation setting of the robot device 30B, for example. Thereafter, the operation setting of the robot devices 30A and 30B is performed by the same operation as in the “cell 1-1”. Thereby, the robot operation data d2 corresponding to the video content data d1 is created. The robot operation data d2 includes a robot operation / utterance file corresponding to the operation setting of each cell set by the above processing.

  In the content distribution system 1 according to the second embodiment, the operation settings of the robot devices 30A and 30B can be performed on the image D1. Thus, while the image D1 is being displayed (reproduced) on the display device 20, the robot devices 30A and 30B can make the same or different utterance comments utter at the same or different timing. For example, the first half of the operation time of the image D1 may cause the robot device 30A to utter the utterance comment M1, and the second half of the operation time of the image D1 may cause the robot device 30B to utter an utterance comment having a content different from the utterance comment M1.

  According to the content distribution system 1 according to the second embodiment, similarly to the content distribution system 1 according to the first embodiment, the display timing at which the display device 20 displays an image and the robot device 30 The timing at which the utterance comment corresponding to the image is uttered can be matched. Further, in the content distribution system 1 according to the second embodiment, the silent time is automatically set between consecutive utterance comments, so that the display timing and the utterance timing can be more easily matched.

  The content distribution system according to the present invention is not limited to the above embodiments.

  As another embodiment, as shown in FIG. 26, the display processing unit 102 displays the utterance comments M1, M2, and M3 on the registration screen 11 when the operation setting of the robot devices 30A and 30B corresponding to the video content C1 is completed. May be displayed in a length corresponding to each comment time. Further, as shown in FIG. 26, the display processing unit 102 sets the regions N1, N2, and N3 representing silence periods adjacent to the setting columns 13c with widths t1, t2, and t3 corresponding to the length of silence periods. It may be displayed. Thus, the editing operator can intuitively grasp the ratio (balance) of the uttered comment and the silence time on the registration screen 11.

  The display processing unit 102 may display the start or end times T0 to T3 of the images D1, D2, and D3 on the registration screen 11 shown in FIG.

  As another embodiment, in the registration screen 11 shown in FIG. 26, when the editor changes the width of a setting column (display frame) including the utterance comments M1, M2, and M3, the utterance time calculation processing unit 104 However, the comment time is changed to a time corresponding to the changed width, and the silent time calculation processing unit 105 changes the silent time to a time corresponding to the changed width. For example, the editing operator changes the width of the setting field by dragging and dropping the right side of the setting field with a mouse. According to this configuration, the ratio of the utterance comment and the silence time can be easily changed on the registration screen 11. In this configuration, the comment speed is automatically changed according to the change of the comment time.

  Further, as another embodiment, the previous silence time from the start of the image display to the start of the utterance of the utterance comment may be input to the previous silence time setting column 27 by the editing operator, or may be input in advance. It may be set. When the previous silence time is set, the silence time calculation processing unit 105 is based on the switching timing detected by the timing detection processing unit 103, the comment time calculated by the speech time calculation processing unit 104, and the previous silence time. Then, a silent time corresponding to the image is calculated. For example, when the previous silence time is set to “2 seconds” on the setting screen 21 shown in FIG. 27, the silence time calculation processing unit 105 calculates the comment time (“1 minute 0 second”) from the operation time (“1 minute 0 second”). The remaining time (“3 seconds”) obtained by subtracting “55 seconds”) and the silence time (“2 seconds”) is set to the silence time corresponding to the image D1. Thus, the utterance comment corresponding to the image is uttered a few seconds after the display of the image is started (after the previous silence period has elapsed), so that the video content can be noticed.

  Note that the silence period according to the present invention is a period during which no utterance comment set corresponding to video content is uttered. Therefore, the silence time does not include, for example, a time during which the robot device 30 outputs a comment or music that is not related to the utterance comment, an operation time during which the robot device 30 operates, and the like.

  As described above, the content distribution method according to the present invention includes the following steps. For example, the content distribution method corresponds to a step of detecting a switching timing of switching from a first image to a second image in video content including a plurality of images reproduced by a display device, and corresponding to the first image to be uttered by a speech device. Calculating an utterance time required for reproducing the first utterance comment; calculating a silence time corresponding to the first image based on the detected switching timing and the calculated utterance time; Causing the speech device to utter a second speech comment corresponding to the second image based on the calculated silence period.

  Further, a content distribution program according to the present invention causes a computer to execute the following steps. For example, the content distribution program corresponds to a step of detecting a timing of switching from a first image to a second image in video content including a plurality of images reproduced by a display device, and corresponding to the first image to be uttered by a speech device. Calculating an utterance time required for reproducing the first utterance comment; calculating a silence time corresponding to the first image based on the detected switching timing and the calculated utterance time; Causing the speech device to utter a second speech comment corresponding to the second image based on the calculated silence period.

  As described above, the present invention is not limited to the above-described embodiment, and various changes can be made within the scope shown in the claims. It is clear that those skilled in the art can conceive various changes or modifications within the scope of the claims, that is, appropriately changed without departing from the scope of the present invention. Embodiments obtained by combining technical means are also included in the technical scope of the present invention.

1: content distribution system 10: content distribution device 11: registration screen 13c: setting field 14c: setting field 20: display device 21: setting screen 30: robot device 30A: robot device 30B: robot device 100: control unit 101: reception processing Unit 102: Display processing unit 103: Timing detection processing unit 104: Utterance time calculation processing unit 105: Silence time calculation processing unit 110: Communication unit 115: Display unit 120: Video content data registration unit 130: Robot operation data registration unit 140: Data transmission unit 150: Storage unit 151: Control program 152: Signage program editing software 153: Utterance editing software 154: Video content data storage area 155: Robot operation data storage area 200: Control unit 210: Communication unit 220: Display unit 230: Record Storage unit 231: Control program 232: Signage reproduction software 233: Video content data storage area 234: Robot operation data storage area 300: Control unit 310: Communication unit 320: Audio output unit 330: Storage unit 331: Control program 332: Robot operation Data storage area

Claims (11)

A content distribution system including a display device that reproduces video content including a plurality of images, and an utterance device that utters an utterance comment corresponding to the video content,
A timing detection unit that detects a timing of switching from a first image to a second image in the video content;
An utterance time determining unit that determines an utterance time required to reproduce a first utterance comment corresponding to the first image to be uttered by the utterance device;
A silent time determining unit that calculates a silent time corresponding to the first image based on the switching timing detected by the timing detecting unit and the utterance time calculated by the utterance time determining unit;
An utterance unit that causes the utterance device to utter a second utterance comment corresponding to the second image based on the silence time calculated by the silence time determination unit;
Content distribution system comprising: The utterance unit causes the second utterance comment to be uttered after the silence period has elapsed since the utterance of the first utterance comment ended,
The content distribution system according to claim 1. The utterance time determination unit calculates the utterance time based on the number of characters of the first utterance comment and the utterance speed of the first utterance comment,
The content distribution system according to claim 1 or 2. A display control unit that displays a registration screen for registering the video content to be reproduced on the display device and the utterance comment to be uttered by the utterance device,
The display control unit displays, on the registration screen, a thumbnail image of the first image and a setting column for setting the first utterance comment, side by side,
The content distribution system according to any one of claims 1 to 3. The display control unit displays the registered first utterance comment in the setting field of the registration screen.
The content distribution system according to claim 4. The display control unit displays the width of the setting column with a length corresponding to the utterance time, and displays an area having a width corresponding to the length of the silence period adjacent to the setting column.
The content distribution system according to claim 5. The display control unit displays the thumbnail images of all the images included in the video content and the setting column for setting the utterance comment corresponding to each of the images, side by side.
The content distribution system according to claim 4. The video content and the utterance comment further includes a content distribution device is registered,
The content distribution device transmits video content data corresponding to the video content and speech data corresponding to the speech comment to the display device,
The display device reproduces the video content based on the video content data received from the content distribution device, and transmits the speech data received from the content distribution device to the speech device,
The content distribution system according to any one of claims 1 to 7. The speech device includes a first speech device and a second speech device,
The utterance unit causes the utterance device to utter the first utterance comment, and causes the second utterance device to utter the second utterance comment.
The content distribution system according to any one of claims 1 to 8. Detecting a switching timing of switching from the first image to the second image in the video content including a plurality of images reproduced by the display device;
Calculating an utterance time required to reproduce a first utterance comment corresponding to the first image to be uttered by the utterance device;
Calculating a silence time corresponding to the first image based on the detected switching timing and the calculated utterance time;
Causing the speech device to utter a second speech comment corresponding to the second image based on the calculated silence period;
Content distribution method including. Detecting a switching timing of switching from the first image to the second image in the video content including a plurality of images reproduced by the display device;
Calculating an utterance time required to reproduce a first utterance comment corresponding to the first image to be uttered by the utterance device;
Calculating a silence time corresponding to the first image based on the detected switching timing and the calculated utterance time;
Causing the speech device to utter a second speech comment corresponding to the second image based on the calculated silence period;
Content distribution program for causing a computer to execute.