JP2022117152A - Information processing method, information processing system, and program - Google Patents

Abstract

To set a number of and variety of character strings for a content.SOLUTION: A terminal device 10 includes: a period setting unit 33 that sets a plurality of unit periods within a reproduction period of one material image of a plurality of material images that are mutually connected on the time axis to constitute a series of contents; and an instruction reception unit 34 that receives, for each of the plurality of unit periods, a character string indicating a voice that is reproduced together with the one material image in the unit period.SELECTED DRAWING: Figure 3

Description

The present disclosure relates to technology for generating content including moving images and audio.

2. Description of the Related Art Conventionally, various techniques have been proposed for creating content including images and sounds. For example, Patent Literature 1 discloses a configuration in which a character string having a number of characters corresponding to the time length of a moving image is added to the moving image.

JP 2020-053832 A

A scene is assumed in which content is created by connecting a plurality of images to each other on the time axis. However, in the configuration in which a character string is set for each image, there is a problem that the total number of character strings set for the entire content is limited. Considering the above circumstances, one of the objects of one aspect of the present disclosure is to set many and various character strings for content.

In order to solve the above problems, an information processing method according to one aspect of the present disclosure provides an information processing method in which one material image out of a plurality of material images forming a series of content by being interconnected on a time axis is A plurality of unit periods are set within the reproduction period, and for each of the plurality of unit periods, a character string representing a sound to be reproduced together with the one material image in the unit period is accepted.

An information processing system according to one aspect of the present disclosure provides a plurality of unit periods within a playback period of one material image among a plurality of material images that form a series of content by being interconnected on a time axis. and an instruction accepting unit that accepts, for each of the plurality of unit periods, a character string representing audio to be reproduced together with the one material image in the unit period.

A program according to one aspect of the present disclosure sets a plurality of unit periods within a playback period of one material image among a plurality of material images that form a series of content by being mutually linked on the time axis. and an instruction accepting unit that accepts, for each of the plurality of unit periods, a character string representing audio to be reproduced together with the one material image in the unit period.

1 is a block diagram illustrating the configuration of an information system according to a first embodiment; FIG. It is a block diagram which illustrates the structure of a terminal device. 3 is a block diagram illustrating a functional configuration of a terminal device; FIG. 4 is a schematic diagram of a selection screen; FIG. 4 is a schematic diagram of an edit screen; FIG. 4 is a schematic diagram of an edit screen; FIG. 9 is a flowchart illustrating a specific procedure of period setting processing; 4 is a flowchart illustrating a specific procedure of control processing; FIG. 11 is a schematic diagram of an edit screen in the second embodiment; FIG. FIG. 11 is a schematic diagram of an edit screen in the third embodiment; FIG.

A: First Embodiment FIG. 1 is a block diagram illustrating the configuration of an information system 100 according to the first embodiment. The information system 100 is a computer system for generating content C including images and sounds, and includes a terminal device 10 and an editing system 20 . The terminal device 10 and the editing system 20 communicate with each other via a communication network 200 such as the Internet.

The terminal device 10 is an information terminal such as a mobile phone, a smart phone, a tablet terminal, or a personal computer, and is used by the user U. The terminal device 10 transmits the material data D to the editing system 20 . The material data D includes a set of image data X and one or more audio data Y for each scene of the content C. FIG. The image data X of each scene represents an image (hereinafter referred to as "material image") corresponding to the scene. A material image is a moving image or a still image. Also, the audio data Y of each scene represents the audio reproduced together with the material image of the scene (hereinafter referred to as "material audio"). The material voice represented by the voice data Y is a voice pronounced by a virtual speaker by reading out a character string instructed by the user U. FIG. The format of each of the image data X and the audio data Y is arbitrary.

The editing system 20 is a computer system that generates content C. As shown in FIG. The editing system 20 comprises an editing processing section 21 and a speech synthesizing section 22 . Note that the system including the editing processing unit 21 and the system including the speech synthesis unit 22 may be installed separately.

The editing processing unit 21 generates content C through editing processing using material data D. FIG. The content C is a video work including a plurality of material images expressed by different image data X in the material data D and a plurality of material sounds expressed by different audio data Y in the material data D. Specifically, the editing processing unit 21 generates content C including an image obtained by connecting a plurality of material images in time series and one or more material sounds added to each material image. As understood from the above description, the material image is a moving image or a still image used as material for the content C. FIG. In other words, the plurality of material images constitute a series of content C by being interconnected on the time axis. Further, the material sound is the sound reproduced together with the material image in the content C (that is, the sound added to the material image).

The speech synthesizing unit 22 generates speech data Y of material speech corresponding to the character string Q transmitted from the terminal device 10 by performing speech synthesis to which the character string Q is applied. A known technique is arbitrarily adopted for speech synthesis by the speech synthesizing unit 22 .

Content C generated by the editing processing unit 21 is transmitted from the editing system 20 to the terminal device 10 . The terminal device 10 reproduces the content C received from the editing system 20 . That is, the material image and the material sound are reproduced in parallel. Note that the editing system 20 may transmit the content C to a device separate from the terminal device 10 that transmits the material data D.

Content C in the first embodiment is, for example, content introducing a company. For example, various types of content C such as content introducing the company itself or content introducing products handled by the company are generated. Therefore, the material image is a moving image or still image of scenery or products in the company. Also, the material voice is a voice explaining a company or a product or the like. However, the contents of the material moving image or the material audio (character string Q) are arbitrary, and are not limited to the above examples.

FIG. 2 is a block diagram illustrating a specific configuration of the terminal device 10. As shown in FIG. The terminal device 10 includes a control device 11 , a storage device 12 , a communication device 13 , an operation device 14 , an imaging device 15 , a display device 16 and a sound emitting device 17 . The terminal device 10 may be realized by a single device or may be realized by a plurality of devices configured separately from each other.

The control device 11 is one or more processors that control each element of the terminal device 10 . Specifically, for example, one or more processors such as CPU (Central Processing Unit), SPU (Sound Processing Unit), DSP (Digital Signal Processor), FPGA (Field Programmable Gate Array), or ASIC (Application Specific Integrated Circuit) The control device 11 is configured by the following.

The storage device 12 is one or more memories that store programs executed by the control device 11 and various data used by the control device 11 . The storage device 12 is composed of a known recording medium such as a magnetic recording medium or a semiconductor recording medium, or a combination of a plurality of types of recording media. In addition, a portable recording medium that can be attached to and detached from the terminal device 10 or a recording medium that can be written or read by the control device 11 via the communication network 200 (for example, cloud storage) is used as the storage device 12. You may

The operation device 14 is an instruction input device that receives instructions from the user U. FIG. The operation device 14 is, for example, a plurality of operators operated by the user U, or a touch panel that detects contact by the user U. FIG. A user U can specify an arbitrary character string Q by operating the operation device 14 . Note that the user U may select the character string Q from a plurality of candidates prepared in advance.

The communication device 13 communicates with the editing system 20 via the communication network 200 . For example, the communication device 13 transmits material data D to the editing system 20 and receives content C transmitted from the editing system 20 . The communication device 13 also transmits a character string Q designated by the user U to the editing system 20 and receives voice data Y generated from the character string Q by the voice synthesizing unit 22 from the editing system 20 .

The imaging device 15 is an image input device that generates image data X by imaging a subject. For example, the imaging device 15 includes an optical system such as a photographing lens, an imaging device that receives incident light from the optical system, and a processing circuit that generates image data X according to the amount of light received by the imaging device. A plurality of pieces of image data X are generated by repeating moving images captured by the imaging device 15 . A plurality of image data X generated by the imaging device 15 are stored in the storage device 12 . Note that the image data X received by the communication device 13 from another device such as a video distribution device or another information terminal may be stored in the storage device 12 . Also, each image data X may be edited according to an instruction from the user U to the operation device 14 .

The display device 16 displays an image instructed by the control device 11 . The display device 16 is composed of a display panel such as a liquid crystal panel or an organic EL panel. The display device 16 configured separately from the terminal device 10 may be connected to the terminal device 10 by wire or wirelessly.

The sound emitting device 17 emits sound instructed by the control device 11 . The sound emitting device 17 is, for example, a speaker, headphones, or earphones. Note that the sound emitting device 17 configured separately from the terminal device 10 may be connected to the terminal device 10 by wire or wirelessly.

FIG. 3 is a block diagram illustrating the functional configuration of the terminal device 10. As shown in FIG. By executing a program stored in the storage device 12, the control device 11 of the terminal device 10 performs a plurality of functions (display control unit 31, sound emission control unit 32, period setting unit 33, instruction reception unit 34, and information processing). Part 35) is realized.

The display control unit 31 causes the display device 16 to display an image. For example, the display control unit 31 causes the display device 16 to display an image of the content C. FIG. The sound emission control unit 32 causes the sound emission device 17 to emit sound. For example, the sound emission control unit 32 causes the sound emission device 17 to emit the sound of the content C. FIG. As understood from the above description, the display control unit 31 and the sound emission control unit 32 function as elements that control the reproduction of the content C. FIG. The display device 16 and the sound emitting device 17 function as playback devices that play back the content C. FIG.

The display control unit 31 causes the display device 16 to display not only the image of the content C but also each of a plurality of images (the selection screen Ga and the editing screen Gb) that the user U refers to in order to prepare the material data D.

FIG. 4 is a schematic diagram of the selection screen Ga. The selection screen Ga is a screen for the user U to select a plurality of material images to be used for the content C. FIG. Specifically, a template 51 and an operation image 52 are displayed on the selection screen Ga. The operation image 52 is an image of an operator that receives an instruction to transmit the material data D from the user U. FIG.

On the selection screen Ga, one template 51 selected by the user U by operating the operation device 14 is displayed from among a plurality of templates 51 registered in advance. A template 51 is a time series of a plurality of scenes that constitute the content C. FIG. The total number and combinations of scenes included in one template 51 are different for each template 51 . Each scene is a unit (scene or scene) that corresponds to a particular subject matter or theme. For example, a variety of scenes are registered in the template 51, such as scenes with titles such as company names or product names, scenes introducing products, scenes presenting a plurality of product models, and scenes introducing usage examples of products. Appropriate types of material images differ for each scene. The user U selects one of the plurality of material images stored in the storage device 12 for each scene by operating the operation device 14 . That is, the time series of the material images forming the content C is generated according to the instruction from the user U. FIG.

The length of time during which the material image is reproduced (hereinafter referred to as “reproduction period”) differs for each material image. Note that when the material image is a still image, the length of time of the reproduction period is the length of time during which the display of the still image is continued. Note that the duration of the reproduction period may be set for each material image in the selection screen Ga according to an instruction from the user U to the operation device 14 .

The user U can select any one of a plurality of material images corresponding to different scenes. The display control unit 31 causes the display device 16 to display an edit screen Gb for one material image selected by the user U (hereinafter referred to as "selected material image"). The editing screen Gb is an image for the user U to instruct the addition of the material sound to the selected material image. Each time the user U selects a selected material image, an edit screen Gb relating to the selected material image is displayed. The selected material image is an example of "one material image".

FIG. 5 is a schematic diagram of the editing screen Gb. The edit screen Gb includes a period image 60 , a first area 61 and a second area 62 . The period image 60 is an elongated image representing the reproduction period of the selected material image. The display length of the period image 60 in the direction of the time axis (specifically, the horizontal direction) means the length of time of the reproduction period. That is, the left end of the period image 60 corresponds to the start point of reproduction of the selected material image, and the right end of the period image 60 corresponds to the end point of reproduction of the selected material image.

The period setting unit 33 in FIG. 3 sets a plurality of periods (hereinafter referred to as “unit periods”) T within the reproduction period of the selected material image. Each unit period T is a period in which the character string Q is set. That is, one character string Q is set for each unit period T.

The period setting unit 33 of the first embodiment divides the reproduction period of the selected material image into a plurality of unit periods T on the time axis. FIG. 6 is a schematic diagram of the editing screen Gb in a state in which the reproduction period is divided into two unit periods T. FIG. The period setting unit 33 sets one boundary point B each time the user U instructs to divide the reproduction period (that is, to add a unit period T). A boundary point B is a time corresponding to a boundary between two unit periods T included in the reproduction period. As can be understood from the above description, the period setting section 33 sets a plurality of unit periods T within the reproduction period in accordance with instructions from the user U. FIG. An initial reproduction period that is not divided into a plurality of unit periods T may be interpreted as one unit period T.

The display control unit 31 displays each unit period T set by the period setting unit 33 using the period image 60 . That is, the display control unit 31 causes the display device 16 to display the period image 60 representing each unit period T. FIG. Specifically, the display control unit 31 causes the display device 16 to display a period image 60 in which a plurality of portions P corresponding to different unit periods T are arranged in the direction of the time axis.

The user U can select any unit period T (hereinafter referred to as “selection period Ts”) from among a plurality of unit periods T within the reproduction period by operating the period image 60 . The display control unit 31 causes the display mode of the portion P corresponding to the selected period Ts among the plurality of unit periods T to be different from the display mode of the portion P corresponding to each unit period T other than the selected period Ts. For example, the frame line of the portion P corresponding to the selected period Ts is highlighted in comparison with the frame line of the portion P corresponding to the unselected unit period T. FIG. When the unit period T is not set within the reproduction period (for example, the state of FIG. 5), the reproduction period is selected as the selection period Ts.

A selected material image is arranged in the first area 61 . For example, when the selected material image is a moving image, some still images among the plurality of still images forming the moving image are displayed in the first area 61 . Also, when the selected material image is a still image, the still image is displayed in the first area 61 .

The second area 62 is an area for receiving an instruction from the user U regarding the character string Q to be added to the selected material image. Specifically, in the second area 62, an image time length L, an allowable number of characters N, a character input area 63, an operation image 64, and an operation image 65 are displayed. The image time length L is the time length of the selection period Ts. That is, in the initial state in which the unit period T is not set within the reproduction period, the image time length L is the time length of the reproduction period (that is, the selection period Ts). On the other hand, when the unit period T is set within the reproduction period, the image time length L is the time length of the unit period T in the selected state (that is, the selected period Ts).

The allowable number of characters N is the maximum number of characters allowed in the corresponding character string Q for the selection period Ts. The display control unit 31 calculates the allowable number of characters N according to the image time length L of the selection period Ts. Specifically, the display control unit 31 calculates the allowable number of characters N by multiplying the standard speech speed S [characters/second] by the image time length L [seconds] (N=SL). The standard speech speed S is the number of characters pronounced by a standard speaker within a unit time (1 second), and is set to 5 characters/second, for example. Therefore, for example, if the image time length L of the selected material image is 6 seconds, the allowable number of characters N is 30 characters. The standard speech speed S is set to a preset fixed value or a variable value according to an instruction from the user U.

The character input area 63 is an input field for the user U to input the character string Q. FIG. That is, the character string Q specified by the user U operating the operation device 14 is displayed in the character input area 63 . When the number of characters of the character string Q input to the character input area 63 reaches the allowable number of characters N, for example, the display control unit 31 causes the display device 16 to display a warning message to notify the user U of exceeding the number of characters. may be notified to

As illustrated in FIG. 5, the first region 61 and the second region 62 are regions adjacent to each other. That is, the first area 61 is located on one side of the boundary line set on the editing screen Gb, and the second area 62 is located on the other side of the boundary line. A period image 60 is displayed below the first area 61 and the second area 62 . As described above, in the first embodiment, the first area 61 in which the selected material image is arranged and the second area 62 in which the user U inputs the character string Q are adjacent to each other. and the contents of the character string Q can be easily grasped by the user U.

The operation image 64 is an image of an operator that receives an instruction from the user U to add the unit period T within the reproduction period. The instruction given by operating the operation image 64 can also be rephrased as an instruction for dividing the reproduction period on the time axis. That is, the number of unit periods T in the reproduction period of the selected reproduction image increases each time the user U operates the operation image 64 . The operation image 65 is an image of an operator that receives from the user U an instruction to shift to the selection screen Ga.

FIG. 7 is a flowchart illustrating a specific procedure of a process (hereinafter referred to as "period setting process") Sa for setting a plurality of unit periods T within a reproduction period. When the period setting process Sa is started, the period setting unit 33 determines whether or not the operation image 64 has been operated by the user U (Sa1). That is, it is determined whether or not the user U has given an instruction to add the unit period T to the reproduction period.

When the operation image 64 is operated (Sa1: YES), the period setting section 33 adds a unit period T within the reproduction period (Sa2). Specifically, the period setting unit 33 sets one boundary point B within the reproduction period. For example, the period setting section 33 adds the unit period T so that each unit period T within the reproduction period has the same length of time. That is, the period setting section 33 sets a plurality of unit periods T by equally dividing the reproduction period on the time axis. Note that the method of dividing the playback period is not limited to the above example (equal division). For example, the period setting unit 33 may divide the reproduction period into a plurality of unit periods T of integer seconds. For example, a playback period of 5 seconds is divided into a unit period T of 2 seconds and a unit period T of 3 seconds.

In step Sa2, the period setting unit 33 of the first embodiment sets a plurality of unit periods T within the reproduction period such that the time length of each unit period T within the reproduction period is equal to or greater than a predetermined threshold value τ. That is, when the unit period T is added within the reproduction period, if the time length of any of the plurality of unit periods T after the addition is below the threshold value τ, the period setting unit 33 adds the unit period T (Sa2). don't run Specifically, the period setting unit 33 prohibits acceptance of the user U's operation of the operation image 64 . For example, the operation image 64 is set to an inoperable state (for example, grayed out state). As can be understood from the above description, the period setting unit 33 adds the unit period T to the reproduction period while ensuring that each unit period T has a time length equal to or greater than the threshold value τ. The threshold τ is set to the shortest length of time (for example, 2 seconds) in which a substantially significant utterance can be established.

The time length of each unit period T is changed by adding the unit period T (Sa2). Therefore, the display control unit 31 updates the image time length L and the allowable number of characters N of the selection period Ts to numerical values corresponding to the changed time length of the selection period Ts (Sa3). Specifically, since the selection period Ts is shortened by the addition of the unit period T, the image time length L and the allowable number of characters N of the selection period Ts are updated to smaller numerical values than before the addition of the unit period T. be.

The user U can instruct to change the time length of each unit period T by operating the operation device 14 . For example, the user U instructs to change the time length of each unit period T by changing the position of the boundary point B on the time axis. If the operation image 64 is not operated (Sa1: NO), the period setting unit 33 determines whether or not the user U has given an instruction to change the time length of each unit period T (Sa4). Specifically, the period setting unit 33 determines whether or not the user U has instructed to move any boundary point B within the reproduction period. When the change of the time length of each unit period T is instructed (Sa4: YES), the period setting unit 33 changes the time length of each unit period T within the reproduction period according to the instruction from the user U ( Sa5).

The period setting unit 33 of the first embodiment prohibits changing the time length of each unit period T such that the time length of any one of the plurality of unit periods T within the reproduction period falls below the threshold value τ. . For example, when the time length of each unit period T is changed in accordance with an instruction from the user U, if the time length of each unit period T after change falls below the threshold τ, the period setting unit 33 sets the unit period Maintain the time length of T at the threshold τ. That is, the shortening of the time length of the unit period T is limited to a range equal to or greater than the threshold value τ. After changing the time length of the unit period T according to the above procedure, the display control unit 31 updates the allowable number of characters N of the selection period Ts to a numerical value corresponding to the changed time length of the selection period Ts (Sa3).

If no change in the time length of the unit period T is instructed (Sa4: NO), the period setting unit 33 determines whether or not the user U has instructed to switch the unit period T to be selected (that is, the selection period Ts). Judgment (Sa6). That is, the period setting unit 33 determines whether or not the user U has instructed to select a unit period T different from the currently selected period Ts.

When switching of the selection period Ts is instructed (Sa6: YES), the period setting unit 33 switches the selection period Ts (Sa7). Specifically, the period setting unit 33 cancels the selection of the current selection period Ts, and selects the unit period T instructed by the user U as the selection period Ts after switching. When the image time length L and the allowable number of characters N of the selection period Ts are updated according to an instruction from the user U (Sa3), or when switching of the selection period Ts is not instructed (Sa6: NO), the period setting process Sa is finish.

The user U can input a desired character string Q representing the material sound to be added to the selected material image into the character input area 63 by operating the operation device 14 . The instruction receiving unit 34 in FIG. 3 receives from the user U an instruction for the character string Q to be added to the selected material image. The instruction accepting unit 34 individually accepts an instruction for the character string Q for each of the plurality of unit periods T within the reproduction period. Specifically, the instruction receiving unit 34 converts the character string Q input by the user U into the character input area 63 to the character string Q of the selected period Ts selected at the time of the input from among the plurality of unit periods T. accept as As can be understood from the above description, the user U selects the unit period T and inputs the character string Q corresponding to the unit period T (that is, the selected period Ts) every unit period T within the reproduction period. run to

The information processing section 35 in FIG. 3 acquires the voice data Y of the material voice corresponding to the character string Q received by the instruction receiving section 34 . The information processing section 35 of the first embodiment acquires the voice data Y from the voice synthesizing section 22 of the editing system 20 . Specifically, the information processing section 35 transmits a synthesis request including the character string Q of the selection period Ts from the communication device 13 to the editing system 20, and converts the speech data Y generated by the speech synthesis section 22 from the character string Q into It is received by the communication device 13 from the editing system 20 . The information processing section 35 saves the audio data Y acquired from the editing system 20 in the storage device 12 in association with the selection period Ts. The audio data Y of the selection period Ts represents the material audio of the selection period Ts.

The information processing section 35 also generates the material data D. FIG. As described above, the material data D includes image data X representing a material image and audio data Y of one or more material sounds added to the material image for each of a plurality of scenes. In an initial state in which the reproduction period of the material image is not divided into a plurality of unit periods T, the material data D includes one sound data Y corresponding to the reproduction period. On the other hand, when the reproduction period of the material image is divided into a plurality of unit periods T, the material data D includes a plurality of sound data Y corresponding to different unit periods T within the reproduction period.

FIG. 8 is a flowchart illustrating a specific procedure of a process Sb executed by the control device 11 (hereinafter referred to as "control process"). Triggered by an instruction from the user U to the operation device 14, the control process Sb is started.

When the control process Sb is started, the control device 11 causes the display device 16 to display the selection screen Ga of FIG. 4 (Sb1). The control device 11 executes a process of allocating the material image to each scene according to the instruction from the user U (Sb2). The control device 11 determines whether or not the transmission of the material data D has been instructed by the user U by operating the operation image 52 (Sb3). If transmission of the material data D has not been instructed (Sb3: NO), the control device 11 determines whether any of the plurality of material images (scenes) set on the selection screen Ga has been instructed by the user U. Determine (Sb4). Allocation of material images (Sb2) and determination of instruction to transmit material data D (Sb3) are repeated until the selected material image is selected (Sb4: NO).

When the selected material image is selected (Sb4: YES), the control device 11 causes the display device 16 to display the edit screen Gb of FIG. 5 (Sb5), and executes the period setting process Sa illustrated in FIG. ). When the period setting process Sa is executed, the control device 11 (instruction receiving unit 34) determines whether or not an instruction for the character string Q corresponding to the selection period Ts has been received from the user U (Sb7). When the character string Q is accepted (Sb7: YES), the control device 11 (information processing unit 35) acquires the audio data Y of the material audio corresponding to the character string Q from the audio synthesis unit 22 of the editing system 20 (Sb8 ). On the other hand, if the character string Q is not accepted (Sb7: NO), acquisition of the voice data Y (Sb8) is not executed.

The control device 11 determines whether or not the user U has instructed to shift to the selection screen Ga by operating the operation image 65 (Sb9). If the instruction to shift to the selection screen Ga is not given (Sb9: NO), the control device 11 shifts the process to step Sb6. On the other hand, when the instruction to shift to the selection screen Ga is given (Sb9: YES), the control device 11 shifts the process to step Sb1. That is, the period setting process Sa (Sb6), the reception of the character string Q (Sb7), and the acquisition of the voice data Y (Sb8) are repeated until the transition to the selection screen Ga is instructed.

By repeating the above processing for each selection of the material image (Sb4: YES), the audio data Y of the material audio is generated for the unit period T for each of the plurality of material images corresponding to different scenes in the selection screen Ga. is set for each After setting the audio data Y for all the material images, the user U operates the operation image 52 using the operation device 14 . When the operation image 52 is operated (Sb3: YES), the control device 11 (information processing section 35) generates material data D (Sb10) and transmits the material data D from the communication device 13 to the editing system 20. (Sb11). As described above, the material data D includes image data X of material images and sound data Y of one or more material sounds for each of a plurality of scenes. The editing system 20 uses the material data D to generate the content C. FIG. In the content C, a plurality of material images are linked in time series, and the material sound corresponding to one or more unit periods T of each material image is reproduced.

As described above, in the first embodiment, the character string Q is set for each unit period T of the material images forming the content C. FIG. Therefore, compared to the configuration in which the character string Q is set for each material image of the content C, many and various character strings Q can be set.

In the first embodiment, since the period image 60 representing each of the plurality of unit periods T within the reproduction period is displayed on the display device 16, the user U can intuitively determine the length of each unit period T with respect to the reproduction period. I can grasp it. Also, since each unit period T is set so that the time length of each unit period T is equal to or greater than the threshold value τ, each unit period T can be provided with a sufficient time length for reproducing the material sound represented by the character string Q.

Moreover, since the time length of each unit period T is changed according to an instruction from the user U, each unit period T within the reproduction period can be set to a time length that reflects the user U's intention. Moreover, since it is prohibited to change the time length of each unit period T so that the time length of each unit period T falls below the threshold value can be secured.

B: Second Embodiment FIG. 9 is a schematic diagram of an edit screen Gb in a second embodiment. In the editing screen Gb of the second embodiment, the character string Q set for the unit period T is displayed in the portion P corresponding to each unit period T in the period image 60 . Specifically, the character string Q is superimposed and displayed within the frame line of the portion P corresponding to each unit period T. FIG.

The same effects as in the first embodiment are achieved in the second embodiment. Further, according to the second embodiment, since the character string Q of the unit period T is arranged in the portion P corresponding to each unit period T, the user U can visually see the relationship between the unit period T and the character string Q. It has the advantage of being easily understood.

C: Third Embodiment FIG. 10 is a schematic diagram of an edit screen Gb in a third embodiment. In the first embodiment, the form in which the reproduction period is divided into a plurality of unit periods T was exemplified. That is, the plurality of unit periods T are successively arranged on the time axis without any interval. On the other hand, in the third embodiment, each of the plurality of unit periods T is individually set within the reproduction period of the selected material image. Therefore, two unit periods T that are adjacent to each other on the time axis can be set to either a state in which they are arranged with no space between them, or a state in which they are arranged with a space between them.

The user U can instruct to change the position on the time axis or the time length for each of the plurality of unit periods T (Sa4: YES). The period setting unit 33 changes the position of the selection period Ts on the time axis or the time length of the selection period Ts (specifically, the positions of the start point and the end point) in accordance with an instruction from the user U to the operation device 14. (Sa5). The period setting unit 33 of the third embodiment changes the position or time length of the selection period Ts so that the selection period Ts does not overlap another unit period T on the time axis. For example, it is assumed that the period setting unit 33 does not accept an instruction from the user U such that a plurality of unit periods T overlap. For example, focus on one unit period T1 and the unit period T2 after the unit period T1. Change the unit period T so that the end point of the unit period T1 is later than the start point of the unit period T2, or change the unit period T2 so that the start point of the unit period T2 is earlier than the end point of the unit period T1. Modification of T is prohibited.

The third embodiment also achieves the same effect as the first embodiment. In addition, in the third embodiment, each of the plurality of unit periods T is individually set within the reproduction period. In comparison, there is an advantage that the unit period T of the position and time length in line with the user U's intention can be set. It should be noted that a plurality of unit periods T may be allowed to overlap each other on the time axis. In a period in which a plurality of unit periods T overlap, material sounds corresponding to each unit period T are produced in parallel.

D: Modifications Examples of specific modifications added to the above-exemplified embodiments are given below. Two or more aspects arbitrarily selected from the following examples may be combined as appropriate within a mutually consistent range.

(1) In each of the above-described forms, the instruction receiving unit 34 receives the character string Q input by the user U using the operation device 14, but the instruction receiving unit 34 receives the character string Q input by the user U (that is It is not limited to an element that directly receives an operation on the operating device 14). For example, a form in which the instruction receiving unit 34 receives the character string Q specified by voice recognition of the voice uttered by the user U is also assumed. The instruction receiving unit 34 in the above embodiment is expressed as an element that receives the character string Q specified by voice recognition or an element that receives voice input by the user U. FIG.

(2) Some or all of the functions of the terminal device 10 (display control unit 31, sound emission control unit 32, period setting unit 33, instruction reception unit 34, information processing unit 35) according to the above-described embodiments are 20 may be installed. The terminal device 10 according to each form described above and the editing system 20 according to the present modification are comprehensively expressed as an "information processing system".

(3) As described above, the functions exemplified in each of the above embodiments are realized by cooperation of multiple processors (for example, the control device 11) and programs stored in a recording medium (for example, the storage device 12). A program for realizing the above functions can be provided in a form stored in a computer-readable recording medium and installed in a computer. The recording medium is, for example, a non-transitory recording medium, and an optical recording medium (optical disc) such as a CD-ROM is a good example. Also included are recording media in the form of It should be noted that the non-transitory recording medium includes any recording medium other than transitory, propagating signals, and does not exclude volatile recording media. Further, in a configuration in which the distribution device distributes the program via the communication network 200, the storage device 12 that stores the program in the distribution device corresponds to the aforementioned non-transitory recording medium.

E: Supplementary Note The following configurations, for example, can be grasped from the above-exemplified forms.

In an information processing method according to one aspect (aspect 1) of the present disclosure, during a playback period of one material image among a plurality of material images that form a series of content by being mutually connected on a time axis, A plurality of unit periods are set, and for each of the plurality of unit periods, a character string representing audio reproduced together with the one material image in the unit period is accepted. According to the above aspect, a character string is set for each unit period of one material image that constitutes the content. Therefore, a large number and variety of character strings can be set compared to a configuration in which a character string is set for each material image in units of material images constituting content.

In the specific example of Aspect 1 (Aspect 2), the image includes a first area in which the one material image is arranged and a second area that receives an instruction regarding the character string, wherein the first area and the second An edit screen in which two areas are adjacent to each other is displayed on the display device. In the above aspect, since the first area in which one material image is arranged and the second area for receiving an instruction regarding a character string are adjacent to each other, the correspondence between the content of one material image and the content of the character string can be easily grasped by the user.

In the specific example of Aspect 2 (Aspect 3), the editing screen includes a period image representing a reproduction period of the one material image, and the period image represents each of the plurality of unit periods within the reproduction period. . In the above aspect, the period image representing each of the plurality of unit periods within the reproduction period is displayed on the display device. Therefore, the user can intuitively grasp the length of each unit period with respect to the reproduction period.

In the specific example of any one of Aspects 1 to 3 (Aspect 4), in setting the plurality of unit periods, the time length of each of the plurality of unit periods is equal to or greater than a predetermined value within the reproduction period. to set the plurality of unit periods. In the above aspect, each unit period is set such that the time length of each unit period is equal to or greater than a predetermined value. Therefore, it is possible to secure a sufficient length of time for each unit period to reproduce the sound represented by the character string.

In a specific example of any one of Aspects 1 to 3 (Aspect 5), in setting the plurality of unit periods, the time length of each of the plurality of unit periods is changed according to an instruction from the user. . In the above aspect, the time length of each unit period is changed according to an instruction from the user. Therefore, each unit period can be set to a time length that reflects the user's intention.

In the specific example of Aspect 5 (Aspect 6), in setting the plurality of unit periods, the time length of each unit period is changed such that the time length of any one of the plurality of unit periods is less than a predetermined value. prohibited. In the above aspect, since it is prohibited to change the time length of each unit period so that the time length of each unit period falls below a predetermined value, a time length sufficient for reproducing the sound represented by the character string is ensured for each unit period. can.

An information processing system according to one aspect of the present disclosure provides a plurality of unit periods within a playback period of one material image among a plurality of material images that form a series of content by being interconnected on a time axis. and an instruction accepting unit that accepts, for each of the plurality of unit periods, a character string representing audio to be reproduced together with the one material image in the unit period.

A program according to one aspect of the present disclosure sets a plurality of unit periods within a playback period of one material image among a plurality of material images that form a series of content by being mutually linked on the time axis. and an instruction accepting unit that accepts, for each of the plurality of unit periods, a character string representing audio to be reproduced together with the one material image in the unit period.

DESCRIPTION OF SYMBOLS 100... Information system, 200... Communication network, 10... Terminal device, 11... Control device, 12... Storage device, 13... Communication device, 14... Operation device, 15... Imaging device, 16... Display device, 17... Sound emitting device , 20... editing system, 21... editing processing unit, 22... voice synthesizing unit, 31... display control unit, 32... sound emission control unit, 33... period setting unit, 34... instruction receiving unit, 35... information processing unit, 51 Template 52 Operation image 60 Period image 61 First area 62 Second area 63 Character input area 64 Operation image 65 Operation image Ga Selection screen Gb Edit screen .

Claims (8)

setting a plurality of unit periods within a reproduction period of one material image among a plurality of material images forming a series of content by being mutually linked on a time axis;
An information processing method implemented by a computer system, which accepts, for each of the plurality of unit periods, a character string representing audio reproduced together with the one material image in the unit period. an editing screen image including a first area in which the one material image is arranged and a second area for receiving an instruction regarding the character string, wherein the first area and the second area are adjacent to each other; , is displayed on a display device. The editing screen includes a period image representing a reproduction period of the one material image,
3. The information processing method according to claim 2, wherein said period image represents each of said plurality of unit periods within said reproduction period. The plurality of unit periods are set within the reproduction period such that the time length of each of the plurality of unit periods is equal to or greater than a predetermined value in setting the plurality of unit periods. Any information processing method. 4. The information processing method according to any one of claims 1 to 3, wherein in setting the plurality of unit periods, the time length of each of the plurality of unit periods is changed according to an instruction from a user. 6. The information processing method according to claim 5, wherein in setting the plurality of unit periods, changing the time length of each of the unit periods such that the time length of any one of the plurality of unit periods falls below a predetermined value is prohibited. a period setting unit that sets a plurality of unit periods within a reproduction period of one of a plurality of material images forming a series of content by being mutually linked on a time axis;
An information processing system, comprising: an instruction receiving unit that receives, for each of the plurality of unit periods, a character string representing a sound to be reproduced together with the one material image in the unit period. a period setting unit for setting a plurality of unit periods within a reproduction period of one material image among a plurality of material images forming a series of content by being mutually linked on a time axis;
A program that causes a computer system to function as an instruction receiving unit that receives, for each of the plurality of unit periods, a character string representing audio to be reproduced together with the one material image in the unit period.

Images