JP6773349B1 - Information processing equipment and programs - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device and a program which enable a user who edits AV data to superimpose audio data included in the AV data on the AV data as text data and easily display the data. SOLUTION: In an information processing apparatus, an editorial unit 102 processes image data based on audio data among AV data to be processed including at least audio data and image data to generate AV data. To edit. The text generation unit 103 generates text data indicating the content of the voice based on the voice data. The target determination unit 104 divides the generated text data into character strings of predetermined units, and determines one or more divided text data as editing targets. The editorial unit 102 further edits the AV data to be processed based on the determined one or more divided text data. [Selection diagram] FIG. 7

Description

The present invention relates to an information processing device and a program.

Conventionally, as a technique for assisting a viewer's understanding of AV (Audio Visual) data, there is a technique for displaying audio data included in AV data as text data by superimposing it on AV data (for example, patent). Reference 1).

Japanese Unexamined Patent Publication No. 2012-105234

However, in recent years, with the generalization of so-called video sharing services, the number of users who upload their own edited AV data to video sharing services is increasing. From such users, there is a request to edit AV data with a simple operation.

An object of the present invention is to enable a user who edits AV data to easily perform an operation of superimposing audio data included in the AV data on the AV data as text data and displaying the data. To do.

In order to achieve the above object, the information processing device of one aspect of the present invention is
Among the data to be processed including at least audio data and image data, an editing means for editing the data to be processed by processing the image data based on the audio data is provided.

The program of one aspect of the present invention is a program corresponding to the above-mentioned information processing apparatus of one aspect of the present invention.

According to the present invention, a user who edits AV data can easily perform an operation of superimposing audio data included in the AV data on the AV data and displaying it as text data.

It is a figure which shows the outline of an example of this service which can be realized by an information processing system including the server which concerns on one Embodiment of this invention. It is a figure which shows an example of the method of combining the preceding and following division text data among the method of editing the division text data individually. It is a figure which shows an example of the method of editing the designated division text data among the method of editing the division text data individually. It is a figure which shows an example of the method for setting the time zone for displaying a telop in AV data, and setting the appearance of a telop among the methods for individually editing the divided text data. It is a figure which shows an example of the structure of the information processing system including the server which concerns on one Embodiment of this invention. It is a block diagram which shows an example of the hardware configuration of a server in the information processing system of FIG. It is a functional block diagram which shows an example of the functional configuration for executing an edit reception process among the functional configurations of the server of FIG. It is a flowchart which shows the flow of the edit acceptance process whose execution is controlled by the server which has the functional configuration of FIG.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

In the following, when simply referred to as an "image", both a "moving image" and a "still image" are included.
Further, the "moving image" shall include an image displayed by each of the following first to third processes.
The first process is a process of continuously switching and displaying a series of still images composed of a plurality of images with the passage of time in response to each operation of an object (for example, an animation character) in a flat image (2D image). .. Specifically, for example, processing based on the principle of two-dimensional animation, so-called flip book, corresponds to the first processing.
The second process is a process in which a motion corresponding to each movement of an object (for example, an animation character) in a stereoscopic image (3D model image) is set, and the motion is changed and displayed with the passage of time. .. Specifically, for example, three-dimensional animation corresponds to the second process.
The third process is a process in which an image (that is, a moving image) corresponding to each movement of an object (for example, an animation character) is prepared and the image is played over time.
Here, the "video (that is, moving image)" is composed of images such as a plurality of frames and fields (hereinafter, referred to as "unit images"). In the following example, the unit image will be described as a frame.

First, with reference to FIGS. 1 to 3, an outline of a service (hereinafter, referred to as “this service”) that can be realized by the information processing system of FIG. 5 described later will be described.

FIG. 1 is a diagram showing an outline of an example of this service that can be realized by an information processing system, including a server according to an embodiment of the present invention.

This service is an example of a service provided by a service provider G (see FIG. 5) to a user U (see FIG. 5) who edits AV data.
In this service, the audio data among the AV data D including the audio data and the image data is output as editable text data T (hereinafter referred to as "text data T").
The output text data T can be superposedly displayed at an arbitrary position at an arbitrary timing of the AV data D to be reproduced by a predetermined setting operation by the user U.

Here, the "voice data" includes data of the voice emitted by the person M appearing in the AV data D as the subject and the person M appearing only by the voice like a narration. In addition, "voice data" also includes data of voices emitted from organisms and objects other than humans.
Specifically, for example, the barking of dogs and cats, BGM (Back Ground Music) of restaurants, engine sounds of automobiles, and the like are all included in the audio data.

The user U is included in the AV data D to be edited simply by operating the terminal 2 (hereinafter referred to as "user terminal 2") such as his / her smartphone without requiring specialized knowledge. Audio data can be output as text data T. Further, the user U can edit the AV data D by editing the output text data T.

FIG. 1 shows an example of a UI (User Interface) displayed on the user terminal 2 of the user U who uses this service. The UI shown in FIG. 1 is configured to include at least a display area F1 and a display area F2.
In the display area F1, the AV data D to be edited is displayed in a playable state. It should be noted that the content of the AV data D in FIG. 1 is such that the person M appearing as a subject talks variously to the viewer of the AV data D.
In the display area F2, a part of the text data T, which is the text data of the voice data included in the AV data D to be edited, is displayed. Specifically, in the display area F2, among the text data t1 to tun (hereinafter, referred to as "divided text data t1 to tun") divided into n character strings (n is an integer value of 1 or more). , Category text data t1 to t7 are displayed.
That is, in the display area F2, the division text data t1 "Yes, thank you", the division text data t2 "It is Takenoko", the division text data t3 "Today is this", and "usbc hub" The division text data t4, the division text data t5 "let me introduce you", the division text data t6 "I think", and the division text data t7 "please see" are displayed.
In the example of FIG. 1, the button B1 described as "write" is displayed so as to overlap the divided text data t6. Therefore, at the display timing shown in FIG. 1, the division text data t6 is invisible.
Further, in the example of FIG. 1, only the division text data t1 to t7 are displayed among the division text data t1 to tn. However, the user U can swipe the display area F2 upward to sequentially display the divided text data t8 to tun.

Here, when the user U taps the button B1 labeled "write" in the display area F2, the entire text of the text data T (not shown) can be output in a predetermined format.
Specifically, for example, when user U taps button B1, the full text of the text data T says, "Yes, I'm a bamboo shoot. Today, I'd like to introduce you to this usbc hub. Please take a look. The HDMI cable is also tight. I have used it several times, but this does not cause any connection failure. ”Text data T is output in the specified format. ..
The format when the user U outputs the entire text of the text data T is not particularly limited. For example, as a format for the user U to output the full text of the text data T, the full text of the text data T can be displayed as a text as it is on the user terminal 2, or can be output as a data file.

The user U can also specify arbitrary division text data tk (k is an arbitrary integer value of 1 or more and n or less) among the division text data t1 to tun and edit them individually.
Hereinafter, a method of individually editing the divided text data tk will be described with reference to FIGS. 2 and 3.

FIG. 2 is a diagram showing an example of a method of combining the preceding and following divided text data among the methods of individually editing the divided text data.

FIG. 2A shows an example of a method of combining the divided text data tk and the divided text data tk + 1.
FIG. 2B shows an example of the state after the division text data tk and the division text data tk + 1 are combined.
In the method shown in FIG. 2A, the user U performs an operation of dragging the editing object Jk + 1 indicating the division text data tk + 1 to the editing object Jk indicating the division text data tk. Thereby, the division text data tk and the division text data tk + 1 can be combined.
Specifically, as shown in FIG. 2A, the user U drags the editing object J1 indicating the division text data t1 so as to superimpose the editing object J2 indicating the division text data t2. To do.
As a result, as shown in FIG. 2 (B), the division text data t1 "Yes, it is" is combined with the division text data t2 "It is bamboo shoot", and the division text data t1 "Yes, it is bamboo shoot" is combined. Is displayed.
Further, since the division text data t2 is combined with the division text data t1 by the above-mentioned drag operation, the division text data t3 to t8 below the division text data t3 are sequentially moved up and displayed. That is, each of the divided text data t3 to t8 shown in FIG. 2 (A) is displayed as each of the divided text data t2 to t7 shown in FIG. 2 (B). Further, the division text data t9 "please see" that was not displayed in the state shown in FIG. 2 (A) (the state showing before the drag operation described above) is the division text in the state shown in FIG. 2 (B). It is displayed in the data t8.

As described above, the user U can specify any division text data tk among the division text data t1 to tun as an editing target and edit it individually.
Specifically, for example, as shown in FIG. 2B, the user U taps the button B2 marked with "..." at the right end of the editing object J1 indicating the division text data t1. Do. As a result, the user U can specify the divided text data t1 as an editing target and edit it individually.

FIG. 3 is a diagram showing an example of a method of editing a designated divided text data among the methods of individually editing the divided text data.

FIG. 3A shows how the user U edits the segmented text data tk. When the button B2 shown in FIG. 2B described above is tapped, the button B4 for editing the divided text data tk as shown in FIG. 3A is displayed in the display area F2.
Specifically, for example, as shown in FIG. 3A, when the division text data t1 is designated as an editing target, the editing object J1 indicating the division text data t1 becomes active. At the same time, a button B4 for selecting an input character is displayed in the display area F2.
As a result, the user U can freely edit the divided text data t1. In addition, FIG. 3A shows an example in which the sentence "Yes, it is a bamboo shoot" is edited into the sentence "Yes, it is a bamboo shoot".
When the editing work is completed, the user U performs an operation of tapping the button B3 indicating that fact. As a result, the user U can superimpose the telop P1, which is a display object corresponding to the division text data t1 designated as the editing target, on the AV data D and display it.

In FIG. 3B, buttons B5 and buttons B6 are displayed on the right side of the editing object J1 showing the division text data t1. Button B5 is a button that the user U taps or the like when setting a time zone for displaying the telop Pk corresponding to the edited divided text data tk on the AV data D. Button B6 is a button that the user U taps or the like when setting whether or not to display the telop Pk on the AV data D.
In the example of FIG. 3B, when the user U taps the button B5, for example, the UI as shown in FIG. 4A is displayed on the user terminal 2. That is, the user terminal 2 displays a UI for setting a time zone in which the user U displays the telop P1 on the AV data D. A specific example of the UI for setting the time zone for the user U to display the telop P1 on the AV data D will be described later with reference to FIG. 4 (A).
Further, when the user U taps the button B6, the telop P1 can be prevented from being displayed on the AV data D.

FIG. 4 is a diagram showing an example of a method for individually editing the divided text data, for setting the time zone for displaying the telop on the AV data and for setting the appearance of the telop, respectively.

FIG. 4A shows a UI for setting a time zone in which the telop P1 corresponding to the division text data t1 “Yes, it is a bamboo shoot” illustrated in FIG. 3 is superimposed on the AV data D and displayed. An example is shown.
As shown in FIG. 4A, the user U performs an operation of dragging each of the setting bars R1 and R2 on the timeline L shown in the display area F2. As a result, the user U can freely set the time zone in which the telop P1 is superimposed on the AV data D and displayed.

In the display area F2 of FIG. 4B, a UI for setting the appearance when the telop P is displayed on the AV data D is displayed.
Specifically, in the display area F2 of FIG. 4B, buttons B7 and buttons are used as buttons for setting the font of the telop P and the font color of the telop P as UI. Each of B8 is displayed.
As a result, the user U can freely set the appearance of the telop P to be displayed on the AV data D. Specifically, for example, as illustrated in FIG. 4B, the font is set to "Gothic 1" and the font color is set to "Gothic 1" for the telop P "Good morning" displayed so as to be superimposed on the AV data D. You can set it to "white".

Next, the configuration of the information system that realizes this service will be described.
FIG. 5 is a diagram showing an example of a configuration of an information processing system including a server according to an embodiment of the present invention.

The information processing system shown in FIG. 5 is configured to include a server 1 and a user terminal 2.
The server 1 and the user terminal 2 are connected to each other via a predetermined network N such as the Internet.

The server 1 is an information processing device managed by the service provider G. The server 1 executes various processes for realizing this service while appropriately communicating with the user terminal 2.

The user terminal 2 is an information processing device operated by the user U, and is composed of, for example, a personal computer, a smartphone, a tablet, or the like.

FIG. 6 is a block diagram showing an example of the hardware configuration of the server in the information processing system of FIG.

The server 1 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a bus 14, an input / output interface 15, an input unit 16, and an output unit 17. A storage unit 18, a communication unit 19, and a drive 20 are provided.

The CPU 11 executes various processes according to the program recorded in the ROM 12 or the program loaded from the storage unit 18 into the RAM 13.
Data and the like necessary for the CPU 11 to execute various processes are also appropriately stored in the RAM 13.

The CPU 11, ROM 12 and RAM 13 are connected to each other via the bus 14. An input / output interface 15 is also connected to the bus 14. An input unit 16, an output unit 17, a storage unit 18, a communication unit 19, and a drive 20 are connected to the input / output interface 15.

The input unit 16 is composed of, for example, a keyboard or the like, and outputs various information.
The output unit 17 is composed of a display such as a liquid crystal display, a speaker, or the like, and outputs various information as images or sounds.
The storage unit 18 is composed of a DRAM (Dynamic Random Access Memory) or the like, and stores various data.
The communication unit 19 communicates with another device (for example, the user terminal 2 in FIG. 5) via the network N including the Internet.

A removable medium 30 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is appropriately mounted on the drive 20. The program read from the removable media 30 by the drive 20 is installed in the storage unit 18 as needed.
In addition, the removable media 30 can also store various data stored in the storage unit 18 in the same manner as the storage unit 18.

Although not shown, the user terminal 2 of FIG. 5 can also have the same configuration as the hardware configuration shown in FIG. Therefore, the description of the hardware configuration of the user terminal 2 will be omitted.

By collaborating with the various hardware of the server 1 of FIG. 6 and the various software, it is possible to execute various processes including the edit reception process on the server 1. As a result, the service provider G can provide the above-mentioned service.

The "editing reception process" means the process for realizing the above-mentioned service.
Hereinafter, the functional configuration for executing the edit reception process, in which the execution of the process is controlled on the server 1, will be described.

FIG. 7 is a functional block diagram showing an example of the functional configuration for executing the edit reception process among the functional configurations of the server of FIG.

As shown in FIG. 7, in the CPU 11 of the server 1, when the execution of the edit reception process is controlled, the acquisition unit 101, the editing unit 102, the text generation unit 103, the target determination unit 104, and the display control unit 105 works.
Further, an AV data DB 181 is provided in one area of the storage unit 18 of the server 1. The AV data DB 181 stores and manages one or more AV data D created or acquired by the user terminal 2.

The acquisition unit 101 acquires the AV data D to be processed, which includes at least audio data and image data. The AV data D acquired by the acquisition unit 101 is stored and managed in the AV data DB 181.

The editing unit 102 edits the AV data D to be processed by processing the image data based on the audio data among the AV data D to be processed acquired by the acquisition unit 101. Specifically, the editing unit 102 performs editing as shown in FIGS. 2 to 4 described above, for example, as processing of image data.
Further, the editing unit 102 edits the AV data D to be processed based on the division text data t1 to tun determined as the editing target by the target determination unit 104 described later.

The text generation unit 103 generates text data T indicating the content of the voice of the voice data based on the voice data included in the AV data D to be processed acquired by the acquisition unit 101.
Specifically, the text generation unit 103 recognizes the voice data included in the AV data D to be processed acquired by the acquisition unit 101, and generates the text data T indicating the content of the voice data. For example, in the example of FIGS. 1 to 4 above, the text generator 103 says, "Yes, I'm a bamboo shoot. Today, I'd like to introduce you to this usbc hub. Look at this. The HDMI cable is also tight. Well, I've used it several times, but this is where no connection failure occurs at all. "
The method used by the text generation unit 103 to generate the text data T is not particularly limited. For example, a conventional transcription method can be adopted, or an automatic recognition method by AI (artificial intelligence) can be adopted.

The target determination unit 104 divides the text data T generated by the text generation unit 103 into the division text data t1 to tun, and determines one or more division text data t as the editing target.
Here, the determination of the editing target by the target determination unit 104 may be automatically performed or may be selected by the user U. The specific method when the editing target is automatically determined is not particularly limited, but for example, a predetermined algorithm or a technique such as machine learning by AI (artificial intelligence) is used.

The display control unit 105 executes control for displaying a predetermined UI for supporting editing by the editorial unit 102.
Specifically, for example, the display control unit 105 executes control for displaying the UI shown in FIGS. 1 to 4 on the user terminal 2 as a predetermined UI for supporting editing by the editing unit 102.

Next, with reference to FIG. 8, the flow of the edit reception process whose execution is controlled by the server 1 having the functional configuration of FIG. 7 will be described.
FIG. 8 is a flowchart showing a flow of edit reception processing whose execution is controlled by the server 1 having the functional configuration of FIG. 7.

That is, when the execution of the edit acceptance process is controlled by the server 1 of FIG. 7, in step S1, the text generation unit 103 of the server 1 determines whether or not the AV data D to be processed is selected. ..
When the predetermined AV data D is selected as the processing target, it is determined as "YES" in step S1, and the processing proceeds to step S2.
On the other hand, when the AV data D to be processed is not selected, the process of step S1 is performed until it is determined as "NO" in step S1 and the predetermined AV data D is selected as the processing target. Control is repeatedly executed.

In step S2, the text generation unit 103 of the server 1 recognizes the voice data included in the AV data D selected as the processing target.
In step S3, the text generation unit 103 of the server 1 generates text data T indicating the content of the voice of the voice data based on the voice data included in the AV data D selected as the processing target.
In step S4, the target determination unit 104 of the server 1 divides the text data T generated by the text generation unit 103 in step S3 into the division text data t1 to tn.
In step S5, the target determination unit 104 of the server 1 determines one or more of the divided text data t1 to tun classified in step S4 as the editing target.
In step S6, the display control unit 105 of the server 1 executes control to display the UI including one or more divided text data t to be operated on the user terminal 2 as the UI for supporting the editing by the editing unit 102. To do.

In step S7, the editorial unit 102 of the server 1 determines whether or not the divided text data of the AV data D to be processed has been edited via the UI including the divided text data t. When the division text data of the AV data D to be processed is edited, it is determined as "YES" in step S7, and the process proceeds to step S8.
On the other hand, if the division text data of the AV data D to be processed has not been edited, it is determined as "NO" in step S7, and the division text data of the AV data D to be processed is edited. Until then, the control of the process in step S7 is repeatedly executed.

In step S8, the editorial unit 102 of the server 1 accepts edits to the divided text data t.
As a result, the edit acceptance process whose execution is controlled by the server 1 ends.

Although one embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiment, and modifications, improvements, and the like within the range in which the object of the present invention can be achieved are included in the present invention. Is.

For example, the audio data and the image data included in the AV data D in the above-described embodiment are merely examples, and any AV data D can be the target of this service.

Further, for example, in FIGS. 1 to 4, only one person M appearing in the AV data D is drawn, but this is only an example. There may be a plurality of persons M appearing in the AV data D.

Further, for example, the contents of the text data T (that is, voice data) in the above-described embodiment and the respective division units and contents of the division text data t1 to t7 constituting the text data T are merely examples. Of course, it may be a division unit or content other than the above-described embodiment.

Further, for example, in FIG. 2, as a method of combining the divided text data t1 and the divided text data t2, the editing object J2 showing the divided text data t2 is placed on the editing object J1 showing the divided text data t1. The method of dragging so as to overlap is shown. However, in addition to this method, for example, the editing object J1 indicating the division text data t1 may be dragged onto the editing object J2 indicating the division text data t2. As a result, the divided text data t1 and the divided text data t2 can be combined.

Further, the system configuration shown in FIG. 5 and the hardware configuration of the server 1 shown in FIG. 6 are merely examples for achieving the object of the present invention, and are not particularly limited.

Further, the functional block diagram shown in FIG. 7 is merely an example and is not particularly limited. That is, it suffices if the information processing system is provided with a function capable of executing the above-mentioned series of processes as a whole, and what kind of functional block is used to realize this function is not particularly limited to the example of FIG. ..

Further, the location of the functional block is not limited to FIG. 7, and may be arbitrary.
For example, in the example of FIG. 7, the functional block required for executing the edit reception process is configured to be provided on the server 1 side, but this is only an example. For example, by installing an application program dedicated to the user of this service on the user terminal 2, at least a part of these functional blocks may be provided on the user terminal 2 side.
Further, one functional block may be configured by a single piece of hardware, a single piece of software, or a combination thereof.

When the processing of each functional block is executed by software, the programs constituting the software are installed on a computer or the like from a network or a recording medium.
The computer may be a computer embedded in dedicated hardware. Further, the computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose smartphone or a personal computer in addition to a server.

The recording medium containing such a program is not only composed of removable media, which is distributed separately from the device main body to provide the program to each user, but also is preliminarily incorporated in the device main body to each user. It is composed of the provided recording media and the like.

In the present specification, the steps for describing a program recorded on a recording medium are not necessarily processed in chronological order according to the order, but are not necessarily processed in chronological order, but in parallel or individually. It also includes the processing to be executed.

Further, in the present specification, the term of the system means an overall device composed of a plurality of devices, a plurality of means, and the like.

Summarizing the above, the information processing system to which the present invention is applied suffices to have the following configuration, and various various embodiments can be taken.
That is, the information processing device to which the present invention is applied (for example, the server 1 in FIG. 7) is
Of the data to be processed (for example, AV data D) including at least audio data (for example, audio data) and image data (for example, image data), the image data is processed based on the audio data. An editing means (for example, the editing unit 102 in FIG. 7) for editing the data to be processed is provided.

As a result, among the data to be processed including the audio data and the image data, the data to be processed can be edited by processing the image data based on the audio data. As a result, even a person without specialized knowledge can edit AV data for uploading to a video sharing service with a simple operation.

Further, a text generation means (for example, the text generation unit 103 in FIG. 6) that generates text data indicating the content of the voice based on the voice data included in the data to be processed, and
An edit target determination means (for example, the target determination unit 104 in FIG. 6) that divides the generated text into character strings of a predetermined unit and determines one or more character strings as edit targets.
With more
The editing means can edit the data to be processed based on the one or more character strings determined as the editing target.

As a result, text data indicating the content of the voice is generated based on the voice data included in the data to be processed. In addition, the editing target is determined based on the text data divided into character strings of a predetermined unit. As a result, even a person without specialized knowledge can edit AV data for uploading to a video sharing service with a simple operation.

Further, a display control means (for example, the display control unit 105 in FIG. 6) for executing control for displaying the editing screen for supporting the editing can be further provided.

As a result, a screen for editing the data to be processed can be displayed on a terminal such as a smartphone. As a result, even a person without specialized knowledge can easily edit AV data for uploading to a video sharing service, for example, by a simple operation on a terminal such as a smartphone.

Further, the display control means is
It is possible to execute a control for displaying an object indicating each of the one or more character strings determined as an editing target on the editing screen so as to be selectable.

As a result, an object indicating each of the one or more character strings determined as the editing target is displayed on the editing screen for editing the data to be processed. As a result, for example, AV data for uploading to a video sharing service can be edited with a simple operation.

1 ... server, 2 ... user terminal, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... bus, 15 ... input / output interface, 16 ... input Unit, 17 ... Output unit, 18 ... Storage unit, 19 ... Communication unit, 20 ... Drive, 30 ... Removable media, 101 ... Acquisition unit, 102 ... Editorial department, 103 ... text generation unit, 104 ... target determination unit, 105 ... display control unit, 181 ... AV data DB, D ... AV data, t ... division text data, B ... -Button, J ... Editing object, F ... Display area, M ... Person, L ... Image timeline, R ... Bar, N ... Network

Claims (3)

Of the data to be processed including at least audio data and image data, an editing means for editing the data to be processed by processing the image data based on the audio data, and
A text generation means for generating text data indicating the content of the voice based on the voice data included in the data to be processed, and
An editing target determining means for dividing the text in the generated text data into character strings of a predetermined unit and determining one or more character strings as editing targets.
A display control means that executes control to display a predetermined editing screen for supporting the editing, and
Equipped with a,
The editing means edits the data to be processed based on the one or more character strings determined as the target of the editing.
The display control means executes control to display an object indicating each of the one or more character strings determined as the target of editing on the editing screen in chronological order and in a selectable manner.
In the editing target determining means, one third object is generated by overlapping the first object and the second object in the context among the one or more objects displayed in time series on the editing screen. Then, the third character string obtained by combining the first character string indicated by the first object and the second character string indicated by the second object is used as the character string indicated by the third object. Decide what to edit,
Information processing device. The third object is created by overlapping the first object and the second object by a predetermined operation of the user who performs the editing.
The information processing device according to claim 1. For computers that control information processing devices
Of the data to be processed including at least audio data and image data, an editing step of editing the processing target data by processing the image data based on the audio data, and
A text generation step of generating text data indicating the content of the voice based on the voice data included in the data to be processed, and a text generation step.
An edit target determination step in which the text in the generated text data is divided into character strings of a predetermined unit and one or more character strings are determined as edit targets.
A display control step that executes control to display a predetermined editing screen for supporting the editing, and
A program for executing a control process comprising,
In the editing step, the data to be processed is edited based on the one or more character strings determined as the target of the editing.
In the display control step, control is executed to display an object indicating each of the one or more character strings determined as the target of the editing on the editing screen in chronological order and in a selectable manner.
In the edit target determination step, one third object is generated by overlapping the first object and the second object in the context among the one or more objects displayed in time series on the edit screen. Then, the third character string obtained by combining the first character string indicated by the first object and the second character string indicated by the second object is used as the character string indicated by the third object. Decide what to edit,
program.

Images