JP2019113661A - Display control method and program - Google Patents

Abstract

To enable a user to easily check the mutual relationship among time series of a plurality of elements.SOLUTION: An information processing device specifies a time series of a plurality of first elements and a time series of a plurality of second elements similar to the time series of the plurality of first elements from a time series of a plurality of elements represented by time series data, and makes a display device display a presentation screen on which a first image in which the plurality of first elements are arranged in a first direction and a second image in which the plurality of second elements are arranged in the first direction are displayed in parallel with a second direction intersecting the first direction.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a technique for displaying a plurality of elements (for example, chord names of songs) arranged in time series.

  There has been conventionally proposed a technique for estimating a time series of a plurality of code names in the music by analyzing an acoustic signal representing a performance sound of the music. For example, Patent Document 1 discloses a code estimation and detection apparatus that determines a constituent sound of a code and a bass sound from an acoustic signal, and estimates a code name from a result of the determination. The result of the code name estimation is displayed on the display.

JP 2014-235328 A

  There is a problem that the user can not easily confirm the relationship between a plurality of sections similar to each other in the music simply by displaying the time series of a plurality of code names estimated from the sound signal linearly on the time axis. . Although the above description exemplarily illustrates a scene displaying a time series of a plurality of code names in music, the same may be applied to any scene in which a plurality of elements arranged in time series are displayed on a display device. A problem is assumed. In consideration of the above circumstances, a preferred aspect of the present invention aims to enable a user to easily confirm the mutual relationship of time series of a plurality of elements.

  In order to solve the above problems, an information processing apparatus according to a preferred aspect of the present invention is a time series of a plurality of elements represented by time series data, a time series of a plurality of first elements, and the plurality of first elements. A time series of a plurality of second elements similar to the time series of elements is specified, and a first image in which the plurality of first elements are arranged in a first direction, and the plurality of second elements in the first direction The display device displays a presentation screen in which the arranged second images are arranged in a second direction crossing the first direction.

  A program according to a preferred aspect of the present invention is, from a time series of a plurality of elements represented by time series data, a plurality of second time series of a plurality of first elements and a plurality of second series similar to the time series of the plurality of first elements. A time-series analysis process of specifying a time-series of elements; a first image in which the plurality of first elements are arranged in a first direction; and a second image in which the plurality of second elements are arranged in the first direction And causing the display control process to cause the display device to display a presentation screen in which the presentation screen is arranged in a second direction crossing the first direction.

It is a block diagram which illustrates the composition of the information processor concerning a 1st embodiment of the present invention. It is explanatory drawing of an analysis period (designation period and related period). It is a schematic diagram of a presentation screen. It is a flowchart of the process which a control apparatus performs. It is a schematic diagram of the presentation screen in 2nd Embodiment. It is a schematic diagram of the presentation screen in 3rd Embodiment. It is a schematic diagram of the presentation screen in 4th Embodiment.

First Embodiment
FIG. 1 is a block diagram of an information processing apparatus 100 according to the first embodiment of the present invention. The information processing apparatus 100 according to the first embodiment is realized by a computer system including a control device 11, a storage device 12, a display device 13, and an input device 14. For example, a portable information terminal such as a mobile phone or a smartphone, or a portable or stationary information terminal such as a personal computer is suitably used as the information processing apparatus 100 according to the first embodiment.

  The display device 13 is formed of, for example, a liquid crystal display panel, and displays an image instructed from the control device 11. The input device 14 is an input device that receives an instruction from a user. Specifically, a plurality of operators operable by the user or a touch panel for detecting a touch on the display surface of the display device 13 is suitably used as the input device 14. Also, a sound collection device that receives voice input from the user may be used as the input device 14.

  The storage device 12 stores a program executed by the control device 11 and various data used by the control device 11. The storage device 12 is configured by, for example, a known recording medium such as a magnetic recording medium or a semiconductor recording medium, or a combination of plural kinds of recording media. A storage device 12 (for example, a cloud storage) separate from the information processing apparatus 100 is prepared, and the control device 11 executes writing and reading to the storage device 12 via a communication network such as a mobile communication network or the Internet. You may That is, the storage device 12 may be omitted from the information processing apparatus 100.

  The storage device 12 according to the first embodiment stores an acoustic signal X representing the playing sound of music. Specifically, an acoustic signal X representing various sounds such as musical tones uttered from a musical instrument or singing sounds uttered by a singer is stored in the storage unit 12. For example, the acoustic signal X may be supplied to the information processing apparatus 100 from a reproduction apparatus that reproduces the acoustic signal X recorded on a recording medium such as an optical disc. The acoustic signal X is stored in the storage unit 12 as a file of any type.

  The control device 11 is, for example, a processing circuit such as a central processing unit (CPU), and controls the elements constituting the information processing apparatus 100 in a centralized manner. The control device 11 according to the first embodiment executes a program stored in the storage device 12 to analyze the acoustic signal X and display the result on the display device 13 (signal analysis unit 21, time series The analysis unit 22, the display control unit 23, and the change processing unit 24) are realized. Note that the function of the control device 11 may be realized by a set of plural devices (that is, a system), or a part or all of the functions of the control device 11 may be realized by a dedicated electronic circuit (for example, a signal processing circuit). It is also good.

  The signal analysis unit 21 analyzes the acoustic signal X stored in the storage unit 12 to generate code data D. The code data D is time series data representing a time series of a plurality of code names C in the music represented by the sound signal X. Specifically, the code data D designates a code name C for each of a plurality of unit periods obtained by dividing the music on the time axis. Each unit period is a period of time length defined by the beat of the music. In the first embodiment, a period corresponding to one bar of music (that is, a plurality of beats) is exemplified as a unit period. Further, for the processing in which the signal analysis unit 21 estimates a time series of a plurality of code names C from the sound signal X, a known music analysis technique is arbitrarily adopted.

  The time series analysis unit 22 analyzes the code data D generated by the signal analysis unit 21 to make a plurality of periods in which the time series of a plurality of code names C in the music are similar to each other (hereinafter referred to as “analysis period”) Identify Q Specifically, as illustrated in FIG. 2, the time-series analysis unit 22 has one period (hereinafter referred to as “designated period”) Qa designated by the user by the operation on the input device 14 and a plurality of them in the music. A period Qb having a time series of code name C similar to the designated period Qa (hereinafter referred to as “related period”) is specified as the analysis period Q. In the first embodiment, a plurality of (specifically, three) related periods Qb similar to one designated period Qa are specified. Specifically, the time series analysis unit 22 identifies one related period Qb located in front of the designated period Qa and two related periods Qb located behind the specified period Qa. Each analysis period Q is a period of time length defined by the beat of the music. Each analysis period Q in the first embodiment is a period of time length corresponding to one bar of the music (ie, a plurality of beats). The plurality of analysis periods Q do not overlap each other on the time axis. Note that the method by which the time series analysis unit 22 specifies a plurality of analysis periods Q is arbitrary. For example, the similarity with the time series of a plurality of code names C in the designated period Qa is calculated for each of a plurality of periods obtained by dividing the music on the time axis, and predetermined periods having high degrees of similarity are taken as the related period Qb. It is possible to choose.

  The display control unit 23 of FIG. 1 causes the display device 13 to display an image. The display control unit 23 according to the first embodiment causes the display device 13 to display the presentation screen 30 of FIG. 3 that represents the result of analysis by the time series analysis unit 22. As illustrated in FIG. 3, the presentation screen 30 includes a plurality (four) corresponding respectively to the plurality of analysis periods Q (one designated period Qa and three related periods Qb) specified by the time-series analysis unit 22. The time series image 31 is included. The time-series image 31 corresponding to any one analysis period Q is an image representing a time series of a plurality of code names C in the analysis period Q.

  Each time-series image 31 is an image in which a plurality of unit images 32 corresponding to different unit periods are arranged in the X direction. The X direction is a lateral direction that means the direction of the time axis. The plurality of time-series images 31 are juxtaposed with one another in the Y direction (specifically, the vertical direction) intersecting the X direction. The X direction is an example of the “first direction”, and the Y direction is an example of the “second direction”.

  As understood from the above description, the presentation screen 30 is an image in which a plurality of unit images 32 are arranged in a matrix along the X direction and the Y direction. A frame-like image 33 meaning that the designated period Qa is added to one time-series image 31 corresponding to the designated period Qa among the plurality of time-series images 31. The user can change the designated period Qa in the music by appropriately operating the time-series image 31 (for example, moving the time-series image 31 to the left and right). The time-series analysis unit 22 specifies a related period Qb similar to the updated designated period Qa every update of the designated period Qa.

  The m-th (m is a natural number) unit image 32 of the time-series images 31 corresponding to one arbitrary analysis period Q is a rectangular image representing the m-th unit period in the analysis period Q. is there. The code name C specified by the time series analysis unit 22 for the unit period is added to the unit image 32 corresponding to one arbitrary unit period. That is, in the presentation screen 30, a plurality of time-series images 31 in which a plurality of code names C are arranged in the X direction are arranged in the Y direction. Therefore, the user can visually confirm the time series of a plurality of code names C in each analysis period Q from the time series image 31.

  As described above, although the result of analysis by the time-series analysis unit 22 is displayed on the presentation screen 30, the user may want to change the code name C estimated from the acoustic signal X. For example, the user may correct the code name C mispredicted from the sound signal X. In addition, the code name C estimated from the sound signal X may be changed to the code name C in accordance with the user's intention and preference. The change processing unit 24 in FIG. 1 changes the code name C arranged on the presentation screen 30 according to an instruction from the user. For example, the user can designate the code name C after the change after selecting any one unit image 32 by appropriately operating the input device 14. The change processing unit 24 changes the code name C designated by the code data D for the unit period of the unit image 32 selected by the user to the code name C after the change instructed by the user.

  By the way, the time series of a plurality of code names C is similar among a plurality of analysis periods Q. Therefore, as understood from FIG. 3, in the presentation screen 30, a plurality of unit images 32 to which code names C that are similar to or match each other are added are arranged in the Y direction. The user can select a set L of a plurality of unit images 32 arranged along the Y direction (hereinafter referred to as “unit image sequence”) by appropriately operating the input device 14. When the unit image sequence L is selected, the display control unit 23 displays a frame-shaped image 34 indicating the unit image sequence L.

  In the state where the image 34 is displayed, the user can instruct to collectively change the code names C of a plurality of unit periods corresponding to the unit image sequence L by appropriately operating the input device 14. Specifically, the user specifies the code name C after the change after selecting the unit image sequence L. The change processing unit 24 changes a plurality of code names C designated by the code data D for a plurality of unit periods corresponding to the unit image string L selected by the user to the code name C after the change designated by the user. Do. That is, in the first embodiment, not only the code name C is individually changed in response to an instruction from the user for each unit period, but a plurality of code names C arranged in the Y direction on the presentation screen 30 are used. Are collectively changed according to the instructions from the person in charge. Therefore, as compared with a configuration in which the code name C needs to be changed individually for each unit period, there is an advantage that it is possible to reduce the burden on the user who intends to edit the code name C of the music.

  FIG. 4 is a flowchart of processing executed by the control device 11. For example, in response to an instruction from the user to the input device 14, the process of FIG. 4 is started. When the process of FIG. 4 is started, the signal analysis unit 21 generates code data D by analyzing the acoustic signal X (Sa1).

  The time series analysis unit 22 specifies a plurality of analysis periods Q from the code data D (Sa2 / time series analysis processing). Specifically, a designated period Qa according to an instruction from the user and a plurality of related periods Qb in which time series of a plurality of code names C are similar to the designated period Qa are specified as the analysis period Q. The display control unit 23 causes the display device 13 to display the presentation screen 30 representing the time series of a plurality of code names C for each analysis period Q specified by the time series analysis unit 22 (Sa3 / display control processing).

  The control device 11 determines whether the user has changed the designated period Qa (Sa4). When the designated period Qa is changed (Sa4: YES), processing (Sa2) of specifying a plurality of related periods Qb for the changed designated period Qa and processing (Sa3) of reflecting the change on the presentation screen 30 are executed. Be done.

  If the designated period Qa has not been changed (Sa4: NO), the control device 11 determines whether or not the user has instructed to change a plurality of code names C of the unit image string L (Sa5). When change of a plurality of code names C in unit image sequence L is instructed (Sa5: YES), change processing unit 24 causes a plurality of code names specified by code data D for each unit period in unit image sequence L. C is collectively changed to the code name C instructed by the user (Sa6). The display control unit 23 changes the display of the code name C in each unit period in the unit image string L in the presentation screen 30 (Sa7).

  The control device 11 determines whether the user has instructed the end (Sa8). When the user instructs the termination (Sa8: YES), the processing of FIG. 4 is terminated. When the user does not instruct the end (Sa8: NO), or when the change of the plurality of code names C is not instructed (Sa5: NO), the control device 11 shifts the processing to Step Sa4.

  As described above, identification (Sa2) and display (Sa3) of the plurality of analysis periods Q are performed each time the designated period Qa is changed, and a plurality of instructions for changing the code name C of the unit image string L are issued. The change of the code name C (Sa6) and the display of the code name C after the change (Sa7) are executed. In FIG. 4, although attention is focused on identification and display of the analysis period Q and change of the plurality of code names C of the unit image string L for convenience, other operations are also given to the presentation screen 30. For example, the change processing unit 24 may change the code name C of one unit period selected by the user.

Second Embodiment
A second embodiment of the present invention will be described. In addition, about the element which a function is the same as that of 1st Embodiment in each following example, the code | symbol used by description of 1st Embodiment is diverted and detailed description of each is abbreviate | omitted suitably.

  FIG. 5 is a schematic view of the presentation screen 30 in the second embodiment. As illustrated in FIG. 5, the display control unit 23 of the second embodiment displays a plurality of operation images 35 corresponding to different time-series images 31 on the presentation screen 30 in addition to the same elements as those of the first embodiment. Deploy. Each operation image 35 is an image representing permission / prohibition of change for each of a plurality of code names C of each time-series image 31. The user can set permission / prohibition of change for a plurality of code names C corresponding to the time-series image 31 by operating any one operation image 35 corresponding to the time-series image 31 It is.

  Specifically, when the user instructs to change the plurality of code names C of the unit image string L (Sa5: YES), the change processing unit 24 allows the operation image 35 to be permitted among the plurality of code names C. Each code name C shown is changed according to the instruction from the user (Sa6). On the other hand, among the plurality of code names C, each code name C representing the prohibition of the operation image 35 is not changed. The time-series image 31 for which the change is permitted and the time-series image 31 for which the change is prohibited are displayed in different display modes (for example, color, gradation or pattern). FIG. 5 exemplifies a case where the change is permitted for the time-series image 31 on the first line to the third line and the change is prohibited on the time-series image 31 on the fourth line. Therefore, the display mode of the time-series image 31 on the fourth line is different from that of the time-series image 31 on the first to third lines.

  Also in the second embodiment, the same effect as that of the first embodiment is realized. Further, in the second embodiment, permission / prohibition of change is set for each of the plurality of code names C of the unit image string L. Therefore, it is possible to easily realize the operation of setting a specific code name C among the plurality of code names C of the unit image string L as a target of change and excluding another code name C from the target of change.

Third Embodiment
FIG. 6 is a schematic view of the presentation screen 30 in the third embodiment. As illustrated in FIG. 6, in addition to the elements similar to the first embodiment, the presentation screen 30 of the third embodiment arranges on the presentation screen 30 a modulated image 36 representing a modulation period in the music. The modulation period is a section in which the initial or basic tone of the music is shifted to another tone. For example, the user arbitrarily designates a modulation period by operating the input device 14. It is also possible to specify a plurality of modulation periods in the music. Specifically, the user designates a start point and an end point of the modulation period and a modulation degree M (hereinafter referred to as “modulation degree”). The degree of modulation M is specified, for example, by a pitch of semitone reduction, and is displayed in the vicinity of the start point of the modulation image 36. On the other hand, the user can cancel the modulation period by operating the input device 14 appropriately. When the modulation period is canceled, the modulation image 36 and the modulation degree M corresponding to the modulation period are erased.

  The modulation image 36 is a linear image ranging from the start to the end of the modulation period. Specifically, among the plurality of unit images 32 constituting each time-series image 31, the modulated image 36 is displayed along the edge in the X direction in each unit image 32 corresponding to each unit period in the modulation period. . That is, the modulated image 36 is displayed along the time series of a plurality of code names C in each time series image 31. The code name C displayed in each unit image 32 in the third embodiment is the code name C before modulation. That is, it is a matter of course that the code name C outside the modulation period is not modulated and the code name C within the modulation period is also code number C not modulated.

  Also in the third embodiment, the same effect as that of the first embodiment is realized. Further, in the third embodiment, since the modulation image 36 representing the modulation period in the music is displayed along the time series of the plurality of code names C, the modulation period in the music along with the time series of the plurality of code names C There is an advantage that the user can grasp intuitively and visually. The configuration of the second embodiment in which permission / prohibition of change of the code name C can be set by the operation image 35 may be applied to the third embodiment.

Fourth Embodiment
FIG. 7 is a schematic view of the presentation screen 30 in the fourth embodiment. As understood from FIG. 7, also in the fourth embodiment, as in the third embodiment, a modulated tone image 36 representing a modulation period in the music is displayed.

  In the third embodiment, the code name C before modulation is displayed also for the modulation period. In contrast to the third embodiment, in the fourth embodiment, the code name C in the modulation period is the code name C after modulation. That is, when the user designates the modulation period by the operation on the input device 14, the change processing unit 24 causes the modulation degree M to which the user designates the code name C that the code data D designates for each unit period within the modulation period. Change to code name C which has just been modulated. The display control unit 23 causes the display device 13 to display the code name C after the change by the change processing unit 24 (that is, the code name C after modulation). On the other hand, when the modulation period is canceled, the change processing unit 24 changes the code name C designated for each unit period in the modulation period to the code name C before modulation. Further, the display control unit 23 deletes the modulated image and changes the code name C of each unit period displayed in the presentation image 30 to the code name C before modulation.

  Also in the fourth embodiment, the same effect as that of the first embodiment is realized. Further, in the fourth embodiment, since the code name C obtained by modulating the code name C represented by the code data D is displayed, there is an advantage that the user can easily grasp the code name C after modulation. The configuration of the second embodiment in which permission / prohibition of change of the code name C can be set by the operation image 35 may be applied to the fourth embodiment.

<Modification>
The aspect of the specific modification added to each aspect illustrated above is illustrated below. Two or more embodiments arbitrarily selected from the following exemplifications may be combined appropriately as long as they do not contradict each other.

(1) In each of the above-described embodiments, a period of time length equivalent to one bar of music is illustrated as a unit period, but the time length of a unit period is not limited to the above examples. For example, a period of a time length corresponding to an integral multiple (for example, one beat) of the beat cycle of the music may be defined as a unit period.

(2) In each embodiment described above, the code name C is added to each unit image 32. However, it is not essential to add the code name C to all unit images 32. For example, when the code name C is common to two consecutive unit periods, the display of the code name C may be omitted for the subsequent unit periods.

(3) A section over a plurality of unit periods represented by the time-series image 31 in the acoustic signal X may be reproduced by a sound emitting device (for example, a speaker). The user can judge the propriety of the code name C by listening to the reproduced sound, and can change it as necessary.

(4) In the third and fourth embodiments, the user designates the modulation period by the operation on the input device 14, but the method of setting the modulation period is not limited to the above example. For example, the control device 11 (for example, the signal analysis unit 21) may estimate the modulation period by analyzing the acoustic signal X.

(5) In the above-described embodiments, the time series of a plurality of code names C is specified from the code data D and displayed on the display device 13. However, the information displayed on the display device 13 is not limited to the code name C. For example, the same configuration is adopted when displaying the lyrics of music. Specifically, the display control unit 23 identifies a plurality of character strings similar to each other among the lyrics of the music designated by the lyric data, and arranges the characters of each character string in the X direction as Y A display screen 13 parallel to the direction is displayed on the display device 13. The change processing unit 24 collectively changes a set of a plurality of characters arranged in the Y direction on the presentation screen 30 according to an instruction from the user.

  Further, the same configuration is adopted when displaying a plurality of scene images constituting a video work. Specifically, the display control unit 23 specifies a plurality of analysis periods whose image characteristics are similar to each other in the image work represented by the image data, and arranged representative still images of the respective analysis periods in the X direction. The display device 13 displays a presentation screen 30 in which the time-series images 31 are arranged in the Y direction. The change processing unit 24 collectively changes the moving images of the section corresponding to the still images arranged in the Y direction on the presentation screen 30 into another moving image according to an instruction from the user.

  From the time series of the plurality of elements represented by the time series data, the configuration exemplified above includes the time series of the plurality of first elements and the time series of the plurality of second elements similar to the time series of the plurality of first elements. Is specified, and a first image in which a plurality of first elements are arranged in a first direction and a second image in which a plurality of second elements are arranged in a first direction are arranged in parallel in a second direction intersecting the first direction The presented screen is included as a configuration to be displayed on the display device. The code data D and the lyric data and the image data according to each modification in each of the above-described embodiments are specific examples of time-series data. Further, the code name C in each of the above-described embodiments and the characters and still images of the lyrics in each of the modifications are specific examples of the elements represented by the time-series data. The time-series image 31 is a specific example of the first image and the second image.

(6) In the above-described embodiments, the acoustic signal X is analyzed to generate the code data D. However, the code data D may be stored in the storage device 12 in advance. That is, the signal analysis unit 21 that generates the code data D from the acoustic signal X is omitted.

(7) In the above embodiments, the information processing apparatus 100 is realized by an information terminal such as a mobile phone or a personal computer, but a part or all of the functions of the information processing apparatus 100 are realized by a server apparatus (so-called cloud server). May be Specifically, the information processing apparatus 100 is realized by a server device that communicates with a terminal device via a communication network such as a mobile communication network or the Internet. For example, the information processing apparatus 100 causes the terminal device to display the presentation screen 30 including the plurality of time-series images 31 by executing the processing of FIG. 4 on the sound signal X received from the terminal device. Note that the signal analysis unit 21 is omitted from the information processing apparatus 100 in a configuration in which the information processing apparatus 100 receives the code data D from the terminal device.

(8) The information processing apparatus 100 according to each of the above-described embodiments is realized by cooperation of a computer (specifically, the control device 11) and a program as illustrated in each of the embodiments. The program according to each of the above embodiments is provided in a form stored in a computer readable recording medium and installed in the computer. The recording medium is, for example, a non-transitory recording medium, and is preferably an optical recording medium (optical disc) such as a CD-ROM, but any known medium such as a semiconductor recording medium or a magnetic recording medium may be used. Recording media of the form Note that non-transitory recording media include any recording media except transient propagation signals, and do not exclude volatile recording media. Also, the program may be provided to the computer in the form of distribution via a communication network.

(9) The following configuration, for example, can be grasped from the embodiments exemplified above.

  In the display control method according to a preferred aspect (aspect 1) of the present invention, the time series of a plurality of first elements and the time series of a plurality of first elements are obtained from the time series of a plurality of elements represented by time series data. A time series of a plurality of similar second elements is specified, and a first image in which the plurality of first elements are arranged in a first direction, and a second image in which the plurality of second elements are arranged in the first direction Are displayed on the display device in parallel with a second direction crossing the first direction. In the above aspect, among the plurality of elements arranged in time series, the time series of the plurality of first elements and the time series of the plurality of second elements similar to the time series of the plurality of first elements are plural The time series of the first element of and the time series of the plurality of second elements are juxtaposed in a second direction crossing the first direction along. Therefore, it is an advantage that the user can intuitively and visually grasp the relationship between each first element and each second element between the time series of the plurality of first elements and the time series of the plurality of second elements. There is.

  In the preferable example (aspect 2) of the aspect 1, each said element arrange | positioned on the said presentation screen is changed according to the instruction | indication from a user. According to the above aspect, there is an advantage that each of the plurality of elements arranged in time series can be changed according to the user's intention.

  In a preferred example of the second aspect (Aspect 3), the first element and the second element arranged in the second direction on the presentation screen are collectively changed according to an instruction from the user. In the above aspect, since the first element and the second element arranged in the second direction are collectively changed, compared with the configuration in which each of the first element and the second element needs to be individually changed. , Reduce the burden on users.

  In the preferable example (aspect 4) of the aspect 3, it is possible to set the permission or rejection of the change according to the instruction from the user for each of the first element and the second element. In the above aspect, since the change permission or rejection is set for each of the first element and the second element, it is possible to exclude a specific element from the change targets.

  In a preferred embodiment (Aspect 5) according to any of Aspects 1 to 4, each of the plurality of elements is a code name in a music. According to the above aspect, the user can intuitively and visually grasp not only the time series of the plurality of code names in the music but also the time series of the code names in the sections similar to each other in the music.

  In a preferable example (aspect 6) of aspect 5, a modulation image representing a modulation period in the music is displayed on the display device along a time series of a plurality of code names arranged on the presentation screen. According to the above aspect, the user can intuitively and visually grasp the transition period in the music together with the time series of a plurality of code names.

  In a preferred example of the sixth aspect (Aspect 7), a code name obtained by modulating the code name represented by the time-series data is displayed for the modulation period. According to the above aspect, there is an advantage that the user can easily grasp the code name after modulation.

  A program according to a preferred aspect (aspect 8) of the present invention is similar to a time series of a plurality of first elements and a time series of the plurality of first elements from a time series of a plurality of elements represented by time series data. A time series analysis process for specifying a time series of a plurality of second elements, a first image in which the plurality of first elements are arranged in a first direction, and a plurality of second elements are arranged in the first direction The computer is caused to execute display control processing for causing a display device to display a presentation screen in which a second image and a second direction intersecting the first direction are arranged in parallel.

100 ... information processing device, 11 ... control device, 12 ... storage device, 13 ... display device, 14 ... input device, 21 ... signal analysis unit, 22 ... time series analysis unit, 23 ... display control unit, 24 ... change processing unit , 30: presentation screen, 31: time-series image, 32: unit image, 35: operation image, 36: modulation image.

Claims (8)

Identifying a time series of a plurality of first elements and a time series of a plurality of second elements similar to the time series of the plurality of first elements from the time series of the plurality of elements represented by the time series data;
A first image in which the plurality of first elements are arranged in a first direction and a second image in which the plurality of second elements are arranged in the first direction are arranged in parallel in a second direction intersecting the first direction Display the presented screen on the display device
Display control method realized by a computer. The display control method according to claim 1, wherein each of the elements arranged on the presentation screen is changed according to an instruction from a user. The display control method according to claim 2, wherein the first element and the second element arranged in the second direction on the presentation screen are collectively changed according to an instruction from a user. The display control method according to claim 3, wherein the permission / prohibition of the change according to the instruction from the user can be set for each of the first element and the second element. The display control method according to any one of claims 1 to 4, wherein each of the plurality of elements is a code name in music. The display control method according to claim 5, wherein the modulation control image representing the modulation modulation period in the music is displayed on the display device along a time series of a plurality of code names arranged on the presentation screen. The display control method according to claim 6, wherein a code name obtained by modulating the code name represented by the time-series data is displayed for the modulation period. A time series analysis for specifying a time series of a plurality of first elements and a time series of a plurality of second elements similar to the time series of the plurality of first elements from a time series of a plurality of elements represented by time series data Processing and
A first image in which the plurality of first elements are arranged in a first direction and a second image in which the plurality of second elements are arranged in the first direction are arranged in parallel in a second direction intersecting the first direction And a program for causing a computer to execute display control processing for causing a display device to display the presented screen.

Images