JP2013122561A - Information processing program, communication system, information processing device, and method for drawing lyric telop - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing program capable of synchronizing reproduction timing of a music piece with drawing timing of lyrics while suppressing a load applied to a server device, a communication network and the like, and to provide a communication system, an information processing device and a method for drawing a lyric telop.SOLUTION: A terminal T1 acquires lyric telop data from a lyric information providing server SA, the lyric telop data including boundary information relating to a boundary of the volume of a music piece to be reproduced. On the basis of the acquired boundary information, the terminal T1 detects a shift time when the volume of the music piece is a predetermined threshold or less, from a time of starting to reproduce the music piece, and starts drawing the lyrics of the music piece on the basis of the shift time.

Description

  The present invention relates to a technical field such as an information processing apparatus that can synchronize the timing of reproduction of music and drawing of lyrics of the music.

  2. Description of the Related Art Conventionally, there is a technique for synchronizing the timing of music reproduction and song lyrics drawing using music data and lyrics data that are separated from each other. For example, Patent Document 1 discloses a karaoke that synchronizes the playback timing of voice music data and performance data using compressed voice music data and performance data in SMF (Standard MIDI File) format including a plurality of lyrics events. A practice device is disclosed. According to Patent Document 1, the performance data includes a header, performance event data and lyric event data, delta time indicating a time difference between reproduction timings of the events, and end data. When one lyric event data is specified, the absolute time from the event data at the head of the performance data to the specified lyric event data is calculated by adding all the delta times in between. By playing the music from the calculated time position, the music is played from the position corresponding to the designated lyrics.

JP 2007-140209 A

  In Patent Document 1, performance data in SMF format is required to synchronize the playback of audio music and the display of lyrics. However, this type of performance data has a large data amount, for example, compared to simple data containing only lyrics. Therefore, for example, when a karaoke practice device acquires performance data from a server via a communication network, the load applied to the server device and the network is large. Further, with the technique of Patent Document 1, it is difficult to synchronize the reproduction of music and the drawing of lyrics only with audio music data and simple data such as lyrics, for example.

  The present invention has been made in view of the above points and the like, and suppresses a load applied to a server device, a communication network, etc., and an information processing program, a communication system, An information processing apparatus and a lyrics telop drawing method are provided.

  In order to solve the above-mentioned problem, the information processing program according to claim 1 includes a storage unit that stores music data and lyric data that can be drawn on a predetermined display unit according to the reproduction of the music. Acquired by a first acquisition step of acquiring volume information indicating a predetermined threshold of the volume of the music from a server device connected via a communication network to a computer of the information processing apparatus provided, and by the first acquisition step Based on the volume information, a detection step of detecting a time when the volume of the music is equal to or less than the predetermined threshold from a playback start time of the music, and the music based on the time detected by the detection step And a step of starting drawing of the lyrics.

  According to a second aspect of the present invention, in the information processing program according to the first aspect, the server device can store attribute information indicating attributes of the plurality of music pieces and can be connected to the server device. The attribute information that can be registered in association with the adjustment time transmitted from a plurality of the information processing devices and the attribute information of the music transmitted together with the adjustment time, and is registered by the server device Shift adjustment information indicating the shift adjustment time of the drawing start timing of the lyrics of the music can be transmitted to the information processing device based on the adjustment time for each of the music pieces, and the information processing program stores the attribute information of the music to be reproduced. A transmission step of transmitting to the server device; and the shift adjustment information registered in the server corresponding to the attribute information transmitted in the transmission step. A second acquisition step acquired from the server device, and a step of starting drawing lyrics of the music based on the shift adjustment time indicated by the shift adjustment information acquired in the second acquisition step. It is characterized by that.

  According to a third aspect of the present invention, in the information processing program according to the second aspect, in the second acquisition step, the shift adjustment information associated with attribute information having the largest number of matching attribute information items is stored in the information processing program. It is obtained from a server device.

  According to a fourth aspect of the present invention, in the information processing program according to any one of the first to third aspects, in the server device, the music is registered in association with a plurality of attribute information, and The volume information of the music is determined for each music, and the information processing program executes a transmission step of transmitting attribute information of the music to be reproduced to the server device, and the first acquisition step includes: Corresponding to the attribute information transmitted in the transmission step, the volume information determined for each piece of music is acquired from the server device.

  The invention according to claim 5 is a communication system comprising an information processing device and a server device to which the information processing device is connected via a communication network, wherein the information processing device includes music data and the music Storage means for storing lyric data that can be rendered on a predetermined display unit in response to playback of the music data, and first transmission means for transmitting volume information request information indicating a predetermined threshold of the volume of the music data to the server device The server device receives the request information transmitted from the information processing device, and the volume information according to the request information received by the first reception device. A second transmission means for transmitting to the information processing apparatus, wherein the information processing apparatus receives the volume information transmitted from the server apparatus by the second reception means and the second reception means. Based on the volume information that has been made, based on the time detected by the detection means, detection means for detecting a time when the volume of the music is equal to or less than the predetermined threshold from the playback start time of the music, Control means for starting drawing of lyrics of the music.

  According to a sixth aspect of the present invention, there is provided storage means for storing music data and lyric data that can be rendered on a predetermined display unit in accordance with reproduction of the music, and volume information indicating a predetermined threshold of the volume of the music Is acquired from a server device connected via a communication network, and based on the volume information acquired by the acquisition unit, the volume of the song is set to the predetermined threshold from the playback start point of the song. It is characterized by comprising: a detecting means for detecting a time which is the following; and a control means for starting drawing of the lyrics of the music based on the time detected by the detecting means.

  According to a seventh aspect of the present invention, there is provided a lyrics telop drawing method executed by an information processing apparatus comprising storage means for storing music data and lyrics data that can be drawn on a predetermined display unit in accordance with the reproduction of the music. And the acquisition step which acquires the volume information which shows the predetermined threshold of the volume of the music from a server device connected via a communication network, and based on the volume information acquired by the acquisition step, A detection step of detecting a time during which the volume of the music is equal to or less than the predetermined threshold from a playback start time of the music, and a step of starting drawing lyrics of the music based on the time detected by the detection step It is characterized by including these.

  According to the first and fifth aspects of the present invention, since the drawing of the lyrics of the music is started using the volume information indicating the predetermined threshold of the volume of the music, the server device, the communication network, etc. The timing of playing music data and drawing lyrics of music can be synchronized.

  According to the second aspect of the invention, since the drawing of the lyrics of the music is started using the shift adjustment information indicating the shift adjustment time of the drawing start timing of the lyrics of the music. The timing of drawing the lyrics can be synchronized with higher accuracy.

  According to the third aspect of the present invention, it is possible to more accurately synchronize the timing of the reproduction of the music and the drawing of the lyrics of the music.

  According to the fourth aspect of the invention, since the drawing of the lyrics of the music is started using the volume information determined for each music, the timing of the reproduction of the music and the drawing of the lyrics of the music is set. Can be synchronized with higher accuracy.

It is a figure which shows the example of a schematic structure of the music information provision system S of this embodiment. (A) is a block diagram showing a schematic configuration example of the terminal Tn. (B) is a conceptual diagram showing the temporal change in the volume level of the music. (A) is a block diagram showing a schematic configuration example of the lyrics information providing server SA. (B) is a diagram showing an example of information registered in the adjustment information database 112. FIG. It is a flowchart which shows an example of the process in the control part 8 of terminal T1. FIG. 4A is a flowchart showing an example of “second automatic timing adjustment processing” shown in step S4 of FIG. FIG. 4B is a flowchart illustrating an example of “third automatic timing adjustment processing” illustrated in step S <b> 7 of FIG. 4. FIG. 4C is a flowchart illustrating an example of “manual timing adjustment processing” illustrated in step S <b> 10 of FIG. 4. (A) is a conceptual diagram which shows the drawing start timing of the lyrics of music. (B) is a figure which shows an example of the screen for timing adjustment. It is a flowchart which shows an example of the process in the control part 13 of the lyrics information provision server SA of this embodiment. (A) is a figure which shows an example of the priority set beforehand for every item of attribute information. (B) is a flowchart illustrating an example of adjustment information acquisition processing based on priorities set in advance for each item of attribute information. It is a flowchart which shows an example of the total process of drawing start timing adjustment time.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. The embodiment described below is an embodiment when the present invention is applied to a music information providing system.

[1. Composition and function of music information providing system S]
First, with reference to FIG. 1 etc., the structure and function of the music information provision system S of this embodiment are demonstrated. FIG. 1 is a diagram illustrating a schematic configuration example of a music information providing system S of the present embodiment. As shown in FIG. 1, the music information providing system S according to the present embodiment includes a plurality of terminals Tn (n is a natural number of 1 or more) and a lyrics information providing server SA. The music information providing system S is an example of a communication system according to the present invention. The terminal Tn and the lyrics information providing server SA can transmit and receive data to and from each other using, for example, TCP / IP as a communication protocol via the communication network NW. The communication network NW is constructed by, for example, the Internet, a dedicated communication line (for example, CATV (Community Antenna Television) line), a mobile communication network (including a mobile base station, etc.), a gateway, and the like.

  FIG. 2A is a block diagram illustrating a schematic configuration example of the terminal Tn. The terminal Tn is an example of an information processing apparatus of the present invention. Examples of the terminal Tn include a mobile phone, a smartphone, or a personal computer. As shown in FIG. 2A, the terminal Tn includes a storage unit 1, a reproduction processing unit 2, a speaker 3, a display processing unit 4, a display unit 5, an operation unit 6, a portable radio communication unit 7, a control unit 8, and the like. It is configured with.

  The storage unit 1 is configured by, for example, a nonvolatile semiconductor memory. The storage unit 1 stores an OS (Operating System), a music playback application program, and the like. The music reproduction application program includes the information processing program of the present invention. This information processing program causes the control unit 8 as a computer to execute each step in the present invention. Details of this processing will be described later. The application program for music reproduction is downloaded from a predetermined server via the communication network NW. Alternatively, it may be recorded on a recording medium such as a CD-ROM and read via a drive. The storage unit 1 stores a terminal ID that identifies the terminal Tn. As the terminal ID, for example, when a SIM (Subscriber Identity Module Card) card is mounted on the terminal Tn, a unique ID number recorded on the SIM card is given as an example. The terminal ID may be a telephone number of the terminal Tn, a mail address of the user of the terminal Tn, or a user ID for identifying the user.

  The storage unit 1 stores audio data of music and attribute information indicating the attributes of the music in association with each music. The music is reproduced based on the audio data of the music. The audio data of the music is stored as a music file in MP3 (MPEG Audio Layer-3) format, for example. The attribute information of the music is associated with each of a plurality of types of items for specifying the music. The items include, for example, a song name, singer name, playback time, album name, track number, file size, encoding method, bit rate (bps), and the like. Here, the reproduction time is the length of the music. The album name is the name of the album on which the music is recorded. Album names are not given to songs that are not included in the album. The track number corresponds to the playback order of the songs in the album. The file size corresponds to the data amount of the music file. The encoding method is a method for encoding audio data of music. Examples of the encoding method include a variable bit rate (VBR) and a constant bit rate (CBR). The audio data of the music and the attribute information of the music are downloaded from a music distribution site (not shown) provided on the communication network NW. The music data may be read from a CD or a memory card. When a unique song ID (identification information) is assigned to the song, the song ID is stored in the storage unit 1 in association with the attribute information. All or part of the attribute information of the music is registered in the music list that can be displayed on the display unit 5, and the user can select the music to be reproduced from the music list.

  The storage unit 1 stores song lyrics telop data. The lyrics telop data is composed of text data, for example. The lyrics telop data includes lyrics data, color change timing data, and boundary information. The lyric data is data that can be drawn on the display unit 5 in accordance with the reproduction of the music. With the lyric data, a character string representing the lyric of the music is displayed on the screen as a telop of the lyrics. The color change timing data is data describing the timing of changing the color of characters representing the lyrics of music. The timing for changing the color of the character is represented, for example, by the elapsed time from the start of drawing the lyrics. The color change timing data is also referred to as color application timing data that describes the timing of color application of the lyrics telop. When the character color is not changed, the color change timing data is not included in the lyrics telop data.

  The boundary information is an example of volume information of the present invention. This boundary information is information used to synchronize the timing of the reproduction of the music and the drawing of the lyrics of the music. For example, the boundary information is a boundary value of the volume of the music at the rise after the silent period from the playback start time of the music. In other words, the boundary value is a predetermined threshold for the volume of music. FIG. 2B is a conceptual diagram showing temporal changes in the volume level of music. As shown in FIG. 2 (B), a sound volume boundary value is set at the rise after the start of music playback after the silent period. A silent section is a section in which the volume of music is below a predetermined value. The predetermined value is set to a value that allows for the maximum value of noise noise that can be generated + the margin. Noise sound is treated as silence. The boundary value of the volume is set to a volume level that allows the CPU to detect the beginning of the music. Based on the boundary information, the time when the volume of the music is equal to or lower than the boundary value is detected by the control unit 8 from the start of the music playback. In other words, based on the boundary value represented by the boundary information, the control unit 8 detects the time exceeding the boundary at the rising edge after the silent section from the music reproduction start time. The detected time is hereinafter referred to as “shift time”. The boundary information may be the time from when the music starts to be reproduced until the volume of the music exceeds the boundary value at the rising edge after the silent period, instead of the boundary value. The shift time is detected based on the time represented by the boundary information. Instead of the boundary value, the boundary information may be represented by a waveform from when the music starts to be reproduced until the volume of the music at the rise after the silent section exceeds the boundary value. This waveform is a function, for example. The shift time is detected by the function represented by the boundary information. The lyrics telop data of the music is acquired from the lyrics information providing server SA via the communication network NW.

  In the storage unit 1, as information used to synchronize the timing of music playback and song lyrics drawing, an adjustment time of the song lyrics drawing start timing (hereinafter referred to as “drawing start timing”) separately from the boundary information. Adjustment information indicating “adjustment time” may be stored. The drawing start timing adjustment time is obtained by adjusting the operation of the user of the terminal Tn during the reproduction of music. The drawing start timing adjustment time is represented by the elapsed time from the start of music playback. In the present embodiment, adjustment information indicating the drawing start timing adjustment time adjusted in another terminal Tn can be acquired from the lyrics information providing server SA via the communication network NW.

  The reproduction processing unit 2 executes a reproduction process for reproducing music in response to a control command from the control unit 8. In the reproduction process, the reproduction processing unit 2 reads and decodes the audio data of the music stored in the storage unit 1, converts the decoded audio data into an analog audio signal, and outputs the analog audio signal to the speaker 3. In response to a control command from the control unit 8, the display processing unit 4 executes a drawing process for drawing the lyrics of the music. In the drawing process, the display processing unit 4 draws on the screen in the display unit 5 using the lyrics data of the music, and displays the lyrics telop. The control unit 8 controls the drawing start timing of the lyrics of the music and the timing of changing the color of the characters representing the lyrics. A display method that displays the entire text of the lyrics from the beginning to the end of one song on a single screen, and updates every partial character string of the entire lyrics from the beginning to the end of a song There is a display method that is displayed on the screen while being done. In the latter display method, the display of the lyrics telop is switched for every several phrases of the music, for example, according to the progress of the music playback. It is possible to arbitrarily set in which display method the lyrics telop is displayed. In either display method, the color of the character representing the lyrics can be changed by the color change timing data.

  The operation unit 6 receives an instruction from the user of the terminal Tn and outputs a signal corresponding to the instruction to the control unit 8. The operation unit 6 may be a touch panel type operation unit formed on the screen of the display unit 5. The portable wireless communication unit 7 can be connected to the communication network NW via a portable base station. The terminal Tn can be connected to the lyrics information providing server SA via the mobile base station and the communication network NW by the mobile radio communication unit 7.

  The control unit 8 includes a CPU, a ROM, a RAM, and the like. The RAM or the storage unit 1 is an example of the storage unit of the present invention. The control unit 8 is an example of a first transmission unit, a second reception unit, an acquisition unit, a detection unit, and a control unit of the present invention. The control unit 8 executes processing to be described later according to the music reproduction application program. The control unit 8 controls the playback processing unit 2 to play back the music, and controls the display processing unit 4 to draw the lyrics of the music as the playback of the music progresses. The control unit 8 uses the boundary information or the adjustment information to control the drawing start timing of the song lyrics. When the color of the character representing the lyrics of the music is changed, the control unit 8 uses the color change timing data to control the timing of changing the color of the character representing the lyrics. There is a case where the drawing start timing of the lyrics of the music is adjusted by the operation of the user of the terminal Tn during the playback of the music. The control unit 8 transmits the adjusted adjustment information to the lyrics information providing server SA together with the attribute information of the music and the terminal ID as adjustment information to be used in another terminal Tn used by another user.

  FIG. 3A is a block diagram illustrating a schematic configuration example of the lyrics information providing server SA. As shown in FIG. 3A, the lyrics information providing server SA includes a storage unit 11, a communication unit 12, a control unit 13, and the like. The lyrics information providing server SA is connected to the communication network NW by the communication unit 12.

  The storage unit 11 is configured by, for example, a hard disk. The storage unit 11 stores an OS, a server processing program, and the like. The storage unit 11 stores attribute information indicating attributes of a plurality of music pieces. Each piece of music is registered in association with a plurality of attribute information. Audio data of music may be stored. The storage unit 11 is provided with a lyrics telop database 111 and an adjustment information database 112. In the lyrics telop database 111, for example, song attribute information, song lyrics telop data, and a song ID of a song are registered in association with each song. The item of music attribute information includes, for example, a song name and a singer name. The lyrics telop data of each song includes boundary information. The boundary information is determined for each music and is different for each music. In the adjustment information database 112, for example, music attribute information, adjustment information, and a terminal ID are registered in association with each terminal Tn. The adjustment information indicates a drawing start timing adjustment time transmitted from a plurality of terminals Tn connectable to the lyrics information providing server SA. The drawing start timing adjustment time is transmitted together with the music attribute information. The terminal ID is the terminal ID of the terminal Tn that has transmitted the song attribute information and the adjustment information.

  FIG. 3B is a diagram illustrating an example of information registered in the adjustment information database 112. The record 1 shown in FIG. 3B includes a song name and a singer name, but does not include a reproduction time and an album name. On the other hand, the record 3 shown in FIG. 3B includes a song name, a singer name, and a reproduction time, but does not include an album name or the like. As described above, the items of the attribute information registered in the adjustment information database 112 are various for each terminal Tn that is the transmission source. As shown in FIG. 3B, the drawing start timing adjustment time registered in the adjustment information database 112 may be different for each record even for the same music title and singer name.

  The control unit 13 includes a CPU, a ROM, a RAM, and the like. The control unit 13 has a timer function. The control unit 13 is an example of a first receiving unit and a second transmitting unit of the present invention. The control unit 13 executes processing to be described later according to the OS and the server processing program. In this process, for example, in response to a request from the terminal Tn, the control unit 13 sends the lyrics telop data registered in the lyrics telop database 111 or the adjustment information registered in the adjustment information database 112 to the requesting terminal Tn. provide.

[2. Operation of Music Information Providing System S]
Next, operation | movement of the music information provision system S of this embodiment is demonstrated.
(Processing of terminal T1)
First, with reference to FIG. 4 etc., the process which the control part 8 of the terminal T1 of this embodiment performs is demonstrated. FIG. 4 is a flowchart illustrating an example of processing in the control unit 8 of the terminal T1. The process shown in FIG. 4 can be executed in the same manner in terminals Tn other than terminal T1.

  The process shown in FIG. 4 is started when the user of the terminal T1 selects a desired piece of music from the operation unit 8 after a music playback application program is started and a playback instruction is given. When the process is started, for example, the terminal T1 connects to the lyrics information providing server SA via the communication network NW. The control unit 8 of the terminal T1 acquires the lyrics telop data of the music selected by the user from the lyrics information providing server SA (step S1). Specifically, the control unit 8 transmits request information indicating a request for the lyrics telop data of the selected music piece to the lyrics information providing server SA. For example, the song ID of the selected song or the song name and singer name of the song is added to the request information (hereinafter referred to as “request for lyrics telop data”). In response to the request for the lyrics telop data, the control unit 8 receives the lyrics telop data transmitted from the lyrics information providing server SA in step S25 described later, and temporarily stores it in the storage unit 1. Thereby, the control part 8 acquires the lyrics telop data containing the boundary information determined for every music. The acquired lyrics telop data has a small amount of data, and can suppress the load applied to the lyrics information providing server SA, the communication network NW, and the like.

  Next, the control unit 8 determines whether or not boundary information or adjustment information acquired in the past, which is boundary information or adjustment information of the selected music, is stored (step S2). The lyrics telop data of the same music is acquired in the past processing from the current processing, and the boundary information included in the lyrics telop data is stored in the storage unit 1 in association with the music ID or the music title and singer name. If the adjustment information is acquired in the past process and is stored in the storage unit 1 in association with the song ID or the song name and singer name, the lyrics telop data acquired in the current process The boundary information contained in is not used.

  When it is determined that the boundary information or adjustment information acquired in the past is stored (step S2: YES), the control unit 8 proceeds to “first automatic timing adjustment processing” in step S3 described later. When it is determined that the boundary information or adjustment information acquired in the past is not stored (step S2: NO), the control unit 8 proceeds to step S4.

  FIG. 5A is a flowchart showing an example of the “second automatic timing adjustment process” shown in step S4 of FIG. In the “second automatic timing adjustment process” in FIG. 5A, the control unit 8 acquires lyrics data, color change timing data, and boundary information from the lyrics telop data acquired in step S1 (step S41). ). The acquired lyrics data is sent to the display processing unit 4. When a control command is given from the control unit 8 to the reproduction processing unit 2, reproduction of the selected music is started.

  Based on the boundary information acquired in step S41, the control unit 8 detects, as a shift time, a time during which the volume of the music is equal to or less than a predetermined threshold from the playback start time of the selected music (step S42). The music playback start time is, for example, the time when the playback processing unit 2 starts reading the audio data of the music, the time when the audio data starts to be decoded, or the time when the analog audio signal of the music starts to be output to the speaker 3. The detection of the shift time in step S42 may be performed before the music reproduction is started.

  Based on the shift time detected in step S42, the control unit 8 starts drawing the lyrics of the music (step S43), and proceeds to step S5 in FIG. Specifically, the control unit 8 gives a control command to the display processing unit 4 to start drawing the lyrics of the music at the timing when the shift time elapses from the reproduction start time of the selected music. FIG. 6A is a conceptual diagram showing the start timing of drawing lyrics of music. In step S43, as shown in FIG. 6A, the drawing of the lyrics is started with a delay of the shift time from the reproduction start time of the music. After the lyrics telop is displayed on the screen, the control unit 8 gives a control command to the display processing unit 4 based on the color change timing data, and controls the color change timing of the character representing the lyrics. The user listens to the reproduced music and looks at the lyrics telop displayed on the screen to confirm whether the timing of the reproduction of the music and the drawing of the lyrics of the music are synchronized.

  In step S5, the control unit 8 determines whether or not the reproduction timing of the music and the drawing timing of the lyrics of the music are synchronized. For example, if the user determines that the playback timing of the music and the drawing timing of the lyrics of the music are not synchronized, the user issues an automatic timing readjustment instruction from the operation unit 8. When the display timing of the singer's singing content included in the audio of the reproduced music and the telop display timing of the lyrics corresponding to the singing content, or the color change timing of the characters representing the lyrics are shifted, It is determined that the timing of drawing the lyrics of the music is not synchronized.

  For example, when the automatic timing readjustment instruction from the user does not exist for a predetermined time from the start of music playback, the control unit 8 determines that the music playback timing and the song lyrics drawing timing are synchronized (step S5: YES). Proceed to step S6. The predetermined time is a time between 30 seconds and 180 seconds, for example, when it is considered that the reproduction timing of the music and the drawing timing of the lyrics of the music are synchronized. When the control unit 8 recognizes the automatic timing readjustment instruction from the user via the operation unit 8, the control unit 8 determines that the reproduction timing of the music and the drawing timing of the lyrics of the music are not synchronized (step S5: NO), and step S7. Proceed to At this time, the control unit 8 causes the reproduction processing unit 2 to finish reproducing the music.

  In step S6, the control unit 8 stores the boundary information acquired in step S41 in the storage unit 1 in association with the music ID of the reproduced music, or the music name and singer name. You may comprise so that the color change timing data acquired by step S41 may be preserve | saved with boundary information. The lyric data acquired in step S41 needs to be acquired from the lyric information providing server SA every time the music is played due to copyright, and is not stored together with the boundary information. When the copyright problem of the lyrics data can be solved by another method, the lyrics data may be stored together with the boundary information. The boundary information is used in the “first automatic timing adjustment process” shown in step S3. In the “first automatic timing adjustment process”, the control unit 8 acquires from the storage unit 1 boundary information stored in association with the song ID or the song name and the singer name. When the color change timing data is stored together with the boundary information, the color change timing data is also acquired. On the other hand, when the color change timing data is not stored together with the boundary information, the color change timing data is acquired from the lyrics telop data acquired in step S1. In step S3, the control unit 8 performs the same processing as in steps S42 and S43 based on the acquired boundary information and the like.

  The control unit 8 stores the lyrics data and the color change timing data in the storage unit 1, but may not store the boundary information in the storage unit 1. The control part 8 should just acquire only the boundary information corresponding to the music selected by the user from the lyrics information provision server SA in step S1.

  FIG. 5B is a flowchart showing an example of the “third automatic timing adjustment process” shown in step S7 of FIG. In the “third automatic timing adjustment process” in FIG. 5B, the control unit 8 acquires adjustment information corresponding to the attribute information of the music selected by the user from the lyrics information providing server SA (step S71). Specifically, the control unit 8 transmits request information indicating a request for adjustment information of the selected music piece to the lyrics information providing server SA. Request information (hereinafter referred to as “request for adjustment information”) is added with attribute information of the selected music. The attribute information added includes at least a song name and a singer name so that the lyrics information providing server SA can identify the song. The attribute information includes one or more pieces of information such as music playback time, album name, track number, file size, encoding method, and bit rate (bps). According to this configuration, it is possible to acquire adjustment information indicating a more accurate drawing start timing adjustment time. Since the file size, the encoding method, and the bit rate (bps) are information related to each other, it is desirable that they are included in the attribute information as a set. The control unit 8 receives the adjustment information transmitted in step S28 described later from the lyrics information providing server SA in response to the adjustment information request, and temporarily stores it in the storage unit 1. The adjustment information indicates a drawing start timing adjustment time adjusted in another terminal Tn different from the terminal T1. The terminal T1 can acquire the adjustment information indicating the drawing start timing adjustment time adjusted by the operation of another user at the other terminal n more efficiently. When information indicating that the requested adjustment information is not registered is transmitted from the lyrics information providing server SA, the control unit 8 proceeds to step S10.

  Also in the third automatic timing adjustment process, the lyrics data and the color change timing data acquired in step S41 are used. When the control command is given from the control unit 8 to the reproduction processing unit 2, reproduction of the selected music is started again from the beginning.

  Next, the control unit 8 starts drawing the lyrics of the music based on the drawing start timing adjustment time indicated by the adjustment information acquired in step S71 (step S72), and proceeds to step S8 shown in FIG. Specifically, the control unit 8 gives a control command to the display processing unit 4 to start drawing the lyrics of the music at the timing when the drawing start timing adjustment time elapses from the playback start time of the selected music. Let

  In step S8, the control unit 8 determines whether or not the reproduction timing of the music and the drawing timing of the lyrics of the music are synchronized. When the user determines that the reproduction timing of the music and the drawing timing of the lyrics of the music are not synchronized, the user performs a manual timing readjustment instruction from the operation unit 8. If there is no manual timing readjustment instruction from the user for a predetermined time from the start of music playback, the control unit 8 determines that the music playback timing and the song lyrics drawing timing are synchronized (step S8: YES), and step Proceed to S9. When the control unit 8 recognizes the manual timing readjustment instruction via the operation unit 8 from the user, the control unit 8 determines that the reproduction timing of the music and the drawing timing of the lyrics of the music are not synchronized (step S8: NO), and step S10. Proceed to At this time, the control unit 8 causes the reproduction processing unit 2 to finish reproducing the music.

  In step S9, the control unit 8 stores the adjustment information acquired in step S71 in the storage unit 1 in association with the music ID of the reproduced music, or the music name and singer name. At this time, the color change timing data acquired in step S41 may be stored together with the adjustment information. The stored adjustment information is used in the “first automatic timing adjustment process” in step S3. In the “first automatic timing adjustment process”, the control unit 8 acquires from the storage unit 1 adjustment information stored in association with the song ID or the song name and singer name. When the color change timing data is stored together with the adjustment information, the color change timing data is also acquired. If the color change timing data is not stored together with the adjustment information, the color change timing data is acquired from the lyrics telop data acquired in step S1. The control unit 8 executes the same process as in step S72 based on the adjustment information acquired in step S3.

  FIG. 5C is a flowchart showing an example of the “manual timing adjustment process” shown in step S10 of FIG. In the “manual timing adjustment process” in FIG. 5C, the control unit 8 displays a timing adjustment screen on the display unit 5 (step S101), and the process proceeds to step S102. FIG. 6B is a diagram illustrating an example of a timing adjustment screen. The timing adjustment screen is provided with a lyrics telop display section 51, a music playback button 52, a timing adjustment button 53, a timing confirmation button 54, and a timing confirmation button 55.

  In step S102, the control unit 8 determines whether or not there is a music reproduction instruction. When the user designates the music playback button 52, it is determined that there has been a music playback instruction. When the control unit 8 determines that there is a music reproduction instruction (step S102: YES), the control unit 8 starts reproduction of the selected music again from the beginning (step S103). The control unit 8 starts drawing the lyrics of the music at the timing when the drawing start timing adjustment time indicated by the adjustment information acquired in step S71 elapses from the playback start time of the music. Next, the control unit 8 determines whether or not there is a timing adjustment instruction (step S104). For example, when the user designates the timing adjustment button 53 at the timing of starting to color the telop of the lyrics while listening to the reproduced music, it is determined that there has been a timing adjustment instruction. In other words, the timing for starting the coloring of the telop for the lyrics is the timing for starting the color change of the characters representing the lyrics. When it is determined that the timing adjustment instruction has been given (step S104: YES), the control unit 8 proceeds to step S106. When it is determined that there is no timing adjustment instruction (step S104: NO), the control unit 8 proceeds to step S105.

  In step S105, the control unit 8 determines whether or not a predetermined time has elapsed from the start of music reproduction in step S103. The predetermined time is a time that the user considers to have missed the timing adjustment, and is, for example, a time between 30 seconds and 180 seconds. When the control unit 8 determines that the predetermined time has not elapsed since the start of the music reproduction (step S105: NO), the control unit 8 returns to step S104. If the control unit 8 determines that a predetermined time has elapsed from the start of music reproduction (step S105: YES), the control unit 8 returns to step S103.

  In step S106, the control unit 8 calculates the drawing start timing adjustment time so that the reproduction position of the music when the timing adjustment instruction is recognized matches the coloring start position of the lyrics telop, and the drawing start timing is calculated. Is adjusted. The reproduction position and the coloring start position mean a temporal position from the music reproduction start time. The drawing start timing adjustment time is temporarily held. Instead of starting to color the lyrics telop, the timing to start displaying the lyrics telop may be used. In this case, the drawing start timing adjustment time is calculated so that the playback position of the music when the timing adjustment instruction is recognized matches the start position of the lyrics telop display.

  Next, the control unit 8 determines whether or not there is a timing confirmation instruction (step S107). For example, when the user wants to confirm the drawing start timing adjusted in step S106, when the timing confirmation button 54 is designated, it is determined that there has been a timing confirmation instruction. When it is determined that the timing confirmation instruction has been given (step S107: YES), the control unit 8 proceeds to step S108. If it is determined that there is no timing confirmation instruction (step S107: NO), the control unit 8 proceeds to step S109.

  In step S108, the control unit 8 starts playing the selected music piece from the beginning again, and based on the drawing start timing adjustment time calculated in step S106 from the reproduction start time of the music piece, the drawing start timing adjustment time is started. When the time passes, the drawing of lyrics is started. After the music is reproduced, the user can confirm whether or not the start timing for coloring the telop for lyrics or the start timing for displaying the telop for lyrics is appropriate.

  In step S109, the control unit 8 determines whether or not there is a timing determination instruction. For example, if the user wants to confirm at the drawing start timing adjusted in step S106 and designates the timing confirm button 55, it is determined that there has been a timing confirmation instruction. When it is determined that the timing determination instruction has been given (step S109: YES), the control unit 8 proceeds to step S11 shown in FIG. Thus, the drawing start timing adjustment time manually adjusted by the user is determined.

  On the other hand, if the control unit 8 determines that there is no timing confirmation instruction (step S109: NO), the control unit 8 proceeds to step S110. In step S110, the control unit 8 determines whether or not there is a music reproduction instruction. If the user wants to redo the timing and designates the music playback button 52, it is determined that there has been a music playback instruction. If the control unit 8 determines that there is a music reproduction instruction (step S110: YES), the control unit 8 returns to step S103. If the control unit 8 determines that there is no music reproduction instruction (step S110: NO), the control unit 8 returns to step S107.

  In step S11 shown in FIG. 4, the control unit 8 transmits a drawing start timing adjustment time registration request adjusted by the manual timing adjustment process to the lyrics information providing server SA. Adjustment information indicating the drawing start timing adjustment time, the attribute information of the selected music piece, and the terminal ID are added to the registration request. The terminal T1 can provide adjustment information indicating the drawing start timing adjustment time adjusted by the user's own operation to another terminal Tn used by another user. The attribute information transmitted in step S11 includes at least a song name and a singer name. The attribute information may include one or more pieces of information such as a music playback time, album name, track number, file size, encoding method, and bit rate (bps).

  Next, the control unit 8 stores adjustment information indicating the drawing start timing adjustment time adjusted by the manual timing adjustment process in the storage unit 1 in association with the music ID of the reproduced music, or the music name and singer name. (Step S12). At this time, the color change timing data acquired in step S41 may be stored together with the adjustment information. The stored adjustment information is used in the “first automatic timing adjustment process”.

  After the process of step S3, S6, S9, or S12, the music reproduction control and lyrics drawing control processes are continued, and then the process ends.

(Processing of lyrics information providing server SA)
Next, processing performed by the control unit 13 of the lyrics information providing server SA according to the present embodiment will be described. FIG. 7 is a flowchart illustrating an example of processing in the control unit 13 of the lyrics information providing server SA.

  The process shown in FIG. 7 is started when the lyrics information providing server SA is turned on. In step S21, the control unit 13 of the lyrics information providing server SA determines whether or not a drawing start timing adjustment time registration request is received from the terminal Tn. When it is determined that the registration request for the drawing start timing adjustment time has been received (step S21: YES), the control unit 13 proceeds to step S22. If it is determined that the drawing start timing adjustment time registration request has not been received (step S21: NO), the control unit 13 proceeds to step S23.

  In step S22, the control unit 13 registers the adjustment information indicating the drawing start timing adjustment time added to the received registration request, the attribute information of the music, and the terminal ID in association with each other in the adjustment information database 112, and then in step S31. Proceed to

  In step S23, the control unit 13 determines whether a request for lyrics telop data is received from the terminal Tn. When it is determined that the request for the lyrics telop data has been received (step S23: YES), the control unit 13 proceeds to step S24. When it is determined that the request for the lyrics telop data has not been received (step S23: NO), the control unit 13 proceeds to step S26.

  In step S24, the lyrics telop data registered in association with the music ID added to the request is acquired from the lyrics telop database 111 in response to the request for the lyrics telop data. When the song title and the singer name are added to the request for the lyrics telop data, the lyrics telop data registered in association with the set of the song name and the singer name is acquired. Next, the control unit 13 transmits the lyrics telop data acquired in step S24 to the requesting terminal Tn (step S25), and proceeds to step S31.

  In step S26, the control unit 13 determines whether or not a request for adjustment information has been received from the terminal Tn. If it is determined that the adjustment information request has been received (step S26: YES), the control unit 13 proceeds to step S27. If it is determined that the adjustment information request has not been received (step S26: NO), the control unit 13 proceeds to step S29.

  In step S27, in response to the received adjustment information request, the control unit 13 executes an adjustment information acquisition process corresponding to the attribute information added to the request (hereinafter referred to as “received attribute information”). To do. In the acquisition process, the control unit 13 acquires adjustment information associated with attribute information that matches the received attribute information. For example, when the received attribute information includes a song name “Song-A”, a singer name “Artist-B”, and a playback time “2:30”, in the example shown in FIG. The attribute information contained in the matches. In this case, the adjustment information included in the record 3 is acquired from the adjustment information database 112.

  If attribute information that matches the attribute information of all received items is not registered, the adjustment information associated with the attribute information having the largest number of items of attribute information that matches the attribute information for each received item is displayed. Priority is acquired from the adjustment information database 112. For example, the received attribute information includes a song name “Song-A”, a singer name “Artist-A”, a playback time “2:32”, an album name “Album-C”, and a track number “3”. In the example shown in FIG. 3B, the attribute information included in the record 7 has the largest number of items. In this case, the adjustment information included in the record 7 is acquired from the adjustment information database 112. The lyrics information providing server SA sends the adjustment information associated with the attribute information having the largest number of items of attribute information that matches the attribute information of each item added to the request to the terminal Tn that has requested the adjustment information. Can be provided. The terminal Tn that has requested the adjustment information can acquire adjustment information indicating the drawing start timing adjustment time that more closely matches the reproduced music. As a result, the terminal Tn can synchronize the reproduction timing of the music and the drawing of the lyrics of the music more accurately.

  In some cases, a plurality of pieces of attribute information having the largest number of items of attribute information that matches the received attribute information for each item are registered. In this case, the adjustment information associated with the attribute information having a higher priority item among the matching attribute information items is given priority based on the priority order set in advance for each item of attribute information. Obtained from database 112.

  FIG. 8A is a diagram illustrating an example of priorities set in advance for each item of attribute information. In FIG. 8A, items of attribute information are shown in descending order of priority. For example, when the received attribute information includes a song name “Song-A”, a singer name “Artist-A”, a playback time “2:30”, and an album name “Album-C”, FIG. In (B), the attribute information included in the record 4 and the attribute information included in the record 9 have the largest number of items. In this case, when the priority order shown in FIG. 8A is applied, the playback time is higher in priority than the album name, so that the attribute information included in the record 4 is associated with the attribute information included in the record 9. The obtained adjustment information is prioritized and acquired from the adjustment information database 112. The lyrics information providing server SA can provide the adjustment information associated with the attribute information that matches the items with higher priority to the terminal Tn that has requested the adjustment information. The terminal Tn that has requested the adjustment information can acquire adjustment information indicating the drawing start timing adjustment time that more closely matches the reproduced music. As a result, the terminal Tn can synchronize the timing of the reproduction of the music and the drawing of the lyrics of the music more accurately.

  FIG. 8B is a flowchart showing an example of adjustment information acquisition processing based on a priority order set in advance for each item of attribute information. In the acquisition process, the priority of the song name and singer name items is the highest among the attribute information items, and the match between the song name and the singer name is essential. This is because if there is a discrepancy between the song name and the singer name, there is a high possibility of another song. In step S271 of the acquisition process shown in FIG. 8B, the control unit 13 adjusts the record including “song name and singer name” that matches “song name and singer name” in the received attribute information. It is determined whether or not it is registered in the database 112. If the control unit 13 determines that a record including the matching song name and singer name is not registered (step S271: NO), the control unit 13 proceeds to step S272, and a record including the matching song name and singer name exists. If it is determined that it is registered (step S271: YES), the process proceeds to step S273.

  In step S272, the control unit 13 transmits information indicating that the requested adjustment information is not registered to the requesting terminal Tn, and proceeds to step S31 illustrated in FIG.

  In step S273, the control unit 13 determines that a record including “playback time, album name, and track number” that matches “playback time, album name, and track number” in the received attribute information is the adjustment information database 112. It is determined whether or not it is registered. If the control unit 13 determines that the record including the matching playback time, album name, and track number is not registered (step S273: NO), the control unit 13 proceeds to step S274, and the matching playback time, album name, When it is determined that the record including the track number is registered (step S273: YES), the adjustment information included in the corresponding record is acquired from the adjustment information database 112 (step S276). In this case, the adjustment information associated with the attribute information that matches the “music title, singer name, playback time, album name, and track number” in the received attribute information is acquired. When there are a plurality of pieces of adjustment information to be acquired, for example, one piece of adjustment information is randomly acquired from the plurality of pieces of adjustment information.

  In step S274, the control unit 13 determines whether or not a record including the reproduction time and album name that matches the reproduction time and album name in the received attribute information is registered in the adjustment information database 112. If the control unit 13 determines that the record including the matching playback time and album name is not registered (step S274: NO), the control unit 13 proceeds to step S275. When it is determined that the record including the matching playback time and album name is registered (step S274: YES), the control unit 13 acquires the adjustment information included in the corresponding record from the adjustment information database 112 ( Step S276). In this case, adjustment information associated with the attribute information that matches the “music name, singer name, playback time, and album name” in the received attribute information is acquired. When there are a plurality of pieces of adjustment information to be acquired, one piece of adjustment information is randomly acquired from the plurality of pieces of adjustment information.

  In step S275, the control unit 13 determines whether or not a record including a reproduction time that matches the reproduction time in the received attribute information is registered in the adjustment information database 112. If the control unit 13 determines that the record including the matching reproduction time is not registered (step S275: NO), the control unit 13 proceeds to step S277. When it is determined that the record including the matching reproduction time is registered (step S275: YES), the control unit 13 acquires the adjustment information included in the corresponding record from the adjustment information database 112 (step S276). . In this case, adjustment information associated with the attribute information that matches the “music title, singer name, and playback time” included in the received attribute information is acquired. If there are a plurality of pieces of adjustment information to be acquired, one piece of adjustment information is randomly acquired from the plurality of pieces of adjustment information.

  In step S277, the control unit 13 acquires adjustment information included in the record including the song name and singer name matching the song name and singer name in the received attribute information from the adjustment information database 112. Here, when there are a plurality of pieces of adjustment information to be acquired, for example, one piece of adjustment information is randomly acquired from the plurality of pieces of adjustment information.

  In the adjustment information acquisition process shown in FIG. 8B, the received attribute information includes “song name, singer name, playback time, album name, track number, file size, encoding method, and bit rate”. The adjustment information associated with the attribute information that matches the attribute information may be acquired. When there are a plurality of pieces of adjustment information to be acquired, for example, one piece of adjustment information is randomly acquired from the plurality of pieces of adjustment information.

  Returning to the process shown in FIG. 7, in step S28, the control unit 13 transmits the adjustment information acquired in the process of step S27 to the requesting terminal Tn, and the process proceeds to step S31. The transmitted adjustment information is adjustment information indicating the drawing start timing adjustment time adjusted in another request source terminal Tn different from the request source terminal Tn.

  In step S <b> 29, the control unit 13 determines whether or not a trigger for counting the drawing start timing adjustment time has arrived. The aggregation trigger is set by, for example, a timer so as to arrive every predetermined time set to about one hour. If the control unit 13 determines that the aggregation opportunity has not arrived (step S29: NO), the control unit 13 proceeds to step S31. If it is determined that the tally trigger has arrived (step S29: YES), the control unit 13 executes the tally processing for the drawing start timing adjustment time (step S30), and proceeds to step S31. In the counting process, when a plurality of sets of attribute information and adjustment information (that is, a plurality of records) are registered, each adjustment information included in a record in which all or part of the attribute information for each registered item is matched. An appropriate drawing start timing adjustment time (hereinafter referred to as “shift adjustment time”) is determined based on the drawing start timing adjustment time shown.

  FIG. 9 is a flowchart illustrating an example of a process of counting the drawing start timing adjustment time. In step S <b> 301, the control unit 13 specifies a record in which “song name and singer name” is included in the attribute information from the adjustment information database 112. The control unit 13 determines whether or not another record including the song name and singer name that matches the song name and singer name in the record identified in step S301 is registered in the adjustment information database 112 (step S301). S302). In step S301 and step S302, it is desirable that a record including attribute information other than the music title and singer name is excluded from the determination target. If the control unit 13 determines that no other record including the matching music name and singer name is registered in the adjustment information database 112 (step S302: NO), the control unit 13 proceeds to step S306. When the control unit 13 determines that another record including the matching music name and singer name is registered in the adjustment information database 112 (step S302: YES), the control unit 13 proceeds to step S303. In step S303, the control unit 13 acquires adjustment information included in the record identified in step S301 and adjustment information included in one or more other records determined to be registered in step S302.

  The control unit 13 determines the optimum shift adjustment time based on the drawing start timing adjustment time indicated by the respective adjustment information acquired in step S303 (step S304). For example, an average value of a plurality of acquired drawing start timing adjustment times is calculated, and the calculated average value is determined as an optimal shift adjustment time. Alternatively, a median value at the center when the plurality of acquired drawing start timing adjustment times are arranged in order of magnitude is calculated, and the calculated median value is determined as the optimum shift adjustment time. Alternatively, the largest drawing start timing adjustment time among the plurality of acquired drawing start timing adjustment times is determined as the optimum shift adjustment time. After narrowing down the plurality of acquired drawing start timing adjustment times under a predetermined condition, the optimum shift adjustment time may be determined in the process of step S304. For example, the control unit 13 narrows down the drawing start timing adjustment time included in the plus or minus predetermined range based on the average value or the median value of the plurality of acquired drawing start timing adjustment times. The predetermined range is set to about 3 seconds, for example. Thereby, the number of the drawing start timing adjustment times acquired is narrowed down to a smaller number. The control unit 13 determines the optimum shift adjustment time as described above based on the plurality of drawn drawing start timing adjustment times.

  Then, the control unit 13 registers the song name and singer name in the record specified in step S301 in association with the shift adjustment information indicating the shift adjustment time determined in step S304 in the adjustment information database 112 ( Step S305). At this time, the record specified in step S301 and one or more other records determined to be registered in step S302 are deleted from the adjustment information database 112. The adjustment information acquired in step S303 is replaced with shift adjustment information indicating the shift adjustment time determined in step S304.

  In step S <b> 306, the control unit 13 determines whether a record including “song name and singer name” in the attribute information is registered in the adjustment information database 112 in addition to the record specified in step S <b> 301. It is determined whether there are still unidentified records. When the control unit 13 determines that a record including “music title and singer name” in the attribute information is registered in the adjustment information database 112 (step S306: YES), the control unit 13 returns to step S301. A record that has not yet been specified is specified in step S301, and the processes in and after step S302 are performed. If the control unit 13 determines that a record including “music title and singer name” in the attribute information is not registered in the adjustment information database 112 (step S306: NO), the control unit 13 proceeds to step S307. If all the records including “music title and singer name” in the attribute information are specified in step S301, the process proceeds to step S307.

  In step S <b> 307, the control unit 13 specifies from the adjustment information database 112 a record whose attribute information includes “music title, singer name, and playback time”. The control unit 13 determines that another record including “song name, singer name, and playback time” that matches “song name, singer name, and playback time” in the record specified in step S307 is the adjustment information database 112. Is registered (step S308). In step S307 and step S308, it is desirable that a record including attribute information other than the song name, singer name, and reproduction time is excluded from the determination target. When the control unit 13 determines that no other record including the matching “music title, singer name, and playback time” is registered in the adjustment information database 112 (step S308: NO), the process proceeds to step S312. . When the control unit 13 determines that another record including the matching “music title, singer name, and playback time” is registered in the adjustment information database 112 (step S308: YES), the control unit 13 proceeds to step S309. .

  The processes in steps S309 to S312 are performed in the same manner as the processes in steps S303 to S306. If all the records including “music title, singer name, and playback time” in the attribute information are specified in step S307, the process proceeds to step S313.

  In step S <b> 313, the control unit 13 specifies from the adjustment information database 112 a record whose attribute information includes “song name, singer name, playback time, and album name”. The control unit 13 includes other “song name, singer name, playback time, and album name” that matches “song name, singer name, playback time, and album name” in the record specified in step S313. It is determined whether or not the record is registered in the adjustment information database 112 (step S314). In step S313 and step S314, it is desirable that a record including attribute information other than the song name, singer name, playback time, and album name is excluded from the determination target. When the control unit 13 determines that no other record including the matching “music name, singer name, playback time, and album name” is registered in the adjustment information database 112 (step S314: NO), step The process proceeds to S318. When the control unit 13 determines that another record including the matching “music title, singer name, playback time, and album name” is registered in the adjustment information database 112 (step S314: YES), step Proceed to S315.

  Steps S315 to S318 are performed in the same manner as steps S303 to S306. If all records including “music title, singer name, playback time, and album name” in the attribute information are specified in step S313, the process proceeds to step S319.

  In step S <b> 319, the control unit 13 specifies a record whose attribute information includes “song name, singer name, playback time, album name, and track number” from the adjustment information database 112. The control unit 13 selects “song name, singer name, playback time, album name, and track number” that matches “song name, singer name, playback time, album name, and track number” in the record specified in step S319. "Is included in the adjustment information database 112 (step S320). In step S319 and step S320, it is desirable that records including attribute information other than the song name, singer name, playback time, album name, and track number are excluded from the determination target. When the control unit 13 determines that no other record including the matching “music name, singer name, playback time, album name, and track number” is registered in the adjustment information database 112 (step S320: NO). ), The process proceeds to step S324. When the control unit 13 determines that another record including the matching “music name, singer name, playback time, album name, and track number” is registered in the adjustment information database 112 (step S320: YES) ), The process proceeds to step S321.

  The processing of steps S321 to S324 is performed in the same manner as the processing of steps S303 to S306. In this way, when all the records whose attribute information includes “song name, singer name, playback time, album name, and track number” are specified in step S319, the process returns to the process shown in FIG.

  By executing the above aggregation processing, the lyric information providing server SA shift adjustment information indicating the optimum shift adjustment time determined based on the drawing start timing adjustment time for each attribute information provided from the plurality of terminals Tn. Can be provided to the terminal Tn that has requested the adjustment information. The optimal shift adjustment time is updated at predetermined time intervals. The terminal Tn that has requested the adjustment information can acquire shift adjustment information indicating the optimum shift adjustment time for the music to be played. As a result, the terminal Tn can synchronize the timing of the reproduction of the music and the drawing of the lyrics of the music more accurately.

  As for the records including “song name, singer name, playback time, album name, track number, file size, encoding method, and bit rate”, the counting process is performed in the same manner as the processes in steps S301 to S306. It may be configured.

  The control unit 13 may determine the boundary information based on the drawing start timing adjustment time provided from the terminal Tn in the aggregation process. For example, the control unit 13 calculates the volume level of the music at the time when the drawing start timing adjustment time has reached from the music reproduction start time as the boundary value, and determines boundary information indicating the calculated boundary value. In this case, the control unit 13 provides the determined boundary information instead of the adjustment information to the terminal Tn that has requested the adjustment information in step S71. You may comprise so that the process which determines boundary information based on drawing start timing adjustment time may be performed by the terminal Tn side. In this case, boundary information is determined based on the drawing start timing adjustment time in step S106, and a registration request for the determined boundary information is transmitted to the lyrics information providing server SA. Thereby, the registered boundary information is provided instead of the adjustment information to the terminal Tn that has requested the adjustment information in step S71.

  In step S31, the control unit 13 determines whether or not there is a power-off instruction. If it is determined that the power-off instruction has been issued (step S31: YES), the processing shown in FIG. 7 ends. If it is determined that there is no termination instruction (step S31: NO), the process returns to step S21.

  As described above, according to the above-described embodiment, the terminal T1 acquires the lyrics telop data including the boundary information regarding the volume boundary of the music to be played from the lyrics information providing server SA. Based on the acquired boundary information, the terminal T1 detects a shift time when the volume of the music is equal to or less than a predetermined threshold from the playback start time of the music, and starts drawing the lyrics of the music based on the shift time. . The terminal T1 can synchronize the reproduction timing of the music data and the drawing timing of the music lyrics while suppressing the load applied to the lyrics information providing server SA and the communication network NW.

  The terminal T1 is configured to start drawing the lyrics of the music using the drawing start timing adjustment time adjusted in the other terminal Tn for the music to be played. The drawing timing can be synchronized with higher accuracy.

DESCRIPTION OF SYMBOLS 1 Memory | storage part 2 Reproduction | regeneration processing part 3 Speaker 7 Portable radio | wireless communication part 8 Control part 11 Memory | storage part 12 Communication part 13 Control part Tn Terminal SA Lyrics information provision server S Music information provision system

Claims (7)

In a computer of an information processing apparatus comprising storage means for storing music data and lyrics data that can be drawn on a predetermined display unit in accordance with the reproduction of the music,
A first acquisition step of acquiring volume information indicating a predetermined threshold of the volume of the music from a server device connected via a communication network;
A detection step of detecting a time during which the volume of the music is equal to or less than the predetermined threshold from the playback start time of the music based on the volume information acquired in the first acquisition step;
Starting to draw lyrics of the music based on the time detected by the detecting step;
An information processing program for executing The server device
Attribute information indicating attributes of a plurality of music pieces can be stored, and adjustment times transmitted from the plurality of information processing devices connectable to the server device, and the music pieces transmitted together with the adjustment times The shift adjustment information indicating the shift adjustment time of the drawing start timing of the lyrics of the music based on the adjustment time for each of the attribute information registered by the server device. To the information processing apparatus,
The information processing program includes:
A transmission step of transmitting attribute information of the music to be reproduced to the server device;
A second acquisition step of acquiring, from the server device, the shift adjustment information registered in the server corresponding to the attribute information transmitted in the transmission step;
Starting drawing lyrics of the music based on the shift adjustment time indicated by the shift adjustment information acquired by the second acquisition step;
The information processing program according to claim 1, further comprising:   The information processing program according to claim 2, wherein the second acquisition step acquires the shift adjustment information associated with the attribute information having the largest number of matching attribute information items from the server device. In the server device, the music is registered in association with a plurality of attribute information, and the volume information of the music is determined for each music.
The information processing program causes a transmission step of transmitting attribute information of a music piece to be reproduced to the server device,
The said 1st acquisition step acquires the said volume information determined for every said music from the said server apparatus corresponding to the said attribute information transmitted by the said transmission step. The information processing program according to any one of the above. A communication system comprising an information processing device and a server device to which the information processing device is connected via a communication network,
The information processing apparatus includes:
Storage means for storing music data and lyric data that can be rendered on a predetermined display unit in accordance with reproduction of the music;
First transmission means for transmitting volume information request information indicating a predetermined threshold of the volume of the music data to the server device,
The server device
First receiving means for receiving the request information transmitted from the information processing apparatus;
Second transmission means for transmitting the volume information to the information processing apparatus in response to the request information received by the first reception means,
The information processing apparatus includes:
Second receiving means for receiving the volume information transmitted from the server device;
Detection means for detecting, based on the volume information received by the second receiving means, a time during which the volume of the music is equal to or less than the predetermined threshold from the playback start time of the music;
Based on the time detected by the detection means, control means for starting to draw lyrics of the music;
A communication system comprising: Storage means for storing music data and lyric data that can be rendered on a predetermined display unit in accordance with reproduction of the music;
Obtaining means for obtaining volume information indicating a predetermined threshold of the volume of the music from a server device connected via a communication network;
Detecting means for detecting, based on the volume information acquired by the acquiring means, a time when the volume of the music is equal to or less than the predetermined threshold from the playback start time of the music;
Based on the time detected by the detection means, control means for starting to draw lyrics of the music;
An information processing apparatus comprising: A lyrics telop drawing method executed by an information processing apparatus including a storage unit that stores music data and lyrics data that can be drawn on a predetermined display unit according to reproduction of the music,
An acquisition step of acquiring volume information indicating a predetermined threshold of the volume of the music from a server device connected via a communication network;
A detection step of detecting a time during which the volume of the music is equal to or less than the predetermined threshold from the playback start time of the music based on the volume information acquired in the acquisition step;
Starting to draw lyrics of the music based on the time detected by the detecting step;
A method for drawing a lyrics telop, comprising:

Images