JP5728120B1 - Acoustic system, communication device and program - Google Patents

Abstract

An audio system capable of increasing user enjoyment is provided. An acoustic system includes an output unit, a communication unit, a first output control unit, and a second output control unit. The output unit is configured to output sound and images. The communication unit is configured to be able to communicate with the external device (10, 90). The first output control unit receives the reproduction signal via the communication unit from the communication device (10) that transmits the acoustic data reproduction signal, and causes the output unit to output sound based on the reproduction signal. It is configured to reproduce a series of sounds represented by the acoustic data. The second output control unit is configured to cause the output unit to output, as an image, a word corresponding to the sound output from the output unit in the series of sounds represented by the acoustic data. [Selection] Figure 1

Description

  The present invention relates to an acoustic system, a communication device, and a program.

  Conventionally, a portable music player has been known. In recent years, portable communication devices typified by smartphones generally have a function as a music playback device. For example, the communication device reproduces music data stored in the storage device and outputs music corresponding to the music data from a built-in speaker.

  A speaker system that wirelessly communicates with a music playback device and outputs music corresponding to the music data played back by the music playback device is also known (see, for example, Patent Document 1).

JP 2008-278328 A

  By the way, in recent years, there are many cases where consumers purchase music data through a network and listen to their favorite music. In this case, there are few opportunities for consumers to know the lyrics corresponding to the music in detail because the lyrics data is not usually attached to the music data. On the other hand, some music providers want to enjoy music with lyrics. In addition, some consumers have a desire to enjoy music with lyrics.

  In one aspect of the present invention, it is desirable to be able to provide at least one of an acoustic system that can increase user enjoyment and a communication device that can use the acoustic system.

  An acoustic system according to one aspect of the present invention includes an output unit, a communication unit, a first output control unit, and a second output control unit. The output unit is configured to be able to output sound and images. The communication unit is configured to be able to communicate with an external device.

  The first output control unit is configured to receive a reproduction signal via a communication unit from a communication device that transmits an acoustic data reproduction signal, and to output sound based on the reproduction signal to the output unit. With this configuration, the first output control unit can operate so that a series of sounds represented by the acoustic data is reproduced through the output unit. The first output control unit may be configured to output sound based on the reproduction signal to the output unit in response to reception of the reproduction signal (for example, in a chain).

  The second output control unit is configured to cause the output unit to output, as an image, a word corresponding to the sound output from the output unit in the series of sounds represented by the acoustic data. The second output control unit may be configured to acquire or generate a word corresponding to the sound output from the output unit out of a series of sounds represented by the acoustic data, and output the generated word as an image to the output unit.

According to one aspect of the present invention, the acoustic system can output words corresponding to the sound as an image corresponding to the output of a series of sounds represented by the acoustic data, so that the user for listening to the sound Enjoyment can increase.

  Examples of acoustic data include music data. The second output control unit may be configured to cause the output unit to output words of lyrics corresponding to a portion output by the output unit in the music represented by the music data.

  According to one aspect of the present invention, the audio system can output music according to a reproduction signal generated by reproduction processing on music data in a communication device, while displaying lyrics corresponding to the music. it can. In this case, for example, the user can enjoy the music as sound using the acoustic system, and can enjoy watching the lyrics. Thus, according to one aspect of the present invention, the acoustic system can increase user enjoyment. Examples of the communication device include a communication device having a music playback function such as a smartphone and a tablet, and a music playback device having a communication function.

  Examples of the sound data include moving image data with sound. The second output control unit may be configured to cause the output unit to output subtitles corresponding to a portion (moving image audio) output by the output unit in the moving image represented by the moving image data. Therefore, according to one aspect of the present invention, the sound system can increase the enjoyment of the user for viewing a moving image, for example.

  The communication device may be configured to transmit a reproduction position signal representing a reproduction position in sound data of sound output based on the reproduction signal. In this case, the second output control unit receives the reproduction position signal from the communication device via the communication unit, and based on the reproduction position signal, the output unit outputs a word corresponding to the sound output from the output unit as an image. It can be made to be made to output.

  Furthermore, the acoustic system may include a counter that counts the playback time. In this case, the second output control unit may be configured to correct the reproduction time counted by the counter to a time corresponding to the reproduction position represented by the received reproduction position signal. Further, the second output control unit may be configured to output words corresponding to the sound output from the output unit as an image to the output unit based on the reproduction time counted by the counter.

  According to such a configuration, even when the reproduction position signal is transmitted from the communication device with a low frequency, the acoustic system can display a word corresponding to the output sound at an appropriate timing. Therefore, according to one aspect of the present invention, the acoustic system can suppress an inappropriate shift in the display timing of words with respect to sound.

  The acoustic system may include an acquisition control unit that acquires image output data corresponding to the acoustic data. The image output data can be configured to include a plurality of words corresponding to a series of sounds represented by the acoustic data. For example, the acquisition control unit may be configured to acquire image output data corresponding to acoustic data from at least one of the communication device and a server device different from the communication device via the communication unit.

  The acquisition control unit may be configured to acquire image output data from the server device by wide area communication via the communication unit. Alternatively, the acquisition control unit may be configured to acquire image output data from a communication device by narrow-area communication via the communication unit. The first output control unit may be configured to receive a reproduction signal from a peripheral communication device by narrow-area communication via the communication unit. In addition, the acquisition control unit may be configured to transmit the image output data acquired from the server device to the communication device via the communication unit.

The second output control unit is configured to cause the output unit to output, as an image, a word corresponding to the sound output from the output unit among the plurality of words based on the image output data acquired by the acquisition control unit. obtain. Alternatively, the second output control unit may be configured to analyze the sound output by the output unit and output the words represented by the sound as an image to the output unit according to the analysis result. In this way, the second output control unit may be configured to generate words corresponding to the sound output by the output unit. In this case, the image output data may not be used.

  The acquisition control unit may be configured to receive identification data capable of identifying image output data corresponding to the acoustic data from the communication device via the communication unit. In this case, the acquisition control unit may be configured to acquire image output data corresponding to the acoustic data based on the received identification data. As another example, the acquisition control unit may be configured to identify image output data corresponding to acoustic data by analyzing at least one of a reproduction signal from the communication device and an output sound from the output unit. .

  In addition to this, the image output data may be configured to include information defining the correspondence between the sound reproduction position and the words in the acoustic data for each of the plurality of words. In this case, the second output control unit is configured to cause the output unit to output, as an image, a word corresponding to the reproduction position of the sound output from the output unit, based on the information defining the correspondence relationship. Can be.

  Examples of image output data include lyric data. When the acoustic data is music data and the image output data is lyrics data, the second output control unit is a portion that the output unit outputs from among the music represented by the music data based on the lyrics data corresponding to the music data The words of the lyrics corresponding to may be output to the output unit as an image.

  Further, the communication device according to one aspect of the present invention is configured to reproduce the sound data on the condition that an instruction to reproduce the sound data is input, and to output a series of sounds represented by the sound data to the sound system. A transmission control unit for transmitting a reproduction signal to the acoustic system is provided. The communication device may be configured to include a storage unit for storing acoustic data.

  The communication device further includes a transmission control unit that transmits, to the acoustic system, a reproduction position signal that represents a reproduction position in the acoustic data of the sound that is output based on the reproduction signal, among the series of sounds that the acoustic data represents. It may be configured.

  The communication device may include a display unit that can output an image. Receives image output data corresponding to the sound data from the sound system, and outputs words corresponding to the sound output by the output unit of the sound system as an image to the display unit of the communication device based on the received image output data. The communication device may include a display control unit configured to be configured. In this case, the sound system can display words corresponding to the sound in accordance with the sound output, and further, the communication device can display words corresponding to the sound.

  The communication device acquires image output data corresponding to the sound data, transmits the image output data to the sound system, and corresponds to the sound output by the output unit of the sound system based on the image output data. You may provide the display control unit which outputs a word to a display unit as an image.

According to one aspect of the present invention, the communication device transmits the reproduction signal and the reproduction position signal of the acoustic data to the acoustic system, and one of the communication device and the acoustic system corresponds to the acoustic data from the server device. The image output data is acquired, and the other of the communication device and the sound system can acquire the image output data from one of the communication device and the sound system. In this case, the communication device and the sound system can synchronously output words corresponding to the output sound as images in accordance with the sound output by the sound system (or according to the sound reproduction position).

  According to another aspect of the present invention, at least a part of the functions of the acoustic system and the communication device can be realized by a computer by a program. For example, the communication device may be configured to include a computer (or processor) and a memory that stores a program for causing the computer (or processor) to function as at least one of the units related to the communication device described above.

  The program can be, for example, a program for causing a computer of a communication device to execute a first transmission control procedure and a second transmission control procedure. In the first transmission control procedure, on the condition that an instruction to reproduce acoustic data is input, the acoustic data is reproduced, and a reproduction signal for outputting a series of sounds represented by the acoustic data to the acoustic system is transmitted to the acoustic system. Can be a procedure to send to. The second transmission control procedure may be a procedure of transmitting a reproduction position signal representing a reproduction position in the sound data of the output sound to the sound system.

  These programs can be recorded on a recording medium in any form readable by a computer. The recording medium may be a tangible non-transitory recording medium. Examples of the tangible non-transitory recording medium include a semiconductor memory, a magnetic disk, and an optical disk.

It is a block diagram showing schematic structure of a music reproduction system. It is a block diagram showing schematic structure of a communication terminal, an acoustic system, and a server apparatus. It is a figure showing schematic structure of lyrics data. It is a block diagram showing the function implement | achieved by the control unit of a communication terminal and an acoustic system. It is a flowchart showing the process performed in a main control part. It is the figure which illustrated the transmission timing of the reproduction position signal. It is a flowchart showing the process performed in a data acquisition part. It is a block diagram showing the function implement | achieved by the communication terminal which the music reproduction system of a 2nd modification has, and the control unit of an acoustic system.

  Embodiments of the present invention will be described below with reference to the drawings. However, the present invention is not construed as being limited in any way by the following examples. The aspect which abbreviate | omitted a part of the following Example is also embodiment of this invention. Any aspect that can be considered without departing from the essence of the invention specified only by the wording of the claims is an embodiment of the present invention.

  A music playback system 1 according to the present embodiment illustrated in FIG. 1 includes a portable communication terminal 10, an acoustic system 50, and a server device 90. A portion indicated by a broken line in FIG. 1 will be used later in the description of the modification. As the communication terminal 10, a smart phone, a tablet terminal, etc. can be mentioned as an example.

  In the music playback system 1, the communication terminal 10 performs playback processing on the music data DM and transmits a playback signal of the music data DM to the acoustic system 50. The communication terminal 10 further transmits a reproduction position signal of the music data DM to the sound system 50 in accordance with the transmission of the reproduction signal. Prior to the execution of the reproduction process, the communication terminal 10 is configured to transmit music piece data of music to be reproduced based on the music data DM to the acoustic system 50.

The acoustic system 50 acquires the lyrics data DL corresponding to the music data DM to be reproduced from the server device 90 via the wide area network NT based on the music data received from the communication terminal 10. Thereafter, the acoustic system 50 receives a reproduction signal of the music data DM transmitted from the communication terminal 10, and outputs the corresponding music from the built-in speaker 53 (see FIG. 2) based on the reproduction signal. .

  The acoustic system 50 further receives a reproduction position signal from the communication terminal 10, and based on the reproduction position signal and the lyrics data DL acquired from the server device 90, generates a character string of lyrics corresponding to the output sound from the speaker 53. This is displayed on the built-in display 55 (see FIG. 2).

  That is, the music playback system 1 of the present embodiment is configured to realize output of music and display of lyrics corresponding to the music data DM to be played back by the communication terminal 10 using an acoustic system 50 different from the communication terminal 10. The Communication between the communication terminal 10 and the acoustic system 50 is realized by narrow area communication, and communication between the acoustic system 50 and the server apparatus 90 is realized by wide area communication through the wide area network NT.

  The wide area network NT is, for example, the Internet. The narrow-area communication can be realized by at least one of short-range wireless communication in accordance with a short-range communication standard represented by Bluetooth (registered trademark) and wireless LAN communication in accordance with the IEEE 802.11 communication standard. The narrow area communication realized by the wireless LAN communication mentioned here indicates communication within the local area network. The music reproduction system 1 functions significantly when the communication terminal 10 and the sound system 50 are in a close positional relationship such as when they are located in the same room.

  As shown in FIG. 2, the communication terminal 10 of this embodiment includes a control unit 11, a storage unit 13, a user interface 15, and a communication unit 17. The control unit 11 includes a CPU 11A and a memory 11B. The CPU 11A executes processing according to various programs stored in the storage unit 13. The memory 11B includes a RAM that is used as a work area when the CPU 11A executes processing. Below, the process which CPU11A performs according to a program is demonstrated by making the control unit 11 into an operation subject.

  The storage unit 13 is configured so that data can be read and written by the control unit 11. The storage unit 13 stores programs for realizing various functions in the communication terminal 10 and various data. Various data includes one or a plurality of music data DM. The storage unit 13 is configured by a large-capacity flash memory, for example.

  The user interface 15 is configured to be able to display various screens to the user and accept operations from the user. The user interface 15 is configured to include, for example, a liquid crystal display and a touch panel (not shown). The user interface 15 is controlled by the control unit 11, displays various screens, and inputs operation signals from the user to the control unit 11.

  The communication unit 17 includes a short-range wireless communication module and a wireless LAN communication module (not shown). That is, the communication unit 17 is configured to be able to realize short-range wireless communication in accordance with the short-range communication standard and wireless LAN communication in accordance with the IEEE 802.11 communication standard. The control unit 11 communicates wirelessly with the acoustic system 50 via the communication unit 17.

  The acoustic system 50 includes a control unit 51, a speaker 53, a display 55, and a communication unit 57. The control unit 51 includes a CPU 51A and a memory 51B, as well as a circuit (not shown).

  The CPU 51A executes processing according to various programs. The memory 51B includes a ROM that stores various programs and a RAM that is used as a work area when the CPU 51A executes processing. Below, the process which CPU51A performs according to a program is demonstrated by making the control unit 51 into an operation subject.

  The speaker 53 is configured to include a plurality of speaker units and amplifiers corresponding to a plurality of different sound ranges. The speaker 53 operates to convert the audio signal input from the control unit 51 into sound and output the sound.

  The display 55 is configured as a liquid crystal display, for example. The display 55 is controlled by the control unit 51 and displays lyrics when the music is played. In addition, the display 55 is controlled by the control unit 51 to display a visual effect during music reproduction. Here, the visual effect refers to an animation that changes at least one of a color and a geometric pattern in accordance with the rhythm of the music.

  Similar to the communication terminal 10, the communication unit 57 includes a short-range wireless communication module and a wireless LAN communication module (not shown). That is, the communication unit 57 is configured to be able to realize short-range wireless communication according to the short-range communication standard and wireless LAN communication according to the IEEE 802.11 communication standard. The control unit 51 performs near field communication or wireless LAN communication with the communication terminal 10 via the communication unit 57. Further, the control unit 51 performs wide area communication with the server device 90 disposed in the wide area network NT by communication via the communication unit 57.

  The server device 90 includes a control unit 91 and a database 95. The control unit 91 is configured to be able to communicate with the acoustic system 50 through the wide area network NT. When the control unit 91 receives a request signal for the lyrics data DL from the acoustic system 50 through the wide area network NT, the control unit 91 operates to search the database 95 for the lyrics data DL requested from the acoustic system 50 according to the request signal. .

  When the requested lyrics data DL can be found in the database 95 by the search, the control unit 91 transmits a response signal including the lyrics data DL to the acoustic system 50. On the other hand, when the lyrics data DL cannot be found, the response signal indicating that is transmitted to the acoustic system 50 through the wide area network NT.

  As shown in FIG. 3, the database 95 is configured to have lyrics data DL for each music piece. As shown in FIG. 3, the lyrics data DL includes metadata and a lyrics data body. The metadata includes song information such as a song name, a composer name, and a songwriter name. The music information is used to specify the lyric data DL requested from the acoustic system 50.

  The lyrics data body has a group of character strings representing lyrics corresponding to the music. Specifically, the lyrics data body is configured to have line data for each line defined by dividing the lyrics of the entire music into a plurality of lines. The row data is configured to have information on the reproduction start time of the music portion (part) corresponding to the row as the row start time. The line start time is represented by the time when the beginning of the music is set to zero, that is, the reproduction time from the beginning of the music.

The line data is configured to include information indicating the start time and end time of the phrase and a character string of the lyrics corresponding to the phrase for each phrase regarding the lyrics area corresponding to the line. The start time and end time of the phrase are also expressed by the time (reproduction time) with the beginning of the music as the origin. In the line data, the character string of each clause is defined as a character string to be displayed in the period from the start time to the end time of this clause.

  Next, details of functions realized by the control unit 11 of the communication terminal 10 will be described with reference to FIG. The control unit 11 functions as the main control unit 111, the first transmission control unit 113, and the second transmission control unit 115 by executing the program.

  The main control unit 111 is configured to execute the processing shown in FIG. 5 on condition that a reproduction instruction for one of the music data DM stored in the storage unit 13 is input from the user through the user interface 15. .

  Specifically, when the playback instruction is input, the main control unit 111 refers to the music data DM to be played back specified by the playback instruction (S110), and attaches music data corresponding to the music data DM. An operation command is transmitted to the acoustic system 50 via the communication unit 17 (S120). The operation command and music piece data are transmitted by wireless LAN communication based on, for example, an OSC (OpenSound Control) communication protocol.

  As shown in FIG. 4, the music data DM has a configuration in which metadata is added to the music data main body. The metadata includes song information such as a song name, a composer name, and a songwriter name. The main control unit 111 refers to this metadata, and transmits an operation command attached with music piece data corresponding to the music data DM to be played back to the acoustic system 50 via the communication unit 17.

  The music piece data is provided to the sound system 50 so that the sound system 50 can acquire the lyric data DL corresponding to the music data DM to be reproduced from the server device 90. That is, the song data is transmitted as identification data that can be identified by the sound system 50 and the server device 90 by using the lyrics data DL corresponding to the song data DM. The music piece data may be configured to include music information such as a music title, a composer name, and a songwriter name.

  When the operation command is transmitted, the acoustic system 50 fails to acquire the acquisition completion notification indicating that the acquisition of the lyrics data DL from the server device 90 is completed and the acquisition of the lyrics data DL from the server device 90 as the notification signal. One of the acquisition failure notifications indicating that it has been sent is sent. The main control unit 111 receives this notification signal from the acoustic system 50 via the communication unit 17 (S130).

  Thereafter, the main control unit 111 switches processing according to whether the received notification signal is an acquisition completion notification or an acquisition failure notification (S140). When the received notification signal is an acquisition completion notification (Yes in S140), the main control unit 111 proceeds to S150 and instructs the start of the music reproduction process and the reproduction position transmission process. An instruction to start the music playback process is input to the first transmission control unit 113. An instruction to start the reproduction position transmission process is input to the second transmission control unit 115.

  The first transmission control unit 113 reproduces the music data DM according to the start instruction to generate a reproduction signal for the music data DM, and sends the reproduction signal to the acoustic system 50 via the communication unit 17. Send. The reproduction process mentioned here may be a process for realizing a process to be completed on the communication terminal 10 side in the reproduction process until the speaker 53 outputs the music.

  Therefore, the reproduction process executed by the first transmission control unit 113 can be mainly a process of decoding the music data DM. For example, the reproduction process may be a process of decoding the music data DM until the sound system 50 can output the music from the speaker 53.

  In the present embodiment, as the playback process, the first transmission control unit 113 executes a process for realizing stream playback of the music data DM. AirPlay (registered trademark) of Apple Inc. is known as a technique for reproducing the music data DM in a stream. The first transmission control unit 113 may be configured to convert the music data DM into a reproduction signal by using this type of technology and transmit the music signal DM to the acoustic system 50 through short-range wireless communication or wireless LAN communication.

  On the other hand, the second transmission control unit 115 is configured to transmit a reproduction position signal indicating the reproduction position of the music data DM to be reproduced by the first transmission control unit 113 in accordance with the start instruction. That is, the second transmission control unit 115 transmits a reproduction position signal indicating the position (reproduction position) of the sound output by the reproduction signal transmitted by the first transmission control unit 113 in the entire music.

  The second transmission control unit 115 may be configured to acquire information on the reproduction position managed by the first transmission control unit 113 from the first transmission control unit 113 and transmit a reproduction position signal indicating the reproduction position. The playback position signal can be configured, for example, as a signal in which the playback position is represented by the time when the beginning of the music is zero, that is, the playback time from the beginning of the music.

  In addition, the second transmission control unit 115 may be configured to transmit a reproduction position signal indicating a reproduction position at that time to the acoustic system 50 every certain time Tc of about 1 second to several seconds. The inverted triangular figure shown in FIG. 6 represents the transmission timing of the reproduction position signal. According to the example shown in the upper area (I), the reproduction position signal is transmitted at each of times t0, t1, t2, t3, t4, t5, t6, t7, and t8 having a certain time interval Tc. The time t0 corresponds to the beginning of the music (music reproduction start timing).

  By the way, an instruction regarding trick play such as a backward reproduction instruction and a skip instruction may be input from the user through the user interface 15. In this case, the first transmission control unit 113 performs a reproduction process on the music data DM so as to change the reproduction position in accordance with the instruction from the user.

  Assuming such a case, in the method of transmitting the reproduction position signal at a constant time interval Tc, a deviation is likely to occur between the actual reproduction position and the reproduction position that the acoustic system 50 grasps based on the reproduction position signal. . Therefore, when an event occurs in which the playback position changes irregularly, the second transmission control unit 115 may be configured to transmit a playback position signal representing the changed playback position at the time of the event occurrence.

  According to the example shown in the middle area (II) of FIG. 6, the second transmission control unit 115 transmits the reproduction position signal at each of times t0, t2, and t4 having a certain time interval 2Tc. Thereafter, when the playback position in the first transmission control unit 113 is changed due to the input of the reverse playback instruction, the second transmission control unit 115 operates as follows. That is, the second transmission control unit 115 operates so as to deviate from the periodical transmission operation of the reproduction position signal and transmit the reproduction position signal when the reproduction position is changed (time t10). Thereafter, the second transmission control unit 115 transmits the reproduction position signal at a constant time interval 2Tc based on the time t10 (that is, at each of the times t12, t14, and 16).

According to the example shown in the lower area (III) of FIG. 6, the second transmission control unit 115 transmits the reproduction position signal at each of the times t0 and t2 having a certain time interval 2Tc. Thereafter, when the playback position in the first transmission control unit 113 is changed due to the input of the skip playback instruction, the second transmission control unit 115 operates as follows. That is, the second transmission control unit 115 operates so as to deviate from the periodical transmission operation of the reproduction position signal and transmit the reproduction position signal when the reproduction position is changed (time t20). Thereafter, the second transmission control unit 115 transmits the reproduction position signal at regular time intervals 2Tc with the time t20 as a base point (for example, at the time t22).

  The reproduction position signal transmission period 2Tc shown in the middle area (II) and the lower area (III) of FIG. 6 is longer than the reproduction position signal transmission period Tc shown in the upper area (I). This is because if the second transmission control unit 115 is configured to transmit the playback position signal at the time of occurrence of an event in which the playback position changes discontinuously, the transmission position signal transmission cycle at the regular transmission is lengthened. Suggest to get. This is because a difference between the actual reproduction position and the reproduction position grasped by the acoustic system 50 hardly occurs even by trick play or the like.

  In response to the start instruction in S150 (see FIG. 5), the first transmission control unit 113 and the second transmission control unit 115 start the above-described processing, and this processing is performed until the reproduction of the music ends. When the reproduction of the music is started by the process of S150, the main control unit 111 proceeds to S160 and executes the lyrics display process to display the lyrics on the user interface 15 in accordance with the reproduction of the music.

  In the present embodiment, the acoustic system 50 transmits the lyrics data DL acquired from the server device 90 to the communication terminal 10 together with the acquisition completion notification. This lyrics data DL is received together with the notification signal in S130. The lyrics display process executed by the main control unit 111 in S160 is a process for displaying lyrics on the user interface 15 (liquid crystal display) based on the lyrics data DL. In the lyrics display process, the main control unit 111 acquires information on the reproduction position from the first transmission control unit 113, and controls the user interface 15 so that the character string of the lyrics corresponding to the reproduction position is displayed.

  Specifically, the main control unit 111 specifies the phrase of the lyrics corresponding to the reproduction position based on the phrase start time and the phrase end time for each phrase indicated by the lyrics data DL. Specifically, the phrase whose playback time (playback time) from the beginning of the music represented by the playback position is within the period from the phrase start time to the phrase end time is specified as the phrase corresponding to the playback position. Then, the main control unit 111 controls the user interface 15 so that the character string of the specified phrase indicated by the lyrics data DL is displayed on the liquid crystal display as a character image. The main control unit 111 continues this lyric display process until the reproduction of the music ends, and thereafter ends the lyric display process (S160) and the process shown in FIG.

  In addition, when the notification signal received from the acoustic system 50 is an acquisition failure notification (No in S140), the main control unit 111 proceeds to S170 and instructs the start of the music reproduction process, similar to S150. Thereafter, the process shown in FIG. When the acquisition failure notification is received, the acoustic system 50 does not have the lyrics data DL corresponding to the music data DM to be played back. In this case, the sound system 50 cannot display the lyrics on the display 55 in accordance with the reproduction of the music.

  In S170, in order to cause the sound system 50 to output the music from the speaker 53 without displaying the lyrics, the start instruction is not input to the second transmission control unit 115 but the start instruction is issued to the first transmission control unit 113. input.

  Next, details of functions realized by the control unit 51 of the acoustic system 50 will be described with reference to FIG. The control unit 51 of the acoustic system 50 functions as a data acquisition unit 511, a reproduction control unit 513, a display control unit 515, and a counter 517 by executing the program.

The data acquisition unit 511 acquires the lyrics data DL from the server device 90 in response to an operation command from the communication terminal 10. In order to acquire the lyric data DL, the data acquisition unit 511 displays the data shown in FIG.
Repeat the process shown in. When this process is started, the data acquisition unit 511 waits until the operation command and music data transmitted from the communication terminal 10 in S120 are received via the communication unit 57, and receives the operation command and music data (S210). Yes), the process proceeds to S220.

  In S220, the data acquisition unit 511 requests the server device 90 for the lyric data DL corresponding to the music data DM that the communication terminal 10 is to play back based on the music piece data received from the communication terminal 10. For example, the data acquisition unit 511 transmits a request signal including the song name indicated by the received song data to the server device 90 via the communication unit 57.

  When this request signal is transmitted, the response signal described above is transmitted from the server device 90. The data acquisition unit 511 receives the response signal from the server device 90 via the communication unit 57 (S230). Thereafter, it is determined whether or not the lyrics data DL is included in the response signal (S240).

  Here, if it is determined that the lyrics signal DL is included in the response signal (Yes in S240), the data acquisition unit 511 proceeds to S250, and the communication terminal 10 that is the operation command transmission source is communicated via the communication unit 57. Send an acquisition completion notification. The data acquisition unit 511 can transmit the lyrics completion data DL acquired from the server device 90 to the acquisition completion notification.

  On the other hand, when the lyrics data DL is not included in the response signal (No in S240), the data acquisition unit 511 proceeds to S260 and transmits the lyrics to the communication terminal 10 that is the operation command transmission source via the communication unit 57. An acquisition failure notification indicating that acquisition of the data DL has failed is transmitted. After the acquisition completion notification or acquisition failure notification is transmitted, the data acquisition unit 511 once terminates the processing illustrated in FIG.

  The reproduction control unit 513 receives the reproduction signal transmitted from the communication terminal 10 after transmitting the acquisition completion notification or the acquisition failure notification via the communication unit 57, and receives the sound based on the reproduction signal. Accordingly, the music is reproduced through the speaker 53 by causing the speaker 53 to output it in a chained manner. For example, the playback control unit 513 converts the received playback signal into an analog audio signal and inputs the analog audio signal to the speaker 53, thereby causing the speaker 53 to output a sound (sound) based on the playback signal. When using Airplay for stream playback of the music data DM, the playback control unit 513 can operate to sequentially convert playback signals transmitted in accordance with this standard into input signals to the speaker 53.

  On the other hand, the display control unit 515 receives the reproduction position signal transmitted from the communication terminal 10 after transmitting the acquisition completion notification via the communication unit 57, and based on the reproduction position signal and the lyrics data DL, The display 55 is controlled so that the character string of the lyrics corresponding to the output sound from the speaker 53 is displayed on the display 55.

  For example, the display control unit 515 can be configured to correct the time counted by the counter 517 to a time corresponding to the reproduction position represented by the received reproduction position signal. The counter 517 is reset to zero by the operation of the display control unit 515 based on the reproduction position signal transmitted from the communication terminal 10 when reproduction of music is started (time t0). The counter 517 counts the elapsed time thereafter.

The time counted by the counter 517 is corrected to the time corresponding to the reproduction position indicated by the reproduction position signal by the operation of the display control unit 515 every time the display control unit 515 receives the reproduction position signal. By this correction, the time counted by the counter 517 is corrected to a time that basically matches the playback time from the beginning of the music, and functions as a parameter that represents the playback position of the music that is not greatly affected by trick play.

  The display control unit 515 can be configured to display the character string of the lyrics corresponding to the output sound from the speaker 53 on the display 55 based on the time counted by the counter 517 and the lyrics data. This counter 517 is useful in that the display control unit 515 can specify the playback position of the sound output from the speaker 53 during the non-reception period of the playback position signal. Accordingly, the counter 517 functions particularly effectively when the reproduction position signal transmission interval is long. On the other hand, when the reproduction position signal transmission interval is short, the counter 517 may not be provided.

  The display control unit 515 corresponds to the reproduction position of the sound output from the speaker 53 based on the lyrics data DL acquired by the data acquisition unit 511 in the same manner as the lyrics display processing executed in S160 of the communication terminal 10. The display 55 can be controlled so that the character string of the lyrics is displayed on the display 55.

  By providing the playback position signal from the communication terminal 10 to the acoustic system 50, the music output from the speaker 53 on the user interface 15 and the display 55 is almost synchronized between the communication terminal 10 and the acoustic system 50. The character string of the lyrics corresponding to the playback section is displayed. Here, “substantially synchronized” is expressed because there is a possibility that a minute error occurs between the reproduction position grasped by the communication terminal 10 and the reproduction position grasped by the acoustic system 50 due to a time lag due to communication. Because.

  The music playback system 1 according to the present embodiment has been described above. According to the music playback system 1, music playback can be realized by the audio system 50 using the music data DM of the communication terminal 10. . In addition, the sound system 50 can output words (character strings) of lyrics corresponding to the output sound as an image in accordance with the output of a series of sounds (music) represented by the music data DM. Therefore, according to this music reproduction system 1, a new way of enjoying music can be provided to the user, and the user's enjoyment of listening to music can be increased.

  For example, the user can enjoy the music as a sound by using the acoustic system 50, and at the same time, can enjoy watching the lyrics. Further, the user can share music and lyrics with other users in the same space as the sound system 50. In other words, according to the acoustic system 50, some music providers want to enjoy the music with the lyrics, and some consumers desire to enjoy the music with the lyrics. I can answer enough.

  In the above-described embodiment, by providing the playback position signal from the communication terminal 10 to the sound system 50, the sound system 50 is adapted to the music playback while using the existing music data DM and the existing stream playback technology. It is also worth noting that the lyrics can be displayed.

  Moreover, in the said Example, the acoustic system 50 acquires the lyric data DL from the server apparatus 90, and provides this to the communication terminal 10. Based on the lyrics data DL received from the acoustic system 50, the communication terminal 10 causes the user interface 15 to display a lyrics character string corresponding to the output sound from the speaker 53. This lyric display is performed substantially synchronously between the acoustic system 50 and the communication terminal 10.

Therefore, the user can see the lyrics displayed by the acoustic system 50 and can also see the lyrics displayed by the communication terminal 10 at hand. Thus, the music reproduction system 1 of the present embodiment is very useful in that it provides an effect that allows the user to enjoy music comfortably.

[First modification]
Then, the 1st modification with respect to the said Example is demonstrated. As shown by a broken line in FIG. 1, the music reproduction system 1 of the first modified example has the lyrics system DL and the reproduction position when the acoustic system 50 is different from the communication terminal 10 </ b> A different from the communication instruction source 10. The signal is configured to be transmitted via the communication unit 57. In the following, regarding the configuration and operation of the music reproduction system 1 of the present modification, configurations and operations different from those of the above embodiment will be described, and description of the same configuration and operation will be omitted as appropriate.

  According to this modification, the data acquisition unit 511 is configured to transmit the lyrics data DL to the other communication terminal 10A in addition to the communication terminal 10 that is the operation command source in S250 (see FIG. 7). Examples of the other communication terminal 10 </ b> A include a communication terminal in the same local area network as the acoustic system 50 and a communication terminal capable of short-range communication with the acoustic system 50. In the present modification, the display control unit 515 is further configured to transmit the reproduction position signal received from the communication terminal 10 to the other communication terminal 10 </ b> A via the communication unit 57.

  According to the music playback system 1 configured as described above, the communication terminal 10 </ b> A can display lyrics on the built-in display in accordance with the music playback by the acoustic system 50, similarly to the communication terminal 10. For example, the communication terminal 10 </ b> A can display lyrics on a built-in display using the same method as the display control unit 515.

  If the lyrics can be displayed on the plurality of communication terminals 10 and 10A, the music and the lyrics can be shared among a plurality of users who own the communication terminals 10 and 10A, and the enjoyment of the music increases. As a further modification to this modification, the acoustic system 50 may be configured to provide the music piece data acquired from the communication terminal 10 to the communication terminal 10A instead of the lyrics data DL. In this case, the communication terminal 10A can be configured to acquire the lyrics data DL corresponding to the music data DM to be reproduced from the server device 90 based on the received music data.

[Second modification]
Then, the 2nd modification with respect to the said Example is demonstrated. As shown in FIG. 8, the music reproduction system 1 according to the second modification is configured such that the communication terminal 10 acquires the lyrics data DL from the server device 90. In the following, regarding the configuration and operation of the music reproduction system 1 of the present modification, configurations and operations different from those of the above embodiment will be described, and description of the same configuration and operation will be omitted as appropriate.

  In this modification, the control unit 11 of the communication terminal 10 functions as the main control unit 611 instead of the main control unit 111. The main control unit 611 refers to the metadata of the music data DM to be played back on condition that a playback instruction for one of the music data DM stored in the storage unit 13 is input from the user through the user interface 15. Then, the server device 90 is requested for the lyrics data DL corresponding to the music data DM.

For example, the main control unit 611 can transmit a request signal including a music title indicated by the metadata to the server device 90 via the communication unit 17. The communication unit 17 is configured to be capable of wide area communication. The main control unit 611 receives a response signal to the request signal from the server device 90, and transmits the lyrics data DL to the acoustic system 50 via the communication unit 17 when the response signal includes the lyrics data DL. After that, the same processing as S150 and S160 is executed. When the lyrics signal DL is not included in the response signal, the main control unit 611 performs the same process as in S170.

  As processing similar to S160, the main control unit 611 causes the user interface 15 to display a text string of lyrics corresponding to the output sound from the acoustic system 50 based on the lyrics data DL acquired from the server device 90 by itself. Processing can be executed.

  According to this modification, the control unit 51 of the acoustic system 50 functions as the data acquisition unit 711 instead of the data acquisition unit 511. The data acquisition unit 711 receives the lyrics data DL from the communication terminal 10 via the communication unit 57, and provides the lyrics data DL to the display control unit 515. According to this modification, the lyric data DL can be provided to the acoustic system 50 without configuring the acoustic system 50 to be capable of wide area communication.

[Other Embodiments]
The present invention can be further implemented in various modes. The above embodiment and the first and second modified examples deal with music data DM and lyric data DL. However, the technical idea corresponding to the present invention is in a video reproduction system that handles video data with audio and subtitle data. Can also be applied. In this case, the sound system may be configured to display a caption corresponding to the moving image while reproducing the moving image. As examples of subtitles, for example, a translated sentence and a commentary sentence of a moving image audio can be cited as an example.

  Referring to the above embodiment and the first and second modified examples, the lyrics data DL may be data for accurately displaying the lyrics that are reproduced by voice, or the lyrics that are reproduced by voice. It may be data for displaying lyrics in a different language. For example, the lyrics data DL can be configured so that English lyrics can be displayed for music sung in Japanese. Such a display form of the lyrics functions significantly when the original music corresponding to the music to be reproduced exists as a song in a different language.

  Further, in the above embodiment, the lyric data DL having a data structure in which the character string constituting the lyrics is divided for each phrase is exemplified, but the lyric data DL defines the correspondence between each part of the lyrics and the reproduction position It is sufficient if it has a data structure including the information to be performed, and the information structure is not limited to that illustrated. For example, the above-described line data of the lyric data DL does not have a character string divided for each phrase, but describes the start time (and end time) of the line and the character string of the line. May be.

  In addition, if it is assumed that there is no trick play in which the playback position changes irregularly, the playback position signal may not be used. That is, the acoustic system 50 measures the elapsed time from this time with the counter 517 with reference to the time when the output of the music based on the reproduction signal from the speaker 53 is started, and reproduces the measured elapsed time. It can be considered that the time corresponds to the position, and the lyric character string corresponding to the output sound can be displayed on the display 55.

  The acoustic system 50 can be configured to extract lyrics by analyzing a reproduction signal from the communication terminal 10 or an output sound from the speaker 53. In this case, the acoustic system 50 can display the lyrics extracted by the analysis. Therefore, the lyrics data DL may not be acquired from the server device 90.

Similarly, the acoustic system 50 can be configured to analyze the reproduction signal from the communication terminal 10 or the output sound from the speaker 53 to identify the music title. In this case, the acoustic system 50 can acquire the corresponding lyric data DL from the server device 90 without receiving the piece data from the communication terminal 10.

  The lyric display in the acoustic system 50 may be realized in such a form that a part of the lyric is highlighted. For example, in the lyrics data DL, a character string to be highlighted can be marked. Then, the sound system 50 can be configured to control the display 55 so as to highlight part of the lyrics according to the mark. Such highlighting can be performed on the part of the lyrics including the message that the music provider particularly wants to convey.

  The visual effect displayed on the display 55 of the sound system 50 may be changed according to an operation from the user through the user interface 15. For example, the communication terminal 10 may be configured to transmit an operation signal for a visual effect input through the user interface 15 to the acoustic system 50 via the communication unit 17.

  On the other hand, the acoustic system 50 can be configured to control the display 55 so as to change the visual effect based on the operation signal received from the communication terminal 10. For example, when the user of the communication terminal 10 performs a tapping operation on the user interface 15, the display 55 is displayed so that an animation as if the vibration when tapped is transmitted appears in the visual effect. Can be controlled. Such an animation can also be added to a character string image of lyrics.

A part or all of the functions realized on the control units 11 and 51 by the program may be realized by a dedicated hardware circuit.
In addition, the program for causing the control unit 11 to function as the main control unit 111, the first transmission control unit 113, and the second transmission control unit 115 can be recorded in any form of a computer-readable recording medium. For example, this program can be stored in a portable semiconductor memory, a magnetic disk, an optical disk or the like and provided to the user. The program may be provided or installed in the communication terminal 10 through a network.

  Furthermore, the communication between the communication terminal 10 and the sound system 50 can be realized using any communication technique within an appropriate range, and this communication is not limited to the illustrated Airplay or Bluetooth communication. It is not something. Of course, communication between the communication terminal 10 and the acoustic system 50 can be realized using a plurality of communication standards or a single communication standard. Communication may be performed according to different communication standards depending on the type of data and signals to be transmitted and received. Here, the communication between the communication terminal 10 and the acoustic system 50 has been described, but the same applies to the communication between the acoustic system 50 and the server device 90 and the communication between the communication terminal 10 and the server device 90. I can say that.

[Correspondence]
Finally, the correspondence between terms will be described. The speaker 53 and the display 55 correspond to an example of an output unit, and the user interface 15 corresponds to an example of a display unit. The reproduction control unit 513 corresponds to an example of a first output control unit, the display control unit 515 corresponds to an example of a second output control unit, and the data acquisition units 511 and 711 correspond to an example of an acquisition control unit. . In addition, the first transmission control unit 113 corresponds to an example of the first transmission control unit, the second transmission control unit 115 corresponds to an example of the second transmission control unit, and the main control units 111 and 611 are displayed. This corresponds to an example of a control unit.

DESCRIPTION OF SYMBOLS 1 ... Music reproduction system 10, 10A ... Communication terminal, 11 ... Control unit, 11A ... CPU, 11B ... Memory, 13 ... Storage unit, 15 ... User interface, 17 ... Communication unit, 50 ... Sound system, 51 ... Control unit , 51A ... CPU, 51B ... memory, 5
DESCRIPTION OF SYMBOLS 3 ... Speaker, 55 ... Display, 57 ... Communication unit, 90 ... Server apparatus, 91 ... Control unit, 95 ... Database, 111,611 ... Main control part, 113 ... First transmission control part, 115 ... Second transmission control part 511, 711 ... Data acquisition unit, 513 ... Playback control unit, 515 ... Display control unit, 517 ... Counter, DL ... Lyric data, DM ... Music data, NT ... Wide area network.

Claims (13)

An acoustic system,
An output unit capable of outputting sound and images;
A communication unit capable of communicating with an external device;
By receiving the reproduction signal via the communication unit from a communication device that transmits a reproduction signal of acoustic data, and outputting the sound based on the reproduction signal to the output unit in response to the reception, A first output control unit that realizes reproduction of a series of sounds represented by acoustic data ;
An acquisition control unit that acquires the image output data via the communication unit from a server device that holds image output data including a plurality of words corresponding to the series of sounds represented by the acoustic data;
Based on the image output data acquired by the acquisition control unit, a word corresponding to the sound output by the output unit in the series of sounds represented by the acoustic data is output to the output unit as the image. A dual output control unit;
Equipped with a,
The communication device outputs a reproduction position signal indicating a reproduction position in the acoustic data of the sound output based on the reproduction signal when at least a command to change the reproduction position is input to the communication device. Configured to send to the system,
The second output control unit receives the reproduction position signal from the communication device via the communication unit, and based on the reproduction position signal, a word corresponding to the sound output by the output unit is used as the image. The sound system is characterized by causing the output unit to output . The acoustic system includes:
With a counter that counts playback time,
The second output control unit corrects the reproduction time counted by the counter to a time corresponding to the reproduction position represented by the received reproduction position signal, and based on the reproduction time counted by the counter, The acoustic system according to claim 1, wherein words corresponding to sound output from the output unit are output to the output unit as the image. The acquisition control unit, the image output data acquired from the server apparatus, the communication apparatus, according to claim 1 or claim 2 sound system, wherein the transmission via the communication unit. The acquisition control unit receives identification data that can identify the image output data corresponding to the acoustic data from the communication device via the communication unit, and based on the received identification data, The acoustic system according to any one of claims 1 to 3, wherein the image output data corresponding to acoustic data is acquired from the server device. The image output data includes, for each of the plurality of words, information defining a correspondence relationship between a sound reproduction position and words in the acoustic data,
The second output control unit causes the output unit to output, as the image, a word corresponding to a reproduction position of a sound output from the output unit among the plurality of words based on information defining the correspondence relationship. claims 1 to sound system of any one of claims 4, characterized in that. The acoustic data is music data,
The image output data is lyrics data,
The second output control unit, based on the lyrics data corresponding to the music data, out of the music represented by the music data as the series of sounds, words of the lyrics corresponding to the portion output by the output unit, acoustic system according to one of claims 1 to 5, characterized in that to output to the output unit as the image. A communication device for communicating with the acoustic system according to any one of claims 1 to 6 ,
A storage unit for storing the acoustic data;
On the condition that an instruction to reproduce the acoustic data is input, the acoustic data is reproduced and a reproduction signal for causing the acoustic system to output a series of sounds represented by the acoustic data is transmitted to the acoustic system. A first transmission control unit that
At least when a command for changing the playback position in the playback process is input , a playback position signal representing a playback position in the acoustic data of the sound output based on the playback signal in the series of sounds A second transmission control unit for transmitting to the acoustic system;
A communication device comprising: A communication device for communicating with the acoustic system according to claim 3 ,
A display unit capable of outputting images;
A storage unit for storing the acoustic data;
On the condition that an instruction to reproduce the acoustic data is input, the acoustic data is reproduced and a reproduction signal for causing the acoustic system to output a series of sounds represented by the acoustic data is transmitted to the acoustic system. a first transmission control unit that,
At least when a command for changing the playback position in the playback process is input, a playback position signal representing a playback position in the acoustic data of the sound output based on the playback signal in the series of sounds A second transmission control unit for transmitting to the acoustic system;
The image output data corresponding to the acoustic data is received from the acoustic system, and the words corresponding to the sound output by the output unit of the acoustic system based on the received image output data are A display control unit that outputs to the display unit as
A communication device comprising: A communication device for communicating with the acoustic system according to claim 1 or claim 2 ,
A display unit capable of outputting images;
A storage unit for storing the acoustic data;
On the condition that an instruction to reproduce the acoustic data is input, the acoustic data is reproduced and a reproduction signal for causing the acoustic system to output a series of sounds represented by the acoustic data is transmitted to the acoustic system. a first transmission control unit that,
At least when a command for changing the playback position in the playback process is input, a playback position signal representing a playback position in the acoustic data of the sound output based on the playback signal in the series of sounds A second transmission control unit for transmitting to the acoustic system;
The acoustic data to obtain the image output data corresponding to, on the basis of the prior Symbol image output data, a word corresponding to the sound output by the output unit of the sound system, to the display unit as the image A display control unit to output,
A communication device comprising: The display control unit realizes synchronized image output for the words in the acoustic system and the communication device by causing the display unit to output words corresponding to the output sound according to the reproduction position. The communication device according to claim 8 or 9 , characterized in that: A computer of a communication device for communicating with the acoustic system according to any one of claims 1 to 6 ,
On the condition that an instruction to reproduce sound data is input, the sound data is reproduced, and a reproduction signal for causing the sound system to output a series of sounds represented by the sound data is transmitted to the sound system. A first transmission control procedure;
At least when a command for changing the playback position in the playback process is input , a playback position signal representing a playback position in the acoustic data of the sound output based on the playback signal in the series of sounds A second transmission control procedure for transmitting to the acoustic system;
A program for running   A computer of a communication device for communicating with the acoustic system according to claim 3,
  On the condition that an instruction to reproduce sound data is input, the sound data is reproduced, and a reproduction signal for causing the sound system to output a series of sounds represented by the sound data is transmitted to the sound system. A first transmission control procedure;
  At least when a command for changing the playback position in the playback process is input, a playback position signal representing a playback position in the acoustic data of the sound output based on the playback signal in the series of sounds A second transmission control procedure for transmitting to the acoustic system;
  The image output data corresponding to the acoustic data is received from the acoustic system, and the words corresponding to the sound output by the output unit of the acoustic system based on the received image output data, the communication A display control procedure for outputting as an image to the display unit of the device;
  A program for running   A computer of a communication device for communicating with the acoustic system according to claim 1 or 2,
  On the condition that an instruction to reproduce the acoustic data is input, the acoustic data is reproduced and a reproduction signal for causing the acoustic system to output a series of sounds represented by the acoustic data is transmitted to the acoustic system. A first transmission control procedure to
  At least when a command for changing the playback position in the playback process is input, a playback position signal representing a playback position in the acoustic data of the sound output based on the playback signal in the series of sounds A second transmission control procedure for transmitting to the acoustic system;
  The image output data corresponding to the acoustic data is acquired, and words corresponding to sounds output by the output unit of the acoustic system are displayed on the display unit of the communication device based on the image output data. Display control procedure to output as
  A program for running

Images