JP3918008B1 - Conversion processing method, conversion processing apparatus, computer program, and distribution system - Google Patents

Abstract

The present invention provides a conversion processing method capable of displaying optimum character data according to the model of a portable terminal and performing fine color change processing.
Position information, size information, and time information for color change from a display information database that stores display information including position information, size information, and time information for color change associated with character data. Is read. The position information of the read character data is converted based on the reduction ratio corresponding to the model of the portable terminal. The size information of the read character data is converted based on the reduction ratio. Based on the time information of the read character data and the size information of the converted character data, the color change speed of the converted character data is calculated.
[Selection] Figure 9

Description

  The present invention relates to a conversion processing method for converting display information related to character data displayed with discoloration in accordance with music data in accordance with the model characteristics of the mobile terminal, a conversion processing device used in the method, and a computer to perform conversion processing. The present invention relates to a computer program and a distribution system for functioning as a device.

  In recent years, music and character data displayed with discoloration in accordance with music are downloaded to a mobile terminal such as a mobile phone, and music is played and character data is displayed on the mobile terminal, and singing along with it. Karaoke for portable terminals is widespread. The user can easily enjoy karaoke without having to go to the store where the karaoke system is installed by appropriately downloading a favorite song to the portable terminal. The portable terminal executes the installed software and reproduces music and displays character data while synchronizing music and character data.

  In karaoke, it is necessary to display character data on the display unit of a portable terminal and to change the color of characters in accordance with music in order to assist the timing of singing by the user. FIG. 18 is an explanatory diagram showing an image of a conventional color change process. A server computer that distributes karaoke data transmits display information indicating music data, text data that is lyrics, timing for displaying text data, timing for changing text data, and the like to the mobile terminal. The portable terminal reads the font of the portable terminal and displays character data on the display unit in accordance with the music data. In addition, the mobile terminal performs a color change process on the character data at an appropriate timing.

FIG. 18 shows an example in which the font of the mobile terminal that reads “In my heart ...” is read and displayed in synchronization with the music data. Then, processing for changing the character of “heart” in accordance with the timing at which the user sings “heart” is performed. Similarly, the color change process of “NO” is performed next, for example, 0.2 seconds after the color change of “heart”. By repeating the display of the character data and the color changing process, the karaoke service can be provided to the user even in the portable terminal.
JP 2003-152992 A

  However, the discoloration process in the conventional portable terminal has a problem in performance of the portable terminal or a problem that the character can be discolored only by one character because there is no discoloration instruction technology. there were. That is, depending on the song, there are various patterns even with a single character. In the example of FIG. 18, “Kokoro (heart)” is uttered, but “Kokoro” may be uttered or “Kokoro” may be uttered. However, the conventional discoloration process only changes the color of the “heart” character, for example, from white to red at a predetermined timing in a single character font unit, and there is a problem that it is difficult for the user to speak at a precise timing. It was.

  In addition, a distributor who distributes music data needs to create a timing for changing the color for each music data, which is a heavy burden. That is, every time a new song is released, it is necessary to sequentially edit the timing of discoloration of the character data displayed in accordance with the music data for the portable terminal, and this burden is excessive.

  Various types of mobile terminal devices are provided by each manufacturer, and it is necessary to provide optimal display information according to the size of the display area of the display unit of each mobile terminal device.

  Further, since the distributed character data has been conventionally displayed using a font provided in the mobile terminal, there is a problem that ruby having a size different from the font cannot be displayed. There was also a growing demand for ruby to be added to karaoke provided on mobile terminals with many difficult characters depending on the lyrics.

  Further, there is a proportional font including characters whose width is set narrower than that of a normal character. If proportional fonts are included in the displayed character data, there is a problem that the proportional fonts cannot be processed in the mobile terminal, which is also a factor that makes it difficult to build a karaoke system in the mobile terminal. It was.

  The present invention has been made in view of such circumstances, and its purpose is to reduce and convert position information and size information of character data as display information in order to display character data as image data in a portable terminal. Further, by calculating the color change speed for each model, a conversion processing method capable of displaying optimal character data and fine color change processing according to the model of the portable terminal, a conversion processing device used in the method, and a computer conversion The object is to provide a computer program and a distribution system for functioning as a processing device.

  Another object of the present invention is to perform conversion processing capable of displaying ruby in an optimum size according to the model in a portable terminal by reducing and converting ruby attached to character data into image data. It is to provide a device or the like.

  Another object of the present invention is to display character data at an optimum position even in a portable terminal by performing an appropriate correction process when the character data includes a proportional font. It is to provide a conversion processing device and the like.

According to the conversion processing method of the present invention, display information related to character data displayed with discoloration according to music data is connected to the portable terminal via a communication network according to the model characteristics of the portable terminal. in the conversion processing method for converting by the conversion processing unit, position information of character data in association to the character data, from the display information database storing display information including the time information when the size information and discoloration, position information, size information And a step of reading out time information when changing color by the control unit, and a step of reading out the reduction rate of the portable terminal to be converted by the control unit from the specification database storing the reduction rate in association with the model of the mobile terminal. A position information conversion step for converting the position information of the read character data by the control unit based on the read reduction rate; A size conversion step for converting the read size information by the control unit based on the reduction ratio, and a color change rate of the character data after conversion based on the read time information and the size information converted by the size conversion step. A speed calculation step calculated by the control unit, and a step of transmitting the calculated color change speed of the converted character data to a portable terminal that performs a color change process according to the color change speed calculated in the speed calculation step. It is characterized by.

A conversion processing apparatus according to the present invention converts display information relating to character data displayed with discoloration in accordance with music data according to the model characteristics of a portable terminal connected via a communication network. read in, the position information of the character data in association to the character data, from the display information database storing display information including the time information when the size information and discoloration, the position information, the time information at the time of size information and discoloration Means for reading out the reduction ratio of the portable terminal to be converted by the control unit from the specification database storing the reduction ratio in association with the model of the portable terminal, and reading out the position information of the read character data Position information conversion means for converting based on the reduction ratio, size conversion means for converting the read size information based on the reduction ratio, and Based on the size information converted by looking out the time information and the size conversion unit, and a speed calculation means for calculating a color change rate of the character data after the conversion, the color change rate of the character data after conversion to the calculated, the rate Means for transmitting to a portable terminal for performing a color change process according to the color change speed calculated by the calculation means .

  The conversion processing apparatus according to the present invention includes the position information converted by the position information conversion unit, the size information converted by the size conversion unit, and the discoloration speed calculated by the speed calculation unit for each model of the portable terminal. The apparatus further comprises means for storing in the model database.

  The conversion processing apparatus according to the present invention further comprises means for converting ruby attached to character data into image data, and ruby conversion means for converting converted ruby image data based on the reduction ratio. To do.

  In the conversion processing device according to the present invention, when the size conversion unit is smaller than the size information of the other character data listed together with the one character data, the size conversion unit Based on the size information of the character data and the reduction ratio, the size information of the one character data is converted, and the specification database stores the reduction ratio and the display area in association with the model of the mobile terminal. When the position information converted by the position information conversion means exceeds the display area of the portable terminal stored in the specification database, the display area is The apparatus further comprises means for correcting the converted position information so as not to exceed.

  In the conversion processing device according to the present invention, the speed calculation means divides the size information converted by the size conversion means by the time information read from the display information database, thereby changing the color change speed of the character data after conversion. It is characterized by calculating.

A computer program according to the present invention is for causing a computer to convert display information relating to character data displayed with discoloration in accordance with music data in accordance with the model characteristics of a mobile terminal connected via a communication network . in the computer program, the computer, the position information of the character data in association to the character data, from the display information database storing display information including the time information when the size information and discoloration, position information, size information and the time of color change a step to leave the time information read by the control unit, the steps to read out from the specification database that stores the reduction ratio in association with the type of portable terminal, the reduction rate of the mobile terminal to be converted by the control unit If, converted by the control unit on the basis of the position information on the reduction rate and read out the previous SL-read out character data A position information converting step that, before SL and size conversion step that converts by the control unit on the basis of the read out the size information to the reduction ratio, was converted by the pre-Symbol read out the time information and the size conversion step based on the size information, color change and the speed calculation step discoloration rate of character data after conversion you calculated by the control unit, the color change rate of the character data after conversion the calculated according discoloration speed calculated by the speed calculating step characterized in that and a step of transmitting to the mobile terminal to perform processing.

The distribution system according to the present invention is a distribution system including any one of the conversion processing device described above and a portable terminal connected to the conversion processing device via a communication network. Further comprising: transmission means for transmitting display information including character data corresponding to data, position information converted by the position information conversion means, and discoloration speed calculated by the speed calculation means to the mobile terminal; includes means for converting text data, position information of character data, and a receiving unit that receives the display information including color change speed, character data thus received to the image data corresponding to the music data to which the transmitted, the Character display means for displaying image data based on the converted character data on a display unit according to the received position information along with reproduction of music data According discoloration rate the received, characterized in that it comprises a color change means that changes color image data based on the displayed character data.

The distribution system according to the present invention is a distribution system including the above-described conversion processing device and a portable terminal connected to the conversion processing device via a communication network, wherein the conversion processing device includes character data corresponding to music data, Transmission means for transmitting display information including position information converted by the position information conversion means, a discoloration speed calculated by the speed calculation means, and ruby image data converted by the ruby conversion means to the mobile terminal. the mobile terminal, character data corresponding to the music data to which the transmitted positional information of character data, a receiving unit that receives the display information including the image data of the color change rate and ruby, the character data thus received Means for converting to image data, and the image data based on the converted character data is transmitted as the music data is reproduced. Character display means for displaying on the display unit together with ruby image data corresponding to the character data according to the position information, and color changing means for changing the color of the image data based on the displayed character data according to the transmitted color change speed. It is characterized by that.

In the present invention, first location information of the character data in association to the character data, from the display information database storing display information including the time information when the size information and discoloration, position information, size information and discolor Time information is read. Further, the control unit reads out the reduction rate of the mobile terminal to be converted from the specification database in which the reduction rate is stored in association with the model of the mobile terminal. Since the display area varies depending on the model of the portable terminal, the position information of the read character data is converted based on the reduction ratio corresponding to the model of the portable terminal. Similarly, the size information of the read character data is converted based on the reduction ratio. Based on the time information of the read character data and the size information of the converted character data, the color change speed of the converted character data is calculated. Specifically, the color change speed of the converted character data is calculated by dividing the converted size information by the time information read from the display information database.

  That is, by converting the position information and the size information of the character data according to the reduction rate for each model, it is possible to display the character data with an appropriate size at an appropriate position. In addition, the reduction rate was used in the conversion processing of the position information and the size information. Unlike these, the discoloration speed is different for each model based on the time information when the character data is discolored and the size information of the converted character data. The color change speed is converted to the color change speed, so the color change process can be performed at a precise timing compared to the process of simply multiplying the color change speed before conversion by the reduction ratio, and the user can enjoy karaoke in a better environment. Is possible. In addition, since the conversion processing device can convert the position information etc. and calculate the discoloration speed using the display information database, the discoloration timing of the character data is manually set every time a new song is released as in the past. No input process is required.

  Further, in the present invention, since the position information converted for each model of the portable terminal, the converted size information, and the calculated color change speed are stored in the model-specific database, after the conversion process is finished When there is a distribution request from the portable terminal, it is possible to read and provide the character data and display information corresponding to the music data with reference to this model-specific database.

  In the present invention, the ruby attached to the character data is converted into image data so that the ruby is displayed together with the character data of the portable terminal. Since the converted ruby image data is converted based on the reduction ratio, the ruby attached to the character data is reduced as image data at the same reduction ratio as the character data according to the reduction ratio for each model. As a result, even if the ruby font does not exist in the portable terminal, it is possible to display ruby accompanying the character data as image data.

  In the present invention, when the size information of one read character data is smaller than the size information of other character data listed together with the one character data, that is, the size information in the proportional font is smaller in the character string. When the set character is included, the size information of one character data is converted based on the size information and the reduction ratio of the other character data. That is, since there is no proportional font in the portable terminal, it is reduced and converted according to the size information of other character data.

  One character data and other character data listed are included, that is, the character data includes characters for which size information in the proportional font is set to a small size, and the position information of the converted character data If the display area exceeds the display area of the mobile terminal, the converted position information is corrected so as not to exceed the display area. In other words, before conversion, the character string was compressed and displayed with the proportional font, but if the character with the size information set to a small size is included in the proportional font, the reduction processing is performed based on the size of the other character data. Therefore, the size information of the character data is inevitably larger than when the reduction process is performed in consideration of the character size in which the size information in the proportional font is set to be small. As a result, the display area of the mobile terminal may be exceeded. In the present invention, when the display area is exceeded, correction is performed by moving the converted position information so that the display area is not exceeded. Therefore, the character data cannot be displayed on the display unit of the portable terminal by the conversion process. It is possible to avoid this situation.

Moreover, in this invention, the delivery system which consists of the conversion processing apparatus mentioned above and the portable terminal connected to this via the communication network is constructed | assembled. The conversion processing device transmits display data including character data corresponding to the music data, the converted position information, and the calculated discoloration speed to the portable terminal. Mobile terminal, character data corresponding to the music data transmitted, receives the position information of the character data, and the display information including color change speed. The portable terminal converts the received character data into image data. That is, the font of the portable terminal is read from the character data, converted into image data, and the image data is reduced or enlarged according to the position information.

  As the music data is reproduced, the image data based on the converted character data is displayed on the display unit according to the received position information. Furthermore, in order to assist the user's singing, the image data based on the displayed character data is discolored according to the received discoloration speed. That is, based on the position information, conversion processing corresponding to the model is realized, and character data is converted into image data. Since this image data is configured to change color according to the calculated color change rate, the character data is not changed in units of characters as in the past, and color change in units of dots can be executed at an optimum speed. This makes it possible to enjoy karaoke in an optimal environment. In addition, since position information, size information, and a color change speed are prepared according to the model, it is possible to easily cope with a distribution request from a different model.

Also, in the present invention, the conversion processing device sends display information including converted ruby image data to the portable terminal in addition to the character data corresponding to the music data, the converted position information, and the calculated discoloration speed. Send. Mobile terminal, character data corresponding to the transmitted music data, position information of character data, in addition to the color change speed, also receives display information including the image data of the ruby. The portable terminal converts the received character data into image data. As the music data is reproduced, the portable terminal displays image data based on the converted character data on the display unit along with the ruby image data corresponding to the character data according to the transmitted position information. That is, the character data is converted into image data according to predetermined size information, and the ruby image data is displayed together with the image data related to the character data. Thereby, the ruby display can be provided, and the user can enjoy karaoke in a better environment even in the portable terminal.

  Furthermore, since the image data based on the displayed character data is discolored according to the transmitted discoloration speed, the image data related to the character data can be discolored more finely in dot units.

  In the present invention, by converting the position information and size information of character data according to the reduction ratio for each model, it is possible to display character data in an appropriate size at an appropriate position. In addition, the reduction rate was used in the conversion processing of the position information and the size information. Unlike these, the discoloration speed is different for each model based on the time information when the character data is discolored and the size information of the converted character data. The color change speed is converted to the color change speed, so the color change process can be performed at a precise timing compared to the process of simply multiplying the color change speed before conversion by the reduction ratio, and the user can enjoy karaoke in a better environment. Is possible. Further, according to the present invention, since the conversion processing device can convert the position information and the color change speed using the display information database, each time a new song is released as in the prior art, the character data is manually updated. A process for inputting the color change timing is not required, and the manufacturing cost and burden can be greatly reduced.

  Further, in the present invention, since the position information converted for each model of the portable terminal, the converted size information, and the calculated color change speed are stored in the model-specific database, after the conversion process is finished When there is a distribution request from the portable terminal, it is possible to read and provide the character data and display information corresponding to the music data with reference to this model-specific database.

  Further, in the present invention, in order to display the ruby on the character data of the portable terminal, the ruby attached to the character data is converted into image data, and the converted ruby image data is converted based on the reduction ratio. Therefore, even if the ruby font does not exist in the portable terminal, it is possible to display the ruby along with the character data as the image data. In addition, even when difficult kanji characters exist, the user can easily utter.

  Further, in the present invention, when one character data is included in other character data listed, and the position information of the converted character data exceeds the display region of the mobile terminal, the display region Therefore, it is possible to avoid a situation in which character data cannot be displayed on the display unit of the portable terminal device by the conversion process.

  In the present invention, conversion processing corresponding to the model is realized based on the size information and the position information, and the character data is converted into image data. Since this image data is configured to change color according to the calculated color change rate, the character data is not changed in units of characters as in the past, and color change in units of dots can be executed at an optimum speed. This makes it possible to enjoy karaoke in an optimal environment. In addition, since position information, size information, and a color change speed are prepared according to the model, it is possible to easily cope with a distribution request from a different model.

  In the present invention, the character data is converted into image data according to the predetermined size information, and the ruby image data is displayed together with the image data related to the character data. In addition, a ruby display can be provided, and the user can enjoy karaoke in a better environment even in a portable terminal. Further, since the image data based on the displayed character data is discolored according to the transmitted discoloration speed, the present invention has an excellent effect such that the image data related to the character data can be discolored more finely in dot units. Play.

Embodiment 1
FIG. 1 is a schematic diagram showing an outline of a distribution system according to the present invention. S is a distribution system according to the present invention, and includes a conversion processing device 1 for converting character data displayed in accordance with music data, a communication network N including the Internet and a mobile phone network, and a plurality of mobile phones of different models. It includes terminals 2, 2, 2. For example, a server computer is used as the conversion processing apparatus 1. In the following description, it is assumed that the conversion processing apparatus 1 is the server computer 1. The portable terminal 2 is, for example, a mobile phone, a PDA (Personal Digital Assistance), a portable audio player or a portable game machine having a display unit, and has a display screen smaller than a monitor installed in a general karaoke store. It is a portable portable terminal. In the present embodiment, the mobile terminal 2 will be described as the mobile phone 2. The mobile phones 2, 2, 2... Are different types of mobile phones 2 having different display areas.

  The server computer 1 sequentially stores karaoke data to be distributed. The karaoke data includes music data and display information such as character data displayed in accordance with the music data. The karaoke data is created each time a new song is released. Since the screen of the mobile phone 2 is smaller than the display screen of a general karaoke store, the server computer 1 performs display information conversion processing such as character data for each model. When there is a distribution request from the mobile phone 2 via the communication network N, display information converted according to the model is distributed to the mobile phone 2 in addition to the music data. The mobile phone 2 reproduces music data and displays character data and the like on the screen according to a reproduction program 256 (see FIG. 3) downloaded in advance.

  FIG. 2 is a block diagram showing a hardware configuration of the server computer 1. The server computer 1 includes a CPU (Central Processing Unit) 11, a RAM (Random Access Memory) 12, an input unit 13, a display unit 14, a communication unit 16, and a storage unit 15 as control units. The CPU 11 is connected to each hardware unit of the server computer 1 via the bus 17 and controls them, and executes various software functions according to a control program stored in the storage unit 15. The control program is described in a programming language such as C language.

  The display unit 14 is, for example, a liquid crystal display, and the input unit 13 includes a keyboard and a mouse. The communication unit 16 is a modem or a LAN card, and sends display information such as music data and converted character data to the mobile phone 2 via the communication network N in accordance with instructions from the CPU 11. The storage unit 15 is configured by, for example, a hard disk, and stores therein the control program, the display information database 151, the model database 152, and the specification database 153 described above. Details of the display information database 151, the model database 152, and the specification database 153 will be described later.

  FIG. 3 is a block diagram showing a hardware configuration of the mobile phone 2. The cellular phone 2 includes a CPU 21, a RAM 22, an input unit 23, a display unit 24, a clock unit 210, a communication unit 26, a microphone 28, a speaker 29, and a storage unit 25 as control units. The CPU 21 is connected to the hardware units of the mobile phone 2 via the bus 27, controls them, and executes various software functions according to the control program stored in the storage unit 25. The control program is described in a programming language such as C language.

  The display unit 24 is, for example, a liquid crystal display, and the input unit 23 is configured by a push button or the like. In addition, you may make it comprise the display part 24 and the input part 23 integrally like a touchscreen. The speaker 29 amplifies and outputs music data, call data, or an audio signal related to audio input from the microphone 28. The microphone 28 converts an audio signal input from the outside into an electric signal. The converted electrical signal is converted into digital data by an A / D converter (not shown) and output to the CPU 21. The communication unit 26 includes a high-frequency transmission / reception unit, an antenna, and the like, and transmits / receives various data including music data, character data, and the like.

  The storage unit 25 stores a music file 252, a display information file 251, an image data file 253, a specification file 254, a font file 255, a reproduction program 256, and the like. The music file 252 stores music data distributed from the server computer 1, and the display information file 251 includes character data displayed together with the music data, the display position of the character data, the discoloration speed of the character data, and the like. It is remembered. The reproduction program 256 is software downloaded from the server computer 1 or the like via the communication network N, and a program for realizing a karaoke function on the mobile phone 2 is described.

  In the specification file 254, information related to a model such as a MAC (Media Access Control) address provided in the mobile phone 2 is stored in advance. The font file 255 stores fonts of characters that the mobile phone 2 displays on the display unit 24. The image data file 253 stores image data obtained by converting character data transmitted from the server computer 1 as an image using a GIF (Graphic Interchange Format), JPEG (Joint Photographic Experts Group), or bitmap format. The CPU 21 executes the reproduction program 256 to read music data from the music file 252 and display information including character data from the display information file 251.

  The CPU 21 refers to the read character data and refers to the font file 255 to store the corresponding font in the read RAM 22. Then, the CPU 21 converts the font related to the read character data into image data. The image data related to the character data converted by the GIF format or the like is stored in the image data file 253. When a signal to start karaoke is input from the input unit 23, the CPU 21 refers to the time signal from the clock unit 210, and synchronizes with the reproduction of the music data, and relates to the character data according to the read display information. Display image data. Further, the CPU 21 performs color change processing of the image data according to the display information stored in the display information file 251 to assist the user's singing. As described above, the lyrics are displayed on the display unit 24 as the character data read from the font file 255, and the lyrics are displayed as image data instead of being discolored in units of characters. Do it in units.

  FIG. 4 is an explanatory diagram showing a record layout of the specification database 153 of the server computer 1. The server computer 1 determines the model by referring to the MAC address or model name transmitted from the cellular phone 2. The specification database 153 of the server computer 1 stores a display area and a reduction ratio in association with the model name. As shown in FIG. 4, model names for specifying the models of the mobile phones 2, 2, 2... Are stored in the model name field as “A601”, “A602”, and “B881”. In the display area field, the display area of the display unit 24 of each mobile phone 2 is stored in each of the vertical direction and the horizontal direction. For example, for the model name “A601”, the vertical area of the display unit 24 is stored as 240 dots, and the horizontal area is stored as 240 dots.

  In the reduction ratio field, the display area reduction ratio of the display unit 24 of each mobile phone 2 with respect to a display area (for example, 400 dots long and 640 dots wide) defined for a monitor of a general karaoke store is stored. That is, a value obtained by dividing the display area of the display unit 24 of the mobile phone 2 by the specified display area and multiplied by 100 is stored. For example, for the model name “A602”, the vertical reduction ratio is 86% and the horizontal reduction ratio is 38%. In addition, the display area prescribed | regulated for the monitor of a general karaoke store is not restricted to 400 dots long and 640 dots wide, The display area is prescribed | regulated suitably according to a condition. The model name, display area, and reduction ratio information may be obtained from another computer (not shown) connected via the communication network N, or the operator can input the model name and display area from the input unit 13. Information may be input and the reduction ratio calculated by the CPU 11 may be stored.

  FIG. 5 is an explanatory diagram showing a record layout of the display information database 151. The content stored in the display information database 151 stores display information such as character data used for monitoring a karaoke store, for example. The display information database 151 stores, for each music data, display information such as character data, position information, size information, and color change speed displayed in synchronization with the music data. As shown in FIG. 5, “Mr. Bear in the Forest”, “Will”, “Spring Come” and the like are stored as audio data. In the example of FIG. 5, the display information including the character data of the music data “Mori no Mori” and the position information of each character data is shown. The music data is stored, for example, in the midi (Musical Instruments Digital Interface) format.

  The display information database 151 includes a display timing field, a synchronization timing field, a character data field, a position information field, a size information field, a time information field for color change, a color change speed field, and a ruby position information field in association with each music data. Consists of including. In the character data field, lyrics are stored in predetermined block units. In the example of FIG. 5, “one day”, “in the forest”, “to Kuma-san”, and “I met” are stored. In this embodiment, character data is processed in units of blocks such as “a certain day” for easy explanation, but may be processed in units of “a”, “ru”, and “day”. Of course.

  The display timing field stores the display start time of the character data group to be displayed. In the example of FIG. 5, the character data groups “one day”, “in the woods”, “to the bear”, and “I met” are displayed after “0 min. In “0 minute 20 seconds 55”, these characters are deleted and the next character data group (phrase) is displayed. The synchronization timing field stores the synchronization timing for starting the color change of the character in association with the music data in association with the character data. For example, in the example of FIG. 5, the character data group “one day”, “in the forest”, “to the bear”, and “I met” are white after “0 min. At the time of “0 minute 10 seconds 00” two seconds later, a process of changing the character of “a certain day” to red or the like is started.

  In the position information field, position information indicating a position when character data is displayed on the monitor is stored. For example, for character data “a certain day”, the character data is displayed with (90, 250) as the start point and end point (218, 202) in the (x, y) coordinate system. FIG. 6 is an explanatory diagram showing a display example of character data. In the example of FIG. 6, the display area of the monitor of the karaoke store is 400 dots long and 640 dots wide. The horizontal direction is the x axis, the vertical direction is the y axis, the coordinates of the left corner are (x, y) = (0, 0), and the unit is a dot. For character data “one day”, (90,250) is displayed as the start point and (218,202) is displayed as the end point, and for “in the forest”, (230,250) is displayed as the start point and (374,202) is displayed. As for the end point, (160,150) for “Kumasan ni”, (384,102) as the end point, and “Meeting” as (450,150) as the start point, (626,102) Each character data is displayed as the end point. Note that the upper left coordinate point of the character data is the start point, and the lower right coordinate point is the end point.

  The size information field stores the display size of each character data. The unit is a dot. For example, for “in the forest”, 3 characters are displayed in a 48-dot size. The character data “Kumasanni” “ku” is stored as a horizontal 32 dot size, and the other characters “masanni” are stored as horizontal 48 dots. The vertical size is 48 dots. This “ku” is a character whose width is set smaller in the proportional font, and size information whose width is smaller than that of other character data is set. In the proportional font, the character set to have a small horizontal width corresponds to the letter “i”, the lowercase letter “tsu”, and the English letter “i”. For the character data “Met” that includes the character “” whose width is set to be small in the proportional font, the size information in the horizontal direction is stored as “48, 48, 32, 48”.

  In the time information field at the time of color change, the time required to change the color of each character data is stored. This is because some characters utter slowly when singing, while others utter quickly. For example, for “Kumasan”, discoloration of “ku” takes 0.9 seconds from the start of discoloration. After finishing discoloration for "ma" in 0.8 seconds from the start of discoloration, for "sa", discoloration in 0.8 seconds from the start of discoloration, and for "n" in 1.2 seconds from the start of discoloration, About “Ni”, the color change is completed in 1.2 seconds from the start of the color change.

  In the color change rate field, the color change rate per unit time is stored in units (dot / 0.1 sec) for each character data. For example, for character data “Kumasan ni”, the color change rate of “ku” is 4 dots per 0.1 second, the color change rate of “ma” is 6 dots per 0.1 second, and the color change rate of “sa” is 0. . 6 dots per second, “n” discoloration rate of 4 dots per 0.1 second, and “ni” discoloration rate of 4 dots per 0.1 second are stored.

  In the ruby position information field, ruby position information corresponding to each character data is stored. The unit is a dot. Although not shown, the display information database 151 stores music data, character data corresponding to the music data, and ruby corresponding to each character data. For example, in “in the forest”, the ruby “mori” is displayed in the “forest” starting from the upper “0” dot in the “forest”. That is, where “forest” is the position coordinate (230, 250), the ruby is a value obtained by adding 0 to the x coordinate 230, the x coordinate 230 is the starting point, and the ruby “forest” does not overlap with “forest” as appropriate. Ruby is added as the y-coordinate position, for example, y-coordinate 270 (x, y: 230, 270). In addition, ruby “Naka” is also added to “middle” at a position (326, 270) where the x coordinate “96” is added as viewed from the character data “Forest”.

  The ruby position information is “5”, etc., and the position coordinates (230, 250) of “forest”. The ruby is a value obtained by adding 5 to the x coordinate 230, and the x coordinate 235 is the starting point. The ruby may be added as an appropriate y coordinate position where the ruby “forest” does not overlap, for example, the y coordinate 270 (x, y: 235, 270). These ruby start position coordinates are determined by the CPU 11 with reference to the ruby position information and the ruby size. The ruby position information “none” means that no ruby exists. That is, there is no ruby for “no” in the forest.

  FIG. 7 is an explanatory diagram showing a record layout of the model-specific database 152. In the model-specific database 152, display information including character data, position information, and the like is stored in association with each music data for each model. The CPU 11 of the server computer 1 refers to the display information stored in the display information database 151 with reference to the model name, display area, and reduction ratio stored in the model-specific database 152 and performs display information conversion processing to convert the converted data. Is stored in the model database 152. The conversion process executed by the CPU 11 and the stored contents of the model database 152 will be described below.

  The model-specific database 152 stores display information including character data and position information of each music data for each model. The example of FIG. 7 shows that the display information of each music data for the model “A601” is stored. The CPU 11 performs conversion processing for each model “A601”, “A602”, “B881”..., And stores the display information after conversion in the model database 152. Note that the models stored in the model-specific database 152 may be shared between models that have different models but have common specifications such as a display area. For example, for a model having the same display area as the model “A601”, the conversion process may be performed using the storage contents common to the model “A601”. In the example of FIG. 7, the display information including the character data of the music data “Mr. Mori no Kuma” and the position information of each character data is shown as in the example of FIG.

  The model-specific database 152 is associated with each music data, and includes a display timing field, a synchronization timing field, a character data field, a position information field, a size information field, a color information time information field, a color change speed field, and a correction amount field. It is comprised including. The configuration of the display timing field, the synchronization timing field, and the character data field is the same as that of the display information database 151 described with reference to FIG. Information stored in the display timing field, the synchronization timing field, and the character data field is read from the display information database 151 by the CPU 11 of the server computer 1 and written into the model database 152.

  In the position information field, coordinates indicating a start point and an end point when character data is displayed on the display unit 24 of the mobile phone 2 are stored. In this position information conversion processing, the CPU 11 of the server computer 1 performs processing such as storage and retrieval of necessary information by interacting using SQL (Structured Query Language) in a schema in which the key of each database field is associated. Execute. The CPU 11 of the server computer 1 searches the specification database 153 based on the model name “A601” and reads the reduction ratio “60% vertical, 38% horizontal”. Further, the CPU 11 reads the position information stored in the position information field of the display information database 151. Then, the converted position information is calculated by multiplying the read position information by the reduction ratio. The CPU 11 stores the converted position information in the position information field of the model-specific database 152 in association with the character data.

  For example, for “inside the forest”, the start point (230, 250) and end point (374, 202) of the position information are stored. The start point of the converted position information is multiplied by 0.38 and 0.6, respectively. (87,150) and end point (142,121) are obtained. Note that the end point calculation process when the character data group includes characters whose size information in the proportional font is set to be small will be described later. FIG. 8 is an explanatory diagram showing a display image of character data displayed on the display unit 24 of the mobile phone 2. The CPU 21 of the mobile phone 2 refers to the font file 255, reads the character data “in the forest”, converts it into image data, and stores it in the image data file 253. Then, the CPU 21 performs image processing for reduction or enlargement so that the converted image data falls within the position information start point (87, 150) and end point (142, 121), and the position information start point (87, 150) is used as a reference. Then, the image data “Forest in forest” after image processing is displayed on the display unit 24. Similarly, “one day” is displayed with (34,150), and “Kumasan ni” is displayed with (61,90) as the starting point. In this embodiment, a plurality of characters are processed as a single block. However, position information is stored in units of one character, and this is converted character by character to obtain start point position information of each character at the start point. You may make it ask.

  The CPU 11 of the server computer 1 reads the size information stored in the display information database 151. Then, the CPU 11 calculates the converted size information by multiplying the read size information by the reduction ratio. For example, for character data “one day”, the character width in the x-axis and y-axis directions is “48” dots, so this is multiplied by 0.38 and the character width in the x-axis and y-axis directions is “18” dots. Get. In the present embodiment, the y-axis direction is also multiplied by the reduction ratio 0.38 in the x-axis direction. However, the size information in the vertical direction may be multiplied by the reduction ratio 0.6 in the y-axis direction.

  When one character data smaller than the size information of the other character data exists in the character data block, the reduction conversion is performed according to the size of the other character data. For example, the character data block “Kumasan ni” includes a character “KU” in which the size information in the proportional font is set to be small. The size information stored in the display information database 151 is “32” dots with respect to other characters “48” dots. In this case, the size is reduced according to the size information of the other character “Masan ni”, and the converted size information “18” dots are obtained. This is in consideration of the case where the mobile phone 2 does not have a proportional font. When the mobile phone 2 has a proportional font, the size information “32” dots related to one character data is multiplied by the reduction rate and converted. The size information “12” dots may be calculated.

  The CPU 11 of the server computer 1 stores the converted size information in the model database 152. Next, a process for calculating the end point x coordinate value of the position information when the character whose size information in the proportional font is set to be small is included will be described. The end point conversion process is performed by multiplying the end point of the position information stored in the display information database 151 by the reduction ratio when the size information in the proportional font does not include a small character. On the other hand, when a character whose size information in the proportional font is set to be small is included, the x coordinate value of the position information end point is obtained in consideration of the converted size information. FIG. 9 is an explanatory diagram showing the relationship of position coordinates when a character whose size information is set small in a proportional font is included. FIG. 9A shows the character data “Kumasan ni” and “I met” before conversion, and the characters “ku” and “tsu” in which the size information is set small in the proportional font of the horizontal size “32” are included. ing. At this time, the start point of “Kuma-san” is (160, 150), the end point is (384, 102), the start point of “I met” is (450, 150), and the end point is (626, 102).

  FIG. 9B shows the coordinates of each character data after reduction. Each starting point coordinate is multiplied by the above-described reduction ratio to obtain the starting point (61, 90) of “Kumasan” and the starting point (171, 90) of “I met”. In order to obtain the end point, the CPU 11 reads the size information stored in the model database 152 and calculates the total value. In the example of this embodiment, the converted size information “18” is multiplied by five characters “Kumasan” to obtain a total size information “90”. The CPU 11 adds the total value 90 to the x coordinate 61 of the start point to obtain the x coordinate 151 of the end point. The y-coordinate value of the end point is multiplied by the reduction ratio to obtain 61 as in the case where the size information in the proportional font does not include a character set to be small. As a result, the end point relating to the position information after conversion of “Kumasan ni” is (151, 61).

  Similarly, the CPU 11 reads the size information stored in the model database 152 and calculates the total value in order to obtain the end point of “I met”. In the example of this embodiment, the converted size information is “18”, and the total value of the size information of the four characters “Meeted” is “72”. The CPU 11 adds the total value 72 to the x coordinate 171 of the start point to obtain the x coordinate 243 of the end point. The y-coordinate value of the end point is multiplied by the reduction ratio to obtain 61 as in the case where the size information in the proportional font does not include a character set to be small. As a result, the end point relating to the position information after conversion of “I met” is (243, 61). The CPU 11 performs such conversion processing and stores the converted position information in the position information field of the model-specific database 152.

  FIG. 9C is an explanatory diagram showing the correction process after the conversion process. Focusing on the end point x coordinate value “243” of the character data “I met” shown in FIG. 9B, it can be understood that the display area side “240” of the model “A601” exceeds 3 dots. The CPU 11 determines whether or not the end point x-coordinate value related to the converted position information exceeds the display area by comparing with the display area stored in the specification database 153. If the CPU 11 determines that the value has exceeded, correction processing is performed until the value does not exceed the value. In this correction process, for example, the CPU 11 may calculate a value “3” that exceeds the display area and subtract it from the x-coordinate values of the start point and end point. In this example, as shown in FIG. 9C, the x-coordinate values of the start point and end point of “Meeted” are respectively reduced by “3” to correct the start point (168, 90) and end point (240, 61). To do.

  The CPU 11 stores this correction amount “3” in the correction amount field of the model-specific database 152 shown in FIG. In the present embodiment, for the sake of explanation, the start point (171, 90) and the end point (243, 61) of the coordinates related to “I met” before correction are described in the position information field. Of course, the start point (168, 90) and the end point (240, 61) may be stored in the position information field.

  Next, ruby conversion processing will be described. The CPU 11 of the server computer 1 reads the ruby from the display information database 151, converts it into image data, further reduces the converted ruby image data in accordance with the reduction ratio, and stores it in the model database 152 in association with the character data. . For example, the CPU 11 reads the ruby “Morinaka” of “in the forest” and obtains the ruby image data “Morinaka”. Then, image processing is performed according to the reduction ratio, and the reduced image data “Morinaka” is stored in association with the character data “Mori no Naka” in the model-specific database 152. The display position of the ruby image data may be appropriately arranged at a position that does not overlap the image data related to the converted character data. For example, the image data of the character data “in the forest” has the start point (87, 150) and the end point (142, 121), but the position information of the ruby image data has the same start point x-coordinate and the y-coordinate appropriately. The value (170) obtained by adding the values (20 dots or the like), that is, the position information start point of the ruby image data may be (87, 170). In the present embodiment, the ruby is collectively described as “Morinaka” for easy explanation, but may be divided and processed as “Morin” and “Naka”.

  The time information field for the color change in the model-specific database 152 stores the time required for changing the color of the image data related to each character data in seconds. Similar to the display information database 151 of FIG. 5, these values are not changed. The CPU 11 of the server computer 1 performs a process of copying the stored contents of the same field of the display information database 151 and pasting it in the same field of the model-specific database 152.

  The color change speed field of the model-specific database 152 stores the color change speed when changing the color of each character in the image data related to the character data displayed on the display unit 24 of the mobile phone 2. The unit is dot / 0.1 sec. In calculating the color change speed, unlike the position information and the size information, the process of simply multiplying the color change speed stored in the display information database 151 by the reduction ratio is not performed. This is because if the color change rate is reduced at the same reduction rate, the tempo is significantly shifted. The CPU 11 reads time information when changing color from the discoloration speed field of the display information database 151 or the model-specific database 152, and further reads size information from the size information field of the model-specific database 152.

  The CPU 11 calculates the discoloration speed of each character by dividing the read size information by the time information when discoloring. For example, with regard to “Kumasan” of “Kumasan ni”, the size information “18” is divided by the time information “0.9” sec when changing the color, and further divided by 10 to make the unit 0.1 seconds. To obtain “2” dots / 0.1 sec. Similarly, “ma” and “sa” are “2.25” dots / 0.1 sec, and “n” and “ni” are 1.5 dots / 0.1 sec.

  The CPU 21 of the mobile phone 2 starts discoloring the image data related to the character data with the synchronization timing as a trigger. The CPU 21 refers to the transmitted color change speed and performs image processing for changing the color. For example, when the image data related to the character data is “Kumasan ni”, the CPU 21 performs image processing for changing the color of “ku” from white characters to red characters at “2” dots / 0.1 sec in the x-axis direction. Do. When the CPU 21 determines that the coloring of 18 dots has been completed, the CPU 21 switches the speed to “2.25” dots / 0.1 sec and performs the color changing process to change the color of the image “ma”. In this way, character data is handled as an image and discoloration is performed in units of dots, so that the mobile phone 2 can also provide appropriate singing guidance to the user.

  The display information database 151, model-specific database 152, and specification database 153 described above are stored in the storage unit 15 of the server computer 1, but are stored in a database computer (not shown) connected via the communication network N. In addition, information may be stored and retrieved as necessary. The CPU 11 of the server computer 1 stores display information including music data, character data, and position information in the display information database 151 every time a new song is released. The CPU 11 refers to the specification database 153, performs the above-described conversion processing on each display information using the reduction rate for the specific model, and stores it in the model database 152 as display information for each model after conversion. .

  When the user wishes to reproduce and display karaoke from the mobile phone 2, the user accesses the server computer 1. The CPU 11 of the server computer 1 determines the model by referring to the MAC address of the mobile phone 2 or the like. Based on the model, the model database 152 is accessed, and display information such as music data, character data, position information, and size information corresponding to the model is read from the model database 152. The CPU 11 transmits the read music data and display information to the accessed mobile phone 2.

  The CPU 21 receives the transmitted music data and display information, and stores the music data in the music file 252 and the display information in the display information file 251. The user activates the reproduction program 256 downloaded from the server computer 1 in advance. The CPU 21 reads out the character data according to the reproduction program 256 and outputs the character data with reference to the font file 255. The CPU 21 converts the output character data into GIF format image data. The CPU 21 reads position information corresponding to the image data related to the converted character data from the display information file 251 and performs enlargement or reduction processing of the converted image data so that it falls within the coordinates of the start point and end point of the position information. Then, the image data relating to the character data after the enlargement or reduction process is stored in the image data file 253.

  The CPU 21 further determines whether or not ruby image data is attached to the character data. If the ruby image data is attached, the CPU 21 converts the ruby image data reduced by the server computer 1 into image data related to the character data. Image processing arranged in parallel is performed. Regarding character data having ruby, image data in which image data related to character data and ruby image data are combined is stored in the image data file 253. The above-described processing is performed for each character data, and sequentially stored in the image data file 253.

  When the CPU 21 receives an instruction to start playing music from the input unit 23, the CPU 21 reads the music data from the music file 252 and outputs the music data to the speaker 29. The CPU 21 resets the clock unit 210 simultaneously with the reproduction of the music, and in accordance with the display timing stored in the display information file 251, if there is image data and ruby associated with the character data stored in the image data file 253, the ruby image Is displayed on the display unit 24. Then, the CPU 21 refers to the synchronization timing from the display information file 251 and performs a color change process. The CPU 21 changes the color of the image data in accordance with the color change speed stored in the display information file 251. In the present embodiment, a mode of changing the color of ruby image data will be described. However, the color of ruby image data may not be changed. The user sings through the microphone 28 in accordance with the character data and the color change instruction displayed on the display unit 24. The audio signal input from the microphone 28 is output from the speaker 29.

  FIG. 10 is a flowchart showing the procedure of the storing process in the model database 152. When a new song is announced, display information such as music data, character data, and position information for providing karaoke is stored in the display information database 151. The CPU 11 of the server computer 1 performs the following processing to convert the display information of the new song for each model. The following example will be described using an example of converting the new song “Mori no Mori” to the model “A601”. First, the CPU 11 reads out music data to be converted from the display information database 151, and stores the read out music data in the storage area of the model “A601” in the model database 152 (step S101).

  The CPU 11 does not perform conversion processing, reads display information including display timing, synchronization timing, character data, and time information for color change from the display information database 151 (step S102), and displays these in association with the model and music data. Information is stored in the model-specific database 152 (step S103).

  FIG. 11 is a flowchart showing the procedure of the conversion process. The CPU 11 searches the specification database 153 based on the model name of the mobile phone 2 to be converted, reads the display area and the reduction ratio (step S111), and stores them in the RAM 12. The CPU 11 reads the start point coordinates and end point coordinates of the position information to be converted, and further reads the size information from the display information database 151 (step S112). The CPU 11 determines whether or not the character data stored in step S103 includes a character whose size information in the proportional font is set to be small (step S113). Specifically, the CPU 11 determines whether there is size information of one character data different from the size information of other character data in the size information related to the character data group to be converted. . For example, the character data group “Kumasan ni” has size information “32, 48, 48, 48, 48”, and size information “32” different from the size information “48” of other character data “Masanni”. The character data “ku” possessed exists.

  When the CPU 11 determines that the character whose size information in the proportional font is set to be small is not included (NO in step S113), the CPU 11 multiplies the size information by the reduction ratio stored in the RAM 12 (step S114). In this example, the size information “48” is multiplied by a reduction ratio of 38% in the horizontal direction (y-axis direction). Then, the CPU 11 stores the converted size information “18” in the size information field of the model database 152 (step S115). Subsequently, the CPU 11 multiplies the start point coordinates and end point coordinates related to the read position information by the reduction ratio (step S116) to obtain the start point coordinates and end point coordinates of the converted character data. The CPU 11 stores the converted position information (start point coordinates and end point coordinates) in the position information field of the model database 152 of the storage unit 15 (step S117). In the present embodiment, the starting point coordinates and the ending point coordinates of the position information are obtained by the conversion process. However, the present invention is not limited to this, and the center coordinates of the character data group may be obtained. All the coordinates may be obtained, or only the start point coordinates or the end point coordinates may be obtained and processed.

  When the CPU 11 determines that the character whose size information in the proportional font is set to be small (YES in step S113), the CPU 11 multiplies the size information other than the character whose size information in the proportional font is set small by the reduction rate ( Step S118). In this example, the size information “48” of another character “Masan ni”, which is not a character whose size information in the proportional font is set to be small, is multiplied by the reduction rate. The CPU 11 stores the converted size information in the size information field of the model-specific database 152 (step S119). As in step S116, the CPU 11 multiplies the start point coordinates of the read position information by the reduction rate, and further multiplies the y coordinate of the end point by the reduction rate (step S1110).

  The CPU 11 adds the value obtained by multiplying the converted size information by the number of characters to the converted start point x-coordinate calculated in step S119 to obtain the end point x-coordinate (step S1111). In this example, the position information before conversion of the character data “Kumasan ni” includes the start point (160, 150), the end point (384, 102), and the size information includes one character in which the size information in the proportional font is set to be small. 32, 48, 48, 48, 48 ". The size information after conversion based on a reduction ratio of 38% in the horizontal direction (x-axis direction) is “18, 18, 18, 18, 18”. The starting point of the converted position information is the starting point (61, 90) due to a reduction ratio of 38% in the horizontal direction (x-axis direction) and 60% in the vertical direction (y-axis direction). The end point y coordinate is “61” due to a reduction ratio of 60% in the vertical direction (y-axis direction). As the end point x coordinate after conversion, a value obtained by multiplying the start point x coordinate “61” by the size information “18” after conversion and the number of characters “5” is added to obtain the converted x coordinate “151”.

  The CPU 11 stores the converted position information in the model-specific database 152 (step S117). The CPU 11 determines whether or not the converted character data exceeds the display area (step S1112). Specifically, the CPU 11 reads the maximum x coordinate (horizontal) value of the display area stored in the RAM 12 and the end point x coordinate of the position information in the model database 152, and the end point x coordinate of the position information exceeds the maximum value of the display area. Determine whether or not. If the CPU 11 determines that the display area is not exceeded (NO in step S1112), the conversion process ends. On the other hand, if the CPU 11 determines that the display area is exceeded (YES in step S1112), that is, if the end point x coordinate of the position information exceeds the maximum value of the display area, the CPU 11 subtracts the exceeded value from the x coordinate of the position information. Correction is performed (step S1113).

  That is, the CPU 11 first obtains a value obtained by subtracting the maximum value from the end point x coordinate value. When character data “I met” is taken as an example, a value “3” obtained by subtracting the maximum value “240” from the x coordinate “243” is obtained. Subsequently, the CPU 11 performs correction by subtracting “3” from the x-coordinates “171” and “243” of the start point and end point of the position information. As a result, corrected position information, start point (168, 90), end point (240, 61) are obtained. The CPU 11 stores the corrected position information in the position information field of the model-specific database 152 (step S1114). In the present embodiment, the correction amount is set to a value obtained by subtracting the maximum value of the display region x coordinate from the x coordinate of the end point for the sake of simplicity. Of course, a value larger than this may be used. .

  FIG. 12 is a flowchart showing a ruby image conversion processing procedure. The CPU 11 searches the character data field of the display information database 151 and determines whether or not ruby exists in the character data (step S121). When CPU 11 determines that ruby exists (YES in step S121), CPU 11 reads ruby position information from display information database 151 (step S122). Further, the CPU 11 reads out ruby character data corresponding to the character data from the display information database 151 (step S123). The CPU 11 converts the read ruby character data into image data such as GIF (step S124).

  The CPU 11 performs image processing for reducing the converted ruby image data in accordance with the reduction ratio read in step S111 (step S125). The CPU 11 calculates the position information of the ruby image data from the position information of the corresponding character data (step S126). Specifically, the CPU 11 may use the position offset from the start point of the converted character data position information as the position information of the ruby image data. For example, for character data “I met”, a starting point (171, 90) of position information, a value “100” obtained by adding an appropriate value “10” to y-coordinate “90” is obtained, and position information ( 171, 100).

  The CPU 11 stores the ruby image data obtained as described above and the position information of the ruby image data in the model database 152 (step S127). If the CPU 11 determines in step S121 that ruby does not exist (NO in step S121), the processing in steps S122 to S127 is skipped.

  FIG. 13 is a flowchart showing the procedure of the color change rate calculation process. The CPU 11 reads the size information in the model database 152 (step S131). Further, the CPU 11 reads out time information when changing color from the time information field when changing color in the display information database 151 or the model-specific database 152 (step S132). The CPU 11 divides the read size information by time information when changing color in order to calculate the color change speed (step S133). The CPU 11 stores the converted color change speed in the color change speed field of the model-specific database 152 (step S134). The conversion process is completed by repeating the above process on the character data in the song. When the conversion process for one model is completed, the display area and the reduction ratio stored in the specification database 153 are read for the other model “A602” and the like, and the same process is repeated.

  FIG. 14 and FIG. 15 are flowcharts showing the procedure of information transmission / reception processing between the server computer 1 and the mobile phone 2. The CPU 21 of the mobile phone 2 establishes communication with the server computer 1. Thereafter, the CPU 21 requests the server computer 1 to acquire the reproduction program 256 (step S141). In response to this acquisition request, the CPU 11 of the server computer 1 reads the reproduction program 256 stored in the storage unit 15 and transmits it to the mobile phone 2 (step S142). The CPU 21 of the mobile phone 2 stores the transmitted reproduction program 256 in the storage unit 25 (step S143).

  When the user desires to acquire karaoke data of a new song, the user selects a song to be downloaded from the input unit 23. In response to the input from the user, the CPU 21 of the mobile phone 2 makes a request for obtaining display information including music data and character data necessary for enjoying karaoke to the server computer 1 and transmits the model information (step). S144). The CPU 11 of the server computer 1 receives the acquisition request and model information, and determines the model of the transmission source mobile phone 2 (step S145). This model discrimination may be made by referring to the model-related information transmitted by the mobile phone 2 or by referring to the MAC address included in the information transmitted and received between the mobile phone 2 and the server computer 1. You may determine the model.

  The CPU 11 of the server computer 1 accesses the model-specific database 152 on which the conversion process has been performed based on the determined model (step S146). The CPU 11 of the server computer 1 reads out the music data requested for acquisition from the model database 152 (step S147), and transmits the read music data to the mobile phone 2 (step S148). The CPU 21 of the mobile phone 2 stores the transmitted music data in the music file 252 (step S149).

  The CPU 11 of the server computer 1 searches the model database 152 based on the model determined in step S145, and displays the display timing, synchronization timing, character data, position information, color change speed, ruby image data, and ruby image data. Display information including position information is read (step S1410), and the read display information is transmitted to the mobile phone 2 (step S1411). The CPU 21 of the mobile phone 2 receives the display information including the transmitted display timing, synchronization timing, character data, position information, discoloration speed, ruby image data, and position information of ruby image data (step S1412).

  The CPU 21 of the mobile phone 2 stores display information including the received display timing, synchronization timing, character data, position information, color change speed, and position information of ruby image data in the display information file 251 (step S151). Similarly, the CPU 21 of the mobile phone 2 stores ruby image data in the image data file 253 (step S152).

  FIG. 16 is a flowchart showing the procedure of reproduction and color change processing. When starting the karaoke, the user inputs a reproduction start signal from the input unit 23 according to the guide shown on the display unit 24. The CPU 21 of the cellular phone 2 receives the input signal related to the start of reproduction (step S161) and starts the reproduction program 256 (step S162). The CPU 21 reads out the character data stored in the display information file 251 and the position information corresponding to the character data (step S163). The CPU 21 reads a font corresponding to the read character data from the font file 255 (step S164). The CPU 21 develops the font of the read character data in the RAM 22.

  The CPU 21 reads the font of the character data from the expanded RAM 22 and converts it into image data in the GIF format or the like (step S165). The CPU 21 refers to the position information read in step S163 and performs an enlargement or reduction process on the image data related to the converted character data (step S167). For example, when reducing or enlarging the image data “Kumasan ni” related to the converted character data, the CPU 21 counts the number of dots in the x-axis direction and the number of dots in the y-axis direction (x1, y1) of the image data “Kumasan ni”. ) And the number of dots in the x-axis direction “90” and the number of dots in the y-axis direction “29” from the position information stored in the display information file 251, the start point (61, 90), and the end point (151, 61). Are calculated respectively. Then, the reduction rate (x1 / 90, y1 / 29) or the enlargement rate (90 / x1, 29 / y1) is calculated from the number of dots, and the image data “Kumasan ni” is reduced or enlarged.

  The CPU 21 stores the image data relating to the character data thus converted in the image data file 253 (step S168). The CPU 21 reads out the music data from the music file 252 and reproduces it (step S169). At the same time, the CPU 21 resets the clock unit 210. The CPU 21 performs the following processing to display the lyrics and the discoloration of the lyrics on the display unit 24. The CPU 21 refers to the position information stored in the display information file 251 and, based on the signal from the clock unit 210, according to the display timing stored in the display information file 251, the character data image data and ruby Image data is read from the image data file 253 and displayed (step S1610).

  The display position of the ruby image data is displayed on the display unit 24 with reference to the position information of the ruby image data transmitted from the server computer 1. Instead of using the position information of the ruby image data, the CPU 21 of the mobile phone 2 may determine the position information of the ruby image data by referring to the position information of the corresponding character data. In this case, when the starting point of the position information of the image data relating to the character data is (x, y), the CPU 21 may use (x, y + a), which is a dot added to the y coordinate, as the starting point, as the position information of the ruby image data. . Thus, the lyrics and the ruby accompanying the lyrics are displayed on the display unit 24 as image data in accordance with the music data.

  The CPU 21 performs the color change processing of the character data image data and the ruby image data according to the synchronization timing and the color change speed stored in the display information file 251 based on the signal from the clock unit 210 in order to perform the color change processing ( Step S1611). For example, when the lyrics are displayed in white, the color is changed in red or the like. The CPU 21 refers to the color changing speed determined for each number of dots corresponding to the size information of the image data related to the character data, and executes image processing for changing the color. By repeating the above processing, character data display and color change processing can be executed.

Embodiment 2
FIG. 17 is a block diagram showing a configuration of the server computer 1 according to the second embodiment. The computer program for operating the server computer 1 according to the second embodiment can be provided by a portable recording medium 1A such as a CD-ROM, MO, or DVD-ROM as in the second embodiment. It is. Further, the computer program can be downloaded from a server computer (not shown) via the communication network N. The contents will be described below.

  A computer that causes a reader / writer (not shown) of the server computer 1 shown in FIG. 17 to read position information, size information, and time information for color change, convert position information, convert size information, and calculate a color change speed. A portable recording medium 1A (CD-ROM, MO, DVD-ROM or the like) on which the program is recorded is inserted and this program is installed in the control program of the storage unit 15. Alternatively, such a program may be downloaded from an external server computer (not shown) via the communication unit 16 and installed in the storage unit 15. Such a program is loaded into the RAM 12 and executed. Thereby, it functions as the server computer 1 of the present invention as described above.

  The second embodiment is configured as described above, and the other configurations and operations are the same as those of the first embodiment. Therefore, corresponding parts are denoted by the same reference numerals, and detailed description thereof is omitted.

It is a schematic diagram which shows the outline | summary of the delivery system which concerns on this invention. It is a block diagram which shows the hardware constitutions of a server computer. It is a block diagram which shows the hardware constitutions of a mobile telephone. It is explanatory drawing which shows the record layout of the specification database of a server computer. It is explanatory drawing which shows the record layout of a display information database. It is explanatory drawing which shows the example of a display of character data. It is explanatory drawing which shows the record layout of a model classification database. It is explanatory drawing which shows the display image of the character data displayed on the display part of a mobile telephone. It is explanatory drawing which shows the relationship of the position coordinate in case the size information in the proportional font contains the character set small. It is a flowchart which shows the procedure of the memory | storage process to a model classification database. It is a flowchart which shows the procedure of a conversion process. It is a flowchart which shows the conversion process sequence of a ruby image. It is a flowchart which shows the procedure of the calculation process of a discoloration speed. It is a flowchart which shows the procedure of the transmission / reception process of the information between a server computer and a mobile telephone. It is a flowchart which shows the procedure of the transmission / reception process of the information between a server computer and a mobile telephone. It is a flowchart which shows the procedure of reproduction | regeneration and a color-change process. 6 is a block diagram illustrating a configuration of a server computer according to Embodiment 2. FIG. It is explanatory drawing which shows the image of the conventional color change process.

Explanation of symbols

1 Server computer (conversion processing device)
1A Recording medium 2 Mobile phone (mobile terminal)
11 CPU (control unit)
13 Input unit 14 Display unit 15 Storage unit 16 Communication unit 21 CPU (Control unit)
23 Input Unit 24 Display Unit 25 Storage Unit 26 Communication Unit 28 Microphone 29 Speaker 151 Display Information Database 152 Model Database 153 Specification Database 210 Clock Unit 251 Display Information File 252 Music File 253 Image Data File 254 Specification File 255 Font File 256 Playback Program N Communication network S Distribution system

Claims (9)

A conversion processing method for converting display information relating to character data displayed with discoloration in accordance with music data by a conversion processing device connected to the portable terminal via a communication network according to the model characteristics of the portable terminal In
Position information of the character data in association to the character data, from the display information database storing display information including the time information when the size information and discoloration, the position information, the control unit the time information when the size information and discoloration A reading step;
A step of reading the reduction ratio of the portable terminal to be converted from the specification database storing the reduction ratio in association with the model of the mobile terminal by the control unit;
A position information conversion step of converting the position information of the read character data by the control unit based on the read reduction ratio;
A size conversion step of converting the read size information by the control unit based on the reduction ratio;
Based on the read time information and the size information converted by the size conversion step, a speed calculation step of calculating a color change speed of the character data after conversion by the control unit ;
Transmitting the calculated color change speed of the character data after conversion to a portable terminal that performs a color change process according to the color change speed calculated in the speed calculation step . In a conversion processing device that converts display information related to character data displayed with discoloration according to music data according to the model characteristics of a mobile terminal connected via a communication network ,
Position information of the character data in association to the character data, from the display information database storing display information including the time information when the size information and discoloration, position information, and means for reading the time information when the size information and discoloration ,
Means for reading out the reduction ratio of the portable terminal to be converted by the control unit from the specification database storing the reduction ratio in association with the model of the mobile terminal;
Position information conversion means for converting the position information of the read character data based on the read reduction ratio;
Size conversion means for converting the read size information based on the reduction ratio;
Based on the read time information and the size information converted by the size conversion means, a speed calculation means for calculating a color change speed of the converted character data ;
A conversion processing apparatus comprising: means for transmitting the calculated color change speed of the converted character data to a portable terminal that performs a color change process according to the color change speed calculated by the speed calculation means . Means for storing the position information converted by the position information conversion means for each model of the portable terminal, the size information converted by the size conversion means, and the discoloration speed calculated by the speed calculation means in a model-specific database; The conversion processing apparatus according to claim 2, further comprising: Means for converting ruby accompanying character data into image data;
The conversion processing apparatus according to claim 2, further comprising: ruby conversion means for converting the converted ruby image data based on the reduction ratio. When the size information of the one character data read out is smaller than the size information of the other character data listed together with the one character data, the size conversion means, the size information of the other character data and the reduction rate Is configured to convert the size information of the one character data,
The specification database stores a reduction ratio and a display area in association with the model of the mobile terminal.
When the one character data is included and the position information converted by the position information conversion means exceeds the display area of the portable terminal stored in the specification database, the display area is not exceeded. The conversion processing apparatus according to claim 2, further comprising: a unit that corrects the converted position information.   The speed calculation means is configured to calculate the color change speed of the converted character data by dividing the size information converted by the size conversion means by the time information read from the display information database. The conversion processing device according to claim 2, wherein In a computer program for causing a computer to convert display information relating to character data displayed with discoloration in accordance with music data, according to the model characteristics of a mobile terminal connected via a communication network ,
On the computer,
Position information of the character data in association to the character data, from the display information database storing display information including the time information when the size information and discoloration, the position information, the control unit the time information when the size information and discoloration comprising the steps of: be read out,
From the specification database storing reduction ratio in association with the type of portable terminal, the method comprising to the reduction ratio of the mobile terminal to convert read out by the control unit,
A position information converting step that converts by the control unit on the basis of the reduction ratio and read out the positional information before Symbol read out character data,
And size conversion step that converts by the control unit on the basis of the previous SL reading out the size information to the reduction ratio,
Based on the previous SL reading out the time information and size information converted by the size conversion step, the velocity calculating step you calculate a discoloration rate of the character data converted by said control unit,
A computer program for executing the step of transmitting the calculated color change speed of the converted character data to a portable terminal that performs color change processing according to the color change speed calculated in the speed calculation step . A distribution system comprising the conversion processing device according to any one of claims 2 to 6 and a mobile terminal connected to the conversion processing device via a communication network.
The conversion processing device includes:
Further comprising transmission means for transmitting display information including character data corresponding to music data, position information converted by the position information conversion means, and discoloration speed calculated by the speed calculation means to the portable terminal,
The portable terminal is
Receiving means for receiving character data corresponding to the music data to which the transmitted positional information of the character data, and the display information including color change speed,
Means for converting the received character data into image data;
Character display means for displaying image data based on the converted character data on a display unit in accordance with the received position information as the music data is reproduced;
A distribution system comprising: a color changing unit that changes the color of the image data based on the displayed character data according to the received color change speed. A distribution system comprising the conversion processing device according to claim 4 and a mobile terminal connected to the conversion processing device via a communication network.
The conversion processing device includes:
Display information including character data corresponding to music data, position information converted by the position information conversion means, color change speed calculated by the speed calculation means, and ruby image data converted by the ruby conversion means Further comprising transmission means for transmitting to
The portable terminal is
Character data corresponding to the music data to which the transmitted positional information of character data, a receiving unit that receives the display information including the image data of the color change rate and ruby,
Means for converting the received character data into image data;
Character display means for displaying image data based on the converted character data on a display unit together with ruby image data corresponding to the character data according to the transmitted position information, along with the reproduction of the music data;
A distribution system comprising: a color changing unit that changes the color of the image data based on the displayed character data in accordance with the transmitted color change speed.

Images