JP2008225375A - Combining method and combining device, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a combining method for suitably arranging lyrics data in each page, and alleviating a processing load when the lyrics data are distributed and reproduced. <P>SOLUTION: A format file in which a format is stored when the lyrics data are displayed in a server computer. For example, a font size and a spacing between lines etc. are stored in the format file. The lyrics data are converted according to the format stored in the format file and developed in a random access memory (RAM). The developed lyrics data composed of a plurality of lines is divided into a plurality of pages by a dividing means so that the data can be accommodated in a display area in the line direction of each page of a background image data. The converting means of the server computer converts the lyrics data of each page which is divided by the dividing means, to an image data. Finally, the image data of each page converted by the converting means is combined with each page of the background image data by the combining means. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a synthesizing method, a synthesizing device, and a program for causing a computer to function as a synthesizing device.

In recent years, services for distributing voice data and lyrics data to portable terminals have become widespread. The user can enjoy karaoke by displaying the lyrics data downloaded to the portable terminal and playing back the voice data. In karaoke, a background image is generally displayed along with the display of lyrics data. Patent Document 1 synthesizes karaoke song data and still image control data distributed from a server with still image data stored in advance in an external storage medium attached to the portable wireless terminal in the portable wireless terminal. A karaoke distribution system is disclosed.
JP 2002-244676 A

  However, in the karaoke distribution system described in Japanese Patent Laid-Open No. 2004-228688, since the composition processing or the like is executed in the mobile terminal, various processes are required each time the lyric data is displayed, resulting in an increase in processing load and processing time. Some songs have very long lyrics. In this case, the number of pages to be displayed also increases. However, if the number of pages is too large, there is a problem that all the lyrics data cannot be displayed depending on the model or standard of the portable terminal.

  The present invention has been made in view of such circumstances. The purpose of the present invention is to expand the lyrics data according to the format of the lyrics data, divide the lyrics data for each lyric data within one page, By converting to image data and finally combining with background image data, the lyrics data can be properly arranged on each page, and the processing burden when distributing and playing the lyrics data can be reduced A synthesis method, a synthesis apparatus, and a program for causing a computer to function as a synthesis apparatus.

  Another object of the present invention is to provide a synthesizer capable of supporting various models and standards by expanding lyrics data in accordance with the format stored in the auxiliary format file when the upper limit of the number of pages is exceeded. There is to do.

  The composition method according to the present invention is a composition method in which lyrics data composed of a plurality of lines is composed with background image data for a portable terminal composed of a plurality of pages by a composition device, and the lyrics data is displayed in a format. In the format file, in accordance with the format stored in the format file, an expansion step in which the lyrics data is expanded on the memory by the control unit of the synthesizer, and a plurality of the expansion on the memory by the expansion step A dividing step of dividing the plurality of pages by the control unit so that the lyrics data composed of rows is within a display area in the row direction of each page of the background image data, and the lyrics data of each page divided by the dividing step A conversion step for converting the image data into image data, and the image data related to each page converted by the conversion step Characterized in that it comprises a synthesizing step of synthesizing on each page of the background image data.

  A synthesizing apparatus according to the present invention stores a format for displaying the lyrics data in a synthesizing apparatus that synthesizes lyrics data composed of a plurality of lines with background image data for a portable terminal composed of a plurality of pages. A format file, an expansion means for expanding the lyric data in accordance with the format stored in the format file, and a plurality of lines of lyric data expanded by the expansion means within the display area in the row direction of each page of the background image data Dividing means for dividing the image into a plurality of pages so as to fit in the image, conversion means for converting the lyrics data of each page divided by the dividing means into image data, and image data relating to each page converted by the conversion means for the background image data And synthesizing means for synthesizing each of the pages.

  In the synthesizing apparatus according to the present invention, the dividing means inserts a page break command at the end of a line before the lyrics data composed of a plurality of lines developed by the developing means reaches the display area limit in the row direction of the background image data. By doing so, the lyrics data is configured to be divided into a plurality of pages.

  The synthesizing apparatus according to the present invention includes means for storing an upper limit value of the number of pages of background image data, an auxiliary format file having a format different from that of the format file, and the number of pages of lyrics data divided by the dividing means. An upper limit value judging means for judging whether or not the upper limit value is exceeded, and when the developing means judges that the upper limit value is exceeded by the upper limit value judging means, the lyric data is stored in accordance with the format stored in the auxiliary format file. It is configured to expand.

  The synthesizing apparatus according to the present invention is characterized in that the format file stores at least a font size and line spacing of lyrics data.

  A program according to the present invention is a program for synthesizing lyrics data composed of a plurality of lines with background image data for a portable terminal composed of a plurality of pages by a computer, and a format for displaying the lyrics data on the computer In the format file, in accordance with the format stored in the format file, an expansion step in which the lyric data is expanded on the memory by the control unit of the computer, and a plurality of lines expanded in the memory by the expansion step A dividing step of dividing the plurality of pages by the control unit so that the lyric data consisting of the background image data falls within a display area in the row direction of each page of the background image data, and the lyrics data of each page divided by the dividing step Conversion step for converting to image data, and conversion by the conversion step The image data of the page, characterized in that to execute a combining step of combining each page of the background image data.

  In the present invention, a format file storing a format for displaying lyrics data on the synthesizer is prepared. The format file stores, for example, the font size and line spacing of the lyrics data. Then, the lyrics data is expanded by the expansion means according to the format stored in the format file. The lyric data composed of a plurality of lines developed by the developing means is divided into a plurality of pages by the dividing means so that it falls within the display area in the row direction of each page of the background image data. Specifically, a page break command is inserted at the end of the line before the lyrics data composed of a plurality of lines expanded by the expansion means reaches the display area limit in the line direction of the background image data.

  The converting means of the synthesizer converts the lyric data of each page divided by the dividing means into image data. Finally, the image data related to each page converted by the conversion unit is combined with each page of the background image data by the combining unit.

  In the present invention, the upper limit value of the number of pages of background image data is stored. An auxiliary format file having a format different from that of the format file is prepared in advance. The upper limit value determining means determines whether or not the number of pages of the lyrics data divided by the dividing means exceeds the stored upper limit value. The expansion means expands the lyrics data in accordance with the format stored in the auxiliary format file when the upper limit determination means determines that the upper limit is exceeded. The lyrics data developed in accordance with the auxiliary format file is divided and combined with the background image data.

  In the present invention, the lyric data is expanded by the expansion means in accordance with the format stored in the format file, and the lyric data is divided so that the lyric data consisting of a plurality of lines fits within the display area in the row direction of each page of the background image data. To divide into multiple pages. The converting means converts the lyrics data of each page divided by the dividing means into image data, and combines it with each page of the background image data by the combining means. Thereby, it becomes possible to divide the lyrics data over a plurality of pages into a plurality of pages at an optimum position. Further, since the lyrics data and the background image data are configured as integrated image data, distribution to the user is facilitated.

  In the present invention, the upper limit value of the number of pages of background image data is stored. An auxiliary format file having a format different from that of the format file is prepared in advance. The upper limit value determining means determines whether or not the number of pages of the lyrics data divided by the dividing means exceeds the stored upper limit value. The expansion means expands the lyrics data in accordance with the format stored in the auxiliary format file when the upper limit determination means determines that the upper limit is exceeded. As a result, even if the lyrics are long and there is an upper limit on the number of pages depending on the model or standard, the segmentation process based on the optimal format is executed, so it is possible to avoid the situation where the lyrics data is interrupted in the middle. Thus, the present invention has excellent effects.

Embodiment 1
FIG. 1 is a schematic diagram showing an outline of an adjustment system. The adjustment system includes an adjustment device 1, a communication network N, a lyrics database (hereinafter referred to as lyrics DB) 10, and portable terminals 2, 2, 2,. For example, a server computer is used as the adjustment device 1. Below, the adjustment apparatus 1 is demonstrated as what is the server computer 1. FIG. The portable terminal 2 is, for example, a mobile phone, a PDA (Personal Digital Assistance), a portable audio player or a portable game machine having a display unit, and has a display screen smaller than a monitor installed in a general karaoke store. It is a portable portable terminal. In the present embodiment, the mobile terminal 2 will be described as the mobile phone 2.

  The server computer 1 and the mobile phones 2, 2, 2,... Are connected via a communication network N such as the Internet and a mobile phone network. The lyrics DB 10 stores a plurality of lyrics data and audio data. The server computer 1 performs adjustment processing to synthesize lyrics data selected in response to a request from the mobile phone 2 with background image data. After the adjustment process, audio data corresponding to the synthesized image data and lyrics data is transmitted from the server computer 1 to the mobile phone 2. The mobile phone 2 displays received image data and reproduces audio data.

  FIG. 2 is a block diagram showing a hardware configuration of the server computer 1. The server computer 1 includes a CPU (Central Processing Unit) 11, a RAM (Random Access Memory) 12, an input unit 13, a display unit 14, a communication unit 16, and a storage unit 15 as control units. The CPU 11 is connected to the hardware units of the server computer 1 via the bus 17 and controls them, and executes various software functions according to the control program 15P stored in the storage unit 15. The control program 15P is described in a programming language such as C language.

  The communication unit 16 is a gateway or the like that functions as a firewall, and transmits and receives necessary information to and from the mobile phone 2. The storage unit 15 is configured by a hard disk, for example, and stores therein a format file 152 and a background image file 151 in addition to the control program 15P described above. The background image file 151 stores a plurality of types of background image data. A plurality of types of background image data are stored in a format such as jpeg (Joint Photographic Experts Group), and the user can select a favorite image as will be described later. The format file 152 stores information such as font size, font, and line spacing when displaying lyrics data, which is text data, for example. Details of the background image file 151 and the format file 152 will be described later.

  The lyrics DB 10 stores a plurality of lyrics data and audio data. The CPU 11 performs processing such as storage and retrieval of necessary information by interacting using SQL (Structured Query Language) or the like in the schema associated with the key of the field of the lyrics DB 10. FIG. 3 is an explanatory diagram showing a record layout of the lyrics DB 10. The lyrics DB 10 includes a lyrics ID field, a lyrics data field, and an audio data field.

  The lyric ID field stores unique identification information (hereinafter referred to as lyric ID) for specifying the lyric data and the audio data. In the lyric data field, lyric data is stored in a text format, for example, in association with the lyric ID. Further, in the voice data field, voice data that is a melody of the lyrics data is stored in a data format such as mmf or mld in association with the lyrics ID and the lyrics data.

  As shown in the figure, a plurality of lyrics data and voice data indicated by lyrics IDs “T1”, “T2” and “T3” are stored. These lyric data and audio data are obtained by downloading the lyric data and audio data used in commercial karaoke to the lyrics DB 10 via the communication unit 16. Note that a CD-ROM or the like on which lyric data and voice data for commercial karaoke are recorded may be inserted into a recording medium reading device (not shown), and the contents thereof may be stored in the lyric DB 10. Note that the lyrics DB 10 is stored in a database server accessible from the server computer 1, but the lyrics DB 10 may be stored in the storage unit 15 of the server computer 1.

  FIG. 4 is a block diagram showing a hardware configuration of the mobile phone 2. The mobile phone 2 includes a CPU 21 as a control unit, a RAM 22, an input unit 23, a display unit 24, a communication unit 26, a microphone 28, a speaker 29, a clock unit 210, and a storage unit 25. The CPU 21 is connected to the hardware units of the mobile phone 2 via the bus 27, controls them, and executes various software functions according to the control program 25P stored in the storage unit 25.

  The display unit 24 is, for example, a liquid crystal display, and the input unit 23 is configured by a push button or the like. In addition, you may make it comprise the display part 24 and the input part 23 integrally like a touchscreen. The speaker 29 amplifies and outputs audio data, call data, or an audio signal related to audio input from the microphone 28. The microphone 28 converts an audio signal input from the outside into an electric signal. The converted electrical signal is converted into digital data by an A / D converter (not shown) and output to the CPU 21. The communication unit 26 includes a high-frequency transmission / reception unit and an antenna, and performs transmission / reception of various data including voice data, character data, and the like. The clock unit 210 outputs date / time information to the CPU 21.

  The storage unit 25 stores a control program 25P, a browser 251, and a playback application 252. The browser 251 analyzes an HTML (HyperText Markup Language) file transmitted / received via the communication unit 26 by HTTP (Hyper Text Transfer Protocol) and displays the file on the display unit 24. The playback application 252 is software that synchronizes playback of music data and display of image data in which lyrics data is combined with background image data. The reproduction application 252 displays the first page of image data including a plurality of pages along with reproduction of music data. Then, referring to the date and time information output from the clock unit 210, the page of the image data is switched after a predetermined time has elapsed. The CPU 21 outputs audio from the microphone 28 according to the program of the reproduction application 252 and refers to date / time information from the clock unit 210 to switch pages of image data to be displayed on the display unit 24.

  FIG. 5 is an explanatory diagram showing a record layout of the background image file 151. A background image file 151 is stored in the storage unit 15 of the server computer 1. The background image file 151 includes a background image ID field, a background image data field, a display area (row) field, and a display area (column) field. The background image ID field stores unique identification information (hereinafter referred to as background image ID) for specifying the background image data. In the background image data field, background image data serving as the background of the lyrics data is stored in association with the background image ID.

  The display area (row) field stores the number of pixels in the vertical (row) direction of the display unit 24 capable of displaying lyrics data. The display area (column) field stores the number of pixels in the horizontal (column) direction of the display unit 24 capable of displaying the lyrics data. For example, the background image with the background image ID “IM1” has a lyrics data display area of 350 pixels in the row direction and 220 pixels in the column direction. The background image file 151 may be stored in the lyrics DB 10.

  FIG. 6 is an explanatory diagram showing an image of image data displayed on the display unit 24. On the display unit 24, synthesized image data obtained by synthesizing the image data related to the lyrics data and the background image data is displayed. The background image data is displayed in accordance with the display area of the display unit 24. The background image data has a form in which, for example, transparent image data 241 is pasted on image data serving as a background. The transmission image data 241 has such a transmittance that the image data as the background can be visually recognized. The transmission image data 241 is pasted to prevent a situation in which it is difficult to visually recognize the lyrics due to the background image. For example, when the lyrics are black, the transmission image data 241 has a transmittance of 25%. White images are used.

  An image related to the lyrics data is displayed in the transparent image data 241 on the background image data, and an area defined by the transparent image data 241 on the rectangle is a display area for the lyrics data. The CPU 11 of the server computer 1 executes adjustment processing so that the image related to the lyric data appropriately fits within the display area of the image related to the lyric data in the transparent image data 241. The x-axis direction of the display area shown in FIG. 6 indicates the column (horizontal) direction, and the y-axis direction of the display area indicates the row (vertical) direction. (0, 0) in the xy coordinate system is the origin, and the display area in the x-axis direction is from x = 0 to x = X. The display area in the y-axis direction is from y = 0 to y = Y. Accordingly, the display areas are (0, 0), (X, 0), (X, Y), and (0, Y). In the example shown in FIG. 5, the image of the background image ID “IM1” has X of 220 and Y of 350.

  FIG. 7 is an explanatory diagram showing an image of line feed processing. The CPU 11 of the server computer 1 reads the target background image data and the display area from the background image file 151. Further, the CPU 11 reads out the target lyrics data from the lyrics DB 10. Further, the CPU 11 reads the format such as the font, font size, display start position of each line, line spacing, etc. from the format file 152. The CPU 11 converts the read lyrics data according to the format. The CPU 11 determines whether or not the lyric data of each line after the format conversion is within the read display area in the column direction.

  Specifically, the CPU 11 converts one line of lyrics data converted according to the format file 152 into image data, and the number of pixels in the column direction falls within the number of pixels related to the display area in the column direction stored in the background image file 151. Judge whether it fits. For example, when the background image is “IM1”, the number of pixels in the display area in the column direction is 220. Therefore, the determination is made based on whether or not the number of pixels in the column direction of the image data of the lyric data subjected to format conversion exceeds 220. . Note that the CPU 11 does not convert the image data into the image data, but determines whether it fits within the display area in the column direction stored in the background image file 151 from the number of characters and the font size of the lyrics data in one line converted according to the format. Also good. When it falls within the display area, line feed processing is performed in accordance with a line feed command previously assigned to the lyrics data. On the other hand, when one line does not fit in the display area, a process of dividing one line of lyrics data into a plurality of lines is performed.

  FIG. 7 a shows an example in which one line of lyrics data is “AAA BBB CCCC DD EEEEE FFFF GGG”. In one line of the lyrics data, a space is inserted between one character block “AAA” and another character block “BBB”. The example of FIG. 7a shows a state in which spaces (1) to (6) are inserted between character blocks. In addition, a line feed command is inserted at the end of one line of lyrics data, in this example, at the end of the character block “GGG”. The line feed command is not shown.

  The horizontal axis (x-axis) in FIG. 7a indicates the number of pixels in the column direction, and X on the x-axis indicates the display region in the column direction of the background image. In the example of FIG. 7a, the lyric data for one row exceeds the display area X in the column direction. In this case, the CPU 11 extracts division information for dividing the lyrics included in the lyrics data for one line. The division information is used to divide lyrics, such as a space, a punctuation mark, a punctuation mark, a period, a question mark, and an exclamation mark. In the following description, for easy explanation, the division information is described as a space inserted between character blocks, and an example in which lyrics data for one line is divided into two lines will be described.

  The CPU 11 extracts spaces (1) to (6) existing in the text, and inserts a line feed command into the spaces (1) to (6). FIG. 7b is a diagram in which one line of lyric data is divided into two lines of lyric data by a space (1), and FIG. 7c is a figure in which one line of lyric data is divided into two lines of lyric data by a space (2). Yes, FIG. 7d is a diagram in which one line of lyric data is divided into two lines of lyric data by a space (3), and FIG. 7e is a figure in which one line of lyric data is divided into two lines of lyric data by a space (4). FIG. 7f is a diagram in which one line of lyric data is divided into two lines of lyric data by a space (5), and FIG. 7g is one line of lyric data into two lines of lyric data by a space (6). FIG. In this way, candidate lyrics data b to g are created.

  The CPU 11 determines whether or not the lyric data for two lines divided by the space fit within the display area. In FIG. 7b, the character block “GGG” on the second line exceeds the display area, and in FIG. 7g, the character block “FFFF” on the first line exceeds the display area. The CPU 11 deletes the lyrics data b and g exceeding the display area from the candidates. The CPU 11 selects lyric data having a good display balance of lyric data displayed over a plurality of lines from the lyric data c, d, e, and f as candidates.

  The CPU 11 calculates the difference between the display areas of each line of the lyric data and selects the lyric data having the smallest difference. Specifically, the CPU 11 calculates the difference in the number of characters in each line, or converts the lyrics data in each line into image data, and calculates the difference in the number of pixels in the column direction. In the example of FIG. 7, it is the lyrics data of FIG. 7e that has the smallest difference in the display area of each row. That is, when a line feed command is inserted into the space (4), it looks best. It is not always necessary to select the lyric data having the smallest difference, and the lyric data having the next smallest difference, in this example, FIG. 7d may be selected. The CPU 11 inserts a line feed command after the space (4) and stores the lyrics data divided into two lines in the storage unit 15.

  In this example, the upper limit value of the number of lines to be divided is 2, but it may be 3 or more. In this case, the operator inputs the maximum value from the input unit 13. The CPU 11 receives the input maximum value and stores it in the storage unit 15. Similarly, when the upper limit value is 3, based on the space, candidate lyric data related to all combinations of three lines is created, and the lyric data that minimizes the sum of the differences between the lyric data of each line may be selected. . In the present embodiment, the configuration in which the optimum space is selected based on the difference between the display areas of each row or the sum of the differences has been described. However, other configurations may be used. For example, you may make it select as a position which divides | segments the space where dispersion | distribution or standard deviation of the display area of each line becomes the minimum.

  The procedure of line feed processing in the above hardware configuration will be described using a flowchart. 8 and 9 are flowcharts showing the procedure of line feed processing. The CPU 11 reads out lyrics data to be synthesized from the lyrics DB 10 and reads out background image data from the background image file 151 (step S81). CPU11 reads the format file 152 memorize | stored in the memory | storage part 15 (step S82). In accordance with the read format, the CPU 11 converts the format of the lyrics data read in step S81 (step S83). Thereby, the display area in the column direction of each row of the lyrics data is determined.

  The CPU 11 reads the display area in the column direction of the background image data read in step S81 from the background image file 151. The CPU 11 determines whether or not the lyric data for one line whose format has been converted fits in the display area in the column direction (step S84). If the CPU 11 determines that the lyric data for one line does not fit within the display area in the column direction (NO in step S84), the CPU 11 refers to the text of the lyric data for one line and extracts a space as division information (step) S85). CPU11 reads the upper limit of the number of lines to divide from the memory | storage part 15 (step S86).

  The CPU 11 divides the lyric data of one line by the extracted space with the read upper limit as a limit, and creates lyric data as a plurality of candidates consisting of a plurality of lines (step S87). The CPU 11 determines whether or not the candidate lyric data is within the display area in the column direction (step S88). If the CPU 11 determines that the candidate lyric data does not fit within the display area in the column direction (NO in step S88), the candidate lyric data that does not fit is deleted from the candidates (step S89), and the process proceeds to step S88. . On the other hand, if the CPU 11 determines that the lyrics data as candidates fall within the display area in the column direction (YES in step S88), the CPU 11 calculates the sum of the differences between the display areas of the divided lines (step S810). If the upper limit value is 2, the CPU 11 calculates the difference between the display areas of each row, not the sum.

  CPU11 performs the process of step S810 about all the candidate lyric data which satisfy | fill the conditions of step S88. The CPU 11 selects candidate lyrics data with the smallest sum of differences (step S811). The CPU 11 inserts a line feed command into the divided space of the selected candidate lyrics data (step S812). In other words, a line feed command is added to the end of the line to be split. The CPU 11 stores the lyrics data divided by the above processing in the storage unit 15 (step S813).

  CPU11 performed the process mentioned above about all the lines after the process of step S813, and when it is judged in step S84 that the lyric data for one line fits in the display area of a column direction (it is YES at step S84). Whether or not (step S91). If the CPU 11 determines that the processing has not been executed for all the rows (NO in step S91), the CPU 11 shifts the processing to the next row (step S92), and executes the processing after step S84 again.

  If the CPU 11 determines that the process has been executed for all the lines (YES in step S91), the lyrics data after the line feed process is converted into image data (step S93). The CPU 11 performs a process of synthesizing the image data related to the converted lyrics data and the background image data read out in step S81 (step S94). Note that the pasting position of the image data related to the lyrics data may be, for example, the coordinate value (0, 0) shown in FIG. The CPU 11 stores the composite image data in association with the background image ID and the lyrics ID (step S95). The above processing is executed for each combination of lyrics data and background image data. Thereby, the composite image data in which the optimum line feed processing is executed for each of the plurality of types of background image IDs and lyrics IDs is stored.

  10 and 11 are flowcharts showing the procedure of the composite image data distribution process. The CPU 21 of the mobile phone 2 activates the browser 251 and makes a connection request to the server computer 1 by inputting the URL of the server computer 1 (step S101). The CPU 11 of the server computer 1 receives the connection request, reads out the lyrics data from the lyrics DB 10 (step S102), and transmits a lyrics data selection screen. In this lyric data selection screen, information including the title, singer name, one phrase of lyric and lyric ID is written in HTML (HyperText Markup Language) format. The CPU 11 transmits to the mobile phone 2 a lyric data selection screen in which information including the title, singer name, one lyric phrase and lyric ID of the read lyric data is created in the HTML format (step S103).

  The CPU 21 of the mobile phone 2 receives the transmitted lyrics data selection screen (step S104). The CPU 21 accepts selection of lyrics data desired to be distributed from the input unit 23 (step S105). The CPU 21 transmits the lyrics ID related to the lyrics data desired to be distributed selected by the user via the input unit 23 to the server computer 1 (step S106). The CPU 11 of the server computer 1 receives the lyrics ID (step S107). Thereby, the selection of the lyrics data is completed.

  Subsequently, the CPU 11 reads the background image data and the background image ID from the background image file 151 (step S108). The CPU 11 creates a thumbnail image of background image data. Then, the CPU 11 creates a background image selection screen for selecting a background image. This background image selection screen is composed of an HTML document including thumbnail images of a plurality of background image data and a background image ID corresponding to each thumbnail image. The CPU 11 transmits the created background image selection screen to the mobile phone 2 (step S109).

  The CPU 21 of the mobile phone 2 receives the background image selection screen (step S110). The CPU 21 displays a background image selection screen on the browser 251. The user selects a thumbnail related to a desired background image as the background of the lyrics from the input unit 23. The CPU 21 accepts selection of a background image input from the input unit 23 (step S111). The CPU 21 transmits a background image ID corresponding to the selected thumbnail image to the server computer 1 (step S112). Thereby, background image data to be synthesized is determined.

  The CPU 11 of the server computer 1 receives the background image ID (step S1120). The CPU 11 reads out the composite image data corresponding to the received background image ID and the lyrics ID received in step S107 from the storage unit 15 (step S113). That is, the CPU 11 reads out the composite image data that satisfies the lyrics ID and the background image ID under the AND condition from the plurality of composite image data stored in step S95.

  Subsequently, the CPU 11 reads out audio data corresponding to the lyrics ID from the lyrics DB 10 (step S114). The CPU 11 transmits the composite image data and the read audio data to the mobile phone 2 (step S115). The CPU 21 of the mobile phone 2 receives the transmitted composite image data and audio data (step S116). The CPU 21 activates the reproduction application 252 (step S117). The CPU 21 displays the composite image data on the display unit 24 in accordance with the instruction of the playback application 252 (step S118). Furthermore, audio data is output from the speaker 29 at a predetermined timing (step S119).

Embodiment 2
FIG. 12 is a block diagram showing a configuration of the server computer 1 according to the second embodiment. A computer program for operating the server computer 1 according to the second embodiment can be provided by a portable recording medium 1A such as a CD-ROM, MO, or DVD-ROM as in the second embodiment. It is. Further, the computer program can be downloaded from a server computer (not shown) via the communication network N. The contents will be described below.

  A portable computer recorded with a computer program for causing a reader / writer (not shown) of the server computer 1 shown in FIG. 12 to determine whether or not it fits in the display area, to extract division information, to divide it into a plurality of lines, and to convert it into image data. The recording medium 1A (CD-ROM, MO, DVD-ROM or the like) is inserted, and this program is installed in the control program of the storage unit 15. Alternatively, such a program may be downloaded from an external server computer (not shown) via the communication unit 16 and installed in the storage unit 15. Such a program is loaded into the RAM 12 and executed. Thereby, it functions as the server computer 1 of the present invention as described above.

  The second embodiment is configured as described above, and the other configurations and operations are the same as those of the first embodiment. Therefore, corresponding parts are denoted by the same reference numerals, and detailed description thereof is omitted.

Embodiment 3
The third embodiment relates to a mode in which the lyric data subjected to line feed processing according to the first embodiment is divided into a plurality of pages. In the following description, it is assumed that the synthesizing apparatus is the server computer 1. FIG. 13 is an explanatory diagram showing the contents stored in the format file 152. The format file 152 stores various information including fonts, font sizes, line spacing, display start positions, and lines for displaying each item with respect to lyrics data that is text data. The format file is an INI file, and its contents are described in a text format. The x-coordinate start position defines the display start position of lyrics data in the x-axis direction, and is stored as x = 0 in this example. Similarly, the y coordinate start position defines the display start position of the lyrics data in the y-axis direction, and is stored as y = 0 in this example.

  FIG. 14 is an explanatory diagram showing an image of image data displayed on the display unit 24. As shown in FIG. 14, the coordinates (0, 0) in the xy coordinate system of the transmission image data 241 is the display start position of the lyrics data. The upper left corner of the display unit 24 may be the xy coordinate system, and the upper left coordinate may be (0, 0). In this case, the x coordinate start position may be 18 and the y coordinate start position may be 20. The line spacing shown in the format file 152 of FIG. This is the number of pixels between the lines of displayed lyrics data.

  The format file 152 stores the items of the lyric data, the font, and the font size to be displayed on each line in association with each line. For example, in the first line, a song name, P Gothic, and font size 18 are stored. As shown in FIG. 14, the music title “111” is displayed in P Gothic and font size 18 on the first line starting from the coordinate value (0, 0). Similarly, the singer name, P Gothic, and font size 18 are stored in the second line. As shown in FIG. 14, the singer name “222” is displayed in P Gothic and font size 18 on the second line with a space of 3 pixels from the first line.

  On the third line, the lyrics name, P Gothic, and font size 11 are stored. As shown in FIG. 14, the lyrics name “333” is displayed in P Gothic and font size 11 on the third line. In FIG. 14, the same font and font size are shown. In the fourth line, the composition name, P Gothic, and font size 11 are stored. As shown in FIG. 14, the composition name “444” is displayed in P Gothic and font size 11 in the fourth line. The fifth and sixth lines are stored as blank because no lyric data is described. As shown in FIG. 14, the lyric data is not displayed in the fifth and sixth lines.

  In the seventh line, lyric data, font is Gothic, and font size is 11 as items. In the seventh and subsequent lines, a format for displaying lyric data to be sung excluding a song name, a singer name, a song name, and a song name is stored. As shown in FIG. 14, the lyrics data to be sung is displayed with a Gothic font and a font size of 11 from the seventh line onward. As described in the first embodiment, the lyric data has already been subjected to line feed processing. Note that information such as the song name, singer name, song name, and song name of the lyrics data is stored in the lyrics DB 10 in association with the lyrics ID.

  In the example of FIG. 14, lyric data to be sung is displayed after the seventh line. However, in the eleventh line, the lyrics data “OOO PP QQQ” exceeds the coordinate Y that is the limit of the display area in the line direction. Hereinafter, the coordinate Y that is the limit of the display area in the row direction is referred to as limit coordinate Y. This limit coordinate Y is Y = 350 when the background image ID is “IM1”. The CPU 11 expands the lyric data converted according to the format on the RAM 12, and determines whether or not the expanded lyric data composed of a plurality of lines is within the display area in the line direction of the background image data. Based on the y coordinate start position, the line spacing, and the font size stored in the format file 152, the CPU 11 detects a line that matches the limit coordinate Y in the line direction.

If the number of pixels in the uppermost line where the description starts is Lstart and the number of pixels in the lowermost line where the description ends is Lend in the display area in the row direction of the arbitrary row L, the Lend of the arbitrary row L Can be represented by the following formula (1).
Lend = y coordinate start position + (H + number of pixels between rows) × (L−1) + H (1)

  However, H is the number of pixels in the line direction of the character corresponding to the font size, and is defined by Lend−Lstart + 1. For example, when the font size is 11, the number of pixels is 20, for example. The CPU 11 substitutes the number of pixels in the line direction of the character corresponding to the y coordinate start position, the number of pixels between lines, and the font size into the formula (1) stored in the storage unit 15, thereby obtaining the number of pixels Lend where the description of each line ends. calculate. In the example of FIG. 14, the lyric data on the 11th line exceeds the limit coordinate Y. In this case, the CPU 11 inserts a page break command (return command) at the end of the line before reaching the limit coordinate Y in order to divide the lyrics data into a plurality of pages. In the example of FIG. 14, a page break command is inserted at the end of the character block “NN” on the 10th line before reaching the limit coordinate Y.

  Thereby, the lyric data in the column direction and the row direction to be displayed on one page is determined. The CPU 11 performs the above-described processing on the next page in the same manner. The CPU 11 stores the line feed command and the page break command inserted by the line feed processing in association with the character block of the lyrics data. FIG. 15 is an explanatory diagram showing an image of image data displayed on the display unit 24. The lyric data “OOO PP QQQ” on the 11th line is displayed on the 1st line of the next page, and the lyric data “UUUUU VVV XXXX” is displayed on the last line of this page without reaching the limit coordinate Y. ing.

  The CPU 11 converts the lyric data composed of a plurality of lines for each page into which the page break command is inserted by the above processing into image data in a format such as jpeg. Then, based on the pasted coordinate position (0, 0), the converted image data is combined with the background image data. By performing this for each page, composite image data composed of a plurality of pages is created. The CPU 11 stores the synthesized image data synthesized in association with the lyrics ID and the background image ID in the storage unit 15.

  16 and 17 are flowcharts showing the procedure of the dividing process. The CPU 11 reads the lyrics data to be divided from the lyrics DB 10 and reads the background image data to be combined from the background image file 151 (step S161). It is assumed that the lyrics data read here has already been subjected to the line feed processing described in the first embodiment. The CPU 11 reads a display area (limit area Y) in the row direction corresponding to the read background image data from the background image file 151 (step S162). CPU11 reads the format memorize | stored from the format file 152 of the memory | storage part 15 (step S163). The CPU 11 converts the read lyric data according to the format and develops it on the RAM 12 (step S164).

  The CPU 11 calculates the number of pixels at which the description in the row direction of each line of the lyrics data developed on the RAM 12 is completed according to the equation (1) stored in the storage unit 15 (step S165). The CPU 11 determines whether or not the calculated number of pixels exceeds the limit area Y (step S166). When the CPU 11 determines that the calculated number of pixels exceeds the limit area Y (YES in step S166), the CPU 11 extracts a line before the line in which the calculated number of pixels exceeds the limit area Y (step S167).

  The CPU 11 inserts a page break command at the end of the extracted line (step S168). Further, the CPU 11 sets a page number in conjunction with the insertion of a page break command (step S169). In the example of FIG. 14, a page break number is inserted at the end of the character block “NN”, and page number 1 is set. Further, time information for switching pages is also stored. That is, time information for synchronizing with voice data is stored in the storage unit 15 in each character block of the lyric data. For example, the character block “OOO” has a time of 2 minutes 10 seconds after the start of playback of the voice data. Time information of 2 minutes and 12 seconds is stored in the storage unit 15. Here, 2 minutes 10 seconds is the singing start time of the character block, and 2 minutes 12 seconds is the singing end time of the character block.

  The CPU 11 reads the time information of the first character block of the next line after the extracted line from the storage unit 15. The CPU 11 subtracts a margin time for switching (for example, 0.5 seconds) from the read singing start time, associates the subtracted time information with the page number as the page switching time, and stores it in the RAM 12 together with the lyrics data (step). S1610). For example, the page switching time for the first page is 2 minutes 9 seconds 50 ms. Note that the operator can input an appropriate value from the input unit 13 as the margin time, and the entered margin time is stored in the storage unit 15.

  Furthermore, in this embodiment, the page switching time is calculated based on the time information of the first character block of the next line after the extracted line, but may be calculated based on the time information for the last character block of the extracted line. good. For example, if the time information of the last character block “NN” in the extracted line is stored in the storage unit from 2 minutes 5 seconds to 2 minutes 7 seconds after the start of audio data reproduction, there is room for 2 minutes 7 seconds that is the singing end time The time obtained by adding the time may be used as the page switching time. In this case, the CPU 11 reads the singing end time of the last character block of the previous line extracted in step S167 from the storage unit 15, adds the margin time to this singing end time to be the page switching time, and uses the page switching time as the lyrics. The data and page number are stored in the RAM 12.

  Then, in order to perform the process for the next page, the CPU 11 proceeds to step S165, and repeats the processes after step S165 for the line exceeding the limit area Y in step S167. If the CPU 11 determines that the number of pixels for which the description in the row direction calculated in step S166 does not exceed the limit area Y (NO in step S166), the CPU 11 determines the end of the lyrics data (step S171), and the last page number Set. The CPU 11 reads out the lyrics data of each page stored in the RAM 12 and converts it into image data (step S172). The CPU 11 synthesizes the image data related to the lyric data of each page with the background image data read in step S161 with reference to the coordinates (0, 0) (step S173).

  The CPU 11 stores the composite image data composed of a plurality of pages in association with the lyrics ID and the background image ID in the storage unit 15 together with the page number and the page switching time (step S174). By causing the CPU 11 to execute the above-described line feed and division processing for all combinations of lyrics data and background image data, it is possible to easily create composite image data having a good appearance.

  FIG. 18 is a flowchart showing the procedure for reproducing the composite image data. The CPU 21 of the cellular phone 2 selects the lyric ID and the background image ID by the procedure described in the first embodiment, thereby downloading the composite image data and the voice data from the server computer 1 (step S181). The CPU 21 activates the reproduction application 252 (step S182). The CPU 21 develops the composite image data composed of a plurality of pages, the page switching time of each page, and the audio data in the RAM 22 (step S183).

  The CPU 21 displays the composite image data on the display unit 24, and outputs the sound data from the speaker 29 in synchronization with this (step S184). The clock unit 210 starts measuring time with the start of reproduction of audio data. The CPU 21 refers to the output from the clock unit 210 and determines whether or not the page switching time for the displayed page has been reached after the music data is reproduced (step S185). If the CPU 21 determines that the page switching time has not been reached (NO in step S185), the CPU 21 waits until it reaches.

  On the other hand, if the CPU 21 determines that the page switching time has been reached (YES in step S185), the CPU 21 refers to the page number of the displayed composite image data and determines whether it is the last page (step S186). If the CPU 21 determines that it is not the last page (NO in step S186), it switches the page of the composite image data to display the next page (step S187). The display unit 24 displays the composite image data relating to the next page after switching. And it transfers to step S185 again and repeats the above process. In step S186, if the CPU 21 determines that the composite image data currently displayed on the display unit 24 is the last page (YES in step S186), the series of processing is terminated upon completion of reproduction of the music data.

  The third embodiment is configured as described above, and the other configurations and operations are the same as those of the first and second embodiments. Therefore, corresponding parts are denoted by the same reference numerals, and detailed description thereof is omitted. To do.

Embodiment 4
FIG. 19 is a block diagram showing a configuration of the server computer 1 according to the fourth embodiment. A computer program for operating the server computer 1 according to the fourth embodiment can be provided by a portable recording medium 1A such as a CD-ROM, MO, or DVD-ROM as in the fourth embodiment. It is. Further, the computer program can be downloaded from a server computer (not shown) via the communication network N. The contents will be described below.

  A portable recording medium having a computer program recorded therein, which stores a format in a reader / writer (not shown) of the server computer 1 shown in FIG. 19, develops the lyric data, divides the lyric data, converts it into image data, and synthesizes it. 1A (CD-ROM, MO, DVD-ROM or the like) is inserted, and this program is installed in the control program of the storage unit 15. Alternatively, such a program may be downloaded from an external server computer (not shown) via the communication unit 16 and installed in the storage unit 15. Such a program is loaded into the RAM 12 and executed. Thereby, it functions as the server computer 1 of the present invention as described above.

  The fourth embodiment is configured as described above, and the other configurations and operations are the same as those of the first to third embodiments. Therefore, the corresponding parts are denoted by the same reference numerals and detailed description thereof is omitted. To do.

Embodiment 5
The fifth embodiment relates to a form having a plurality of format files. FIG. 20 is a block diagram illustrating a hardware configuration of the server computer 1 according to the fifth embodiment. The storage unit 15 newly stores an auxiliary format file 153 and an upper limit page number storage unit 154. The auxiliary format file 153 is an INI file that stores a format different from the format file 152, and stores various formats in a text format. In the present embodiment, an example in which two types of format file 152 and auxiliary format file 153 are prepared will be described. However, a file defining three or more types of formats may be prepared.

  The upper limit page number storage unit 154 stores an upper limit value of the page number of the composite image data obtained by combining the image data related to the lyrics data and the background image data. For example, the upper limit number of pages is seven. The CPU 11 reads the format from the auxiliary format file 153 when the total number of pages exceeds the upper limit (hereinafter referred to as the upper limit page number) by the line feed process and the dividing process described in the first and third embodiments, In accordance with this new format, line feed processing and division processing are performed again. In the auxiliary format file 153, a font size smaller than the format of the format file 152, a narrow line space, and the like are stored so as to fit the upper limit number of pages.

  FIG. 21 is an explanatory diagram showing the stored contents of the auxiliary format file 153. Similar to the format file 152, the auxiliary format file 153 stores various information including fonts, font sizes, line spacing, display start positions, and lines for displaying each item for text data. The x-coordinate start position defines the display start position of lyrics data in the x-axis direction, and is stored as x = 0 in this example. Similarly, the y coordinate start position defines the display start position of the lyrics data in the y-axis direction, and is stored as y = 0 in this example.

  Unlike the line spacing “3” of the format file 152, the line spacing is set narrowly to “2”. This is because the composite image data is contained within the upper limit number of pages. The format of the item “song name” is stored in the first line, and the format of the item “singer name” is stored in the second line, but the font size is changed from “18” to “11” in the format file 152. . The format of the item “lyric name” is stored in the third line and the format of the item “composition name” is stored in the fourth line, but the font size is changed from “11” to “10” in the format file 152. ing.

  In the auxiliary format file 153, the blanks in the 5th and 6th lines of the format file 152 are deleted, and the format of the item “lyric data” is stored next in the 5th line. The font size of the lyrics data has been changed from “11” to “10” in the format file 152.

  FIG. 22 is a flowchart showing a processing procedure when an auxiliary format file is used. The CPU 11 of the server computer 1 receives an input of the upper limit page number from the input unit 13 (step S221). The CPU 11 stores the received upper limit page number in the upper limit page number storage unit 154 (step S222). Further, the CPU 11 stores the auxiliary format file 153 in the storage unit 15 (step S223). As described in the first and third embodiments, the CPU 11 reads out lyrics data and background image data to be combined (step S224). The CPU 11 reads the format from the format file 152 (step S225).

  The CPU 11 executes the line feed process shown in FIGS. 8 and 9 of the first embodiment and the dividing process shown in FIGS. 16 and 17 of the third embodiment (step S226). The details of these processes are the same as those already described, and will be omitted. The CPU 11 determines whether or not the total number of pages when it is determined at the end of the lyrics data in step S171 exceeds the upper limit page number stored in the upper limit page number storage unit 154 (step S227).

  Here, when the total number of pages of the lyrics data does not exceed the upper limit number of pages (NO in step S227), the CPU 11 ends the process. On the other hand, when the total number of lyrics data pages exceeds the upper limit number of pages (YES in step S227), the CPU 11 reads the format of the auxiliary format file 153 stored in the storage unit 15 (step S228). The CPU 11 converts the lyric data according to the format read from the auxiliary format file 153, and expands it in the RAM 22 (step S229). Thereafter, the CPU 11 executes the line feed process shown in FIGS. 8 and 9 of the first embodiment and the dividing process shown in FIGS. 16 and 17 of the third embodiment (step S2210). As a result, even if the lyrics are long and exceed the upper limit number of pages, the format is appropriately set and falls within the upper limit number of pages.

The fifth embodiment has the above-described configuration, and the other configurations and operations are the same as those of the first to fourth embodiments. Therefore, the corresponding parts are denoted by the same reference numerals and detailed description thereof is omitted. To do.
(Appendix 1)
In the adjusting device for adjusting the display position of the lyrics data to display the lyrics data on the mobile terminal,
Determining means for determining whether or not the lyric data for one line is within a display area in a column direction of background image data displayed on the portable terminal;
An extraction means for extracting division information for dividing the lyrics included in the lyrics data when the determination means determines that it does not fit within the display area;
Division means for dividing the lyrics data for one line into a plurality of lines based on the division information extracted by the extraction means;
An adjustment device comprising: conversion means for converting the lyrics data divided by the dividing means into image data.

It is a schematic diagram which shows the outline | summary of an adjustment system. It is a block diagram which shows the hardware constitutions of a server computer. It is explanatory drawing which shows the record layout of lyrics DB. It is a block diagram which shows the hardware constitutions of a mobile telephone. It is explanatory drawing which shows the record layout of a background image file. It is explanatory drawing which shows the image of the image data displayed on a display part. It is explanatory drawing which shows the image of a line feed process. It is a flowchart which shows the procedure of a line feed process. It is a flowchart which shows the procedure of a line feed process. It is a flowchart which shows the procedure of the delivery process of synthetic image data. It is a flowchart which shows the procedure of the delivery process of synthetic image data. 6 is a block diagram illustrating a configuration of a server computer according to Embodiment 2. FIG. It is explanatory drawing which shows the memory content of a format file. It is explanatory drawing which shows the image of the image data displayed on a display part. It is explanatory drawing which shows the image of the image data displayed on a display part. It is a flowchart which shows the procedure of a division process. It is a flowchart which shows the procedure of a division process. It is a flowchart which shows the reproduction | regeneration procedure of synthetic | combination image data. FIG. 10 is a block diagram illustrating a configuration of a server computer according to a fourth embodiment. FIG. 20 is a block diagram illustrating a hardware configuration of a server computer according to a fifth embodiment. It is explanatory drawing which shows the memory content of an auxiliary | assistant format file. It is a flowchart which shows the process sequence at the time of utilizing an auxiliary | assistant format file.

Explanation of symbols

1 server computer 1A portable recording medium 2 mobile phone 10 lyrics DB
11 CPU (control unit)
12 RAM
13 Input Unit 14 Display Unit 15 Storage Unit 15P Control Program 16 Communication Unit 21 CPU (Control Unit)
22 RAM
23 Input unit 24 Display unit 25 Storage unit 25P Control program 26 Communication unit 28 Microphone 29 Speaker 151 Background image file 152 Format file 153 Auxiliary format file 154 Upper limit page number storage unit 210 Clock unit 241 Transparent image data 251 Browser 252 Playback application N Communication network

Claims (6)

In a synthesizing method for synthesizing lyrics data composed of a plurality of lines with background image data for a portable terminal composed of a plurality of pages by a synthesizer,
Storing a format for displaying the lyrics data in a format file;
An expansion step of expanding the lyrics data on a memory by the control unit of the synthesizer according to the format stored in the format file;
A dividing step of dividing the lyrics data composed of a plurality of lines developed on the memory by the developing step into the plurality of pages by the control unit so that the lyrics data is within a display area in the row direction of each page of the background image data;
A conversion step of converting the lyric data of each page divided by the dividing step into image data;
And a synthesis step of synthesizing the image data related to each page converted by the conversion step with each page of the background image data. In a synthesizing apparatus that synthesizes lyrics data composed of a plurality of lines with background image data for a portable terminal composed of a plurality of pages,
A format file for storing a format for displaying the lyrics data;
Expanding means for expanding the lyrics data in accordance with the format stored in the format file;
Dividing means for dividing the lyric data composed of a plurality of lines developed by the developing means into a plurality of pages so as to fit within a display area in the row direction of each page of the background image data;
Conversion means for converting the lyric data of each page divided by the dividing means into image data;
A synthesizing device comprising: synthesizing means for synthesizing image data relating to each page converted by the converting means with each page of the background image data. The dividing means inserts a page break command at the end of the line before the lyrics data composed of a plurality of lines expanded by the expansion means reaches the display area limit in the line direction of the background image data, thereby The composition device according to claim 2, wherein the composition device is configured to be divided into a plurality of pages. Means for storing an upper limit of the number of pages of background image data;
An auxiliary format file having a format different from that of the format file;
An upper limit determination unit for determining whether the number of pages of the lyrics data divided by the dividing unit exceeds the upper limit;
The expansion means is
The composition device according to claim 2 or 3, wherein when the upper limit value determining means determines that the upper limit value is exceeded, the lyrics data is expanded according to a format stored in an auxiliary format file. .   The composition apparatus according to any one of claims 2 to 4, wherein the format file stores at least a font size and line spacing of lyrics data. In a program for synthesizing lyrics data composed of a plurality of lines with background image data for a portable terminal composed of a plurality of pages by a computer,
On the computer,
Storing a format for displaying the lyrics data in a format file;
An expansion step of expanding the lyrics data on a memory by the control unit of the computer according to the format stored in the format file;
A dividing step of dividing the lyrics data composed of a plurality of lines expanded on the memory by the expansion step into the plurality of pages by the control unit so that the background image data falls within a display area in a row direction of each page of the background image data.
A conversion step of converting the lyric data of each page divided by the dividing step into image data;
And a synthesis step for synthesizing the image data relating to each page converted by the conversion step with each page of the background image data.

Images