JP2009282815A - Text composition processing system and portable communication terminal equipped with the same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a text composition processing system which is used for a portable communication terminal or the like and composites a text with image data. <P>SOLUTION: The text composition processing system includes: an image data storage part for storing image data associated with the information of at least one of font, display position, display direction, display size and rotational position for displaying a text to be compounded with the image data as a template; an image data acquisition part for acquiring the image data of the template from the image data storage part; a text input acceptance part for accepting the input of the text to be compounded with the image data; and a composite image storage processing part for compositing the text with the image data by using glyph data based on the information of font in the template based on at least one of the display position, display direction, display size and rotational position in the selected template, and for making a predetermined storage device store the composite image. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

The present invention relates to a text composition processing system that synthesizes text with image data. In particular, the present invention relates to a case where the text composition processing system is used in a portable communication terminal such as a mobile phone, PHS, PDA, or smart phone.

  In recent years, many people have portable communication terminals and use an electronic mail function in addition to a telephone call function. In addition to e-mails that simply send and receive text data, this e-mail function can change the background, character color and size of e-mails, and blink characters, send and receive e-mails in cHTML format. It is possible to send and receive e-mails with various effects such as moving to, or inputting characters in the frame. Such decorated e-mails are becoming widespread because they can convey their own emotions more expressively than text-only e-mails and can produce gorgeousness.

  This decorated e-mail service is provided by each mobile phone company, such as a deco-mail service provided by NTT DoCoMo, Inc. The mechanism of the decomail service is disclosed in Non-Patent Document 1 and Non-Patent Document 2 below.

NTT DoCoMo, Inc., “Decomail Service Mechanism”, [online], <URL: http://www.nttdocomo.co.jp/service/imode/make/content/deco_mail/mechanism/> Satoshi Yamato, “What is Deco-mail”, [online], Impress Corporation, Internet <URL: http://k-tai.impress.co.jp/cda/article/keyword/17872.html>

  However, even if the conventional decorated e-mail function as described above is used, only the normal font is combined with the background image of the e-mail. It is not enough yet. This is because an area in which a message can be input is determined for each background, and the characters of the message are displayed according to a predetermined line.

  For this reason, it is not possible to display a message in an area other than the input-enabled area. For example, a message is displayed on the sandy beach image data as if a message was written on the sandy beach, or a message is displayed on the wall image data. Cannot be displayed along the wall. For this reason, it lacks decoration and production effects.

  In view of the above problems, the inventor of the present invention invented a text composition processing system capable of transmitting an e-mail having a higher effect than the conventional decorated e-mail function, and a portable communication terminal including the same.

  1st invention is a text composition processing system which synthesize | combines a text with image data, Comprising: The said text composition processing system is a font for displaying image data and the text made to synthesize | combine with the image data, a display position, a display direction, One or more pieces of information of display size and rotation position are associated with each other, and the image data storage unit stored as a template and the image data of the template selected by the user are acquired from the image data storage unit An image data acquisition unit, a text input reception unit that receives input of text to be combined with the image data, and at least one piece of information among display position, display direction, display size, and rotation position in the selected template Based on the font information in the template Combining the text to the image data, a text combining processing system having a composite image storage processing unit for storing in a predetermined storage device.

  With the configuration according to the present invention, a user can easily synthesize text as a message with image data. If this image data is transmitted by e-mail, it is possible to transmit an e-mail with high decorativeness and effect.

  According to a second aspect of the present invention, there is provided a text composition processing system for synthesizing text with image data, wherein the text composition processing system receives an image data acquisition unit for acquiring the image data, and an input of the text to be combined with the image data. A text input receiving unit, a font processing unit for setting the resolution of the glyph data of the text based on the number of types of glyph data included in the text, and glyph data having a resolution set by the font processing unit. , A text composition processing system comprising: a composite image storage processing unit that synthesizes the glyph data with the image data and stores it in a predetermined storage device.

  A third aspect of the present invention is a text composition processing system that synthesizes text with image data, the text composition processing system receiving an image data acquisition unit that acquires the image data, and an input of the text to be combined with the image data. Based on the number of types of glyph data included in the text and a text processing unit that determines one or more information of receiving, displaying position, display direction, display size, and rotation position of the text, the glyph of the text A font processing unit for setting the resolution of data, and a composite image storage processing unit for synthesizing the text with the image data with glyph data of a font based on the information determined by the text processing unit, and storing it in a predetermined storage device And the text processing unit has a glyph data having a resolution set by the font processing unit. And the image data rendered to be displayed on the display device, a text combining processing system.

  Since the user is free to enter text, the text may use all glyph data. The glyph data needs to be redrawn at a high speed in accordance with the user's input. However, in order to perform such processing, the memory used for font processing needs to have a capacity. However, in the case of a portable communication terminal using a memory with limited capacity, there is a problem that the above cannot be performed if all glyph data are expanded. Therefore, by performing the processing of the present invention, the amount of memory used for the font can be suppressed to a certain limit, and the above-mentioned problems can be solved.

  The first invention can be realized by executing the text composition processing program of the present invention on a portable terminal. That is, the image data is associated with at least one of font, display position, display direction, display size, and rotation position for displaying text to be combined with the image data, and is stored as a template. A portable terminal including a storage device, an image data acquisition unit that acquires image data of a template selected by a user from the storage device, a text input reception unit that receives an input of text to be combined with the image data, the selected The text is combined with the image data with glyph data based on font information in the template based on any one or more of the display position, display direction, display size, and rotation position in the template. Function as a composite image storage processing unit to be stored in the device It can be configured as text synthesis processing program.

  By executing the text composition processing program of the present invention on a portable terminal, the second invention can be realized. Based on the number of types of glyph data included in the text, an image data acquisition unit that acquires image data, a text input reception unit that receives input of text to be combined with the image data, and a glyph of the text Functions as a font processing unit for setting data resolution, and a composite image storage processing unit for combining the glyph data with the image data with the glyph data having the resolution set by the font processing unit and storing the data in a predetermined storage device The text composition processing program can be configured.

  The third invention can be realized by executing the text composition processing program of the present invention on a portable terminal. An image data acquisition unit that acquires image data from a portable terminal, accepts input of text to be combined with the image data, and determines one or more pieces of information on the display position, display direction, display size, and rotation position of the text A text processing unit, a font processing unit for setting a resolution of the glyph data of the text based on the number of types of glyph data included in the text, and a glyph data of the font based on information determined by the text processing unit And a text composition processing program that functions as a composite image storage processing unit that synthesizes the text with the image data and stores it in a predetermined storage device, wherein the text processing unit has a resolution set by the font processing unit. Text glyph data is rendered into the image data and displayed on a display device. It can be configured as processing program.

  Moreover, it is preferable that the text composition processing program of each of the above-described inventions is provided in a portable communication terminal.

  The portable communication terminal is preferably a portable communication terminal including an e-mail processing unit that transmits the synthesized image data generated in the text synthesis processing program as e-mail data.

E-mail with higher decorativeness and higher production effect than conventional decorated e-mail by sending the synthesized image data generated by the text composition processing system of the portable communication terminal of the present invention as e-mail Can be realized.

  An example of the hardware configuration of the portable communication terminal 1 of the present invention is shown in FIG. In the portable communication terminal 1 of the present invention, an arithmetic device 10 such as a CPU that executes arithmetic processing of a program, a storage device 11 such as a RAM or ROM that stores information, a display device 12 such as a display, a keypad, An input device 13 for inputting characters, numbers, symbols and the like such as a keyboard, a communication device 14 for transmitting and receiving processing results of the arithmetic device 10 and information stored in the storage device 11 via a network such as the Internet, and an imaging device 15 And a motion detection device 16 that detects a tilt direction, a tilt amount, and the like in the portable communication terminal 1.

  Examples of the motion detection device 16 include an acceleration sensor, a tilt sensor, and a gyro provided in the portable communication terminal 1. That is, any device that detects the direction in which the portable communication terminal 1 is tilted, the amount of tilt, and the like may be used. In addition to the sensors and gyros as described above, the direction and amount of tilt of the portable communication terminal 1 can be determined using data captured by the imaging device 15 provided outside or inside the portable communication terminal 1. It may be detected. In this case, the motion detection device 16 is realized by processing the tilt direction, the tilt amount, and the like by a predetermined processing process based on the image data captured by the image capturing device 15.

  A text compositing processing system 2 (hereinafter referred to as “text compositing processing system 2”), which is provided in the portable communication terminal 1 of the present invention and synthesizes text input by a user and background image data, is referred to as a portable communication terminal 1. In FIG. 4, the program is realized by executing a predetermined program or module. Each means in the present invention is only logically distinguished in function, and may be physically or practically the same area.

  The text composition processing system 2 executed by the arithmetic device 10 of the portable communication terminal 1 includes an image data storage unit 3, an image data acquisition unit 4, a text processing unit 5, a composite image storage processing unit 6, and a composite image data storage unit 7. And have. FIG. 2 schematically shows an example of the functional configuration of the text composition processing system 2.

  The image data storage unit 3 stores image data as a background when transmitting by e-mail, particularly preferably image data captured by the imaging device 15 of the portable communication terminal 1. In addition to image data captured by the imaging device 15, image data downloaded from a website, image data received from another computer terminal or the portable communication terminal 1, and the like may be used. Further, it may be image data stored in advance.

  The image data acquisition unit 4 acquires background image data used in the text composition processing system 2 from the image data storage unit 3.

  The text processing unit 5 performs processing related to information such as text and its font, text display position, display direction, display size, rotation position, and color to be synthesized with the background image data acquired by the image data acquisition unit 4. Execute. The text processing unit 5 further includes a text input reception unit 51, a font selection reception unit 52, a position determination processing unit 53, a direction determination processing unit 54, a size determination processing unit 55, a rotational position determination processing unit 56, and a color determination processing unit 57. And have. FIG. 3 schematically shows an example of the functional configuration of the text processing unit 5. In this specification, the “text” may be any information other than characters, such as numbers, symbols, special symbols, pictograms, and the like that can be used for an e-mail message.

  The composite image storage processing unit 6 combines the glyph data of the text with the image data acquired by the image data acquisition unit 4 based on the information such as the display position of the text processed by the text processing unit 5, and processes it. The data is stored in a composite image data storage unit 7 described later as composite image data.

  The composite image data storage unit 7 stores the composite image data stored in the composite image storage processing unit 6. The composite image data stored here is transmitted to the transmission destination as e-mail data.

  The text input receiving unit 51 in the text processing unit 5 described above receives input of text to be combined with the image acquired by the image data acquiring unit 4 from the input device 13 of the portable communication terminal 1. Here, the glyph data of the text that has been accepted is combined with the image data as a message.

  The font selection accepting unit 52 accepts the selection of the text font accepted by the text input accepting unit 51. The text is synthesized with the image data by using the glyph data of the selected font.

  The position determination processing unit 53 performs a display position determination process as to where the input text is to be combined. In this display position determination process, the motion position is changed by the motion detector 16 by changing the text position up, down, left, or right according to the information input by the input device 13 or by tilting the portable communication terminal 1 forward, backward, left, or right. And the amount of inclination are detected, and the text position is changed vertically and horizontally according to the detected inclination direction and amount.

  The direction determination processing unit 54 performs a display direction determination process on the text whose display position has been determined by the position determination processing unit 53. In the process of determining the display direction, the direction of text display is changed by the information input by the input device 13, or the tilt direction of the portable communication terminal 1 is tilted forward / backward / left / right by the motion detection device 16. The inclination amount is detected, and the text display direction is changed in the detected inclination direction according to the inclination amount. For example, when the portable communication terminal 1 is tilted forward, the center point of the text becomes the center point of rotation and tilts forward. When it is tilted to the right, it is tilted to the right from the center point of the text.

  The size determination processing unit 55 performs text display size determination processing on the text whose display position and display direction are determined by the position determination processing unit 53 and the direction determination processing unit 54. In the process of determining the display size, the display size is expanded and contracted in the vertical and horizontal directions according to the information input by the input device 13, or the tilt direction is tilted by the motion detection device 16 by tilting the portable communication terminal 1 in the front and rear and right and left directions. And the tilt amount are detected, and the display size is expanded and contracted in the vertical and horizontal directions according to the tilt amount in the detected tilt direction.

  The rotation position determination processing unit 56 rotates the text and determines the position of the text whose display position, display direction, and display size are determined by the position determination processing unit 53, the direction determination processing unit 54, and the size determination processing unit 55. Process. When the rotational position is determined, the text is rotated clockwise or counterclockwise with the center point of the text as the rotation center point according to the information input by the input device 13, or the portable communication terminal 1 is moved back and forth. The motion detection device 16 detects the tilt direction and the tilt amount by tilting left and right, and the text is rotated clockwise or counterclockwise with the center point of the text as the rotation center point according to the detected tilt direction. Rotate around.

  The color determination processing unit 57 determines whether or not the font of the text is colored for each process for the text described above, and determines the chromaticity, saturation, and lightness of the text if it is not colored. Do. In this process, the chromaticity, saturation, and brightness of the text are changed according to information input by the input device 13, or the tilt direction of the portable communication terminal 1 is tilted by the motion detection device 16 by tilting the portable communication terminal 1 back and forth. And the amount of inclination are detected, and the chromaticity, saturation, and brightness of the text are changed in the detected inclination direction according to the amount of inclination. Here, in determining chromaticity, saturation, and lightness, values may be specified using the HSV color space, or values may be specified using other methods such as the RGB color space, the HLS color space, and the like. You may do it.

  The execution order of the processing means in the text processing unit 5 is arbitrary, and only a part of the processing means may be executed without executing all of them.

  Next, an example in which the text composition processing system 2 is functioned using the portable communication terminal 1 of the present invention and a decorated electronic mail (hereinafter referred to as “electronic mail”) is transmitted is schematically shown.

  In the following description, a case where the portable communication terminal 1 is a mobile phone will be described, but other terminals such as a PHS, a PDA, and a smartphone may be used.

  A user (user) of the mobile phone images image data to be used as an e-mail background with the imaging device 15 provided in the mobile phone. The image data captured by the imaging device 15 is stored in the image data storage unit 3 in the storage device 11 of the mobile phone. The image data storage unit 3 may store image data that is not used in addition to image data that is used as the background of the e-mail. That is, it is only necessary to store captured image data, image data acquired by a mobile phone, and the like.

  When the user transmits an e-mail using the text composition processing system 2 of the present invention, the text composition system is activated by performing a predetermined operation using the input device 13 of the mobile phone. An example of the menu screen displayed at this time is shown in FIG.

  In the screen of FIG. 5, the “original background” means that, as described above, the image data used as the background is not first imaged by the imaging device 15 but is selected by selecting the “original background”. Is a menu that is selected so that the captured image data is stored in the image data storage unit 3 and can be used as a background image. The “data folder” is a menu used when image data stored in advance in the image data storage unit 3 such as image data captured in advance as described above or image data acquired by a mobile phone is used as a background. is there. “Spider” and “Sunahama” are necessary information such as the display position when combining the image data of “Spider” and “Sunahama” and the corresponding font information and text glyph data. This is a menu that is stored in advance and used as a template. “Other background (download)” is a menu when image data used as a background is downloaded from an arbitrary website and stored in the image data storage unit 3.

  As described above, in this embodiment, since the image data is first picked up by the image pickup device 15 of the mobile phone, and the image data to be used as the background is selected from the picked-up image data, the user selects FIG. By selecting “Data Folder” from the menu screen, image data to be used as the background is selected.

  When image data to be used as a background is selected here, the image data acquisition unit 4 acquires the selected image data from the image data storage unit 3 based on the received selection (S100). That is, the selected image data stored in the image data storage unit 3 is loaded.

  When the image data acquisition unit 4 acquires (loads) the selected image data from the image data storage unit 3, the vertical or horizontal size of the image data selected as the load target depends on the resolution of the display device 12 of the mobile phone. If it is large, the image data is loaded as reduced image data while maintaining the aspect ratio so that both the vertical and horizontal resolutions are lower than the resolution of the display device 12. Conversely, the vertical and horizontal sizes of the image data selected as the load target are the application display area on the display device 12 of the mobile phone (from the display area of the display device 12 to the remaining battery level of the mobile phone such as the pictogram region, If it is larger than the display area indicating the situation etc. (area used for displaying the application), the image data is centered and loaded.

  Further, in this embodiment, the image data is acquired from the image data storage unit 3. However, when the imaging device 15 is activated and imaged like “original background” on the menu screen of FIG. It is preferable to set the resolution of the image data at the time of imaging to be the same as the resolution of the display device 12, and to store the captured image data in the image data storage unit 3.

  As described above, the image data acquisition unit 4 acquires (loads) the image data used as the background of the e-mail. Assume that the image data selected as the background is shown in FIG.

  Next, the text processing unit 5 executes processing related to the text to be combined with the background. First, text to be combined with background image data is input. When the image data used as the background is selected in the image data acquisition unit 4, the text input reception unit 51 displays a screen for prompting message input as shown in FIG. By pressing a button or the like, the text editor shown in FIG. 8 is activated. The user inputs a message from the input device 13 into the text editor. The message input here is received by the text input receiving unit 51 (S110). For example, if it is assumed that the input and "Hello", accept it is text input receiving unit 51.

  When the input of the text as the message is received in this way, the font selection receiving unit 52 receives the selection of the font of the input text (S120). When the text is received by the text input receiving unit 51, the font selection receiving unit 52 displays a screen for prompting font selection as shown in FIG. 9, and is input in a font usable for the background image data. Displays the glyph data of the text that has been entered (that is, the rendered text is rendered with glyph data of an available font). A screen showing this state is shown in FIG.

  The fonts that can be used at this time are preferably stored in the storage device 11 in advance. In addition, although two types of usable fonts have been described here, three or more types may be used.

  Among the usable fonts, the user selects a font to be used from the input device 13 (for example, by selecting the up / down key up / down), and the selection is received by the font selection receiving unit 52, and the selected font is selected. Identification information (such as a font name) is stored.

  When the font to be used is selected, the position determination processing unit 53 performs processing for determining the text display position (S130). When the selection of the font to be used is received by the font selection receiving unit 52, the text rendered with the glyph data of the font is displayed at the center of the background image data, and the text as shown in FIG. A screen that prompts the user to determine the display position is displayed. As for the processing for the text after S130, the processing for the text rendered with the glyph data of the font selected in S120 has been described. However, even the description “text” is simply “selected in S120”. This is processing for “text rendered with font glyph data”.

  Then, when the user tilts the mobile phone forward, backward, left and right, the motion detection device 16 detects the tilt direction and the tilt amount. Then, when the position determination processing unit 53 receives information about the tilt direction and the tilt amount from the motion detection device 16, the display position of the text is moved in the vertical and horizontal directions according to the tilt direction and the tilt amount. For example, when the user tilts the mobile phone forward, the text display position moves upward, and when the user tilts the mobile phone right, the text display position moves right.

  FIG. 12 shows a case where the text display position is in the initial state (center), and FIG. 13 shows that the text display position is upward when the user tilts the mobile phone forward from the state shown in FIG. Indicates that it has moved.

  In addition to determining the display position according to the tilt direction and the tilt amount by tilting the mobile phone, the input device 13 inputs the vertical and horizontal directions, and the position determination processing unit 53 receives the input to display the text. The position may be moved vertically and horizontally.

  Information on the text display position input by the user in this way, for example, information on the relative coordinates of the text display position in the image data is stored.

  Once the text display position in the background image data has been determined, the direction determination processing unit 54 performs processing for determining the text display direction (S140). First, when the display position of the text is determined by the position determination processing unit 53, a screen for prompting the determination of the text display direction as shown in FIG. 14 is displayed.

  Then, when the user tilts the mobile phone forward, backward, left and right, the motion detection device 16 detects the tilt direction and the tilt amount. Then, when the direction determination processing unit 54 receives information about the tilt direction and the tilt amount from the motion detection device 16, the display direction of the text is changed according to the tilt direction and the tilt amount.

  In other words, with the center point of the text as the rotation center point, when tilted forward, it looks clockwise from the negative direction on the x-axis, and when tilted backward, negative direction from the top of the x-axis When it is tilted counterclockwise and tilted to the right, it looks clockwise from the negative direction on the y axis, and when tilted to the left, it looks counterclockwise when viewed from the negative direction on the y axis. Rotate the text. In the initial state, it is assumed that the text display direction is the front direction with respect to the user. This is schematically shown in FIG.

  For example, when the user tilts the mobile phone to the right, as shown in FIG. 16, the user is tilted to the right from the center point of the text.

  In addition to determining the display direction according to the tilt direction and the tilt amount by tilting the cellular phone, the input device 13 inputs the up / down / left / right directions, and the direction determination processing unit 54 receives the input to display the text. The direction may be changed.

  Information on the display direction of the text input by the user in this way, for example, information such as the angle of inclination with respect to the x-axis and y-axis is stored.

  Once the text display direction is determined, the size determination processing unit 55 performs processing for determining the display size (size) of the text (S150). When the direction determination processing unit 54 determines the text display direction, a screen prompting the determination of the text display size as shown in FIG. 17 is displayed.

  Then, when the user tilts the mobile phone forward, backward, left and right, the motion detection device 16 detects the tilt direction and the tilt amount. Then, when the size determination processing unit 55 receives information on the inclination direction and the inclination amount from the motion detection device 16, the display size of the text is changed according to the inclination direction and the inclination amount.

  In other words, the center point of the text is used as the center point of the display size change, the text height is reduced when tilted forward, the text height is increased when tilted backward, and the right direction The text display size is changed so that the text width is increased when tilted to the left, and the text width is decreased when tilted to the left. This is schematically shown in FIG.

  For example, when the user tilts the mobile phone leftward, the text width is small as shown in FIG.

  In the text display size determination process in the size determination processing unit 55, the text display size is compared with the display size of the background image data so that the text display size does not exceed the background display size. A restriction may be provided on the change range. Further, the change range may be limited so as not to exceed a predetermined ratio of the display size of the image data, for example, 70%. Furthermore, the change range may be limited to a small size so that the text display size does not become smaller than a predetermined display size.

  In addition to determining the display size according to the tilt direction and tilt amount by tilting the cellular phone, the input device 13 inputs the vertical and horizontal directions, and the size determination processing unit 55 receives the input to display the text. You may change the size.

  Information on the display size of the text input by the user in this way, for example, information on the vertical and horizontal sizes of the text is stored.

  Once the text display size is determined, the rotational position determination processing unit 56 performs a process for determining the rotational position of the text (S160). When the display size of the text is determined by the size determination processing unit 55, a screen prompting the determination of the text rotation position as shown in FIG. 20 is displayed.

  When the user tilts the mobile phone left and right, the motion detection device 16 detects the tilt direction and the tilt amount. Then, when the rotation position determination processing unit 56 receives the information on the inclination direction and the amount of inclination from the motion detection device 16, the rotation position of the text is determined according to the inclination direction and the amount of inclination.

  In other words, the center point of the text is the center point of rotation, and when it is tilted to the right, the text is rotated clockwise from the user's center, and when it is tilted to the left, the center point is The text is rotated counterclockwise as viewed from the user center. The initial state is the horizontal position. This is schematically shown in FIG.

  For example, when the user tilts the mobile phone leftward, as shown in FIG. 22, the text is rotated counterclockwise around the center point of the text.

  In addition to determining the rotation position according to the tilt direction and the tilt amount by tilting the mobile phone, the left and right directions are input by the input device 13 and the rotation position determination processing unit 56 accepts the input to rotate the text. The position may be changed.

  Information on the rotational position of the text input by the user in this way, for example, information on the angle rotated from the horizontal state is stored.

  When the text display position, display direction, display size, and rotation position are determined as described above, the color determination processing unit 57 determines whether the font of the text is colored (S170). If not, the color determination processing unit 57 performs processing for selecting the chromaticity, the saturation, and the brightness of the font (S180, S190). If the text font is colored, the process proceeds to S200. Note that the font is colored means that the chromaticity to be rendered and the saturation and brightness are determined for the font selected in S120, and that the font is not colored. This means that the chromaticity to be rendered and the saturation and brightness are not defined for the font selected in S120. In each process for the text described above, if the font selected in S120 is colored, rendering is performed with the chromaticity, saturation, and lightness. If the font selected in S120 is not colored, the rendering is performed in advance. After rendering with the set chromaticity (preferably a conspicuous color), saturation and lightness, in the processing of S180 and S190 described later, the chromaticity, saturation and lightness actually rendered for the font Make a decision.

  In S170 described above, whether or not the font is colored may be determined as follows. That is, the glyph data of the font is in a raster format and has an alpha value (alpha channel) and an RGB value. When the font is colored, the alpha value and the RGB value are set. When the font is not colored, only the alpha value is set (no RGB value is set). Therefore, for the glyph data of the font, the color determination processing unit 57 determines that the font is not colored when the RGB value is not set, and the font is colored when the RGB value is set. What is necessary is just to determine that it is.

  If the color determination processing unit 57 determines that the font is not colored in S170, the color determination processing unit 57 performs processing for determining the chromaticity of the font (S180). This is to determine the display color of the text (font) as shown in FIG. 23 when the rotation position determination processing unit 56 determines the rotation position of the text and determines that the font of the text is not colored. A screen prompting you to display is displayed.

  In this embodiment, the chromaticity for displaying text and the color determination processing unit 57 for determining the saturation and lightness are described based on the HSV color space. However, the color determination processing unit 57 determines based on the other color space. You can also

  First, when the user tilts the mobile phone left and right, the motion detection device 16 detects the tilt direction and the tilt amount. Then, when the color determination processing unit 57 receives the information on the inclination direction and the inclination amount from the motion detection device 16, the Hue value on the HSV ring is determined according to the inclination direction and the inclination amount.

  FIG. 24 shows an example of a screen schematically showing this.

  For example, when the user tilts the mobile phone to the right, the selection mark moves on the HSV ring clockwise as viewed from the user according to the amount of tilt, and the Hue value (chromaticity) increases accordingly. When tilted to the left, the selection mark moves on the HSV ring counterclockwise as viewed from the user, and the Hue value decreases accordingly. Then, the text is rendered with the selected font at the corresponding Hue value and displayed. FIG. 25 schematically shows a case where the chromaticity of the text (font) is changed from the initial value (green) to red by such an operation.

  In addition to determining the chromaticity according to the tilt direction and the tilt amount by tilting the mobile phone, the left and right directions are input by the input device 13, and the input is received by the color determination processing unit 57, thereby the text (font). The chromaticity may be determined.

  Information on the chromaticity (Hue value, etc.) of the text input by the user in this way is stored.

  When the chromaticity of the text is determined in this way, the color determination processing unit 57 performs processing for determining the saturation and lightness of the font (S190). This displays a screen that prompts the color determination processing unit 57 to determine the chromaticity of the text (font) and to determine the saturation and brightness of the text (font) as shown in FIG.

  Then, when the user tilts the mobile phone forward, backward, left and right, the motion detection device 16 detects the tilt direction and the tilt amount. Then, when the color determination processing unit 57 receives the information on the inclination direction and the inclination amount from the motion detection device 16, the saturation value (saturation) and the value value (lightness) on the HSV ring according to the inclination direction and the inclination amount. ).

  FIG. 27 shows an example of a screen schematically showing this.

  For example, when the user tilts the mobile phone forward, the selection mark moves upward in the triangle of the HSV ring according to the amount of the tilt, and the Saturation value increases accordingly and tilts backward. In accordance with the amount of inclination, the selection mark moves downward in the triangle of the HSV ring, and the saturation value decreases accordingly. In addition, when tilted to the right, the selection mark moves to the right in the triangle of the HSV ring, and the value increases accordingly, and when tilted to the left, the selection mark moves to the triangle of the HSV ring. Moving to the left, the Value value decreases accordingly. Then, the text is rendered with the selected font at the corresponding Saturation value and Value value and displayed. FIG. 28 schematically shows a case where the saturation and brightness of text (font) are determined by such an operation. The initial value of the saturation value is 100%, and the initial value of the value value is 50%.

  In addition to determining the saturation and brightness according to the tilt direction and the tilt amount by tilting the mobile phone, the input device 13 inputs the up / down / left / right directions, and accepts the input by the color determination processing unit 57 to thereby receive the text. The saturation and lightness of (font) may be determined.

  In this way, information on the saturation and brightness (saturation value, value value) of the text input by the user is stored.

  The HSV value determined as described above may be converted into an RGB value by a predetermined method and used as the RGB value of the glyph data.

  By executing the processes in the text processing unit 5 as described above, the text input by the user is added to the image data selected as the background, and the desired display position, display direction, display size, rotation position, chromaticity, It can be synthesized with saturation and brightness.

  When the saturation and lightness are determined by the color determination processing unit 57, the user inputs a predetermined operation for synthesizing and saving an image from the input device 13 on the mobile phone, thereby receiving the input. The composite image storage processing unit 6 then acquires the image data acquired (loaded) by the image data acquisition unit 4 based on the information acquired by each process of the text processing unit 5 and the text received by the text input reception unit 51. Are combined with the glyph data of the font selected by the font selection receiving unit 52 and stored in the combined image data storage unit 7 as combined image data (S200). An example of the synthesized image data synthesized in this way is shown in FIG.

  By inserting the composite image data generated as described above into an e-mail, it is possible to send an e-mail with a higher effect than the conventional decorated e-mail. In particular, in the conventional decorated e-mail, the input position of the text is determined, but the user arranges the display position, direction, size, etc. in various ways so that the text matches the background image data. The generated composite image data can be transmitted as an e-mail.

  By executing each processing in the first embodiment, text glyph data can be combined with image data selected as a background. However, simply by combining the ambient light in the background image data into text glyph data. Because it doesn't reach, it doesn't fit nicely.

  Therefore, in the above-described first embodiment, the combined image storage processing unit 6 may perform the combining process after reflecting the ambient light.

  Specifically, in the image data, the average brightness of the pixels in the range where the glyph data of the text is arranged is calculated by the composite image storage processing unit 6, and the Gaussian blur (Gaussian blur) of the brightness of the pixels of the image data in the range is performed. (The blur can be calculated by using a Gaussian blur function or the like) is calculated by the composite image storage processing unit 6, and the Gaussian blur lightness at the position of each pixel of the text glyph data is calculated based on the average lightness calculated above. If it is higher, the brightness of the pixel of the glyph data is increased by a predetermined value, and if not, the process of lowering the brightness of the pixel by a predetermined value is executed. Note that the same processing can be executed using a smoothing method other than Gaussian blurring.

  By performing the processing as described above, it is possible to realize processing for adapting ambient light to the background image data, and the background image data and the text become more familiar.

  In each process in the text processing unit 5 described above, the process is executed while rendering the glyph data of the text in real time with the font selected by the user in S120. This is because the input value by the user is reflected in real time so that the user can easily recognize the input result.

  For that purpose, text glyph data needs to be rendered at high speed on the background image data, but in the case of a mobile phone, unlike a personal computer, its performance is limited, so it is difficult as it is. .

  From such a problem, when image processing is performed, it has been conventionally attempted to improve the processing speed by reducing the image quality in accordance with the processing performance. In this case, however, the generated composite image data also has low image quality, but the user desires to transmit high-quality image data. This is particularly true in recent years when the image quality of the imaging device 15 of the mobile phone is increasing.

  Therefore, in the process of the first embodiment, the text display position determining process, the display direction determining process, the display size determining process, the rotation position determining process, and the color determining process which are burdensome on the process are performed in the high-speed mode. Although executed, the process of saving the composite image can be configured to perform the process in the high image quality mode.

  That is, in the position determination processing unit 53, the direction determination processing unit 54, the size determination processing unit 55, the rotation position determination processing unit 56, and the color determination processing unit 57, the environmental light in the second embodiment is reduced in order to reduce the processing load. The processing in each means is executed without performing the processing for and the antialiasing processing. In other words, by performing processing for ambient light and anti-aliasing processing, the text glyph data and the background image data will be blended cleanly. In the case of a telephone, drawing is delayed, which may cause stress on the operation. Each process in the text processing unit 5 is how to combine the glyph data of the text with the background image data, its display position, display direction, display size, rotation position, chromaticity, saturation and brightness of the glyph data. It is important to determine the (HSV value), and if it is determined, the composite image storage processing unit 6 performs the composite processing of the background image data and the text glyph data based on each information. There is no inconvenience if only processing for ambient light and anti-aliasing are performed. This is because the combined image data that is actually transmitted by e-mail is only the image data that has been combined by the combined image storage processing unit 6, and at which position the text is to be displayed is determined. This is because the image data is not transmitted by electronic mail.

  Therefore, the text glyph data is converted into the background image data in each processing in the position determination processing unit 53, the direction determination processing unit 54, the size determination processing unit 55, the rotation position determination processing unit 56, and the color determination processing unit 57 described above. In the case of rendering, the load on the mobile phone is reduced by not performing either or both of the processing for the ambient light and the anti-aliasing as the high-speed mode, and the processing is realized at high speed. On the other hand, when the synthesized image storage processing unit 6 synthesizes the text glyph data and the background image data, based on the information in each process described above, the process for the ambient light and the anti-aliasing process in the second embodiment. By performing the above, it is possible to obtain high-quality composite image data.

  When an image is captured by the imaging device 15 provided in the mobile phone, the captured image data includes lens distortion. When text glyph data is synthesized without taking lens distortion into consideration, the edge of the image data is not particularly well-suited. Therefore, the synthesized image storage processing unit 6 may synthesize text glyph data with background image data in consideration of lens distortion.

  For example, when a lattice is imaged, if there is no lens distortion, the image should be captured as shown in FIG. If the lattice shown in FIG. 30 is synthesized there, it will become familiar and become as shown in FIG. Here, FIG. 29 shows the background image data, and the grid in FIG. 30 corresponds to text glyph data.

  However, in reality, when the same lattice as in FIG. 29 is imaged, lens distortion exists, so the imaged image data is as shown in FIG. 32 (in FIG. 32, the lens distortion is emphasized for ease of understanding). As shown). Even if the grid of FIG. 30 is synthesized there, as shown in FIG. 33, the lens distortion of the background image data does not reach the glyph data of the text, and the synthesized image becomes unfamiliar.

  Therefore, in the present embodiment, a case will be described in which, in addition to the above-described first to third embodiments, processing for synthesizing text glyph data in consideration of lens distortion of background image data is described.

ただし画像データの中心を（０，０）とし、画像データの縦横サイズが（２ｗ，２ｈ）、メッシュの頂点の歪み適用前の座標が（ｘ，ｙ）、適用後の座標が（ｄｘ，ｄｙ）、歪み係数をｄとする。 First, in this embodiment, the entire text glyph data is not made one rectangle, but is divided into meshes each having a predetermined pixel (for example, 40 pixels), and barrel distortion correction processing is performed on each mesh according to Equation (1). Then, the composition process is performed.

However, the center of the image data is (0, 0), the vertical and horizontal size of the image data is (2w, 2h), the coordinates of the vertex of the mesh before the distortion application is (x, y), and the coordinates after the application are (dx, dy) ), And let d be the distortion coefficient.

  In the above equation 1, the distortion coefficient d varies depending on the lens of the imaging device 15 provided in the mobile phone, but a value such as −0.04 can be used.

  The composite image storage processing unit 6 executes the above process when performing the process of combining the text glyph data with the background image data, so that more familiar composite image data including lens distortion can be obtained. I can do it. FIG. 34 shows an example when the above-described lens distortion correction processing is performed.

  Any font may be used to express the text in each of the embodiments described above, but it is preferable to use a dedicated font in order to enhance the effect. However, font glyph data is in raster format, and when loading fonts into the memory of a mobile phone, it is not possible to expand all glyph data in raster format on mobile phones that do not have high memory performance. Absent.

  However, since the user freely inputs the text to be combined with the background image data using the input device 13 of the mobile phone, the possibility that the text uses all glyph data cannot be denied. In addition, due to the nature of combining text glyph data with background image data and sending the composite image data as an e-mail, all text glyph data to be combined with the image data is simultaneously visible. In addition, it is necessary to redraw the glyph data at high speed in accordance with the user input at the time of each processing on the text in the text processing unit 5. Therefore, all glyph data must be able to be expanded on the mobile phone memory in a raster format.

  Therefore, in this embodiment, a case where the above-described problem can be solved also in a mobile phone will be described. That is, in the present embodiment, a case will be described in which the resolution of the glyph data on the memory of the mobile phone is changed while loading it depending on the number of types of glyph data included in the input text. As described above, the cellular phone according to the present embodiment includes a font processing unit (not shown) that executes processing for a font.

  First, the font processing unit determines the number of types of glyph data to be used from the text input by the user received by the text input receiving unit 51 (the number of types is C). Then, the total amount of memory used for glyph data is set (this total amount of memory is set to M). The total memory amount may be set in advance, or may be set by calculating by some calculation.

Next, the font processing unit calculates the maximum amount of memory used for one piece of glyph data based on the maximum size of the glyph data (this amount of memory is G). Then, S is calculated by calculating Formula 2 (where S is rounded up to an integer).

  When loading each glyph data based on S calculated using Equation 2, the glyph data is loaded into the memory of the mobile phone while resampling the vertical and horizontal resolutions to 1 / S.

  By executing the processing of this embodiment, the total amount of memory used for loading glyph data can be suppressed to a certain level or less. A graph showing the relationship between the number of types of glyph data used and the total amount of memory is shown in FIG.

  As the number of types of glyph data increases, the resolution of glyph data decreases, but the effect on image quality is negligible. This is because when the number of types of glyph data is large, the number of characters included in the text is also large. At this time, the text is drawn with a size that fits in the background image data, so even if the resolution of the individual glyph data is reduced, the influence on the image quality is reduced.

  In the first to fifth embodiments described above, the user selects image data as a background, and the user determines the display position, display direction, display size, rotation position, color, and the like of the input text. However, by storing the template in the mobile phone in advance, the operation input by the user can be reduced. This case will be described in the present embodiment.

  That is, in the case of the present embodiment, the user selects image data stored in advance in the image data storage unit 3 as a template, and the user simply inputs the text to be combined with the image data. Is synthesized. That is, the user only needs to select a template and input text.

  Fonts for displaying text, text display position, display direction, display size, rotation position, chromaticity, saturation, brightness (HSV value), etc., on image data stored in the image data storage unit 3 and usable as a template Are stored in association with each other. That is, the information that the user has input in the text processing unit 5 in the first embodiment or the like is stored in association with the image data of the template.

  For example, when the user selects “Sunahama” as a template from the menu screen of FIG. 5, the image data acquisition unit 4 receives “Sunahama” from the image data storage unit 3 by accepting the selection. The image data of the template and information such as the font for displaying the text, the display position of the text, the display direction, the display size, the rotation position, the chromaticity, the saturation and the brightness (HSV value) are acquired from the image data storage unit 3.

  As described above, when the user selects a template, the image data acquisition unit 4 acquires (loads) image data used as the background of the e-mail. Then, a screen for prompting input of text as shown in FIG. 36 is displayed.

  When this screen is displayed, the user presses any button or the like from the input device 13 to activate the text editor shown in FIG. The user inputs a message from the input device 13 into the text editor. The message input here is received by the text input receiving unit 51. For example, if it is assumed that the input and "Hello", accept it is text input receiving unit 51.

  In this way, the input of the text as a message is received, and the user inputs a predetermined operation for combining and storing the image on the mobile phone from the input device 13, so that the combined image storage processing unit 6 can display the template image. Information such as font for displaying text associated with data, text display position, display direction, display size, rotation position, chromaticity, saturation, and brightness (HSV value), and the text input reception unit 51 Based on the text information, the text is synthesized with the image data acquired (loaded) by the image data acquisition unit 4 and stored in the composite image data storage unit 7 as composite image data. An example of the composite image data in this case is shown in FIG.

  By inserting the composite image data generated as described above into an e-mail, it is possible to send an e-mail with a higher effect than the conventional decorated e-mail. Further, since information such as a display position is set as a template, it is possible to more easily transmit composite image data having a higher effect than the conventional one as an e-mail.

Realizing an e-mail with a higher effect than a conventional decorated e-mail by transmitting the synthesized image data generated by the text composition processing system 2 of the portable communication terminal 1 of the present invention as an e-mail. I can do it.

It is a conceptual diagram which shows typically an example of the hardware constitutions of a portable communication terminal. It is a key map showing typically an example of composition of a text composition processing system. It is a conceptual diagram which shows an example of a structure of a text processing part typically. It is a flowchart which shows an example of the process of this invention. It is an example of a menu screen. It is an example of the image data selected as a background. It is an example of the screen which prompts input of a text. It is an example of the screen of a text editor. It is an example of a screen prompting to select a font. It is an example of the screen which selects a font. It is an example of the screen which prompts to determine the display position of a text. It is an example of the screen of the initial state at the time of determining the display position of a text. It is an example of the screen at the time of changing the display position of a text. It is an example of the screen which prompts to determine the display direction of a text. It is a figure which shows typically the process which determines the display direction of a text. It is an example of the screen at the time of changing the display direction of a text. It is an example of the screen which prompts to determine the display size of a text. It is a figure which shows typically the process which determines the display size of a text. It is an example of the screen at the time of changing the display size of a text. It is an example of the screen which prompts to determine the rotation position of a text. It is a figure which shows typically the process which determines the rotation position of a text. It is an example of the screen at the time of changing the rotation position of a text. It is an example of the screen which prompts to determine the chromaticity of a text. It is a figure which shows typically the process which determines the chromaticity of a text. It is an example of the screen at the time of changing the chromaticity of a text. It is an example of the screen which prompts to determine the saturation and the brightness of a text. It is a figure which shows typically the process which determines the saturation and the brightness of a text. It is an example of the screen at the time of changing the saturation and the brightness of a text. It is an example of the imaged image data when there is no lens distortion when imaging a grid assuming background image data. It is an example of a grid that assumes text glyph data. It is an example at the time of combining FIG. 30 with the image data of FIG. It is an example of the imaged image data when a lens distortion exists when a grid that assumes background image data is imaged. It is an example at the time of combining FIG. 30 with the image data of FIG. FIG. 30 shows an example in which the lens distortion correction processing is performed on FIG. 30 and the image data of FIG. 32 is combined. It is an example of the graph which shows the relationship between the number of the kind of glyph data used, and total memory amount. It is an example of a screen for prompting text input when image data as a template is used. It is an example of the screen of synthetic | combination image data when a text is synthesize | combined using the image data which is a template. It is an example of the screen of synthetic image data.

Explanation of symbols

1: portable communication terminal 2: text composition processing system 3: image data storage unit 4: image data acquisition unit 5: text processing unit 6: composite image storage processing unit 7: composite image data storage unit 10: arithmetic device 11: storage Device 12: Display device 13: Input device 14: Communication device 15: Imaging device 16: Motion detection device 51: Text input reception unit 52: Font selection reception unit 53: Position determination processing unit 54: Direction determination processing unit 55: Size determination Processing unit 56: Rotation position determination processing unit 57: Color determination processing unit

Claims (8)

A text synthesis processing system for synthesizing text with image data,
The text composition processing system includes:
An image stored as a template in which image data is associated with at least one of font, display position, display direction, display size, and rotation position for displaying text to be combined with the image data. A data storage unit;
An image data acquisition unit that acquires image data of a template selected by a user from the image data storage unit;
A text input receiving unit that receives input of text to be combined with the image data;
Based on any one or more of the display position, display direction, display size, and rotation position in the selected template, the text is combined with the image data with glyph data based on the font information in the template, A composite image storage processing unit to be stored in a predetermined storage device;
A text composition processing system comprising: A text synthesis processing system for synthesizing text with image data,
The text composition processing system includes:
An image data acquisition unit for acquiring the image data;
A text input receiving unit that receives input of text to be combined with the image data;
A font processing unit for setting the resolution of the glyph data of the text based on the number of types of glyph data included in the text;
A synthesized image storage processing unit configured to synthesize the glyph data with the image data with the resolution glyph data set by the font processing unit, and store the synthesized glyph data in a predetermined storage device;
A text composition processing system comprising: A text synthesis processing system for synthesizing text with image data,
The text composition processing system includes:
An image data acquisition unit for acquiring the image data;
A text processing unit that accepts input of text to be combined with the image data, and determines at least one of the display position, display direction, display size, and rotation position of the text;
A font processing unit for setting the resolution of the glyph data of the text based on the number of types of glyph data included in the text;
A composite image storage processing unit that combines the text with the glyph data of the font and the image data based on the information determined by the text processing unit, and stores the image data in a predetermined storage device;
The text processing unit
Rendering the glyph data of the resolution set by the font processing unit into the image data and displaying it on a display device;
A text composition processing system characterized by that. Memory that stores image data and at least one of font, display position, display direction, display size, and rotation position for displaying text to be combined with the image data and stored as a template A portable terminal equipped with a device,
An image data acquisition unit for acquiring image data of a template selected by a user from the storage device;
A text input receiving unit for receiving input of text to be combined with the image data;
Based on any one or more of the display position, display direction, display size, and rotation position in the selected template, the text is combined with the image data with glyph data based on the font information in the template, A composite image storage processing unit to be stored in a predetermined storage device;
A text composition processing program characterized in that it functions as a program. A portable terminal
An image data acquisition unit for acquiring image data;
A text input receiving unit for receiving input of text to be combined with the image data;
A font processing unit for setting the resolution of the glyph data of the text based on the number of types of glyph data included in the text;
A synthesized image storage processing unit that synthesizes the glyph data with the image data with the resolution glyph data set by the font processing unit, and stores the synthesized data in a predetermined storage device;
A text composition processing program characterized in that it functions as a program. A portable terminal
An image data acquisition unit for acquiring image data;
A text processing unit that accepts input of text to be combined with the image data and determines any one or more of the display position, display direction, display size, and rotation position of the text;
A font processing unit for setting the resolution of the glyph data of the text based on the number of types of glyph data included in the text;
Based on the information determined by the text processing unit, a combined image storage processing unit that combines the text with the image data with glyph data of a font and stores the image data in a predetermined storage device;
A text synthesis processing program that functions as
The text processing unit
Rendering the glyph data of the resolution set by the font processing unit into the image data and displaying it on a display device;
A text composition processing program characterized by that.   A portable communication terminal comprising the text composition processing program according to claim 4. The portable communication terminal is
An email processing unit that transmits the composite image data generated in the text composition processing program as email data;
The portable communication terminal according to claim 7.

Images