JP4735636B2 - Portable terminal and composite image display program - Google Patents

Description

  The present invention relates to a portable terminal having an imaging function and a composite image display program.

  2. Description of the Related Art Conventionally, a mobile phone has a mail creation / transmission function, and recently, a built-in imaging function such as a digital camera has a function of attaching a captured image to a created mail content and transmitting it. Exists. In such a mobile phone, the image data to be attached to the e-mail can be combined with image data prepared in advance, or the image data can be three-dimensionalized, and further provided with an effect such as an action to express the image data. It is conceivable to increase the power and make information transmission by e-mail more effective. For example, a system for creating texture image data from a captured image is known as a three-dimensional image, and is an effective method for providing rich expressiveness to a captured image (see, for example, Patent Document 1). ).

Japanese Patent Laid-Open No. 2000-20735, page 11, FIG.

  However, image processing such as image composition, three-dimensionalization, and action addition as described above is generally performed on a device that does not have a special image processing function, such as a mobile phone, unless the device has a high processing capability such as a computer. It was impossible. In addition, the processed image data is data that cannot be expanded in the commonly known image formats such as JPEG and PNG, and the file size is plural and very large, and there is a risk of causing a data error especially when downloading by wireless. Therefore, it has been difficult to implement with a device such as a mobile phone.

  Therefore, the present invention provides a mobile terminal capable of synthesizing 3D animation with expressive power with a captured image, and a composite image display program, even if the device does not have a special image processing function. Objective.

In order to achieve the above object, the invention described in claim 1 is directed to whether or not 3D animation data to be combined with image data picked up by the image pickup means is selected by detecting an image pickup means and an external operation. A selection determining means for determining, a combining means for combining the image data picked up by the imaging means and the 3D animation data determined to be selected by the selection determining means, and a state combined by the combining means are displayed. Display means.

  The invention according to claim 2 further comprises setting means for setting a light source direction of the ambient light of the 3D animation data to be synthesized in the invention according to claim 1, wherein the synthesizing means is controlled by the setting means. 3D animation data having a set light source direction as background data is synthesized with image data picked up by the image pickup means.

According to a third aspect of the invention, there is provided image data selection judging means for judging whether or not image data to which no copyright flag is added is selected from a plurality of image data. The synthesizing means includes, in addition to the image data picked up by the image pickup means and the 3D animation data determined to be selected by the selection determining means, an image determined to be selected by the image data selection determining means; The data is further synthesized.

  According to a fourth aspect of the present invention, in the invention according to any one of the first to third aspects of the present invention, the apparatus further comprises storage means for storing the state synthesized by the display means.

In order to achieve the above object, the invention according to claim 5 is an image picked up by the image pickup unit by detecting an external operation of a computer included in a portable terminal including the image pickup unit and a display unit. Selection determining means for determining whether or not 3D animation data to be combined with data is selected, and combining for combining the image data captured by the imaging unit and the 3D animation data determined to be selected by the selection determining means And a display control means for causing the display unit to display the state synthesized by the synthesis means.

  According to the present invention, even a device that does not have a special image processing function can synthesize a 3D animation with expressive power with a captured image.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings as an example applied to a mail transmission / reception system using a mobile phone.

A. First embodiment A-1. Configuration of First Embodiment FIG. 1 is a block diagram showing a configuration of a mail transmission / reception system according to a first embodiment of the present invention. In the figure, mobile phones (wireless communication terminals / data communication devices) 1a and 1b each have an imaging function and an image memory, cut out a part of image data captured by its own imaging function, and a part of the image data. A function of creating a 3D animation file on the composite image creation system server 6 while communicating with the composite image creation system server 6 is provided.

  The mobile phones 1a and 1b also have a function of registering the 3D animation file stored in the image memory with the composite image creation system server 6 and a function of instructing to transmit the 3D animation file attached to an email. Yes. The mobile phones 1a and 1b have a function of receiving a mail with a 3D animation file from the composite image creation system server 6. In the 3D animation, it is possible to specify an action that can express an action.

  The mobile phone 9 is a terminal connected to a communication service provider 7 different from the mobile phones 1a and 1b, and has a function of creating a 3D animation file and a function of directly browsing the 3D animation file. Although there is no reproduction function by a general GIF file (GIF animation).

  The radio base station 2, 2, or the radio base station 2 is connected to a communication service provider (including an Internet provider) 3 or 7 to which a user of the mobile phone 1 a, 1 b or mobile phone 9 subscribes via the public line network 4. Connecting.

  The communication service provider (including the Internet provider) 3 uses the mobile phone 1a, the wireless base station 2 as an AP (access point), in addition to the exchange 31 required for the mobile phone service provided as the main service. A system (Web server 32, database 35) for connecting 1b to WWW 5 and a mail system (mail server 33) are provided. Similarly, the communication service provider 7 connects the mobile phone 9 to the WWW 5 using the wireless base station 2 as an AP (access point) in addition to the exchange 71 required for the mobile phone service provided as the main service. System (Web server 72, database 75) and a mail system (mail server 73).

  The public line network 4 is an analog or digital telephone line network. WWW5 is the so-called Internet.

  The composite image creation system server 6 includes a system (Web server 61, database 63 for convenience) and a mail system (mail server 62) for connecting to the WWW 5. In response to a request from the mobile phones 1a and 1b, the composite image creation system server 6 synthesizes various selection screens for creating a 3D animation prepared in advance on image data captured by the mobile phone, A typical 3D animation. The final 3D animation is stored in the database 63, and a message in a Web mail format (which can be viewed by a Web browser) in which the 3D animation file is executed is transferred according to the instructions from the mobile phones 1a and 1b.

  At this time, it is determined whether the partner terminal is a terminal that can play back the 3D animation file (a terminal that uses the same carrier as the transmission side) or a terminal that cannot play back the 3D animation file (a terminal that uses a carrier of another company). If the terminal is capable of playing a 3D animation file, the message with the 3D animation file attached is transferred as it is. If the terminal cannot play the 3D animation file, the 3D animation file is converted to a GIF file. Change to and forward the message.

  Next, FIGS. 2A and 2B are external views (open state: front view and rear view) of the mobile phones 1a and 1b. The cellular phones 1a and 1b in the present embodiment have a two-fold structure including a lid portion and a main body portion. The antenna 11 is for communicating with the radio base station 2 of the communication service provider 3 in FIG. Moreover, the speaker 12 is provided in the front side of the cover part, and performs audio | voice output. The display unit (main display unit) 13 is a color liquid crystal and has 120 dots (width) × 160 dots (height). The display unit 13 can simultaneously display the execution of the 3D animation file and the message.

  The key operation unit 14 is provided on the front surface of the main body unit, and includes various function keys (mail key 141, address key 142, function key 143), a numeric key 144, and the like. The mail key 141 is for starting a mail function and displaying a mail menu. The address key 142 is for opening an address book used when selecting a destination mail address. The numeric keypad 144 is used when inputting a telephone number or characters. The microphone 15 is provided in the lower part of the main body, and performs voice input.

  The sub display unit 16 is provided on the back surface of the lid. The LED 17 is made of a transparent or translucent member, and emits light when receiving an incoming call. The imaging lens 18 is provided on the back surface of the lid portion 2 and below the sub display portion 16. The notification speaker 19 notifies an incoming call or the like, and is arranged on the back surface of the main body so that a notification sound can be heard even when the lid is closed to the main body.

  Next, FIG. 3 is a block diagram showing the configuration of the mobile phones 1a and 1b. The wireless transmission / reception unit 20 wirelessly transmits and receives voice and data (mail data and Web mail message) via the antenna 11 to modulate / demodulate. The wireless signal processing unit 21 demodulates voice and data (mail data and Web mail message) received by the wireless transmission / reception unit 20 or performs wireless communication such as modulation of voice and data to be transmitted to the wireless transmission / reception unit 20. Perform the necessary processing. The control unit 22 controls various operations and overall operations.

  The image memory 23 is an image file captured by the imaging unit (imaging lens 18, imaging module 181, DSP 182) and compressed and encoded by a program stored in the image processing program area 2413, or an image file downloaded via WWW 5. Is a memory for storing. The ROM 24 is composed of a rewritable flash ROM, and stores various programs to be described later, which are features of the present invention.

  The driver 25 drives the display unit 13. The driver 26 drives the sub display unit 16. The subscriber information storage unit 27 stores profile data such as a telephone number for calling the mobile phone 1 and an operator (subscriber) ID. The ROM 28 stores various programs for controlling the control unit 18. The RAM 29 stores various data necessary as a wireless communication terminal, stores data necessary for the operation of the control unit 25, and stores mail data.

  The audio signal processing unit 200 encodes the audio signal input from the microphone 15 or decodes the audio signal based on the signal output from the radio signal processing unit 21 to drive the speaker 12 and outputs audio. The imaging module 181 is configured by a CCD or a CMOS, and captures a color image. The DSP 182 encodes the image captured by the imaging module 181. The notification device 192 is a driver for driving the notification sound speaker 19, the vibrator 191, and the LED 17.

  Next, FIG. 4 is a conceptual diagram showing the configuration of the memory area of the ROM 24 in the cellular phones 1a and 1b. The ROM 24 stores a software program that is a feature of the present embodiment. The ROM 24 includes a mail software program area 241, an image processing program area 2413, and other program areas 2414.

  The mail software program area 241 is divided into an area 2411 for storing a known mail software program and an area 2412 for storing a 3D animation file viewer program. Note that the 3D animation file viewer program may be downloaded from the WWW 5 via the composite image creation system server 6.

  The image processing program area 2413 stores an image processing program for compressing a digitally encoded image captured by the imaging unit (the imaging lens 18, the imaging module 181, and the DSP 182) using the JPEG method, the PNG, or the GIF method. To do. In the first embodiment, the image processing program also performs processing such as extracting a region to be used for 3D animation from a part of captured image data when creating a 3D animation file. The other program area 2414 stores application programs other than the above.

  Next, FIG. 5 is a conceptual diagram showing the configuration of the memory area of the RAM 29 in the cellular phones 1a and 1b. The RAM 29 includes an address book data storage area 291, a mail data storage area 292, an attached file storage area 293, and other / work memory 294. The address book data storage area 291 stores a plurality of names, telephone numbers, mail addresses, etc. as a set of records.

  The mail data storage area 292 stores mail data created using mail software and received mail data. When a file is attached to the mail, the attached file storage area 293 stores the file. Others The work memory 294 stores various data as other work memories. The 3D animation file storage area 295 stores the 3D animation file attached to the mail. Note that the cellular phone 9 has the same basic circuit configuration except for the modulation / demodulation processing by the radio transmission / reception unit 20 and the radio signal processing unit 21, but belongs to a communication service company different from the cellular phones 1 a and 1 b, so that it is a 3D animation file. The storage area 295 is not provided.

A-2. Operation of First Embodiment Next, the operation of the first embodiment described above will be described. Here, FIGS. 6 and 7 are flowcharts for explaining the 3D animation file creation processing according to the first embodiment. Prior to the execution of the processing, it is assumed that the cellular phone 1 a is captured by the imaging module 181 and the DSP 182 and the image data is stored in the image memory 23.

(1) 3D Animation Creation Processing When “Create 3D animation” is selected in the top page display state in the mobile phone 1a, the composite image creation system server 6 is accessed (step Sa10). The composite image creation system server 6 performs logon processing (step Sb10), reads the creation procedure CGI, and transfers the image selection screen (step Sb12).

  In the mobile phone 1a, the image selection screen shown in FIG. 9A is displayed (step Sa12), and as shown in FIG. 9B, a pre-captured image file in the mobile phone terminal is selected (step Sa14). . Next, as shown in FIG. 9C, in a state where the selected image file is displayed on the display unit 13, a portion to be used as a 3D animation by displaying the cut frame 131, that is, a synthesis range is selected (step Sa16). . Next, it is determined whether or not a transmission instruction is detected (step Sa18). If no transmission instruction is detected, the process returns to step Sa14. When a transmission instruction is detected, the composition range is transferred to the composite image creation system server 6. Send. At this stage, as shown in FIG. 10A, an image of the combined range portion where the clipping has been completed is displayed on the mobile phone 1a (1b). When the composite image creation system server 6 receives the composite range, the category selection screen is transferred (step Sb14).

  In the mobile phone 1a, the category selection screen shown in FIG. 10B is displayed (step Sa20), and the category to be used to create the 3D animation is selected (step Sa22). Next, it is determined whether or not a transmission instruction is detected (step Sa24). If no transmission instruction is detected, the process returns to step Sa22. When a transmission instruction is detected, the selected category is selected from the composite image creation system server 6. Send to. When the composite image creation system server 6 receives the category, it transfers the BODY selection screen belonging to the selected category (step Sb16).

  The cellular phone 1a displays the BODY selection screen shown in FIG. 10C (step Sa26), and selects BODY used for 3D animation (step Sa28). Next, it is determined whether or not a transmission instruction is detected (step Sa30). If no transmission instruction is detected, the process returns to step Sa28. When a transmission instruction is detected, the selected BODY is replaced with the composite image creation system server 6. Send to. When the composite image creation system server 6 receives BODY, it transfers an action selection screen for determining the movement of the 3D animation (step Sb18).

  The mobile phone 1a displays an action selection screen shown in FIG. 10D (step Sa32), and selects an action for determining the movement of the 3D animation (step Sa34). Next, it is determined whether or not a transmission instruction is detected (step Sa36). If no transmission instruction is detected, the process returns to step Sa34. When a transmission instruction is detected, the selected action is assigned to the composite image creation system server 6. Send to. When the composite image creation system server 6 receives the action, it creates a 3D animation file and a GIF file and stores them in the database 63 (step Sb20). Next, the created 3D animation is transferred to the mobile phone 1a (step Sb22).

  In the mobile phone 1a, the 3D animation viewer is activated and the received 3D animation is displayed as shown in FIG. 10E (step Sa38). Next, it is determined whether or not there is an instruction to download the created 3D animation file on the screen of FIG. 10F (step Sa40). When there is an instruction to download, the 3D animation file is converted into the 3D animation file in the RAM 29. Store in the storage area 295 (step Sa42). Note that it is also possible to select message transmission by Web mail on the screen of FIG.

  Here, the 3D animation file created by the composite image creation system server 6 will be described. FIG. 8 is a conceptual diagram showing the configuration of a 3D animation file. The 3D animation file includes a header part and a data source part. The header part consists of file name data, copyright flag data, property data, and image size data. The data source part consists of a background data part, a data size part, and an entity data part. The background data portion includes background color data, ambient light intensity data, parallel light intensity data, and parallel light source direction data. The data size portion includes a model data size, an animation data size, a texture data size, an environment bitmap data size, and a viewpoint data size. The entity data section stores model data entities, animation data entities, texture data entities, environmental bitmap data entities, viewpoint data entities (viewpoint positions are stored for each frame, and multiple frames are sequentially read out and Data that triggers an action on the click). The feature of the 3D animation data of the present invention is that it is configured as one file as shown in the figure.

  This is because a conventional system for executing 3D animation is composed of at least three files (model data, animation data, texture data), and such a file structure is directly provided with a small display device such as a mobile phone. In addition, since it is difficult to apply to a device that is difficult to apply a load to the system, it is configured as one file. In the file structure of FIG. 8, data essential for execution is set at the beginning of the file as much as possible, and other data, that is, data that can be set later by the mobile phone alone is set later in the file. Yes. That is, the environment bitmap data entity, the viewpoint data entity, and the like can be displayed even if they do not exist, and are therefore set at positions that do not affect the entire file even if omitted.

(2) Mail transmission process Next, an operation for transmitting a mail with the above-described 3D animation file attached will be described. FIG. 11 is a flowchart for explaining the mail transmission process. First, the mobile phone 1a determines whether or not mail transmission is detected (step Sa50). If mail transmission is not instructed, the process is terminated. On the other hand, when mail transmission is instructed, the composite image creation system server 6 is requested to send mail. The composite image creation system server 6 activates the mail creation CGI, reads the web mail creation screen according to the mail transmission request, and transfers it to the mobile phone 1a (step Sb50).

  In the mobile phone 1a, on the Web mail creation screen, a mail creation process for inputting a mail text and an address input process for inputting a destination mail address are executed (step Sa52). Next, it is determined whether or not a determination instruction is detected (step Sa54). If there is no determination instruction, the process returns to step Sa52 to continue the editing operation. On the other hand, when the determination instruction is detected, the determination instruction is transmitted to the composite image creation system server 6. The composite image creation system server 6 creates and transmits a list of 3D animation files registered with the user ID.

  The mobile phone 1a displays a list of 3D animation files registered with the user ID (step Sa56). The user selects a 3D animation file to be attached to the mail from the list of 3D animation files (step Sa58). Next, it is determined whether or not a determination instruction is detected (step Sa60). If there is no determination instruction, the process returns to step Sa58 and continues to select a 3D animation file. On the other hand, when the determination instruction is detected, the determination instruction is transmitted to the composite image creation system server 6. The composite image creation system server 6 creates Web mail content in which the selected 3D animation file is attached to the created mail (text), adds a URL to the database, and stores it (step Sb54).

(3) Mail Incoming Processing Next, the operation for receiving the mail with the 3D animation file attached will be described. Here, FIG. 12 is a flowchart for explaining the mail incoming process. First, the cellular phone 1b (or 9) determines whether or not an email has been received (step Sc10). If no email has been received, the processing ends. On the other hand, when a mail is received, the notification speaker 19 notifies the incoming call (step Sc12), and determines whether or not an opening instruction by the user is detected (step Sc14). If there is no opening instruction, the process returns to step Sc12 to continue the incoming call notification.

  On the other hand, if there is an opening instruction, a mail header is displayed (step Sc16), and it is determined whether or not a URL instruction is detected (step Sc18). Here, when the user designates the URL described in the mail, the composite image creation system server 6 is accessed.

  When the composite image creation system server 6 receives access from the mobile phone 1b (or 9), it performs terminal confirmation processing to determine the identification information (manufacturer name, model number, browser version, etc.) of the terminal that requested access. (Step Sb60) It is determined whether 3D animation data can be displayed (Step Sb62). If the terminal that requested access can display the 3D animation data, that is, if it is the mobile phone 1b, the Web mail content composed of the mail text and the 3D animation file is transferred (step Sb64).

  On the other hand, if the terminal that requested access cannot display 3D animation data, that is, if it is a mobile phone 9 of a different carrier, the Web mail content composed of the mail text and the GIF file is transferred (step Sb66).

  In the mobile phone 1b (or 9), the viewer corresponding to the reproduction of the image file attached to the received file is activated (step Sc20). That is, in the case of the mobile phone 1b, a 3D animation viewer and a browser are started, and in the case of the mobile phone 9, a Web browser is started. Next, the mail text and the 3D animation file (or GIF file) from the composite image creation system server 6 are displayed (step Sc22), and the process ends.

  According to the first embodiment described above, since the 3D animation file is created in cooperation with the composite image creation system server 6, even in the cellular phone 1a having a low computing capability, the captured image data is a part. A 3D animation file can be created. In addition, since the data (BODY, action) and 3D animation file of the common part of the 3D animation are stored in the composite image creation system server 6, the processing capacity and memory capacity of the CPU are limited like a mobile phone. Can also create 3D animation files. In addition, since the capability of the terminal on the mail receiving side is determined and transmitted in a file format corresponding to the capability, 3D animation can be displayed even if the terminal is not a terminal of the same carrier.

B. Second Embodiment Next, a second embodiment of the present invention will be described. In the first embodiment described above, a 3D animation file is created in cooperation with the composite image creation system server 6 based on previously captured image data. However, in the second embodiment, a composite image is obtained by a series of operations from photographing. A feature is that a 3D animation file is created in cooperation with the creation system server 6. Note that the configurations of the system and the mobile phone are the same as those in the first embodiment described above, and thus the description thereof is omitted.

B-1. Operation of Second Embodiment Next, the operation of the second embodiment will be described. Here, FIG. 13 is a flowchart for explaining the operation (part) of the second embodiment. Note that the same portions as those of the first embodiment are referred to and the description thereof is omitted.

  First, when “Create 3D animation” is selected in the top page display state of the mobile phone 1a, the composite image creation system server 6 is accessed (step Sa10 in FIG. 6). The composite image creation system server 6 performs a logon process (step Sb10 in FIG. 6), reads the creation procedure CGI, starts the creation procedure CGI, and transfers the cut frame data (step Sb12 in FIG. 13).

  In the mobile phone 1b, the cut frame data is received and buffered (step Sa70), and the imaging module 181 and the DSP 182 are activated (step Sa72). Next, an image captured through the lens 18 and the imaging module 181 with the cutting frame 131 is displayed in real time (step Sa74), and it is determined whether or not the shutter is operated (step Sa76). If the shutter is not operated, the process returns to step Sa74 and the through display with the cutting frame 131 is continued.

  The user determines the composition so that a desired subject enters the cutout frame 131 and operates the shutter while watching the captured image with the cutout frame 131 displayed on the display unit 13. Then, when the shutter is operated, the image data in the cutout frame 131 is extracted from the captured image data, and the image data in the cutout frame 131 is transmitted to the composite image creation system server 6, and step Sa20 in FIG. Proceed to When the composite image creation system server 6 receives the image data in the cut frame 131 from the mobile phone 1a, it transfers the category selection screen (step Sb72) and proceeds to step Sb16 in FIG.

  Hereinafter, a 3D animation file is created by the same processing as in the first embodiment described above. Further, the mail transmission process and the mail incoming process are the same as those in the first embodiment.

  According to the second embodiment described above, a 3D animation file can be directly created from image data captured on the spot.

C. Third Embodiment Next, a third embodiment of the present invention will be described. In the first or second embodiment described above, a 3D animation file is created in cooperation with the composite image creation system server 6, but in the third embodiment, a 3D animation file is created by the mobile phone 1a (or 1b) itself. It is characterized by doing.

C-1. Configuration of the Third Embodiment The system configuration according to the third embodiment and the configuration of the mobile phone 1a (or 1b) are basically the same as those of the first embodiment described above, but a 3D animation file is created by the terminal itself. In order to create, the memory configuration of the ROM 24 of the mobile phone 1a (or 1b) is as shown in FIG. That is, instead of the 3D animation file viewer program, an area 242 for storing a 3D animation data creation program is provided.

C-1. Operation of Third Embodiment Next, the operation of the third embodiment will be described. Here, FIG. 15 and FIG. 16 are flowcharts for explaining the operation of the mobile phone 1a (or 1b) according to the third embodiment. First, in the 3D animation file creation mode, a menu is displayed (step Sa80), and it is determined whether new creation is selected from the menu (step Sa82). When new creation is selected, the cut frame data is read (step Sa84), and the imaging module 181 and DSP 182 are activated (step Sa86).

  Next, an image captured through the lens 18 and the imaging module 181 with the cutting frame 131 is displayed in real time (step Sa88), and it is determined whether or not the shutter is operated (step Sa90). If the shutter is not operated, the process returns to step Sa88, and the through display with the cutting frame 131 is continued.

  The user determines the composition so that a desired subject enters the cutout frame 131 and operates the shutter while watching the captured image with the cutout frame 131 displayed on the display unit 13. When the shutter is operated, the image data in the cut frame 131 is extracted from the captured image data, and the image data in the cut frame 131 is buffered (step Sa92).

  Next, a BODY selection screen used for 3D animation is displayed (step Sa98), and it is determined whether BODY is selected (step Sa100). The user selects BODY to be used for 3D animation from the BODY selection screen. When BODY is selected, the ambient light / light source setting screen is displayed (step Sa102), and it is determined whether or not the setting of the ambient light / light source is detected (step Sa104). The user sets the ambient light / light source.

  When the environment light / light source is set, a preview of the 3D image data is displayed (step Sa106), and it is determined whether or not a decision is detected (step Sa108). The user confirms the preview of the 3D image data, and if this is OK, the decision is instructed, and if the change is to be made, the change is instructed. Here, when the user instructs a change, the process returns to steps Sa80, Sa98, and Sa102 according to the changed portion.

  On the other hand, when the user instructs determination, a background image selection screen is displayed (step Sa112), and it is determined whether new creation is selected (step Sa114). Here, when the user selects the new creation, the video imaged through the lens 18 and the imaging module 181 is displayed in real time (step Sa116), and it is determined whether or not the shutter is operated (step S116). Step Sa118). If the shutter is not operated, the process returns to step Sa116 to continue the through display. When the shutter is operated, the image taken at that time is buffered (step Sa124).

  On the other hand, if new creation is not selected from the background image selection screen, an image file without a copyright flag is read and displayed in a list (step Sa120), and it is determined whether any one is selected (step Sa122). ). When any one is selected, the selected image is buffered (step Sa124).

  In either case, the 3D image data and the background image are synthesized and previewed again (step Sa126). The user confirms the preview, and if it is OK, instructs the decision, and if it changes, instructs the change. Here, when the user instructs to change, the process returns to step Sa112, and the background image is selected again.

  On the other hand, when the user instructs determination, an action selection screen is displayed (step Sa130), and it is determined whether any action is selected (step Sa132). When any action is selected, the completion state of the 3D image data is displayed (step Sa134). The user confirms the completion state and instructs whether or not to save / overwrite. When the save / overwrite is instructed, a 3D animation file is created from the 3D image data and the action, and an overwrite update process is performed (step Sa138). On the other hand, when discarding is instructed, the buffer is cleared, and the menu display is returned to step Sa80 or the processing is terminated (step Sa140).

  According to the third embodiment described above, when there is a margin in the computing capacity and memory capacity of the mobile phone, the 3D animation file is created in the own terminal, so it is easy to install without installing a separate server. 3D animation files can be sent by e-mail.

  In the third embodiment, all 3D animation files are created on the mobile phone from the time of imaging. However, the present invention is not limited to this, and processing that is burdensome on the mobile phone (for example, creation of model data and texture data). Processing) depends on the composite image creation system server 6 of the first and second embodiments, and other data (for example, animation data, environment bitmap data, viewpoint data) is created in the mobile phone. May be.

It is a block diagram which shows the structure of the mail transmission / reception system by 1st Embodiment of this invention. It is an external view (open state: front view and back view) of mobile phones 1a and 1b. It is a block diagram which shows the structure of the mobile telephones 1a and 1b. 3 is a conceptual diagram showing a configuration of a memory area of a ROM 24. FIG. 3 is a conceptual diagram showing a configuration of a memory area of a RAM 29. FIG. It is a flowchart for demonstrating the 3D animation file creation process by this 1st Embodiment. It is a flowchart for demonstrating the 3D animation file creation process by this 1st Embodiment. It is a conceptual diagram which shows the structure of 3D animation file. It is a schematic diagram which shows the example of a screen transition of the mobile telephone 1a by this 1st Embodiment. It is a schematic diagram which shows the example of a screen transition of the mobile telephone 1a by this 1st Embodiment. It is a flowchart for demonstrating the mail transmission process by this 1st Embodiment. It is a flowchart for demonstrating the mail incoming call process by this 1st Embodiment. It is a flowchart for demonstrating the operation | movement (part) of 2nd Embodiment of this invention. It is a conceptual diagram which shows the memory structure of ROM24 by 3rd Embodiment of this invention. It is a flowchart for demonstrating operation | movement of the mobile telephone 1a (or 1b) by this 3rd Embodiment. It is a flowchart for demonstrating operation | movement of the mobile telephone 1a (or 1b) by this 3rd Embodiment.

Explanation of symbols

1a, 1b Cellular phone 2 Wireless base station 4 Public line network 5 WWW
9 Cellular phone 3, 7 Communication service provider 31 Exchange 32 Web server 33 Mail server 35 Database 4 Public line network 5 WWW
6 Composite image creation system server 61 Web server 62 Mail server 63 Database 71 Web server 72 Mail server 75 Database 11 Antenna 12 Speaker 13 Display unit 14 Key input unit 15 Microphone 16 Sub display unit 17 LED
18 Image pickup lens 19 Notification speaker 20 Wireless transmission / reception unit 21 Wireless signal processing unit 22 Control unit 23 Image memory 24 Flash ROM
25 Driver 26 Driver 27 Subscriber information storage unit 28 System ROM
29 RAM
181 Imaging module 182 DSP
192 Driver 200 Audio signal processor

Claims (5)

Imaging means;
A selection determination unit that determines whether or not 3D animation data to be combined with the image data captured by the imaging unit is selected by detecting an external operation ;
Combining means for combining the image data picked up by the image pickup means and the 3D animation data determined to be selected by the selection determining means;
Display means for displaying the state synthesized by the synthesis means;
A portable terminal comprising: Setting means for setting the light source direction of the ambient light of the 3D animation data to be synthesized;
The portable terminal according to claim 1, wherein the synthesizing unit synthesizes 3D animation data using the light source direction set by the setting unit as background data and image data captured by the imaging unit. Image data selection judging means for judging whether or not image data without a copyright flag is selected from a plurality of image data;
The synthesizing unit further includes the image data determined to be selected by the image data selection determining unit in addition to the image data captured by the imaging unit and the 3D animation data determined to be selected by the selection determining unit. The mobile terminal according to claim 1, wherein the mobile terminal is synthesized.   The portable terminal according to any one of claims 1 to 3, further comprising storage means for storing the state synthesized by the display means. A computer provided in a portable terminal including an imaging unit and a display unit,
Selection determining means for determining whether or not 3D animation data to be combined with image data captured by the imaging unit is selected by detecting an operation from the outside ;
Synthesizing means for synthesizing the image data captured by the imaging unit and the 3D animation data determined to be selected by the selection determining means;
Display control means for displaying on the display unit the state synthesized by the synthesis means;
A composite image display program characterized by functioning as

Images