JP4258507B2 - Mobile phone with camera and data communication device - Google Patents

Description

  The present invention relates to a data communication apparatus, a data communication system, a moving image-added document display method, and a moving image-added document display program applied to an electronic mail system or the like.

Conventionally, there is a system for exchanging e-mails with various files attached. In recent years, a wireless communication terminal such as a mobile phone has an imaging function, and a captured image (or a URL where the image is stored) is displayed. A service is known in which a mail text and an image are displayed on a received wireless communication terminal by being attached to an email and transmitted to the other wireless communication terminal. In addition, in recent years, a service has appeared in which not only a still image but also a moving image having a small capacity is attached to a mail as an attached file and transmitted / received (for example, see Patent Document 1). Furthermore, a technique for adding copyright information to a moving image is also known (see, for example, Patent Document 2).
By the way, for example, in a mobile phone, a still image can be displayed with 128 × 96 pixels as an example, but a moving image has a small screen size of 96 × 80 pixels. Therefore, even if a display area of 128 × 96 pixels is provided, the display area of the moving image is small and the display area is not used effectively. Therefore, there is an idea that a moving image of 96 × 80 pixels is simply enlarged to a size of 128 × 96 pixels and reproduced (for example, see Patent Document 3).

JP 2000-23121 A JP 11-317892 A JP 2000-270294 A

  However, the moving image reproduction method according to the prior art has a drawback that a 96 × 80 pixel moving image is simply enlarged to a size of 128 × 96 pixels and reproduced, so that the image becomes rough and difficult to see.

Accordingly, an object of the present invention is to provide a camera-equipped mobile phone and a data communication device that can effectively use the display area and improve the appearance without causing a decrease in visibility due to image degradation in moving image reproduction. To do.

To achieve the above object, the camera-equipped cellular phone according to the first aspect of the present invention is a camera-equipped cellular phone, wherein the storage means stores a moving image received as an e-mail attachment, and a display capable of displaying still images and moving images. And display control means for enlarging a peripheral portion of the moving image and displaying it in the still image displayable area size of the display means when the received moving image stored in the storage means is read and reproduced. It is characterized by that.

In order to achieve the above object, the camera-equipped mobile phone according to the invention as claimed in claim 2 is a camera-equipped mobile phone, comprising: a shutter; and a still image capturing means for capturing a still image when the shutter is operated within a predetermined time; , Moving image capturing means for capturing a moving image when the shutter is operated for a predetermined time or more, storage means for storing the captured still image or moving image, and transmitting the still image or moving image stored in the storing means by mail attachment A mail transmission / reception unit for receiving a still image or a moving image attached to an e-mail, a still image display unit for displaying a still image stored in the storage unit, and a moving image display unit for displaying a moving image stored in the storage unit The moving image display means enlarges a peripheral portion of the moving image and reproduces the reproduction table with the display size of the still image when reproducing and displaying the moving image. Characterized in that to.

In order to achieve the above object, a data communication device according to a third aspect of the present invention is a data communication device, comprising: a receiving unit that receives a still image and a moving image; a photographing unit that captures a still image and a moving image; Storage means for storing still images and moving images photographed by the photographing means or still images or moving pictures received by the receiving means, display means for displaying still images or moving pictures stored in the storage means, and storage means Select a stored video, enlarge a peripheral portion of the selected video and continuously play back the still image display size, a video playback means, a pause instruction means, and a pause from the pause means And display control means for stopping reproduction of the moving image when instructed and displaying the still image at that time in a uniformly enlarged manner on the display unit.

  Further, as a preferred aspect, for example, as in claim 11, in the document display method with moving image according to claim 9, when an instruction to enlarge the moving image is given at the time of reproducing the moving image, the peripheral portion of the moving image is expanded. Then, the moving image may be reproduced and displayed with the displayable area size of the display means.

According to the first aspect of the present invention, the moving image received by mail attachment is stored in the storage means, and when the received received moving image is read and reproduced by the display control means, the peripheral portion of the moving image is enlarged. Since the display means displays the still image displayable area size, it is possible to effectively use the display area and improve the appearance without reducing the visibility due to the image deterioration in moving image playback. Is obtained.

According to the second aspect of the invention, the still image capturing unit captures a still image when the shutter is operated within a predetermined time, and the moving image capturing unit captures and captures a moving image when the shutter is operated for a predetermined time or more. The stored still image or video is stored in the storage means, and the mail transmission / reception means transmits the still image or video stored in the storage means as an email attachment, and also receives the still image or video attached to the mail and stores it in the storage means. The displayed still image is displayed by the still image display means, and when the moving image is reproduced and displayed by the moving image display means, the peripheral portion of the moving image is enlarged and reproduced and displayed at the display size of the still image. in video playback attached to, without lowering the visibility due to image degradation, effective use of display area, it is possible to improve the appearance An advantage that can be obtained.

According to the third aspect of the present invention, the still image and the moving image taken by the photographing unit or the still image or the moving image received by the receiving unit are stored in the storage unit, and the still image or the moving image stored in the storage unit is stored. Is displayed on the display means, and the moving picture playback means selects the moving picture stored in the storage means, enlarges the peripheral portion of the selected moving picture, continuously plays back the still image display size, and from the pause means. When there is a pause instruction, the playback of the video is stopped by the display control means, and the still image at that time is uniformly enlarged and displayed on the display unit. In addition, it is possible to check the mail text and the moving image on a single screen.

  Hereinafter, an embodiment of the present invention will be described as an example applied to a mobile phone with reference to the drawings.

A-1. Configuration of Embodiment FIG. 1 is a block diagram showing a configuration of a mail transmission / reception system according to an embodiment of the present invention. In the figure, mobile phones (wireless communication terminals / data communication devices) 1a and 1b have an imaging function and an image memory, and transmit moving images stored in the image memory to a system (particularly, mail servers 33 and 63 described later). And a function to receive e-mail with video. The mobile phones 1a and 1b display a mail text and a video attached to the mail text so that they can be confirmed on a single screen when creating a mail with a video, and even when a mail with a video is received, Can be displayed and video playback on a single screen. This is an example, and the mail text and the attached moving image can be displayed on different screens. Further, when reproducing a moving image, the moving image is enlarged to a maximum display area of 128 × 96 pixels. The enlargement method includes a method of simply enlarging the periphery of the movie, a method of increasing the enlargement rate linearly as it goes around the movie, and a method of increasing the enlargement factor exponentially as going from the center to the periphery. However, in any case, since the visibility of the moving image is not deteriorated by enlargement, the central portion remains at 1 ×. The moving image enlargement algorithm uses a well-known technique and will not be described.

  The radio base stations 2 and 2 are connected via a public network 4 to a communication service provider (including an Internet provider) 3 to which a user of the mobile phone 1a or 1b subscribes.

  A communication service provider (including an Internet provider) 3 is connected to a WWW 5 described later (Web server 32, router 35) in addition to the exchange 34 required for the mobile phone service provided as the main service. And a mail system (mail server 33). A function for connecting the mobile phones 1a and 1b to the WWW 5 using the wireless base station 2 as an AP (access point) is also provided.

  The public line network 4 is an analog or digital telephone line network. WWW5 is the so-called Internet.

  An Internet service provider (hereinafter referred to as ISP) 6 has the same configuration as that of the communication service provider 3 except for an exchange, and is a system (Web server 62 and router 65 for convenience), a mail system (for convenience). A mail server 63). The personal computer 7 has a function of connecting to the WWW 5 via the public line 4 and ISP 6 and transmitting / receiving mails.

  As a feature of the present embodiment, the mobile phones 1a and 1b display the mail with the moving image and the mail text and the moving image on one screen (details will be described later), but from the mobile phones 1a and 1b to the personal computer 7. When a mail with a moving image is transmitted, the personal computer 7 handles the moving image as an attached file. That is, the “video mail software program with moving image” according to the present embodiment is compatible with generally known mail software.

  Next, FIGS. 2A and 2B are external views (open state: front view and rear view) of the mobile phones 1a and 1b. The cellular phones 1a and 1b in the present embodiment have a two-fold structure including a lid portion and a main body portion. The antenna 11 is provided on the back surface of the lid, and is extendable. The speaker 12 is provided on the front side of the lid, and performs audio output. The display unit (main display unit) 13 is a color liquid crystal and has 120 dots (width) × 160 dots (height). The display unit 13 can simultaneously display a photograph (photograph) and a text of a mail with a photograph.

  The key operation unit 14 is provided on the front surface of the main body, and includes various function keys (email key 141, address key 142, function key 143), numeric key 144, shutter key 145, and the like. The mail key 141 is for starting a mail function and displaying a mail menu. The address key 142 is for opening an address book used when selecting a destination mail address. The function key 143 is used to instruct reproduction or pause of a moving image when creating a moving image-attached mail or checking a moving image-attached mail. The numeric keypad 144 is used when inputting a telephone number or characters. The shutter key 145 starts moving image shooting when pressing is detected for a predetermined second (about 2 seconds) in the imaging mode.

  The microphone 15 is provided at the lower part of the main body, and performs voice input. The captured and captured data is accumulated in the imaging data buffer area 195 until the moving image shooting is completed or the predetermined capacity (maximum 100 Kbytes) is exceeded. Then, it is detected that data has been accumulated up to a predetermined capacity, or that the above-mentioned press maintenance has been released, and the compressed file is created and stored in the image memory 23.

  The sub display unit 16 is provided on the back surface of the lid. The back key 17 is made of a transparent or translucent member, and incorporates an LED 171 that emits light when an incoming call is received. The imaging lens 18 is provided on the back surface of the lid portion 2 and below the sub display portion 16. The notification speaker 19 notifies an incoming call or the like, and is arranged on the back surface of the main body so that a notification sound can be heard even when the lid is closed to the main body.

  Next, FIG. 3 is a block diagram showing the configuration of the mobile phones 1a and 1b. The wireless transmission / reception unit 20 wirelessly transmits and receives voice and data (mail data) via the antenna 11 to modulate / demodulate. The wireless signal processor 21 demodulates the voice and data (mail data) received by the wireless transmitter / receiver 20 or processes necessary for wireless communication such as modulating voice and data to be transmitted to the wireless transmitter / receiver 20. To do. The control unit 22 controls various operations and overall operations.

  The image memory 23 is an image file captured by the imaging unit (imaging lens 18, imaging module 181, DSP 182) and compressed and encoded by a program stored in the image processing program area 2413, or an image file downloaded via WWW 5. Is a memory for storing. The ROM 24 is composed of a rewritable flash ROM, and stores various programs to be described later, which are features of the present invention.

  The driver 25 drives the display unit 13. The driver 26 drives the sub display unit 16. The subscriber information storage unit 27 stores profile data such as a telephone number for calling the mobile phone 1 and an operator (subscriber) ID. The ROM 28 stores various programs for controlling the control unit 18. The RAM 29 stores various data necessary as a wireless communication terminal, stores data necessary for the operation of the control unit 25, and stores mail data. In particular, in the present embodiment, the RAM 29 has a storage area for buffering a moving image being shot once in the shooting mode.

  The audio signal processing unit 200 encodes the audio signal input from the microphone 15 or decodes the audio signal based on the signal output from the radio signal processing unit 21 to drive the speaker 12 and outputs audio. The imaging module 181 is configured by a CCD or a CMOS, and captures a color image. The DSP 182 encodes the image captured by the imaging module 181. The notification device 192 is a driver for driving the notification sound speaker 19, the vibrator 191, and the LED 171.

  Next, FIG. 4 is a conceptual diagram showing the configuration of the memory area of the ROM 24 of the cellular phones 1a and 1b. The ROM 24 stores a software program that is a feature of the present embodiment. The ROM 24 includes a mail software program area 241, an image processing program area 2413, and other program areas 2414.

  The mail software program area 241 is divided into an area 2411 for storing a known mail software program and an area 2412 for storing a mail software program with moving image. Note that the mail software program with moving image may be downloaded from the WWW 5 via the ISP 6.

  The image processing program area 2413 compresses moving image data captured and digitally encoded and buffered in the RAM 29 by the image pickup unit (the image pickup lens 18, the image pickup module 181, and the DSP 182) by an encoding and compression process based on MPEG-4. Stores an image processing program for filing. Further, the image processing program displays a moving image received from the outside or filed on its own device at the time of reproduction by enlarging the peripheral portion of the moving image and changing the display size to 128 × 96 pixels as a whole. It is like that.

  Here, FIG. 5 is a conceptual diagram for explaining the moving image enlargement method according to the present embodiment. As described above, in the present embodiment, the peripheral portion (the hatched portion in the figure) of the moving image of 96 × 80 pixels is partially enlarged according to a predetermined moving image enlargement method (described later), and the display area as a whole is 128 × 96 pixels. It comes to play with. When the moving image is stopped (temporarily stopped), the entire image is uniformly enlarged and displayed as a still image with 128 × 96 pixels (Sub-QCIF size). The other program area 2414 stores application programs other than the above.

  Next, FIG. 6 is a conceptual diagram for explaining an example of a moving image enlargement method according to the present embodiment. In FIG. 6A, the central part is 1 time and the periphery is 3 times, and the system is simply enlarged. In FIG. 6B, the enlargement ratio is linearly increased toward the periphery of the moving image. In FIG. 6C, the enlargement ratio is exponentially increased from the center to the periphery. In any case, since the visibility of the moving image is not deteriorated due to enlargement, the central portion remains at 1 ×. Which moving image enlargement method is used may be determined in advance or may be selectable by the user.

  Next, FIG. 7 and FIG. 8 are conceptual diagrams for explaining an example of a moving image enlargement method. When the moving image is MPEG-4, when decoding, it is necessary to refer to the previous and subsequent frames as shown in FIG. 7, and therefore, a memory area for three frames is usually required for the buffer. As an example of the partial enlargement method, an interpolation method may be used in which interpolation is performed by embedding data of the pixel of interest in adjacent pixels as shown in FIG. Usually, an image process of applying a filter process to the interpolated data is added.

  Next, FIG. 9 is a conceptual diagram showing the configuration of the memory area of the RAM 29 of the mobile phones 1a and 1b. The RAM 29 includes an address book data storage area 291, a mail data storage area 292, an attached file storage area 293, other work memory 294, and an imaging data buffer area 295. The address book data storage area 291 stores a plurality of names, telephone numbers, mail addresses, etc. as a set of records. The mail data storage area 292 stores mail data created using mail software and received mail data. When a file is attached to the mail, the attached file storage area 293 stores the file. Others The work memory 294 is used as other work memory, for example, as a frame memory (for three frames) in the decoding process described above, or stores various data. The enlarged data area 295 stores partially enlarged moving image data. The display buffer 296 is used as a buffer when displaying a moving image. The imaging data buffer area 297 is a storage area for once buffering a moving image being shot.

A-2. Operation of Embodiment Next, the operation of the above-described embodiment will be described.

(1) Shooting Mode First, the operation in the shooting mode according to the present embodiment will be described. Here, FIG. 10 and FIG. 11 are flowcharts for explaining the operation in the imaging mode according to the present embodiment. When the shooting mode is selected by the user, first, the shooting module 181 and the DSP 182 are activated (step S10). Next, an image processing program is loaded (step S12), and a through image is displayed on the display unit 13 (step S14). Next, it is determined whether or not the shutter key 145 has been pressed (step S16). If the shutter key 145 is not pressed, the process returns to step S14 to continue displaying the through image.

  On the other hand, when the shutter key 145 is pressed, it is determined whether or not the pressing is maintained for a predetermined second (2 seconds) (step S18). When the shutter key 145 is kept pressed for a predetermined time, the captured data is sequentially taken and sequentially stored in the captured data buffer area 295 (step S20). Here, FIG. 12 is a schematic diagram showing how a subject is imaged in the shooting mode. In the illustrated example, the object is photographed while moving in the direction of the arrow. In the capturing process of the imaging data, it is determined whether or not a predetermined amount of data (for example, 100 Kbytes) has been accumulated (step S22), and further, it is determined whether or not the shutter key 145 has been released (step S22). S24). If the predetermined capacity has not been reached and the pressing of the shutter key 145 has not been released, the process returns to step S22, and the accumulation of the imaged data in the imaging data buffer area 295 is continued.

  On the other hand, when the predetermined capacity is reached or the pressing of the shutter key 145 is released, the imaging data stored in the imaging data buffer area 295 is converted into a compressed file (step S26). Then, the compressed video file is added with a file name based on the time stamp and stored in the image memory 23 (step S32), and then the process returns to step S14 to continue the above-described processing.

  In step S18, if the shutter key 145 is not pressed for a predetermined time, that is, if the shutter key 145 is pressed for a moment (2 seconds or less), the captured data is captured (step S28). The file is compressed (step S30). Then, the compressed still image file is added with a file name based on the time stamp and stored in the image memory 23 (step S32), and then the process returns to step S14 to continue the above-described processing.

  As described above, in the shooting mode, when the pressing operation / release of the shutter key 145 is detected within a predetermined time, the image captured in the imaging module at that time is converted into a compressed file as a still image, while the predetermined time is When the pressing of the shutter key 145 is detected over the above, the images captured from the pressing start point are sequentially accumulated in the imaging data buffer area 295 (moving image), and the predetermined amount (100 Kbytes) is exceeded, or the shutter key When the release of the pressure of 145 is detected, the moving image shooting is stopped.

(2) Mail Creation Next, the operation at the time of mail creation according to the present embodiment will be described. Here, FIG. 13 to FIG. 16 are flowcharts for explaining the operation at the time of mail creation of the mobile phone according to the present embodiment. When the mail creation mode is selected by the user, a mail menu is displayed (step S40). Next, it is determined whether new creation is selected from the mail menu (step S42). If new creation is not selected, it is determined whether or not an inbox is selected (step S44). If no inbox is selected, the process proceeds to other processing (step S46). A process for displaying a received mail when the inbox is selected, that is, a process for displaying a received mail will be described later.

  On the other hand, when new creation is selected from the mail menu, the creation menu is displayed (step S48). Next, it is determined whether or not a mail with a moving image is selected from the mail menu (step S50). If no mail with a moving image is selected, the process proceeds to normal mail processing (step S52).

  On the other hand, when mail with moving image is selected from the mail menu, the mail program with moving image and the image processing program are loaded (step S54), and the creation screen is displayed (step S56).

  Next, it is determined whether any of the items “image selection”, “mail creation / editing”, or “save / end” has been selected on the creation screen (step S58). Here, when “Select Image” is selected, first, a moving image file is searched (step S60). Then, it is determined whether or not there is a moving image file (step S62). If there is no moving image file, an error is displayed (step S64), and the process returns to the creation screen display in step S56 shown in FIG.

  On the other hand, if there is a moving image file, the moving image file (still image at the start of imaging) is displayed as an album (step S66). Next, it is determined whether any moving image file is selected from the album display (step S68). If not selected, the process returns to step S66 and the album display is continued.

  On the other hand, when one of the moving image files is selected, the selected moving image file is resized to the Sub-QCIF size (128 × 96 pixels) (step S70), and a still image is displayed (step S72). Thereafter, the process returns to the creation screen display in step S56.

  When “Create / Edit Mail” is selected on the creation screen, first, a screen for performing each item / edit / display is displayed (step S80). Here, FIG. 18 is a schematic diagram showing a display screen when “mail creation / editing” is selected. In the figure, the Subject area 131 displays the title of the mail. In the From area 132, the name of the mail sender is displayed. The date display area 133 displays the creation date and time of the attached moving image file. Note that it may be possible to switch to the reception date and time, the current time, and the like by a predetermined key operation.

  The display area 134 is 128 × 96 pixels (Sub-QCIF size), streaming content (moving image), still image (still image display when a moving image file displaying 96 × 80 pixels is paused, or the periphery of the moving image file This is an area for displaying a moving image when the portion is enlarged and reproduced, and the display area 135 is a portion that is not enlarged when the moving image is reproduced in the display area 134 (a central portion that is reproduced and displayed at a magnification of 1). The playback time gauge 136 is used to indicate at what point the currently displayed image is displayed when the moving image file is played back, and the mail text display area 137 displays the mail text. If there is a long sentence that does not fit in the area, a scroll bar for scrolling and displaying the text is displayed at the right end. It is supposed to be.

  The function key 138 is a key for instructing “save / end”. The function key 139 is a key for instructing “creation / editing”. The function key 140 is a key for instructing “image selection”. The function keys 138, 139, 140 correspond to the mail key 141, the center key 145, and the function key 143 in the external view shown in FIG. The function key 143 is also used for controlling reproduction / pause of a moving image.

  Next, FIG. 19 is a schematic diagram showing an example of the display screen. In the Subject area 131, the title of the mail “Which is better?” Is displayed. In the From area 132, the name “XX” of the mail sender is displayed. The date display area 133 displays the date and time “2002/04/03 14:00 PM” of the attached moving image file. In the display area 134, the selected moving image (still image) is uniformly enlarged and displayed as a still image of 128 × 96 pixels (Sub-QCIF size). The mail text display area 137 displays the mail text being created. Further, a function key 146 (corresponding to the function key 143) for instructing “playing” of the moving image is displayed at the bottom line of the display screen.

  Next, returning to the explanation of the operation, it is determined whether or not the function key 146 has been operated on the display screen shown in FIG. 19 (step S82), and further, it is determined whether or not “decision” has been detected (step S82). S84). If neither the operation of the function key 146 for instructing “play” nor “decision” is performed, the process returns to step S80, and the screen display of “each item / edit / display” shown in FIG. 18 is continued.

  On the other hand, when the function key 146 (corresponding to the function key 143) for instructing “play” is operated, it is determined whether or not a moving image is selected (step S86). When a moving image is selected, a 96 × 80 pixel moving image is partially enlarged to 128 × 96 pixels and repeatedly reproduced according to one of the enlargement methods shown in FIGS. (Step S90).

  Here, FIG. 17 is a flowchart for explaining the operation when the moving image is enlarged and reproduced. First, the selected moving image file is read (step S120), decoded (step S122), and partial enlargement processing is executed according to any of the enlargement methods shown in FIGS. 6 (a) to 6 (c) (step S124). Then, the partially enlarged moving image is stored in the display buffer of the LCD (step S126), and it is determined whether or not the moving image has ended (step S128). If the moving image has not ended, the process returns to step S120, and the above-described operation is repeated. That is, as shown in FIG. 20, the 96 × 80 pixel peripheral portion indicated by the broken line DL is enlarged (shaded portion) and reproduced as a 128 × 96 pixel moving image. In the display area 135, the central portion of the moving image is reproduced and displayed without being enlarged. On the other hand, if the moving image has ended, the processing ends.

  Here, FIGS. 21A to 21C show the display when the moving image file of the object imaged in the imaging direction as shown in FIG. 12 in the above-described imaging mode is reproduced and displayed in the mail creation mode. It is a schematic diagram which shows an example of a screen. In the display area 134, the peripheral portion is partially enlarged (shaded portion) in the order shown in FIGS. 21A to 21C, and a moving image is reproduced and displayed at 128 × 96 pixels. In addition, a function key 147 (corresponding to the function key 143) for instructing “pause” is displayed at the bottom line of the display screen during reproduction.

  During the reproduction, it is determined whether or not the function key 147 (corresponding to the function key 143) instructing “pause” is pressed (step S92), and the moving image in step S90 is displayed until the function key 147 is pressed. Continue to play repeatedly.

  On the other hand, when the function key 147 (corresponding to the function key 143) is pressed during the reproduction of the moving image, the video is paused (step S94). During the pause, as shown in FIG. 22, the still image at that time is resized (substantially enlarged) to the Sub-QCIF size (128 × 96 pixels) and the display is maintained. Note that the example shown in FIG. 22 is a display example when the display is paused in the display state shown in FIG. Then, it returns to step S80 and repeats the process mentioned above. As described above, in this embodiment, a moving image can be easily reproduced / paused even when a mail text is being created / edited, and the mail text and the moving image can be confirmed on one screen.

  Also, in step S80, when each item / edit / display screen is displayed, if a function key is operated in a state in which no moving image is selected, “no movie is selected”. A message is displayed (step S96). Next, it is determined whether or not a predetermined time has elapsed (step S98). If the predetermined time has not elapsed, the process returns to step S96 to maintain the message display.

  On the other hand, when the message display has elapsed for a predetermined time, the message is deleted (step S100). Then, it returns to step S80 and repeats the process mentioned above.

  In step S80, when each item / edit / display screen is displayed, if a "decision" operation is detected, the process returns to the creation screen display in step S56 shown in FIG. 13, and the above-described processing is repeated. .

  If “save / end” is selected on the creation screen, it is first determined whether there is an unfilled item or a moving image file is not selected (step S110). If there is an unfilled item or no moving image file is selected, a confirmation display for the user is performed (step S112), and it is determined whether or not “OK” is selected (step S114). If “OK” is not selected, that is, if there is an unfilled item or no moving image file is selected, the process returns to step S56 shown in FIG. 13 and proceeds to display of the creation screen. Thereafter, the user completes the mail by inputting in an unfilled item or selecting a moving image file.

  On the other hand, if “OK” is selected in the confirmation display to the user, it means that there may be an unfilled item or that the video file may not be selected. The information is stored in the transmission box (step S116), the display returns to the mail menu display in step S40, and the above-described processing is repeated. If there is no unfilled item or a moving image is selected, the mail is stored in the transmission box (step S116), the display returns to the mail menu display in step S40, and the above-described processing is repeated. The mail with moving image stored in the transmission box is transmitted at a predetermined timing.

(3) Confirmation of Received Mail Next, the operation when confirming the received mail according to the present embodiment will be described. Here, in the present embodiment, a case will be described in which an email with a moving image created as described above by the mobile phone 1a is received by the mobile phone 1b. Since there is no place different from processing, it is omitted. FIG. 23 is a flowchart for explaining the operation when confirming the received mail. Note that the received mail confirmation process is executed when a reception box is selected in step S44 of the above-described flowchart for creating a mail.

  When the inbox is selected, first, a list of received mails stored in the inbox is displayed (step S130). Next, it is determined whether or not a mail with a moving image has been selected (step S132). If a normal mail is selected, the process proceeds to a normal mail process (step S134).

  On the other hand, when a mail with a moving image is selected, a mail program with a moving image and an image processing program are loaded (step S136), the mail text is displayed, and the peripheral portion of the moving image is enlarged by the above-described processing to 128 × 96. Movie reproduction is performed with pixels (step S138). Here, FIGS. 24A to 24C and FIGS. 25A and 25B are schematic diagrams illustrating an example of a display screen during reproduction of a moving image of a received e-mail with moving image. In the display area 135, the partially enlarged video is reproduced and displayed at 128 × 96 pixels in the order of FIGS. 24 (a), (b), (c), FIGS. 25 (a), and (b). In addition, a function key 147 (corresponding to the function key 143) for instructing “pause” of the moving image is displayed at the bottom line of the display screen during reproduction.

  While the received mail is being displayed, it is determined whether or not cancellation is detected (step S140). If cancellation is detected, the process returns to the reception list display of step S130 and the above-described processing is repeated. On the other hand, if no cancel is detected, it is determined whether or not a function key 147 (corresponding to the function key 143) for temporarily stopping the reproduction of the moving image has been operated (step S142). If the function key 147 for pause is not operated, the process returns to step S138, and the display of the mail text and the reproduction of the moving image are continued.

  On the other hand, when the function key 147 (corresponding to the function key 143) for pausing is operated, as shown in FIG. 26, 128 × 96 pixels (Sub− The resized still image is displayed in (QCIF size) (step S144). Next, it is determined whether or not a function key 146 for reproduction (corresponding to the function key 143) has been operated (step S146). If reproduction is not instructed, the process returns to step S144, and the pause state is continued. On the other hand, when the playback function key 146 is operated, the process returns to step S138 to display the mail text, and from the still image at that time, resize and play back the movie partially enlarged to 128 × 96 pixels. Display and repeat the process described above.

  In the above-described embodiment, a flag may be added to the moving image file to instruct the moving image to be partially enlarged and played back. In a mobile phone that has received an e-mail with a moving image, if the flag is added to the e-mail with a moving image (or if enlargement playback is instructed), the peripheral portion of the moving image is enlarged by a predetermined enlargement method. On the other hand, when reproduction and display is performed at × 96 pixels, when the above flag is not added (or when enlargement reproduction is not instructed), reproduction and display is performed at 96 × 80 pixels without partial enlargement.

  In the above-described embodiment, a function for instructing partial enlargement may be given to any of the keys when playing back a moving image. In this case, regardless of the presence or absence of the flag, when the key is pressed, the peripheral portion of the moving image is enlarged by a predetermined enlargement method, and is reproduced and displayed at 128 × 96 pixels. Alternatively, every time the above key is pressed, the enlargement method shown in FIG. 6A, the enlargement method shown in FIG. 6B, and the enlargement method shown in FIG.

  In addition, a copyright flag may be attached to the header of the moving image file to limit transfer of the moving image file.

  In the above-described embodiment, the details of the mobile phone with a camera (imaging function) have been described. However, the present invention is not limited to this, and any communication device that can display a moving image is applicable.

It is a block diagram which shows the structure of the mail transmission / reception system by embodiment of this invention. It is an external view (open state: front view and back view) of mobile phones 1a and 1b. It is a block diagram which shows the structure of the mobile telephones 1a and 1b. It is a conceptual diagram which shows the structure of the memory area of ROM24 of the mobile telephones 1a and 1b. It is a conceptual diagram for demonstrating the moving image expansion system by this embodiment. It is a conceptual diagram for demonstrating the example of the moving image expansion system by this embodiment. It is a conceptual diagram for demonstrating an example of the system of the moving image expansion by this embodiment. It is a conceptual diagram for demonstrating an example of the system of the moving image expansion by this embodiment. It is a conceptual diagram which shows the structure of the memory area of RAM29 of mobile phone 1a, 1b. It is a flowchart for demonstrating the operation | movement at the time of imaging mode by this embodiment. It is a flowchart for demonstrating the operation | movement at the time of imaging mode by this embodiment. It is a schematic diagram which shows a mode that a to-be-photographed object is imaged in imaging | photography mode. It is a flowchart for demonstrating the operation | movement at the time of the mail preparation of the mobile telephone by this embodiment. It is a flowchart for demonstrating the operation | movement at the time of the mail preparation of the mobile telephone by this embodiment. It is a flowchart for demonstrating the operation | movement at the time of the mail preparation of the mobile telephone by this embodiment. It is a flowchart for demonstrating the operation | movement at the time of the mail preparation of the mobile telephone by this embodiment. It is a flowchart for demonstrating the operation | movement at the time of carrying out enlarged reproduction of the moving image by this embodiment. It is a schematic diagram which shows a display screen when "mail creation / edit" is selected. It is a schematic diagram which shows a display screen when the moving image being reproduced is paused. It is a schematic diagram which shows the display screen during moving image reproduction. It is a schematic diagram which shows an example of a display screen in the case of reproducing | regenerating and displaying the moving image file of the object imaged in the imaging direction as shown in FIG. 10 in the said imaging | photography mode in mail creation mode. It is a schematic diagram which shows a display screen when the moving image being reproduced is paused. It is a flowchart for demonstrating the operation | movement at the time of the incoming mail confirmation of the mobile telephone by this embodiment. It is a schematic diagram which shows an example of the display screen during reproduction | regeneration of the moving image of the mail with a moving image received. It is a schematic diagram which shows an example of the display screen during reproduction | regeneration of the moving image of the mail with a moving image received. It is a schematic diagram which shows an example of the display screen which is stopping the moving image of the mail with a moving image received.

Explanation of symbols

1a, 1b Mobile phone (data transmission device, data reception device)
2 Wireless base station 3 Communication service provider 32 Web server 33 Mail server 34 Switch 35 Router 4 Public line network 5 WWW
6 Internet Provider 62 Web Server 63 Mail Server 65 Router 7 Personal Computer 11 Antenna 12 Speaker 13 Display Unit (Display Means)
131 Subject area 132 From area 133 Date display area 134 Display area 135 Display area 136 Playback time gauge 137 Mail text display area 138 Function key 139 Function key 140 Function key 14 Key input part 141 Mail key 142 Address key 143 Function key 144 Numeric keypad 145 Shutter key 15 Microphone 16 Sub display 17 Rear key 171 LED
18 Imaging lens (photographing means)
19 Notification speaker 20 Wireless transmission / reception unit (transmission means, reception means)
21 wireless signal processing unit 22 control unit (control unit, display control unit, reproduction control unit, first display control unit, second display control unit)
23 Image memory 24 Flash ROM
25, 26 Driver 27 Subscriber information storage unit 28 System ROM
29 RAM (storage means, moving image storage means)
181 Imaging module (imaging means)
182 DSP
192 Driver 200 Audio signal processor

Claims (3)

A mobile phone with a camera,
Storage means for storing the video received as an email attachment;
Display means capable of displaying still images and moving images;
Display control means for enlarging a peripheral portion of the moving image and displaying it in the still image displayable area size of the display means when reading and playing the received moving image stored in the storage means;
A mobile phone with a camera, comprising: A mobile phone with a camera,
Shutter,
A still image capturing means for capturing a still image when the shutter is operated within a predetermined time;
Moving image capturing means for capturing a moving image when the shutter is operated for a predetermined time or more;
Storage means for storing the captured still image or moving image;
An email transmission / reception means for transmitting the still image or video stored in the storage means by email attachment and receiving the still image or video attached to the email; and
A still image display means for displaying a still image stored in the storage means;
Moving image display means for displaying the moving image stored in the storage means,
The camera-equipped cellular phone, wherein the moving image display means enlarges a peripheral portion of the moving image and reproduces and displays it with the display size of the still image when the moving image is reproduced and displayed. A data communication device,
Receiving means for receiving still images and moving images;
Photographing means for photographing still images and moving images;
Storage means for storing still images and moving images taken by the photographing means or still images or moving images received by the receiving means;
Display means for displaying still images or moving images stored in the storage means;
A moving image reproducing means for selecting a moving image stored in the storage means, enlarging a peripheral portion of the selected moving image and continuously reproducing the display size of the still image;
A pause instruction means;
Display control means for stopping reproduction of the moving image when the pause instruction is issued from the pause means and uniformly enlarging the still image at that time and displaying it on the display unit;
A data communication device comprising:

Images