JP4518081B2 - Portable electronic device and display program - Google Patents

Description

  The present invention relates to a portable electronic device having a broadcast receiving function and a display program.

  2. Description of the Related Art Conventionally, there is a system for exchanging e-mails with various files attached. In recent years, a radio communication terminal such as a mobile phone is provided with an imaging function, and a captured image (or a URL where the image is stored). Is attached to a mail and transmitted to the other party's wireless communication terminal, and the received other party's wireless communication terminal displays a mail text and an image (see, for example, Patent Document 1).

JP-A-2002-359695, page 5, FIGS. 2 and 4

  However, with the above-described method for creating an e-mail with an attached image, for example, when sending a moving image by e-mail, it is very difficult to easily create and edit an e-mail while checking the contents of the moving image. It was.

  Therefore, the present invention can display a distribution video and broadcast information received together with this video clearly even in a small display area when viewing the video distributed in the broadcasting system, and can be recorded. It is an object to provide an electronic device and a display program.

In order to achieve the above object, the invention according to claim 1 is a display means having a video display area and a data display area, a video to be distributed, and a receiving means for receiving broadcast information distributed together with the video, The video received by the receiving means is displayed in the video display area, while the received broadcast information is displayed in the data display area, and the operation content to be operated when instructing recording is displayed. 1 display control means, a detection means for detecting a recording instruction in the display state by the first display control means, and an image received by the receiving means when the recording instruction is detected by the detection means a first storage means for storing in association with the broadcast information distributed along with the video, and transfer means for transferring the storage contents of the first storage unit to the device outside, before A document creation means for creating a document to be transferred together with the stored contents, when displaying the stored contents to be transferred by said transfer means to said display means, and displays an image stored as the stored content in the video display area The broadcast information stored in association with the stored video is combined with the displayed video and displayed, while the document created by the document creating means is displayed in the data display area. and second display control means, comprising the.

Further, an invention according to claim 2, wherein, in the invention described in claim 1, wherein the first display control means, as the operation contents to be operated for instructing the recording, first, when instructing the recording standby The operation content to be operated is displayed, and when an instruction for recording standby is detected in response to this display, the operation content to be operated when instructing recording is displayed.

According to a third aspect of the present invention, in the second aspect of the invention, the second storage unit for buffering the video received by the receiving unit and the recording standby instruction are detected. Storage control means for starting storage of received video in the second storage means, and third display control for controlling the storage means to display the storage state of the second storage means on the display means. And means.

According to a fourth aspect of the present invention, in the third aspect of the present invention, when the first storage means detects a recording instruction by the detection means, the video stored in the second storage means is displayed. It is characterized by being transferred and stored.

In order to achieve the above-mentioned object, the invention according to claim 5 is a computer, wherein the computer displays the video received by the receiving unit in the video display area of the display unit, while the received broadcast information is displayed in the data of the display unit. A first display control means for controlling to display the operation contents to be displayed when instructing recording to be displayed in the display area, and in the display state by the first display control means, a recording instruction is given. A detecting unit for detecting, a recording unit for detecting a recording instruction by the detecting unit, a storage unit for storing the video received by the receiving unit and the broadcast information distributed together with the video in the storage unit, and the storage unit transfer means for transferring the stored memory contents in the storage unit to the apparatus outside, document creation detecting means for detecting that the document to be transferred together with the stored contents is created, When displaying the stored content to be transferred by the transfer means on the display unit, the video stored as the stored content is displayed in the video display area, and the broadcast information stored in association with the stored video Is combined with the displayed video and displayed, while functioning as second display control means for controlling to display the document that has been detected by the document creation detection means in the data display area. Features.

According to the present invention, the received video is displayed in the video display area, the received broadcast information is displayed in the data display area, and the operation content to be operated when instructing recording is displayed. When a recording instruction is detected sometimes, the received video and broadcast information distributed together with the video are stored in association with each other, while the stored content is stored in the video display area when transferred to the outside of the device. In addition to displaying the recorded video, the broadcast information stored in association with the displayed video is combined with the displayed video, and the document whose creation has been detected is displayed in the data display area. delivery video and display the broadcast information received together with the video, while it is possible to record, when transferring can be transferred with the document in the form of video distribution source seen

First Embodiment Hereinafter, a case where the present invention is applied to a mobile phone having an imaging function will be described as a first embodiment with reference to the drawings.

A-1. Configuration of Embodiment FIG. 1 is a block diagram showing a configuration of a mail transmission / reception system according to a first embodiment of the present invention. In the figure, mobile phones (wireless communication terminals / data communication devices) 1a and 1b have an imaging function and an image memory, and transmit moving images stored in the image memory to a system (particularly, mail servers 33 and 63 described later). And a function to receive e-mail with video. The mobile phones 1a and 1b display a mail text and a video attached to the mail text so that they can be confirmed on a single screen when creating a mail with a video, and even when a mail with a video is received, Can be displayed and video playback on a single screen.

  The wireless base stations 2 and 2 are wirelessly connected to a communication service provider (including an Internet provider) 3 to which a user of the mobile phone 1a or 1b subscribes.

  A communication service provider (including an Internet provider) 3 is connected to a WWW 5 described later (Web server 32, router 35) in addition to the exchange 34 required for the mobile phone service provided as the main service. And a mail system (mail server 33). A function for connecting the mobile phones 1a and 1b to the WWW 5 using the wireless base station 2 as an AP (access point) is also provided.

  The public line network 4 is an analog or digital telephone line network. WWW5 is the so-called Internet.

  An Internet service provider (hereinafter referred to as ISP) 6 has the same configuration as that of the communication service provider 3 except for an exchange, and is a system (Web server 62 and router 65 for convenience), a mail system (for convenience). A mail server 63). The personal computer 7 has a function of connecting to the WWW 5 via the public line 4 and ISP 6 and transmitting / receiving mails.

  As a feature of the first embodiment, the mobile phones 1a and 1b display the mail with the moving image and the mail text and the moving image on one screen (details will be described later). When a mail with a moving image is transmitted to the computer 7, the personal computer 7 handles the moving image as an attached file. That is, the “video software program with moving image” according to the first embodiment is compatible with generally known mail software.

  Next, FIGS. 2A and 2B are external views (open state: front view and rear view) of the mobile phones 1a and 1b. The cellular phones 1a and 1b in the first embodiment have a two-fold structure including a lid portion and a main body portion. The antenna 11 is provided on the back surface of the lid, and is extendable. The speaker 12 is provided on the front side of the lid, and performs audio output. The display unit (main display unit) 13 is composed of a 120-dot (width) × 160-dot (height) color liquid crystal device. The display unit 13 has a QVGA class resolution capable of simultaneously displaying a photograph (photograph) and text of a mail with a photograph.

  The key operation unit 14 is provided on the front surface of the main body, and includes various function keys (email key 141, address key 142, function key 143), numeric key 144, shutter key 145, and the like. The mail key 141 is for starting a mail function and displaying a mail menu. The address key 142 is for opening an address book used when selecting a destination mail address. The function key 143 is used to instruct reproduction or pause of a moving image when creating a moving image-attached mail or checking a moving image-attached mail. The numeric keypad 144 is used when inputting a telephone number or characters. The shutter key 145 starts moving image shooting when pressing is detected for a predetermined second (about 2 seconds) in the imaging mode.

  The microphone 15 is provided at the lower part of the main body, and performs voice input. The captured and captured data is accumulated in the imaging data buffer area 195 until the moving image shooting is completed or the predetermined capacity (maximum 100 Kbytes) is exceeded. Then, it is detected that data has been accumulated up to a predetermined capacity, or that the above-mentioned press maintenance has been released, and the compressed file is created and stored in the image memory 23.

  The sub display unit 16 is provided on the back surface of the lid. The back key 17 is made of a transparent or translucent member, and incorporates an LED 171 that emits light when an incoming call is received. The imaging lens 18 is provided on the back surface of the lid portion 2 and below the sub display portion 16. The notification speaker 19 notifies an incoming call or the like, and is arranged on the back surface of the main body so that a notification sound can be heard even when the lid is closed to the main body.

  Next, FIG. 3 is a block diagram showing the configuration of the mobile phones 1a and 1b. The wireless transmission / reception unit 20 wirelessly transmits and receives voice and data (mail data) via the antenna 11 to modulate / demodulate. The wireless signal processor 21 demodulates the voice and data (mail data) received by the wireless transmitter / receiver 20 or processes necessary for wireless communication such as modulating voice and data to be transmitted to the wireless transmitter / receiver 20. To do. The control unit 22 controls various operations and overall operations.

  The image memory 23 is an image file captured by the imaging unit (imaging lens 18, imaging module 181, DSP 182) and compressed and encoded by a program stored in the image processing program area 2413, or an image file downloaded via WWW 5. Is a memory for storing. The ROM 24 is composed of a rewritable flash ROM, and stores various programs to be described later, which are features of the present invention.

  The driver 25 includes a buffer corresponding to the display area of the display unit 13 and drives the display unit 13. The driver 26 drives the sub display unit 16. The subscriber information storage unit 27 stores profile data such as a telephone number for calling the mobile phone 1 and an operator (subscriber) ID. The ROM 28 stores various programs for controlling the control unit 18. The RAM 29 stores various data necessary as a wireless communication terminal, stores data necessary for the operation of the control unit 25, and stores mail data. In particular, in the first embodiment, the RAM 29 has a storage area for buffering the moving image being shot once in the shooting mode.

  The audio signal processing unit 200 encodes the audio signal input from the microphone 15 or decodes the audio signal based on the signal output from the radio signal processing unit 21 to drive the speaker 12 and outputs audio. The imaging module 181 is configured by a CCD or a CMOS, and captures a color image. The DSP 182 encodes the image captured by the imaging module 181. The notification device 192 is a driver for driving the notification sound speaker 19, the vibrator 191, and the LED 171.

  Next, FIG. 4 is a conceptual diagram showing the configuration of the memory area of the ROM 24 of the cellular phones 1a and 1b. The ROM 24 stores a software program that is a feature of the first embodiment. The ROM 24 includes a mail software program area 241, an image processing program area 2413, and other program areas 2414.

  The mail software program area 241 is divided into an area 2411 for storing a known mail software program and an area 2412 for storing a mail software program with moving image. Note that the mail software program with moving image may be downloaded from the WWW 5 via the ISP 6.

  The image processing program area 2413 compresses moving image data captured and digitally encoded and buffered in the RAM 29 by the image pickup unit (the image pickup lens 18, the image pickup module 181, and the DSP 182) by an encoding and compression process based on MPEG-4. Stores an image processing program for filing. In addition, the image processing program is 96 × 80 pixels at the time of reproduction and 128 × 96 pixels (Sub-QCIF size) at the time of stop (pause) of a moving image received from the outside or filed on its own device. Change the display size.

This is because it is assumed that the communication service provider places restrictions on video files that can be attached to e-mails individually. In this case, the attached image is played back. Is reproduced and displayed at 96 × 80 pixels. On the other hand, in the case of video distribution from a communication service provider (portal site) or the playback of a video file attached to an e-mail, the still image display when a pause is detected is defined as 128 × 96 pixels. The This is because even when attached to an email (including during creation and confirmation of received email), at least in the case of a still image, it is displayed in an enlarged manner for easy viewing.
In the first embodiment, the playback size is different between the video file attached to the e-mail and the video file by video distribution. However, the present invention is not limited to this. You may change the size of the playback display.

  The other program area 2414 stores application programs other than the above.

  Next, FIG. 5A is a conceptual diagram showing the configuration of the memory area of the RAM 29 of the mobile phones 1a and 1b. The RAM 29 includes an address book data storage area 291, a mail data storage area 292, an attached file storage area 293, other work memory 294, and an imaging data buffer area 295. The address book data storage area 291 stores a plurality of names, telephone numbers, mail addresses, etc. as a set of records. The mail data storage area 292 stores mail data created using mail software and received mail data. When a file is attached to the mail, the attached file storage area 293 stores the file. Others The work memory 294 stores various data as other work memories. The imaging data buffer area 295 is a storage area for once buffering a moving image being shot. The image data management table 296 is configured as shown in FIG. 5B. The image data management table 296 includes a storage address of an image file stored in the image memory 23, a file name, a file attribute such as a still image or a moving image, A plurality of sets of recording date / time, creator information and other property data of the file are stored as a set of records.

A-2. Operation of Embodiment Next, the operation of the above-described first embodiment will be described.

(1) Shooting Mode First, the operation in the shooting mode according to the first embodiment will be described. Here, FIGS. 6 and 7 are flowcharts for explaining the operation in the imaging mode according to the first embodiment. When the shooting mode is selected by the user, first, the shooting module 181 and the DSP 182 are activated (step S10). Next, an image processing program is loaded (step S12), and a through image is displayed on the display unit 13 (step S14). Next, it is determined whether or not the shutter key 145 has been pressed (step S16). If the shutter key 145 is not pressed, the process returns to step S14 to continue displaying the through image.

  On the other hand, when the shutter key 145 is pressed, it is determined whether or not the pressing is maintained for a predetermined second (2 seconds) (step S18). When the shutter key 145 is kept pressed for a predetermined time, the captured data is sequentially taken and sequentially stored in the captured data buffer area 295 (step S20). Here, FIG. 8 is a schematic diagram showing a state in which a subject is imaged in the shooting mode. In the illustrated example, the object is photographed while moving in the direction of the arrow. In the capturing process of the imaging data, it is determined whether or not a predetermined amount of data (for example, 100 Kbytes) has been accumulated (step S22), and further, it is determined whether or not the shutter key 145 has been released (step S22). S24). If the predetermined capacity has not been reached and the pressing of the shutter key 145 has not been released, the process returns to step S22, and the accumulation of the imaged data in the imaging data buffer area 295 is continued.

  On the other hand, when the predetermined capacity is reached or the pressing of the shutter key 145 is released, the imaging data stored in the imaging data buffer area 295 is converted into a compressed file (step S26). Then, the compressed video file is added with a file name based on the time stamp and stored in the image memory 23 (step S32), and then the process returns to step S14 to continue the above-described processing.

  In step S18, if the shutter key 145 is not pressed for a predetermined time, that is, if the shutter key 145 is pressed for a moment (2 seconds or less), the captured data is captured (step S28). The file is compressed (step S30). Then, the compressed still image file is added with a file name based on the time stamp and stored in the image memory 23 (step S32), and then the process returns to step S14 to continue the above-described processing.

  As described above, in the shooting mode, when the pressing operation / release of the shutter key 145 is detected within a predetermined time, the image captured in the imaging module at that time is converted into a compressed file as a still image, while the predetermined time is When the pressing of the shutter key 145 is detected over the above, the images captured from the pressing start point are sequentially accumulated in the imaging data buffer area 295 (moving image), and the predetermined amount (100 Kbytes) is exceeded, or the shutter key When the release of the pressure of 145 is detected, the moving image shooting is stopped.

(2) Mail Creation Next, the operation at the time of mail creation according to the first embodiment will be described. Here, FIG. 9 to FIG. 12 are flowcharts for explaining the operation at the time of mail creation of the mobile phone according to the first embodiment. When the mail creation mode is selected by the user, a mail menu is displayed (step S40). Next, it is determined whether new creation is selected from the mail menu (step S42). If new creation is not selected, it is determined whether or not an inbox is selected (step S44). If no inbox is selected, the process proceeds to other processing (step S46). A process for displaying a received mail when the inbox is selected, that is, a process for displaying a received mail will be described later.

  On the other hand, when new creation is selected from the mail menu, the creation menu is displayed (step S48). Next, it is determined whether or not a mail with a moving image is selected from the mail menu (step S50). If no mail with a moving image is selected, the process proceeds to normal mail processing (step S52).

  On the other hand, when mail with moving image is selected from the mail menu, the mail program with moving image and the image processing program are loaded (step S54), and the creation screen is displayed (step S56).

  Next, it is determined whether any of the items “image selection”, “mail creation / editing”, or “save / end” has been selected on the creation screen (step S58). Here, when “Select Image” is selected, first, a moving image file is searched (step S60). Then, it is determined whether or not there is a moving image file (step S62). If there is no moving image file, an error is displayed (step S64), and the process returns to the creation screen display in step S56 shown in FIG.

  On the other hand, if there is a moving image file, the moving image file (still image at the start of imaging) is displayed as an album (step S66). Next, it is determined whether any moving image file is selected from the album display (step S68). If not selected, the process returns to step S66 and the album display is continued.

  On the other hand, when one of the moving image files is selected, the selected moving image file is resized to the Sub-QCIF size (128 × 96 pixels) (step S70), and a still image is displayed (step S72). Thereafter, the process returns to the creation screen display in step S56.

  When “Create / Edit Mail” is selected on the creation screen, first, a screen for performing each item / edit / display is displayed (step S80). Here, FIG. 13 is a schematic diagram showing a display screen when “mail creation / editing” is selected. In the figure, the Subject area 131 displays the title of the mail. In the From area 132, the name of the mail sender is displayed. The date display area 133 displays the creation date and time of the attached moving image file. Note that it may be possible to switch to the reception date and time, the current time, and the like by a predetermined key operation.

  The display area 134 is 128 × 96 pixels (Sub-QCIF size) and displays streaming content (moving image) or still images (including still image display when a moving image file displaying 96 × 80 pixels is paused). It is an area. The display area 135 is an area for reproducing and displaying a moving image with 96 × 80 pixels. The reproduction time gauge 136 is used to indicate at which point the image currently displayed at the time of reproduction of the moving image file is. The mail text display area 137 is an area in which the mail text is displayed, and when a long sentence or the like does not fit in the area, a scroll bar for scrolling and displaying the text is displayed at the right end. Yes.

  The function key 138 is a key for instructing “save / end”. The function key 139 is a key for instructing “creation / editing”. The function key 140 is a key for instructing “image selection”. The function keys 138, 139, 140 correspond to the mail key 141, the center key 145, and the function key 143 in the external view shown in FIG. The function key 143 is also used for controlling reproduction / pause of a moving image.

  Next, FIG. 14 is a schematic diagram showing an example of the display screen. In the Subject area 131, the title of the mail “Which is better?” Is displayed. In the From area 132, the name “XX” of the mail sender is displayed. The date display area 133 displays the date and time “2002/04/03 14:00 PM” of the attached moving image file. In the display area 134, the selected moving image (still image) is displayed in 128 × 96 pixels (Sub-QCIF size). The mail text display area 137 displays the mail text being created. Further, a function key 146 (corresponding to the function key 143) for instructing “playing” of the moving image is displayed at the bottom line of the display screen.

  Next, returning to the explanation of the operation, it is determined whether or not the function key 146 has been operated on the display screen shown in FIG. 14 (step S82), and further, it is determined whether or not “decision” has been detected (step S82). S84). If neither the operation of the function key 146 for instructing “play” nor “decision” is performed, the process returns to step S80, and the screen display of “each item / edit / display” shown in FIG. 14 is continued.

  On the other hand, when the function key 146 (corresponding to the function key 143) for instructing “play” is operated, it is determined whether or not a moving image is selected (step S86). If a moving image is selected, it is resized to 96 × 80 pixels (step S88), and the moving image is repeatedly reproduced (step S90). That is, the moving image shown in FIG. 14 is resized to 96 × 80 pixels, and moving image reproduction is started.

  Here, FIGS. 15A to 15C show the display when the moving image file of the object imaged in the imaging direction as shown in FIG. 8 in the shooting mode is reproduced and displayed in the mail creation mode. It is a schematic diagram which shows an example of a screen. In the display area 135, a moving image file is reproduced and displayed at 96 × 80 pixels in the order shown in FIGS. In addition, a function key 147 (corresponding to the function key 143) for instructing “pause” is displayed at the bottom line of the display screen during reproduction.

  During the reproduction, it is determined whether or not the function key 147 (corresponding to the function key 143) instructing “pause” is pressed (step S92), and the moving image in step S90 is displayed until the function key 147 is pressed. Continue to play repeatedly.

  On the other hand, when the function key 147 (corresponding to the function key 143) is pressed during the reproduction of the moving image, the video is paused (step S94). During the pause, as shown in FIG. 16, the still image at that time is resized to the Sub-QCIF size (128 × 96 pixels) and the display is maintained. Note that the example shown in FIG. 16 is a display example when the display is paused in the display state shown in FIG. Then, it returns to step S80 and repeats the process mentioned above. As described above, in the first embodiment, even when the mail text is being created / edited, the video can be easily played / paused, and the mail text and the video can be confirmed on one screen. Can do.

  Also, in step S80, when each item / edit / display screen is displayed, if a function key is operated in a state in which no moving image is selected, “no movie is selected”. A message is displayed (step S96). Next, it is determined whether or not a predetermined time has elapsed (step S98). If the predetermined time has not elapsed, the process returns to step S96 to maintain the message display.

  On the other hand, when the message display has elapsed for a predetermined time, the message is deleted (step S100). Then, it returns to step S80 and repeats the process mentioned above.

  In step S80, when each item / edit / display screen is displayed, if the operation of "decision" is detected, the process returns to the creation screen display in step S56 shown in FIG. 9, and the above-described processing is repeated. .

  If “save / end” is selected on the creation screen, it is first determined whether there is an unfilled item or a moving image file is not selected (step S110). If there is an unfilled item or no moving image file is selected, a confirmation display for the user is performed (step S112), and it is determined whether or not “OK” is selected (step S114). If “OK” is not selected, that is, if there is an unfilled item or no moving image file is selected, the process returns to step S56 shown in FIG. 9 and proceeds to display of the creation screen. Thereafter, the user completes the mail by inputting in an unfilled item or selecting a moving image file.

  On the other hand, if “OK” is selected in the confirmation display to the user, it means that there may be an unfilled item or that the video file may not be selected. The information is stored in the transmission box (step S116), the display returns to the mail menu display in step S40, and the above-described processing is repeated. If there is no unfilled item or a moving image is selected, the mail is stored in the transmission box (step S116), the display returns to the mail menu display in step S40, and the above-described processing is repeated. The mail with moving image stored in the transmission box is transmitted at a predetermined timing.

(3) Received Mail Confirmation Next, the operation at the time of received mail confirmation according to the first embodiment will be described. Here, in the first embodiment, a case will be described in which an email with a moving image created as described above by the mobile phone 1a is received by the mobile phone 1b. Since there is no difference with mail incoming processing, it is omitted.

  FIG. 17 is a flowchart for explaining the operation when confirming the received mail. Note that the received mail confirmation process is executed when a reception box is selected in step S44 of the above-described flowchart for creating a mail.

  When the inbox is selected, first, a list of received mails stored in the inbox is displayed (step S120). Next, it is determined whether or not a mail with a moving image has been selected (step S122). If a normal mail is selected, the process proceeds to a normal mail process (step S124).

  On the other hand, when the mail with moving image is selected, the mail program with moving image and the image processing program are loaded (step S126), and the moving image file received together with the mail text display and the mail text is stored in the attached file storage area 293. Reading and moving image reproduction (96 × 80 pixels) are performed (step S128). Here, FIGS. 18A to 18C and FIGS. 19A and 19B are schematic diagrams illustrating an example of a display screen during the reproduction of the received moving image of the mail with moving image. In the display area 135, moving images are reproduced and displayed in the order of FIGS. 18A, 18B, 18C, 19A, and 19B. In addition, a function key 147 (corresponding to the function key 143) for instructing “pause” of the moving image is displayed at the bottom line of the display screen during reproduction.

  While the received mail is being displayed, it is determined whether or not cancellation is detected (step S130). If cancellation is detected, the process returns to the reception list display in step S120, and the above-described processing is repeated. On the other hand, if no cancel is detected, it is determined whether or not a function key 147 (corresponding to the function key 143) for temporarily stopping the reproduction of the moving image has been operated (step S132). If the function key 147 for pause is not operated, the process returns to step S128, and the display of the mail text and the reproduction of the moving image are continued.

On the other hand, when the function key 147 for pause (corresponding to the function key 143) is operated, the moving image being played back at that time is resized to 128 × 96 pixels (Sub-QCIF size) as shown in FIG. The completed still image is displayed (step S134). Next, it is determined whether or not a function key 146 for reproduction (corresponding to the function key 143) has been operated (step S136). If reproduction is not instructed, the process returns to step S134 to continue the pause state. On the other hand, when the function key 146 for playback is operated, the still image at that time is resized to 96 × 80 pixels (step S138), and the process returns to the mail text display and video playback in step S128. repeat.
In the first embodiment, the mobile phone with a camera (imaging function) has been described in detail. However, the present invention is not limited to this, and a portable electronic device having a mail (message) creation function and a moving image shooting function is not limited thereto. Any device (mobile PC, PDA) can be applied.

Second Embodiment In the first embodiment, the case where the present invention is applied to a mobile phone having an imaging function has been described in detail, but in the second embodiment, it is distributed by a digital broadcasting system. A case where the present invention is applied to a mobile phone capable of receiving a video image will be described.
The description of the system configuration, the appearance of the mobile phone, and the main configuration of the mobile phone is omitted for the same parts as those in the first embodiment.

B-1. Configuration of Embodiment FIG. 21 is a block diagram showing a configuration of a mail transmission / reception system according to the second embodiment of the present invention. In the figure, the difference from the first embodiment is that the mobile phone 100 has a function of receiving a broadcast from a digital broadcast system (broadcast station 101, video database 102, broadcast antenna 103, digital broadcast receiver 104). There is. The mobile phone (wireless communication terminal / data communication device) 100 has a digital broadcast receiving function, and in detail, is modulated by an OFDM (Orthogonal Frequency Division Multiplexing) system as shown in FIG. One segment corresponding to b in the center is received among the carrier waves divided into 13 segments in the band of 5.57 MHz per broadcast station (429 KHz per segment). In this segment, an image encoded by the MPEG-4 system using the QPSK (Quadrature Phase Shift keying) modulation system is set.
In FIG. 22, a segment corresponding to a is set with a video encoded by the MPEG-2 system using a 64QAM (Quadrature Amplitude Modulation) modulation system so that the digital broadcast receiver 104 can receive the segment.
The broadcast station 101 modulates the digital video stored in the video database 102 or the digital video obtained by a network (not shown) by the OFDM method and distributes it from the broadcast antenna 103.

  FIG. 23 is an external view (open state: front view) of the mobile phone 100. The cellular phone 100 in the second embodiment is substantially the same as the cellular phones 1a and 1b in the first embodiment, but instead of the imaging function (imaging lens 18, imaging module 181 and DSP 182), digital It has a broadcast reception function. In the figure, an antenna 210 for receiving a digital broadcast is incorporated, and instead of the shutter key 145, a capture key 150 that is operated when a user watches a digital broadcast and records a desired video is provided. Is changed by operating the left side or the right side of the cross key 151.

  FIG. 24 is a block diagram showing a configuration of the mobile phone 100. As described above, since the digital broadcast receiving function is provided instead of the imaging function, the antenna 210, the tuner 211, the A / D converter 212, the demodulation processing unit 213, the signal are replaced with the imaging lens 18, the imaging module 181, and the DSP 182. Each circuit for receiving digital broadcasts includes a processing unit 214. When the user operates the mobile phone 100 to view a digital broadcast, when the mode is changed to the TV viewing mode by a predetermined key operation, power is supplied to each circuit for receiving the digital broadcast, and the tuner 211 receives the RF signal. Frequency conversion to IF signals. The A / D converter 212 samples and quantizes the IF signal and outputs the IF signal to the demodulation processing unit 213.

  The demodulation processing unit 213 receives the channel selected by detecting the user's operation of the cross key 151 from the baseband OFDM signal obtained by orthogonal demodulation of the digital IF signal output from the A / D converter 212. The data included in the subcarrier corresponding to is extracted and output to the signal processing unit 214. The signal processing unit 214 extracts the data of the segment b modulated by the QPSK method from the data output from the demodulation processing unit 213, specifically, the data including 13 segments illustrated in FIG. The video data decoded by the decoding system corresponding to the system and encoded by the MPEG-4 system are sequentially sent to the buffer of the driver 25.

  The image memory 23 is a memory for storing a moving image file based on a captured video (moving image) or an image file downloaded via the WWW 5 in the TV viewing mode. The ROM 24 is composed of a rewritable flash ROM, and stores various programs to be described later, which are features of the present invention.

  The RAM 29 includes a capture data buffer area 297 for once buffering the video captured in the TV viewing mode as shown in FIG.

  In the second embodiment, the image data stored in the image data management table 296 shown in FIG. 5B includes a moving image file based on the video data captured in the TV viewing mode. When video data is stored, broadcast information data (channel number, broadcast station name, program name) transmitted together with the video data is stored in the item of property data.

B-2. Operation of the Embodiment Next, the operation of the above-described second embodiment will be described.

  FIG. 26 is a flowchart for explaining the operation in the TV viewing mode according to the second embodiment. When the TV viewing mode is selected by the user, first, power is supplied to each circuit for receiving the digital broadcast, and the video data distributed from the broadcast station 101 is received by the above-described processing and displayed on the display unit 13. (Viewing state: Step S120). Here, FIG. 27 is a schematic diagram showing the display screen of the display unit 13 in the viewing state of step S120. In the figure, a video distributed from the broadcast station 101 and the broadcast antenna 103 is displayed in the video display area 152. In the broadcast information data display area 153, the channel number, program name, and broadcast station name distributed together with the video data are displayed. In FIG. 27, the channel number is “0ch”, the program name is “mobile news”, the broadcast The station name (distribution source) is “◯ × BCN”. An arrow icon 154 is a channel selection instruction mark. Reference numeral 155 denotes a recording standby instruction mark.

  In this display state, it is determined whether or not the operation of the function key 143 by the user has been detected (step S121). If detected, a timer built in the control unit 22 is activated to start measuring a predetermined time (step S122). Then, a transition is made to the recording standby state (step S123), and a process of copying and writing the video data supplied to the driver 25 sequentially to the capture data buffer area 297 using the video at the time when the timing is started as the first frame. Start (step S124). FIG. 28 is a schematic diagram showing the display screen of the display unit 13 in the standby state in step S124. In the figure, the contents of the video display area 152 and the broadcast information data display area 153 are the same as those in the viewing state, but a gauge 157 indicating the buffering state is displayed instead of the arrow icon 154. This gauge is displayed when the operation of the function key 143 is detected. The bar length of 157a indicates how much video data currently distributed is recorded in the capture data buffer area 297. It is. When the bar 157a reaches the right end of the gauge 157, the time is up. Reference numeral 156 denotes a recording instruction mark.

  When the operation of the capture key 150 corresponding to the recording instruction mark 156 of the user is detected in the standby state in step S123 (step S125), the video data at the time when the capture key 150 is operated is used as the first frame in the image memory 23. The transfer of the video data is started (step S126). In transferring the video data, a part of the broadcast information data, in the second embodiment, the broadcast station name is recorded and transferred so as to be displayed at the end of the display video.

  Then, in the process of transferring the video data to the image memory 23, it is determined whether or not video data of a predetermined capacity (for example, 100 Kbytes) has been accumulated (step S127). In the process of accumulating video data up to a predetermined capacity, it is determined whether or not the capture key 150 is released (step S128). If the predetermined capacity has not been reached and the capture key 150 has not been pressed, the process returns to step S126, and the accumulation of video data in the capture data buffer area 297 is continued.

  On the other hand, when the predetermined capacity is reached or the capture key 150 is released, the video data at the time of release is stored in the image memory 23 as the final frame and converted into a moving image file, which is currently distributed. The broadcast information data is acquired and stored in association with the moving image file, and the capture data buffer area 297 is cleared (step S129). Thereafter, the process returns to the viewing state (step S120) in the TV viewing mode.

  In step S130, when the timer expires in the standby state, the standby state is canceled and the viewing state is restored (step S131).

  As described above, in the TV viewing mode, when the transition to the standby mode for capturing the video data and subsequently the pressing of the capture key 150 for a predetermined time or more is detected, the video data transferred from the pressing start point. Are sequentially stored in the image memory 23, and when the predetermined capacity (100 Kbytes) is exceeded or the release of the capture key 150 is detected, this process is stopped.

  Note that when creating a mail by attaching a moving image file obtained from the video thus distributed, the creation screen is as shown in FIG. In FIG. 29, in the Subject area 131, property data (channel number, program name in this display example) stored in association with this moving image file in the image memory 23 is displayed as a default display state. In the From area 132, the name “XX” of the mail sender is displayed. The date display area 133 displays the date and time “2002/04/03 14:00 PM” of the attached moving image file. The selected moving image is displayed in the display area 134 in 128 × 96 pixels (Sub-QCIF size), and the broadcast station name “◯ × BCN” is synthesized as broadcast information data 1341 in the lower right corner. ing. The mail text display area 137 displays the mail text. Further, a function key 146 (corresponding to the function key 143) for instructing “playing” of the moving image is displayed at the bottom line of the display screen.

As described above, in the second embodiment, in a mobile phone capable of receiving digital broadcast distribution video, broadcast information data (channel number, broadcast station name, program name) is different from the video display screen when viewing the broadcast. Therefore, the distribution video can be clearly displayed even in a small display area, and can be recorded by a simple operation while viewing. On the other hand, when the moving image file obtained by recording the distribution video is attached and transmitted from the mobile phone, the broadcast information data is combined with the moving image (distribution video) to be attached. The receiving side of the e-mail with moving image can confirm whether the program was broadcast, and even in that case, which broadcast station (distribution source) belongs to which program.
In the second embodiment, the details of the mobile phone capable of receiving a digital broadcast have been described. However, the present invention is not limited to this, and a portable electronic device having a mail (message) creation function and a digital broadcast reception function is not limited thereto. Any device (portable TV, PDA) is applicable.

It is a block diagram which shows the structure of the mail transmission / reception system by the 1st Embodiment of this invention. It is an external view (open state: front view and back view) of mobile phones 1a and 1b. It is a block diagram which shows the structure of the mobile telephones 1a and 1b. It is a conceptual diagram which shows the structure of the memory area of ROM24 of the mobile telephones 1a and 1b. It is a conceptual diagram which shows the structure of the memory area of RAM29 of mobile phone 1a, 1b. It is a flowchart for demonstrating operation | movement at the time of the imaging mode by 1st Embodiment. It is a flowchart for demonstrating operation | movement at the time of the imaging mode by 1st Embodiment. It is a schematic diagram which shows a mode that a to-be-photographed object is imaged in imaging | photography mode. It is a flowchart for demonstrating the operation | movement at the time of the mail preparation of the mobile telephone by 1st Embodiment. It is a flowchart for demonstrating the operation | movement at the time of the mail preparation of the mobile telephone by 1st Embodiment. It is a flowchart for demonstrating the operation | movement at the time of the mail preparation of the mobile telephone by 1st Embodiment. It is a flowchart for demonstrating the operation | movement at the time of the mail preparation of the mobile telephone by 1st Embodiment. It is a schematic diagram which shows a display screen when "mail creation / edit" is selected. It is a schematic diagram which shows an example of a display screen when "mail creation / edit" is selected. It is a schematic diagram which shows an example of the display screen during reproducing | regenerating a moving image. It is a schematic diagram which shows a display screen when the moving image being reproduced is paused. It is a flowchart for demonstrating the operation | movement at the time of the incoming mail confirmation of the mobile telephone by 1st Embodiment. It is a schematic diagram which shows an example of the display screen during reproduction | regeneration of the moving image of the mail with a moving image received. It is a schematic diagram which shows an example of the display screen during reproduction | regeneration of the moving image of the mail with a moving image received. It is a schematic diagram which shows an example of the display screen which is stopping the moving image of the mail with a moving image received. It is a block diagram which shows the structure of the mail transmission / reception system by the 2nd Embodiment of this invention. It is a figure which shows the structure of the segment of the carrier wave allocated per broadcasting station. 1 is an external view (open state: front view) of a mobile phone 100. FIG. 1 is a block diagram showing a configuration of a mobile phone 100. FIG. 3 is a conceptual diagram showing a configuration of a memory area of a RAM 29 of the mobile phone 100. FIG. It is a flowchart for demonstrating the operation | movement at the time of TV viewing mode by 2nd Embodiment. It is a schematic diagram which shows the display screen of TV viewing condition. It is a schematic diagram which shows the display screen of a standby state. It is a schematic diagram which shows a display screen when "mail creation / edit" is selected.

Explanation of symbols

1a, 1b, 100 Mobile phone (transmission side data communication device, reception side data communication device)
2 Wireless base station 3 Communication service provider 4 Public network 5 WWW
6 Internet provider 7 Personal computer 11 Antenna 12 Speaker 13 Display unit 14 Key input unit 15 Microphone 16 Sub display unit 17 Back key 18 Imaging lens 19 Notification speaker 20 Wireless transmission / reception unit 21 Radio signal processing unit 22 Control unit 23 Image memory 24 Flash ROM
25, 26 Driver 27 Subscriber information storage unit 28 System ROM
29 RAM
32 Web server 33 Mail server 34 Switch 35 Router 62 Web server 63 Mail server 65 Router 101 Broadcast 102 Video database 103 Broadcast antenna 104 Digital broadcast receiver 131 Subject area 132 From area 133 Date display area 134 Display area 135 Display area 136 Playback time Gauge 137 Mail text display area 138 Function key 139 Function key 140 Function key 141 Mail key 142 Address key 143 Function key 144 Ten key 145 Shutter key 150 Capture key 151 Cross key 171 LED
181 Imaging module 182 DSP
192 Driver 200 Audio signal processing unit 210 Antenna 211 Tuner 212 A / D converter 213 Demodulation processing unit 214 Signal processing unit

Claims (5)

Display means having a video display area and a data display area;
Receiving means for receiving a video to be distributed and broadcast information distributed together with the video;
The video received by the receiving means is displayed in the video display area, while the received broadcast information is displayed in the data display area, and the operation content to be operated when instructing recording is displayed. 1 display control means;
Detecting means for detecting a recording instruction in a display state by the first display control means;
A first storage means for storing the video received by the receiving means and the broadcast information distributed together with the video when the recording instruction is detected by the detecting means;
Transfer means for transferring the storage contents of the first storage means to the outside of the device;
Document creation means for creating a document to be transferred together with the stored content;
When displaying the storage content to be transferred by the transfer means on the display means, the video stored as the storage content is displayed in the video display area, and the broadcast information stored in association with the stored video A second display control means for controlling to display the document created by the document creation means in the data display area ,
A portable electronic device characterized by comprising: The first display control means first displays the operation content to be operated when instructing the recording standby as the operation content to be operated when instructing the recording, and further records in response to this display. 2. The portable electronic device according to claim 1, wherein when a standby instruction is detected, an operation content to be operated when instructing recording is displayed . Second storage means for buffering video received by the receiving means;
Storage control means for starting storage of the received video in the second storage means when detecting the recording standby instruction;
Third display control means for controlling to display the storage state of the second storage means by the storage control means on the display means;
The portable electronic device according to claim 2, further comprising: 4. The portable type according to claim 3, wherein the first storage unit transfers and stores the video stored in the second storage unit when the recording unit detects a recording instruction. 5. Electronics. Computer
The content of the operation to be performed when the video received by the receiving unit is displayed in the video display area of the display unit, while the received broadcast information is displayed in the data display area of the display unit and recording is instructed. First display control means for controlling to display
Detecting means for detecting a recording instruction in a display state by the first display control means;
A storage unit that stores the video received by the receiving unit and the broadcast information distributed together with the video in the storage unit when the recording instruction is detected by the detection unit;
Transfer means for transferring the storage content stored in the storage unit by the storage means to the outside of the device;
Document creation detection means for detecting that a document to be transferred together with the stored content is created;
When displaying the storage content to be transferred by the transfer means on the display unit, the video stored as the storage content is displayed in the video display area, and the broadcast information stored in association with the stored video Second display control means for controlling to display the document whose creation is detected by the document creation detection means in the data display area,
Display program characterized by functioning as

Images