JP2007006085A - Wireless portable terminal, and imaging method and communication method using same - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a wireless portable terminal, and imaging method and communication method using the same capable of communicating simultaneously a moving image which are movie imaged and a moving image taken during a call in communicating with a television telephone, so to speak. <P>SOLUTION: In movie pickup without accompanying moving image communication, either the same first frame rate as a frame rate in realtime imaging accompanying the moving image communication or a second frame rate higher than the first frame rate is selected to pick up the moving image. With respect to the moving image for which the first frame rate has been selected, during wireless communication, a moving image (a self image) by the realtime imaging and a moving image by movie imaging at the first frame rate stored are displayed in one picture of a display part, while simultaneous communications of both of them are performed. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a wireless portable terminal capable of communicating real-time captured moving images, and an imaging method and communication method using the same.

  Japanese Patent Application Laid-Open No. 2004-228561 describes a technique related to a wireless portable terminal with a camera. Other prior art document information other than Patent Document 1 related to this application includes the following.

JP 2003-274376 A JP 2003-18320 A

  FIGS. 6B and 6C of Patent Document 1 show examples of screen display when simultaneous communication (so-called videophone) of real-time captured moving images and audio is performed. However, in FIGS. 6B and 6C described above, the images captured by the two cameras mounted on the wireless portable terminal are only displayed on the display screen together with the image of the other party. there were.

  In other words, when a moving image captured in the past with the camera attached to the wireless portable terminal is transmitted to the other party and the content of the moving image is to be discussed, the moving image is temporarily attached to an e-mail or the like. After the transmission and the other party confirmed the transmitted video, the call had to be resumed, which was troublesome.

  Therefore, it is conceivable that a moving image captured by a user during a call and a moving image captured by a movie in the past are communicated at the same time, and the captured moving image is included in the display screen of a wireless portable terminal during a videophone call.

  However, in general, the frame rate in a video phone is low, while the frame rate of a moving image at the time of shooting a movie is as high as about twice the frame rate in a video phone. In movie shooting without moving image communication, image communication processing is not required, so that the frame rate can be increased and smooth moving images can be picked up. On the other hand, in real-time shooting with moving image communication, enormous information is acquired. This is because moving image communication processing with processing is required, and it is necessary to capture moving images at a lower frame rate than when shooting a movie (in other words, with coarse frame advance). For this reason, it has not been possible to simultaneously communicate a moving image captured by a high frame rate movie and a moving image captured during a low frame rate call.

  The present invention has been made in view of the above circumstances. When performing so-called videophone communication, a wireless image capable of simultaneously communicating a moving image that has been captured with a movie and a moving image that is captured during a call. A portable terminal, and an imaging method and a communication method using the portable terminal are realized.

  The invention described in claim 1 is a wireless portable terminal capable of capturing a movie without moving image communication and real-time imaging with moving image communication, and includes a control unit, an imaging unit, a wireless communication unit, and a storage unit. In the movie imaging, the imaging unit selects either a first frame rate that is the same as a frame rate in the real-time imaging or a second frame rate that is higher than the first frame rate to select a moving image. The storage unit can store a moving image captured by the movie imaging, and the control unit can perform the real-time imaging via the imaging unit during wireless communication via the wireless communication unit. The wireless portable terminal performs communication of moving images according to the above and also performs communication of moving images of the first frame rate stored in the storage unit.

  The invention described in claim 2 is an imaging method using a wireless portable terminal capable of performing movie imaging without moving image communication and real-time imaging with moving image communication, and (a) a frame rate in the real-time imaging; Selecting whether to perform the movie imaging at the same first frame rate or to perform the movie imaging at a second frame rate higher than the first frame rate; and (b) the selected first or And taking a movie of the moving image at a second frame rate.

  The invention according to claim 3 is a communication method using a wireless portable terminal having a display unit, capable of capturing a movie without moving image communication and real-time imaging with moving image communication. A step of reading from the wireless portable terminal a moving image stored in the wireless portable terminal that has been subjected to the movie imaging at the same frame rate as the imaging frame rate; and (c) communication of a moving image by the real-time imaging. And a step of performing communication of the read moving image by capturing the movie.

  According to the first aspect of the present invention, in the movie shooting, the imaging unit selects either the first frame rate that is the same as the frame rate in real-time imaging or the second frame rate that is higher than the first frame rate. In the wireless communication via the wireless communication unit, the control unit communicates the moving image by real-time imaging via the imaging unit, and the first frame rate moving image stored in the storage unit Also communicates images. Since the frame rate of real-time imaging and the frame rate of movie imaging of moving images stored in the storage unit are both the same as the first frame rate, a movie that has already been captured when performing so-called videophone communication It is possible to simultaneously communicate an image and a moving image captured during a call. Therefore, it is possible to confirm a moving image obtained by movie imaging and a moving image obtained by real-time imaging on a single screen, and it is not necessary to transmit the movie captured image to the other party in advance.

  According to the second aspect of the present invention, it is selected whether movie shooting is performed at the same first frame rate as the frame rate in real-time imaging or movie shooting is performed at a second frame rate higher than the first frame rate. Then, moving image movie shooting is performed at the selected first or second frame rate. Therefore, when moving image movie shooting is performed at the first frame rate, the real-time imaging frame rate and the movie shooting frame rate are both the same as the first frame rate, and so-called videophone communication is performed. In this case, it is possible to simultaneously communicate a moving image that has been captured with a movie and a moving image that is captured during a call. On the other hand, when a moving image movie is captured at the second frame rate, a smooth moving image can be captured.

  According to the third aspect of the present invention, a moving image stored in the wireless portable terminal, which has been captured at the same frame rate as the frame rate in real-time imaging, is read from the wireless portable terminal, and a moving image is obtained by real-time imaging. In addition to image communication, the read-out movie image communication is also performed. Since the frame rate for real-time imaging is the same as the frame rate for movie recording of stored moving images, a moving image captured during movie calls and a moving image captured during a telephone call when performing a so-called videophone communication Can be communicated simultaneously. Therefore, it is possible to confirm a moving image obtained by movie imaging and a moving image obtained by real-time imaging on a single screen, and it is not necessary to transmit the movie captured image to the other party in advance.

  Embodiments according to the present invention have the same first frame rate as the frame rate in real-time imaging with moving image communication or a second frame rate higher than the first frame rate in movie shooting without moving image communication. With regard to a moving image in which a moving image is picked up by selecting any one and the first frame rate is selected, a moving image is communicated by real-time imaging during wireless communication, and a movie having a stored first frame rate A wireless portable terminal that performs simultaneous communication of moving images by imaging, and an imaging method and a communication method using the wireless portable terminal.

  FIG. 1 is a diagram showing an example of a wireless portable terminal according to the present invention. As shown in FIG. 1, this wireless portable terminal is a cellular phone 1, which includes a color display unit 2 such as a liquid crystal display screen, a receiver 3, a sub camera 4 as a part of an imaging unit, a key button 5, a microphone 6, and a speaker. 7, an antenna 8 and a main camera 9 which is another part of the imaging unit.

  FIG. 2 is a diagram showing a circuit configuration of the mobile phone 1 of FIG. As shown in FIG. 2, the mobile phone 1 includes a control unit 10 composed of a CPU (Central Processing Unit) and a memory, a memory 11 as a storage unit such as a flash memory, an audio control unit 12, and other imaging units. The image encoder 13, the image decoder 14, the image / audio processor 15, the wireless communication unit 16, and the audio encoder / decoder 17 are included.

  The control unit 10 controls each circuit of the memory 11, the audio control unit 12, the image encoder 13, the image decoder 14, the image / audio processing unit 15, and the audio encoder / decoder 17. Information input from the user via the key button 5 is given to the control unit 10. The memory 11 can store information output from the image / sound processing unit 15 as well as information from the control unit 10.

  The voice control unit 12 is connected to the receiver 3, the microphone 6, the speaker 7, and the voice coder / decoder 17, and controls voice transmission / reception at the time of a call, generation of a ringing tone, and the like. The image encoder 13 is a component of the imaging unit and is connected to the sub camera 4, the main camera 9, the image decoder 14, and the image / audio processing unit 15, and is a sub component that is another component of the imaging unit. Image information captured by the camera 4 and the main camera 9 is encoded. The image decoder 14 is connected to the color display unit 2, decodes the encoded image, and displays the image on the color display unit 2.

  The image / audio processing unit 15 is connected to the memory 11, the image encoder 13, the wireless communication unit 16, and the audio encoder / decoder 17, and performs mixing processing on encoded audio and image information, Data processing such as processing for separating voice / image information transmitted from the other party into voice information and image information is performed. The wireless communication unit 16 is connected to the antenna 8 and performs modulation / demodulation for wireless communication of voice and image information. The voice encoder / decoder 17 encodes voice information from the voice control unit 12 and decodes received voice information.

  Next, the operation of the mobile phone 1 during movie imaging and real-time imaging will be described. When shooting a movie without moving image communication, a moving image is first picked up by the main camera 9, and the moving image is encoded by the image encoder 13. In addition, voice is input from the microphone 6, and voice is encoded in the voice encoder / decoder 17 via the voice control unit 12. The thus encoded moving image and sound are subjected to data processing such as mixing processing in the image / sound processing unit 15 and stored in the memory 11.

  On the other hand, when performing real-time imaging with moving image communication, a moving image of a user is captured by the sub camera 4 and encoded by the image encoder 13 in order to perform simultaneous communication of a moving image and sound (so-called videophone). Is done. In addition, voice is input from the microphone 6, and encoding is performed in the voice encoder / decoder 17 via the voice control unit 12. The video / audio thus encoded is subjected to data processing such as mixing processing in the image / audio processing unit 15 and transmitted from the antenna 8 via the wireless communication unit 16. Also, the moving image and audio information from the call destination is received by the antenna 8 and demodulated by the wireless communication unit 16, and then the moving image and audio information is sent to the image / audio processing unit 15. Thus, data processing such as image / audio information separation is performed. The audio information is output to the receiver 3 or the speaker 7 via the audio control unit 12, and the moving image information is output to the color display unit 2 via the image decoder 14.

  In the present invention, a moving image obtained by movie shooting stored in the memory 11 is read out when making a videophone call, picked up by the sub camera 4 during the videophone call, and encoded by the real time image pickup 13 via the image encoder 13. Simultaneous communication of a moving image and a moving image by movie shooting and simultaneous display on the color display unit 2 are performed.

  FIG. 3 is a diagram illustrating a screen display example in the color display unit 2. In FIG. 3, a moving image 19 of a videophone call partner and transmission information 18 from the user are shown in the color display unit 2. The transmission information 18 from the user includes a moving image 20 of the user himself / herself captured by the sub camera 4 and encoded, and a moving image 21 captured by the movie stored in the memory 11.

  Then, by transmitting the simultaneously displayed moving image (transmission information 18 from the user) from the antenna 8 via the wireless communication unit 16, the moving image 21 and real-time imaging by movie imaging are performed with the other party. Simultaneous communication with the moving image 20 is performed. At this time, the call voice input from the microphone 6 and encoded by the voice encoder / decoder 17 via the voice control unit 12 is also mixed with the moving image in the image / voice processing unit 15, thereby creating a movie. It is possible to make a call with the other party of the videophone call while performing simultaneous communication between the moving image 21 obtained by imaging and the moving image 20 obtained by real-time imaging.

  FIG. 4 is a flowchart illustrating an imaging method using the wireless portable terminal according to the present invention, and is a flowchart at the time of movie imaging without moving image communication. In the present invention, when shooting a movie with the sub camera 4 or the main camera 9 which is a part of the imaging unit, the first frame rate or the first frame rate is the same as the frame rate in real-time imaging with moving image communication. A higher second frame rate is selected to capture a moving image. A moving image on which movie shooting has been performed is stored in the memory 11.

  In movie imaging without moving image communication, since image communication processing is not required, the frame rate can be increased and a smooth moving image can be captured. On the other hand, since real-time imaging with moving image communication requires moving image communication processing with enormous information processing, moving images are picked up at a lower frame rate (roughly frame-by-frame feed) than when shooting a movie. There is a need. Therefore, in the present invention, when taking a movie without moving image communication, the user takes into account the possibility of sending a moving image taken with a movie together with a real-time moving image at the time of a videophone call. The frame rate can be selected.

  When there is a possibility that a moving image captured by a movie is sent together with a real-time moving image during a videophone call, the user may select the same first frame rate (for example, 15 frames / second) as the frame rate in real-time imaging. This is because, since the same frame rate is used, when moving image communication by real-time imaging is performed, simultaneous communication of a moving image captured by movie imaging and display on the color display unit 2 can be performed. On the other hand, when there is no possibility of sending a moving image captured by a movie together with a real-time moving image during a videophone call, the user may select a second frame rate (for example, 30 frames / second) higher than the first frame rate. . This is because smooth moving images can be captured.

  That is, after the user operates the key button 5 to activate the movie imaging function (step S1), movie imaging is performed by videophone recording (imaging at the same first frame rate as that in real-time imaging). Or it is performed by normal recording (capturing at a second frame rate higher than the first frame rate) or by displaying a selection screen on the color display unit 2 to allow the user to select (step S2).

  When the videophone recording is selected, the control unit 10 sets the frame rate to the first frame rate for the image encoder 13 which is a part of the imaging unit (step S3), and starts shooting. (Step S4). On the other hand, when the normal recording is selected, the control unit 10 causes the image encoder 13 to start shooting at the second frame rate that is the default frame rate (step S4).

  As described above, according to the imaging method using the wireless portable terminal according to the present invention, movie imaging is performed at the same first frame rate as the frame rate in real-time imaging, or the second frame higher than the first frame rate. Whether movie shooting is performed at a rate is selected, and movie shooting of a moving image is performed at the selected first or second frame rate. Therefore, when moving image movie shooting is performed at the first frame rate, the real-time imaging frame rate and the movie shooting frame rate are both the same as the first frame rate, and so-called videophone communication is performed. In this case, it is possible to simultaneously communicate a moving image that has been captured with a movie and a moving image that is captured during a call. On the other hand, when a moving image movie is captured at the second frame rate, a smooth moving image can be captured.

  FIG. 5 is a flowchart showing a communication method using the wireless portable terminal according to the present invention. After the videophone call is started (step S11), the control unit 10 monitors whether or not the user requests the reproduction of the moving image captured by the movie through the operation by the key button 5 (step S12). When the user is requesting playback of a moving image captured by a movie, the control unit 10 searches the memory 11, and data of a moving image that can be played back during a videophone call (specifically, a frame rate in real-time imaging) It is detected whether there is moving image data captured at the same first frame rate (step S13).

  If there is no reproducible moving image data, the control unit 10 displays on the color display unit 2 that the reproduction is impossible via the image decoder 14, and informs the user accordingly (step S14). ). On the other hand, when there is reproducible moving image data, the control unit 10 reads out the moving images that have been captured at the first frame rate and stored in the memory 11 and displays the list on the color display unit 2. This is displayed to prompt the user to select which moving image to send (step S15).

  After the user selects a moving image to be transmitted via the key button 5, the control unit 10 displays the selected moving image captured by the movie and the moving image captured in real time by the sub camera 4 as an image / audio. The image data is compressed by the processing unit 15 and a two-screen composition process is performed (step S16). That is, each size of the moving image for movie imaging and the moving image for real-time imaging is compressed to, for example, 1/2, and two screens are combined into one screen. The combined image is displayed on the color display unit 2 as transmission information 18 from the user in FIG. 3, and further transmitted from the antenna 8 to the base station via the wireless communication unit 16 and transmitted to the other party of the call. (Step S17). Note that the receiving terminal of the other party of the call does not synthesize the moving image of movie shooting, and performs the same reception process as when receiving a normal real-time moving image, so that the moving image of movie shooting and the moving image of real-time shooting are processed. It is possible to display a two-screen composite image.

  That is, at the time of wireless communication via the wireless communication unit 16, the control unit 10 includes a moving image 20 by real-time imaging via the sub camera 4 that is a part of the imaging unit, and a memory within one screen of the color display unit 2. 11 and the moving image 21 having the first frame rate stored in the memory 11 are displayed, and simultaneous communication between them is performed.

  Note that for audio communication when transmitting a two-screen composite image of a moving image by movie imaging and a moving image by real-time imaging, for example, the user selects either audio during movie imaging or audio during real-time imaging. So that it can be transmitted. When transmitting the sound at the time of shooting the movie, the voice information accompanying the movie moving image read from the memory 11 is transmitted to the other party of the call through the image / sound processing unit 15 in the same manner as in the case of transmitting the image information. Send to. At this time, the call voice input from the microphone 6 is muted by the voice control unit 12 so as not to be transmitted to the other party. Further, the sound of the movie moving image is read out from the memory 11 via the image / audio processing unit 15, the audio encoder / decoder 17, the audio control unit 12, and the speaker 7, and not only to the call partner terminal but also to the own terminal. Also play movie movie audio.

  On the other hand, when a call voice accompanying a real-time moving image is transmitted, the sound at the time of movie shooting is muted by the image / sound processing unit 15, and the call voice accompanying the real-time moving image input from the microphone 6 is controlled by voice control. The data is transmitted to the other party via the unit 12, the audio code / decoder 17, the image / audio processing unit 15, the wireless communication unit 16, and the antenna 8.

  Note that, as described above, not only one of the sound at the time of movie imaging and the sound at the time of real-time imaging may be transmitted, but a configuration in which both are mixed and transmitted may be employed.

  According to the wireless portable terminal and the communication method using the wireless portable terminal according to the present invention, the imaging unit including the sub-camera 4, the main camera 9, and the image encoder 13 has a frame rate in real-time imaging in movie imaging. A moving image is picked up by selecting either the same first frame rate or a second frame rate higher than the first frame rate, and the control unit 10 performs color communication during wireless communication via the wireless communication unit 16. While displaying the moving image 20 obtained by real-time imaging via the imaging unit and the moving image 21 having the first frame rate stored in the memory 11 on one screen of the display unit 2, both are simultaneously communicated. Since the frame rate of real-time imaging and the frame rate of movie imaging of moving images stored in the memory 11 are both the same as the first frame rate, the movie-captured moving image is used when performing so-called videophone communication. It is possible to simultaneously communicate an image and a moving image captured during a call. Therefore, it is possible to confirm a moving image obtained by movie imaging and a moving image obtained by real-time imaging on a single screen, and it is not necessary to transmit the movie captured image to the other party in advance.

It is a figure which shows an example of the wireless portable terminal which concerns on this invention. It is a figure which shows the circuit structure of the mobile telephone of FIG. It is a figure which shows the example of a screen display in a display part. It is a flowchart which shows the imaging method using the wireless portable terminal which concerns on this invention, Comprising: It is a flowchart at the time of movie imaging. 3 is a flowchart illustrating a communication method using a wireless portable terminal according to the present invention.

Explanation of symbols

1 mobile phone, 2 color display unit, 4 sub camera, 9 main camera, 10 control unit, 11 memory, 16 wireless communication unit.

Claims (3)

A wireless portable terminal capable of capturing a movie without moving image communication and real-time imaging with moving image communication,
A control unit;
An imaging unit;
A wireless communication unit;
A storage unit,
In the movie imaging, the imaging unit selects a first frame rate that is the same as a frame rate in the real-time imaging or a second frame rate that is higher than the first frame rate to capture a moving image,
The storage unit can store a moving image captured by the movie imaging,
The control unit performs communication of a moving image by the real-time imaging through the imaging unit during wireless communication through the wireless communication unit, and the moving image of the first frame rate stored in the storage unit Wireless mobile terminal that also communicates. An imaging method using a wireless portable terminal capable of performing movie imaging without moving image communication and real-time imaging with moving image communication,
(A) selecting whether to perform the movie imaging at the same first frame rate as the frame rate in the real-time imaging or to perform the movie imaging at a second frame rate higher than the first frame rate;
(B) An imaging method using a wireless portable terminal, comprising: performing the movie imaging of a moving image at the selected first or second frame rate. A communication method using a wireless portable terminal having a display unit capable of capturing a movie without moving image communication and real-time imaging with moving image communication,
(A) reading from the wireless portable terminal a moving image stored in the wireless portable terminal in which the movie is captured at the same frame rate as the frame rate in the real-time imaging;
(C) A communication method using a wireless portable terminal, comprising performing communication of the moving image by the real-time imaging and performing communication of the read moving image by the movie imaging.

Images