JP2005303561A - Moving object terminal device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To timely secure a photographing opportunity in a photographing mode, and secure a moving image of a transport stream to avoid missing it. <P>SOLUTION: If a half-depression operation of a release button is performed while the transport stream to be distributed is received by a receiving means and the reception mode for synthesizing the received image data and displaying it on an LCD panel is being activated, the device shifts to an image pickup mode and an image to be picked up by a CCD sensor is displayed on the LCD panel. Also, the stream which is received until then is recorded in a memory while the device shifts to the photographing mode. Further, after photographing is performed in the photographing mode, stream video recording is finished, and the device automatically restored to the receiving mode to display the stream received at present again on the LCD panel. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a portable mobile terminal device having an electronic camera and a moving image distribution receiving function such as a TV tuner.

  Conventionally, as portable mobile terminal devices, mobile phones, PDA (Personal Digital Assistant) devices, and the like are known (Patent Document 1). Some of these electronic devices have a built-in electronic camera so that you can shoot the desired image whenever you want, and some have a built-in TV tuner so that you can watch TV whenever you want. Known (Patent Document 2).

  In the invention described in Patent Document 2, it is possible to use both a function of a mobile phone such as a function of sequentially receiving moving image distribution from the Web or a function of a videophone, and a function of sequentially receiving digital terrestrial broadcasting. Mobile phones that can be used are described, and circuits such as encoding / decoding processing are made common so as not to increase size, weight, and cost.

JP 2003-309756 A JP 2003-153111 A

  By the way, there is an increasing demand for recording television broadcasts in mobile terminal devices. For example, in terrestrial digital broadcasting, the frequency of 1 channel 5.7 MHz is divided into 13 segments, and one of these segments is allocated exclusively for mobile terminals. In order to send a video to a mobile terminal such as a mobile phone with a small antenna, a technology for compressing video information is indispensable. However, in order to use a technique for increasing the compression rate so as to obtain high image quality, for example, a technique of “MPEG-4” or “H.264” standard, the complexity of the algorithm becomes high, and the reproduction side In the case of hardware, for example, a semiconductor chip, problems such as an increase in chip area and an increase in operating frequency are caused.

  An object of the present invention is to provide a mobile terminal device that can receive a transport stream such as TV broadcast received by a TV tuner or video data distributed on the Web and record the stream easily and at low cost. And

  In order to achieve the above object, in the mobile electronic device of the present invention, the received moving image data is received in the mobile terminal device that receives the moving image data to be distributed by the receiving means and displays the received moving image data on the display unit. A recording means for recording in a memory; and a control means for controlling the recording means to record the moving image data in response to the operation of the recording instruction means under a predetermined condition. is there.

  Also, a control means for executing a playback mode in which recorded moving image data is reproduced from the memory or the second memory in response to an operation of the reproduction instruction means and an image of the reproduced moving image data is displayed on the display unit. It is desirable to prepare for.

  As the predetermined conditions for recording a television broadcast, there are cases where an arbitrary channel of the television broadcast is being viewed on the display unit or is being shot with an electronic camera. While an arbitrary channel (one channel) of the television broadcast is being viewed on the display unit, a television broadcast of another channel different from the one channel cannot be viewed. For this reason, the other channel is recorded on the back side. In this case, it is necessary to provide two TV tuners and two decoders (decoding processing units).

  In addition, a photographing mode in which a subject image combined with a photographing lens is picked up by a photographing unit on a mobile terminal device and the picked-up image is displayed as a through image on the display unit, and at least the photographing mode and the receiving mode are selected. Some have a mode selection operation unit for selecting automatically. In this case, there are times when it is desired to shoot a television broadcast with an electronic camera while watching through the display unit. In this case, the shooting mode is activated, a through image is displayed on the display unit, and framing is performed for shooting. However, since the live view image picked up by the image pickup means is displayed on the display unit during the period in which this shooting mode is activated, the result is that the television broadcast that was previously watched is missed. Therefore, when the shooting mode is being executed, if the TV broadcast of the channel received earlier is recorded, it can be viewed later. In this case, it is necessary to provide a recording unit for recording a television broadcast, in addition to the function of recording the image captured by the imaging unit in the memory.

  Further, when a telephone call is received from the public telephone network while a television broadcast is being displayed on the display unit or when the recorded moving image data is being reproduced on the display unit, the reproduction is temporarily interrupted to give priority to the incoming call. Further, in response to the incoming call, a mark or a character indicating the incoming call may be displayed on the display unit, and the reproduction may be temporarily interrupted in response to the incoming call operation.

  As an optimal configuration for the mobile terminal device of the present invention, a moving image data to be distributed is received by a receiving unit including an antenna, and a received mode in which the received moving image data is displayed on the display unit, and an image captured by the imaging unit. Either a shooting mode in which data is displayed on the display unit and an image captured in response to a shutter release is encoded by a compression processing circuit and recorded in a memory by a first recording unit, or a reception mode or a shooting mode The selection operation unit for selecting one and the mode selected by the selection operation unit are activated, and the mode is changed to the shooting mode in response to selecting the shooting mode by the selection operation unit while the reception mode is activated. It is preferable to include control means for recording the previously received moving image data with the second recording means during the period of shifting to the shooting mode.

  As the control means, the image data captured by the imaging means in response to the operation of the imaging instruction means is displayed on the display section, and the image data obtained by imaging in response to the operation of the recording instruction means is compressed by the compression processing section A first control unit that executes a shooting mode that is encoded and recorded in a memory; and the received moving image data is received sequentially by the receiving unit; the received moving image data is decoded by the data processing unit; And a second control means for executing a reception mode for displaying the decoded moving image data in the memory or the second memory. If one of these control means has a role of controlling the display unit and the other control means is controlled in synchronization with the one control means, it is not necessary to use a high-speed control means. However, since it can be processed individually by the two control means, it can be achieved at a low cost.

  As described above, in the mobile terminal device of the present invention, since the television broadcast is recorded under a predetermined condition, it is not necessary to provide a large recording capacity, and the portable mobile terminal device can easily record. can do. In the invention of recording a television broadcast while the shooting mode is being executed, a television broadcast scene that was missed during the start of the shooting mode can be viewed later.

  As shown in FIG. 1, the mobile phone 10 of the present invention includes a camera unit 11 and a mobile / broadcast transmission / reception unit 12. In the camera unit 11, a subject image formed by an imaging lens 13 provided outside is captured by a CCD sensor 14, and an image signal output from the CCD sensor 14 is sent to a CDS / AD circuit 15. The drive of the CCD sensor 14 is controlled by the main CPU 17 via the CCD driver 16. The CDS / AD circuit 15 is an A / D converter circuit dedicated to image processing that incorporates a CDS (interphase double sampler) that corrects an error due to a characteristic residual charge of the CCD sensor 14.

  The digital image data converted by the CDS / AD circuit 15 is sent to the first bus line 18. An image processing unit 19, a compression / decompression unit 20, an IF controller 21, a main CPU 17, and the like are connected to the first bus line 18, and image data is transferred to the LCD panel 23 via the main CPU 17 and the LCD driver 22. Displayed as a through display. The drive of the CDS / AD circuit 15, the image processing unit 19, the compression / decompression unit 20, the IF controller 21, and the LCD driver 22 is controlled by the main CPU 17.

  The main CPU 17 is connected to the ROM 24, the first SDRAM 25, and the operation unit 26. The ROM 24 controls the operation of the main CPU 17 and a sub CPU 27, which will be described in detail later, and is a program used in a shooting mode, a television broadcast reception mode (hereinafter referred to as “reception mode”), a cellular phone function, and the like, an MPEG video Data and programs for reproducing JPEG format image data, and constants used in these programs are stored.

  A first SDRAM (Synchronous DRAM) 25 is a main memory that is synchronized with an external clock of the main CPU 17, and is used as an image memory and a display memory for storing image data obtained by capturing a part of the image data. The operation unit 26 includes a mode changeover switch 28 for switching modes and a release button 29. The mode selector switch 28 includes buttons for a shooting mode 28a, a television broadcast reception mode (hereinafter referred to as “reception mode”) 28b, and a playback mode 28c, and the mode can be selected by operating any button. One is selected. The shooting modes include a still image recording mode for shooting still images and a moving image recording mode for recording movies (moving images). The playback mode includes a shooting data selection button 24 for selecting still image or moving image data recorded in the shooting mode, and a reception data selection button 33 for selecting moving image data recording a television broadcast.

  The release button 29 includes a half-press switch S1 that detects that the button has been pressed to approximately half of the full stroke, and a full-press switch S2 that detects that the button has been pressed to the full stroke. . The operation unit 26 is provided with a numeric keypad button, a recording button, and the like that are used for the function of the mobile phone. Note that these buttons are also used when used in the shooting mode, playback mode, and reception mode.

  A first slot 31 is connected to the IF controller 21 via an interface 30. A first memory card 32 as a recording medium is detachably set in the slot 31. When the shooting mode is selected, distance measurement and photometry (not shown) are performed in response to detecting the half-press switch S1, and the image data captured at that time is captured in the image memory, and the image memory is loaded. The read image data is displayed on the LCD panel 23. The image data read from the image memory in response to detecting the full-press switch S2 is sent to the compression / decompression unit 20 for compression, and the compressed image data is sent to the IF controller 21 to the first memory card 32. Control to record. In the moving image recording mode, recording is started when the first full-press switch S2 is detected, and recording is stopped when the next full-press switch S2 is detected.

  The portable / broadcast transmission / reception unit 12 includes an antenna 34, a terrestrial digital reception unit 35, a data processing unit 36, a TS processing unit 37, an MPEG processing unit 38, an audio output unit 39, a speaker 40, an IF controller 41, and a second slot 42. The mobile phone transmission / reception unit 43, the mobile phone processing unit 44, the sub CPU 27, the second SDRAM 45, and the like. Each of the terrestrial digital reception unit 35, the data processing unit 36, the TS processing unit 37, the MPEG processing unit 38, the IF controller 41, and the sub CPU 27 is connected via a second bus line 46.

  The antenna 34 corresponds to each use frequency of a mobile phone and terrestrial digital broadcasting. The mobile phone transmission / reception unit 43 and the mobile phone processing unit 44 are circuit portions dedicated to mobile phones, and the terrestrial digital reception unit 35, the data processing unit 36, and the TS processing unit 37 are circuit portions dedicated to terrestrial digital broadcasting. is there. Further, the sub CPU 27, the MPEG processing unit 38, and the audio output unit 39 are shared by the mobile phone function and the reception mode.

  The sub CPU 27 is driven in synchronization with the main CPU 17, and a bus line 45 for transferring data is connected between the main and sub CPUs 17 and 27. The main CPU 17 includes a sub CPU 27 that controls the operation of the sub CPU 27. The main CPU 17 includes programs such as a reception mode and a mobile phone function, a program for reproducing moving image data in MPEG format and image data in JPEG format, and constants used in these programs. Through the ROM 24 to process these programs.

  That is, the sub CPU 27 of the dual CPUs 17 and 27 is optimized for functions requiring high-speed processing such as reception mode processing and mobile phone mode processing, and the other main CPU 17 is generally used for shooting mode processing and display processing. It plays a role of a typical control means (controller). A second ROM may be connected to the sub CPU 27 and a program for controlling the operation of the sub CPU may be separately stored in the second ROM.

  The terrestrial digital receiver 35 includes a receiving circuit for receiving terrestrial digital broadcasting, a video / audio demodulating circuit, and the like. The data processing unit 36 demodulates relatively short fixed-length packet data received by the terrestrial digital broadcast receiving unit, and outputs video data, audio data, and a transport (TS) signal. . The TS processing unit 37 demodulates the transport signal, cuts out a header, an adaptation field, a payload, and the like and sends them to the MPEG processing unit 38. The MPEG processing unit 38 decodes the video data and audio data obtained from the data processing unit 36 into an MPEG4 format video signal and audio signal based on the transport signal.

  The decoded video signal is written to the display memory using a part of the second SDRAM 45 via the sub CPU 27, and then sent to the LCD driver 22 via the main CPU 17 and displayed on the LCD panel 23. The audio output unit 39 performs electrical / acoustic conversion on the audio signal processed by the MPEG processing unit 38 through the speaker 40 and outputs the result.

  When recording terrestrial digital broadcasting, the sub CPU 27 reads out from the display memory and sends it to the IF controller 41 in response to an operation of a recording button provided in the operation unit 26. A second slot 42 is connected to the IF controller 41 via an interface 47. A second memory card 48 is detachably provided in the second slot 42, and compressed moving image data sent from the IF controller 41 is recorded on the second memory card 48.

  The main CPU 17 controls the LCD panel 23 to display either one of the image data captured based on the mode selection signal from the operation unit 26 or the received moving image data. When the shooting mode is selected, a screen for selecting a still image recording mode and a moving image recording mode is displayed on the LCD panel 23 next. When the still image recording mode is selected, still image data obtained in response to the shutter release is compressed and recorded in the first memory card 32. When the moving image recording mode is selected, the moving image data is compressed and recorded on the first memory card 32. Note that moving image recording in the shooting mode defines the maximum recording time.

  When the reception mode is selected, a channel selection screen is displayed on the LCD panel 23. By selecting a channel on this screen, the television broadcast of that channel is displayed on the LCD panel 23.

  By the way, there are cases where it is desired to take a picture while receiving or recording a television broadcast. In this case, since the television broadcast is displayed on the LCD panel 23, the result is a missed photo opportunity.

  Therefore, as shown in FIG. 2, when the release button 29 is half-pressed while a television broadcast is being displayed, the main CPU 17 executes a shooting mode in response to this and the image captured by the CCD sensor 14 is displayed on the LCD. The CCD driver 16, the image processing unit 19, and the LCD driver 22 are controlled to display on the panel 23. Thereby, the display of the LCD panel 23 is switched from the television broadcast to an image captured by the CCD sensor 14. Note that a shooting mode in which shooting is performed while watching a TV broadcast is referred to as an “interrupt shooting mode”. The operation for shifting to the interrupt shooting mode is not limited to the half-pressing operation of the release button 29 but may be performed by other button operations.

  While the interrupt shooting mode is being executed, the television broadcast display is disabled. For this reason, when the interruption shooting mode is changed from the television broadcast display, the subsequent television broadcast scene is missed. Therefore, during the interrupt shooting mode, the previously received television broadcast is recorded. That is, the main CPU 17 controls the sub CPU 27 to record the television broadcast being received in the second memory card 48 in response to switching the LCD panel 23 to the photographed image. Therefore, while the main CPU 17 performs control to display a through image on the LCD panel 23, the sub CPU 27 controls the portable / broadcast transmission / reception unit 12 so as to record the television broadcast being received at that time.

  In the interrupt shooting mode, only a still image is recorded. When the operation for shifting to the interrupt shooting mode is performed, that is, when the release button 29 is half-pressed, the LCD panel 23 is switched to the through image display in response to this, and at the same time, distance measurement and photometry are performed, Shooting is performed by performing. The image data captured at this time is recorded on the first memory card 32. In the interrupt shooting mode, the still image recording mode and the moving image recording mode may be alternatively selected to perform shooting.

  After recording the image, the display mode is automatically returned to the reception mode again, and the television broadcast being received is displayed on the LCD panel 23. At this time, the recording of the television broadcast is also ended. In addition to the moving image data, it is desirable to record the time stamp such as the recording start date and time and the information such as the channel number as the recorded data because it is easy to search the recorded data later.

  When the playback mode is selected, a selection screen for shooting data and reception data is displayed on the LCD panel 23. When shooting data is selected, a list of still image data and moving image data recorded on the first memory card 32 is displayed on the LCD panel 23. Then, by designating desired data from the list display by input of the operation unit, an image of the designated data is reproduced on the LCD panel 23. When the reception mode is selected, a list of moving image data recorded on the second memory card 48 is displayed on the LCD panel 23. Then, an image of the designated data is reproduced on the LCD panel 23 by designating desired data from the list display.

  If a mobile phone call is received while an image is being reproduced on the LCD panel 23, a mark indicating the call is displayed on a part of the screen of the LCD panel 23. Then, during playback of the image, the mobile phone's incoming operation, for example, by operating the start button that is a telephone mark with the handset raised, in response to this, playback is temporarily interrupted and the mobile phone's functions are Operates and can receive calls using the mouthpiece and earpiece. Then, the call is ended by operating the call end button, for example, the end button which is a telephone mark with the handset. When the call is finished, it is preferable to return to the playback mode in which the temporarily interrupted image is played back again.

  In the above embodiment, the television broadcast is recorded during the period of transition to the interrupt shooting mode while watching the television broadcast. However, the present invention is not limited to the television broadcast, and is connected to the Internet using a mobile phone function. For example, it is configured to switch to the interrupt shooting mode even when video data from streaming distribution etc. is displayed while downloading, and the remaining video data previously displayed during this period is buffered in the memory It may be configured to record automatically. In this case, the moving image data distributed from the Internet is not limited to the MPEG-4 standard, but is a file corresponding to a compression standard such as MPEG, MPEG-2, or “H.264”. Instead of the unit 36, the TS processing unit 37, and the MPEG processing unit 38, a data processing circuit capable of reproducing a file according to the compression standard may be provided.

  In the above embodiment, the captured image data is separately recorded on the first memory card 32 and the video data of the television broadcast is separately recorded on the second memory card 48. However, the image data is recorded on one memory card. May be. In this case, the storage area of one memory card may be divided into a recording area for the shooting mode and a recording area for the reception mode in advance, or the recording area for the still image data and the moving image recording area may be used. It may be divided into data recording areas. The memory card is a detachable type, but a fixed built-in memory may be used.

  Furthermore, since the file size of moving image data becomes large, the capacity of the memory may be exceeded. In this case, recording ends at that time. For this reason, there arises a disadvantage that the recording ends without knowing. Therefore, it is preferable that the recording time or storage capacity is set in advance according to the storage capacity of the memory by input from the operation unit 26. According to this, it is possible to know in advance the maximum time that can be recorded. Further, when the memory capacity is exceeded, the moving image data may be divided and recorded in the overwrite mode in the first memory card 32.

  In the above-described embodiment, an example of a mobile phone with an electronic camera and a TV tuner has been described. However, the present invention is not limited to this and is not limited to a mobile phone, and the present invention is applied to a portable electronic device such as a PDA. Needless to say, you can.

It is a block diagram which shows the electrical outline of the portable electronic device of this invention. It is a flowchart figure which shows the operation procedure of a portable electronic device. FIG. 3 is a flowchart showing a continuation of the operation procedure described in FIG. 2.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Mobile phone 11 Camera part 12 Mobile / broadcast transmission / reception part 13 Shooting lens 14 CCD sensor 17 Main CPU
27 Sub CPU
28a Shooting mode button 28b Reception mode button 28c Playback mode button 32 First memory card 48 Second memory card S1 Release button half-press detection switch S2 Release button full-press detection switch

Claims (5)

In a mobile terminal device that receives moving image data distributed by a receiving means including an antenna and displays the received moving image data on a display unit,
Recording means for recording the received moving image data in the memory, and control means for controlling the recording means to record the received moving image data in response to an operation of the recording instruction means under a predetermined condition. A mobile terminal device characterized by that.   2. The control unit according to claim 1, wherein the control unit executes a reproduction mode in which the moving image data recorded in the memory is reproduced in response to an operation of the reproduction instruction unit and an image of the moving image data is displayed on the display unit. The mobile terminal device described.   The subject image combined by the photographing lens is picked up by the image pickup means, the picked-up image is displayed as a through image on the display unit, and the image picked up at that time in response to the operation of the photographing instruction means is the memory or the same A period during which the shooting mode is being executed under the predetermined condition, including a shooting mode to be recorded in a different second memory, and a selection operation unit that selectively selects at least the shooting mode and the reception mode The mobile terminal device according to claim 1, wherein the mobile terminal device is configured as described above.   A mobile phone function having a transmission / reception unit for transmitting / receiving to / from the public telephone network is provided, and the control means receives a call from the public telephone network while reproducing the received video data or reproducing the recorded video data. 4. The mobile terminal device according to claim 1, wherein the playback is temporarily interrupted.   A mobile phone function having a transmission / reception unit for transmitting / receiving to / from the public telephone network is provided, and the control means receives a call from the public telephone network while reproducing the received video data or reproducing the recorded video data. 5. The mobile terminal apparatus according to claim 4, wherein a mark indicating an incoming call is displayed on a display unit displaying a moving image.

Images