JP2005167324A - Image transmitting apparatus and transmission control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image transmitting apparatus and a transmission control apparatus which are capable of easily performing a series of processes from photographing of an image by a photographing means to checking whether or not the image is focused and transmission of an electronic mail with the image, and exactly performing checking whether or not the image is focused. <P>SOLUTION: In a cellular phone 1, it is determined whether or not the image photographed in a camera mode is focused (step S14), and subsequently, processing of transmitting the electronic mail with the image is performed if it is determined that the image is focused (step S15). <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an image transmission device and a transmission control method, for example, an image transmission device included in a communication device such as a mobile phone having an imaging function, and a transmission control method thereof.

In recent years, a mobile phone is provided with photographing means typified by a digital camera, thereby increasing the number of usage modes in which photographing is easily performed and reproduced by a mobile phone alone (for example, see Patent Document 1).
Furthermore, mobile phones equipped with such photographing means often have a function of attaching an image photographed by the photographing means to an e-mail and easily transmitting it to a third party.
Japanese Patent Laid-Open No. 2003-110681

  However, when taking a picture using such a picture taking function of a mobile phone and then attaching it to an e-mail and sending it to a third party, whether the photographed image is in focus, camera shake, etc. There is a problem that the merit that “it is easy to shoot and transmit” cannot be utilized. Furthermore, the display screen of the mobile phone has a problem that it is difficult to check whether or not the captured image is good because the resolution is low or the screen is small.

  Therefore, an object of the present invention is to check whether an image photographed by the photographing means is in focus, whether there is camera shake, and the like. It is an object of the present invention to provide an image transmission apparatus and a transmission control method that can easily perform a series of processes up to attachment.

The invention described in claim 1
In the image transmission device,
Photographing means;
Determination means for determining whether or not an image photographed by the photographing means is in focus;
A transmission unit that transmits the image when the determination unit determines that the image is in focus;
It is characterized by having.

The invention according to claim 2 is the image transmission apparatus according to claim 1,
When the determination means determines that the image is not in focus, it further comprises notification means for notifying that the image is not in focus.

The invention according to claim 3 is the image transmission apparatus according to claim 1 or 2,
The image forming apparatus further includes control means for controlling the photographing means to immediately enter a photographing standby state where photographing can be performed when the judging means determines that the image is out of focus.

The invention according to claim 4 is the image transmission apparatus according to any one of claims 1 to 3,
A photographing control means for controlling the photographing means to perform continuous photographing;
The determination unit includes a selection unit that selects an image that is most in focus from a plurality of images captured by the continuous shooting when the continuous shooting is performed by the shooting control unit.

The invention according to claim 5 is the image transmission apparatus according to any one of claims 1 to 4,
The image forming apparatus further includes an adjusting unit that adjusts a shooting condition by the shooting unit when the determining unit determines that the image is out of focus.

The invention described in claim 6
A transmission control method in an electronic device including an imaging unit and a transmission unit for transmitting an image to the outside of the device,
A determination step of determining whether an image captured by the imaging unit is in focus;
A transmission step for transmitting the image from the transmission unit when it is determined that the image is in focus in the determination step;
It is characterized by consisting of.

  According to the first and sixth aspects of the present invention, it is possible for the user to transmit only an in-focus image without confirming whether the captured image is in focus, which is complicated. You can easily and easily send images taken without work.

  According to the second aspect of the present invention, when it is determined that the image is not in focus, the user can easily recognize that the photographed image is not in focus. As a result, it is possible to prevent a problem that an image out of focus is transmitted.

  According to the third aspect of the present invention, when it is determined that the subject is not in focus, the photographing standby state in which photographing can be performed immediately is set, so that it is possible to quickly retake an image without complicated work. As a result, a similar image in focus can be easily obtained.

  According to the fourth aspect of the present invention, when continuous shooting is performed, the most focused image is selected from a plurality of images shot by continuous shooting. Images can be obtained.

  According to the fifth aspect of the present invention, when it is determined that the image is not in focus, the photographing condition of the photographing unit is automatically adjusted, so that the image is retaken under the photographing condition optimum for photographing the image. Can do. As a result, when the image is retaken, an image in focus can be obtained easily and with a high probability.

  Hereinafter, an image transmission apparatus according to an embodiment of the present invention will be described with reference to the drawings. However, the following is one embodiment of the present invention and does not limit the present invention.

  FIG. 1 is a front view and a rear view of an external appearance of a mobile phone terminal with a photographing function (hereinafter referred to as a mobile phone) as an image transmission apparatus according to an embodiment of the present invention in an open state. The mobile phone 1 is a two-fold type, and FIG. 1A shows the front side with the lid open, and FIG. 1B shows the back side with the lid open.

  As shown in FIG. 1 (a), the mobile phone 1 is a color having a speaker 101 that outputs a received voice on the front side with the lid open, various information such as graphics and images, and a resolution equivalent to QVGA. Main display unit 102 of liquid crystal, communication antenna 103 corresponding to a frequency band used in a portable wireless protocol adopted by a communication service company, key operation unit 100 for inputting various information, function instructions, etc., transmission voice The microphone 114 etc. which collect sound is provided.

  Further, as shown in FIG. 1B, the mobile phone 1 has a microphone 115 for collecting sound when the recording function is operated in the camera mode or the like on the back side with the lid open, and the lid is closed. Color liquid crystal sub-display unit 116 for notifying the user of a simple message even in the state of the camera, a notification LED 117 for notifying an incoming call or warning, a step motor for autofocus control, a lens unit 118 for photographing a subject, and photographing At this time, an LED 119 that is turned on to brighten the periphery of the subject, a notification speaker 120 that outputs a ringtone or a warning sound, and the like are provided.

  Further, the key operation unit 100 shown in FIG. 1A includes a camera key 104 that is operated when a specific function is operated in each mode and a camera mode is operated, and a mail key that is operated in a mail mode. 105, the decision key 106 that is operated when instructing the decision in each mode or the shutter key, the up / down / left / right directions can be selected, and the selection operation is performed in each mode. Cursor key 107 for adjusting the direction of Ev. Operates when operating the address book mode in the normal incoming call waiting state. Operates when operating the auto focus function or setting the focus lock in the camera mode. Address book key 108 to use, Internet connection in normal incoming call waiting state Operate when instructing, in the camera mode, the Web key 109 that is operated when changing the shooting conditions such as exposure time and sensitivity correction, the clear key 110 for instructing the previous state in each mode, off-hook A key 111, an on-hook / power ON / OFF key 112, a numeric key 113 for instructing character input and dial input, and the like are arranged.

  FIG. 2 is a circuit diagram showing a circuit configuration example of the mobile phone 1 shown in FIG. First, the circuit of the cellular phone 1 uses the antenna 103 in a radio signal format (CDMA in this embodiment as a communication method) and a modulation / demodulation method (QPSK modulation / demodulation method in this embodiment) adopted by a communication service company. A wireless unit 121 that extracts a wireless signal addressed to the mobile phone from the wireless signal input via the wireless signal and converts various digital data output from the control unit 122 described later into a wireless signal and outputs the wireless signal to the antenna 103; Yes.

  Also required as a control unit 122 for controlling the individual operation and the overall operation of the mobile phone 1, an address / data bus processing unit 123 for controlling data transfer with peripheral circuits surrounded by a broken line, the mobile phone 1 and photographing means. RAM 124 for storing various data (address book data, e-mail data, compression-encoded still image data and moving image data) and storing data necessary for the operation of the control unit 122, electrically rewritable A program ROM 125 configured with a flash ROM and operating in various modes including a camera mode and storing application software including an image compression / decompression processing program, a sound source IC 126 storing digital melody sound source information, and a sound source IC 126 Amplifier that amplifies the sound source and transmits it to the notification speaker 120 And a AMP) 127 and the like.

  Further, the display module driver 128 that controls various notification / display outputs of the main display unit 102, the sub display unit 116, the notification LED 117 and the LED 119, and an analog electrical signal output from the imaging device 130 described later are converted into digital signals. A DSP 129, a CCD or CMOS, and an image pickup device 130 that outputs an image picked up via the lens unit 118 as an electrical signal, and a motor control unit that controls the driving of the step motor of the lens unit 118 controlled by the control unit 122. 131 and the like.

  The control unit 122 permits data input / output based on a terminal authentication method set in advance for data input from the wireless unit 121, and includes voice data, mail data, still image data, and moving image data. A communication data processing unit 1221 that performs packet data input / output control, stores authentication data set for each subscriber and terminal, including a telephone number and mail address set for the mobile phone 1, and stores a communication protocol processing program The system ROM 1222, the voice input from the microphones 114 and 115 during voice call or recording is compression-coded based on the CELP voice coding method, and on the other hand, the communication data processing unit is accompanied by voice call processing and moving image playback. The compressed audio data input from 1221 or the address / data bus processing unit 123 is decoded, and the speaker 10 Audio interface 1223 for performing the processing to more output contains.

  Further, the mobile phone 1 is provided with a digital camera as a photographing means as described above. The photographing unit of the present embodiment is configured by the control unit 122, the RAM 124, the photographing lens 118, the imaging device 130, the DSP 129, the main display unit 102, the LED 119, the camera key 104 and the key operation unit 100 including the determination key 106. ing.

  Further, the mobile phone 1 is provided with a mail transmission means as a transmission means. The mail transmission means of the present embodiment includes the control unit 122, the RAM 124, the main display unit 102, the key operation unit 100 including the mail key 105 and the address book key 108, and the like.

  The photographing unit according to the present embodiment includes a “photographing & simple mail transmission mode” that allows the photographed image to be automatically attached to an e-mail and transmitted in conjunction with the mail transmitting unit. Also, in this “Shooting & Simple Mail Sending Mode”, before attaching the shot image to the e-mail, it is automatically determined whether the shot image is in focus or has camera shake. This determination is performed by the control unit 122.

  In the present embodiment, while the camera is ready to shoot in the camera mode, an image is taken into the imaging device 130 via the photographic lens 118 every predetermined period without performing a shooting operation by the user. Processing to display the monitor on the display unit 102 is performed. When an operation of the enter key 106 by the user is detected, the image stored in the RAM 124 when the operation is detected and the image captured by the imaging device 130 immediately before (or immediately after) the image capturing are stored in the RAM 128. Both the images are zoomed at the maximum magnification, and the images are compared at a plurality of positions automatically detected from both images. Note that the magnification for zooming the image does not necessarily have to be the maximum magnification, and may be an appropriate magnification depending on the shooting conditions, the state of the image, and the like.

  As a result of the comparison, when the shift width in both images is smaller than a predetermined amount, it is determined that the image is in focus, and the shift width in both images is determined in advance. If it is greater than or equal to the predetermined amount, it is determined that the camera is out of focus due to camera shake or the like.

  Only when it is determined that the subject is in focus, the e-mail attached with the image is transmitted by the mail transmitting means. In this embodiment, when it is determined that the subject is in focus, the mail mode is automatically operated, and a mail creation screen with the image attached is displayed. Here, an image-attached mail can be transmitted simply by writing the address, text, etc. of the other party.

  In addition, the mobile phone 1 is provided with notifying means for performing an alert (notification) that the focus is not achieved when it is determined that the focus is not achieved. In the present embodiment, the notification unit includes the speaker 120 and the main display unit 102, and a predetermined notification sound is output from the speaker 120 and the screen on the main display unit 102 is not in focus. Display is made.

  Next, in the mobile phone 1 configured as described above, FIG. 3 shows a first example of the operation and the processing performed by the control unit 122 from image capture to transmission of an e-mail attached with the captured image. This will be described with reference to a flowchart.

  First, the user operates the camera key 104 of the key operation unit 100 to operate the camera mode. Further, by performing a predetermined key operation, the mode is switched to a photographing & simple mail transmission mode in which an image photographed by a digital camera as photographing means is automatically attached to an e-mail and can be transmitted (step S11).

  Next, the user performs shooting with a digital camera by pointing the lens unit 118 toward the subject and operating the enter key 106. The photographed image data is digitized by the DSP 129, captured in the RAM 124, and stored. Further, the image data captured by the imaging device 130 before and after the operation detection of the enter key 106 is also stored in the RAM 124 (step S12).

  Next, the control unit 122 automatically determines whether or not the captured image is in focus. In the present embodiment, even when the user does not operate the enter key 106, processing for capturing an image into the imaging device 130 via the photographing lens 118 is performed every predetermined period. Then, both the image captured and captured in the RAM 124 at the maximum magnification (step S13) and the image captured at the imaging device 130 immediately before or after the image capture and zoomed at the maximum magnification are both displayed. Are compared at a plurality of positions automatically detected from the images (step S14).

  If the difference between the two images is smaller than a predetermined amount, it is determined that the image is in focus, and then an e-mail attached with the image is transmitted (step S15). In this embodiment, the mail mode is automatically operated, and a mail creation screen with the image attached is displayed.

  On the other hand, when the shift width in both images is equal to or larger than a predetermined amount, it is determined that the image is out of focus due to camera shake or the like. Then, an alert (notification) that the focus is not achieved is performed by the notification means (step S16). In this example, a predetermined notification sound is output from the speaker 120 and a display indicating that the subject is not in focus is displayed on the screen. In addition, an image out of focus is also displayed. Further, the cause of the out-of-focus state and advice for achieving the in-focus state may be notified. Specifically, there is a case where a “camera shake notice” or the like is displayed on the screen.

  Then, a determination is made on the screen as to whether or not to send an e-mail with the unfocused image attached (step S17). If the e-mail can be sent as it is, the e-mail in step S15 described above is sent. Process to send.

  If it is determined that an unfocused image should not be attached and sent by e-mail, the image data is deleted (step S18) and the image is captured again (step S12). Return.

Next, a second example of the operation from the image capturing to the transmission of the e-mail attached with the captured image and the processing performed by the control unit 122 in the mobile phone 1 will be described with reference to the flowchart shown in FIG. .
In this second example, when the control unit 122 determines that the image is not in focus, the control unit 122 puts the photographing unit into a photographing standby state in which photographing can be performed immediately.

  First, as in S11 of the first example, the camera mode is operated, and the mode is further switched to the shooting & simple mail transmission mode (step S21).

  Next, as with S12 in the first example, when photographing with a digital camera is performed, the photographed image data is captured and stored in the RAM 124. In addition, the image data captured by the imaging device 130 before and after the operation detection of the enter key 106 is also stored in the RAM 124 (step S22).

  Next, as in the first example, the control unit 122 automatically determines whether or not the captured image is in focus. In this example as well, even when the user does not operate the enter key 106, processing for capturing an image into the imaging device 130 via the photographing lens 118 is performed every predetermined period. Then, the image captured and captured in the RAM 124 is zoomed at the maximum magnification (step S23), and the image burned on the imaging device 130 immediately before or after the image shooting is zoomed at the maximum magnification. A comparison is made at a plurality of positions automatically detected from both images (step S24).

  Then, as in the first example, when the shift width in both images is smaller than a predetermined amount, it is determined that the image is in focus, and the image is similar to S15 in the first example. A process of transmitting an e-mail with the attached is performed (step S25).

  On the other hand, when the shift width in both images is equal to or larger than a predetermined amount, it is determined that the image is out of focus due to camera shake or the like. In this second example, when it is determined that the subject is not in focus, the digital camera is automatically placed in a photographing standby state (automatic re-photographing state) in which the digital camera can immediately shoot ( Step S26). Further, in this example, processing for automatically changing the setting of shooting conditions and performing shooting again is performed. For example, based on the degree of focus deviation in the determination of S24, a control signal is sent to the imaging device 130 or the motor control unit 131 so as to increase the shutter speed or adjust the stepping motor to obtain the shooting condition. May be included.

  Further, instead of changing the shooting conditions, it may be configured to automatically enable continuous shooting. In this case, when continuous shooting is performed, the most in-focus image is automatically selected from the captured images and attached to the e-mail. In the automatic re-photographing state, the photographing conditions may be reset to enable continuous photographing.

  Then, when it is determined on the screen whether or not to send an e-mail with an image taken again under the shooting conditions of S26 (step S27), the e-mail can be sent with the re-taken image. Performs the process of transmitting the e-mail in step S25 described above. Note that the processing of S22 to S24 is also performed on the re-photographed image, and an image that is not in focus here is not attached.

  If it is determined that the re-captured image is not attached and the e-mail is not transmitted, the image data is deleted, and the process returns to the process of capturing the image again (step S22).

Next, in the mobile phone 1, a third example of the operation from the image capturing to the transmission of the e-mail attached with the captured image and the processing performed by the control unit 122 will be described with reference to the flowchart shown in FIG. .
In this third example, when the control unit 122 determines that the image is not in focus, the control unit 122 automatically moves the image data to a temporary evacuation box provided in the RAM 124, and When the data in the temporary evacuation box exceeds a certain amount, the control unit 122 notifies that the data has reached a certain amount.

  First, similarly to S11 of the first example, the camera mode is operated, and the mode is further switched to the photographing & simple mail transmission mode (step S31).

  Next, as with S12 in the first example, when photographing with a digital camera is performed, the photographed image data is captured and stored in the RAM 124. Further, the image data captured by the imaging device 130 before and after the operation detection of the enter key 106 is also stored in the RAM 124 (step S32).

  Next, as in the first example, the control unit 122 automatically determines whether or not the captured image is in focus. In this example as well, even when the user does not operate the enter key 106, processing for capturing an image into the imaging device 130 via the photographing lens 118 is performed every predetermined period. Then, the image captured and captured in the RAM 124 is zoomed at the maximum magnification (step S33), and the image burned on the imaging device 130 immediately before or after the image shooting is zoomed at the maximum magnification. A comparison is made at a plurality of positions automatically detected from both images (step S34).

  Then, as in the first example, when the shift width in both images is smaller than a predetermined amount, it is determined that the image is in focus, and the image is similar to S15 in the first example. A process of transmitting an e-mail with the attached is performed (step S35).

  On the other hand, when the shift width in both images is equal to or larger than a predetermined amount, it is determined that the image is out of focus due to camera shake or the like. Then, as in S16 of the first example, an alert (notification) that the focus is not achieved is performed by the notification means (step S36). In addition, the out-of-focus image is also displayed as in the first example.

  Then, as in S17 of the first example, a determination is made on the screen as to whether or not to send an e-mail with the unfocused image attached (step S37), and it may be sent as it is. In this case, the process of transmitting the e-mail in step S35 described above is performed.

  On the other hand, if it is determined that an unfocused image should not be attached and sent by e-mail, the image data is moved to a temporary evacuation box (so-called trash can) (step S38). Then, it is determined whether or not the data capacity of the trash can exceeds a certain amount (data full) (step S39). If the data capacity of the trash can has not yet reached a certain amount, the image is taken again. The process returns to the process (step S32).

  On the other hand, when the data capacity of the trash box is equal to or greater than a certain amount (data full), an alert (notification) that the data capacity of the trash box is equal to or greater than a certain amount is performed by the notification means (step S40 ), The data in the trash box is deleted (step S41), and the process returns to the process of taking an image again (step S32).

  The first example, the second example, and the third example described above may be performed not only independently but also in combination. For example, the image data of an out-of-focus image is temporarily moved to the temporary evacuation box as in the third example, and at the same time, the shooting conditions are changed as in the second example and the image data is reproduced again. You may come to shoot.

  As described above, according to the image transmission device in the present embodiment, the user can send only an in-focus image by e-mail without checking whether or not the captured image is in focus. Therefore, it is possible to easily and easily send a photographed image without complicated work.

  In the present embodiment, when it is determined that the image is not in focus, the user can easily recognize that the captured image is not in focus. As a result, it is possible to prevent a problem that an image out of focus is transmitted by e-mail.

Furthermore, in the present embodiment, when it is determined that the subject is not in focus, the photographing standby state in which photographing can be performed immediately is set, so that an image can be retaken quickly without any complicated work.
As a result, a similar image in focus can be easily obtained.

  Furthermore, in the present embodiment, when continuous shooting is performed, the most in-focus image is selected from a plurality of images shot by continuous shooting. An image can be obtained.

In this embodiment, when it is determined that the image is not in focus, the shooting condition of the shooting unit is automatically adjusted, so that the image can be retaken under the shooting condition optimal for shooting the image.
As a result, when the image is retaken, an image in focus can be obtained easily and with a high probability.

Furthermore, in this embodiment, when it is determined that the image is not in focus, the image data is automatically moved to the temporary evacuation box, so that the image that is not in focus is completely deleted. It is possible to confirm whether or not it can be deleted.
As a result, it is possible to prevent a necessary image from being deleted even if focus is not achieved.
In addition, when the amount of data in the temporary evacuation box exceeds a certain amount, the fact that the data has reached a certain amount is notified, so that it is possible to prevent the data capacity from being filled with unnecessary image data.
As a result, the data capacity in the mobile phone can be used efficiently.

  The image transmission apparatus according to the present invention is not limited to the above-described embodiment, and can be applied to other configurations.

(A) is a front view of the state which opened the cover of the mobile telephone which concerns on one Embodiment of this invention. (B) is a rear view of a state in which a lid of a mobile phone according to an embodiment of the present invention is opened. FIG. 2 is a circuit diagram illustrating a circuit configuration example of the mobile phone in FIG. 1. 3 is a flowchart illustrating a first example of a flow from image capturing to image attached mail transmission in the mobile phone of FIG. 1. 6 is a flowchart showing a second example of a flow from image capturing to image attached mail transmission in the mobile phone of FIG. 1. 7 is a flowchart illustrating a third example of a flow from image capturing to image attached mail transmission in the mobile phone of FIG. 1.

Explanation of symbols

1 Mobile phone (image transmission device)
100 Key operation unit 102 Main display unit (notification means)
103 Antenna (transmission means, transmission unit)
104 Camera key 105 Mail key 106 Enter key 108 Address book key 118 Lens unit (photographing means, photographing section)
119 LED
120 Informing speaker (notifying means)
121 Radio unit (transmission means)
122 Control unit (determination means, control means, photographing control means, selection means, adjustment means)
124 RAM
129 DSP
130 Imaging device (photographing means)

Claims (6)

Photographing means;
Determination means for determining whether or not an image photographed by the photographing means is in focus;
A transmission unit that transmits the image when the determination unit determines that the image is in focus;
An image transmitting apparatus comprising:   The image transmission apparatus according to claim 1, further comprising a notification unit that notifies that the image is out of focus when the determination unit determines that the image is out of focus.   3. The apparatus according to claim 1, further comprising a control unit configured to control the photographing unit to immediately enter a photographing standby state where photographing can be performed when the determination unit determines that the image is out of focus. The image transmission device described in 1. A photographing control means for controlling the photographing means to perform continuous photographing;
The determination unit includes a selection unit that selects, when the continuous shooting is performed by the shooting control unit, an image that is in focus among a plurality of images shot by the continuous shooting. Item 4. The image transmission device according to any one of Items 1 to 3.   The image according to any one of claims 1 to 4, further comprising an adjusting unit that adjusts a shooting condition by the shooting unit when the determining unit determines that the image is out of focus. Transmitter device. A transmission control method in an electronic device including an imaging unit and a transmission unit for transmitting an image to the outside of the device,
A determination step of determining whether an image captured by the imaging unit is in focus;
A transmission step for transmitting the image from the transmission unit when it is determined that the image is in focus in the determination step;
A transmission control method comprising:

Images