JP2001078160A - Video phone and image pickup method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To automatically pick up an image of a user's face in a proper state and to transmit the picked-up image to the opposite party. SOLUTION: A receiver 116 such as an earphone is provided with an optical transmission section 117 that transmits an optical signal. An optical sensor 111 receives the transmitted optical signal and since an automatic focus adjustment section 112 automatically adjusts the focus of a camera section 110 so that a user hearing a voice through the receiver 116 can be picked up with an optimum focus in response to the received optical signal, the user making a speech with a mobile video phone 100 is picked up automatically with an optimum focus.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a videophone apparatus and an image pickup method for picking up an image while focusing on a user making a call and transmitting the picked-up image to a call destination.

[0002]

2. Description of the Related Art Hitherto, a video telephone device using a radio telephone line has been manufactured. In this videophone device, an innerphone including an earphone (receiver) and a microphone is connected to the videophone device main body, and the user inserts the earphone into an ear and holds the videophone device main body by hand. While listening to the caller's voice displayed on the display, the voice of the caller is heard, and the voice is input by inputting the user's own voice from a microphone.

[0003]

However, in the conventional apparatus, since the user holds the main body of the videophone device and makes a call while watching the other party displayed on the display, the user is imaged according to the state of possession. The camera does not notice even if the camera's imaging direction is shifted and only a part of the person's face has been imaged, or even if not all of the image has been imaged. There is a problem that it is not sent to the call destination.

The present invention has been made in view of the above circumstances, and provides a videophone apparatus and an imaging method capable of automatically imaging a user's face in an appropriate state and transmitting the image to a call destination. With the goal.

[0005]

According to the present invention, there is provided an apparatus main body having an image pickup means, an audio output means located at a position distant from the image pickup means, and measuring a distance between the image pickup means and the audio output means. And a focus control unit that controls the focus of the imaging unit to be around the audio output unit in accordance with the measured distance.

According to this configuration, the position near the audio output means, for example, the face of the user near the earphone located at the user's ear is focused, so that the user who makes a telephone call with the videophone device is focused. In addition, it is possible to capture an image and transmit the captured image to a call destination.

According to the present invention, there is provided an apparatus main body having an image pickup means,
The voice input means at a position distant from the image capturing means, a distance measuring means for measuring a distance between the image capturing means and the voice input means, and a focus of the image capturing means according to the measured distance, A focus control unit for performing control for adjusting the surroundings of the voice input unit is adopted.

[0010] According to this configuration, the position near the voice input means, for example, the face of the user near the microphone located at the mouth of the user is focused, so that the user who makes a telephone call with the video telephone device is focused. In addition, it is possible to capture an image and transmit the captured image to a call destination.

According to the present invention, there is provided an apparatus main body having an image pickup means,
A voice input / output unit at a position distant from the image capturing unit; a distance measuring unit for measuring a distance between the image capturing unit and the voice input / output unit; and a focus of the image capturing unit according to the measured distance. And focus control means for performing control for adjusting the position of the sound input / output means to the periphery of the audio input / output means.

[0010] According to this configuration, since the focus is on the position near the voice input / output means, for example, on the face of the user near the earphone with a microphone worn by the user, the focus is on the user who talks with the videophone device. Can be taken together, and the taken video can be transmitted to the other party.

According to the present invention, in any one of the above structures,
Direction detection means for detecting a direction from the apparatus body to any one of audio output means, audio input means, and audio input / output means; and direction control means for controlling an imaging direction of the imaging means according to the detected direction. Is adopted.

[0012] According to this configuration, since the imaging direction of the imaging means is directed to the face of the user wearing any one of the audio output means, the audio input means, and the audio input / output means, the user making a telephone call with the videophone device Can be put on the imaging screen in an appropriate state, and the captured video can be transmitted to the call destination.

According to the present invention, in any one of the above structures,
A configuration is adopted in which display means for displaying an image and control means for displaying the image picked up by the image pickup means are provided on the display means.

According to this configuration, the user can confirm the imaging state after the focus adjustment.

According to the present invention, in any one of the above structures,
Operation means for inputting information, storage means for storing storage data, information data input from the operation means,
A storage control unit for storing any of the video data captured by the imaging unit and the received information / video data as storage data in the storage unit, and reading out the storage data and displaying the readout data on the display unit; Take.

According to this configuration, the user can, at any time,
The input information / video data or the information / video data from the called party can be displayed and confirmed.

According to the present invention, in any one of the above structures,
The operation means includes a specific input key for inputting an e-mail address, and an Internet control means for accessing the computer of the Internet provider in accordance with the e-mail address input using the specific input key. Take the configuration.

According to this configuration, it is possible to easily input an e-mail address from the videophone device and access an Internet provider.

According to the present invention, a mobile communication system is provided with a videophone device having any one of the above configurations.

According to this configuration, in the mobile communication system, the same operation and effect as any one of the first to seventh aspects can be obtained.

According to the present invention, a distance between any one of the sound output means, the sound input means and the sound input / output means and the image pickup means is measured, and the focal point of the image pickup means is set in accordance with the measured distance. Control to match the surroundings of the audio output means is performed.

According to this method, the face of the user wearing any of the voice output means, the voice input means and the voice input / output means is focused, so that the user making a telephone call with the video telephone apparatus is focused. , And the captured image can be transmitted to the other party.

According to the present invention, in the above-described method, control is performed such that any one of the sound output means, the sound input means, and the sound input / output means is detected, and the imaging direction of the imaging means is adjusted to the detected direction. did.

According to this method, since the imaging direction of the imaging means is directed to the face of the user wearing any one of the audio output means, the audio input means, and the audio input / output means, the user making a telephone call with the videophone device Can be put on the imaging screen in an appropriate state, and the captured video can be transmitted to the call destination.

[0025]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The gist of the present invention is to detect the direction of a sound output means to be attached to an ear by a user, adjust the image pickup direction of the image pickup means to the detected direction, and set the sound output means and the image pickup means together. Is measured, and the focal point of the imaging unit is set around the audio output unit in accordance with the measured distance.
That is, by performing control to match the user's face, the user's face is automatically imaged in an appropriate state and transmitted to the call destination.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

(Embodiment) FIG. 1 is a block diagram showing a configuration of a videophone device according to an embodiment of the present invention. 1 includes an antenna 101, an antenna sharing unit 102, and a transmitting / receiving unit 103.
, Central control unit 104, display control unit 105, display unit 106, stabilization unit 107, battery power supply 108, external power supply interface unit 109, camera unit 110, optical sensor 111, automatic focus adjustment Unit 112, camera control unit 113, key operation unit 114, data memory unit 1
15, receiver 116, optical transmitter 117 and microphone 1
And an inner phone unit 119 having the same.

The antenna 101 is a built-in or telescopic antenna for efficiently transmitting radio waves to a base station (not shown).

The antenna sharing unit 102 includes the antenna 101
It performs impedance matching and transmission / reception switching for efficiently transmitting / receiving data to / from the device.

The transmission / reception section 103 converts a signal from the base station received via the antenna 101 and the antenna sharing section 102 into a signal having a local oscillation frequency, and then demodulates the signal.
A device that outputs the demodulated signal to the central control unit 104, modulates the signal output from the central control unit 104, converts the signal to a radio frequency, and transmits the radio frequency to the base station via the antenna sharing unit 102 and the antenna 101. It is.

The display control unit 105 controls an image captured by the camera unit 110 in response to a display instruction from the central control unit 104,
It controls the display of the video data, telephone number, text data, and the like stored in the data memory unit 115 on the display unit 106.

The display unit 106 uses a liquid crystal display, a plasma display, or the like.
A video, a telephone number, characters, and the like are displayed in accordance with the control of step S05.

The battery power supply 108 is a power supply for supplying a rechargeable secondary battery or a primary battery to each circuit section of the videophone device 100.

The external power supply interface unit 109 is connected to an external power supply (not shown) for charging a rechargeable secondary battery or supplying power to each circuit unit of the videophone device 100.

The stabilizing section 107 stabilizes an external power supply connected to the battery power supply 108 or the external power supply interface section 109 and supplies power to each circuit section of the videophone device 100.

The camera control unit 113 includes a key operation unit 114
The operation of the camera unit 110 is controlled according to the imaging operation.

The camera section 110 captures an image of a subject under the control of the camera control section 113, converts a video signal of the optical system obtained by the capturing into a digital signal (video data), and outputs the digital signal to the central control section 104. Things.

The optical sensor 111 receives an optical signal emitted from the optical transmitter 117 and outputs the optical signal to the automatic focus adjuster 112.

The automatic focus adjustment unit 112
1 so that the optical signal is received at the maximum intensity
A user who adjusts the imaging direction of 0, measures and obtains the distance to the optical transmission unit 117 according to the propagation delay amount of the received optical signal, performs camera shake correction, and performs a call using the inner phone unit 119 is illustrated. Automatic focus adjustment control for optimal focusing by controlling the operation of the aperture of the camera unit 110 and the like, and operation of the key operation unit 114 so that an image is displayed in an optimal state on the display of the destination videophone device. And controls the imaging direction of the camera unit 110, the focus adjustment, and the like according to.

The key operation unit 114 is provided with function keys such as numeric keys and symbols, and performs an operation for making and receiving calls, an operation for registering a telephone number, and an operation related to an imaging function of the camera unit 110. It has an off switch. A signal generated by the operation is output to the central control unit 104 and the camera control unit 113.

The data memory section 115 stores text data such as memos using telephone numbers, names and names of destinations, characters, and the like, and video data.

The inner phone section 119 includes an optical transmission section 117
Is provided with a receiver 116 such as an earphone or a headphone, which is integrally mounted, and a microphone 118 connected to the receiver 116.
The user inputs his / her own voice by using the microphone 118 while listening to the voice by inserting 6 into his / her ear.

The light transmitting section 117 is integrally mounted on the receiver 116, and transmits an optical signal when the imaging ON / OFF switch of the key operation section 114 is ON.

The central control unit 104 controls the display control unit 105 to instruct the display unit 106 to display an image corresponding to the video signal received by the transmission / reception unit 103, and transmits the video data from the camera unit 110 to the transmission / reception unit 103. Control to transmit to the called party via the display, and display the video data from the camera unit 110 to the display unit 10
6, control for displaying video data from the camera unit 110, receiving video data and text data in the data memory unit 112, reading the data and displaying the data on the display unit 106, and control from the key operation unit 114 as described above or below. The control of each unit according to various input operations and the control of each unit described above are integrally performed.

The operation of the videophone device 100 having such a configuration will be described with reference to the flowchart shown in FIG.

In step ST201, the user turns on the power of the videophone device 100.

Here, if the imaging on / off switch provided in the key operation unit 114 is also turned on in step ST202, the optical sensor 111 detects the optical signal transmitted from the optical transmission unit 117 in step ST203. I do.

In response to the detected light signal, the automatic focus adjustment unit 112 adjusts the image pickup direction of the camera unit 110 so that the light signal is received at the maximum intensity in step ST204. Correction is performed, and in step ST206, the transmitting / receiving section 1
By calculating the distance up to 17 in step ST20
At 7, the user with the receiver 116 attached to his ear adjusts the focus so that the camera unit 110 captures the image at the optimum focus.

This state may be displayed on the monitor of the display unit 106. In this case, when an operation for performing monitor display is performed from the key operation unit 114, the central control unit 104 responds to the operation instruction signal, and the image of the user captured by the camera unit 110 via the display control unit 105. Is displayed on the display unit 106 on the monitor. Here, the user can check the display state while viewing his / her own image (own image) displayed on the monitor.

Next, in step ST208, when the user performs a calling operation from the key operation unit 114, a call connection is established with the called party, and in step ST209, the own video data imaged by the camera unit 110 is displayed. The call is transmitted to the call destination, and in step ST210, a call is made.

In this call state, the video of the other party is displayed on the display unit 106, and the user can have a conversation while watching the displayed video of the other party.

On the other hand, if the imaging ON / OFF switch is turned off in step ST202, the own video data is not transmitted to the call destination, and the display of the call destination is
Your own image is not displayed.

Then, assuming that the conversation has ended, in step ST211, after performing a call termination operation for disconnecting the call with the key operation unit 114, in step ST212,
The power of the videophone device 100 is turned off.

In addition to the above, the videophone device 100 includes the text data input by the key operation unit 114 and the camera unit 1.
The video data captured in step 10 and the text data and video data received from the other party
An operation of storing the data in the data memory unit 112 under the control of the control unit 04, reading out the stored data under the control of the central control unit 104, and displaying the data on the display unit 106 is performed.

Further, the key operation unit 114 is provided with a ＠ mark input key for inputting a ＠ mark used for a mail address so as to be connectable to an Internet provider.
This may be configured so that images can be transmitted and received via the Internet.

Further, the light transmitting section 117 is connected to the inner phone section 1.
In place of 19, provided in the main body of the videophone device 100,
The optical sensor 111 can be provided in the inner phone section 119, and furthermore, not only light but also a radio wave transmitting / receiving means can be provided to obtain the distance from the delay time of the radio wave, and to obtain the direction from the arrival direction of the radio wave. it can.

Further, the main body of the apparatus 100 and the innerphone section 119 are connected by an audio signal line having a variable length for transmitting an audio signal by wire, and the main body and the innerphone section 119 are connected.
The automatic focus adjustment unit 112 may adjust the focus of the camera unit 110 in accordance with the length of the audio signal line corresponding to the length between.

There are at least the following two methods for making the length of the audio signal line between the main body and the inner phone section 119 variable and measuring the length.

In the first method, a means for winding a fixed-length audio signal line is provided in the main body or the inner phone section 119 or in both the main body and the inner phone section 119, and the apparatus is wound by this means. The distance between the main body and the inner phone unit 119 is measured from the length of the audio signal line or the length of the audio signal line that has not been wound.

The second method is to use an elastic body for the audio signal line, or to wind the audio signal line in a coil shape, for example, so that the audio signal line varies depending on the length between the main body and the inner phone section 119. And the distance between the main body and the inner phone unit 119 is measured from the tension.

The receiver 1 of the inner phone unit 119
16 is not limited to audio output means typified by earphones or the like, and audio input means such as a microphone provided away from the main body and around the subject is used in place of the audio output means, and The distance from the main body may be measured.

In particular, the sound output means is generally provided around the ear, which is the side of the subject. When adjusting the focus or direction from the distance between the audio output means and the main unit,
By correcting the positional relationship between the ear and the center of the face statistically, or by a value predetermined by the user,
It is desirable that the focus or direction be adjusted to the center of the face around the sound output means. If two sound output means are provided in a stereo type, the direction may be adjusted to be the center of the two sound output means. Good.

On the other hand, the sound input means is generally provided around the mouth which is in front of the subject in a case other than the inner phone structure, and the distance between the sound input means and the main body is measured using the sound output means. Measuring the distance between the voice input means and the main body is easier than adjusting the focus in front of the subject with the camera unit 110, and further using the light propagation delay for measuring the distance. It is preferable to provide the optical transmitter 117 at a position facing the main body.

Further, by providing the camera unit 110 for imaging in an imaging direction corresponding to the direction of arrival of light or radio waves or in an imaging direction corresponding to the direction in which the tension of the audio signal line is applied, the audio output means or the audio input means can be provided. It becomes easier to capture an image by directing the camera unit 110 in the direction of the provided subject.

As described above, according to the videophone device 100 of the present embodiment, the receiver 116 such as an earphone
An optical transmission unit 117 for transmitting an optical signal is provided. The transmitted optical signal is received by the optical sensor 111, and the automatic focus adjustment unit 112 is controlled by the receiver 1 according to the received optical signal.
At 16, the focus of the camera unit 110 is adjusted so that the image is focused on the user who listens to the voice. Therefore, the image is focused on the user who makes a call using the videophone device 100. The captured video can be transmitted to the other party.

Further, since the receiver 116 provided with the optical transmission unit 117 is provided in the innerphone unit 119, the videophone device 1 to which the innerphone unit 119 is connected is provided.
At 00, imaging can be focused on the user making the call.

Further, the central control unit 104 controls the camera unit 11
Since the image captured at 0 is displayed on the monitor on the display unit 106, the user can confirm the focus adjustment state.

The central control unit 104 operates the key operation unit 1
14 is stored in the data memory unit 115, and the stored data is read out and displayed on the display unit 106. , The user can display and confirm the input information / video data or the information / video data from the other party at any time.

The key operation section 114 is provided with a ＠ mark input key for inputting a ＠ mark which is a constituent symbol of an e-mail address, and the central control section 104 is inputted using the ＠ mark input key. Since access is made to the computer of the Internet provider using the electronic mail address, the user can easily input the electronic mail address from the videophone device 100 to access the Internet provider.

The videophone device 100 described above is used as a mobile station device in a mobile communication system, and has a wide frequency band used, such as W-CDMA (Wi-Fi).
de band-Code Division Multiple Access). In this case, video data can be transferred at high speed.

[0071]

As described above, according to the present invention,
The user's face can be automatically imaged in an appropriate state and transmitted to the call destination.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a videophone device according to an embodiment of the present invention.

FIG. 2 is a flowchart for explaining an operation of a telephone call process of the videophone device according to the embodiment.

[Explanation of symbols]

 REFERENCE SIGNS LIST 100 videophone device 104 central control unit 106 display unit 110 camera unit 111 optical sensor 112 automatic focus adjustment unit 116 receiver 117 optical transmission unit 119 innerphone unit 114 key operation unit 115 data memory unit

Claims (10)

[Claims] 1. An apparatus main body having an image pickup means, an audio output means at a position distant from the image pickup means, a distance measurement means for measuring a distance between the image pickup means and the audio output means, A video phone device comprising: a focus control unit that controls a focus of the imaging unit to be around the audio output unit in accordance with the set distance. 2. An apparatus main body having an image pickup means, a sound input means located at a position distant from the image pickup means, a distance measuring means for measuring a distance between the image pickup means and the sound input means, A video phone device comprising: a focus control unit that controls a focus of the imaging unit to be around the voice input unit in accordance with the set distance. 3. An apparatus main body having an image pickup means, a voice input / output means at a position apart from the image pickup means, a distance measuring means for measuring a distance between the image pickup means and the voice input / output means, A video phone apparatus comprising: a focus control unit that controls a focus of the imaging unit to be around the audio input / output unit in accordance with the measured distance. 4. A direction detecting means for detecting a direction from the apparatus main body to any one of a sound output means, a sound input means and a sound input / output means, and an image pickup direction of an image pickup means according to the detected direction. The videophone device according to any one of claims 1 to 3, further comprising a direction control means for controlling. 5. The display device according to claim 1, further comprising: display means for displaying an image; and control means for displaying the image picked up by the image pickup means on the display means. Video phone equipment. 6. An operation unit for inputting information, a storage unit for storing storage data, information data input from the operation unit, video data imaged by the imaging unit, and received information / video data. The television according to any one of claims 1 to 5, further comprising: storage control means for storing any one of the stored data as the stored data in the storage means, and reading the stored data and displaying the read data on the display means. Telephone equipment. 7. A specific input key provided in the operation means for inputting an e-mail address, and an Internet control means for accessing a computer of an Internet provider in accordance with the e-mail address input using the specific input key The videophone device according to any one of claims 1 to 6, comprising: 8. A mobile communication system comprising the videophone device according to any one of claims 1 to 7. 9. A distance between any one of the sound output means, the sound input means, and the sound input / output means and the imaging means is measured,
An image pickup method in a videophone device, wherein control is performed to adjust the focus of the image pickup means to the periphery of the audio output means according to the measured distance. 10. The apparatus according to claim 9, wherein a direction of any one of the voice output means, the voice input means, and the voice input / output means is detected, and control is performed to adjust an imaging direction of the imaging means to the detected direction. An imaging method in the videophone device described in the above.