WO2010024415A1 - 通信機器 - Google Patents
通信機器 Download PDFInfo
- Publication number
- WO2010024415A1 WO2010024415A1 PCT/JP2009/065122 JP2009065122W WO2010024415A1 WO 2010024415 A1 WO2010024415 A1 WO 2010024415A1 JP 2009065122 W JP2009065122 W JP 2009065122W WO 2010024415 A1 WO2010024415 A1 WO 2010024415A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- unit
- videophone function
- execution
- control unit
- image
- Prior art date
Links
- 238000004891 communication Methods 0.000 title claims abstract description 55
- 230000005540 biological transmission Effects 0.000 claims abstract description 13
- 238000001514 detection method Methods 0.000 claims description 101
- 238000003384 imaging method Methods 0.000 claims description 84
- 238000006073 displacement reaction Methods 0.000 claims description 13
- 230000001629 suppression Effects 0.000 claims description 4
- 230000006870 function Effects 0.000 description 131
- 238000000034 method Methods 0.000 description 24
- 230000005236 sound signal Effects 0.000 description 8
- 238000005070 sampling Methods 0.000 description 4
- 101000661807 Homo sapiens Suppressor of tumorigenicity 14 protein Proteins 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 101000911772 Homo sapiens Hsc70-interacting protein Proteins 0.000 description 2
- 101000710013 Homo sapiens Reversion-inducing cysteine-rich protein with Kazal motifs Proteins 0.000 description 2
- 230000003321 amplification Effects 0.000 description 2
- 238000006243 chemical reaction Methods 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000005401 electroluminescence Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 101001139126 Homo sapiens Krueppel-like factor 6 Proteins 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 108090000237 interleukin-24 Proteins 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000004904 shortening Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/147—Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
- H04B1/40—Circuits
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/40—Bus networks
- H04L12/40006—Architecture of a communication node
- H04L12/40013—Details regarding a bus controller
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M11/00—Telephonic communication systems specially adapted for combination with other electrical systems
- H04M11/08—Telephonic communication systems specially adapted for combination with other electrical systems specially adapted for optional reception of entertainment or informative matter
- H04M11/085—Telephonic communication systems specially adapted for combination with other electrical systems specially adapted for optional reception of entertainment or informative matter using a television receiver, e.g. viewdata system
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
- H04N21/41407—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
- H04N21/42202—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] environmental sensors, e.g. for detecting temperature, luminosity, pressure, earthquakes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/443—OS processes, e.g. booting an STB, implementing a Java virtual machine in an STB or power management in an STB
- H04N21/4436—Power management, e.g. shutting down unused components of the receiver
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/141—Systems for two-way working between two video terminals, e.g. videophone
- H04N7/142—Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
- H04N2007/145—Handheld terminals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W52/00—Power management, e.g. TPC [Transmission Power Control], power saving or power classes
- H04W52/02—Power saving arrangements
- H04W52/0209—Power saving arrangements in terminal devices
- H04W52/0261—Power saving arrangements in terminal devices managing power supply demand, e.g. depending on battery level
- H04W52/0267—Power saving arrangements in terminal devices managing power supply demand, e.g. depending on battery level by controlling user interface components
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Definitions
- the present invention relates to a communication device having a videophone function.
- the videophone function is a function of capturing a caller's image with a camera that captures the caller at the same time as a voice signal for a voice call, and performing transmission / reception in the same manner as a voice signal.
- the image signal of the other party is acquired, it is displayed on the display unit.
- the caller can make a call while looking at the other party.
- a moving image is generated by transmitting and receiving a moving image signal by shortening the interval at which an image is taken, it becomes possible to know more about the state of the other party.
- Patent Document 1 discloses a technique in which a user switches between a videophone function and a normal voice call function.
- Patent Document 2 discloses a technique for confirming in advance whether or not the communication terminal of the other party is compatible with a videophone.
- the present invention provides a communication device capable of smoothly making a call by the videophone function by suppressing the videophone function depending on whether the videophone function is in an effective state in the videophone function.
- the purpose is to do.
- a communication device includes an imaging unit and a control unit that executes a videophone function based on an image captured by the imaging unit, and the control unit is captured by the imaging unit. When the image satisfies a predetermined condition, execution of the videophone function is suppressed.
- a face information detection unit that detects information related to a human face from an image captured by the imaging unit, and the control unit detects the human information from the image captured by the imaging unit by the face information detection unit.
- the control unit detects the human information from the image captured by the imaging unit by the face information detection unit.
- an audio detection unit is provided, and the control unit suppresses transmission of an image captured by the imaging unit and transmits the audio detected by the audio detection unit, thereby enabling the videophone function. Suppress execution.
- control unit suppresses execution of the videophone function by suppressing image capturing by the image capturing unit.
- the display unit has a display unit
- the control unit displays an image transmitted from the execution partner of the videophone function on the display unit when execution of the videophone function is being suppressed.
- control unit suppresses execution of the videophone function when an image captured by the imaging unit does not satisfy the predetermined condition. Is released.
- a communication device includes a luminous intensity detection unit, an imaging unit, and a control unit that executes a videophone function based on an image captured by the imaging unit, and the control unit includes the luminous intensity When the light intensity lower than the predetermined light intensity is detected by the detection unit, execution of the videophone function is suppressed.
- an audio detection unit is provided, and the control unit suppresses transmission of an image captured by the imaging unit and transmits the audio detected by the audio detection unit, thereby enabling the videophone function. Suppress execution.
- control unit suppresses execution of the videophone function by suppressing image capturing by the image capturing unit.
- the display unit has a display unit
- the control unit displays an image transmitted from the execution partner of the videophone function on the display unit when execution of the videophone function is being suppressed.
- a communication device includes a housing state detection unit, an imaging unit, and a control unit that executes a videophone function based on an image captured by the imaging unit.
- the casing state detection unit detects a displacement of the casing that exceeds a predetermined condition value, the execution of the videophone function is suppressed.
- an audio detection unit is provided, and the control unit suppresses transmission of an image captured by the imaging unit and transmits the audio detected by the audio detection unit, thereby enabling the videophone function. Suppress execution.
- control unit suppresses execution of the videophone function by suppressing image capturing by the image capturing unit.
- control unit cancels the suppression of the execution of the videophone function when a predetermined condition is not detected by the casing state detection unit while the execution of the videophone function is being suppressed. To do.
- the video phone function can be smoothly controlled by suppressing the video phone function according to whether the video phone function is valid.
- FIG. 1 is a block diagram illustrating an example of a configuration of a mobile terminal.
- FIG. 2 is an external view showing an example of the front surface of the mobile terminal.
- FIG. 3 is a flowchart for explaining an operation example of the mobile terminal when the videophone function is executed.
- FIG. 1 is a block diagram illustrating an example of a configuration of the mobile terminal 100 according to the embodiment.
- FIG. 2 is an external view showing an example of the front surface of the mobile terminal 100.
- the mobile terminal 100 includes an imaging unit 1, a communication unit 2, a display unit 3, an operation unit 4, a storage unit 5, a voice input / output unit 6, a luminous intensity detection unit 7, a face information detection unit 8, a housing. It has a body state detection unit 9 and a control unit 10.
- the imaging unit 1 is a camera device that uses a solid-state imaging element such as a complementary metal-oxide semiconductor (CMOS) or a charge coupled device (CCD).
- CMOS complementary metal-oxide semiconductor
- CCD charge coupled device
- the imaging unit 1 is provided on the front side of the mobile terminal 100 as shown in FIG.
- the mobile terminal 100 of the present embodiment is a foldable mobile phone, and generally, each function of the mobile terminal 100 is used in a state where the fold is opened (a state shown in FIG. 2).
- the imaging unit 1 is provided on the front surface of the mobile terminal 100 as shown in FIG. 2 so that the face of the user of the mobile terminal 100 can be captured in this opened state.
- the imaging unit 1 may be provided in addition to the front side of the portable terminal 100 described above. That is, a plurality of imaging units 1 may be provided. In this case, when the imaging unit 1 is used, which imaging unit 1 is used may be changed according to a user operation.
- the position of the imaging unit 1 provided on the front side of the mobile terminal 100 is not limited to the position illustrated in FIG. 2, and may be any position on the front side of the mobile terminal 100.
- the communication unit 2 performs processing related to wireless communication with a base station (not shown in FIG. 1). For example, transmission data supplied from the control unit 10 to be described later is subjected to predetermined modulation processing to be converted into a radio signal and transmitted. Alternatively, the radio signal received from the base station is subjected to a predetermined demodulation process to be converted into reception data and output to the control unit 10.
- the data transmitted / received by the communication unit 2 is, for example, voice data at the time of voice call of the mobile terminal 100, mail data at the time of mail transmission / reception, image data attached to these, or video phone data when using the video phone function described later ( Audio data and image data).
- the display unit 3 is a display device configured by, for example, a liquid crystal display panel or an organic EL (Electro-Luminescence) panel.
- the display unit 3 displays an image corresponding to the image data supplied from the control unit 10. For example, the destination telephone number at the time of outgoing call, the telephone number of the other party at the time of incoming call, the contents of the received mail and the outgoing mail, the image of the photographing result captured by the imaging unit 1, the browser screen for browsing the Internet web page, When the standby screen, date, time, remaining battery level, or videophone function is used, the image of the other party is displayed.
- the operation unit 4 is an input device composed of keys and buttons having various functions such as numeric keys, character keys, arrow keys, and decision keys. When these keys are operated by the user, the operation unit 4 converts the operation content into an electrical signal and notifies the control unit 10 of the operation content.
- the storage unit 5 is a storage device such as a ROM (Read Only Memory) or a RAM (Random Access Memory). The storage unit 5 stores data related to various processes of the mobile terminal 100 or programs for the control unit 10 to execute various functions of the mobile terminal 100.
- the audio input / output unit 6 detects an audio signal input / output through a speaker and a microphone (not shown), and performs processing so that the communication unit 2 can perform transmission / reception. That is, for example, the audio signal input from the microphone is subjected to signal processing such as amplification, analog-digital conversion, encoding, and the like, converted into digital audio data, and output to the control unit 10. Further, the audio data supplied from the control unit 10 is subjected to signal processing such as decoding, digital-analog conversion, amplification, etc., converted into an analog audio signal, and output from the speaker.
- signal processing such as amplification, analog-digital conversion, encoding, and the like
- the light intensity detector 7 detects the light intensity of the environment where the mobile terminal 100 is placed.
- the light intensity detection unit 7 is, for example, an optical sensor (photosensor), and is disposed on the front side of the mobile terminal 100 as shown in FIG. That is, the light intensity detection unit 7 is provided on the same side of the portable terminal 100 as the imaging unit 1 that can capture the user's face. This is because an image captured by the imaging unit 1 capable of capturing the user's face when the videophone function described later is executed has a predetermined luminous intensity, and an image capable of recognizing the user's face is captured by the imaging unit 1. This is for determining whether or not the image is picked up based on the light intensity detected by the light intensity detection unit 7.
- the method of detecting the luminous intensity of the luminous intensity detector 7 is not particularly limited in the present invention. Existing photometric detection technology may be used.
- the face information detection unit 8 is an image processing unit that detects a human face from an image captured by the imaging unit 1.
- the imaging unit 1 provided on the front side of the mobile terminal 100 is for capturing a user's face.
- the imaging unit 1 provided on the front side of the portable terminal 100 may not be able to capture the user's face well.
- the face information detection unit 8 detects whether or not a human face is reflected in the image captured by the imaging unit 1, and transmits the result to the control unit 10. As a result, when a human face is not shown in the image captured by the imaging unit 1, the control unit 10 can notify the user.
- the fact that a human face is reflected in the image captured by the imaging unit 1 and detected by the face information detection unit 8 corresponds to satisfying the predetermined condition of the present invention.
- the method by which the face information detection unit 8 detects a human face is not particularly limited in the present invention. Existing face detection technology may be used.
- the control unit 10 can detect when the detected human face size is smaller than a predetermined size. The controller 10 may determine that a human face has not been detected.
- the housing state detection unit 9 detects the displacement of the mobile terminal 100 (housing). For example, when the mobile terminal 100 is used while the user is running, the image captured by the imaging unit 1 may shake greatly, and the other party of the call may have difficulty in identifying the image.
- the casing state detection unit 9 uses a sensor that detects the state of the mobile terminal 100. For example, using an inclination sensor that detects a three-dimensional inclination of the mobile terminal 100 with respect to the X axis, Y axis, and Z axis, the inclination of the mobile terminal 100 is sampled with respect to each of the X axis, Y axis, and Z axis. The difference between the slope value obtained by sampling and the slope value obtained by this sampling is obtained.
- the housing state detection unit 9 causes the mobile terminal 100 to be greatly displaced.
- the threshold value of the difference can be set individually for the X axis, the Y axis, and the Z axis.
- the tilt sensor may be configured to detect a one-dimensional or two-dimensional tilt of the mobile terminal 100.
- the predetermined number of times compared with the number of times when the absolute value of the difference exceeds the threshold value can be arbitrarily set.
- the threshold value of these differences and the predetermined number of times can be freely changed according to conditions, for example, can be changed according to the light intensity detected by the light intensity detection unit 7. Also, when the difference between the slope value obtained in the immediately preceding sampling and the slope value obtained in the current sampling is obtained, and the absolute value of this difference is compared with the threshold value of the difference, the sign of the difference is obtained. May be added to the displacement determination material of the mobile terminal 100. For example, when the difference between the slope values is continuously positive or negative, it may be determined that the mobile terminal 100 is displaced in the same direction but does not satisfy a predetermined condition.
- the housing state detection unit 9 is not limited to the tilt sensor. For example, an acceleration sensor may be used.
- casing state detection part 9 is good also as a structure which detects that the portable terminal 100 has displaced greatly by comparing the blurring of the image imaged by the imaging part 1 with a predetermined value.
- the casing state detection unit 9 detects whether the mobile terminal 100 is displaced and transmits the result to the control unit 10. As a result, the control unit 10 can suppress the videophone function when the mobile terminal 100 is displaced.
- the fact that the portable terminal 100 detected by the housing state detection unit 9 is displaced by a predetermined value or more corresponds to satisfying the predetermined condition of the present invention. Whether or not the displacement is greater than a predetermined value may be determined by appropriately setting conditions.
- the detection method of the displacement of the portable terminal 100 by the housing state detection unit 9 is not particularly limited in the present invention. Existing detection technology may be used.
- the control unit 10 is a control block that performs overall control of each configuration described above and executes each operation / process of the mobile terminal 100.
- the control unit 10 is configured by, for example, a CPU (Central Processing Unit).
- the functions of the mobile terminal 100 executed by the control unit 10 are, for example, a voice call function, a mail transmission / reception function, a web browsing function, a videophone function, and the like.
- the control unit 10 detects whether the image captured by the imaging unit 1 satisfies a predetermined condition (a face of the person is detected in the image by the face information detection unit 8) or the light intensity detection. Based on the light intensity detected by the unit 7 or the displacement of the mobile terminal 100 detected by the housing state detection unit 9, the execution of the videophone function can be suppressed. Details of the videophone function will be described below.
- the videophone function is a function for transmitting and receiving an image of a user's face with a communication terminal of a call partner in addition to a normal voice call function. That is, it is a function that allows the user to enjoy the conversation with the other party while viewing the image showing the other party's face displayed on the display unit 3.
- the image captured by the imaging unit 1 may be a moving image or a still image, for example. In the case of a still image, it is possible to give a certain amount of movement by updating to a new image at a predetermined time interval.
- FIG. 3 is a flowchart for explaining an operation example of the mobile terminal 100 when the videophone function is executed.
- Step ST1 The control unit 10 determines whether the incoming call from the other party is a request for a call using the videophone function or a request for a voice-only call. Alternatively, when the user makes a call, the control unit 10 determines whether a call request using the videophone function is transmitted or a call request for only a voice call. If the incoming or outgoing call is a call request using the videophone function, the process proceeds to step ST2, and if the call request is a voice-only call, the process proceeds to step ST16.
- Step ST2 The control unit 10 acquires the remaining battery level of the mobile terminal 100.
- Step ST3 If the remaining battery level acquired in step ST2 is greater than or equal to a predetermined value, the process proceeds to step ST4. If the acquired remaining battery level is less than the predetermined value, the process proceeds to step ST13.
- Step ST4 The control unit 10 measures the communication speed of the mobile terminal 100.
- Step ST5 When the communication speed measured in step ST4 is equal to or higher than a predetermined value (higher than the predetermined communication speed), the process proceeds to step ST6, and when the measured communication speed is lower than the predetermined value (slower than the predetermined communication speed). Then, the process proceeds to step ST13.
- Step ST6 The controller 10 causes the light intensity detector 7 to detect the light intensity.
- the light intensity detection unit 7 is provided on the front side of the mobile terminal 100, on the same side as the imaging unit 1 for capturing the user's face. That is, by detecting the light intensity by the light intensity detection unit 7, it can be determined whether or not the image capturing unit 1 can successfully capture an image showing the user's face.
- Step ST7 In the light intensity detection of the light intensity detection unit 7 in step ST6, if the detected light intensity is equal to or greater than a predetermined light intensity (brighter than a predetermined brightness), the process proceeds to step ST8, and the detected light intensity is less than the predetermined light intensity. If it is present (darker than the predetermined brightness), the process proceeds to step ST13.
- Step ST9 As a result of detecting the displacement by the casing state detection unit 9, if the mobile terminal 100 is not displaced and not shaken (the amount of change is smaller than the predetermined value) (when the predetermined condition is not detected), the process proceeds to step ST10. When the portable terminal 100 is displaced and shakes (when a predetermined condition is detected), the process proceeds to step ST13.
- Step ST11 The control unit 10 causes the face information detection unit 8 to perform face detection of the image captured by the imaging unit 1 in step ST8.
- face detection by the face information detection unit 8 if a human face is detected in the image captured by the imaging unit 1, the process proceeds to step ST12. If not, the process proceeds to step ST13.
- Step ST13 If the remaining battery level is less than the predetermined value in step ST3, if the communication speed is less than the predetermined value in step ST5, or if it is determined in step ST7 that the luminous intensity detected by the luminous intensity detector 7 is smaller than the predetermined luminous intensity, If it is determined in step ST9 that the displacement of the portable terminal 100 is large by the housing state detection unit 9, or if a human face cannot be detected in the image captured by the imaging unit 1 by the face information detection unit 8 in step ST11.
- the control unit 10 determines whether or not the telephone call function is in use. If the videophone function is in a call, the process proceeds to ST14. If the videophone function is not in a call, the process proceeds to ST15.
- Step ST14 The control unit 10 suppresses the videophone function.
- the control unit 10 is a method of suppressing transmission of an image captured by the imaging unit 1 by the communication unit 2 and transmitting an audio signal generated by the audio input / output unit 6.
- the imaging unit 1 performs imaging, but the image signal generated by the imaging is not transmitted to the call partner by the communication unit 2.
- the audio signal generated by the audio input / output unit 6 may be transmitted after the control unit 10 suppresses the image capturing itself by the imaging unit 1.
- Step ST15 The control unit 10 determines whether or not to terminate the call using the videophone function.
- the process returns to step ST2 to control the start / end / continuation / voice call of the videophone function. That is, by steps ST13 to ST14, even when the video call function is switched to the voice call, the video call function can be resumed.
- the call using the videophone function is to be ended, this is ended.
- Step ST16 The control unit 10 starts a voice call with the other party.
- step ST7 when it is determined in step ST7 that the light intensity detected by the light intensity detector 7 is smaller than the predetermined light intensity, after the voice call with the call partner is started in step ST12 (TV Even when execution of the telephone function is suppressed, the light intensity may be detected by the light intensity detector 7 at predetermined time intervals, for example.
- the light intensity becomes greater than or equal to a predetermined value during a voice call (when a light intensity higher than the predetermined light intensity is detected)
- the user is notified at that time and a call using the videophone function is started. It may be made to select whether to do.
- the imaging unit 1 automatically starts imaging the user's face, and whether there is a human face in the image captured by the imaging unit 1 If the face information detection unit 8 determines whether or not a human face is detected, a call using the videophone function may be automatically started. Conversely, in the flowchart shown in FIG. 3, even if it is determined in step ST7 that the light intensity detected by the light intensity detection unit 7 is greater than the predetermined light intensity, communication using the videophone function is performed in step ST12. After the start, the light intensity detection by the light intensity detection unit 7 may be performed, for example, every predetermined time.
- the user is notified at that time and whether or not to end the call using the videophone function or whether to switch to a voice call. You may make it select whether or not.
- the videophone function call is automatically terminated or switched to a voice call. Also good. As a result, it is possible to reduce the discomfort of the other party that may occur during communication using the videophone function.
- the casing state detection unit 9 may perform a process of detecting the displacement of the mobile terminal 100 at predetermined time intervals, for example. Furthermore, when it is determined that the displacement of the mobile terminal 100 has been settled (when a predetermined condition is no longer detected), a call using the videophone function may be automatically started.
- steps ST8 to ST8- The processing related to ST9 may be performed after the processing by the face information detection unit 8 in steps ST10 to ST11.
- step ST11 even if it is determined in step ST11 that the human face cannot be detected in the image captured by the imaging unit 1 by the face information detection unit 8, a voice call with the other party is made in step ST14.
- the face information detection unit 8 may perform processing for detecting a human face in an image captured by the imaging unit 1 at predetermined time intervals, for example. Further, when a human face is detected (when the image no longer satisfies a predetermined condition), a call using the videophone function may be started in accordance with the user's selection or automatically.
- step ST11 even if it is determined in step ST11 that the face information detection unit 8 has detected a face in the flowchart shown in FIG.
- the face detection by the face information detection unit 8 may be performed every predetermined time, for example. Further, when face detection by the face information detection unit 8 is lost or becomes small during communication by the videophone function, the user is notified at that time, and whether or not the telephone call by the videophone function is terminated. Alternatively, it may be selected whether to switch to a voice call. Alternatively, when face detection by the face information detection unit 8 is not performed without such notification, or the detected face size is smaller than a predetermined size, the television is automatically set at that time. You may make it complete
- the image when the image is not transmitted from here (that is, when the light intensity detection unit 7 determines that the light intensity is smaller than a predetermined value, or when the face information detection unit 8 captures the image captured by the image capturing unit 1) Even when a face is not detected), when an image for a videophone function is transmitted from the call partner side, it may be displayed on the display unit 3. As a result, since the image transmitted from here does not properly capture the user's face, the image from the other party can be displayed even when the image for the videophone function cannot be transmitted. Usability is improved.
- the remaining battery level of the mobile terminal 100 is predetermined. If the value is less than the value, the control unit 10 controls to perform only the voice call without performing the call by the videophone function. Since the videophone function calls consume more power than voice calls, switching from the videophone function to voice calls can reduce power consumption and extend the call time with the other party.
- the control unit 10 controls to perform only a voice call without performing a call by the videophone function.
- the control unit 10 resumes the call using the videophone function from the voice call.
- the imaging unit 1 for imaging the user's face is photographed.
- the face information detection unit 8 determines whether or not a person's face is reflected in the captured image, and only when it is determined that the person's face is reflected, a videophone call is started. If the image is not captured or is smaller than the predetermined size, the control unit 10 controls to perform only a voice call without performing a call using the videophone function. For this reason, it is possible to avoid a situation in which the calling party cannot recognize the face of the user even though the telephone call by the videophone function is started, and it is suppressed that the calling party (the other party) feels uncomfortable.
- the face information detection unit 8 determines whether or not a person's face is reflected in the captured image, and only when it is determined that the person's face is reflected, a videophone call is started. If the image is not captured or is smaller than the predetermined size, the control unit 10 controls to perform only a voice call without performing a call using the videophone function. For this reason, it is possible
- the mobile terminal 100 of the present embodiment it is possible to avoid a situation in which the call partner cannot recognize the user's face even though the call using the videophone function is started. A sense of incongruity can be reduced.
- the luminous intensity detection unit 7 determines the luminous intensity at the front surface of the portable terminal 100 provided with the imaging unit 1, The control unit 10 controls to start a call by the videophone function when the brightness is greater than the light intensity, and perform a voice call without performing the call by the videophone function when the light intensity is smaller than a predetermined value. For this reason, it is possible to suitably avoid a situation in which the other party cannot recognize the face of the user even though the telephone call by the videophone function is started, and the other party is not discomforted.
- the mobile terminal 100 of the present embodiment when it is determined that the light intensity detected by the light intensity detection unit 7 is smaller than the predetermined light intensity every predetermined time, a voice call with the call partner Even after the start, the light intensity may be detected by the light intensity detector 7 at predetermined time intervals, for example. Further, when the light intensity becomes a predetermined value or more during the voice call, the user may be notified at that time and may select whether or not to start the call using the videophone function.
- the imaging unit 1 automatically starts imaging the user's face, and whether there is a human face in the image captured by the imaging unit 1 If the face information detection unit 8 determines whether or not a human face is detected, a call using the videophone function may be automatically started.
- the voice call with the call partner is started in step ST14.
- the face information detection unit 8 may perform processing for detecting a human face in an image captured by the imaging unit 1 at predetermined time intervals, for example. Further, when a person's face is detected, a call using the videophone function may be automatically started.
- the image when the image is not transmitted from here (that is, when the light intensity detection unit 7 determines that the light intensity is smaller than a predetermined value, or when the face information detection unit 8 captures the image captured by the image capturing unit 1) Even when a face is not detected), when an image for a videophone function is transmitted from the call partner side, it may be displayed on the display unit 3. As a result, since the image transmitted from here does not properly capture the user's face, the image from the other party can be displayed even when the image for the videophone function cannot be transmitted. Usability is improved.
- the mobile terminal 100 of the present embodiment when there is an incoming call using the videophone function, it is determined whether or not the videophone function is in an effective state, and it is determined that the videophone function is not effective. In this case, the telephone call function can be switched to a voice call. In addition, when it is determined that the videophone function is not effective, and the videophone function is enabled, the videophone function can be resumed by switching from the voice call to the videophone function. .
- the face information detection unit 8 detects the face after the light intensity detection unit 7 detects the light intensity.
- the present invention is not limited to this, and the light intensity detection unit 7 detects the light intensity.
- the face information may be detected by the face information detection unit 8 without performing the detection or before detecting the luminous intensity.
- the videophone function is selected by the user or automatically. The call may be terminated or switched to a voice call.
- the control unit 10 determines whether or not the predetermined condition is satisfied based on the face detection result by the face information detection unit 8 or the light intensity detected by the light intensity detection unit 7.
- the present invention is not limited to this, and the determination may be made based on the brightness or blur of the image itself captured by the imaging unit 1. That is, when the brightness or blur of the image itself captured by the imaging unit 1 is lower than a predetermined value, it is determined that the predetermined condition is not satisfied, and when it is equal to or higher than the predetermined value, the predetermined condition is satisfied. It may be determined that Thereby, since the execution of the videophone function based on the image with low brightness of the image captured by the imaging unit 1 is suppressed, the uncomfortable feeling to the other party is reduced.
- the predetermined condition may be another condition that affects the visibility of the image.
- the mobile terminal 100 is assumed to be a mobile phone or a PHS, but the present invention is not limited to this.
- another portable terminal having an imaging unit such as a PDA (Personal Digital Assistant) may be used.
- the image signal of the user's face and the audio signal generated by the audio input / output unit 6 are superimposed and transmitted / received by the communication unit 2 as videophone data.
- the present invention is not limited to this. For example, even when the videophone function is executed, the image signal picked up by the image pickup unit 1 and the sound signal generated by the sound input / output unit 6 are transmitted and received separately from the call partner. It may be configured to be.
- the videophone function and the normal voice call can be switched depending on whether or not the videophone function is in an effective state, which is useful for a communication device having the videophone function.
- SYMBOLS 100 Portable terminal, 1 ... Imaging part, 2 ... Communication part, 3 ... Display part, 4 ... Operation part, 5 ... Memory
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- General Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Business, Economics & Management (AREA)
- Biodiversity & Conservation Biology (AREA)
- Ecology (AREA)
- Emergency Management (AREA)
- Environmental & Geological Engineering (AREA)
- Environmental Sciences (AREA)
- Remote Sensing (AREA)
- Life Sciences & Earth Sciences (AREA)
- Software Systems (AREA)
- Telephone Function (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
Description
テレビ電話機能とは、音声通話用の音声信号と同時に、通話者を撮影するカメラにより通話者の画像を撮像し、音声信号と同様に送受信を行う機能である。通話相手の画像信号を取得したら、これを表示部に表示する。これにより、通話者は通話相手の様子を見つつ、通話を行うことができる。特に、画像を撮影する間隔を短くすることにより動画像を生成して動画像信号を送受信すれば、より通話相手の様子を具に知ることができるようになる。
以下の実施形態の携帯端末100は、携帯電話機を想定している。
図1は、実施形態の携帯端末100の構成の一例を示すブロック図である。
図2は、携帯端末100の前面の一例を示した外観図である。
撮像部1は、例えばCMOS(Complementary Metal-Oxide Semiconductor)やCCD(Charge Coupled Device)などの固体撮像素子を使用したカメラデバイスである。
撮像部1は、図2に示すように、携帯端末100の前面側に設けられている。
本実施形態の携帯端末100は、図2に示すように、折り畳み式の携帯電話機であり、一般に折り畳みを開いた状態(図2に示す状態)において、携帯端末100の各機能が使用される。撮像部1は、この開いた状態において、携帯端末100のユーザの顔を写すことができるように、図2に示すように携帯端末100の前面に設けられている。
なお、撮像部1は上記説明した携帯端末100の前面側以外にも設けられていてもよい。すなわち、撮像部1は複数設けられていてもよい。この場合には、撮像部1が使用される際に、どの撮像部1を使用するかをユーザの操作に応じて変更できるようにしてもよい。また、携帯端末100の前面側に設けられる撮像部1の位置は、図2に示す位置に限られず、携帯端末100の前面側のどの位置にあってもよい。
通信部2が送受信するデータは、例えば、携帯端末100の音声通話時の音声データ、メール送受信時のメールデータ、これらに添付する画像データ、あるいは後述するテレビ電話機能使用時のテレビ電話用データ(音声データ及び画像データを含む)等である。
例えば、発信時における発信先の電話番号や、着信時における着信相手の電話番号、受信メールや送信メールの内容、撮像部1が取り込んだ撮影結果の画像、インターネットのWebページを閲覧するブラウザ画面、待ち受け画面、日付、時刻、バッテリ残量、あるいは、テレビ電話機能使用時には通話相手の画像等を表示する。
記憶部5は、ROM(Read Only Memory)、RAM(Random Access Memory)などの記憶デバイスである。記憶部5は、携帯端末100の各種処理に関するデータ、あるいは制御部10が携帯端末100の各種機能を実行するためのプログラム類を記憶している。
光度検出部7は、例えば光センサ(フォトセンサ)であり、図2に示すように、携帯端末100の前面側に配置されている。すなわち、光度検出部7は、携帯端末100において、ユーザの顔を写すことができる撮像部1と同じ側の面に設けられる。これは、後述するテレビ電話機能の実行時において、ユーザの顔を写すことができる撮像部1により撮影される画像が所定の光度を有し、ユーザの顔を認識できるような画像が撮像部1により撮像されるか否かを光度検出部7が検出する光度により判断するためである。
光度検出部7の光度検出の方法は、本発明では特に限定しない。既存の光度検出技術を利用すればよい。
上述したように、携帯端末100の前面側に設けられた撮像部1は、ユーザの顔を撮影するためのものである。しかし、ユーザが携帯端末100を保持する角度などによっては、携帯端末100の前面側に設けられた撮像部1がうまくユーザの顔を写すことができない場合もある。
顔情報検出部8は、撮像部1が撮像した画像に人の顔が写っているか否かを検出し、制御部10に結果を送信する。これにより、撮像部1が撮像した画像に人の顔が写っていない場合には、制御部10によりユーザに通知したりすることが可能になる。
ここで、顔情報検出部8が検出する、撮像部1が撮像した画像に人の顔が写っていることが、本発明の所定の条件を満たしていることに対応する。
顔情報検出部8が人の顔を検出する方法は、本発明では特に限定しない。既存の顔検出技術を利用すればよい。
また、制御部10は、顔情報検出部8が撮像部1により撮像された画像内に人の顔を検出できた場合でも、検出した人の顔の大きさが所定の大きさよりも小さい場合には、制御部10により人の顔を検出できなかった、と判定されるようにしてもよい。
たとえばユーザが走っている最中に携帯端末100を使用した場合、撮像部1が撮像する画像が大きく揺れ、通話相手が画像の識別に困難をきたす場合がある。
筐体状態検出部9は、携帯端末100の状態を検出するセンサを用いる。たとえば、携帯端末100の、X軸、Y軸、Z軸に対する三次元的な傾きを検出する傾きセンサを用い、X軸、Y軸、Z軸それぞれに関して、携帯端末100の傾きをサンプリングし、直前のサンプリングで得られた傾きの値と、今回のサンプリングで得られた傾きの値との差分を得る。この差分の絶対値と、差分の閾値とを比較し、差分の絶対値が閾値を超えた回数が所定回数を超えた場合、筐体状態検出部9は、携帯端末100が大きく変位していると判断する。
ここで、差分の閾値は、X軸、Y軸、Z軸に対して個別に設定可能である。傾きセンサは、携帯端末100の一次元的、あるいは二次元的な傾きを検出する構成としてもよい。また、差分の絶対値が閾値を超えた回数と比較される所定回数は、任意に設定可能である。なお、これら差分の閾値や所定回数は、条件に応じて自由に可変可能であり、たとえば光度検出部7が検出する光度に応じて可変可能である。
また、直前のサンプリングで得られた傾きの値と、今回のサンプリングで得られた傾きの値との差分を得て、この差分の絶対値と、差分の閾値とを比較する際、差分の正負を、携帯端末100の変位の判定材料に加えても良い。たとえば、傾きの値の差分が連続して正または負であった場合、携帯端末100は同一方向に変位してはいるが、所定の条件を満たしてはいないと判定してもよい。
なお、筐体状態検出部9は傾きセンサに限られない。たとえば、加速度センサを用いてもよい。あるいは、筐体状態検出部9は、撮像部1により撮像された画像のブレを所定値と比較することで、携帯端末100が大きく変位していることを検出する構成としても良い。
筐体状態検出部9は、携帯端末100が変位しているか否かを検出し、制御部10に結果を送信する。これにより、制御部10は、携帯端末100が変位していた場合には、テレビ電話機能を抑制したりすることが可能となる。
ここで、筐体状態検出部9が検出する、携帯端末100が所定値以上変位していることが、本発明の所定の条件を満たしていることに対応する。変位が所定値以上大きいか否かは、適宜条件を設定して判断すればよい。
なお、筐体状態検出部9による携帯端末100の変位の検出方法は、本発明では特に限定しない。既存の検出技術を利用すればよい。
制御部10により実行される携帯端末100の機能は、例えば、音声通話機能、メール送受信機能、Webブラウジング機能、テレビ電話機能などである。
また、制御部10は、撮像部1により撮像された画像が所定の条件を満たしている(顔情報検出部8により、画像内に人の顔が検出された)か否か、または、光度検出部7により検出された光度、または、筐体状態検出部9により検出された携帯端末100の変位に基づいて、テレビ電話機能の実行を抑制することができる。
以下では、テレビ電話機能の詳細について説明する。
撮像部1が撮影する画像は、例えば動画でもよいし、静止画でもよい。静止画の場合、所定の時間間隔で新たな画像に更新することにより、ある程度の動きを与えることも可能である。
図3は、テレビ電話機能実行時の携帯端末100の動作例を説明するためのフローチャートである。
ステップST1:
制御部10は、通話相手からの着信がテレビ電話機能を使用した通話の要求であるか、音声のみの通話の要求であるか、を判定する。
或いは、制御部10は、ユーザが発信する際に、テレビ電話機能を使用した通話要求を送信するか、音声通話のみの通話の要求であるか、を判定する。
着信或いは発信が、テレビ電話機能を使用した通話要求である場合はステップST2に進み、音声のみの通話要求であった場合にはステップST16に進む。
ステップST2:
制御部10は、携帯端末100の電池残量を取得する。
ステップST3:
ステップST2で取得された電池残量が所定値以上である場合はステップST4に進み、取得された電池残量が所定値未満の場合はステップST13に進む。
ステップST4:
制御部10は、携帯端末100の通信速度を計測する。
ステップST5:
ステップST4で計測された通信速度が所定値以上である(所定の通信速度以上速い)場合にはステップST6に進み、計測された通信速度が所定値未満である(所定の通信速度より遅い)場合にはステップST13に進む。
ステップST6:
制御部10は、光度検出部7に光度を検出させる。
上述したように、光度検出部7は携帯端末100の前面側、ユーザの顔を写すための撮像部1と同じ側に設けられている。すなわち、光度検出部7により光度を検出することにより、撮像部1がユーザの顔を写す画像をうまく撮像できるかどうかを判断することができる。
ステップST6での光度検出部7の光度検出において、検出された光度が所定の光度以上である(所定の明るさ以上明るい)場合にはステップST8に進み、検出された光度が所定の光度未満である(所定の明るさより暗い)場合にはステップST13に進む。
ステップST8:
制御部10は、筐体状態検出部9に、携帯端末100の変位を検出させる。
ステップST9:
筐体状態検出部9による変位の検出の結果、携帯端末100が変位して揺れていない(所定値よりも変化量が小さい)場合(所定の条件が検出されなかった場合)はステップST10へ進み、携帯端末100が変位して揺れている場合(所定の条件が検出された場合)はステップST13に進む。
ステップST10:
制御部10は、携帯端末100の前面部に設けられた撮像部1による撮像を開始する。
制御部10は、顔情報検出部8に、ステップST8において撮像部1により撮像された画像の顔検出を行わせる。
顔情報検出部8による顔検出の結果、撮像部1が撮像した画像に人の顔が検出された場合はステップST12に進み、されなかった場合はステップST13に進む。
ステップST12:
制御部10は、通話相手とのテレビ電話機能による通話を開始する。
すなわち、撮像部1が撮像した画像信号と、音声入出力部6により生成された音声信号とを重畳して、通信部2により通話相手へと送信する。
これにより、以降ユーザがテレビ電話機能により通話を行うことが可能となる。
ステップST3において電池残量が所定値未満の場合、ステップST5において通信速度が所定値未満である場合、ステップST7において光度検出部7により検出された光度が所定の光度より小さいと判定された場合、ステップST9において筐体状態検出部9により携帯端末100の変位が大きいと判定された場合、あるいはステップST11において顔情報検出部8により撮像部1により撮像された画像内に人の顔が検出できないと判定された場合、制御部10は、テレビ電話機能による通話中であるか否かを判定する。
テレビ電話機能による通話中である場合はST14に進み、テレビ電話機能による通話中でない場合はST15に進む。
制御部10は、テレビ電話機能を抑制する。
たとえば、制御部10は、撮像部1が撮像した画像を通信部2により送信することを抑制し、音声入出力部6により生成された音声信号は送信する方法である。この場合、撮像部1は撮像を行うが、撮像により生成された画像信号が通信部2により通話相手に送信されないことになる。
あるいは、制御部10により撮像部1による画像の撮像そのものを抑制した上で、音声入出力部6により生成された音声信号を送信してもよい。
制御部10は、テレビ電話機能による通話を終了させるか否かを判定する。
テレビ電話機能による通話を終了させない場合、すなわちテレビ電話機能による通話を継続させる場合、ステップST2に戻り、テレビ電話機能による通話の開始・終了・継続・音声通話への切り替えを制御する。すなわち、ステップST13~ST14により、一旦はテレビ電話機能による通話から音声通話に切り替えられた場合でも、テレビ電話機能による通話を再開させることができる。
一方、テレビ電話機能による通話を終了させる場合は、これを終了させる。
制御部10は、通話相手との音声通話を開始する。
また逆に、図3に示したフローチャートで、ステップST7において光度検出部7により検出された光度が所定の光度よりも大きいと判定された場合であっても、ステップST12においてテレビ電話機能による通信が開始された後に、光度検出部7による光度の検出を例えば所定時間ごとに行ってもよい。さらに、テレビ電話機能による通信中に光度が所定の値より小さくなった場合は、その時点でユーザにその旨を通知し、テレビ電話機能による通話を終了するか否か、または音声通話に切り替えるか否かを選択させるようにしてもよい。また、或いはこのような通知はせずに光度検出部7により検出された光度が所定の値より小さくなった時点で自動的にテレビ電話機能による通話を終了する、或いは音声通話に切り替えるようにしてもよい。これにより、テレビ電話機能による通信中において生じうる相手方の違和感を低減することができる。
なお、筐体状態検出部9が、撮像部1により撮像された画像のブレを所定値と比較することで、携帯端末100が大きく変位していることを検出する構成である場合、ステップST8~ST9に係る処理を、ステップST10~ST11における顔情報検出部8による処理の後に行うようにしてもよい。
また逆に、図3に示したフローチャートで、ステップST11において顔情報検出部8により顔が検出されたと判定された場合であっても、ステップST12においてテレビ電話機能による通信が開始された後(テレビ電話機能の実行を抑制している時)に、顔情報検出部8による顔の検出を例えば所定時間ごとに行ってもよい。さらに、テレビ電話機能による通信中に顔情報検出部8による顔の検出がなくなったまたは小さくなった場合は、その時点でユーザにその旨を通知し、テレビ電話機能による通話を終了するか否か、または音声通話に切り替えるか否かを選択させるようにしてもよい。また、或いはこのような通知はせずに顔情報検出部8による顔の検出がなくなったまたは検出された顔の大きさが所定の大きさよりも小さくなった場合にはその時点で自動的にテレビ電話機能による通話を終了するまたは、音声通話に切り替えるようにしてもよい。
テレビ電話機能による通話は音声通話と較べて消費電力が大きいため、テレビ電話機能から音声通話に切り替えることにより、消費電力を抑えることができ、通話相手との通話時間を延ばすことができる。
これにより、携帯端末100の通信環境に応じて、テレビ電話機能による通話と音声通話とを適切に切り替えることが可能となる。
このため、テレビ電話機能による通話を開始したにもかかわらず、通話相手がこちらのユーザの顔を認識できない、という事態を回避することができ、通話相手(相手方)に違和感を与えることが抑制される。
このため、テレビ電話機能による通話を開始したにもかかわらず、通話相手がこちらのユーザの顔を認識できない、という事態を好適に回避することができ、通話相手に違和感を与えることがなくなる。
すなわち、本実施形態の携帯端末100によれば、テレビ電話機能を使用した着信があった場合、テレビ電話機能が有効な状況にあるか否かを判定し、テレビ電話機能が有効でない状況と判断した場合、テレビ電話機能による通話から音声通話に切り替えられる。また、テレビ電話機能が有効でない状況と判断した後、テレビ電話機能が有効な状況となった場合、音声通話からテレビ電話機能による通話に切り替えることで、テレビ電話機能による通話を再開することができる。
すなわち、本発明の実施に際しては、本発明の技術的範囲またはその均等の範囲内において、上述した実施形態の構成要素に関し様々な変更並びに代替を行ってもよい。
例えば、本実施形態においては顔情報検出部8による顔の検出を、光度検出部7による光度の検出後に行っていたが、本発明はこれに限定されず、光度検出部7による光度の検出をすることなく、または光度の検出の前に顔情報検出部8による顔の検出を行ってもよい。そしてその結果、顔情報検出部8により顔の検出ができなかった場合または検出された顔の大きさが所定の大きさよりも小さかった場合には、ユーザの選択によりまたは自動的にテレビ電話機能による通話を終了するまたは、音声通話に切り替えるようにしてもよい。
本実施形態の携帯端末100では、ユーザの顔の画像信号と、音声入出力部6により生成された音声信号とが重畳され、テレビ電話用のデータとして通信部2により送受信されることを想定している。しかし、本発明はこれに限定されず、例えばテレビ電話機能の実行時でも、撮像部1により撮像された画像信号と、音声入出力部6により生成された音声信号とが別々に通話相手と送受信されるように構成されてもよい。
本出願は、2008年8月28日出願の日本特許出願・出願番号2008-220444に基づくものであり、その内容はここに参照として取り込まれる。
Claims (15)
- 撮像部と、
前記撮像部に撮像された画像に基づいてテレビ電話機能を実行する制御部と、
を有し、
前記制御部は、前記撮像部により撮像された画像が所定の条件を満たした場合には前記テレビ電話機能の実行を抑制する
ことを特徴とする通信機器。 - 前記撮像部により撮像された画像から人の顔に関する情報を検出する顔情報検出部を有し、
前記制御部は前記撮像部により撮像された画像から前記顔情報検出部により人の顔が検出されなかった場合には、前記テレビ電話機能の実行を抑制する
ことを特徴とする請求項1に記載の通信機器。 - 音声検出部を有し、
前記制御部は、前記撮像部に撮像された画像の送信を抑制するとともに、前記音声検出部により検出された音声を送信することにより前記テレビ電話機能の実行を抑制する
ことを特徴とする請求項1に記載の通信機器。 - 前記制御部は、前記撮像部による画像の撮像を抑制することにより前記テレビ電話機能の実行を抑制する
ことを特徴とする請求項1に記載の通信機器。 - 表示部を有し、
前記制御部は、前記テレビ電話機能の実行を抑制しているときにおいて前記テレビ電話機能の実行相手から送信される画像を前記表示部に表示する請求項1に記載の通信機器。 - 前記制御部は、前記テレビ電話機能の実行を抑制しているときにおいて前記撮像部により撮像された画像が前記所定の条件を満たさなくなった場合には前記テレビ電話機能の実行の抑制を解除する
ことを特徴とする請求項1に記載の通信機器。 - 光度検出部と、
撮像部と、
前記撮像部に撮像された画像に基づいてテレビ電話機能を実行する制御部と、
を有し、
前記制御部は、前記光度検出部により所定の光度より低い光度が検出された場合には、前記テレビ電話機能の実行を抑制する
ことを特徴とする通信機器。 - 音声検出部を有し、
前記制御部は、前記撮像部に撮像された画像の送信を抑制するとともに、前記音声検出部により検出された音声を送信することにより前記テレビ電話機能の実行を抑制する
ことを特徴とする請求項7に記載の通信機器。 - 前記制御部は、前記撮像部による画像の撮像を抑制することにより前記テレビ電話機能の実行を抑制する
ことを特徴とする請求項7に記載の通信機器。 - 表示部を有し、
前記制御部は、前記テレビ電話機能の実行を抑制しているときにおいて前記テレビ電話機能の実行相手から送信される画像を前記表示部に表示する請求項8に記載の通信機器。 - 前記制御部は、前記テレビ電話機能の実行を抑制しているときにおいて前記光度検出部により所定の光度より高い光度が検出された場合には前記テレビ電話機能の実行の抑制を解除する
ことを特徴とする請求項7に記載の通信機器。 - 筐体状態検出部と、
撮像部と、
前記撮像部に撮像された画像に基づいてテレビ電話機能を実行する制御部と、
を有し、
前記制御部は、前記筐体状態検出部により所定値以上の筐体の変位が検出された場合には、前記テレビ電話機能の実行を抑制する
ことを特徴とする通信機器。 - 音声検出部を有し、
前記制御部は、前記撮像部により撮像された画像の送信を抑制するとともに、前記音声検出部により検出された音声を送信することにより前記テレビ電話機能の実行を抑制する
ことを特徴とする請求項12に記載の通信機器。 - 前記制御部は、前記撮像部による画像の撮像を抑制することにより前記テレビ電話機能の実行を抑制する
ことを特徴とする請求項12に記載の通信機器。 - 前記制御部は、前記テレビ電話機能の実行を抑制しているときにおいて前記筐体状態検出部により所定の条件が検出されなくなった場合には前記テレビ電話機能の実行の抑制を解除する
ことを特徴とする請求項12に記載の通信機器。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/059,712 US9277173B2 (en) | 2008-08-28 | 2009-08-28 | Communication device |
KR1020117006946A KR101380482B1 (ko) | 2008-08-28 | 2009-08-28 | 통신 기기 |
JP2010526802A JP5226074B2 (ja) | 2008-08-28 | 2009-08-28 | 通信機器 |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2008-220444 | 2008-08-28 | ||
JP2008220444 | 2008-08-28 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010024415A1 true WO2010024415A1 (ja) | 2010-03-04 |
Family
ID=41721578
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2009/065122 WO2010024415A1 (ja) | 2008-08-28 | 2009-08-28 | 通信機器 |
Country Status (4)
Country | Link |
---|---|
US (1) | US9277173B2 (ja) |
JP (1) | JP5226074B2 (ja) |
KR (1) | KR101380482B1 (ja) |
WO (1) | WO2010024415A1 (ja) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2014090387A (ja) * | 2012-10-31 | 2014-05-15 | Ricoh Co Ltd | 情報処理装置、会議システムおよびプログラム |
JP2015525918A (ja) * | 2012-06-25 | 2015-09-07 | アマゾン・テクノロジーズ、インコーポレイテッド | 注視決定とデバイス入力との使用 |
WO2018128014A1 (ja) * | 2017-01-06 | 2018-07-12 | ソニー株式会社 | 情報処理装置、情報処理方法、及びプログラム |
Families Citing this family (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8009586B2 (en) | 2004-06-29 | 2011-08-30 | Damaka, Inc. | System and method for data transfer in a peer-to peer hybrid communication network |
US8380859B2 (en) | 2007-11-28 | 2013-02-19 | Damaka, Inc. | System and method for endpoint handoff in a hybrid peer-to-peer networking environment |
JP5420210B2 (ja) * | 2008-08-08 | 2014-02-19 | 京セラ株式会社 | 携帯端末および携帯端末におけるロック設定方法 |
US8892646B2 (en) | 2010-08-25 | 2014-11-18 | Damaka, Inc. | System and method for shared session appearance in a hybrid peer-to-peer environment |
US9043488B2 (en) | 2010-03-29 | 2015-05-26 | Damaka, Inc. | System and method for session sweeping between devices |
US9191416B2 (en) | 2010-04-16 | 2015-11-17 | Damaka, Inc. | System and method for providing enterprise voice call continuity |
US8352563B2 (en) | 2010-04-29 | 2013-01-08 | Damaka, Inc. | System and method for peer-to-peer media routing using a third party instant messaging system for signaling |
US8611540B2 (en) | 2010-06-23 | 2013-12-17 | Damaka, Inc. | System and method for secure messaging in a hybrid peer-to-peer network |
US8743781B2 (en) | 2010-10-11 | 2014-06-03 | Damaka, Inc. | System and method for a reverse invitation in a hybrid peer-to-peer environment |
US8407314B2 (en) | 2011-04-04 | 2013-03-26 | Damaka, Inc. | System and method for sharing unsupported document types between communication devices |
US9088661B2 (en) * | 2011-08-02 | 2015-07-21 | Genesys Telecommunications Laboratories, Inc. | Hands-free voice/video session initiation using face detection |
KR101490698B1 (ko) * | 2012-08-13 | 2015-02-06 | 삼성에스디에스 주식회사 | 모바일 단말기 및 이를 이용한 영상 통화 방법 |
US9270822B2 (en) * | 2012-08-14 | 2016-02-23 | Avaya Inc. | Protecting privacy of a customer and an agent using face recognition in a video contact center environment |
GB2509323B (en) | 2012-12-28 | 2015-01-07 | Glide Talk Ltd | Reduced latency server-mediated audio-video communication |
US9025001B2 (en) * | 2013-03-11 | 2015-05-05 | Honeywell International Inc. | Apparatus and method to switch a video call to an audio call |
US10284247B2 (en) * | 2013-06-10 | 2019-05-07 | Nxp B.V. | System and method for bit processing in a central network component |
US9027032B2 (en) * | 2013-07-16 | 2015-05-05 | Damaka, Inc. | System and method for providing additional functionality to existing software in an integrated manner |
US9357016B2 (en) | 2013-10-18 | 2016-05-31 | Damaka, Inc. | System and method for virtual parallel resource management |
WO2016022574A1 (en) | 2014-08-05 | 2016-02-11 | Damaka, Inc. | System and method for providing unified communications and collaboration (ucc) connectivity between incompatible systems |
US10530731B1 (en) * | 2016-03-28 | 2020-01-07 | Snap Inc. | Systems and methods for chat with audio and video elements |
US10091025B2 (en) | 2016-03-31 | 2018-10-02 | Damaka, Inc. | System and method for enabling use of a single user identifier across incompatible networks for UCC functionality |
US10405038B2 (en) * | 2016-08-30 | 2019-09-03 | Patrick Dean Cummins | Systems, methods, and apparatus for network architecture with video hardware basis |
US10841536B2 (en) | 2018-09-28 | 2020-11-17 | Universal City Studios Llc | Special effects communication techniques |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004032305A (ja) * | 2002-06-25 | 2004-01-29 | Matsushita Electric Ind Co Ltd | 画像通信携帯端末機 |
JP2006100980A (ja) * | 2004-09-28 | 2006-04-13 | Nec Access Technica Ltd | Tv電話機能付き携帯電話端末、及びその映像及び音声のon/off制御方法 |
Family Cites Families (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH02113761A (ja) * | 1988-10-24 | 1990-04-25 | Nippon Telegr & Teleph Corp <Ntt> | テレビ電話装置 |
JPH06233289A (ja) * | 1993-02-02 | 1994-08-19 | Nippon Telegr & Teleph Corp <Ntt> | 画像通信端末 |
JP2001054085A (ja) | 1999-08-12 | 2001-02-23 | Matsushita Electric Ind Co Ltd | 携帯端末装置 |
JP2002163921A (ja) | 2000-11-28 | 2002-06-07 | Matsushita Electric Works Ltd | 照明器具 |
KR20030065659A (ko) * | 2002-01-30 | 2003-08-09 | 삼성전자주식회사 | 얼굴정보 검출을 이용하여 기지국 또는 단말기에서의보안을 제공하기 위한 장치 및 그 방법 |
US7308581B1 (en) * | 2003-03-07 | 2007-12-11 | Traffic101.Com | Systems and methods for online identity verification |
JP2005236597A (ja) | 2004-02-19 | 2005-09-02 | Oki Electric Ind Co Ltd | 省電力機能を備えた携帯端末装置 |
KR100640483B1 (ko) * | 2004-10-22 | 2006-10-30 | 삼성전자주식회사 | 이동통신 단말기에서 통화 모드를 자동변경하기 위한 장치및 방법 |
JP2006194612A (ja) * | 2005-01-11 | 2006-07-27 | Denso Corp | 光センサ付き機器 |
US7564476B1 (en) * | 2005-05-13 | 2009-07-21 | Avaya Inc. | Prevent video calls based on appearance |
KR101403172B1 (ko) * | 2005-05-17 | 2014-06-03 | 퀄컴 인코포레이티드 | 방위-감응 신호 출력 |
KR100703332B1 (ko) * | 2005-06-07 | 2007-04-03 | 삼성전자주식회사 | 휴대단말기의 동작모드 전환방법 |
US7518631B2 (en) * | 2005-06-28 | 2009-04-14 | Microsoft Corporation | Audio-visual control system |
WO2007077614A1 (ja) * | 2005-12-28 | 2007-07-12 | Fujitsu Limited | Tv電話機能の撮影画像処理切り替え装置 |
CA2633778C (en) * | 2006-01-05 | 2016-03-15 | Anisse Taleb | Media content management |
JP4966600B2 (ja) | 2006-07-20 | 2012-07-04 | Necカシオモバイルコミュニケーションズ株式会社 | テレビ電話装置及びプログラム |
US8375136B2 (en) * | 2007-08-08 | 2013-02-12 | Innopath Software, Inc. | Defining and implementing policies on managed object-enabled mobile devices |
JP5224804B2 (ja) * | 2007-12-27 | 2013-07-03 | 三星電子株式会社 | 撮像装置 |
US20100079508A1 (en) * | 2008-09-30 | 2010-04-01 | Andrew Hodge | Electronic devices with gaze detection capabilities |
-
2009
- 2009-08-28 KR KR1020117006946A patent/KR101380482B1/ko not_active IP Right Cessation
- 2009-08-28 US US13/059,712 patent/US9277173B2/en not_active Expired - Fee Related
- 2009-08-28 JP JP2010526802A patent/JP5226074B2/ja active Active
- 2009-08-28 WO PCT/JP2009/065122 patent/WO2010024415A1/ja active Application Filing
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2004032305A (ja) * | 2002-06-25 | 2004-01-29 | Matsushita Electric Ind Co Ltd | 画像通信携帯端末機 |
JP2006100980A (ja) * | 2004-09-28 | 2006-04-13 | Nec Access Technica Ltd | Tv電話機能付き携帯電話端末、及びその映像及び音声のon/off制御方法 |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2015525918A (ja) * | 2012-06-25 | 2015-09-07 | アマゾン・テクノロジーズ、インコーポレイテッド | 注視決定とデバイス入力との使用 |
JP2014090387A (ja) * | 2012-10-31 | 2014-05-15 | Ricoh Co Ltd | 情報処理装置、会議システムおよびプログラム |
WO2018128014A1 (ja) * | 2017-01-06 | 2018-07-12 | ソニー株式会社 | 情報処理装置、情報処理方法、及びプログラム |
US10965815B2 (en) | 2017-01-06 | 2021-03-30 | Sony Corporation | Information processing apparatus and information processing method |
US11503162B2 (en) | 2017-01-06 | 2022-11-15 | Sony Corporation | Information processing apparatus and information processing method |
Also Published As
Publication number | Publication date |
---|---|
JP5226074B2 (ja) | 2013-07-03 |
KR20110051257A (ko) | 2011-05-17 |
US9277173B2 (en) | 2016-03-01 |
KR101380482B1 (ko) | 2014-04-01 |
US20110141220A1 (en) | 2011-06-16 |
JPWO2010024415A1 (ja) | 2012-01-26 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5226074B2 (ja) | 通信機器 | |
US20110115833A1 (en) | Portable terminal and luminance adjustment program | |
CN111050062B (zh) | 一种拍摄方法及电子设备 | |
KR100689384B1 (ko) | 카메라 기능을 가진 이동 통신 단말기 및 그 방법 | |
JP2023518895A (ja) | 画像撮影方法と電子機器 | |
EP1662761B1 (en) | Method for performing a camera function in a mobile communication terminal | |
CN115336251B (zh) | 摄像装置、摄像方法及记录介质 | |
JP2004032442A (ja) | 携帯端末及びその報知方法 | |
JP2007312039A (ja) | Tv電話機能付き携帯端末 | |
KR100663470B1 (ko) | 카메라가 구비된 휴대용 단말기 및 이를 이용한 촬영방법 | |
KR100646031B1 (ko) | 눈동자 움직임으로 입력을 제어하는 방법 및 이동통신단말기 | |
JP2004289688A (ja) | テレビ電話装置 | |
KR101138563B1 (ko) | 휴대 전화기 | |
JP2007005915A (ja) | 携帯端末装置 | |
JP5221404B2 (ja) | 携帯電子機器及び音声調整方法 | |
JP4069681B2 (ja) | 携帯端末及びその報知方法 | |
KR100663429B1 (ko) | 줌 기능을 제어하는 이동 통신 단말기 및 그 방법 | |
KR100606067B1 (ko) | 카메라 기능을 가진 이동 통신 단말기 및 그 방법 | |
JP2005142929A (ja) | 携帯端末 | |
KR20060136235A (ko) | 휴대단말기의 통화수행 방법 | |
KR100626217B1 (ko) | 이동통신단말기에서 광마우스 기능을 구현하기 위한 장치및 방법 | |
KR100697627B1 (ko) | 움직임 감지를 이용한 촬영 방법 및 장치 | |
KR100663471B1 (ko) | 카메라가 구비된 휴대용 단말기를 포함하는 시스템 및 이를 이용한 촬영방법 | |
KR100606010B1 (ko) | 휴대 단말기에서 흔들림 방지 장치 및 방법 | |
JP2001160958A (ja) | 携帯テレビ電話装置における撮影画像データ補正方法及びその装置 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09810063 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2010526802 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13059712 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 20117006946 Country of ref document: KR Kind code of ref document: A |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 09810063 Country of ref document: EP Kind code of ref document: A1 |