JP2005354450A - Personal digital assistant and its control method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To protect the privacy of an intended party of a TV telephone call or video communication in a personal digital assistant. <P>SOLUTION: A mobile phone is equipped with a video input whose connection with a TV receiver through a cable permits motion pictures and sounds outputted to the TV receiver. The mobile phone enables a TV telephone call. The pictures and the sounds that have been transmitted from the terminal of the intended party through the telephone call are also outputted to the TV receiver 150. During the TV telephone call, when the cable is connected with the video input, information for informing that the pictures and the sounds that have been transmitted from the intended party are transmitted at the terminal of the intended party of the TV telephone call. As a result, a message image screen 512 is displayed within a TV telephone call screen 510 in the display unit of the terminal of the intended party. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a portable information terminal, and more particularly to a portable information terminal having a videophone function or at least an image communication function and a control method thereof.

  2. Description of the Related Art In recent years, portable information terminals such as mobile phones have been put into practical use having a videophone function that is a call function using image information and audio information as disclosed in Patent Document 1 and the like. Note that the video phone described in Patent Document 1 has an answering function, and further has a function of notifying the other party of the remaining time during which a message can be recorded.

  On the other hand, since a portable information terminal has portability, it is basically considered to be used personally. Therefore, in a call using a videophone function in a portable information terminal, even if image information and audio information are transmitted and received, it is considered that the image information and audio information is viewed personally and is relatively personal. It is considered that there are cases where image information and audio information are transmitted and received.

  In such a portable information terminal, at least as long as image information is transmitted and received, the sender can grasp how the transmitted information is used. For example, the privacy of the person who transmitted the information is protected. It is thought that consideration is necessary.

It is a technology related to the technology related to the videophone function, and takes into account the privacy protection of the person who is photographed with the camera when the image photographed with the camera is viewed at a place away from the camera. As such, the technique described in Patent Document 2 can be cited. Patent Document 2 discloses a technique regarding a nurse call intercom device. Specifically, when a predetermined operation is performed in a nurse center, a surveillance camera installed in a hospital room is activated to operate in the nurse center. There is disclosed a technique for notifying a patient that a monitoring camera is operating by turning on an operation indicator when an image captured by the monitoring camera is displayed on a monitor television.
JP-A-8-23525 Japanese Patent Laid-Open No. 11-368

  However, even if the technology described in Patent Document 2 above is applied to a portable information terminal having a conventional videophone function, a technology that contributes to protecting the privacy of a person who has transmitted image information or audio information is created. Is hard to say. A person who intends to transmit image information or audio information using a portable information terminal equipped with a videophone function determines whether or not the videophone camera or microphone provided in the portable information terminal is in operation. This is because it can be recognized without notification, and even if the technique described in Patent Document 2 is applied, the use of the transmitted image information and audio information cannot be notified to the sender.

  The present invention has been conceived in view of such circumstances, and an object thereof is to provide a portable information terminal capable of protecting the privacy of a communication partner during a videophone call or image communication, and a control method thereof. That is.

  A portable information terminal according to an aspect of the present invention determines a transmission / reception unit for transmitting / receiving an image to / from another communication device and whether an image is transmitted / received using the transmission / reception unit. Communication determining means, connection means for outputting an image received by the transmission / reception means to an external device different from the other communication devices, and whether an external device is connected via the connection means A connection determination unit that determines whether an external device is connected via the connection unit, and the communication determination unit transmits and receives an image using the transmission / reception unit. Control means for transmitting to the other communication device information indicating that the image transmitted by the other communication device is being output from the external device. And wherein the Rukoto.

  A portable information terminal according to another aspect of the present invention is a portable information terminal having a function of performing a videophone call with another terminal, and transmits and receives image and voice data related to the videophone call. A transmission / reception unit; a call determination unit that determines whether or not a videophone call using the transmission / reception unit is made; a connection unit for connecting to an external device; Output processing means for executing processing for outputting received images and sounds to an external device, connection determination means for determining whether or not an external device is connected via the connection means, and the connection determination means When it is determined that an external device is connected via the connection means and it is determined that a videophone call is being made, the call is sent to the transmission / reception means. Characterized in that it comprises a control means for transmitting predetermined information to the terminal of the other party of the videophone call by disconnection means.

  Also, in the portable information terminal according to the present invention, the predetermined information is output from the terminal of the other party of the videophone call and the image and sound of the videophone call are output from a device different from the portable information terminal. It is preferable that the information is a notification message.

  In the portable information terminal according to the present invention, it is preferable that the predetermined information includes information for displaying the message at the terminal of the other party of the videophone call.

  The portable information terminal according to the present invention may further include an imaging unit that captures an image related to a videophone call, and the predetermined information may be obtained by combining the message with an image captured by the imaging unit. It is preferable to include information to be displayed on the terminal of the other party of the telephone call.

  In the portable information terminal according to the present invention, it is preferable that the predetermined information includes information for outputting a voice corresponding to the message at the terminal of the other party of the videophone call.

  In the portable information terminal according to the present invention, it is preferable that the control means causes the transmission / reception means to transmit the predetermined information to the terminal of the other party of the videophone call at predetermined time intervals.

  Moreover, in the portable information terminal according to the present invention, the control means determines that the connection determination means is connected to an external device via the connection means with respect to the transmission / reception means, and the call It is preferable that the predetermined information is continuously transmitted during a period in which it is determined by the determining means that a videophone call is being made.

  The portable information terminal according to the present invention includes an image data generating unit that generates image data by capturing an external video, and an audio data generating unit that generates audio data by inputting external audio. The transmission / reception unit further transmits the image data generated by the image data generation unit and the audio data generated by the audio data generation unit to a call partner terminal during a videophone call, and the control unit Preferably, the predetermined information is combined with image data generated by the image data generation unit or audio data generated by the audio data generation unit and transmitted to the transmission / reception unit.

  A method for controlling a portable information terminal according to an aspect of the present invention has a function of transmitting and receiving an image to and from another communication device, and is received from the other communication device by being connected to an external device. A method of controlling a portable information terminal comprising connection means for outputting an image to an external device, the step of determining whether or not an image is being transmitted / received to / from the other communication device, and the connection Determining whether or not an external device is connected via the means; and determining that the external device is connected via the connection means and an image between the other communication device Transmitting to the other communication device information indicating that the image transmitted by the other communication device is output in an external device when it is determined that the transmission / reception is performed. Features To.

  A method for controlling a portable information terminal according to another aspect of the present invention has a function of performing a videophone call with a terminal with another communication device, and is connected to an external device to make a videophone call. A method of controlling a portable information terminal comprising a connection means for outputting image and sound received by a call to the outside, the step of transmitting and receiving image and sound data relating to a videophone call, and a videophone call being made A step of determining whether or not an external device is connected to the connection means, a determination that an external device is connected to the connection means, and a videophone call And a step of transmitting predetermined information to the terminal of the other party of the videophone call when it is determined that the call is made.

  According to the present invention, in a portable information terminal, when a cable is connected to a terminal during a videophone call or when a videophone call is started with a cable connected to the terminal, the other party of the videophone call On the other hand, by transmitting predetermined information, it is possible to notify that a cable is connected to the terminal and that a voice or an image based on a videophone call is output to an external output device.

  Therefore, the portable information terminal according to the present invention provides the other party with information for avoiding that the voice or image transmitted by the other party of the videophone call is used for a purpose contrary to the intention of the other party. This can contribute to protecting the other party's privacy.

  Further, according to the present invention, in the portable information terminal, the other party of the videophone call is directly notified as a message that the voice or image based on the videophone call is output to the external output device. Therefore, the situation can be easily understood by the calling party.

  Further, according to the present invention, since the message as described above is displayed or outputted by voice in the portable information terminal, the situation can be more easily understood by the other party.

  In addition, according to the present invention, the above message is displayed on the portable information terminal in a synthesized manner with an image based on the videophone call that is considered to be noticed by the call partner at the call partner terminal. Therefore, the situation can be understood more easily.

  Further, according to the present invention, in the portable information terminal, transmission of predetermined information is performed at predetermined time intervals, so when the message as described above is displayed or the message is output as voice, It is possible to reduce the troubles to the call.

  In addition, according to the present invention, since predetermined information is continuously transmitted in the portable information terminal, audio and images based on the videophone call are transmitted to an external output device to the other party of the videophone call. You can make sure that it is output.

  Further, according to the present invention, in the portable information terminal, predetermined information is combined with data originally transmitted in a videophone call and transmitted. Thereby, in the portable information terminal, it is possible to minimize the burden caused by transmitting predetermined information during a videophone call.

  Note that a videophone usually consists of both transmission and reception of images and sounds. However, in the present invention, when at least an image is transmitted and received and the image is output to the outside, a message to that effect is transmitted to the communication partner. Configured as follows. As a result, it is possible to provide the communication partner with information for avoiding that the image transmitted by the communication partner is used for a purpose contrary to the intention of the partner, thereby protecting the privacy of the communication partner. Can contribute.

  Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In the following description, components having the same name and function are denoted by the same reference numerals, and detailed description thereof will not be repeated.

  FIG. 1 is a schematic perspective view of a mobile phone 100 which is an embodiment of the portable information terminal of the present invention. FIG. 1A is a diagram illustrating the appearance of a mobile phone viewed from the user's operation surface side. FIG. 1B is a diagram illustrating the appearance of a mobile phone viewed from the back side of the operation surface of the mobile phone.

  Referring to FIGS. 1A and 1B, mobile phone 100 includes a first housing 121 provided with an antenna 135 and a second housing 123. The first casing 121 and the second casing 123 are connected to each other by a connecting portion 122 so as to be freely rotatable.

  The first casing 121 includes a speaker 125, an inner liquid crystal display device 127A, and a camera 129, and an outer liquid crystal display device 127B is disposed on the back surface facing the inner liquid crystal display device 127A. The second casing 123 includes an operation button 131A, a numeric button 131B, and a microphone 133. A video input / output unit 138 is disposed on the back surface of the operation button 131A.

  The camera 129 includes, for example, a CCD (Charge Coupled Device). The camera 129 constitutes image data generating means for generating image data by shooting an external video.

  The first casing 121 and the second casing 123 rotate about the connecting portion 122 as a rotation axis. Thereby, in the mobile phone 100, the inner liquid crystal display device 127A of the first housing 121 and the numeric buttons 131B of the second housing 123 can be folded in a state of facing each other. When the cellular phone 100 is folded, the display on the outer liquid crystal display device 127B is valid, and when the cellular phone 100 is opened, the display on the inner liquid crystal display device 127A is valid. Note that whether to enable the inner liquid crystal display device 127A or the outer liquid crystal display device 127B is not limited to the condition of the open / close state of the mobile phone 100, but other conditions, for example, pressing the operation button 131A in the open state, etc. May be switched.

  Further, in this embodiment, a so-called foldable mobile phone is illustrated, but it may be a straight type or a biaxial type (second rotation in a direction perpendicular to the rotational axis direction of the connection portion 122). An axis may be provided, and the first housing 121 may be rotatably provided).

  The operation button 131A includes a movement button for moving the cursor displayed on the inner liquid crystal display device 127A, a determination button for inputting a confirmed instruction, and the like. The number button 131B is a button for inputting numbers, characters, or symbols. The number buttons 131B are composed of a total of 12 buttons to which numbers 0 to 9 and symbols “*” and “#” are attached. Each button is assigned an alphabet, a kana, or a symbol, and numeric input and kana input are possible by switching the input mode.

  The video input / output unit 138 is a terminal for connecting the mobile phone 100 to an external device, and the video input / output unit 138 has one end connected to the television receiver 150 and the other end of the cable 151. Connected. One end of the cable 151 is connected to the video input terminal and the audio input terminal of the television receiver 150. The television receiver 150 receives an image from the mobile phone 100 and outputs the image and sound. Accordingly, the video input / output unit 138 outputs an image and sound to the television receiver 150 in a state where the video input / output unit 138 is connected to the television receiver 150 via the cable 151. The control unit 101 can detect whether or not the cable 151 is connected to the video input / output unit 138. In addition, in order to allow the control unit 101 to electrically detect the presence / absence of the connection of the cable 151 to the video input / output unit 138, the mobile phone 100 determines whether the cable 151 is connected to the video input / output unit 138, for example. An electrical connection state between a plurality of terminals (not shown) is changed. In this embodiment, mobile phone 100 is connected to television receiver 150. Instead of television receiver 150, a display device that can display an image without a tuner, a speaker that outputs sound, and the like. May be connected. In addition, the mobile phone 100 includes a television broadcast receiving unit and another communication means (for example, a wireless local area network (LAN)) that can receive distributed moving image data, and outputs video and video to an output device that is an external monitor. The structure which can output an audio | voice may be sufficient.

  In this embodiment, the connection method with the television receiver 150 which is an external device is exemplified by using a cable, but the present invention is not limited to this. As an external device in the present invention, not only a device directly connected to a portable information terminal with a cable, but also an external device wirelessly connected using a technology such as Bluetooth or IEEE801.11a / b / g, a LAN Including all external devices connected via a network such as

  In this embodiment, a case where a general videophone is applied as an aspect in which the portable information terminal of the present invention receives information from another terminal or a communication device is illustrated. It is not limited. At least, when the portable information terminal of the present invention is capable of bidirectional communication of images with other terminals or communication devices, the communication partner can know when the image received from the communication partner is output externally. As long as the predetermined information is transmitted as described above. As a result, the communication partner can know when the image transmitted by the communication partner is externally output by the other party. Thus, the person who transmitted the image can know whether the image transmitted by himself / herself is in a state that can be seen by an unspecified number of persons, for example, being output to a display device having a large screen. That is, the portable information terminal of the present invention sends information for avoiding the use of the image transmitted by the communication partner for a purpose contrary to the intention of the communication partner to the terminal (device) on the communication partner side. This can contribute to the protection of the privacy of the communication partner.

  FIG. 2 is a functional block diagram showing functions of the mobile phone 100. Referring to FIG. 2, mobile phone 100 includes a control unit 101 for controlling the entire mobile phone 100, a ROM (Read Only Memory) 104 for storing a program executed by control unit 101, and a predetermined number. EEPROM (electrically erasable / programmable read only memory) 102 that stores initial values and the like, data processing unit 103 connected to microphone 133 and speaker 125, image processing unit 111 connected to camera 129, and storage unit 113 A video processing unit 115 connected to the video input / output unit 138, a display control unit 107 connected to the inner liquid crystal display device 127A and the outer liquid crystal display device 127B, and an input connected to the operation buttons 131A and the numeric buttons 131B. And a control unit 109. These are appropriately connected by a bus 117.

  The mobile phone 100 further includes a communication control unit 105 connected to the data processing unit 103. Communication control unit 105 is connected to antenna 135. The communication control unit 105 performs wireless communication with a base station of a mobile phone. The communication control unit 105 outputs a signal received from the base station to the data processing unit 103, and transmits the signal received from the data processing unit 103 to the base station.

  The communication control unit 105 outputs an incoming call signal to the data processing unit 103 when receiving an incoming call signal requesting the start of a call from the base station. When the communication control unit 105 receives an e-mail from the base station, the communication control unit 105 outputs the e-mail to the data processing unit 103. The reception of the incoming call signal and the reception of the e-mail are reception of a connection request signal for requesting the mobile phone 100 to establish a wireless communication connection.

  Further, in the cellular phone 100, by appropriately operating the operation button 131A and the numeric button 131B, a signal requesting a videophone call or an e-mail transmission is input from the input control unit 109 to the control unit 101. The In response to this, the communication control unit 105 transmits a signal for starting a call (calling signal) or an e-mail to the base station.

  The data processing unit 103 is controlled by the control unit 101. The data processing unit 103 converts the audio signal input from the microphone 133 into a digital signal, performs a predetermined compression process on the digital signal, outputs the digital signal to the communication control unit 105, and receives the input from the communication control unit 105. The audio signal is expanded and converted into an analog signal, and then output to the speaker 125. Further, the data processing unit 103 stores the image data received from the communication control unit 105 in the storage unit 113. Furthermore, when an email is input from the communication control unit 105, the data processing unit 103 stores the input email in the storage unit 113. The microphone 133 and the data processing unit 103 constitute sound data generating means for generating sound data by inputting external sound.

  The image processing unit 111 inputs image data obtained by imaging with the camera 129 from the camera 129 in accordance with an instruction from the control unit 101. Then, the image processing unit 111 compresses the input image data using a compression method such as JPEG (joint photographic experts group) or MPEG (moving picture experts group), and stores the compressed data in the storage unit 113.

  The storage unit 113 includes a recording medium, and writes and reads data with respect to the recording medium in accordance with instructions from the control unit 101. When image data is recorded on the recording medium, the storage unit 113 can read the image data.

  The display control unit 107 outputs a video signal to either or both of the inner liquid crystal display device 127A and the outer liquid crystal display device 127B in accordance with an instruction from the control unit 101. The video signal includes a moving image and a still image.

  The video processing unit 115 converts the image and sound input via the video input / output unit 138 into digital signals in accordance with an instruction from the control unit 101, and compresses the digital signal using a compression method such as MPEG2, for example. To remember. In addition, the video processing unit 115 outputs an image and audio obtained by expanding the compressed data stored in the storage unit 113 to the video input / output unit 138 in accordance with an instruction from the control unit 101. Since the video input / output unit 138 is connected to the television receiver 150 by the cable 151, the image and sound input to the video input / output unit 138 are output to the television receiver 150 and output from the television receiver 150. Is done. When the mobile phone 100 includes a television broadcast receiving unit and another communication means (for example, a wireless LAN) that can receive distributed image data, the video processing unit 115 follows the instruction from the control unit 101. The images received by them may be output to the video input / output unit 138.

  The video processing unit 115 also outputs an image and sound based on the data received by the communication control unit 105 to the video input / output unit 138. When the video input / output unit 138 is connected to the television receiver 150, the image and sound based on the data received by the communication control unit 105 are output from the television receiver 150 by the processing by the video processing unit 115. Note that the image received by the communication control unit 105 includes a still image and a moving image. The image received by the communication control unit 105 includes an image received when videophone communication is executed and an image attached to an e-mail.

  The input control unit 109 accepts inputs from the operation buttons 131A and the numeric buttons 131B in accordance with instructions from the control unit 101. The input control unit 109 outputs an input signal assigned to each button to the control unit 101 in response to receiving an input from the operation button 131A and the numeric button 131B.

  The control unit 101 reads out and executes the output control program recorded in the storage unit 113. In this embodiment, an example in which the output control program executed by the control unit 101 is stored in the storage unit 113 is shown, but other recording media such as a flexible disk, a cassette tape, a CD-ROM, a hard disk, Optical disks (MO (Magnetic Optical Disc) / MD (Mini Disc) / DVD (Digital Versatile Disc)), IC cards (including memory cards), optical cards, mask ROM, EPROM, EEPROM, flash ROM, and other semiconductor memories The program may be stored in a medium that carries the program in a fixed manner.

  The program referred to here includes not only a program that can be directly executed by a CPU (Central Processing Unit) but also a program in a source program format, a compressed program, an encrypted program, and the like.

  Next, the operation executed in the mobile phone 100 will be specifically described. Note that the cellular phone 100 is characterized by an operation when it is connected to the television receiver 100 by connecting the cable 151 to the video input / output unit 138 during a videophone call. Therefore, in the following part, an explanation will be given focusing on the operation of the mobile phone 100 at such time.

  FIG. 3 is a flowchart of a main routine executed by the control unit 101.

  Referring to FIG. 3, when power is turned on to mobile phone 100, control unit 101 first performs processing for entering a standby state in step S1 (hereinafter, “step” is omitted). The standby state refers to a state in which a predetermined standby screen is displayed on the inner liquid crystal display device 127A, for example.

  Next, in step S2, the control unit 101 determines whether or not there is a call from the mobile phone 100. The transmission means that the communication control unit 105 transmits a call signal or an e-mail to the base station. If it is determined that there is a call, the control unit 101 proceeds to S4. If it is determined that there is no transmission, the control unit 101 proceeds to S3.

  In S <b> 3, the control unit 101 determines whether there is an incoming call in the mobile phone 100. An incoming call means that the communication control unit 105 has received an incoming call signal or an e-mail. If it is determined that there is an incoming call, the control unit 101 proceeds to S4. If it is determined that there is no incoming call, the control unit 101 proceeds to S7.

  In S4, the control unit 101 determines whether or not the outgoing call in S2 or the incoming call in S3 is due to a videophone call. If so, the control unit 101 advances to S5, and if not (ie, electronic Regarding mail transmission / reception) The process proceeds to S6.

  In S5, the control unit 101 executes a videophone process that is a process for a videophone call, and then returns the process to S1. The contents of the videophone process will be described later.

  In S6, the control unit 101 performs communication processing that is processing related to transmission / reception of electronic mail, and then proceeds to S7.

  In S7, the control unit 101 determines whether or not the cable 151 is connected to the video input / output unit 138. If it is determined that the cable 151 is connected, the process proceeds to S8. If it is determined that the cable 151 is not connected, the process proceeds to S9.

  In S8, the control unit 101 executes an external output control process, which is a process for outputting an image or sound to the television receiver 150 via the video input / output unit 138, and then returns the process to S1. The contents of the external output control process will be described later.

  In S <b> 9, the control unit 101 determines whether information has been input to the input control unit 109. When determining that an input has been made, the control unit 101 executes a process according to the input in S10, and then returns the process to S1. On the other hand, when determining that there is no input, the control unit 101 returns the process to S1 as it is.

  FIG. 4 is a flowchart of the subroutine of the videophone process in S5 described above.

  Referring to FIG. 4, in the videophone process, control unit 101 first executes a process related to transmission / reception of information for a videophone call in S51.

  Next, in S52, the control unit 101 determines whether or not the cable 151 is connected to the video input / output unit 138. If it is determined that it is connected, the process proceeds to S53. If it is determined that it is not connected, the process proceeds to S54. To proceed.

  In S53, the control unit 101 performs a process of outputting audio and images received from the other party in a videophone call to the TV receiver 150, and then proceeds to SA1. In S <b> 53, specifically, the control unit 101 causes the video processing unit 115 to output audio and images received by the communication control unit 105 to the video input / output unit 138. Output of audio and video to the video input / output unit 138 is continued until either the videophone call or the connection of the cable 151 to the video input / output unit 138 is terminated.

  In SA1, the control unit 101 executes an output notification process for notifying the other party of the videophone call that the image and the sound are being output to the television receiver 150. The contents of the output notification process will be described later with reference to FIG.

  On the other hand, in S54, the control unit 101 checks the communication status in the communication control unit 105 to determine whether the videophone call has ended. If the control unit 101 determines that the videophone call has ended, the process for controlling the display content and the like of the inner liquid crystal display device 127A in response to the end of the videophone call in S55 (call end) After executing the processing), return. On the other hand, if the control unit 101 determines that the videophone call has not ended yet, it returns the process to S52.

  FIG. 5 is a flowchart of the external output control process subroutine of S8 described above.

  Referring to FIG. 5, in the external output control process, first, in step S <b> 81, the control unit 101 transmits, to the television receiver 150, the audio and image received from the other party in the videophone call, which is the same process as S <b> 53 described above. Perform output processing.

  Next, in S82, the control unit 101 determines whether there is a call from the mobile phone 100. If it is determined that there is a call, the process proceeds to S84. If it is determined that there is no call, the process proceeds to S83.

  In S83, the control unit 101 determines whether there is an incoming call in the mobile phone 100. If it is determined that there is an incoming call, the process proceeds to S84. If it is determined that there is no incoming call, the process proceeds to S86.

  In S84, the control unit 101 determines whether the outgoing call in S82 or the incoming call in S83 is due to a videophone call. If so, the process proceeds to S85. If not, the process proceeds to SA1. Proceed with the process.

  In SA1, the control unit 101 executes the output notification process as described above.

  In S85, the control unit 101 performs communication processing that is processing related to transmission / reception of electronic mail, and then proceeds to S86.

  In S86, the control unit 101 determines whether or not the connection of the cable 151 to the video input / output unit 138 is released. If it is determined that the connection is released, the process returns to S1, and if it is determined that the connection is not released, the process proceeds to S82. To return.

  FIG. 6 is a flowchart of a subroutine of output notification processing in SA1.

  With reference to FIG. 6, in the output notification process, the control unit 101 performs “external output” stored in the ROM 104 as image data captured by the camera 129 in the image processing unit 111 in SA11. The process of synthesizing the image data of the message is performed. Note that the data composition processing in SA11 is continued until stopped in SA13 or SA15.

  As a result of the processing of SA11, as shown in FIG. 7, an image captured by the camera 129 and a message “externally output” are displayed on the display unit of the other party of the videophone call of the mobile phone 100. It will be displayed. Referring to FIG. 7, screen 500 displayed on the display unit of the call partner terminal includes a call screen 510 for displaying an image captured by camera 129 and a radio wave of the call partner terminal. An antenna picture 501 for indicating a situation, an image 502 for indicating that the terminal of the other party is in a videophone call, and an image 503 indicating a volume output in a videophone call at the terminal of the other party included. In the call screen 510, a message image 512 corresponding to the message “externally output” as described above is displayed together with a caller image 511 that is a caller image captured by the camera 129 of the mobile phone 100. It is displayed.

  Referring to FIG. 6 again, next, at SA12, the control unit 101 determines whether or not the connection of the cable 151 to the video input / output unit 138 is released. If it is determined that the connection is released, the process proceeds to SA13. If it is determined that it has not been released, the process proceeds to SA14.

  In SA13, the control unit 101 stops the synthesis of data started in SA11. Thus, on the screen displayed on the display unit of the other party of the videophone call, as shown in FIG. 8, the message “external output” as described above is not displayed.

  Referring to FIG. 8, when the processing of SA13 is performed, screen 590 is displayed on the display unit of the other party of the videophone call. The screen 590 includes an antenna picture 501 and images 502 and 503 as in the screen 500 shown in FIG. Screen 590 includes a call screen 591 instead of call screen 510. Compared to the call screen 510, the call screen 591 includes the caller image 511 but does not include the message image 512.

  Referring to FIG. 6 again, in SA14, control unit 101 checks the communication status in communication control unit 105 to determine whether the videophone call has ended. When the control unit 101 determines that the videophone call has ended, the control unit 101 ends the data composition started in SA11 in SA15, and further, in SA16, the inner liquid crystal corresponding to the end of the videophone call. After executing the process for controlling the display content and the like of the display device 127A (call termination process), the process returns to S1. On the other hand, if the control unit 101 determines that the videophone call has not ended yet, it returns the process to SA12.

  In the present embodiment described above, the mobile phone 100 includes the video input / output unit 138, and the video input / output unit 138 is connected to the television receiver 150 with the cable 151, whereby images and audio are transmitted to the television receiver 150. Is output. The mobile phone 100 can perform a videophone call, and the image and sound transmitted from the other party's terminal by the videophone call are also output to the television receiver 150 in the same manner. When the cable 151 is connected to the video input / output unit 138 during a videophone call, an image and sound transmitted from the other party are output to the TV receiver 150 at the terminal of the other party of the videophone call. Information that informs the user is transmitted. As a result, the message image 512 is displayed in the call screen 510 as shown in FIG.

  In the present embodiment, the call screen 591 displayed on the terminal of the other party of the videophone call of the mobile phone 100 is described as including only the caller image 511, but this is merely an example. The call screen 591 basically displays an image taken by the camera 129 as in the case of a general videophone call.

  Further, in the present embodiment, during the period in which the cable 151 is connected to the video input / output unit 138, the data synthesis in SA11 is continuously performed. Although control is performed so that the message image 512 is displayed on the display unit, the notification mode according to the present invention is not limited to this. That is, the data composition in SA11 may be performed once every fixed time (for example, once every two seconds) during the period in which the cable 151 is connected to the video input / output unit 138. As a result, the message screen 512 is displayed once every fixed time on the display unit of the other party's terminal.

  In the present embodiment, the notification as described above is performed by synthesizing image data corresponding to the message image 512 with image data based on the image captured by the camera 129 and transmitting the image data to the terminal of the other party. The message image 512 is displayed on the call screen 510, but the notification mode based on the present invention is not limited to this. When the mobile phone 100 performs the notification as described above, the mobile phone 100 may transmit the image data for display such as the message image 512 without being combined with the image data based on the image captured by the camera 129. good. In this case, the terminal of the other party of the call may be configured to display a dedicated image 593 outside the call screen 591 as shown in FIG. 9, for example, by receiving such image data. preferable. FIG. 9 shows a screen 592 displayed on the display unit of the other party's terminal. The screen 592 includes a call screen 591 including a caller image 511, an antenna picture 501, and images 502 and 503, similar to the screen 590 illustrated in FIG. 8. The screen 592 further includes an image 593 for notifying that the image and sound transmitted for the videophone call from the terminal are output to an external device in the mobile phone 100 that is the call partner. It is.

  Further, in the present embodiment, the notification as described above is performed in such a manner that a message is displayed on the display unit of the other party's terminal, but the notification mode is not limited to this. For example, the notification may be made by causing a terminal of the other party to output a specific sound.

  For example, when the connection of the cable 151 to the video input / output unit 138 is detected in the cellular phone 100, the control unit 101 performs data processing instead of causing the image processing unit 111 to synthesize image data. After the voice signal input from the microphone 133 is converted into a digital signal in the unit 103, it is synthesized with voice data corresponding to a message such as “externally output” stored in the ROM 104, and the video call It is conceivable to transmit to the other terminal. As a result, the terminal of the other party of the call outputs a voice “externally output” simultaneously with the voice input by the microphone 133.

  As another example of voice notification, when the connection of the cable 151 to the video input / output unit 138 is detected in the mobile phone 100, the control unit 101 makes a normal videophone call to the other party's terminal. It is also conceivable to transmit a control signal for outputting a voice for notifying the voice at the terminal of the other party to the data transmitted at the time of the call. In such a case, it is preferable that the other party's terminal is configured to output pre-stored voice data by receiving such a control signal.

  In any example, the above-described audio notification may be performed continuously during a period in which the cable 151 is connected to the video input / output unit 138 in the mobile phone 100, or at a certain time. It may be performed once.

  The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.

1 is an overview perspective view of a mobile phone as an embodiment of a portable information terminal of the present invention. It is a functional block diagram of the mobile phone of FIG. It is a flowchart of the main routine of the control part of FIG. It is a flowchart of the subroutine of the videophone process of FIG. It is a flowchart of the subroutine of the external output control process of FIG. It is a flowchart of the subroutine of the output alerting | reporting process of FIG. 4 and FIG. FIG. 2 is a diagram showing an example of a screen displayed on the screen of the display unit of the terminal of the other party of the video phone call in the mobile phone of FIG. 1. It is a figure which shows another example of the screen displayed on the screen of the display part of the terminal of the other party of the video telephone call of the mobile telephone of FIG. It is a figure which shows another example of the screen displayed on the screen of the display part of the terminal of the other party of the video telephone call of the mobile phone of FIG.

Explanation of symbols

  100 cellular phone, 101 control unit, 103 data processing unit, 105 communication control unit, 107 display control unit, 109 input control unit, 111 image processing unit, 113 storage unit, 115 video processing unit, 117 bus, 121 first housing Body, 122 connection section, 123 second housing, 125 speaker, 127A inner liquid crystal display device, 127B outer liquid crystal display device, 129 camera, 131A operation button, 131B numeric button, 133 microphone, 135 antenna, 138 video input / output unit 150 TV receiver, 151 cable, 500, 590, 593 screen, 501 antenna pic, 502, 503, 593 image, 510, 591, 592 call screen, 511 caller image, 512 message image.

Claims (11)

A transmission / reception means for transmitting / receiving an image to / from another communication device;
Communication determining means for determining whether an image is transmitted or received using the transmitting / receiving means;
Connection means for outputting the image received by the transmission / reception means to an external device different from the other communication device;
Connection determination means for determining whether an external device is connected via the connection means; and
When it is determined by the connection determination means that an external device is connected via the connection means, and the communication determination means determines that the image transmission / reception using the transmission / reception means is being performed, A portable information terminal comprising: a control unit that transmits information indicating that an image transmitted by the other communication device is output from the external device to the other communication device. A portable information terminal having a function of making a videophone call with another terminal,
A transmission / reception means for transmitting / receiving image and audio data relating to a videophone call;
Call determination means for determining whether a videophone call using the transmission / reception means is being made; and
Connection means for connecting to an external device;
Output processing means for executing processing for outputting the image and sound received by the transmission / reception means to an external device via the connection means;
Connection determination means for determining whether an external device is connected via the connection means; and
When it is determined that the connection determination means is connected to an external device via the connection means, and the call determination means determines that a videophone call is being made, A portable information terminal comprising: control means for transmitting predetermined information to a terminal of a call partner of a videophone call.   The predetermined information is information for informing a message indicating that an image and sound of a videophone call are output from a device different from the portable information terminal at the terminal of the other party of the videophone call. The portable information terminal according to claim 2.   The portable information terminal according to claim 3, wherein the predetermined information includes information for displaying the message at a terminal of the other party of the videophone call. It further comprises an imaging means for taking an image relating to a videophone call,
The portable information terminal according to claim 4, wherein the predetermined information includes information for combining the message with an image captured by the imaging unit and causing the message to be displayed on a terminal of the other party of the videophone call.   6. The portable information terminal according to claim 3, wherein the predetermined information includes information for outputting a voice corresponding to the message at a terminal of the other party of the videophone call.   7. The mobile phone according to claim 2, wherein the control unit causes the transmitting / receiving unit to transmit the predetermined information at a predetermined time interval to a terminal of the other party of the videophone call. Information terminal.   The control means determines that the connection determination means determines that the transmission / reception means is connected to an external device via the connection means, and that the call determination means determines that a videophone call is being made. The portable information terminal according to any one of claims 2 to 6, wherein the predetermined information is continuously transmitted during a period of time being set. Image data generating means for generating image data by photographing an external video;
Voice data generating means for generating voice data by inputting external voice,
The transmission / reception unit transmits the image data generated by the image data generation unit and the audio data generated by the audio data generation unit to the other party's terminal during a videophone call,
The said control means synthesize | combines the said predetermined information with the image data which the said image data generation means produces | generates, or the audio | voice data which the said audio | voice data generation means produces | generates, The said transmission / reception means is made to transmit. The portable information terminal according to any one of 8. Portable information having a function of transmitting and receiving an image to and from another communication device, and having connection means for outputting an image received from the other communication device to an external device by being connected to the external device A terminal control method,
Determining whether an image is being transmitted / received to / from the other communication device;
Determining whether an external device is connected via the connection means;
When it is determined that an external device is connected via the connection unit and it is determined that an image is being transmitted / received to / from the other communication device, the other communication device And a step of transmitting information indicating that an image transmitted by the other communication device is output from an external device. A portable information terminal having a function of performing a videophone call with another terminal, and having a connection means for outputting an image and a sound received by the videophone call to the outside by being connected to an external device Control method,
Sending and receiving image and audio data for videophone calls;
Determining whether a videophone call is being made;
Determining whether an external device is connected to the connection means;
When it is determined that an external device is connected to the connection means, and it is determined that a videophone call is being made, transmitting predetermined information to a terminal of the other party of the videophone call A method for controlling a portable information terminal.

Images