JP2008060752A - Calling method of communication terminal - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a calling method of a call setup server and a calling method of communication terminals which do not take time for calling a communication partner by telephone, and can reproduce a video file immediately after communication start in a communication system in which reproduction display of the video file is possible in each communication terminal during speech. <P>SOLUTION: When calling operation is carried out for calling the communication partner, if designation of upload (transfer) of the video file is made which is reproduced during the speech, a terminal A starts the upload processing of the designated video file from the terminal A to a media server 70 after processing of position registration is made in a SIP (Session Initiation Protocol) server 40. The media server 70 notifies a message of the file transfer completion to the SIP server 40 after the upload processing of the file completes. The SIP server 40 executes processing to call out the communication partner after the message of the file transfer completion notification is received from the media server 70. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a calling method of a communication terminal in a communication system capable of reproducing and displaying a video file at each communication terminal during a call.

Conventionally, many communication terminals equipped with a videophone function are known. In particular, in a communication terminal equipped with a videophone function in recent years, when a video file stored in the communication terminal is designated for playback during a call, it is displayed on the display unit of the communication terminal. A technique is known in which data of the video file is transmitted to a communication terminal of the other party via a communication line and can be streamed and displayed on a display unit of the communication terminal of the other party.
In addition, the videophone system disclosed in Patent Document 1 transmits a video (for example, CM) corresponding to a user to a videophone terminal that is transmitting, and has personal information of the user on the network side. The user selects a video based on the user, synthesizes voice and ringback tone, and transmits the video file to the outgoing videophone terminal until the other party answers.
JP-A-2005-33442

However, with a communication terminal equipped with a conventional videophone function, when streaming playback (transfer) of a video file using all the lines temporarily during a call, while watching the playback video, ”And the like, there is a problem that they cannot talk to each other during playback.
In addition, when transferring video files in parallel while making a call, there is a problem that the bandwidth that can be used for file transfer is reduced and it takes time to complete the transfer, so that real-time characteristics are lacking.
Further, when streaming playback (transfer) of a video file is performed in parallel with a call, the video file may not be correctly played back if the transfer rate is lower than the rate required for streaming playback.
Furthermore, in a communication terminal equipped with a conventional videophone function, the video file to be played back and displayed on each communication terminal during a call must be transferred during the call. There is also a problem that playback cannot be displayed on the terminal.
Note that the videophone system described in Patent Document 1 is not a technique for displaying the same video on each communication terminal during a call. Also, it is not a technology for transferring a video file for that purpose during a call.

  The present invention has been made in view of such problems, and an object of the present invention is to provide a communication terminal calling method capable of reproducing a video file immediately after the start of a call.

In order to achieve the above object, a communication terminal calling method according to the present invention, when a video file uploaded to a server on a network receives a playback request for the video file from a communication terminal in a call, In the communication system in which the video file is distributed to each communication terminal and the video file can be reproduced and displayed on each communication terminal during a call, the communication terminal performs a call operation for calling the other party. At this time, if the upload of the video file to be played during the call is specified, the upload of the specified video file to the server is performed before the process of calling the other party, and the upload is performed. After the call is completed, a process of calling the other party is executed.
Alternatively, after the remaining size to be uploaded reaches a predetermined size, the process of calling the other party is executed.
Alternatively, when the estimated completion time of the upload process exceeds a predetermined time, a process for calling the other party is executed.
Alternatively, when a predetermined time has elapsed from the start of uploading, a process of calling the other party is executed.

  When the communication terminal does not complete the upload process even when a call with the call partner is started, it is preferable to secure a bandwidth necessary for the call and perform the upload process with the remaining bandwidth, or It is preferable to detect the silent section and perform the upload process when the silent state is detected. Moreover, it is preferable that the communication terminal displays a message indicating that a file is being transferred on the screen of the communication terminal during the upload process.

  In the present invention, since the video file to be shown to the other party is transferred or transferred to the media server before the other party answers, the video file can be reproduced immediately after the start of the call, or for a while after the call is started. Video files can be played.

  Embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a configuration diagram of a network to which a mobile terminal device which is an example of a communication terminal according to the present invention is connected. The mobile terminal device 10 is equipped with a videophone function and can perform group calls. Call control is performed by transmitting a message to a SIP (Session Initiation Protocol) server 40 on an IP network. Is converted into an RTP (Real-time Transport Protocol) packet in the mobile terminal device 10 and transmitted to the counterpart communication terminal device. The RTP packet is transmitted to a partner terminal device or another network 60 via a PDSN (Packet Data Serving Node) 50. An SMS (Short Message Service) server 30 creates an SMS message that informs the other party of the incoming call of the group call, for example, based on the incoming call notification from the SIP server 40, and transmits it to the terminal device of the other party. In addition, when the other party performs registration to the SIP server 40 and the incoming call notification from the SIP server 40 to the other party is possible, the incoming call notification by the SMS message from the SMS server 30 is not necessary. The media server 70 temporarily stores the video / audio file sent from the mobile terminal device 10, and in response to the stored video / audio file, the video / audio file of the video / audio file is received by a command from the mobile terminal device 10 during a call. When a reproduction request is received, a video / audio file is distributed to each mobile terminal device 10 during a call, and video / audio data is reproduced / stopped / paused.

  In the above description, the incoming call notification is notified by the SMS message so as not to wastefully occupy the band between the mobile terminal device 10 and the base station 20. That is, in order for the mobile terminal device 10 to receive a notification from the SIP server 40, it is necessary to always establish a PPP connection between the mobile terminal device 10 and the base station 20 (or PDSN 50). However, the number of portable terminal devices 10 that can be connected to the base station 20 at the same time is limited, and the bandwidth utilization efficiency is also deteriorated. Therefore, the incoming call notification is performed by the SMS message, and then the PPP (Point to Point Protocol) connection is established to communicate with the SIP server 40.

  FIG. 2 is a system configuration diagram of a mobile terminal device showing an example of a communication terminal according to the present invention. In the present embodiment, a mobile phone will be described as an example of the mobile terminal device. 2 includes a transmission / reception unit 102, a control unit 103, an SMS analysis unit 104, an audio modulation / demodulation unit 105, a video modulation / demodulation unit 106, a speaker 107, a display device 108, a microphone 109, The camera 110, the memory 111, and the operation unit 113 are included.

  A signal transmitted from the base station 20 is received by the antenna 101. The transmission / reception unit 102 processes the received signal based on a command from the control unit 103 and outputs it to the control unit 103 if it is a SIP message, and extracts audio data and video data from the packet if it is an RTP packet, These are output to the audio modulation / demodulation unit 105 and the video modulation / demodulation unit 106, respectively. The sound modulation / demodulation unit 105 decodes the sound data and outputs the decoded sound data from the speaker 107. The video modulation / demodulation unit 106 decodes the video data and outputs the decoded video to the display device 108.

  In the case of transmission, when audio data and video data acquired from the microphone 109 and the camera 110 are input to the audio modulation / demodulation unit 105 and the video modulation / demodulation unit 106, respectively, the audio modulation / demodulation unit 105 encodes the audio data, and the video modulation / demodulation unit 106 Encode video data. The transmission / reception unit 102 converts the encoded data into an RTP packet based on a command from the control unit 103 and transmits the RTP packet to the base station 20 through the antenna 101. In addition, the control unit 103 generates a SIP message and transmits it to the base station 20 through the transmission / reception unit 102 and the antenna 101.

  The memory 111 includes a data storage unit 112. The data storage unit 112 stores data to be transmitted to the media server 70 and data downloaded from the media server 70. In addition, the memory 111 stores an application program for making a voice call, an application program for playing a video file, an application program for making a videophone call, and the like.

  When the incoming call notification is received as an SMS message, the transmission / reception unit 102 processes the received SMS message based on a command from the control unit 103 and transmits the processed SMS message to the SMS analysis unit 104. When the SMS analysis unit 104 analyzes the SMS message and determines that, for example, an incoming videophone call is received, the SMS analysis unit 104 activates an application program for making a videophone call stored in the memory 111 and notifies the application of member information. The application performs location registration (Registration) to the SIP server 40 and performs incoming call processing.

  FIG. 3 is a sequence diagram for explaining the first embodiment from when the mobile phone shown in FIG. 2 uploads (transfers) a video file to the media server and starts a call. When a call operation for calling a call partner is performed on the operation unit 113, the terminal A specifies that uploading (transfer) of a video file to be played during a call is performed on the operation unit 113. After the location registration (Registration) processing is performed in 40, the upload processing of the designated video file from the terminal A to the media server 70 is started first. FIG. 4 is a diagram illustrating an example of a screen displayed on the display device of the terminal A during the upload process. On the upload processing screen, the antenna and battery icons are displayed at the top, the message “Transferring file” and the caller's text and the phone number of the other party are displayed in the center. May be displayed, or the numbers of all members may be displayed), and a bar indicating the progress of file transfer and the transfer amount (%) are displayed at the bottom.

  When the file upload process ends, the media server 70 notifies the terminal A of a file transfer completion message, and when the file upload process ends, the terminal A sends an INVITE message to the SIP server 40 to notify the other party of the call. Perform the calling process. When the SIP server 40 receives the INVITE message from the terminal A, it notifies the SMS server 30 of the incoming call. Upon receiving the incoming call notification, the SMS server 30 notifies the designated terminals B and C of the SMS message. If the designated call partner (terminals B and C) included in the INVITE message is registering with the SIP server 40, the notification of the SMS message is omitted and the incoming call is notified by the SIP message.

  When the terminals B and C receive the SMS message notification and perform location registration processing with respect to the SIP server 40, the INVITE message is sent from the SIP server 40 to the terminals B and C. When the terminals B and C receive the INVITE message, they ring a ringing tone and transmit Ringing to the terminal A via the SIP server 40. When the terminals B and C are off-hook, a 200 OK response message is transmitted to the terminal A via the SIP server 40. When terminal A transmits an ACK message to terminals B and C in response to receiving the 200 OK response message, a connection is established between terminal A and terminals B and C. Thereafter, terminal A and terminals B and C A call is started between.

  In the embodiment described above, since the process of calling the other party is performed after the upload process of the designated video file to the media server 70 is completed, the video file can be reproduced immediately after the start of the call.

  In FIG. 3, after the upload process of the designated video file to the media server 70 is completed, the process of calling the other party (transmission of the INVITE message from the terminal A to the SIP server 40) is performed. Considering the time until C responds by receiving the SMS message, the message may be notified to the SIP server before the upload process is completed. Next, an example of performing a process of calling a call partner before the upload process is completed will be described.

  In the second embodiment, a process of uploading a designated video file to the media server 70 is performed, and a process of calling a call partner is executed after the remaining size to be uploaded reaches a predetermined size. Although it takes time to call the other party, in the second embodiment, the process for calling the other party after the remaining size to be uploaded reaches a predetermined size in consideration of the time required for this call. Is executed, the other party can be called earlier than in the first embodiment, and the video file can be reproduced immediately after the start of the call.

  In the third embodiment, upload processing of a designated video file to the media server 70 is performed, and when the estimated remaining time of completion of the upload processing exceeds a predetermined time (time required to call the other party), a call is made. The process of calling the other party is executed. In the third embodiment, since the other party is called when the remaining time until the upload process is completed reaches a predetermined time, the other party can be called earlier than the first embodiment for a predetermined time and immediately after the start of the call. Can play files.

  In the fourth embodiment, a process of uploading a designated video file to the media server 70 is performed, and when a predetermined time has elapsed since the upload process was started, a process of calling the other party is executed. In the fourth embodiment, since the calling party is called after a predetermined time has elapsed from the start of the upload process, it is possible to prevent the start of the call from being delayed.

  In the second, third, and fourth embodiments, the upload process may not be completed due to the influence of the communication path even when the terminals B and C respond to the other party and become ready for a call. In that case, when a call with the other party is started, a bandwidth necessary for the call is secured, and upload processing is performed with the remaining bandwidth. In other words, the bandwidth that can be used for file transfer is calculated from the bandwidth that is currently available and the bandwidth that is used for videophone, for example, and the amount of file transfer is reduced so that the call is not affected. To continue the file transfer. As another method, when a call with the other party is started, a silent section where the amount of voice packets transferred is below a certain amount is detected, and when a silent state is entered, the files are uploaded together. Also good. FIG. 5 is a diagram illustrating an example of a screen displayed on the display device of the terminal A when the upload process is not completed when the call is ready. A bar 203 is displayed on the screen so that the upload progress can be known. 201 is an image of the other party who is making a videophone call, and 202 is his own image.

  Next, the media server will be described. The video file uploaded to the media server 70 can be operated from the operation unit 113 of the terminal that uploaded the video file. Note that an uploaded video file such as playback may be controlled by an operation from the other party. When the terminal A is instructed to play the video file, the video and audio of the speaker is stopped, and the video file may be transmitted from the media server 70 to the terminals A, B, and C. As described above, the video file is played on the terminal. Since the video file is in the media server 70, the media server 70 can synthesize the voice of the speaker with the video and audio of the file and transmit them to the terminal of the other party. If the voice of the video file and the voice of the speaker can be synthesized, it is possible to have a conversation (comment) on the video file being played. There is a method of synthesizing the voice of the video file and the voice of the speaker on the terminal side, but when synthesizing the voices of all the speakers, voice data of all the speakers is required in the terminal.

  In addition, the video file uploaded to the media server 70 is deleted when the call is not established (when the outgoing call is canceled) or when the call is ended. If there is, it may be downloaded from the media server 70 and stored in the terminal.

  In the present invention, the video file and the speaker's voice may not be synthesized and the video file may be transmitted to the other party's terminal separately from the video phone, for example. In this case, it is necessary to notify the terminal in advance of information on the media server that transmits the video file. FIG. 6 is a diagram showing an example of a screen when a video file transmitted separately from the videophone is being received and played back while a videophone call is being made. 201 is the other party's video, 202 is his own video, and 204 is the file playback video.

It is a block diagram of a network to which a mobile terminal device according to the present invention is connected. It is a system configuration | structure figure of the portable terminal device which concerns on this invention. FIG. 6 is a sequence diagram for explaining a first embodiment from when a mobile phone uploads (transfers) a video file to a media server and starts a call. It is a figure which shows the example of the screen displayed on the display apparatus of the terminal A at the time of an upload process. It is a figure which shows the example of the screen displayed on the display apparatus of the terminal A when upload processing is not completed when it becomes a telephone call possible state. It is a figure which shows the example of a screen when receiving and reproducing | regenerating the video file transmitted separately from the videophone when making a telephone call.

Explanation of symbols

10 mobile terminal device 20 base station 30 SMS server 40 SIP server 50 PDSN
60 network 70 media server 101 antenna 102 transmission / reception unit 103 control unit 104 SMS analysis unit 105 audio modulation / demodulation unit 106 video modulation / demodulation unit 107 speaker 108 display device 109 microphone 110 camera 111 memory 112 data storage unit 113 operation unit 201 partner video 202 own Video 203 Bar 204 File playback video

Claims (7)

When a video file uploaded to a server on the network receives a playback request for the video file from a communication terminal in a call, the video file is distributed to each communication terminal in a call, In a communication system capable of reproducing and displaying the video file on a communication terminal,
When the communication terminal is designated to upload a video file to be played back during the call when a call operation for calling the call partner is performed, before the process of calling the call partner, A method for calling a communication terminal, comprising: performing a process of uploading a designated video file to the server, and performing a process of calling the other party after completion of the upload. When a video file uploaded to a server on the network receives a playback request for the video file from a communication terminal in a call, the video file is distributed to each communication terminal in a call, In a communication system capable of reproducing and displaying the video file on a communication terminal,
When the communication terminal is designated to upload a video file to be played back during the call when a call operation for calling the call partner is performed, before the process of calling the call partner, A method for calling a communication terminal, comprising: performing a process of uploading a designated video file to the server, and performing a process of calling the other party after the remaining upload size reaches a predetermined size. When a video file uploaded to a server on the network receives a playback request for the video file from a communication terminal in a call, the video file is distributed to each communication terminal in a call, In a communication system capable of reproducing and displaying the video file on a communication terminal,
When the communication terminal is designated to upload a video file to be played back during the call when a call operation for calling the call partner is performed, before the process of calling the call partner, A method for calling a communication terminal, comprising: uploading a specified video file to the server, and executing a process of calling the other party when a predicted completion time of the upload process exceeds a predetermined time. When a video file uploaded to a server on the network receives a playback request for the video file from a communication terminal in a call, the video file is distributed to each communication terminal in a call, In a communication system capable of reproducing and displaying the video file on a communication terminal,
When the communication terminal is designated to upload a video file to be played back during the call when a call operation for calling the call partner is performed, before the process of calling the call partner, A method for calling a communication terminal, comprising: performing a process of uploading a designated video file to the server, and executing a process of calling the other party when a predetermined time has elapsed since the uploading started.   The communication terminal reserves a bandwidth necessary for the call and performs the upload processing with the remaining bandwidth when the upload processing is not completed even when a call with the call partner starts. Item 5. A communication terminal calling method according to Item 4.   5. The communication terminal detects a silence interval when the upload process is not completed even when a call with the call partner is started, and performs the upload process when in a silence state. A calling method for a communication terminal according to claim 1. The said communication terminal performs the display which shows that it is transferring the file on the screen of the said communication terminal during the said upload process, The any one of Claim 1 to 6 characterized by the above-mentioned. The communication terminal calling method described.

Images