JP2017188776A - Communication device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a communication device that allows a reception side terminal to reproduce data on the basis of timing intended by a transmission side user without being influenced by variation occurring due to difference between a delay time of a voice call and a delay time of external sound reproduction.SOLUTION: A terminal 200 includes: a time management unit 103 for managing reference time common to a transmission side terminal that gives reproduction instructions on external sound; a reproduction data generation unit 108 for obtaining reproduction designation time T1 of the external sound transmitted by a terminal 100; and a data reproduction unit 110 for performing reproduction processing of the external sound indicated by the terminal 100 on the basis of the reproduction designation time T1 and the reference time managed by the time management unit 103.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a communication apparatus for providing external sound such as music to a call partner in addition to a call.

  Conventionally, a technique for providing a sound (external sound) different from a speaker's voice (call voice) in a voice call using a mobile phone or the like has been proposed. For example, Patent Document 1 below discloses a telephone terminal device that can reproduce background music during a call.

JP 2005-217614 A

  When transmitting / receiving data instructing the reproduction of external sound using a line other than the voice call line during a voice call, as in the telephone terminal device of Patent Document 1, the delay time of the voice call (the speaker speaks) Until the utterance is played back on the other party's phone terminal) and the external sound playback delay time (after the user on the sending side performs an external sound playback instruction operation, The time until the sound is played back is different. Further, when there is no bandwidth guarantee on the line for transmitting / receiving data instructing the reproduction of external sound, the external sound reproduction delay varies. Therefore, even if the transmission side transmits data instructing the reproduction of the external sound in synchronism with the call voice, it is not guaranteed that the external sound is reproduced on the reception side telephone terminal at the timing intended by the transmission side. In particular, when a sound effect is to be reproduced as an external sound, the timing of the sound and the sound effect may be shifted.

  The present invention has been made in view of the above problems, and allows a receiving side terminal to reproduce data based on a timing intended by a transmitting side user without being affected by variations in delay of a data communication line. An object of the present invention is to provide a communication device capable of performing the above.

  In order to solve the above-described problem, the communication apparatus of the present invention includes a time management unit that manages a reference time common to a transmission-side terminal that issues a reproduction target reproduction instruction, and the reproduction target transmitted from the transmission-side terminal. An acquisition means for acquiring the reproduction designated time, and a reproduction process of the reproduction target instructed from the transmission side terminal based on the reproduction designated time obtained by the obtaining means and the reference time managed by the time management means Data reproducing means for performing

  According to the present invention, based on the reproduction designated time and the reference time, the reproduction process of the reproduction target instructed from the transmission side terminal is performed. As a result, it is possible to reproduce the reproduction target in the receiving terminal based on the timing intended by the user on the transmitting side.

  In addition, the communication device of the present invention acquires the current time using the time when the telephone line is connected as a reference time. According to the present invention, by acquiring the current time using the time when the call line is connected as the reference time, the current time can be adjusted to the point in time when the call is started at both the transmitting and receiving terminals. A common reference time can be set for the transmitting terminal.

  In the communication apparatus of the present invention, the data reproduction means performs a reproduction process at a reproduction time obtained by adding a delay time in a predetermined voice call to the reproduction designated time. According to the present invention, by performing the reproduction process at a reproduction time obtained by adding a predetermined line delay time to the reproduction designated time, the reproduction process can be performed at a timing that takes into account the delay time in the voice call. The reproduction process based on the timing intended by the user is made possible.

  Further, in the communication device of the present invention, when the current time is earlier than the playback time, the playback means plays back when the current time reaches the playback time.

  According to the present invention, when the current time is earlier than the reproduction time, the reproduction is performed when the current time reaches the reproduction time. In some cases, the delay time of the data communication is shorter than the delay time of the voice call. In this case, the reproduction process based on the timing intended by the user on the transmission side is enabled by waiting until the reproduction time is reached.

  Further, the communication device of the present invention does not perform the reproduction process when the current time is later than the reproduction time and the current time is later than an adjustment time obtained by adding a predetermined time to the reproduction time. When the current time is later than the reproduction time and the current time is earlier than the adjustment time, a reproduction process is performed.

  According to the present invention, when the current time is later than the reproduction time and the current time is later than the adjustment time, the reproduction process is not performed. When the current time is earlier than the adjustment time, the reproduction process is performed. By doing so, the reproduction processing in a time-shifted state that is uncomfortable for the user of the receiving terminal is not performed. Thereby, reproduction with a sense of incongruity can be prevented.

  The communication apparatus of the present invention includes a time management unit that manages a reference time common to the receiving terminal, a generating unit that generates an instruction signal that indicates a reproduction target to be reproduced in the receiving terminal, and the reproduction target Transmitting means for transmitting, with the instruction signal, a reproduction designated time that designates a time during which the reproduction target is reproduced in the receiving terminal.

  According to the present invention, the reception side terminal that reproduces the reproduction target transmits the reproduction designation time that specifies the reproduction time of the reproduction target together with the instruction signal, so that the reception side terminal reproduces the reproduction based on the reproduction designation time. Enable processing. Therefore, the reproduction process based on the timing intended by the user on the transmission side is made possible.

  According to the present invention, it is possible for the receiving terminal to reproduce the external sound at a timing intended by the user of the transmitting terminal.

It is a figure which shows schematic structure of the telephone call system of this embodiment. It is a figure which shows the functional block of the terminal 100 of this embodiment. It is a figure which shows the functional block of the terminal 200 of this embodiment. It is a hardware block diagram of the terminal 100 and the terminal 200 of this embodiment. It is a flowchart which shows an example of the process performed in the terminal 100 and the terminal 200 of this embodiment. It is a figure which shows the functional block of the terminal 400 of this embodiment. In the communication system of this embodiment, it is a figure which shows a process sequence when an instruction | indication signal is received before time T1 + D2. In the communication system of this embodiment, it is a figure which shows a process sequence when the instruction | indication signal is received before the time T + D2 + D3 after the time T1 + D2. In the communication system of this embodiment, it is a figure which shows a processing sequence when an instruction | indication signal is received after time T1 + D2 + D3.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant descriptions are omitted.

  FIG. 1 is a diagram illustrating a schematic configuration of a call system including a terminal 100 and a terminal 200 according to the present embodiment. As shown in FIG. 1, in a call system, a call between a user 1 (first speaker) and a user 2 (second speaker) is performed. In the call system, terminal 100 and terminal 200 (the same configuration as terminal 100 is preferable) are used as a call device. Here, the terminal 100 is a transmitting terminal that transmits instruction information for reproducing instructions to be reproduced, such as music and voice, to the terminal 200, and the terminal 200 functions as a receiving terminal that receives the instruction information. When the user 1 uses the terminal 100 and the user 2 uses the terminal 200, a voice call between the user 1 and the user 2 is realized.

  In the call system of the present embodiment, for example, the terminal 100 and the terminal 200 are configured to be communicable via the communication network 3 (communication network). Furthermore, the server 300 may be configured to be able to communicate with the terminal 100 and the terminal 200 via the communication network 3.

  Here, an example of the operation outline of the call system will be described. For example, when the call voice V1 of the user 1 is input at the terminal 100, it is encoded and then output as an encoded sequence and transmitted to the terminal 200. At the same time, an instruction signal for reproducing the content V3 held in the terminal 200 (external sound such as music / voice different from the call voice: reproduction target) is generated by the operation of the terminal 100 of the user 1 (user operation). And transmitted to the terminal 200.

  Specifically, as shown in FIG. 1, in terminals 100 and 200, contents a to c, which are sets of contents, are held in association with instruction signals a to c for reproducing each content. Yes. The instruction signal corresponding to the content selected by the user 1 is transmitted to the terminal 200 of the user 2, and the content corresponding to the instruction signal is reproduced on the terminal 200, whereby the content desired by the user 1 can be reproduced on the terminal 200. it can. As a result, the user 2 can hear not only the call voice V1 of the user 1 but also the content V3 desired by the user 1. At the same time, the user 1 may be able to listen to the content V3. The set of contents held in the terminal 100 and the terminal 200 may all be the same. Further, at least content selected by the user 1 may be held in the terminal 200.

  Since the terminal 100 and the terminal 200 have the same configuration, the user 1 can hear not only the call voice V2 of the user 2 but also the content V3 desired by the user 2. At this time, the user 2 may also be able to listen to the content V3.

  Examples of the content V3 include sound effects and music such as BGM. However, the content V3 is not limited to music, but is an environmental sound such as a song of a bird or a bustle of a station, or a line. May be used.

  Here, in the call system of the present embodiment, a communication line (voice call line) for transmitting / receiving the call voice V1 or V2 and a communication line (data communication line) for transmitting / receiving an instruction signal for reproducing the content V3. ), And the voice call line uses a mechanism with more stable operation and less delay variation. For example, a circuit switching method may be used for a voice communication line, a packet switching method may be used for a data communication line, or a bandwidth guarantee may be provided after using a packet switching method for a voice communication line.

  Note that the communication system of the present embodiment can also be applied when content is not held in the terminal 200. In that case, the content V4 may be held in the terminal 100 or the server 300 and transmitted to the terminal 200 in accordance with the operation of the user 1. In this case, the content V3 in the following description is replaced with the content V4.

  Even when the content is not held in the terminal 100, the content V <b> 4 may be held in the server 300 and transmitted to the terminal 200 in response to the operation of the user 1. Further, it may be transmitted to the terminal 100. In this case, the content V3 in the following description is replaced with the content V4.

  FIG. 2 is a diagram illustrating functional blocks of the terminal 100 which is a terminal (transmission side terminal) that specifies an external sound according to the present embodiment. As shown in FIG. 1, a call between the user 1 and the user 2 is performed by the terminal 100 and the terminal 200. It is preferable that the terminal 100 and the terminal 200 have the same configuration. Hereinafter, the terminal 100 of the user 1 will be described as an example.

  2, the terminal 100 includes a voice call unit 101 and a data communication unit 102. The data communication unit 102 includes a time management unit 103 (time management unit) and an instruction signal generation unit 104 (generation unit). ), A reproduction time information adding unit 105, and a data transmission unit 106 (transmission means).

  The voice call unit 101 receives the call voice V1 of the user 1, encodes the call voice V1, generates an encoded sequence B1, and transmits it to the call partner.

  The data communication unit 102 is a part that inputs an external sound data transmission instruction C1 from the user 1, generates transmission data C2 including reproduction time information described later, and transmits the transmission data C2 to the user 2.

  The time management unit 103 is a part that manages a time based on the time when the voice call unit 101 starts a call. Specifically, the time in the voice call is managed by setting the time T at which the notification indicating that the call is started from the voice call unit 101 to 0. The time management unit 103 outputs the current time T, which is time information, as necessary.

  Note that the time management unit 103 sets the actual time (eg, X hour, Y minute, Z second) as the reference time instead of setting the time when the notification indicating that the call is started from the voice call unit 101 as 0. It may be recorded, and thereafter, the difference from the reference time may be output. The notification indicating that the call has started may be input from other than the voice call unit 101, and may be input from the terminal 200 or the server 300 using a data communication line, for example. In addition, the time reference managed by the time management unit 103 is not limited to the time when the voice call unit 101 starts a call, and the time when the predetermined communication is performed between the terminal 100 and the terminal 200 is the reference time. It is good. For example, a time at which a data communication connection is established between the terminal 100 and the terminal 200 may be set as the reference time. The time management unit 103 may be outside the data communication unit 102.

  Here, the operation of the time management unit 103 is preferably different between the calling side terminal and the called side terminal of the voice call. Specifically, the caller terminal uses the time when the callee terminal receives a notification indicating that the callee terminal has responded to the voice call as a reference time, and the callee terminal receives a voice call from the callee terminal. The time obtained by adding the predetermined time D1 to the time when the call is answered may be used as the reference time. Here, it is preferable that the predetermined time D1 corresponds to a time taken for the notification indicating that the called terminal has responded to the incoming call of the voice call from the called terminal to the calling terminal. Thereby, the reference time can be set at the same time for the called terminal and the calling terminal, and it is not necessary to distinguish between the called terminal and the calling terminal in the subsequent processing.

  The predetermined time D1 is a value set in advance, but may be changed according to the other party. For example, you may change according to the telephone number of the terminal 200. FIG. It is determined whether the physical distance between the terminal 100 and the terminal 200 is far from the telephone number, information provided from the network in a voice call, and information provided from the terminal 200 or the server 300. For example, it is determined that the distance is short. The predetermined time D1 may be made smaller than a predetermined value at the time, and the predetermined time D1 may be made larger than the predetermined value when it is determined that the distance is far.

  The instruction signal generation unit 104 is a part that receives the data transmission instruction C1 from the user 1 and generates an instruction signal to be transmitted to the user 2. Specifically, an instruction signal (FIG. 1) for reproducing the content corresponding to the data transmission instruction C1 by the user 1 is generated and output.

  Here, instead of outputting the instruction signal, the instruction signal generation unit 104 may output a bit stream obtained by encoding the content V4 corresponding to the data transmission instruction C1. Further, the content corresponding to the data transmission instruction C1 by the user 1 may be output to the user 1 (not shown), so that the user 1 can also listen to the content.

  The reproduction time information adding unit 105 acquires the reproduction designation time T1 (reproduction time information) when the data transmission instruction C1 by the user 1 is input from the time management unit 103, and the instruction signal input from the instruction signal generation unit 104 This is a part that generates and outputs transmission data C2 by assigning to.

  The data transmission unit 106 is a part that transmits the transmission data C <b> 2 input from the reproduction time information adding unit 105 to the user 2.

  Next, functional blocks of the terminal 200 that is the receiving terminal will be described with reference to FIG. The terminal 200 includes a voice call unit 101a and a data communication unit 102a. The data communication unit 102a includes a time management unit 103a (time management unit), a data reception unit 107, a reproduction data generation unit 108, a reproduction time information extraction unit 109 (acquisition unit), and a data reproduction unit 110 (data reproduction unit). ).

  The voice call unit 101a is a part that receives the coded sequence B2 corresponding to the call voice V2 from the terminal 200 of the user 2, decodes the coded sequence B2, and generates and outputs the call voice V2.

  The data communication unit 102a receives the reception data C3 from the terminal 200 of the user 2, and reproduces the content V3 indicated by the reception data C3 based on the reproduction time information included in the reception data C3.

The time management unit 103 is a part that manages a time based on the time when the voice call unit 101a starts a call. Specifically, when a notification indicating that a call has been started is output from the voice call unit 101a, time management is performed by setting the current time T that has been waiting for a predetermined time D1 to 0.
The notification indicating that the call has started is output from a call start detection unit (not shown) that monitors the operation of the voice call unit 101a and detects the start of the call, instead of being output from the voice call unit 101a. May be.

  The data receiving unit 107 is a part that receives and outputs received data C3 that is an instruction signal to which reproduction time information is added. The received data C3 may be content V4 to which reproduction time information is given. For example, the content may be in the form of a bit stream of audio data.

  The reproduction data generation unit 108 is a part that generates and outputs the content V3 (FIG. 1) corresponding to the instruction signal included in the reception data input from the data reception unit 107. Specifically, the content stored in the storage (not shown) of the terminal 100 corresponding to the instruction signal is read and output. Note that if the content V4 is included in the data input from the data receiving unit 107, the content V4 may be output.

  The reproduction time information extraction unit 109 is a part that extracts and outputs the reproduction designated time T1 indicated by the reproduction time information included in the reception data input from the data reception unit 107.

  The data reproduction unit 110 adjusts the reproduction timing based on the reproduction designated time T1 indicated by the reproduction time information input from the reproduction time information extraction unit 109 and the current time T obtained from the time management unit 103, and a reproduction data generation unit This is a part for reproducing the content V3 input from 108. The adjustment of the reproduction timing performed by the data reproduction unit 110 is preferably a time T1 + D2 obtained by adding a predetermined time D2 to the reproduction designated time T1 indicated by the reproduction time information. Here, the predetermined time D2 preferably corresponds to a delay time of a voice call performed by the voice call unit 101. The predetermined time D2 is information stored in advance in the time management unit 103, but may be transmitted from the terminal 100 together with the instruction signal.

  In addition, when the current time T when the content is input from the reproduction data generation unit 108 is after the reproduction time (reproduction designated time T1 + predetermined time D2), it is preferable to reproduce immediately. Furthermore, in order to avoid the content being played back at a timing far from the timing intended by the user of the terminal 100 that is the transmission side terminal, the time management unit 103a when the content is input from the playback data generation unit 108 manages the content. When the current time T is after the time T1 + D2 + D3, it is preferable not to reproduce the content. Here, the predetermined time D3 corresponds to the longest time without a sense of incongruity for the user of the terminal 200 that is the receiving terminal. Note that there is no need to distinguish whether or not the current time T is after the time T1 + D2 + D3. In this case, the content input after the time T1 + D2 may always be reproduced immediately.

  Similar to the above-described predetermined time D1, the predetermined time D2 may be changed according to the other party of the call. From the telephone number, the information provided from the network in the voice call, the information provided from the terminal 200 or the server 300, the terminal The physical distance between the terminal 100 and the terminal 200 may be determined and changed. Further, the value of the predetermined time D3 may be changed according to the type of content. For example, it is shorter for a sound effect that causes a sense of discomfort if the playback timing is slightly shifted, and is longer for a BGM that does not cause a sense of discomfort even if the playback timing is slightly shifted (Including not performing control for a predetermined time D3).

  Further, the adjustment of the reproduction timing may be performed by a communication partner terminal or a server. Specifically, instead of inputting the reproduction designated time T1, the communication partner terminal or the server transmits the reproduction designated time T1 ′ adjusted to the reproduction designated time T1 + the predetermined time D2 as reproduction time information to the terminal 100. You may do it.

  Furthermore, the reproduction time information may not be added to the instruction signal generated by the instruction signal generation unit 104. For example, information on a voice call at the timing of generating reproduction time information may be given. The voice call information may be, for example, a coded sequence B1 (or a part thereof) or a bit stream obtained by coding the call voice V1. In this case, the reproduction time information extraction unit 109 holds the received voice call encoded sequence B2 and the output call voice V2, and the voice corresponding to the voice call information given to the instruction signal is voice. The timing output from the call unit 101 (or the timing corresponding thereto) may be regarded as the playback time. In this case, the data communication unit 102 may not include the time management unit 103. Further, the information of the voice call to be given is not limited to the above example, and any information that can identify the timing (or the timing according to it) at which the voice of the voice call is output may be used.

  FIG. 6 is a diagram illustrating functional blocks of a terminal 400 having functions of the terminal 100 and the terminal 200 according to the present embodiment. As shown in FIG. 6, this terminal 400 includes a voice call unit 101b and a data communication unit 102b. The data communication unit 102b includes a time management unit 103, an instruction signal generation unit 104, a reproduction time information addition unit 105, a data transmission unit 106, a data reception unit 107, a reproduction data generation unit 108, and reproduction time information extraction. Unit 109 and a data reproduction unit 110 are provided. The voice call unit 101b has both functions of the voice call unit 101 and the voice call unit 101a. The data communication unit 102b has both functions of a data communication unit 102 for data transmission and a data communication unit 102a for data reception.

  Here, the hardware configuration of the terminal 100 will be described with reference to FIG. FIG. 4 is a hardware configuration diagram of the terminal 100. As shown in FIG. 4, the terminal 100 physically includes one or more CPUs (Central Processing Units) 21, a RAM (Random Access Memory) 22 and a ROM (Read Only Memory) 23 that are main storage devices, Hardware such as a communication module 26 that is a data transmission / reception device, an auxiliary storage device 27 such as a semiconductor memory, an input device 28 that accepts user input such as an operation panel (including operation buttons) and a touch panel, and an output device 29 such as a display. It can comprise as a computer provided with. Each function of the terminal 100 in FIG. 2 includes, for example, reading one or a plurality of predetermined computer software on hardware such as the CPU 21 and the RAM 22, thereby controlling the communication module 26, the input device 28, This can be realized by operating the output device 29 and reading and writing data in the RAM 22 and the auxiliary storage device 27. Note that the terminal 200 can have the same hardware configuration as the terminal 100.

  Next, with reference to FIG. 5, a call method executed by the terminal 100 and the terminal 200 of the present embodiment will be described. FIG. 5 is a flowchart illustrating an example of processing executed in the terminal 100 and the terminal 200. The process of this flowchart is executed during a call between the user 1 (FIG. 1) using the terminal 100 and the user 2 using the terminal 200.

  In the example shown in FIG. 5, the terminal 100 is a calling side terminal for a voice call, and the terminal 200 is a called side terminal for a voice call. In addition, an instruction signal for reproducing external sound is transmitted from terminal 100 to terminal 200, and content corresponding to the instruction signal is reproduced by terminal 200. Needless to say, the terminal 100 and the terminal 200 of the present embodiment are not limited to this combination, and the terminal 200 may be a calling terminal of a voice call and the terminal 100 may be a called terminal of a voice call. Good. In addition, an instruction signal for reproducing external sound may be transmitted from terminal 200 to terminal 100, and content corresponding to the instruction signal may be reproduced by terminal 100.

  In the example illustrated in FIG. 5, the processing flow of S101 to S108 is executed in the terminal 100, and the processing flow of S201 to S211 is executed in the terminal 200.

  First, in the terminal 100, the voice call unit 101 makes a voice call to the terminal 200 (step S101), and in the terminal 200, the voice call unit 101a makes an incoming call (step S201).

  Next, the voice call unit 101a of the terminal 200 responds to the incoming call of the voice call by the operation of the user 2 (step S202). Then, a voice call is started (step S203).

  Furthermore, in the terminal 100, the voice call unit 101 detects that the user 2 has responded to the incoming call of the voice call (step S102), and the voice call is started (step S103).

  In the terminal 100, the time management unit 103 sets the timing at which it is detected that the user 2 has responded to the incoming voice call as the reference time (step S104). Specifically, time T is set to 0 in time management unit 103 of terminal 100. Note that the order of step S103 and step S104 may be reversed.

  At this time, the time management unit 103a of the terminal 200 sets, as a reference time, a timing at which the user waits for a predetermined time D1 (step S204) from the time when the incoming voice call is answered. Specifically, the current time T is set to 0 in the time management unit 103a of the terminal 200. Note that the reference time may be set without waiting for the predetermined time D1 from the time when the incoming voice call is answered. In this case, the reproduction designated time T1 included in the transmission data C2 from the terminal 100 is set as T1 + D1. The subsequent processing may be performed. Note that the order of step S203 may be after step S204 or after step S205.

  Subsequently, a data transmission instruction C1 is input to the terminal 100 by the operation of the user 1 (step S105). The terminal 100 obtains the reproduction designated time T1 when the data transmission instruction C1 is input from the time management unit 103, and adds the reproduction designated time T1 to the instruction signal for reproducing the content corresponding to the data transmission instruction C1 to generate transmission data C2. And it transmits to the terminal 200 (step S106).

  Note that the content corresponding to the data transmission instruction C1 may be played on the terminal 100 at the timing of step S106. Thereby, the user 1 can listen to the content corresponding to the data transmission instruction C1 by himself / herself.

  In terminal 200, data receiving unit 107 receives transmission data C2 transmitted from terminal 100 (step S206). In terminal 200, reproduction time information extraction section 109 extracts reproduction designation time T1 included in the transmission data, and adds predetermined time D2 to current time T obtained from time management section 103a of terminal 200 and reproduction designation time T1. The added reproduction time T1 + D2 is compared (step S207).

  When the current time T managed by the time management unit 103a of the terminal 200 is before the reproduction time T1 + D2 (step S207: Y), the data reproduction unit 110 of the terminal 200 waits until the reproduction time T1 + D2 (step S208), and the transmission data The content corresponding to the instruction signal included in C2 is reproduced (step S209).

  When the current time T of the terminal 200 is after the reproduction time T1 + D2 (step S207: N), the terminal 200 compares the current time T with the adjustment time T1 + D2 + D3 obtained by adding the predetermined time D2 + D3 to the reproduction designated time T1 (step S210). ).

  When the current time T managed by the time management unit 103a of the terminal 200 is earlier than the time T1 + D2 + D3 (step S210: Y), the data reproduction unit 110 of the terminal 200 reproduces content corresponding to the instruction signal included in the transmission data C2. (Step S209).

  When the current time T of the terminal 200 is after the time T1 + D2 + D3 (step S210: N), the data receiving unit 107 of the terminal 200 transmits an error notification to the terminal 100 (step S211). At this time, if there is content being played back on the terminal 200, the playback of the content may be stopped in order to synchronize with the content playback state of the terminal 100.

  If the terminal 100 receives an error notification from the terminal 200 after transmitting the transmission data C2 (step S107: Y), the terminal 100 notifies the user 1 of the error (S108) and returns to the state before step S105 is performed. At this time, if there is content being played back on the terminal 100, the playback of the content may be stopped in order to synchronize with the content playback state of the terminal 200.

  If the terminal 100 does not receive an error notification from the terminal 200 after transmitting the transmission data C2 (step S107: N), the terminal 100 returns to the state before step S105 is performed.

  If the terminal 200 does not make the determination in step S210, the processes in steps S210, S211, S107, and S108 are not necessary. When the current time T of the terminal 200 is after the time T1 + D2 (step S207: N), the content is reproduced (step S209).

  In the flow of FIG. 4, when terminal 200 is a calling side terminal for voice call and terminal 100 is a called side terminal for voice call, the positions of steps S101 to S104 and steps S201 to S205 are interchanged. Operate. Further, when an instruction signal for reproducing an external sound is transmitted from the terminal 200 to the terminal 100, the operation is performed such that the positions of steps S105 to S108 and steps S206 to S211 are interchanged.

  In this way, the call between the user 1 and the user 2 is advanced by repeatedly executing the processing of the flowchart of FIG.

  Next, the effect of the terminal 100 will be described with reference to FIGS. In terminal 100, voice call unit 101 starts a voice call in accordance with a voice call origination (step S301) and a voice call response detection (step S302). On the other hand, in terminal 200, voice call unit 101a makes a voice call according to the incoming call (step S301) and the response (step S302).

  Then, the time management unit 103 of the terminal 100 sets the reference time (step S303), and the time management unit 103a of the terminal 200 waits for the predetermined time D1 and sets the reference time (step S304). In this way, by acquiring the current time using the time when the call line is connected, such as the start of a voice call, as the reference time, the current time is adjusted to the time when the call is started at both the transmitting and receiving terminals. It is possible to easily set a reference time common to the terminal 100 which is a transmission side terminal.

  Then, the terminal 100 and the terminal 200 make a voice call using the voice call units 101 and 101a, respectively (S305). Thereafter, the instruction signal generation unit 104 of the terminal 100 receives the input of the data transmission instruction (step S105), generates an instruction signal, and the reproduction time information adding unit 105 adds the reproduction designated time T1 to the data including the instruction signal. Then, the data transmission unit 106 transmits the data of the instruction signal given the time T1 (step S306).

  On the other hand, in the terminal 200, the data receiving unit 107 receives the data of the instruction signal given the reproduction designated time T1 (S306), and acquires the data generated by the reproduction data generating unit 108 from the time management unit 103. Reproduction is performed at the reproduction timing adjusted based on the current time T and the predetermined times D1 and D2 that have been made and the reproduction designated time T1 extracted by the reproduction time information extraction unit 109 (S307).

  In the example of FIG. 7, since the external sound instruction signal is received by the terminal 200 before time T1 + D2, the data reproduction unit 110 reproduces the external sound until time T1 + D2. As described above, the reproduction process can be performed at the timing in consideration of the predetermined time D2 indicating the delay of the voice call, and the reproduction process based on the timing intended by the user on the transmission side can be performed.

  In the following situations, the necessity of matching the reproduction timing becomes particularly significant. For example, when you are talking, (1) Send “Correct!” And immediately send “Ping Pong ♪” with a sound effect, or (2) Send “Why is it!” For example, when sending “bash (punch sound) ♪”, (3) “Happy Birthday!” Is sent by voice and immediately “buzzy crackling (applause sound) ♪” is sent.

  In such a case, if neither the sound nor the external sound (sound effect in this case) is reproduced at the timing intended by the user on the transmission side, a strange interval may be created and the effect of the production is impaired. The problem arises. In the communication system of the present embodiment, it is possible to realize an effective presentation without such a strange time.

  In the example of FIG. 8, it is indicated that the instruction signal of the external sound is received at the terminal 200 after the time T1 + D2 and before the time T1 + D2 + D3 (S306a). In this case, the data reproducing unit 110 reproduces the external sound immediately.

  On the other hand, in the example of FIG. 9, the external sound instruction signal indicates that it has been received at the terminal 200 after the time T1 + D2 has elapsed and further after the time T1 + D2 + D3 has elapsed (S306b, S306b). In this case, the terminal 200 sends an error notification to the terminal 100 (S308). When receiving an error notification from the terminal 200, the terminal 100 displays an error on a display unit (not shown) on the screen.

  As a result, the terminal 100, which is the communication apparatus according to the present embodiment, reproduces data by the terminal 200, which is the receiving terminal, on the basis of the timing intended by the transmitting user, without being affected by the variation in the delay of the voice call. can do. Also, when the voice call delay is unexpectedly sent, an error notification is performed so that the external sound is not reproduced in a shifted state.

  Further, the terminal 100 and the terminal 200 of the present embodiment are not limited to the above-described embodiments. A configuration in which the features included in the respective embodiments and processing steps included in the embodiment are appropriately combined can also be used as the embodiment of the present invention.

  Further, the terminal 100 and the terminal 200 of the present embodiment are not limited to application to voice calls and telephone terminals, and perform first data communication and second data communication using two different lines. In the system, it can be used for adjusting the reproduction timing of received data.

DESCRIPTION OF SYMBOLS 100 ... Terminal, 101, 101a ... Voice call part, 102, 102a ... Data communication part, 103, 103a ... Time management part, 104 ... Instruction signal generation part, 105 ... Reproduction time information provision part, 106 ... Data transmission part, 107 ... Data receiving section, 108 ... Reproduction data generation section, 109 ... Reproduction time information extraction section, 110 ... Data reproduction section, 200 ... Terminal, 300 ... Server.

Claims (6)

Time management means for managing a reference time common to a transmission side terminal that issues a reproduction instruction for reproduction;
An acquisition means for acquiring a reproduction designated time of the reproduction target transmitted from the transmission side terminal;
Data reproduction means for performing reproduction processing of the reproduction target instructed from the transmission side terminal based on the reproduction designated time acquired by the acquisition means and the reference time managed by the time management means;
A communication device comprising: Get the current time using the time when the call line is connected as the reference time,
The communication apparatus according to claim 1. The data reproducing means includes
The communication apparatus according to claim 2, wherein a reproduction process is performed at a reproduction time obtained by adding a delay time in a predetermined voice call to the reproduction designated time. The data reproducing means includes
If the current time is earlier than the playback time, playback when the current time reaches the playback time,
The communication apparatus according to claim 3. The data reproducing means includes
When the current time is later than the reproduction time and the current time is later than the adjustment time obtained by adding a predetermined time to the reproduction time, the reproduction process is not performed.
When the current time is later than the reproduction time and the current time is earlier than the adjustment time, a reproduction process is performed.
The communication apparatus according to claim 4. Time management means for managing a reference time common to the receiving terminal;
Generating means for generating an instruction signal instructing a reproduction target to be reproduced in the receiving terminal;
Transmitting means for transmitting, together with the instruction signal, a reproduction designated time that designates a time at which the reproduction object is reproduced at the receiving terminal that reproduces the reproduction object;
A communication device comprising:

Images