JP4425172B2 - Call device, call system, and program - Google Patents

Description

The present invention relates to a call device , a call system, and a program , and more specifically, when a two-way voice call is made via a network such as a telephone communication, a voice of a speaker and a surrounding sound handled in a normal voice call. Conversation device that communicates while simultaneously outputting multiple voices, such as voice of video files on the network and content voice that means the sound of content such as programs recorded on a video deck on the network. The present invention relates to a system and a program .

2. Description of the Related Art Conventionally, there is known a technique for controlling the volume of a call device of a call partner so that the other party (call partner) can hear his / her voice. For example, in Patent Document 1, the current vehicle location information, registered vehicle, etc. are installed in a vehicle such as an automobile and the center that has jurisdiction over the emergency call system such as the police or emergency call center in an emergency such as a traffic accident or sudden illness. An emergency call system that controls the volume level of an audio signal from a center that has jurisdiction over the emergency call system has been disclosed, particularly in a hands-free voice call during emergency call notification, regarding an emergency call system terminal device that transmits data . By using this technique, it is possible to reliably sound the voice received from the emergency call center by controlling the volume level of the hands-free call at the time of emergency call to be a certain level or higher.
Japanese Patent Laid-Open No. 2000-222626

  However, in order to ensure that the conversation voice is heard by the other party in a situation where voice communication is performed while simultaneously outputting a plurality of voices such as the conversation voice and the content voice, the volume level of the conversation voice is constant at the other party's call device. It is not sufficient to control only the above.

  FIG. 30 is a conceptual diagram for explaining a situation in which voice communication is performed while simultaneously outputting a plurality of voices such as conversation voices and content voices in a conventional system. In the figure, reference numeral 501a denotes information on a telephone device at Mr. A's house. A processing terminal, 501b is an information processing terminal that is a call device at Mr. B's house, 502 is a network, and 503 is a content server that can provide various contents. In this example, conversation is performed while the video content of the athletic meet is played on both voice communication terminals (information processing terminal 501a and information processing terminal 501b). That is, the information processing terminal 501a outputs the voice “Wow” of the video content of the athletic meet and the conversation voice “good” of the other party (Mr. B who is the user of the information processing terminal 501b). In addition, the information processing terminal 501b outputs the voice “Wow” of the video content of the athletic meet and the conversation voice “I enjoyed the athletic meet” of the other party (Mr. A who is the user of the information processing terminal 501a).

  In such a situation, when you want to make sure that the other party hears the conversation, simply having a function that can control the volume level of the conversational sound output by the other party to be above a certain level will ensure the conversation. Is not always heard by the other party. Details thereof will be described with reference to FIG. 31 below.

  FIG. 31 is a diagram for explaining problems that occur in the conventional system shown in FIG. First, suppose that Mr. A raises the volume level of the conversational sound produced by Mr. B in order to ensure that the conversation is spoken to the other party, the conversational voice “It was fun at the athletic meet” that is output from the information processing terminal 501b. The volume increases. However, suppose that Mr. B adjusts the volume level of the audio of the video content to be equal to or higher than the volume level of the conversational audio at that time. In this case, the volume of the voice “Wow” of the video content output from the information processing terminal 501b is set to be equal to or higher than the volume of the conversation voice “I enjoyed the athletic meet”, so Mr. B has the conversation voice. Is drowned out by the content sound, and Mr. B cannot fully hear the conversation sound. In other words, unlike Mr. A's intention, there is a problem that Mr. B cannot be spoken and a poor communication is caused.

The present invention has been made in view of the above circumstances, and even in a situation where voice communication is performed while simultaneously outputting a plurality of voices such as a conversation voice and a content voice, the partner ( The object is to provide a call device, a call system, and a program that give priority to the output of conversational sound or content sound on the receiver side and can reliably hear either one of the other party 's sounds. .

For example , if you want to give the conversation voice priority to the other party, you can operate from your own (sending) side, and the sound level setting on the other party (receiving) side will be changed and the conversation voice will be given priority. And a means for prohibiting or limiting the adjustment of the sound output level setting by the other party's operation.

In order to solve the above-described problem, the first technical means of the present invention is a call device capable of making a call including a conversation voice with another call device and simultaneously viewing a content including the sound. The call device further includes means for transmitting to the other call device sound output level setting change instruction information for setting the sound output with priority given to either the conversation voice or the content sound in the other call device. provided, when the speech loudness level of the communication device exceeds a predetermined amount, is from the communication device that features that you send the sound output level setting change instruction information to the other communication device.
The communication device described here includes at least voice communication. However, video communication may be performed together with voice communication in the same manner as a normal videophone, and various forms such as a fixed phone, a videophone, a mobile phone, and a PC are considered. It is done.

The second technical means is a call device capable of making a call including a conversation voice with another call device and simultaneously viewing a content including the sound, wherein the call device includes the other call device. Means for transmitting sound output level setting change instruction information for setting sound output by giving priority to either conversational sound or content sound at the device, and setting sound output of the other call device Is characterized by changing the setting of the echo canceller.

A third technical means is a call device capable of making a call including a conversation voice with another call device and simultaneously viewing a content including the sound, wherein the call device includes the other call device. Means for transmitting sound output level setting change instruction information for setting sound output by giving priority to either conversational sound or content sound at the device, and setting sound output of the other call device Is characterized in that the volume of the conversation audio is increased and the volume of the content audio is decreased.

A fourth technical means is a call device capable of making a call including a conversation voice with another call device and simultaneously viewing a content including the sound, wherein the call device includes the other call device. Means for transmitting sound output level setting change instruction information for setting sound output by giving priority to either conversational sound or content sound at the device, and setting sound output of the other call device Is characterized by sound output from different speakers.

According to a fifth technical means, in any one of the first to fourth technical means, the call device operates the other call device for a predetermined time after changing the sound output setting of the other call device. It is characterized by prohibiting or restricting the change of the sound output setting by.

A sixth technical means is any one of the first to fifth technical means, in which, when the call device changes the sound output setting of the other call device, The sound output setting is changed.

A seventh technical means is a call device capable of making a call including a conversation voice with another call device and simultaneously viewing a content including the sound, wherein the call device is connected to the call device. Means for receiving sound output level setting change instruction information for setting sound output by giving priority to either conversational sound or content sound from the other call device, and according to the received sound level setting change instruction information The setting of the echo canceller is changed as the sound output setting of the communication device .

The eighth technical means is a call device capable of making a call including a conversation voice with another call device and allowing the content including the sound to be synchronized and viewed, wherein the call device is connected to the call device. Means for receiving sound output level setting change instruction information for setting sound output by giving priority to either conversational sound or content sound from the other call device, and according to the received sound level setting change instruction information as sound output setting of the communication devices, to increase the volume of the conversation voice, is obtained by said lowering the sound volume of content sound.

A ninth technical means is a call device capable of making a call including a conversation voice with another call device and simultaneously viewing a content including the sound, wherein the call device is connected to the call device. Means for receiving sound output level setting change instruction information for setting sound output by giving priority to either conversational sound or content sound from the other call device, and according to the received sound level setting change instruction information As a sound output setting of the call device, sound is output from different speakers.

According to a tenth technical means, in any one of the seventh to ninth technical means, the call device changes the sound output setting of the call device, and then sets the sound output by operating the call device for a predetermined time. It is characterized by prohibiting or restricting the change of

In an eleventh technical means according to any one of the seventh to ninth technical means, when the communication device receives the sound output level setting change instruction information from the other communication device, the sound output level setting is performed. The sound output setting instruction based on the change instruction information is invalidated, and the sound output setting of the call device is not changed.

A twelfth technical means is a call device capable of making a call including a conversation voice with another call device and simultaneously viewing a content including the sound, wherein the call device includes the other call device. Means for transmitting to the other call device a mixed sound obtained by mixing the conversation sound and the content sound in accordance with the mixed volume ratio information received from the device, and giving priority to either the conversation sound or the content sound in the other call device. Means for changing a mixed sound volume ratio of the mixed sound to be transmitted to the other call device so as to make a sound, and when the conversation volume level of the call device exceeds a certain amount, it is obtained by the features that you change the mixing volume ratio of the mixed sound to be transmitted.

In a thirteenth technical means according to any one of the twelfth technical means, the call device raises the volume of the conversational sound as a mixed sound volume ratio of the mixed sound transmitted to the other call device, It is characterized by lowering the volume.

In a fourteenth technical means according to any one of the twelfth and thirteenth technical means, the communication device changes the mixed sound volume ratio of the mixed sound to be transmitted to the other communication device, and then the other device for a predetermined time. The change of the mixed sound volume ratio by the operation of the communication device is prohibited or restricted.

According to a fifteenth technical means, in any one of the twelfth to fourteenth technical means, when the communication device changes a mixed sound volume ratio of mixed sound to be transmitted to the other communication device, it is interlocked with this. Thus, the sound output setting is changed so that priority is given to either the conversation sound or the content sound in the call device.

The sixteenth technical means is a call system comprising the call device according to any one of the first to fifteenth technical means and another call device.

The seventeenth technical means is a program for executing a function as a communication device in any one of the first to fifteenth technical means.

According to the present invention, even in a situation where voice communication is performed while simultaneously outputting a plurality of voices such as a conversation voice and a content voice, the conversation voice or content of the user (sending side) can be sent to the other party (receiving side) at an arbitrary timing. The voice can be heard clearly.
Specifically, by operating from the sending side, the other party (receiving side) can increase the volume level of the conversational voice to make it easier to hear the conversational voice, or conversely, by lowering the volume level of the content voice. It makes it easy to hear the speech, and further makes it easy to hear the speech by lowering the volume level of the content sound while raising the volume level of the conversation sound. In addition, the content sound and the conversation sound can be easily distinguished from each other by outputting the content sound and the conversation sound through different channels using a stereo speaker.

Example 1
An example of the operation of the communication device of the present invention will be specifically described with reference to the following embodiments.
FIG. 1 is a conceptual diagram for explaining an example of a situation in which voice communication is performed while simultaneously outputting a plurality of voices such as conversation voices and content voices in an information processing system to which the present invention is applied. In FIG. An information processing terminal that is a home call device, 101b is an information processing terminal that is a call device at Mr. B's home, 102 is a network, and 103 is a content server that can provide content.

  In FIG. 1, first, suppose that Mr. A does not perform an operation for preferentially listening to Mr. B, but has a normal conversation. In this case, Mr. B can arbitrarily change the sound level setting of his terminal. Here, it is assumed that Mr. A operates the information processing terminal 101a with a remote controller or the like in order to give the conversation voice priority to the other party. In this case, the information processing terminal 101b at Mr. B's house is changed to a setting in which conversation voice (in this example, “It was athletic meet was fun”) is preferentially output, and at the same time, Mr. B has his information processing terminal 101b. The sound output level setting cannot be changed. That is, during this time, regardless of Mr. B's operation, Mr. B can be surely heard the conversation voice from Mr. A, “I enjoyed the athletic meet”.

  Then, it is assumed that Mr. A operates the information processing terminal 101a with a remote controller or the like so as to stop the conversation voice from being given priority to the other party (Mr. B). In this case, the information processing terminal 101b at Mr. B's home returns to the setting immediately before the conversation voice is output with priority, and at the same time, Mr. B can change the sound output level setting of his / her information processing terminal 101b. Become.

  In the information processing (calling) system of the present embodiment, content on the network 102 such as an athletic meet video file stored on the WWW (World Wide Web) server on the network 102, that is, the content server 103 is transferred to Mr. A's house. The information processing terminal 101a and the information processing terminal 101b at Mr. B's house can synchronously output, and at the same time, conversation between Mr. A and Mr. B can be enjoyed. In other words, the information processing system including the information processing terminal according to the present embodiment is configured to realize communication with a sense of connection more than ever since the user can talk while sharing content. The synchronous output here indicates that the content is played back at the same timing in Mr. A's house and Mr. B's house, and the same timing does not have to be completely coincident with the communication network. Some timing discrepancies are allowed due to delays.

  FIG. 2 is a diagram for explaining a schematic configuration example of the information processing system according to the first embodiment. The information processing system according to this embodiment includes an information processing terminal 101 a (A's house), an information processing terminal 101 b (B's house), and a content server 103 connected via a network 102. Here, for example, it is assumed that the information processing terminal 101a is a video phone operated by Mr. A, and the information processing terminal 101b is a video phone operated by Mr. B. The content server 103 is assumed to be a WWW server that holds content, and distributes the designated content to the information processing terminal 101a and the information processing terminal 101b simultaneously as stream data.

  The information processing terminal 101a transmits the conversation voice 11a of Mr. A to the information processing terminal 101b, and the content voice 13a received from the content server 103 via the network 102 and the conversation voice 12a of Mr. B received from the information processing terminal 101b. Are mixed and output as a mixed sound 14a. Similarly, the information processing terminal 101b transmits Mr. B's conversation voice 12b to the information processing terminal 101a, and the content voice 13b received from the content server 103 via the network 102 and Mr. A's received from the information processing terminal 101a. The conversation voice 11b is mixed and output as a mixed voice 14b. In the information processing system of this embodiment, video communication is performed together with voice communication in the same manner as a normal videophone. However, since the present invention is related to voice communication, description regarding video communication is omitted.

  FIG. 3 is a block diagram illustrating a configuration example of the information processing terminal 101a according to the first embodiment. The information processing terminal 101a includes the communication unit 110, the conversation voice input unit 111, the voice output unit 112, the conversation voice transmission unit 113, and the conversation voice. The receiving unit 114, the content audio receiving unit 115, the output sound mixing unit 116, the mixed sound volume change input unit 117, the mode change input unit 118, the mode change transmission unit 119, the mode change receiving unit 120, and the sound output control unit 121 are configured. Is done. Note that the information processing terminal 101a and the information processing terminal 101b have the same configuration. Hereinafter, the information processing terminal 101a or the information processing terminal 101b is often referred to as the information processing terminal 101.

  The communication unit 110 is means for performing wired communication or wireless communication with an information processing terminal (information processing terminal 101b) or a content server 103 as a communication partner via the network 102. For example, a network card or a LAN (Local Area Network) connection terminal Etc.

  The conversation voice input unit 111 is a means for generating a conversation voice by converting a voice uttered by Mr. A and surrounding sounds into an electric signal, and is specifically a voice input device such as a microphone. The audio output unit 112 is a unit that outputs mixed audio, which is an electric signal obtained by mixing the conversation audio of Mr. B who is a communication partner and content audio, and is specifically an audio output device such as a speaker. The conversation voice transmission unit 113 is means for transmitting the conversation voice transmitted from the conversation voice input unit 111 to the network 102 via the communication unit 110.

  The conversation voice receiving unit 114 is means for receiving conversation voice from the information processing terminal 101 b via the network 102. The content audio receiving unit 115 is means for receiving content audio from the content server 103 via the network 102.

  The output sound mixing unit 116 sets and mixes the volume of the conversation sound received by the conversation sound receiving unit 114 and the content sound received by the content sound receiving unit 115 based on the determined mixed volume information. Generate mixed speech. In the mixed volume information, for example, the volume ratio between the conversational sound and the content sound is designated in a form such as “7: 3”. In that case, the output sound mixing unit 116 sets and mixes the ratio of the volume of the conversational sound and the volume of the content sound to be 7: 3. Note that the reference unit necessary for calculating the ratio may be anything such as a scale of a TV volume level or an acoustic sound unit such as dB. Further, the mixed sound volume information does not necessarily have to be a ratio, and may be in a format that specifies each absolute sound volume.

  The mixed volume change input unit 117 is a means that is operated when Mr. A changes the mixed volume information of the sound output from the information processing terminal 101a, and generates a mixed volume change signal corresponding to Mr. A's operation. Specifically, it is an operation device such as a remote controller.

  The mode change input unit 118 is a means to be operated when Mr. A switches the mode of the information processing terminal 101b of Mr. B who is a communication partner, and a mode change signal corresponding to Mr. A's operation (that is, the output of the present invention). Sound level setting change instruction information). Specifically, it is an operation device such as a remote controller. Note that there are two types of modes, for example, a normal mode in which a conversation is performed with a normal sound output level setting, and a conversation priority sound output mode in which a conversation sound is preferentially output. When the mode change signal is the conversation priority sound output mode, the sound output level setting of the information processing terminal 101b of Mr. B who is the communication partner is forcibly changed from here (Mr. A side). This effect is considered to be temporary. For example, a mode button 1016 is provided on the remote controller 1013, which will be described later in FIG. 28, and is effective only while Mr. A continues to press a predetermined operation key on the remote control, or for a predetermined time after the operation key on the remote control is pressed. A method of making it effective only (for example, for 10 seconds) can be considered. An example in which the mode button 1016 is mounted on the remote controller 1013 will be described in detail with reference to FIG.

  The mode change transmission unit 119 is a means for transmitting the mode change signal transmitted from the mode change input unit 118 to the network 102 via the communication unit 110. When the transmitted mode change signal is in the conversation priority sound output mode, the information processing terminal 101b changes the setting so that the conversation sound is preferentially output, and at the same time, the operation of Mr. B makes the output of the information processing terminal 101b. Changing the sound level setting is prohibited or restricted.

  Here, after the information processing terminal 101a transmits the mode change signal (sound output level setting change instruction information) to the information processing terminal 101b, the sound output level setting change end for releasing the sound output level setting change instruction is completed. During the period until the instruction information is transmitted, the change of the sound output level setting by the information processing terminal 101b may be prohibited or restricted. The sound output level setting change end instruction information is a mode release signal for canceling the sound output level setting change instruction to the information processing terminal 101b instructed to change the sound output level setting by the mode change signal. 101a.

  For example, an operation key for transmitting a mode change signal is provided to a remote controller for operating the information processing terminal 101a, and when the user of the information processing terminal 101a presses the operation key, the mode change signal is transmitted to the information processing terminal 101b. (The conversation priority sound output mode is valid), and when the user stops pressing the operation key, a mode release signal may be transmitted to the information processing terminal 101b.

  Further, when a user of the information processing terminal 101a presses an operation key, a mode change signal is transmitted to the information processing terminal 101b, and after a predetermined time (for example, 10 seconds) has elapsed since the mode change signal was transmitted. A mode release signal may be transmitted to the information processing terminal 101b. The information processing terminal 101b that has received the mode release signal can perform the sound output level setting operation, and the sound output level setting immediately before the sound output level setting is prohibited or restricted, that is, before setting the priority sound output level of the conversational sound. You may make it return to the sound output level setting.

Further, as a method different from the above method, the sound output level by the information processing terminal 101b for a certain period of time after the information processing terminal 101a transmits a mode change signal (sound output level setting change instruction information) to the information processing terminal 101b. Changing the setting may be prohibited or restricted. In this case, the sound output level setting change end instruction information is not required, and the information processing terminal 101b can perform the sound output level setting operation after a certain time has elapsed after receiving the sound output level setting change instruction information. At this time, the sound output level setting immediately before prohibition or restriction of the sound output level setting, that is, the sound output level setting before setting the priority sound output level of the conversation voice may be restored.

  The mode change receiving unit 120 is a means for receiving a mode change signal from the information processing terminal 101b from the network 102 via the communication unit 110. At this time, if the received mode change signal is in the conversation priority sound output mode, the information processing terminal 101a changes the setting so that the conversation sound is preferentially output, and at the same time, the information processing terminal is operated by Mr. A's operation. Changing the sound output level setting of 101a is prohibited or restricted.

  The sound output control unit 121 is a unit that receives the mixed volume change signal of the information processing terminal 101a and the mode change signal received from the information processing terminal 101b, and determines and holds mixed volume information based thereon.

  FIG. 4 is a block diagram illustrating a detailed configuration example of the sound output control unit 121. The sound output control unit 121 includes a mixed sound volume control unit 121a, a mixed sound volume information holding unit 121b, a mode information holding unit 121c, and an original set mixed sound volume. The information holding unit 121d and the conversation priority mixed sound volume information holding unit 121e are configured.

  The mixed volume control unit 121a receives the mixed volume change signal 123 of the information processing terminal 101a and the mode change signal 124 received from the information processing terminal 101b, determines the mixed volume information 122 based thereon, and the mixed volume information holding unit Means for writing to 121b. At this time, the mixed volume control unit 121a holds four pieces of information, a mixed volume information holding unit 121b, a mode information holding unit 121c, an original set mixed volume information holding unit 121d, and a conversation priority mixed volume information holding unit 121e as necessary. The information is written into the unit or the information is read from the four information holding units.

  The mixed volume information holding unit 121b holds mixed volume information. The mode information holding unit 121c holds mode information indicating whether the mode is the conversation priority sound output mode or the normal mode. The original set mixed volume information holding unit 121d holds mixed volume information set when the conversation priority sound output mode is changed to the normal mode. The mixed sound volume information at this time is a sound output level setting immediately before the conversation priority sound output mode is entered. The conversation priority mixed sound volume holding unit 121e holds mixed sound volume information set in the case of the conversation priority sound output mode. The mixed sound volume information may be determined in advance or may be specified from the information processing terminal 101b.

An operation example of the information processing terminal 101a in the first embodiment will be described with reference to a flowchart shown below. In addition, although demonstrated centering on the information processing terminal 101a, the operation | movement of the information processing terminal 101b is also the same.
(Voice call)
FIG. 5 is a flowchart for explaining an example of the voice call process of the information processing terminal 101a according to the first embodiment. In addition, this example shall be demonstrated based on the structure shown in FIG.3 and FIG.4. In addition, although the transmission process and the reception process are actually performed at the same time, each process is shown separately for explanation.

  In the transmission process shown in FIG. 5A, first, the information processing terminal 101a captures Mr. A's conversation voice by the conversation voice input unit 111 (step S1), and the captured conversation voice is transmitted to the network 102 via the communication unit 110. (Step S2). On the other hand, in the reception process shown in FIG. 5B, the information processing terminal 101a receives Mr. B's conversation voice from the network 102 via the communication unit 110, and simultaneously receives the content voice (step S3). Subsequently, in order to mix these two sounds, the sound output sound mixing unit 116 reads the mixed sound volume information from the mixed sound volume information holding unit 121b (step S4), and mixes the conversation sound and the content sound based on the ratio. The mixed sound is generated (step S5), and the generated mixed sound is output from the sound output unit 112 (step S6). It is assumed that the transmission process of steps S1 to S2 and the reception process of steps S3 to S6 are executed simultaneously.

(Mixed volume change)
FIG. 6 is a flowchart for explaining an example of the mixed sound volume changing process for the sound output from the information processing terminal 101a according to the first embodiment. In addition, this example shall be demonstrated based on the structure shown in FIG.3 and FIG.4. First, the information processing terminal 101a converts the signal input by the operation performed by Mr. A to change the mixed volume into the mixed volume change signal 123 through the mixed volume change input unit 117 (step S11). A volume change signal 123 is input to the mixed volume control unit 121a. Next, the mixed sound volume control unit 121a reads the current mode information from the mode information holding unit 121c, and checks whether it is the conversation priority sound output mode or the normal mode (step S12).

  Next, in step S12, the mixed volume control unit 121a writes the mixed volume information 122 based on the mixed volume change signal 123 to the mixed volume information holding unit 121b in the normal mode (in the case of the normal mode in the figure). Then, the mixed sound volume information 122 is changed (step S14), and the result is displayed (step S15). On the other hand, if it is the conversation priority sound output mode in step S12 (in the case of the conversation priority sound output mode in the figure), the mixed sound volume information 122 is not changed and the result is displayed (step S13).

  Here, as shown in FIG. 7, in the normal mode, if the mixed sound volume of the sound output from the information processing terminal 101a can be changed, information for informing the user that the change has been made is displayed on the screen of the information processing terminal 101a. To display. The information processing terminal 101a of this example displays “changed conversation X: content Y”. Note that the conversation X: content Y indicates that the volume ratio of the conversation voice and the content voice is X: Y. On the other hand, in the conversation priority sound output mode, if the mixed sound volume of the sound output from the information processing terminal 101a cannot be changed, information for notifying the user that it cannot be changed is displayed on the screen of the information processing terminal 101a. indicate. The information processing terminal 101a of the present example displays “Unchangeable conversation priority sound output”.

(Conversation priority transmission)
FIG. 8 is a flowchart for explaining an operation example when the information processing terminal 101a performs a mode change operation on the information processing terminal 101b in the first embodiment. In addition, this example is demonstrated based on the structure shown in FIG.3 and FIG.4. First, the information processing terminal 101a converts a signal input by an operation performed by Mr. A to change the mode of the information processing terminal 101b into a mode change signal through the mode change input unit 118 (step S21). The change signal is transmitted to the network 102 via the communication unit 110 by the mode change transmission unit 119 (step S22).

  Next, the information processing terminal 101a checks whether the transmitted mode change signal is the normal mode or the conversation priority sound output mode (step S23), and in the case of the conversation priority sound output mode (in the case of the conversation priority sound output mode in the figure). ) And display the result (step S24). On the other hand, in step S23, in the normal mode (in the figure, in the normal mode), the result is displayed (step S25). FIG. 9 shows a display example of the transmission results in steps S24 and S25. In this way, information for notifying whether the transmitted mode change signal is the conversation priority sound output mode or the normal mode is displayed on the screen of the information processing terminal 101a and is transmitted to the user.

  In the screen example shown in FIG. 9, when the conversation priority sound output mode is transmitted, the information processing terminal 101a displays “conversation priority transmission” on the screen, and when the normal mode is transmitted, “Release transmission” is displayed.

(Conversation priority reception)
FIG. 10 is a flowchart for explaining an operation example when the information processing terminal 101a receives a mode change operation from the information processing terminal 101b in the first embodiment. In addition, this example is demonstrated based on the structure shown in FIG.3 and FIG.4. First, the information processing terminal 101a receives the mode change signal 124 from the information processing terminal 101b by the mode change receiving unit 120 and transmits it to the mixed sound volume control unit 121a (step S31). Subsequently, the mixed sound volume control unit 121a checks whether the mode change signal 124 is the conversation priority sound output mode or the normal mode (step S32). If the mode change signal 124 is the conversation priority sound output mode (in the figure, the conversation priority sound output mode). ), The mixed sound volume control unit 121a writes the conversation priority sound output mode as mode information to the mode information holding unit 121c (step S33). Next, in order to hold the original mixed sound volume information, the current mixed sound volume information is read from the mixed sound volume information holding unit 121b and written to the original mixed sound volume information holding unit 121d (step S34). The sound output level setting for the conversation priority sound output mode is read from the mixed sound volume information holding unit 121e and written to the mixed sound volume information holding unit 121b (step S35). Finally, information indicating which mode is received is displayed on the screen (step S36).

  On the other hand, when the mode change signal 124 is in the normal mode in the step S32 (in the case of the normal mode in the figure), the mixed sound volume control unit 121a writes the normal mode as the mode information in the mode information holding unit 121c (step S37). . Next, in order to return to the original mixed sound volume, the mixed sound volume information is read from the original mixed sound volume information holding unit 121d and written to the mixed sound volume information holding unit 121b (step S38). Finally, information indicating which mode is received is displayed on the screen (step S39). FIG. 11 shows a display example of the reception results in steps S36 and S39. In this way, information for notifying whether the received mode change signal is the conversation priority sound output mode or the normal mode is displayed on the screen of the information processing terminal 101a to inform the user.

  In the screen example shown in FIG. 11, when the conversation priority sound output mode is received, the information processing terminal 101a displays “conversation priority sound output” on the screen, and when the normal mode is received, “Sound Cancel Conversation X: Content Y” is displayed. This conversation X: content Y shows the original sound output level setting before the mode change.

  FIG. 12 is a diagram illustrating an example of a data structure of the mixed volume information and mode information. The mixed sound volume information and mixed sound volume change signal shown in FIG. 12A are represented by the ratio of conversational sound and content sound. At this time, by regarding the value of the ratio as a volume level, it is possible to add not only the ratio but also information on the absolute volume. Further, the mode information and the mode change signal shown in FIG. 12 (B) are either a conversation priority sound output mode for outputting a sound with priority to a conversation sound or a normal mode for performing a conversation with a normal sound output level setting. It is represented by

(Function that does not enter conversation priority sound output mode)
Assuming the usage scene of the information processing system of this embodiment, there may be a case where the user wants to listen to the content sound in a concentrated manner, for example, when he wants to watch the content carefully. For such a case, the information processing terminal 101 may be provided with a function that does not enter the conversation priority sound output mode. If this function is enabled, the mode change signal received from the communication partner can be ignored, the sound output level setting of the information processing terminal 101 can be arbitrarily set, and the content sound can be listened in a concentrated manner. For example, an operation key for invalidating a mode change signal is provided in a remote controller or the like that operates the information processing terminal 101, and when the operation key is pressed by the user, even if the mode change signal is received, the information processing terminal 101 The sound output level setting may not be changed.

(Function that can be operated to some extent even in conversation priority sound output mode)
Further, assuming the use situation of the information processing system of the present embodiment, it may be desired to finely adjust the sound output level setting when the conversation priority sound output mode is entered so that the user can easily hear it. For such a case, even in the conversation priority sound output mode, the information processing terminal 101 may be provided with a function capable of performing sound output to some extent. If this function is enabled, it is possible to adjust the sound output level setting of the information processing terminal 101 within a range in which the conversation voice is preferentially output even in the conversation priority sound output mode.

(Function to switch to conversation priority sound output mode)
Assuming that the information processing system of the present embodiment is used, when the other party wants to give priority to the conversation voice, it is often the purpose of talking to each other. There may be cases where you want to prioritize the conversation voice here. For such a case, the information processing terminal 101 may be provided with a function of entering the conversation priority sound output mode. When this function is enabled, when the mode change operation is performed so that the conversation (speech) side gives priority to the conversation voice, the information processing terminal 101 on the partner (reception) side enters the conversation priority sound output mode. At the same time, the information processing terminal 101 on its own (sending) side is also changed to a setting that gives priority to the conversation voice from the other party.

(Function to divide output audio by channel using stereo speakers)
Further, there may be a function of outputting each sound from another place so that the content sound can be clearly distinguished from the conversation sound and the content sound. FIG. 13 is a conceptual diagram for explaining an example of a function of dividing output sound by channel using a stereo speaker.

  The example shown in FIG. 13 assumes a stereo speaker that can output two-channel sound of the left channel and the right channel, that is, stereo sound, using two left and right speakers. In a normal case, conversation voice and content voice are output simultaneously. That is, the left speaker outputs a sound in which the conversation sound L sound and the content sound L sound are mixed, and the right speaker outputs a sound in which the conversation sound R sound and the content sound R sound are mixed. Sounded. In this case, both the conversational sound and the content sound are output as two-channel stereo sound, so that you can hear a sound that is full of realism, but the sound that is a mixture of the conversational sound and the content sound is output from either the left speaker or the right speaker. Therefore, it is difficult to distinguish between the conversation voice and the content voice. Therefore, when it is desired to distinguish between the conversation voice and the content voice, that is, when a mode change operation is received from the information processing terminal 101b, the conversation voice is called the left channel and the content voice is called the right channel for each of the conversation voice and the content voice. Separate channels and output sound independently from different speakers. At this time, if the original audio signal is stereo audio, the stereo audio is synthesized to generate monaural audio that is 1-channel audio, and then the channels are divided and output. By such control, the conversation voice and the content voice are output independently from different speakers, so that an effect that it is easy to distinguish can be expected.

(Function that allows content audio to be output on the other party's priority)
Assuming the usage scene of the information processing system of the present embodiment, it is considered that there is a case where a specific scene such as an important display place is emphasized and told to the other party when sharing contents. For such a case, there may be a mode in which the content sound is prioritized similarly to the conversation priority sound output mode in which the conversation sound is prioritized. As an example, there may be a method in which content audio is preferentially output on the other party only while the button is pressed.

(Function to switch the echo canceller setting in conjunction with the mode)
When the information processing system of this embodiment is used in a hands-free manner, an echo canceller is essential. Further, in the conversation priority sound output mode, the state of half-duplex calls in which conversations are alternately exchanged increases, and in the normal mode, the state of full-duplex calls in which voice flows simultaneously increases. That is, since the characteristics of the call differ depending on the mode, the appropriate setting of the echo canceller differs for each mode.

  In consideration of this, the side that has set the conversation priority sound output mode (information processing terminal 101a side) actively sends its own conversation voice 11a to the other party, but the conversation voice 12a from the other party is sent too much. The echo canceller is set in accordance with the situation where it does not come. On the other hand, the conversation voice 11b from the other party is actively sent on the side that has received the conversation priority sound output mode (information processing terminal 101b side). There may be a function of setting the echo canceller according to the situation where the conversation voice 12b is not transmitted so much, and in the normal mode, setting the echo canceller according to the situation where the voice is transmitted and received in both directions. .

(Function to automatically disable conversation priority sound output mode when content is not shared)
If the content is not shared, the other party seems to have set the sound output level suitable for conversation, and the function of the conversation priority sound output mode is not very meaningful. Therefore, when the content is not shared, the normal mode may always be set.

(Function to change the mode according to the volume level of the conversation voice)
There may be a function of switching between the conversation priority sound output mode and the normal mode according to the conversation sound 11a. Specifically, an example is considered in which when the waveform is analyzed and it is recognized that Mr. A's conversation voice is input, the conversation priority sound output mode is set, or the mode is changed according to the volume level of the conversation voice 11a.

  An example in which the mode is changed according to the volume level will be described with reference to FIG. The graph (characteristic curve) shown in FIG. 14 represents an example of the temporal change in the volume level of the conversational voice. The switching to the conversation priority sound output mode is performed when the volume level of the conversation voice is equal to or higher than a set level for a predetermined time or longer. On the other hand, switching to the normal mode is performed when the volume level of the conversation voice is below a certain time and below the cancellation level. In order to prevent the mode from switching frequently, once the mode is switched, the mode continues for a certain period regardless of the switching algorithm.

In FIG. 14, the sound volume level is equal to or higher than the set level at time t ₁ , but the conversation priority sound output mode is not set because the time zone A is not equal to or longer than a certain time, while the sound volume level is set at time t _2. Since the time zone B that is higher than the level is longer than a certain time, the mode is switched to the conversation priority sound output mode. At time t ₃ , the volume level is equal to or lower than the release level, and the time zone C is equal to or longer than a certain time. Therefore, the condition for switching to the normal mode is satisfied, but for a certain period after switching to the conversation priority sound output mode. Because it is within, the mode is not switched. Finally, at time t _4, the time period D the volume level is equal to or less than cancellation level is at a predetermined time or more, further, since it is after a predetermined period after switching to conversation priority sound output mode, it switched to the normal mode ing.

  In addition, the function which does not become the conversation priority sound output mode mentioned above, the function which can be operated to some extent even in the conversation priority sound output mode, the function which becomes the conversation priority sound output mode to each other, the function which divides the output sound by the channel using the stereo speaker, the content sound A function that allows the other party to output sound with priority, a function that switches the echo canceller setting in conjunction with the mode, a function that automatically disables the conversation priority sound output mode when content is not shared, the volume of the conversation voice Each function of changing the mode according to the level can be applied not only to the first embodiment but also to the second and third embodiments described below.

(Example 2)
FIG. 15 is a diagram for explaining a schematic configuration example of the information processing system according to the second embodiment. A feature of the information processing system of the present embodiment is that A and B can enjoy a conversation while sharing the contents owned by A. The content owned by Mr. A may, for example, be recorded on the information processing terminal, or may be read by connecting a video deck or digital video camera to the external input terminal of the information processing terminal, A recording medium such as an SD (Secure Digital) memory card may be read by inserting it into a memory card slot of the information processing terminal, and various forms are possible.

  The information processing system according to the present exemplary embodiment includes an information processing terminal 201a, an information processing terminal 201b, and a content holding unit 203 connected via a network 202. The information processing system of this embodiment differs greatly from the first embodiment described above in that the content holding unit 203 and the information processing terminal 201a are connected, and the content is transferred from Mr. A's information processing terminal 201a to Mr. B's information processing terminal 201b. Is to send. The content holding unit 203 of this example may be anything that can hold and provide content, such as a storage medium built in the information processing terminal 201a or a storage medium that can be externally connected to the information processing terminal 201a. Similar to Example 1, it may be a content server on the network.

  The information processing terminal 201a transmits Mr. A's conversation voice 21a to the information processing terminal 201b, and mixes the content voice 23a acquired from the content holding unit 203 with Mr. B's conversation voice 22a received from the information processing terminal 201b. And output as mixed voice 24a. Similarly, the information processing terminal 201b transmits the conversation voice 22b of Mr. B to the information processing terminal 201a, and the content voice 23b received from the information processing terminal 201a and the conversation voice 21b of Mr. A received from the information processing terminal 201a. Are mixed and output as a mixed sound 24b.

  FIG. 16 is a block diagram illustrating a configuration example of the information processing terminal 201a according to the second embodiment. The information processing terminal 201a includes a communication unit 210, a conversation voice input unit 211, a voice output unit 212, a conversation voice transmission unit 213, and a conversation voice. Receiving unit 214, output sound mixing unit 215, mixed sound volume change input unit 216, mode change input unit 217, mode change transmission unit 218, mode change reception unit 219, content audio extraction unit 220, content audio transmission unit 221, output sound A control unit 222 and a content holding unit 203 are included. Note that the information processing terminal 201b in this example has the same configuration as the information processing terminal 101a of the first embodiment shown in FIG.

  16, each unit other than the content audio extraction unit 220, the content audio transmission unit 221, and the content holding unit 203 (that is, the communication unit 210, the conversation audio input unit 211, the audio output unit 212, the conversation audio transmission unit 213, the conversation audio reception) Unit 214, output sound mixing unit 215, mixed sound volume change input unit 216, mode change input unit 217, mode change transmission unit 218, mode change reception unit 219, and sound output control unit 222) are shown in FIG. The functions are the same as those of the first unit, and a description thereof is omitted here. Similar to the sound output control unit 121 shown in FIG. 4, the sound output control unit 222 is a mixed sound volume control unit, mixed sound volume information holding unit, mode information holding unit, original set mixed volume information holding unit, conversation priority mixing. It is comprised by the volume information holding part.

  The content audio extraction unit 220 is a unit that extracts content audio from the content holding unit 203. The content audio transmission unit 221 is means for transmitting the content audio transmitted from the content audio extraction unit 220 to the network 202 via the communication unit 210.

  Hereinafter, based on the flow shown in FIG. 17, the operation example of the information processing terminal 201a will be mainly described. Note that the operation example of the information processing terminal 201b is the same as the flow of the first embodiment shown in FIG. 5, FIG. 6, FIG. 8, and FIG.

(Voice call)
FIG. 17 is a flowchart for explaining an example of the voice call processing of the information processing terminal 201a according to the second embodiment. This example will be described based on the configuration shown in FIG. In addition, although the transmission process and the reception process are actually performed at the same time, each process is shown separately for explanation.

  In the transmission process shown in FIG. 17A, first, the information processing terminal 201a captures Mr. A's conversation voice by the conversation voice input unit 211 and simultaneously fetches the content voice by the content voice extraction unit 220 (step S41). After that, the information processing terminal 201a transmits the conversation voice by the conversation voice transmission unit 213 and the content voice by the content voice transmission unit 221 to the network 202 via the communication unit 210 (step S42).

  On the other hand, in the reception process shown in FIG. 17B, first, the information processing terminal 201a receives conversation voice from Mr. B from the network 202 via the communication unit 210, and at the same time, the content audio is extracted by the content audio extraction unit 220. Capture (step S43). Subsequently, as in the case of the first embodiment, the sound output sound mixing unit 215 reads the mixed sound volume information from the mixed sound volume information holding unit of the sound output control unit 222 in order to mix these two sounds (step S44). Based on the ratio, the conversation voice and the content voice are mixed to generate a mixed voice (step S45), and the generated mixed voice is output from the voice output unit 212 (step S46). It is assumed that the transmission process of steps S41 to S42 and the reception process of steps S43 to S46 are executed simultaneously.

  The other processes, that is, the mixed sound volume change, conversation priority transmission, and conversation priority reception process flows are the same as those in the first embodiment shown in FIGS.

(Function to determine that content is not shared when the external input terminal is not connected)
The information processing terminal of the present invention may have a function of determining that content is not shared when nothing is connected to an external input terminal for inputting data of the content server. After determining that the content is not shared, the function described in the first embodiment (a function of automatically disabling the conversation priority sound output mode when the content is not shared) may be used.

  Note that the function of determining that content is not shared when the external input terminal is not connected is applicable not only to the second embodiment but also to the third embodiment described below.

(Example 3)
FIG. 18 is a diagram for explaining a schematic configuration example of the information processing system according to the third embodiment. The characteristic of the information processing system of the present embodiment is that, like the second embodiment described above, A and B can enjoy a conversation while sharing the content owned by Mr. A. The difference is that conversation voice and content voice are not transmitted separately from Mr. A to Mr. B, but are mixed and transmitted at Mr. A's information processing terminal. That is, since an audio signal can be transmitted as one data, an existing TV phone system can be used. Furthermore, there is an effect that the communication band can be reduced to ½ compared to when the data is transmitted separately as two data. However, in this embodiment, the sound output level setting in the conversation priority sound output mode is not limited to the absolute sound volume but limited to the sound volume ratio.

  The information processing system according to the present exemplary embodiment includes an information processing terminal 301a, an information processing terminal 301b, and a content holding unit 303 connected via a network 302. The information processing system of the present embodiment is greatly different from that of the second embodiment in that the voice sent from the information processing terminal 301a to the information processing terminal 301b is not a conversation voice and a content voice but a mixed voice that has already been mixed. is there.

  The information processing terminal 301a mixes the content audio 33a acquired from the content holding unit 303 and the conversation audio 31a of Mr. A and transmits the mixed audio 35a to the information processing terminal 301b of B, and also acquires from the content holding unit 303. The mixed content sound 33a and Mr. B's conversation sound 32a received from the information processing terminal 301b are mixed and output as mixed sound 34a. Similarly, the information processing terminal 301b transmits Mr. B's conversation voice 32b to the information processing terminal 201a and outputs the mixed voice 31b received from the information processing terminal 301a.

  FIG. 19 is a block diagram illustrating a configuration example of the information processing terminal 301a according to the third embodiment. The information processing terminal 301a includes a communication unit 310, a conversation voice input unit 311, a voice output unit 312, a conversation voice reception unit 313, and a sound output. Audio mixing units 314a and 314b, mixed volume change input unit 315, mode change input unit 316, mode change reception unit 317, content audio extraction unit 318, mixed audio transmission unit 319, mixed volume change reception unit 320, sound output control unit 321a , 321b and the content holding unit 303.

  In FIG. 19, each unit other than the sound output sound mixing unit 314b, the mixed sound volume change receiving unit 320, the mixed sound transmission unit 319, and the sound output control unit 321b (that is, the content holding unit 303, the communication unit 310, the conversation sound input unit 311, The voice output unit 312, the conversational voice receiving unit 313, the output voice mixing unit 314 a, the mixed sound volume change input unit 315, the mode change input unit 316, the mode change reception unit 317, the content voice extraction unit 318, and the sound output control unit 321 a). Since the functions are the same as those in the second embodiment shown in FIG. 16, the description thereof is omitted here. Note that the sound output control units 321a and 321b are similar to the sound output control unit 121 shown in FIG. 4, the mixed sound volume control unit, the mixed sound volume information holding unit, the mode information holding unit, the original mixed sound volume information holding unit, the conversation It is comprised by the priority mixing volume information holding part.

  The output sound mixing unit 314 b mixes the conversation sound from the conversation sound input unit 311 and the content sound from the content sound extraction unit 318 and inputs the mixed sound to the mixed sound transmission unit 319. The mixed sound transmission unit 319 transmits the mixed sound transmitted from the output sound mixing unit 314 b to the network 302 via the communication unit 310. The mixed volume change receiving unit 320 receives mixed volume change information (voice ratio change information) from the information processing terminal 301b from the network 302 via the communication unit 310, and outputs the mixed volume change information to the sound output control unit 321b. Enter. The output sound mixing unit 314b reads the mixed sound volume information from the mixed sound volume information holding unit of the sound output control unit 321b, generates mixed sound based on the ratio, and the generated mixed sound is sent from the mixed sound transmission unit 319 to the network 302. Sent to.

(Voice call)
FIG. 20 is a flowchart for explaining an example of the voice call process of the information processing terminal 301a according to the third embodiment. This example will be described based on the configuration shown in FIG. In addition, although the transmission process and the reception process are actually performed at the same time, each process is shown separately for explanation.

  In the transmission process shown in FIG. 20A, first, in the information processing terminal 301a, Mr. A's conversation voice is captured by the conversation voice power unit 311 and at the same time, the content voice is captured by the content voice extraction unit 318 (step S51). ). Next, in order to mix these two sounds, the sound output sound mixing unit 314b reads the mixed sound volume information from the mixed sound volume information holding unit of the sound output control unit 321b (step S52), and outputs the mixed sound based on the ratio. Generate (step S53). Thereafter, the information processing terminal 301a transmits the generated mixed sound to the network 302 via the communication unit 310 (step S54).

  On the other hand, in the reception process shown in FIG. 20B, first, the information processing terminal 301a receives conversation voice from Mr. B from the network 302 via the communication unit 310, and at the same time, the content audio is extracted by the content audio extraction unit 318. Capture (step S55). Subsequently, as in the case of the second embodiment, the output sound mixing unit 314a reads the mixed sound volume information from the mixed sound volume information holding unit of the sound output control unit 321a in order to mix these two sounds (step S56). Based on the ratio, the conversation voice and the content voice are mixed to generate a mixed voice (step S57), and the generated mixed voice is output from the voice output unit 312 (step S58). It is assumed that the transmission process of steps S51 to S54 and the reception process of steps S55 to S58 are executed simultaneously.

  The mixed sound volume changing process in the information processing terminal 301a is the same as that in the first embodiment shown in FIG.

(Conversation priority transmission)
FIG. 21 is a flowchart for explaining an operation example when the information processing terminal 301a performs a mode change operation on the information processing terminal 301b in the third embodiment. This example will be described based on the configuration shown in FIG. First, the information processing terminal 301a converts a signal input by an operation performed by Mr. A to switch the mode of the information processing terminal 301a into a mode change signal through the mode change input unit 316 (step S61). Subsequently, the mode change signal is transmitted to the mixed sound volume control unit in the sound output control unit 321b, and the mixed sound volume control unit checks whether the mode change signal is the conversation priority sound output mode or the normal mode (step S62). When it is the priority sound output mode (in the case of the conversation priority sound output mode in the figure), the mixed sound volume control unit writes the conversation priority sound output mode as mode information in the mode information holding unit (step S63).

  Next, in order to retain the original mixed sound volume information, the current mixed sound volume information is read from the mixed sound volume information holding unit and written to the original set mixed sound volume information holding unit (step S64). The sound level setting for the conversation priority sound output mode is read from the information holding unit and written to the mixed sound volume information holding unit (step S65). Finally, information indicating which mode is transmitted is displayed on the screen (step S66).

  On the other hand, when the mode change signal is the normal mode in step S62 (in the case of the normal mode in the figure), the mixed sound volume control unit writes the normal mode as mode information in the mode information holding unit (step S67). Next, in order to return to the original mixed sound volume, the mixed sound volume information is read from the original mixed sound volume information holding unit and written to the mixed sound volume information holding unit (step S68). Finally, information indicating which mode is transmitted is displayed on the screen (step S69). FIG. 9 shows a display example of the reception results in steps S66 and S69. In this way, information for notifying whether the transmitted mode change signal is the conversation priority sound output mode or the normal mode is displayed on the screen of the information processing terminal 301a and is transmitted to the user (Mr. A).

  The conversation priority reception process in the information processing terminal 301a is the same as that in the first embodiment shown in FIG.

(Mixed volume change: Setting of the other party's output level)
FIG. 22 is a diagram for explaining an operation example when the sound output level setting of the information processing terminal 301b is changed according to the mixed sound volume change signal received from the information processing terminal 301b in the information processing terminal 301a of the third embodiment. FIG. This example will be described based on the configuration shown in FIG. First, the information processing terminal 301a receives the mixed volume change signal from the information processing terminal 301b by the mixed volume change receiving unit 320 and transmits it to the mixed volume control unit of the sound output control unit 321b (step S71). Next, the mixed sound volume control unit reads the current mode information from the mode information holding unit and checks whether it is the conversation priority sound output mode or the normal mode (step S72). As a result, in the normal mode (in the case of the normal mode in the figure), the mixed volume information based on the mixed volume change signal from the information processing terminal 301b is written to the mixed volume information holding unit, and the mixed volume of the information processing terminal 301b is written. Information is changed (step S73). On the other hand, if it is the conversation priority sound output mode in step S72 (in the case of the conversation priority sound output mode in the figure), the mixed sound volume information is not changed and the process is terminated as it is.

  FIG. 23 is a block diagram illustrating a configuration example of the information processing terminal 301b according to the third embodiment. The information processing terminal 301b includes a communication unit 410, a conversation voice input unit 411, a voice output unit 412, a conversation voice transmission unit 413, and a mixed sound volume. A change input unit 414, a mode change input unit 415, a mode change transmission unit 416, a mixed sound reception unit 417, and a mixed sound volume change transmission unit 418 are configured.

  In FIG. 23, each unit other than the mixed voice receiving unit 417 and the mixed volume change transmitting unit 418 (that is, the communication unit 410, the conversation voice input unit 411, the voice output unit 412, the conversation voice transmission unit 413, the mixed volume change input unit 414, The mode change input unit 415 and the mode change transmission unit 416) have the same functions as those of the second embodiment shown in FIG.

  The mixed sound receiving unit 417 is a means for receiving mixed sound from the network 302 via the communication unit 410. The mixed sound volume change transmission unit 418 is a means for transmitting the mixed sound volume change signal transmitted from the mixed sound volume change input unit 414 to the network 302 via the communication unit 410.

(Voice call)
FIG. 24 is a flowchart for explaining an example of the voice call process of the information processing terminal 301b according to the third embodiment. This example will be described based on the configuration shown in FIG. In addition, although the transmission process and the reception process are actually performed at the same time, each process is shown separately for explanation.

  In the transmission process shown in FIG. 24A, first, the information processing terminal 301b captures Mr. B's conversation voice by the conversation voice input unit 411 (step S81), and the captured conversation voice is transmitted to the network 302 via the communication unit 410. (Step S82). On the other hand, in the reception process shown in FIG. 24B, the information processing terminal 301b receives mixed sound from the network 302 via the communication unit 410 (step S83), and outputs the received mixed sound from the sound output unit 412. (Step S84). It is assumed that the transmission process of steps S81 to S82 and the reception process of steps S83 to S84 are executed simultaneously.

(Mixed volume change)
FIG. 25 is a flowchart for explaining an example of the mixed sound volume changing process for the sound output from the information processing terminal 301b according to the third embodiment. This example will be described based on the configuration shown in FIG. First, the information processing terminal 301b changes the signal input by the operation performed by Mr. B to change the mixed volume to the mixed volume change signal through the mixed volume change input unit 414 (step S91). Subsequently, the mixed volume change transmission unit 418 transmits the acquired mixed volume change signal to the network 302 via the communication unit 410 and transmits the signal to the information processing terminal 301a (step S92). Then, the actual mixed sound volume changing process is executed by the information processing terminal 301a according to the flow shown in FIG.

  The conversation priority transmission process in the information processing terminal 301b is the same as that in the first embodiment shown in FIG.

  Further, there is no processing performed by the information processing terminal 301b for the conversation priority reception process. In the information processing system according to the third embodiment, the conversation priority reception process and the mixed sound volume change process in the information processing terminal 301b are performed on the information processing terminal 301a. Therefore, in order to display the result on the information processing terminal 301b side, notification of new control information is necessary. The information processing terminal may be provided with a control information notification function for this purpose.

(Program implementation)
Note that the information processing terminal of the present invention can also be realized as a program. This program is stored in a computer-readable recording medium, and each process is realized by the program. Examples of recording media include tape systems such as magnetic tapes and cassette tapes, magnetic disk systems such as floppy (registered trademark) disks and hard disks, disk systems such as optical disks such as CD-ROM / MO / MD / DVD, and ICs. Any of a card system such as a card or an optical card, a medium carrying a fixed program including a semiconductor memory such as a mask ROM, FPROM, EEPROM, flash ROM or the like may be used.

(Example of housing layout)
FIG. 26 is a connection configuration diagram for explaining an example of a connection configuration between blocks of the information processing terminal according to the present invention. The information processing terminal 101a shown in FIG. 26 is connected via a TV set 1011, a video phone camera and microphone set-top unit 1012, a remote control unit 1013 operated by a user, and a network 102 using a wired or wireless line. And at least an adapter unit 1010 that transmits and receives video and audio to and from the other information processing apparatus 101b.

  The set-top unit 1012 is connected to the adapter unit 1010 by wire or wirelessly, and instructs the selection of information to be received via the network 102 or instructs the transmission of image data captured by the built-in camera. The adapter unit 1010 is connected to the network 102 by wire or wirelessly, and is connected to the television receiver 1011, and transmits information such as video and audio received via the network 102 to the television receiver 1011. At the same time, the image data taken by the built-in camera of the set top unit 1012 is transmitted to another information processing apparatus designated via the network 102. The remote control unit 1013 transmits an instruction from the user to the set top unit 1012 or to the adapter unit 1010 via the set top unit 1012 by an infrared ray or a radio signal. The television receiver 1011 displays and outputs video and audio from the adapter unit 1010 and the set top unit 1012 or text information.

  27 is a connection configuration diagram for explaining another example of the connection configuration between blocks of the information processing apparatus according to the present invention, and shows a modification of the information processing apparatus 101a shown in FIG. . That is, the information processing apparatus 101a ′ shown in FIG. 27 differs from the configuration shown in FIG. 26 in that the adapter unit 1010 of the information processing apparatus 101a is a communication unit 1010 ′, and the communication unit 1010 ′ is connected to the television receiver 1011 ′. This shows a case of an integrated information processing apparatus built in and integrated. Although not shown, the television receiver 1011 ′ may be further integrated with the set top unit 1012 ′. Further, the communication unit 1010 ′ has an external input terminal for inputting video and audio from an external device. In the example shown in FIG. 27, three RCA pin jacks (video 1, audio 2) are provided as external input terminals, but an input format other than the RCA pin may be used.

(Example of remote control layout)
FIG. 28 is a diagram for explaining an example of the layout of the remote control unit 1013. The remote control unit 1013 shown in this example selects a power button 1014, a menu button 1015 for displaying various setting items, a mode button 1016 for switching between the conversation priority sound output mode and the normal mode, and an item displayed by the menu button 1015. There are at least an up / down decision button, a decision button 1017, a first volume adjustment button 1018, and a second volume adjustment button 1019. The setting items displayed by the menu button 1015 include an item for adjusting the sound output level setting by the volume ratio or the sound volume level, an item for prohibiting the conversation priority sound output mode, and the like.

  When the volume ratio is adjusted, the overall volume level is adjusted with the first volume adjustment button 1018, and the volume ratio between the conversational sound and the content sound is adjusted with the second volume adjustment button 1019. On the other hand, when the volume level is adjusted, the volume level of the conversational sound is adjusted with the first volume adjustment button 1018, and the volume level of the content sound is adjusted with the second volume adjustment button 1019.

(Example of screen display during volume adjustment)
FIG. 29 is a diagram illustrating a screen display example at the time of volume adjustment. It is an example different from FIG. 7 described above. The display screen in this example includes a conversation voice icon 1020, a content voice icon 1021, a conversation voice level bar 1022, and a content voice level bar 1023. The conversation voice icon 1020 is a display for making it easy to understand that the conversation voice level bar 1022 represents the volume level of the conversation voice. The content voice icon 1021 has the content voice level bar 1023 indicating the volume level of the content voice. It is a display to make it easy to understand what is being represented.

  The conversational voice level bar 1022 represents the volume level of the conversational voice in the form of a bar extending vertically, and indicates that the volume level increases as it extends upward. The content audio level bar 1023 represents the volume level of the content audio in the form of a bar extending up and down, and indicates that the volume level increases as it extends upward. In the normal mode, the conversation audio level bar 1022 and the content audio level bar 1023 are displayed in green. In the conversation priority sound output mode, the conversation audio level bar 1022 and the content audio level bar 1023 are displayed in red. It may be emphasized that it cannot be changed in the conversation priority sound output mode by displaying it.

It is a conceptual diagram for explaining an example of a situation where voice communication is performed while simultaneously outputting a plurality of voices such as conversation voices and content voices in an information processing system to which the present invention is applied. 1 is a diagram for explaining a schematic configuration example of an information processing system according to a first embodiment. FIG. 1 is a block diagram illustrating a configuration example of an information processing terminal according to a first embodiment. It is a block diagram which shows the detailed structural example of a sound output control part. FIG. 6 is a flowchart for explaining an example of a voice call process of the information processing terminal in the first embodiment. It is a flowchart for demonstrating an example of the mixing sound volume change process of the sound uttered by the information processing terminal in Example 1. It is a figure which shows the example of a screen display when a mixed sound volume is changed in this invention. FIG. 6 is a flowchart for explaining an operation example when the information processing terminal performs a mode change operation on the counterpart information processing terminal in the first embodiment. It is a figure which shows the example of a screen display when the conversation priority is instruct | indicated in this invention. FIG. 6 is a flowchart for explaining an operation example when the information processing terminal receives a mode change operation from the counterpart information processing terminal in the first embodiment. It is a figure which shows the example of a screen display when the conversation priority is instruct | indicated from the other party in this invention. It is a figure which shows an example of the data structure of mixed volume information and mode information. It is a conceptual diagram for demonstrating an example of the function which divides | segments output audio | voice by a channel using a stereo speaker. It is a figure for demonstrating an example of the function which changes a mode according to a conversational sound volume level. FIG. 6 is a diagram for explaining a schematic configuration example of an information processing system according to a second embodiment. FIG. 10 is a block diagram illustrating a configuration example of an information processing terminal according to a second embodiment. FIG. 10 is a flowchart for explaining an example of a voice call process of the information processing terminal according to the second embodiment. FIG. 10 is a diagram for explaining a schematic configuration example of an information processing system according to a third embodiment. FIG. 10 is a block diagram illustrating a configuration example of an information processing terminal according to a third embodiment. FIG. 10 is a flowchart for explaining an example of a voice call process of the information processing terminal according to the third embodiment. FIG. 10 is a flowchart for explaining an operation example when the information processing terminal performs a mode change operation on the counterpart information processing terminal in the third embodiment. In the information processing terminal according to the third embodiment, an operation example when changing the sound output level setting of the information processing terminal of the counterpart in accordance with the mixed sound volume change signal received from the counterpart information processing terminal is described. FIG. FIG. 10 is a block diagram illustrating a configuration example of an information processing terminal according to a third embodiment. FIG. 10 is a flowchart for explaining an example of a voice call process of the information processing terminal according to the third embodiment. FIG. 10 is a flowchart for explaining an example of a mixed sound volume changing process for sounds output from the information processing terminal according to the third embodiment. It is a connection block diagram for demonstrating an example of the connection structure between each block of the information processing terminal which concerns on this invention. It is a connection block diagram for demonstrating the other example of the connection structure between each block of the information processing terminal which concerns on this invention. It is a figure which shows an example of the layout of the remote control unit used with the information processing terminal which concerns on this invention. It is a figure which shows the example of a screen display in the case of volume adjustment. It is a conceptual diagram for demonstrating the situation where voice communication is performed while simultaneously outputting a plurality of voices such as conversation voice and content voice in a conventional system. It is a figure for demonstrating the problem which generate | occur | produces in the conventional system shown in FIG.

Explanation of symbols

11a, 11b, 21a, 21b, 31a ... A conversation voice, 12a, 12b, 22a, 22b, 32a, 32b ... B conversation voice, 13a, 13b, 23a, 23b, 33a ... content voice, 14a, 14b, 24a , 24b, 31b, 34a ... mixed voice, 101a, 101b, 201a, 201b, 301a, 301b, 501a, 501b ... information processing terminal (calling device), 102, 102 ', 202, 302, 502 ... network, 103, 103 ', 503 ... Content server, 110, 210, 310, 410 ... Communication unit, 111, 211, 311, 411 ... Conversation voice input unit, 112, 212, 312, 412 ... Voice output unit, 113, 213, 413 ... Conversation Voice transmitting unit, 114, 214, 313 ... conversation voice receiving unit, 115 ... content Voice receiving unit 116, 215, 314a, 314b ... Outgoing sound mixing unit, 117, 216, 315, 414 ... Mixed volume change input unit, 118, 217, 316, 415 ... Mode change input unit, 119, 218, 416 ... mode change transmission unit, 120, 219, 317 ... mode change reception unit, 121, 222, 321a, 321b ... sound output control unit, 121a ... mixed volume control unit, 121b ... mixed volume information holding unit, 121c ... mode information holding 121d ... original setting mixed volume information holding unit, 121e ... conversation priority mixed volume information holding unit, 122 ... mixed volume information, 123 ... mixed volume change signal, 124 ... mode change signal, 203,303 ... content holding unit, 220 , 318 ... content audio extraction unit, 221 ... content audio transmission unit, 319 ... mixed audio transmission unit, 320 ... mixing Volume change receiving unit, 417 ... Mixed sound receiving unit, 418 ... Mixed volume change transmitting unit, 1010 ... Adapter unit, 1011, 1011 '... TV receiver, 1012, 1012' ... Set top unit, 1013, 1013 '... Remote control unit DESCRIPTION OF SYMBOLS 1010 '... Communication part, 1014 ... Power button, 1015 ... Menu button, 1016 ... Mode button, 1017 ... Up / down, decision button, 1018 ... First volume adjustment button, 1019 ... Second volume adjustment button, 1020 ... Conversation Voice icon, 1021... Content voice icon, 1022 ... conversation voice level bar, 1023 ... content voice level bar.

Claims (17)

A call device capable of making a call including conversation voice with another call device and simultaneously viewing content including the voice,
The call device includes means for transmitting sound level setting change instruction information to the other call device for setting the sound output by giving priority to either conversation voice or content sound in the other call device ,
Wherein when the speech loudness level of the call device exceeds a predetermined amount, the communication device characterized that you send the sound output level setting change instruction information to the other communication device from the communication device. A call device capable of making a call including conversation voice with another call device and simultaneously viewing content including the voice,
The call device includes means for transmitting sound level setting change instruction information to the other call device for setting the sound output by giving priority to either conversation voice or content sound in the other call device,
The call device is characterized in that the sound output setting of the other call device changes the setting of the echo canceller. A call device capable of making a call including conversation voice with another call device and simultaneously viewing content including the voice,
The call device includes means for transmitting sound level setting change instruction information to the other call device for setting the sound output by giving priority to either conversation voice or content sound in the other call device,
The sound output setting of the other call device is characterized in that the volume of the conversation voice is increased and the volume of the content sound is decreased. A call device capable of making a call including conversation voice with another call device and simultaneously viewing content including the voice,
The call device includes means for transmitting sound level setting change instruction information to the other call device for setting the sound output by giving priority to either conversation voice or content sound in the other call device,
The communication device is characterized in that the sound output setting of the other communication device is a sound output from a different speaker. The communication device according to any one of claims 1 to 4 ,
The call device is characterized in that after changing the sound output setting of the other call device, the change of the sound output setting by operating the other call device is prohibited or restricted for a predetermined time. The communication device according to any one of claims 1 to 5 ,
When the sound output setting of the other call device is changed, the call device changes the sound output setting of the call device in conjunction with the change. A call device capable of making a call including conversation voice with another call device and simultaneously viewing content including the voice,
The call device includes means for receiving, from the other call device, sound output level setting change instruction information for setting sound output with priority given to either conversation voice or content sound at the call device. According to the sound output level setting change instruction information , the call canceling device changes the setting of the echo canceller as the sound output setting of the communication device. A call device capable of making a call including conversation voice with another call device and simultaneously viewing content including the voice,
The call device includes means for receiving, from the other call device, sound output level setting change instruction information for setting sound output with priority given to either conversation voice or content sound at the call device. According to the sound output level setting change instruction information, the call device is characterized in that, as the sound output setting of the call device, the volume of the conversation sound is increased and the volume of the content sound is decreased. A call device capable of making a call including conversation voice with another call device and simultaneously viewing content including the voice,
The call device includes means for receiving, from the other call device, sound output level setting change instruction information for setting sound output with priority given to either conversation voice or content sound at the call device. According to the sound output level setting change instruction information, a sound is output from a different speaker as the sound output setting of the communication device. The communication device according to any one of claims 7 to 9 ,
The call device is characterized in that after changing the sound output setting of the call device, the change of the sound output setting by operating the call device is prohibited or restricted for a predetermined time. The communication device according to any one of claims 7 to 9 ,
When the call device receives the sound level setting change instruction information from the other call device, the call device invalidates the sound setting instruction according to the sound level setting change instruction information, and sets the sound setting of the call device. A telephone device characterized by not changing. A call device capable of making a call including conversation voice with another call device and simultaneously viewing content including the voice,
The communication device is configured to transmit a mixed sound obtained by mixing a conversation sound and a content sound to the other call device according to the mixed volume ratio information received from the other call device;
Means for changing the mixed sound volume ratio of the mixed sound to be transmitted to the other call device so as to give priority to either the conversation voice or the content sound at the other call device ;
When speech loudness level of the communication device exceeds a predetermined amount, the communication device characterized that you change the mixing volume ratio of the mixed sound to be transmitted to the other communication device. The communication device according to claim 12 ,
The call device is characterized in that, as the mixed sound volume ratio of the mixed sound transmitted to the other call device, the volume of the conversation sound is increased and the volume of the content sound is decreased. The communication device according to claim 12 or 13 ,
The call device prohibits or restricts the change of the mixed sound volume ratio by the operation of the other call device for a predetermined time after changing the mixed sound volume ratio of the mixed sound transmitted to the other call device. Telephone device. The communication device according to any one of claims 12 to 14 ,
If the mixed volume ratio of the mixed voice to be transmitted to the other call device is changed, the call device sets the sound output to give priority to either the conversation voice or the content sound in the call device in conjunction with this change. A call device characterized by changing the voice. A call system comprising the call device according to any one of claims 1 to 15 and another call device. The program for performing the function as a telephone apparatus of any one of Claims 1-15 .

Images