JP5735360B2 - Information terminal, information device, and system comprising these - Google Patents

Description

  The present invention relates to an information terminal, an information device, and a system including these.

  In recent years, a method of using a television and a mobile terminal in cooperation has been proposed.

  As an example, there is a usage in which a user views a TV while watching the mobile terminal at hand.

  In the case of the above example, since the user listens to the sound output from both the television and the mobile terminal, it is necessary to synchronize the output timings of both the sounds and provide a viewing environment without a sense of incongruity.

  In order to solve this, there is a method described in Patent Document 1 as one method.

  The patent document 1 describes a synchronized reproduction system for media data packets. In this system, a media source (for example, an audio distribution device) transmits a media data packet with a time stamp (for example, audio data) to a plurality of media sinks (for example, an audio output device), and each media sink receives the received media. Since the media data packet is reproduced at the time indicated by the time stamp of the data packet, for example, a plurality of devices can output audio in synchronization. (See paragraph 0039)

Japanese Patent Laid-Open No. 2004-104796

    However, when the system of Patent Document 1 is applied to the above usage scenes of a television and a mobile terminal, it is necessary to prepare audio data with a time stamp on the broadcast station side. Also, it is necessary for the television and the mobile terminal to have the system clocks of their own devices, which are the basis for time calculation, accurately match each other.

  Accordingly, an object of the present invention is to provide an information terminal, an information device, and a system including these that can be synchronized without using a time stamp.

  In order to achieve the above object, for example, the configuration described in the claims is adopted.

  ADVANTAGE OF THE INVENTION According to this invention, the information terminal which can synchronize without using a time stamp, information equipment, and the system which consists of these can be provided.

  Problems, configurations, and effects other than those described above will be clarified by the following description of embodiments.

1 is a system conceptual diagram of Embodiment 1. FIG. 1 is an example of a configuration diagram of an audio output device 1 of Example 1. FIG. It is an example of the data flow figure of the audio | voice output apparatus 1 of Example 1. FIG. It is an example of the block diagram of the audio | voice output apparatus 2 of Example 1 and Example 2. FIG. It is an example of the data flow figure of the audio | voice output apparatus 2 of Example 1 and Example 2. FIG. It is an example of the processing flow figure of the audio | voice output apparatus 1 of Example 1, and the audio | voice output apparatus 2. FIG. 6 is a conceptual diagram of a system according to a second embodiment. It is an example of the block diagram of the audio | voice output apparatus 1 of Example 2. FIG. It is an example of the data flow figure of the audio | voice output apparatus 1 of Example 2. FIG. It is an example of the processing flowchart of the audio | voice output apparatus 1 and the audio | voice output apparatus 2 of Example 2. FIG. It is an example of the volume information management database 1211 of Example 2. FIG. 10 is a conceptual diagram of a system according to a third embodiment. It is an example of the block diagram of the audio | voice output apparatus 1 of Example 3. FIG. It is an example of the data flow figure of the audio | voice output apparatus 1 of Example 3. FIG. It is an example of the block diagram of the audio | voice output apparatus 2 of Example 3. FIG. It is an example of the data flow figure of the audio | voice output apparatus 2 of Example 3. FIG. It is an example of the processing flow figure of the audio | voice output apparatus 1 and the audio | voice output apparatus 2 of Example 3. FIG. It is an example of the volume information management database 1211 of Example 3.

    Hereinafter, examples will be described with reference to the drawings.

  In this embodiment, an example will be described in which the audio output device 1 outputs audio in synchronization with the audio output device 2 connected to the network.

  First, the concept of the system in the present embodiment will be described with reference to FIG.

  As shown in FIG. 1, the system of this embodiment includes an audio output device 1 and an audio output device 2. The sound output from the sound output device 2 reaches the user and the sound output device 1. The sound output from the sound output device 1 reaches the user. The audio output device 1 and the audio output device 2 are connected via a network, and audio data is transmitted from the audio output device 2 to the audio output device 1. Audio data refers to information obtained by encoding audio.

  Next, a schematic configuration of the audio output device 1 according to the present embodiment will be described with reference to FIG.

  As shown in FIG. 2, the audio output device 1 of the present embodiment includes a control device 11, a recording device 12, an audio input device 13, an audio output device 14, a communication device 15, an operation input device 16, and a display. Device 17.

  The control device 11 is a device that executes the processing program held by the recording device 12 and controls the operation of the entire device.

  The recording device 12 is a device that records a processing program for controlling the operation of the audio output device 1, a database for managing various information, audio data, and the like. Examples of the recording device 12 include a disk, a tape, and a semiconductor. The processing program held by the recording device 12 includes a device control processing unit 121, an audio data acquisition processing unit 122, an audio input processing unit 123, a time difference measurement processing unit 124, a time adjustment processing unit 125, and an audio output process. Part 126. The recording device 12 also has an audio data buffer 1212 that temporarily stores audio data.

  The device control processing unit 121 is a processing unit that causes each device of the sound output device 1 to operate in cooperation with each other. For example, an audio output function for causing the audio output device 14 to output audio data input to the communication device 15 is realized. Details of other processing units will be described later.

  The voice input device 13 is a device for inputting voice. An example of the voice input device 13 is a sound collection device such as a microphone.

  The audio output device 14 is a device that outputs audio. An example of the audio output device 14 is a sound emitting device such as a speaker.

  The communication device 15 is a device that communicates with other devices via a network. Examples of communication methods include USB (Universal Serial Bus), IEEE1394 (Institute of Electrical and Electronic Engineers 1394), Ethernet (registered trademark), wireless LAN (Local Area Network), and HDMI (High-Definition Multimedia Interface). .

  The operation input device 16 is an interface device that allows the user to operate the audio output device 1. Examples of the operation input device 16 include buttons, switches, keys, dials, sticks, mice, remote controllers, and touch panels.

  The display device 17 is a device that displays a device operation screen or the like for the user. Examples of the display device 17 include a liquid crystal panel, a plasma display panel, and an organic EL panel. Note that the audio output device 1 may not include the display device 17 in the device, and may output image data so that a desired image is displayed on the display device 17 connected outside the device. .

  Note that the audio data buffer 1212 may store audio data temporarily or for a long time.

  Next, the role and data flow of each processing unit of the audio output device 1 according to the present embodiment will be described with reference to FIG.

  FIG. 3 is an example of a data flow diagram of the audio output device 1 according to the present embodiment, but a data flow when the device control processing unit 121 links each device of the audio output device 1 is omitted.

  The audio data acquisition processing unit 122 receives communication data including audio data (hereinafter, acquired audio data 101) from the audio output device 2 connected to the network via the communication device 15, and acquires the acquired audio data 101. Is a processing unit. The audio data acquisition processing unit 122 passes the acquired audio data 101 to the time difference measurement processing unit 124 and stores it in the audio data buffer 1212.

  The voice input processing unit 123 is a processing unit that converts voice (hereinafter referred to as input voice 103) input by the voice input device 13 into voice data (hereinafter referred to as input voice data 104). In addition, the voice input processing unit 123 passes the input voice data 104 to the time difference measurement processing unit 124.

  The time difference measurement processing unit 124 is a processing unit that measures a time difference between a time at which a certain characteristic part in the acquired voice data 101 can be output and a time at which the same or similar characteristic part of the input voice data 104 appears. The time difference measurement processing unit 124 passes the time difference information 105 including the measured time difference to the time adjustment processing unit 125.

  The time adjustment processing unit 125 is a processing unit that reads the acquired audio data 101 from the audio data buffer 1212, adjusts the time by the time difference extracted from the time difference information 105, and passes it to the audio output processing unit 126.

  The sound output processing unit 126 is a processing unit that converts the acquired sound data 101 into sound (hereinafter, referred to as output sound 102) and outputs the sound by the sound output device 14.

  Note that the audio data acquisition processing unit 122 may pass the acquired audio data 101 directly to the time difference measurement processing unit 124 or may pass it through a data buffer. This data buffer may be the audio data buffer 1212 or another buffer.

  The voice input processing unit 123 may pass the input voice data 104 directly to the time difference measurement processing unit 124 or may pass it through a data buffer. This data buffer may be the audio data buffer 1212 or another buffer.

  Next, a schematic configuration of the audio output device 2 according to the present embodiment will be described with reference to FIG.

  As shown in FIG. 4, the audio output device 2 according to the present embodiment includes a control device 21, a recording device 22, a broadcast receiving device 23, an audio output device 24, a communication device 25, an operation input device 26, and a display. Device 27. The audio output device 2 is the same as the audio output device 1 shown in FIG. 2 except that it has the broadcast receiving device 23 and the contents of the processing program recorded by the recording device 22. A detailed description of devices other than the receiving device 23 is omitted.

  The recording device 22 is a device that records a processing program for controlling the operation of the audio output device 2, a database for managing various information, audio data, and the like. Examples of the recording device 22 include a disk, a tape, and a semiconductor. The processing programs held by the recording device 22 include a device control processing unit 221, an audio data acquisition processing unit 222, a time adjustment processing unit 223, an audio output processing unit 224, and an audio data transmission processing unit 225. The recording device 22 includes an audio data buffer 226 that temporarily stores audio data, and an audio data recording unit 227 that stores audio data for a long period of time.

  The device control processing unit 221 is a processing unit that causes each device of the audio output device 2 to cooperate and operate as an audio output device. For example, an audio output function for causing the audio output device 24 to output audio data included in the broadcast data received by the broadcast receiving device 23 is realized. Details of other processing units will be described later.

  The broadcast receiving device 23 is a device that receives a signal from a connected antenna / cable and generates video / audio data based on the received signal. Functions such as tuner, decoder, demultiplexer.

  Note that the audio data buffer 226 may store the audio data temporarily or for a long time.

  The audio data buffer 226 may be a recording unit different from the audio data recording unit 227 or the same recording unit.

  Further, although the case where the audio data recording unit 227 of the audio output device 2 is included in the recording device 22 has been described as an example, the audio data recording unit 227 is a separate recording medium that is not included in the recording device 22. Alternatively, an external recording medium that is not included in the audio output device 2 may be used.

  Next, the role and data flow of each processing unit of the audio output device 2 according to the present embodiment will be described with reference to FIG.

  FIG. 5 is an example of a data flow diagram of the audio output device 2 according to the present embodiment, but a data flow when the device control processing unit 221 links the devices of the audio output device 2 is omitted.

  The audio data acquisition processing unit 222 is a processing unit that receives broadcast data including the audio data 201 via the broadcast receiving device 23 and acquires the audio data. The voice data acquisition processing unit 222 receives communication data including voice data from other devices on the network via the communication device 25, and acquires voice data. Further, the audio data acquisition processing unit 222 reads the audio data from the audio data recording unit 227 of the recording device 22 and acquires the audio data. Hereinafter, the audio data acquired by the audio data acquisition processing unit 222 is referred to as acquired audio data 201.

  The audio data acquisition processing unit 222 passes the acquired audio data 201 to the audio data transmission processing unit 225 and stores it in the audio data buffer 226.

  The time adjustment processing unit 223 is a processing unit that reads the acquired audio data 201 from the audio data buffer 226, adjusts the time, and passes the acquired audio data 201 to the audio output processing unit 224.

  The sound output processing unit 224 is a processing unit that converts the acquired sound data 201 into sound (hereinafter referred to as output sound 202) and outputs the sound by the sound output device 24.

  The audio data transmission processing unit 225 is a processing unit that generates communication data including the acquired audio data 201 and transmits the communication data to the audio output device 1 connected to the network via the communication device 25.

  Note that the audio data acquisition processing unit 222 may pass the acquired audio data 201 directly to the audio data transmission processing unit 225 or may pass it through a data buffer. This data buffer may be the audio data buffer 226 or another buffer.

  Further, when acquiring the broadcast data including the audio data 201, the audio data acquisition processing unit 222 may acquire the broadcast data by the broadcast receiving device 23 receiving the broadcast data from the antenna and the cable. May be acquired from the communication device 25 and broadcast data may be extracted.

  Next, operations of the audio output device 1 and the audio output device 2 according to the present embodiment will be described with reference to FIG.

  First, in the audio output device 2, the audio data acquisition processing unit 222 acquires the audio data 201 and stores it in the audio data buffer 226 (step 1001). Next, the audio data transmission processing unit 225 transmits communication data including the acquired audio data 201 to the audio output device 1 (step 1002).

  Next, in the audio output device 1, the audio data acquisition processing unit 122 receives communication data including the acquired audio data 201 (acquired audio data 101 for the audio output device 1) (step 1002), and acquires the audio data 201. And stored in the audio data buffer 1212 (step 1003).

  Next, in the audio output device 2, the time adjustment processing unit 223 adjusts the time of the acquired audio data 201 (step 1004), and the audio output processing unit 224 starts outputting the output audio 202 (step 1005). In step 1004, the time adjustment processing unit 223 of the audio output device 2 is sufficient for the audio output device 1 to output the output audio 102 in synchronization with the output audio 202 (the input audio 103 for the audio output device 1). The output of the output sound 202 is delayed for a long time. By doing so, it is possible to prevent that the audio data is transmitted from the device 2 to the device 1 after the output sound, and the time adjustment of the sound output in the device 1 cannot be prevented, and the synchronous output of the sound can be surely performed.

  Next, in the audio output device 1, the audio input processing unit 123 converts the output audio 202 (the input audio 103 for the audio output device 1) into audio data (step 1006). Next, the time difference measurement processing unit 124 measures the time difference from the acquired voice data 101 and the input voice data 104 (step 1007), and the time adjustment processing unit 125 adjusts the time of the acquired voice data 101 (step 1008). The audio output processing unit 126 starts outputting the output audio 102 (step 1009).

  Note that the timing of transmission of communication data including audio data (step 1002) may be after the audio data 201 is acquired in step 1001 and before being stored in the audio data buffer 226.

  Also, the audio output device 2 may transmit communication data including audio data all at once (step 1002), adjust the time (step 1004), and start audio output (step 1005). In parallel, while transmitting communication data including audio data as stream data (step 1002), the time may be adjusted (step 1004) and audio output may be started (step 1005).

  Further, the audio output device 1 may store the acquired audio data 101 in the audio data buffer 1212 (step 1003) and then measure the time difference (step 1007), or store the acquired audio data 101 in the audio data buffer 1212. The time difference may be measured in parallel (Step 1007) while (Step 1003).

  Also, in the audio output device 1, the time difference is periodically measured again (step 1007), and when the time difference information 105 is changed, the audio output time is adjusted as needed (step 1008).

  The audio output device 2 according to the present embodiment transmits the acquired audio data 101 to the audio output device 1 connected to the network. Also, the acquired audio data 101 is time-adjusted and output audio 102 is output.

  Also, the audio output device 1 according to the present embodiment acquires the acquired audio data 101 from the audio output device 2 connected to the network. Also, the output sound 202 output from the sound output device 2 (the input sound 103 for the sound output device 1) is converted into the input sound data 104, and a time at which a certain characteristic portion in the acquired sound data 101 can be output, and the input sound data The time difference from the time when the same or similar feature portion 104 appears is measured. Further, the acquired audio data 101 is time-adjusted by the time difference, and the output audio 101 is output.

  For this reason, the audio | voice output apparatus, system, and method which can be synchronized without using a time stamp can be provided. For example, the audio output device 1 and the audio output device 2 can output audio synchronously without processing the acquired audio data 101 and adding a time stamp.

  For example, when the audio output device 1 is a mobile terminal and the audio output device 2 is a television, the user can add a time stamp to the audio data without adding a function to the mobile terminal or the television. The user can hold the mobile terminal while watching the TV and listen to the sound output in synchronization with the TV and the mobile terminal.

  In the present embodiment, the acquired audio data 101 has been described using an example in which the audio output device 2 is the acquired audio data 201 passed to the audio output device 1, but the acquired audio data 101 is an audio output device. 1 may be voice data that is independently acquired via the communication device 15 or the like. In that case, even if the audio output device 2 does not pass the acquired audio data 201 to the audio output device 1, the same effect as in the present embodiment can be obtained.

  For example, when the output sound 202 of the sound output device 2 is a television broadcast sound and the sound output device 1 includes a broadcast receiving device, the sound output device 2 outputs the broadcast ID from which the acquired sound data 201 is acquired. The audio output device 1 can acquire the same audio data as the acquired audio data 201 by transmitting the broadcast data with the broadcast receiving device of its own device just by passing it to the device 1, and transmits a large amount of audio data via the network. The output sound 102 can be output in synchronism with the output sound 202 without being performed.

  In addition, for example, when the audio output device 1 includes a matching audio data acquisition processing unit that extracts features of the input audio data 104 and acquires matching audio data from another device, the audio output device 2 to the audio output device 1, the audio output device 1 can acquire the same audio data as the acquired audio data 201 by itself, and the output audio can be output without connecting the audio output device 2 and the audio output device 1 to the network. The output sound 102 can be output in synchronism with 202.

  In the present embodiment, in addition to the first embodiment, an example in which the audio output device 1 adjusts the volume of the output audio 102 in consideration of the volume of the input audio 103 will be described.

  First, the concept of the system in the present embodiment will be described with reference to FIG.

  As shown in FIG. 7A, the system of this embodiment includes an audio output device 1 and an audio output device 2. The sound output from the sound output device 2 reaches the user and the sound output device 1. The sound output from the sound output device 1 reaches the user. The audio output device 1 and the audio output device 2 are connected via a network, and audio data is transmitted from the audio output device 2 to the audio output device 1.

  In FIG. 7B, when the volume of the input voice 103 is high, the volume of the output voice 102 is adjusted to be low. In FIG. 7C, when the volume of the input voice 103 is low. Indicates that the volume of the output sound 102 is adjusted to increase.

  Next, a schematic configuration of the audio output device 1 according to the present embodiment will be described with reference to FIG.

  8 is obtained by adding an input volume measurement processing unit 127, a volume management processing unit 128, an output volume adjustment processing unit 129, and a volume information management database 1211 to the recording device 12 of the audio output device 1 of FIG. is there. Other configurations have the same functions as the configurations already described with the same reference numerals, and thus the description thereof is omitted.

  The volume information management database 1211 is a database used by the volume management processing unit 128 for storing volume information and determining the output volume. Details will be described later.

  Details of other processing units will be described later.

  Next, the role and data flow of each processing unit of the audio output device 1 according to the present embodiment will be described with reference to FIG.

  9 adds an input volume measurement processing unit 127, a volume management processing unit 128, an output volume adjustment processing unit 129, a volume information management database 1211, and a data flow related thereto to the data flow diagram of FIG. It is a thing. The other processing units and data flow have the same functions and the same relationship as the processing units and data flows that have already been described with the same reference numerals, and a description thereof will be omitted.

  The device control processing unit 121 is a processing unit that links each device of the audio output device 1. In the present embodiment, a process of generating the set volume information 107 including the volume information set by the user operating the operation input device 16 and passing it to the volume management processing unit 128 will be described as an example.

  The voice input processing unit 123 further passes the input voice data 104 to the input volume measurement processing unit 127 in addition to FIG.

  The input volume measurement processing unit 127 is a processing unit that measures the volume of audio data. The volume of the input voice data 104 received from the voice input processing unit 123 is measured, the input volume information 106 including information on the measured volume is generated, and passed to the volume management processing unit 128.

  The volume management processing unit 128 is a processing unit that uses the volume information management database 1211 to store volume information and determine the determination of the output volume. The set volume information 107 received from the device control processing unit 121 and the input volume information 106 received from the input volume measurement processing unit 127 are recorded in the volume information management database 1211. Further, the output volume is determined according to the determination condition and the volume adjustment method of the volume information management database 1211. Also, output volume information 108 including information on the output volume is generated and passed to the output volume adjustment processing unit 129. Details of the volume information management database 1211 will be described later.

  The output volume adjustment processing unit 129 is a processing unit that adjusts the volume of output sound. From the output volume information 108 received from the volume management processing unit 128, the output volume information 109 of the own device is generated and passed to the audio output processing unit 126.

  In addition to FIG. 3, the audio output processing unit 126 further receives the output volume information 109 of its own device from the output volume adjustment processing unit 129, adjusts the volume of the output audio 102, and outputs it.

  Note that the voice input processing unit 123 may pass the input voice data 104 directly to the input volume measurement processing unit 127 or may pass it through a data buffer. This data buffer may be the audio data buffer 1212 or another buffer.

  The output volume determination process in the volume management processing unit 128 may be determined based on information managed by the volume information management database 1211. Alternatively, the determination process may be implemented by providing a conditional branch in the program. You may decide without using.

  Next, operations of the audio output device 1 and the audio output device 2 according to the present embodiment will be described with reference to FIG.

  First, in the audio output device 1, when the user operates the operation input device 16 to set the volume, the volume management processing unit 128 stores the set volume information 107 passed from the device control processing unit 121 in the volume information management database 1211. Save (step 2001).

  The next steps 2002 to 2009 are the same processes as steps 1001 to 1008 in FIG.

  Next, in the audio output device 1, the input volume measurement processing unit 127 measures the volume of the input audio data 104 and passes it to the volume management processing unit 128, and the volume management processing unit 128 stores it in the volume information management database 1211. (Step 2010). Next, the volume management processing unit 128 determines the output volume information 108 according to the determination condition and volume adjustment method of the volume information management database 1211 (step 2011).

  Next, the output volume adjustment processing unit 129 adjusts the volume of the output sound 102 according to the determined output volume information 108 (Step 2012), and the sound output processing unit 126 starts outputting the output sound 102 (Step 2013). ).

  Note that the timing of the volume setting by the user operation and the saving of the set volume (step 2001) in the audio output device 1 is arbitrary. For example, it may be before audio data conversion (step 2007), after it, or in parallel. Further, it may be after the audio output start (step 2013) in the audio output device 1. When the set volume is changed, the volume information management database 1211 is updated as needed (step 2001), and the output volume is determined again (step 2011).

  In addition, the volume of the input audio data 104 in the audio output device 1 is periodically measured again (step 2010). When the input volume information 106 is changed, the volume information management database 1211 is updated at any time (step 2010). 2010), the output volume is re-determined (step 2011).

  Further, the process of measuring and saving the input volume (step 2010) and determining the output volume (step 2011) may be after the process of measuring the time difference (step 2008) and adjusting the time (step 2009). , It may be done before or in parallel.

  Further, the adjustment of the output volume (step 2012) may be performed before or after the sound output (step 2013), or may be performed simultaneously in parallel.

  Next, the volume information management database 1211 according to the present embodiment will be described with reference to FIG.

  11A and 11C show examples of volume information managed by the volume information management database 1211. FIG. The volume information includes set volume information 12111 (X), input volume information 12112 (Y) from an external device, output volume information 12113 (Z) of the own device, and maximum output volume information 12114 (Zmax) of the own device. Consists of. The set volume information 107 in FIG. 9 corresponds to X in FIG. 11, the input volume information 106 in FIG. 9 corresponds to Y in FIG. 11, and the output volume information 109 of the own device in FIG. 9 corresponds to Z in FIG. Is done. Here, the own device indicates the audio output device 1 and the external device indicates the audio output device 2.

  Here, the maximum output volume information 12114 (Zmax) of the own device is information on the maximum volume allowed from the aspect of comfort when output by the own device, and in this embodiment, the maximum output volume information 12114 (Zmax) is not changed during use. An example will be described. In general, the audio output device 14 is often uncomfortable for the user because the sound is cracked or distorted when output at a volume close to the maximum outputable volume. For this reason, if the maximum volume allowed from the aspect of comfort is used instead of the maximum outputable volume, the user's voice listening environment can be optimized.

  Note that the maximum output volume information 12114 (Zmax) of the own device may be information on the maximum volume allowed in terms of comfort when output by the own device, or the maximum volume that can be output by the own device. It may be information.

  (A) is an example of volume information before determining the output volume, and indicates that X is 13, Y is 3, Z is 9, and Zmax is 15. (C) is an example of volume information after the output volume is determined, and indicates that X is 13, Y is 3, Z is 10, and Zmax is 15.

  FIG. 11B shows an example of output volume determination information for the volume management processing unit 128 to determine the output volume. The output volume determination information includes a determination priority order 12115 indicating the order in which the determination conditions are applied, a determination condition 12116 for deriving the volume adjustment method of the own device from the current volume information, and a volume adjustment method 12117 of the own device.

  For example, when the volume information (a) before determining the output volume is applied to the output volume determination information (b), the determination is first made with the determination condition “X> Zmax” of the determination priority order 1. Since the determination result is false, the determination is performed under the determination condition “X> Y + Z” of determination priority order 2. Since the determination result is true, the volume of the own device is increased by 1 according to the volume adjustment method “Raise only XYZ”. As a result, the volume information (c) after determining the output volume is obtained. Z is 9 in the volume information (a) before determining the output volume, but Z is 10 in the volume information (c) after determining the output volume as a result of increasing the volume of the own device by 1.

  In this embodiment, the case where the user operates to specify the set volume has been described as an example. However, the output volume of the audio output device 1 may be changed regardless of the setting of the user's set volume. good. In this case, for example, the volume management processing unit 128 calculates the sum of the input volume (Y) from the external device and the output volume (Z) of the own device immediately after the user changes the output volume of the audio output device 1. And saved as set volume information (X).

  In addition to the first embodiment, the audio output device 1 according to the present embodiment outputs the output volume information 108 based on the set volume information 107 by user operation and the input volume information 106 obtained by measuring the volume of the input audio data 104. Get.

  Therefore, it is possible to provide an audio output device, system and method capable of synchronously outputting at an appropriate volume without passing time stamps and volume information between devices. For example, the audio output device 1 and the audio output device 2 can synchronize and output audio at an appropriate volume without processing the acquired audio data 101 and adding a time stamp or volume information.

  For example, the audio output device 1 is a mobile terminal, the audio output device 2 is a television, and the user places the mobile terminal at hand while watching the TV, and listens to the audio output in synchronization with the TV and the mobile terminal. Assuming that

  When the user moves away from the television with the mobile terminal, the volume of the television that reaches the user and the mobile terminal decreases. At this time, the mobile terminal according to the present embodiment increases the volume of the output sound so as to compensate for the decreased volume. Conversely, when the user approaches the television, the volume of the television that reaches the user and the mobile terminal increases, and the mobile terminal decreases the volume of the output sound. For this reason, the user can always listen to the sound of the same volume regardless of the distance from the television.

  In this embodiment, in addition to the second embodiment, an example in which the audio output device 1 controls the audio output device 2 to adjust the volume of the output audio 202 will be described.

  First, the concept of the system in the present embodiment will be described with reference to FIG.

  As shown in FIG. 12, the system of the present embodiment includes an audio output device 1 and an audio output device 2. The sound output from the sound output device 2 reaches the user and the sound output device 1. The sound output from the sound output device 1 reaches the user. The audio output device 1 and the audio output device 2 are connected via a network, and audio data is transmitted from the audio output device 2 to the audio output device 1.

  Further, the sound volume control information is transmitted from the sound output device 1 to the sound output device 2.

  Next, a schematic configuration of the audio output device 1 according to the present embodiment will be described with reference to FIG.

  FIG. 13 is obtained by adding an external device control processing unit 1210 to the recording device 12 of the audio output device 1 of FIG. Other configurations have the same functions as the configurations already described with the same reference numerals, and thus the description thereof is omitted.

  Details of the external device control processing unit 1210 will be described later.

  Next, the role and data flow of each processing unit of the audio output device 1 according to the present embodiment will be described with reference to FIG.

  FIG. 14 is obtained by adding an external device control processing unit 1210 and a data flow related thereto to the data flow diagram of FIG. The other processing units and data flow have the same functions and the same relationship as the processing units and data flows that have already been described with the same reference numerals, and a description thereof will be omitted.

  In addition to FIG. 9, the output volume adjustment processing unit 129 further generates output volume information 110 of the external device and passes it to the external device control processing unit 1210.

  The external device control processing unit 1210 generates communication data including the volume control information 111 from the output volume information 110 of the external device received from the output volume adjustment processing unit 129, and transmits the communication data to the audio output device 2 connected to the network. It is a processing part which transmits via. The volume control information 111 is information for controlling the volume of the audio output device 2. The volume control information 111 may be an amount and a direction for changing the volume of the audio output device 2, or may be a volume set by the audio output device 2. For example, when the volume of the audio output device 2 is changed from the current 8 to 10, “the volume is increased by 2 units” or “the volume is set to 10” may be used.

  Next, a schematic configuration of the audio output device 2 according to the present embodiment will be described with reference to FIG.

  FIG. 15 is obtained by adding an output volume adjustment processing unit 228 to the recording device 22 of the audio output device 2 of FIG. Other configurations have the same functions as the configurations already described with the same reference numerals, and thus the description thereof is omitted.

  Details of the output volume adjustment processing unit 228 will be described later.

  Next, the role and data flow of each processing unit of the audio output device 2 according to the present embodiment will be described with reference to FIG.

  FIG. 16 is obtained by adding an output volume adjustment processing unit 228 and a data flow related thereto to the data flow diagram of FIG. The other processing units and data flow have the same functions and the same relationship as the processing units and data flows that have already been described with the same reference numerals, and a description thereof will be omitted.

  The device control processing unit 221 is a processing unit that links the devices of the audio output device 2 together. In this embodiment, communication data including volume control information 203 (volume control information 111 for the audio output device 1) is received from the audio output device 1 on the network via the communication device 25, and the volume control information 203 is extracted. The processing will be described as an example. The device control processing unit 221 passes the extracted volume control information 203 to the output volume adjustment processing unit 228.

  The output volume adjustment processing unit 228 generates the output volume information 204 of its own device from the volume control information 203 received from the device control processing unit 221 and passes it to the audio output processing unit 224.

  In addition to FIG. 5, the audio output processing unit 224 further receives the output volume information 204 of its own device from the output volume adjustment processing unit 228, adjusts the volume of the output audio 202, and outputs it.

  Next, operations of the audio output device 1 and the audio output device 2 according to the present embodiment will be described with reference to FIG.

  Steps 3001 to 3010 are the same processes as steps 2001 to 2010 in FIG.

  Next, in the audio output device 1, the volume management processing unit 128 determines the output volume information 109 of the own device and the output volume information 110 of the external device according to the determination condition and the volume adjustment method of the volume information management database 1211 (step 3011). Next, the external device control processing unit 1210 generates communication data including the volume control information 111 and transmits the communication data to the audio output device 2 via the communication device 15 (step 3012).

  Next, in the audio output device 2, the device control processing unit 221 acquires communication data including the volume control information 203 (the volume control information 111 for the audio output device 1) via the communication device 25 (step 3012). Volume control information 203 is acquired. Next, the output volume adjustment processing unit 228 adjusts the volume of the output sound 202 according to the volume control information 203 (step 3013).

  In the audio output device 1, the generation of communication data including the volume control information 111 and the transmission to the audio output device 2 (step 3012) may be performed after the volume adjustment (step 3014) processing of the output audio 102. It may be done before or in parallel.

  Further, the adjustment of the output volume (step 3014) of the audio output device 1 may be performed before or after the audio output (step 3015), or may be performed simultaneously in parallel.

  Further, the audio output device 1 gives an example in which the volume control information 111 (volume control information 203 for the audio output device 2) is passed to the audio output device 2 via the network and the volume of the audio output device 2 is controlled. Although described, the volume of the audio output device 2 may be controlled by another route. For example, when the voice output device 1 includes an infrared transmission device and the infrared remote controller of the voice output device 2 controls a volume, the infrared transmission device transmits the same signal as the infrared signal that is transmitted. The volume of the audio output device 2 may be controlled.

  The volume control information 203 may be the volume control information 111 or another volume control information that performs the same control.

  Next, the volume information management database 1211 according to this embodiment will be described with reference to FIG.

  FIG. 18 is different from FIG. 11 in the items and data of the output volume determination information (b) and the data of the volume information (c) after the output volume determination. The other items and data have the same meaning as the items and data having the same reference numerals already described, and therefore their explanation is omitted.

  The set volume information 107 in FIG. 14 corresponds to X in FIG. 18, the input volume information 106 in FIG. 14 corresponds to Y in FIG. 18, and the output volume information 109 of the own device in FIG. 14 corresponds to Z in FIG. Is done.

  The volume information (c) after determining the output volume in FIG. 18 indicates that X is 13, Y is 0, Z is 13, and Zmax is 15.

  The output volume determination information (b) of FIG. 18 further includes a volume adjustment method 12118 of an external device in addition to FIG.

  For example, when the volume information (a) before determining the output volume is applied to the output volume determination information (b), the determination is first made with the determination condition “X ≦ Zmax” of the determination priority order 1. Since the determination result is true, the volume of the own device is set to 13 according to the volume adjustment method “X” of the own device. Further, the volume of the external device is set to 0 in accordance with the volume adjustment method “0” of the external device. As a result, the volume information (c) after determining the output volume is obtained. In the volume information (a) before determining the output volume, Y is 3 and Z is 9, but as a result of setting the volume of the own device to 13 and the volume of the external device to 0, the volume information (c) after determining the output volume Then, Y is 0 and Z is 13.

  Also, when the determination result under the determination condition of determination priority order 2 is true, the volume adjustment method of the external device is “adjust so that X = Zmax + Y”. The volume control information 203 (volume control information 111 for the audio output device 1) determines how much the volume of the output audio 202 of the external device should be increased and how much the volume of the input audio 103 that has reached the device increases. Varies depending on the distance and environment between the device and the external device. For this reason, for example, the volume control information 203 slightly changes the volume of the external device, measures the change in volume of the input voice 103 at that time, and adjusts until the desired input volume is reached.

  In this embodiment, the case where “0” is used as the volume adjustment method of the external device when the determination condition is “X ≦ Zmax” has been described as an example. For example, the volume of the own device may be slightly lowered from “X”, and the volume of the external device may be increased accordingly.

  In addition to the second embodiment, the audio output device 1 according to the present embodiment determines the volume adjustment method of the external device, transmits the volume control information to the audio output device 2, and controls the volume of the audio output device 2.

  Therefore, it is possible to provide an audio output device, system, and method that can perform synchronous output at an appropriate volume without using a time stamp and without including volume information in the audio data. For example, the audio output device 1 and the audio output device 2 can synchronize and output audio at an appropriate volume without processing the acquired audio data 101 and adding a time stamp or volume information.

  For example, the audio output device 1 is a mobile terminal, the audio output device 2 is a television, and the user places the mobile terminal at hand while watching the TV, and listens to the audio output in synchronization with the TV and the mobile terminal. Assuming that

  When the user is away from the television with the mobile terminal, the volume of the television reaching the user and the mobile terminal is small. At this time, the mobile terminal according to the present embodiment outputs sound at the set volume and sets the output volume of the television to zero. For this reason, the user can listen to the sound with the sound volume as set without causing the TV to output the sound with a high sound volume and disturbing other people around.

  The embodiment of the present invention has been described above.

  In addition, this invention is not limited to an above-described Example, Various modifications are included. For example, the above-described embodiments have been described in detail for easy understanding of the present invention, and are not necessarily limited to those having all the configurations described. Further, a part of the configuration of one embodiment can be replaced with the configuration of another embodiment, and the configuration of another embodiment can be added to the configuration of one embodiment. Further, it is possible to add, delete, and replace other configurations for a part of the configuration of each embodiment.

  Each of the above-described configurations, functions, processing units, processing means, and the like may be realized by hardware by designing a part or all of them with, for example, an integrated circuit. Each of the above-described configurations, functions, and the like may be realized by software by interpreting and executing a program that realizes each function by the processor. Information such as programs, tables, and files that realize each function can be stored in a recording device such as a memory, hard disk, or SSD (Solid State Drive), or a recording medium such as an IC card, SD card, DVD, or BD. it can.

  Further, the control lines and information lines indicate what is considered necessary for the explanation, and not all the control lines and information lines on the product are necessarily shown. Actually, it may be considered that almost all the components are connected to each other.

DESCRIPTION OF SYMBOLS 1 Audio | voice output apparatus 11 Control apparatus 12 Recording apparatus 13 Audio | voice input apparatus 14 Audio | voice output apparatus 15 Communication apparatus 16 Operation input apparatus 17 Display apparatus 2 Audio | voice output apparatus 21 Control apparatus 22 Recording apparatus 23 Broadcast receiving apparatus 24 Audio | voice output apparatus 25 Communication apparatus 26 Operation input device 27 Display device

Claims (2)

An information terminal that outputs audio connected to a network with an information device that outputs audio,
A voice input unit for inputting voice output from the information device;
A communication unit that receives audio data transmitted from the information device via a network;
An audio output unit for outputting audio based on the audio data;
The input voice is converted into voice data, a time difference is measured by comparing the received voice data with a predetermined feature portion, and a voice output from the information device is based on the measured time difference. And a control unit that outputs sound in synchronization with each other,
Information the control unit, along with increasing the volume of the audio to be output from the self-device, and wherein the Rukoto to transmit control information for reducing the volume of sound output from the information device from the communication unit to the information device Terminal. A system comprising an information device that outputs audio connected to a network and an information terminal that outputs audio,
The information device is
An audio acquisition unit for acquiring audio data;
An audio output unit for outputting audio based on the audio data;
A communication unit for transmitting the audio data via a network;
A control unit,
The information terminal
A voice input unit for inputting voice output from the information device;
A communication unit that receives audio data transmitted from the information device via a network;
An audio output unit for outputting audio based on the audio data;
A control unit,
The control unit of the information terminal converts the input voice into voice data, measures the time difference by comparing the received voice data with a predetermined feature portion, and based on the measured time difference , And synchronize with the audio output from the information equipment,
The control unit of the information terminal further determines the volume of the output voice based on the volume of the input voice,
The control unit of the information device adjusts the time so that the information terminal can perform a sound output synchronized with a sound output from the own device based on the input sound and the received sound data. To output sound,
The control unit of the information terminal increases the volume of the sound output from the own device and causes the communication unit to transmit control information for decreasing the volume of the sound output from the information device to the information device,
In the information device, when the communication unit receives control information for reducing the volume of the sound output from the information device from the information terminal, the control unit decreases the volume of the output sound. A system characterized by

Images