JP6152696B2 - Terminal device, program thereof, and electronic system - Google Patents

Description

  The present invention relates to a technique for specifying the position of a user.

2. Description of the Related Art An audio signal processing device that forms a sound field based on a synthesized sound image with a plurality of speakers is known. For example, some audio sources, such as DVDs (Digital Versatile Discs), record multichannel audio signals such as 5.1 channels. Audio signal processing systems for reproducing such audio sources are becoming popular in ordinary households. When reproducing a multi-channel audio source, each speaker is arranged at a recommended position in the listening room, and a sound reproduction effect such as surround is obtained when the user views at a predetermined reference position.
Since the sound reproduction effect is based on the premise that a plurality of speakers are arranged at recommended positions and the user views at the reference position, a desired sound effect can be obtained when the user views at a position different from the reference position. I can't. Patent Document 1 discloses a technique for correcting an audio signal so as to obtain a desired acoustic effect based on user position information.
Japanese Patent Application Laid-Open No. 2004-228561 discloses a technique for acquiring user position information by analyzing an image taken by a user with a camera. Furthermore, a schematic diagram of the listening room is displayed on the touch panel on the terminal device, and the user's position information is acquired by touching the user with the viewing position, or the user is acquired using GPS (Global Positioning System). It is conceivable to acquire the position information.

JP 2000-354300 A

JP-A-6-266498

  However, the mode of capturing a user with a camera has a problem in that the configuration is complicated and the processing load for image recognition processing is large. In addition, there is a problem that the error is large in the mode in which the user touches the screen in the terminal device. Furthermore, in the aspect using GPS, there is a problem that radio waves cannot be received indoors from a satellite, and accuracy is poor and time is required.

  The present invention has been made in view of the above-described circumstances, and an object thereof is to accurately measure the position of the user with a simple configuration.

In order to solve the above-described problems, a program for a terminal device according to the present invention includes an input unit through which a user can input an instruction, a direction sensor that detects a direction in which the terminal device is facing, and a processor. When the user inputs, using the input unit, that the terminal device is facing one of the first target and the second target, the direction of the processor is a program of the terminal device A first acquisition unit configured to acquire first direction information indicating a direction in which the one target is viewed from the terminal device based on an output signal of the sensor; and the terminal device includes the first target and the second target. When the user inputs using the input unit that he / she is facing the other target, second direction information indicating a direction in which the other target is viewed from the terminal device based on an output signal of the direction sensor. First to get Based on the acquisition unit, the first target position information indicating the position of the first target, the second target position information indicating the position of the second target, and the first direction information and the second direction information. A position information generation unit that generates user position information indicating the position of the user, and a reference position that serves as a reference for the coordinate system of the first target position information and the second target position information. When the user inputs using the input unit that he / she is facing a predetermined target, the first direction is caused to function as a reset control unit that resets an angle specified based on an output signal of the direction sensor. The information indicates an angle formed between a reference straight line passing through the reference position and the predetermined target and a first straight line passing through the user position and the one target, and the second direction information is the reference straight line. And the user Position and showing a second angle which the straight line and forms through the other target.

According to the present invention, the user can generate user position information by operating the input unit with the terminal device facing each of the first target and the second target whose positions are known. The position of the user can be specified with a simple configuration with high accuracy and in a short time. Note that the terminal device program may be downloaded from a site on the Internet, for example, or may be recorded on a recording medium.
Further, according to the present invention, when an acceleration sensor or a gyro sensor that detects a relative direction is used as the direction sensor, the angle is reset based on a predetermined target. Can be obtained. In addition, when an azimuth sensor that detects an absolute direction is used as the direction sensor, an angle based on a predetermined target can be obtained.

  In the terminal device program described above, it is preferable that the one target is the first target, and the other target is the second target. According to this invention, it is determined that the first direction information acquired by the first acquisition unit is the direction of the first target, and the second direction information acquired by the second acquisition unit is the direction of the second target. It has been. For this reason, it is not necessary to determine whether the first direction information and the second direction information correspond to the first target or the second target. Therefore, the processing load on the terminal device can be reduced.

  In the terminal device program described above, the position information generation unit may determine whether each of the first direction information and the second direction information is based on an angle indicated by the first direction information and an angle indicated by the second direction information. It is determined which of the first target and the second target corresponds, and the determination result, the first target position information, the second target position information, and the first direction information Preferably, the user position information is generated based on the second direction information. According to the present invention, even if the user specifies the direction using the input unit without distinguishing between the first target and the second target, the user is determined in the position information generation unit. Specifying the direction becomes easier.

Next, a terminal device according to the present invention includes an input unit through which a user can input an instruction, a direction sensor that detects a direction in which the terminal device is facing, and the terminal device includes a first target and a second target. A first direction indicating a direction in which the one target is viewed from the terminal device based on an output signal of the direction sensor when the user inputs using the input unit that the target is facing one of the targets. When the user inputs using the input unit that the first acquisition unit that acquires information and the terminal device is facing the other target of the first target and the second target, the direction A second acquisition unit configured to acquire second direction information indicating a direction in which the other target is viewed from the terminal device based on an output signal of the sensor; first target position information indicating a position of the first target; Second target position information indicating the position of the second target And based on the first direction information and the second direction information, and position information generating unit for generating a user position information indicating the position of the user, the terminal device is the first target position information and the The angle specified based on the output signal of the direction sensor when the user inputs using the input unit that the user is pointing to a predetermined target at a reference position serving as a reference in the coordinate system of the second target position information. and a reset controller for resetting the said first direction information, makes a reference straight line passing through the reference position and the predetermined target, a first straight line passing through the position and the one of the goals of the user The second direction information indicates an angle formed by the reference straight line and the second straight line passing through the user position and the other target.

  According to the present invention, the user can generate user position information by operating the input unit with the terminal device facing each of the first target and the second target whose positions are known. The position of the user can be specified with a simple configuration with high accuracy and in a short time. Such a terminal device corresponds to a smartphone, a remote control device, or the like.

Next, an electronic system according to the present invention is an electronic system including a terminal device and an electronic device, and the terminal device is suitable for an input unit through which a user can input an instruction and the terminal device. When the user inputs using the input unit that the direction sensor detects the direction and the terminal device is facing one of the first target and the second target, the output signal of the direction sensor A first acquisition unit that acquires first direction information indicating a direction in which the one target is viewed from the terminal device, and the terminal device faces the other of the first target and the second target. When the user inputs using the input unit, the second acquisition unit acquires second direction information indicating the direction in which the other target is viewed from the terminal device based on the output signal of the direction sensor. The terminal device or the power supply The device is based on the first target position information indicating the position of the first target, the second target position information indicating the position of the second target, and the first direction information and the second direction information. A position information generating unit that generates user position information indicating the position of the user, and a reference position at which the terminal device serves as a reference for the coordinate system of the first target position information and the second target position information. A reset control unit that resets an angle specified based on an output signal of the direction sensor when the user inputs using the input unit that the user is facing a predetermined target, the first direction information is , An angle formed by a reference straight line passing through the reference position and the predetermined target and a first straight line passing through the user position and the one target, and the second direction information includes the reference straight line, The location of the user and It indicates an angle formed between the second straight line passing through the serial other goals, the electronic device, based on user location information generated by the position information generation unit, a control unit for controlling the electronic device.

  According to this electronic system, the position of the user can be specified with a simple configuration with high accuracy and in a short time, and the electronic device can be controlled using the user position information. Such an electronic system is applicable to, for example, an air conditioner system, a lighting system, an image system, an audio system, and the like.

  In the electronic system described above, the electronic device is an audio signal processing device that supplies an output audio signal to each of a plurality of speakers including a first speaker and a second speaker, wherein the first target is the A first speaker; the second target is the second speaker; and the control unit applies an acoustic effect to the input audio signal based on the user position information generated by the position information generation unit. It is preferable that the output audio signal to which is given is a signal generator for generating each of the plurality of speakers. In order to give a desired sound effect, it is preferable to specify the positions of a plurality of speakers and the positions of users. According to the present invention, the positions are known to the first speaker and the second speaker. The position of the user can be specified by operating the input unit of the terminal device toward them. Therefore, according to the present invention, the position of the user can be specified with a simple configuration with high accuracy and in a short time, and an acoustic effect can be provided using the user position information.

It is a block diagram which shows the structural example of 1 A of audio signal processing systems which concern on embodiment. It is a top view which shows arrangement | positioning of speaker SP1-SP5 in a listening room. 2 is a block diagram illustrating an example of a hardware configuration of a terminal device 10. FIG. FIG. 3 is a block diagram showing an example of a hardware configuration of the audio signal processing device 20. It is a top view which shows arrangement | positioning of the microphone M at the time of measuring the distance of speaker SP1-SP5. It is a flowchart which shows the content of the measurement process of the distance between several speakers SP1-SP5 and the reference position Pref. It is a flowchart which shows the processing content of a direction measurement process. It is explanatory drawing which shows an example of the image displayed on a display part in a direction measurement process. It is explanatory drawing which shows an example of the image displayed on a display part in a direction measurement process. It is explanatory drawing which shows an example of calculation of the position of speaker SP3. It is a flowchart which shows the content of the specific process of the predetermined position P. It is explanatory drawing which shows an example of the image displayed on a display part in the specific process of the predetermined position P. FIG. It is explanatory drawing for demonstrating the calculation method of the coordinate of the predetermined position P. FIG. It is a functional block diagram which shows the function structure of the audio signal processing system 1A. It is a functional block diagram which shows the function structure of the audio signal processing system 1B. It is explanatory drawing which shows each area | region which divided | segmented the listening room. It is explanatory drawing which shows the angle measured in each area | region where the predetermined position P belongs. It is a perspective view which shows an example of a listening room. It is a perspective view which shows the example which has arrange | positioned speaker SP1-SP7 in three dimensions.

Embodiments of the present invention will be described below with reference to the drawings.
<Configuration of audio signal processing system>
FIG. 1 shows a configuration example of an audio signal processing system according to the first embodiment. The audio signal processing system 1A includes a terminal device 10 such as a smartphone, an audio signal processing device 20, and speakers SP1 to SP5. The terminal device 10 is a communication device such as a smartphone and can communicate with the audio signal processing device 20. The form of communication may be either wireless or wired, but for example, communication is possible via a wireless LAN (Local Area Network). Further, the terminal device 10 can download an application program from a predetermined site on the Internet. Such application programs include a program used for measuring each direction of the plurality of speakers SP1 to SP5 and a program for specifying the position of the user.

  The audio signal processing device 20 is a so-called multichannel amplifier. The audio signal processing device 20 generates output audio signals OUT1 to OUT5 obtained by adding sound effects to the input audio signals IN1 to IN5, and supplies OUT1 to OUT5 to the speakers SP1 to SP5. The speakers SP1 to SP5 are connected to the audio signal processing device 20 by wire or wirelessly.

  FIG. 2 shows an arrangement example of the speakers SP1 to SP5 in the listening room of the audio signal processing system 1A. In this example, five speakers SP1 to SP5 are arranged in the listening room, but the number of speakers is not limited to five, and may be four or less, or may be six or more. . In this case, the number of input audio signals may be 4 or less, or 6 or more. For example, a so-called 5.1 surround system may be obtained by adding a subwoofer speaker.

In this audio signal processing system 1A, the positions of the speakers SP1 to SP5 in the listening room are known. In this example, the speaker SP1 is disposed in front of the reference position Pref, the speaker SP2 is disposed obliquely to the right of the reference position Pref, the speaker SP3 is disposed obliquely to the right of the reference position Pref, and the speaker SP4 is disposed at the reference position Pref. The speaker SP5 is arranged diagonally to the left of the reference position Pref. When the user U views a sound emitted from the speakers SP1 to SP5 at a predetermined position (hereinafter referred to as “reference position Pref”), a desired acoustic effect is obtained. In this example, it is assumed that the user U views at a predetermined position P different from the reference position Pref.
In this case, if the predetermined position P can be specified, the audio signal processing apparatus 20 can adjust the sound imparting effect to obtain sound effects such as surround sound and virtual sound source. In the present embodiment, when two speakers out of the speakers SP1 to SP5 whose positions are known are set as the first target and the second target, the first target direction and the second target viewed from the predetermined position P are used. The predetermined position P is specified based on the direction.

  FIG. 3 shows an example of the hardware configuration of the terminal device 10. The terminal device 10 displays a CPU 100 that functions as a control center of the entire device, a memory 110 that functions as a work area of the CPU 100, stores a program such as an application program, an operation unit 120 that allows a user to input instructions, and displays operation details. Display unit 130, communication interface 140 that communicates with the outside, gyro sensor 151, acceleration sensor 152, and direction sensor 153.

  The gyro sensor 151 outputs rotation angles of the X axis, the Y axis, and the Z axis that are orthogonal to the attitude of the terminal device 10. From these angles, the direction in which the terminal device 10 is facing can be specified. The acceleration sensor 152 measures an acceleration component applied to the terminal device 10 with respect to the X axis, the Y axis, and the Z axis that are orthogonal to each other. In this case, the acceleration measured by the acceleration sensor 152 is represented by a three-dimensional vector, and the direction in which the terminal device 10 is facing can be specified based on the three-dimensional vector. The direction sensor 153 measures the direction by detecting geomagnetism, for example. With this orientation, the direction in which the terminal device 10 is facing can be specified. However, the signals output from the gyro sensor 151 and the acceleration sensor 152 are the three-axis coordinate system of the terminal device 10 and not the coordinate system fixed to the listening dream. Therefore, the directions measured by the gyro sensor 151 and the acceleration sensor 152 are relative. That is, a certain target fixed in the listening room is used as a reference, and an angle with respect to the reference is obtained as a relative direction. On the other hand, the signal output from the orientation sensor 153 is an orientation on the earth and indicates an absolute direction.

The CPU 100 measures the direction in which the terminal device 10 is directed using at least one output of the gyro sensor 151, the acceleration sensor 152, and the direction sensor 153 by executing the application program. The terminal device 10 of this example includes the gyro sensor 151, the acceleration sensor 152, and the direction sensor 153, but may include at least one of them. The gyro sensor 151 and the acceleration sensor 152 output an angle. The angle is a value relative to some standard. The standard may be any predetermined target within the listening room. In this example, the predetermined target is the speaker SP1. That is, the speaker SP1 viewed from the reference position Pref is the angle reference.
On the other hand, when the direction of the plurality of speakers SP1 to SP5 is measured using the direction sensor 153, it is not necessary to input the reference direction. This is because the direction sensor 153 outputs a value indicating an absolute direction.

  An audio signal processing device 20 shown in FIG. 4 includes a CPU 210 that functions as a control center of the entire device, a communication interface 220 that performs communication with the outside, a memory 230 that stores programs and data and functions as a work area of the CPU 210, and a microphone. An external interface 240 that receives a signal from an external device and supplies the signal to the CPU 210, a reference signal generation circuit 250 that generates reference signals Sr1 to Sr5, a selection circuit 260, and a processing unit 270 are provided. The processing unit 270 outputs audio signals O1 to O5 obtained by applying an acoustic effect to the input audio signals IN1 to IN5 based on the positions of the speakers SP1 to SP5 and the predetermined position P that the user U views. Generated for each of ~ SP5.

  The reference signal generation circuit 250 generates reference signals Sr1 to Sr5 and outputs them to the selection circuit 260 under the control of the CPU 210. The CPU 210 generates the reference signal generation circuit 250 so as to generate the reference signals Sr1 to Sr5 when measuring the distances of the plurality of speakers SP1 to SP5. In addition, the CPU 210 selects the reference signals Sr1 to Sr5 when measuring the distances of the plurality of speakers SP1 to SP5, and outputs audio signals obtained by selecting the audio signals O1 to O5 when applying acoustic effects. The selection circuit 260 is controlled to supply OUT1 to OUT5 to each of the plurality of speakers SP1 to SP5.

<Operation of audio signal processing system>
Next, the operation of the audio signal processing system will be described separately for the specification of the position of the speaker and the specification of the predetermined position P.
<Speaker position identification process>
In the speaker position specifying process, first, each distance between the plurality of speakers SP1 to SP5 and the reference position Pref is measured, and secondly, each direction of the plurality of speakers SP1 to SP5 is measured. 3, each position of the plurality of speakers SP1 to SP5 is specified based on the measured distance and direction.

  In measuring the distance, as shown in FIG. 5, the microphone M is arranged at the reference position Pref, and the microphone M is connected to the audio signal processing device 20. The output signal of the microphone M is supplied to the CPU 210 via the external interface 240. FIG. 6 shows the contents of the distance measurement processing between the plurality of speakers SP1 to SP5 and the reference position Pref executed by the CPU 210 of the audio signal processing device 20.

  First, the CPU 210 identifies one speaker that has not been measured (S1). Next, the CPU 210 controls the reference signal generation circuit 250 so as to generate the reference signals Sr1 to Sr5, and sequentially selects the reference signals Sr1 to Sr5 to output the output audio signals OUT1 to OUT5 to the plurality of speakers SP1 to SP5. The selection circuit 260 is controlled so as to output to each of them (S2). Thereafter, the CPU 210 calculates a distance between the speaker to be measured and the reference position Pref based on the output signal of the microphone M, and stores the calculated distance in association with the speaker identifier in the memory 230 (S3). ). Next, the CPU 210 determines whether or not the measurement has been completed for all speakers (S4). If there is a speaker whose measurement has not been completed, the CPU 210 returns the process to step S1, and repeats the processes from step S1 to step S4 until the measurement is completed for all the speakers. In this way, the distance from the reference position Pref to the plurality of speakers SP1 to SP5 is measured.

  For example, assume that the distance from the reference position Pref to the speaker SP1 is L. In this case, the speaker SP1 exists on a circle having a radius L from the reference position Pref, but its position is unknown. Therefore, in the present embodiment, the position of the speaker SP1 is specified by measuring the direction of the speaker SP1 viewed from the reference position Pref using the terminal device 10.

  FIG. 7 shows the processing content of the direction measurement processing executed by the CPU 100 of the terminal device 10. In this example, each direction of the plurality of speakers SP1 to SP5 is specified using at least one of the gyro sensor 151 and the acceleration sensor 152. As described above, the gyro sensor 151 and the acceleration sensor 152 output an angle. The reference for the angle in this example is the speaker that measures the direction first.

When the application for the direction measurement process is activated, the CPU 100 causes the display unit 130 to display an image that prompts the user to perform the setting operation by pointing the terminal device 10 toward the first speaker (S20). For example, when the direction of the speaker SP1 is set first, the CPU 100 displays an arrow directed to the speaker SP1 on the display unit 130 as shown in FIG.
Next, the CPU 100 determines whether or not a setting operation has been performed by the user (S21). Specifically, it is determined whether or not the user has pressed the setting button BT (a part of the operation unit 120 described above) shown in FIG. When the setting operation is not performed, the CPU 100 repeats the determination until the setting operation is performed, and when the setting operation is performed, the CPU 100 resets the measurement angle (S22). That is, the direction from the reference position Pref toward the speaker SP1 is set to 0 degree.

  Thereafter, the CPU 100 causes the display unit 130 to display an image that prompts the user to perform a setting operation for setting the terminal device 10 toward the next speaker (S23). For example, when setting the direction of the speaker SP2 to be the second, the CPU 100 displays an arrow directed to the speaker SP2 on the display unit 130 as shown in FIG.

  Next, the CPU 100 determines whether or not a setting operation has been performed by the user (S24). Specifically, it is determined whether or not the user has pressed the setting button BT shown in FIG. When the setting operation is not performed, the CPU 100 repeats the determination until the setting operation is performed, and when the setting operation is performed, the CPU 100 stores it in the memory 110 that stores the angle with respect to the reference of the speaker to be measured (S25).

  Thereafter, the CPU 100 determines whether or not the measurement has been completed for all the speakers (S26). If there is a speaker for which measurement has not been completed, the CPU 100 returns the process to step S23, and repeats the process from step S23 to step S26 until the measurement is completed for all speakers. When the direction measurement is completed for all the speakers, the CPU 100 transmits the measurement result to the audio signal processing device 20 using the communication interface 140. In this way, each direction of the plurality of speakers SP1 to SP5 is measured. In the above-described example, the measurement results are collectively transmitted to the audio signal processing device 20, but the measurement results may be transmitted to the audio signal processing device 20 every time the direction of one speaker is measured. However, since the direction of the speaker SP1 that is the first measurement target is the reference for the angles of the other speakers SP2 to SP5, and the angle is 0 degrees, the transmission of the measurement result may be omitted.

  Thus, when specifying each direction of several speaker SP1-SP5 as an angle with respect to a reference | standard, by making a reference | standard one of several speaker SP1-SP5, a user's burden can be reduced. If the reference of the angle does not correspond to any of the plurality of speakers SP1 to SP5 and is a certain predetermined target arranged in the listening room, the user sets the terminal device 10 to the predetermined target. It is necessary to reset the angle by performing a predetermined operation, and to specify the direction by performing the predetermined operation toward each of the plurality of speakers SP1 to SP5. is there. That is, although it is necessary to direct the terminal device 10 to a predetermined target, the input operation can be simplified by setting the predetermined target to any one of the plurality of speakers SP1 to SP5.

Next, when the CPU 210 of the audio signal processing device 20 acquires each direction of the plurality of speakers SP1 to SP5 using the communication interface 220, the plurality of speakers is based on each direction and each distance of the plurality of speakers SP1 to SP5. Each position of SP1 to SP5 is calculated. That is, the CPU 210 and the communication interface 220 function as an acquisition unit that acquires each direction of the plurality of speakers SP1 to SP5.
For example, as shown in FIG. 10, it is assumed that the direction of the speaker SP3 is an angle θ and the distance is L3. In this case, the CPU 210 calculates the coordinates (x3, y3) of the speaker SP3 according to the following formula.
(X3, y3) = (L3sinθ, L3cosθ)
The coordinates (x, y) are similarly calculated for the other speakers SP1, SP2, SP4, SP5.
CPU210 calculates each position of several speaker SP1-SP5 based on each distance from the reference position Pref to several speaker SP1-SP5 and each direction of several speaker SP1-SP5.

<Specific position identification processing>
Next, a process for specifying the predetermined position P viewed by the user U will be described. In the present embodiment, the predetermined position P is specified using the terminal device 10.
FIG. 11 shows the content of the specific process of the predetermined position P executed by the CPU 100 of the terminal device 10. First, the CPU 100 directs the terminal device 10 from the reference position Pref to a predetermined target to display a screen for prompting a setting operation on the display unit 130, and prompts the user U to perform a setting operation (S30). For example, the CPU 100 displays the screen shown in FIG. In this example, the speaker SP1 is a predetermined target. The predetermined position P calculation can be simplified by matching the predetermined target in the specifying process of the predetermined position P with the predetermined target of the specifying process for specifying the positions of the speakers SP1 to SP5. Further, since the user U only needs to perform the setting operation with the terminal device 10 directed toward the same target, the user U can easily perform the operation.

Next, the CPU 100 determines whether or not a setting operation has been performed by the user (S31). Specifically, it is determined whether or not the user has pressed the setting button BT shown in FIG. When the setting operation is not performed, the CPU 100 repeats the determination until the setting operation is performed, and when the setting operation is performed, the CPU 100 resets the measurement angle (S32). When the gyro sensor 151 or the acceleration sensor 152 that outputs a relative direction is used, the reset in the specific position specifying process controls the sensor so that the output signal of the sensor is reset to 0 degrees. On the other hand, the reset in the case of using the azimuth sensor 153 that outputs an absolute direction means that the azimuth angle output when the setting button BT is pressed is stored in the memory 110 as a reference angle. In this case, when the measured azimuth angle is θd and the reference angle is θr, the CPU 100 uses “θd−θr” as the angle of the first and second target directions.
As a result, the direction from the reference position Pref toward the speaker SP1, which is a predetermined target, is 0 degree.

Thereafter, the CPU 100 causes the display unit 130 to display an image that prompts the terminal device 10 to perform a setting operation from the viewing position P toward the speaker SP5 that is the first target. For example, the CPU 100 displays the screen shown in FIG. 12A on the display unit 130 (S33).
Next, the CPU 100 determines whether or not a setting operation has been performed by the user (S34). Specifically, it is determined whether or not the user has pressed the setting button BT shown in FIG. When the setting operation is not performed, the CPU 100 repeats the determination until the setting operation is performed. When the setting operation is performed, the CPU 100 stores the angle with respect to the first target reference in the memory 110 (S35). This angle corresponds to first direction information indicating the direction of the first target viewed from the terminal device 10.

Thereafter, the CPU 100 causes the display unit 130 to display an image that prompts the terminal device 10 to perform the setting operation toward the direction of the speaker SP2, which is the second target. For example, the CPU 100 displays the screen shown in FIG. 12B on the display unit 130 (S36).
Next, the CPU 100 determines whether or not a setting operation has been performed by the user (S37). Specifically, it is determined whether or not the user has pressed the setting button BT shown in FIG. When the setting operation is not performed, the CPU 100 repeats the determination until the setting operation is performed. When the setting operation is performed, the CPU 100 stores the angle with respect to the second target reference in the memory 110 (S38). This angle corresponds to the second direction information indicating the direction of the second target viewed from the terminal device 10.

Thereafter, the CPU 100 transmits the angles of the first target and the second target as measurement results to the audio signal processing device 20 (S39). When the CPU 210 of the audio signal processing device 20 receives the measurement result using the communication interface 220, the CPU 210 calculates the predetermined position P from the directions of the speakers SP1 and SP2. The predetermined position P corresponds to user position information indicating the position of the user.
For example, the angle θ5 of the first target (speaker SP5) shown in FIG. 13 is −55 degrees, the angle θ2 of the second target (speaker SP2) is +30 degrees, and the coordinates of the speaker SP5 are (−1, 1), the coordinates of the speaker SP2 are (1, 1), and the coordinates of the predetermined position P are (Px, Py). The coordinates of the speaker SP5 are first target position information indicating the position of the first target, and the coordinates of the speaker SP2 are second target position information indicating the position of the second target. , Calculated in advance by the above-described speaker position specifying process, and stored in the memory 230.
The straight line L5 and straight line L2 shown in FIG. 13 are given by the following equations (1) and (2).
y = a1 * x + b1 …… Formula (1)
y = a2 * x + b2 …… Formula (2)

In addition, the inclination a1 and the inclination a2 are expressed using an angle θ5 ′ and an angle θ2 ′ from the X axis,
a1 = tan (θ5 ') = tan (-(90-55)) = tan (-35) =-0.700
a2 = tan (θ2 ') = tan (90-60) = tan (30) = 1.732
Further, since the straight line L5 passes through (-1, 1) and the straight line L2 passes through (1, 1), a1 and (-1, 1) are substituted into the equation (1), and a2 and into the equation (2). If (1,1) is substituted, b1 and b2 can be obtained.
1 = -0.700 * -1 + b1 b1 = 0.300
1 = 1.732 * 1 + b2 b2 = -0.732
Therefore, the straight line L5 is given by equation (3), and the straight line L2 is given by equation (4).
y = -0.574 * x + 0.300 …… Formula (3)
y = 1.732 * x-0.732 …… Formula (4)

Since the predetermined position P is an intersection of the straight line L5 and the straight line L2, Equations (3) and (4) are solved and (Px, Py) = (0.448, 0.044).
As described above, the CPU 210 of the audio signal processing device 20 specifies the predetermined position P which is the user position information indicating the position of the user, and controls the processing unit 270 based on the predetermined position P, whereby the input audio signal IN1. It is possible to obtain output audio signals OUT1 to OUT5 obtained by adding desired acoustic effects to .about.IN5.

  Thus, by matching the angle reference for specifying the positions of the plurality of speakers SP1 to SP5 with the angle reference for specifying the position of the user, the first is used when specifying the position of the user. The process of specifying the direction of the first target and the second target can be executed by the same process as the process of specifying the directions of the plurality of speakers SP1 to SP5. For this reason, it is possible to use a program module in which two processes are shared. In addition, since the user resets the angle with a common target (speaker SP1 in this example), there is no need to store individual targets.

<Functional configuration of audio signal processing system 1A>
As described above, the audio signal processing system 1 </ b> A includes the terminal device 10 and the audio signal processing device 20, and shares various functions. FIG. 14 shows functions shared by the terminal device 10 and the audio signal processing device 20 in the audio signal processing system 1A.

  The terminal device 10 includes an input unit F11 through which a user can input an instruction, a direction sensor F12 that detects a direction in which the terminal device 10 is facing, and the terminal device 10 is one of a first target and a second target. When the user inputs using the input unit F11, the first direction information indicating the direction of viewing one target is acquired from the terminal device 10 based on the output signal of the direction sensor F12. When the user inputs using the input unit F11 that the first acquisition unit F13 and the terminal device 10 are facing the other target of the first target and the second target, an output signal of the direction sensor F12 2nd acquisition part F14 which acquires the 2nd direction information which shows the direction which looked at the other target from the terminal unit 10 based on. Here, the directions indicated by the first direction information and the second direction information are angles with respect to a predetermined target, and the terminal device 10 indicates that the terminal device 10 is facing the predetermined target by the user using the input unit F11. It is preferable to further include a reset control unit F15 that controls the first acquisition unit F13 and the second acquisition unit F14 so as to reset the angle specified based on the output signal of the direction sensor F12.

The first acquisition unit F13 corresponds to the CPU 100, and when the user inputs using the input unit F11 that the terminal device 10 is pointed at the speaker SP5 that is the first target (S34), the first acquisition unit F13 includes the direction sensor F12. Based on the output signal, first direction information indicating the direction in which one target is viewed from the terminal device 10 is acquired as the angle of the first target (S35).
The second acquisition unit F14 corresponds to the CPU 100, and when the user inputs using the input unit F11 that the terminal device 10 is pointed at the speaker SP2 that is the second target (S34), the direction sensor Based on the output signal of F12, second direction information indicating the direction in which the other target is viewed from the terminal device 10 is acquired as the second target angle (S35).
Further, the reset control unit F15 corresponds to the CPU 100, and when the user inputs using the input unit F11 that the terminal device 10 is facing the speaker SP1, which is a predetermined target, the output of the direction sensor F12. The first acquisition unit F13 and the second acquisition unit F14 are controlled to reset the angle specified based on the signal (S30 to S32).

The audio signal processing device 20 is based on the first target position information indicating the position of the first target, the second target position information indicating the position of the second target, and the first direction information and the second direction information. Based on the user position information generated by the position information generation unit F21 that generates user position information indicating the position of the user and the position information generation unit F21, an acoustic effect is given to the input audio signals IN1 to IN5. A signal generation unit F22 that generates output audio signals OUT1 to OUT5 for each of the plurality of speakers SP1 to SP5, and a storage unit F23 that stores first target position information and second target position information.
The signal generation unit F22 corresponds to the processing unit 270 and the CPU 210 described above, and the first target position information and the second target position information correspond to the coordinates of the speaker SP5 and the coordinates of the speaker SP2. The storage unit F23 corresponds to the memory 230.

As described above, according to the present embodiment, when the terminal device 10 is operated toward the first target and the second target whose positions are known, user position information indicating the position of the user is generated. can do. For this reason, in order to identify a user's position, compared with the aspect which images a user with a camera, a structure is simplified and also an image recognition process becomes unnecessary, Therefore A processing load can be reduced. Compared with the aspect in which the user touches the screen in the terminal device to specify the position of the user, the accuracy of specifying the position of the user can be improved. In addition, there is an advantage that the position of the user can be specified accurately in a short time even indoors where radio waves are not received from the satellite, as compared with the mode using GPS.
Furthermore, since the output audio signals OUT1 to OUT5 in which sound effects are given to the audio signals IN1 to IN5 can be generated using the user position information, even if the user does not view at the reference position Pref, the actual viewing position can be obtained. A desired acoustic effect can be obtained.

<Modification>
The present invention is not limited to the above-described embodiments, and various modifications described below are possible. Moreover, each modification and embodiment mentioned above can be combined suitably.

(1) In the above-described embodiment, the user position information is generated by the position information generation unit F21 provided in the audio signal processing device 20, but the present invention is not limited to this and is used by the terminal device 10. Person position information may be generated.
FIG. 15 shows a configuration example of an audio signal processing system 1B according to a modification. The audio signal processing system 1B is the same as the audio signal processing system 1A shown in FIG. 14 except that the position information generation unit F21 is deleted from the audio signal processing device 20 and the terminal device 10 is provided with the position information generation unit F21. It is configured.

  In the audio signal processing system 1B, the first target position information indicating the first target position and the second target position information indicating the second target position stored in the storage unit F23 of the audio signal processing device 20 are: To the terminal device 10. Specifically, when the terminal device 10 executes processing for specifying user position information, the terminal device 10 transmits a transfer request for requesting transfer of the first target position information and the second target position information as an audio. It transmits to the signal processing device 20. The audio signal processing device 20 that has received the transfer request reads the first target position information and the second target position information from the storage unit F, and transmits a transfer response including these to the terminal device 10.

  When the terminal device 10 receives the transfer response, the position information generation unit F21, based on the first target position information and the second target position information, the first direction information and the second direction information included in the received transfer response, User position information indicating the position of the user is generated.

  Note that the first and second target position information is not limited to coordinates as long as it indicates the positions of the first and second targets, and may be given in any format. For example, the first target position information may be a distance from the reference position Pref to the first target and a direction (angle) of the first target viewed from the reference position Pref, and the second target position information is The distance from the reference position Pref to the second target and the direction (angle) of the second target viewed from the reference position Pref may be used. In this case, the CPU 100 of the terminal device 10 performs the processing of the CPU 210 of the audio signal processing device 20 as described with reference to FIG. 10, based on the distance and the angle, the coordinates of the first target and the second target. May be calculated.

Furthermore, when the first target and the second target are any of the plurality of speakers SP1 to SP5, the angles of the first target and the second target viewed from the reference position Pref are the plurality of speakers. Since the measurement is performed by the terminal device 10 in order to specify the positions of SP1 to SP5, the CPU 100 stores the measurement result in the memory 110, and the distance from the reference position Pref to the first target and the second position from the reference position Pref. The distance to the target may be acquired from the audio signal processing device 20, and the coordinates of the first target and the second target may be calculated based on the acquired distance and the measured angle.
According to this modification, since the user position information can be generated by the terminal device 10, the processing load on the audio signal processing device 20 can be reduced.

(2) In the above-described embodiment, as described with reference to FIG. 11, in the process of specifying the predetermined position P viewed by the user U, the user U sets the terminal device 10 to a predetermined target at the reference position Pref. However, the present invention is not limited to this, and any method may be adopted as long as the angle can be reset. For example, as shown in FIG. 13, at the predetermined position P, the user U sets and operates the terminal device 10 in a direction Q2 parallel to the direction Q1 in which the user U looks at the predetermined target from the reference position Pref. It may be reset. In this case, since it is not necessary for the user U to move to the reference position Pref and perform the setting operation, it is possible to reduce the labor of the user U.

(3) In the above-described embodiment, in order to reset the angle measured by the direction sensor F12 in the process of specifying the predetermined position P viewed by the user U, the CPU 100 of the terminal device 10 performs step S30 shown in FIG. Although -S32 was performed, this invention is not limited to this.
For example, if the reference angle of reset can be acquired from the audio signal processing device 20, steps S30 to S32 may be omitted. In this case, the direction sensor F12 employs an azimuth sensor 153 that absolutely outputs a direction. Specifically, when the user U operates a plurality of terminal devices 10, when the operation is switched from one terminal device 10 to another terminal device 10, the reset reference angle is set from the audio signal processing device 20. You may acquire and omit steps S30-S32.
Further, in the case of using the direction sensor 153 that outputs an absolute direction as the direction sensor F12, in the speaker position specifying process shown in FIG. 7, the angle when the speaker SP1 is viewed from the reference position Pref is set as the reference angle θr. The CPU 100 stores the information in the memory 110 (S22), omits steps S30 to S32 shown in FIG. 11 in the process of specifying the predetermined position P, sets the measured azimuth angle to θd, and sets the reference angle to θr. “Angle θd−reference angle θr” may be used as an angle in the first and second target directions.
On the other hand, when the gyro sensor 151 or the acceleration sensor 152 that outputs a relative direction is used as the direction sensor F12 and the speaker position specifying process and the specified position P specifying process are continuously performed, the speaker position specifying is performed. Since the angle is reset in the process, steps S30 to S32 shown in FIG. 11 may be omitted in the process of specifying the predetermined position P.

(4) In the above-described embodiment, the plurality of speakers SP1 to SP5 are formed as separate bodies as shown in FIG. 2, but the present invention is not limited to this. For example, the plurality of speakers is one. It may be stored in one housing. In this case, since the position of each speaker is determined by the mounting position on the housing, when the user position information is calculated in the audio signal processing device 20, the audio signal processing device 20 determines the first target speaker number. It is not necessary to acquire the first target position information and the second target position information of the second target speaker as long as they are held in the terminal device 10 as part of the application program.

(5) In the above-described embodiment, in the specifying process for specifying the position of the user, the direction of the speaker SP5 that is the first target is specified first, and then the direction of the speaker SP2 that is the second target is specified. However, the present invention is not limited to this, and the display unit 130 may not perform display prompting the user to point the terminal device 10 at each of the first target and the second target. That is, the first target and the second target are determined in advance, and one of those angles is measured first, and then the other angle is measured. You may determine whether it is an angle.

  In this case, the position information generation unit F21 uses the first direction information and the second direction information as the first target position and the second direction information based on the angle indicated by the first direction information and the angle indicated by the second direction information. The user position information is determined based on the determination result, the first target position information and the second target position information, and the first direction information and the second direction information. Should be generated.

  Hereinafter, the determination method will be specifically described. FIG. 16 shows each region to which the predetermined position P belongs, and FIG. 17 shows angles measured in each region to which the predetermined position P belongs. As shown in FIG. 16, it is assumed that the speaker SP5 is arranged at the coordinates (Xa, Ya) and the speaker SP2 is arranged at the coordinates (Xb, Ya). Further, the areas A to F are determined as follows. Region A is in the range of x <Xa and y <Ya. The region B is in a range of Xa ≦ x <Xb and y <Ya. The region C is a range of Xb ≦ x and y <Ya. The region D is in a range of Xb ≦ x and Ya ≦ y. The region E is in the range of Xa ≦ x <Xb and Ya ≦ y. The region F is in the range of x <Xa and Ya ≦ y.

Assuming that the positive direction of the Y-axis is 0 degree, when the predetermined position P belongs to the region A, the speakers SP5 and SP2 are located on the upper right side with respect to the predetermined position P. Therefore, as shown in FIG. <Θ2.
Next, when the predetermined position P belongs to the region B, the speaker SP5 is positioned obliquely on the left with respect to the predetermined position P, and the speaker SP2 is disposed obliquely on the right with respect to the predetermined position P. FIG. ), Θ5 <0 <θ2.
Next, when the predetermined position P belongs to the region C, the speakers SP5 and SP2 are located on the upper left side with respect to the predetermined position P, so that θ5 <θ2 <0 as shown in FIG.
Next, when the predetermined position P belongs to the region D, since the speakers SP5 and SP2 are located obliquely to the left of the predetermined position P, θ2 <θ5 <0 as shown in FIG.
Next, when the predetermined position P belongs to the region E, the speaker SP5 is positioned diagonally to the left of the predetermined position P, and the speaker SP2 is positioned diagonally downward to the right of the predetermined position P. FIG. ), Θ5 <0 <θ2.
Next, when the predetermined position P belongs to the region F, since the speakers SP5 and SP2 are located obliquely lower right with respect to the predetermined position P, 0 <θ2 <θ5 as shown in FIG.

Here, when the predetermined position P belongs to any of the regions A, B, and C, θ5 <90 and θ2 <90. That is, when the two measured angles are both 90 degrees or less, the larger angle is θ5.
On the other hand, when the predetermined position P belongs to any of the regions D, E, and F, θ5 <90 and θ2 <90 are not satisfied. In this case, the negative direction of the Y axis is converted to 0 degrees. Then, the larger angle becomes θ2. Note that the angle before conversion is adopted as the measurement angle. In the example shown in FIG. 17D, θ5 = −110 and θ2 = −150.
In this way, each of the first direction information and the second direction information corresponds to either the first target or the second target based on the angle indicated by the first direction information and the angle indicated by the second direction information. Can be determined.

(6) In the above-described embodiment, the application of the acoustic effect using the user position information in the audio signal processing system 1A has been described as an example. However, the present invention is not limited to this, and the terminal device 10 and the electronic device It can apply to the electronic system provided with.
For example, in the listening room shown in FIG. 18, the air conditioner 300, the television 400, or the lights 501 and 502 may be controlled using the user position information. A driving mechanism (not shown) is incorporated in the illuminations 501 and 502, and a spotlight can be irradiated in a desired direction using the driving mechanism.

  For example, an air conditioner system including an air conditioner 300 and a terminal device 10 is assumed as an example of an electronic system. In the air conditioner system, the lower left portion 301 of the front panel is the first target, and the lower right portion 302 is the second target. The positions of the lower left portion 301 and the lower right portion 302 are fixed to the air conditioner 300, and these positions are known. When the user U operates the terminal device 10 toward the lower left portion 301 and the lower right portion 302, the first direction information and the second direction information are measured in the terminal device 10. The terminal device 10 transmits these to the air conditioner 300. The air conditioner 300 generates user position information based on the received first direction information and second direction information and the first target position information and second target position information held by itself, and uses the user position information. For example, air blowing control is performed. Thereby, it becomes possible to blow toward the predetermined position P where the user U is sitting.

  Next, a television system including the television 400 and the terminal device 10 is assumed as an example of the electronic system. In the control of the television 400, the left speaker 401 is a first target, and the right speaker 402 is a second target. When the user U operates the terminal device 10 toward the left speaker 401 and the right speaker 402, the first direction information and the second direction information are measured in the terminal device 10. The terminal device 10 transmits these to the television 400. The television 400 generates user position information based on the received first direction information and second direction information and the first target position information and second target position information held by itself, and uses the user position information. Thus, it is possible to emit a sound imparted with an acoustic effect toward the user U from the left speaker 401 and the right speaker 402.

  Next, as an example of an electronic system, an illumination system including the illuminations 501 and 502 and the terminal device 10 is assumed. In the control of the lights 501 and 502, the light 501 is a first target and the light 502 is a second target. When the user U operates the terminal device 10 toward the lighting 501 and the lighting 502, the first direction information and the second direction information are measured in the terminal device 10. The terminal device 10 transmits these to the lighting 501 and the lighting 502. The lights 501 and 502 generate user position information based on the received first direction information and second direction information and the first target and second target held by the lighting 501 and 502, and use the user position information. It becomes possible to irradiate a spotlight toward the person U.

  Thus, the user position information can be used by various electronic devices. In this modification, the user position information is generated by an electronic device such as the air conditioner 300 to be controlled. However, the user position information is generated by the terminal device 10 and the user position information is electronically transmitted from the terminal device 10. It may be sent to the device.

(7) In the above-described embodiment, the plurality of speakers SP1 to SP5 are two-dimensionally arranged. However, as shown in FIG. 22, the plurality of speakers SP1 to SP7 may be three-dimensionally arranged. . In this example, when viewed from the reference position Pref, the speaker SP6 is disposed diagonally upward to the left front, and the speaker SP7 is disposed diagonally upward to the right front. Even when a plurality of speakers SP1 to SP7 are arranged three-dimensionally in this way, if each direction of the plurality of speakers SP1 to SP7 is measured with respect to the speaker SP1, the angles of the speakers SP2 to SP7 are measured. Good.

DESCRIPTION OF SYMBOLS 1A, 1B ... Audio signal processing system, 10 ... Terminal device, 20 ... Audio signal processing device, F11 ... Input part, F12 ... Direction sensor, F13 ... First acquisition part, F14 ... Second acquisition part, F21 ... Position information calculation Unit, F22 ... signal generation unit, F23 ... storage unit.

Claims (6)

A program for a terminal device including an input unit through which a user can input an instruction, a direction sensor that detects a direction in which the terminal device is facing, and a processor,
The processor;
When the user inputs using the input unit that the terminal device is facing one of the first target and the second target, the terminal device outputs the terminal device based on the output signal of the direction sensor. A first acquisition unit that acquires first direction information indicating a direction in which one target is viewed;
When the user inputs using the input unit that the terminal device is facing the other target of the first target and the second target, the terminal device is based on the output signal of the direction sensor. A second acquisition unit for acquiring second direction information indicating a direction in which the other target is viewed;
Based on the first target position information indicating the position of the first target, the second target position information indicating the position of the second target, and the first direction information and the second direction information, the use A position information generation unit that generates user position information indicating the position of the person ,
When the user inputs using the input unit that the terminal device is facing a predetermined target at a reference position serving as a reference in the coordinate system of the first target position information and the second target position information, As a reset control unit that resets the angle specified based on the output signal of the direction sensor,
The first direction information indicates an angle formed by a reference straight line passing through the reference position and the predetermined target, and a first straight line passing through the user position and the one target,
The second direction information indicates an angle formed by the reference straight line and a second straight line passing through the user position and the other target.
Terminal device program. The terminal device program according to claim 1 , wherein the one target is the first target, and the other target is the second target. The position information generation unit determines whether each of the first direction information and the second direction information is the first target and the second direction based on the angle indicated by the first direction information and the angle indicated by the second direction information. It is determined which one of the targets corresponds, and based on the determination result, the first target position information and the second target position information, and the first direction information and the second direction information Te, a program of the terminal device according to claim 1, characterized in that to generate the user position information. An input unit that allows the user to input instructions;
A direction sensor for detecting a direction in which the terminal device is facing;
When the user inputs using the input unit that the terminal device is facing one of the first target and the second target, the terminal device outputs the terminal device based on the output signal of the direction sensor. A first acquisition unit that acquires first direction information indicating a direction in which one target is viewed;
When the user inputs using the input unit that the terminal device is facing the other target of the first target and the second target, the terminal device is based on the output signal of the direction sensor. A second acquisition unit for acquiring second direction information indicating a direction in which the other target is viewed;
Based on the first target position information indicating the position of the first target, the second target position information indicating the position of the second target, and the first direction information and the second direction information, the use A position information generation unit that generates user position information indicating the position of the person ,
When the user inputs using the input unit that the terminal device is facing a predetermined target at a reference position serving as a reference in the coordinate system of the first target position information and the second target position information, A reset controller that resets the angle specified based on the output signal of the direction sensor,
The first direction information indicates an angle formed by a reference straight line passing through the reference position and the predetermined target, and a first straight line passing through the user position and the one target,
The second direction information indicates an angle formed by the reference straight line and a second straight line passing through the user position and the other target.
Terminal device. An electronic system including a terminal device and an electronic device,
The terminal device
An input unit that allows the user to input instructions;
A direction sensor for detecting a direction in which the terminal device is facing;
When the user inputs using the input unit that the terminal device is facing one of the first target and the second target, the terminal device outputs the terminal device based on the output signal of the direction sensor. A first acquisition unit that acquires first direction information indicating a direction in which one target is viewed;
When the user uses the input unit to input that the terminal device is facing the other target of the first target and the second target, the terminal device outputs the terminal device based on the output signal of the direction sensor. A second acquisition unit that acquires second direction information indicating a direction in which the other target is viewed;
The terminal device or the electronic device is
Based on the first target position information indicating the position of the first target, the second target position information indicating the position of the second target, and the first direction information and the second direction information, the use A position information generation unit that generates user position information indicating the position of the person ,
When the user inputs using the input unit that the terminal device is facing a predetermined target at a reference position serving as a reference in the coordinate system of the first target position information and the second target position information, A reset controller that resets the angle specified based on the output signal of the direction sensor,
The first direction information indicates an angle formed by a reference straight line passing through the reference position and the predetermined target, and a first straight line passing through the user position and the one target,
The second direction information indicates an angle formed by the reference straight line and a second straight line passing through the user position and the other target,
The electronic device is
Based on the user location information generated by the location information generation unit, a control unit for controlling the electronic device,
An electronic system characterized by that. The electronic device is an audio signal processing device that supplies an output audio signal to each of a plurality of speakers including a first speaker and a second speaker,
The first target is the first speaker;
The second target is the second speaker;
The control unit is a signal generation unit that generates the output audio signal obtained by adding an acoustic effect to the input audio signal for each of a plurality of speakers based on the user position information generated by the position information generation unit. ,
The electronic system according to claim 5 .

Images