JP2011035472A - Image display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display device which can visualize a position of a sound source while suppressing deterioration of precision in specifying the position of the sound source, and shortening a time required for specifying the position of the sound source. <P>SOLUTION: The image display device is provided with: a display means which displays a photographed image taken by a camera 17 on a display region 71A; a sound collecting means which consists of a pair of microphones M1, M2 arranged in a predetermined interval; a correction temperature setting means which establishes a temperature to correct a propagation speed of a sound collected by the sound collecting means; a sound source position calculation means which calculates the position of the sound source emitting the sound based on a time difference which the sound reaches to a pair of microphones, and the corrected temperature established by the correction temperature setting means; a correlation means which correlates the position of the sound source calculated by the sound source position calculation means, with the display position in the photographed image displayed in the display region corresponding to the position of the sound source; and a display control means which controls to display the image identifying the position of the sound source in the display position correlated with the position of the sound source by the correlation means. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an image display device that displays an image for identifying the position of a sound source in a display area of a display means.

  In the patent document 1, the present applicant uses five microphones, estimates the position of the sound source based on the arrival time difference of the sound between the microphones, collects an image of the vicinity of the estimated sound source position with a camera, and displays it. Disclosed a technique related to a sound source search system for displaying a sound source position on an image near the sound source position displayed in FIG.

  According to the present technology, for example, by installing the above sound source exploration system at a predetermined location in a factory or the like and periodically measuring the position of the sound source, a failure occurs due to equipment failure such as a transformer or a motor. The sound source that emits sound can be identified. Thereby, abnormality of an apparatus can be discovered.

JP 2003-111183 A

  By the way, in order to quickly find an abnormality in the device as described above, it is desired to shorten the time required to specify a sound source that emits a failure sound. For example, in order to shorten the time required to specify the position of the sound source, the information used for calculating the position of the sound source is reduced, thereby simplifying the calculation and calculating the position of the sound source in a state that matches the actual environment. It can be considered to follow in real time.

  However, as described above, when the information used for the calculation is reduced, the accuracy of specifying the position of the sound source may be lower than when the position of the sound source is specified using a lot of information. It had been.

  The present invention has been proposed in view of such a situation, and it is possible to reduce the time required to specify the position of the sound source while suppressing a decrease in the accuracy of specifying the position of the sound source, and to reduce the position of the sound source. An object of the present invention is to provide an image display device that can visualize the above.

  An image display device according to a first aspect of the present invention includes a display unit that displays a captured image captured by a camera in a display area, a sound collection unit including a pair of microphones arranged at a predetermined interval, and the sound collection unit. Based on the correction temperature setting means for setting the temperature for correcting the propagation speed of the sound collected by the means, the time difference when the sound reaches the pair of microphones, and the correction temperature set by the correction temperature setting means, A sound source position calculating unit that calculates a position of a sound source that emits sound; a position of the sound source calculated by the sound source position calculating unit; and a display position in a captured image that is displayed in the display area in correspondence with the position of the sound source. And an image for identifying the position of the sound source at the display position correlated with the position of the sound source by the correlation means. Characterized in that it comprises a display control means for Shimesuru control, the.

  According to a second aspect of the present invention, in the first aspect, the correction temperature setting means can select different temperatures as the correction temperature according to a difference in season.

  According to a third aspect of the present invention, in the first or second aspect, the band-limited signal obtained by removing a frequency equal to or lower than a predetermined cutoff frequency from the sound signal collected by the sound collecting unit and band-limiting to a predetermined frequency band. An output band limiting filter is provided, and the sound source position calculating means calculates the position of the sound source according to the band limited signal output by the band limiting filter.

  According to a fourth aspect of the present invention, in any one of the first to third aspects, the sound source position calculating means limits a calculation interval for continuously calculating the position of the sound source to a predetermined calculation interval.

  According to a fifth aspect of the present invention, in any one of the first to fourth aspects, the apparatus further comprises a moving means capable of moving the position where the sound collecting means is installed so that the sound collecting means can follow the sound source. .

  According to a sixth aspect of the present invention, in any one of the first to fifth aspects, the correction temperature setting means includes a temperature sensor that measures an ambient temperature of the sound collection means, and the sound source position calculation means is controlled by the temperature sensor. The position of the sound source is calculated according to the measured ambient temperature.

  According to a seventh aspect of the present invention, in any one of the first to sixth aspects, the correlating means includes a position of the sound source according to a ratio of a shootable range in the horizontal direction of the camera and a horizontal dimension of the display area. The display position in the horizontal direction of the display area is correlated.

According to the image display device of the first aspect of the invention, unlike the case where sound is collected using five conventional microphones, sound is collected using a pair of microphones in order to calculate the position of the sound source. do it. Therefore, it is possible to reduce sound information necessary for calculating the position of the sound source as compared with the conventional art. As a result, the time required for calculating the position of the sound source using the sound source position calculating means can be reduced as compared with the conventional case, and the time required for specifying the position of the sound source can be reduced.
In addition, the propagation speed of the sound affected by the temperature can be converged within a certain range by the correction temperature. For this reason, as described above, even when the information of the sound necessary for calculating the position of the sound source is reduced, the position of the sound source can be determined by using the sound propagation speed converged in a certain range. It can suppress that the precision to identify falls.
In addition, the position of the sound source can be replaced with an image. Therefore, the position of the sound source can be visualized through the image.
According to the invention of claim 2, by operating the correction temperature setting means, it is possible to easily select the correction temperature corresponding to the difference in season.
According to the invention of claim 3, the sound source position calculating means can calculate the position of the sound source using the band limited signal obtained by removing the frequency equal to or lower than the cutoff frequency from the sound collected by the sound collecting means. For this reason, the information used by the sound source position calculating unit to calculate the position of the sound source as compared with the case where the sound source position calculating unit calculates the position of the sound source using a band-limited signal that does not remove the frequency below the cutoff frequency. Can be reduced. Along with this, the time required for the sound source position calculating means to calculate the position of the sound source can be shortened.
According to the invention of claim 4, the sound source position calculation means suppresses the calculation capability required for calculating the position of the sound source as compared with the case where the position of the sound source is calculated at intervals exceeding a predetermined calculation interval. be able to. As a result, the sound source position calculating means can be simplified as compared with the prior art, and thus the manufacturing cost of the sound source position calculating means can be reduced and the sound source position calculating means can be reduced in size.
According to the invention of claim 5, during the movement of the sound collecting means by following the sound source by the moving means, the position where the sound collecting means is installed with respect to the sound source changes variously. It is possible to make it easier for the sound collecting means to continuously acquire information on different types of sounds used to calculate the position of the sound source. As a result, the sound collecting means can acquire as much sound information as possible for the sound source position calculating means to calculate the position of the sound source. Therefore, if a large amount of sound information is used, a state in accordance with the actual environment can be reflected in the calculation of the sound source position, and the accuracy of the sound source position specified by the sound source position calculating means can be improved. Can do.
According to the invention of claim 6, the sound source position calculating means can sequentially calculate the position of the sound source while reflecting the ambient temperature of the sound collecting means. Therefore, if the ambient temperature is used, the sound source position calculating means can calculate the position of the sound source under conditions that match the actual environment. Thereby, the accuracy with which the sound source position calculating means calculates the position of the sound source can be increased.
According to the invention of claim 7, the imageable range of the camera can be set to a constant value according to the standard of the camera, and the horizontal dimension can be set to a constant value according to the standard of the display area. The ratio with the horizontal dimension of the display area can be set to a constant value. Thereby, the correlation means can easily associate the position of the sound source and the display position corresponding to the position of the sound source in the horizontal direction of the display area according to a certain value.

It is a schematic block diagram of the image display apparatus of Embodiment 1 of this invention. It is a schematic block diagram of the personal computer which comprises the image display apparatus. It is a flowchart regarding the process which the image display apparatus performs. It is explanatory drawing of the sound source position specific process which the image display apparatus performs. It is a figure which shows the state by which the graphic image was displayed on the display. It is explanatory drawing of the image display coordinate transformation process which the image display apparatus performs. It is a schematic block diagram of the personal computer which comprises the image display apparatus of Embodiment 2 of this invention. It is a schematic block diagram of the image display apparatus of Embodiment 3 of this invention. FIG. 6 is a schematic block diagram of a personal computer that constitutes an image display apparatus according to a third embodiment. It is a schematic block diagram of the image display apparatus of other embodiment.

<Embodiment 1>
Embodiment 1 of the present invention will be described with reference to FIGS. 1 to 6. The image display apparatus 1 according to the first embodiment includes a measurement unit 10, an amplifier 20, a bandpass filter 30, an A / D converter 40, a personal computer 50, a video input / output unit 60, and a display 70. ing.

  As shown in FIG. 1, the measurement unit 10 includes support members 15A to 15C, a base 16, a CCD camera 17, a microphone support 18, and microphones M1 and M2. The base 16 is arrange | positioned at the upper part of support member 15A-15C. The microphone support base 18 is supported on the base 16 by a camera support member. A CCD camera 17 is fixed to the camera support member. The microphones M1 and M2 are attached to the microphone support base 18.

  In the measurement unit 10, the microphone M1 and the microphone M2 constitute a pair of microphones. The horizontal interval between the microphone M1 and the microphone M2 is kept at a predetermined distance. The microphones M1 and M2 are examples of the sound collecting means of the present invention.

  Each microphone M1, M2 is connected to an amplifier 20. The amplifier 20 amplifies the sound wave signal transmitted from each microphone M1, M2. The amplifier 20 is connected to the band pass filter 30. The band pass filter 30 limits the frequency band passing through the filter to 200 Hz to 4 kHz, and removes a sound wave signal having a frequency lower than a predetermined frequency (here, a frequency lower than 200 Hz). The band pass filter 30 is connected to the A / D converter 40. The A / D converter 40 converts the sound wave signal (analog signal) into a digital signal. The digital signal is transmitted to the personal computer 50. The bandpass filter 30 is an example of a band limiting filter according to the present invention. 200 Hz to 4 kHz is an example of the predetermined frequency band of the present invention, and a frequency slightly lower than 200 Hz is an example of the cutoff frequency of the present invention. A sound wave signal that passes through the bandpass filter 30 while limiting the frequency band from 200 Hz to 4 kHz is an example of the band limited signal of the present invention.

  The CCD camera 17 is connected to the video input / output unit 60. The video input / output unit 60 converts the imaging signal (analog signal) transmitted from the CCD camera 17 into a digital signal. A digital signal (imaging signal) is transmitted to the personal computer 50 by the video input / output unit 60. The personal computer 50 is connected to the display 70. Reference numerals 71 </ b> A and 71 </ b> B are display areas of the display 70. The display 70 is an example of display means of the present invention.

  FIG. 2 is a schematic block diagram of the personal computer 50. The personal computer 50 includes a keyboard 51, an arithmetic processing unit 52, and a storage unit 53.

  The keyboard 51 is connected to the arithmetic processing unit 52. The keyboard 51 is used to input the number of microphones, the interval between the microphone M1 and the microphone M2 described above, the set value of the frequency that passes through the bandpass filter 30 (here, 200 Hz to 4 kHz), and the like. In addition, in the present embodiment, the operator of the image display device 1 operates the keyboard 51 to input a correction temperature value for correcting the propagation speed of sound emitted from the sound source, and a calculation interval of the horizontal angle θ described later. To do. Here, the operator operates the keyboard 51 to input a winter correction temperature value (10 ° C.) or a summer correction temperature value (30 ° C.), and sets the calculation interval (for example, 10 times / second) of the horizontal angle θ. I decided to enter it. The keyboard 51 is an example of a correction temperature setting unit of the present invention.

  The arithmetic processing unit 52 is connected to the storage unit 53 and the display 70, respectively. The storage unit 53 includes a digital signal (sound wave signal) arithmetic processing program storage unit 53A, a display image data selection processing program storage unit 53B, an image display control program storage unit 53C, and a data storage unit 53D. The digital signal (sound wave signal) arithmetic processing program storage unit 53A stores a program for executing a frequency analysis process (S4), a sound source position specifying process (S5), an image display coordinate conversion process (S6), and the like, which will be described later. . The display image data selection processing program storage unit 53B stores a program for executing display image data selection processing (S7) described later. The image display control program storage unit 53C stores a program for executing an image display process (S8) described later.

  In the data storage unit 53D, image data of a captured image of the CCD camera 17 displayed in the display area 71A according to the above-described imaging signal, frequency analysis processing (S4), sound source position specifying processing (S5), image display coordinates Each data calculated by the conversion process (S6) is stored. The data storage unit 53D stores image data of different types of graphic images in association with selected frequency data extracted by frequency analysis processing (S4) described later. In the present embodiment, a circular image having a different color and the same size is set as the graphic image.

  As will be described later, the arithmetic processing unit 52 causes the above-described circular image data or the image of the captured image of the CCD camera 17 from the data storage unit 53D due to, for example, the occurrence of a sound including a failure sound of the device. Read data. Thereafter, the arithmetic processing unit 52 generates an image signal of a display image to be displayed in the display areas 71A and 71B based on the circular image data. Subsequently, the arithmetic processing unit 52 transmits a generated image signal and an imaging signal related to the image data of the captured image to the display 70, and a sound source that generates a sound including a faulty sound superimposed on the captured image in the display area 71A. An image for identifying the position (the circular image described above) is displayed.

  Next, processing in which the arithmetic processing unit 52 displays an image for identifying the position of the sound source in each of the display areas 71A and 71B will be described. When the power of the image display device 1 is turned on, as shown in FIG. 3, the arithmetic processing unit 52 performs an initial setting process (S1), an initial image display process (S2), and an input signal acquisition process (S3). The frequency analysis process (S4), the sound source position specifying process (S5), the image display coordinate conversion process (S6), the display image data selection process (S7), and the image display process (S8) are executed.

  In the initial setting process (S1), the number of microphones (two in this case) input from the keyboard 51, the interval between the microphone M1 and the microphone M2, the set value of the frequency that passes through the band-pass filter 30, Correction temperature value (10 ° C. or 30 ° C.), calculation interval of horizontal angle θ (10 times / second), values of horizontal dimensions X1 and X2 (see FIG. 5) of display areas 71A and 71B, and display area 71B A process of storing data related to the vertical dimension Y2 (see FIG. 5) and the like in the data storage unit 53D is executed.

  The arithmetic processing unit 52 executes an initial screen display process (S2) after the initial setting process (S1). In the initial image display process (S2), the program stored in the image display control program storage unit 53C is executed to start the process of specifying the position of the sound source in each of the display areas 71A and 71B as an initial image. The process which displays the alerting image which alert | reports doing is performed.

  The arithmetic processing unit 52 executes an input signal acquisition process (S3) after the initial screen display process (S2). In the input signal acquisition process (S3), the sound wave signal (sound pressure level) of the sound emitted from the sound source and the process of acquiring the above imaging signal are executed. Here, the sound wave signals detected by the microphones M1 and M2 and the imaging signal are input to the arithmetic processing unit 52 as digital signals as shown in FIG. Thereafter, the arithmetic processing unit 52 executes processing for storing the sound wave signal and the imaging signal in the data storage unit 53D.

  The arithmetic processing unit 52 executes a frequency analysis process (S4) after the input signal acquisition process (S3). In the frequency analysis process (S4), the sound pressure level of the sound wave signal acquired by the input signal acquisition process (S3) is analyzed using the program stored in the digital signal (sound wave signal) arithmetic processing program storage unit 53A. Then, a process of extracting a frequency at which the sound pressure level has a maximum value is executed as the selected frequency. Thereafter, in the frequency analysis process (S4), a process of storing data of the selected frequency in the data storage unit 53D is executed.

  The arithmetic processing unit 52 executes the sound source position specifying process (S5) after the frequency analysis process (S4). In the sound source position specifying process (S5), a program stored in the digital signal (sound wave signal) arithmetic processing program storage unit 53A is used, and a pair of microphones M1 and M2 is selected for each selected frequency by the method described below. A process of calculating a horizontal angle θ (see FIG. 4) between the origin position O (see FIG. 4) and the position of the sound source is executed. The data of the horizontal angle θ is stored in the data storage unit 53D. The origin position O is a point that bisects a straight line connecting the microphone M1 and the microphone M2. The direction indicated by the two-dot chain line arrow in FIG. 4 is the propagation direction of the sound emitted from the sound source.

The value of the horizontal angle θ varies depending on the distance between the microphone M1 and the microphone M2, the time difference when the sound emitted from the sound source reaches the pair of microphones M1 and M2, and the temperature of the sound propagation path. The horizontal angle θ is calculated using the following formulas (1) and (2). D12 is a difference in arrival time of sound in the pair of microphones M1 and M2, and c is a propagation speed of sound. L is the distance between the microphone M1 and the microphone M2, and t is the temperature of the sound propagation path.
θ = sin ⁻¹ {(D12 × c) / L} [°] (1)
c = 334 + 0.6t [m / s] (2)

  In the present embodiment, the arithmetic processing unit 52 stores the temperature t in the above equation (2) in the data storage unit 53D when calculating the horizontal angle θ by the sound source position specifying process (S5). The above corrected temperature data (10 ° C. or 30 ° C.) was used. In the sound source position specifying process (S5), the horizontal angle θ is calculated continuously at an interval of 10 times / second, for example, using the above program. The arithmetic processing unit 52 is an example of a sound source position calculation unit of the present invention, and the 10 times / second interval is an example of a predetermined calculation interval of the present invention.

  The arithmetic processing unit 52 executes an image display coordinate conversion process (S6) after the sound source position specifying process (S5). In the image display coordinate conversion process (S6), a process for correlating the position of the sound source with the display position of each of the display areas 71A and 71B is executed. Here, as shown in FIG. 5, the horizontal dimension X1 of the display area 71A and the horizontal dimension X2 of the display area 71B are associated with the horizontal angle θ described above, and the display of each display area 71A, 71B corresponding to the position of the sound source is displayed. Calculate the position.

  Specifically, each display area 71A corresponding to the position of the sound source is based on the ratio α between the horizontal angle of view of the CCD camera 17 (here, 120 °) and the horizontal dimensions X1 and X2 of the display areas 71A and 71B. , 71B is calculated. Hereinafter, as an example, a method for calculating the display position when the value of α is 0.6 will be described using FIG. 6. The display position of the sound source in the vertical direction Y of the display area 71A is associated with a straight line that bisects the vertical dimension of the display area 71A.

  When the horizontal angle θ calculated by the sound source position specifying process (S5) is 25 °, the multiplication result of the value of the horizontal angle θ and the value of α is 15 mm. Thereby, the display position in the horizontal direction of each display area 71A, 71B corresponding to the position P1 of the sound source is determined at a position P3 15 mm away from the center point of each display area 71A, 71B. Thereafter, in the image display coordinate conversion process (S6), a process of storing the data of the position P3 in the data storage unit 53D is executed. The arithmetic processing unit 52 is an example of the correlation unit of the present invention, and the horizontal angle of view of the CCD camera 17 is an example of an imageable range in the horizontal direction of the camera of the present invention.

  In the image display coordinate conversion process (S6), in addition to the process for correlating the above-described sound source position P1 with the display positions of the display areas 71A and 71B, the frequency value of the sound emitted by the sound source and the frequency A process for correlating the display position of the circular image with different colors is executed. Here, in accordance with the vertical dimension Y2 of the display area 71B, a frequency display position corresponding to a frequency of 200 Hz to 4000 Hz is calculated from the lowest point to the highest point in the vertical direction of the display area 71B. The data of the frequency display position is stored in the data storage unit 53D.

  The arithmetic processing unit 52 executes a display image data selection process (S7) after the image display coordinate conversion process (S6). In the display image data selection process (S7), circular image data stored in advance in the data storage unit 53D is selected according to the data of the selected frequency stored in the data storage unit 53D by the frequency analysis process (S4). Execute the process.

  In the display image data selection process (S7), the arithmetic processing unit 52 executes the program stored in the display image data selection processing program storage unit 53B, and stores, for example, 660 Hz in the data storage unit 53D as data of the selected frequency. If it is determined that the image data has been selected, red circular image data is selected from the data storage unit 53D. The red circular image data is used to display a red circular image Z1 (see FIG. 5) in each of the display areas 71A and 71B. In the display image data selection process (S7), circular image data of different colors are selected from the data storage unit 53D in response to different selection frequencies. The circular image data of different colors are used to display circular images Z2 to Z4 (see FIG. 5) of different colors in the display areas 71A and 71B.

  Subsequently, the arithmetic processing unit 52 executes an image display process (S8) after the display image data selection process (S7). In the image display process (S8), the program stored in the image display control program storage unit 53C is executed, and based on the circular image data selected by the display image data selection process (S7) as described below. Then, a process of displaying each of the various circular images Z1 to Z4 at the display position in the horizontal direction of each display area 71A, 71B determined by the image display coordinate conversion process (S6) and the frequency display position of the display area 71B is executed. .

  In the case where a failure sound of the device including the selected frequency is generated at the position P1 shown in FIG. 6, in the image display process (S8), the selected frequency (here, the failure sound is detected) from the data storage unit 53D. Image data (here, red circular image data) associated with a frequency of 660 Hz is read out. Then, based on the red circular image data, the screen is rewritten 10 times per second in accordance with the calculation interval (for example, 10 times / second) of the horizontal angle θ described above, and the position P3 (see FIG. 6). ), A red circular image Z1 (see FIG. 5) is displayed at the display position of each of the display areas 71A and 71B. In the display image data selection process (S8), each display corresponding to the position of the sound source and the selected frequency is performed in the same manner as when the red circular image Z1 (see FIG. 5) is displayed at the display position of the display area 71A. The circular images Z2 to Z4 and the like are displayed in the areas 71A and 71B. The arithmetic processing unit 52 is an example of the display control means of the present invention.

  The arithmetic processing unit 52 determines whether or not a reset process has been performed after the image display process (S8) (S9). Here, the operator operates the keyboard 51 to determine whether or not a key for instructing a reset operation has been pressed.

  If the arithmetic processing unit 52 determines in S9 that the key for instructing the reset operation has not been pressed and the reset process has not been performed, the process returns to the input signal acquisition process (S3). On the other hand, in S9, when the arithmetic processing unit 52 determines that the reset processing has been performed by pressing the key for instructing the reset operation, the execution of the program stored in each of the storage units 53A to 53C is continued. Whether or not (S10).

  In S10, if the arithmetic processing unit 52 determines that the operator has selected to continue the execution of the program by operating the keyboard 51, the process returns to the initial setting process (S1). On the other hand, in S10, when the arithmetic processing unit 52 determines that the operator has selected to stop the execution of the program by operating the keyboard 51, the above-described processes (S1 to S10) are ended. .

<Effect of Embodiment 1>
In the image display device 1 according to the first embodiment, the arithmetic processing unit 52 uses the expressions (1) and (2) in the sound source position specifying process (S5), thereby achieving a sound arrival time difference D12 between the pair of microphones M1 and M2. The horizontal angle θ between the origin position O (see FIG. 4) and the sound source position P1 was calculated. For this reason, unlike the conventional case of obtaining a sound wave signal of a sound emitted from a sound source using five microphones, in order to calculate the horizontal angle θ, the pair of microphones M1 and M2 are used. What is necessary is just to acquire a sound wave signal. Therefore, it is possible to reduce the number of sound wave signals acquired for calculating the horizontal angle θ compared to the conventional case. As a result, the time required for the calculation processing unit 52 to specify the position P1 of the sound source can be reduced as the calculation processing unit 52 can reduce the time required to calculate the horizontal angle θ by the sound source position specifying process (S5). Can be shortened.
In addition, in the sound source position specifying process (S5), the arithmetic processing unit 52 uses the corrected temperature (10) stored in the data storage unit 53D by the operator operating the keyboard 51 as the temperature t in the expression (2). The horizontal angle θ was calculated using the data of (° C. or 30 ° C.). For this reason, when calculating the horizontal angle θ using the correction temperature data, the propagation speed of the sound affected by the temperature can be converged in a certain range. For this reason, as described above, even when the sound wave information acquired for calculating the horizontal angle θ is reduced, the position P1 of the sound source is determined by using the sound propagation speed converged to a certain range. It can suppress that the precision to identify falls.
In addition, in the image display process (S8), the arithmetic processing unit 52 displays the display position in the horizontal direction of each display area 71A, 71B determined by the image display coordinate conversion process (S6), and the frequency in the vertical direction of the display area 71B. Various circular images Z1 to Z4 for identifying the position P1 of the sound source are displayed at the display position, respectively. Thereby, the position P1 of the sound source can be replaced with various circular images Z1 to Z4 and the like. Therefore, the position P1 of the sound source can be visualized through various circular images Z1 to Z4.

The arithmetic processing unit 52 calculates the horizontal angle θ for each selected frequency extracted in the frequency analysis process (S4) based on the sound wave signal that has passed through the bandpass filter 30 in the sound source position specifying process (S5). did. Therefore, the horizontal angle θ can be calculated by the sound source position specifying process (S5) based on the sound wave signal obtained by removing the frequency lower than 200 Hz from the sound wave signal transmitted from each of the microphones M1 and M2. Therefore, when the arithmetic processing unit 52 calculates the horizontal angle θ in the sound source position specifying process (S5) based on the sound wave signal that does not remove the frequency lower than 200 Hz from the sound wave signal transmitted from each of the microphones M1 and M2. As compared with the above, it is possible to reduce the number of sound wave signals used by the arithmetic processing unit 52 to calculate the horizontal angle θ. Accordingly, the time required for the arithmetic processing unit 52 to calculate the horizontal angle θ can be shortened.
In addition, as described above, the band-pass filter 30 removes frequencies below 200 Hz from the sound wave signals transmitted from the microphones M1 and M2, so that 200 Hz is obtained from the frequency characteristics required for the microphones M1 and M2. Lower frequencies can be excluded. Thereby, compared with the case where the microphone which can acquire the sound wave signal of the frequency below 200 Hz is used, the purchase price of each microphone M1 and M2 employ | adopted for this embodiment can also be made cheap.

  Further, in the sound source position specifying process (S5), the calculation processing unit 52 limits the interval for continuously calculating the horizontal angle θ to an interval of 10 times / second. For this reason, compared with the case where the arithmetic processing unit 52 calculates the horizontal angle θ at an interval exceeding 10 times / second, it is possible to suppress the calculation capability required to calculate the horizontal angle θ. Thereby, since the arithmetic processing part 52 can be simplified compared with the past, it can contribute to the reduction of the manufacturing cost of the arithmetic processing part 52, or size reduction of the arithmetic processing part 52.

  In addition, the horizontal angle of view of the CCD camera 17 can be determined according to the standard of the CCD camera 17, and the horizontal dimensions X1 and X2 can be determined to be constant values according to the standard of the display areas 71A and 71B. . For this reason, each ratio between the horizontal angle of view and the horizontal dimensions X1 and X2 can be set to a constant value. As a result, in the image display coordinate conversion process (S6), the arithmetic processing unit 52 determines the position P1 of the sound source according to the respective ratios of the horizontal angle of view and the horizontal dimensions X1 and X2 set to a constant value. The display position corresponding to the position P1 in the horizontal direction of each of the display areas 71A and 71B can be easily associated.

<Embodiment 2>
A second embodiment of the present invention will be described with reference to FIGS. 3, 5, and 7. FIG. Here, the same configurations as those of the first embodiment are denoted by the same reference numerals, and description thereof is omitted. In the image display apparatus according to the present embodiment, the personal computer 50 </ b> A includes a controller 54. The controller 54 is connected to the arithmetic processing unit 52. The controller 54 is provided with a winter mode setting button 54A and a summer mode setting button 54B. As will be described later, the operator can select either the winter mode setting button 54A or the summer mode setting button 54B to select a correction temperature for the sound propagation speed corresponding to the winter or summer. Each setting button 54A, 54B is an example of the correction temperature setting means of the present invention.

  Each data of winter correction temperature (10 ° C.) and summer correction temperature (30 ° C.) is stored in advance in the data storage unit 53D. The data storage unit 53D includes a selection correction temperature data storage unit 53E.

  Next, a process in which the arithmetic processing unit 52 of the present embodiment displays an image for identifying the position of the sound source in the display areas 71A and 71B will be described. The arithmetic processing unit 52 executes each processing (S1 to S10) shown in FIG. Hereinafter, processing (S1, S5, S9) different from that of the first embodiment will be described.

  When the winter mode setting button 54A is selected and pressed by the operator, the arithmetic processing unit 52 reads the winter correction temperature (10 ° C.) data from the data storage unit 53D in the initial setting process (S1). Processing for storing the winter correction temperature data in the selected correction temperature data storage unit 53E is executed. On the other hand, when the summer mode setting button 54B is selected and pressed by the operator, the arithmetic processing unit 52 receives the summer correction temperature (30 ° C.) from the data storage unit 53D in the initial setting process (S1). Data is read and processing for storing the summer correction temperature data in the selected correction temperature data storage unit 53E is executed.

  When calculating the horizontal angle θ in the sound source position specifying process (S5), the arithmetic processing unit 52 uses the correction temperature (stored in the selected correction temperature data storage unit 53E as the temperature t in the above equation (2)). 10 ° C or 30 ° C) data is used. Thereafter, as in the first embodiment, the arithmetic processing unit 52 displays the circular images Z1 to Z4 and the like at the display positions of the display areas 71A and 71B associated with the horizontal angle θ calculated for each selected frequency. To do.

  Subsequently, when the arithmetic processing unit 52 determines in S9 that the reset processing has been performed, the arithmetic processing unit 52 returns to the initial setting processing (S1). Thereby, the arithmetic processing unit 52 repeatedly confirms which one of the winter mode setting button 54A and the summer mode setting button 54B is pressed by the operator, and corrects the winter correction temperature (10 ° C.) and the summer correction temperature (30 ° C.). Is stored in the selected correction temperature data storage unit 53E.

<Effect of Embodiment 2>
In the image display apparatus according to the second embodiment, the operator can select different temperatures (10 ° C. or 10 ° C.) as the temperatures for correcting the propagation speed of the sound emitted from the sound source by either the winter mode setting button 54A or the summer mode setting button 54B. 30 ° C.) can be selected. For this reason, the operator can easily select the correction temperature of the propagation speed according to either the winter or summer by selecting and pressing either the winter mode setting button 54A or the summer mode setting button 54B. Can do.

<Embodiment 3>
Embodiment 3 of the present invention will be described with reference to FIG. 3, FIG. 8, and FIG. Here, the same configurations as those of the first and second embodiments are denoted by the same reference numerals, and the description thereof is omitted. In the image display device 1 </ b> B of the present embodiment, a temperature sensor 80 is fixed to the microphone support base 18. The temperature sensor 80 is used to measure the ambient temperature of the pair of microphones M1 and M2.

  The temperature sensor 80 is connected to the A / D converter 40. The A / D converter 40 generates actually measured temperature data based on the voltage signal transmitted from the temperature sensor 80. This measured temperature data is transmitted to the personal computer 50.

  Next, processing in which the arithmetic processing unit 52 displays an image for identifying the position of the sound source in each of the display areas 71A and 71B will be described. Here, processing (S3, S5) different from the first and second embodiments among the processing executed by the arithmetic processing unit 52 will be described.

  The arithmetic processing part 52 performs the process which acquires said measured temperature data in the input signal acquisition process (S3) shown in FIG. Here, as shown in FIG. 9, the actually measured temperature data is input to the arithmetic processing unit 52. The arithmetic processing unit 52 executes a process of storing the actually measured temperature data in the data storage unit 53D.

  Furthermore, when calculating the horizontal angle θ in the sound source position specifying process (S5), the arithmetic processing unit 52 uses the measured temperature data stored in the data storage unit 53D as the temperature t in the above equation (2). Use. Thereafter, the arithmetic processing unit 52 displays the circular images Z1 to Z4 and the like in the display areas 71A and 71B as in the first and second embodiments.

<Effect of Embodiment 3>
In the image display device 1B of the third embodiment, the arithmetic processing unit 52 performs the above-described operation according to the ambient temperature (measured temperature data) of the pair of microphones M1 and M2 measured by the temperature sensor 80 in the sound source position specifying process (S5). The horizontal angle θ was calculated. Therefore, the arithmetic processing unit 52 can sequentially calculate the horizontal angle θ while reflecting the actually measured temperature data. Therefore, if the measured temperature data is used, the arithmetic processing unit 52 can calculate the horizontal angle θ under conditions that match the actual environment. Thereby, the precision which the arithmetic processing part 52 calculates horizontal angle (theta) can be improved.

  The present invention is not limited to the embodiment described above, and can be implemented by appropriately changing a part of the configuration without departing from the spirit of the invention. For example, unlike Embodiments 1 to 3 described above, instead of circular images, images such as triangles and squares are displayed in the display areas 71A and 71B, or sound waves acquired by input signal acquisition processing (S4) Depending on the difference in sound pressure level of the signal, the arithmetic processing unit 52 may display circular images or the like having different sizes in the display areas 71A and 71B.

  Unlike the second embodiment, in addition to the winter mode setting button 54A and the summer mode setting button 54B, the controller 54 is provided with a spring mode setting button and an autumn mode setting button. In addition to the winter and summer seasons, The operator may be able to easily select the correction temperature for the sound propagation speed. In addition, without providing the controller 54 in addition to the keyboard 51, the buttons 54 </ b> A and 54 </ b> B may have functions of arbitrary keys of the keyboard 51 so that the winter correction temperature and the summer correction temperature can be selected.

  Further, the present invention is not limited to the above-described embodiment, and is removed by the bandpass filter 30 by changing the frequency band that passes through the bandpass filter 30 to an appropriate range according to the frequency of the fault sound to be detected. The frequency of the sound wave signal may be set to a value other than a value lower than 200 Hz. As a result, the sound wave signal having a frequency unnecessary for the calculation of the horizontal angle θ described above can be cut as noise, and the sound wave signal having the unnecessary frequency is erroneously reflected in the calculation of the horizontal angle θ, and the position P1 of the sound source. It is possible to prevent a decrease in the accuracy of specifying the. In addition, the horizontal angle θ displayed in the display area 71B is not limited to 120 °, and may be set to an appropriate value (for example, 130 °) corresponding to the horizontal angle of view of the CCD camera 17.

In addition, unlike the above-described embodiments, as shown in FIG. 10, the caster 19 is attached to the support members 15 </ b> A to 15 </ b> C, and the operator presses the measurement unit 10 to push the caster 19. The microphones M1 and M2 may be rotated so as to follow the sound source so that the microphones M1 and M2 can be moved largely or narrowly.
In such a case, during the movement of the microphones M1 and M2 following the sound source, the positions where the microphones M1 and M2 are installed with respect to the sound source are variously changed, so that each microphone M1 is changed. , M2 can easily acquire sound signals of different types (for example, different frequencies) used for calculating the horizontal angle θ described above.
As a result, the microphones M1 and M2 can acquire as many sound wave signals as possible for the arithmetic processing unit 52 to calculate the horizontal angle θ by the sound source position specifying process (S5). Therefore, if a large number of sound wave signals are used, a state in accordance with the real environment can be reflected in the calculation of the horizontal angle θ in real time, and the accuracy of specifying the position P1 of the sound source can be improved. The caster 19 is an example of the moving means of the present invention.
In addition, after using a large number of sound wave signals and reflecting the state in accordance with the real environment in the calculation of the horizontal angle θ in real time, the arithmetic processing unit 52 performs the sound source position specifying process ( In S5), the interval at which the horizontal angle θ is continuously calculated may be limited to an interval of 10 times / second, for example. According to this, even when many sound wave signals are used, the time required for the arithmetic processing unit 52 to calculate the horizontal angle θ is limited to the interval at which the horizontal angle θ is continuously calculated. There is also an advantage that it can be shortened according to

  In addition, unlike the above-described embodiments, an MPU (Micro Processing) in which the amplifier 20, the band-pass filter 30, the A / D converter 40, the personal computer 50, and the video input / output unit 60 are integrated into one chip. (Unit) and a small camera and a pair of microphones incorporated in or externally attached to a case equipped with an MPU, the image display device may be made smaller and portable.

  In addition, in a game device that is equipped with one camera and one microphone and is portable in advance, the other one microphone is externally attached, and a program that can execute the processing in each embodiment is stored, so that each of the embodiments can be stored. A function similar to that of the image display device may be provided. Furthermore, you may use the image display apparatus of each embodiment not only for the failure sound of an apparatus but in order to identify the position where an insect call, an animal call, etc. are emitted.

  1 .... Image display device, 17 .... CCD camera, 19..Caster, 30..Bandpass filter, 51..Keyboard, 52..Calculation processing unit, 54A..Winter mode setting button, 54B..Summer mode Setting button, 70..Display, 71..Display area, 80..Temperature sensor, L..Distance between two microphones, M1, M2..Microphone, X..Horizontal dimensions of display area, Z1 to Z4 ..Circular images

Claims (7)

Display means for displaying a captured image captured by the camera in a display area;
Sound collecting means comprising a pair of microphones arranged at a predetermined interval;
Correction temperature setting means for setting a temperature for correcting the propagation speed of the sound collected by the sound collection means;
Sound source position calculating means for calculating the position of the sound source that emits the sound based on the time difference when the sound reaches the pair of microphones and the correction temperature set by the correction temperature setting means;
Correlating means for correlating the position of the sound source calculated by the sound source position calculating means with the display position in the captured image displayed in the display area in correspondence with the position of the sound source;
Display control means for performing control to display an image for identifying the position of the sound source at the display position correlated with the position of the sound source by the correlation means;
An image display device comprising:   The image display apparatus according to claim 1, wherein the correction temperature setting unit can select different temperatures as the correction temperature according to a difference in season. A band limiting filter that outputs a band-limited signal that is band-limited to a predetermined frequency band by removing a frequency equal to or lower than a predetermined cutoff frequency from the sound signal collected by the sound collecting means;
The image display device according to claim 1, wherein the sound source position calculating unit calculates the position of the sound source according to the band limited signal output from the band limiting filter.   4. The image display device according to claim 1, wherein the sound source position calculating means limits a calculation interval for continuously calculating the position of the sound source to a predetermined calculation interval.   The image display apparatus according to claim 1, further comprising a moving unit that can move a position where the sound collecting unit is installed to follow the sound source. The correction temperature setting means includes a temperature sensor that measures the ambient temperature of the sound collection means,
The image display apparatus according to claim 1, wherein the sound source position calculating unit calculates the position of the sound source according to the ambient temperature measured by the temperature sensor. The correlation means includes
The position of the sound source and the display position in the horizontal direction of the display area are correlated in accordance with a ratio between a shootable range in the horizontal direction of the camera and a horizontal dimension of the display area. Item 7. The image display device according to any one of Items 1 to 6.

Images