WO2007020984A1

WO2007020984A1 - Vibrator observing method, vibrator observing device, vocal cord observing method, vocal cord observing device and vocal cord observing program

Info

Publication number: WO2007020984A1
Application number: PCT/JP2006/316191
Authority: WO
Inventors: Seiichi Washio; Shinji Deguchi
Original assignee: National University Corporation Okayama University
Priority date: 2005-08-17
Filing date: 2006-08-17
Publication date: 2007-02-22
Also published as: JP2007050077A; JP3882088B1

Abstract

A vibrator observing method which permits the detailed observation of vibration at a vibrator such as a vocal cord having a plurality of vibration portions as a result of a lesion or the like with a simple operation and concurrently at the plurality of vibration portions, and a small, light, and inexpensive vibrator observing device used for the method, and a vocal cord observing device and a vocal cord observing program. When a vibrator vibrating at at least a first basic frequency and a second basic frequency is photographed by an imaging means, a first signal having a frequency different from the first basic frequency and a second signal having a frequency different from the second basic frequency are generated, the vibrator is photographed based on the first and second signals, and photographed images are continuously displayed on a display means to generate slow-motion images.

Description

Specification

Vibrating body observation method, vibrating body observation apparatus, vocal cord observation method, vocal cord observation apparatus, and vocal cord observation program

TECHNICAL FIELD [0001] The present invention relates to a vibrating body observation method, a vibrating body observation apparatus, a vocal cord observation method, a vocal cord observation apparatus, and a vocal cord observation program for observing a vibrating body such as a vocal cord. Vibrating body observation method, vibrating body observation apparatus, vocal cord observation method, vocal cord observation apparatus, and vocal cord observation program that can visualize the vibration state of a vibrating body such as a vocal cord that vibrates at a high frequency that is not visible in It is about.

Background art

[0002] It is well known that human voices are caused by vocal cord vibrations. In the case of adult men, the basic frequency is 110 to 150 Hz, and in the case of adult women, the basic frequency is 220 to The vocal cords vibrate and sing at about 270Hz.

[0003] When a lesion or the like occurs in this vocal cord, the vibration is inhibited by the lesion portion, so that the vocal cord has a vibration with a frequency different from the normal frequency, thereby producing a double sound. Are known. However, if this dual sound can be confirmed by listening with the ear, the lesion occurring in the vocal cords has progressed vigorously, and the abnormal vibration of the vocal cords is detected before it can be confirmed by hearing with the ear. It is demanded.

[0004] However, since the vocal cords vibrate at a frequency of 100 Hz or higher, it is impossible to visually observe the vibration state of the vocal cords, and the initial abnormal vibrations of the vocal cords are detected visually. Was impossible.

[0005] Therefore, in some medical facilities, it is possible to visually check vibration abnormalities by photographing the vocal cord vibration at high speed using a high-speed camera and displaying the vibration state of the vocal cords as a slow motion image. It is done.

[0006] However, high-speed cameras and video playback devices shot with high-speed cameras are expensive and complicated to operate, so it is not a device that anyone can handle. It was only popular in medical facilities in Japan. [0007] On the other hand, in recent years, an informed concept has been emphasized, and images taken of the vibration state of the vocal cords are used only for the diagnosis of voice disorders and vocal cord diseases, for explanation to patients and the like. It is also extremely useful.

[0008] Therefore, it is required to photograph the vibration state of the vocal cords more easily and at a lower cost than a high-speed camera. In response to such demands, a simple method for creating slow motion video has been proposed using the characteristic that vocal cord vibration is constant when a constant voice is uttered.

[0009] In this method of creating a slow motion video, a voice emitted from a subject is picked up by a microphone and a voice signal that is a fundamental frequency signal in the voice is extracted, and a cycle slightly longer than the cycle of the voice signal is extracted. A sampling signal is generated, a light emitting diode is caused to emit light at a timing based on this sampling signal, a vocal cord is sequentially photographed by a CCD camera at the timing of light emission of this light emitting diode, and the photographed image is continuously displayed on a display device. There has been proposed a method of generating a slow motion image by reducing the apparent vibration speed of the vocal cords by displaying (for example, Non-Patent Document 1).

[0010] Further, the apparatus includes an imaging unit of an imaging unit such as the CCD camera and an irradiation unit such as the light-emitting diode, and can easily capture the vocal cord by integrating the imaging unit and the irradiation unit. An apparatus that can be used has been proposed (for example, Patent Document 1).

[0011] In addition, the apparatus includes the imaging unit and the irradiation unit, and vibrates at a predetermined frequency like the vocal cords, and vibrations of the heart and the esophagus affected by the heartbeat. Devices for observing the body have also been proposed (for example, Patent Document 2).

Patent Document 1: Japanese Patent Laid-Open No. 2001-78962

Patent Document 2: Japanese Patent Laid-Open No. 08-160319

Non-Patent Document 1: Tadashi Ishimaru, 4 others, "Prototype of a laryngeal stroboscope using a light-emitting diode", The Nippon Eclipse Journal, 51 (4), 2000, pp. 335-339

Disclosure of the invention

Problems to be solved by the invention

[0013] However, in the conventional method and apparatus, one type of sampling signal is set for an inspection object that vibrates at one type of basic frequency, and based on this sampling signal. When the object to be inspected vibrates at multiple fundamental frequencies, such as a vocal cord that emits double sound, for example, a single fundamental frequency is used. When creating slow motion video based on the above, it is difficult to generate slow motion video of vibration states based on other fundamental frequencies, and it is difficult to accurately observe multiple types of vibration states There was a problem of becoming.

[0014] In the present invention, when observing the vibration state of a vibrating body that vibrates based on multiple types of basic vibrations such as a vocal cord that emits double sound, it is possible to observe in detail with a simple operation. It is an object of the present invention to provide a vibrating body observation method and a vocal cord observation method, a small and light vibration body observation device and a vocal cord observation device, and a vocal cord observation program used for the vocal cord observation device.

Means for solving the problem

[0015] In order to achieve the above object, in the vibrating body observation method of the present invention, a plurality of vibrating bodies are photographed at a predetermined timing by the imaging means, and the photographed images are continuously displayed on the display means. In the method for observing a vibrating body that enables observation of the vibration state of at least the first fundamental frequency and the second fundamental frequency of the vibrator that vibrates at the first fundamental frequency and the second fundamental frequency are detected. Generating a first signal having a frequency different from the first basic frequency detected in the frequency detecting step and a second frequency having a frequency different from the second basic frequency. A signal generating step for generating a signal, a shooting step for shooting a vibrating body based on the first signal and the second signal generated in the signal generating step, and an image shot in the shooting step on the display means. To display It was to have shown driving step.

[0016] Further, in the signal generation step, the ratio of the frequency of the first signal and the frequency of the second signal is matched with the ratio of the first fundamental frequency and the second fundamental frequency. Have characteristics.

[0017] Further, in the vibrating body observation apparatus of the present invention, at least the first fundamental frequency and the second fundamental frequency of the vibrator that vibrates at the first fundamental frequency and the second fundamental frequency are obtained. Detecting frequency detection means and signal generation for generating a first signal and a second signal that vibrate at a frequency different from the first fundamental frequency and the second frequency detected by the frequency detection means, respectively. Means and In addition, there are provided photographing means for photographing the vibrating body at a timing based on the first signal and the second signal, and display means for continuously displaying the images photographed by the photographing means.

[0018] Further, the signal generating means has matched the ratio of the frequency of the first signal and the frequency of the second signal with the ratio of the first fundamental frequency and the second fundamental frequency. The imaging device is also characterized by including a light source that emits light at a timing based on the first signal and the second signal to illuminate the vibrator.

[0019] Further, the vocal cord observation method of the present invention is a vocal cord observation method for observing a vocal cord that vibrates at least at the first fundamental frequency and the second fundamental frequency, and the first fundamental frequency and the second fundamental frequency. To generate a first signal based on the first fundamental frequency and a second signal based on the second fundamental frequency, and to generate a timing based on the first signal. In addition to irradiating the vocal cords with light instantaneously, the vocal cords are observed by momentarily irradiating the vocal cords with the timing based on the second signal.

[0020] Further, in the vocal cord observation method of the present invention, a plurality of vocal cord images are photographed at a predetermined timing, and the vocal cord vibration state can be observed by continuously displaying the photographed images on the display means. In the observation method, the vocal cords that vibrate at least at the first fundamental frequency and the second fundamental frequency are generated based on the first signal generated based on the first fundamental frequency and the second fundamental frequency. The photo is taken while irradiating light at a timing based on the generated second signal.

[0021] Further, in the vocal cord observation apparatus of the present invention, the frequency detecting means for detecting a plurality of basic frequencies included in the sound emitted from the vocal cords, and the plurality of basic frequencies detected by the frequency detecting means. A signal generating means for generating a signal having a frequency different from the fundamental frequency for each of the above, a photographing means for photographing the vocal cords based on each signal generated by the signal generating means, and an image photographed by the photographing means in succession Display means for displaying automatically.

[0022] Furthermore, the following features are also characteristic. That is,

(1) The frequency detection means detects any one basic vibration included in the sound as the first basic vibration, and the basic vibration having a higher frequency than the first basic vibration is detected as the second basic vibration. The signal generation means detects the first frequency corresponding to the first fundamental frequency. The frequency of the signal and the frequency of the second signal corresponding to the second fundamental frequency are generated, and the ratio between the frequency of the first signal and the frequency of the second signal is set to The ratio between the fundamental frequency and the second fundamental frequency must be matched.

(2) An extraction unit that extracts an image captured by the imaging unit for each image captured at a timing based on the first signal and an image captured at a timing based on the second signal; It has compositing means for compositing the extracted images, and the display means displays the composite image synthesized by the compositing means.

(3) The photographing means should include a light source that emits light at a timing based on the first signal and the second signal to illuminate the vibrating body.

(4) The light emission at the timing based on the first signal should be emitted with a color different from the light emission at the timing based on the second signal!

(5) a light amount calculating means for calculating the light amount of the light source based on the vocal cord image taken by the photographing means, and a light amount control means for adjusting the vocal cord image according to the light amount of the light source calculated by the light amount calculating means. thing.

(6) When the frequency detecting means has a force capable of detecting only one fundamental frequency, this fundamental frequency is set as the first fundamental frequency, and the signal generating means corresponds to the first fundamental frequency. Only the first signal was generated, and the vocal cords were photographed by the photographing means at the timing based on this first signal.

[0023] Further, in the vocal cord observation program of the present invention, a computer generates a signal for observing the vocal cords based on the sound emitted from the vocal cords, and outputs a photographed vocal cord image based on the signal. A vocal fold observation program to be executed by a computer, wherein a computer detects each of a plurality of fundamental frequencies detected in a frequency detection step and a frequency detection means for detecting a plurality of fundamental frequencies included in a voice emitted from the vocal cords. A signal generation means for generating a signal having a frequency different from the basic vibration frequency, a photographing control means for photographing the vocal cords with a photographing means for photographing the vocal cords based on each signal generated in the signal generation step, It was made to function as a display driving means for continuously displaying images taken in steps on the display means.

[0024] Further, the frequency detection means may convert any one of the basic vibrations included in the sound to the first basic vibration. In addition to detecting as a vibration, a fundamental vibration having a frequency larger than the first fundamental vibration is detected as a second fundamental frequency, and the signal generating means uses a first signal corresponding to the first fundamental frequency. And the frequency of the second signal corresponding to the second fundamental frequency, and the ratio of the frequency of the first signal to the frequency of the second signal is It is also characterized by the fact that it matches the ratio between the frequency and the second fundamental frequency.

The invention's effect

[0025] According to the present invention, a vibrating body that vibrates based on a plurality of fundamental vibrations is photographed by the imaging means at the timing of the signal set based on each fundamental vibration, and the photographed image force is also slow motion video. By generating, a slow motion image that clearly enables observation of the vibration state corresponding to each basic vibration can be generated easily and inexpensively, and detailed observation of the vibration state can be made possible.

[0026] In particular, when the vibrating body is a vocal cord, the vibration state can be clearly observed when a vibration based on a plurality of types of fundamental frequencies is generated in the vocal cord due to a lesion or the like occurring in the vocal cord. Slow motion video can be generated easily and inexpensively, making it easier to detect abnormalities in the vocal cords.

[0027] Furthermore, each signal that designates the imaging timing of the imaging means that is set based on each fundamental vibration is a signal having a frequency ratio that matches the frequency ratio of each fundamental vibration. In addition, it is possible to generate a slow motion image that clearly shows the vibration state of the vibrating body that vibrates with each basic vibration.

Brief Description of Drawings

FIG. 1 is a schematic diagram of a vocal cord observation apparatus according to the present invention.

FIG. 2 is a block diagram of a vocal cord observation apparatus according to the present invention.

[FIG. 3] FIG. 3 is a conceptual diagram showing the relationship between the detected vocal cord vibration, the irradiation period of light applied to the vocal cord, and the observed vocal cord vibration.

[Fig. 4] Fig. 4 is an explanatory view showing the state of the vibration of the vocal cords causing the lesion.

[FIG. 5] FIG. 5 is a speech waveform spectrum diagram obtained by analyzing speech uttered by a vocal cord with lesions.

FIG. 6 is a flowchart showing an operation mode of the vocal cord observation apparatus shown in FIG. Explanation of symbols

[0029] 1 subject

2 vocal cords

2F, 2B Vibration section

3 Microphone

5 Camera

10 computers

11 Control unit

12 Recording section

14 Display

21, 22 LED

100 Vocal cord observation device

BEST MODE FOR CARRYING OUT THE INVENTION

[0030] The vibrating body observation method and the vibrating body observation apparatus according to the present invention photograph a vibrating body that vibrates at a plurality of types of basic frequencies at a predetermined timing a plurality of times, and link the photographed images. This is a vibration body observation method and a vibration body observation apparatus that generates a slow motion video by continuously displaying it, and enables the state of vibration of the vibration body to be visually observed using this slow motion video!

[0031] In particular, in the vibrating body observation method and the vibrating body observation apparatus of the present invention, at least two types of basic frequencies are detected, and a signal having a frequency different from that frequency is detected for each basic frequency. Each sampling signal is generated, and a vibrating body is sequentially photographed by an imaging means such as a CCD camera at a timing based on the sampling signal, and the photographed images are continuously displayed on the displaying means. It is.

[0032] In this way, each of the vibration bodies having different fundamental frequencies is photographed based on the respective sampling signals, and the images obtained by the photographing are combined and displayed. Slow motion video can be generated that enables confirmation of the vibration status at basic vibration.

[0033] Here, when the vocal cords were observed using the vibrating body as a vocal cord, lesions had occurred in the vocal cords It is possible to provide a vocal cord observation apparatus that can reliably and easily observe the vibration state of the vocal cords based on a plurality of types of fundamental vibrations that occur at the same time.

[0034] In particular, when observing the vocal cords, it is only necessary to observe vibrations at a frequency different from the normal frequency in the abnormal vocal cords. 2 fundamental vibrations are identified, the first signal is generated as a sampling signal based on the first fundamental frequency, and the second signal is used as the sampling signal based on the second fundamental frequency. Generated and shot by irradiating the vocal cords with light instantaneously at the timing based on the first signal, and illuminating the vocal cords with light instantaneously at the timing based on the second signal. In addition, a slow-motion video of the vocal cords that vibrates with two basic vibrations is generated from each image, enabling visual observation.

[0035] The first signal is a signal having a frequency smaller than the first fundamental frequency, and the second signal is a signal having a frequency smaller than the second fundamental frequency. By using, it is possible to generate slow motion video.

[0036] Furthermore, the first signal and the second signal indicate the ratio of the frequency of the first signal to the frequency of the second signal, and the ratio between the first fundamental frequency and the second fundamental frequency. By matching the ratio, the vibration state at each fundamental frequency displayed in the generated slow motion video can be clarified more clearly.

[0037] Hereinafter, a vibrating body observation method, a vibrating body observation apparatus, a vocal cord observation apparatus, and a vocal cord observation program according to the present invention will be described with reference to the drawings. In the following description, the vibrating body is described as a vocal cord, but it goes without saying that it can be used for a vibrating body other than the vocal cord.

As shown in FIG. 1, a vocal cord observing apparatus 100 according to the present invention detects a voice generated by a personal computer 10 that is a computer as a control terminal and a vocal cord 2 of a subject 1 as an electrical signal. The microphone 3 as a means, the amplifier 4 that amplifies the output signal of the microphone 3 and inputs it to the personal computer 10, and two light emitting diodes (hereinafter referred to as light emitting diodes) that are connected to the personal computer 10 and emit light under the control of the personal computer 10 (Referred to as “LED”) 21 and 22 and the vocal cord 2 illuminated by the light emission of these LEDs 21 and 22 are photographed and the signal of the photographed image is output to the personal computer 10 Camera 5 as shadowing means, support bar 6 as light source support member that integrally supports LED21, 22 at its tip, microphone 3, amplifier 4, amplifier 4, personal computer 10, LED11, personal computer 10, LED12 And a personal computer 10, a camera 5 and a personal computer 10 connected to each other, and a cable 7 as a signal transmission means for transmitting various signals as will be described later. In addition, the power that uses a so-called CCD (Charge-Coupled Device) camera for camera 5 COMS (Complementary Metal Oxide Semiconductor 7 mef can be used.

As shown in FIG. 2, the personal computer 10 is constituted by a CPU or the like. Specifically, the personal computer 10 controls the overall operation of the vocal cord observation device 100, a hard disk, A storage unit 12 composed of ROM, RAM, etc., an input unit 13 composed of a keyboard and a mouse, a display unit 14 composed of a monitor, a speaker 15 that outputs audio, and an amplifier 4 An AZD converter 16 that performs AZD conversion of input signals and output signals to the LEDs 21 and 22 and a video input port 17 that receives input signals from the camera 5 are provided. The control unit 11, the storage unit 12, the AZD converter 16, and the video input port 17 are provided in the main body 10a of the personal computer 10.

[0040] The personal computer 10 according to the present embodiment is a notebook personal computer that includes the display unit 14 and is easy to carry.

[0041] The LEDs 21 and 22 emit light in different colors. Specifically, the LEDs 21 and 22 emit light in red and green, respectively. The reason for using red and green as the LED 21 and 22 color combinations is that these colors are the most readily available and easy to use, and have the advantage of being easily discernable when viewed with the eyes. Because of the power that may be a combination of other colors.

[0042] The microphone 3 is a non-contact microphone. By using a non-contact microphone, it is possible to facilitate the operation up to the observation that does not require wearing work on the neck like a contact microphone, and to reduce the burden and discomfort of the subject 1

[0043] Generally, the human vocal cord 2 oscillates at a fundamental frequency of 100 to 400 Hz and emits sound in a normal state. Therefore, simply observing the vocal cord 2 with light, The state cannot be accurately captured by the human eye. Therefore, the vocal cord observation device 100 shoots the vocal cord 2 by emitting light at a frequency different from the fundamental frequency that powers the LEDs 21 and 22, and reduces the apparent frequency of the vocal cord 2 by using the photographed image. The vibration state of the vocal cords can be observed.

The principle that the apparent frequency of vocal cord 2 is reduced will be described with reference to FIG. In Fig. 3, the waveform shown by the solid line shows the actual fundamental vibration of vocal cord 2. Let T be the period of the actual fundamental vibration. Here, if light is applied to the vocal cord 2 at a timing based on a period T ′ different from T, the vocal cord 2 becomes visible only when the light is applied, and this visible state is the time T ′ interval. Above, the vibration of vocal cord 2 is observed in the waveform shown by the broken line, and the apparent period becomes T ". Period T" is determined by the relationship between period T and period T '.

[0045] Therefore, by adjusting the light emission period of LEDs 21 and 22 (T 'in Fig. 3), the range of periods in which the apparent period of vocal cord 2 (T "in Fig. 3) can be captured by the human eye If it is inside, it is possible to observe in detail the state of vibration of vocal cord 2. In other words, by adjusting the emission frequency of LEDs 21 and 22 (1ZT 'using T' in Fig. 3), the vocal cord 2 The apparent frequency (1ZT "using Τ" in Fig. 3) is within the range of frequencies that can be perceived by the human eye.

[0046] Normally, normal vocal cord 2 vibrates at a single fundamental frequency, and if vocal cord 2 is in a normal state, the left vibrating portion and right vibrating portion of vocal cord 2 are synchronized with each other. It is known to vibrate symmetrically at a single basic frequency!

However, as shown in FIG. 4, when a lesion 18 such as a nodule or cancer occurs in the vocal cord 2, the living tissue hardens in the lesion 18 and the lesion progresses as the lesion 18 progresses. It is known that the lesion 18 is difficult to vibrate.

[0048] In this state, the vocal cord 2 has the lesioned part 18 as a node, and the vibrating part 2F on the front side and the vibrating part 2 より on the rear side of the lesioned part 18 vibrate independently. 2F and 2B show vibrations with multiple fundamental frequencies different from the fundamental frequencies in the normal state.

[0049] That is, vocal cord 2 has a plurality of fundamental frequencies different from the single fundamental frequency found in normal times. It will vibrate at the number of motions, resulting in a voice disturbance that appears as a double voice. Fig. 4 is a schematic diagram of the vocal fold vibration dynamics of Takebushi-like vocal cord cases (Hirose Hirose, "Clinical voice disorder", Interna, 2000), which shows an example of lesions occurring in vocal cord 2 However, if a lesion occurs in another mode, it will vibrate in a different state from that shown in Fig. 4.

[0050] As already described, in order to observe vocal cords 2 with such lesions with a conventional apparatus, the operation is complicated, and a plurality of vibration parts cannot be observed at one time. Since it is impossible to observe the vibration of the vibration part in comparison, it is difficult to grasp the actual vibration of the vocal cords.

[0051] In other words, the conventional pharyngeal stroboscope device is suitable for observing vocal cords that vibrate at a single basic frequency in a normal vocal cord, but is accurate for clinical examination and diagnosis. It is difficult to accurately observe the vibration of pathological vocal cords with multiple fundamental frequencies that are required.

[0052] Therefore, when a camera capable of high-speed shooting is used, the vibration of the vocal cords can be reduced to a speed that can be followed by the human eye, and can be reproduced and observed. Because it is large and expensive, it is difficult to spread.

[0053] On the other hand, in recent years, the informed concept has been emphasized, and observing the vocal cord vibration so that it can be followed by the human eye is only useful for diagnosing voice disorders and vocal cord diseases. It is extremely useful for explaining to patients.

[0054] Therefore, in the vocal cord observation apparatus 100 of the present invention, the vibration of the vocal cord 2 having a plurality of vibration parts due to the occurrence of a lesion or the like can be performed at a time by a simple operation by using the plurality of LEDs 21 and 22. This is a small, lightweight and inexpensive vocal cord observation device that enables detailed observation. A case where the vocal cord 2 shown in FIG. 4 is observed using the vocal cord observation apparatus 100 will be described.

[0055] First, a photographer who photographs the vocal cord 2 with the camera 5 operates the support bar 6 to insert the LEDs 21 and 22 disposed at the tip thereof into the oral cavity of the subject 1, and the LEDs 21 and 22 The support rod 6 is arranged at a position suitable for irradiating the vibrating parts 2F and 2B, respectively. Further, the photographer places the camera 5 in a position where the vocal cord 2 can photograph at least the vibrating portions 2F and 2B, and the microphone. 3 is arranged at a position near the throat of the subject 1 so that the voice of the subject 1 can be picked up.

[0056] In the personal computer 10, the photographer activates a program related to the vocal cord observation device 100 (hereinafter referred to as a "voice vocal vibration observation program"), prompts the subject 1 to speak, and picks up the voice of the subject 1 with the microphone 3.音声 The audio signal amplified by amplifier 4 is converted to a digital signal by AZD converter 16.

[0057] Based on the vocal cord vibration observation program! / In the personal computer 10, the digital signal is stored in the storage unit 12 or directly stored in the control unit 11 without being stored in the storage unit 12. , Transform into frequency domain by FFT (Fast Fourier Transform). This conversion produces a speech waveform spectrum as shown in Fig. 5. Based on the vocal cord vibration observation program, the control unit 11 of the personal computer 10 identifies the fundamental frequencies Fl and F2 of the vibration units 2F and 2B from the speech waveform spectrum.

[0058] Based on the vocal cord vibration observation program, the control unit 11 of the personal computer 10 causes the LEDs 21 and 22 to emit light based on the fundamental frequencies Fl and F2. The frequencies differ from the fundamental frequencies Fl and F2, respectively. F, 1, and F'2 signals are generated and output through the AZD comparator 16, and LEDs 21 and 22 are output based on the generated frequency F'1 and F'2 signals, respectively. Make it emit light.

[0059] The vibration parts 2F and 2B of the vocal cord 2 have periods T'l, (= lZF'1), and T'2 (= lZF'2), respectively.

Illuminated by the LEDs 21 and 22, and taken by the camera 5 at the timing.

[0060] In particular, one LED 21 emits red light, for example, and the other LED 22 emits green light, for example, so that the camera 5 takes a red image as the LED 21 emits light and the LED 22 emits light. Take a green image.

The camera 5 sequentially inputs the captured image signal to the personal computer 10 via the video input port 17. In the personal computer 10, the input image is stored in the storage unit.

Record in 12 and display continuously on display 14.

[0062] In the control unit 11 of the personal computer 10, the period T "l, Τ" 2 is adjusted to about lZlOsec, which is the speed that the human eye can follow, and the vibration of the vocal cord 2 is adjusted to each vibration unit 2F.

, 2B can be observed well as each vibration. These series of operations are controlled by the control unit 11 based on a vocal cord vibration observation program recorded in the storage unit 12 of the personal computer 10.

[0064] Therefore, the storage unit 12 and the control unit 11 detect the frequency of the voice corresponding to the plurality of fundamental frequencies F1 and F2 of the vocal cord 2 in the voice of the subject 1 detected by the microphone 3. Signal generation means that functions as a detection means and generates signals of frequencies F '1 and F' 2 different from the basic frequencies Fl and F2 for the detected basic frequencies Fl and F2 of the detected sounds. Function as.

[0065] Therefore, the vocal cord vibration observation program is a program for detecting the fundamental frequencies F1 and F2 included in the voice of the subject 1, and performs spectrum analysis to generate the voice waveform spectrum shown in Fig. 5 by FFT. The analysis program to be performed and the generated speech waveform spectrum detector also include a detection program for detecting a plurality of fundamental frequencies F1 and F2, and the fundamental vibrations for the detected fundamental frequencies Fl and F2. Includes generation programs that generate signals of frequencies F '1 and F' 2 that are different from the numbers Fl and F2.

[0066] Here, the fundamental frequency refers to a fundamental frequency of different vibration sources, here, the vibration frequencies 2F and 2B, respectively, that is, the lowest order frequency. This is different from the frequency that is called the harmonic frequency of multiples such as the second and third frequency.

[0067] The detection of the fundamental frequency generally takes into account that the vocal cord vibration is not a perfect sinusoidal vibration. For example, if simply detecting a plurality of frequencies, it is possible to detect the fundamental frequency and its multiples. In such a case, in the example of this embodiment, the vibration frequency of only the vibration part 2F or the vibration frequency of the vibration part 2B is detected, and both vibration parts 2F and 2B can be observed simultaneously. become unable.

[0068] The detection program is configured to detect and extract a fundamental frequency that indicates the lowest frequency component from a plurality of frequency components that appear as peaks in the speech waveform spectrum.

[0069] On the other hand, when the voice of the subject 1 who has no lesion in the vocal cords is detected by the microphone 3, only one fundamental frequency can be detected, and in this case, it is the same as the conventional vocal cord observation device. One basic frequency force One signal with different frequency is generated and based on this signal Then shoot the vocal cords with camera 5.

[0070] In this manner, the control unit 11 of the personal computer 10 automatically generates a signal for controlling the light emission of the LEDs 21 and 22 based on the number of detected fundamental frequencies, thereby causing lesions in the vocal cords of the subject 1 to be detected. The vocal cord observation apparatus of this embodiment can be used without considering the presence or absence.

[0071] Since vocal cord observation apparatus 100 of the present embodiment has two LEDs 21 and 22 as light sources, two basic vibrations are calculated from the lower fundamental frequency among the plurality of fundamental frequencies of vocal cord 2. The number is detected. In general, the larger the vibration part, the lower the vibration speed and the lower the vibration frequency of the vocal cord, so detecting the lower fundamental frequency force is suitable for capturing the state of the larger vibration part. Also excellent! /

[0072] As shown in FIG. 3, the generation program has a frequency cycle T detected by the detection program, a signal cycle generated by the program T 'based on this cycle, and an apparent frequency cycle. Is Τ "

τ '= τ "/ (τ" / τ- ι)

Generate T 'from the relational expression

Here, T ′ 1 and T ′ 2 are determined to be different from each other and one of them is not an integral multiple of the other. The reason why one of them does not become an integral multiple of the other is to suppress the simultaneous emission of LEDs 21 and 22 and to provide good observation, but this relationship is not necessarily required. Absent.

[0074] T "is preferably an appropriate value that is input using the input unit 13 or is recorded in advance in the storage unit 12, and is preferably set to lZlOsec or more.

[0075] Since Ding '1 and Ding' 2 are different from each other, the amount of light emitted by 1 ^: 021, 22 is different from each other, and the vibrating part 2F observed in the image taken by the camera 5 The amount of light of 2B, in other words, brightness, etc., is different.

[0076] Therefore, in the vocal cord observation apparatus 100, the control unit 11 calculates the respective light amounts of the vibrating units 2F and 2B based on the signal from the camera 5, and the light amounts at the time of display match each other. In addition, the current value flowing through the LEDs 21 and 22 is controlled.

[0077] These controls are the light amount calculation program and light amount included in the vocal cord observation device 100, respectively. This is done using a control program. These programs are recorded in the storage unit 12 and executed by the control unit 11. Therefore, the control unit 11 and the storage unit 12 function as a light amount calculation unit and a light amount control unit having such functions as the light amount calculation program and the light amount control program are executed.

Note that the light amount control program may perform image processing so that the light amounts at the time of display of the respective vibration units 2F and 2B coincide with each other because the current flowing through the LEDs 21 and 22 is controlled.

[0079] The display unit 14 functions as an output unit that outputs an image captured by the camera 5.

[0080] The speaker 15 converts the voice of the subject 1 collected by the microphone 3 into an electric signal and can output it in synchronization with the output by the output means. Alternatively, the storage unit 12 of the personal computer 10 preliminarily stores the reference sound data for utterance, and the control unit 11 of the personal computer 10 reproduces the reference sound by reproducing the reference sound. And let subject 1 utter at a frequency that is easy to shoot based on this reference sound.

[0081] LEDs 21 and 22 emit light in a pulse manner at each of a plurality of frequencies F'1 and F'2 based on a signal generated by the generation program, and stroboscopically irradiate vocal cord 2. Illuminate each vibration part 2F, 2B of vocal cord 2 that vibrates at fundamental frequency Fl, F2 by irradiation

[0082] The LED selected as the light source is versatile, small and inexpensive, and is suitable for the vocal cord observation device 100 of the present invention. In particular, the small size of the light source is not only easy to carry, but also has the advantage that the discomfort of subject 1 can be reduced when it is inserted into the mouth of subject 1 such as the larynx.

[0083] Furthermore, the LED has excellent responsiveness with respect to blinking, and is suitable as a light source for the vocal cord observation apparatus 100 that needs to emit light instantaneously. However, since LEDs emit light at almost a single wavelength, there is also the advantage of good extraction sensitivity when extracting images, which will be described later.

[0084] Vocal cord observation apparatus 100 can be configured to perform only the operations described above. With this alone, noise may appear in the observation state of vibrating portions 2F and 2B. [0085] That is, when the irradiation range by the LEDs 21 and 22 reaches the other vibration units 2B and 2F that are not the target irradiation ranges, the period T "l, Τ “There is a possibility that the image of the vibrating parts 2F and 2B irradiated with the other LED is superimposed as a ghost image on the image of the vibrating parts 2F and 2B that should be observed so as to vibrate simply at 2.

[0086] Therefore, in the vocal cord observation apparatus 100 of the present embodiment, the image of the vocal cord 2 taken by the camera 5 is extracted and extracted for each of the vibration units 2F and 2B by the image processing by the control unit 11. A composite image is generated by pasting the images of the vibration units 2F and 2B at predetermined positions, and this composite image is displayed on the display unit 14.

Thereby, the state of vibration of the vibration part 2F can be observed as an image irradiated only by the LED 21, and the state of vibration of the vibration part 2B can be observed as an image irradiated only by the LED 22.

[0088] When generating each vibration unit 2F and 2B in the generation of the composite image, in the image processing by the control unit 11, the LEDs 21 and 22 emit light at single wavelengths different from red and green, respectively. By utilizing this, an image of each color is extracted using a color filter.

[0089] In the image processing by the control unit 11, images of the vibrating units 2F and 2B are cut out from the extracted images. To cut out the images of the vibration parts 2F and 2B, display the captured image on the display as a test, and set the cut-out areas of the vibration parts 2F and 2B in advance. Based on the

[0090] In the vocal cord vibration observation program, a filtering program for performing filtering for image extraction, a cutting program for cutting out a predetermined region of the extracted image force, and a synthesized image by pasting the extracted image at a predetermined position Are included in the storage unit 12 and controlled by the control unit 11.

Accordingly, the control unit 11 and the storage unit 12 function as extraction means for extracting the image of the vocal cord 2 captured by the camera 5 for each of the vibration units 2F and 2B using the filtering program and the cutout program. At the same time, it functions as a synthesizing unit that synthesizes the images of the vibration units 2F and 2B extracted as described above. [0092] The display unit 14 outputs and displays a composite image formed by combining by the combining means. The composite image may be one in which each vibration part 2F, 2B is displayed in red or green, or the whole may be displayed in monochrome.

[0093] When the composite image is generated in this way, the light emission timings of the LEDs 21 and 22 are shifted from each other, so that it is sufficient that only one camera 5 is provided. Two may be provided corresponding to the number of ED21 and 22. When a plurality of cameras are provided corresponding to the number of LEDs 21 and 22, each camera can focus on each subject, and a clearer image can be obtained.

[0094] The composite image may be displayed on the display unit 14 at the same time as the photographing by the camera 5. The photographed image is recorded in the power storage unit 12 and a composite image is generated from the stored image data. Alternatively, the composite image may be recorded in the storage unit 12 and read out.

In the vocal cord observation apparatus 100 of the present invention, the light emission control signal periods Tl ′ (= lZF′1) and T2 ′ (= Not only do 1ZF '2) have different values and one does not become an integral multiple of the other, but also has the relationship shown below.

That is, the frequencies F ′ 1 and F ′ 2 of the signal for light emission control have the ratio of the frequencies F ′ 1 and F ′ 2 matched with the ratio of the fundamental frequencies Fl and F2. .

[0097]

F1: F2 = F1 ': F2'

It is said.

[0098] In other words

T1: T2 = T1,: Τ2,

It is. Tl ′ and T2 ′ are the period of the emission frequency.

[0099] Then, the generation program sets the light emission frequency periods Tl 'and T2'.

T1 '= Τ1, Ζ (Τ1 "/ Τ1 1)

Τ2, = Τ2 "/ (Τ2" / Τ2-1)

is doing. [0100] That is,

Tl '= T1,, Z (T1 "/ T1 1)

Τ2 '= Τ2 / (1 -Τ1 / Τ1 ")

It becomes.

[0101] Therefore,

Fl, = (T1 "/ T1-1) / Tl"

F2, = (1 -T1 / T1 ") / T2

It becomes.

[0102] The target apparent frequency period Tl "is usually the period input using the input unit 13 or the period recorded in advance in the storage unit 12, which is usually set to 1ZlOsec or more. Any frequency may be used.

[0103] As described above, the apparent frequency period 通常 is normally set to lZlOsec or more so that it can be captured by the human eye, and a slow motion video can be obtained. A period of about 1 Hz is desirable as the period during which vibrations can be observed in detail.

[0104] Although the vocal cord observation device 100 can be configured as described above, in consideration of the burden on the subject 1, the optical fiber 1 is inserted into the oral cavity because the LEDs 21 and 22 are inserted into the oral cavity. In this optical fiber, the light from the LEDs 21 and 22 can be directed to the vibrating parts 2F and 2B for illumination.

[0105] The light guiding member is not limited to an optical fiber, but is preferably thin and easy to be inserted into the oral cavity so that the subject's discomfort is greatly reduced.

[0106] In the vocal cord observation apparatus 100 described above, as shown in Fig. 6, the microphone 3, the camera 5, the LEDs 21, 22 and the like are respectively installed at predetermined positions so that each component can be operated. After setup, the vocal cord vibration observation program is started in the personal computer 10 and various kinds of input such as the number of basic frequencies to be detected as an initial setting and a target visual frequency are input (Sl).

[0107] After the initial setting, the vocal cord observation device 100 starts collecting sound by the microphone 3 (S2), detects a plurality of fundamental frequencies Fl (= lZT2), F2 (= lZT2) (S3), The emission frequencies F ′ 1 (= 1 / T ′ 1) and F ′ 2 (= 1 / T ′ 2) are generated for each fundamental frequency Fl, F2 (S4). [0108] Vocal cord observation apparatus 100 starts strobe irradiation with each LED 21 and 22 at each of the generated emission frequencies F'1 and F'2 (S5), and photographs vocal cord 2 with camera 5 (S6).

[0109] The vocal cord observation apparatus 100 extracts the red image and the green image obtained based on the irradiation by the LEDs 21 and 22, respectively (S7), and extracts the vibrating parts 2F and 2B from the images of the respective colors. Extraction areas to be determined are determined (S8), images of the respective extraction areas are extracted and combined (S9), and a combined image generated by the combination is displayed on the display unit 14 (S10). The slow motion video based on the composite image displayed on the display unit 14 is a video in which the vibration units 2F and 2B vibrate at frequencies F "l (= 1ZT" 1) and F "2 (= lZT" 2) The dynamics of vocal cord 2 can be observed.

[0110] Step S1 is an initial setting step in which initial setting is performed in the control unit 11 and the storage unit 12 using the input unit 13 of the personal computer 10.

[0111] The personal computer 10 comprises an initial setting means for performing initial setting by the input unit 13, the control unit 11, and the storage unit 12 according to a predetermined program.

Step S2 is a voice signal receiving step in which the voice emitted from the vocal cord 2 by the microphone 3 is used as an electrical signal and the electrical signal is input to the control unit 11 and the storage unit 12 of the personal computer 10.

[0113] The control unit 11 and the storage unit 12 of the personal computer 10 constitute an audio signal receiving unit that receives an electrical signal output from the microphone 3 that detects a voice emitted from the vocal cords 2.

[0114] Step S3 is a frequency detection step of detecting a plurality of fundamental frequencies F1 and F2 in the electric signal force vocal cord 2 received in the voice signal reception step by the control unit 11 and the storage unit 12 of the personal computer 10. is there. The frequency detection step includes a spectrum analysis step in which spectrum analysis is performed by the above-described analysis program, and a detection step in which detection is also performed using the spectrum analysis result force by the above-described detection program.

[0115] The control unit 11 and the storage unit 12 of the personal computer 10 constitute frequency detecting means for detecting a plurality of fundamental frequencies F1 and F2 of the vocal cord 2 from the electrical signal received by the audio signal receiving means. . This frequency detection means includes a spectrum analysis means for executing spectral analysis by executing the analysis program described above, and a detection means for executing detection based on the result of spectrum analysis by executing the detection program described above. It is out. [0116] In step S4, the control unit 11 and the storage unit 12 of the personal computer 10 have a frequency F 'different from the basic frequency F1, F2 for each of the plurality of basic frequencies Fl, F2 detected in the frequency detection step. 1, F ′ 2 is a light emission frequency generation step for generating based on the above-described generation program.

[0117] The control unit 11 and the storage unit 12 of the personal computer 10 have the fundamental frequency Fl, F2 for each of the plurality of fundamental frequencies Fl, F2 detected by the frequency detection means in accordance with the execution of the generation program described above. This constitutes a signal generation means that generates different frequencies F ′ 1 and F ′ 2.

[0118] In step S5, the control unit 11 and the storage unit 12 of the personal computer 10 operate the LEDs 21 and 22 with the plurality of frequencies F ′ 1 and F ′ 2 generated by the frequency generation step, and the strobe to the vocal cord 2 This is a light emission driving step for performing irradiation. The light emission drive step includes a light amount calculation step for calculating the light amount of the LEDs 21 and 22 using the light amount calculation program described above, and a light amount control step for controlling the light amount of the LEDs 21 and 22 using the light amount control program described above. Yes.

The control unit 11 and the storage unit 12 of the personal computer 10 operate the LEDs 21 and 22 with a plurality of frequencies F ′ 1 and F ′ 2 generated by the signal generation unit, and thereby each of the vibration units 2F and 2B of the vocal cord 2 The light emission driving means for stroboscopic irradiation is configured. The light emission drive unit includes a light amount calculation unit that calculates the light amount of the LEDs 21 and 22 by executing the above-described light amount calculation program, and a light amount control unit that executes the above-described light amount control program and controls the light amount of the LEDs 21 and 22. .

[0120] Step S6 is a photographing step of photographing the vibrating parts 2F and 2B of the vocal cord 2 illuminated by the light emission driving step with the force lens 5. In the shooting step, it is sufficient if the vocal cord 2 is shot with the multiple frequencies F ′ 1 and F ′ 2 generated in the frequency generation step. Other than the timing specified by the frequencies F ′ 1 and F ′ 2. You can shoot with

[0121] The camera 5 is a photographing means for photographing the vocal cord 2 illuminated by the drive of the light emission driving means. The camera 5 may take the vocal cord 2 at a timing specified by at least the frequencies F ′ 1 and F ′ 2, and may take the vocal cord 2 at other timings.

[0122] In step S7, from the image photographed in the photographing step, a personal computer This is an extraction step in which the control unit 11 and the storage unit 10 extract the red image and the green image obtained by the red irradiation and the green irradiation by the LEDs 21 and 22.

[0123] The control unit 11 and the storage unit 12 of the personal computer 10 execute the above-described filtering program without using a color filter to generate a red image and a green image from the image captured by the camera 5. An extraction means for extracting is configured.

[0124] In step S8, the control unit 11 and the storage unit 12 of the personal computer 10 and the input unit 13 as needed cut out and extract the vibration units 2F and 2B from the image extracted in the extraction step. This is an area determination step for determining an extraction area.

[0125] The control unit 11 and the storage unit 12 of the personal computer 10, and the input unit 13 as necessary, execute the above-described cutting program and extract the vibration units 2F and 2B from the image extracted by the extraction unit. An area determination means for determining an extraction area to be cut out and extracted is configured.

In step S9, the control unit 11 and the storage unit 12 of the personal computer 10 perform extraction in each extraction region determined in the region determination step to generate an extraction image, and synthesize the extraction image. This is a synthesis step for generating a synthesized image.

[0127] The control unit 11 and the storage unit 12 of the personal computer 10 execute the above-described synthesis program, extract an image of each extraction region determined by the region determination unit, and generate an extraction image. A composing means for composing the images to generate a composite image is constructed.

Step S10 is an output driving step in which the control unit 11 and the storage unit 12 of the personal computer 10 output the combined image generated by the combining step to the display unit 14 to display the slow motion video.

[0129] The control unit 11 and the storage unit 12 of the personal computer 10 constitute output driving means for outputting the synthesized image generated by the synthesizing means to the display unit 14 to display the slow motion video.

[0130] Thus, the vocal cord observation method and vocal cord observation program of the present invention generate the frequencies F, l, F '2 for observing the vocal cord 2 based on the speech, and the frequencies F, l, Displaying the vocal cord 2 image captured based on F ′ 2 on the display means is configured to be executed by the personal computer 10. [0131] In the vocal cord observation apparatus 100, the vocal cord observation method, the vocal cord observation program, and the recording medium on which this is recorded, the vocal cord 2 is illuminated by the intermittently emitted LEDs 21 and 22, and the vocal cord 2 is illuminated at the illuminated timing. Shooting with camera 5 and displaying the captured image, producing the slow motion video that made the movement of vocal cord 2 into slow motion LED21 and 22 are continuously lit to illuminate vocal cord 2 constantly, Slow motion video with slow motion of the movement of vocal cord 2 may be generated by displaying an image obtained by intermittently photographing vocal cord 2 with camera 5.

[0132] As another embodiment, a case will be described in which LEDs 21 and 22 are made to emit light continuously and the vocal cord 2 is shot intermittently with the camera 5.

In this case, step S5 described above is a light emission drive step in which the LEDs 21 and 22 are always operated by the control unit 11 and the storage unit 12 of the personal computer 10 to constantly illuminate the vocal cords 2.

[0134] The control unit 11 and the storage unit 12 of the personal computer 10 constitute a light emission drive unit that constantly illuminates the vocal cord 2 with the LEDs 21, 22, and the light emission drive unit executes the light quantity calculation program described above to execute the LED 21, A light amount calculating unit for calculating the light amount of 22, and a light amount control unit for controlling the light amount of the LEDs 21 and 22 by executing the above-described light amount control program.

[0135] Step S6 described above is a shooting step in which the vibration parts 2F and 2B of the vocal cord 2 illuminated by the light emission driving step are shot by the camera 5, and shooting is performed by a plurality of steps generated by the frequency generation step. The timing is based on frequencies F, 1, and F'2.

[0136] In this case, the camera 5 can be configured as an imaging unit that captures the vibration parts 2F and 2B of the vocal cord 2 with a plurality of frequencies F'1 and F'2 generated by the signal generation unit.

[0137] After the above step S6, the images of the vibration units 2F and 2B photographed by the camera 5 are processed as described above to generate a composite image.

[0138] The control unit 11 of the personal computer 10 generates a slow motion video in which the movement of the vocal cord 2 is converted into a slow motion by displaying the composite image on the display means.

[0139] The camera 5 shoots continuously including the timing based on the frequencies F'1 and F'2 only when shooting at the timing based on the frequencies F'1 and F'2. You may extract the image of the timing based on the frequency F'1, F, 2. [0140] As a form for carrying out the present invention, the vocal cord observation apparatus to which the present invention is applied has been described. However, the application of the present invention is not limited to the above-described form unless otherwise limited in the above description. It is not limited.

[0141] For example, the computer that executes the vocal cord observation program is preferably a laptop type, considering its light weight and low cost, ease of carrying, etc., like the personal computer 10, but it is a desktop type. It may be a personal computer 10 or a dedicated computer.

[0142] Furthermore, the computer for executing the vocal cord observation program is configured by a plurality of computers connected via a network such as the Internet or a local area network, which is not limited to the configuration of a single personal computer 10. May be.

[0143] Further, the vocal cord observation program may store the initial power of the computer in the storage unit 12, use a recording medium composed of various media, or use a network such as the Internet. It may be recorded in the storage unit 12 after shipment.

[0144] The LEDs 21 and 22 may be disposed outside the oral cavity as they are inserted into the oral cavity of the subject 1 as long as the amount of light is sufficient for photographing by the camera 5.

[0145] In particular, the light source is provided according to the number of vibration parts to be observed, and is not limited to two, and may be provided with three or more. The light source is not limited to the LED, and a laser beam may be used.

[0146] In the present application, the plurality of light sources only have to substantially constitute a plurality of light sources. For example, when one LED can emit a plurality of colors, a predetermined timing is determined at a predetermined timing. It can be applied to the above-described form by emitting light in color. When one light source can be effectively used as a plurality of light sources, this is also included in the meaning of a plurality of light sources.

[0147] The microphone 3 may be a contact microphone connected with a non-contact type microphone.

[0148] The observed vibrating body is not limited to the vocal cords, and may be any part as long as it vibrates at a plurality of fundamental frequencies. For example, when the heart vibrates at a plurality of fundamental frequencies, organs such as the esophagus, arteries, and veins vibrate at each fundamental frequency.

[0149] In addition, the subject is not limited to a person, and may be other animals, moreover plants, and things other than living things. Yes. Here, the sound includes a simple sound. The present invention is generally applicable to observation of a vibrating object having a plurality of fundamental frequencies, regardless of whether it is included in the human body or included in other than the human body.

[0150] Voice detection means, frequency detection means, signal generation means, voice signal reception means, light emission drive means, photographing drive means, output drive means, constituting the vocal cord observation apparatus, vocal cord observation method, and vocal cord observation program, The recording medium, computer, light source, photographing means, input means, display unit, output means, extraction means, composition means, color of light emitted by the light source, configuration of the irradiation member, etc. It is not limited and can be changed arbitrarily.

[0151] The effects described in the embodiments of the present invention only list the most preferable effects generated by the present invention, and the effects of the present invention are described in the embodiments of the present invention. It is not limited to things.

[0152] The vocal cord observation apparatus and the vocal cord observation method described above are configured so as to capture the vibration of the vocal cords with the camera 5, but without the camera 5, the LE disposed at the tip of the support rod 6 is provided. By observing the vocal cords directly while intermittently irradiating the vocal cords with D21, 22, the vibration state of the vocal cords can be observed in slow motion.

[0153] In particular, by irradiating light of different colors with the two LEDs 21 and 22, vibrations at two fundamental frequencies F1 and F2 of the vocal cord can be visually confirmed.

[0154] Note that the fundamental frequencies Fl and F2 are obtained by converting the audio signal of the subject 1 picked up by the microphone 3 into a digital signal by the AZ D converter 16 and converting the audio signal of the digital signal by FFT (High Speed Fourier Transform). The voice waveform spectrum is obtained by converting to the frequency domain, and this voice waveform spectrum force also specifies the fundamental frequencies Fl and F2.

[0155] Based on the identified fundamental frequencies Fl and F2, as described above, signals of frequencies F '1 and F' 2 different from the fundamental frequencies Fl and F2 are generated, and the A / D converter 16 LED 21 and 22 are caused to emit light based on the generated frequency F ′ 1 and F ′ 2 signals, respectively.

Thus, by intermittently irradiating the vocal cords with light by the LEDs 21 and 22, the vibration of the vocal cords can be visually observed, and an extremely fast and powerful diagnosis can be made.

[0157] It is difficult to see the vocal cords directly, and the subject has a lot of physical Since it may cause stress, it can be easily observed visually using a mirror.

Industrial applicability

The vibration state is clearer when generating a slow motion video to observe the vibration state of a vibrating body that vibrates such as the vocal cords and that contains multiple reference vibrations. It is possible to generate a slow motion video that can be observed easily, and can be applied as an inexpensive slow motion video generation means in the medical field.

Claims

The scope of the claims

[1] In the vibrating body observation method in which a plurality of vibrating bodies are imaged at a predetermined timing by the imaging means, and the vibration state of the vibrating body can be observed by continuously displaying the captured images on the display means.

A frequency detecting step for detecting the first basic frequency and the second basic frequency of a vibrating body that vibrates at least at a first basic frequency and a second basic frequency;

A first signal having a frequency different from the first basic frequency detected in the frequency detecting step is generated, and a second signal having a frequency different from the second basic frequency is generated. A signal generation step to generate;

An imaging step of imaging the vibrator based on the first signal and the second signal generated in the signal generation step;

A vibrating body observation method comprising: a display driving step for continuously displaying images taken in the photographing step on a display means.

[2] In the signal generation step, the ratio of the frequency of the first signal and the frequency of the second signal is made to coincide with the ratio of the first fundamental frequency and the second fundamental frequency. The vibrating body observation method according to claim 1, wherein:

[3] Frequency detection means for detecting the first basic frequency and the second basic frequency of a vibrating body that vibrates at least at the first basic frequency and the second basic frequency;

Signal generating means for generating a first signal and a second signal, respectively, that vibrate at a different frequency from the first fundamental frequency and the second frequency detected by the frequency detecting means;

Imaging means for imaging the vibrating body at a timing based on the first signal and the second signal;

Display means for continuously displaying images taken by the photographing means

Vibrating body observing apparatus.

[4] The signal generating means matches the ratio of the frequency of the first signal and the frequency of the second signal with the ratio of the first fundamental frequency and the second fundamental frequency. The vibrating body observation apparatus according to claim 3, wherein

[5] The vibration according to claim 3 or 4, wherein the photographing unit includes a light source that emits light at a timing based on the first signal and the second signal to illuminate the vibrating body. Body observation device.

[6] A vocal cord observation method for observing a vocal cord vibrating at least at a first fundamental frequency and a second fundamental frequency,

Identifying the first fundamental frequency and the second fundamental frequency;

Generating a first signal based on the first fundamental frequency and generating a second signal based on the second fundamental frequency;

A vocal cord observation method for irradiating light to the vocal cords instantaneously at a timing based on the first signal, and observing the vocal cords by momentarily irradiating light on the vocal cords at a timing based on the second signal.

[7] In a vocal cord observation method that allows a plurality of images of a vocal cord to be photographed at a predetermined timing and continuously displays the photographed images on a display means so that the vibration state of the vocal cords can be observed.

A vocal cord that vibrates at least at the first fundamental frequency and the second fundamental frequency is generated based on the first signal generated based on the first basic frequency and the second fundamental frequency. A method for observing vocal cords, characterized by taking a picture while irradiating light at a timing based on the second signal.

[8] A frequency detection means for detecting a plurality of fundamental frequencies contained in speech uttered from the vocal cords;

Signal generating means for generating a signal having a frequency different from the basic frequency for each of the plurality of basic frequencies detected by the frequency detecting means;

An imaging unit that images the vocal cords based on each signal generated by the signal generation unit, and a display unit that continuously displays images captured by the imaging unit

A vocal cord observing apparatus.

[9] The frequency detection means detects any one of the fundamental vibrations included in the sound as a first basic vibration, and also detects a fundamental vibration having a greater frequency than the first fundamental vibration. Detected as the second fundamental frequency,

The signal generating means generates the frequency of the first signal corresponding to the first fundamental frequency and the frequency of the second signal corresponding to the second fundamental frequency, and 9. The ratio of the frequency of the first signal and the frequency of the second signal is made to coincide with the ratio of the first fundamental frequency and the second fundamental frequency. Vocal cord observation device.

[10] Extraction means for extracting the image captured by the imaging means for each image captured at a timing based on the first signal and for each image captured at a timing based on the second signal;

10. A vocal cord according to claim 8 or claim 9, further comprising: a combining unit that combines the extracted images extracted by the extracting unit, wherein the display unit displays the combined image combined by the combining unit. Observation device.

[11] The apparatus according to any one of claims 8 to 10, wherein the photographing unit includes a light source that emits light at a timing based on the first signal and the second signal to illuminate the vibrating body. The vocal cord observation apparatus described.

12. The vocal fold observation device according to claim 11, wherein the light emission at the timing based on the first signal is emitted in a color different from the light emission at the timing based on the second signal. .

[13] A light amount calculating unit that calculates a light amount of the light source based on an image of the vocal cords photographed by the photographing unit;

Light quantity control means for adjusting the vocal cord image according to the light quantity of the light source calculated by the light quantity calculation means

13. The vocal fold observation device according to claim 12, characterized by comprising:

[14] Force of the frequency detection means When a force that can detect only one fundamental frequency is detected, the fundamental frequency is set as the first fundamental frequency, and the signal generation means is adapted to the first fundamental frequency. 13. The vocal cord observing apparatus according to claim 12, wherein only the first signal that has been adapted is generated and the vocal cords are photographed by the photographing device at a timing based on the first signal.

[15] A vocal cord observation program for causing a computer to generate a signal for observing the vocal cords based on a voice generated and to output an image of the vocal cords photographed based on the signal. And

Computer

A frequency detection means for detecting a plurality of fundamental frequencies included in the voice emitted from the vocal cords;

Signal generating means for generating a signal having a frequency different from the basic frequency for each of the plurality of basic frequencies detected in the frequency detecting step;

Photographing control means for photographing the vocal cords by photographing means for photographing the vocal cords based on each signal generated in the signal generating step;

Display driving means for continuously displaying images taken in the photographing step on the display means

Vocal cord observation program to function as.

[16] The frequency detection means detects any one of the fundamental vibrations included in the sound as a first basic vibration, and also detects a fundamental vibration having a greater frequency than the first fundamental vibration. As the fundamental frequency of

The signal generating means generates the frequency of the first signal corresponding to the first fundamental frequency and the frequency of the second signal corresponding to the second fundamental frequency, and 16. The ratio of the frequency of the first signal and the frequency of the second signal is made to coincide with the ratio of the first fundamental frequency and the second fundamental frequency. Vocal cord observation program.