JP2015159929A - Control device, head-mounted display, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a control device capable of causing a diagnostic image to be automatically displayed in an HMD, a head-mounted display equipped with a head display with a display part and the control device, and a program.SOLUTION: A CPU of a control device receives an echo signal (S11). The CPU determines a color according to an amplitude of the echo signal (S19 and S21). The CPU creates a first image indicating the echo signal in the determined color (S23). The CPU outputs image signals indicating an RGB value of each of a plurality of pixels constituting a created diagnostic image in an optical see-through type head display (S25). The CPU determines one of colors corresponding to a first amplitude and an amplitude 0 to be a first color specified from first luminosity. The CPU determines the other to be a second color specified from second luminosity which is smaller than the first luminosity, and is 50% or more. The CPU causes the color corresponding to a second amplitude smaller than the first amplitude to be the same as the color corresponding to the amplitude 0.

Description

  The present invention relates to a control device that controls a head display that can be mounted on a head, a head display, a head-mounted display including the control device, and a program.

  A technique for displaying a diagnostic image using a medical diagnostic apparatus is known. The diagnostic video is, for example, a video corresponding to an echo signal output from the probe of the ultrasonic diagnostic apparatus to the outside. Specific examples of the diagnostic apparatus include an ultrasonic diagnostic apparatus, a magnetic resonance imaging (MRI) apparatus, and an X-ray computed tomography (CT) apparatus. Patent Document 1 discloses a technique for detecting a boundary of an object from an image corresponding to an echo signal.

JP2013-81824A

  An optical see-through type head mounted display (HMD) may be used to show a user a diagnostic video output from a medical diagnostic apparatus to the outside. There is a need to display a diagnostic video directly on the display unit of the HMD so that the user can recognize the diagnostic video. However, with the above technique, it is impossible to automatically extract a diagnostic image and display it on the display unit of the optical see-through HMD.

  An object of the present invention is to provide a control device capable of automatically displaying an image on which a user can easily recognize a diagnostic object on a display unit of the head display, a head display, a head mounted display including the control device, and a program Is to provide.

  The control device according to the first aspect of the present invention includes: a receiving unit that receives an echo signal; a color corresponding to a first amplitude that is equal to or greater than a predetermined value among amplitudes of the received echo signal; One of the colors corresponding to the second amplitude is determined to be a first color having RGB values specified from the first brightness, the predetermined saturation, and the predetermined hue, and the color corresponding to the first amplitude And the other color among the colors corresponding to the second amplitude has an RGB value specified from the second lightness smaller than the first lightness and greater than or equal to a predetermined value, a predetermined saturation, and a predetermined hue. Determining means for determining two colors; generating means for generating video information for displaying the echo signal with the color determined by the determining means; and outputting the video information generated by the generating means to a display device And a control means.

  According to the first aspect, the control device can determine colors corresponding to the first amplitude and the second amplitude of the echo signal, automatically generate video information, and output the video information to the display device. In this case, the control device can distinguish the video according to the amplitude of the echo signal and output it to the display device. Therefore, the user can easily recognize an image corresponding to the amplitude of the echo signal.

  In the first aspect, the deciding means selects a color corresponding to an amplitude between the first amplitude and the second amplitude as a lightness between the first lightness and the second lightness. You may determine to the 3rd color which has the RGB value specified from 3 brightness. In this case, the control device can distinguish the video according to the amplitude between the first amplitude and the second amplitude of the echo signal and output the video to the display device.

  In the first aspect, the first amplitude may be a maximum amplitude of the echo signal. In this case, the control device can determine the first amplitude according to the received echo signal.

  In the first aspect, the second amplitude may be an amplitude of zero. In this case, the control device can distinguish and output the image of the portion corresponding to the amplitude 0 of the echo signal to the display device.

  In the first aspect, the determination unit may determine the second color having an RGB value that is smaller than the first lightness and specified from the second lightness of 50% or more. In this case, the control device can suppress the second color having the RGB value specified according to the second lightness from approaching black, and accordingly appropriately suppress the real image of the outside world from being displayed to the user wearing the display device. it can.

  In the first aspect, the determining means sets a color corresponding to a third amplitude that is a minimum amplitude of the echo signal, a third brightness that is smaller than the first brightness and greater than or equal to a predetermined value, a predetermined saturation, and a predetermined You may determine with the 3rd color which has the RGB value specified from these hues. In this case, the control device displays the image of the portion corresponding to each of the first amplitude, the second amplitude, and the third amplitude of the echo signal separately for each of the first color, the second color, and the third color. Can output to the device.

  In the first aspect, the determining means is specified from the lightness from the first lightness to the third lightness, the predetermined saturation, and the predetermined hue with respect to the amplitude from the first amplitude to the third amplitude. A fourth color having RGB values may be determined. In this case, the control device can distinguish and output the image of the portion corresponding to the amplitude between the first amplitude and the third amplitude of the echo signal to the display device.

  In the first aspect, the deciding means sets the nth amplitude (n is an integer equal to or less than N) in the order of a plurality of amplitudes divided into N (N is an integer) from the first amplitude to the third amplitude. RGB that is identified from the nth lightness, the predetermined saturation, and the predetermined hue in order from the first lightness among a plurality of lightnesses obtained by dividing the corresponding color into N equal parts from the first lightness to the third lightness The fourth color having a value may be determined. In this case, the control device can change the fourth color corresponding to the amplitude between the first amplitude and the third amplitude from the first color to the third color. For this reason, the control apparatus can output the image of the part corresponding to the amplitude from the first amplitude to the third amplitude of the echo signal for each amplitude and output it to the display device.

  In the first aspect, the determining unit may determine a color corresponding to the second amplitude as the first color, and determine a color corresponding to the first amplitude as the second color. In this case, the control device can output to the display device an image in which the color corresponding to the second amplitude is brighter than the color corresponding to the first amplitude.

  In the first aspect, the determination unit may determine a color corresponding to each of the second amplitudes as the second color, and determine a color corresponding to the first amplitude as the first color. In this case, the control device can output to the display device an image in which the color corresponding to the first amplitude is brighter than the color corresponding to the second amplitude.

  A head mounted display according to a second aspect of the present invention includes the control device according to the first aspect and the display device of the see-through type. According to the 2nd aspect, there can exist an effect similar to a 1st aspect.

  The program according to the third aspect of the present invention includes a first receiving step for receiving an echo signal, a color corresponding to a first amplitude not less than a predetermined value among the amplitudes of the received echo signal, and a predetermined value. One of the colors corresponding to the following second amplitude is determined as the first color having RGB values specified from the first lightness, the predetermined saturation, and the predetermined hue, and corresponds to the first amplitude. The other of the color and the color corresponding to the second amplitude has an RGB value that is specified from a second lightness that is smaller than the first lightness and greater than or equal to a predetermined value, a predetermined saturation, and a predetermined hue. A determination step for determining the second color; a generation step for generating video information for displaying the echo signal with the color determined in the determination step; and output of the video information generated in the generation step to a display device Control step To execute the door to the computer. According to the 3rd aspect, there can exist an effect similar to a 1st aspect.

It is a perspective view of HMD1. It is a figure which shows the echo signal 76 and the diagnostic image | video 77. It is a block diagram which shows the electric constitution of HMD1. It is a flowchart of a main process. It is a figure which shows the echo signal 76 and the diagnostic image | video 78. It is a figure which shows the echo signal 76 and the diagnostic image | video 79.

  DESCRIPTION OF EMBODIMENTS Embodiments embodying the present invention will be described with reference to the drawings. An outline of a head mounted display (hereinafter referred to as HMD) 1 will be described with reference to FIG. In the present embodiment, the HMD 1 includes a display device (hereinafter referred to as a head display or HD) 10 and a control device (hereinafter referred to as a control box or CB) 50. In the following description, the upper, lower, diagonally lower right, diagonally upper left, diagonally upper right and diagonally lower left of FIG. 1 are the upper, lower, forward, rearward, right and left sides of the HMD 1, respectively. In the present embodiment, the display device 10 is a see-through type head-mountable display device.

  An outline of the HD 10 will be described. The HD 10 is attached to the spectacles 5 which is a dedicated wearing tool. The user wears the HD 10 on the head by using the glasses 5 to which the HD 10 is attached. In addition to the glasses 5, the HD 10 may be attached. The HD 10 can irradiate image light backward. The image light is incident on the left eye of the user wearing the HD 10. The HD 10 is detachably connected to the CB 50 via the harness 7. The HD 10 includes a housing 2, a half mirror 3, a display unit 15 (see FIG. 3), an eyepiece optical system (not shown), and the like as main components.

  The housing 2 is provided at the right end of the glasses 5. A half mirror 3 is provided on the left end side of the housing 2. The half mirror 3 is disposed in front of the user's left eye with the user wearing the HD 10 on the head. Inside the housing 2, the display unit 15 and the eyepiece optical system are arranged in order from the right side to the left side. The display unit 15 is a liquid crystal element. The display unit 15 displays an image corresponding to the image signal received from the CB 50 via the harness 7. The display surface of the display unit 15 faces leftward. Image light indicating an image displayed on the display unit 15 enters the eyepiece optical system from the right side and exits toward the half mirror 3 from the left side. The half mirror 3 reflects the image light emitted from the eyepiece optical system backward. In a state where the HMD 1 is worn by the user, the video light is incident on the eyeball of the user's left eye. The half mirror 3 transmits light from the real image of the outside world toward the left eye of the user. The HMD 1 allows the user to visually recognize a scene in which the video displayed on the display unit 15 is superimposed on a real image (for example, an external scenery) within the visual field range of the user.

  The glasses 5 can be held on the user's head by being worn on the user's head. The glasses 5 include a frame 6 and a support portion 4. Since the shape of the frame 6 is substantially the same as that of normal glasses, detailed description is omitted. A support 4 is provided at the right end of the upper surface of the rim that supports the left-eye lens in the frame 6. The support unit 4 holds the housing 2 of the HD 10. The support part 4 can move the holding position of the housing 2 in the vertical direction and the horizontal direction. The user can adjust the position so that the position of the eyeball of the left eye and the position of the half mirror 3 are aligned in the front-rear direction by moving the housing 2 in the vertical direction and the horizontal direction.

  The HD 10 may be attached to other wearing tools such as glasses, helmets, and headphones that are used on a daily basis by the user. The display unit 15 may be another spatial modulation element. For example, the display unit 15 may be a retinal scanning display unit that performs two-dimensional scanning with laser light having an intensity corresponding to a video signal, and an organic EL (Organic Electro-luminescence) display. In FIG. 1, the support portion 4 and the HD 10 are provided on the right side of the frame 6, but the support portion 4 and the HD 10 may be provided on the right side of the frame 6. In this case, the video light is incident on the right eyeball of the user while the HMD 1 is worn by the user.

  An outline of the CB 50 will be described. CB50 is attached to a user's waist belt, an arm, etc., for example. The CB 50 controls the HD 10. The CB 50 is detachably connected to the HD 10 via the harness 7. The CB 50 includes a casing 63, a switch 61, an LED 62, an input terminal 72, and the like as main components. The shape of the housing 63 is a substantially rectangular parallelepiped with rounded edges. The switch 61 is a switch for performing various settings in the HD 10, various operations during use, and power on / off. The LED 62 is a light emitting element for notifying the user of the state of the HMD 1. The input terminal 72 is a terminal for receiving an echo signal or a video signal. A cable 71 for communicating an echo signal or a video signal is detachably connected to the input terminal 72. The echo signal is output from the probe, and the video signal is output from the video device.

  An outline of the echo signal and the probe will be described. The probe is a well-known probe that irradiates a diagnostic object with ultrasonic waves and detects ultrasonic waves reflected by the diagnostic object (hereinafter referred to as reflected waves). The probe can output an echo signal indicating the temporal change in the intensity of the detected reflected wave to the cable 71. The probe emits a plurality of ultrasonic signals to the object and detects the bounce. The echo signal shows a waveform in which a plurality of peaks are arranged in time series. In general, the probe is connected to a known ultrasonic diagnostic apparatus. In this case, the ultrasonic diagnostic apparatus creates a video (hereinafter referred to as diagnostic video) in which the peak positions and amplitudes of a plurality of echo signals received from the probe are visualized, and outputs the video to a monitor or the like. Each position of the plurality of peaks indicates a distance from the probe to the diagnostic object.

  With reference to FIG. 2, a diagnostic image 77 that the ultrasonic diagnostic apparatus receives the echo signal 76 and displays on the monitor will be described. The diagnostic image 77 is a black and white image. In the diagnostic image 77, each peak of the echo signal 76 is indicated by an achromatic color (gray) having an RGB value specified by the lightness according to the amplitude. The portion of the echo signal 76 having the amplitude “0” is indicated by an achromatic color (black) having an RGB value specified by the lightness of “0%”. In the present embodiment, the portion of the amplitude “0” is indicated by an achromatic color (black) having an RGB value specified by the lightness of “0%”, but the amplitude within the predetermined range from the amplitude “0”. , May be indicated by an achromatic color (black) having an RGB value specified by a lightness of “0%”. On the other hand, the maximum peak portion of the echo signal 76 is indicated by an achromatic color (white) having an RGB value specified by a lightness of “100%”. Therefore, in the diagnostic image 77, the background 77A indicating the portion where the reflected wave is not detected by the probe, that is, the portion where there is no diagnostic object is shown in black, and the portion where the reflected wave is detected by the probe, that is, the diagnostic object The object 77B is indicated by an achromatic color having different brightness.

  The probe scans the first scanning direction in which the ultrasonic wave is irradiated while repeating the irradiation of the ultrasonic wave and the detection of the reflected wave. The probe outputs one echo signal for each ultrasonic irradiation. The ultrasonic diagnostic apparatus generates an image 77C representing the distance from the probe to the diagnostic object according to one echo signal by the above method. The probe generates a plurality of echo signals corresponding to one scan. The ultrasound diagnostic apparatus arranges a plurality of images 77C representing the distance from the probe to the diagnostic object generated based on each of the generated plurality of echo signals in the first scanning direction to perform one scan. A diagnostic image 77 corresponding to minutes is generated.

  On the other hand, in the present embodiment, the probe is directly connected to the CB 50 via the cable 71. The CB 50 generates a diagnostic video 78 (see FIG. 5, which will be described later) different from the diagnostic video 77 in accordance with the received echo signal 76 and displays the diagnostic video 78 on the display unit 15 of the HD 10. The reason why the CB 50 generates a diagnostic video 78 different from the diagnostic video 77 is as follows. When the diagnostic image 77 is displayed on the display unit 15 of the HD 10, the portion of the background 77A indicated by black is in a completely see-through state. In this case, since the real image of the outside world can be seen in the background 77 </ b> A portion of the diagnostic video 77, the user may have difficulty recognizing the diagnostic video 77. Therefore, the CB 50 generates a diagnostic video 78 and displays it on the display unit 15 so that the user can easily recognize it. Details of the diagnostic image 78 will be described later.

  Details of the video signal and the video device will be described. The video device is a well-known AV device capable of outputting a video signal. The video signal is a well-known digital signal indicating the RGB value of each of a plurality of pixels included in each image frame. Specific examples of the video apparatus include a PC, a video receiver, and a video camera. Hereinafter, the video displayed according to the video signal output from the video device is referred to as a video video.

  The electrical configuration of the HMD 1 will be described with reference to FIG. First, the electrical configuration of the HD 10 will be described. The HD 10 includes a CPU 11 that controls the entire HD 10. The CPU 11 is electrically connected to the flash ROM 12, RAM 13, input control unit 14, and display unit 15. The flash ROM 12 stores a program executed by the CPU 11. The program is stored in the flash ROM 12 when the HMD 1 is shipped. The RAM 13 temporarily stores various data. The input control unit 14 is connected to the output control unit 59 of the CB 50 via the harness 7 (see FIG. 1). The input control unit 14 receives the video signal from the output control unit 59. The display unit 15 can display a video corresponding to the received video signal.

  The HMD 1 may further include a wireless communication unit (not shown). The CPU 11 may download a program from a program download server via the wireless communication unit and store the program in the flash ROM 12. The flash ROM 12 may store a program executed by the CPU 51 of the CB 50. The CPU 11 may execute the same process as the process executed by the CPU 51 of the CB 50 instead of the CPU 51.

  The electrical configuration of the CB 50 will be described. The CB 50 includes a CPU 51 that controls the entire CB 50. The CPU 51 is electrically connected to a flash ROM 52, a RAM 53, an ASIC 55, a peripheral interface (hereinafter referred to as a peripheral I / F) 58, and an output control unit 59. The flash ROM 52 stores a program executed by the CPU 51. The flash ROM 52 stores a hue setting value. Hereinafter, the set value of the hue is referred to as “set hue”. The program and hue setting values are stored in the flash ROM 52 when the HMD 1 is shipped. The RAM 53 temporarily stores various data. The ASIC 55 is an ASIC that can generate a diagnostic image 78 (see FIG. 5) according to the echo signal when an echo signal is received through the input terminal 72. The peripheral I / F 58 is connected to the input terminal 72, the switch 61, and the LED 62, and controls signal input / output. The output control unit 59 is connected to the input control unit 14 of the HD 10 via the harness 7. The output control unit 59 outputs the video signal to the input control unit 14 of the HD 10 via the harness 7. The generation process of the diagnostic video 78 processed by the ASIC 55 may be executed by the CPU 51 by executing a program stored in the flash ROM 52.

  The HMD 1 may further include a wireless communication unit (not shown). The CPU 51 may download a program from a program download server via the wireless communication unit and store the program in the flash ROM 52. The flash ROM 52 may store a program executed by the CPU 11 of the HD 10. The CPU 51 may execute the same process as the process executed by the CPU 11 of the HD 10 instead of the CPU 11. The HMD 1 may be downloaded from a program download server via a wireless communication unit (not shown) and installed.

  The main process executed by the CPU 51 of the CB 50 will be described with reference to FIG. When the CPU 51 detects an operation for turning on the power of the CB 50 via the switch 61, the CPU 51 starts the main process by starting the process based on the program stored in the flash ROM 52.

  The CPU 51 determines whether a plurality of echo signals corresponding to one scan have been received (S11). When the CPU 51 determines that a plurality of echo signals corresponding to one scan have been received (S11: YES), the CPU 51 stores the data of the received plurality of echo signals in the flash ROM 52 (S13). The CPU 51 determines the maximum amplitude as the first amplitude among the peak amplitudes included in each of the plurality of echo signals, and determines the minimum amplitude as the second amplitude (S15). The CPU 51 stores the determined first amplitude and second amplitude in the flash ROM 52 (S15). The CPU 51 outputs an instruction signal to the ASIC 55 (S19).

  When the ASIC 55 detects the instruction signal output from the CPU 51, the ASIC 55 generates a diagnostic video based on the data of the plurality of echo signals, the set hue, the first amplitude, and the second amplitude stored in the flash ROM 52. Details of the diagnostic video generation method will be described later. After generating the diagnostic video, the ASIC 55 stores the generated diagnostic video data in the flash ROM 52. The ASIC 55 outputs a notification signal to the CPU 51.

  With reference to FIG. 5, the details of the method for generating the diagnostic image 78 will be described. The ASIC 55 specifies the color corresponding to the amplitude of the echo signal 76 as follows. The ASIC 55 determines the color corresponding to the first amplitude as the chromatic color having the RGB value specified by the maximum saturation “1”, the set hue, and the lightness of “50%”. The ASIC 55 determines the color corresponding to the amplitude “0” and the second amplitude to an achromatic color (white) having an RGB value specified by the maximum saturation “1”, the set hue, and the lightness of “100%”. To do. When the lightness is “100%”, the color having the specified RGB value is an achromatic color (white) regardless of the values of saturation and hue. The ASIC 55 has a RGB value specified by a color corresponding to an amplitude between the first amplitude and the second amplitude by a maximum saturation “1”, a set hue, and a lightness of “50% to 100%”. Decide on the color. Specifically, it is as follows. The ASIC 55 calculates a plurality of amplitudes obtained by dividing the values from the first amplitude to the second amplitude into 51 equal parts. The ASIC 55 determines the brightness corresponding to each of the calculated plurality of amplitudes as “50%”, “51%”, “52%”,. In other words, the ASIC 55 determines the lightness corresponding to the nth amplitude in the descending order among the plurality of amplitudes obtained by equally dividing the values from the first amplitude to the second amplitude into “50 + n”%.

The ASIC 55 calculates the RGB value specified by the saturation, hue, and brightness as follows. Hue is represented as H (0 to 360), saturation is represented as S (0 to 1), lightness is represented as L (0 to 1), R value (0 to 1), G value (0 to 1), and B value. When the maximum value is expressed as M and the minimum value is expressed as m among (0 to 1), it is general that H, S, and L and the R value, G value, and B value satisfy the following relational expressions. Known to.
H = 60 × ((GB) / (R−m)) (when M = R)
H = 60 × (2+ (BR) / (G−m)) (when M = G)
H = 60 × (4+ (RG) / (B−m)) (when M = B)
S = 0 (when M = m = 0 or M = m = 1)
S = (M−m) / (1− | M + m−1 |) (when M = m = 0 and M = m = 1 are excluded)
L = (M + m) / 2
The ASIC 55 calculates an R value, a G value, and a B value that satisfy the above relational expression when the maximum saturation is “1”, the set hue, and the lightness “0.5 to 1”, and specifies the corresponding color. To do.

  The ASIC 55 generates an image 78C representing the distance from the probe to the diagnosis target according to one echo signal based on the color pixel determined for each amplitude. The CPU 51 arranges, in the first scanning direction, a plurality of images 78C representing the distance from the probe to the diagnostic object, which are created based on each of the plurality of echo signals 76 corresponding to one scanning. As described above, the ASIC 55 generates the diagnostic video 78 corresponding to one scan.

  Note that the portion of the echo signal 76 with the amplitude “0” corresponds to the background 78A in the diagnostic video 78 where there is no diagnostic object. Further, the portion between the first amplitude and the second amplitude of the echo signal 76 corresponds to the diagnostic object 78 </ b> B in the diagnostic image 78. In FIG. 5, the diagnostic image 78 is shown in black and white, but the saturation of colors other than white is maximized, so that the actual diagnostic image 78 is shown in color.

  In the above description, the lightness when determining the color corresponding to the amplitude may be another value. For example, the brightness when determining the color corresponding to the first amplitude may be a value greater than “50%”, and the brightness when determining the color corresponding to the second amplitude and the amplitude “0” is It is good also as a value larger than the brightness in the case of determining the color corresponding to 1 amplitude.

  In the above description, the brightness in the case of determining a color corresponding to an amplitude between the first amplitude and the second amplitude may be specified by another method. For example, a table in which the amplitude between the first amplitude and the second amplitude and the corresponding brightness are associated with each other may be stored in the flash ROM 52. The ASIC 55 may specify the brightness when determining a color corresponding to an amplitude between the first amplitude and the second amplitude by using a table.

  As shown in FIG. 4, the CPU 51 detects the notification signal output from the ASIC 55 after outputting the instruction signal to the ASIC 55 (S21). Based on the diagnostic video data stored in the flash ROM 52, the CPU 51 generates a video signal capable of displaying the diagnostic video on the display unit 15 of the HD 10 (S23). The video signal is a digital signal indicating the R value, G value, and B value of each of a plurality of pixels included in the diagnostic video. The CPU 51 outputs the generated video signal to the input control unit 14 of the HD 10 (S25). The CPU 11 of the HD 10 displays a diagnostic video on the display unit 15 in accordance with the video signal received from the CPU 51 of the CB 50 via the input control unit 14.

  The CPU 51 determines whether an operation for ending the display on the HD 10 has been detected via the switch 61 (S27). When the CPU 51 determines that an operation for ending the display is not detected (S27: NO), the CPU 51 performs the process of S11 again. When the CPU 51 determines that an operation for ending the display on the HD 10 has been detected (S27: YES), the CPU 51 ends the main process.

  If the CPU 51 determines that a plurality of echo signals corresponding to one scan are not received (S11: NO), it determines whether a video signal for one frame has been received (S29). When the CPU 51 determines that the video signal for one frame has been received (S29: YES), the CPU 51 outputs the received video signal to the input control unit 14 of the HD 10 (S31). The CPU 11 of the HD 10 displays the video image on the display unit 15 in accordance with the video signal received from the CPU 51 of the CB 50 via the input control unit 14. If the CPU 51 determines not to receive a video signal for one frame (S29: NO), it executes the process of S11 again.

  As described above, the ASIC 55 determines the color corresponding to the first amplitude in the echo signal 76 as the chromatic color having the RGB value specified by the lightness of “50%”. The ASIC 55 determines the color corresponding to the amplitude “0” and the second amplitude in the echo signal 76 to be an achromatic color (white) having an RGB value specified by the brightness of “100%”. The ASIC 55 determines the color corresponding to the amplitude between the first amplitude and the second amplitude in the echo signal 76 as the color having the RGB value specified by the lightness of “50 to 100%”. The ASIC 55 generates a diagnostic image 78 showing the echo signal 76 in the color determined as described above. The CPU 51 can output the video signal of the diagnostic video 78 generated by the ASIC 55 to the HD 10 and display the diagnostic video 78 on the display unit 15. In this case, since the color corresponding to the amplitude “0” is white, the background 78A corresponding to the amplitude “0” in the diagnostic image 78 is not in the see-through state. For this reason, it can suppress that the real image of the outside world is seen through HD10. Therefore, the CPU 51 can suppress the real image of the outside world from interfering with the user's recognition of the diagnostic object 78B. For this reason, since the user can clearly distinguish the background 78A and the diagnostic object 78B, the user can recognize the diagnostic object 78B well.

  The ASIC 55 associates “50 + n”% as the brightness corresponding to the nth amplitude in order from the smallest of the plurality of amplitudes obtained by dividing the values from the first amplitude to the second amplitude into 51 equal parts. In this case, the CPU 51 can sequentially change the color corresponding to the amplitude between the first amplitude and the second amplitude from the first color to the second color. For this reason, the user wearing the HD 10 can clearly distinguish and recognize the diagnostic object 78B corresponding to the amplitudes of the echo signal 76 from the first amplitude to the second amplitude.

  The CPU 51 determines the maximum amplitude as the first amplitude among the peak amplitudes included in each of the plurality of echo signals corresponding to one scan, and determines the minimum amplitude as the second amplitude (S15). In this case, the CPU 51 can easily determine the first amplitude value and the second amplitude according to the echo signal 76.

  In addition, this invention is not limited to the said embodiment, A various change is possible. The ASIC 55 may generate a diagnostic video by a method different from the above. Details will be described with reference to FIG. The ASIC 55 specifies the color corresponding to the amplitude of the echo signal 76 as follows. The ASIC 55 determines the color corresponding to the first amplitude as an achromatic color (white) having an RGB value specified by the maximum saturation “1”, the set hue, and the brightness of “100%”. The ASIC 55 determines the color corresponding to the amplitude “0” and the second amplitude as a chromatic color having an RGB value specified by the maximum saturation “1”, the set hue, and the lightness of “50%”. The ASIC 55 determines the color corresponding to the amplitude between the first amplitude and the second amplitude as the color having the RGB value specified by the maximum saturation, the set hue, and the lightness of “100 to 50%”. . Specifically, it is as follows. The ASIC 55 calculates, for example, a plurality of amplitudes obtained by dividing the values from the first amplitude to the second amplitude into 51 equal parts. In this embodiment, 51 equal parts are used, but it may be divided other than 51 equal parts. The ASIC 55 determines the brightness corresponding to each of the calculated plurality of amplitudes as “100%”, “99%”, “98%”,. In other words, the ASIC 55 determines the brightness corresponding to the nth amplitude in the descending order among the plurality of amplitudes obtained by equally dividing the values from the first amplitude to the second amplitude into “100-n”%. The ASIC 55 determines the color corresponding to each of the plurality of amplitudes as the color having the RGB value specified by the maximum saturation “1”, the set hue, and the lightness determined by the above method. The ASIC 55 generates a line-shaped image 79 </ b> C by arranging pixels of a color determined for each amplitude along the time axis direction of the echo signal 76. The CPU 51 arranges line-shaped video signals generated from each of the plurality of echo signals 76 corresponding to one scan in a direction orthogonal to the lines. As described above, the ASIC 55 generates the diagnostic video 79.

  In the above case, the color corresponding to the first amplitude is white, and the color corresponding to the amplitude “0” is darker than the color corresponding to the first amplitude. A portion corresponding to the first amplitude in the diagnostic image 79 is not in a see-through state. For this reason, the user can more clearly recognize the diagnostic object 79B corresponding to the portion corresponding to the first amplitude.

  In the above description, the lightness when determining the color corresponding to the amplitude may be another value. For example, the brightness when determining the color corresponding to the second amplitude and the amplitude “0” may be a value larger than “50%”, or the brightness when determining the color corresponding to the first amplitude is It is good also as a value larger than the brightness in the case of determining the color corresponding to 2nd amplitude.

  In the above embodiment, the saturation when determining the RGB value of the color according to the amplitude of the echo signal is maximized, but the saturation is another value (for example, any value of 0.5 or more). May be. Moreover, although the hue used when determining the RGB value of the color according to the amplitude of the echo signal is the set hue, the hue may be specified by another method. For example, when detecting an operation for inputting a hue via the switch 61, the CPU 51 may store the detected hue in the flash ROM 52 as a set hue. Further, for example, a table in which IDs and hues are associated may be stored in the flash ROM 52. When the CPU 51 detects an operation of inputting an ID via the switch 61, the CPU 51 may specify the hue associated with the detected ID using a table. The CPU 51 may store the specified hue in the flash ROM 52 as the set hue.

  In the above embodiment, the CPU 51 determines the maximum value of the amplitude of the received echo signal for one scan as the first amplitude and the minimum value of the amplitude as the second amplitude. The CPU 51 may determine the first amplitude and the second amplitude by another method. For example, when the CPU 51 detects an operation of inputting an amplitude via the switch 61, the CPU 51 may determine the first amplitude and the second amplitude according to the detected amplitude.

  When the probe is connected to the CB 50, the electrical state of a specific terminal of the cable 71 may be Hi. On the other hand, when the video apparatus is connected to the CB 50, the electrical state of a specific terminal of the cable 71 may be set to Low. In the process of S11, the CPU 51 determines that an echo signal has been received when a signal is received in a Hi electrical state at a specific terminal, and determines that a video signal has been received when a signal is received in a Low electrical state. May be.

  The CPU 51 that performs the process of S11 is an example of the “reception unit” in the present invention. The ASIC 55 is an example of the “determination unit” and “generation unit” of the present invention. The CPU 51 that performs the process of S25 is an example of the “control unit” in the present invention.

Claims (12)

Receiving means for receiving an echo signal;
Of the amplitudes of the received echo signals, one of the color corresponding to the first amplitude equal to or greater than a predetermined value and the color corresponding to the second amplitude equal to or smaller than the predetermined value is set to the first brightness and the predetermined saturation. And a first color having an RGB value specified from a predetermined hue, and the other of the color corresponding to the first amplitude and the color corresponding to the second amplitude is determined from the first brightness. Determining means for determining a second color having an RGB value specified from a second lightness that is smaller and greater than or equal to a predetermined value, a predetermined saturation, and a predetermined hue;
Generating means for generating video information for displaying the echo signal by the color determined by the determining means;
And a control unit that outputs the video information generated by the generation unit to a display device.   The determining means specifies a color corresponding to an amplitude between the first amplitude and the second amplitude from a third brightness that is any brightness between the first brightness and the second brightness. The control apparatus according to claim 1, wherein the control apparatus determines a third color having an RGB value.   The control device according to claim 1, wherein the first amplitude is a maximum amplitude of the echo signal.   4. The control device according to claim 1, wherein the second amplitude is an amplitude of 0. 5.   The said determination means determines the said 2nd color which has an RGB value specified from the 2nd lightness smaller than the said 1st lightness and 50% or more, The any one of Claim 1 to 4 characterized by the above-mentioned. The control device according to one item.   The determination means specifies a color corresponding to a third amplitude that is a minimum amplitude of the echo signal from a third brightness, a predetermined saturation, and a predetermined hue that are smaller than the first brightness and equal to or greater than a predetermined value. The control device according to claim 1, wherein the control device determines a third color having an RGB value.   The determination means has RGB values specified from the lightness from the first lightness to the third lightness, a predetermined saturation, and a predetermined hue with respect to the amplitude from the first amplitude to the third amplitude. The control device according to claim 6, wherein the fourth color is determined. The determining means includes
The color corresponding to the n-th (n is an integer equal to or less than N) amplitude among the plurality of amplitudes divided into N equal parts (N is an integer) from the first amplitude to the third amplitude is determined from the first brightness. The fourth color having the RGB value specified from the nth lightness, the predetermined saturation, and the predetermined hue among the plurality of lightnesses equally divided into N to the third lightness is determined in order from the first lightness. The control device according to claim 7. The determining means includes
The color corresponding to the second amplitude is determined as the first color, and the color corresponding to the first amplitude is determined as the second color. The control device described in 1. The determining means includes
The color corresponding to the second amplitude is determined as the second color, and the color corresponding to the first amplitude is determined as the first color. The control device described in 1.   A head-mounted display comprising the control device according to claim 1 and the display device of a see-through type. A first receiving step for receiving an echo signal;
Of the amplitudes of the received echo signals, one of the color corresponding to the first amplitude equal to or greater than a predetermined value and the color corresponding to the second amplitude equal to or smaller than the predetermined value is set to the first brightness and the predetermined saturation. And a first color having an RGB value specified from a predetermined hue, and the other of the color corresponding to the first amplitude and the color corresponding to the second amplitude is determined from the first brightness. A determination step of determining a second color having an RGB value specified from the second lightness, the predetermined saturation, and the predetermined hue that are smaller than or equal to a predetermined value; and the echo signal by the color determined by the determination step Generating step for generating video information for displaying
A program for causing a computer to execute a control step of outputting video information generated by the generation step to a display device.