JP2017068360A - Information display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information display device capable of displaying a plurality of images in an easily visually recognizable manner while reducing operation frequency for image display.SOLUTION: A CPU acquires instrument information output from a measurement instrument connected to an input/output I/F of a control device. The CPU determines whether an image pattern shown by the instrument information accords with an image pattern defined in an instrument information table. According to one of a first event, a second event and a third event occurring, the CPU transmits an instruction to display an instrument image which has been determined to accord with the image pattern defined in the instrument information table, to an image display unit. In the case where the first event occurs, the CPU transmits an instruction to switch the instrument image being displayed to an instrument image corresponding to the subsequent orders in a display order table and display the same, to the image display unit (S89).SELECTED DRAWING: Figure 9

Description

  The present invention relates to an information display device that displays information on an information display unit worn by a user.

  A technique for outputting diagnostic information to a head mounted display (HMD) using a medical diagnostic device is known. Specific examples of the diagnostic device include an electrocardiograph performing an electrocardiogram examination, an ultrasonic diagnostic apparatus, a magnetic resonance imaging (MRI) apparatus, and an X-ray computed tomography (CT) apparatus. In Patent Document 1, a plurality of HMDs are connected to an information processing apparatus that unifies a wide variety of diagnostic information transmitted from a plurality of diagnostic devices, and each of the plurality of HMDs plays a role in the medical field of the HMD user. A technique for outputting corresponding diagnostic information is disclosed.

JP 2015-19678 A

  By the way, in a scene where an HMD to which a plurality of diagnostic devices are connected is used in a medical field, some of the diagnostic devices connected to the HMD may be changed. In addition, the user may be required to display a diagnostic information image of a diagnostic device that is different from the diagnostic information image being displayed in the HMD. The user may manually operate an operation unit such as a button provided in the control box (CB) of the HMD in order to display a desired diagnostic information image on the display unit of the HMD. May feel complicated. It is also conceivable to display diagnostic information images of all connected diagnostic devices on the display unit of the HMD. However, due to the nature of the HMD being worn by the user, the display area of the display part of the HMD is often relatively small, and it is difficult to display a plurality of diagnostic information images at a time while the user can visually recognize them. is there.

  An object of the present invention is to provide an information display device capable of displaying a plurality of images in an easily viewable manner while reducing the operation frequency for image display.

  An information display device according to the present invention includes a device information acquisition unit that acquires device information output from each of a plurality of measuring devices, and a table that stores a device table in which the format of the device information is associated with each measuring device. With reference to the storage unit and the device table, a determination unit that determines which of the plurality of measurement devices the device information acquired by the device information acquisition unit corresponds to is determined by the determination unit. Display control means for displaying a device image based on the device information corresponding to the measuring device on a display unit that can be mounted on the head, and a display for storing a display order that determines the order in which the device image is displayed on the display unit An order storage unit; and a first instruction acquisition unit configured to acquire a first instruction to switch the device image displayed on the display unit to another device image. When the first instruction is acquired by the first instruction acquisition unit, the display order storage unit is referred to and another device image is stored in the display unit based on the display order stored in the display order storage unit. An information display device characterized by displaying.

  According to the information display device of the present invention, when the first instruction is acquired, the device image is displayed on the display unit in the order determined in the display order, so that the user performs an operation for switching the image. The frequency can be reduced. Thereby, the information display device according to the present invention makes it easy for the user to visually recognize the device images acquired from each of the plurality of measuring devices even in a relatively small display unit such as a display unit worn on the head. Therefore, the information display device according to the present invention can display a plurality of device images in an easily viewable manner while reducing the operation frequency for image display.

  The device table may associate an output mode of a device image corresponding to the device information with each measuring device. Image generation means for generating an output image that is a device image based on corresponding device information according to the output mode of the device image associated with the measurement device determined by the determination device with reference to the device table May be provided. The display control unit may display the output image, which is another device image, on the display unit.

  Depending on the device image, rather than displaying the device image as it is acquired from a plurality of measuring devices on the display unit as it is, it is better to generate and display an image of the output mode according to the size of the display unit, etc. An operator may easily view the device image. Since the information display device includes image generation means for generating an output image in accordance with the output mode of the device image defined in the device table, a plurality of device images can be displayed in an easily viewable manner.

  The device table may associate a characteristic portion included in the device image with each measuring device. The determination unit may determine whether the feature part is included in a device image based on the device information acquired by the device information acquisition unit. The display control unit may cause the display unit to display a specific image related to the characteristic part when the determination unit determines that the characteristic part is included.

  In this case, when the device image includes a feature portion, the information display device displays the device image including the feature portion on the display unit, so that the possibility that the user misses the feature portion can be reduced.

  The determination unit may determine whether the feature portion is included in a device image based on the acquired device information each time the device information is acquired by the device information acquisition unit.

  In this case, each time device information is acquired, it is determined whether or not a feature portion is included in the device image, and thus the information display device can further reduce the possibility that the user misses the feature portion.

  The display order storage unit may store a plurality of the display orders. You may provide the 2nd instruction | indication acquisition means which acquires the 2nd instruction | indication which shows which is selected among these display order. The display control unit may cause the display unit to display a device image based on a display order corresponding to the second instruction acquired by the second instruction acquisition unit.

  A plurality of scenes where the information display device is used may be assumed. The information display device can acquire a second instruction as to which one is selected from a plurality of display orders stored in the display order storage unit, and can display a device image based on the display order corresponding to the second instruction. For this reason, even if the information display apparatus is used in a plurality of scenes, the information display apparatus can display the device image based on the display order corresponding to the scene.

  The information display device refers to a display result storage unit that stores display result information including at least information indicating an order in which the device images are displayed on the display unit by the display control unit, and the display result storage unit The display order stored in the display order storage unit may be updated according to the display result information.

  In this case, the display order stored in the display order storage unit is updated according to display result information indicating at least the order in which the device images are displayed on the display unit. For this reason, the information display device can display the device images in the display order in accordance with the usage status of the conventional information display device.

  The information display device may include detection means capable of detecting the position of the display unit. The display control unit may cause the display unit to suppress display of the device image when the position detected by the detection unit is the specific position.

  There is a scene where the user does not need to visually recognize the device image displayed by the information display device. In such a case, the user may arrange the position of the display unit at a specific position with respect to the head so as not to visually recognize the device image. In such a case, since the information display device suppresses display of the device image on the display unit, power consumption for displaying the device image on the display unit can be suppressed.

  The information display device may include image determination means for determining whether the device image displayed on the display unit is a still image or a moving image. The display control unit continuously displays the device image displayed on the display unit when the image determination unit determines that the device image displayed on the display unit is a moving image; and A notification image based on the acquisition of the first instruction by the first instruction acquisition unit may be displayed on the display unit.

  When the device image is a moving image, the user may want to continuously view the device image of the displayed moving image. The information display device determines whether the device image is a still image or a moving image. If the device image is a moving image, the information display device continues to display the device image and displays a notification image based on the acquisition of the first instruction. . Therefore, it is possible to notify the user that the first instruction is acquired by the notification image while continuing to view the device image of the moving image displayed to the user.

It is a front view of HMD10. It is a front view of HMD10 with HD20 arranged in a specific position. It is a block diagram which shows the electric constitution of HMD10. 4 is a diagram showing a data configuration of a device information table 60. FIG. It is explanatory drawing for demonstrating the expansion position coordinate in the apparatus information table 60, an expansion area | region, an alarm extraction position coordinate, and an alarm threshold value by taking the electrocardiogram image 71 as an example. It is a figure which shows the data structure of the display order table. It is a flowchart of a device information display process. It is a flowchart of connection apparatus judgment treatment. It is a flowchart of a connection apparatus confirmation process. It is a flowchart of an alarm generation process. It is a specific example of an alarm release image 77. It is a specific example of the alarm notification image 79. It is a flowchart of HD position judgment processing. It is a flowchart of a display order update process. 4 is a diagram showing a data configuration of a display result table 80. FIG. It is a figure which shows the data structure of the display result table 80 when the process of S143 is performed.

  Hereinafter, a head mounted display (hereinafter referred to as “HMD”) 10 according to an embodiment of the present invention will be described with reference to the drawings. The HMD 10 is an example of an information display device that includes an input unit to which a video signal is input. In the following description, the upper, lower, lower left, upper right, lower right, and upper left in FIG. 1 are the upper, lower, front, rear, right, and left sides of the HMD 10, respectively.

  An overview of the HMD 10 will be described with reference to FIGS. 1 and 2. The HMD 10 includes a head display (hereinafter referred to as “HD”) 20, a mounting tool 8, a connection tool 9, and a control device (hereinafter referred to as “control box” or “CB”) 30 (see FIG. 3).

  The configuration of the HD 20 will be described. The HD 20 has a function of projecting image light. The HD20 projection format is a virtual image projection type. Specifically, the HD 20 irradiates image light backward. The image light is incident on a light receiving object (for example, a user's eye wearing the HMD 10). The HD 20 includes a housing 2. The housing 2 includes a resin half mirror (not shown) on the left side. The half mirror is arranged in front of the user's eyes (for example, the left eye) when the HMD 10 is mounted on the user's head. The HD 20 includes an image display unit 22 (see FIG. 3) and a lens unit (not shown) inside the housing 2. The image display unit 22 displays an image based on a video signal transmitted from the CB 30 described later. The image display unit 22 is, for example, a spatial modulation element such as a liquid crystal element and a light source. The image display unit 22 may be a liquid crystal display, an organic EL (Organic Electro-luminescence) display, or the like. Further, the image display unit 22 may be a retinal scanning projection device that projects light two-dimensionally scanned onto a user's retina.

  The lens unit collects image light indicating an image displayed on the image display unit 22 and irradiates the half mirror from the left end of the housing 2. The image light emitted from the lens unit is reflected at least partially (for example, half) backward by a half mirror provided on the left side of the housing 2. When the HMD 10 is mounted on the user's head, the image light reflected by the half mirror is incident on one (for example, the left) eyeball (not shown) of the user. The image light incident on the eyeball is imaged on the retina by the crystalline lens, and is visually recognized by the user as a virtual image (image). Since the half mirror transmits at least a part of the light from the real image in the outside world, an image superimposed on the real image (the landscape in the outside world) can be shown to the user in the field of view of the user. The half mirror may be made of glass. In place of the half mirror, an optical path deflecting member that deflects the optical path by an action such as refraction, total internal reflection, or diffraction, such as a prism or a diffraction grating, may be used. Further, a total reflection mirror may be used instead of the half mirror.

  The wearing tool 8 is configured to hold the HD 20 on the user's head. The mounting tool 8 is formed of a metal material such as a flexible resin or stainless steel, for example. The mounting tool 8 has a first portion 8A and a pair of second portions 8B. Each of the first portion 8A and the pair of second portions 8B is a curved and elongated plate-like member. The wearing tool 8 is worn on the user's head with the first portion 8A placed on the user's forehead and a pair of second portions 8B on each of the right and left heads of the user.

  The connection tool 9 is a structure for connecting the mounting tool 8 and the HD 20. The connection tool 9 is a slightly curved rod-like member. The upper end portion of the connection tool 9 is connected to the mounting tool 8. The lower end portion of the connection tool 9 is connected to the HD 20. The connection tool 9 holds the HD 20 at a position separated from the mounting tool 8. As shown in FIG. 1, the connection tool 9 can arrange | position the half mirror of the housing | casing 2 ahead of a user's left eye in the state in which the mounting tool 8 was mounted | worn with the user. In this case, the user can visually recognize the image displayed on the image display unit 22 through the half mirror. As shown in FIG. 2, the connection tool 9 can arrange the half mirror of the housing 2 above the front of the user's left eye in a state where the mounting tool 8 is mounted on the user. For example, when the user does not need to view the image displayed on the image display unit 22, the user moves the lower end of the connection tool 9 upward to hold the HD 20 on the connection tool 9 at the position shown in FIG. Can be made. The position of the HD 20 in the HMD 10 shown in FIG. 2 is hereinafter referred to as “specific position”. The specific position corresponds to the “specific position” in the present invention.

  The CB 30 controls the HD 20. The CB 30 is connected to the HD 20 via the harness 7 (see FIG. 3). Note that the CB 30 and the HD 20 may perform wireless communication via wireless regardless of the harness 7. The CB 30 is attached to a position different from the HD 20 (for example, a user's waist belt, arm, etc.). However, the CB 30 may be configured integrally with the HD 20 or the wearing tool 8. The CB 30 includes an operation unit 37 including a power switch and operation buttons (not shown). Various settings in the HD 20, various operations during use, power on / off operations, and the like are input to the operation unit 37.

  The electrical configuration of the HMD 10 will be described with reference to FIG. First, the electrical configuration of the CB 30 will be described. The CB 30 includes a CPU 31 that controls the entire CB 30. The CPU 31 is electrically connected to a RAM 32, a flash memory 33, an input / output interface (hereinafter referred to as “input / output I / F”) 34, an operation unit 37, and a connection controller 35. The RAM 32 temporarily stores various data such as calculation results obtained by calculation processing by the CPU 31.

  The flash memory 33 is a nonvolatile storage device. The flash memory 33 stores the OS. The flash memory 33 stores various programs executed by the CPU 31, flags used by the various programs, initial values of data, and the like. Various programs are executed on the OS.

  The flash memory 33 secures at least storage areas of a program storage area 331, a device information table storage area 332, a display order table storage area 333, and a display result table storage area 334. The program storage area 331 stores at least a device information display program for the CPU 31 to execute a device information display process described later. The device information table storage area 332 stores a device information table 60 (see FIG. 4) described later. The display order table storage area 333 stores a display order table 70 (see FIG. 6) described later. The display result table storage area 334 stores a display result table 80 (see FIGS. 15 and 16) described later. Various programs including the device information display program, the device information table 60, the display order table 70, and the OS are stored in the flash memory 33 when the HMD 10 is shipped, for example. Note that the display result table 80 is a table generated when the device image is actually displayed on the HMD 10, and therefore does not need to be stored in the flash memory 33 when the HMD 10 is shipped.

  Further, the HMD 10 may download and install various programs and OS from a program download server via wireless communication. For example, the various programs and the OS may be transmitted from the server to the HMD 10 as a computer-readable temporary storage medium (for example, a transmission signal). The flash memory 33 is an example of a non-temporary storage medium. The non-temporary storage medium may be any storage medium that can store information regardless of the period in which the information is stored. The non-transitory storage medium may not include a temporary storage medium (for example, a signal to be transmitted). The storage device in the present embodiment is the flash memory 33, but the storage device is another non-transitory storage medium that can hold data regardless of the length of time for storing information, for example, ROM, RAM, etc. It may be configured.

  The input / output I / F 34 includes input terminals of one or a plurality of interfaces conforming to a predetermined standard (for example, Universal Serial Bus (USB)), and functions as an input port for connecting the CB 30 and an external device. In the present embodiment, a plurality of measuring devices 50 of measuring devices 1 to N can be connected to the input / output I / F 34. The measuring device 50 is various devices used in the medical field. The measuring device 50 includes, for example, an electrocardiograph that performs an electrocardiogram examination, an electroencephalograph that measures an electroencephalogram, an ultrasonic diagnostic apparatus, an MRI apparatus, an X-ray CT apparatus, a personal computer (PC), and the like, and displays an image of a medical chart. An information processing apparatus that outputs the information. The input / output I / F 34 acquires information input from the connected measuring device 50. The information input from the measuring device 50 is information corresponding to an image indicating the content measured or imaged by the measuring device 50, and is also referred to as “device information” below.

  The operation unit 37 performs input / output of an input signal or the like corresponding to an operation by the user. The connection controller 35 is electrically connected to the connection controller 21 of the HD 20 via the harness 7 and performs wired communication.

  Next, the electrical configuration of the HD 20 will be described. The HD 20 includes a connection controller 21, an image display unit 22, and a detection unit 23. The connection controller 21, the image display unit 22, and the detection unit 23 are electrically connected. The connection controller 21 is electrically connected to the connection controller 35 of the CB 30 via the harness 7 and performs wired communication. As described above, the image display unit 22 displays an image based on the video signal. The detection unit 23 is a sensor that can detect the position of the HD 20 in the HMD 10. In the present embodiment, the detection unit 23 is a well-known acceleration sensor provided in the housing 2, detects the inclination of the HD 20 by measuring the gravitational acceleration of the earth, and outputs the detection result. The output detection result is transmitted to the CB via the connection controller 21. The CPU 31 of the CB 30 determines whether the HD 20 is placed at a specific position according to the detection result of the detection unit 23.

  The device information table 60 stored in the device information table storage area 332 of the flash memory 33 in the CB 30 will be described with reference to FIGS. 4 and 5. As shown in FIG. 4, in the device information table 60, measurement devices, image patterns, moving images / still images, enlarged position coordinates, enlarged regions, alarm extraction position coordinates, alarm threshold values, and divided display sizes are associated and stored. Yes. The measuring device indicates any one of the measuring devices 1 to N. The image pattern is information that can identify which measuring device 50 is the device information input to the CPU 31 via the input / output I / F 34. In the present embodiment, the image pattern is information indicating the pattern of the image signal indicated by the device image input from each of the plurality of measuring devices 50. The image pattern is information about the template image for determining which measurement device 50 is the device image corresponding to the device information input to the CB 30 via the input / output I / F 34 by pattern matching. There may be. Further, the image pattern may be a pattern obtained by extracting a unique image signal pattern for each measuring device 50 included in the device information. In addition, the image pattern may be various information that each of the measuring devices 50 outputs as header information of the device information. The moving image / still image indicates whether the device image, which is an image based on the device information output by the measuring device 50, is a moving image or a still image.

  The enlarged position coordinates indicate a reference position for extracting a part of the device image from the device image when a part of the device image is enlarged and displayed on the image display unit 22 of the HD 20. In the present embodiment, the enlarged position coordinates are defined by values indicating the coordinate positions in the device image when the lower left corner of the device image is the origin (0, 0). The enlarged region indicates a region where a part of the device image is cut out from the device image by the number of dots on the vertical axis × horizontal axis. When the entire device image is displayed on the image display unit 22, depending on the amount of information included in the entire device image, the time required for the user who visually recognizes the device image to determine the medical condition or the like shown in the device image May be relatively long. In such a case, when a main part required by the user is cut out from the device image out of the entire device image, and the cut out main part is enlarged and displayed on the image display unit 22, the user can view the enlarged image. It may be easier to immediately determine the medical condition.

  For example, the case where the measuring device 1 which is one of the measuring devices 50 is an electrocardiograph and the device image indicated by the device information output from the measuring device 1 is an electrocardiogram image will be described as an example. As shown in FIG. 5, an electrocardiogram image 71 which is an example of an electrocardiogram image shows a plurality of waveforms corresponding to various values measured by the measuring device 1 in the left region from the center. Further, the electrocardiogram image 71 shows a plurality of numerical values corresponding to various values measured by the measuring device 1 in the right region. A point 72 indicates a position corresponding to the enlarged position coordinates (X1, X2) associated with the measuring device 1 in the device information table 60. The region 73 is a region to which the enlarged region associated with the measuring device 1 in the device information table 60 is applied with the enlarged position coordinates (X1, X2) as the origin. That is, when the electrocardiogram image 71 that is a device image of the measuring device 1 is displayed on the image display unit 22, the CPU 31 generates an output image corresponding to the image of the region 73 in the electrocardiogram image 71, and the generated output image Is displayed on the image display unit 22.

  The alarm extraction position coordinates are used when the alarm image, which is an image indicating a feature that requires a warning to the user, is included in the device image because the measured value by the measuring device 50 indicates an abnormal value. The reference position for extracting from is shown. The alarm threshold is set to a reference value that is determined by the CPU 31 when an alarm image is included in the device image, based on a measurement value by the measuring device 50 or the like. In the example of FIG. 6, the point 75 indicates a position corresponding to the alarm extraction position coordinate (X11, Y11) associated with the measuring device 1 in the device information table 60. In the case of the electrocardiogram image 71, the CPU 31 determines that the alarm image is included in the electrocardiogram image 71 when the waveform based on the measurement value of the measuring device 1 is drawn so as to exceed the straight line 74. That is, information indicating the straight line 74 in the electrocardiogram image 71 is stored as the alarm threshold value of the measuring device 1. When the CPU 31 determines that an alarm image is included in the electrocardiogram image 71, information for extracting an alarm image indicating a predetermined size area with reference to the alarm extraction position coordinates (X11, Y11) is device information. Is generated based on An alarm image is displayed on the image display unit 22 based on the generated information.

  The device image can be displayed on the image display unit 22 in various ways. For example, when a device image is displayed on the image display unit 22, the device image is not displayed over the entire display area of the image display unit 22, and a part of the display region of the image display unit 22 is divided. A device image may be displayed on the screen. The divided display size defines the size of the area in which the device image is displayed with respect to the display area of the image display unit 22 in order to display the device image in such a divided display. In the present embodiment, the HMD 10 includes a split mode in which a device image is displayed in a divided manner and a normal mode in which the device image is not displayed in a divided manner as display modes when the device image is displayed on the image display unit 22.

  The display order table 70 stored in the display order table storage area 333 of the flash memory 33 in the CB 30 will be described with reference to FIG. The display order table 70 defines the order in which device images are displayed on the image display unit 22. The CPU 31 can display the device images on the image display unit 22 in the order corresponding to the order determined in the display order table 70 with reference to the display order table 70.

  Depending on the usage scene in which the user uses the HMD 10 and the user's role for each usage scene, the type of device image required by the user, the order in which the device image is desired to be visually recognized, and the length of time in which each device image is desired to be visible May be different. As shown in FIG. 6, the display order table 70 stores an associated order, measuring device, and set time for each usage pattern. The usage pattern defines various patterns in which the HMD 10 is used in the medical field. For example, a plurality of usage patterns are provided depending on the usage scene of the HMD 10 such as the type of surgery, the role of the user of the HMD 10 in a medical site such as surgery, and the like. The order and measuring device define the display order of device images based on device information. Among these, the order indicates the display order of the device information, and the order from the “1” th to the “L” th which is the last in the order is defined. The measurement device indicates which of the measurement devices 1 to N is the measurement device 50 corresponding to the device image to be displayed. As the set time, the display time of each device image displayed according to the order is set in advance. In the present embodiment, the display order table 70 is provided with “AA surgery” as a use scene, and “surgeon” and “anesthesiologist” as roles in AA surgery. As shown in FIG. 6, different display orders are defined for the “AA surgeon” pattern and the “AA surgeon anesthesiologist” pattern. Thus, since a plurality of device image display orders corresponding to a plurality of usage patterns can be defined in the display order table 70, the HMD 10 can provide a device image suitable for the user usage pattern to the user of the HMD 10.

  The device information display process will be described with reference to FIGS. As described above, the HMD 10 is shipped with a device information display program stored in the flash memory 33 in advance. The device information display program is a program executed by the CPU 31 in the CB 30 of the HMD 10. The CPU 31 that has executed the device information display program switches the device image based on the device information to a device image corresponding to the display order defined in the display order table 70, or a device image corresponding to another opportunity, and the image of the HD 20 Processing to be displayed on the display unit 22 is performed.

  Various timer counters used in the device information display process will be described. The RAM 32 stores a set time counter, a display time counter, and a device search time counter. The set time counter measures the set time defined in the display order table 70. When the device image is displayed on the image display unit 22 according to the order defined in the display order table 70, the set time counter measures the set time from the start of displaying the device image. When the counter value corresponding to the set time is set in the set time counter, the set time counter value is sequentially subtracted with 0 as the lower limit value.

  The display time counter measures a display time T that is the length of time that the device image is actually displayed. When measurement of the display time T is started by the display time counter, the counter values of the display time counter are sequentially added.

  The device search time counter measures a search time for searching whether a predetermined measuring device 50 is connected to the CB 30 in a connected device confirmation process (see FIG. 9) described later. When a counter value corresponding to a predetermined search time is set in the device search time counter, the set device search time counter value is sequentially subtracted with 0 as a lower limit value. Note that the measurement by the set time counter, the display time counter, and the device search time counter is performed based on the timer function of the OS.

  Various flags used in the device information display process will be described. The RAM 32 stores a first flag, a second flag, a third flag, a specific position flag, and the like. The first flag is set to “ON” when a first event that is an event for switching the device image according to the display order defined in the display order table 70 has occurred, and the first event has not occurred. In this case, “OFF” is set. The first event is that there is no first input via the operation unit 37 within a predetermined period after the set time counter value becomes “0” after the set time measured by the set time counter has elapsed. Occurs when. The first input is, for example, an input based on an operation in which the user presses the operation button of the operation unit 37 once for a short time. The first event occurs when there is a first input before the set time measured by the set time counter elapses and there is a first input again after that. In addition, the first event is that there is a first input within a predetermined period after the setting time measured by the setting time counter has elapsed and the value of the setting time counter becomes “0”. Occurs when there is a first input. That is, in this embodiment, when the user does not perform an operation corresponding to the first input as the set time elapses, the device image displayed on the image display unit 22 is displayed in the display order table 70. It is switched according to the order. Further, when the user performs an operation corresponding to the first input before the set time elapses and then the user performs an operation corresponding to the first input again, the display order table 70 even before the set time elapses. Other device images corresponding to the display order defined in the above are displayed on the image display unit 22. When the user performs an operation corresponding to the first input within a predetermined period after the set time has elapsed, the device image being displayed is continuously displayed on the image display unit 22. Then, when the user performs an operation corresponding to the first input thereafter, the device image displayed on the image display unit 22 is switched according to the display order defined in the display order table 70. The first event also occurs when the number of measuring devices 50 connected to the input / output I / F 34 of the CB 34 has increased or decreased.

  The second flag is set to “ON” when the second event has occurred, and when the second event has not occurred, or an alarm release instruction described later has been input by the user via the operation unit 37. In response to this, it is set to “OFF”. In the present embodiment, the second event is a state in which an alarm image is included in the device image based on the device information input from the input / output I / F 34.

  The third flag is set to “ON” when the third event has occurred, and is set to “OFF” when the third event has not occurred. The third event occurs when there is a second input via the operation unit 37 while the CPU 31 executes the device information display process. The second input is, for example, an input based on an operation in which the user presses the operation button of the operation unit 37 once longer than that corresponding to the first input. In the present embodiment, it is assumed that the CPU 31 causes the user to select a device image of the measurement device 50 desired by the user in response to the second input.

  The specific position flag is “ON” when the HD 20 is in the specific position, and is “OFF” when the HD 20 is not in the specific position. The CPU 31 determines whether the HD 20 is in a specific position based on the detection result of the detection unit 23.

  Next, a process performed by the CPU 31 when the device information display holding process is executed will be described. When the user operates the power switch in the operation unit 37 of the CB 30, the CPU 31 performs an operation associated with a predetermined initial setting process (not shown) at the time of activation. The CPU 31 initializes flags and data stored in the RAM 32 and writes initial values of the flags and data stored in the flash memory 33 to the RAM 32.

  When the initial setting process is completed, the CPU 31 starts a device information display process. As shown in FIG. 7, when the device information display process is started, the CPU 31 determines whether a usage pattern has been acquired (S11). For example, the user inputs a usage pattern including “AA surgery” which is a usage scene using the HMD 10 and “surgeon” which is a user role in the usage scene via the operation unit 37. The CPU 31 stores the acquired usage pattern in the RAM 32. The CPU 31 repeats the determination of S11 until the usage pattern is acquired (S11: NO). When the usage pattern is acquired (S11: YES), the CPU 31 executes a connected device determination process (S13).

  The connected device determination process (S13, FIG. 7) will be described with reference to FIG. The connected device determination process is a process for determining which measurement device 50 connected to the input / output I / F 34 of the CB 30 is connected. As shown in FIG. 8, when the connected device determination process is started, the CPU 31 sets “1” to the value of the terminal counter for specifying the number of the input terminal provided in the input / output I / F 34. (S61). Hereinafter, the value of the terminal counter may be expressed as “X”. The terminal counter is stored in the RAM 32. The CPU 31 determines whether or not the measuring device 50 is connected to the Xth input terminal of the input / output I / F 34 (S62). When the device information is not input to the Xth input terminal, the CPU 31 determines that the measuring device 50 is not connected to the Xth input terminal (S62: NO), and proceeds to the determination of S71. Hereinafter, the Xth input terminal is referred to as an input terminal X.

  When the device information is input to the input terminal X, the CPU 31 determines that the measurement device 50 is connected to the input terminal X (S62: YES), and is output from the measurement device 50 connected to the input terminal X. Device information is acquired (S63). The CPU 31 refers to the device information table 60 stored in the device information table storage area 332 of the flash memory 33 (S64). The CPU 31 compares the image pattern indicated by the device information acquired in the process of S63 with each of the image patterns defined in the device information table 60 (S65). The CPU 31 determines whether or not the image pattern indicated by the device information matches any image pattern defined in the device information table 60 (S66). When the image pattern indicated by the acquired device information does not match any of the image patterns defined in the device information table 60 (S66: NO), the CPU 31 proceeds to the determination of S71.

  When the image pattern indicated by the device information matches one of the image patterns defined in the device information table 60 (S66: YES), the CPU 31 displays the measurement device connected to the input terminal X as the device information. It is determined that the measuring device corresponds to the matching image pattern in the table 60 (S68). The CPU 31 refers to the alarm threshold value associated with the measuring device 50 determined to be connected to the input terminal X in the device information table 60, and determines whether the device image based on the device information includes an alarm image. (S69). When the alarm image is included in the device image based on the device information (S69: YES), the CPU 31 sets the second flag to “ON” (S70), and shifts the processing to the determination of S71. When the alarm image is not included in the device image based on the device information (S69: NO), the CPU 31 proceeds to the determination of S71.

  The CPU 31 determines whether the value of the terminal counter is equal to Xmax, which is the maximum number of input terminals provided in the input / output I / F 34 (S71). When the value of the terminal counter is not equal to Xmax (S72), the CPU 31 adds “1” to the terminal counter (S72), and returns the process to S62. The CPU 31 repeats the processing from S62 to S70 until the value of the terminal counter becomes equal to Xmax. When the value of the terminal counter is equal to Xmax (S71: YES), the CPU 31 generates a correspondence list (not shown) in which the input terminal X and the measuring device 50 connected to the input terminal X are associated with each other. The generated correspondence list is stored in the RAM 32 (S74). In this way, the CB 30 recognizes which measuring device 50 is connected to the input terminal X of the input / output I / F 34. In this embodiment, when it is determined in S69 that the device image includes an alarm image, the CPU 31 assigns an identifier to the measurement device 50 corresponding to the device image including the alarm image in the correspondence list. Add and remember. The CPU 31 returns the process to the device information display process (see FIG. 6).

  Returning to the description of FIG. Next, the CPU 31 sets “1” to the value of the display order counter that stores the display order of the device images based on the device information. The display order counter is stored in the RAM 32. Hereinafter, the value of the display order counter may be expressed as “M”. The CPU 31 executes connected device confirmation processing (S15).

  With reference to FIG. 9, the connected device confirmation process (S15, see FIG. 7) will be described. The connected device confirmation processing confirms whether or not the measuring device 50 corresponding to the display order defined in the display order table 70 is connected to the input / output I / F 34, and device information output from the measuring device 50 that has confirmed the connection. This is a process for causing the image display unit 22 to display a device image based on the above. As shown in FIG. 9, when the connected device confirmation process is started, the CPU 31 stores the display order table 70 stored in the display order table storage area 333 of the flash memory 33 in the RAM 32 in the process of S11. A table portion corresponding to the usage pattern is referred to (S81).

  The CPU 31 determines whether the M-th measuring device 50 corresponding to the value of the display order counter among the orders defined in the display order table 70 corresponding to the usage pattern is connected to the input / output I / F 34 ( S82). When the M-th measuring device 50 is connected to the input / output I / F 34 (S82: YES), the CPU 31 proceeds to S88. The CPU 31 can execute this determination with reference to the list stored in the RAM 32 in the process of S74 (see FIG. 8), and whether the referenced list includes the M-th measuring device 50 in the display order table 70.

  When the M-th measuring device 50 is not connected to the input / output I / F 34 (S82: NO), the CPU 31 issues an instruction to display an error notification image (not shown) via the connection controller 35. 22 (S83). The image display unit 22 displays an error notification image in response to the instruction in S83. The error notification image is in the display order defined in the display order table 70, and the user knows that the measuring device 50 corresponding to the device image to be displayed next is not connected to the input / output I / F 34 of the CB 30. It is an image for notifying to. The error notification image is, for example, an image displaying a message such as “Please connect the measuring device 4”. It is assumed that data indicating the error notification image is stored in advance in the flash memory 33 or the like.

  CPU31 starts measurement of search time (S84). The search time takes into account the time required for the user who has visually recognized the error notification image displayed on the image display unit 22 in the process of S83 to connect the necessary measurement device 50 to the input / output I / F 34 of the CB 30. You only have to set it. The CPU 31 executes the above-described connected device determination process (see FIG. 8) (S85). As a result, the CPU 31 connects the measurement device 50 newly connected to the input / output I / F 34 to the correspondence device stored in the RAM 32 in the previous execution of the processing of S13 (see FIG. 7) and the measurement device 50. The correspondence list including the correspondence with the input terminal X is updated.

  The CPU 31 refers to the correspondence list updated in the process of S85, and the M-th measuring device 50 is connected to the input / output I / F 34 in the order defined in the display order table 70 corresponding to the usage pattern. Is determined (S86). When the M-th measurement device 50 is connected to the input / output I / F 34 (S86: YES), the CPU 31 proceeds to S88. When the M-th measuring device 50 is not connected to the input / output I / F 34 (S86: NO), the CPU 31 refers to the value of the search time counter and determines whether the search time has elapsed (S91). When the search time has not yet elapsed (S91: NO), the CPU 31 returns the process to S85 and repeats the processes of S85 and S86.

  The CPU 31 generates an output image that is a device image based on the device information output from the Mth measuring device 50 (S88). In this process, the CPU 31 refers to the device information table 60 and acquires the enlarged position coordinates and the enlarged region corresponding to the Mth measuring device 50 in the device information table 60. The CPU 31 generates output image data of an output image indicating an enlarged region with reference to the enlarged position coordinates in the device image.

  The CPU 31 transmits an instruction to display an output image based on the generated output image data to the image display unit 22 via the connection controller 35 (S89). The image display unit 22 displays an output image in response to the instruction in S89. When the display mode is the split mode, the CPU 31 displays an instruction to output the output image in a size corresponding to the split display size corresponding to the Mth measurement device 50 in the device information table 60. In this case, the image display unit 22 displays the output image with a size corresponding to the divided display size. The CPU 31 returns the process to the device information display process (see FIG. 7).

  On the other hand, when the search time has elapsed (S91: YES), the CPU 31 is provided in the display result table storage area 334 of the flash memory 33 to the effect that the M-th measuring device 50 has not been connected to the input / output I / F 34. Is registered in the displayed display result table 80 (S92). Although details will be described later, the display result table 80 is a table for storing the order in which the device images are actually displayed on the image display unit 22 and the time when the device images are actually displayed on the image display unit 22 in association with each other. is there.

  The CPU 31 determines whether the value of the display order counter is equal to “L”, which is the last order in the display order table 70 (S93). When the value of the display order counter is not equal to “L” (S93: NO), the CPU 31 adds “1” to the display order counter (S94), and returns the process to S82. In this manner, the CPU 31 is defined in the subsequent order in the device information table 60 when it is not confirmed that the Mth measuring device 50 is connected to the input / output I / F 34. It is confirmed whether the measuring device 50 is connected to the input / output I / F 34. When the value of the display order counter is equal to “L” (S93: YES), the CPU 31 executes display order update processing (S96), and ends the connected device confirmation processing and device information display processing. Details of the display order update processing will be described later.

  Returning to the description of FIG. The CPU 31 starts measuring the display time T of the device image based on the device information of the M-th measuring device 50 instructed to display on the image display unit 22 in the processing of S89 in the connected device determination processing of S15. (S16). At this time, the CPU 31 also refers to the display order table 70 and starts measuring the set time associated with the Mth measuring device 50.

  The CPU 31 determines whether a first event has occurred (S21). In this determination, the CPU 31 refers to the RAM 32 and determines that the first event has occurred if the first flag is “ON”, and the first flag if the first flag is “OFF”. Judge that no event has occurred. When the first event has occurred (S21: YES), the CPU 31 ends the measurement of the display time T (S22). The CPU 31 also ends the measurement of the set time.

  The CPU 31 flushes the display result table 80 (see FIG. 15) including “usage pattern”, “M” indicating the value of the display order counter, “measurement device”, and “T” indicating the value of the display time counter. It is generated in the display result table storage area 334 of the memory 33. When the CPU 31 executes S22 for the first time, the CPU 31 registers the usage pattern acquired in the process of S11 in the “use pattern” item of the display result table 80. The CPU 31 sets the display order counter value in the “M” item of the display result table 80, the measurement device 50 corresponding to the display order counter value in the display order table 70 in the “measurement device” item, and the “T” item. The value of the display time counter is registered (S23). The item “P” provided in the display result table 80 in FIG. 15 will be described later.

  The CPU 31 clears the value of the display time counter to “0” (S24). The CPU 31 adds “1” to the display order counter (S25), and returns the process to S15. The CPU 31 executes connected device confirmation processing in S15. As a result, the device image displayed on the image display unit 22 is the next or later in the display order table 70 from the output image displayed according to the display instruction output in the process of S89 of the previous connected device confirmation process. To the output image corresponding to the order following. CPU31 starts measurement of display time T (S16), and performs judgment of S21 again.

  When the first flag is not “ON” and the first event has not occurred (S21: NO), the CPU 31 determines whether the second event has occurred (S31). In this determination, the CPU 31 refers to the RAM 32 and determines that the second event has occurred if the second flag is “ON”, and the second flag if the second flag is “OFF”. Judge that no event has occurred. When the second event has occurred (S31: YES), the CPU 31 executes an alarm occurrence process (S32). Thereafter, the CPU 31 returns the processing to the determination of S21.

  With reference to FIG. 10, the process at the time of alarm occurrence (S32, see FIG. 7) will be described. The alarm generation process is a process for causing the image display unit 22 to display a device image including an alarm image instead of the device image being displayed on the image display unit 22 when the second event occurs. . As shown in FIG. 10, when the alarm occurrence process is started, the CPU 31 interrupts the measurement of the display time T that is being measured (S101). The CPU 31 separately stores the value of the display time counter when the measurement of the display time T is interrupted in the RAM 32. At this time, the CPU 31 also interrupts the measurement of the set time by the set time counter. The CPU 31 clears the value of the display time counter to “0” (S102). The CPU 31 determines whether the device image being displayed is a moving image (S103). In this determination, the CPU 31 refers to the display order table 70 and the value of the display order counter, and determines which measuring apparatus 50 is the measuring device 50 corresponding to the value of the display order counter in the display order table 70. . The CPU 31 refers to the device information table 60 to determine whether the device image based on the determined device information of the measuring device 50 is a moving image or a still image.

  If the displayed device image is not a moving image (S103: NO), the CPU 31 adds “0.5” to the display order counter (S104). The CPU 31 transmits an instruction to display a device image including an alarm image to the image display unit 22 via the connection controller 35 (S105). The image display unit 22 displays a device image including an alarm image in response to the instruction in S105. In this process, the CPU 31 determines the measuring device 50 corresponding to the device image including the alarm image based on the identifier attached to the correspondence list stored in the RAM 32. The CPU 31 specifies an alarm extraction position coordinate associated with the measuring device 50 corresponding to the device image including the determined alarm image by referring to the device information table 60 in response to the display instruction of the device image including the alarm image. . Based on the specified alarm extraction position coordinates, the CPU 31 instructs display of an output image in which the alarm image portion is extracted from the device image. The image display unit 22 displays an output image in which the alarm image portion is extracted from the device image in response to the instruction in S105. That is, the device image including the alarm image displayed on the image display unit 22 in the process of S105 corresponds to the “specific image” of the present invention. The CPU 31 starts measuring the display time T of the device image including the alarm image (S106).

  The CPU 31 transmits an instruction to display the alarm release image 77 (see FIG. 11) to the image display unit 22 via the connection controller 35 (S108). The image display unit 22 displays the alarm release image 77 in response to the instruction in S108. The alarm release image 77 cancels the display of the device image including the alarm image in the image display unit 22 and causes the image display unit 22 to display the device image that was displayed immediately before the device image including the alarm image is displayed. It is an image which shows operation with respect to the operation part 37 for this. It is assumed that data indicating the alarm release image 77 is stored in advance in the flash memory 33 or the like.

  With reference to FIG. 11, an example of the display contents of the image display unit 22 when the process of S108 is executed will be described. The display content of the image display unit 22 includes an alarm device image 76 and an alarm release image 77. The alarm device image 76 is an electrocardiogram image having a predetermined size centered on a point 75 corresponding to the alarm extraction position coordinates (X11, Y11) in response to the alarm image being included in the electrocardiogram image 71 shown in FIG. 71 is an image extracted from 71. The alarm device image 76 is a device image including an alarm image, and is an example of the “specific image” in the present invention. Since the alarm device image 76 is displayed on the image display unit 22 by the process of S104 instead of the device image being displayed, it is difficult for the user to overlook the alarm image. In addition, since the operation for visually recognizing the device image before switching to the alarm device image 76 is indicated by the alarm release image 77, the user can appropriately operate the operation unit 37 according to the alarm release image 77.

  Returning to the description of FIG. The CPU 31 cancels the device image including the alarm image, and a predetermined input for visually recognizing the device image displayed on the image display unit 22 immediately before the device image including the alarm image is input via the operation unit 37. (S109). Hereinafter, the predetermined input via the operation unit 37 is referred to as an alarm release instruction. When there is no alarm release instruction (S109: NO), the CPU 31 repeats the determination of S106 until there is an alarm release instruction. When there is an alarm release instruction (S109: YES), the CPU 31 ends the measurement of the display time T of the device image including the alarm image (S111).

  The CPU 31 associates the value of the display order counter, the measuring device 50 corresponding to the device image including the alarm image, and the value of the display time counter and registers them in the display result table 80 (S112). Thereafter, the CPU 31 clears the value of the display time counter to “0”. The CPU 31 subtracts “0.5” from the display order counter (S113). The CPU 31 transmits an instruction to display the device image of the Mth measuring device 50 to the image display unit 22 via the connection controller 35 (S114). In response to the instruction in S114, the image display unit 22 resumes the display of the device image of the Mth measurement device 50 instead of the device image including the alarm image. CPU31 sets the value memorize | stored in RAM32 by the process of S101 to the display time counter, and restarts the measurement of the display time T of the Mth measuring device 50 which restarted the display (S115). At this time, the CPU 31 also restarts the measurement of the set time by the set time counter that was interrupted in the process of S101. The CPU 31 moves the process to S116.

  On the other hand, when the device image being displayed is a moving image (S103: YES), the CPU 31 transmits an instruction to display the alarm notification image 79 (see FIG. 12) to the image display unit 22 via the connection controller 35 (S118). ). The image display unit 22 displays an alarm notification image 79 in response to the instruction in S118. The CPU 31 moves the process to S116. In this case, the processing from S104 to S115 is not performed, and the device image displayed at the time of S103 is continuously displayed on the image display unit 22.

  With reference to FIG. 12, an example of the display content of the image display unit 22 when the process of S118 is executed will be described. The display content of the image display unit 22 includes a device moving image 78 that is a device image by a moving image and an alarm notification image 79. As shown in FIG. 12, the alarm notification image 79 displays, for example, a message such as “An alarm is being generated in the device image of the measuring device 5”. When the device image being displayed is a moving image, the user may want to continuously view the device image currently being viewed rather than the device image including the alarm image. In such a case, the HMD 10 displays the alarm notification image 79 on the image display unit 22 while continuously displaying the device image on the image display unit 22. As a result, the HMD 10 is connected to the CB 30 such that the measuring device 50 outputting the device image including the alarm image while the device image by the moving image being displayed is continuously viewed by the user, that is, the second The user can be made aware that an event has occurred. In this embodiment, the alarm notification image 79 is automatically deleted from the image display unit 22 after being displayed on the image display unit 22 for a predetermined period. Thereafter, the CPU 31 sets the second flag to “OFF” (S116), and returns the process to the device information display process (see FIG. 7).

  Returning to the description of FIG. On the other hand, when the second event has not occurred (S31: NO), the CPU 31 determines whether a third event has occurred (S41). In this determination, the CPU 31 refers to the RAM 32, determines that the third event has occurred if the third flag is “ON”, and determines if the third flag is “OFF”. Judge that no event has occurred. When the third event has occurred (S41: YES), the CPU 31 ends the measurement of the display time T (S42). The CPU 31 also ends the measurement of the set time.

  The CPU 31 registers the value of the display order counter, the value of the measuring device 50 corresponding to the value of the display order counter in the display order table 70, and the value of the display time counter in the display result table 80 (S43). The CPU 31 clears the value of the display time counter to “0” (S54). CPU31 produces | generates the image for an output which is an apparatus image based on the apparatus information output from the measuring apparatus 50 selected by the 2nd input in a 3rd event (S45). In this process, the CPU 31 refers to the correspondence list and determines which of the measuring devices 50 corresponding to the device information is based on the device information output from the selected measuring device 50. The CPU 31 refers to the device information table 60 and acquires enlarged position coordinates and an enlarged region corresponding to the determined measuring device 50. The CPU 31 generates output image data of an output image indicating an enlarged region with reference to the enlarged position coordinates in the device image.

  The CPU 31 transmits an instruction to display an output image based on the generated output image data to the image display unit 22 via the connection controller 35 (S46). The image display unit 22 displays an output image in response to the instruction in S46. CPU31 starts measurement of display time T (S47), and returns a process to judgment of S21.

  On the other hand, when the third event has not occurred (S41: NO), the CPU 31 executes HD position determination processing (S51), and returns the processing to the determination of S21. In this way, the CPU 31 repeatedly executes the determinations of S21, S31, S41, and S51 to determine the occurrence of the first event, the occurrence of the second event, the occurrence of the third event, and the status of the HD 20 placement. It is constantly monitored in the device information display process. In particular, the CPU 31 determines whether or not an alarm image is included in the acquired device information every time device information is acquired in the connected device confirmation processing in S15, thereby reducing the possibility that the user will miss an image related to the alarm image. it can.

  The HD position determination process (S51, see FIG. 7) will be described with reference to FIG. In the HD position determination process, a process according to whether or not the arrangement of the HD 20 in the HMD 10 is a specific position is performed. As shown in FIG. 13, when the HD position determination process is started, the CPU 31 determines whether the HD 20 is located at a specific position (S121). The CPU 31 determines whether the HD 20 is arranged at a specific position according to the detection result by the detection unit 23 of the HD 20.

  When the HD 20 is located at a specific position (S121: YES), the CPU 31 transmits a display suppression instruction that is an instruction to suppress display of the device image to the image display unit 22 via the connection controller 35 (S122). . The image display unit 22 that has received the display suppression instruction suppresses the display of the device image by turning off the light source. The CPU 31 returns the process to the device information display process (see FIG. 7). In this way, when the HD 20 is arranged at a specific position, the HMD 10 considers that the user does not need to view the image display unit 22 of the HD 20 and turns off the light source of the image display unit 22 to save the HMD 10. Electricity is being planned. The HMD 10 may be operated by an internal power supply mounted inside such as a battery without receiving power supply from the outside due to the nature of being mounted on a user and used. Since the HMD 10 can reduce power consumption according to the position of the HD 20, the life of the internal power supply can be extended.

  When the HD 20 is not arranged at the specific position (S121: NO), the CPU 31 transmits a normal display instruction, which is an instruction for normally displaying the device image, to the image display unit 22 via the connection controller 35 (S123). ). The image display unit 22 that has received the normal display instruction operates the light source at a light intensity suitable for the user to visually recognize the device image, thereby displaying the device image so as to be visible to the user. The CPU 31 returns the process to the device information display process (see FIG. 7).

  Next, the display order update process (S96, see FIG. 9) will be described with reference to FIGS. The display order update process is a process for updating the display order table 70 based on the registered contents of the display result table 80 according to the order in which the device images are actually displayed. As shown in FIG. 14, when the display order update process is started, the CPU 31 refers to the display result table 80 stored in the display result table storage area 334 of the flash memory 33 (S131). In each process of S23, S43 (see FIG. 7), S92 (see FIG. 9), and S112 (see FIG. 10), the CPU 31 displays the usage pattern, the value of the display order counter, and the measuring device 50, the display time Each of the counter values is registered in the display result table 80. As a result, a display result table 80 as shown in FIG. 15 is constructed.

  In the display result table 80 shown in FIG. 15, the measuring device 50 is one of the measuring devices 1 to N and the display time T are registered in ascending order of the value of M. The maximum value of M is “M = L”. The case where the item of M is a decimal number instead of an integer corresponds to the case where the measuring device 50 and the display time T for the device image including the alarm image are registered by the processing of S112 according to the occurrence of the second event. To do. “-” Is registered in the item M for the device image whose display is started by the process of S46 regardless of the order defined in the display order table 70 according to the occurrence of the third event. This corresponds to the case where the measuring device 50 and the display time T are registered. The item of T is “-(no connection)” because the M-th measuring device 50 is not connected to the input / output I / F 34 by the process of S92 according to the occurrence of the first event. Corresponds to the case of registration. Note that at the time of execution of S131, nothing is registered in the item “P” in FIG.

  The CPU 31 assigns the number “P” to the display result table 80 in ascending order of the value of M (S132). Let Pmax be the maximum value of P. At this time, a display result table 80 as shown in FIG. 15 is constructed. The CPU 31 sets “1” to the value of the display result counter for specifying the value of “P” in the display result table 80 (S133). The display result counter is stored in the RAM 32. Hereinafter, the value of the display result counter may be expressed as “P”.

  The CPU 31 determines whether the value of M corresponding to P is an integer in the display result table 80 (S134). When the value of M is not an integer (S134: NO), the CPU 31 deletes the data string including “M”, “measurement device”, and “T” corresponding to P from the display result table 80 (S137). The data string including “M”, “measurement device”, and “T” to be deleted in this process is displayed in the display result table 80 due to the occurrence of the second event according to the patient's condition and the like at the medical site. It is registered. When the user uses the HMD 10 in another scene of the same usage pattern, the same second event does not necessarily occur at the same timing. For this reason, the CPU 31 deletes the data string registered in the display result table 80 due to the occurrence of the second event. The CPU 31 proceeds to the determination of S138.

  When the value of M is an integer (S134: YES), the CPU 31 determines whether or not the value of the item “T” corresponding to P in the display result table 80 indicates a value of 10 seconds or less (S135). When the value of the item “T” indicates a value of 10 seconds or less (S135: YES), the CPU 31 stores a data string including “M”, “measurement device”, and “T” corresponding to P from the display result table 80. It is deleted (S137). The data string to be deleted in this process is a data string in which a relatively short display time T is registered in the display result table 80 due to the occurrence of the first event or the third event. Since the display time T is relatively short, when the user uses the HMD 10 in another scene of the same usage pattern, the user necessarily needs to visually recognize the device image as registered in the display result table 80 this time. Is not limited. For this reason, the CPU 31 deletes the data string registered in the display result table 80 indicating the relatively short display time T due to the occurrence of the first event or the third event. The CPU 31 proceeds to the determination of S138.

  When the value of the item “T” indicates a value greater than 10 seconds (S135: NO), the CPU 31 sets the value of the item “M” corresponding to P in the display result table 80 to “− (no connection). It is determined whether or not (S136). When the value of the item “M” is “− (no connection)” (S136: YES), the CPU 31 includes “M”, “measurement device”, and “T” corresponding to P from the display result table 80. The data string is deleted (S137). The data string to be deleted in this process is displayed as a result of the fact that the Mth measuring device 50 is not connected to the input / output I / F 34 by the process of S92 in response to the occurrence of the first event. It is registered in the table 80. In this case, it is considered that the user has determined that it is not necessary to visually recognize the device image of the Mth measurement device 50 and has not connected the Mth measurement device 50 to the input / output I / F 34. Therefore, even when the user uses the HMD 10 in another scene of the same usage pattern, there is a high possibility that the Mth measurement device 50 is not connected to the input / output I / F 34. Therefore, in response to the occurrence of the first event, the CPU 31 registers the data registered in the display result table 80 due to the fact that the Mth measurement device 50 has not been connected to the input / output I / F 34 by the process of S92. Delete the column. The CPU 31 proceeds to the determination of S138.

  The CPU 31 determines whether the value of the display result counter is Pmax (S138). When the value of the display result counter is not Pmax (S138: NO), the CPU 31 adds “1” to the display result counter and returns the process to the determination of S134. The CPU 31 repeats the processing from S134 to S138 until the value of the display result counter reaches Pmax.

  When the value of the display result counter is Pmax (S138: YES), the CPU 31 sorts each data string in the display result table 80 in ascending order of the value of the item “P” (S141). In this process, when the data string is deleted by the process of S137, the value stored in the item “P” of the display result table 80 may not be a continuous value. In this case, the CPU 31 reassigns the value of “P” again in ascending order of the value of the previous “P” item.

  The CPU 31 refers to the display order table 70 corresponding to the usage pattern (S142). The CPU 31 compares the display result table 80 and the display order table 70, and compares the “T” value of the display result table 80 corresponding to the same measuring device 50 and the “set time” value of the display order table 70. Are respectively calculated (S143). The CPU 31 registers the calculated average value by overwriting the value “T” in the display result table 80. The display result table 80 at this time has contents as shown in FIG.

  The CPU 31 associates P in the display result table 80 with the item “order” in the display order table 70 and changes the data structure of the display order table 70 to the structure registered in the display result table 80 obtained in S143. Update (S144). In this way, the display order and display time of the device images in the display order table 70 are updated according to the use result of using the HMD 10. In this way, the actual order in which the device images are displayed on the image display unit 22 is reflected in the display order table 70. Therefore, the HMD 10 can display device images in a display order more suitable for the user when the HMD 10 is used in the same usage pattern after the next time.

  CPU31 transmits the instruction | indication which displays an apparatus image to the image display part 22 according to generation | occurrence | production of a 1st event, a 2nd event, and a 3rd event (S46, S89, S105). The image display unit 22 displays a device image in response to each instruction of S46, S89, and S105. In addition, when the device image is switched according to the occurrence of the first event (S21: YES), the CPU 31 is displayed on the image display unit 22 according to the display order of the device images defined in the display order table 70. An instruction to display the device images in the order subsequent to the device image order is transmitted to the image display unit 22 (S89). In this manner, in the HMD 10, the device image displayed on the image display unit 22 is switched according to the display order of the device images defined in the display order table 70. For this reason, the frequency with which the user performs input for switching the device image via the operation unit 37 in order to switch the device image is reduced. In addition, even in the case of the image display unit 22 having a relatively small display area, such as the HD 20 worn on the user's head, the HMD 10 sends device images acquired from each of the plurality of measuring devices 50 to the user. Easy to see. Therefore, the HMD 10 reduces the operation frequency of the operation unit 37 necessary for the user to visually recognize the device image, and displays each device image of the plurality of measuring devices 50 in an aspect that is easy for the user to visually recognize. 22 can be displayed.

  Since the measuring device 50 includes various measuring devices 1 to N, the aspect of the device image also varies depending on the measuring device 50. Rather than displaying a device image corresponding to the device information itself acquired from the measuring device 50 on the image display unit 22, an output image generated in an output mode corresponding to the display area of the image display unit 22 is displayed. This may improve the visibility of the user's device image. The CPU 31 refers to the device information table 60 and acquires the enlarged position coordinates and the enlarged region corresponding to the measuring device 50 outputting the device information. Based on the acquired enlargement position coordinates and enlargement area, the CPU 31 generates output image data of an output image indicating an enlargement area based on the enlargement position coordinates in the device image (S89). The CPU 31 transmits an instruction to display an output image based on the generated output image data to the image display unit 22 (S89). For this reason, the HMD 10 can display the device images of the plurality of measuring devices 50 on the image display unit 22 in a manner that is easy for the user to visually recognize.

  The device information table 60 includes an alarm extraction position coordinate indicating a reference position for extracting an alarm image from the device image, and an alarm threshold which is a reference value determined by the CPU 31 when the device image includes the alarm image. It is stored in association with every 50th. The CPU 31 refers to the alarm threshold associated with the measuring device 50 determined to be connected to the input terminal X, and determines whether an alarm image is included in the device image based on the device information (S69). When the alarm image is included in the device image, the CPU 31 transmits an instruction to display the device image including the alarm image to the image display unit 22 via the connection controller 35 (S105). The image display unit 22 displays a device image including an alarm image in response to the instruction in S105. Therefore, the HMD 10 can reduce the possibility that the user misses the device image including the alarm image.

  The CPU 31 repeatedly executes the determinations of S21, S31, S41, and S51, so that the occurrence of the first event, the occurrence of the second event, the occurrence of the third event, and the status of the HD 20 are displayed in the device information display process. Are constantly monitoring. In particular, the CPU 31 determines whether a second event has occurred (S69) each time device information is acquired in the connected device confirmation processing in S15 (S63), so that the user may miss an image related to the alarm image. Can be reduced.

  Depending on the usage pattern of the HMD 10, the types of device images required by the user, the order in which the device images are desired to be visually recognized, and the length of time in which each device image is desired to be visible may differ. The display order table 70 defines a plurality of device image display orders corresponding to a plurality of usage patterns. The CPU 31 acquires the usage pattern of the HMD 10 via the operation unit 37 (S11), and refers to the display order table 70 corresponding to the usage pattern (S81), thereby displaying the device image based on the display order corresponding to the usage pattern. The instruction to transmit is transmitted to the image display unit 22 (S89). Therefore, the HMD 10 can display the device image based on the display order corresponding to the usage scene in which the user uses the HMD 10 and the role of the user for each usage scene.

  In each process of S23, S43 (see FIG. 7), S92 (see FIG. 9), and S112 (see FIG. 10), the CPU 31 displays the usage pattern, the value of the display order counter, and the measuring device 50, the display time Each of T is registered in the display result table 80. The CPU 31 updates the display order table 70 in accordance with the contents registered in the display result table 80 (S144). For this reason, the HMD 10 can display the device images in the order corresponding to the display order table 70 in which the actual order in which the device images are displayed on the image display unit 22 is reflected.

  When the user does not need to view the image displayed on the image display unit 22, the HD 20 may be arranged at a specific position. The HD 20 is provided with a detection unit 23 that can detect the position of the HD 20 in the HMD 10. The CPU 31 can determine whether the HD 20 is located at a specific position according to the detection result of the detection unit 23. When the HD 20 is disposed at the specific position (S121: YES), the CPU 31 transmits a display suppression instruction to the image display unit 22 (S122). The image display unit 22 that has received the display suppression instruction suppresses the display of the device image by turning off the light source. As described above, the HMD 10 can reduce power consumption by suppressing the display of the device image on the image display unit 22 in accordance with the position of the HD 20 being the specific position.

  When the device image being displayed is a moving image, the user may want to continuously view the device image currently being viewed rather than the device image including the alarm image. The CPU 31 determines whether the device image being displayed is a moving image (S103). When the device image being displayed is a moving image (S103: YES), the CPU 31 transmits an instruction to display the alarm notification image 79 to the image display unit 22 while continuously displaying the device image being displayed (S118). . Thereby, HMD10 can make a user grasp | ascertain that the 2nd event has generate | occur | produced by the alarm alert image 79, making a user visually recognize the apparatus image currently displayed.

  In the above embodiment, the HMD 10 corresponds to an “information display device” of the present invention. The CPU 31 that executes the processes of the input / output I / F 34 and S63 corresponds to the “apparatus information acquisition unit” of the present invention. The device information table 60 corresponds to the “device table” of the present invention. The device information table storage area 332 of the flash memory 33 corresponds to the “table storage unit” of the present invention. The CPU 31 that executes the process of S66 functions as the “determination unit” of the present invention. The image display unit 22 of the CB 20 corresponds to the “display unit” of the present invention. The CPU 31 that executes the processes of S46, S89, S105, and S114 functions as the “display control means” of the present invention. The display order table storage area 333 of the flash memory 33 that stores the display order table 70 corresponds to the “display order storage unit” of the present invention. The CPU 31 that executes the processes of S21, S31, and S41 functions as the “first instruction acquisition unit” of the present invention.

  The CPU 31 that executes the processes of S45 and S88 functions as the “image generating means” of the present invention. The CPU 31 that executes the process of S11 functions as the “second instruction acquisition unit” of the present invention. The display result table 80 corresponds to “display result information” of the present invention. The display result table storage area 334 of the flash memory 33 corresponds to the “display result storage unit” of the present invention. The CPU 31 that executes the process of S144 functions as the “update means” of the present invention. The detection unit 23 of the CB 20 corresponds to the “detection unit” of the present invention. The CPU 31 that executes the process of S103 functions as the “image determination unit” of the present invention.

  In addition, this invention is not limited to said embodiment, A various change is possible. For example, the input / output I / F 34 may be an interface circuit that conforms to various wireless communication standards.

  A plurality of measuring devices 50 are connected to one measuring device 50, one measuring device 50 is connected to the input / output I / F 34, and a plurality of devices corresponding to a plurality of measuring devices 50 from one measuring device 50 are connected. The information may be input to the input / output I / F 34.

  In the above embodiment, the CPU 31 refers to the device information table 60 in the process of S103 to determine whether the device image is a moving image or a still image, but is not limited thereto. For example, the CPU 31 determines whether the device image displayed on the image display unit 22 is a moving image based on the mode of the device image displayed on the image display unit 22 without using the device information table 60. Also good.

  In the above embodiment, an output image indicating an enlarged region with reference to the enlarged position coordinates is generated from the device image, and the generated output image is displayed on the image display unit 22 (S46, S89). The device image displayed in the processing of S46 and S89 is not necessarily an output image, and the device image based on the device information acquired from the measuring device 50 is directly used as the image display unit 22 depending on the output mode of the device image. May be displayed.

  In the above embodiment, an output image in which an alarm image portion is extracted from a device image is displayed on the image display unit 22 based on the alarm extraction position coordinates in accordance with the processing of S105. The device image displayed on the image display unit 22 in response to the instruction in S105 does not necessarily have to be an alarm image portion extracted based on the alarm extraction position coordinates. For example, the entire device image including the alarm image is included. May be displayed on the image display unit 22.

  In the embodiment, the connected device determination process is a process incorporated in the device information display process. The connected device determination process does not necessarily have to be incorporated in the device information display process, and may be a process independent of the device information display process. In this case, the connected device determination process may be executed by the CPU 31 in parallel with the device information display process. In this case, the connected device determination process is repeatedly executed in parallel with the device information display process, so that the device information is acquired from the measuring device 50 by the process of S63 each time the connected device determination process is executed. Further, every time device information is acquired, it is determined by the process of S69 whether an alarm image is included in the device image based on the device information. After determining that the device image includes an alarm image in the process of S69, the CPU 31 issues an alarm release instruction when the device image no longer includes the alarm image when the process of S69 is executed next time. It may be generated. In this way, when the alarm image is not included in the device image after the execution of the alarm occurrence process (S32) is started, the process of S109 is performed regardless of the predetermined input via the operation unit 37. It is determined that an alarm release instruction has been automatically issued during processing.

  Various modes can be considered for updating the display order table 70 in accordance with the contents registered in the display result table 80. In the above embodiment, the corresponding data string is deleted from the display result table 80 according to the determination results of S134, S135, and S136 (S137). For example, it may be preferable to update the display order table 70 including the contents registered in the display result table 80 due to the occurrence of the second event. Even in the case where a relatively short display time T is registered in the display result table 80, it may be preferable to update the display result table 80 as it is. In some cases, it is preferable not to delete the measuring device 50 registered as “-(no connection)” in the display result table 80 from the display order table 70. For this reason, in the display order update process, the determinations in S134, S135, and S136 do not necessarily have to be performed, and some or all of S134, S135, and S136 may not be performed.

  In the above embodiment, the detection unit 23 is provided inside the housing 2 of the HD 20, but a member for determining whether the HD 20 is disposed at a specific position is not necessarily provided inside the housing 2 of the HD 20. There is no need to be done. A member corresponding to the detection unit 23 may be provided on the outer side of the housing 2 of the HD 20, the wearing tool 8, or the like.

  In the above embodiment, the first input that triggers the occurrence of the first event is an input based on an operation in which the user presses the operation button of the operation unit 37 once in a short time. However, the first input is not limited to this. For example, the first input may be an input based on a well-known speech recognition process that extracts an acoustic feature quantity (for example, phonemes). In this case, the HD 20 may include a microphone inside the housing 20 that converts analog sound input from the outside of the housing 20 (for example, a user's mouth) into digital sound data. The microphone may output sound data to the CB 34. The CPU 31 may determine whether or not the sound data corresponds to a user's specific voice corresponding to the first input based on the execution result of the voice recognition process. The first input may be an input based on a predetermined detection result by the detection unit 23. In this case, the user can generate the first input by moving the head wearing the HMD 10 in a predetermined direction (for example, performing a whispering operation).

  In the above embodiment, the image display unit 22 suppresses the display of the device image by turning off the light source in response to the display suppression instruction transmitted to the image display unit 22 by the process of S122. The display mode of the device image display is not limited to this. For example, the display of the device image may be suppressed by reducing the brightness of the light source of the image display unit 22. Further, the CPU 31 may suppress the display of the device image by interrupting the transmission of the video signal related to the device image to the CB 20 in response to the display suppression instruction. In this case, since the processing load on the CPU 31 and the image display unit 22 is reduced, the HMD 10 can reduce power consumption.

  The device information display process may be distributed by a plurality of electronic devices (that is, a plurality of CPUs). For example, a part of the device information display process may be executed in an external device such as a PC that can wirelessly communicate with the HMD 10 via a network including the Internet, a LAN, and other dedicated lines. For example, the program may be downloaded from a PC or the like capable of wireless communication with the HMD 10 via a predetermined network and stored in the flash memory 33 of the CB 30 or the like.

10 HMD
20 HD
22 Image display unit 23 Detection unit 30 CB
31 CPU
33 Flash memory 34 I / O I / F
60 Device information table 80 Display result table 332 Device information table storage area 333 Display order table storage area 334 Display result table storage area

Claims (8)

Device information acquisition means for acquiring device information output from each of a plurality of measuring devices;
A table storage unit for storing a device table in which the format of the device information and each measuring device are associated;
A determination unit that refers to the device table and determines which of the plurality of measurement devices corresponds to the device information acquired by the device information acquisition unit;
Display control means for displaying a device image based on device information corresponding to the measurement device determined by the determination means on a display unit that can be worn on the head;
A display order storage unit that stores a display order that defines the order in which the device images are displayed on the display unit;
First instruction acquisition means for acquiring a first instruction to switch the device image displayed on the display unit to another device image;
The display control unit refers to the display order storage unit when the first instruction is acquired by the first instruction acquisition unit, and another device based on the display order stored in the display order storage unit An information display device that displays an image on the display unit. The device table associates an output mode of a device image corresponding to the device information and each measuring device,
Image generation means for generating an output image that is a device image based on corresponding device information according to the output mode of the device image associated with the measurement device determined by the determination device with reference to the device table With
The information display apparatus according to claim 1, wherein the display control unit displays the output image, which is another device image, on the display unit. The device table associates the characteristic part included in the device image with each measuring device,
The determination unit determines whether the feature part is included in a device image based on the device information acquired by the device information acquisition unit,
3. The information according to claim 1, wherein the display control unit causes the display unit to display a specific image related to the characteristic part when the determination unit determines that the characteristic part is included. 4. Display device.   The determination unit determines whether the feature part is included in a device image based on the acquired device information every time the device information is acquired by the device information acquisition unit. The information display device described in 1. The display order storage unit stores a plurality of the display orders,
Comprising a second instruction acquisition means for acquiring a second instruction indicating which of the plurality of display orders to select;
The said display control means displays the apparatus image based on the display order according to the said 2nd instruction | indication acquired by the said 2nd instruction | indication acquisition means on the said display part. Information display device. A display result storage unit for storing display result information including at least information indicating the order in which the device images are displayed on the display unit by the display control unit;
The update means for updating the display order stored in the display order storage unit according to the display result information with reference to the display result storage unit. An information display device according to the above. A detecting means capable of detecting the position of the display unit;
The display control unit causes the display unit to suppress display of the device image when the position detected by the detection unit is the specific position. The information display device described in 1. Image judging means for judging whether the device image displayed on the display unit is a still image or a moving image;
The display control unit continuously displays the device image displayed on the display unit when the image determination unit determines that the device image displayed on the display unit is a moving image; and The information display device according to claim 1, wherein a notification image based on the acquisition of the first instruction by the first instruction acquisition unit is displayed on the display unit.