JP2015228184A - Monitoring program, monitoring system, and monitoring method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve accuracy in monitoring operation of an apparatus.SOLUTION: A monitoring device 10 has an identification unit 11, a monitoring unit 12, and a storage unit 13. The storage unit 13 stores apparatus information 13a for at least one apparatus, the apparatus information 13a including information for identifying positions of light emission members 2a, 2b provided in an apparatus 2 corresponding to the one apparatus, and a light emission state of the light emission members 2a, 2b at a time when the apparatus 2 is in at least one operational state. The identification 11 detects, on the basis of an imaged image 5 acquired from an imaging device 3, the positions of the light emission members 2a, 2b in the imaging image 5, and the light emission state of the light emission members 2a, 2b. The identification unit 11 identifies an apparatus type of the apparatus 2 imaged by the imaging device 3 on the basis of comparison of the apparatus information 13a with the detected positions of the light emission members and the light emission state of the light emission members. The monitoring unit 12 monitors the operational state of the imaged apparatus 2 on the basis of the imaged image 5 acquired from the imaging device 3 according to a monitoring condition corresponding to the identified apparatus type, the monitoring condition being stored in the storage unit 13.

Description

  The present invention relates to a monitoring program, a monitoring system, and a monitoring method.

  In recent years, a technique has been considered in which a device to be monitored is captured and the operation of the device is monitored using the captured image. For example, a monitoring area including a notification LED (Light Emitting Diode) in the captured image and a monitoring pattern for determining that the lighting mode of the notification LED included in the monitoring area is abnormal are set in the monitoring area in the captured image. There has been proposed a technique for notifying that when it is determined that the lighting mode of the included notification LED satisfies the monitoring pattern.

JP 2005-242915 A

  However, the monitoring conditions for monitoring the operation of the device to be monitored are different for each device model. For this reason, in the process of monitoring the operation of the device using the captured image, there is a problem that the operation of the device cannot be accurately monitored unless the model of the device to be monitored is specified.

  In one aspect, an object of the present invention is to provide a monitoring program, a monitoring system, and a monitoring method capable of improving the accuracy of device operation monitoring.

  In one proposal, a monitoring program that causes a computer to execute the following processing is provided. The computer detects the position of the light emitting member and the light emission state of the light emitting member in the captured image based on the captured image acquired from the imaging device. Next, for the at least one device, the computer stores the position of the light emitting member included in the corresponding device, and the light emitting state of the light emitting member when the device is in at least one operating state. The model of the device imaged by the imaging device is identified based on the comparison between the device information including information for identifying the light emitting member and the detected position of the light emitting member and the light emitting state of the light emitting member. Then, the computer monitors the operation state of the imaged device based on the captured image acquired from the imaging device according to the monitoring condition corresponding to the specified model stored in the storage unit.

  Further, in one proposal, a storage device that stores a plurality of devices in a detachable state, an imaging device that captures an image stored in the storage device, and an operation state of the devices stored in the storage device are monitored. A monitoring system having a monitoring device is provided. In this monitoring system, the monitoring device includes a storage unit, a specifying unit, and a monitoring unit. The identification unit detects the position of the light emitting member and the light emission state of the light emitting member in the captured image based on the captured image acquired from the imaging device, and handles at least one device stored in the storage unit Device information including information specifying the position of the light emitting member included in the device to be operated and the light emitting state of the light emitting member when the device is in at least one operation state, the position of the detected light emitting member, and the light emitting member Based on the comparison with the light emission state, the model of the device imaged by the imaging device is specified. The monitoring unit monitors the operating state of the imaged device based on the captured image acquired from the imaging device according to the monitoring condition corresponding to the specified model stored in the storage unit.

  Furthermore, in one proposal, a monitoring method is provided in which a computer executes the same processing as the above monitoring program.

  In one aspect, the accuracy of device operation monitoring can be improved.

It is a figure which shows the structural example and processing example of the monitoring system of 1st Embodiment. It is a figure which shows the example of the information processing system of 2nd Embodiment. It is a figure which shows the hardware structural example of a monitoring control apparatus. It is a figure which shows the function example of a monitoring control apparatus. It is a figure which shows the example of an LED image information table. It is a figure which shows the example of an LED information table. It is a figure which shows the example of the light emission pattern information table. It is a figure which shows the example of an apparatus information table. It is a figure which shows the example of a monitoring information table. It is a flowchart which shows the example of the process which specifies the model of information equipment. 10 is a flowchart (continuation) illustrating an example of processing for specifying a model of an information device. 12 is a flowchart (continuation 2) illustrating an example of processing for specifying a model of an information device. It is a flowchart which shows the example of the process which monitors information equipment. 10 is a flowchart (continuation) illustrating an example of processing for monitoring an information device. It is a figure which shows the example of arrangement | positioning of an imaging device. It is a figure which shows the example of the LED image information table used in 3rd Embodiment. It is a flowchart which shows the example of the process which specifies the model of information equipment.

Hereinafter, the present embodiment will be described with reference to the drawings.
[First Embodiment]
FIG. 1 is a diagram illustrating a configuration example and a processing example of the monitoring system according to the first embodiment. The monitoring system 1 includes an imaging device 3 that images the device 2 to be monitored, and a monitoring device 10 that monitors the operation of the device 2 based on a captured image acquired from the imaging device 3.

  The device 2 to be monitored is an electronic device such as a computer, a storage device, or a network device. Further, a light emitting member that indicates an operation state of the device 2 is installed on the outer surface of the device 2. The imaging device 3 is arranged so as to capture at least the surface on which the light emitting member is installed among the outer surfaces of the device 2. As the surface on which the light emitting member is installed, for example, the front panel of the device 2 can be considered.

  In the example of FIG. 1, the device 2 to be monitored is stored in the storage device 4 in a detachable state. A plurality of devices may be stored in the storage device 4. In this case, the monitoring device 10 may monitor the operation of each of the plurality of devices stored in the storage device 4. Further, the imaging device 3 or both the imaging device 3 and the monitoring device 10 may be mounted on the storage device 4.

  The monitoring device 10 includes a specifying unit 11, a monitoring unit 12, and a storage unit 13. The processing of the specifying unit 11 and the monitoring unit 12 is realized by, for example, a processor included in the monitoring device 10 executing a predetermined program. The storage unit 13 is realized by a storage area of a predetermined storage device such as an HDD (Hard Disk Drive) included in the monitoring device 10, for example.

  The storage unit 13 stores at least device information 13a. The device information 13a includes information for specifying the position of the light emitting member included in the corresponding device and the light emission state of the light emitting member for at least one device. The position of the light emitting member registered in the device information 13a is represented by, for example, coordinates of an image captured by the imaging device 3. However, the method of expressing the position of the light emitting member is not limited to this method.

  In the device information 13a, information indicating the light emission state of the light emitting member when the corresponding device is in at least one operation state is registered. For example, information indicating the light emission state of the light emitting member when the corresponding device is in a normal state is registered in the device information 13a. In the device information 13a, information indicating the light emission states of the light emitting members when the corresponding device is in a plurality of operation states (for example, a normal state and an abnormal state) may be registered.

  The identification unit 11 detects the position of the light emitting member in the captured image and the light emission state of the light emitting member based on the captured image acquired from the imaging device 3. As the light emission state to be detected, for example, when the light emission color of the light emitting member, the light emitting member continues to be lit, blinks, or blinks, the blinking interval is detected.

  In the example of FIG. 1, it is assumed that the specifying unit 11 detects two light emitting members 2 a and 2 b from the captured image 5 obtained by the imaging device 3 capturing the device 2. Then, as shown in Table 6, the specifying unit 11 detects the position of the light emitting member 2a as “x11, y11”, the light emission state as “state # 11”, and the position of the light emitting member 2b as “x12, y12”. It is assumed that the light emission state is detected as “state # 12”.

  The specifying unit 11 compares the detected position and light emission state of the light emitting members 2a and 2b with the device information 13a stored in the storage unit 13, and based on the comparison, the device 2 captured by the imaging device 3 Specify the model. In the example of FIG. 1, the device information 13a includes a light emitting member at a position “x11, y11” and a light emission state “state # 11”, and a light emitting member at a position “x12, y12” and a light emission state “state # 12”. Information of “model # 1” is registered. The information of each light emitting member of “model # 1” matches the detection result of the light emitting members 2a and 2b by the specifying unit 11 shown in Table 6. Therefore, the specifying unit 11 specifies the model of the device 2 captured by the imaging device 3 as “model # 1”.

  The monitoring unit 12 monitors the operating state of the device 2 imaged by the imaging device 3 based on the captured image acquired from the imaging device 3 in accordance with the monitoring condition corresponding to the model specified by the specifying unit 11. Here, the monitoring condition corresponding to the specified model is stored in the storage unit 13. In the example of FIG. 1, the monitoring unit 12 acquires the monitoring condition “condition # 1” corresponding to “model # 1” from the storage unit 13.

  As the monitoring condition “condition # 1”, for example, the light emission states “state # 11” and “state # 12” registered in association with “model # 1” in the device information 13a are read from the storage unit 13 as they are. May be issued. For example, it is assumed that the light emission state when the device is in a normal state is registered in the device information 13a. In this case, the monitoring unit 12 determines that the device 2 is in a normal state while the light emission states of the light emitting members 2a and 2b detected based on the captured images match the “state # 11” and “state # 12”, respectively. It can be determined that

  In addition to the device information 13a, device monitoring conditions may be registered in the storage unit 13 in advance for each model. In this case, the monitoring unit 12 reads out the monitoring conditions corresponding to the model specified by the specifying unit 11 from these monitoring conditions registered in advance, and uses them for the monitoring process.

  According to the first embodiment described above, the monitoring device 10 detects the positions of the light emitting members 2a and 2b and the light emission state thereof based on the captured image 5 acquired from the imaging device 3, and the detection result is the device. By comparing with the information 13a, the model of the imaged device 2 is specified. And the monitoring part 12 monitors operation | movement of the imaged apparatus 2 according to the monitoring conditions corresponding to the specified model. Thereby, the monitoring unit 12 can use the optimum monitoring condition for the device 2 when monitoring the operation of the imaged device 2. As a result, the monitoring unit 12 can accurately monitor the operation of the device 2.

  In addition, since the specifying unit 11 specifies the model of the device 2 based on the captured image 5, it is not necessary for the operator to visually determine the model of the device 2 before monitoring the device 2. Is reduced. In particular, when a large number of devices to be monitored are stored in the storage device 4, if the operator tries to determine the models of all the devices, the operation becomes complicated. On the other hand, the operator's workload can be significantly reduced by the model specifying process by the specifying unit 11.

[Second Embodiment]
FIG. 2 is a diagram illustrating an example of an information processing system according to the second embodiment. The information processing system 20 includes a rack 25, information devices 30a to 30c, imaging devices 40a to 40i, illumination devices 50a and 50b, and a monitoring control device 100. The monitoring control device 100 is connected to the imaging devices 40a to 40i. The monitoring control device 100 is an example of the monitoring device 10 according to the first embodiment.

  The rack 25 is installed in a predetermined place such as a server room, for example. A plurality of information devices are housed in the rack 25 in a detachable state. For example, the height of the information device is defined in units of units (U), and an information device having a height of one unit or a plurality of units can be stored in the rack 25. The information devices 30a to 30c illustrated in FIG. 2 are examples of such information devices.

  Examples of information devices stored in the rack 25 include computers such as servers and various control devices, storage devices including storage media, network devices such as router devices and switching hubs, and the like. Arbitrary information devices stored in the rack 25 are connected to each other by, for example, a cable, a backplane or a midplane stored in the rack 25. One or more LED lamps indicating the operating state of the information device are installed on at least the front panel of the information device stored in the rack 25.

  Inside the open / close door of the rack 25, a plurality of imaging devices and a monitoring control device 100 are installed. The imaging device is capable of imaging the front panel of the information device stored in the rack 25. In the present embodiment, as an example, three imaging devices are installed in units of units, and the imaging devices are arranged so that the entire front panel of the information device corresponding to one unit is captured by the three imaging devices. .

  In the example of FIG. 2, the entire front panel of the information device 30 a is imaged by the imaging devices 40 a to 40 c. In addition, the entire front panel of the information device 30b is imaged by the imaging devices 40d to 40f. Further, the entire panel on the front surface of the information device 30c is imaged by the imaging devices 40g to 40i.

Each imaging apparatus is connected to the monitoring control apparatus 100 and transmits data of the captured image to the monitoring control apparatus 100.
The lighting devices 50 a and 50 b irradiate the front panel of the information equipment stored in the rack 25 with illumination light under the control of the monitoring control device 100. Note that the number of illumination devices is not particularly limited as long as it is possible to irradiate illumination light on the front panels of all information devices that can be stored in the rack 25.

  The monitoring control device 100 determines the position and light emission state of the LED lamp installed on the front panel of the information device housed in the rack 25 based on the image acquired from each imaging device, and based on the determination result, The model of the information device stored in the rack 25 is specified. Then, the monitoring control device 100 monitors the operation state of each information device stored in the rack 25 according to the monitoring condition corresponding to the model of each information device.

  In the following description, in order to simplify the description, the information device to be monitored by the monitoring control apparatus 100 is assumed to be an information device having a height of 1U. In addition, an area in which information devices having a height of 1 U are respectively stored may be referred to as a “slot”.

  In addition, the three imaging devices corresponding to the slots respectively capture images of a part of the front panel of the information device housed in the corresponding slot. The supervisory control device 100 combines images acquired from three imaging devices corresponding to one slot, and generates a combined image in which the entire front panel of the information device stored in the slot is reflected. The monitoring control device 100 expresses the position of the LED lamp of the information device to be monitored using the coordinate information in the generated composite image.

  Note that the monitoring control device 100 may be installed, for example, on the housing surface of the rack 25, the outer surface of the door, the slot in the rack 25, or the like. The monitoring control apparatus 100 may be installed at a remote place and receive an image from the imaging apparatus via a network. In FIG. 2, only the imaging devices 40 a to 40 i corresponding to three slots are shown as an example, but actually, three imaging devices are provided for each slot of the rack 25. Also, the number of imaging devices used for imaging one information device may be two or less, or four or more.

  FIG. 3 is a diagram illustrating a hardware configuration example of the monitoring control device. Note that the imaging devices 40a to 40i illustrated in FIG. 2 each have the same hardware configuration, and thus are represented as “imaging device 40” in FIG. Similarly, since the illumination devices 50a and 50b shown in FIG. 2 have the same hardware configuration, they are represented as “illumination device 50” in FIG. In addition, hereinafter, when the imaging devices 40a to 40i and the illumination devices 50a and 50b are described without being distinguished, the expressions “imaging device 40” and “illumination device 50” are used, respectively.

  The entire monitoring and control apparatus 100 is controlled by the processor 101. A RAM (Random Access Memory) 102 and a plurality of peripheral devices are connected to the processor 101 via a bus 109. The RAM 102 is used as a main storage device of the monitoring control device 100, and temporarily stores at least part of a program to be executed by the processor 101 and various data necessary for processing by this program.

  The processor 101 is connected with an HDD 103, a graphic processing device 104, an input interface 105, a reading device 106, an input / output interface 107, and a communication interface 108 as examples of peripheral devices.

  The HDD 103 is used as a secondary storage device of the monitoring control device 100, and stores programs executed by the processor 101, various data necessary for the execution, and the like. As the secondary storage device, for example, other types of nonvolatile storage devices such as SSD (Solid State Drive) may be used.

  A display device 104 a is connected to the graphic processing device 104. The graphic processing device 104 causes the display device 104a to display an image in accordance with a command from the processor 101. As the display device 104a, a liquid crystal display (LCD), an organic EL (Electro Luminescence) display, or the like can be used.

  An input device 105 a is connected to the input interface 105. The input interface 105 transmits an output signal output by a user input operation to the input device 105a to the processor 101. Examples of the input device 105a include an input operation key and a keyboard.

  The display device 104a and the input device 105a are installed on, for example, the control panel 26 provided in the information processing system 20. The control panel 26 is installed on the outer surface of the open / close door of the rack 25, for example.

  A portable recording medium 106 a is detached from the reading device 106. The reading device 106 reads the data recorded on the portable recording medium 106 a and transmits it to the processor 101. Examples of the portable recording medium 106a include a magnetic disk such as a flexible disk (FD) and an HDD, an optical disk such as a CD (Compact Disc) and a DVD (Digital Versatile Disc), and a magneto-optical disk (MO). ), A memory card with flash memory can be used.

  The input / output interface 107 executes interface processing for transmitting and receiving data between the imaging device 40 and the monitoring control device 100. Further, the input / output interface 107 executes interface processing for transmitting data from the processor 101 to the lighting device 50. The communication interface 108 communicates with other information processing apparatuses via a network such as the network 108a.

  FIG. 4 is a diagram illustrating a function example of the monitoring control device. The monitoring control apparatus 100 includes a monitoring control information storage unit 110, an image acquisition unit 120, a device specifying unit 130, and a device monitoring unit 140. The device specifying unit 130 is an example of the specifying unit 11 according to the first embodiment. The device monitoring unit 140 is an example of the monitoring unit 12 according to the first embodiment. The monitoring control information storage unit 110 can be realized as a storage area secured in the RAM 102 or the HDD 103. The processing of the image acquisition unit 120, the device identification unit 130, and the device monitoring unit 140 is realized, for example, when the processor 101 executes a predetermined program.

  The monitoring control information storage unit 110 stores information on the LED lamps included in the information device, information on the light emission pattern of the LED lamps, and the like for each type of information device. The light emission pattern indicates the light emission state of the LED lamp for each operation state of the information device. For example, it means a combination of the lighting state of the LED lamp such as lighting, blinking or extinguishing, the blinking interval, the emission color of the LED lamp, and the like. In the second embodiment, the emission color of the LED lamp is expressed by hue. Hereinafter, the emission color of the LED lamp may be referred to as “the hue of the LED lamp”. In addition, the monitoring control information storage unit 110 stores in advance information indicating each installation position of the imaging device 40. Information indicating the installation position of the imaging device 40 is stored in association with the identification information of the imaging device 40.

  The image acquisition unit 120 receives some images of any of the information devices stored in the rack 25 from the imaging devices 40a to 40i at regular time intervals. The image acquisition unit 120 synthesizes the received images based on the installation position of the imaging device that is the transmission source of the received image, and generates a composite image that shows the entire front panel of one information device. Specifically, first, the image acquisition unit 120 selects an image received from each imaging device installed at the same height from the received images. Then, the image acquisition unit 120 combines the selected images based on the installation position in the horizontal direction of the transmission source imaging apparatus, and generates a combined image in which the entire front panel of one information device is captured. Hereinafter, the composite image generated in this way may be simply referred to as “an image showing an information device”.

The device specifying unit 130 specifies the model of the information device that appears in the image as follows as preprocessing for monitoring the information device stored in the rack 25 as follows.
First, the device specifying unit 130 uses the image acquisition unit 120 to acquire an image in which an information device is captured for a certain period (for example, 10 minutes) at regular time intervals (for example, every 1/30 seconds). Next, the device specifying unit 130 extracts an image of an area having a higher luminance than the surrounding pixels as an image of the LED lamp from the acquired image of each information device. Next, the device specifying unit 130 determines the light emission pattern of the LED lamp based on the extracted information of the image of each LED lamp. The light emission pattern is specified by the hue of the LED lamp and the lighting state indicating lighting or flashing. The device specifying unit 130 acquires the information about the LED lamps included in the information device, the information about the light emission pattern of the LED lamps, the determined light emission pattern, and the position of the extracted LED lamp image using the image acquisition unit 120. Identify the model of the information device that appears in the image. In addition, the device specifying unit 130 registers an information device whose model is specified as a monitoring target.

In addition, the apparatus specific | specification part 130 irradiates illumination light to the illuminating devices 50a and 50b as needed, when specifying a model.
Thereafter, the device monitoring unit 140 monitors the state of the information device by repeatedly acquiring an image in which the information device is captured and determining the state of the information device as follows. First, the device monitoring unit 140 uses the image acquisition unit 120 to acquire an image in which the information device is captured at regular time intervals for a certain period (for example, 30 seconds). Next, the device monitoring unit 140 determines the light emission pattern of the LED lamp of the information device based on the acquired image information. Then, the device monitoring unit 140 determines whether the state of the information device shown in the image is abnormal based on the determined light emission pattern, and determines that the state of the information device is abnormal, the management of the information processing system 20 The person in charge.

Next, a table used by the monitoring control device 100 will be described with reference to FIGS.
FIG. 5 is a diagram illustrating an example of the LED image information table. The LED image information table 111 temporarily stores information related to the image of the LED lamp extracted from the image obtained by imaging the front panel of the information device. An image on the front panel of the information device is acquired by the image acquisition unit 120. The LED image information table 111 is stored in the monitoring control information storage unit 110. The LED image information table 111 is used by the device specifying unit 130 to specify information devices that appear in the image.

  The LED image information table 111 includes items of slot number, hue, position information, size, monitoring period, number of trials, number of extractions, number of continuous extractions, maximum number of continuous extractions, and number of minimum continuous extractions. In the slot number item, a number for identifying the slot in which the imaged information device is stored is set.

  In the item of hue, information indicating the hue of the extracted LED lamp is set. The hue of the LED lamp is represented by an angle. For example, the hue indicating red is “0 ° (360 °)”, the hue indicating green is “120 °”, and the hue indicating blue is “240 °”.

  In the position information item, information indicating the position of the extracted LED lamp on the image is set. Further, the information indicating the position of the LED lamp is represented by the coordinates of the representative position (for example, the middle point) of the image of the LED lamp on the image of the information device. The coordinates of the representative position are represented by “(position in the X-axis direction, position in the Y-axis direction)”. This coordinate indicates a coordinate in a synthesized image obtained by synthesizing images obtained from three imaging devices corresponding to one slot. Further, the coordinates of the representative position may be expressed by another method such as latitude / longitude in addition to the above-described expression method.

  In the size item, information indicating the size of the extracted LED lamp image is set. The size of the LED lamp image is represented by, for example, the number of pixels having a diameter of the LED lamp image, but is not limited thereto.

  In the monitoring period, information indicating the length of the period during which the device specifying unit 130 acquires the image of the information device is set. In the item of the number of trials, information indicating the number of information device images (composite images) stored in the corresponding slot, which is acquired within the monitoring period of the device specifying unit 130, is set. Since the number of images acquired during the monitoring period for the same slot is the same, the value of the monitoring period is the same and the number of trials is the same for each record corresponding to the same slot.

  In the item of the number of extractions, information indicating the number of extracted corresponding LED lamp images among information device images acquired by the device specifying unit 130 during the monitoring period is set. In the item of the number of times of continuous extraction, information indicating the number of times that the corresponding LED lamp images are continuously extracted is set. The value of the item of the number of continuous extractions is used to calculate the maximum number of continuous extractions and the minimum number of continuous extractions.

  In the item of the maximum number of consecutive extractions, a maximum value of the number of times that the corresponding LED lamp images are continuously extracted within the monitoring period of the device specifying unit 130 is set. In the item of the minimum number of continuous extractions, a minimum value of the number of times that the corresponding LED lamp images are continuously extracted within the monitoring period of the device specifying unit 130 is set. When the corresponding LED lamp image is extracted from all images of the information device acquired by the device specifying unit 130 within the monitoring period, “NULL” is displayed in the items of the maximum continuous extraction count and the minimum continuous extraction count. Is set.

  The shape of the LED lamp may be a rectangle or an ellipse other than a circle. In this case, for example, information indicating the length of each side of the rectangle and information indicating the lengths of the long and short sides of the ellipse are set in the size item. Further, the LED image information table 111 may include an item in which information indicating an image area of the LED lamp is set instead of the position information and the size item.

  FIG. 6 is a diagram illustrating an example of the LED information table. The LED information table 112 stores information on LED lamps included in the information device for each model. The LED information table 112 is stored in the monitoring control information storage unit 110. The LED information table 112 includes items of model name, LED name, LED type, position information, and size.

  In the model name item, information indicating the model name of the information device is set. In the item of LED name, information indicating the name of the LED lamp included in the information device is set. In the LED type item, information indicating the type of the corresponding LED lamp is set. For example, when the corresponding LED lamp indicates the power state of the information device, “power lamp” is set in the item of LED type. When the corresponding LED lamp indicates whether there is an abnormality in the information device, “warning lamp” is set in the item of LED type. Furthermore, when the corresponding LED lamp indicates the state of the communication port provided in the information device, “communication port” is set in the item of LED type.

  In the position information item, information indicating the position of the image of the corresponding LED lamp is set. The position of the LED lamp image is expressed as coordinates in the same coordinate system as the representative position of the LED lamp image described in FIG. In the size item, information indicating the size of the corresponding LED lamp image is set. The size of the image of the LED lamp is represented by the same method as the size of the image of the LED lamp described in FIG.

  FIG. 7 is a diagram illustrating an example of the light emission pattern information table. The light emission pattern information table 113 stores information on the light emission pattern of the LED lamps included in the information device. The light emission pattern is specified by a combination of the hue, lighting state, and blinking interval of the LED lamp. The light emission pattern information table 113 is stored in the monitoring control information storage unit 110. The light emission pattern information table 113 includes items of model name, LED type, state type, lighting state, hue, blinking interval, and abnormal level.

  In the model name item, information indicating the model name of the information device is set. Information indicating the type of the LED lamp included in the corresponding information device is set in the item of LED type. The type of the LED lamp is represented by the same method as the type of the LED lamp described in FIG. In the item of state type, information indicating the operation state of the information device corresponding to the light emission pattern of the LED lamp is set.

  Information indicating the lighting state of the LED lamp corresponding to the state type is set in the lighting state item. For example, in the case of indicating a state where the LED lamp is continuously lit, “lighting” is set in the item of lighting state. Further, when the LED lamp indicates a blinking state, “blinking” is set in the lighting state item. Further, when the LED lamp is turned off, “light off” is set in the lighting state item.

  In the hue item, information indicating the hue of the LED lamp corresponding to the state type is set. The hue of the LED lamp is represented by the same method as the hue of the LED lamp described in FIG. When the lighting state is “off”, “NULL” is set in the hue item.

  Information indicating the blinking interval of the LED lamp when the LED lamp is blinking is set in the item of blinking interval. When the LED lamp blinks at a constant interval, a time indicating the blinking interval is set in the item of blinking interval. When the LED lamp blinks at random intervals, “random” is set in the item of blink interval. When the lighting state of the LED lamp is “lit” or “off”, “NULL” is set in the item of the blinking interval.

  In the item of abnormality level, information indicating the degree of abnormality of the information device corresponding to the state type is set. When indicating that the information device is normal, “NULL” is set in the item of the abnormal level. When there is a possibility that the information device is abnormal, “medium” or “high” is set in the item of abnormality level according to the high possibility that the information device is abnormal.

  FIG. 8 is a diagram illustrating an example of a device information table. The device information table 114 stores information indicating the appearance characteristics of the information device for each model. The device information table 114 is stored in the monitoring control information storage unit 110. The device information table 114 includes items of model name, device type, hue, and saturation.

  In the model name item, information indicating the model name of the information device is set. In the device type item, information indicating the type of function of the corresponding information device is set. Information indicating the hue of the front panel of the corresponding information device is set in the hue item. In the item of saturation, information indicating the saturation of the front panel of the corresponding information device is set.

Information of the LED information table 112, the light emission pattern information table 113, and the device information table 114 shown in FIGS. 6 to 8 is stored in the monitoring control information storage unit 110 in advance.
FIG. 9 is a diagram illustrating an example of the monitoring information table. The monitoring information table 115 temporarily stores information indicating the monitoring result of the information device identified as the monitoring target. The monitoring of the information device is executed by determining the light emission pattern of each LED lamp included in the information device shown in the captured image. The monitoring information table 115 is stored in the monitoring control information storage unit 110. The monitoring information table 115 is used by the device monitoring unit 140 to monitor the state of the information device.

  The monitoring information table 115 includes items of slot number, model name, LED name, hue, monitoring period, number of trials, number of extractions, number of continuous extractions, maximum number of continuous extractions, minimum number of continuous extractions, state, and duration.

  In the slot number item, a number for identifying the slot in which the information device to be monitored is stored is set. In the model name item, information indicating the model name of the information device to be monitored is set. In the LED name item, information indicating the name of the LED lamp included in the corresponding information device is set. In the item of hue, information indicating the hue of the extracted LED lamp is set. The hue of the LED lamp is represented by the same method as the hue of the LED lamp described in FIG.

  In the monitoring period, information indicating the length of the period during which the device monitoring unit 140 acquires the image of the information device is set. In the item of the number of trials, information indicating the number of images of the information device stored in the corresponding slot acquired during the monitoring period of the device monitoring unit 140 is set. As in the case of the LED image information table 111, since the number of images acquired in the monitoring period for the same slot is the same, the value of the monitoring period is the same in each record corresponding to the same slot, and the value of the number of trials. Will be the same.

  In the item of the number of extractions, information indicating the number of images determined to be emitted from the corresponding LED lamp among the information device images acquired by the device monitoring unit 140 during the monitoring period is set. In the item of the number of continuous extractions, information indicating the number of times images are continuously extracted when the corresponding LED lamps emit light within the monitoring period of the device monitoring unit 140 is set. The value of the item of the number of continuous extractions is used to calculate the maximum number of continuous extractions and the minimum number of continuous extractions.

  In the item of the maximum number of consecutive extractions, a maximum value of the number of times that images are continuously extracted when the corresponding LED lamp is emitting within the monitoring period of the device monitoring unit 140 is set. In the item “minimum continuous extraction number”, a minimum value of the number of times the image is continuously extracted when the corresponding LED lamp emits light within the monitoring period of the device monitoring unit 140 is set. In addition, when the image when the corresponding LED lamp emits light is extracted from all the images of the information device acquired by the device monitoring unit 140 within the monitoring period, the maximum continuous extraction count and the minimum continuous extraction count are included in the items. Is set to “NULL”.

  In the status item, information indicating the current operation status of the information device indicated by the corresponding LED lamp is set. Information indicating the time during which the current operation state of the information device indicated by the corresponding LED lamp is continued is set in the item of duration.

Next, processing executed by the monitoring control apparatus 100 will be described using flowcharts with reference to FIGS.
FIG. 10 is a flowchart illustrating an example of processing for specifying the model of the information device. The process of FIGS. 10 to 12 is executed as a pre-process of the process of monitoring the information equipment stored in the rack 25. 10 to 12 are executed in the rack 25 for each slot in which the information device is stored. Hereinafter, the processing illustrated in FIGS. 10 to 12 will be described in order of step number.

  (S11) The device identification unit 130 acquires the image of the information device stored in the corresponding slot through the image acquisition unit 120 for a certain period (for example, 10 minutes) at regular time intervals (for example, every 1/30 seconds). To do. The device specifying unit 130 controls the illumination device 50 not to emit illumination light while acquiring these images.

(S12) The device identification unit 130 selects one image of the information device acquired in step S11 in the order of acquisition.
(S13) The device identification unit 130 extracts an image of a region having a higher brightness than the surrounding pixels from the information device image selected in step S12 as an LED lamp image. For example, the device specifying unit 130 binarizes the image of the selected information device into an area where the luminance is greater than or equal to a predetermined value and an area where the luminance is less than the predetermined value, and the image of the area classified as greater than or equal to the predetermined value is converted into an LED lamp. Extracted as an image.

(S14) The device specifying unit 130 determines the hue of the LED lamp image for each extracted LED lamp image.
As an example of determining the hue of the LED lamp image, the following equation (1) can be used.

  Here, R, G, and B indicate the average value of the red component of each pixel, the average value of the green component of each pixel, and the average value of the blue component of each pixel in the image of the LED lamp. H indicates the hue of the image of the LED lamp.

  Moreover, the apparatus specific | specification part 130 determines the position and magnitude | size of the image of the said LED lamp in the image acquired by step S11 for every image of LED lamp extracted by step S13.

  (S15) The device specifying unit 130 registers or updates the LED image information table 111 based on the hue, position, and size of the image of each LED lamp determined in step S14.

  Specifically, the device specifying unit 130 determines whether a record including the slot number to be processed and the hue, position, and size of any LED lamp determined in step S14 exists in the LED image information table 111. . Note that a record including a hue whose error from the hue determined in step S14 is within a predetermined range (for example, “−15 ° to 15 °”) may be a search target. In addition, a record including position information in which an error of each coordinate indicating the position determined in step S14 is within a predetermined range (for example, “−2 to 2”) may be a search target.

  When the corresponding record does not exist in the LED image information table 111 for the LED lamp image extracted in step S <b> 13, the device specifying unit 130 registers the LED lamp image information in the LED image information table 111. At this time, the slot number to be processed is set in the slot number item, and the hue of the image of the LED lamp determined in step S14 is set in the hue item. The position of the LED lamp image determined in step S14 is set in the position information item, and the size of the LED lamp image determined in step S14 is set in the size item. In addition, information indicating the period during which the information device image is acquired in step S11 is set in the monitor period item, and information indicating the number of information device images acquired in step S11 is set in the trial number item. Is done. In addition, “1” is set in each of the item of the number of extractions and the item of the number of continuous extractions. “NULL” is set in each of the maximum continuous extraction count item and the minimum continuous extraction count item.

  On the other hand, when the corresponding record exists in the LED image information table 111 for the LED lamp image extracted in step S13, the device specifying unit 130 sets the value of the number of extractions included in the corresponding record and the number of continuous extractions. Increment the value of the item by “1”.

  Furthermore, the device specifying unit 130 searches the LED image information table 111 for a record that does not include the hue, position, and size of any LED lamp image determined in step S14 from the record that includes the slot number to be processed. . The LED lamp image corresponding to this record indicates an image that has been extracted from the past image but not extracted from the current image to be processed. The device specifying unit 130 updates the items of the maximum continuous extraction count, the minimum continuous extraction count, and the continuous extraction count for each retrieved record as follows.

  First, when the value of the item of continuous extraction is larger than the value of the item of maximum continuous extraction, the item of maximum continuous extraction is updated with the value of the item of continuous extraction. On the other hand, when the value of the item of continuous extraction is smaller than the value of the item of minimum continuous extraction, the item of minimum continuous extraction is updated with the value of the item of continuous extraction. Thereafter, the value of the item of the number of continuous extractions is reset to “0”.

  The update of the items of the maximum continuous extraction count, the minimum continuous extraction count, and the continuous extraction count is such that the LED lamp image corresponding to the searched record is extracted from the image selected in the previous step S12. It may be done only if

  (S16) The device identification unit 130 determines whether all images of the information device acquired in step S11 have been selected. If all the images of the information device have been selected, the process proceeds to step S21. If there is an image of an information device that has not been selected, the process proceeds to step S12.

FIG. 11 is a flowchart (continuation) illustrating an example of processing for specifying the model of the information device.
(S21) The device identification unit 130 selects one record including the slot number to be processed from the LED image information table 111.

  (S22) The device identification unit 130 selects a record corresponding to one model name and one LED name from the LED information table 112. In addition, the device specifying unit 130 selects a record corresponding to the same model name and the LED type corresponding to the LED name from the light emission pattern information table 113.

  (S23) The device identification unit 130 determines whether both the position information and the size included in the record selected in step S21 match the position information and the size included in the record selected from the LED information table 112 in step S22. To do. In addition, when the error of each coordinate included in each position information is within a predetermined range (for example, “−2 to 2”), it may be determined that the position information matches.

  If it is determined that both the position information and the size included in the record selected in step S21 match the position information and the size included in the record selected from the LED information table 112 in step S22, the process proceeds to step S24. If it is determined that at least one of the position information and size included in the record selected in step S21 does not match the position information and size included in the record selected from the LED information table 112 in step S22, the process proceeds to step S41. Proceed.

  (S24) The device identification unit 130 determines whether the hue included in the record selected in step S21 matches any of the hues of the LED lamps included in the record selected from the light emission pattern information table 113 in step S22. In addition, when the error of each hue is within a predetermined range (for example, “−15 ° to 15 °”), it may be determined that the hues match.

  If it is determined that the hue included in the record selected in step S21 matches one of the hues of the LED lamps included in the record selected from the light emission pattern information table 113 in step S22, the process proceeds to step S25. If it is determined that the hue included in the record selected in step S21 does not match any of the hues of the LED lamps included in the record selected from the light emission pattern information table 113 in step S22, the process proceeds to step S41.

  (S25) The device identification unit 130 determines the lighting state of the LED lamp indicated by the record selected in step S21. Specifically, when the number of trials included in the record selected in step S21 matches the number of extractions, the device identification unit 130 determines that the lighting state of the LED lamp indicated by the record selected in step S21 is “lit”. To do. In addition, when the number of trials included in the record selected in step S21 does not match the number of extractions and the number of extractions is “1” or more, the device identification unit 130 indicates the LED lamp indicated by the record selected in step S21. The lighting state is determined as “flashing”.

  (S26) The device identification unit 130 associates the lighting state determined in step S25 with the hue determined to be included in the record selected from the light emission pattern information table 113 in step S22 and matched in step S24. It is determined whether it matches the lighting state. If it is determined that the lighting state determined in step S25 matches the above condition and “matches”, the process proceeds to step S27. If it is determined that the lighting state does not match the above condition and “does not match”, the process proceeds to step S41.

  Next, when the lighting state at the time of matching is “flashing”, the device specifying unit 130 executes steps S27 to S28 to determine whether or not the flashing intervals match. If the lighting state at the time of coincidence is “lighting”, the process proceeds to step S29 without executing steps S27 to S28.

(S27) The device specifying unit 130 determines the blinking interval of the LED lamp indicated by the record selected in step S21.
Here, when the LED lamp is blinking at a constant interval, the difference between the maximum continuous extraction number and the minimum continuous extraction number is small, while when the LED lamp is blinking at random intervals, the maximum continuous The difference between the number of extractions and the minimum number of continuous extractions becomes large.

  Therefore, when the maximum number of consecutive extractions in the record selected in step S21 is somewhat larger than the minimum number of consecutive extractions, the device identification unit 130 determines that the LED lamp blinking interval indicated by the record selected in step S21 is “random”. . Whether the maximum number of continuous extractions is somewhat larger than the minimum number of continuous extractions can be determined, for example, by satisfying the condition of “(maximum number of continuous extractions / minimum number of continuous extractions)> 2”, but is limited to the above determination method. It is not a thing. In addition, the blinking interval that is “random” means a state in which the LED lamps are blinking at random intervals.

  In addition, when the blinking interval of the LED lamp is other than “random” (that is, a constant interval), the device specifying unit 130 determines the range of the blinking interval of the LED lamp as follows. Specifically, the device identification unit 130 determines “monitor period / number of trials × minimum number of consecutive extractions × α” in the record selected in step S21 as the lower limit value of the blinking interval of the LED lamps. On the other hand, the device identification unit 130 determines “monitor period / number of trials × maximum number of consecutive extractions × β” in the record selected in step S21 as the upper limit value of the LED lamp blinking interval range. Here, α and β are correction values for limiting the range of the blinking interval to some extent, α is a value larger than 1 (for example, “1.2”), and β is a value larger than 0 and smaller than 1 ( For example, “0.8”). At this time, the values of α and β are set so that the lower limit value does not exceed the upper limit value. Α and β may be set dynamically based on the maximum number of consecutive extractions and the minimum number of consecutive extractions, or may be preset values.

  (S28) The device specifying unit 130 corresponds to the blinking interval of the LED lamp determined in step S27 and the hue included in the record selected from the light emission pattern information table 113 in step S22 and determined to match in step S24. It is determined whether the assigned blinking interval matches.

  Specifically, when the blinking interval is determined to be “random” in step S27, the device specifying unit 130 determines that the blinking interval extracted from the light emission pattern information table 113 as described above is “random”. In S28, “match” is determined. When it is determined in step S27 that the blinking interval is other than “random”, the device identifying unit 130 determines that the blinking interval extracted from the light emission pattern information table 113 as described above is the range of the blinking interval determined in step S27. If it is within the range, it is determined as “match” in step S28. If these conditions are not met, it is determined in step S28 that they do not match.

If it is determined as “match” in step S28, the process proceeds to step S29. If it is determined in step S28 that they do not match, the process proceeds to step S41.
(S29) The device identification unit 130 counts up the number of matches corresponding to the record in the LED information table 112 selected in step S22. Information indicating the number of matches for each record in the LED information table 112 is temporarily stored, for example, in a storage area in the monitoring control information storage unit 110.

FIG. 12 is a flowchart (continuation 2) illustrating an example of processing for specifying the model of the information device.
(S41) The device identification unit 130 determines whether all records in the LED information table 112 have been selected in step S22 of FIG. If all the records in the LED information table 112 have been selected, the process proceeds to step S42. If there is an unselected record, the process proceeds to step S22 in FIG.

  (S42) The device identifying unit 130 determines whether all records including the slot number to be processed are selected from the records in the LED image information table 111 in step S21 of FIG. If all the records in the LED image information table 111 have been selected, the process proceeds to step S43. If there is an unselected record, the process proceeds to step S21 in FIG.

  (S43) In the LED information table 112, the device specifying unit 130 sums up the number of matches set in step S29 of FIG. 11 corresponding to each record including the same model name. Then, the device identification unit 130 identifies the model having the maximum total number of matches as the model of the information device to be monitored.

  (S44) The device specifying unit 130 determines whether a plurality of models are specified in the process of step S43. If a plurality of models are specified, the process proceeds to step S45. If only one model is specified, the process proceeds to step S48.

  (S45) The device identifying unit 130 causes the illumination device 50 to emit illumination light, and in that state, causes the imaging device 40 that captures the corresponding slot to capture an image and obtains an image from the imaging device 40.

  (S46) The device identification unit 130 analyzes the image acquired in step S45, and determines the appearance characteristics of the information device that appears in the image. The appearance characteristics of the information device are specified by the hue and saturation of the front panel of the information device. For the hue of the front panel, the average value of the red component, the average value of the green component, and the average value of the blue component of each pixel of the entire image acquired in step S45 are obtained with respect to R, G, and B in the above formula (1). It can be calculated by substituting. Further, the saturation of the information device can be calculated by averaging the saturation of each pixel of the entire image acquired in step S45.

  Here, in step S46, the hue and saturation of the front panel can be accurately calculated by using the image captured in the state in which the monitoring target information device is irradiated with illumination light in step S45. On the other hand, the image acquired in step S11 in FIG. 10 is desirably an image captured without illuminating illumination light. This is because, by not irradiating illumination light, the contrast between the image area where the LED lamp is present and the other image area is increased, and as a result, the image area and hue of the LED lamp are highly accurate in step S13 and step S14. It is because it can be judged.

  Note that the device identification unit 130 may calculate the hue as described above based on an image of an area estimated to include the front panel of the information device among the images acquired in step S45. The area of the front panel in the acquired image can be obtained in advance, for example, from the relative positional relationship of the imaging device 40 with respect to the corresponding slot.

  (S47) The device specifying unit 130 selects an information device whose appearance matches the model registered in the device information table 114 from among the plurality of models specified in step S43. Specifically, the device specifying unit 130 extracts a record including each of the models specified in step S43 from the device information table 114. The device specifying unit 130 selects a record including the hue and saturation determined in step S46 from the extracted records, and specifies the model corresponding to the selected record as the model of the information device to be monitored.

  Note that a record in which a hue whose error from the hue determined in step S46 is within a predetermined range (for example, “−15 ° to 15 °”) is determined to include the hue determined in step S46. May be. In addition, regarding the record in which the saturation with which the error from the saturation determined in step S46 is within a predetermined range (for example, “−5 to 5”), the saturation determined in step S46 is included. You may judge.

  In steps S45 to S47 described above, the hue of the front panel of the information device is detected as a feature of the appearance of the information device. However, as a feature of the appearance of the information device, for example, a logo indicating the model name of the information device or the like stamped on the front panel of the information device may be detected. In this case, for example, the device specifying unit 130 can detect the content of the logo and its position from the acquired image and specify the model from the detection result. The model may be specified using both the content and position of the logo and the hue of the front panel.

  (S48) The device specifying unit 130 registers information on each LED lamp included in the model specified in step S43 or step S47 in the monitoring information table 115. Specifically, first, the device specifying unit 130 selects a record including the model name specified above from the LED information table 112. Next, the device identification unit 130 registers a record in the monitoring information table 115 based on the record selected from the LED information table 112.

  At this time, the slot number included in the record of the LED image information table 111 selected in step S21 in FIG. In addition, the model name included in the record selected from the LED information table 112 is set in the model name item, and the LED lamp name (LED) included in the record selected from the LED information table 112 is set in the LED name item. Name) is set. Other items are initialized in step S60 of FIG.

  Note that if any of the total number of matches calculated in step S43 is less than a predetermined value, it may be determined that the model of the information device shown in the image cannot be specified. In this case, for example, an administrator of the information processing system 20 visually identifies the model of the information device that appears in the image. Then, the administrator of the information processing system 20 registers information regarding the identified model in the monitoring information table 115 by an input operation.

  FIG. 13 is a flowchart illustrating an example of processing for monitoring an information device. The processes of FIGS. 13 to 14 are executed after the information device to be monitored is specified by the processes of FIGS. The process of FIGS. 13 to 14 is executed for each slot in which information equipment is stored in the rack 25. Hereinafter, the processes illustrated in FIGS. 13 to 14 will be described in order of step number.

  (S60) The device monitoring unit 140 initializes each record of the monitoring information table 115 registered in step S48 of FIG. Specifically, the device monitoring unit 140 sets “0” in the item of the monitoring period, the number of trials, and the number of consecutive extractions included in each record registered in step S48. In addition, the device monitoring unit 140 sets “NULL” in the hue item, the maximum continuous extraction number item, the minimum continuous extraction number item, and the state item included in each record registered in step S48.

  (S61) The device monitoring unit 140 transmits the image of the information device stored in the corresponding slot through the image acquisition unit 120 at a certain time interval (for example, every 1/30 seconds) for a certain period (for example, 30 seconds). get.

  (S62) The device monitoring unit 140 selects one record from the monitoring information table 115. As a result, one of the LED lamps included in the information device to be monitored is selected. At this time, the device monitoring unit 140 updates the number of trials to the number of images acquired in step S61 in the selected record. In addition, the device monitoring unit 140 updates the monitoring period during the certain period.

(S63) The device monitoring unit 140 selects one image of the information device acquired in step S61 in the order of acquisition.
(S64) The device monitoring unit 140 determines whether the brightness of the image of the LED lamp indicated by the record selected in step S62 is equal to or higher than a predetermined value as follows.

  First, the device monitoring unit 140 acquires the position information and the size of the LED lamp indicated by the record selected in step S62. Specifically, the device monitoring unit 140 searches the LED information table 112 for a record including the LED name included in the record selected in step S62, and refers to the position information and size included in the searched record.

  Next, the device monitoring unit 140 extracts an image of an area specified by the acquired position information and size from the image selected in step S63, and determines the luminance of the extracted image. The brightness of the image is obtained by averaging the brightness of each pixel in the extracted image. And the equipment monitoring part 140 determines whether the acquired brightness | luminance is more than predetermined value.

If the brightness of the LED lamp image is greater than or equal to the predetermined value, the process proceeds to step S66. If the luminance of the image of the LED lamp is less than the predetermined value, the process proceeds to step S65.
(S65) In the record selected in step S62, when the value of the item of continuous extraction is larger than the value of the item of maximum continuous extraction, the device monitoring unit 140 sets the item of maximum continuous extraction as the number of continuous extractions. Update with the value of the item. In addition, when the value of the item of continuous extraction count is smaller than the value of the item of minimum continuous extraction count, the device monitoring unit 140 updates the item of minimum continuous extraction count with the value of the item of continuous extraction count. Furthermore, the device monitoring unit 140 resets the item of the number of continuous extractions to “0”.

  The process in step S65 described above may be performed only when it is determined from the image selected in the previous step S63 that the luminance of the LED lamp region corresponding to the record is equal to or higher than a predetermined value.

  (S66) The device monitoring unit 140 determines the hue of the LED lamp image indicated by the record selected in step S62. The image of the LED lamp can be acquired by the method described in step S13 of FIG. The hue can be determined by the method described in step S14 in FIG. Then, the device monitoring unit 140 updates the hue included in the record selected in step S62 with the hue determined above.

In addition, the device monitoring unit 140 increments the value of the extraction count item included in the record selected in step S62 by “1”.
(S67) The device monitoring unit 140 determines whether all images of the information device have been selected in step S63. If all the images of the information device have been selected, the process proceeds to step S81. If there is an image of an information device that has not been selected, the process proceeds to step S63.

FIG. 14 is a flowchart (continuation) illustrating an example of processing for monitoring an information device.
(S81) The device monitoring unit 140 determines the lighting state of the LED lamp indicated by the record selected in step S62 of FIG. The lighting state of the LED lamp can be determined as “lighting” or “flashing” by the method described in step S25 of FIG. Furthermore, when the number of extractions included in the record selected in step S62 in FIG. 13 is “0”, the lighting state of the LED lamp indicated by the record selected in step S62 is determined to be “off”.

  In addition, when the device monitoring unit 140 determines that the lighting state is “flashing”, the device monitoring unit 140 determines the flashing interval of the LED lamp indicated by the record selected in step S62 of FIG. The blinking interval of the LED lamp is determined by the method described in step S27 of FIG.

  (S82) The device monitoring unit 140 determines the state of the information device indicated by the LED lamp indicated by the record selected in step S62 of FIG. The state of the information device indicated by the LED lamp is determined based on the hue of the LED lamp determined in step S66 of FIG. 13 and the lighting state and blinking interval of the LED lamp determined in step S81.

  Specifically, the device monitoring unit 140 first searches the LED information table 112 for a record including the model name and LED name included in the record selected in step S62 in FIG. Next, the device monitoring unit 140 searches the light emission pattern information table 113 for a record including the LED type included in the searched record. Next, the device monitoring unit 140 searches the record retrieved from the light emission pattern information table 113 for a record including the LED lamp hue, LED lamp lighting state, and LED lamp blinking interval determined above. Then, the device monitoring unit 140 determines the state type included in the searched record as the state of the information device indicated by the LED lamp.

  (S83) The device monitoring unit 140 determines whether the state (that is, the state of the information device indicated by the LED lamp) included in the record selected in step S62 of FIG. 13 has changed. Specifically, the device monitoring unit 140 determines whether the state included in the record selected in step S62 in FIG. 13 matches the state of the information device indicated by the LED lamp determined in step S82. If there is a change in the state included in the record selected in step S62 of FIG. 13, the duration of the record selected in step S62 of FIG. 13 is updated with “0”, and the process proceeds to step S85. If there is no change in the state of the information device indicated by the LED lamp, the fixed period (for example, 30 seconds) described in FIG. 13 is added to the duration of the record selected in step S62 in FIG. 13, and the process proceeds to step S84. Proceed.

  (S84) The device monitoring unit 140 determines whether all records have been selected from the monitoring information table 115 in step S62 of FIG. If all records have been selected from the monitoring information table 115, the process proceeds to step S60 in FIG. If there is an unselected record, the process proceeds to step S62 in FIG.

(S85) The device monitoring unit 140 updates the state included in the record selected in step S62 of FIG. 13 with the state of the information device indicated by the LED lamp determined in step S82.
(S86) The device monitoring unit 140 determines whether the state of the information device indicated by the LED lamp updated in step S85 requires a warning. That is, the device monitoring unit 140 determines whether the abnormality level of the information device indicated by the changed state is other than “NULL”. The abnormal level indicated by the changed state can be acquired by referring to the abnormal level included in the record retrieved from the light emission pattern information table 113 in step S82.

  When the abnormality level of the information device indicated by the state after the change is other than “NULL” (a warning is required), the process proceeds to step S87. If the abnormality level of the information device indicated by the state after the change is “NULL” (no warning is required), the process proceeds to step S84.

  (S87) The device monitoring unit 140 notifies the administrator of the information processing system 20 of warning information. An example of a method for notifying warning information is a method of sending an e-mail to an administrator. Or you may notify by sounding an alarm instead of notifying warning information.

  In step S81, in addition to the case where the LED lamp is blinking, the lighting state may be determined to be “flashing” even when the LED lamp is switched from the off state to the on state within a certain period. is there. Alternatively, the lighting state may be determined to be “flashing” even when the LED lamp is switched from the lit state to the unlit state within a certain period. Therefore, if the device monitoring unit 140 determines in step S83 that the state has been updated to “flashing”, the device monitoring unit 140 suspends execution of the processing in steps S85 to S87, and then advances the processing to step S84. Then, in the next fixed period, when it is determined that the lighting state is “flashing” again in step S83 executed for the same LED lamp, the processing in steps S85 to S87 may be executed.

  According to the second embodiment, the device specifying unit 130 analyzes the characteristics of the LED lamp included in the information device based on the image captured by the information device, and the model of the information device captured in the image based on the analysis result. Is identified. Thus, by analyzing the image captured by the information device, the model of the information device automatically captured in the image can be specified. Then, the device monitoring unit 140 monitors the operation state of the information device appearing in the image according to the monitoring condition corresponding to the specified model. As a result, the information device can be accurately monitored using the correct monitoring conditions.

  Further, by specifying the model based on the image of the information device, the operator can omit the model specifying operation and the monitoring condition setting operation corresponding to the model, thereby reducing the work load. In particular, since various information devices from various manufacturers can be stored in the rack 25, when an operator performs a task of specifying the model of the stored information device and setting monitoring conditions, the work load is large. According to the second embodiment, the work load on the operator can be significantly reduced.

  Further, the LED lamp emitting light is also reflected in an image captured in a state where the rack 25 is closed and the rack 25 is not irradiated with light. For this reason, by analyzing the light emission position and light emission state of the LED lamp, it is possible to specify the information device regardless of the brightness around the imaging device.

  In addition, when a plurality of information devices are specified, the information device that appears in the image is specified based on the appearance characteristics of the information device. Thereby, even if there is an information device including an LED lamp that emits light with the same light emission pattern, the model of the information device that appears in the image can be specified.

[Third Embodiment]
In the second embodiment, the front panel of the information device stored in one slot is imaged from the front by the imaging device, and the model of the information device is specified using the obtained image. On the other hand, in the third embodiment, the front panel of the information device in which one slot is accommodated is imaged by a plurality of imaging devices having different imaging directions, and images obtained from the plurality of imaging devices are captured. The second embodiment is modified so as to specify the model of the information device.

  FIG. 15 is a diagram illustrating an arrangement example of the imaging devices. Here, as an example, an example is shown in which the front panel of the information device 31 housed in one slot is imaged by the two left and right imaging devices 41a and 41b. The imaging devices 41a and 41b are attached to a rack frame 25a, for example.

  Further, on the front panel of the information device 31, for example, communication terminals 32a and 32b and LED lamps 33a and 33b are arranged. A communication cable can be inserted into each of the communication terminals 32a and 32b. For example, the LED lamp 33a indicates an operation state of communication through the communication terminal 32a, and the LED lamp 33b indicates an operation state of communication through the communication terminal 32b, for example.

  When a communication cable is connected to the communication terminal, the communication cable protrudes from the front panel surface. For this reason, if only the front panel is imaged from one direction, the LED lamp arranged on the front panel may be hidden behind the communication cable, and the LED lamp may not be captured in the captured image. On the other hand, as shown in FIG. 15, by imaging the front panel from a plurality of directions, even when the communication cable is connected, the LED lamp arranged on the front panel captures images from any direction. The possibility of appearing in the image increases.

Hereinafter, the monitoring control apparatus of the third embodiment will be described using the same reference numerals for the same components as those of the second embodiment.
FIG. 16 is a diagram illustrating an example of an LED image information table used in the third embodiment. In the LED image information table 111a, an image type column is added to the LED image information table 111 shown in FIG. In the image type column, information indicating whether the corresponding LED lamp is detected from the left or right imaging device is registered. When the corresponding LED lamp is detected from both the left and right imaging devices, “left” is registered in the image type column.

  FIG. 17 is a flowchart illustrating an example of processing for specifying the model of an information device. In the third embodiment, the process shown in FIG. 10 is modified as shown in FIG. That is, steps S11 and S16 in FIG. 10 are changed to steps S11a and S16a in FIG. 17, and steps S12 to S15 in FIG. 10 are changed to S101 to S106 in FIG.

  (S11a) The device identification unit 130 sends the image device pair stored in the corresponding slot through the image acquisition unit 120 from the left and right imaging devices at regular time intervals (for example, every 1/30 seconds). Acquired for a certain period (for example, 10 minutes).

(S101) The device specifying unit 130 selects an image of an information device acquired from the left imaging device from among image pairs acquired at the same timing.
(S102) The device specifying unit 130 uses an image of the information device selected in step S101 as an LED lamp image from the information device image selected in step S101 in the same procedure as step S13 in FIG. Extract. Then, the hue of the LED lamp image is determined for each extracted LED lamp image in the same procedure as in step S14 of FIG.

  Further, the device specifying unit 130 determines the position and size of the LED lamp image for each extracted LED lamp image. Here, when the imaging device on the left does not capture the information device from the front of the front panel, the coordinate system on the captured image is the coordinate system of the image when the front panel is captured from the front, that is, LED information. This is different from the coordinate system corresponding to the position information of the table 112. Therefore, the device specifying unit 130 changes the position and size of the LED lamp image extracted from the image acquired from the left imaging device to the position and size in the coordinate system corresponding to the position information in the LED information table 112. Convert. This conversion is realized, for example, by converting the coordinate value of the pixel in the acquired image using a projective conversion formula. The expression for projective transformation is uniquely determined by, for example, the relative position and imaging direction of the left imaging device with respect to the front panel.

  (S103) The device specifying unit 130 registers in the LED image information table 111a based on the hue, position, and size of the image of each LED lamp determined in step S102 by the same method as in step S15 in FIG. Or update. At this time, the device specifying unit 130 registers “left” in the image type column of the record in which information is registered or updated.

(S104) The device identification unit 130 selects the image of the information device acquired from the right imaging device corresponding to the image selected in step S101.
(S105) In the same procedure as step S13 in FIG. 10, the device specifying unit 130 uses an image of the information device selected in step S104 as an image of the LED lamp from the image of the region having higher brightness than the surrounding pixels. Extract. Then, the hue of the LED lamp image is determined for each extracted LED lamp image in the same procedure as in step S14 of FIG.

  Further, the device specifying unit 130 determines the position and size of the LED lamp image for each extracted LED lamp image. At this time, the device specifying unit 130 uses the projection conversion formula to calculate the position and size of the image of the LED lamp from the value of the coordinate system in the image acquired from the right imaging device, and the position information of the LED information table 112. Convert to the value of the coordinate system corresponding to. The projection conversion formula at this time is also uniquely determined by, for example, the relative position and imaging direction of the right imaging device with respect to the front panel.

  (S106) Based on the hue, position, and size of the image of each LED lamp determined in step S105, the device identification unit 130 registers in the LED image information table 111a using the same method as in step S15 in FIG. Or update. However, the device specifying unit 130 determines that the LED image information table 111a includes a record including information on LED lamps having the same hue, position, and size among the LED lamp information determined in step S105. Information registration or update to the image information table 111a is not performed. In other words, the device specifying unit 130 inputs information obtained by logically summing the information of the LED lamp detected from the left captured image and the information of the LED lamp detected from the right captured image to the LED image information table 111a. Subject to registration or renewal.

  Further, when registering or updating the LED image information table 111a using the LED lamp image information determined in step S105, the device specifying unit 130 sets “right” in the image type column of the corresponding record. sign up.

  (S16a) The device identification unit 130 determines whether all image pairs of the information device acquired in step S11a have been selected. If all image pairs of the information device have been selected, the process proceeds to step S21. If there is an image pair of an information device that has not been selected, the process proceeds to step S101.

  Through the processing in FIG. 17 described above, the device specifying unit 130 can specify the hue, position, and size of the image of the LED lamp based on images acquired from a plurality of imaging devices having different imaging directions. Thereby, there is a high possibility that the hue, position, and size of the image of the LED lamp can be accurately specified, and as a result, the specification accuracy of the model of the imaged information device is improved.

  Information registered in the image type of the LED image information table 111a is also added to the monitoring information table 115 shown in FIG. The information device monitoring process shown in FIG. 13 is modified as follows.

  In step S61, the device monitoring unit 140 acquires images of information devices stored in the corresponding slots from the left and right imaging devices for a certain period of time at regular time intervals. In step S63, the device monitoring unit 140 refers to the image type column of the corresponding record in the monitoring information table 115. If “left” is registered in the image type column, the image acquired from the left imaging device is selected. If “right” is registered in the image type column, the image is acquired from the right imaging device. Select the selected image. In steps S <b> 64 and S <b> 66, the device monitoring unit 140 converts the acquired image coordinate system into a coordinate system value corresponding to the position information in the LED information table 112 and uses it. Alternatively, the device monitoring unit 140 may use the position information in the LED information table 112 by converting it into a coordinate system value of the acquired image. The latter conversion process can be executed by performing an inverse conversion of the projective conversion in step S102 or step S105 of FIG.

  As described above, the information processing of the first embodiment can be realized by causing the monitoring device 10 to execute a program, and the information processing of the second and third embodiments is performed by the monitoring control device 100. This can be realized by executing the program. Such a program can be recorded on a computer-readable recording medium (for example, portable recording medium 106a). As the recording medium, for example, a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like can be used. Magnetic disks include FD and HDD. Optical discs include CD, CD-R (Recordable) / RW (Rewritable), DVD, and DVD-R / RW.

  When distributing the program, for example, a portable recording medium in which the program is recorded is provided. It is also possible to store the program in a storage device of another computer and distribute the program via the network 108a. The computer stores, for example, a program recorded on a portable recording medium or a program received from another computer in a storage device (for example, HDD 103), and reads and executes the program from the storage device. However, a program read from a portable recording medium may be directly executed, or a program received from another computer via the network 108a may be directly executed. In addition, at least a part of the information processing described above can be realized by an electronic circuit such as a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), or a PLD (Programmable Logic Device).

DESCRIPTION OF SYMBOLS 1 Monitoring system 2 Equipment 2a, 2b Light emitting member 3 Imaging device 4 Storage device 5 Captured image 6 Table 10 Monitoring device 11 Identification | specification part 12 Monitoring part 13 Storage | storage part 13a Equipment information

Claims (8)

On the computer,
Based on the captured image acquired from the imaging device, the position of the light emitting member in the captured image and the light emission state of the light emitting member are detected,
The information which identifies the position of the light emission member with which the corresponding apparatus with respect to the at least 1 apparatus memorize | stored in the memory | storage part and the light emission state of the said light emission member when the said apparatus is in an at least 1 operation state is included Based on the comparison between the device information and the detected position of the light emitting member and the light emitting state of the light emitting member, the model of the device imaged by the imaging device is identified,
Monitoring the operating state of the imaged device based on the captured image acquired from the imaging device according to the monitoring condition corresponding to the identified model stored in the storage unit;
A monitoring program for executing a process. In the device information, information indicating the color of the housing surface on which the light emitting member is arranged is registered for each model,
In the detection of the position of the light emitting member and the light emitting state of the light emitting member in the acquired captured image, the color of the housing surface of the imaged device is further detected,
In the specification of the model of the imaged device, based on the comparison result between the device information, the detected position of the light emitting member, the light emission state of the light emitting member, and the color of the housing surface of the imaged device, Identify the model of the imaged device,
The monitoring program according to claim 1.   In the determination of the color of the housing surface of the imaged device, the illumination device emits illumination light, and the imaged device is captured based on a captured image captured by the imaging device in a state where the illumination light is emitted. The monitoring program according to claim 2, wherein the color of the housing surface is detected. One housing surface of one device is imaged from different directions by a plurality of imaging devices,
In the detection of the position of the light emitting member and the light emitting state of the light emitting member in the acquired captured image, the position of the light emitting member and the light emitting state of the light emitting member are based on the plurality of captured images acquired from each of the plurality of imaging devices. Detect,
The monitoring program according to any one of claims 1 to 3.   In the detection of the position of the light emitting member and the light emitting state of the light emitting member in the acquired captured image, when the light emitting member is detected from a similar position in all the images among a plurality of images acquired from the imaging device for a certain period of time. The light emission state of the light emitting member is determined to be lighted, and when the light emitting member is detected from a similar position in some images, the light emitting state of the light emitting member is determined to be blinking. The monitoring program according to any one of 1 to 4.   In the detection of the position of the light emitting member and the light emitting state of the light emitting member in the acquired captured image, the light emitting member is continuously generated from similar positions on the acquired image based on a plurality of images acquired from the imaging device for a certain period. The number of detected images is recorded, and based on the maximum and minimum values of the number of images, it is determined whether the light emitting member is blinking at a constant interval or at random intervals. The monitoring program according to claim 5. A storage device for storing a plurality of devices in a removable state; and
An imaging device for imaging the device stored in the storage device;
A monitoring device for monitoring the operating state of the equipment stored in the storage device;
Have
The monitoring device
A storage unit;
Based on the captured image acquired from the imaging device, the position of the light emitting member and the light emitting state of the light emitting member in the captured image are detected, and the corresponding device for at least one device stored in the storage unit Device information including information specifying the position of the light-emitting member included in the light-emitting member and the light-emitting state of the light-emitting member when the device is in at least one operation state, the detected position of the light-emitting member, and the light emission of the light-emitting member Based on the comparison with the state, a specifying unit that specifies the model of the device imaged by the imaging device;
A monitoring unit that monitors an operation state of the imaged device based on a captured image acquired from the imaging device according to a monitoring condition corresponding to the specified model stored in the storage unit;
A monitoring system comprising: Computer
Based on the captured image acquired from the imaging device, the position of the light emitting member in the captured image and the light emission state of the light emitting member are detected,
The information which identifies the position of the light emission member with which the corresponding apparatus with respect to the at least 1 apparatus memorize | stored in the memory | storage part and the light emission state of the said light emission member when the said apparatus is in an at least 1 operation state is included Based on the comparison between the device information and the detected position of the light emitting member and the light emitting state of the light emitting member, the model of the device imaged by the imaging device is identified,
Monitoring the operating state of the imaged device based on the captured image acquired from the imaging device according to the monitoring condition corresponding to the identified model stored in the storage unit;
A monitoring method characterized by that.

Images