JP2021168161A - Mobile device - Google Patents

Abstract

To automatically and efficiently determine a status of electronic devices.SOLUTION: In a mobile device that moves between places where electronic devices are installed, a movement control means that moves along a predetermined route corresponding to installation positions of the electronic devices by causing predetermined movement means to perform a predetermined movement operation corresponding to the installation positions, in which the route includes first routes along the direction of arrangement of the electronic devices and a second route connecting the first routes to each other, and also position information storage means is provided, which stores position information regarding the first position, which is the position corresponding to the installation positions of the electronic devices, and position information regarding the second position, which is an end of the first routes and a connection between the first routes and the second route, and the movement control means causes the movement means to perform a movement while stopping at the first position while moving along the route, by causing the same to perform a moving operation based on the position information stored in the position information storage means.SELECTED DRAWING: Figure 1

Description

The present invention relates to a state determination device capable of determining the state of an electronic device, and in particular, provides a moving means and performs state determination of an electronic device installed at a predetermined place while performing a predetermined moving operation. With respect to possible mobile devices.

Facilities such as data centers where many electronic devices such as server devices, switches, routers, and storage devices are installed are known.
In such a facility, a plurality of racks are arranged in a predetermined place such as a machine room, and a plurality of electronic devices are installed in each rack.
Since these electronic devices are important devices that carry out the business, inspection work is carried out in a timely manner.
This type of inspection is usually performed by an inspector who determines whether or not the lamps are normal by looking at the light emitting state of various lamps provided in the electronic device.
For example, a power lamp or the like indicating an operating state of an electronic device is determined to be normal when it is lit, and is determined to be abnormal when it is off.
By the way, such an inspection must be visually performed one by one by the inspector.
Therefore, an automatic inspection technique that does not require human labor has been proposed.
For example, in Patent Document 1, an imaging device is provided at a predetermined position on a rack, and a monitoring system that identifies the light emitting state of a lamp from an image captured by the electronic device captured by the imaging device and determines the operating state of the electronic device. Is disclosed.

Japanese Unexamined Patent Publication No. 2015-228184

However, since the monitoring system of Patent Document 1 is provided with an image pickup device for each electronic device to be inspected, at least the same number of image pickup devices as the number of electronic devices must be prepared.
For this reason, there is a problem that it takes a lot of time and effort to purchase the image pickup device and to install the image pickup device.
In particular, in a facility such as a data center where many electronic devices are installed, the cost of purchasing an imaging device becomes enormous.
In addition, since the model and mounting position of the electronic device differ depending on the rack, it is necessary to change the position of the image pickup device for each rack. If the mounting position of the electronic device is changed, the position of the image pickup device is changed accordingly. Must.

The present invention has been proposed to solve the problems of the conventional techniques as described above, and is provided with a moving means, and can determine the state of an electronic device installed at a predetermined place by performing a predetermined moving operation. It is an object of the present invention to provide a mobile device that can be automatically performed while performing the above.

In order to achieve the above object, the mobile device of the present invention is a mobile device that moves a predetermined place where one or more electronic devices are installed, and a predetermined moving means corresponds to a predetermined position corresponding to the installation position of the electronic device. A movement control means for moving along a predetermined route corresponding to the installation position by performing the movement operation is provided, and the route includes a first route along the direction of the arrangement of the electronic devices and the said route. The second route connecting the first routes is included, and the position information of the first position, which is the position corresponding to the installation position of the electronic device, and the end of the first route, the first route and the first route. A position information storage means for storing position information including a position information of a second position which is a connection portion with two routes is provided, and the movement control means is stored in the movement means and in the position information storage means. The configuration is such that the movement along the route is performed by performing the movement operation based on the position information, and the movement is performed while stopping at the first position.

According to the present invention, the state determination of an electronic device can be automatically and efficiently performed.

It is external drawing of the inspection robot which concerns on one Embodiment of the mobile device of this invention. It is a figure which shows the state in the machine room of a data center. It is a rack layout diagram which shows the layout structure of the rack in a machine room. It is a rack mounting diagram which shows the mounting mode of the electronic device in a rack. It is a block diagram which shows the structure of an inspection robot. It is a list of all equipment management composed of management information and route information about all electronic devices in the machine room. This is an LED position table in which the model name of the electronic device, the LED type, and the LED position information are associated with each other. It is a figure which shows the movement route when inspecting all the electronic devices in a machine room. It is a figure which shows the imaging range of the imaging unit when the movable base unit 17 is set to the height corresponding to the mounting position "7-9" in the state where the inspection robot 10 is stopped at the marker coordinates (1,1). .. It is a schematic diagram schematically showing the shape of the front panel of the electronic device "SV2" identified from the captured image. This is a state determination table in which the light emitting state of the LED and the state of the electronic device are associated with each other. It is a block diagram which shows the structure of the management terminal which concerns on one Embodiment of this invention. (A) is a list related to a specific electronic device selected from the all device management list, and (b) is a specific device created by setting a predetermined number in the movement order of route information included in the list of (a). It is a management list. It is a figure which shows the movement route when inspecting a specific electronic device. It is a flowchart which shows the creation method of the specific device management list. It is a flowchart which shows the state determination method. This is an operation unit position table in which the mounting position of the electronic device and the position information of the power button of each electronic device are associated with each other. It is a figure which shows the operation which matches the position of the extension part with the position of the operation part in the display part of a management terminal.

Hereinafter, embodiments of the mobile device according to the present invention will be described with reference to the drawings.
Here, the mobile device of the present invention shown below is realized by processing, means, and functions executed by a computer according to a program (software) instruction. The program can send a command to each component of the computer to perform a predetermined process, function, or the like according to the present invention shown below. That is, each process, means, and function in the present invention is realized by a concrete means in which a program and a computer cooperate.

All or part of the program is provided by, for example, a magnetic disk, an optical disk, a semiconductor memory, or any other computer-readable recording medium, and the program read from the recording medium is installed and executed in the computer. NS. The program can also be loaded and executed directly on the computer through a communication line without going through a recording medium.

FIG. 1 is a diagram showing the appearance of an inspection robot 10 according to an embodiment of a mobile device of the present invention, and FIG. 2 is a diagram showing a state inside a machine room of a data center.
As shown in these figures, the inspection robot 10 includes a main body base portion 19, a vertical member 18 provided vertically to the main body base portion 19, and a movable base portion 17 provided on the vertical member 18 and movable in the vertical direction. It is composed of and.
Inside the main body base portion 19, a drive unit 13 is provided as a means of transportation in the machine room.
Further, the movable base unit 17 is provided with an imaging unit 14 and an extension unit 15 so that each electronic device 8 mounted on the rack 9 can perform a predetermined operation at a predetermined height.
The electronic device 8 can exemplify, for example, a server device, a storage device, a switch, a router, and the like.
FIG. 3 is a rack layout diagram showing a rack layout configuration in a machine room, and FIG. 4 is a rack mounting diagram showing a mounting mode of electronic devices in the rack.
As shown in these figures, box-shaped racks 9 having a predetermined height are arranged in a plurality of rows on the floor of the machine room.
The height of the electronic device 8 of the rack 9 is determined by the mounting position. Therefore, a plurality of electronic devices 8 can be mounted on one rack 9 by allocating the mounting positions so that they do not overlap.
The vertical member 18 of the inspection robot 10 has a height corresponding to the height of the rack 9.

[Inspection robot 10]
Specifically, as shown in FIG. 5, the inspection robot 10 is composed of a storage unit 11, a communication unit 12, a drive unit 13, an imaging unit 14, an extension unit 15, and a control unit 16.
The storage unit 11 is a storage means such as a ROM, RAM, and HDD, and stores programs and data.
For example, the storage unit 11 stores the all device management list shown in FIG. 6 and the LED position table shown in FIG. 7.
The all device management list contains management information about all the electronic devices 8 in the machine room, such as the column number of the rack 9, the rack number for each row, the mounting position corresponding to the height, the model name of the electronic device 8, and the electronic device 8. It is composed of information such as the system name to which the robot 10 belongs and route information regarding the movement route of the inspection robot 10 (see FIG. 6).
The LED position table is table data in which the model name of the electronic device 8 is associated with the LED type and the LED position information (see FIG. 7).
Of these, the LED position information is the xy coordinates of the LED when the front panel 80 is in the xy plane with the lower right corner thereof as the origin (0,0).
In addition, the storage unit 11 can also store a specific device management list (see FIG. 13B), which will be described later.
Hereinafter, the all device management list and the specific device management list are collectively referred to as "device management list".

The communication unit 12 is a data communication means, and can transmit and receive various data to and from the management terminal 20 via a wireless LAN or the Internet.
For example, from the management terminal 20, there is inspection command information (all inspection command information for all electronic devices 8 and specific inspection command information for a specific electronic device 8) which is an inspection command for the electronic device 8. ), And the information of the inspection result can be transmitted to the management terminal 20.

The drive unit 13 is a moving means for moving the inspection robot 10 in the machine room.
The drive unit 13 includes left and right drive wheels 131, an electric motor (not shown), a power transmission unit that transmits the power of the motor to the drive wheels 131, and a power source such as a battery as a power source.
The moving direction and moving distance of the inspection robot 10 are determined by the diameter and the number of rotations of the left and right drive wheels 131. For example, if each drive wheel 131 is rotated at the same rotation speed, the vehicle travels straight, and the moving distance can be obtained based on the rotation speed and diameter of the drive wheel 131. Further, when changing the course at a certain point, the course can be changed to an angle corresponding to the rotation by rotating the other drive wheel 131 in a predetermined manner while stopping one drive wheel 131.
Therefore, the control unit 16 can move the inspection robot 10 to a predetermined position by controlling the drive unit 13.
The movement of the inspection robot 10 can also be controlled by remote control from the management terminal 20.
A waiting point for the inspection robot 10 is provided on the floor of the machine room, and the inspection robot 10 is usually arranged at this waiting point.
A charging facility is provided at the standby point, and the inspection robot 10 can stand by while charging the battery as a power source.

The imaging unit (imaging means) 14 is composed of a camera or the like capable of capturing an electronic device 8 mounted on the rack 9 with a moving image or a still image.
The imaging unit 14 is provided on a movable base unit 17 that can move in the vertical direction along the vertical member 18. Further, the imaging unit 14 and the movable base unit 17 are connected to the control unit 16 housed in the main body base unit 19 by a communication cable or the like, and their respective operations are controlled by the control unit 16.
As a result, the imaging unit 14 can be moved in the vertical direction, the imaging range can be moved in the vertical direction, and the imaging process can be performed at a predetermined height.
The extension portion (extension member) 15 is composed of a rod-shaped member that can be extended stepwise.
The extension portion 15 is provided on the movable base portion 17 like the imaging unit 14. Further, the extension unit 15 is also connected to the control unit 16 housed in the main body base unit 19 by a communication cable or the like, and the respective operations of the extension unit 15 and the movable base unit 17 are controlled by the control unit 16. Will be done.
As a result, the extension portion 15 can be moved in the vertical direction or extended at a predetermined height.
The operations of the imaging unit 14, the extension unit 15, and the movable base unit 17 can also be controlled by remote control from the management terminal 20.

The control unit 16 is a computer including a CPU or the like, and performs the following operations by reading a predetermined program stored in the storage unit 11. The control unit 16 is housed in the main body base unit 19.
By operating as a movement control means, the control unit 16 causes the drive unit 13 to perform a predetermined movement operation corresponding to the installation position of the electronic device 8, so that the control unit 16 follows a predetermined route corresponding to the installation position. Move the inspection robot 10.
The "predetermined movement operation" is performed based on the route information (see FIGS. 6 and 12) included in the device management list stored in the storage unit 11.
As shown in FIG. 8, the route information is information about each marker provided along a predetermined movement route.

The marker is information for guiding the inspection robot 10 to move along the movement route by being provided along the predetermined movement route, and specifically, depending on the marker type, the marker coordinates, and the movement order. It is configured (see FIG. 6).
The "marker coordinates" are the position information of the markers when the floor of the machine room is set to the xy plane with the standby point of the inspection robot 10 as the origin (0,0) (see FIGS. 6 and 8).
The "movement order" is information indicating the movement order of the inspection robot 10.
Therefore, the control unit 16 controls the drive unit 13 to move each marker according to the movement order, so that the inspection robot 10 can be moved along a predetermined movement route (see FIG. 8).
Further, the "marker type" includes a stop marker and an end marker.
Of these, the stop marker is a marker for instructing the stop at the position of the marker, and is provided on the front side of each rack 9.
As a result, in the process of moving the inspection robot 10 along the movement route, each rack 9 is made to temporarily stop in front of the rack 9.
Specifically, under the control of the control unit 16, the inspection robot 10 stops moving at the point of the stop marker, and a predetermined operation for each electronic device 8 mounted on the corresponding rack 9 at that position (described later, imaging control means). Each operation from to to the state determination means) is performed, and when the predetermined operation is completed, the marker moves to the next movement order.
As shown in FIG. 8, the end marker is a marker that guides movement in the x-axis direction or the like by being provided outside the row.

The movement operation described above can also be performed by another method.
For example, an identification member such as a tape may be laid along a predetermined movement route, and the inspection robot 10 may be moved while identifying the identification member with a predetermined sensor.
In this case, the same movement operation can be performed by attaching a barcode instructing stop to the position of the stop marker and moving the inspection robot 10 while identifying each barcode.

By operating as an image pickup control means, the control unit 16 causes the image pickup unit 14 to take an image of the electronic device 8 in response to the movement operation.
Specifically, when the inspection robot 10 stops at the position of the stop marker, the image pickup unit 14 is made to take an image of each electronic device 8 mounted on the corresponding rack 9.
First, the control unit 16 sets the movable base unit 17 at a height corresponding to the “mounting position” of the rack 9 in the device management list.
When the movable base portion 17 is set at a height corresponding to the "mounting position" while the inspection robot 10 is stopped at the position of the stop marker, the "mounting" is included in the imaging range of the imaging unit 14. The imaging magnification can be automatically adjusted so as to include the entire front panel 80 of the electronic device 8 mounted in the "position".
Therefore, by setting the movable base unit 17 at a height corresponding to each "mounting position" and causing the imaging unit 14 to take an image, the front panel 80 of each electronic device 8 mounted at each "mounting position" The captured image can be acquired.
For example, FIG. 9 shows a captured image when the movable base portion 17 is set to a height corresponding to the mounting positions “7 to 9” when the inspection robot 10 is stopped at the marker coordinates (1,1). It is a figure.
As shown in the example of this figure, in the state where the inspection robot 10 is stopped at the marker coordinates (1, 1), the movable base portion 17 is set to the height corresponding to the mounting position “7 to 9” and the imaging unit 14 is set. The captured image of the front panel 80 of the "SV2" can be acquired.
Such an imaging operation is performed, for example, in ascending order of mounting positions, so that the electronic devices 8 mounted on the upper part are sequentially performed one by one.
However, even if the imaging process for one electronic device 8 is completed, the operation remains at that position until the predetermined operation for the electronic device 8 (each operation from the light emitting unit information acquisition means to the state determination means described later) is completed, and the predetermined operation is performed. After that, the image is moved to the height corresponding to the next mounting position and the imaging operation for the next electronic device 8 is performed.

By operating as a light emitting unit information acquisition means, the control unit 16 obtains information on the light emitting state of the light emitting unit (LED) 81 provided in the electronic device 8 from the captured image of the electronic device 8 captured by the imaging unit 14. To get.
Here, the electronic devices 8 mounted at the mounting positions “7 to 9” of the column number “1” and the rack number “1” (hereinafter, referred to as “1-1”) will be described.
First, the control unit 16 acquires the type of LED provided in the target electronic device 8 and its position information.
In this case, since the electronic device 8 mounted at the rack mounting positions "7 to 9" of 1-1 is "SV2" (see FIG. 6), "SV2" is based on the LED position table (FIG. 7). "LED1" and position information (5, 18) can be acquired as the LED type and position information of.
Next, the control unit 16 specifies the shape and size of the front panel 80 of the electronic device 8 from the feature information of the captured image captured by the imaging unit 14 based on a known method.
FIG. 10 is a schematic view schematically showing the front panel 80 identified from the captured image.
Thereby, the control unit 16 can specify the lower right corner portion of the front panel 80 and specify the range of the xy plane with the lower right corner portion as the origin to specify the region of the front panel 80.
Subsequently, the control unit 16 identifies the light emitting state at the point of the acquired position information.
Specifically, the brightness at the point of coordinates (5, 18) or the brightness in a certain area centered on that point is obtained, and if it is equal to or more than a predetermined reference value, it is determined that "LED1" is in the "lit" state. If it is less than the reference value, it is determined that "LED1" is in the "off" state.
In addition, when the captured image is a moving image (including a plurality of still images within a certain period of time), if the "lit" state and the "off" state are detected alternately, it is determined to be the "blinking" state. be able to. In this case, the "blinking interval" can be specified based on the interval of turning on or off.
Furthermore, it is also possible to specify what color the light is on or off. For example, it can be specified by obtaining a "hue value (0 to 360)" by a known method. For example, when the hue value is 114 to 165, it can be specified as "green", when it is 38 to 60, it can be specified as "yellow", and when it is 341-360 or 0 to 17, it can be specified as "red".

Then, the control unit 16 operates as a state determination means to determine the state of the electronic device 8 based on the information on the light emitting state of the light emitting unit 81 acquired by the light emitting unit information acquisition means.
Specifically, the determination is made based on the state determination table shown in FIG.
For example, if the light emission state of "LED1" of "SV2" is "lit" of "green", it is judged as "normal", and if it is "blinking" of "red", it is a moderate abnormality ("abnormal"). ), And in the case of "lighting" of "red", it can be determined that the altitude is abnormal ("abnormal height").
Similarly, when the light emitting state of "LED1" of "SW1" is "lighting" of "green", it can be determined as "normal", and when it is "off", it can be determined as "abnormally high".
Similarly, when the light emitting state of "LED1" of "SV1" is "off", it is judged as "normal", and when it is "yellow" and "blinking", it is judged as "abnormal" and "red". In the case of "lighting", it can be determined as "abnormal height".
Similarly, when the light emitting state of "LED2" of "SV1" is "lighting" of "green", it can be determined to be "normal", and when it is "off", it can be determined to be "abnormally high".
It is also possible to add a blinking interval to the determination of the state.

A series of inspection operations leading to the movement operation and the state determination of the inspection robot 10 are performed by the control unit 16 as follows based on the all device management list (see FIG. 6).

First, the inspection robot 10 is passed from the origin, which is the standby position, through the end marker of the movement order "1", and stopped in front of the rack 9 of 1-1, which is the position of the stop marker of the movement order "2". The state of each electronic device 8 mounted on the rack 9 is determined. In the state determination for each electronic device 8, first, the imaging unit 14 is set to a height corresponding to the mounting position "2" at the stop position, and "SW1" is imaged, and "LED1" is imaged from the captured image. The information on the light emitting state of "" is acquired, the state of "SW1" is determined based on the information on the light emitting state, and secondly, the image pickup unit 14 is set to a height corresponding to the mounting positions "4 to 5". The "SV1" is imaged, information on the light emitting state of "LED1" and "LED2" is acquired from the captured image, and the state of "SV1" is determined based on the information on the light emitting state. The imaging unit 14 is set to a height corresponding to the mounting positions "7 to 9" to image the "SV2", the information on the light emitting state of the "LED1" is acquired from the captured image, and the information on the light emitting state is used. Based on this, the state of "SV2" is determined. As a result, the state determination of each electronic device 8 mounted on the rack 9 of 1-1 is completed.
Next, the inspection robot 10 is stopped in front of the rack 1-2, which is the position of the stop marker in the movement order "2", and the state of each electronic device 8 mounted on the rack 9 is determined in the same manner. ..
After that, the movement operation and the state determination of the inspection robot 10 are repeated in the same manner, and when the state determination of each electronic device 8 mounted on the rack 9 of 1-5 is completed, the inspection robot 10 is moved to the end of the movement order "7". Pass the marker, then pass the end marker of the movement order "8", stop in front of the rack 9 of 2-5 which is the position of the stop marker of the movement order "9", and mount it on the rack 9. The state of each electronic device 8 is determined.
After that, the moving operation and the state determination of the inspection robot 10 are repeated in the same manner, and when the state determination of each electronic device 8 mounted on the rack 9 of 4-1 is completed, the inspection of all the electronic devices 8 in the machine room is performed. Complete.
When the inspection of all the electronic devices 8 is completed, the inspection robot 10 is moved to the origin (0,0) which is a standby point. As a result, the inspection robot 10 is set to the standby state again and charging is started.

By the above operation, the inspection robot 10 is automatically inspected while autonomously moving all the electronic devices 8 in the machine room of the data center along an appropriate route corresponding to the installation position. Can be done.

In addition, the inspection robot 10 can store the result of the state determination in the storage unit 11 as the inspection result or transmit it to the management terminal 20.
Further, the inspection result can be transmitted to the management terminal 20 every time the state determination of one electronic device 8 is completed, or can be transmitted after the state determination of all the electronic devices 8 is completed.
It is also possible to transmit the captured image of the electronic device 8 captured at the time of determining the state together with the inspection result to the management terminal 20.
Further, when the result of the state determination is a predetermined state such as "abnormal", it can be immediately transmitted to the management terminal 20. In this case, the moving image of the target electronic device 8 can be transmitted in real time.
Further, when the result of the state determination is "abnormal", the abnormality can be notified by sound or image via a speaker or a display (not shown).
In addition, information that shows the time required for inspection (inspection time) can be stored in the storage unit 11 together with the inspection result, or can be transmitted to the management terminal 20.

[Management terminal 20]
The management terminal 20 is an information processing device such as a PC, a tablet terminal, or a smartphone, and can form the state determination device of the present invention together with the inspection robot 10.
The management terminal 20 can remotely control and manage the inspection robot 10 deployed in the data center.
Therefore, when the inspection robots 10 are deployed in the machine rooms of a plurality of data centers, each inspection robot 10 can be operated and centrally managed.

As shown in FIG. 12, the management terminal 20 includes a storage unit 21, a communication unit 22, an operation unit 23, a display unit 24, and a control unit 25.
The storage unit 21 is a storage means such as a ROM, RAM, and HDD, and stores programs and data.
For example, the storage unit 21 stores the device management list. The administrator can edit and update the device management list as needed.
The communication unit 22 is a communication means for transmitting and receiving data, and for example, transmits and receives data to and from the inspection robot 10 via a wireless LAN or the Internet.
For example, inspection command information (all inspection command information, specific inspection command information), which is an inspection command for the electronic device 8, can be transmitted to the inspection robot 10, and inspection results can be received from the inspection robot 10.
In addition, the specific device management list can be transmitted to the inspection robot 10.
Further, when the device management list is updated, the updated device management list can be transmitted to the inspection robot 10 to update the device management list in the inspection robot 10.
As a result, when an electronic device 8 or a rack 9 is newly installed or changed in each data center, it can be handled only by the management terminal 20 side.
The operation unit 23 is an operation means including a mouse and a keyboard in a PC and a touch panel in a tablet terminal and a smartphone.
The display unit 24 is a display means including a display screen such as a liquid crystal display. In tablet terminals and smartphones, the touch panel is both an operation means and a display means.
The control unit 25 is a computer including a CPU or the like, and performs various operations by reading a program stored in the storage unit 21.

For example, in the management terminal 20, by receiving the inspection result and the captured image transmitted from the inspection robot 10, these can be displayed on the display unit 24.
As a result, the administrator can confirm the inspection result and the state of the electronic device 8 at the time of inspection.
In addition, based on the inspection time information received from the inspection robot 10, the representative values (for example, average value, maximum value, etc.) of the inspection time for each rack or device are obtained, and based on this, the next and subsequent inspections are performed. It is also possible to predict the inspection time of.
For example, when the average inspection time per electronic device 8 is calculated to be 9 minutes from the past inspection record, and if there are 100 electronic devices 8 to be inspected next, the estimated inspection time is 15 hours. It can be calculated as (= 9 minutes x 100 units ÷ 60 minutes).
This can be useful in determining whether the inspection is performed once or divided into a plurality of times when the inspection time is limited (for example, 8 hours).
Further, regarding the capacity of the battery of the inspection robot 10, by obtaining the discharge time in one inspection, the number of electronic devices 8 and the like, the inspection can be performed once or divided into a plurality of times. Can be determined.
In addition, the mobile device of the present invention performs the following characteristic operations.

[Operation when a specific electronic device is selected as an inspection target]
The mobile device of the present invention includes a selection means capable of selecting a specific electronic device 8 from the electronic devices 8 installed in the machine room, and performs an inspection operation on the specific electronic device selected by such selection means. It is designed to be carried out efficiently.
A case where an electronic device 8 belonging to the system name “sys2” is selected as a specific electronic device 8 will be described with respect to a configuration that enables such an inspection operation.
In this case, first, in the management terminal 20, a specific device management list is created using the all device management list.
Specifically, by performing a predetermined operation, data related to "sys2" and data related to the end marker are selected and extracted from the all device management list stored in the storage unit 21.
As a result, the list shown in FIG. 13 (a) is extracted.

Next, the "movement order" of the route information included in this list is set (changed) according to the following (1) to (7).
(1) "Of the end markers attached to the youngest column number, the movement order of the end markers closer to the origin (0,0) is set to" 1 ". 』\
The "end marker attached to the youngest column number" is an end marker having marker coordinates (0.5, 2) and an end marker having marker coordinates (5.5, 2). Of these, the "end marker closer to the origin (0,0)" is the end marker at the marker coordinates (0.5,2).
Therefore, the movement order of the end markers at the marker coordinates (0.5, 2) is set to "1".
(2) "Set the movement order of the stop markers belonging to the same column number to the next number. When there are a plurality of stop markers, the numbers are set in order from the stop marker closest to the end marker for which the movement order is set in (1). 』\
The "stop marker belonging to the column number belonging to the same column number" is a stop marker having marker coordinates (3, 2) belonging to the same column number "2" as the youngest column number "2".
Therefore, the movement order of the markers at the marker coordinates (3, 2) is set to "2".
(3) "Of the end markers attached to the same column number, the movement order of the end marker that is not the end marker for which the movement order is set in (1) is set to the next number. 』\
The "end marker attached to the same column number" is the end marker of the marker coordinates (0.5, 2) and the end marker of the marker coordinates (5.5, 2) attached to the column number "2". be. Of these, "the end marker that is not the end marker whose movement order is set in (1)" is the end marker of the marker coordinates (5.5, 2).
Therefore, the movement order of the end markers at the marker coordinates (5.5, 2) is set to "3".

(4) "Of the end markers attached to the next youngest column number, the movement order of the end marker closer to the end marker whose movement order was set in the previous step is set to the next number. 』\
The "end marker attached to the next youngest column number" is the end marker of the marker coordinates (0.5, 4) and the marker coordinates (5.5, 4) attached to the column number "4". It is an end marker. The "end marker whose movement order is set in the previous step" is an end marker having the marker coordinates (5.5, 2) in which the movement order "3" is set in (3). Then, "among the end markers attached to the next youngest column number, the end marker closer to the end marker whose movement order was set in the previous step" has the marker coordinates (5.5, 4). It is an end marker.
Therefore, the movement order of the end markers at the marker coordinates (5.5, 4) is set to "4".
(5) "Set the movement order of the stop markers belonging to the same column number to the next number. When there are a plurality of stop markers, the numbers are set in order from the stop marker closest to the end marker for which the movement order is set in (4). 』\
The "stop markers belonging to the same column number" are a stop marker having marker coordinates (2, 4) and a stop marker having marker coordinates (3, 4) belonging to the column number "4", and there are a plurality of them. Of these, the "stop marker closer to the end marker whose movement order is set in (4)" is a stop marker having marker coordinates (3, 4) closer to the end marker in marker coordinates (5.5, 4). be.
Therefore, the movement order of the stop markers at the marker coordinates (3, 4) is set to "5", and the movement order of the stop markers at the marker coordinates (2, 4) is set to "6".
(6) "Of the end markers attached to the same column number, the movement order of the end marker that is not the end marker for which the movement order is set in (4) is set to the next number. 』\
The "end marker attached to the same column number" is an end marker of marker coordinates (0.5, 4) and an end marker of marker coordinates (5.5, 4) attached to column number "4". be. Of these, "the end marker that is not the end marker whose movement order is set in (4)" is the end marker at the marker coordinates (0.5, 2).
Therefore, the movement order of the end markers at the marker coordinates (0.5, 4) is set to "7".
(7) "After that, repeat (4) to (6) until there is no corresponding data. 』\
In the case of this example, since there is no column number after the column number "4", the movement order of the end markers of the marker coordinates (0.5, 4) is set and the process ends.

As a result, as shown in FIG. 13B, it is possible to create a specific device management list consisting only of the electronic devices 8 belonging to the "sys2" to be inspected.
The management terminal 20 transmits the specific device management list created in this way to the inspection robot 10 together with the specific inspection command information.
When the inspection robot 10 receives the specific inspection command information from the management terminal 20, the inspection robot 10 stores the specific device management list received together with the specific inspection command information in the storage unit 11 and performs the following operations.
Specifically, the control unit 16 causes the drive unit 13, the movable base unit 17, and the imaging unit 14 to perform a series of inspection operations leading to the movement operation and the state determination according to the route information included in the specific device management list.
The operation of the series of inspections leading to the detailed movement operation and the state determination is the same as the operation performed based on the above-mentioned all device management list.

As a result, as shown in FIG. 14, the inspection robot 10 has an appropriate movement route (specific route) corresponding to the installation position of the specific electronic device 8 “electronic device 8 belonging to sys2” selected as the inspection target. It is possible to have the inspection performed automatically while moving autonomously along the line.
That is, the columns (columns of column numbers "1" and "3") consisting only of the rack 9 on which the electronic device 8 to be inspected is not mounted are not included in the movement route without providing a marker. , It is possible to prevent the inspection robot 10 from performing unnecessary moving operations.
Further, for the columns including the rack 9 on which the electronic device 8 to be inspected is mounted (columns of column numbers "2" and "4"), a stop marker is provided only for the rack 9, and other than this, a stop marker is provided. Since the stop marker is not provided on the rack 9, the inspection robot 10 can be prevented from stopping unnecessarily.
Therefore, when a specific electronic device 8 is selected as an inspection target, the inspection robot 10 can efficiently perform the inspection in a short time.

It is also effective when the inspection is divided into a plurality of times.
For example, when the inspection execution time is limited to, for example, 8 hours, and the estimated inspection time is calculated to be 15 hours, it is necessary to perform the inspection in two steps.
In this case, the management terminal 20 selects a predetermined electronic device 8 from the all device management list to create two specific device management lists (for example, those in the first and second columns and those in the third to fourth columns). By passing this to the inspection robot 10, it is possible to easily perform a plurality of inspections by the inspection robot 10.
The same applies when charging is required during the inspection due to the capacity of the battery. In this case, when the first inspection is completed, the battery returns to the standby point, and when the charging is completed, the second inspection is performed. You can also try to get started.

Next, a method of creating a specific device management list will be described.
FIG. 15 is a flowchart showing a method of creating a specific device management list.
As shown in FIG. 15, first, information about a specific electronic device is extracted from the entire device management list (S1).
Specifically, in the management terminal 20, information about the specific electronic device 8 is extracted from the all device management list (see FIG. 6) by a predetermined operation. For example, the list of FIG. 13A is created by extracting the information of the electronic device 8 belonging to "sys2".
Next, "1" is assigned to the variable n (S2).
Subsequently, it is determined whether or not there is a column number "n" (S3).
In the list of FIG. 13A, for example, when n = 1, it is determined that there is no column number “1” (No), and when n = 2, it is determined that there is a column number “2” (Yes). ..
When there is no column number "n" (S3-No), "n + 1" is assigned to the variable n and the process returns to S3 (S4).
When there is a column number "n" (S3-Yes), the movement order of the end markers at a position close to the origin among the end markers attached to the column number "n" is set to "1" (S5).
Next, the movement order of the stop markers belonging to the column number "n" is set to the next number (S6). When there are a plurality of applicable stop markers, the numbers are set in order from the stop marker closest to the end marker for which the movement order is set in S5.
Subsequently, among the end markers attached to the column number "n", the movement order of the end marker other than the end marker whose movement order is set in S5 is set to the next number (S7).
Next, it is determined whether or not n = 4 (S8).
In S8, when n = 4 (S8-No), "n + 1" is substituted for the variable n (S9), and the process proceeds to the next step (S10).
In S10, it is determined whether or not there is a column number "n" (S10).
If there is no column number "n" (S10-No), substitute "n + 1" for the variable n and return to S10.
When there is a column number "n" (S10-Yes), the movement order of the end markers at positions close to the end markers whose movement order was set in the previous step among the end markers attached to the column number "n" is changed. Set to the next number (S11).
Next, the movement order of the stop markers belonging to the column number "n" is set to the next number (S12). When there are a plurality of applicable stop markers, the numbers are set in order from the stop marker closest to the end marker whose movement order was set in the previous process.
Subsequently, among the end markers attached to the column number "n", the movement order of the end marker on the opposite side to the end marker whose movement order is set in S11 is set to the next number (S13).
Next, the process proceeds to S8, and when it is determined that n = 4 (S8-Yes), the process ends.
As a result, it is possible to create a specific device management list when the specific electronic device 8 is to be inspected (see FIG. 13 (b)).
The specific device management list created in this way can be used in the state determination method described later.

Next, the state determination method will be described.
FIG. 16 is a flowchart showing a state determination method.
As shown in FIG. 16, first, the inspection robot 10 determines whether the inspection target is all the electronic devices 8 in the machine room or the specific electronic devices 8 (S21).
For example, when the inspection robot 10 receives all inspection command information from the management terminal 20, it is determined that all the electronic devices 8 are subject to inspection, and the specific inspection command information is received from the management terminal 20. In this case, it is determined that the specific electronic device 8 is the target of the inspection.
In S21, when inspecting all electronic devices (S21- "all"), a moving operation is performed to move between markers based on the route information included in the all device management list (see FIG. 6) (S22). ).
Specifically, by controlling the drive unit 13 by the control unit 16, the inspection robot 10 moves between the markers according to the movement order.
Next, each time the marker is reached, it is determined whether or not the marker is a stop marker (S23).
When the marker is a stop marker (S23-Yes), the movement is stopped (S24).
Next, an image is taken of one electronic device 8 mounted on the corresponding rack (S25).
Next, information about the light emitting unit is acquired (S26).
Specifically, information on the light emitting state of the LED provided on the front panel 80 is acquired from the captured image acquired in S25.
Subsequently, the state is determined (S27).
Specifically, it is determined whether the electronic device 8 is normal or abnormal based on the information on the light emitting state of the LED acquired in S26.
The processing of S25 to S27 is performed for each electronic device 8, and when the processing of all the electronic devices 8 mounted on the rack 9 is completed, the process proceeds to S28.
Next, it is determined whether or not there are remaining markers (S28).
If there are remaining markers (S28-Yes), the marker is moved to the next marker in the movement order (S29), and the above-mentioned processing after S23 is performed.
The processing after S23 is performed until there are no remaining markers (S28-No), and when the remaining markers are exhausted, a series of processing is completed.

In S21, when inspecting a specific electronic device 8 (S21- "specification"), the operation of moving between markers based on the route information included in the specific device management list (see FIG. 13B) is performed. Do (S30).
Specifically, the operations of S23 to S28 described above are performed.

[About the operation of the operation part by the extension part]
Next, the operation of the operation unit 82 by the extension unit 15 will be described.
The inspection robot 10 can extend the extension unit 15 toward the electronic device 8 by the control unit 16 operating as the extension control means (see FIG. 1 and the like).
Here, the electronic device 8 is generally provided with an operation unit 82 that causes the electronic device 10 to perform a predetermined operation by pressing a power button or the like.
Therefore, in the inspection robot 10, by extending the extension unit 15 at the corresponding position of the operation unit 82, the operation unit 82 can be pressed and operated.
In order to enable such an operation, the inspection robot 10 and the management terminal 20 have the following configurations.

As a premise, it is assumed that the relative position table shown in FIG. 17 is stored in the storage unit 11 of the inspection robot 10.
The relative position table is table data in which the mounting position of the electronic device 8 and the relative position information (relative position information) of the extension portion 15 with respect to the power button 82 of the electronic device 8 are associated with each other.
The "relative position information" is the xy coordinates of the reference position of the extension portion 15 when the front surface of the rack 9 is regarded as an xy plane with the position of the power button 82 of each electronic device 8 as the origin. The xy coordinates are represented by the actual length (cm).
Therefore, for example, in the relative position information (20, 120) of the relative position table, the reference position of the extension portion 15 and the power button 82 are separated by 20 cm along the x-axis direction and 120 cm along the y-axis direction. It shows that there is.
The reference position of the extension portion 15 is set at the center position of the rack width in the x-axis direction.
This is the position of the extension portion 15 when the inspection robot 10 is stopped at the position of the stop marker, and the extension portion 15 is operated after the inspection robot 10 is stopped at the position of the stop marker. ..
The reference position of the extension portion 15 is set to the uppermost position in the y-axis direction for convenience.

Here, the inspection robot 10 acquires information indicating the positional relationship between the operation unit 82 and the extension unit 15 provided in the electronic device 8 by the control unit 16 operating as the positional relationship information acquisition means. ..
Specifically, a case where the power button 82 of the predetermined electronic device 8 is operated by the predetermined operation of the management terminal 20 will be described.
For example, when it is instructed to operate the power button 82 of the "SV2" mounted at the mounting positions "7 to 9" of the rack 9 of 1-1 by a predetermined operation of the management terminal 20, the management terminal 20 is used for management. The terminal 20 transmits command information indicating the content of the instruction to the inspection robot 10.
In the inspection robot 10, when the control unit 16 receives the command information, the relative position information (20, 20) corresponding to the mounting positions “7 to 9” of the rack 9 of 1-1 is based on the relative position table (see FIG. 17). 120) is acquired as "information indicating the positional relationship between the operation unit 82 and the extension unit 15".
Next, the control unit 16 operates as the extension member moving means, and based on the information indicating the positional relationship indicating the positional relationship between the operation unit 82 and the extension unit 15, the extension unit 15 is operated by the operation unit 82. Move to the position corresponding to.
Specifically, since the relative position information is (20,120), if the extension portion 15 is in the reference position, it is -20 cm in the x-axis direction and -120 cm in the y-axis direction from the reference position. There is a power button 82 at a distance.
That is, by moving the extension portion 15 to a position 20 cm to the right and 120 cm downward from the reference position, the extension portion 15 can be moved to the position of the power button 82.
Therefore, when the inspection robot 10 is stopped at the position of the stop marker at the marker coordinates (1,1) and the movable base portion 17 is set at the uppermost portion, the extension portion 15 is set at the reference position. From there, the inspection robot 10 is moved 20 cm to the right and the movable base portion 17 is moved 120 cm downward, so that the extension portion 15 can be moved to the position of the power button 82.
Then, the control unit 16 operates as the extension control means, and based on the fact that the extension member moving means moves the extension unit 15 to a position corresponding to the operation unit 82, the extension unit 16 The operation unit 82 is operated by extending the 15.
That is, by moving the extension portion 15 to the position of the power button 82 and then extending the extension portion 15, the power button 82 can be pressed by the extension operation of the extension portion 15, thereby. The power of the electronic device 8 can be turned off and on.
A pressure detection sensor may be provided at the tip of the extension portion 15 and pressed with a predetermined pressure.
In addition, by setting the pressing time, it is possible to perform a short press or a long press.
As described above, according to the present invention, the operation unit 82 such as the power button can be operated by remote control from the management terminal 20.
Therefore, for example, when a restart is required at the time of inspection, the administrator or the like can cause the inspection robot 10 to operate the power button 82 to restart the robot 10 without going to the data center.

[About the configuration that automatically operates the operation unit]
In addition, the mobile device of the present invention can also cause the inspection robot 10 to automatically operate the operation unit 82 in a predetermined case.
In order to enable such an operation, the inspection robot 10 has the following configuration.

The control unit 16 operates as the extension member moving means, and when the state determination means determines that the electronic device 8 is in a predetermined state, the control unit 16 moves the extension unit 15 to a position corresponding to the operation unit 82. By moving to and operating as an extension control means, the extension member moving means extends the extension portion 15 based on the movement of the extension portion 15 to a position corresponding to the operation portion 82. The operation unit 82 is operated by letting it out.
The "predetermined state" is, for example, a state in which a restart is required immediately, for example, when an "abnormal height" is determined as a result of a state determination of a certain electronic device 8 at the time of inspection by the inspection robot 10. Can be mentioned.
The control unit 16 determines that the electronic device 8 for which such a "predetermined state" is determined is, for example, the electronic device 8 mounted at the mounting position "7 to 9" of the rack 9 of 1-1. Once specified, relative position information (20,120) can be acquired as information indicating the positional relationship between the operation unit 82 and the extension unit 15 based on the relative position table (see FIG. 17).
Next, the control unit 16 operates as the extension member moving means to move the extension unit 15 to a position corresponding to the operation unit 82 based on the information indicating the positional relationship between the operation unit 82 and the extension unit 15. Move.
Specifically, since the relative position information is (20,120), if the extension portion 15 is at the reference position, the extension portion 15 is moved 20 cm to the right and 120 cm downward from the reference position.
Therefore, when the inspection robot 10 is stopped at the position of the stop marker at the marker coordinates (1,1) and the movable base portion 17 is set at the uppermost portion, the extension portion 15 is set at the reference position. From there, the inspection robot 10 is moved 20 cm to the right and the movable base portion 17 is moved 120 cm downward, so that the extension portion 15 can be moved to a position corresponding to the position of the power button 82.
Then, the control unit 16 operates as the extension control means, and based on the fact that the extension member moving means moves the extension unit 15 to a position corresponding to the operation unit 82, the extension unit 16 The operation unit 82 is operated by extending 15.
Specifically, the extension portion 15 is extended after being moved to a position corresponding to the position of the power button 82.
As a result, the power button 82 can be pressed by the extension unit 15. For example, the power of the electronic device 8 is turned off, and after a certain period of time, the same operation is performed again to restart the electronic device 8. be able to.
In this way, when a state requiring restart such as a failure is determined during automatic inspection by the inspection robot 10, the administrator or the like automatically restarts the failure without going to the data center. Can be restored.
The captured image of the electronic device 8 before the power is turned off and the captured image of the electronic device 8 after the restart can be stored in the storage unit 11 or transmitted to the management terminal 20.
As a result, the administrator can confirm whether or not the failure or the like has been recovered by the restart via the management terminal 20.

[About position correction of the extension part]
As described above, the inspection robot 10 of the present embodiment moves the extension unit 15 to operate the operation unit 82 by remote control or automatic control at the time of inspection. An error may occur in the moving distance or the like, and it is conceivable that the operation unit 82 cannot be operated well only by the automatic control.
Therefore, in the mobile device of the present invention, the extension portion 15 is surely aligned with the position of the operation portion 82 by performing a predetermined correction operation while confirming the actual position of the extension portion 15 on the management terminal 20. It makes it possible.
In order to enable such an operation, the inspection robot 10 and the management terminal 20 have the following configurations.

The inspection robot 10 transmits to the management terminal 20 an image in which the control unit 16 can identify the position of the extension unit 15 and the position of the operation unit 82 based on the image pickup information of the electronic device 8 imaged by the image pickup unit 14. However, the management terminal 20 displays the image on the display unit 24.
Here, the "position of the extension portion" is defined by, for example, providing a light irradiation means such as a laser beam at the tip of the extension portion 15 to obtain an irradiation point of the laser light emitted from the irradiation means from the captured image. It can be specified as the position of the extension portion 15. For example, the irradiation point of the laser light can be specified based on the brightness, color, and light emitting region peculiar to the laser light.
It can also be identified from the captured image obtained by the imaging process with the extended portion 15 extended.
FIG. 18 is an image captured by the front panel 80 of the “SV2” mounted on the predetermined rack 9, which is transmitted to the tablet terminal, which is the management terminal 20, and displayed on the touch panel.
As shown in the figure, the position of the extension portion 15 (point "x") does not match the position of the operation button 82, and even if the extension portion 15 is extended in this state, the power button 82 Cannot be pressed.
Here, when the management terminal 20 performs a predetermined operation to match the position of the extension unit 15 displayed on the display unit 24, which is the display means, with the position of the operation unit 82, the control unit 25 causes the display means. Based on the position of the extension unit 15 and the position of the operation unit 82 displayed by, information indicating the positional relationship between the extension unit 15 and the operation unit 82 is acquired.
"Predetermined operation to match the position of the extension part displayed on the display part with the position of the operation part" means, for example, touching the part "x" and keeping the touched part up to the part of the power button 82. Examples include an operation of sliding to release the touch, and an operation of clicking the “x” portion and sliding to the location of the power button 82 while being clicked to release the click.
At this time, in the management terminal 20, the control unit 25 measures the sliding distance in the operation.
For example, in FIG. 18, the slide distance from point A to point B when the slide operation is performed from point A (point x) to point B (point of the power button 82) with point A as the origin is the x-axis. It is assumed that the measurement is 2 cm in the direction and 2 cm in the y-axis direction (slide distance = (2, 2)).
This "slide distance" is the distance between the extension portion 15 and the power button 82 on the touch panel of the tablet terminal, and may differ from the actual distance between the extension portion 15 and the power button 82.
Specifically, it may differ depending on the "imaging magnification" when the captured image is captured and the "display magnification" on the touch panel of the tablet terminal.
For example, when the "imaging magnification" is the same magnification (1x) and the "display magnification" is the same magnification (1x), the "slide distance" and "between the actual extension portion 15 and the power button 82" Distances "match.
In this case, the management terminal 20 transmits the "slide distance" to the inspection robot 10 as the distance actually to be moved (referred to as the actual movement distance).
If the "imaging magnification" is not the same magnification (1x) or the "display magnification" is not the same magnification (1x), the value obtained by converting the "slide distance" into the actual distance is used as the "actual moving distance". It is transmitted to the inspection robot 10.
For example, if the "imaging magnification" is 1/2x and the "display magnification" is 1x, the "slide distance" is doubled, and if the "imaging magnification" is 1x and the "display magnification" is 2x. Is the value obtained by doubling the "slide distance", and the value obtained by quadrupling the "slide distance" when the "imaging magnification" is 1/2 times and the "display magnification" is 1/2 times. Let it be the "actual distance traveled".
Next, in the inspection robot 10, the control unit 16 operates as the extension member moving means to move the extension unit 15 to a position corresponding to the position of the operation unit 82.
Specifically, when "actual movement distance = (2,2)" is received from the management terminal 20, the inspection robot 10 is moved 2 cm to the right and the movable base portion 17 is moved 2 cm upward.
Then, the control unit 16 operates as the extension control means, and based on the fact that the extension member moving means moves the extension unit 15 to a position corresponding to the operation unit 82, the extension unit 16 Extend 15
As a result, the extension portion 15 can be operated by pressing the power button 82.

As described above, according to the mobile device including the inspection robot 10 and the management terminal 20 according to the present embodiment, the electronic device 8 installed in the data center or the like is set to a predetermined route corresponding to the installation position. The inspection is performed while performing a predetermined movement along the line.
In addition, when inspecting a specific electronic device, the inspection is performed while performing a predetermined movement operation along an appropriate route corresponding to the installation position of the specific electronic device.
Therefore, the inspection of the electronic device can be performed automatically and efficiently in a short time.
Further, the operation unit 82 of the electronic device 8 can be operated by moving the extension portion 15 of the inspection robot 10 to a predetermined position and extending the extension portion 15 by remote control or automatic control at the time of inspection. ..
Therefore, a predetermined operation can be performed even if the manager or the like does not go to the site.
Further, in this case, the position of the extension portion 15 can be corrected by a predetermined operation.
Therefore, accurate operation can be performed.

Although the present invention has been described above with reference to preferred embodiments, it goes without saying that the present invention is not limited to the above-described embodiments, and various modifications can be made within the scope of the present invention.
Electronic devices are not limited to server devices, storage devices, switches, and routers, but can be any device or device that has a light emitting means that can determine the state or an operating means that can be pressed. The invention can be applied.
Further, the present invention can be applied not only to a data center but also to a facility in which an electronic device is installed, such as a base station of a telecommunications company.

The present invention can be suitably used for inspection of electronic devices in facilities where many electronic devices are installed, such as a data center.

10 Inspection robot 11 Storage unit 12 Communication unit 13 Drive unit (transportation means)
131 Drive wheels 14 Imaging unit (imaging means)
15 Extension part (extension member)
16 Control unit (movement control means, imaging control means, light emitting unit information acquisition means, state determination means, extension control means, positional relationship information acquisition means, extension member moving means)
20 Management terminal 21 Storage unit 22 Communication unit 23 Operation unit 24 Display unit (display means)
25 Control unit 8 Electronic equipment 80 Front panel 81 Light emitting unit (LED)
82 Operation unit (power button)
9 racks

Claims (6)

In a mobile device that moves a predetermined location where one or more electronic devices are installed
A movement control means for moving along a predetermined route corresponding to the installation position by causing a predetermined movement means to perform a predetermined movement operation corresponding to the installation position of the electronic device is provided.
The route includes a first route along the direction of the arrangement of the electronic devices and a second route connecting the first routes to each other.
The position information of the first position, which is the position corresponding to the installation position of the electronic device, and the position information of the second position, which is the end of the first route and is the connection portion between the first route and the second route. Equipped with a position information storage means for storing position information including and
The movement control means causes the movement means to perform a movement operation based on the position information stored in the position information storage means to move along the route, and stops at the first position. A moving device characterized in that it moves while moving. An image pickup control means for causing a predetermined image pickup means to take an image of an electronic device according to the moving operation.
A light emitting unit information acquisition means for acquiring information on a light emitting state of a light emitting unit provided in the electronic device from an image captured by the electronic device captured by the imaging means.
The mobile device according to claim 1, further comprising a state determination means for determining the state of the electronic device based on the information on the light emitting state of the light emitting unit acquired by the light emitting unit information acquisition means. .. An extension control means capable of extending a predetermined extension member toward the electronic device, and an extension control means.
A positional relationship information acquisition means for acquiring information indicating a positional relationship between the operation unit provided in the electronic device and the extension member, and
An extension member moving means capable of moving the extension member to a position corresponding to the operation unit based on the information indicating the positional relationship is provided.
The extension control means extends the extension member based on the extension member moving means moving the extension member to a position corresponding to the operation unit, thereby extending the operation unit. The mobile device according to claim 1 or 2, wherein the mobile device is operated. The extension member moving means is based on information indicating a positional relationship between the operation unit and the extension member when the state determination means determines that the electronic device is in a predetermined state. It is possible to move the ejection member to a position corresponding to the operation unit.
The extension control means extends the extension member based on the extension member moving means moving the extension member to a position corresponding to the operation unit, thereby extending the operation unit. The mobile device according to claim 3, wherein the mobile device is operated. A display means for identifiablely displaying the position of the extension member and the position of the operation unit based on the image pickup information of the electronic device imaged by the image pickup means is provided.
The extension member moving means moves the extension member to a position corresponding to the operation unit based on an operation of matching the position of the extension member displayed by the display means with the position of the operation unit. It is possible to move,
The extension control means extends the extension member based on the extension member moving means moving the extension member to a position corresponding to the operation unit, thereby extending the operation unit. Operate,
An imaging magnification specifying means for specifying an imaging magnification when the electronic device is imaged by the imaging means, and
A display magnification specifying means for specifying a display magnification when the electronic device imaged by the imaging means is displayed on the display means, and a display magnification specifying means.
A display distance calculation means for calculating a display distance, which is a display distance between the extension member and the operation unit displayed on the display means,
An actual distance calculation means for calculating an actual distance, which is an actual distance between the extension member and a position corresponding to the operation unit, based on the display distance, the imaging magnification, and the display magnification. With
The extension member moving means is the same as the extension member calculated by the actual distance calculation means based on an operation of matching the position of the extension member displayed by the display means with the position of the operation unit. The moving device according to claim 3 or 4, wherein the extending member is moved to a position corresponding to the operating portion based on an actual distance from a position corresponding to the operating portion. The mobile device according to any one of claims 3 to 5, wherein the operation unit is a power button that can turn on / off the power of the electronic device by pressing the operation unit.

Images