JP2011175336A - Device position specifying device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a device position specifying device that can simultaneously specify a plurality of locations in a wide range and at a low cost. <P>SOLUTION: The device position specifying device includes: a device specifying information storage part 35 for storing device specifying information that is transmitted from a TV set 10A, an air-conditioner 10B and a compo 10C, or the like; a device operation detection part 34 for detecting operating condition of each of the devices; an image storage part 31 for storing image information that is output from an omnidirectional camera 2 for photographing each of the devices; and a device position specifying part 36 for specifying the positions of each of the devices based on the device specifying information stored in the device specifying information part 35, the operating condition of each of the devices, the condition being detected by the device operation detection part 34 and the image information stored in the image storage part 31. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a device location specifying apparatus suitable for use in a housing facility that can collectively operate home appliances such as a television, an air conditioner, and a component connected to a network from a remote location.

2. Description of the Related Art Conventionally, for example, a technique described in Patent Document 1 is known as a technique for specifying the position of a home appliance in the above-described housing facility. Patent Document 1 describes a technique for identifying each of a large number of network connection devices (hereinafter referred to as “devices”) on a network using a light emitting means. The processing flow is shown below.
1. The light emitting element of the device is caused to emit light from the management terminal.
2. The position is obtained by receiving the emitted light.
3. Associate the obtained position with the device.

JP 2008-198209 A

However, the prior art described in Patent Document 1 described above has the problems listed below.
1) Since each element of light emission / light reception is required for specifying the position of the device, the cost increases.
2) Since the light emitting element needs to be located at a position where the management terminal can receive light, the range in which the position of the device can be specified is limited.
3) Since the position is detected only by the presence or absence of light emission, a plurality of devices cannot be specified simultaneously.

  The present invention has been made in view of such circumstances, and is capable of specifying the position of a wide range of devices, simultaneously specifying the positions of a plurality of devices, and realizing the position of the devices at a low cost. The purpose is to provide.

  The device position specifying device of the present invention stores a device specifying information storing unit for storing device specifying information, a device operation detecting unit for detecting the operation status of the device, and image information output from at least a camera for photographing the device. Based on the image storage unit, the device identification information stored in the device identification information storage unit, the operation status of the device detected by the device operation detection unit, and the image information stored in the image storage unit A device position specifying unit for specifying the position of the device.

  According to the said structure, the position of the apparatus in the area | region which can be image | photographed with a camera can be pinpointed. In addition, since the position of the device is detected by the camera, a plurality of devices can be specified simultaneously. In addition, since it is not necessary to provide the device with a means for specifying the position (“light emitting element” in the above-described conventional technology), the cost can be reduced.

  In the above configuration, the device position specifying unit acquires the device specifying information corresponding to the device detected by the device operation detecting unit from the device specifying information storage unit, and stores the image based on the acquired device specifying information. The position of the device is specified from the image information stored in the section.

  According to the above configuration, since the position of the device is specified from the image information stored in the image storage unit based on the acquired device specifying information, it is possible to specify the position of the device within the area that can be captured by the camera.

  In the above configuration, the apparatus further includes a device position storage unit that stores the position of the device specified by the device position specifying unit, and the position of the device stored in the device position storage unit is specified by the device position specifying unit. It is updated when the operation is performed again at an arbitrary timing.

  According to the above configuration, since the position of each device is updated by the specific operation of the device position specifying unit being performed again at an arbitrary timing, the latest device position information can always be accumulated, and the error of the device can be stored. No recognition or misoperation occurs.

  In the above-described configuration, the device is an image display device having a function of displaying an image, and the device specifying information includes the change in the screen of the image display device, the color information of the screen, and the image display based on the information. It includes information indicating a method for detecting the position of the device.

  According to the above configuration, the position of the device can be reliably specified based on the unique information of the image display device such as a television.

  In the above configuration, the device is a device having a portion that is movable during operation, and the device identification information is a method of detecting the position of the device based on the movement of the movable portion of the device and the movement of the movable portion. Information to be included.

  According to the said structure, the position of this apparatus can be pinpointed reliably based on the motion of this movable part of apparatuses which have movable parts (louver etc.), such as an air-conditioner.

  In the above configuration, the device specifying information includes information specifying a person's movement and a direction in which at least a part of the person's body is facing.

  According to the said structure, the position of the apparatus which a person is going to operate can be pinpointed reliably.

  The device position specifying method of the present invention stores a device specifying information storing step for storing device specifying information, a device operation detecting step for detecting an operation state of the device, and storing at least image information output from a camera for photographing the device. Based on the image storing step, the device specifying information stored in the device specifying information storing step, the operation status of the device detected in the device operation detecting step, and the image information stored in the image storing step. And a device position specifying step for specifying the position of the device.

  According to the above method, it is possible to specify the position of the device within the area that can be photographed by the camera. In addition, since the position of the device is detected by the camera, a plurality of devices can be specified simultaneously. In addition, since it is not necessary to provide the device with a means for specifying the position (“light emitting element” in the above-described conventional technology), the cost can be reduced.

  The device position specifying program according to the present invention includes a device specifying information storing step for storing device specifying information in a computer, a device operation detecting step for detecting an operation state of the device, and at least image information output from a camera for photographing the device. Based on the image storing step to be stored, the device specifying information stored in the device specifying information storing step, the operation status of the device detected in the device operation detecting step, and the image information stored in the image storing step. And a device position specifying step for specifying the position of the device.

  According to the above program, it is possible to specify the position of a device within an area that can be photographed by a camera. In addition, since the position of the device is detected by the camera, a plurality of devices can be specified simultaneously. In addition, since it is not necessary to provide the device with a means for specifying the position (“light emitting element” in the above-described conventional technology), the cost can be reduced.

  According to the present invention, the position of devices can be specified over a wide range, the positions of a plurality of devices can be specified simultaneously, and the positions of devices can be specified at low cost.

1 is a block diagram showing a schematic configuration of a device position specifying device according to an embodiment of the present invention. The schematic diagram which shows an example which installed the apparatus positioning device of FIG. 1 in the house The sequence diagram which shows the process between a television and a server when a television is connected to the network of the apparatus position specific device of FIG. 1, and the figure which shows an example of the content of the apparatus specific information and apparatus specific information storage part of a television The figure which shows an example of the apparatus position information accumulate | stored in the apparatus position storage part of the apparatus position specific device of FIG. The figure which showed typically the position specification of the television by the apparatus position specification apparatus of FIG. Sequence diagram showing in detail the process shown in FIG. The figure which showed typically the position specification of the air-conditioner by the apparatus position specification apparatus of FIG. The figure which showed typically the position specification of the component by the apparatus position specification apparatus of FIG. It is a figure which shows an example of the position detection result by the gesture accumulate | stored in the apparatus position storage part of the apparatus position specification apparatus of FIG. 1, (a) is the 1st position detection result, (b) is the 2nd position detection result. The figure which shows the position in the 500 * 500 image of the position estimation result of FIG.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Hereinafter, preferred embodiments for carrying out the invention will be described in detail with reference to the drawings.

  FIG. 1 is a block diagram showing a schematic configuration of a device position specifying device according to an embodiment of the present invention. In the figure, an apparatus position specifying device 1 according to the present embodiment includes an omnidirectional camera 2 and a server 3 that specifies the position of each apparatus based on image information including an image of the apparatus taken by the omnidirectional camera 2. It has. In the present embodiment, the device whose position is to be specified is a home appliance such as a television, an air conditioner, and a component, but these are simply referred to as “devices”. The camera, server, and device are connected via a network (wired / wireless).

  The omnidirectional camera 2 captures all azimuths of 360 degrees in the horizontal direction and about 120 degrees in the vertical direction and outputs image information. The server 3 includes an image storage unit 31, a person detection unit 32, a gesture detection unit 33, a device operation detection unit 34, a device specification information storage unit 35, a device position specification unit 36, and a device position storage unit 37. The device position update unit 38, the device operation determination unit 39, and the device operation unit 40 are configured.

  The image storage unit 31 stores at least the image information output from the omnidirectional camera 2 that captures the device. The person detection unit 32 extracts a person region from the image information stored in the image storage unit 31 by background difference processing, and detects a person from the extracted person region by template matching. The gesture detection unit 33 detects the gesture of the person detected by the person detection unit 32, that is, the gesture gesture. The device operation detection unit 34 detects the operation status of the device 10. For example, when the device 10 is operated or notifies the device operation detection unit 34 of the device state and the operation content at regular time intervals, for example, the device 10 is turned on or turned off. Detect whether or not

The device specifying information storage unit 35 stores device specifying information transmitted from the device 10 in advance. Examples of device specifying information include those listed below.
(1) Device shape and color information (2) Changes in visible information (lighting, display LED (light emitting diode), screen, etc.) during device operation (3) Operating parts during device operation (louvers of air conditioners, CDs and DVDs) (4) Human movement information (face orientation, remote control operation, arm orientation during switch operation, etc.)
(5) Audio information during device operation (radio sound, etc.)
The device identification information is transmitted from the device 10 to the server 3 when the device 10 is connected to the server 3 and accumulated in the device identification information storage unit 35. Note that the device 10 may transmit only the type (TV, air conditioner, component, etc.) to the server 3, and the server 3 may acquire device specifying information from a database (not shown). By doing in this way, the structure by the side of the apparatus 10 can be simplified.

  FIG. 2 is a schematic diagram illustrating an example in which the device position specifying device 1 according to the present embodiment is installed in a house 100. The house 100 shown in the figure includes devices such as a television 10A, an air conditioner 10B, a component 10C, and a lighting fixture 10D. These devices 10A to 10D are connected to the server 3 through a HUB (concentrator) 4 connected to the network. By connecting each device 10A to 10D to the network (NW), the device specifying information is transmitted to the server 3 from each device 10A to 10D. That is, the device specifying information related to this is transmitted from the television 10A to the server 3, the device specifying information related to this is transmitted from the air conditioner 10B to the server 3, and the device specifying information related to this is transmitted from the component 10C to the server 3. The illumination device 10D transmits device identification information related to this to the server 3. In addition, the code | symbol 5 in FIG. 2 shows a user (or person).

  FIG. 3 is a sequence diagram showing processing between the TV 10A and the server 3 when the TV 10A is connected to the network of the device position specifying device 1, and the contents of the device specifying information and the device specifying information storage unit 35 of the TV 10A. It is a figure which shows an example. In the figure, when the user 5 connects the TV 10 </ b> A to the network of the device position specifying device 1, the TV 10 </ b> A transmits its device specifying information to the server 3. When the server 3 receives the device specifying information transmitted from the television 10A, the server 3 assigns a management ID (for example, TV001) to the device specifying information and stores it in its own device specifying information storage 35. Thereafter, the management ID is notified to the television 10A. As shown in FIG. 3, the device identification information storage unit 35 stores the device identification information of the air conditioner 10B received before the device identification information from the television 10A. AC001 is assigned to this air conditioner 10B as a management ID.

  The device identification information of the TV 10A is composed of “home appliance type”, “position detection information”, and “position detection method”, the home appliance type is “TV”, and the position detection information is “screen change, screen color / luminance information”. The position detection method is “difference between frames”. Two criteria are provided for the determination method of the position detection method. The reference 1 uses a total of 0.5 seconds before and after the power-on notification, and the reference 2 uses 0.5 seconds before and after the power-off notification. A total of 1 second is used.

  Returning to FIG. 1, the device position specifying unit 36 includes the device specifying information stored in the device specifying information storing unit 35, the operation status of the device 10 detected by the device operation detecting unit 34, and the image stored in the image storing unit 31. The position of the device 10 is specified based on the information. The device position storage unit 37 stores the position of the device 10 specified by the device position specifying unit 36 as device position information. FIG. 4 is a diagram illustrating an example of device position information stored in the device position storage unit 37. In the example shown in the figure, device position information of the air conditioner 10B (ID = AC001) and the television 10A (ID = TV001) is accumulated. In this example, the device position is a position in an image of 500 × 500, the position of the air conditioner 10B is (20,400), and the position of the television 10A is (100,200). In the air conditioner 10B, the operation is “do not blow the person directly”, and in the television 10A, the power is turned on when approaching. When the position information is finally detected, “2009/11/12, 19:15:15” is set for the air conditioner 10B, and “2009/4/4, 14:13:43” is set for the television 10A.

  Returning to FIG. 1, the device position update unit 38 updates the device position information stored in the device position storage unit 37 when the specific operation by the device position specifying unit 36 is performed again at an arbitrary timing. In this case, the update frequency may be changed depending on the device (for example, the air conditioner 10B is every other year, the fan is every other day, etc.). If there is a change in another device, the device position may be re-detected in consideration of the pattern change. The device operation determination unit 39 compares the device position information stored in the device position storage unit 37 with the person position when a person is detected by the person detection unit 32, and determines whether or not operation of the device is necessary. To do. The device operation unit 40 operates the device 10 determined by the device operation determination unit 39 as requiring device operation. For example, when a person is detected near the air conditioner, the air blowing direction is controlled so that wind is not directly applied to the detected person.

  Next, the operation of the device position specifying device 1 of the present embodiment will be described. FIG. 5 is a diagram schematically showing the position specification of the television 10 </ b> A by the device position specifying device 1. In the figure, when the user 5 connects the TV 10A to the network of the device position specifying device 1, the TV 10A communicates with the server 3 and transmits its own device specifying information. This device specifying information includes device name: TV, position detection information: screen change and screen color and luminance information, position detection method: interframe difference (1 second), and color determination. It should be noted that the position detection method shown in this figure is a simplified description of the position detection method shown in FIG.

  The device specifying information storage unit 35 receives and stores the device specifying information transmitted from the television 10A. After the device identification information is transmitted from the television 10A, the user 5 turns on the power of the television 10A, so that the device operation detection unit 34 detects that the power of the television 10A is turned on, and the device position identification unit 36 Notify The image storage unit 31 stores image information obtained by photographing all directions including image information of the television 10 </ b> A, and the device position specifying unit 36 identifies the device from the image information stored in the image storage unit 31. The detection method of the television 10A is determined based on the device identification information of the television 10A stored in the information storage unit 35. At this time, whether or not the television 10A is used is determined by taking the difference between frames of the stored image information (1 second) and changing the color and brightness of the image information. Thus, when the detection area of the television 10A is detected, the detected area and the television 10A are associated with each other, and the position of the television 10A is specified. Then, the specified position of the television 10 </ b> A is stored in the device position storage unit 37.

  Here, for example, when a person is walking in a room when the TV is turned on, a plurality of changes (the TV is turned on and the person is moved) are detected when the difference between frames is taken. Even in such a case, it can be seen from the device identification information that the brightness is increased when the TV is turned on, so that it is possible to distinguish whether the detected change is a television or a person.

  FIG. 6 is a sequence diagram showing the above process in detail. In the figure, the user 5 turns on the power of the television 10A. Thereby, the television 10A displays a screen and notifies the server 3 that the power is turned on (the device ID of the television 10A is TV001). When the server 3 receives and accumulates images transmitted from the omnidirectional camera 2 at regular intervals and receives a power-on notification from the television 10A during that time, the server 3 searches for the device identification information of the television 10A, and If there is device specifying information to be acquired, the images from time t1 (0.5 seconds before notification) to time t2 (0.5 seconds after notification) that have already been accumulated are acquired. After acquiring the image, the position of the television 10A is detected based on the reference 1 (when the power is turned on) in accordance with the position detection method included in the device specifying information of the television 10A. Then, the detected position of the television 10A, that is, device position information is stored in the device position storage unit 37. Thereafter, the television 10A is notified that the position of the device has been specified.

  Once the position of the television 10A is specified, for example, when the user 5 approaches the television 10A the next day, the server 3 detects the position of the person from the image from the omnidirectional camera 2, and refers to the device position storage unit 37. Then, the position of the television 10A and the position of the person are compared, and if the comparison result can be assumed that the person turns on the power of the television 10A, the device ID = TV001 is notified of the power on. In response to this notification, the television 10A turns on its own power and displays a screen.

  In this way, the position of the television 10A is identified based on the device identification information of the television 10A, the operation status of the television 10A, and the image information from the omnidirectional camera 2 including the image of the television 10A. After the identification, if a person is detected from the image information from the omnidirectional camera 2 and the person is compared with the position of the television 10A and it is determined that the person is approaching the television 10A, the power of the television 10A is determined. Set to ON.

  Next, FIG. 7 is a diagram schematically illustrating the position specification of the air conditioner 10 </ b> B by the device position specifying device 1. In the figure, when the user 5 connects the air conditioner 10B to the network of the device position specifying device 1, the air conditioner 10B communicates with the server 3 and transmits its own device specifying information. This device specifying information includes device name: air conditioner, position detection information: louver movement, position detection method: interframe difference (10 seconds).

  The device specifying information storage unit 35 receives and stores the device specifying information transmitted from the air conditioner 10B. After the device specifying information is transmitted from the air conditioner 10B, the user 5 turns on the air conditioner 10B, so that the device operation detecting unit 34 detects that the air conditioner 10B is turned on, and the device position specifying unit 36 is turned on. Notify The image storage unit 31 stores image information obtained by photographing all directions including the image information of the air conditioner 10 </ b> B, and the device position specifying unit 36 identifies the device from the image information stored in the image storage unit 31. The detection method of the air conditioner 10B is determined based on the device identification information of the air conditioner 10B stored in the information storage unit 35. That is, the detection area of the air conditioner 10B is detected using the inter-frame difference (10 seconds). At this time, whether or not the air conditioner 10B is used is determined from the movement of the louver 10Br of the air conditioner 10B. In the device identification information, it is described that the movement of the louver 10Br is, for example, a periodic movement. Therefore, the device position specifying unit 36 obtains an area that periodically moves from the image for 10 seconds after the power is turned on, and detects that there is an air conditioner there. When the detection area of the air conditioner 10B can be detected in this manner, the detected area and the air conditioner 10B are associated with each other to identify the position of the air conditioner 10B. Then, the specified position of the air conditioner 10 </ b> B is stored in the device position storage unit 37. The details of the processing in the air conditioner 10B are substantially the same as the processing shown in the sequence diagram of FIG.

  Next, FIG. 8 is a diagram schematically showing the position specification of the component 10 </ b> C by the device position specifying device 1. In this figure, when the user 5 connects the component 10C to the network of the device position specifying device 1, the component 10C communicates with the server 3 and transmits its own device specifying information. This device identification information is composed of device name: component, position detection information: human movement, position detection method: direction in which the arm is facing.

  The device specifying information storage unit 35 receives and stores the device specifying information transmitted from the component 10C. After the device identification information is transmitted from the component 10C, the user 5 operates the remote controller 10Cr of the component 10C to turn on the component 10C, so that the device operation detection unit 34 turns on the component 10C. Is detected and notified to the device position specifying unit 36. The image storage unit 31 stores image information obtained by photographing all directions including the image information of the component 10 </ b> C, and the device position specifying unit 36 specifies a device from the image information stored in the image storage unit 31. The component 10C detection method is determined based on the device identification information of the component 10C stored in the information storage unit 35. That is, person detection by the person detection unit 32 and gesture recognition of the person by the gesture detection unit 33 are performed on the images before and after the power is turned on, and the detection area of the component 10C is detected. At this time, whether or not the component 10C is determined from the movement of the person holding the remote controller 10Cr, and it is determined that the component 10C is in the direction in which the arm is facing. When the detection area of the component 10C can be detected in this manner, the position of the component 10C is specified by associating the detected detection area with the component 10C. Then, the position of the identified component 10C is stored in the device position storage unit 37.

  Thus, the position detection of component 10C is performed by person detection and gesture recognition. In the case of FIG. 7, by performing a gesture that the detected person turns his arm, the gesture is recognized, and there is a detection area in the direction in which the arm is facing, and the detection area is associated with the combo 10C.

  Here, the position specification of the component 10C will be described in detail. FIG. 9 is a diagram illustrating an example of the position detection result by the gesture accumulated in the device position accumulation unit 37, where (a) shows the first position detection result and (b) shows the second position detection result. FIG. 10 is a diagram showing the position in the 500 × 500 image of the position estimation result of FIG. The component ID of the component 10C is “AU001”, and the operation is “volume adjustment according to the distance to the person”. The first detection result is the start point (240, 250) and the direction (2, 1), and the device position (370, 315) that can be estimated is from the person (start point: 240, 250) to the direction of the person's arm (2 , 1) is the midpoint P1 of the image end of the line segment. The second detection result is the start point (400, 150) and the direction (0, 1), and the intersection P2 between the first line segment and the second line segment is estimated as the device position (400, 330). From the third time onward, a point closer to the intersection is estimated. Further, data past a certain time may be discarded or the weighting may be lowered. Here, for the sake of simplicity, the estimation using the line segment is performed, but the estimation using the image after panorama development may be performed in consideration of the distortion of the entire surrounding image.

  In addition, although the example of operation with a remote control was demonstrated, about the type of apparatus which operates the switch of an apparatus main body directly, you may recognize the gesture in which a person operates the switch of a main body directly. In that case, what is necessary is just to presume that the front-end | tip part of a hand is not an arm peeling direction but an apparatus position. In the case of a device that has both the remote control and device switch functions, the device operation detection is also performed with information on whether the device is operated by the remote control or when the device switch is operated directly when the device is operated. By transmitting to the unit, the device position specifying unit can switch the estimation method.

  In FIG. 9, since “motion” is “volume adjustment according to the distance of the person”, after specifying the position of the component 10 </ b> C, the device operation determination unit 39 is based on the image information from the omnidirectional camera 2. The distance between the user 5) and the position of the component 10C is measured, and a command is given to the device operating unit 40 in order to set the volume corresponding to the measured distance. The device operation unit 40 sets the volume of the component 10 </ b> C according to a command from the device operation determination unit 39.

  Thus, according to the device position specifying apparatus 1 of the present embodiment, the device specifying information storage unit 35 that stores device specifying information transmitted from devices such as the TV 10A, the air conditioner 10B, and the component 10C, the TV 10A, the air conditioner 10B, a component operation detection unit 34 that detects the operation status of components such as the component 10C, and an image storage unit that accumulates image information output from the omnidirectional camera 2 that captures devices such as the television 10A, the air conditioner 10B, and the component 10C. 31, the device identification information stored in the device identification information storage unit 35, the operation status of devices such as the television 10 </ b> A, the air conditioner 10 </ b> B, the component 10 </ b> C detected by the device operation detection unit 34, and the image storage unit 31. And a device position specifying unit 36 for specifying the position of devices such as the television 10A, the air conditioner 10B, and the component 10C based on the image information. , TV 10A in the region that can be captured by the omnidirectional camera 2, air conditioning 10B, it is possible to specify the position of all devices 10, such as a component 10C. Further, since the position of the device 10 such as the television 10A, the air conditioner 10B, the component 10C, etc. is detected by the omnidirectional camera 2 and the position is detected based on the device specifying information, the device can be used even when image changes are detected at a plurality of locations at the same time. Since it is possible to determine which device each change corresponds to based on the specific information, a plurality of devices 10 can be specified simultaneously. In addition, since it is not necessary to provide means for specifying the position (“light emitting element” in the above-described conventional technology) in devices such as the television 10A, the air conditioner 10B, and the component 10C, the cost can be reduced.

  In addition, a device position storage unit 37 that stores the positions of devices such as the television 10A, the air conditioner 10B, and the component 10C specified by the device position specifying unit 36, and the television 10A, the air conditioner 10B, and the component that are stored in the device position storage unit 37 are stored. Since the device position updating unit 38 that updates the position of a device such as 10C by updating the specific operation of the device position specifying unit 36 at an arbitrary timing is provided, the latest device position information is always accumulated. It is possible to prevent erroneous recognition and operation of the device.

  Further, the update timing may be changed depending on the device. For example, an air conditioner that is unlikely to change its position after installation is detected every year. As a result, the number of recognition processes can be reduced.

  In the above embodiment, the component 10C position detection method is the direction in which the arm of the user 5 is facing. However, such a detection method is not limited to the component 10C, and the television 10A or the air conditioner 10B is also used. Can be used similarly. The reverse is also possible, and the position detection method of the component 10C can be used for the television 10A or the air conditioner 10B. The position detection method described with reference to FIGS. 5 to 8 described above is only one form and is not limited.

  The present invention has the effect that the position of a device can be specified in a wide range, the position of a plurality of devices can be specified simultaneously, and the position of the device can be realized at low cost. It can be applied to residential equipment that can be operated collectively from a remote location of home appliances such as components.

1 equipment location device 2 omnidirectional camera 3 server 4 HUB
5 users (persons)
DESCRIPTION OF SYMBOLS 10 apparatus 10A TV 10B air conditioner 10Br louver 10C component 10Cr remote control 31 image storage part 32 person detection part 33 gesture detection part 34 apparatus operation | movement detection part 35 apparatus specific information storage part 36 apparatus position specification part 37 apparatus position storage part 38 apparatus position update part 39 Device operation determination unit 40 Device operation unit

Claims (8)

A device identification information storage unit for storing device identification information;
A device operation detector for detecting the operation status of the device;
An image storage unit that stores image information output from a camera that captures at least the device;
The position of the device is determined based on the device identification information stored in the device identification information storage unit, the operation status of the device detected by the device operation detection unit, and the image information stored in the image storage unit. A device location identifying unit to identify;
Equipment location device with The device location specifying unit
The device specifying information corresponding to the device detected by the device operation detecting unit is acquired from the device specifying information storage unit, and the device is obtained from the image information stored in the image storage unit based on the acquired device specifying information. The apparatus position specifying device according to claim 1, wherein the position of the apparatus is specified.   A device position storage unit that stores the position of the device specified by the device position specifying unit is further included, and the position of the device stored in the device position storage unit may be determined by the specifying operation of the device position specifying unit. The device position specifying device according to claim 1, wherein the device position specifying device is updated by being performed again at a timing. The device is an image display device having a function of displaying an image,
The device according to claim 1, wherein the device identification information includes information indicating a method of detecting a position of the image display device based on information on a screen change or a screen color of the image display device. Positioning device. The device is a device having a portion that moves during operation,
The device position specifying device according to claim 1, wherein the device specifying information includes information indicating a method for detecting a position of the device based on a movement of a movable part of the device.   The device position specifying device according to claim 1, wherein the device specifying information includes information specifying a direction in which a part of a person's body is facing. A device identification information storage step for storing device identification information;
A device operation detection step for detecting the operation status of the device;
An image accumulating step for accumulating at least image information output from a camera for photographing the device;
Based on the device identification information accumulated in the device identification information accumulation step, the operation status of the device detected in the device operation detection step, and the image information accumulated in the image accumulation step, the position of the device is determined. A device location step to identify;
Device location method with On the computer,
Device identification information accumulation step for accumulating device identification information;
Device operation detection step for detecting the operation status of the device,
An image accumulating step for accumulating image information output from a camera that captures at least the device;
Based on the device identification information accumulated in the device identification information accumulation step, the operation status of the device detected in the device operation detection step, and the image information accumulated in the image accumulation step, the position of the device is determined. Equipment location step to identify,
An equipment location program that executes

Images