JP2014026397A - Display control device, display control method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To inhibit a user who is not authorized to use a content from furtively glancing at the content.SOLUTION: A display control device connected with a display device comprises: a reception unit which receives detection data from an acceleration sensor, an angular velocity sensor and a geomagnetic sensor carried by a user in a control target area, respectively; a position detection unit which detects a position of the user in the control target area on the basis of the detection data; a motion detection unit which detects motion of the user on the basis of the detection data; and a display control unit which controls display of display information on the display device on the basis of the detected user position and motion.

Description

  The present invention relates to a display control device, a display control method, and a program.

  Today, security is extremely important. For example, there is confidential content that can only be shown to a specific user. For such content, security is managed so that only authorized users who have access rights are given login IDs and passwords, and unauthorized users who do not have access rights are not allowed to use or view it. The

  However, even if content security management is performed using a login ID or password, if an authorized user displays the content on a display or the like after logging in, there is a possibility that the unauthorized user may see it. As described above, there is a problem that the security is not sufficiently managed only by the login ID and the password.

  The present invention has been made in view of the above, and an object of the present invention is to provide a display control device, a display control method, and a program that can prevent a user who is not permitted to use the content from stealing the content. To do.

  In order to solve the above-described problems and achieve the object, the present invention is a display control device connected to a display device, each of an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor possessed by a user in a control target area. A detection unit that receives detection data from the detection unit, a position detection unit that detects the position of the user in the control target area based on the detection data, and an operation of the user based on the detection data An operation detection unit, and a display control unit that controls display of display information on the display device based on the detected position and operation of the user are provided.

  In addition, the present invention provides a reception step of receiving detection data from each of an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor possessed by a user in the control target area, and based on the detection data, A position detecting step for detecting the position of the user; an operation detecting step for detecting the user's action based on the detection data; and display of display information on the display device based on the detected position and action of the user. A display control step for controlling the display.

  In addition, the present invention provides a computer connected to a display device based on the detection data, a receiving unit that receives detection data from each of an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor possessed by a user in a control target area. A position detection unit that detects the position of the user in the control target region, an operation detection unit that detects the user's operation based on the detection data, and the detected position and operation of the user. And a display control unit that controls display of display information on the display device.

  According to the present invention, there is an effect that it is possible to prevent a user who is not permitted to use the content from stealing the content.

FIG. 1 is a network configuration diagram of the device control system according to the present embodiment. FIG. 2 is a diagram in which a smartphone and a sensor are mounted and defined. FIG. 3 is a diagram illustrating an example in which an information device capable of detecting human movement is mounted separately from a smartphone. FIG. 4 is a diagram illustrating a direction detected by each sensor. FIG. 5 is a diagram illustrating an example of an installation state of the monitoring camera. FIG. 6 is a diagram illustrating an example of an installation state of LED lighting devices, taps, and air conditioners. FIG. 7 is a block diagram illustrating a functional configuration of the positioning server device. FIG. 8 is a diagram illustrating waveforms of acceleration components in the vertical direction when the sitting operation and the standing operation are performed. FIG. 9 is a diagram illustrating a waveform of the angular velocity component in the horizontal direction when the squatting operation and the standing operation are performed, respectively. FIG. 10 is a diagram illustrating a waveform of the angular velocity component in the vertical direction when the operation of changing the direction in a stationary state is performed. FIG. 11 is a diagram illustrating a waveform of the angular velocity component in the horizontal direction of the head when the eye is removed from the display in the seated state. FIG. 12 is a diagram illustrating a waveform of the angular velocity component in the horizontal direction of the head when the line of sight is removed from the display in a sitting state. FIG. 13 is a block diagram illustrating a functional configuration of the control server device according to the present embodiment. FIG. 14 is a flowchart illustrating a procedure of detection processing by the positioning server device according to the present embodiment. FIG. 15 is a flowchart illustrating the procedure of the device control process according to the present embodiment. FIG. 16 is a flowchart illustrating an example of a procedure of display control processing according to the present embodiment. FIG. 17 is a diagram illustrating an example of a positional relationship between the positioning server device, the PC, and the user. FIG. 18 is a diagram for explaining an example of the display control process. FIG. 19 is a diagram for explaining an example of screen display control. FIG. 20 is a diagram for explaining an example of screen display control. FIG. 21 is a diagram for explaining an example of screen display control. FIG. 22 is a diagram for explaining an example of screen display control. FIG. 23 is a diagram for explaining an example of screen display control. FIG. 24 is an explanatory diagram illustrating a hardware configuration example of the apparatus according to the present embodiment.

  Exemplary embodiments of a display control device, a display control method, and a program according to the present invention will be explained below in detail with reference to the accompanying drawings.

  Patent Document 1 proposes a technique for determining a specified range centering on display content and performing display control when an unauthorized user exists within the specified range. However, with this technology, there is a possibility that content is stolen from unauthorized users from a location outside the specified range. On the contrary, there is a problem in that display control is performed even when there is a person (user) who passes within the specified range but does not steal the content.

  Therefore, the display control device of the present embodiment controls the display of content (display information) according to the position and operation of the unauthorized user on the display device. For example, based on the moving speed when moving in front of the display device, it is estimated whether the unauthorized user is stealing or passing, and if it is determined that the user is passing, display control is not performed. When the moving speed is slower than the specific speed, display control is performed. Further, display control is performed if there is an unauthorized user in the vicinity of the authorized user. As described above, in the present embodiment, by considering the position and operation of the unauthorized user, for example, the problem of the prior art that display control is performed even if it is passed is solved, and unnecessary display control is suppressed and the authorized user is suppressed. Realize content sneak prevention without imposing a load.

  Below, the example which implement | achieves the display control apparatus of this embodiment as a one part apparatus of the apparatus control system which controls the electric power of an apparatus according to a user's position etc. is demonstrated. The applicable system is not limited to such a device control system.

  FIG. 1 is a network configuration diagram of the device control system according to the present embodiment. As shown in FIG. 1, the device control system of the present embodiment includes a plurality of smartphones 300, a plurality of monitoring cameras 400 as imaging devices, a positioning server device 100 as a display control device, and a control server device 200. , A plurality of LED lighting devices 500 as devices to be controlled, a plurality of taps 600 and a plurality of air conditioners 700, a PC (personal computer) 800, and a display unit 850 as a display device.

  The PC 800 is a device for a user to perform operations such as content display. The display unit 850 is connected to the PC 800 and displays content according to a user instruction or the like. In addition, the form of the apparatus for displaying the content is not limited to these. For example, a notebook PC in which the PC 800 and the display unit 850 are integrated may be used. The PC 800 and the positioning server device 100 are connected by a wireless communication network such as Wi-Fi (Wireless Fidelity), for example. Note that the wireless communication method is not limited to Wi-Fi. Further, the PC 800 and the positioning server device 100 may be connected by wire.

  The plurality of smartphones 300, the plurality of monitoring cameras 400, and the positioning server device 100 are connected by a wireless communication network such as Wi-Fi, for example. Note that the wireless communication method is not limited to Wi-Fi. Moreover, the monitoring camera 400 and the positioning server apparatus 100 may be connected with a wire.

  The positioning server device 100 and the control server device 200 are connected to a network such as the Internet or a LAN (Local Area Network).

  In addition, the control server device 200, a plurality of LED (Light Emitting Diode) lighting devices 500, a plurality of taps 600, and a plurality of air conditioners 700 are connected by a wireless communication network such as Wi-Fi, for example.

  The communication method between the control server device 200, the plurality of LED lighting devices 500, the plurality of taps 600, and the plurality of air conditioners 700 is not limited to Wi-Fi, and other wireless communication methods are used. In addition, a wired communication system such as an Ethernet (registered trademark) cable or PLC (Power Line Communications) may be used.

  The smartphone 300 is an information device that is carried by a human and detects human movement. FIG. 2 is a diagram illustrating a wearing state of the smartphone 300. In addition to being held by a human hand or the like, the smartphone 300 may be worn on the human waist as shown in FIG.

  Returning to FIG. 1, each of the smartphones 300 is equipped with an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor, and transmits detection data from each sensor to the positioning server device 100 at regular intervals such as 1 second. Yes. Here, the detection data of the acceleration sensor is an acceleration vector. The detection data of the angular velocity sensor is an angular velocity vector. The detection data of the geomagnetic sensor is a magnetic orientation vector.

  In the present embodiment, the smartphone 300 is used as an information device that detects a human motion. However, if the information device includes an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor, the smartphone 300 can be used. It is not limited to mobile terminals.

  In addition, the smartphone 300 includes information devices that detect human movements such as an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor, and the information devices that detect human movements may be mounted separately from the smartphone 300. Good.

  For example, FIG. 3 is a diagram illustrating an example in which an information device capable of detecting human movement is mounted separately from the smartphone 300. As illustrated in FIG. 3, separately from the smartphone 300, a small headset type sensor group 301 including an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor can be attached to the head. In this case, the detection data detected by the sensor group 301 can be transmitted directly to the positioning server device 100 via the smartphone 300 in addition to being directly transmitted to the positioning server device 100 by the sensor group 301. As described above, by attaching the sensor group 301 to the human head separately from each sensor of the smartphone 300, various posture detections can be performed.

  FIG. 4 is a diagram illustrating a direction detected by each sensor. FIG. 4A shows directions detected by the acceleration sensor and the geomagnetic sensor. As shown in FIG. 4A, the acceleration sensor and the geomagnetic sensor can detect the traveling direction, the vertical direction, the horizontal direction acceleration component, and the geomagnetic direction component, respectively. FIG. 4B shows an angular velocity vector A detected by the angular velocity sensor. Here, the arrow B indicates the positive direction of the angular velocity. In the present embodiment, the projection of the angular velocity vector A onto the traveling direction, the vertical direction, and the horizontal direction shown in FIG. 4A is considered, and the angular velocity component in the traveling direction, the angular velocity component in the vertical direction, and the angular velocity component in the horizontal direction, respectively. That's it.

  Returning to FIG. 1, the monitoring camera 400 captures an image of a room that is a control target area, and is installed near an upper portion of the room that is a control target area. FIG. 5 is a diagram illustrating an example of an installation state of the monitoring camera 400. In the example of FIG. 5, although installed in two places near the door in the room, it is not limited to this. The monitoring camera 400 images a room that is a control target area, and transmits the captured image (captured video) to the positioning server device 100.

  Returning to FIG. 1, in the present embodiment, the illumination system, the tap system, and the air conditioning system are targeted for power control. A plurality of LED lighting devices 500 as a lighting system, a plurality of taps 600 as a tap system, and a plurality of air conditioners 700 as an air conditioning system are targeted for power control.

  The plurality of LED lighting devices 500, the plurality of taps 600, and the plurality of air conditioners 700 are installed in a room that is a control target area. FIG. 6 is a diagram illustrating an example of an installation state of the LED lighting device 500, the tap 600, and the air conditioner 700.

  As shown in FIG. 6, one group is formed by six desks in the room, and three groups are provided. One LED lighting device 500 and one tap 600 are provided for each desk. On the other hand, one air conditioner 700 is provided between two groups. In addition, arrangement | positioning of such LED lighting apparatus 500, the tap 600, and the air conditioner 700 is an example, and is not limited to the example shown in FIG.

  Although not shown in FIG. 6, the sum total information of the total power in the room according to the present embodiment can be grasped by the grid power measuring device installed outside the room.

  In the room, 18 users are performing specific business activities, and the entrance to and exit from the room is performed by two doors. In the present embodiment, the layout, devices, the number of users, and the like are limited, but the present invention can be applied to a wider variety of layouts and devices. Furthermore, the present invention can be widely extended and applied to the arbitraryness in scalability of the space scale and the number of users, and the arbitraryness in the user attribute and the type of business involved when viewed in individual units or group units. Moreover, this embodiment may be applied not only to indoor spaces as shown in FIGS.

  Note that the positioning server device 100 and the control server device 200 of this embodiment are installed outside the room shown in FIGS. The positioning server device 100 and the control server device 200 can be provided in the room of the control target area and can be the target of power control.

  In this embodiment, network devices such as Wi-Fi access points, switching hubs, and routers that constitute a communication network system are not subject to power control, but can also be subject to power control. is there.

  The amount of power consumed by these network devices can be calculated as the amount of power obtained by dividing the total power in the LED lighting device 500, the air conditioner 700, and the tap 600 from the total system power.

  Each of the plurality of LED lighting devices 500, the plurality of taps 600, and the plurality of air conditioners 700 is remotely controlled by the control server device 200 via a network.

  That is, the LED lighting device 500 is remotely controlled by the control server device 200 with respect to the illumination range and illuminance. Specifically, the LED lighting device 500 is provided with an on / off switch that can be individually controlled remotely, and the on / off control is performed by the control server device 200 by a wireless control method using Wi-Fi. The LED lighting device 500 uses an LED lamp with a dimming function in consideration of low power consumption, and the dimming function is configured to be capable of remote control via Wi-Fi.

  The illumination system is not limited to the LED illumination device 500, and for example, an incandescent lamp or a fluorescent lamp can be used.

  The air conditioner 700 is remotely controlled by the control server device 200 to turn on and off the power. That is, the air conditioner 700 can be individually controlled remotely, and the control targets are the air direction and the air blowing intensity in addition to the on / off of the air conditioner 700. In this embodiment, although control is not performed about the temperature and humidity which ventilate, it is not limited to this, Temperature and humidity can also be made into a control object.

  The tap 600 includes a plurality of tap openings, and the power supply on / off of each tap opening is remotely controlled by the control server device 200. That is, the tap 600 is provided with an on / off switch that can be remotely controlled individually for each tap opening. The on / off control is performed by the control server device 200 using a Wi-Fi wireless control scheme. The number of tap openings included in one tap 600 can be any number, but as an example, a structure in which one tap is constituted by four tap openings can be used.

  As shown in FIG. 6, one tap 600 is installed on each desk. The tap 600 can be connected to an electrical device (not shown), specifically, a desktop PC, a display device, a notebook PC, a printer device, and chargers.

  In the present embodiment, a power source of a display device, which is a device in which a direct relationship with a person is important, is connected to the tap opening of the tap 600. The display device is a device that can be controlled by turning on / off the power supplied to the tap port by the control server device 200.

  Even when a desktop PC main body or printer device is connected to the tap 600, the control server device 200 cannot control the power supplied to the tap port by on / off due to the configuration of the device. For this reason, for desktop PCs, control software can be controlled by installing control software that can shift to the power saving mode or shutdown via the network, and return from the power saving mode or shutdown state. Is a manual operation by the user himself.

  Further, when a charger or a notebook PC at the time of charging is connected to the tap 600, it is always turned on for convenience. Note that devices connected to the tap opening of the tap 600 are not limited to these.

  Returning to FIG. 1, the positioning server device 100 receives the detection data of each sensor, detects the position and operation state of the person wearing the sensor, and transmits the position and operation state to the control server device 200.

  FIG. 7 is a block diagram showing a functional configuration of the positioning server device 100. As shown in FIG. 7, the positioning server device 100 includes a communication unit 101, a position detection unit 102, a speed calculation unit 103, an operation detection unit 104, a correction unit 105, a determination unit 106, and a display control unit 107. And a storage unit 110.

  The storage unit 110 is a storage medium such as a hard disk drive (HDD) or a memory, and stores indoor map data in the control target area.

  The communication unit 101 detects the acceleration sensor, the angular velocity sensor, and the geomagnetic sensor mounted on the smartphone 300 at regular intervals, or the acceleration sensor, the angular velocity sensor, and the geomagnetic sensor of the sensor group 301 separate from the smartphone 300. Receive data. That is, the communication unit 101 receives an acceleration vector from the acceleration sensor, receives an angular velocity vector from the angular velocity sensor, and receives a magnetic orientation vector from the geomagnetic sensor.

  In addition, the communication unit 101 receives a captured image from the monitoring camera 400. Furthermore, the communication unit 101 transmits an operation state such as an absolute position of a human, which will be described later, a direction, and a posture, to the control server device 200.

  The position detection unit 102 analyzes the received detection data and specifies the absolute position of the person in the room with the accuracy of the person's shoulder width or stride. Details of the method for specifying the absolute position of the human by the position detector 102 will be described later.

  The speed calculation unit 103 calculates the moving speed of the person from the received detection data. For example, the speed calculation unit 103 calculates the movement of the human from the movement amount of the absolute position of the human detected by the position detection unit 102 and the reception time (number of detection data) of the detection data used for detection of the movement amount. Calculate the speed.

  The motion detection unit 104 analyzes the received detection data and detects a human motion state. In the present embodiment, the motion detection unit 104 detects whether the human is in a stationary state or a walking state as the motion state. In addition, the motion detection unit 104 detects the motion state of the human direction with respect to the device in the control target area and whether the human posture is a standing state or a seated state based on the detection data when the motion state is a stationary state. To do.

  That is, when the motion detection unit 104 detects from the captured image from the monitoring camera 400 that a person has entered the room through the door, the motion detection unit 104 includes an acceleration sensor, an angular velocity sensor, a geomagnetic sensor of the smartphone 300 attached to the person who entered the room, Alternatively, the human motion state is walking using the time series data of the acceleration vector and the angular velocity vector among the detection data sequentially received from the acceleration sensor, the angular velocity sensor, and the geomagnetic sensor of the sensor group 301 separate from the smartphone 300. Sequentially determine whether the state is stationary. Here, the method of determining whether the human motion state is the walking state using the acceleration vector and the angular velocity vector is realized by the processing by the dead reckoning device disclosed in Japanese Patent No. 4243684. Then, when it is determined that the person is not in a walking state by this method, the motion detection unit 104 determines that the person is in a stationary state.

  More specifically, the motion detection unit 104 detects a human motion state as follows, similarly to the processing by the dead reckoning device disclosed in Japanese Patent No. 4243684.

  That is, the motion detection unit 104 obtains a gravitational acceleration vector from the acceleration vector received from the acceleration sensor and the angular velocity vector received from the angular velocity sensor, subtracts the gravitational acceleration vector from the acceleration vector, removes the vertical acceleration, Obtain time-series data of differential acceleration components. Then, the motion detection unit 104 performs principal component analysis on the time-series data of the residual acceleration component to obtain the traveling direction of the walking motion. Further, the motion detection unit 104 searches for a peak-valley peak pair of acceleration components in the vertical direction, and searches for a peak-peak peak pair of acceleration components in the traveling direction. Then, the motion detection unit 104 calculates the gradient of the acceleration component in the traveling direction.

  Further, the motion detection unit 104 determines whether or not the gradient of the acceleration component in the traveling direction is equal to or greater than a predetermined value at the detection time of the valley peak where the vertical acceleration component changes from the peak to the peak. When it is equal to or greater than the predetermined value, it is determined that the human motion state is a walking state.

  On the other hand, in the above processing, a peak-to-valley peak pair in the vertical acceleration component is not searched, or a trough peak-to-peak peak pair in the traveling acceleration component is not searched, or a vertical acceleration is detected. When the gradient of the acceleration component in the traveling direction is less than a predetermined value at the detection time of the valley peak at which the component changes from the peak to the valley peak, the motion detection unit 104 indicates that the human motion state is stationary. Judge that there is.

  When it is determined that the person is in a stationary state, the position detection unit 102 determines that the door is at a stationary state from the reference position using the acceleration vector, the angular velocity vector, and the magnetic orientation vector as the reference position. The relative movement vector to the specified position is obtained. Here, as a method of calculating the relative movement vector using the acceleration vector, the angular velocity vector, and the magnetic azimuth vector, the method disclosed in the processing of the dead reckoning device disclosed in JP 2011-47950 A is used.

  More specifically, the position detection unit 102 obtains a relative movement vector as follows, similarly to the processing of the dead reckoning device disclosed in JP 2011-47950 A.

  That is, the position detection unit 102 obtains a gravity azimuth vector from the acceleration vector received from the acceleration sensor and the angular velocity vector received from the angular velocity sensor, and from the gravity azimuth vector and the magnetic azimuth vector received from the angular velocity vector or the geomagnetic sensor, The attitude angle is calculated as the moving direction. Further, the position detection unit 102 obtains a gravitational acceleration vector from the acceleration vector and the angular velocity vector, and calculates an acceleration vector generated by the walking motion from the gravitational acceleration vector and the acceleration vector. Then, the position detection unit 102 analyzes and detects the walking motion from the gravitational acceleration vector and the acceleration vector generated by the walking motion, and determines the magnitude of the walking motion based on the detection result. And the acceleration vector generated by the walking motion, and the measurement result is used as a stride. Then, the position detection unit 102 obtains a relative movement vector from the reference position by integrating the movement direction and the stride thus obtained. That is, the human position is detected in real time with an accuracy of human stride or shoulder width, for example, approximately 60 cm or less (more specifically, approximately 40 cm or less).

  When the relative movement vector is calculated in this way, the position detection unit 102 specifies the absolute position after the movement of the person from the relative movement vector from the door and the indoor map data stored in the storage unit 110. To do.

  Thereby, the position detection unit 102 can specify the position of the desk where the person is placed in the room. As a result, the shoulder width of the person, for example, approximately 60 cm or less (more specifically, approximately 40 cm). It is possible to specify the position of a person with an accuracy of less than about).

  The higher the position accuracy, the better. For example, assuming a scene in which two or more people are having a conversation, it is rare that they talk in contact with each other, and they are separated by a certain distance. Accordingly, when considering accuracy, the accuracy corresponding to the shoulder width or stride of a person, whether standing or sitting, is equivalent to the length from the waist to the knee.

  According to anthropometric data published by the Ministry of Health, Labor and Welfare (Makiko Kawauchi, Masaaki Mochimaru, Hiroshi Iwasawa, Seiji Mitani (2000): Japanese Human Body Size Database 1997-98, Ministry of International Trade and Industry, Industrial Technology Life and JIS Center) The data (shoulder width) corresponding to the shoulder width of adolescents and elderly men and women is about 35 cm (34.8 cm) for the elderly women with the lowest average value, and about 40 cm (39.7 cm) for the highest adolescent men It has become. Similarly, the difference between the length from the waist to the knee (pubic bone joint upper edge height−femoral outer epicondyle height) is about 34 cm to about 38 cm. On the other hand, the stride when a person moves is 95 steps when walking 50 m, and is about 53 cm (50 ÷ 95 × 10) from now on, and the position detection method used in the present invention can have an accuracy equivalent to the stride. Therefore, the present embodiment is configured based on the above data on the assumption that the accuracy is 60 cm or less, preferably 40 cm or less. These data serve as a standard for considering accuracy, but are based on the Japanese and are not limited to these values.

  Further, when the absolute position of the person is specified and the person is stationary at the seat in front of the desk, the motion detection unit 104 determines the direction with respect to the human display device based on the direction of the magnetic orientation vector received from the geomagnetic sensor. (Orientation) is determined. In addition, when the person is stationary at the seat in front of the desk, the motion detection unit 104 determines the posture of the person, that is, whether the person is standing or sitting from the acceleration component in the vertical direction of the acceleration vector.

  Here, as in the dead reckoning device disclosed in Japanese Patent No. 4243684, the gravitational acceleration vector is determined from the acceleration vector received from the acceleration sensor and the angular velocity vector received from the angular velocity sensor. Obtain the acceleration component in the vertical direction. And the motion detection part 104 calculates | requires the peak of the peak and trough of the acceleration component of a perpendicular direction similarly to the dead reckoning apparatus currently disclosed by the patent 4243684.

  FIG. 8 is a diagram illustrating waveforms of acceleration components in the vertical direction when the sitting operation and the standing operation are performed. As shown in FIG. 8, in the case of the seating operation, the interval from the peak of the peak of the acceleration component in the vertical direction to the peak of the valley is about 0.5 seconds. On the other hand, in the standing motion, the interval from the peak of the vertical acceleration component to the peak of the peak is about 0.5 seconds. Therefore, the motion detection unit 104 determines whether the person is in a sitting state or a standing state based on the peak interval. That is, the motion detection unit 104 determines that the human motion state is the seating state when the interval from the peak of the acceleration component in the vertical direction to the peak of the valley is within a predetermined range from 0.5 seconds. To do. Further, the motion detection unit 104 determines that the human motion state is a standing state when the interval from the peak of the vertical acceleration component valley to the peak of the peak is within a predetermined range from 0.5 seconds. To do.

  As described above, when the motion detection unit 104 determines whether the human motion state is the standing state or the seated state, the position in the height direction of the human is approximately 50 cm or less (more specifically, approximately 40 cm or less). It means that it was detected with accuracy.

  Further, as in the example shown in FIG. 3, a smartphone 300 equipped with information devices for detecting human motion such as an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor is worn on the waist, and further, the acceleration sensor, the angular velocity sensor, and the geomagnetism are mounted. When a small headset type sensor group 301 including sensors is mounted on the head, the motion detection unit 104 can further detect the following human postures and motions.

  FIG. 9 is a diagram showing waveforms of angular velocity components in the horizontal direction when the squatting operation and the standing operation are performed. From the acceleration data from the acceleration sensor, waveforms similar to those of the seating motion and the standing motion shown in FIG. 8 are detected, but it is difficult to discriminate the squatting motion and the standing motion only from the acceleration data.

  For this reason, the motion detection unit 104 matches the above-described method for discriminating between the sitting motion and the standing motion based on the waveform of FIG. 8, and the temporal change in the angular velocity data in the horizontal direction received from the angular velocity sensor matches the waveform of FIG. By judging whether or not to perform, the squatting action and the standing action are discriminated.

  Specifically, the motion detection unit 104 first determines whether the interval from the peak of the peak of the acceleration component in the vertical direction based on the acceleration vector received from the acceleration sensor to the peak of the valley is within a predetermined range from 0.5 seconds. Judge whether or not.

  Then, when the interval from the peak of the peak of the acceleration component in the vertical direction to the peak of the valley is within a predetermined range from 0.5 seconds, the motion detection unit 104 detects the horizontal direction of the angular velocity vector received from the angular velocity sensor. As shown in the waveform of FIG. 9, the angular velocity component gradually increases from 0, then reaches a peak of the mountain with a rapid increase, gradually decreases from the peak of the mountain, then gradually returns to 0, and the time between them When it is about 2 seconds, it is determined that the human motion is a squatting motion.

  Further, the motion detection unit 104 determines whether or not the interval from the peak of the trough of the acceleration component in the vertical direction to the peak of the peak is within a predetermined range from 0.5 seconds. When the interval from the peak of the valley of the acceleration component in the vertical direction to the peak of the peak is within a predetermined range from 0.5 seconds, the motion detection unit 104 receives the angular velocity vector received from the angular velocity sensor in the horizontal direction. When the angular velocity component reaches the peak of the valley in steps from 0, gradually returns to 0 from the peak of the valley, and the time between them is about 1.5 seconds as shown in the waveform of FIG. Is determined to be a standing motion.

  As the angular velocity vector used in the determination of the squatting motion and the standing motion in the motion detection unit 104, it is preferable to use an angular velocity vector received from an angular velocity sensor worn on the head. This is because the angular velocity component in the horizontal direction based on the angular velocity vector from the angular velocity sensor worn on the head shows the waveform shown in FIG.

  FIG. 10 is a diagram illustrating a waveform of an angular velocity component in the vertical direction when a human performs an operation of changing the direction by approximately 90 degrees in a stationary state. If the angular velocity component in the vertical direction is positive, the direction is changed to the right side, and if it is negative, the direction is changed to the left side.

  The motion detection unit 104 gradually returns to 0 after the temporal change of the angular velocity component in the vertical direction of the angular velocity vector received from the angular velocity sensor gradually reaches the peak of the mountain from 0 as shown in the waveform of FIG. When the time between them is about 3 seconds, it is determined that the direction changes to the right.

  In addition, the motion detection unit 104 determines that the temporal change in the angular velocity component in the vertical direction gradually returns to 0 after gradually reaching the peak of the valley from 0 as shown in the waveform of FIG. When it is about 1.5 seconds, it is determined that the direction changes to the left.

  The motion detection unit 104 determines that the vertical angular velocity components of the angular velocity vectors received from both the angular velocity sensor of the head and the angular velocity sensor of the hip smartphone 300 are similar to the waveform of FIG. In the case of a change in the eye, it is determined that the movement of the whole body changes to the right or left.

  On the other hand, the motion detection unit 104 shows that the vertical angular velocity component of the angular velocity vector received from the angular velocity sensor of the head shows a temporal change similar to the waveform of FIG. When the angular velocity component in the vertical direction of the angular velocity vector from the sensor shows a temporal change that is completely different from the waveform of FIG. 10, it is determined that the operation is to change the direction of the head only to the right or left. As such an operation, for example, a posture operation in the case of communicating with an adjacent user while the user is seated can be considered.

  FIG. 11 is a diagram showing the waveform of the angular velocity component in the horizontal direction of the angular velocity vector received from the angular velocity sensor of the head when the line of sight is removed from the display in the sitting state.

  Consider a case where the position detection unit 102 specifies that the absolute position of a person is in front of a desk, and the motion detection unit 104 detects that a person in front of the desk is in a sitting state. In such a case, the motion detection unit 104 gradually reduces the angular velocity component in the horizontal direction of the angular velocity vector received from the angular velocity sensor of the human head from 0 as shown in the waveform shown in FIG. When the peak is reached and then suddenly returns to 0, and the time between them is about 1 second, it is determined that the operation is an operation in which the user's line of sight is removed from the display in the seated state (an operation to look up). Further, the motion detector 104 reaches the peak of the mountain while the angular velocity component in the horizontal direction gradually increases from 0 as shown in the waveform of FIG. Is about 1.5 seconds, it is determined that the action is to return the line of sight to the display from the state where the line of sight is removed from the display in the sitting state.

  FIG. 12 is a diagram showing the waveform of the angular velocity component in the horizontal direction of the angular velocity vector received from the angular velocity sensor of the head when the line of sight is removed from the display in the sitting state.

  Consider a case where the position detection unit 102 specifies that the absolute position of a person is in front of a desk, and the motion detection unit 104 detects that a person in front of the desk is in a sitting state. In such a case, the motion detection unit 104 causes the angular velocity component in the horizontal direction of the angular velocity vector received from the angular velocity sensor of the human head to rapidly increase from 0 as shown in the waveform of FIG. When the peak is reached and then suddenly returns to 0 and the time between them is about 0.5 seconds, it is determined that the operation is an operation in which the line of sight is removed from the display in a sitting state (an operation to look down).

  Further, the motion detection unit 104 reaches the peak of the valley while the angular velocity component in the horizontal direction decreases rapidly from 0 as shown in the waveform of FIG. Is about 1 second, it is determined that the operation is to return the line of sight to the display from the state where the line of sight is removed downward from the display in the sitting state.

  In this way, the motion detection unit 104 is a posture and motion that an office worker can take everyday, that is, walking (standing state), standing (stationary state), sitting on a chair, squatting at work, sitting state or It is possible to determine by the above-described method whether the direction (direction) is changed in the standing state, looking up at the heavens in the sitting state or the standing state, whispering in the sitting state or the standing state.

  In addition, when using the technique of the dead reckoning device of patent 4243684, as disclosed in patent 4243684, the lifting and lowering motion of a human by an elevator is also determined using the acceleration component in the vertical direction. .

  For this reason, in this embodiment, the motion detection unit 104 uses the function of the map matching device disclosed in Japanese Patent Laid-Open No. 2009-14713, and the vertical acceleration component is shown in FIG. When detected by the waveform, unlike the elevator lifting / lowering operation by the dead reckoning device of Japanese Patent No. 4243684, it can be determined with high accuracy whether the operation is a standing operation or a seating operation.

  The correction unit 105 corrects the specified absolute position and operation status (direction and posture) based on the captured image from the monitoring camera 400 and the map data stored in the storage unit 110. More specifically, the correction unit 105 determines whether or not the absolute position, direction, and posture of the human determined as described above are correct through image analysis of a captured image of the monitoring camera 400, map data, and the like. And the function of the map matching device disclosed in Japanese Patent Application Laid-Open No. 2009-14713. If it is incorrect, the correcting unit 105 corrects the correct absolute position, direction, and orientation obtained from the captured image and the map matching function.

  The correction unit 105 is configured to perform correction using limited means such as short-range wireless and optical communication such as RFID and Bluetooth (registered trademark) as well as a captured image from the monitoring camera 400. Also good.

  In this embodiment, the same technology as the dead reckoning device disclosed in Japanese Patent No. 4243684 and Japanese Patent Application Laid-Open No. 2011-47950, and the same technology as the map matching device disclosed in Japanese Patent Application Laid-Open No. 2009-14713. Is used to detect a human motion state, a relative movement vector from a reference position, and a posture (whether standing or sitting), but the detection method is not limited to these techniques.

  The determination unit 106 determines whether the detected user is an authorized user who has the access right to the content displayed on the display unit 850 based on the detected absolute position and operation status of the user, or has no access right. Determine if you are an unauthorized user. For example, the determination unit 106 determines that a user who exists in a predetermined area with the display unit 850 as a reference, faces the display unit 850, and has the shortest distance from the display unit 850 is an authorized user. . Further, the determination unit 106 determines that users other than the authorized user are non-permitted users.

  In addition, the determination method of an authorized user is not restricted to this. The determination may be made using other absolute position and operation condition criteria that can be determined to have the right to access the displayed content. For example, it may be determined that one or more users whose operating conditions and the like meet a predetermined criterion are permitted users, and other users are determined to be non-permitted users.

  The absolute position and operation status detected for each of the authorized user and the unauthorized user are stored in the storage unit 110, for example.

  The display control unit 107 controls display of content on the display unit 850 based on the detected absolute position and operation status of the user. For example, the display control unit 107 controls the display of content according to the relationship between the plurality of regions I and II with respect to the display unit 850 and the position of the unauthorized user. For example, the area I is determined as an area in which the contents cannot be understood unless the display unit 850 is viewed carefully. The area II is an area inside the area I, for example, and is determined as an area where the contents of the content can be immediately understood because the display unit 850 is present in front of the user.

  When the non-permitted user enters the area I, the display control unit 107 performs display control based on the speed (movement speed) of the non-permitted user. Since the slower the speed, there is a risk of being snooping, so the display control unit 107 performs display control if the speed of the unauthorized user is slower than a predetermined speed threshold (hereinafter referred to as Z (m / s)). Thereby, it is also possible to prevent display control when an unauthorized user passes in front of the display unit 850. When the unauthorized user enters the area II, the display control unit 107 estimates that there is a risk that the content content may be immediately seen, and immediately performs display control regardless of the speed of the unauthorized user. Thereby, it is possible to efficiently prevent the content from being seen.

  Next, details of the control server device 200 will be described. The control server device 200 includes a plurality of LED lighting devices 500, a plurality of taps 600, and a plurality of air conditioners installed in the room based on the position and operation state (direction, posture) of the person in the room that is the control target area. Each of the 700s is remotely controlled via a network.

  FIG. 13 is a block diagram showing a functional configuration of the control server device 200 of the present embodiment. As shown in FIG. 13, the control server device 200 according to the present embodiment mainly includes a communication unit 201, a power consumption management unit 202, a device control unit 210, and a storage unit 220.

  The storage unit 220 is a storage medium such as an HDD or a memory, and stores room position data that is a control target area.

  The communication unit 201 receives the absolute position and motion information (direction, posture) of the person from the positioning server device 100. Further, the communication unit 201 receives power consumption from the plurality of LED lighting devices 500, the electric devices connected to the plurality of taps 600, and the plurality of air conditioners 700. In addition, the communication unit 201 transmits a control signal for performing power control to the plurality of LED lighting devices 500, the plurality of taps 600, and the plurality of air conditioners 700.

  The power consumption management unit 202 manages the power consumption received from the plurality of LED lighting devices 500, the electric devices connected to the plurality of taps 600, and the plurality of air conditioners 700.

  The device control unit 210 includes a lighting device control unit 211, an outlet control unit 213, and an air conditioner control unit 215. The lighting device control unit 211 controls the LED lighting device 500 based on the absolute position and motion information (direction, posture) of the person. More specifically, the lighting device control unit 211 sets the lighting range to be narrower than a predetermined range if the person is seated on the LED lighting device 500 disposed in the vicinity of the received absolute position, A control signal for setting the illuminance higher than a predetermined threshold is transmitted via the communication unit 201. As a result, it is possible to control the illumination range and illuminance suitable for fine work for a user who is working in a sitting state.

  On the other hand, the lighting device control unit 211 communicates a control signal for setting the illumination range wider than the predetermined range and setting the illuminance lower than the predetermined threshold if the person is standing up to the LED lighting device 500. The data is transmitted via the unit 201. This makes it possible to control the illumination range and illuminance so that a standing user can look over the entire room.

  The outlet control unit 213 controls power on / off of the tap opening of the tap 600 based on the absolute position and motion information (direction and posture) of the person. More specifically, the outlet control unit 213 is seated with respect to the display device connected to the tap 600 arranged in the vicinity of the received absolute position, and the direction with respect to the display device is forward. In this case, a control signal for turning on the switch of the tap port to which the display device is connected in the tap 600 is transmitted via the communication unit 201.

  On the other hand, the outlet control unit 213 is connected to the display device connected to the tap 600 when a person is standing or the direction toward the display device is backward. A control signal for turning off the switch of the tap opening is transmitted via the communication unit 201.

  As described above, the power control is performed according to the direction of the person with respect to the display device, and the display device is an important device in the direct relationship with the person, and it is determined that the display device is used when the direction is forward. Because it can be done. Further, when the human posture is also in the sitting state, it can be determined that the display device is being used. As described above, in the present embodiment, power control is performed in consideration of actual use of the device, and finer control can be performed compared to the case where power control is simply performed based on the distance from the device. It becomes possible.

  Further, the outlet control unit 213 of the present embodiment performs power control of the desktop PC main body and the display device in conjunction with the user's personal recognition information.

  The air conditioner control unit 215 controls on / off of the power supply of the air conditioner 700 based on the absolute position of the person. More specifically, the air conditioner control unit 215 transmits, via the communication unit 201, a control signal for turning on the power of the air conditioner 700 set in the group in which the received seat at the absolute position exists.

  Next, the detection process by the positioning server device 100 of the present embodiment configured as described above will be described. FIG. 14 is a flowchart illustrating a procedure of detection processing performed by the positioning server device 100 according to the present embodiment. The detection process according to the flowchart is executed for each of the plurality of smartphones 300.

  In addition to the detection process according to this flowchart, the positioning server device 100 includes an acceleration sensor, an angular velocity sensor, a geomagnetic sensor, or an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor mounted on the plurality of smartphones 300. Detection data (acceleration vector, angular velocity vector, magnetic direction vector) is received from each sensor at regular intervals, and captured images are received from a plurality of monitoring cameras 400.

  First, it is determined whether or not a person has entered a room, which is a control target area, based on a captured image of a door to be opened and closed (step S11). If the user has not entered the room (step S11: No), the positioning server device 100 determines whether or not the person has left the room (step S20). If the user has not left the room (step S20: No), the process returns to step S11 and is repeated. If the user leaves the room (step S20: Yes), the detection process is terminated. When entering the room (step S11: Yes), the operation detection unit 104 detects the operation state of the person who has entered the room using the above-described method (step S12). Then, the motion detection unit 104 determines whether or not the human motion state is a walking state (step S13), and repeats detection of the motion state while it is in a walking state (step S13: Yes).

  On the other hand, when the human motion state is not the walking state in step S13 (step S13: No), the motion detection unit 104 determines that the human motion state is the stationary state. And the position detection part 102 calculates the relative movement vector from a door by the above-mentioned method by making a reference | standard position into a door (step S14).

  And the position detection part 102 pinpoints the absolute position of the person who became the stationary state from the map data of the room preserve | saved at the memory | storage part 110, and the relative movement vector from a door (step S15). As a result, the position detection unit 102 can specify the position of the desk where the person is placed indoors. As a result, the shoulder width of the person (approximately 60 cm or less, more specifically approximately 40 cm or less). The position of the person is specified with the accuracy of. Note that the speed calculation unit 103 may calculate the moving speed of the person based on the specified position or the like.

  Next, the motion detection unit 104 further detects the direction (orientation) of the human display device from the magnetic orientation vector received from the geomagnetic sensor as a human motion state in a stationary state (step S16).

  Next, the motion detection unit 104 detects the posture, whether the sitting state or the standing state, as the human motion state by the above-described method (step S17). Thereby, the motion detection unit 104 detects the position in the height direction of the human with an accuracy of about 50 cm or less (more specifically, about 40 cm or less).

  Further, the motion detection unit 104 may be a human motion state of squatting or standing motion, an operation of changing the orientation in a seated state, a motion of returning a seat, an operation of raising a line of sight in a seated state, a motion of returning a eye, or a seated state The operation of lowering the line of sight or the operation of returning the line of sight may be detected respectively.

  Next, the correction unit 105 determines whether or not correction is necessary for the specified absolute position, detected direction, and posture as described above, and corrects if necessary (step S18).

  Then, the communication unit 101 transmits the absolute position, the detected direction and orientation (if corrected, the corrected absolute position, the detected direction and orientation) to the control server device 200 as detection result data. (Step S19).

  Next, device control processing by the control server device 200 will be described. FIG. 15 is a flowchart illustrating the procedure of the device control process according to the present embodiment.

  First, the communication unit 201 receives the absolute position, direction, and posture of a person as detection result data from the positioning server device 100 (step S31). Next, each control unit 211, 213, 215 of the device control unit 210 specifies the LED lighting device 500, the tap 600, and the air conditioner 700 to be controlled from the absolute position of the received detection result data (step S32).

  More specifically, the lighting device control unit 211 refers to the position data stored in the storage unit 220 and specifies the LED lighting device 500 installed on the desk corresponding to the absolute position as a control target. Further, the outlet control unit 213 refers to the position data stored in the storage unit 220 and specifies the tap 600 installed near the desk corresponding to the absolute position as a control target. The air conditioner control unit 215 refers to the position data stored in the storage unit 220 and specifies the air conditioner 700 installed corresponding to a group having a desk corresponding to the absolute position as a control target.

  Next, the air conditioner control unit 215 performs control to turn on the power of the identified air conditioner 700 (step S33).

  Next, the outlet control unit 213 determines whether or not the direction of the received detection result data is forward and whether or not the posture of the detection result data is a seated state (step S34). When the direction is the front and the posture is the seating state (step S34: Yes), the outlet control unit 213 switches the switch of the tap mouth to which the display device is connected in the tap 600 specified in step S32. Control to turn on is performed (step S35).

  On the other hand, when the direction is rearward or the posture is standing in step S34 (step S34: No), the outlet control unit 213 connects the display device at the tap 600 specified in step S32. Control is performed to turn off the switch of the tapped port (step S36).

  Next, the lighting device control unit 211 determines again whether or not the posture of the received detection result data is the seating state (step S37). When the posture is the seated state (step S37: Yes), the lighting device control unit 211 sets the illumination range of the LED lighting device 500 specified in step S32 to be narrower than the predetermined range, and sets the illuminance to a predetermined threshold value. Control to set higher is performed (step S38).

  On the other hand, when the posture is in the standing state in step S37 (step S37: No), the illumination device control unit 211 sets the illumination range of the LED illumination device 500 specified in step S32 to be wider than the predetermined range, and the illuminance Is set to be lower than a predetermined threshold value (step S39).

  In addition, you may comprise each control part 211,213,215 of the apparatus control part 210 so that control other than the control mentioned above may be performed with respect to each control object apparatus.

  In addition, the human movement status is squatting or standing, changing the orientation in the sitting state, returning it, raising the line of sight in the sitting state (looking up), returning the line of sight, or looking in the sitting state. The control units 211, 213, and 215 of the device control unit 210 may be configured to control each control target device depending on whether the operation is to lower (look down) or return the eye.

  Examples of each operation, control target device and control method in such a case are as follows. These operations are operations that can occur when it is assumed that an operator is sitting in front of a desk, and the controlled device is a desktop fan corresponding to a PC or a display device of a PC, a desk lamp, and individual air conditioning. Etc.

  For example, when it is determined that the operation of squatting continues for a certain time or more from the received detection result data when the worker is at the desk, the switch of the tap port to which the power source of the PC is connected is turned off. Thus, the outlet control unit 213 can be configured. In addition, the mode control unit can be configured so that the device control unit 210 is provided with a mode control unit that controls the mode of the device, and the display device of the PC is shifted to the standby mode.

  In addition, when the standing operation is detected from the sitting state and the standing state continues for a certain time or more, the mode control unit is configured to shift the PC to the standby mode, or the power supply of the display device is connected at the same time. The outlet control unit 213 can be configured to turn off the switch of the tapped port.

  The following control is given as an example for the operation of changing the direction. If a change in the orientation of the face or upper body is detected from the state of sitting at the desk, and this state continues for a certain period of time, the situation may be such as a conversation with another worker in an adjacent seat. If the lighting device such as a PC, a display device, or a desk lamp is set to standby or off, and it is detected that the orientation of the worker has returned to the original state, the lighting device such as a PC, a display device, or a desk lamp is turned on. The outlet control unit 213 and the mode control unit can be configured to be turned on.

  Further, it is conceivable to perform an operation of looking down when the worker reads a document at a desk, and to perform an operation of looking up at the ceiling when the worker comes up with or thinks of an idea. For this reason, when an operation of looking up or looking down for a certain time or longer is continuously detected, the outlet control unit 213 performs control to shift the PC to the standby mode or to turn off the display device. A mode control unit can be configured. Further, in the case of an operation to look down, the outlet control unit 213 may be configured to perform control without turning off the desk lamp.

  As described above, in the present embodiment, the position of the person is specified with the accuracy of the shoulder width, the direction and posture of the person is detected, and the power control of the apparatus is performed. Thus, it is possible to realize further power saving and energy saving while maintaining the comfort of the worker and the high efficiency of the work.

  That is, in this embodiment, not only can a person be detected, but also the equipment owned by the person, the lighting equipment directly above the desk on which the person sits, the air conditioner, and the office equipment can be individually controlled, and one person can It becomes possible to grasp the power consumption of one person at the same time.

  In the prior art, even if the power of buildings, offices, factories, and offices can be realized so-called "visualization", it is unclear how individuals can save power, and the overall target value If the situation is not tight, such as exceeding the power supply amount, it may be difficult to continue due to difficulty in conscious of power saving. While maintaining high efficiency, further power saving and energy saving can be realized.

  Further, according to the present embodiment, even in automatic device control, power saving can be further improved by performing cooperative control between devices as well as people and devices.

  Next, display control processing by the positioning server device 100 will be described. FIG. 16 is a flowchart illustrating an example of a procedure of display control processing according to the present embodiment. The display control process is based on the premise that the detection process as shown in FIG. 14 is always executed, and as a result, the absolute position and operation status of each user can be obtained.

  First, the position detection unit 102 detects the position of the display unit 850 (step S101). For example, the position detection unit 102 detects the position of the display unit 850 based on a signal received from a position sensor attached to the display unit 850. Note that the position detection method of the display unit 850 is not limited to this. For example, the position detection unit 102 may detect the position of the display unit 850 from a captured image from the monitoring camera 400 or map data stored in the storage unit 110.

  The determination unit 106 determines whether there is an authorized user who is facing the display unit 850 and has the shortest distance (step S102). In addition, the determination unit 106 determines whether there are non-permitted users other than the permitted users (step S103). When it exists (step S103: Yes), the determination part 106 determines whether an unauthorized user exists in the area | region I (step S104). As described above, the area I is an area in which the contents cannot be understood unless the display unit 850 is carefully viewed.

  When the non-permitted user does not exist in the area I (step S104: No), the determination unit 106 determines whether the non-permitted user exists in the area II (step S105). As described above, the area II is an area inside the area I, for example, and is an area where the contents can be immediately understood.

  When the unauthorized user exists in the area II (step S105: Yes), the display control unit 107 executes the screen display control regardless of the movement speed of the unauthorized user (step S108). Note that the screen display control means that display information displayed on the display unit 850 is controlled to be displayed in a display mode different from normal.

  When it is determined in step S104 that an unauthorized user exists in the area I (step S104: Yes), the determination unit 106 determines whether or not the moving speed of the unauthorized user is smaller than the speed threshold value Z (m / s). (Step S107). When the moving speed is smaller than Z (m / s) (step S107: Yes), the display control unit 107 executes screen display control (step S108). As described above, when an unauthorized user exists in the area I, the display control unit 107 performs screen display control according to the speed of the unauthorized user.

  When it is determined that there is no unauthorized user (step S103: No), when the unauthorized user does not exist in the area II (step S105: No), and the movement speed of the unauthorized user is Z (m / s). ) In the above case (step S107: No), the display control unit 107 does not execute the screen display control (step S106) and ends the display control process.

  Thus, in this embodiment, since screen display control is performed according to the area | region where a user exists, and a user's operation | movement, it can prevent that an unauthorized user steals a content.

  When an unauthorized user exists in the area I, screen display control is performed only when the movement speed of the unauthorized user is slower than Z (m / s). On the other hand, even if the movement speed of the disallowed user is slower than Z (m / s), useless screen display control is executed if the disallowed user is not watching the content.

  When PDR (Pedestrian Dead Reckoning) is used as a detection method by the motion detection unit 104, for example, it is assumed that each user wears a terminal (smart phone 300 or the like) equipped with a PDR sensor module on his / her waist. For this reason, the motion detection unit 104 may not be able to determine the orientation of the face even if the orientation of the user's body can be determined. Accordingly, an imaging device may be attached to the display unit 850 so that the orientation of the user's face can be detected from an image captured by the imaging device. For example, the imaging device is installed so that a background in front of the display unit 850 on which content is displayed is captured.

  The motion detection unit 104 detects the orientation of the user's face from the image captured by the imaging device. As a method for detecting the orientation of the face by the motion detection unit 104, any conventionally used method such as a method of detecting the orientation of the user's face by pattern matching can be applied. Note that the imaging apparatus may be configured to have a function of detecting the orientation of the user's face. Further, the motion detection unit 104 may be configured to estimate that the user's face is facing the display (display unit 850), for example, by detecting the motion of returning the line of sight to the display as described above. .

  The display control unit 107 moves the non-permitted user existing in the area I at a speed slower than Z (m / s), and the face of the non-permitted user faces the content (or faces the content). If it is close, screen display control is performed. By performing such screen display control, more efficient control can be realized without performing unnecessary screen display control.

  Below, the specific example of the display control process by the display control apparatus (positioning server apparatus 100) of this embodiment is demonstrated using FIGS. FIG. 17 is a diagram illustrating an example of a positional relationship among the positioning server device 100, the PC 800, and the users 410a and 410b.

  The display unit 850 that displays content is a display or the like. Display unit 850 includes a position sensor 860 and a front part (a black rectangle in display unit 850) representing a part where content is displayed. Each of the users 410a and 410b has smartphones 300a and 300b used for position detection. In FIG. 17, for convenience of explanation, an example in which the positioning server device 100 is placed on the desk 401 is shown, but the location of the positioning server device 100 is arbitrary. It is assumed that the content can be activated from any terminal such as the PC 800.

  The positioning server device 100 detects the positions, body orientations, and speeds of the users 410a and 410b that carry the smartphone 300 by using the position detection unit 102, the speed calculation unit 103, the motion detection unit 104, and the like. The detected information (positioning information) is stored in the storage unit 110, for example. Similarly, the position detection unit 102 of the positioning server device 100 detects the position of the display unit 850 based on a signal from the position sensor 860, and stores the detected position information in the storage unit 110. The display control unit 107 performs screen display control according to the positioning information and the position information of the display unit 850, and realizes prevention of unauthorized viewing by unauthorized users.

  FIG. 18 is a diagram for explaining an example of the display control process when the unauthorized user (user 410 b) moves in the direction of the display unit 850. It is assumed that the user 410a who is an authorized user logs in to the PC 800 to use certain confidential content and displays the confidential content on the display unit 850. Here, it is assumed that the user 410a who is operating toward the content is detected as an authorized user. Regions 511 and 512 correspond to region I and region II, respectively.

  When the unauthorized user (user 410b) enters the area I, the display control unit 107 performs display control according to the speed of the unauthorized user. When the x-axis direction and the y-axis direction are determined as shown in FIG. 18, the display control unit 107 is, for example, in the x-axis direction (for example, the direction of the arrow 501 in FIG. 18) If the speed is slower than Z (m / s), screen display control is performed. Note that screen display control may be performed in consideration of not only the speed in the x-axis direction but also the speed in the y-axis direction. For example, the display control unit 107 may be configured to compare the speed in the actual movement direction with a threshold value (Z (m / s)).

  The user 410b is moving toward the display unit 850 from behind the user 410a. However, since the speed in the x-axis direction is 0 (<Z (m / s)) here, when the user 410b enters the area I, the screen display is controlled.

  Here, for example, assuming that there is a wall behind the display unit 850, the regions I and II are semicircular regions. The ranges and shapes of the regions I and II are not limited to this. For example, assuming that there is no wall behind the display unit 850 and the screen display control is performed so that the user cannot see the content even if the user exists behind the display unit 850, the display unit 850 is the center. A circular area may be used as at least one of areas I and II. Further, for example, the sizes (radius, etc.) of the regions I and II may be changeable according to the security level.

As the screen display control, for example, the following control can be applied.
(1) Control not to display content (hide)
(2) Controlling to display content display substitute content (3) Controlling to display the content at a reduced size (4) Controlling to display a part of the content (5) Face orientation of the unauthorized user Detect and control display

  (1) can be realized by shutting off the power supply of the display unit 850, for example. In this case, compared with (2) to (5), not only unauthorized users can be seen but also energy saving can be realized most.

  FIG. 19 is a diagram for explaining an example of the screen display control (1). It is assumed that the unauthorized user 410b enters the area 511 (area I) in FIG. 18 at Y (m / s) whose speed in the x-axis direction is slower than Z (m / s). In this case, as shown in FIG. 19, the display control unit 107 executes screen display control for hiding the original content 601 like a screen 602.

  FIG. 20 is a diagram for explaining an example of the screen display control (2). Similarly to the above, if the unauthorized user 410b enters the area I at the speed Y (m / s) in the x-axis direction, the display control unit 107 displays the alternative content 702 instead of the original content 701. Execute screen display control.

  FIG. 21 is a diagram for explaining an example of the screen display control (3). Similarly to the above, if the unauthorized user 410b enters the area I at the speed Y (m / s) in the x-axis direction, the display control unit 107 displays the original content 801 on a reduced scale like the screen 802 Execute display control.

  FIG. 22 is a diagram for explaining an example of the screen display control (4). As in the above, if the unauthorized user 410b enters the area I at the speed Y (m / s) in the x-axis direction, the display control unit 107 displays a part of the original content 901 as shown on the screen 902. Execute screen display control to

  FIG. 23 is a diagram for explaining an example of the screen display control (5). In the example of (5), the display unit 850-2 further includes an imaging device 1001 for detecting the orientation of the user's face. The viewing angle of the imaging device 1001 is indicated by a viewing angle 1002 in FIG. FIG. 23 shows an example in which the unauthorized user 410b passes behind the authorized user 410a. In the case of (5), even if the speed of the non-permitted user 410b in the x-axis direction is a speed Y (m / s) that is slower than Z (m / s), the screen display control is executed because the content is not sniffed. do not do.

  As described above, according to the PDR or the like, it can be detected that the unauthorized user 410b is moving in the direction of the arrow. On the other hand, it may not be possible to detect the face direction in order to determine whether the display unit 850-2 is being viewed. Therefore, the motion detection unit 104 detects the orientation of the face from the image obtained from the imaging device 1001. The display control unit 107 determines whether to perform screen display control based on the detected orientation information of the non-permitted user 410b in addition to the positioning information acquired by the position detection unit 102 and the like.

  In the example of FIG. 23, the non-permitted user 410b does not face the display unit 850-2. For this reason, the display control unit 107 does not execute the screen display control regardless of the moving speed in the region I. As a result, it is possible to prevent snooping by more efficient control without performing unnecessary screen display control.

  Next, the hardware configuration of the devices (positioning server device 100 and control server device 200) according to the present embodiment will be described with reference to FIG. FIG. 24 is an explanatory diagram illustrating a hardware configuration example of the apparatus according to the present embodiment.

  The positioning server device 100 and the control server device 200 according to this embodiment include a communication I / F 54 that communicates with a control device such as a CPU 51 and a storage device such as a ROM (Read Only Memory) 52 and a RAM 53 by connecting to a network. And an external storage device such as an HDD and a CD drive device, a display device such as a display device, an input device such as a keyboard and a mouse, and a bus 61 for connecting each part, and using a normal computer It has a hardware configuration.

  The detection program executed by the positioning server device 100 of the present embodiment and the control program executed by the control server device 200 of the present embodiment are an installable format or an executable format file, such as a CD-ROM, a flexible disk (FD), CD-R, DVD (Digital Versatile Disc) and the like are recorded on a computer-readable recording medium and provided.

  In addition, the detection program executed by the positioning server device 100 according to the present embodiment and the control program executed by the control server device 200 according to the present embodiment are stored on a computer connected to a network such as the Internet, and are transmitted via the network. You may comprise so that it may provide by downloading. The detection program executed by the positioning server device 100 according to the present embodiment and the control program executed by the control server device 200 according to the present embodiment may be provided or distributed via a network such as the Internet.

  Further, the detection program executed by the positioning server device 100 of the present embodiment and the control program executed by the control server device 200 of the present embodiment may be configured to be incorporated in advance in the ROM 52 or the like.

  The detection program executed by the positioning server device 100 according to the present embodiment includes the above-described units (communication unit 101, position detection unit 102, speed calculation unit 103, motion detection unit 104, correction unit 105, determination unit 106, display control unit). 107). As actual hardware, the CPU 51 (processor) reads the detection program from the storage medium and executes it to load the respective units onto the main storage device, and the respective units are stored in the main storage. It is generated on the device.

  The control program executed by the control server device 200 of this embodiment is a module including the above-described units (communication unit 201, power consumption management unit 202, lighting device control unit 211, outlet control unit 213, air conditioner control unit 215). As actual hardware, the CPU 51 (processor) reads the control program from the storage medium and executes it to load the above-mentioned units onto the main storage device, and the respective units are generated on the main storage device. It has become so.

(Modification 1)
From the device control in the present embodiment, it can be configured not to perform power control of the display device in accordance with the direction of the person.

(Modification 2)
From the device control in the present embodiment, it can be configured not to perform the power control of the display device according to the direction of the person and the power control of the desktop PC main body or the display device linked to the personal recognition information.

(Modification 3)
For the device control in the present embodiment, in addition to the standing state and the seating state, a posture correlated with the standing state and the seating state is detected, and the power control of the display device is performed based on the posture. Can be configured.

(Modification 4)
The number of regions used for determination of screen display control is not limited to two. One area may be defined, and screen display control may be executed when an unauthorized user enters the area. Three or more areas may be defined and different screen display control may be executed for each area.

(Modification 5)
Although the example in which the positioning server device 100 functions as a display control device has been described, a part or all of the functions necessary for display control processing may be provided in another device such as the control server device 200. .

(Modification 6)
In addition, as a technique capable of detecting a human position, in addition to the method described above performed by the positioning server device 100 based on detection data of an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor, for example, entrance / exit management using an IC card or the like , Human detection by a human sensor, a method using a wireless LAN, a method using an indoor GPS (IMES), a method for processing an image captured by a camera, a method using an active RFID, and visible light communication Methods are known.

  In the entrance / exit management using an IC card or the like, personal identification is possible, but the positioning accuracy is extremely low for the entire area to be managed. Therefore, although it is possible to know who is in the area, it is not possible to grasp the human activity status in the area.

  Human detection by a human sensor can obtain a positioning accuracy of about 1 to 2 m which is a detection range of the human sensor, but individual identification cannot be performed. In addition, in order to grasp the human activity state in the area, it is necessary to disperse and arrange a large number of human sensors in the area.

  In the method using a wireless LAN, the distance between one wireless LAN terminal possessed by a human and a plurality of LAN access points installed in the area is measured, and the position of the human in the area is determined by the principle of triangulation. Is identified. Although this method enables individual identification, the positioning accuracy is highly dependent on the environment, and the positioning accuracy is generally as low as 3 m or more.

  In the method using indoor GPS, a dedicated transmitter that emits radio waves in the same frequency band as GPS satellites is installed indoors. Send. Then, the signal is received by a receiving terminal possessed by an indoor person, thereby specifying the position of the person inside. Although this method can identify individuals, the positioning accuracy is as low as about 3 to 5 m. In addition, it is necessary to install a dedicated transmitter, which increases the introduction cost.

  Although the method for image processing of the captured image of the camera can obtain a relatively high positioning accuracy of about several tens of centimeters, it is difficult to perform individual identification. For this reason, in the positioning server device 100 of the present embodiment, the captured image of the monitoring camera 400 is used only when the absolute position, direction, and posture of the employee are corrected.

  In the method using active RFID, a person has an RFID tag with a built-in battery, and the position of the person is specified by reading information of the RFID tag with a tag reader. Although this method enables individual identification, the positioning accuracy is highly dependent on the environment, and the positioning accuracy is generally as low as 3 m or more.

  The method using visible light communication enables individual identification and relatively high positioning accuracy of about several tens of centimeters. However, humans cannot be detected in places where the visible light is blocked, and natural light and other Since there are many noise sources and interference sources such as visible light, it is difficult to maintain the stability of detection accuracy.

  In contrast to these techniques, the method performed by the positioning server device 100 according to the present embodiment is capable of individual identification, provides high positioning accuracy equivalent to a human shoulder width or stride, and, in addition, only by the human position. Without being able to detect human operating conditions. Specifically, according to the method performed by the positioning server device 100 according to the present embodiment, the posture and motion that an office employee can take on a daily basis, that is, walking (standing state), standing up as a human operating state. Detect (shut down), sit in a chair, squat when working, change direction (direction) in sitting or standing state, look up to the sky in sitting or standing state, whisper in sitting or standing state, etc. Can do.

  For this reason, in this embodiment, the positioning server device 100 uses the above-described method based on the detection data of the acceleration sensor, the angular velocity sensor, and the geomagnetic sensor of the smartphone 300 and the sensor group 301, and in the office that is the control target area. The absolute position of the employee and the operation status of the employee are detected. However, the method for detecting the absolute position of the employee in the office, which is the control target area, and the operation status of the employee is not limited to the method described above performed by the positioning server device 100. One or more of the other methods described above may be used in the above-described method performed by the positioning server device 100. The absolute position and the operation status of the employee may be detected by a combination of one or more methods. May be combined to detect the absolute position and operational status of the employee.

DESCRIPTION OF SYMBOLS 100 Positioning server apparatus 101 Communication part 102 Position detection part 103 Speed calculation part 104 Motion detection part 105 Correction | amendment part 106 Judgment part 107 Display control part 110 Storage part 200 Control server apparatus 201 Communication part 202 Power consumption management part 210 Equipment control part 211 Illumination Device control unit 213 Outlet control unit 215 Air conditioner control unit 220 Storage unit 300 Smartphone 400 Monitoring camera 500 LED lighting device 600 Tap 700 Air conditioner

JP 2007-188264 A

Claims (9)

A display control device connected to the display device,
A receiving unit that receives detection data from each of an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor possessed by a user in the control target area;
A position detection unit that detects the position of the user in the control target area based on the detection data;
An operation detection unit that detects the user's operation based on the detection data;
A display control unit for controlling display of display information on the display device based on the detected position and operation of the user;
A display control apparatus comprising: Based on the detected position and operation of the user, it is determined whether the user is an authorized user having an access right to the display information or an unauthorized user having no access right to the display information. Further comprising a determination unit for
The display control unit controls display of display information on the display device based on the position and operation of the unauthorized user;
The display control apparatus according to claim 1. The determination unit determines that a user who faces the display device and is closest to the display device is the permitted user, and determines a user other than the permitted user as the non-permitted user;
The display control apparatus according to claim 2. The receiving unit receives a captured image of the control target area from an imaging device that images the control target area,
The motion detection unit further detects the orientation of the user's face based on the captured image,
The display control unit further controls display of display information on the display device based on a face orientation of the unauthorized user;
The display control apparatus according to claim 2. Further comprising a speed calculator that calculates the moving speed of the user based on the detection data;
The display control unit further controls display of display information on the display device based on a moving speed of the unauthorized user;
The display control apparatus according to claim 2. The display control unit controls the display of display information on the display device when the position and operation of the unauthorized user are the position and operation of viewing the display information;
The display control apparatus according to claim 2. The display control unit includes at least one of control for not displaying the display information, control for changing the display information to be displayed, control for changing the size of the display information, and control for displaying a part of the display information. Running one,
The display control apparatus according to any one of claims 3 to 6, wherein: A receiving step of receiving detection data from each of an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor possessed by a user in the control target region;
A position detecting step for detecting the position of the user in the control target area based on the detection data;
An operation detecting step for detecting the operation of the user based on the detection data;
A display control step for controlling display of display information on a display device based on the detected position and operation of the user;
A display control method comprising: A computer connected to the display device,
A receiving unit that receives detection data from each of an acceleration sensor, an angular velocity sensor, and a geomagnetic sensor possessed by a user in the control target area;
A position detection unit that detects the position of the user in the control target area based on the detection data;
An operation detection unit that detects the user's operation based on the detection data;
A display control unit for controlling display of display information on the display device based on the detected position and operation of the user;
Program to function as.

Images