JP2018190460A - Wearable terminal and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a wearable terminal and a method capable of estimating the state of a worker performing a work within a predetermined area.SOLUTION: A wearable terminal (worker terminal 10) has a built-in sight-line detection sensor. The wearable terminal comprises: means for measuring the number of blinks of a user wearing the wearable terminal using a sight-line detection sensor; and means for carrying out a corresponding operation relevant to the user on the basis of the number of measured blinks.SELECTED DRAWING: Figure 1

Description

  Embodiments described herein relate generally to a wearable terminal and method.

  In recent years, for example, wearable terminals that are worn and used by users have been put into practical use. As wearable terminals, for example, glasses-type wearable terminals and wristband-type wearable terminals are known.

  Since such a wearable terminal can be used in a hands-free state, it is considered to be worn by a user (hereinafter referred to as a worker) who performs work within a predetermined range such as a factory. ing.

JP 05-21650 A

  By the way, in the factory where the workers described above work, managers who manage the workers are arranged. The administrator gives instructions to workers to assign work, confirm and change work contents, etc. For example, if the site area of the factory is large and the number of workers is large, the instructions are sent by telephone (voice call). Often done in

  However, for example, when an incoming call (incoming call) is received from an administrator when the worker is in a dangerous state (for example, working at a high position), the worker tries to answer the incoming call. May be unexpectedly out of balance, which may lead to unexpected accidents. Furthermore, in such a case, since it is often impossible to respond to an incoming call from an administrator, it is inefficient. Therefore, a mechanism for grasping the worker's state is desired.

  Therefore, the problem to be solved by the present invention is to provide a wearable terminal and method capable of estimating the state of a user who performs work within a predetermined range.

  According to the embodiment, a wearable terminal incorporating a line-of-sight detection sensor is provided. The wearable terminal includes means for measuring the number of blinks of a user who wears the wearable terminal with the line-of-sight detection sensor, and means for performing a process related to the user based on the measured number of blinks.

The figure for demonstrating an example of the environment where the management system in 1st Embodiment is used. Schematic which shows an example of the worker terminal which a worker wears and uses. Schematic which shows an example of the worker terminal which a worker wears and uses. The figure which shows an example of the network structure of a management system. The figure which shows an example of the system configuration | structure of a worker terminal. The figure which shows an example of the system configuration | structure of an administrator terminal. The block diagram which shows an example of a function structure of a management server apparatus. The figure which shows an example of the data structure of the worker information stored in the worker information storage part. The figure which shows an example of the data structure of the apparatus information stored in the apparatus information storage part. The figure which shows an example of the data structure of the process information stored in the process information storage part. The figure for demonstrating the outline | summary of a state estimation process. The figure for demonstrating the outline | summary of a state estimation process. The flowchart which shows the process sequence of a state estimation process. The flowchart which shows the process sequence of the management server apparatus at the time of outputting a notification with respect to a worker terminal and an administrator terminal. The figure for demonstrating an example of the display area of a worker terminal. The figure which shows an example of the data structure of the apparatus information stored in the apparatus information storage part in 2nd Embodiment. The flowchart which shows the process sequence of a state estimation process. The figure which shows an example of the system configuration | structure of the worker terminal in 3rd Embodiment. The flowchart which shows the process sequence of a state estimation process.

  Hereinafter, each embodiment will be described with reference to the drawings.

(First embodiment)
First, the first embodiment will be described. FIG. 1 is a diagram for explaining an example of an environment in which a management system including a management server device according to the present embodiment is used.

  The management system in the present embodiment is, for example, a worker who performs work within a predetermined range (for example, a factory premises) and a device installed within the range (for example, a manufacturing apparatus for manufacturing a product, etc.) Used to manage).

  As shown in FIG. 1, the management system includes a worker terminal 10, a manufacturing apparatus 20, an administrator terminal 30, and a management server apparatus 40.

  The worker terminal 10 is a terminal device (user terminal) used by a worker (user) who performs work in a work area 100 such as in a factory premises, for example. The worker terminal 10 includes, for example, a glasses-type wearable terminal that can be worn and used by a worker. In the following description, it is assumed that the worker terminal 10 is a glasses-type wearable terminal.

  As shown in FIG. 1, in the management system, one worker wears and uses one worker terminal 10. Therefore, the management system includes a number of worker terminals 10 corresponding to the number of workers.

  The manufacturing apparatus 20 is an apparatus that can manufacture a product in accordance with, for example, an operator's operation. In addition, the manufacturing apparatus 20 shall be an apparatus which manufactures a product automatically, for example, when an operator sets a member required for manufacture and completes preparation. In the present embodiment, the management system is described as including the manufacturing apparatus 20, but the management system may include other apparatuses as long as the apparatus is installed in the work area 100, for example.

  Although one manufacturing apparatus 20 is shown in FIG. 1 for convenience, it is assumed that a plurality of manufacturing apparatuses 20 are installed in the work area 100.

  The administrator terminal 30 is a terminal device used by an operator who manages the workers in the work area 100 and the manufacturing apparatus 20. The administrator terminal 30 includes, for example, a personal computer installed in a monitoring room or the like outside the work area 100. Note that, for example, when the administrator looks around the work area 100 in order to monitor the situation in which the worker is working and the operation status of the manufacturing apparatus 20, the same as the worker terminal 10 described above. A glasses-type wearable terminal may be used as the administrator terminal 30.

  The management server device 40 is a server device (electronic device) that manages a manufacturing process of a product by the manufacturing device 20 installed in the work area 100. In addition, although mentioned later for details, the management server apparatus 40 has a function which estimates the state of the worker who performs work in the work area 100. FIG.

  Although omitted in FIG. 1, it is assumed that the work area 100 is provided with a plurality of access points for the worker terminal 10 to perform wireless communication.

  2 and 3 are schematic views showing an example of a worker terminal (glasses-type wearable terminal) 10 worn and used by a worker.

  The worker terminal 10 includes a light projecting unit 1001, a lens-integrated screen (display) 1002, and the like.

  The light projecting unit 1001 includes a light source unit 1001a, an additional image display unit 1001b, a half mirror unit 1001c, a lens group 1001d, a driving unit 1001e, a built-in power source 1001f, and the like. In the light projecting unit 1001, the image and information displayed by the additional image display unit 1001b are illuminated by the light 2000 emitted from the light source unit 1001a, and the reflected light (projected image) is output (emitted). The light 2000 emitted from the light source unit 1001a is non-parallel divergent light (divergent light).

  The light source unit 1001a is preferably a dimming white LED light source including a plurality of (for example, three) LEDs (Light Emitting Diodes) capable of independently changing the output light amounts. In this case, the three LEDs have different emission colors. When such a dimmable white LED light source is used, for example, the luminescent color is changed according to the usage environment such as when the worker terminal 10 is used in a clean room where orange-based illumination is often used. By changing, it is possible to provide (output) a display color that is easy for the operator to see.

  The additional image display unit 1001b is a reflective LCD (Liquid Crystal Display) module, for example, and displays a predetermined additional image. The predetermined additional image includes, for example, various messages and marks.

  The light 2000 emitted from the light source unit 1001a is reflected by the half mirror unit 1001c to illuminate the additional image displayed by the additional image display unit 1001b, and is reflected again as image light corresponding to the additional image.

  The light (additional image light) 2000 reflected by the additional image display unit 1001b passes through the half mirror unit 1001c, is given a predetermined image size by the lens group 1001d, and reaches the lens-integrated screen 1002.

  The drive unit 1001e controls the light emission of the light source unit 1001a corresponding to the additional image displayed by the additional image display unit 1001b.

  The built-in power supply 1001f is realized by, for example, a button battery. The worker terminal 10 operates with electric power supplied from the built-in power supply 1001f.

  The lens-integrated screen 1002 has a Fresnel lens type half mirror portion 1002a.

  As described above, a part of the light 2000 that reaches the lens-integrated screen 1002 is reflected by the Fresnel lens-shaped half mirror unit 1002a to form a virtual image for the additional image displayed on the additional image display unit 1001b.

  As shown in FIG. 3, the worker terminal 10 includes a speaker 1001g, a (slide type) switch 1001h, a (rotary type) knob 1001i, and the like at predetermined positions (for example, the bottom surface) of the light projecting unit 1001. . The switch 1001h is provided, for example, to adjust the luminance of the light 2000 emitted from the light projecting unit 1001. The knob 1001i is provided to adjust the projection angle of the light 2000 emitted from the light projecting unit 1001, for example. By operating each of the switch 1001h and the knob 1001i, the worker (a user of the glasses-type wearable terminal) adjusts the brightness and the projection angle while viewing the additional image projected by the lens-integrated screen 1002. be able to. That is, by providing the switch 1001h, it is possible to provide the display brightness and color tone of the additional image according to the preference of the worker. Further, since the knob 1001i is provided, an additional image can be displayed at an optimum position according to the shape and size of the head of the worker.

  Further, the worker terminal 10 is provided with a camera 1003 for taking an image around the worker terminal 10, for example. The camera 1003 is provided at a position shown in FIG. 3, for example, to capture an image in the line of sight of the worker wearing the worker terminal 10.

  FIG. 4 shows the network configuration of the management system. In FIG. 4, an example in which the management system includes a plurality of worker terminals 10 is shown. 4, the plurality of worker terminals 10 include worker terminals 10-1, 10-2,..., 10-n (n is an integer of 3 or more, for example).

  As shown in FIG. 4, in the management system in the present embodiment, the plurality of worker terminals 10 are connected to the management server device 40 through a network NTW so as to be communicable. Thereby, the management server device 40 can receive (acquire) various information described later from the plurality of worker terminals 10.

  Although omitted in FIG. 4, the management server device 40 and each of the plurality of manufacturing devices 20 may be communicably connected via the network NTW. In the case of such a configuration, the management server device 40 can receive (collect) information indicating each state of the manufacturing device 20 (hereinafter referred to as status information of the manufacturing device 20) from the manufacturing device 20. The state indicated by the status information includes, for example, a state in which a product is being manufactured, a state in which preparations for manufacturing a product are completed, a state in which preparations for manufacturing a product are not completed, and the like. The status information may include information indicating whether or not the manufacturing apparatus 20 is operated.

  FIG. 5 shows an example of the system configuration of the worker terminal 10. As shown in FIG. 5, the worker terminal 10 includes a CPU 11, a ROM 12, a RAM 13, a GPS (Global Positioning System) sensor 14, an acceleration sensor 15, an atmospheric pressure sensor 16, a communication module 17, and the like. In FIG. 5, the components described in FIG. 2 and FIG. 3 are omitted.

  The CPU 11 is a processor (processing circuit) that controls the operation of each component in the worker terminal 10. The CPU 11 executes various software (program for the worker terminal 10) loaded from the ROM 12 which is a nonvolatile memory to the RAM (main memory) 13.

  The GPS sensor 14 is a sensor capable of detecting the position of the worker terminal 10 (the worker wearing the worker) by executing communication with a GPS satellite.

  The acceleration sensor 15 is a sensor capable of measuring an acceleration generated with respect to the worker terminal 10 (a worker wearing the worker terminal 10).

  The atmospheric pressure sensor 16 is a sensor that can measure the atmospheric pressure around the worker terminal 10. The worker terminal 10 estimates the position in the height direction of the worker wearing the worker terminal 10 based on the atmospheric pressure (change) measured by the atmospheric pressure sensor 16, and the estimated Information indicating the position of the worker in the height direction can be obtained.

  The communication module 17 is a module configured to execute wireless communication with the management server device 40 and the like via the network NTW. The communication module 17 executes wireless communication such as a wireless LAN via an access point provided in the work area 100, for example.

  Thereby, the communication module 17 includes information indicating the position detected by the GPS sensor 14 (hereinafter referred to as worker position information) and information indicating the acceleration measured by the acceleration sensor 15 (hereinafter referred to as worker acceleration information). And information obtained based on the atmospheric pressure measured by the atmospheric pressure sensor 16 as described above (hereinafter referred to as worker height information) can be transmitted to the management server device 40.

  The communication module 17 is configured to execute wireless communication according to standards such as Wi-Fi (registered trademark), WiMAX (registered trademark), 3G mobile communication, 4G mobile communication, and Bluetooth (registered trademark). Also good.

  Although not shown in FIG. 5, the worker terminal 10 further includes a microphone and the like, and has a voice call function realized by, for example, a technology called VoIP (Voice over Internet Protocol). To do. According to this voice call function, a worker can make a voice call with, for example, an administrator via the worker terminal 10.

  The worker terminal 10 may further include, for example, an LED lamp (not shown) for notifying the worker of various alerts.

  FIG. 6 shows an example of the system configuration of the administrator terminal 30. As shown in FIG. 6, the administrator terminal 30 includes a CPU 31, a ROM 32, a RAM 33, a communication module 34, a display 35, and the like.

  The CPU 31 is a processor (processing circuit) that controls the operation of each component in the administrator terminal 30. The CPU 31 executes various types of software (program for the administrator terminal 30) loaded from the ROM 32, which is a nonvolatile memory, to the RAM (main memory) 33.

  The communication module 34 is a module configured to execute wireless communication with the management server device 40 or the like, for example.

  The display 35 is a display device for displaying various information. The display 35 includes, for example, a liquid crystal display device (LCD).

  Although not shown in FIG. 6, the manager terminal 30 has a voice call function that allows the manager to make a voice call with the worker, for example, like the worker terminal 10. And

  As described above, when the administrator terminal 30 is a glasses-type wearable terminal or the like, the administrator terminal 30 may further include various sensors such as a GPS sensor, an acceleration sensor, and an atmospheric pressure sensor.

  FIG. 7 is a block diagram illustrating a functional configuration of the management server device 40. As shown in FIG. 7, the management server device 40 includes a control unit 41, a communication processing unit 42, an information management unit 43, a worker information storage unit 44, a device information storage unit 45, and a process information storage unit 46.

  In the present embodiment, some or all of the control unit 41, the communication processing unit 42, and the information management unit 43 are programmed on a computer (not shown) such as a CPU (not shown) provided in the management server device 40 (for the management server device 40). Program), that is, realized by software. Part or all of these units 41 to 43 may be realized by hardware such as an IC (Integrated Circuit) or may be realized as a combination configuration of software and hardware. Note that the program to be executed by the computer may be stored in an arbitrary storage device provided in the management server device 40, for example.

  The control unit 41 controls the operation of the management server device 40. Under the control of the control unit 41, the management server device 40 can manage the manufacturing process of the product by the worker wearing the worker terminal 10 and the manufacturing device 20.

  The communication processing unit 42 performs wireless communication with the worker terminal 10 and the like. The communication processing unit 42 receives, for example, the above-described worker position information, acceleration information, height information, and the like from the worker terminal 10.

  The information management unit 43 manages various types of information stored in the worker information storage unit 44, the device information storage unit 45, and the process information storage unit 46.

  The worker information storage unit 44 stores information about workers who perform work in the work area 100 (hereinafter referred to as worker information).

  The apparatus information storage unit 45 stores information (hereinafter referred to as apparatus information) related to the manufacturing apparatus 20 installed in the work area 100.

  The process information storage unit 46 stores information (hereinafter referred to as process information) related to the product manufacturing process by the manufacturing apparatus 20.

  In the present embodiment, the management server device 40 (the control unit 41 included therein) includes information received from the worker terminal 10, a worker information storage unit 44, a device information storage unit 45, and a process information storage unit. The state of the worker who performs the work in the work area 100 is estimated using each information stored in 46. The state of the worker estimated by the control unit 41 is notified (transmitted) to, for example, the administrator terminal 30 through the communication processing unit 42, for example.

  Hereinafter, the worker information stored in the worker information storage unit 44 illustrated in FIG. 7, the device information stored in the device information storage unit 45, and the process information stored in the process information storage unit 46 will be described.

  FIG. 8 shows an example of the data structure of worker information stored in the worker information storage unit 44. As shown in FIG. 8, the worker information stored in the worker information storage unit 44 includes position information indicating the position of the worker in association with a worker ID for identifying the worker, and the work. The status of the employee is included.

  In the example shown in FIG. 8, worker information 441 to 443 is stored in the worker information storage unit 44.

  The worker information 441 includes position information “Xu1, Yu1” and a status “working” in association with the worker ID “HO — 0001”. According to the worker information 441, the position of the worker identified by the worker ID “HO — 0001” is the position indicated by the position information “Xu1, Yu1”, and the worker is working (that is, Is being worked on). Note that when the worker is performing an operation to operate the manufacturing apparatus 20, the status may include an identifier for identifying the manufacturing apparatus 20.

  Note that the position information “Xu1, Yu1” has a predetermined position in the work area 100 as the origin, and the X axis and Y axis when the east-west axis is the X axis and the north-south axis is the Y axis, for example. The position on the plane (XY plane) including The origin may be, for example, the position of the main manufacturing apparatus 20 installed in the work area 100, the corner of the work area 100, or the like. The same applies to other position information.

  The worker information 442 includes position information “Xu2, Yu2” and a status “moving” in association with the worker ID “HO_0002”. According to the worker information 442, the position of the worker identified by the worker ID “HO_0002” is the position indicated by the position information “Xu2, Yu2”, and the worker is moving (that is, moving) In the middle).

  The worker information 443 includes position information “Xu3, Yu3” and a status “standby” in association with the worker ID “HO_0003”. The worker information 443 indicates that the position of the worker identified by the worker ID “HO_0003” is the position indicated by the position information “Xu3, Yu3”, and that the worker is on standby. ing.

  The position information included in the worker information 441 to 443 can be periodically updated by receiving the above-described worker position information from the worker terminal 10. The statuses included in the worker information 441 to 443 can be periodically updated based on the worker position information and the status information of the manufacturing apparatus 20 described above. Specifically, for example, when the manufacturing apparatus 20 in the vicinity of the position of the worker indicated by the position information is in a state of manufacturing a product, the status is set to “working (for example, operating the manufacturing apparatus 20). Can be updated.) The manufacturing apparatus 20 in the vicinity of the worker's position can be specified (searched) using position information included in apparatus information described later. Further, when the position of the worker indicated by the position information that is periodically updated is sequentially moving, the status can be updated to “moving”. Furthermore, if the position of the worker indicated by the position information is a predetermined position (for example, a standby place), the status can be updated to “waiting”.

  The status included in the worker information may be updated according to the state of the worker specified by the worker in the worker terminal 10, for example.

  Although only the worker information 441 to 443 has been described in FIG. 8, the worker information storage unit 44 stores worker information regarding all workers who perform work in the work area 100. Although the worker information related to the worker has been described here, for example, when the administrator looks around the work area 100, the position information indicating the position of the administrator (manager information related to the manager) is managed. It may be managed in the server device 40.

  FIG. 9 shows an example of the data structure of the device information stored in the device information storage unit 45. As shown in FIG. 9, the apparatus information stored in the apparatus information storage unit 45 includes position information indicating the position of the manufacturing apparatus 20 in association with the apparatus ID for identifying the manufacturing apparatus 20 and the manufacturing apparatus. 20, the risk level (hereinafter referred to as device risk level) is included.

  In the example illustrated in FIG. 9, device information 451 to 453 is stored in the device information storage unit 45.

  The device information 451 includes location information “Xd1, Yd1” and device risk “5” in association with the device ID “M_0001”. According to this apparatus information 451, the manufacturing apparatus 20 identified by the apparatus ID “M_0001” is installed at the position indicated by the position information “Xd1, Yd1”, and the apparatus risk level of the manufacturing apparatus 20 is 5. It has been shown.

  The device information 452 includes location information “Xd2, Yd2” and device risk “4” in association with the device ID “M_0002”. According to this apparatus information 452, the manufacturing apparatus 20 identified by the apparatus ID “M_0002” is installed at the position indicated by the position information “Xd2, Yd2”, and the apparatus risk level of the manufacturing apparatus 20 is 4. It has been shown.

  The device information 453 includes position information “Xd3, Yd3” and device risk “1” in association with the device ID “M_0003”. According to this apparatus information 453, the manufacturing apparatus 20 identified by the apparatus ID “M_0003” is installed at the position indicated by the position information “Xd3, Yd3”, and the apparatus risk level of the manufacturing apparatus 20 is 1. It has been shown.

  Note that the device risk included in the device information is represented by a numerical value of 1 to 5, for example. In this case, for example, the device risk “1” represents the lowest risk (that is, the safest), and the device risk “5” represents the highest risk (that is, the most dangerous). Represent. The apparatus risk level is determined in consideration of the installation position of the manufacturing apparatus 20 (for example, installed at a high position) in addition to the risk level in the operation of the manufacturing apparatus 20.

  Although only the apparatus information 451 to 453 has been described in FIG. 9, the apparatus information storage unit 45 stores apparatus information regarding all the manufacturing apparatuses 20 installed in the work area 100.

  FIG. 10 shows an example of the data structure of the process information stored in the process information storage unit 46. As illustrated in FIG. 10, the process information stored in the process information storage unit 46 includes a manufacturing start time, a work name, and a status in association with the apparatus ID for identifying the manufacturing apparatus 20.

  The manufacturing start time indicates the start time of a product manufacturing process (hereinafter referred to as a manufacturing process of the manufacturing apparatus 20) by the manufacturing apparatus 20 identified by the apparatus ID associated with the manufacturing start time. The work name indicates a work performed by the worker in the manufacturing process of the manufacturing apparatus 20 identified by the manufacturing apparatus ID associated with the work name. The status indicates the current state of the manufacturing apparatus 20 identified by the apparatus ID associated with the status. Note that this status is periodically updated based on the status information of the manufacturing apparatus 20 received from each product apparatus 20 described above.

  In the example illustrated in FIG. 10, process information 461 to 464 is stored in the process information storage unit 46.

  The process information 461 includes a manufacturing start time “10:00”, a work name “work A”, and a status “manufacturing” in association with the apparatus ID “M_0001”. According to this process information 461, the start time of the manufacturing process of the manufacturing apparatus 20 identified by the manufacturing apparatus ID “M_0001” is 10:00, and the work performed by the worker in the manufacturing process is the work A. It is shown that the manufacturing apparatus 20 is in the state of manufacturing a product.

  The process information 462 includes a manufacturing start time “10:30”, a work name “work B”, and a status “ready” in association with the device ID “M_0002”. According to this process information 462, the start time of the manufacturing process of the manufacturing apparatus 20 identified by the apparatus ID “M_0002” is 10:30, the work performed by the worker in the manufacturing process is the work B, and the manufacturing process is performed. It is shown that the device 20 is ready to manufacture a product (ie, waiting for the start of the manufacturing).

  The process information 463 includes a manufacturing start time “11:30”, a work name “work C”, and a status “not ready” in association with the device ID “M_0003”. According to the process information 463, the start time of the manufacturing process of the manufacturing apparatus 20 identified by the apparatus ID “M_0003” is 11:30, and the work performed by the worker in the manufacturing process is the work C, and the manufacturing process is performed. It is shown that the device 20 is not ready to manufacture the product.

  The process information 464 includes a manufacturing start time “12:30”, a work name “work D”, and a status “not ready” in association with the apparatus ID “M_0004”. According to this process information 464, the start time of the manufacturing process of the manufacturing apparatus 20 identified by the apparatus ID “M_0004” is 12:30, and the work performed by the worker in the manufacturing process is the work D. It is shown that the device 20 is not ready to manufacture the product.

  Although only the process information 461 to 464 has been described with reference to FIG. 10, the process information storage unit 46 stores process information regarding manufacturing processes of all the manufacturing apparatuses 20 installed in the work area 100.

  Hereinafter, the operation when the management server device 40 according to the present embodiment estimates the state of a worker who performs work in the work area 100 will be described.

  First, an outline of a process for estimating a worker's state (hereinafter referred to as a state estimation process) will be described.

  In the present embodiment, the worker state estimated by the state estimation process includes, for example, “danger” and “safety”. “Danger” indicates that the worker is in a dangerous state. “Safe” indicates that the worker is in a safe state.

  In the state estimation process, as shown in FIG. 11, the position information (Xu, Yu) of the worker, the position information (Xd, Yd) of each manufacturing apparatus 20 installed in the work area 100, and the apparatus risk ( Rd) and the state of the worker is estimated.

  Specifically, for example, when the manufacturing apparatus 20 with a high degree of danger is installed in the vicinity of the worker, it is estimated that the state of the worker is “danger”. On the other hand, when the manufacturing apparatus 20 is not installed in the vicinity of the worker, or when the risk of the manufacturing apparatus 20 installed in the vicinity of the worker is low, the state of the worker is “safe”. Estimated.

  Further, in the state estimation process, worker height information (Zu) may be used as shown in FIG. Note that the worker height information (Zu) indicates the position of the worker in the height direction when the floor surface (work floor) of the work area 100 is used as a reference, for example, as shown in FIG. In this case, as described above, when the high-risk manufacturing apparatus 20 is installed in the vicinity of the worker and the worker is in a high place, the worker's state is “dangerous”. presume. On the other hand, even if the high-risk manufacturing apparatus 20 is installed in the vicinity of the worker, if the worker is not in a high place, it is estimated that the worker's state is “safe”. .

  Although the outline of the state estimation process has been described with reference to FIGS. 11 and 12, the details of the process procedure of the state estimation process will be described below with reference to the flowchart shown in FIG. In addition, FIG. 13 demonstrates the case where a worker's state is estimated using a worker's height information in addition to the worker's position information, the position information of each manufacturing apparatus 20, and the device risk. The process shown in FIG. 13 is executed by the management server device 40.

  The process shown in FIG. 13 is executed for each worker terminal 10 worn by each worker who performs work in the work area 100. In the following description, the worker terminal 10 that is the target of the process is displayed. For convenience, it is referred to as a target worker terminal 10. Similarly, a worker wearing the target worker terminal 10 is referred to as a target worker for convenience.

  First, the target worker terminal 10 attached by the target worker who performs work in the work area 100 identifies the target worker by continuously driving the GPS sensor 14, the acceleration sensor 15, and the atmospheric pressure sensor 16, for example. The position information, acceleration information, and height information of the target worker are periodically transmitted to the management server device 40 together with the worker ID for the purpose.

  Thereby, the communication processing unit 42 included in the management server device 40 receives the position information, acceleration information, and height information of the target worker from the target worker terminal 10 (block B1).

  Each of the manufacturing apparatuses 20 installed in the work area 100 periodically transmits status information (status information of the manufacturing apparatus 20) indicating the state of the manufacturing apparatus 20 to the management server apparatus 40. As described above, the status information of the manufacturing apparatus 20 periodically transmitted from the manufacturing apparatus 20 is similarly received by the communication processing unit 42.

  When various types of information are received by the communication processing unit 42, the information management unit 43 determines the worker information described above based on the position information of the target worker and the status information of the manufacturing apparatus 20 (position information and status included therein). And the process information (status included) is updated.

  When the process of block B1 is executed, the control unit 41, based on the position information included in each piece of device information stored in the device information storage unit 45, the manufacturing apparatus installed in the vicinity of the target worker 20 is specified (block B2).

  Specifically, the control unit 41 sets the position indicated by the position information (first position information) included in each piece of apparatus information and the position indicated by the position information (second position information) of the target worker. Manufacturing in which it is determined whether or not the distance (distance to the target worker) is equal to or less than a predetermined value (hereinafter referred to as a first threshold), and the distance is determined to be equal to or less than the first threshold The apparatus 20 is specified as the manufacturing apparatus 20 installed in the vicinity of the target worker. In addition, when the manufacturing apparatus 20 installed in the vicinity of the target worker does not exist (that is, the manufacturing apparatus 20 whose distance from the target worker is equal to or less than the first threshold does not exist), the target worker is It is assumed that a safe state is assumed, and the subsequent processing is not executed.

  In the following description, the manufacturing apparatus identified in block B2 (that is, the manufacturing apparatus installed in the vicinity of the target worker) 20 is referred to as the target manufacturing apparatus 20 for convenience.

  The control unit 41 acquires the device risk level (the device risk level of the target manufacturing device 20) included in the device information related to the target manufacturing device 20 stored in the device information storage unit 45 (block B3). In this case, the control unit 41 acquires the device risk level included in the device information in association with the device ID for identifying the target manufacturing device 20.

  Next, the control unit 41 determines whether or not the device manufacturing degree of the target manufacturing apparatus 20 acquired in block B3 is high (block B4). In this case, the control unit 41 determines whether or not the device risk level of the target manufacturing device 20 is equal to or greater than a predetermined value (hereinafter referred to as a second threshold value). When it is determined that the device risk level of the target manufacturing device 20 is equal to or higher than the second threshold value, it is determined that the device risk level of the target manufacturing device 20 is high. On the other hand, when it is determined that the device risk level of the target manufacturing device 20 is not equal to or higher than the second threshold value, it is determined that the device risk level of the target manufacturing device 20 is not high.

  When it is determined that the device manufacturing device 20 has a high device risk (YES in block B4), the control unit 41 determines whether the target worker is at a high position based on the height information of the target worker. Determine (block B5). In this case, the control unit 41 determines whether the position (height) in the height direction of the target worker indicated by the height information of the target worker is higher than a predetermined position (height). . When it is determined that the position of the target worker in the height direction is higher than a predetermined position, it is determined that the target worker is at a high position. On the other hand, when it is determined that the position of the target worker in the height direction is not higher than a predetermined position, it is determined that the target worker is not at a high position.

  Here, based on the acceleration (change) indicated by the acceleration information of the target worker received in the block B1, for example, it is estimated whether the target worker is working (that is, working). Shall be able to.

  For this reason, when it is determined that the target worker is at a high position (YES in block B5), the control unit 41 determines the target based on the acceleration indicated by the acceleration information of the target worker received in block B1. It is determined whether or not the worker is working (block B6).

  When it is determined that the target worker is working (YES in block B6), the control unit 41 is in a dangerous state for the target worker (that is, the target worker is working in a dangerous state). ) (Block B7). In this case, “danger” is held in the management server device 40 as the state of the target worker.

  On the other hand, when it is determined in block B4 that the device manufacturing apparatus 20 is not high in device risk (NO in block B4), it is estimated that the target worker is not in a dangerous state (that is, in a safe state). Processing is terminated. In this case, “safety” is held in the management server device 40 as the state of the target worker. The same applies to the case where it is determined that the target worker is not at a high position in block B5 (NO in block B5) and the case where it is determined in block B6 that the target worker is not working (NO in block B6).

  By executing the processing shown in FIG. 13 for each worker terminal 10, each state of the worker who performs work in the work area 100 (“danger” or “safe”) in the management server device 40. Can be managed. The process shown in FIG. 13 is periodically executed every time the position information, acceleration information, and height information of each worker is received by the management server device 40 as described above. Thereby, the state of each worker is updated according to the change of the state.

  In the process shown in FIG. 13, when the target manufacturing apparatus 20 has a high device risk level, the target worker is at a high position, and the target worker is working, the target worker is in a dangerous state. However, one or two of the processes of blocks B4 to B6 may be omitted. That is, for example, when the process of block B4 is omitted, if the target worker is at a high position and the target worker is working, the target worker is estimated to be in a dangerous state. Good. For example, when the process of block B5 is omitted, if the target manufacturing apparatus 20 has a high device risk level and the target worker is working, it is estimated that the target worker is in a dangerous state. May be. Further, for example, when the processing of the blocks B5 and B6 is omitted, if the target manufacturing apparatus (that is, the manufacturing apparatus installed in the vicinity of the target worker) 20 has a high device risk level, the target worker is in danger. It may be presumed that there is a state.

  Further, the process of block B6 may be executed on the worker terminal 10 side. In this case, whether or not the target worker is working is determined based on the acceleration indicated by the acceleration information of the target worker at the worker terminal 10, and the determination result is used instead of the acceleration information. To the management server device 40.

  Further, for example, if the worker terminal 10 can acquire device information and the like, all of the processing shown in FIG. 13 is executed on the worker terminal 10 side, and the worker state estimation result is output to the management server device 40 and the like. It is good also as a structure to be made.

  Further, although it has been described that it is determined whether or not the target worker is working based on the acceleration indicated by the acceleration information of the target worker, depending on the work (contents), the worker terminal 10 (glasses-type wearable) The terminal may not be accelerated, and the target worker may not be detected to be working. Therefore, in block B6, for example, whether or not the target worker is working by using information (worker information and process information) stored in the worker information storage unit 44 or the process information storage unit 46. It may be determined. Specifically, for example, when the status included in the worker information in association with the worker ID for identifying the target worker indicates that the target worker is working, the target worker is working. You may judge. For example, when the status included in the process information in association with the device ID for identifying the target manufacturing device 20 indicates that manufacturing is in progress (that is, the target manufacturing device 20 is being operated). The target worker may be determined to be working. Moreover, it is good also as a structure which determines whether a target worker is working based on the acceleration information of a target worker, worker information, and process information.

  Here, in the present embodiment, for example, the worker terminal 10 and the administrator terminal 30 that are worn by a worker estimated to be “dangerous” (that is, a worker in a dangerous state) are in this state. A corresponding notification shall be output.

  Hereinafter, with reference to the flowchart of FIG. 14, a processing procedure of the management server device 40 when a notification is output to the worker terminal 10 and the administrator terminal 30 will be described.

  First, the administrator uses the worker terminal 10 and the administrator terminal 30 (the voice call function that the manager terminal 30 has) to give instructions to each worker such as assignment of work, confirmation and change of work contents, and the like. ). In this case, the administrator performs an operation (hereinafter referred to as a call operation) for making a call to the worker who is the target of this instruction (the worker terminal 10 worn by the operator) on the administrator terminal 30. Do it. The call operation includes, for example, an operation for displaying a screen for calling the worker on the administrator terminal 30 or an operation for pressing a button for calling the worker on the screen. Etc. are included. Hereinafter, in the description of FIG. 14, a worker to whom an administrator tries to make a call by a call operation is called a target worker.

  When a call operation is performed on the administrator terminal 30, the administrator terminal 30 transmits an inquiry to the management server device 40. This inquiry includes a worker ID for identifying the target worker.

  The communication processing unit 42 included in the management server device 40 receives the inquiry transmitted by the administrator terminal 30 (block B11).

  Next, the control unit 41 includes the inquiry received in the block B11 based on the state of each worker managed in the management server device 40 by executing the process shown in FIG. It is determined whether or not the state of the target worker identified by the worker ID is “danger” (block B12).

  When it is determined that the state of the target worker is “dangerous” (YES in block B12), the control unit 41 is in a “dangerous” state as a response to the inquiry received in block B11. Is output to the administrator terminal 30 (block B13).

  In this case, the notification output by the control unit 41 is displayed on the display 35 of the administrator terminal 30. Specifically, on the display 35 of the administrator terminal 30, for example, the state of the target worker should be “dangerous”, so that the target worker should not be called (or the target worker will not answer the incoming call). Message indicating that the user cannot respond).

  When such a message is displayed on the display 35 of the administrator terminal 30, the administrator stops calling the target worker and, for example, performs a call operation again after a predetermined time has elapsed. Preferably it is done.

  As described above, when the process of block B13 is executed, the call by the administrator is canceled, but the control unit 41 performs the call operation by the administrator although the call is stopped (call making). A notification including that the call operation has been performed on the administrator terminal 30 is output to the worker terminal 10 (block B14).

  In this case, the notification output by the control unit 41 is displayed on the display (lens-integrated screen 1002) of the worker terminal 10. Specifically, on the display of the worker terminal 10, a message, a mark, or the like indicating that a call operation has been performed by the administrator (that is, the administrator is trying to call the target worker) Is displayed. This message, mark, etc. shall be displayed in a partial area 1100 of the lens-integrated screen 1002 as shown in FIG. 15 in order to secure the field of view of the target worker wearing the worker terminal 10. . The area 1100 shown in FIG. 15 is arranged on the upper part of the lens-integrated screen 1002, but the area 1100 can be located at other positions (see FIG. 15) as long as the field of view of the target worker can be secured. For example, it may be provided in the lower part or the like.

  The operator may be notified that the call operation has been performed by the administrator, for example, by turning on an LED lamp provided in the worker terminal 10.

  In the present embodiment, when an incoming call is received from an administrator when the target worker is in a “dangerous” state, an unexpected accident may occur, for example, in response to the incoming call. Based on the viewpoint of the existence, when the state of the target worker is “dangerous”, the manager is prompted to cancel the call. On the other hand, even when a message or the like is displayed on the display of the worker terminal 10 when the state of the target worker is “danger”, an unexpected accident may occur when trying to check the message. For this reason, such a message or the like is displayed, for example, after the state of the target worker is updated from “danger” to “safe” (that is, the state that the target worker is dangerous has been resolved). It may be.

  Further, in the present embodiment, as described above, when the state of the target worker is “danger”, the administrator urges the caller to cancel the call. A call may be made. In this case, the ringing tone (ringing tone) at the worker terminal 10 when the call is made by the administrator for the purpose of preventing the danger (safety) of the target worker is not output (that is, no sound is generated). It may be. In such a configuration, since the target worker often does not notice the incoming call, for example, when the state of the target worker is updated from “danger” to “safe”, the incoming call history in the worker terminal 10 is not changed. It may be displayed on the display of the worker terminal 10.

  Further, when the state of the target worker is “danger”, for example, under the control of the management server device 40, the incoming call at the worker terminal 10 worn by the target worker is forcibly rejected. May be.

  In the process illustrated in FIG. 14, a notification including that the call operation has been performed by the administrator is output to the worker terminal 10 (that is, the worker having performed the call operation has been performed by the administrator). However, the worker may be notified that the worker is in a dangerous state, for example. In this case, for example, it is possible to notify the worker that the device risk of the manufacturing device 20 installed in the vicinity of the worker is high.

  Further, for example, it is determined that the worker is moving based on the position information of the worker periodically transmitted from the worker terminal 10, and there is a dangerous passage or place in the vicinity of the worker. In such a case, the worker may be notified of the presence of the dangerous passage or place. Furthermore, when a working vehicle or the like is traveling in the work area 100, the vehicle approaches the worker based on the position of the vehicle detected by a GPS sensor provided in the vehicle. The worker may be notified of the fact that he / she is present. In this case, the distance between the worker and the vehicle may be notified together.

  In addition to the fact that the worker is in a dangerous state, for example, the worker is notified of the state of the manufacturing equipment installed in the vicinity of the worker (for example, being in a trial run or being out of service). It does not matter.

  As described above, in the present embodiment, position information (second position information) indicating the position of a worker (user) who wears the worker terminal (glasses-type wearable terminal) 10 and performs work in the work area 100 is provided. Based on the positional information (first positional information) and the risk included in the device information received from the worker terminal 10 and stored in the device information storage unit 45, the work is performed based on the received positional information. Estimate the condition of the worker.

  Specifically, for example, it is determined that the device risk level of the manufacturing apparatus 20 installed in the vicinity of the worker terminal 10 (the worker wearing the worker terminal) is equal to or higher than a predetermined value (second threshold). In some cases, it can be estimated that the worker is in danger.

  In this case, the position information received from the worker terminal 10 indicates the position detected by the GPS sensor 14 provided in the worker terminal 10. Note that the position of the worker (the worker terminal 10 worn by the worker) is estimated based on, for example, the position of an access point that can communicate with the worker terminal 10 among a plurality of access points provided in the work area 100. It does not matter.

  In the present embodiment, with such a configuration, for example, it is not necessary for the administrator to check the state of each worker, so the burden on the administrator can be reduced.

  In this embodiment, when it is further determined that the worker is at a high position (the position in the height direction of the worker is higher than a predetermined position), the worker is in a dangerous state. It is also possible to adopt an estimation configuration. It is also possible to adopt a configuration in which it is estimated that the worker is in a dangerous state when it is further determined that the worker is working. According to such a configuration, it is possible to estimate the worker's state (that the worker is in a dangerous state) more accurately.

  Note that the position in the height direction of the worker is estimated based on the atmospheric pressure (change) measured by the atmospheric pressure sensor 16 provided in the worker terminal 10, for example, photographed by a camera provided in the work area 100. It may be estimated on the basis of an image including the worker who has been performed or an image around the worker photographed by the camera 1003 provided in the worker terminal 10. Further, whether or not the worker is working may be determined using the acceleration measured by the acceleration sensor 15 provided in the worker terminal 10, or the position information of the manufacturing apparatus 20 included in the device information. The determination may be made using the worker position information received from the worker terminal 10 and the status information received from the manufacturing apparatus 20.

  Furthermore, in the present embodiment, when an operation (calling operation) for calling a worker is performed on the administrator terminal 30, a notification including that the worker is in a dangerous state is sent. It is output to the manager terminal 30. In this embodiment, such a configuration allows the administrator to cancel a call to a worker in a dangerous state, so that the worker is aware of an incoming call corresponding to the call from the administrator. You can concentrate on work (dangerous work) without being taken. According to this, the safety of the worker can be ensured, and the work efficiency of the worker, the operating rate of the manufacturing apparatus 20 and the like can be improved. Note that the notification including that the worker is in a dangerous state may be output to the administrator terminal 30 when it is estimated that the worker is in a dangerous state, for example.

  Further, in the present embodiment, the fact that the call operation has been performed on the administrator terminal 30 (that is, that the administrator was about to make a call) is reported to the worker (the worker terminal 10 worn by the worker). Be notified. In this embodiment, for example, the operator can make a call (make a phone call) to the administrator after the dangerous work is completed. Communication) and the like can be performed efficiently.

  In the present embodiment, by using a glasses-type wearable terminal as the worker terminal 10, the worker can work in a hands-free manner. On the other hand, the worker terminal 10 according to the present embodiment only needs to be able to provide (transmit) worker position information, acceleration information, and height information to the management server device 40. It may be a wearable device having another shape such as a mold. Furthermore, the worker terminal 10 may be a mobile device such as a smartphone carried by the worker.

  Furthermore, when the worker wearing the worker terminal (glasses-type wearable terminal) 10 has a mobile device such as a smartphone, for example, the worker terminal 10 and the smartphone may be linked. Is possible. Specifically, the worker terminal 10 and the smartphone are connected so as to be communicable by, for example, Bluetooth or the like, and the worker terminal 10 receives the position information indicating the position detected by the GPS sensor provided in the smartphone from the smartphone and uses it. You may make it do.

  Moreover, the image captured by the camera provided in the smartphone may be transmitted to the worker terminal 10 so that the image is displayed on the display of the worker terminal 10.

  Furthermore, as a configuration in which a state such as a worker moving is detected by a function of measuring the number of steps of the worker provided in the smartphone, and the detected state is transmitted to the management server device 40. Also good.

  In addition, when the worker terminal 10 has a configuration that does not have a voice call function, a voice call between the worker and the administrator may be performed using the voice call function of the smartphone.

  When the worker terminal 10 and the smartphone are linked in this manner, various functions of the smartphone can be used.

(Second Embodiment)
Next, a second embodiment will be described. Since the environment in which the management system in the present embodiment is used, the network configuration of the management system, the worker terminal, the administrator terminal, and the configuration of the management server device are the same as those in the first embodiment, Detailed description thereof is omitted here. In the following, description will be given with reference to FIGS. In the present embodiment, the differences from the first embodiment described above will be mainly described.

  In the present embodiment, the data structure of the device information stored in the device information storage unit 45 included in the management server device 40 is different from that of the first embodiment described above.

  FIG. 16 shows an example of the data structure of the device information stored in the device information storage unit 45 in the present embodiment. As shown in FIG. 16, the device information stored in the device information storage unit 45 includes position information, device risk, work name, and work risk in association with the device ID. Since the device ID, the position information, and the device risk level are as described with reference to FIG. 9, detailed description thereof is omitted.

  The work name indicates the work performed by the worker in the manufacturing process of the manufacturing apparatus 20 identified by the apparatus ID associated with the work name. The work name included in the device information indicates a work obtained by further subdividing the work indicated by the work name included in the process information illustrated in FIG. 10 described above. For this reason, in the device information shown in FIG. 16, a plurality of work names are associated with one device ID.

  The work risk level indicates the risk level related to the work (contents) indicated by the work name associated with the work risk level.

  In the example illustrated in FIG. 16, device information 451a, 452a, and 453a are stored in the device information storage unit 45. The device information 451a is information related to the manufacturing device 20 identified by the device ID “M_0001”. The device information 452a is information related to the manufacturing device 20 identified by the device ID “M_0002”. The device information 453a is information related to the manufacturing device 20 identified by the device ID “M_0003”.

  The device information 451a includes work names “work A1”, “work A2”, and “work A3” in association with the device ID “M_0001”. The work indicated by each of the work names “work A1” to “work A3” is the work A performed by the worker in the manufacturing process of the manufacturing apparatus 20 identified by the apparatus ID “M_0001” described in FIG. It corresponds to each work when subdividing. The device information 451a includes work risk levels “1”, “3”, and “5” in association with work names “work A1”, “work A2”, and “work A3”, respectively. According to the device information 451a, the risk level for the work indicated by the work name “work A1” is 1, the risk level for the work indicated by the work name “work A2” is 3, and the work name “work A3”. It is shown that the degree of risk related to the work indicated by is 5.

  The device information 452a includes work names “work B1” and “work B2” in association with the device ID “M_0002”. The work indicated by each of the work names “work B1” and “work B2” is the work B performed by the worker in the manufacturing process of the manufacturing apparatus 20 identified by the apparatus ID “M_0002” described in FIG. It corresponds to each work when subdividing. Further, the device information 452a includes work risk levels “2” and “4” in association with work names “work B1” and “work B2”, respectively. According to this device information 452a, it is indicated that the risk level for the work indicated by the work name “work B1” is 2, and the risk level for the work indicated by the work name “work B2” is 4.

  The device information 453a includes a work name “work C1” in association with the device ID “M_0003”. It is assumed that the operation C performed by the worker in the manufacturing process of the manufacturing apparatus 20 identified by the apparatus ID “M_0003” described in FIG. 10 described above cannot be subdivided. Therefore, in the device information 453a, only one work name is associated with the device ID “M_0003”. In this case, the work name “work C” included in the process information 463 illustrated in FIG. 10 and the work name “work C1” included in the device information 453a indicate the same work. The device information 453a includes a work risk “1” in association with the work name “work C1”. According to this device information 453a, it is indicated that the degree of risk related to the work indicated by the work name “work C1” is 1.

  In the present embodiment, the worker's state (“danger” or “safety”) is estimated using the above-described work risk level.

  Hereinafter, with reference to the flowchart shown in FIG. 17, the processing procedure of the state estimation process in this embodiment is demonstrated.

  First, processing of blocks B21 to B26 corresponding to the processing of blocks B1 to B6 shown in FIG. 13 is executed.

  Here, in block B26, it is determined whether the target worker is working based on the acceleration (change) indicated by the acceleration information of the target worker received in block B21. Sometimes, a specific vibration (acceleration) may occur in the target worker, and the work (content) that the target worker is working on may be specified (estimated) based on the acceleration. It is assumed that the acceleration (pattern) generated in each work is stored in the management server device 40 in advance.

  For this reason, when it is determined in block B26 that the target worker is working (YES in block B26), the control unit 41 associates the apparatus information with the work name indicating the work identified as described above. The included work risk (work risk of the target manufacturing apparatus 20) is acquired (block B27).

  Next, the control unit 41 determines whether or not the work risk level of the target manufacturing apparatus 20 acquired in block B27 is high (block B28). In this case, the control unit 41 determines whether or not the work risk level of the target manufacturing apparatus 20 is equal to or higher than a predetermined value (hereinafter referred to as a third threshold value). When it is determined that the work risk level of the target manufacturing apparatus 20 is greater than or equal to the third threshold value, it is determined that the work risk level of the target manufacturing apparatus 20 is high. On the other hand, when it is determined that the work risk level of the target manufacturing apparatus 20 is not equal to or higher than the third threshold value, it is determined that the work risk level of the target manufacturing apparatus 20 is not high.

  When it is determined that the work risk level of the target manufacturing apparatus 20 is high (YES in block B28), the process of block B29 corresponding to the process of block B7 shown in FIG. 13 is executed.

  On the other hand, when it is determined in block B28 that the risk of work of the target manufacturing apparatus 20 is not high (NO in block B28), it is estimated that the target worker is not in a dangerous state (that is, in a safe state). Processing is terminated.

  As described above, in the process shown in FIG. 17, when the high-risk manufacturing apparatus 20 is installed in the vicinity of the target worker and the target worker is performing a dangerous work at a high position, It is estimated that the target worker is in danger. Note that a configuration in which at least one of the processes of the blocks B24 to B26 and B28 is omitted may be employed. When the process of block B28 is omitted, the process of block B27 is also omitted.

  At the time of processing of block B27, for example, the target worker is working using information (worker information or process information) stored in the worker information storage unit 44 or the process information storage unit 46, for example. The work (contents) may be estimated. Specifically, the status included in the worker information related to the target worker is “working”, for example, the status included in the process information in association with the device ID for identifying the target manufacturing device 20 Can be specified (estimated) that the work indicated by the work name included in the process information is the work being performed by the target worker.

  Further, if the status information received from the target manufacturing apparatus 20 includes an operation (content) being performed on the target manufacturing apparatus 20, the work content of the target worker is specified from the operation or the like. May be possible. For this reason, each manufacturing apparatus 20 is good also as a structure which transmits the status information containing the operation currently performed with respect to the said manufacturing apparatus 20 to the management server apparatus 40. FIG. In addition, each manufacturing apparatus 20 manages status information including a work name that is presumed to be currently performed according to an operation performed on the manufacturing apparatus 20 or an operating state of the manufacturing apparatus 20. It is good also as a structure which transmits to the server apparatus 40. FIG.

  Although detailed explanation is omitted in the present embodiment, the manager manages the call operation for the worker after the state shown in FIG. 17 is executed and the state of each worker is estimated. When the process is performed at the person terminal 30, the process described with reference to FIG. 14 is executed.

  As described above, in the present embodiment, it is further determined that the degree of risk related to the work performed by the worker is greater than or equal to a predetermined value (third threshold value) as compared with the first embodiment described above. If this happens, it is estimated that the worker is in danger.

  Here, for example, even when a worker is working in the vicinity of the manufacturing apparatus 20 having a high apparatus risk level (working on the manufacturing apparatus 20), the manufacturing process of the manufacturing apparatus 20 is performed. Depending on the progress status, the risk level for the current work may not be high.

  In the present embodiment, as described above, by using the work risk level, management is performed even though the risk level related to the work performed by the worker is not high (that is, the call can be answered). It is possible to prevent the caller from canceling the call (so that the administrator does not make a call). Thereby, compared with 1st Embodiment, the instruction | indication (contact) from a manager to an operator can be performed more smoothly.

(Third embodiment)
Next, a third embodiment will be described. This embodiment is different from the second embodiment described above in that the worker terminal 10 that is a glasses-type wearable terminal includes a line-of-sight detection sensor 18 as shown in FIG.

  The line-of-sight detection sensor 18 is, for example, a sensor using an electrooculogram sensing technique, and changes depending on the movement of the eyeball by a plurality of electrodes attached to the worker terminal 10 (around the eye). Measure the potential difference (change in voltage) between the two.

  The worker terminal 10 can obtain the number of blinks of the worker, the angle (direction) of the line of sight, and the like based on the potential difference measured by the line-of-sight detection sensor 18 by using such a line-of-sight detection sensor 18. it can.

  Information including the number of blinks and the line-of-sight angle obtained by the worker terminal 10 (hereinafter referred to as line-of-sight information) is transmitted via the communication module 17 together with other information (position information, acceleration information, and height information). It is transmitted to the management server device 40.

  In this embodiment, the worker's state (“danger” or “safe”) is estimated using this line-of-sight information.

  Hereinafter, with reference to the flowchart shown in FIG. 19, the processing procedure of the state estimation process in this embodiment is demonstrated.

  First, the communication processing unit 42 included in the management server device 40 receives position information, acceleration information, height information, and line-of-sight information of the target worker from the target worker terminal 10 (block B31). The line-of-sight information received by the communication processing unit 42 includes the number of blinks and the line-of-sight angle of the target worker as described above.

  Next, the processing of blocks B32 to B38 corresponding to the processing of block B22 to block B28 shown in FIG. 17 is executed.

  Here, when the target worker is in a dangerous state (feels), the target worker is often in a tension state. In addition, a person who is in a tension state generally tends to increase the number of blinks. For this reason, in this embodiment, the line-of-sight information received in block B31 is used to determine whether or not the target worker is in a tension state.

  When it is determined in block B38 that the work risk of the target manufacturing apparatus 20 is high (block B38), the control unit 41 determines whether the target worker is in a tension state based on the line-of-sight information received in block B31. Is determined (block B39). In this case, the control unit 41 determines whether or not the number of blinks of the target worker included in the line-of-sight information is equal to or greater than a predetermined value (hereinafter referred to as a fourth threshold value). When it is determined that the number of blinks of the target worker is equal to or greater than the fourth threshold, it is determined that the target worker is in a tension state. On the other hand, when it is determined that the number of blinks of the target worker is not equal to or greater than the fourth threshold, it is determined that the target worker is not in a tension state.

  The fourth threshold is a value determined from, for example, the number of times the target worker blinks during normal times, and is assumed to be stored in the management server device 40 in advance.

  In addition, a person who is in a tension state may be characterized by the movement of the line of sight (change in angle). For this reason, in the above-described block B39, processing in consideration of the line-of-sight angle included in the line-of-sight information received in block B31 may be executed.

  When it is determined that the target worker is in a tension state (YES in block B39), the process of block B40 corresponding to the process of block B29 shown in FIG. 17 described above is executed.

  On the other hand, when it is determined that the target worker is not in a tension state (NO in block B39), it is estimated that the target worker is not in a dangerous state (that is, in a safe state), and the process ends.

  As described above, in the process shown in FIG. 19, the manufacturing apparatus 20 with a high degree of risk is installed in the vicinity of the target worker, and the target worker is performing a dangerous work at a high position, and the target worker When the worker is in a tension state, it is estimated that the target worker is in a dangerous state. Note that a configuration in which at least one of the processes of the blocks B34 to B36, B38, and B39 is omitted may be employed.

  Although detailed explanation is omitted in the present embodiment, the manager manages the call operation for the worker after the state shown in FIG. 19 is executed and the state of each worker is estimated. When the process is performed at the person terminal 30, the process described with reference to FIG. 14 is executed.

  As described above, in the present embodiment, when it is further determined that the number of blinks of the worker is equal to or greater than a predetermined value (fourth threshold value) as compared with the second embodiment described above. It is estimated that the worker is in a dangerous state.

  In the present embodiment, with such a configuration, for example, an operator cannot respond to an incoming call corresponding to an outgoing call by an administrator, such as a worker being in a tension state, or an accident or the like occurs due to an incoming call answering. Since it is estimated that the worker is in a dangerous state only when the possibility is high (presumed), it is possible to prevent the manager from calling the worker unnecessarily. .

  Note that although the line-of-sight detection sensor 18 in the present embodiment has been described as a sensor (ocular potential sensor) using an electro-oculography sensing technique, the line-of-sight detection sensor 18 includes the number of blinks of the worker and the angle of the line of sight. Other sensors may be used as long as they can obtain the above. Specifically, for example, a camera (such as an infrared camera and a visible light camera) that can photograph the eye movement of the worker may be used as the line-of-sight detection sensor 18.

  Further, line-of-sight information (number of blinks, line-of-sight angle, etc.) obtained using the line-of-sight detection sensor 18 in the present embodiment may be used to operate the worker terminal 10. That is, the worker terminal 10 may be configured to be operable depending on the number of blinks of the worker, the angle (direction) of the line of sight, and the like.

  According to at least one embodiment described above, it is possible to provide an electronic device and a method capable of estimating the state of a worker (user) who performs work within a predetermined range.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope and gist of the invention, and are also included in the invention described in the claims and the equivalents thereof.

  DESCRIPTION OF SYMBOLS 10 ... Worker terminal (user terminal), 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... GPS sensor, 15 ... Acceleration sensor, 16 ... Air pressure sensor, 17 ... Communication module, 18 ... Gaze detection sensor, 20 ... Manufacturing apparatus, 30 ... administrator terminal, 31 ... CPU, 32 ... ROM, 33 ... RAM, 34 ... communication module, 35 ... display, 40 ... management server apparatus, 41 ... control unit, 42 ... communication processing unit, 43 ... information Management unit, 44 ... worker information storage unit, 45 ... device information storage unit, 46 ... process information storage unit.

Claims (2)

In a wearable terminal with a built-in gaze detection sensor,
Means for measuring the number of blinks of a user wearing the wearable terminal with the line-of-sight detection sensor;
A wearable terminal comprising: means for performing a handling process related to the user based on the measured number of blinks. Measuring the number of blinks of a user wearing the wearable terminal with a gaze detection sensor built in the wearable terminal;
Performing corresponding processing relating to the user based on the measured number of blinks.

Images