JP6858063B2 - Work information system and methods for collecting data related to events that occur at the work site - Google Patents

Description

The present invention relates to a work information system and a method for collecting data that may be related to an event when an event occurs at the work site.

As a prior art related to this field, for example, the systems or devices described in Patent Documents 1 to 4 are known.

The work support system described in Patent Document 1 displays a work image to the worker, takes a visual field image of the worker, and measures the biological information of the worker. Then, this system detects the occurrence of a hilarious hat state from biological information, stores the visual field image taken at the time of the hiyari hat detection and the displayed work image in the memory, and the work procedure manual based on both stored images. Allows you to update.

The safety management support device described in Patent Document 2 photographs the site with a camera installed at the work site, analyzes the captured image, and identifies the worker, the work machine, and the work being performed at the site. To do. Then, this device outputs the risk information associated with the execution work by referring to the definition table of the risk information (for example, pinching, flying debris, etc.) or the dangerous event (for example, vibration, etc.) according to the work content. .. In addition, this device analyzes the captured image and determines whether or not a dangerous event (vibration, etc.) has occurred in the implementation work.

The driving support system described in Patent Document 3 captures a moving image of the surroundings of the vehicle and measures the driver's biological information (heartbeat, blood pressure, sweating, body temperature, etc.), driving operation (steering, brake, accelerator) and line of sight. In addition, data on the environmental conditions (temperature, weather, etc.) around the vehicle is acquired. Then, when the biometric information changes beyond the value and the operation data shows an abnormality (sudden steering wheel, sudden braking), this system determines that a dangerous reaction of the type corresponding to the abnormality has occurred, and at that time. From the moving images around the front and rear cars, the position of the car, the position and speed of other surrounding objects, information on the objects in the driver's line of sight, surrounding environmental data, map data of the location of the car (three-forked road, intersection) , Slope, etc.) etc. In addition, the system warns the driver.

The mobile warning device described in Patent Document 4 measures and inputs a user situation (automobile, driver, surrounding environment, etc.) with a sensor, and records the information of the user situation when a hearing hat occurs. It is used to warn the user.

Japanese Unexamined Patent Publication No. 2013-97466 JP-A-2017-33047 Japanese Unexamined Patent Publication No. 2007-47914 Japanese Patent No. 5447371

At various work sites such as manufacturing, construction, civil engineering, inspection and maintenance, and transportation, what kind of information should be collected when what kind of event occurs depends on each site. Therefore, there may be cases where an information gathering system suitable for one site is not suitable for another site. However, it is uneconomical to build an optimal system for each site.

In addition, one important purpose of collecting information when an event occurs is to elucidate the cause of the event. In particular, when an adverse event occurs, it is strongly required to clarify the cause for future prevention. However, if the facts that could not be collected by the workers or devices directly involved in the occurrence of the event were the cause of the occurrence of the event, it is difficult to clarify the cause. A system that collects all kinds of information everywhere in the field would solve this problem, but such a system would be uneconomical and impractical. A system that can economically collect data related to the occurrence of events from multiple directions is desired.

One of the objects of the present invention is to provide a work information system that can be applied to different work sites.

Another object of the present invention is to provide a work information system capable of economically collecting data related to the occurrence of an event from a plurality of directions.

According to one embodiment of the present invention, a work information system for collecting data related to an event that has occurred at one or more work sites is provided. Each workplace may have one or more data collection systems, each equipped by one or more workers, and each data collection system collects one or more types of data about each worker and / or the surrounding environment. ..

Then, this work information system includes a data server that receives the data collected by the one or more data collection systems. This data server sets the detection criteria based on the detection criteria that define what event is detected based on what received data, the data received from the one or more data collection systems, and the above detection criteria. Each event is based on an event detection unit that detects each defined event, a selection standard that defines which of the received data is selected in response to each event defined in the detection criteria, and an event detection unit. When is detected, the data selection unit that selects the data corresponding to each detected event from the received data based on the selection criteria, and the data selected by the data selection unit are used as the detected event. It has an event recording unit that records in association with each other, a data output unit that outputs the data recorded by the event recording unit to the outside of the data server, and a condition setting unit that sets detection criteria and selection criteria for each work site. be able to.

According to the work information system configured in this way, the data collected by the data collection system of one or more workers is received by the data server at each work site. Then, in the data server, a detection standard that defines what event is detected based on which data of the data received from each work site and which data of the received data when each event is detected are detected. It is possible to set a selection standard for each work site, which defines whether to select and record. Then, based on the detection criteria and the selection criteria set for each work site, the detection of the event for each work site and the selection and recording of the data are executed.

The work information system configured in this way can be applied to different work sites having different requirements in terms of what event should be detected and what data should be recorded at the time of event detection.

The above-mentioned data server has a notification standard that defines what report should be sent to which destination in response to at least one emergency event of one or more events defined in the detection standard, and an event detection unit. When an emergency event is detected, an emergency report unit that creates a report corresponding to the detected emergency event based on the report standard and sends the report to the destination corresponding to the detected emergency event, and further May have. Then, the condition setting unit may be configured so that the reporting standard can be set for each work site.

According to such a configuration, it is possible to set a notification standard for each work site, which defines what notification is sent to which destination (for example, which worker) when a certain emergency event occurs. Then, when an emergency event occurs, an appropriate report is provided to an appropriate destination based on the report standard set for each work site.

In this way, in addition to collecting data when an event occurs, notification to a person concerned or a related device when an emergency event occurs is automatically executed and executed in a mode for each work site. Therefore, this work information system can be adapted to different work sites.

When the condition setting unit described above sets the detection criteria and the selection criteria for each work site, the detection criteria are based on the first data received from the first data collection system of the first worker. It defines that the first event is detected, and the selection criteria are from the second data collection system of the second worker, which is different from the first worker, in response to the first event. It may be configured so that it can be defined that the second data received is screened.

According to this configuration, when a certain event is detected based on the data from the data collection system of one worker (first worker), another worker (second worker) other than that worker is detected. It is possible to select and record the data from the data collection system of. For example, if each data collection system is equipped with a camera that captures the surrounding situation, when one worker (first worker) causes an event, another worker (second worker) Image data taken by the camera can be selected and recorded.

As a result, for example, situations that the person who caused the event did not know (for example, the situation behind the person who caused the accident, the situation behind the person, or how to move the person's body, etc.), etc. It can be grasped by referring to the data observed from the workers of. Therefore, the analysis of the cause of the event can be more accurate. That is, it is possible to economically collect data from a plurality of directions, which is useful for analyzing the cause of an event, by utilizing the existing resources at the work site of other workers.

When the above-mentioned condition setting unit also sets the detection standard and the notification standard of each work site, the detection standard is based on the first data received from the first data collection system of the first worker. It is defined that the first emergency event is detected, and the reporting standard includes a second worker different from the first worker in response to the first emergency event. It may be configured to be included in the destination.

According to this configuration, when an emergency event occurs for one worker (first worker), it is detected to send a report to another worker (second worker) other than that worker. Criteria and reporting criteria can be set. As a result, for example, when an accident occurs in a certain worker, a report can be sent to an appropriate other worker to instruct the appropriate accident handling and rescue of the injured. The mode of this notification can be set according to the circumstances of each work site.

The data server may further have a group setting that defines a group to which a plurality of workers at each work site belong. Then, the above-mentioned condition setting unit can include one or more other workers belonging to the same group as the above-mentioned first worker defined in the group setting in the above-mentioned second worker. May be configured.

According to such a configuration, when an event occurs in which a worker belongs to a certain group, data collected by another worker belonging to the same group can be recorded, or another worker belonging to the same group can record the data. It is possible to send appropriate reports. The settings for that purpose can also be adjusted according to the circumstances of each work site.

Each worker's data collection system may have a position sensor that detects the position of each worker. Then, the above-mentioned condition setting unit defines a relative position range with respect to the first worker, so that one or more other workers located in the defined relative position range can be assigned to the above-mentioned second worker. It may be configured so that it can be included in.

According to such a configuration, when an event occurs in which a worker is in a certain position, data collected by another worker in a certain relative position range (for example, a certain distance range) with respect to the worker. It is possible to record or send a report to other workers within its relative position range. The settings for that purpose can also be adjusted according to the circumstances of each work site.

In addition to workers, one or more peripheral objects (for example, devices, machines, objects, buildings, tools and machines operated by workers, devices and robots that work with workers, etc.) are present at the work site. ) May exist. Each peripheral object may be adapted to detect data about the peripheral object. Then, the above-mentioned data server may further receive the data detected by the surrounding object. In that case, the above-mentioned condition setting unit may be configured so that the data defined in the detection standard and the selection standard can include the data received from the peripheral object.

According to such a configuration, an event is detected by using not only the data collected by the worker's data collection system but also the data detected by devices and machines (peripheral objects) existing around the worker. Or, data from surrounding objects can be recorded when an event is detected. It is possible to set which data to be used from which peripheral object according to the actual situation of each work site.

As a result, it is possible to economically collect data from multiple directions, which is useful for elucidating the cause of an event, using existing peripheral objects at the work site.

In addition, each worker's data collection system may have headgear that each worker wears on his or her head. The headgear may have a camera that captures the surrounding situation seen from each worker's head and a microphone that senses the voice emitted by each worker. Then, the above-mentioned condition setting unit can define that a specific event is detected based on the utterance word grasped from the voice data from the microphone in the detection standard, and corresponds to the specific event in the selection standard. Then, it may be configured so that it can be defined that the image data from the camera is selected.

With such a configuration, an event can be detected based on the utterance of each worker. For example, when the words "bad", "bad", "dangerous", etc. are spoken, it is possible to detect an event corresponding to a kind of so-called hiyari hat. Since the utterances of workers can include words that can estimate the occurrence of various events, it would be effective to detect events based on the utterances at any work site. What kind of words should be used may be set for each site of action.

Further, when a certain event is detected based on the uttered word, image data taken from the headgear of the head of the worker or another worker who uttered the word can be selected and recorded. It is meaningful to record such an image because the image seen from the position of each worker's head may contain information that is likely to be useful for future improvement of the worker's working method.

Furthermore, by collecting audio and image data using headgear, workers can freely concentrate on their work with both hands without worrying about data collection.

Further, the data collection system of each worker may further have a portable personal computer (abbreviated as a mobile PC) carried by each worker in addition to the headgear worn on the head of each worker. The mobile PC can communicate with the headgear and also with the above-mentioned data server, and may be configured to receive audio data and image data from the headgear and transmit the data to the data server. As a mobile PC, a so-called smartphone or an existing general-purpose information communication terminal such as a tablet terminal in which an application program for a data collection system is installed can be used.

According to such a configuration, by using the communication function and the information processing function of the mobile PC, the configuration of the headgear worn by the worker on the head can be simplified, and the cost and weight of the headgear can be simplified accordingly. Can be reduced. In addition, the number of delicate parts mounted on the headgear, which will be used harshly, can be reduced, and the failure rate of the headgear can be reduced.

The block diagram which shows the whole structure of the work information system which concerns on one Embodiment of this invention. The front view which shows the schematic structure of the headgear for a worker. Explanatory drawing which shows the setting example of the detection standard and the emergency standard. Explanatory drawing which shows the setting example of a selection standard. Explanatory drawing which shows the setting example of a group setting. Explanatory drawing which shows the setting example of a report standard. Explanatory drawing which shows the data structure example of the event record. A low chart showing an example of headgear control flow. A flowchart showing an example of a control flow of a mobile PC. A flowchart showing an example of a control flow of a data server.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.

FIG. 1 shows the overall configuration of a work information system according to an embodiment of the present invention.

The work information system 1 shown in FIG. 1 can be used at one or more work sites where at least one, typically a plurality of, workers 3 work, typically at a plurality of different work sites. In the following, the explanation will be focused on one work site. At the work site, each worker 3 is affected by the environmental condition 5 related to the work site and himself / herself during the work. The environmental state 5 includes, for example, atmosphere, weather, season, latitude, longitude, altitude, temperature, atmospheric pressure, brightness, noise, time, living conditions, various stress factors, and the like. Further, there are various peripheral objects 7 around each worker 3, and each worker 3 and the peripheral objects 7 influence each other. Peripheral objects 7 may include, for example, work objects, tools, buildings, machines, equipment, natural objects, and the like.

Each worker 3 wears a headgear 9 and a portable personal computer (hereinafter referred to as a portable PC) 11 during the work. The headgear 9 and the portable PC 11 possessed by each worker 3 function as a data collection system for each worker 3, and at the position of each worker 3, various types of data related to the worker 3 and its surrounding environment are provided. To collect.

The headgear 9 and the portable PC 11 of each worker 3 can perform data communication with each other by a predetermined proximity wireless communication. Data communication for voice conversation, video conferencing, text conversation, and the like is possible between different mobile PCs 9 used by different workers 3.

The headgear 9 is a head-mounted electronic device that can be worn by the worker 3 on the head, and an example of a specific configuration thereof will be described later with reference to FIG. The headgear 9 ensures that the worker 3 can work freely with both hands, and makes the worker 3 particularly aware of the data on the worker 3 and its surrounding environment obtained at the position of the worker 3. Can be collected without

As the mobile PC 11, for example, a general-purpose mobile information communication terminal such as a so-called smartphone, mobile phone, or tablet terminal can be used. By installing a predetermined application program on such a mobile information communication terminal, the mobile information communication terminal functions as a mobile PC 11 for the work information system 1. Alternatively, a dedicated portable PC 11 may be prepared for the work information system 1.

At least one data server 13 exists at a location remote from the worker 3 or at a location remote from the work site. The data server 13 collects data related to various events occurring at the work site in real time from the work site and the worker 3, records the data, and works on various information based on the data. It has the role of providing to member 3 and other related parties. The data server 13 can communicate with each other through a predetermined communication network with the mobile PC 11 of each worker 3.

The data server 13 also communicates wirelessly or by wire with specific peripheral objects 7 in or near the work site, and obtains data on the state of the peripheral objects 7 detected by those peripheral objects 7 in real time. It may be configured for collection. For example, at a manufacturing site, a tool or machine such as a nut runner operated by each worker 3, a manufacturing facility such as a robot or a transfer device that works in cooperation with the worker 3, or a device to be worked on. The data server 13 may be configured to collect predetermined data from a machine or the like.

FIG. 2 is a front view showing a schematic configuration example of the headgear 9.

As shown in FIG. 2, the headgear 9 is configured by using, for example, a helmet 15 (or a work cap) that the worker 3 should wear on his head at the work site, but this is only an example, and not necessarily so. You don't have to. A transparent shield (visor) 17 for protecting the face is attached to the helmet 15. The shield 17 may have a function as a display 18 for displaying (or projecting on) an image or text. Alternatively, a display 18 for showing an image or text to the worker 3 may be provided on the helmet 15 as a device separate from the shield 17 (not shown).

The helmet 15 includes a camera 19 (preferably a compound-eye camera capable of measuring the distance to an object in the captured image) for capturing a moving image or a still image of a spatial area in front of the worker's head, and another worker. A set of a conversation microphone 21 and a conversation speaker 23 for conversation with 3 or other people is provided. Further, the helmet 15 is provided with a main device 25, which is equipped with various sensors (described later), an information processing device that performs data processing, a communication device that performs wireless communication with the mobile PC 11, and the like. Will be done. Further, the helmet 15 is provided with a battery 27 as a power source for various electronic devices of the helmet 15.

See FIG. 1 again.

As described above, the headgear 9 includes a display 18, a camera 19, a conversation microphone 21, a conversation speaker 23, and a main device 25. The main device 25 then includes various sensors such as a position sensor 35, an orientation sensor 37, an acceleration sensor 39, a line-of-sight sensor 41, one or more bitile sensors 43, and one or more environmental sensors 45. ..

Since the camera 19 captures the area in front of the head 47 of the worker 3, the captured image includes the limbs 51 and a part of the body 49 of the worker 3, and the surroundings in front of the head 47 of the worker 3. There is a possibility that the object 7 (for example, an object to be worked on or an object near the work object) and the appearance of another worker 3 within the range visible to the worker 3 and the like can be seen.

It is desirable that the camera 19 constantly shoots a moving image during the work of the worker 3, but instead, the camera 19 may intermittently repeat the shooting of a still image, or may be operated by the worker 3. You may shoot a moving image or a still image depending on the situation.

The position sensor 35, the azimuth sensor 37, and the acceleration sensor 39 are the three-dimensional position (latitude, longitude, altitude) of the head 47 of the worker 3, the direction in front of the head 47, and the three-dimensional acceleration (or the three-dimensional acceleration) of the head 47, respectively. Inertial force) is measured. The position sensor 35 may be, for example, a GPS receiver or a combination of the GPS receiver and the above-mentioned direction sensor 37 and acceleration sensor 39.

The line-of-sight sensor 41 observes the movement of the eye 53 of the worker 3 and measures the position of the viewpoint (where he / she is looking) of the worker 3. The one or more vital sensors 43 measure one or more vital signs 59 of the worker 3 (eg, body temperature, pulse rate, respiratory rate, blood pressure, or blood glucose level). The one or more environmental sensors 45 measure one or more state values (eg, air temperature, humidity, barometric pressure, gas components and concentrations, noise level, or wind speed, etc.) included in the environmental state 5.

It is desirable that these sensors 35 to 45 continue to be sensed at all times during the work of the worker 3, but instead, the sensing may be repeated intermittently, or depending on the operation of the worker 3. You may perform sensing.

The main device 25 transmits the moving image data or the still image data taken by the camera 19 and various measurement data obtained by the sensors 35 to 45 to the portable PC 11 of the same worker 3 in real time. The main device 25 also processes a voice conversation between the worker 3 using the conversation microphone 21 and the conversation speaker 23 and other workers or people (for example, the voice data from the conversation microphone 21 is processed in real time by the mobile PC 11). And the voice data coming from the mobile PC 11 is output to the conversation speaker 23 in real time, etc.). The main device 25 also displays image data and text coming from the mobile PC 11 on the display 18 in real time.

The portable PC 11 includes a main device 51, a position sensor 53, an acceleration sensor 55, a voice recognition unit 57, a voice synthesis unit 59, and the like.

The position sensor 53 and the acceleration sensor 55 of the mobile PC 11 measure the three-dimensional position (latitude, longitude, altitude) and acceleration of the mobile PC 11, respectively. Since the worker 3 wears the portable PC 11 during the work, the position and acceleration measured by the position sensor 53 and the acceleration sensor 55 substantially indicate the position and acceleration of the body 49 of the worker 3. The position sensor 53 may be, for example, a GPS receiver, or may be a combination of a GPS receiver, a direction sensor, and the acceleration sensor 55.

The voice recognition unit 57 inputs voice data, performs voice recognition, and outputs text data. The voice synthesis unit 59 inputs text data, performs voice synthesis, and outputs voice data.

The main device 51 of the mobile PC 11 receives the moving image data, the still image data, various measurement data, and the audio data sent from the headgear 9, and transmits the data to the data server 13 in real time. Further, the main device 47 sends the position data and the acceleration data measured by the position sensor 53 and the acceleration sensor 55 in the portable PC 11 to the data server 13 in real time.

Further, when a voice conversation is being performed between the worker 3 and the other worker 3 or another person, the main device 47 sends the voice data from the head gear 9 to the mobile PC 11 of the conversation partner in real time. Also, the voice data from the mobile PC 11 of the conversation partner is sent to the head gear 9 in real time. Further, when a text conversation is being performed between the worker 3 and the other worker 3 or another person, the main device 47 sends the text data from the headgear 9 to the mobile PC 11 of the conversation partner in real time. Also, the text data from the mobile PC 11 of the conversation partner is sent to the headgear 9 in real time.

The main device 47 further receives the voice data sent from the head gear 9, sends the voice data to the voice recognition unit 55 in real time, and as a result, the voice-recognized text data output from the voice recognition unit 55. , Send to the data server 13 in real time. Further, the main device 47 sends text data (for example, text data of an emergency call message described later) sent from the data server 13 to the head gear 9 in real time, and / or voices the text data in real time. It is sent to the synthesis unit 59, and as a result, the voice data output from the voice synthesis unit 59 is sent to the head gear 9 in real time.

The data server 13 has functional elements such as a communication device 61, a condition setting unit 63, a short-term storage unit 65, an event detection unit 67, a data selection unit 69, a long-term storage unit 71, a data output unit 73, and an emergency notification unit 75. Further, the data server 13 has information elements such as a detection standard 81, an emergency standard 83, a selection standard 85, a group setting 87, a work schedule 89, a notification standard 91, and an event record 93.

The communication device 61 of the data server 13 receives various data sent from the mobile PC 11 of each worker 3 and transmits data necessary for each mobile PC 11 (for example, an emergency call message described later). To do. The communication device 61 may also perform data communication with some of the peripheral objects 7 present at the work site.

The condition setting unit 63 detects what kind of event, what kind of data is recorded regarding the detected event, and what kind of message or control signal regarding the detected event, for each work site. It sets the operating conditions such as which device to notify the worker or which device. The condition setting unit 63 also sets a work schedule at each site. The matters set by the condition setting unit 63 are registered in the detection standard 81, the emergency standard 83, the selection standard 85, the group setting 87, the work schedule 89, and the notification standard 91.

The condition setting unit 63 is, for example, a mobile PC 11 or another information processing terminal from a specific person (for example, a specific worker 3, a specific manager, etc.) who has been given the right to set the conditions of the site in advance for each site. When logged in through, the site is described in the detection standard 81, the emergency standard 83, the selection standard 85, the group setting 87, the work schedule 89, or the reporting standard 91 after receiving the input of the setting items from the specific person. Edit (add, delete or change) the settings of various conditions.

The short-term storage unit 64 stores various collected data received from the portable PC 11 of each worker 3 for a predetermined short period of time, and erases the stored data when the storage period elapses. The storage period is determined by how long the relevant data is recorded retroactively from the time of occurrence of a predetermined event. For example, when data is recorded from a time point 10 minutes before the event occurrence time, the storage period can be set to 10 minutes. This storage period can be set for each site by the condition setting unit 63.

The event detection unit 67 examines the data stored in the short-term storage unit 65 and determines whether or not a predetermined event has occurred, that is, detects the occurrence of a predetermined event. The detection criterion 81 and the emergency criterion 83 are used to detect an event, that is, to determine the occurrence of an event.

The detection criterion 81 defines, for each type of event to be detected, a type of data to be investigated and a detection condition for determining what condition the data satisfies to determine that an event has occurred. The urgent criterion 83 defines which of the event types set in the detection criterion is an urgent event (that is, an event for which prompt coping action should be executed). The definition content of the detection standard 81 can be set for each site by the condition setting unit 63.

The event detection unit 67 continuously checks whether or not the data stored in the short-term storage unit 65 satisfies any of the detection conditions described in the detection criterion 81, and a certain detection condition is satisfied. Then, it is determined that an event of the event type corresponding to the detection condition has occurred. Then, when the occurrence of some event is detected, the event detection unit 67 notifies the data selection unit 69 of the event type of the event, and determines whether or not the event type is an emergency event in light of the emergency standard 83. .. When it is determined that an emergency event has occurred, the event detection unit 67 notifies the emergency call unit 75 of the event type. The urgent criterion 83 defines which of the event types described in the detection criterion 81 corresponds to an urgent event. The definition content of the urgent standard 83 can be set for each site by the condition setting unit 63.

When a certain event is detected, the data selection unit 69 selects and reads data related to the event type from the short-term storage unit 65. For this sorting, sorting criteria 85 is referenced. The selection criterion 85 defines the data type and data source to be selected (that is, where and what kind of data should be selected) for each event type. The definition content of the selection standard 85 can be set for each site by the condition setting unit 63.

When a certain event occurs, if a certain worker group is defined as a data source for the event type in the sorting criterion 85, the data sorting unit 69 refers to the group setting 87 and which worker. Determine if the data from 3 should be sorted. The group setting 87 is used to identify a group of workers 3 working at each site (that is, a team, a department to which the worker belongs, etc.), a worker 3 who is a member of each group, and a mobile PC 11 used by the worker 3. Information is defined. The definition content of the group setting 87 can be set for each site by the condition setting unit 63.

The data selected by the data selection unit 69 includes data of the work schedule 89 prepared in advance in addition to the data stored in the short-term storage unit 64. The work schedule 89 describes a work schedule preset for each site, each worker group, or each worker. The contents of the work schedule 89 can be set for each site by the condition setting unit 63.

The long-term recording unit 71 stores the selection data regarding the occurrence event sent from the data selection unit 69 as the event record 93 related to the occurrence event for a long period of time.

When the data output unit 73 is requested to output the event record 93 by an appropriate information processing terminal or user outside the data server 13, the data output unit 73 reads the event record 93 from the long-term recording unit 71 and uses the request source information processing terminal or the data output unit 73. Provide to the user. By analyzing this, the output event record 93 can be useful for, for example, elucidation of the cause of occurrence of an event, improvement of a work process, or skill transfer.

When an emergency event occurs, the emergency call unit 75 generates a message, auxiliary information, and / or a control signal for immediately responding to the emergency event, and the worker who should deal with the emergency event through the communication device 61. 3 (portable PC 11 used by the worker 3) and / or the peripheral object 7 is notified. At that time, the emergency call unit 75 determines what kind of information is to be reported to which worker 3 or which main variable object with reference to the report standard 91. In the notification standard 91, the destination and the content of the notification are defined for each event type of the emergency event. When a certain worker group as a report destination of the event type that occurred is defined in the report standard 91, the group setting 87 is referred to, and the worker 3 belonging to the worker group is specified as a specific destination. To. The definition content of the notification standard 91 can be set for each site by the condition setting unit 63.

FIG. 3 shows a setting example of the detection standard 81 and the emergency standard 83.

As illustrated in FIG. 3, in the detection criterion 81, a data type and a detection condition are defined for each event type (in the figure, an identification code such as “001” is used as an example). The data type indicates which data is used to determine the occurrence of the event (detect the event). The detection condition indicates what kind of condition is satisfied for the data to determine that the event has occurred (the event is detected). Further, the emergency standard 83 defines whether or not it is an emergency event (for example, a value “1”) (for example, a value “0”) for each event type.

In FIG. 3, for example, for the event type “001”, the data type is “person: vocalized word” and the detection condition is “(bad) + (bad) + (has been)” (here, the symbol “”. "+" Means OR, which is the same under other conditions). This is about the three workers themselves when the words spoken by the worker 3 (that is, the voice recognition result of the voice data of the worker 3) are "bad", "bad", or "has been". It means that it is determined that an event of event type "001" (for example, a kind of so-called hiyari hat) has occurred. In the example of FIG. 3, this event type "001" is not set as an emergency event.

For example, for the event type "004", the data type is "person: head gravity acceleration; then head movement speed", and the detection condition is "≤2.0 m / sec2; (≤3 cm / sec) x (≥30 sec)". (Here, the symbol "x" means the logical product, and this also applies to other conditions). This is because the gravitational acceleration of the head of a worker 3 (eg, measured by the accelerometer 39 of the headgear 9) drops to "≤2.0 m / sec2" (that is, it may have fallen), followed by The state in which the moving speed of the head (for example, calculated from the measurement data of the position sensor 35 of the head gear 9 and the acceleration sensor 39) was “≦ 3 cm / sec” continued for “≧ 30 sec” (that is, the head was 30). If it continues to be in a state of almost no movement for more than a second), it is determined that an event of event type "004" (for example, a fall or a fall that causes the person to lose consciousness) has occurred for the three workers. means. In the example of FIG. 3, this event type "004" is set as an emergency event.

Further, for example, for the event type "005", the data type is "nut runner 01" and the detection condition is "insufficient torque". This is because when the nut runner of the identification number “01” used for bolt tightening in the peripheral object 7 issues an error signal indicating “insufficient torque”, the nut runner (the worker 3 who uses the nut runner) in advance. If it is specified, it means that it is determined that an event of event type "005" (for example, a kind of work error) has occurred for the worker 3). In the example of FIG. 3, this event type "005" is not set as an emergency event.

Further, for example, for the event type "006", the data type is "other company: vocalized word", and the detection condition is "(" person's name ") x ((dangerous) + (no good))". When the word uttered by one worker 3 is "dangerous" or "no good" with the name of another worker 3, the event of event type "006" for the other worker 3 whose name is called ( For example, it means that it is judged that a kind of so-called hiyari hat) has occurred. In the example of FIG. 3, this event type "006" is not set as an emergency event.

As described above, the events defined in the detection standard 81 and the emergency standard 83 are automatically detected based on the data collected by the worker 3 or the peripheral object 7.

Here, it should be noted that the matters defined in the detection standard 81 and the emergency standard 83 can be arbitrarily set by the user for each work site. Then, depending on the user's settings, not only when an event related to each worker 3 is detected from the data collected at the position of the worker 3, but also the data detected at the position of the other worker 3. It may be detected from (for example, the event type “006” in FIG. 3) or it may be detected from the data collected by the peripheral object 7 (for example, the event type “005” in FIG. 3). That is. This makes it possible to flexibly detect events according to the circumstances and needs of the site.

FIG. 4 shows a setting example of the selection criterion 85. In FIG. 4, only the setting example for one event type “001” is shown, but not only that, the setting for all the event types defined in the detection criterion 81 described above may be included in the selection criterion 85. ..

As illustrated in FIG. 4, the selection criterion 85 defines, for each event type, the type and source of data to be selected when the event is detected, and the period during which the data should be recorded.

For example, in FIG. 4, for the event type “001”, the data types are “microphone sound”, “speaker sound”, “camera image”, “position”, “head orientation”, “line of sight”, and “peripheral object”. "Data", "work schedule", etc. are defined. As data sources, "microphone sound", "speaker sound", and "line of sight" are defined as "person", and "camera image", "position", "head orientation", and "work schedule" are included. Is defined as "(principal) + (same group) + (distance ≤ 20 m)", and "peripheral object data" is defined as "(distance ≤ 20 m)". Furthermore, as the recording time, "work schedule" is defined as "one day on the day", and "± 10 minutes" is defined for other data.

This setting example means that when an event of event type "001" is detected for a certain worker 2, the following data is selected.

That is, the voice spoken by the three workers (voice data output from the conversation microphone 21), the voice heard by the worker (voice data input to the conversation speaker 23), the image taken by the camera 19 of the worker, and the person himself / herself. Position (three-dimensional position data measured by the position sensor 35), the orientation of the person's head (direction data measured by the orientation sensor 37), the line of sight of the person (viewpoint data measured by the line-of-sight sensor 41), and the person. Work schedule (obtained from work schedule 89) is selected.

In addition, camera images, three-dimensional positions, head orientations, from other workers 3 belonging to the same worker group as the person, and other workers 3 who were within a distance of 20 m from the position of the person. And work schedules are also screened. Further, the data sensed by the peripheral object 7 located within 20 m from the position of the person is also selected.

And, among the above-mentioned various data selected, for "work schedule", the data for one day on the day of the event occurrence, and for other data, from 10 minutes before to 10 minutes after the event time. The data for the period is sent to the long-term recording unit 71 and recorded in the event record 93 associated with the detected event.

In this way, when a certain event is detected, according to the definition of the selection criterion 85, the data that may be related to the detected event is selected for the defined period and stored as the event record 93.

What should be noted here is that the definition content of the selection criterion 85 can be arbitrarily set by the user for each site. Then, depending on the user's settings, regarding the event that occurred with respect to a certain worker 3, not only the data collected at the position of the worker 3 but also the data collected at the position of another worker 3 or the surroundings. The data collected on the object 7 can also be recorded.

As a result, the sources of data recorded regarding the occurrence of events will be expanded to more fields, and later analysis such as elucidation of the cause can be performed in more detail and accurately. For example, when a worker 3 collides with a surrounding object 7 and is injured, not only the data collected at the worker 3 but also other workers around the worker 3 are present. The data collected at the workers 3 (for example, the camera image of another worker 3 may show the colliding worker 3 and the surrounding objects 7 before and after the collision) and the surroundings. By recording the data collected by the object 7 (from which it may be possible to know in detail what kind of behavior the surrounding object 7 collided with at the time of the collision), the cause of the collision (it is the collision). There is a possibility that the movement of the person's body or the unexpected movement of the surrounding object 7), which could not be found only by the data collected by the three workers who did the work, could be clarified more accurately. ..

FIG. 5 shows a setting example of the group setting 87.

The group setting 87 is, for example, when a worker group is defined as "the same group" as a data source in the above-mentioned selection standard 85 or as a report destination in the report standard 91 described later, the work belonging to the group. Used to identify member 3.

As illustrated in FIG. 5, in the group setting 87, for each worker group, a group identification code (group ID), an identification code (member ID) of the worker 3 who is a member of the group, and each member The status (member status) and name (member name) in the group, the communication address of the mobile PC 11 (mobile PC address), the identification code of the mobile PC 11 (mobile PCI ID), the identification code of the headgear 9 (headgear ID), etc. are defined. To. Although only one group setting example having the group ID “G01” is shown in FIG. 5, if there are a plurality of groups, all the settings of those groups can be registered in the group setting 87.

The content of the group setting 87 can also be arbitrarily set by the user for each site. Therefore, it is possible to flexibly respond to the circumstances and needs of the site.

FIG. 6 shows a setting example of the notification standard 91. In FIG. 6, only a setting example for one event type “004” corresponding to an emergency event is shown, but not only that, but also the setting for all the emergency event event types defined in the above-mentioned emergency standard 83 is shown. , May be included in reporting criteria 91.

As illustrated in FIG. 6, the reporting standard 91 defines the reporting destination, the reporting means (type of signal or data used for reporting), and the reporting content (messages, data, or operations constituting the reporting) for each event type. Etc.).

For example, in FIG. 6, for the event type “004” (in the example shown in FIG. 3 described above, the worker 3 falls or faints in a way that causes the person to lose consciousness), one of the report destinations is “the person”. There is "Speaker voice" in the reporting means, and "Is it okay ..." in the reporting content. This is the conversation speaker of the three workers who caused the fall or fainting. It means sending a voice message to 23, "Are you okay? ..." to ask the person about his / her current status.

In addition, there is "(administrator) + (same group) + (≦ distance 20m)" in another reporting destination, and the reporting means are "speaker voice", "display", "personal position", and "speaker voice". There is a possibility that the "personal name" is abnormal in the content of each report. Please check and take measures such as rescue. "..." "," Personal camera image "," Personal position: Map & relative position display "," Microphone voice: (Person) + (Same group) + (≤ Distance 20m) ". And, for another worker 3 who belongs to the same group as the person or is within a distance of 20 m, "the person's name" may be abnormal. Please check and take measures such as rescue. A voice message "..." is reported from each person's conversation speaker 23, the image taken by the person's camera 19 is displayed on each person's display 18, and each person displays a map showing the person's three-dimensional position and a relative position display. It is displayed on the display 18 of the above, and the microphone sound of the conversation that those people exchange with each other is sent to each person's speaker 23 to tell the current situation of this accident to the surrounding people as accurately as possible and take measures such as rescue. Means to encourage.

There is "AED" in another report destination, "indicator light" in the report means, and "lighting" in the report content. This means that an indicator light is turned on at the installation station of the AED (automated external defibrillator), which is one of the peripheral objects 7, to inform the surrounding people of the location of the AED.

The content of the notification standard 91 can also be arbitrarily set by the user for each site. Depending on the user's settings, when an emergency event occurs, appropriate notifications are sent to the person himself / herself, other workers 3, related peripheral objects 7, etc., and they take appropriate measures. Instructed or guided to.

FIG. 7 shows an example of the data structure of the event record 93.

As shown in FIG. 7, the event record 93 relating to a certain occurrence event includes, for example, an identification code (event ID) of the event, an event type, and an occurrence date and time. Further, in the event record 93, for example, the identification code (person ID) of the worker 3 (person) who was directly involved in the occurrence of the event (note that the peripheral object 7 instead of the worker 3 is directly involved in the occurrence. If so, the identification code of the peripheral object 7), the data source and data type of each recorded data, and each recorded data file associated with the scribe information of these data by the file path, etc. are included. Is done.

FIG. 8 shows an example of the control flow of the headgear 9 of each worker 3 during the work.

As shown in FIG. 8, the headgear 9 uses the camera 19, the conversation microphone 23, and other sensors 35 to 45 mounted on the headgear 9, and the state or operation of the worker 3 wearing the headgear 9, and an image of the surroundings. , And the surrounding environment state 5 is sensed (step S1), and the sensed data is transmitted to the mobile PC 11 of the same worker 3 (S2). This operation is continuously repeated.

Further, the headgear 9 receives image data, voice data, text data, etc. to be provided to the worker 3 from the mobile PC 11 (S3), and an output device corresponding to the received data, for example, a display 18 or a conversation speaker. Output to 23 or the like (S4). This operation is continuously repeated.

FIG. 9 shows an example of the control flow of the mobile PC 11 of each worker 3 during the work.

As shown in FIG. 9, the mobile PC 11 receives the data sent from the headgear 9 of the same worker 3 (S11), and sends the received data to the data server 13 (S12). At that time, the received voice data is voice-recognized, and the text data of the voice recognition result is also sent to the data server 13. This operation is continuously repeated.

Further, the mobile PC 11 senses with the sensors 53 and 55 mounted therein (S13), and sends the sensed data to the data server 13 (S14). This operation is continuously repeated.

Further, the mobile PC 11 receives the image data, audio data, text data, etc. for the headgear 9 sent from the data server 13 (S15), and sends the data to the headgear 9 of the same worker 3 (S16). .. At that time, the mobile PC 11 converts the received text data into voice data by voice synthesis and sends it to the headgear 9. This operation is continuously repeated.

Furthermore, the mobile PC 11 receives image data, audio data, text data, etc. for the mobile PC 11 sent from the data server 13 (S17), and displays the data in a corresponding output device of the own device, for example, display. Output to a device or speaker (S18). This operation is continuously repeated.

FIG. 10 shows an example of the control flow of the data server 13.

As shown in FIG. 10, the data server 13 receives and receives data sent from the portable PC 11 of one or more workers 3 at each work site and / or one or more peripheral objects 7 (S21). The data is stored in the short-term storage unit 65 (S22). This operation is continuously repeated.

The received data 101 stored in the short-term storage unit 65 is stored there for a predetermined short period of time. During the storage period, the data server 13 examines the received data 101 against the detection criterion 81 to determine whether or not the event defined in the detection criterion 81 has occurred (S23). As a result, when it is determined that any of the defined events has occurred (Yes in S24), the data server 13 specifies the type of the event that has occurred (S25). This operation is continuously repeated.

Further, the data server 13 refers to the selection criterion 85 based on the event type 103 identified in step S25, and what is the data to be recorded for a long period of time according to the event type 103 (data type, data source). , And the recording time)), and the specified long-term recording target data is selected and read from the short-term recording unit 65 or the work schedule 89 (S26). Then, the data server 13 stores the read long-term recording target data in the long-term recording unit 71 as an event record 93 related to the detected event (S27). The event record 93 is stored in the long-term recording unit 71 for a long period of time. This operation is executed each time any event defined in the detection criterion 81 is detected.

Further, the data server 13 outputs the event record 93 stored in the long-term recording unit 71 to the outside as needed (S28).

Further, each time the event type of the event that occurs is specified in step S25, the data server 13 refers to the emergency standard 83 and determines whether or not the event type corresponds to an emergency event (S31). As a result, when it is determined that the event corresponds to an emergency event (Yes in S31), the data server 13 refers to the notification standard 91, creates an emergency call according to the event type, and carries the appropriate worker 3. It is transmitted to the PC 11 and / or the peripheral object 7 (S32).

One embodiment of the present invention described above is merely an example for explanation, and is not intended to limit the scope of the present invention to only those embodiments. The present invention can be implemented in various forms different from the above-described embodiments.

For example, various data collection devices (camera, microphone, other various sensors, voice recognition unit, etc.) and various data output devices (display, speaker, voice, etc.) mounted on the head gear 9 and the portable PC 11 in the above embodiment, respectively. The synthesis part, etc.) is just an example. An embodiment in which at least a part of those devices included in the above embodiment is missing, an embodiment in which an additional device is added, and a part or all of the functions of the mobile PC 11 in the above embodiment are transferred to the headgear 9. Alternatively, various variations can be implemented, such as an embodiment in which some functions of the headgear 9 are transferred to the mobile PC 11.

Further, in the above embodiment, the data collection system of each worker 3 is composed of two electronic devices, a headgear 9 and a portable PC 9. As a result, the functions of the mobile PC 9 (for example, the communication function with another mobile PC 9 and the data server 13 described later, the advanced information processing function for executing software such as voice recognition and voice synthesis at high speed, etc.) are provided to the headgear 9. There is an advantage that the structure of the headgear 9 can be simple and low cost because it is not necessary to double the headgear. However, this configuration is only an example, and other configurations can be adopted. For example, if the headgear 9 has all the main functions of the portable PC 9, each worker 3 is equipped with only the headgear 9. You may do it. Alternatively, an additional electronic device may be added in addition to the headgear 9 and the portable PC 9 to configure a data collection system for each worker 3.

Further, the camera 19 of the headgear 9 may be capable of photographing not only the front of the head but also other directions, or may be capable of photographing 360 degrees in all directions.

1 Work information system 3 Worker 5 Environmental condition 7 Peripheral objects 9 Headgear 11 Portable personal computer (portable PC)
13 Data server 15 Helmet (or work cap)
17 Shield (visor)
18 Display 19 Camera 21 Conversation microphone 23 Conversation speaker 25 Main device 35 Position sensor 37 Orientation sensor 39 Accelerometer 41 Line of sight sensor 43 Vital sensor 45 Environmental sensor 51 Main device 53 Position sensor 55 Accelerometer 57 Voice recognition unit 59 Voice synthesis unit 61 Communication device 63 Condition setting unit 65 Short-term recording unit 67 Event detection unit 69 Data selection unit 71 Long-term recording unit 73 Data output unit 75 Emergency notification unit 81 Detection standard 83 Emergency standard 85 Selection standard 87 Group setting 89 Work schedule 91 Notification standard 93 Event Record

Claims (11)

In a work information system for collecting data related to events that occurred at one or more work sites, respectively.
Each work site has one or more data collection systems, each equipped by one or more workers, and each data collection system collects one or more types of data about each worker and / or the surrounding environment.
The work information system includes a data server that receives data collected by the one or more data collection systems.
The data server
Detection criteria that define what event is detected based on what received data,
An event detection unit that detects each event defined in the detection criteria based on the data received from the one or more data collection systems and the detection criteria, and an event detection unit.
A selection criterion that defines which of the received data is to be selected in response to each of the events defined in the detection criterion, and a selection criterion.
When each event is detected by the event detection unit, a data selection unit that selects data corresponding to each detected event from the received data based on the selection criteria, and a data selection unit.
An event recording unit that records the data selected by the data selection unit in association with the detected event, a data output unit that outputs the data recorded by the event recording unit to the outside of the data server, and a data output unit.
It has a condition setting unit that sets the detection standard and the selection standard for each work site.
Work information system. The data server
A reporting standard that defines what notification should be sent to which destination in response to an emergency event of at least one of the one or more events defined in the detection criteria.
When the emergency event is detected by the event detection unit, a report corresponding to the detected emergency event is created based on the notification standard, and the creation is made to the destination corresponding to the detected emergency event. It also has an emergency call department that sends the reported reports.
The work information system according to claim 1, wherein the condition setting unit can set the notification standard for each work site. The condition setting unit
When setting the detection criteria and the selection criteria for each work site,
The detection criteria define that the first event is detected based on the first data received from the first data collection system of the first worker, and the selection criteria include the first It is configured to be able to define that the second data received from the second data collection system of the second worker different from the first worker is selected in response to the above-mentioned event. ,
The work information system according to any one of claims 1 and 2. The one or more data collection systems have cameras that capture their surroundings.
The condition setting unit is configured so that the image data taken by the camera of the second data collection system of the second worker can be included in the second data.
The work information system according to claim 3. The condition setting unit
When setting the detection criteria and the reporting criteria for each work site,
The detection criteria define that the first emergency event is detected based on the first data received from the first data collection system of the first worker, and the reporting criteria include the first In response to one emergency event, a second worker other than the first worker can be included in the destination of the notification.
The work information system according to claim 2. The data server further has a group setting that defines a group to which a plurality of workers at each work site belong.
The condition setting unit is configured so that the second worker can include one or more other workers who belong to the same group as the first worker defined in the group setting. ,
The work information system according to claims 3 to 5. The one or more data collection systems have position sensors that detect the position of each worker.
By defining the relative position range with respect to the first worker, the condition setting unit includes one or more other workers located in the defined relative position range in the second worker. Configured to be able to
The work information system according to claims 3 to 6. At the work site, there are one or more peripheral objects in addition to the one or more workers, and each peripheral object detects data on each peripheral object.
The data server further receives the data detected by each of the one or more peripheral objects, and receives the data.
The condition setting unit of the data server is configured so that the data defined in the detection criterion and the selection criterion can include the data received from the peripheral object.
The work information system according to any one of claims 1 to 7. The work information system further includes the one or more data collection systems at each work site.
Each data collection system has a headgear that each worker wears on his head.
The headgear has a camera that captures the surrounding situation seen from the head of each worker, and a microphone that senses the sound emitted by each worker.
The condition setting unit
In the detection criteria, it is possible to define that a specific event is detected based on the uttered word grasped from the voice data from the microphone, and
The selection criteria can define that image data from the camera is selected in response to the specific event.
Constructed as
The work information system according to any one of claims 1 to 8. Each of the data collection systems further has a portable personal computer carried by each worker.
Each of the portable personal computers can communicate with the head gear and also communicate with the data server, and receives the voice data and the image data from the head gear and transmits the voice data and the image data to the data server.
The work information system according to claim 9.
In a method performed by a work information system for collecting data related to an event that has occurred at one or more work sites, respectively.
Each work site has one or more data collection systems, each equipped by one or more workers, and each data collection system collects one or more types of data about each worker and / or the surrounding environment.
The method is
A data reception step of receiving the data collected by the one or more data collection systems, and
Steps to prepare detection criteria for each work site that define what event is detected based on what received data, and
An event detection step for detecting each event defined in the detection criteria based on the data received from the one or more data collection systems and the detection criteria, and
A step of preparing a selection standard for each work site, which defines which data of the received data is to be selected in response to each of the events defined in the detection standard.
When each event is detected by the event detection unit, a data selection step of selecting data corresponding to each detected event from the received data based on the selection criteria, and a data selection step.
It has an event recording step of recording the data selected by the data selection step in association with the detected event.
Method.

Images