JP7250364B2 - system and program - Google Patents

Description

The present invention relates to a device, a system and a program provided with the device, and the like.

2. Description of the Related Art A monitoring camera has been proposed that includes a lens unit and stores image data captured by the lens unit in a detachable storage medium (see, for example, Patent Document 1).

JP 2013-197902 A

Normally, such a surveillance camera continuously captures images of the object to be monitored, so in order to check the contents of the image taken at the time of an abnormality, a long image is played back from the beginning, and the scene in question is replayed by fast-forwarding. I had to search and check. For this reason, it took a very long time for the confirmation work.

SUMMARY OF THE INVENTION Accordingly, it is an object of the present invention to provide an apparatus and the like capable of acquiring image data by which the content of images captured before and after an event has occurred can be easily confirmed. This object is achieved, for example, by the combination of features stated in the independent claims. The dependent claims also for example define further advantageous embodiments of the invention.

(1) In order to solve the above problems, the present invention provides image data captured by an imaging means at least at a predetermined time before and after the time when an event occurs when information indicating the occurrence of an event is received from the outside. may be provided with a control means for controlling to store in the storage means.

By doing so, it is possible to store the image data captured by the imaging means before and after the event occurs, so that it becomes easy to confirm the contents of the images captured before and after the time when the event occurred. For example, in order to check the image, it is preferable to provide a reproducing means for reproducing the stored image data so that the user can visually recognize it. The reproducing means may be provided integrally with the control means, or may be provided separately. Further, in the present invention, it is preferable to provide the imaging means together with the control means. It is preferable that the image capturing means constantly perform image capturing regardless of whether or not an event has occurred, and temporarily store image data over a predetermined period of time. Then, when the control means receives the information indicating the occurrence of the event, the control means preferably performs control so that the image data captured before and after the predetermined time is stored in the storage means. In addition, in the present invention, the storage means may be built in the device in which the control means is provided, but may be detachably provided in the device, for example, in the form of a memory card, hard disk drive, or the like.

An "event" may be generated, for example, when an abnormality occurs. For example, it may be various events, especially failures in machine tools operating on a factory production line, unusual vibrations detected by equipment, changes in state detected by external sensors, abnormalities, etc. It should be

"Information indicating the occurrence of an event" may be, for example, information indicating a change in state or the occurrence of an abnormality. Specifically, for example, information generated when a machine tool detects a failure in work may be defined as "information indicating the occurrence of an event". In particular, the alarm signal may be "information indicating the occurrence of an event". It is particularly preferable to use an alarm signal that is generated when the machine tool detects a work failure as "information indicating the occurrence of an event." Further, for example, a signal from a revolving light connected to the machine tool (for example, a status signal indicating that the revolving light is on) may be used as "information indicating the occurrence of an event". Also, the "information indicating the occurrence of an event" may be a signal generated by an external device. The apparatus is preferably configured with trigger receiving means for receiving these signals as trigger signals. Then, the control means preferably performs control to store the image data captured by the imaging means in the storage means with the change in the state of the trigger signal as a trigger. "Information indicating the occurrence of an event" is not limited to information received from the outside. A configuration may be provided for receiving also "information indicating the occurrence of".

The "time when the event occurred" may be, for example, the time immediately after the information indicating the occurrence of the event is received from the outside.

The “image data” may be taken as an imaging range in which the cause of the occurrence of the event can be investigated.

The "image" may be, for example, a still image, but it is particularly preferable to use a moving image. Also, the image may be, for example, a 2D image or a 3D image. For example, it may be a black-and-white image or a color image.

(2) Preferably, in the present invention, the control means controls to embed the information identifying the event in the file storing the image data and store it in the storage means. By doing so, it is possible to extract the information for identifying the event from the file storing the image data. Therefore, it is possible to obtain information for identifying an event simply by exchanging a file containing the image data without exchanging a file containing the information for identifying the event separately from the image data. For example, when a device located in a remote factory sends images stored when an event occurs to a management department, etc., and the management department checks the contents of the images, many related files are required. It takes a lot of effort to send the files all at once, and it takes a lot of effort on the part of the receiver of the files to distinguish and manage a set of files. In such a case, if the above configuration is used, it is possible to eliminate the need to manually input the information for identifying the event, or to store the file for recording the information for identifying the event and the recorded image data. Reduced labor on both the sending side of the file captured by the device and the checking of the sent image, such as confirming the correspondence with the file on both the sending side and the receiving side. can do.

(3-1) For example, the control means may perform control so that information identifying an event is used as at least part of the file name and stored. In this way, the content of the information identifying the event can be grasped from the file name without opening the file. For example, it is possible to grasp the contents of the file simply by displaying the file name, without the time-consuming task of extracting and displaying information identifying an event or image data from the file. (3-2) As another example, the control means may perform control such that information identifying the event is embedded as a watermark in the image captured by the imaging means. This makes it difficult to falsify the information identifying the event. In particular, it may be arranged to embed information identifying the event without increasing the size of the file and without visually affecting the image. (3-3) As still another example, the control means may control such that information identifying an event is embedded as additional information in a file storing image data. In this way, the information identifying the event can be embedded without visible impact on the image. Note that "additional information" refers to information other than the image itself, such as a header and footer, among files storing image data. Of course, for example, the configurations (3-1) to (3-3) can be arbitrarily combined. In particular, it is desirable to have any two of (3-1) to (3-3), and most preferably, for example, the configuration of (3-1), the configuration of (3-2), and the configuration of (3-3) It is preferable to have a configuration of For example, the information identifying the first event is used as at least part of the file name, the information identifying the second event is embedded in the image as a watermark, and the information identifying the third event is used as additional information in the image data. should be embedded in the file that stores the . For example, the information identifying the first to third events may be the same information, but it is particularly preferable to include different information. In particular, these may be completely different information, but it is preferable to include the same information especially for a part of the information. In this way, the same information can be easily recognized by the user from the file name, and tampering is made difficult, and tampering can be detected by comparing the information identifying the first to third events. can be done easily. In particular, it is preferable to use a configuration in which the same information is stored as information in different representation formats for part of the information. For example, the information used for the file name is a location code that allows people to identify the location, the date and time of the event, and the information that specifies the location and date and time of the event that uniquely corresponds to the location. Character string information in which the event code, which is a code indicating the content, is arranged in this order is used as additional information and watermarks. It is recommended to store character strings with similar contents.

(4) When the image data is a moving image composed of a plurality of frames, the control means preferably controls to embed and store information identifying the event in the frame captured when the event occurs. . In this way, it becomes easier to specify the frame when the event occurred, and to easily check the images before and after the event. Also, the event that occurred in that frame can be identified from the information identifying the event. In particular, it is preferable to provide information for identifying the type of event as the information for identifying the event. By doing so, it is possible to extract the frame in which the event of that type occurred from the moving image. The file may be configured so that the moving image of one file has one frame in which an event has occurred, but it is preferable to have a plurality of frames in which an event has occurred in the moving image of one file. With this configuration, a frame in which an event occurs in a moving image file can be easily specified from the information identifying the type of event, and there is no need to check the entire moving image by fast-forwarding or the like, so that a remarkable effect can be obtained. Play.

(5-1) Preferably, in the present invention, the information identifying an event includes information indicating the time when the event occurred. In this way, the time at which the event occurred outside can be specified from the received file. Therefore, there is no need to separately exchange the file containing the information indicating the time when the event occurred. You don't have to check each and every one. (5-2) Also, the information identifying the event may include information indicating the place where the event occurred. In this way, the place where the event occurred can be identified from the received file. Therefore, there is no need to separately exchange a file containing information indicating the location where an event occurred, and a file containing information indicating the location where an event occurred and a file containing image data can be transferred separately, or the correspondence between the two can be established. You don't have to check each and every one. Information indicating the place where the event occurred may be, for example, information indicating the factory in which the machine tool is installed or information indicating the line in which the machine tool being photographed is installed in the factory. Also, it is particularly preferable that the information indicating the place where the event occurred includes information indicating the country or region. In this way, it is easy to consolidate video data of abnormalities in different manufacturing equipment on multiple different manufacturing lines in factories in various regions in various countries at the head office and examine the causes. can be done. (5-3) Also, the information identifying the event may include information indicating the type of the event. In this way, the type of event that occurred can be identified from the received file. Therefore, there is no need to exchange a file containing information indicating the type of event separately. no longer need to. For example, when the control means receives an alarm signal indicating the occurrence of an abnormality from a machine tool as an event, the "information indicating the type of event" may be an error code indicating the type of abnormality. In addition, information for identifying an event may be a serial number indicating the order in which the event occurred from the start of recording. Of course, for example, the configurations (5-1) to (5-3) can be combined arbitrarily. In particular, it is preferable to have a configuration including any two of (5-1) to (5-3), and most preferably, for example, the configuration of (5-1), the configuration of (5-2), and the configuration of (5-3) It is preferable to have a configuration of More details about the event from the received file, such that the information identifying the event includes at least two, and preferably all, of the time the event occurred, the location in which the event occurred, and the inside of the event in which it occurred. multifaceted information can be obtained. In addition, it becomes easy to classify a large number of files in which images at the time of event occurrence are recorded according to the location of the event, the time of occurrence, and the type of event. .

(6) The object to be photographed repeats the motion with a predetermined motion time as one cycle, and the predetermined time preferably includes at least the time from the start of the motion time in the cycle in which the event occurs to the occurrence of the event. In this way, it is possible to reproduce and check the stored image data of the motion from the start of the motion of one cycle including the time of occurrence of the event to the occurrence of the event. Therefore, it becomes easy to trace back and identify the cause of the occurrence of an event in that period by checking the image data, and it is possible to prevent recording unrelated to the occurrence of the event, thereby shortening the time required for checking the image data. can do. For example, if the object to be photographed is a machine tool that repeats its operation with a predetermined operating time as one cycle, and an event such as an operation error of the machine tool occurs, the event occurs from the start of the operating time in the cycle in which the event occurred. Since the image data taken until the occurrence of the error is stored, it is possible to easily investigate the cause of the operation error. The predetermined time may be "at least including the time from the start of the operation time in the cycle in which the event occurred until the occurrence of the event", but in particular, "the time for one cycle including the time when the event occurred". should be In this way, it is possible to easily investigate the cause of the work error. Further, as another configuration, the predetermined time may be the time from the start of the operation time in the cycle in which the event occurs to the occurrence of the event. For example, an operation start signal may be received at the start of operation in one cycle, and video recording may be started when the operation start signal is received.

(7) Further, it is more preferable that the predetermined time is one period of operation time before and after the time when the information indicating the occurrence of the event is received. In this way, regardless of the event occurrence timing within one unit of operation time, it is possible to store the image data including the period from the start to the end of the period in which the event occurred. For example, in a machine tool that repeats operations with a predetermined operation time as one cycle, when an event such as an operation error of the machine tool occurs, image data captured from the start to the end of the cycle including the time when the event occurred It is possible to memorize without omission, and it is possible to easily confirm the cause of the work mistake and the subsequent processing. Further, for example, an operation end signal is received at the end of the operation of one cycle, and when the operation end signal is received without receiving the signal indicating the occurrence of the event from the outside, the image data corresponding to the cycle is generated. A configuration in which no recording is performed is preferable. By doing so, it is possible to reduce the storage capacity and save the trouble of checking the image data of a scene in which no event has occurred. Further, for example, when a signal indicating the occurrence of the event is received from the outside, it is preferable to extend the recording of the image data by at least the recovery time due to the occurrence of the event. In this way, in a device or the like that performs recovery processing upon occurrence of an event, the recovery process can also be recorded.

(8) Preferably, the control means controls the storage means to store the image data at a time other than a predetermined time before or after the time when the information indicating the occurrence of the event is received, with a lower amount of information than during the predetermined time. good. In this way, it is possible to roughly check the contents of the image data captured during the time when no event has occurred, and to check the details of the image data when the event has occurred. In addition, while suppressing the size of the file storing the image data, it is possible to store the image of the time when no event occurs.

"Storing image data with a small amount of information" is particularly good, for example, when moving images are stored at a reduced frame rate. In addition, the image file may be compressed, the image quality of the image file may be reduced, a color image may be stored when an event occurs, and a black-and-white image may be stored at other times.

(9) Preferably, the apparatus of the present invention further comprises vibration detection means for detecting vibration and transmitting information indicating occurrence of an event to the control means when vibration equal to or greater than a predetermined value is detected. In this way, it is possible to record images before and after the event assuming that the event has occurred even when the device is subjected to vibrations of a predetermined value or more, other than when information indicating the occurrence of the event is received from the outside. can. For example, when a machine tool error is received as an event and the machine tool is photographed, an unexpected vibration such as a shock applied to the device itself or a change in the photographing direction is detected. In some situations, an event can be self-generated to record an image.

(10) The present invention also provides a system comprising a plurality of the devices according to any one of (1) to (13) above, wherein the plurality of devices constituting the system generate a common event. is configured to be able to receive information indicating In this way, it is possible to store image data captured by a plurality of devices before and after the occurrence of an event, thereby facilitating confirmation of the situation before and after the occurrence of the event.

(11) In the present invention, the control means provided in each device constituting the system is configured to perform control such that the information identifying the event is embedded in the file storing the image data and stored in the storage means. A first device among the devices functions as a master, a plurality of devices other than the first device function as slaves, and when the first device receives information indicating the occurrence of an event, the first device functions as a device functioning as a slave. The control means provided in the device functioning as a slave, which includes an event distribution unit for distributing information identifying the event, distributes the information identifying the event distributed from the first device to the image captured by the device functioning as the slave. It is preferable that the system be controlled so that the data is embedded in the file storing the data and stored in the storage means.

In this way, when an event occurs, a plurality of devices forming the imaging system can embed information identifying a common event in the file. As a result, it becomes easy to specify the image data stored by controlling the respective devices with the occurrence of a common event as a trigger. Further, when the information identifying the event includes information indicating the type of the event, it becomes easy to classify the files. Each of the plurality of devices constituting the imaging system may be controlled so as to store image data in a common storage means, but it is preferable to be controlled so as to store image data in different storage means.

Here, "distribution" means that the received information may be divided and distributed to other devices as it is, but the received information may be processed (for example, by modifying or adding information) and then distributed to other devices. You can hand them out. The means for transmitting information to be "distributed" can be wired, but it is preferable to use wireless. It also includes direct and indirect methods of distribution. For example, a plurality of slaves may be cascade-connected in multiple stages, and the information identifying the event supplied from the master and the information indicating the occurrence of the event may be sequentially transmitted to subsequent stages.

(12) In the present invention, the control means of each device constituting the system includes identification information for identifying the device in addition to information for identifying the event distributed from the first device. It is preferable to control so that it is embedded in the file to be stored and stored in the storage means.

Preferably, the control means of the device functioning as a slave embeds information for identifying the device functioning as a master in a file storing image data and stores the information in the storage means. In this way, since common information is embedded in files stored by slaves connected to a common master, it becomes possible to easily find an image file shot with a common event as a trigger.

As identification information for identifying a device, for example, a unique identification number may be assigned to each device in advance, or information uniquely assigned in advance, such as a MAC address, may be used. In addition, it is particularly good to automatically prevent duplication through communication between the master and the slave at the time of connection.

(13) Preferably, the event distribution unit provided in the first device distributes the information indicating the occurrence of the event to the device functioning as a slave when the control means receives the information indicating the occurrence of the event. In this way, information indicating the occurrence of an event can be distributed along with information identifying the event. Since the supply source of the information identifying the event and the supply source of the information indicating the occurrence of the event are common, the connection and setting of each device constituting the system are facilitated.

(14) The program of the present invention preferably causes a computer to function as any of the devices described above.

1 is a schematic diagram showing a configuration of an imaging system 1 together with a machine tool 2; FIG. 4 is a schematic diagram showing an overview of the order of operations when an event occurs in the machine tool 2; FIG. 1 is a schematic diagram showing the appearance of an imaging device 100. FIG. 2 is a block diagram showing the configuration of the imaging device 100 together with the memory card 200. FIG. FIG. 4 is a diagram showing the relationship between the occurrence of an event and recording of image data; FIG. 4 is a schematic diagram showing an overview of the order of operations when an event occurs in a machine capable of externally outputting an alarm signal; 1 shows an example of installation of an imaging device 100 according to a second embodiment of the present invention. 3 shows an example of installation of the imaging device 100 in the third embodiment of the present invention.

[First Embodiment]
When a manufacturing line has just been constructed in a factory, it is necessary to monitor the machine tools that make up the line for a period of about 3 to 4 months because various troubles may occur. For example, there are cases where troubles such as a screw falling off or falling down occur in a screw tightening line. Eliminate the cause of such troubles, reduce troubles to almost zero, and carry out activities to ensure that the product is completed properly. In the past, a video camera was constantly filming the machine tool, and if an abnormality was found later from the data recorded by the machine tool, the operator would watch the video from the beginning. was Then, search for the part where the abnormality occurred in the recorded video, copy only that part, send it to the headquarters or the machine tool manufacturer, and the headquarters or the machine tool manufacturer will investigate the cause of the trouble and take countermeasures. I was making plans for

An imaging system 1, which is a preferred embodiment of the present invention, will be described below with reference to the drawings. The imaging system 1 of this embodiment is a system that records images of the machine tool 2 in order to monitor the work content of the machine tool 2 operating on the manufacturing line of the factory. FIG. 1 is a schematic diagram showing the configuration of an imaging system 1 together with a machine tool 2. As shown in FIG. FIG. 2 is a schematic diagram showing an overview of the order of operations when an event occurs in the machine tool 2. FIG.

In this example, it is assumed that the machine tool 2 to be monitored performs a screw tightening operation in a manufacturing line. The machine tool 2 repeatedly executes this screw tightening operation with a predetermined operation time (for example, 30 seconds) as one cycle. When the machine tool 2 detects a failure in its own work or an abnormality in the equipment, it outputs an alarm signal indicating the occurrence of the abnormality. An "event" is a transition from a normal state to a state different from the normal state, such as a work failure or equipment malfunction. The machine tool 2 changes the signal level of the alarm signal from low to high when an event occurs. The alarm signal is input to the revolving light 21 as a lighting control signal. When the signal level of the alarm signal is low, the revolving lamp 21 is turned off (or lit in blue to indicate that there is no abnormality), and when the signal level is high, it is lit in red to indicate that there is an abnormality. In addition to changing the alarm signal when an event occurs, the machine tool 2 outputs information (error code) indicating what kind of event occurred. As the error code, for example, a different code is provided for each type of abnormality, such as that a screw has fallen, that a screw has fallen down, or the like. After outputting the alarm signal, the machine tool 2 stops working, removes the defective product, resumes working, and returns the alarm signal from high to low. It is assumed that a series of processes after these failure detections are completed within the operating cycle in which the failure in the machine tool 2 is detected. The imaging system 1 detects the occurrence of an event from the state change of the alarm signal, and captures images before and after the occurrence of the event.

The imaging system 1 includes three imaging devices ((100-1, 100-2, 100-3) collectively referred to as imaging device 100).

3 is a schematic diagram showing the appearance of the imaging device 100, and FIG. 4 is a block diagram showing the configuration of the imaging device 100 together with the memory card 200. As shown in FIG. The imaging device 100 includes a CPU 110 , an imaging unit 120 , an event input section 130 , an acceleration sensor 140 , an event distribution section 150 , a timer section 170 , and a memory card slot 160 inside a substantially cylindrical housing 105 . A lower portion of the housing 105 is provided with a screw hole for fixing to a shooting location.

The CPU 110 corresponds to control means of the present invention. The CPU 110 performs various controls according to control programs. The CPU 110 controls driving of the imaging unit 120, and controls image processing, accumulation of image data, and the like. Further, the CPU 110 receives information about an event input to the event input unit 130, a sensor signal output from the acceleration sensor 140, and the like, and executes control according to the event.

The memory card slot 160 is provided at one longitudinal end of the housing 105 . A memory card 200 corresponding to the storage means of the present invention is inserted into the memory card slot 160 . Under the control of the CPU 110 , a file containing image data captured by the imaging unit 120 is recorded in the memory card 200 . A file that stores image data is embedded with an event occurrence time, a shooting location, and an error code as information for identifying an event.

The memory card 200 also stores a setting file defining conditions for recording image data (for example, image quality, number of recording frames, etc.), identification information for identifying the imaging apparatus 100, and master/slave settings, which will be described later. be done. In addition, when the setting as the master is defined, the information indicating the shooting location is also defined in the setting file. As the information indicating the information indicating the photographing location, identification information indicating the factory in which the machine tool is installed and identification information indicating the machine tool being photographed in the factory are defined. In this example, it is assumed that the conditions necessary for recording, which will be described below, are defined in the setting file.

The imaging unit 120 corresponds to imaging means of the present invention. The imaging unit 120 is provided at the end of the substantially cylindrical housing 105 opposite to the memory card slot 160 with the longitudinal direction of the housing 105 as the optical axis. The imaging unit 120 is composed of a lens section 122 and an imaging device 124 . The lens unit 122 has a zoom lens, and can set the angle of view according to the size of the object to be photographed and the distance to the object to be photographed. The imaging device 124 is a CCD, CMOS image sensor, or the like, and acquires an image of a subject formed by the lens unit 122 as image data.

The event input unit 130 is a terminal provided on the side surface of the housing 105 and includes a trigger input terminal 132 and an event identification information input terminal 134 . The trigger input terminal 132 is connected to a wiring branched from a connection line for transmitting an alarm signal for turning on the alarm revolving light 21 when the machine tool 2 detects a failure in the work. A trigger input terminal 132 receives an alarm signal as a trigger signal indicating the occurrence of an event. A trigger signal input to the trigger input terminal 132 is transmitted to the CPU 110 and used as a type of information indicating the occurrence of an event.

An error code output terminal of the machine tool 2 is connected to the event identification information input terminal 134 of the imaging device 100 set as the master. The event identification information input terminal 134 of the imaging device 100 set as the master receives an error code generated when the machine tool 2 detects a failure in the work. The input error code is transmitted to the CPU 110 and used as part of the information identifying the event. Also, the event distribution unit 150 of the imaging device 100 set as the master is connected to the event identification information input terminal 134 of the imaging device 100 set as the slave. The event identification information input terminal 134 of the imaging device 100 set as a slave receives information identifying an event distributed by the imaging device 100 set as a master. The information identifying the input event is transmitted to the CPU 110 and used as part of the information identifying the event in the imaging device 100 set as a slave.

Since existing machine tools are provided with a configuration for informing a person of the occurrence of an event as described above, the imaging device 100 uses this configuration to receive a trigger signal and an error code via an event input section. .

Acceleration sensor 140 detects vibration, and changes the sensor signal from a low state to a high state when vibration having a preset intensity or more is detected. The sensor signal is transmitted to CPU 110 . The CPU 110 uses the sensor signal as one type of information indicating the occurrence of an event.

Clocking unit 170 clocks the current time, and outputs current time information to CPU 110 in response to a request from CPU 110 . The CPU 110 uses the time information acquired from the timer 170 as part of the information for identifying the event.

The image signal output terminal 180 is a terminal for outputting an image signal for displaying an image captured by the imaging unit 120 on an external monitor. In this embodiment, an HDMI (High-Definition Multimedia Interface, registered trademark) terminal is used. be done.

The event distribution unit 150 distributes information identifying an event to other imaging devices 100 functioning as slaves when the imaging device 100 is set to function as a master. Specifically, under the control of the CPU 110, the event occurrence time measured by the timer unit 170 of the imaging device 100 functioning as the master is recorded in the setting file of the memory card 200 inserted into the imaging device 100 functioning as the master. Information indicating the shooting location and an error code are output from the output terminal. A cable for transmitting information identifying an event to the imaging device 100 functioning as a slave is connected to the output terminal. The output terminal of the event distribution unit 150 has the same structure and pin arrangement as the error code output terminal of the machine tool 2, and the error code output terminal of the machine tool 2 and the event identification information input terminal 134 of the imaging device 100 functioning as a master. and the cable connecting the event distribution unit 150 of the imaging device 100 functioning as a master and the event identification information input terminal 134 of the imaging device 100 functioning as a slave are compatible.

Each imaging device 100 configured as described above is installed so as to photograph the machine tool 2 from mutually different directions. Each imaging device 100 is fixed to a structure around the machine tool 2 to be photographed or to a mount such as a tripod using a screw hole provided in the lower portion of the housing 105 . A camera platform is provided between the fixing point and the imaging device 100, and the imaging direction can be freely changed. The angle of view of the lens unit 122 included in each imaging device 100 is adjusted so that image data can be recorded within an imaging range in which the cause of the occurrence of an event can be investigated. When adjusting the imaging range, the image signal output terminal 180 of the imaging device 100 is connected to the monitor 3, and the image captured by the imaging device 100 is displayed as it is on the screen of the monitor 3 (so-called through image display). , make adjustments while checking the range displayed on the screen. Of the three imaging devices, the imaging device 100-1 is set to function as a master, and the remaining imaging devices 100-2 and 100-3 are set to function as slaves.

A cable for transmitting an alarm signal from the machine tool 2 is connected to the trigger input terminal 132 of each imaging device 100 . Through such connection, the three imaging devices 100 forming the imaging system 1 can receive an alarm signal, which is information indicating the occurrence of a common event. A cable for transmitting an error code from the machine tool 2 is connected to the event identification information input terminal 134 of the imaging device 100-1, which is the master. A cable for transmitting information identifying an event distributed from the event distribution unit 150 of the imaging device 100-1 is connected to the event identification information input terminal 134 of each of the imaging devices 100-2 and 100-3 serving as slaves. be.

Hereinafter, the specific operation of the imaging system 1 when executing the monitoring function will be described. It should be noted that the operation of each component in the following description is under the control of the CPU 110, even if not specified.

FIG. 5 is a diagram showing the relationship between the occurrence of events and the recording of image data. The imaging unit 120 of each imaging device 100 that constitutes the imaging system 1 constantly captures a moving image regardless of whether an event has occurred, and the memory card 200 inserted in each memory card slot 160, Image data from a predetermined time ago to the latest is temporarily stored at a high frame rate (for example, 30 frames per second). Image data for which a predetermined time has passed since the time of photographing is thinned to a low frame rate (for example, one frame per second) and stored in the memory card 200 .

As described above, if a failure occurs in the work performed by the machine tool 2 while moving images are constantly being captured, the machine tool 2 detects this failure and changes the state of the alarm signal from low to high. Let Then, this alarm signal is input to the trigger input terminal 132 of each imaging device 100 . Triggered by the detection of a change in the alarm signal from low to high, the CPU 110 detects the event occurrence time from a predetermined time before the time when the event occurred (that is, the time when it was detected that the alarm signal changed from low to high). The memory card 200 stores the high frame rate image data captured by the imaging unit 120 within a predetermined period of time. Specifically, the high frame rate image data temporarily stored in the memory card at the time the event occurred (that is, the image data from a predetermined time before the event occurrence time to the event occurrence time) and the event occurrence time High frame rate image data captured during a predetermined time from the time of occurrence is recorded in a file in the memory card 200 without thinning.

Events such as work mistakes occur through the process of the event causing the mistake, the occurrence of the mistake, the detection of the mistake, and the transmission of information indicating the occurrence of the event (e.g., change in alarm signal). Although it is necessary to confirm the image before the occurrence of the event to investigate the cause of the above, according to the present embodiment, it is possible to confirm the image before the occurrence of the event.

The aforementioned “predetermined time” is assumed to be one cycle of the operating time of the machine tool 2 . In this way, regardless of the event occurrence timing within one cycle of the operation time, it is possible to store the image data including the period from the start to the end of the period in which the event occurred. Since the image data photographed from the start to the end of the cycle including the time when the event occurred can be stored without omission, it is possible to easily confirm the cause of the work mistake and the subsequent processing. That is, by checking the image before the occurrence of the event in the cycle in which the event occurred, it is possible to grasp the cause of the work error. Also, by checking the image after the occurrence of the event in the cycle in which the event occurred, it is possible to check whether the processing after the occurrence of the event has been appropriately performed.

When a file storing detailed image data captured during a predetermined time period from the time an event occurs is recorded in the memory card 200, the CPU 110 controls to embed information identifying the event in the file. Information for identifying an event is distributed by the imaging device 100-1 functioning as a master to the imaging devices 100-2 and 100-3 functioning as slaves. As a result, information for identifying a common event is embedded in files recorded by the imaging devices 100 triggered by the occurrence of one event, which facilitates classification and management of files.

In the example of this embodiment, the information identifying the event is information indicating the time when the event occurred, information indicating the place where the event occurred, and an error code. The CPU 110 of the imaging device 100-1 functioning as a master acquires the time at which the event occurred from the clock unit 170 included in the imaging device 100-1. Also, information indicating the place where the event occurred is read out and used in advance from the setting file recorded in the memory card 200 inserted in the imaging apparatus 100-1. The error code output from the machine tool 2 is received via the event identification information input terminal 134 and used.

As a method of embedding the information identifying the event, the information identifying the event is used as part of the file name. By including the information identifying the event in the file name, it is possible to easily grasp the contents of the image data stored in the file without reading the image file into dedicated software. Also, an error code is embedded in the header of the frame when an event occurs in the moving image to be recorded. By searching for frames with embedded error codes during playback, you can quickly check the image at the moment the event occurred. In addition, when a plurality of files recorded by each imaging device 100 are reproduced at the same time triggered by the occurrence of one event, synchronization can be achieved by simultaneously reproducing frames in which error codes are embedded.

The CPU 110 of each imaging device 100 constituting the imaging system 1 embeds identification information for identifying the imaging device 100 in addition to information identifying an event in a file storing image data captured by the imaging unit 120. It controls to store in the memory card 200 . As the identification information for identifying the imaging device 100, the information defined in advance in the setting file recorded in the memory card 200 inserted in each imaging device 100 is read and used.

After a predetermined period of time has passed since the time when the event occurred, moving images are constantly captured again, and image data from a predetermined period of time up to the latest is stored in the memory cards 200 inserted in the respective memory card slots 160. is temporarily stored at a high frame rate, and the image data after a predetermined time has elapsed from the time of photographing is thinned as needed to a low frame rate and stored in the memory card 200.例文帳に追加In this way, it is possible to roughly check the contents of the image data captured during the time when no event has occurred, and to check the details of the image data when the event has occurred. In addition, while suppressing the size of the file storing the image data, it is possible to store the image of the time when no event occurs.

In addition to the case where the machine tool 2 notifies the imaging system 1 of the occurrence of an event by an alarm signal as described above, each of the imaging devices 100 constituting the imaging system 1 of the present embodiment is provided with an acceleration sensor 140 in advance. Detecting a vibration of a set strength or more is treated as occurrence of an event, and high frame rate image data captured by the imaging unit 120 from a predetermined time before the time when the vibration is detected to a predetermined time after the time when the event occurs. is stored in the memory card 200. Storing of image data triggered by the detection of vibration is performed only by the imaging device 100 having the acceleration sensor 140 that detected the vibration, and the other imaging devices 100 do not store the image data. As a result, there is an event in which only the imaging device 100 that has detected the vibration has stored the file, so it is possible to easily identify the imaging device 100 that may have had an abnormality.

In this way, images before and after the event can be recorded assuming that the event has occurred even when vibration of a predetermined value or more is applied to the device, other than when an alarm signal is received from the machine tool 2.例文帳に追加In situations where unexpected vibrations or abnormalities on the imaging device side are detected, such as when the imaging device itself receives a shock or when the shooting direction is changed, an event can be generated by itself and an image can be recorded. As a result, it is possible to easily notice a change in the photographing direction of the camera, correct the photographing direction, and prepare for appropriately photographing when an event such as an abnormality of the machine tool 2 occurs.

Information for identifying an event different from that triggered by an alarm signal from the machine tool 2 is embedded in the file recorded when vibration is detected by the acceleration sensor 140 . Specifically, an error code indicating detection of abnormal vibration is embedded as information for identifying the event.

A file storing image data respectively recorded by the three imaging devices 100 has a function of being synchronized and played back by a viewer operating on a computer, triggered by the occurrence of a common event. This viewer synchronizes and reproduces the frames of each image data in which the error code is embedded in the header so that they are reproduced at the same timing. Also, the time information, location information, and error code included in the information identifying the event are displayed in association with the image being reproduced. Also, when selecting a target file to be reproduced, a plurality of files having common event identifying information are displayed in association with each other. This makes it easy to specify files to be played back in sync. The viewer also has a function of searching for files to be played using time information, location information, and error codes as keys. With such a viewer, it is possible to quickly find a file containing image data shot from multiple directions before and after a single event, and play them back in sync, making it possible to investigate the cause of the event and confirm post-processing. easier.

According to the imaging system 1 described above, it is possible to eliminate the need to manually input the information for identifying the event and the identification information of the imaging device. Therefore, when an apparatus placed in a remote factory sends images stored when an event occurs to a management department collectively, and the management department confirms the contents of the images, the imaging device 100 can capture images. On the side of transmitting the file obtained by this method, the file in which various information is automatically embedded can be transmitted as it is. Also, on the side that confirms the sent image, it is possible to handle a file in which predetermined information is reliably embedded. Therefore, labor can be reduced on both the transmitting side and the receiving side. In addition, since image data captured before and after the occurrence of an event by a plurality of imaging devices 100 can be stored, it is easy to confirm the situation before and after the occurrence of the event.

Further, when an event occurs, the plurality of imaging devices 100 constituting the imaging system 1 embeds information identifying a common event in a file, so that each imaging device 100 stores information upon occurrence of a common event. It becomes easy to identify the image data that has been processed. Also, if the information identifying the event includes information indicating the type of the event, the classification and management of the files are facilitated.
[Modification of the first embodiment]

The present invention is not limited to the above-described first embodiment, and includes modifications, improvements, etc. within the scope of achieving the object of the present invention.

For example, in the above-described first embodiment, when the machine tool 2 detects a failure in its own work or an abnormality in the equipment, the signal to the revolving light 21 connected to the machine tool 2 is branched. However, the machine tool 2 is configured to output an alarm signal indicating the occurrence of an abnormality to the outside and use the alarm signal as information indicating the occurrence of an event. You may In the case where the signal to the revolving light 21 is branched and used, for example, the revolving light 21 that lights up in blue when normal and lights up in red when an abnormality occurs is used, and a control signal for turning on in red is used. may be used as an alarm signal. Further, a light-receiving element for detecting red light emission may be provided in the imaging device 100, and the red light emission of the revolving lamp 21 may be received as information indicating the occurrence of an event. In addition, as the rotating light 21, one that lights up in red and emits a warning sound when an abnormality occurs is used, and a microphone for detecting the warning sound is provided in the imaging device 100 so that the warning sound of the rotating light is received as information indicating the occurrence of an event. may Further, the object to be photographed by the imaging device 100 is not limited to machine tools, and may be various robots, processing machines, and the like arranged on a factory line. As an example, FIG. 6 schematically shows the order of operations when an event occurs in the case where a robot placed in a strawberry cake manufacturing line and arranging strawberries on the top of the cake is taken as an imaging target. The robot does not have a revolving light, and is configured to output an alarm signal to the outside when it detects a work failure.

In the first embodiment described above, the imaging device 100-1 serving as the master adds information indicating the time and information indicating the shooting location to the error code received from the machine tool 2, and uses the information to identify the event as the slave. However, the error code received from the machine tool 2 may be distributed to the slaves as it is.

In the first embodiment, the means for transmitting information to be "distributed" is wired, but it may be wireless. In the case of wireless transmission, wireless communication standards such as Wifi, 3G, and Bluetooth (registered trademark) do not matter. Moreover, the method of distributing information is not limited to the method of distributing information directly from the master to each slave, but also includes the method of distributing information indirectly. For example, a plurality of slaves may be cascade-connected in multiple stages with one master as a starting point, and information identifying an event supplied from the master and information indicating the occurrence of an event may be sequentially transmitted to subsequent stages. As another example, all the imaging devices 100 may be connected to a network, and information to be distributed over the network may be broadcast from the master to all the slaves.

In the first embodiment, the identification information defined in the memory card 200 in advance is used as the identification information for identifying the device. Information may be used. Further, when setting the configuration of the imaging system 1, the identification information may be automatically set through communication between the master and the slave so that the identification information is not duplicated.

Alternatively, the CPU 110 of the imaging device 100 functioning as a slave may control such that the identification information of the imaging device 100 functioning as a master is embedded in a file storing image data and stored. In this way, since common information is embedded in files stored by slaves connected to a common master, it becomes possible to easily find an image file shot with a common event as a trigger.

In the first embodiment, the machine tool 2 and each imaging device 100 are directly connected to transmit information indicating the occurrence of an event (that is, an alarm signal). The distribution unit 150 may be configured to distribute information indicating the occurrence of an event in addition to the information identifying the event to the slaves. In this manner, the information identifying the event and the information indicating the occurrence of the event can be distributed, thereby facilitating the connection and setting of each device constituting the system. In this case, the cable for transmitting the information identifying the event and the cable for transmitting the information indicating the occurrence of the event should be integrated. By doing so, the number of cables used for connection between the master and the slave can be reduced, making connection and setting easier. Also, the cable that transmits the information indicating the occurrence of an event from the master to the slave should be configured to be compatible with the transmission of the alarm signal from the machine tool 2 to the master.

Alternatively, a serial number from the start of recording may be transmitted together with information indicating the occurrence of an event that serves as a trigger, and files of image data recorded by each imaging device 100 may be associated with this serial number. This serial number from the start of recording may be part of the information identifying the event.

In the first embodiment described above, when the acceleration sensor 140 detects a vibration having a preset intensity or more, the image is recorded only in the imaging device 100 including the acceleration sensor 140 that has detected the vibration. Information indicating the occurrence of an event may be transmitted to the imaging device 100 so that another imaging device 100 may also record an image. In order to distribute information indicating the occurrence of an event from an arbitrary imaging device 100 to the other imaging devices 100, the information indicating the occurrence of the event is individually transmitted from the distribution source imaging device to each of the other imaging devices. However, for example, it is preferable to connect all imaging devices 100 to a network and broadcast information indicating the occurrence of an event from the imaging device 100 of the distribution source to the network. Accordingly, information indicating the occurrence of an event can be transmitted to all imaging devices 100 at approximately the same timing.

In the first embodiment, the image capturing unit 120 captures moving images as images, but may capture still images, for example. Also, the image may be, for example, a 2D image or a 3D image. Moreover, it may be a black-and-white image or a color image. The lens section provided in the imaging unit 120 may be a short focus lens instead of a zoom lens.

In the above-described first embodiment, the memory card 200 inserted into the memory card slot 160 is used as storage means, but other storage devices such as a hard disk drive may be used instead of the memory card. Further, the storage means is not limited to being detachable, and may be incorporated in the housing 105 in a non-detachable manner. In the above-described first embodiment, the memory card 200 inserted into the memory card slot 160 of each imaging device 100 is used as a storage means. The image data may be stored in the storage area provided above. However, the best configuration is to store each imaging device 100 as described above. Especially when a production line has just been built in a factory, for a period of about 3 to 4 months, in the case of temporary installation such as when monitoring troubles, it can be easily installed by screwing without building a large-scale system. can be stored in each imaging device. In addition, not only in the case of temporary facilities, but also in the case where events do not occur very frequently, it is possible to easily photograph the abnormal situation of the machine tool without large-scale system construction or the like.

In the above-described first embodiment, a moving image is always captured. However, a configuration is adopted in which an operation start signal is received at the start of operation in one cycle, and video recording is started when the operation start signal is received. may be configured. Further, for example, when the operation end signal is received at the end of the operation of one cycle, the image data corresponding to the cycle is recorded when the operation end signal is received without receiving the signal indicating the occurrence of the event from the outside. It is good also as the structure which does not carry out. For example, when a signal indicating the occurrence of an event is received from the outside, it is preferable to extend the recording of the image data by at least the recovery time due to the occurrence of the event.

In the first embodiment, the image data captured by the imaging unit 120 is temporarily stored in the memory card 200 for a predetermined period of time. The image data of high frame rate when an event occurs and the image data of low frame rate when no event occurs may be finally recorded in the memory card 200 .

In the first embodiment, when an event occurs, high frame rate images are recorded from a predetermined time before the event occurrence time to a predetermined time after the event occurrence time. may be different, and the user should be able to set the time freely. For example, if the machine tool 2 requires a longer period of time than one cycle of normal operation for post-event processing, the post-event recording time may be longer. In this way, it is possible to more reliably investigate the cause of the occurrence of the event and confirm the post-processing.

In the first embodiment, the information identifying the event is embedded in the file by using it as part of the file name, but it can be embedded in other ways. For example, information identifying the event may be embedded in the image as a watermark. In this way, the information identifying the event can be embedded without increasing the size of the file and without visually affecting the image. Also, it is possible to make it difficult to falsify the information that identifies the event. As another example, information identifying an event may be embedded as characters superimposed on the image. As still another example, information identifying an event may be embedded as additional information in a file that stores data. Note that "additional information" refers to information other than the image itself, such as a header and footer, among files storing image data.

Further, in the first embodiment, the information identifying the three events, that is, the information indicating the time when the event occurred, the information indicating the location where the event occurred, and the information identifying the event including the error code, are stored in the file. Although it was decided to use it for at least part of the name, for example, information identifying the first event (for example, information indicating the time when the event occurred) is used for at least part of the file name, and the second event ( For example, information that identifies the location where the event occurred) is embedded as a watermark in the image, and information that identifies the third event (for example, an error code) is embedded as additional information in the file that stores the image data. good. For example, the information identifying the first to third events may be the same information, but it is particularly preferable to include different information. In particular, these may be completely different information, but it is preferable to include the same information especially for a part of the information. In this way, the same information can be easily recognized by the user from the file name, and tampering is made difficult, and tampering can be detected by comparing the information identifying the first to third events. can be done easily. In particular, it is preferable to use a configuration in which the same information is stored as information in different representation formats for part of the information. For example, the information used for the file name is a location code that allows people to identify the location, the date and time of the event, and the information that specifies the location and date and time of the event that uniquely corresponds to the location. Character string information in which the event code, which is a code indicating the content, is arranged in this order is used as additional information and watermarks. It is recommended to store character strings with similar contents.

In the above-described first embodiment, the file is configured so that the number of frames in which an event has occurred is one in the moving image of one file. may

In the above-described first embodiment, a high frame rate image is recorded from a predetermined time before the event occurrence time to a predetermined time after the event occurrence time, and a low frame rate image is recorded for the rest of the time. Images may not be recorded at other times. Also, from a predetermined time before to a predetermined time after the event occurrence time, the compression rate of the image file is reduced (or not compressed), the image quality of the image file is increased (for example, HD (High Definition) image), and the color image is used. , etc. to record images with a large amount of information, and at other times the amount of information is reduced by increasing the compression rate of the image file, lowering the image quality of the image file (for example, VGA image), making it a black and white image, etc. may

In the above-described first embodiment, an example was described in which the viewer as the reproducing means is provided as software executed on a computer separate from the imaging device 100 . A reproducing means for reproducing and displaying the obtained image data may be integrally provided.

[Second embodiment]
FIG. 7 shows an installation example of the imaging device 100 according to the second embodiment of the present invention. In this embodiment, the imaging device 100 is placed on a table in the workplace and monitors the table. For example, when a worker leaves the workplace during lunch break, the tools and the like placed on the table are monitored. In this embodiment, the imaging device 100 operates using power supplied from a battery used for power tools or the like. The imaging apparatus 100 of this example receives a sensor signal indicating abnormal vibration output from an internal acceleration sensor and a trigger signal from an external sensor as information indicating the occurrence of an event, and captures image data before and after the occurrence of the event. Record.

[Third Embodiment]
FIG. 8 shows an installation example of the imaging device 100 according to the third embodiment of the present invention. In this embodiment, the imaging device 100 is attached to a frame at the rear of the cab of the forklift, and captures an image of the front. The imaging range is set to include the driver's cab and the area in front of the forklift, especially the forks. The imaging device 100 of this example is also provided with mounting screw holes on the upper surface of the housing, and is configured so that the imaging device 100 can be installed by being suspended from above. The imaging device 100 of this embodiment includes temperature measuring means. When a forklift moves in and out of a freezer, the imaging unit fogs up. To prevent this, heating is performed with a heating wire and a thermostat only when the temperature measuring means detects a low temperature to prevent fogging. In addition, the detection of a rapid change in temperature (for example, a change in temperature due to entering/exiting from a freezer) by the temperature measuring means is treated as an event, and captured image data is recorded.

1 imaging system 2 machine tool 3 monitor 100 imaging device 105 housing 110 CPU
120 imaging unit 130 event input unit 140 acceleration sensor 150 event distribution unit 160 memory card slot 170 timer unit 200 memory card

Claims (3)

A photographing device configured to be attachable to a forklift,
an imaging means having a lens portion and an imaging element;
a temperature measuring means;
a function of heating to prevent fogging of the imaging means when a low temperature is detected by the temperature measuring means;
A function of performing control to store the image data captured by the imaging means in a storage means when the temperature measurement means detects a temperature change associated with the movement of the forklift in and out of the freezer as an event;
A photographing device having a The imaging device according to claim 1, wherein the heating for preventing fogging is heating with a heating wire. A photographing device configured to be attachable to a forklift,
imaging means;
a temperature measuring means;
A function of performing control to store the image data captured by the imaging means in a storage means when the temperature measurement means detects a temperature change associated with the movement of the forklift in and out of the freezer as an event;
A photographing device having a

Images