JP2016039473A - Device, system, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a device etc. capable of acquiring image data that facilitates checking the content of imaging before and after the occurrence of an event.SOLUTION: With reception of information indicating the occurrent of an event from the outside as a moment, control means controls storage means to store at least image data captured by imaging means in predetermined periods before and after the time when the event occurs.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a device, a system including the device, a program, and the like.

  There has been proposed a surveillance camera that includes a lens unit and stores image data captured by the lens unit in a removable storage medium (see, for example, Patent Document 1).

JP 2013-197902 A

  Normally, with such a surveillance camera, the object to be monitored is continuously imaged. Therefore, in order to check the contents of the shooting at the time of abnormality, a long-time video is played from the beginning, and the problem scene is quickly turned. There was a need to look and confirm. For this reason, it took a very long time for the confirmation work.

  Therefore, an object of the present invention is to provide an apparatus and the like that can acquire image data that allows easy confirmation of shooting contents before and after an event occurs. This object is achieved, for example, by a combination of features described in the independent claims. The dependent claims define further advantageous specific examples of the present invention, for example.

(1) In order to solve the above-described problem, the present invention is based on the fact that information indicating the occurrence of an event has been received from the outside, and image data captured by the imaging means at least at a predetermined time before and after the time at which the event occurred. It is preferable that the apparatus includes a control unit that performs control for storing the information in the storage unit.

  In this way, it is possible to store the image data captured by the imaging means before and after the occurrence of the event, making it easy to check the content of the image captured before and after the time when the event occurred. For example, in order to confirm the image, it is preferable to include a reproducing unit that reproduces the stored image data so that the user can visually recognize the image data. The reproduction means may be provided integrally with the control means, or may be provided as a separate body. Moreover, in this invention, it is good to provide an imaging means with a control means. The image capturing means may store image data over a predetermined time by always capturing regardless of the occurrence of an event. Then, when the control means receives information indicating the occurrence of an event, the control means may control the storage means to store the image data captured at a predetermined time before and after that. In the present invention, the storage means may be built in the device provided with the control means, but may be provided in the form of a memory card, a hard disk drive or the like so as to be detachable from the device.

  The “event” may be generated when an abnormality occurs, for example. For example, it may be a variety of events, especially due to failure of work on machine tools operating on the factory production line, unusual vibration detected by the device, change or abnormality of the state detected by the external sensor, etc. You should do it.

  “Information indicating the occurrence of an event” may be, for example, information indicating a change in state or occurrence of an abnormality. Specifically, for example, information that is generated when the machine tool detects a failure in work may be “information indicating the occurrence of an event”. In particular, the alarm signal may be “information indicating the occurrence of an event”. It is particularly preferable that an alarm signal generated when the machine tool detects a work failure is “information indicating the occurrence of an event”. For example, a signal from a rotating lamp connected to the machine tool (for example, a status signal indicating that the rotating lamp is lit) may be “information indicating the occurrence of an event”. The “information indicating the occurrence of an event” may be a signal generated by an external device. The apparatus may be configured to include trigger receiving means for receiving these signals as trigger signals. Then, the control unit may perform control to store the image data captured by the imaging unit in the storage unit in response to a change in the state of the trigger signal. In addition to the information received from the outside, “information indicating the occurrence of an event” detects the occurrence of an event within the device and transmits the “information indicating the occurrence of the event” It is also possible to provide a configuration for receiving "information indicating occurrence of".

  The “time when the event has occurred” may be, for example, the time immediately after receiving information indicating the occurrence of the event from the outside.

  The “image data” may be captured with a range in which the cause of the occurrence of the event can be pursued as an imaging range.

  The “image” may be a still image, for example, but is particularly preferably a moving image. The image may be a 2D image or a 3D image, for example. For example, it may be a black and white image or a color image.

(2) Preferably, in the present invention, the control means may control the information for identifying the event to be embedded in a file storing image data and stored in the storage means. In this way, it is possible to extract information for identifying the event from the file storing the image data. Therefore, it is possible to obtain information for identifying an event only by exchanging a file for storing image data, without exchanging a file containing information for identifying an event separately from image data. For example, when an image stored in a remote factory is stored in the event of an event and sent to the management department, etc., and the contents of the image are checked by the management department, many related files are stored. It takes a lot of labor to send them together, and it takes a lot of effort to distinguish and manage a set of files even on the side receiving the files. In such a case, with the above configuration, it is possible to eliminate the need to manually input information for identifying an event, or to record a file for recording information for identifying an event and image data. Reduces labor both on the side of sending files obtained by the device and on the side of checking sent images, such as checking the correspondence between files on both the sending and receiving sides. can do.

(3-1) For example, the control means may control to use information for identifying the event as at least a part of the file name. In this way, it is possible to grasp the contents of the information for identifying the event from the file name without opening the file. For example, it is possible to grasp the contents of a file only by displaying the file name without performing time-consuming work such as extracting information for identifying an event or image data from the file and displaying it. (3-2) As another example, the control unit may control to embed information for identifying an event as a watermark in an image captured by the imaging unit. In this way, it is possible to make it difficult to falsify information identifying the event. In particular, it is preferable to embed information for identifying an event without increasing the size of the file and without affecting the image. (3-3) As yet another example, the control means may control to embed information for identifying an event as additional information in a file storing image data. In this way, it is possible to embed information for identifying an event without having a visible effect on the image. The “additional information” refers to information other than the image itself, such as a header and a footer, among files storing image data. Of course, for example, the configurations of (3-1) to (3-3) can be arbitrarily combined. In particular, it is preferable to have a configuration including any two of (3-1) to (3-3), and most preferably, for example, the configuration of (3-1), the configuration of (3-2), and (3-3). It is good to have the structure of. For example, the information for identifying the first event is used for at least part of the file name, the information for identifying the second event is embedded as a watermark in the image, and the information for identifying the third event is image data as additional information. Should be embedded in the file that stores. For example, the information for identifying the first to third events may be the same information, but in particular, it may be configured to include different information. In particular, these may be completely different information, but in particular, some information may include the same information. In this way, the user can easily visually recognize the same information from the file name, make it difficult to tamper with, or detect tampering by comparing information identifying the first to third events. Can be easily done. In particular, it may be configured to store the same information as part of information in different expression formats. For example, the information used for the file name includes the location code, date and time of the event that can identify the location by a person who consists of, for example, an alphanumeric string that uniquely identifies the location and date and time where the event occurred. While the event code, which is a code indicating the contents, is used as character string information arranged in this order, as additional information and watermark, the character string indicating the name of the place corresponding to the place code and the event corresponding to the event code are specified. It is recommended to store character strings with typical contents.

(4) When the image data is a moving image composed of a plurality of frames, the control means may control to embed and store information for identifying the event in the frame captured when the event occurs. . In this way, it is easy to specify a frame when an event occurs, and it is possible to easily check images before and after the event. In addition, an event occurring in the frame can be identified from the information for identifying the event. In particular, information for identifying the type of event may be provided as information for identifying the event. In this way, it is possible to extract the frame in which that type of event has occurred from the moving image. A file may be configured such that one frame has an event in a moving image of one file, but a plurality of frames in which an event has occurred may be provided in the moving image of one file. With this configuration, it is possible to easily specify the frame in which the event occurred in the video file from the information for identifying the type of event, and it is not necessary to confirm the entire video by fast-forwarding etc. Play.

(5-1) Preferably, in the present invention, the information for identifying an event may include information indicating a time when the event occurs. In this way, it is possible to specify the time when the event occurred externally from the received file. Therefore, there is no need to exchange a file containing information indicating the time when the event occurred, and a file containing information indicating the time when the event occurred and a file storing image data are separately transferred, or the correspondence between the two There is no need to check each time. (5-2) Further, the information for identifying the event may include information indicating a place where the event has occurred. In this way, the place where the event occurred can be identified from the received file. Therefore, there is no need to exchange a file containing information indicating the location where the event occurred, and the file containing the information indicating the location where the event occurred and the file storing the image data are passed separately, or the correspondence between the two There is no need to check each time. The information indicating the place where the event has occurred may be, for example, information indicating a factory where a machine tool is installed or information indicating a line where a machine tool photographed in the factory is installed. In addition, it is particularly preferable that the information indicating the location where the event occurs includes information indicating the country or region. In this way, it is easy to consolidate video data at the time of abnormality of different manufacturing equipment of multiple different manufacturing lines in factories in various regions of various countries at the headquarters / headquarters and examine the causes. Can be. (5-3) Further, the information for identifying the event may include information indicating the type of event. In this way, the type of event that occurred can be identified from the received file. Therefore, there is no need to exchange files containing event type information separately, files containing event type information and files storing image data are separately passed, and the correspondence between them is checked one by one. There is no need to do this. For example, when the control means receives an alarm signal indicating the occurrence of an abnormality from the machine tool as an event, the “information indicating the type of event” may be an error code indicating the type of abnormality. In addition, the information for identifying the event may be a serial number indicating the order in which the event has occurred since the start of recording. Of course, for example, the configurations of (5-1) to (5-3) can be arbitrarily combined. In particular, it is desirable to have any two of (5-1) to (5-3), and most desirably, for example, the configuration of (5-1), the configuration of (5-2), and (5-3). It is good to have the structure of. More information about the event from the received file by ensuring that the information identifying the event includes at least two, preferably all, the time the event occurred, the location where the event occurred, and the edge of the event that occurred Multi-faceted information can be obtained. In addition, it becomes easy to classify a large number of files in which images at the time of an event are recorded according to the place where the event occurred, the time of occurrence, and the type of the event, making it easier to examine and investigate the cause of the event. .

(6) The imaging target repeats the operation with a predetermined operation time as one cycle, and the predetermined time may include at least the time from the start of the operation time to the occurrence of the event in the cycle in which the event has occurred. By doing this, it is possible to reproduce and check the stored image data from the disclosure time of the operation of one cycle including the time when the event occurs to the event occurrence. Therefore, it is easy to check and specify the image data by tracing back the cause of the event that occurred in that cycle, and it is possible to prevent recording that is unrelated to the occurrence of the event, thus reducing the time required to check the image data. can do. For example, when an object to be photographed is a machine tool that repeats an operation with a predetermined operation time as one cycle, if an event such as a machine tool operation error occurs, the event starts from the start of the operation time in the event occurrence cycle. Since the image data taken in the time until the occurrence of is stored, the cause of the work mistake can be easily determined. The predetermined time may be configured to include “at least from the start time of the operation time in the cycle in which the event has occurred to the occurrence of the event”, and in particular, “time for one cycle including the time in which the event has occurred” It is good to do. In this way, it is possible to easily investigate the cause of a work error. As another configuration, in particular, the predetermined time may be a time from the start of the operation time to the occurrence of the event in the cycle in which the event has occurred. For example, an operation start signal may be received at the start of one cycle of operation, and video recording may be started when the operation start signal is received.

(7) Further, it is more preferable that the predetermined time be one cycle of the operating time before and after the time when the information indicating the occurrence of the event is received. In this way, it is possible to store image data including from the start to the end of the cycle in which the event occurred regardless of the event occurrence timing within one unit of the operation time. For example, when an event such as a work error of a machine tool occurs in a machine tool that repeats the operation with a predetermined operation time as one cycle, image data taken from the start to the end of the cycle including the time when the event occurred The data can be stored without omission, and the cause of the work error and the subsequent processing can be easily confirmed. Also, for example, an operation end signal is received at the end of one cycle of operation, and when the operation end signal is received without receiving a signal indicating the occurrence of the event from the outside, the image data corresponding to the cycle is stored. It is recommended that the recording is not performed. In this way, it is possible to reduce the storage capacity and to save the trouble of confirming the image data of a scene where no event has occurred. Further, for example, when a signal indicating the occurrence of the event is received from the outside, it is preferable to perform a process of extending the recording of the image data for at least a recovery time due to the occurrence of the event. In this way, it is possible to record, including the recovery process, in a device or the like that performs recovery processing in response to the occurrence of an event.

(8) Preferably, the control unit controls the storage unit to store the image data with a lower amount of information than the predetermined time before and after the time when the information indicating the occurrence of the event is received. Good. In this way, it is possible to roughly check the content of the image data captured in the time zone when no event occurs, and to check the content of the image data in detail when the event occurs. Further, it is possible to store an image of a time when no event occurs while suppressing the size of a file storing image data.

  “Storing image data with a low amount of information” is particularly good when the frame rate of a moving image is lowered and stored, for example. In addition, the image file may be compressed, the image file quality may be reduced, a color image may be stored when an event occurs, and a black and white image may be stored for other times.

(9) Preferably, the apparatus of the present invention further includes vibration detection means for detecting vibration and transmitting information indicating the occurrence of an event to the control means when vibration greater than a predetermined value is detected. In this way, in addition to the case where information indicating the occurrence of an event is received from the outside, it is possible to record images before and after the event, assuming that the event has occurred even when vibration exceeding a predetermined value is applied to the device. it can. For example, when an error of a machine tool is received as an event and the machine tool is photographed, unexpected vibrations such as an impact on the device itself or a change in the photographing direction are detected. In situations, an event can be generated by itself to record an image.

(10) Further, the present invention is a system configured by including a plurality of devices of any one of the above (1) to (13), and the plurality of devices configuring the system generate a common event. Can be received. In this way, it is possible to store image data captured before and after an event has occurred by a plurality of devices, so it is easy to check the situation before and after the event has occurred.

(11) In the present invention, the control means included in each device constituting the system is configured to control the information for identifying the event to be embedded in a file storing image data and stored in the storage means. The first device among the devices functions as a master, and the devices other than the first device among the plurality of devices function as slaves, and the first device functions as a slave when receiving information indicating the occurrence of an event. The control means provided in the device functioning as a slave that includes an event distribution unit that distributes information for identifying the event is an image obtained by capturing information identifying the event distributed from the first device by the device functioning as the slave. A system for controlling to embed data in a file to be stored in the storage means may be used.

  In this way, when an event occurs, a plurality of devices constituting the imaging system can embed information for identifying a common event in a file. As a result, it becomes easy to specify the image data stored by the control of each device triggered by the occurrence of a common event. Further, when the information for identifying an event includes information indicating the type of event, file classification is facilitated. Each of a plurality of devices constituting the imaging system may be controlled to store image data in a common storage unit, but may be controlled to store image data in different storage units.

  Here, “distribution” means that the received information may be distributed to other devices as it is, but after the received information is processed (for example, information is modified, changed, or added), the other devices are distributed. You may distribute it. The means for transmitting information to be “distributed” can be wired, but is preferably wireless. Also included are methods of distributing directly and indirectly. For example, a plurality of slaves may be connected in cascade, and information identifying an event supplied from the master and information indicating the occurrence of the event may be sequentially transmitted to the subsequent stage.

(12) In the present invention, the control means of each device constituting the system uses the image data captured by the device as identification information for identifying the device in addition to the information identifying the event distributed from the first device. It may be controlled to embed it in the file to be stored and store it in the storage means.

  The control means of the device functioning as the slave may control the information for identifying the device functioning as the master to be embedded in the file storing the image data and stored in the storage means. In this way, since common information is embedded in files stored by slaves connected to a common master, it becomes possible to easily find an image file that has been taken in response to a common event.

  As identification information for identifying a device, for example, a unique identification number may be assigned to each device in advance, or information that is uniquely assigned in advance such as a MAC address may be used. In addition, it is particularly preferable to set so as not to automatically overlap through communication between the master and the slave at the time of connection.

(13) Preferably, the event distribution unit included in the first device may distribute the information indicating the occurrence of the event to the device functioning as a slave when the control unit receives the information indicating the occurrence of the event. In this way, information indicating the occurrence of an event can be distributed together with information for identifying the event. Since the supply source of the information for identifying the event and the supply source of the information indicating the occurrence of the event are common, it is easy to connect and set each device constituting the system.

(14) In the program of the present invention, the computer may function as any of the above-described devices.

1 is a schematic diagram showing a configuration of an imaging system 1 together with a machine tool 2. FIG. It is a schematic diagram which shows the outline | summary of the operation | movement order when an event generate | occur | produces in the machine tool 2. FIG. 1 is a schematic diagram illustrating an appearance of an imaging apparatus 100. FIG. 2 is a block diagram showing a configuration of the imaging apparatus 100 together with a memory card 200. FIG. It is a figure which shows the relationship between generation | occurrence | production of an event and recording of image data. It is a schematic diagram which shows the outline | summary of the operation | movement order when an event generate | occur | produces with the machine which can output an alarm signal externally. The installation example of the imaging device 100 in 2nd Embodiment of this invention is shown. The installation example of the imaging device 100 in 3rd Embodiment of this invention is shown.

[First Embodiment]
When the production line is just built in the factory, it is necessary to monitor the machine tools that make up the line for various periods of about 3 to 4 months. For example, troubles such as a screw falling on a screw tightening line or a screw falling may occur. We will work to eliminate the causes of such troubles, make the troubles almost zero, and ensure that the product is completed properly. Conventionally, the machine tool is always photographed with a video camera, and if something abnormal happens later from the data recorded by the machine tool, the image taken by the operator is viewed from the beginning. It was. Then, find the part where the abnormality occurred in the recorded video, copy only that part, send it to the headquarters or machine tool manufacturer, and investigate the cause of the trouble and take countermeasures at the headquarters or machine tool manufacturer. I was planning.

  Hereinafter, an imaging system 1 which is a preferred embodiment of the present invention will be described with reference to the drawings. The imaging system 1 of the present embodiment is a system that records an image of the machine tool 2 in order to monitor the work content of the machine tool 2 operating on a production line of a factory. FIG. 1 is a schematic diagram showing the configuration of the imaging system 1 together with the machine tool 2. FIG. 2 is a schematic diagram showing an outline of an operation sequence when an event occurs in the machine tool 2.

  It is assumed that the machine tool 2 to be monitored in this example performs a screw fastening operation on the production line. The machine tool 2 repeatedly executes this screw fastening operation with a predetermined operation time (for example, 30 seconds) as one cycle. The machine tool 2 outputs an alarm signal indicating the occurrence of an abnormality when detecting a failure in the work performed by the machine tool 2 or an abnormality of the device. A transition from a normal state to a state different from the normal state, such as work failure or device abnormality, is called an “event”. The machine tool 2 changes the signal level of the alarm signal from low to high when an event occurs. The alarm signal is input to the rotating lamp 21 as a lighting control signal. The revolving lamp 21 is turned off when the signal level of the alarm signal is low (or a blue light indicating that there is no abnormality), and is turned red when the signal level is high. In addition to changing the alarm signal when an event occurs, the machine tool 2 outputs information (error code) indicating what kind of event has occurred. As the error code, for example, a different code is provided for each type of abnormality such as a screw falling or a screw falling. After outputting the alarm signal, the machine tool 2 stops the operation, eliminates the defective product, restarts the operation, and returns the alarm signal from high to low. The series of processes after the failure detection is completed within the operation cycle in which the failure in the machine tool 2 is detected. In the imaging system 1, the occurrence of an event is detected from a change in the state of an alarm signal, and images before and after the occurrence of the event are taken.

  The imaging system 1 includes three imaging devices ((100-1, 100-2, 100-3), which are collectively referred to as the imaging device 100).

  FIG. 3 is a schematic diagram illustrating an appearance of the imaging apparatus 100, and FIG. 4 is a block diagram illustrating the configuration of the imaging apparatus 100 together with the memory card 200. The imaging apparatus 100 includes a CPU 110, an imaging unit 120, an event input unit 130, an acceleration sensor 140, an event distribution unit 150, a timer unit 170, and a memory card slot 160 inside a substantially cylindrical housing 105. A screw hole is provided at the lower part of the housing 105 for fixing to the shooting location.

  The CPU 110 corresponds to control means of the present invention. The CPU 110 performs various controls according to the control program. The CPU 110 controls driving of the imaging unit 120 and performs control such as image processing and image data accumulation. Further, the CPU 110 receives information related to the event input to the event input unit 130, a sensor signal output from the acceleration sensor 140, and the like, and executes control according to the event.

  The memory card slot 160 is provided at one end of the housing 105 in the longitudinal direction. A memory card 200 corresponding to the storage means of the present invention is inserted into the memory card slot 160. Under the control of the CPU 110, a file storing image data captured by the imaging unit 120 is recorded in the memory card 200. In the file storing the image data, an event occurrence time, a shooting location, and an error code are embedded as information for identifying the event.

  Further, the memory card 200 stores conditions relating to image data recording (for example, image quality, the number of recorded frames, etc.), identification information for identifying the imaging device 100, and a setting file defining master / slave settings described later. Is done. In addition, when the setting as the master is defined, information indicating the shooting location is also defined in the setting file. As information indicating the information indicating the shooting location, identification information indicating the factory where the machine tool is installed and identification information indicating the machine tool shooting in the factory are defined. In this example, it is assumed that conditions necessary for recording described below are defined in the setting file.

  The imaging unit 120 corresponds to the imaging means of the present invention. The imaging unit 120 is provided at the end of the substantially cylindrical casing 105 opposite to the memory card slot 160 with the longitudinal direction of the casing 105 as the optical axis. The imaging unit 120 includes a lens unit 122 and an imaging element 124. The lens unit 122 includes a zoom lens, and can set the angle of view according to the size of the subject to be photographed and the distance to the subject to be imaged. The imaging element 124 is a CCD, a CMOS image sensor, or the like, and acquires an image of a subject to be imaged formed by the lens unit 122 as image data.

  The event input unit 130 is a terminal provided on the side surface of the housing 105 and includes a trigger input terminal 132 and an event identification information input terminal 134. Connected to the trigger input terminal 132 is a wiring branched from a connection line that transmits an alarm signal for turning on the alarm rotating lamp 21 when the machine tool 2 detects a failure in work. The trigger input terminal 132 receives the alarm signal as a trigger signal indicating the occurrence of an event. The trigger signal input to the trigger input terminal 132 is transmitted to the CPU 110 and used as a kind of information indicating the occurrence of an event.

  An error code output terminal of the machine tool 2 is connected to the event identification information input terminal 134 of the imaging apparatus 100 set as the master. The event identification information input terminal 134 of the imaging apparatus 100 set as the master receives an error code generated when the machine tool 2 detects a work failure. The input error code is transmitted to the CPU 110 and used as part of information for identifying the event. The event distribution unit 150 of the imaging device 100 set as the master is connected to the event identification information input terminal 134 of the imaging device 100 set as the slave. The event identification information input terminal 134 of the imaging device 100 set as the slave receives information for identifying the event distributed by the imaging device 100 set as the master. The information for identifying the input event is transmitted to the CPU 110 and used as part of the information for identifying the event in the imaging apparatus 100 set as the slave.

  Since the existing machine tool has a configuration for notifying a person of the occurrence of an event as described above, the imaging apparatus 100 receives the trigger signal and the error code via the event input unit using the configuration. .

  The acceleration sensor 140 detects a vibration, and transitions the sensor signal from a low state to a high state when a vibration having a predetermined intensity or more is detected. The sensor signal is transmitted to the CPU 110. The CPU 110 uses the sensor signal as a kind of information indicating the occurrence of an event.

  The timer unit 170 measures the current time and outputs information on the current time to the CPU 110 in response to a request from the CPU 110. In the CPU 110, the time information acquired from the timer unit 170 is used as a part of information for identifying the event.

  The image signal output terminal 180 is a terminal that outputs an image signal for displaying an image picked up by the image pickup unit 120 on an external monitor. In this embodiment, an HDMI (High-Definition Multimedia Interface, registered trademark) terminal is used. It is done.

  When the imaging device 100 is set to function as a master, the event distribution unit 150 distributes information for identifying an event to other imaging devices 100 that function as slaves. Specifically, under the control of the CPU 110, the event occurrence time measured by the time measuring unit 170 of the imaging device 100 functioning as the master is recorded in the setting file of the memory card 200 inserted in the imaging device 100 functioning as the master. The information indicating the shooting location and the error code are output from the output terminal. A cable for transmitting information for identifying an event to the imaging apparatus 100 functioning as a slave is connected to the output terminal. The output terminal of the event distribution unit 150 has the same structure and pin arrangement as the error code output terminal of the machine tool 2, and the event identification information input terminal 134 of the imaging device 100 that functions as the error code output terminal of the machine tool 2 and the master. And the cable connecting the event distribution unit 150 of the imaging apparatus 100 functioning as a master and the event identification information input terminal 134 of the imaging apparatus 100 functioning as a slave have compatibility.

  Each imaging device 100 configured as described above is installed so as to photograph the machine tool 2 from different directions. Each imaging device 100 is fixed to a structure such as a structure or a tripod around the machine tool 2 to be imaged using a screw hole provided in a lower portion of the housing 105. A pan head is provided between the fixed portion and the imaging apparatus 100, and the photographing direction can be freely changed. Each lens unit 122 provided in each imaging device 100 has its angle of view adjusted so that image data can be recorded with the range in which the cause of the occurrence of the event can be pursued as the imaging range. When adjusting the imaging range, the image signal output terminal 180 of the imaging device 100 and the monitor 3 are connected, and the image captured by the imaging device 100 is displayed as it is on the screen of the monitor 3 (so-called through image display). , Make adjustments while checking the range displayed on the screen. Of the three imaging devices, the imaging device 100-1 is set to function as a master, and the remaining imaging devices 100-2 and 100-3 are set to function as slaves.

  A cable for transmitting an alarm signal from the machine tool 2 is connected to the trigger input terminal 132 of each imaging apparatus 100. With such connection, the three imaging devices 100 constituting the imaging system 1 can receive an alarm signal that is information indicating the occurrence of a common event. In addition, a cable for transmitting an error code from the machine tool 2 is connected to the event identification information input terminal 134 of the imaging device 100-1 that is a master. The event identification information input terminal 134 provided in each of the imaging devices 100-2 and 100-3 that are slaves is connected to a cable that transmits information for identifying an event distributed from the event distribution unit 150 of the imaging device 100-1. The

  Hereinafter, the operation | movement at the time of performing the monitoring function by the specific imaging system 1 is demonstrated. In the following description, the operation of each component is based on the control of the CPU 110 even if not particularly specified.

  FIG. 5 is a diagram showing the relationship between the occurrence of an event and the recording of image data. The imaging unit 120 of each imaging device 100 constituting the imaging system 1 always captures a moving image regardless of whether an event occurs or not, and the memory card 200 inserted in each memory card slot 160 Image data from a predetermined time before to the latest is temporarily stored at a high frame rate (for example, 30 frames per second). Image data for which a predetermined time has elapsed from the time of photographing is thinned out at any time so as to have a low frame rate (for example, one frame per second) and stored in the memory card 200.

  As described above, when a failure occurs in the work performed by the machine tool 2 in the state where the moving image is constantly captured, the machine tool 2 detects this failure and changes the state of the alarm signal from low to high. Let Then, this alarm signal is input to the trigger input terminal 132 of each imaging device 100. As a trigger for detecting a change from low to high in the alarm signal, the CPU 110 triggers the event occurrence time from a predetermined time before the time at which the event occurred (ie, the time at which the change from low to high in the alarm signal was detected). Control is performed to store the high frame rate image data captured by the imaging unit 120 in the memory card 200 until a predetermined time later. Specifically, high frame rate image data (that is, image data from a predetermined time before the event occurrence time to the event occurrence time) temporarily stored in the memory card at the time when the event occurred, and the event High frame rate image data captured during a predetermined time from the time of occurrence is recorded in a file in the memory card 200 without being thinned out.

  An event such as a work error occurs due to a sequence of processes that cause an error, the occurrence of a mistake, the detection of a mistake, and the transmission of information indicating the occurrence of the event (for example, a change in an alarm signal). However, according to the present embodiment, it is possible to confirm the image before the occurrence of the event.

  The above “predetermined time” is one cycle of the operation time of the machine tool 2. In this way, it is possible to store image data including from the start to the end of the cycle in which the event has occurred, regardless of the event generation timing within one cycle of the operation time. Since the image data captured from the start to the end of the cycle including the time when the event occurs can be stored without omission, it is possible to easily check the cause of the work error and the subsequent processing. That is, by confirming the image before the occurrence of the event in the event occurrence cycle, it is possible to grasp the cause of the work mistake. Also, by confirming the image after the occurrence of the event in the cycle in which the event occurred, it is possible to confirm whether the processing after the occurrence of the event has been performed appropriately.

  When a file storing detailed image data captured during a predetermined time from the time when the event occurs is recorded in the memory card 200, the CPU 110 controls to embed information for identifying the event in the file. Information for identifying the event is distributed to the imaging devices 100-2 and 100-3 functioning as slaves by the imaging device 100-1 functioning as a master. As a result, information identifying a common event is embedded in a file recorded by each imaging apparatus 100 when one event occurs, so that file classification and management are facilitated.

  In the example of this embodiment, the information for identifying the event is information indicating the time when the event occurred, information indicating the location where the event occurred, and an error code. The CPU 110 of the imaging device 100-1 functioning as a master acquires the time when the event occurred from the time measuring unit 170 included in the imaging device 100-1. Further, as information indicating the location where the event has occurred, information previously defined in the setting file recorded in the memory card 200 inserted in the imaging apparatus 100-1 is read and used. The error code output from the machine tool 2 is received via the event identification information input terminal 134 and used.

  As a method for embedding information for identifying an event, information for identifying the event is used as part of the file name. By including information for identifying the event in the file name, it is possible to easily grasp the contents of the image data stored in the file without reading the image file into dedicated software. Also, an error code is embedded in the header of the frame when an event in the moving image to be recorded occurs. By searching for a frame in which an error code is embedded during playback, it is possible to quickly confirm an image at the moment when the event occurs. In addition, when a plurality of files recorded in each imaging apparatus 100 are simultaneously played back when one event occurs, synchronization can be achieved by simultaneously playing back frames in which error codes are embedded.

  The CPU 110 of each imaging device 100 constituting the imaging system 1 embeds identification information for identifying the imaging device 100 in addition to information for identifying an event in a file that stores image data captured by the imaging unit 120. Control is performed so that the data is stored in the memory card 200. As the identification information for identifying the imaging device 100, information previously defined in the setting file recorded in the memory card 200 inserted in each imaging device 100 is read and used.

  After a predetermined time has elapsed from the time when the event occurred, the moving image is always captured again, and the image data from the predetermined time to the latest is stored in the memory card 200 inserted in each memory card slot 160. Is temporarily stored at a high frame rate, and image data after a predetermined time has elapsed from the time of shooting is thinned to a low frame rate as needed and stored in the memory card 200. In this way, it is possible to roughly check the content of the image data captured in the time zone when no event occurs, and to check the content of the image data in detail when the event occurs. Further, it is possible to store an image of a time when no event occurs while suppressing the size of a file storing image data.

  As described above, in addition to the case where the machine tool 2 informs the imaging system 1 of the occurrence of an event by an alarm signal, each imaging device 100 constituting the imaging system 1 of the present embodiment is preliminarily provided by the acceleration sensor 140 provided therein. High-frame-rate image data captured by the imaging unit 120 from a predetermined time before the time when the vibration is detected to a predetermined time after the time when the event is detected Is stored in the memory card 200. Storage of image data triggered by detection of vibration is performed only by the imaging device 100 including the acceleration sensor 140 that has detected the vibration, and image data is not stored in other imaging devices 100. As a result, since there is an event in which only the imaging device 100 that has detected the vibration stores the file, it is possible to easily identify the imaging device 100 that may have an abnormality.

  In this way, in addition to the case where an alarm signal is received from the machine tool 2, it is possible to record images before and after the event, assuming that an event has occurred even when a vibration of a predetermined value or more is applied to the apparatus. In a situation where an unexpected vibration such as an impact on the imaging apparatus itself or a change in the shooting direction or an abnormality on the imaging apparatus side is detected, an event can be generated and an image can be recorded. Accordingly, it is possible to easily notice a change in the shooting direction of the camera, correct the shooting direction, and prepare for appropriate shooting when an event such as an abnormality of the machine tool 2 occurs.

  Information identifying an event different from that triggered by an alarm signal from the machine tool 2 is embedded in the file recorded when the acceleration sensor 140 detects the vibration. Specifically, an error code indicating that abnormal vibration has been detected is embedded as information for identifying the event.

  A file that stores image data recorded by each of the three imaging devices 100 in response to the occurrence of a common event has a function of a viewer operating on a computer playing back synchronously. This viewer performs reproduction in synchronization so that frames in which error codes are embedded in the header of each image data are reproduced at the same timing. Further, the time information, the location information, and the error code included in the information for identifying the event are displayed in association with the image being reproduced. Further, when selecting a target file to be reproduced, a plurality of files having common information for identifying an event are displayed in association with each other. This makes it easy to specify a file to be reproduced in synchronization. In addition, the viewer has a function of searching for a file to be played using time information, location information, and an error code as keys. Such a viewer can quickly find a file containing image data taken from multiple directions before and after one event and play it back synchronously, so you can investigate the cause of the event and check the post-processing. It becomes easy.

  According to the imaging system 1 described above, it is possible to eliminate the need to manually input information for identifying an event and identification information of an imaging apparatus. Therefore, when the device arranged at the remote factory stores the images stored at the time of the event to the management department or the like, and the contents of the image are confirmed by the management department, the imaging device 100 takes a picture. On the side of sending the obtained file, a file in which various information is automatically embedded can be sent as it is. In addition, on the side of confirming the sent image, a file in which predetermined information is securely embedded can be handled. Therefore, labor can be reduced on both the transmission side and the reception side. In addition, since the image data captured before and after the occurrence of the event by the plurality of imaging devices 100 can be stored, it is easy to check the situation before and after the occurrence of the event.

In addition, when an event occurs, the plurality of imaging devices 100 configuring the imaging system 1 embeds information for identifying a common event in a file, so that each imaging device 100 stores the information when the common event occurs. The specified image data can be easily identified. In addition, when the information for identifying an event includes information indicating the type of event, file classification and management are facilitated.
[Modification of First Embodiment]

  The present invention is not limited to the first embodiment described above, but includes modifications and improvements as long as the object of the present invention can be achieved.

  For example, in the first embodiment, when the machine tool 2 detects that the work performed by itself has failed, an abnormality of the device, etc., the signal to the rotating lamp 21 connected to the machine tool 2 is branched. Although configured to receive information indicating the occurrence of an event using the machine tool 2, the machine tool 2 is configured to output an alarm signal indicating the occurrence of an abnormality to the outside and use the alarm signal as information indicating the occurrence of an event. May be. Further, when the signal to the rotating lamp 21 is branched and used, for example, the rotating lamp 21 that is lit blue when normal and lit red when an abnormality occurs is used, and a control signal for lighting red. May be used as an alarm signal. In addition, the imaging device 100 may be provided with a light receiving element that detects red light emission, and the red light emission of the rotating lamp 21 may be received as information indicating the occurrence of an event. In addition, a rotating lamp 21 that emits a red warning sound when an abnormality occurs is provided, and a microphone for detecting the warning sound is provided in the imaging apparatus 100 so that the rotating lamp warning sound is received as information indicating the occurrence of an event. May be. Further, the object to be imaged by the imaging apparatus 100 is not limited to a machine tool, and may be various robots and processing machines arranged on a factory line. As an example, FIG. 6 schematically shows an operation sequence when an event occurs in the case where a robot that is arranged on a line for producing a strawberry cake and arranges strawberries on the top surface of the cake is an object to be photographed. The robot is not provided with a rotating light, and is configured to be able to output an alarm signal to the outside when it detects a work failure.

  In the first embodiment, the imaging device 100-1 serving as the master adds information indicating time and information indicating the shooting location to the error code received from the machine tool 2, and sets the slave and The error codes received from the machine tool 2 may be distributed as they are to the slaves.

  In the first embodiment, the means for transmitting the “distributed” information is wired, but may be wireless. In the case of wireless transmission, any wireless communication standard such as WiFi, 3G, Bluetooth (registered trademark) or the like may be used. Further, the method of distributing information is not limited to the method of distributing directly from the master to each slave, but includes a method of distributing indirectly. For example, a plurality of slaves may be cascaded starting from one master, and information identifying an event supplied from the master and information indicating the occurrence of the event may be sequentially transmitted to the subsequent stage. As another example, all the imaging apparatuses 100 may be connected to the network, and information distributed to the network from the master may be broadcast to transmit the information to all the slaves.

  In the first embodiment, the identification information defined in advance in the memory card 200 is used as the identification information for identifying the device, but instead, it is uniquely assigned to each device in advance such as a MAC address. Information may be diverted. Further, when the configuration of the imaging system 1 is set, the identification information may be automatically set through communication between the master and the slave so as not to overlap.

  In addition, the CPU 110 of the imaging device 100 functioning as a slave may control the identification information of the imaging device 100 functioning as a master to be embedded and stored in a file storing image data. In this way, since common information is embedded in files stored by slaves connected to a common master, it becomes possible to easily find an image file that has been taken in response to a common event.

  In the first embodiment, the machine tool 2 and each imaging device 100 are directly connected and information indicating the occurrence of an event (that is, an alarm signal) is transmitted, but the event included in the imaging device 100-1 functioning as a master is provided. The distribution unit 150 may be configured to distribute information indicating the occurrence of the event to the slaves in addition to the information for identifying the event. In this way, information indicating the occurrence of the event can be distributed together with the information for identifying the event, so that the devices constituting the system can be easily connected and set. In this case, the cable for transmitting information for identifying the event and the cable for transmitting information indicating the occurrence of the event may be integrated. In this way, the number of cables used for connection between the master and the slave can be reduced, and connection and setting are facilitated. The cable for transmitting information indicating the occurrence of an event from the master to the slave may be configured to be compatible when an alarm signal is transmitted from the machine tool 2 to the master.

  Alternatively, a serial number from the start of recording may be transmitted together with information indicating the occurrence of a trigger event, and a file of image data recorded by each imaging device 100 may be associated with this serial number. The serial number from the start of recording may be a part of information for identifying an event.

  In the first embodiment, when the acceleration sensor 140 detects a vibration having a predetermined strength or higher, an image is recorded only in the imaging device 100 including the acceleration sensor 140 that detects the vibration. Information indicating the occurrence of an event may be transmitted to the image capturing apparatus 100 so that another image capturing apparatus 100 records an image. In order to distribute information indicating the occurrence of an event from an arbitrary imaging apparatus 100 to other imaging apparatuses 100, information indicating the occurrence of an event is individually transmitted from the distribution source imaging apparatus to each of the other imaging apparatuses. However, for example, all the imaging devices 100 may be connected to the network, and information indicating the occurrence of an event may be broadcast from the distribution-source imaging device 100 to the network. As a result, information indicating the occurrence of an event can be transmitted to all the imaging devices 100 at substantially the same timing.

  In the first embodiment, the imaging unit 120 captures a moving image as an image. However, for example, a still image may be captured. The image may be a 2D image or a 3D image, for example. Further, it may be a black and white image or a color image. The lens unit included in the imaging unit 120 may be a short focus lens instead of a zoom lens.

  In the first embodiment, the memory card 200 inserted into the memory card slot 160 is used as the storage means, but other storage devices such as a hard disk drive may be used instead of the memory card. Further, the storage means is not limited to a detachable one, and may be built in the housing 105 in a form that cannot be detached. In the first embodiment, the memory card 200 inserted into the memory card slot 160 included in each imaging device 100 is used as the storage unit. However, the plurality of imaging devices 100 share a common storage unit (for example, a hard disk drive or a communication network). The image data may be stored in a storage area provided above. However, the best configuration is to store each image capturing apparatus 100 described above. In particular, when the production line is just built in the factory, it can be easily attached by screwing without a large system in case of temporary monitoring such as when monitoring troubles for a period of about 3 to 4 months. Can be stored in each imaging device. Moreover, not only in the case of temporary installation, but also when the occurrence of events does not occur frequently, the situation at the time of abnormality of the machine tool can be easily photographed without carrying out a large-scale system construction or the like.

  In the above-described first embodiment, the moving image is always captured. However, the operation start signal is received at the start of one cycle of operation, and video recording is started when the operation start signal is received. It is good also as a structure. For example, when an operation end signal is received at the end of one cycle of operation, the image data corresponding to the cycle is recorded when the operation end signal is received without receiving a signal indicating the occurrence of the event from the outside. It is good also as a structure which does not. For example, when a signal indicating the occurrence of an event is received from the outside, it may be configured to perform a process of extending the recording of image data at least for the recovery time due to the occurrence of the event.

  In the first embodiment, the image data picked up by the image pickup unit 120 is temporarily stored in the memory card 200 for a predetermined time. However, the image data is temporarily stored in a storage element such as an SDRAM built in the image pickup apparatus 100. The image data having a high frame rate when an event occurs and the image data having a low frame rate when no event occurs may be finally recorded in the memory card 200.

  In the first embodiment, when an event occurs, an image with a high frame rate from a predetermined time before to a predetermined time after the event occurrence time is recorded, but the predetermined time is a recording time before the event occurrence and a recording time after the event occurrence. May be different, so that the user can freely set the time. For example, when the machine tool 2 takes a longer time than one cycle of normal operation for the processing after the event occurrence, the recording time after the event occurrence may be made longer. In this way, the cause of the occurrence of the event and the confirmation of the post processing can be performed more reliably.

  In the first embodiment, the information for identifying the event is embedded in the file by using it as a part of the file name, but can be embedded by other methods. For example, information for identifying an event may be embedded in the image as a watermark. In this way, it is possible to embed information for identifying an event without increasing the size of the file and without visually affecting the image. Further, it is possible to make it difficult to falsify information for identifying an event. As another example, information for identifying an event may be embedded as characters superimposed on an image. As yet another example, information for identifying an event may be embedded as additional information in a file storing data. The “additional information” refers to information other than the image itself, such as a header and a footer, among files storing image data.

  In the first embodiment, information identifying three events, that is, information indicating the time when the event occurred, information indicating the location where the event occurred, and information identifying the event including the error code are stored in the file. For example, information identifying the first event (for example, information indicating the time when the event occurred) is used for at least a part of the file name, and the second event ( For example, information identifying the location where the event occurred) is embedded in the image as a watermark, and information identifying the third event (for example, an error code) is embedded in the file storing the image data as additional information. Good. For example, the information for identifying the first to third events may be the same information, but in particular, it may be configured to include different information. In particular, these may be completely different information, but in particular, some information may include the same information. In this way, the user can easily visually recognize the same information from the file name, make it difficult to tamper with, or detect tampering by comparing information identifying the first to third events. Can be easily done. In particular, it may be configured to store the same information as part of information in different expression formats. For example, the information used for the file name includes the location code, date and time of the event that can identify the location by a person who consists of, for example, an alphanumeric string that uniquely identifies the location and date and time where the event occurred. While the event code, which is a code indicating the contents, is used as character string information arranged in this order, as additional information and watermark, the character string indicating the name of the place corresponding to the place code and the event corresponding to the event code are specified. It is recommended to store character strings with typical contents.

  In the first embodiment, the file is configured so that one frame has an event in the moving image of one file. However, a plurality of frames in which an event has occurred is included in the moving image of one file. May be.

  In the first embodiment, a high frame rate image is recorded from a predetermined time before the event occurrence time to a predetermined time after the event occurrence time, and a low frame rate image is recorded at other times. Images may not be recorded at other times. Also, from a predetermined time before to a predetermined time after the event occurrence time, a color image is formed that lowers (or does not compress) the compression rate of the image file and increases the image file quality (for example, HD (High Defintion) image). Images with a large amount of information are recorded by other means, and at other times, the amount of information is reduced by increasing the compression rate of the image file, lowering the image file quality (for example, VGA image), and making it a black and white image. May be.

  In the first embodiment, the example in which the viewer as the reproduction unit is provided as software executed on a computer separate from the imaging apparatus 100 has been described. Reproduction means for reproducing and displaying the processed image data may be provided integrally.

[Second Embodiment]
FIG. 7 shows an installation example of the imaging apparatus 100 in the second embodiment of the present invention. In the present embodiment, the imaging apparatus 100 is arranged on a table in a work place and monitors the table. For example, when a worker disappears from a lunch break workplace, tools placed on the table are monitored. In the present embodiment, the imaging apparatus 100 operates using electric power supplied from a battery used for an electric tool or the like. The imaging apparatus 100 of this example receives a sensor signal indicating abnormal vibration output from an internal acceleration sensor and a trigger signal from an external sensor as information indicating the occurrence of an event, and acquires image data captured before and after the occurrence of the event. Record.

[Third Embodiment]
FIG. 8 shows an installation example of the imaging apparatus 100 in the third embodiment of the present invention. In the present embodiment, the imaging device 100 is attached to the frame at the rear of the cab of the forklift and photographs the front. The imaging range is set so as to include the area in front of the driver's cab and the forklift, particularly the fork. The imaging apparatus 100 of this example is provided with a screw hole for attachment on the upper surface of the housing, and is configured so that the imaging apparatus 100 can be hung from the top. The imaging apparatus 100 according to the present embodiment includes a temperature measurement unit. When the forklift goes in and out of a freezer or the like, the imaging unit becomes cloudy. To prevent this, only when the temperature measuring means detects a low temperature, heating is performed with a heating wire and a thermostat to prevent fogging. Further, the fact that the temperature measurement means detects a sudden change in temperature (for example, a temperature change accompanying entering / exiting from the freezer) is treated as an event, and the captured image data is recorded.

DESCRIPTION OF SYMBOLS 1 Imaging system 2 Machine tool 3 Monitor 100 Imaging device 105 Case 110 CPU
120 Imaging Unit 130 Event Input Unit 140 Acceleration Sensor 150 Event Distribution Unit 160 Memory Card Slot 170 Timekeeping Unit 200 Memory Card

Claims (14)

  An apparatus comprising control means for controlling the storage means to store image data picked up by the image pickup means at least at a predetermined time before and after the time when the event occurred, triggered by receiving information indicating the occurrence of the event from the outside .   The apparatus according to claim 1, wherein the control unit performs control so that information for identifying an event is embedded in a file storing image data and stored in the storage unit. The control means controls to store information for identifying the event using at least a part of the name of the file.
Control to embed information identifying the event as a watermark in the image captured by the imaging means;
Control to embed information identifying the event as additional information in a file storing image data;
The apparatus according to claim 2, wherein at least one of the controls is performed. The image data captured by the imaging means is a moving image composed of a plurality of frames,
The apparatus according to claim 2, wherein the control unit performs control so that information identifying an event is embedded and stored in a frame captured when the event occurs.   6. The information for identifying an event includes at least one of information indicating a time when the event has occurred, information indicating a place where the event has occurred, and information indicating the type of the event. The apparatus of any one of these.   The imaging object repeats an operation with a predetermined operation time as one cycle, and the predetermined time includes at least a start time of an operation time in an event occurrence cycle to an event occurrence. The apparatus according to any one of 2 to 5.   The apparatus according to claim 6, wherein the predetermined time is one period of operating time before and after the time when information indicating the occurrence of an event is received.   The control means controls the storage means to store the image data at a time other than the predetermined time before and after the time when the information indicating the occurrence of the event is received, with a lower amount of information than at the predetermined time. The apparatus according to any one of claims 1 to 7.   9. The apparatus according to claim 1, further comprising a vibration detection unit that detects vibration and transmits information indicating the occurrence of an event to the control unit when vibration of a predetermined value or more is detected. The device described.   A system configured to include the apparatus according to claim 1, wherein a plurality of apparatuses configuring the system are configured to be able to receive information indicating occurrence of a common event. A system characterized by that. The control means included in each device constituting the system is configured to control to embed information for identifying an event in a file storing image data and store the information in the storage means.
A first device of the plurality of devices functions as a master, and a plurality of devices other than the first device function as slaves,
The first device includes an event distribution unit that distributes information for identifying the event to a device functioning as a slave when information indicating the occurrence of the event is received,
The control means provided in the device functioning as the slave embeds information for identifying the event distributed from the first device in a file storing image data captured by the device functioning as the slave and stores the information in the storage means. The system according to claim 10, wherein the control is performed as follows.   The control means of each device constituting the system embeds identification information for identifying the device in addition to the information for identifying the event distributed from the first device, and embeds it in a file storing image data captured by the device. 12. The system according to claim 11, wherein the system is controlled to store in the means.   The event distribution unit included in the first device distributes information indicating the occurrence of an event to a device functioning as a slave when the control means receives information indicating the occurrence of the event. The system according to 11 or 12.   A program that causes a computer to function as the apparatus according to any one of claims 1 to 9.