JP7055394B2 - Systems and programs - Google Patents

Description

The present invention relates to an apparatus, a system including the apparatus, a program, and the like.

A surveillance camera having a lens unit and storing the image pickup data captured by the lens unit in a detachable storage medium has been proposed (see, for example, Patent Document 1).

Japanese Unexamined Patent Publication No. 2013-197902

Normally, with such a surveillance camera, the object to be monitored is constantly imaged, so a long-time video is played back from the beginning in order to check the shooting content in the event of an abnormality, and the problematic scene is captured by fast-forwarding. I had to look for and confirm. Therefore, it took a lot of time for the confirmation work.

Therefore, an object of the present invention is to provide an apparatus or the like capable of acquiring image data capable of easily confirming the shooting contents before and after an event occurs. This object is achieved, for example, by combining the features described in the independent section in the claims. Dependent terms also specify, for example, further advantageous embodiments of the present invention.

(1) In order to solve the above problems, in the present invention, the image data captured by the imaging means at least at a predetermined time before and after the time when the event occurs, triggered by receiving information indicating the occurrence of the event from the outside. It is preferable to use a device provided with a control means for controlling the storage of the data.

By doing so, since the image data captured by the imaging means before and after the event occurs can be stored, it becomes easy to confirm the contents of the images captured before and after the time when the event occurs. For example, in order to confirm an image, it is preferable to provide a reproduction means for reproducing the stored image data so that the user can see it. The regenerating means may be provided integrally with the control means, or may be provided as a separate body. Further, in the present invention, it is preferable to provide an image pickup means together with the control means. The image pickup means may perform image capture at all times regardless of the presence or absence of an event, and temporarily store image data over a predetermined time. Then, when the control means receives the information indicating the occurrence of the event, the control means may control the storage means to store the image data captured at a predetermined time before and after that. Further, in the present invention, the storage means may be built in a device provided with the control means, but may be detachably provided in the device, for example, in the form of a memory card, a hard disk drive, or the like.

The "event" may be, for example, generated when an abnormality occurs. For example, it is often considered as various events, especially caused by work failure in a machine tool operating on a factory production line, unusual vibration detected by the device, change in the state detected by an external sensor, or an abnormality. It is good to do.

The "information indicating the occurrence of an event" may be, for example, information indicating a change in state or the occurrence of an abnormality. Specifically, for example, the information generated when the machine tool detects a work failure may be referred to as "information indicating the occurrence of an event". In particular, the alarm signal may be "information indicating the occurrence of an event". It is particularly preferable that the alarm signal generated when the machine tool detects a work failure is "information indicating the occurrence of an event". Further, for example, a signal from a rotating light connected to the machine tool (for example, a status signal indicating that the rotating light is lit) may be used as "information indicating the occurrence of an event". Further, the "information indicating the occurrence of an event" may be a signal generated by an external device. The device may be configured to include a trigger receiving means that receives these signals as trigger signals. Then, the control means may perform control to store the image data captured by the image pickup means in the storage means, triggered by the change in the state of the trigger signal. In addition, "information indicating the occurrence of an event" is not limited to information received from the outside, but "information indicating the occurrence of an event" is transmitted by detecting the occurrence of an event inside the device, and "event" generated inside the device. It may be provided with a configuration for receiving "information indicating the occurrence of".

The "time when the event occurred" may be, for example, the time immediately after receiving information indicating the occurrence of the event from the outside.

The "image data" may be captured in a range in which the cause of the occurrence of the event can be investigated.

The "image" may be, for example, a still image, but may be particularly a moving image. Further, the image may be, for example, a 2D image or a 3D image. For example, it may be a black-and-white image or a color image.

(2) Preferably, in the present invention, the control means may control the information for identifying the event to be embedded in a file for storing the image data and stored in the storage means. By doing so, it is possible to extract the information that identifies the event from the file that stores the image data. Therefore, it is possible to obtain the event identification information only by exchanging the file for storing the image data without exchanging the file containing the event identification information separately from the image data. For example, if a device located in a remote factory sends images stored at the time of an event to the management department, etc., and the management department confirms the contents of the images, a lot of related files are sent. It takes a lot of effort to send them all together, and even on the receiving side, it takes a lot of effort to distinguish and manage a set of files. In such a case, if the above configuration is used, it is possible to eliminate the need to manually input the information for identifying the event, or the file for recording the information for identifying the event and the image data are recorded. Reduces labor on both the sending side and the sending image side of the file captured by the device, such as checking the correspondence with the file on both the transmitting side and the receiving side. can do.

(3-1) For example, the control means may control the event identification information to be used and stored in at least a part of the file name. By doing so, it is possible to grasp the content of the information that identifies the event from the file name without opening the file. For example, it is possible to grasp the contents of the file simply by displaying the file name without performing time-consuming work such as extracting and displaying information for identifying an event or image data from the file. (3-2) As another example, the control means may control the information for identifying the event to be embedded as a watermark in the image captured by the image pickup means. In this way, it is possible to make it difficult to falsify the information that identifies the event. In particular, it is preferable to embed information for identifying the event without increasing the size of the file and without having a visible effect on the image. (3-3) As yet another example, the control means may control the information for identifying the event to be embedded as additional information in the file for storing the image data. In this way, information that identifies the event can be embedded without having a visible effect on the image. The "additional information" refers to information other than the image itself, such as a header and a footer, among the files for storing the image data. Of course, for example, the configurations (3-1) to (3-3) can be arbitrarily combined. In particular, it is desirable to have a configuration including any two of (3-1) to (3-3), and most preferably, for example, the configuration of (3-1), the configuration of (3-2), and (3-3). It is preferable to have the configuration of. For example, the information that identifies the first event is used as at least a part of the file name, the information that identifies the second event is embedded as a watermark in the image, and the information that identifies the third event is image data as additional information. It is recommended to embed it in the file that stores. For example, the information for identifying the first to third events may be the same information, but in particular, it may be configured to include different information. In particular, these may be completely different information, but it is particularly preferable that the same information is included for some information. By doing so, the user can easily see the same information from the file name, make it difficult to be tampered with, and detect tampering by comparing the information that identifies the first to third events. Can be done easily. In particular, it is preferable to store the same information as information in different expression formats for some information. For example, the information used for the file name is the location code, date and time, and event that can be identified by a person, for example, an alphanumerical string that uniquely corresponds to the location and the date and time when the event occurred. While the event code, which is the code indicating the content, is used as the character string information arranged in this order, the additional information and the watermark include the character string indicating the name of the place corresponding to the place code and the specific event corresponding to the event code. It is advisable to store a character string with similar contents.

(4) When the image data is a moving image composed of a plurality of frames, the control means may control to embed and store the information identifying the event in the frame captured when the event occurs. .. By doing so, it becomes easy to identify the frame when the event occurs, and it is possible to easily confirm the images before and after the event. In addition, the event that occurred in the frame can be identified from the information that identifies the event. In particular, it is preferable to include information for identifying the type of event as information for identifying the event. In this way, the frame in which the event of that type occurs can be extracted from the moving image. The file may be configured so that the frame in which the event occurs is one in the moving image of one file, but it is preferable to include a plurality of frames in which the event occurs in the moving image of one file. With this configuration, the frame in which the event occurred in the video file can be easily identified from the information that identifies the type of event, and there is no need to check the entire video by fast-forwarding, which is a remarkable effect. Play.

(5-1) Preferably, in the present invention, the information for identifying the event may include information indicating the time when the event occurred. By doing this, it is possible to identify the time when the event occurred externally from the received file. Therefore, there is no need to exchange a file containing information indicating the time when the event occurred separately, and a file containing information indicating the time when the event occurred and a file containing image data can be passed separately, and the correspondence between the two can be exchanged. There is no need to check each time. (5-2) Further, the information for identifying the event may include information indicating the place where the event has occurred. In this way, the location where the event occurred can be identified from the received file. Therefore, there is no need to separately exchange a file containing information indicating the location where the event occurred, and a file containing information indicating the location where the event occurred and a file containing image data can be passed separately, and the correspondence between the two can be exchanged. There is no need to check each time. As the information indicating the place where the event occurred, for example, the information indicating the factory where the machine tool is installed or the information indicating the line where the machine tool being photographed at the factory is installed may be used. In addition, it is particularly preferable that the information indicating the place where the event occurs includes the information indicating the country or region. In this way, it is easy to collect video data at the time of abnormality of different manufacturing equipment of multiple different manufacturing lines of factories in various regions of various countries at the head office / headquarters and examine the cause etc. Can be done. (5-3) Further, the information for identifying the event may include information indicating the type of the event. In this way, the type of event that occurred can be identified from the received file. Therefore, there is no need to exchange a file containing information indicating the type of event separately, and a file containing information indicating the type of event and a file containing image data can be passed separately, and the correspondence between the two can be checked one by one. You don't even have to. For example, when the control means receives an alarm signal indicating the occurrence of an abnormality from the machine tool as an event, the "information indicating the type of event" may be an error code indicating the type of abnormality. In addition, the information that identifies the event may be a serial number indicating the order in which the events have occurred since the start of recording. Of course, for example, the configurations (5-1) to (5-3) can be arbitrarily combined. In particular, it is desirable to have a configuration including any two of (5-1) to (5-3), and most preferably, for example, the configuration of (5-1), the configuration of (5-2), and (5-3). It is preferable to have the configuration of. More details about the event from the received file by including the information that identifies the event at least two, preferably all, when the event occurred, where the event occurred, and where the event occurred. You can get multifaceted information with. In addition, it becomes easy to classify a large number of files in which images at the time of event occurrence are recorded according to the place where the event occurred, the time when the event occurred, and the type of the event, and it becomes easy to examine and investigate the cause of the event occurrence. ..

(6) The imaging target repeats the operation with a predetermined operation time as one cycle, and the predetermined time may include at least from the start time of the operation time in the cycle in which the event occurs to the occurrence of the event. By doing so, it is possible to reproduce and confirm the image data stored in the operation from the disclosure time of the operation of one cycle including the time when the event occurs to the event occurrence. Therefore, it becomes easy to check and identify the image data by tracing back the cause of the event occurrence in that cycle, and it is possible to prevent recording unrelated to the occurrence of the event, so that the time required for checking the image data is shortened. can do. For example, when the object to be photographed is a machine tool that repeats the operation with a predetermined operation time as one cycle, when an event such as a work error of the machine tool occurs, the event starts from the start time of the operation time in the cycle in which the event occurs. Since the image data taken up to the occurrence of the above is stored, it is possible to easily investigate the cause of the work error. The predetermined time may be configured to "include at least from the start time of the operation time in the cycle in which the event occurred to the occurrence of the event", and in particular, "the time for one cycle including the time when the event occurred". It is good to say. By doing so, it is possible to easily investigate the cause of the work error. Further, as another configuration, the predetermined time may be, in particular, the time from the start time of the operation time in the cycle in which the event occurs to the occurrence of the event. For example, it is preferable to have a configuration in which an operation start signal is received at the start of one cycle of operation, and a configuration in which video recording is started when the operation start signal is received.

(7) Further, it is more preferable that the predetermined time is one cycle of the operating time before and after the time when the information indicating the occurrence of the event is received. By doing so, it is possible to store the image data including the period from the start to the end of the cycle in which the event occurs, regardless of the event occurrence timing within one unit of the operation time. For example, when an event such as a machine tool work error occurs in a machine tool that repeats operation with a predetermined operation time as one cycle, image data taken from the start to the end of the cycle including the time when the event occurred is captured. It can be memorized without omission, and it is possible to easily confirm the cause of the work error and the subsequent processing. Further, for example, the operation end signal is received at the end of one cycle of operation, and when the operation end signal is received without receiving the signal indicating the occurrence of the event from the outside, the image data corresponding to the cycle is obtained. It is recommended that the configuration is not recorded. By doing so, it is possible to reduce the storage capacity and save the trouble of checking the image data of the scene where the event has not occurred. Further, for example, when a signal indicating the occurrence of the event is received from the outside, it is advisable to perform a process of extending the recording of the image data by at least the time of recovery due to the occurrence of the event. By doing so, it is possible to record the recovery process as well in a device or the like that performs recovery processing when an event occurs.

(8) Preferably, the control means controls the storage means to store the image data at a time other than the predetermined time before and after the time when the information indicating the occurrence of the event is received, with a lower amount of information than at the predetermined time. good. By doing so, the contents of the image data captured during the time when the event does not occur can be roughly confirmed, and the contents of the image data can be confirmed in detail when the event occurs. Further, it is possible to store the image at the time when the event does not occur while suppressing the size of the file for storing the image data.

"Storing image data with a low amount of information" is particularly preferable, for example, when the frame rate of a moving image is lowered and stored. In addition, the image file may be compressed, the image quality of the image file may be deteriorated, a color image may be stored when an event occurs, and a black-and-white image may be stored at other times.

(9) Preferably, the apparatus of the present invention further includes a vibration detecting means that detects vibration and transmits information indicating the occurrence of an event to the control means when vibration of a predetermined value or more is detected. By doing so, it is possible to record the images before and after the event as if the event occurred even when the vibration of a predetermined value or more is applied to the device, except when the information indicating the occurrence of the event is received from the outside. can. For example, when a machine tool error is received as an event and the machine tool is being photographed, unexpected vibrations such as an impact applied to the device itself or the shooting direction being changed are detected. In the situation, the event can be generated by itself and the image can be recorded.

(10) Further, the present invention is a system configured to include a plurality of the devices according to any one of (1) to (13) described above, and the plurality of devices constituting the system generate a common event. Is configured to be receivable. By doing so, it is possible to store the image data captured before and after the event occurs by the plurality of devices, so that it becomes easy to confirm the situation before and after the event occurs.

(11) In the present invention, the control means included in each device constituting the system is configured to embed information for identifying an event in a file for storing image data and control the storage means to store the information. The first device among the devices functions as a master, the devices other than the first device among a plurality of devices function as slaves, and the first device becomes a device that functions as a slave when information indicating the occurrence of an event is received. The control means provided in the device that functions as a slave and has an event distribution unit that distributes the information that identifies the event is an image captured by the device that functions as the slave with the information that identifies the event distributed from the first device. It is preferable to use a system that controls information by embedding it in a file that stores data and storing it in a storage means.

In this way, when an event occurs, a plurality of devices constituting the imaging system can embed information for identifying a common event in the file. As a result, it becomes easy to specify the image data stored by the control of each device when a common event occurs. Further, when the information for identifying the event includes the information indicating the type of the event, the files can be easily classified. Each of the plurality of devices constituting the image pickup system may be controlled to store the image data in a common storage means, but may be controlled to store the image data in different storage means.

Here, "distribution" means that the received information may be distributed separately to other devices as it is, but the received information may be processed (for example, the information may be modified, changed, or added) and then divided into other devices. You may distribute it. Wired can be used as a means of transmitting "distributed" information, but wireless is preferable. It also includes methods of direct and indirect distribution. For example, a plurality of slaves may be connected in multiple stages, and information for identifying an event supplied from the master or information indicating the occurrence of an event may be sequentially transmitted to the subsequent stage.

(12) In the present invention, the control means of each device constituting the system receives the image data captured by the device as the identification information for identifying the device in addition to the information for identifying the event distributed from the first device. It is advisable to control it so that it is embedded in the file to be stored and stored in the storage means.

It is preferable that the control means of the device functioning as a slave is controlled so that the information for identifying the device functioning as the master is embedded in a file for storing the image data and stored in the storage means. By doing so, since common information is embedded in the files stored by the slaves connected to the common master, it becomes possible to easily find the image file taken by the common event.

As the identification information for identifying the device, for example, a unique identification number may be assigned to each device in advance, or information uniquely assigned in advance such as a MAC address may be diverted. In addition, it is particularly preferable to set it so that it does not automatically overlap through communication between the master and the slave at the time of connection.

(13) It is preferable that the event distribution unit included in the first device distributes the information indicating the occurrence of the event to the device functioning as a slave when the control means receives the information indicating the occurrence of the event. In this way, the information indicating the occurrence of the event can be distributed together with the information identifying the event. Since the source of the information that identifies the event and the source of the information that indicates the occurrence of the event are common, it is easy to connect and set each device constituting the system.

(14) In the program of the present invention, the computer may function as any of the above-mentioned devices.

It is a schematic diagram which shows the structure of the image pickup system 1 together with the machine tool 2. It is a schematic diagram which shows the outline of the operation order when an event occurs in a machine tool 2. It is a schematic diagram which shows the appearance of the image pickup apparatus 100. It is a block diagram which shows the structure of the image pickup apparatus 100 together with the memory card 200. It is a figure which shows the relationship between the occurrence of an event, and the recording of image data. It is a schematic diagram which shows the outline of the operation order when an event occurs in the machine which can output an alarm signal externally. An installation example of the image pickup apparatus 100 in the second embodiment of the present invention is shown. An installation example of the image pickup apparatus 100 in the third embodiment of the present invention is shown.

[First Embodiment]
When the production line is just built in the factory, it is necessary to monitor it for a period of about 3 to 4 months because the machine tools that make up the line cause various troubles. For example, troubles such as a screw falling or a screw falling may occur at the screw tightening line. We will carry out activities to eliminate the causes of such troubles, eliminate troubles to almost zero, and ensure that products are properly completed. In the past, a video camera was used to constantly shoot a machine tool, and if something went wrong with the data recorded by the machine tool later, the video taken by the worker would be viewed from the beginning. Was there. Then, the part where the abnormality occurred is searched from the recorded video, only that part is copied and sent to the manufacturer of the headquarters or machine tool, and the cause of the trouble is investigated and countermeasures are taken by the manufacturer of the headquarters or machine tool. I was planning etc.

Hereinafter, the imaging system 1 which is a preferred embodiment of the present invention will be described with reference to the drawings. The image pickup system 1 of the present embodiment is a system that records an image of the machine tool 2 in order to monitor the work contents of the machine tool 2 operating on the production line of the factory. FIG. 1 is a schematic diagram showing the configuration of the image pickup system 1 together with the machine tool 2. FIG. 2 is a schematic diagram showing an outline of the operation order when an event occurs in the machine tool 2.

The machine tool 2 to be monitored in this example shall perform screw tightening work on the production line. The machine tool 2 repeatedly executes this screw tightening operation with a predetermined operation time (for example, 30 seconds) as one cycle. The machine tool 2 outputs an alarm signal indicating the occurrence of an abnormality when it detects that the work performed by itself has failed, an abnormality of the equipment, or the like. The transition from a normal state to a state different from the normal state, such as work failure or equipment abnormality, is called an "event". The machine tool 2 changes the signal level of the alarm signal from low to high when an event occurs. The alarm signal is input to the rotary lamp 21 as a lighting control signal. When the signal level of the alarm signal is low, the rotary lamp 21 is turned off (or is lit in blue indicating that there is no abnormality), and when it is high, it is lit in red indicating that there is an abnormality. In addition to changing the alarm signal when an event occurs, the machine tool 2 outputs information (error code) indicating what kind of event has occurred. As the error code, a different code is provided for each type of abnormality such as that the screw has fallen or that the screw has fallen. After outputting the alarm signal, the machine tool 2 stops the work, eliminates defective products, restarts the work, and returns the alarm signal from high to low. It is assumed that the series of processes after the failure detection is completed within the operation cycle in which the failure in the machine tool 2 is detected. The image pickup system 1 detects the occurrence of an event from the change in the state of the alarm signal, and captures images before and after the occurrence of the event.

The image pickup system 1 is composed of three image pickup devices ((100-1, 100-2, 100-3), which are collectively referred to as an image pickup device 100).

FIG. 3 is a schematic view showing the appearance of the image pickup apparatus 100, and FIG. 4 is a block diagram showing the configuration of the image pickup apparatus 100 together with the memory card 200. The image pickup apparatus 100 includes a CPU 110, an image pickup unit 120, an event input unit 130, an acceleration sensor 140, an event distribution unit 150, a timekeeping unit 170, and a memory card slot 160 inside a substantially cylindrical housing 105. At the lower part of the housing 105, a screw hole for fixing to the photographing place is provided.

The CPU 110 corresponds to the control means of the present invention. The CPU 110 performs various controls according to the control program. The CPU 110 controls the drive of the image pickup unit 120, and controls image processing, image data storage, and the like. Further, the CPU 110 receives information about an event input to the event input unit 130, a sensor signal output by the acceleration sensor 140, and the like, and executes control according to the event.

The memory card slot 160 is provided at one end of the housing 105 in the longitudinal direction. A memory card 200 corresponding to the storage means of the present invention is inserted into the memory card slot 160. According to the control of the CPU 110, a file storing the image data captured by the image pickup unit 120 is recorded in the memory card 200. The event occurrence time, shooting location, and error code are embedded in the file that stores the image data as information for identifying the event.

Further, the memory card 200 stores a setting file that defines conditions related to recording image data (for example, image quality, number of recorded frames, etc.), identification information for identifying the image pickup apparatus 100, and master / slave settings described later. Will be done. When the setting as a master is defined, the information indicating the shooting location is also defined in the setting file. As the information indicating the shooting location, the identification information indicating the factory where the machine tool is installed and the identification information indicating the machine tool being photographed at the factory are defined. In this example, it is assumed that the conditions necessary for recording described below are defined in the configuration file.

The image pickup unit 120 corresponds to the image pickup means of the present invention. The image pickup unit 120 is provided at the end of the substantially cylindrical housing 105 on the opposite side of the memory card slot 160, with the longitudinal direction of the housing 105 as the optical axis. The image pickup unit 120 is composed of a lens unit 122 and an image pickup element 124. The lens unit 122 is provided with a zoom lens, and the angle of view can be set according to the size of the object to be photographed and the distance to the object to be imaged. The image pickup element 124 is a CCD, a CMOS image sensor, or the like, and acquires an image of an image to be imaged formed by the lens unit 122 as image data.

The event input unit 130 is a terminal provided on the side surface of the housing 105, and includes a trigger input terminal 132 and an event identification information input terminal 134. The trigger input terminal 132 is connected to a wiring branched from a connection line for transmitting an alarm signal for turning on the alarm rotation light 21 when the machine tool 2 detects a work failure. The trigger input terminal 132 receives an alarm signal as a trigger signal indicating the occurrence of an event. The trigger signal input to the trigger input terminal 132 is transmitted to the CPU 110 and used as a kind of information indicating the occurrence of an event.

An error code output terminal of the machine tool 2 is connected to the event identification information input terminal 134 of the image pickup apparatus 100 set in the master. The event identification information input terminal 134 of the image pickup apparatus 100 set in the master receives an error code generated when the machine tool 2 detects a work failure. The input error code is transmitted to the CPU 110 and used as a part of the information for identifying the event. Further, the event distribution unit 150 of the image pickup device 100 set in the master is connected to the event identification information input terminal 134 of the image pickup device 100 set in the slave. The event identification information input terminal 134 of the image pickup apparatus 100 set as the slave receives the information for identifying the event to be distributed by the image pickup apparatus 100 set in the master. The input information for identifying the event is transmitted to the CPU 110 and used as a part of the information for identifying the event in the image pickup apparatus 100 set in the slave.

Since the existing machine tool is provided with a configuration for notifying a person of the occurrence of an event as described above, the image pickup apparatus 100 uses the configuration to receive a trigger signal and an error code via the event input unit. ..

The accelerometer 140 detects vibration, and when it detects vibration of a preset intensity or higher, it shifts the sensor signal from the low state to the high state. The sensor signal is transmitted to the CPU 110. The CPU 110 uses the sensor signal as a kind of information indicating the occurrence of an event.

The timekeeping unit 170 clocks the current time and outputs the current time information to the CPU 110 in response to a request from the CPU 110. The CPU 110 uses the time information acquired from the timekeeping unit 170 as a part of the information for identifying the event.

The image signal output terminal 180 is a terminal that outputs an image signal for displaying an image captured by the image pickup unit 120 on an external monitor, and is used by an HDMI (High-Definition Multimedia Interface, registered trademark) terminal in this embodiment. Be done.

When the image pickup device 100 is set to function as a master, the event distribution unit 150 distributes information identifying an event to another image pickup device 100 that functions as a slave. Specifically, under the control of the CPU 110, the event occurrence time measured by the time measuring unit 170 of the image pickup device 100 functioning as the master is recorded in the setting file of the memory card 200 inserted in the image pickup device 100 functioning as the master. Information indicating the shooting location and the error code are output from the output terminal. A cable for transmitting information for identifying an event is connected to the image pickup device 100 that functions as a slave to the output terminal. The output terminal of the event distribution unit 150 has the same structure and pin arrangement as the error code output terminal of the machine tool 2, and has the error code output terminal of the machine tool 2 and the event identification information input terminal 134 of the image pickup apparatus 100 that functions as a master. The cable connecting the above and the event distribution unit 150 of the image pickup apparatus 100 functioning as a master and the event identification information input terminal 134 of the image pickup apparatus 100 functioning as a slave are compatible with each other.

Each image pickup apparatus 100 configured as described above is installed so as to photograph the machine tool 2 from different directions. Each image pickup device 100 is fixed to a structure around the machine tool 2 to be photographed or a frame such as a tripod by using a screw hole provided in the lower part of the housing 105. A pan head is provided between the fixed portion and the image pickup apparatus 100, and the shooting direction can be freely changed. The angle of view of the lens unit 122 provided by each image pickup device 100 is adjusted so that image data can be recorded with a range in which the cause of the occurrence of an event can be pursued as an image pickup range. When adjusting the image pickup range, the image signal output terminal 180 of the image pickup device 100 and the monitor 3 are connected, and the image captured by the image pickup device 100 is displayed as it is on the screen of the monitor 3 (so-called through image display). , Make adjustments while checking the range displayed on the screen. Of the three image pickup devices, the image pickup device 100-1 is set to function as a master, and the remaining image pickup devices 100-2 and 100-3 are set to function as slaves.

A cable for transmitting an alarm signal from the machine tool 2 is connected to the trigger input terminal 132 of each image pickup apparatus 100. From such a connection, the three image pickup devices 100 constituting the image pickup system 1 can receive an alarm signal which is information indicating the occurrence of a common event. Further, a cable for transmitting an error code from the machine tool 2 is connected to the event identification information input terminal 134 of the image pickup apparatus 100-1 which is the master. A cable for transmitting information for identifying an event distributed from the event distribution unit 150 of the image pickup device 100-1 is connected to the event identification information input terminal 134 provided in each of the slave image pickup devices 100-2 and 100-3. To.

Hereinafter, the operation when the monitoring function by the specific imaging system 1 is executed will be described. In the following description, the operation of each component is controlled by the CPU 110 even if it is not specified.

FIG. 5 is a diagram showing the relationship between the occurrence of an event and the recording of image data. The image pickup unit 120 of each image pickup device 100 constituting the image pickup system 1 constantly captures a moving image regardless of the occurrence of an event, and inserts the moving image into the memory card 200 inserted into each memory card slot 160. Image data from a predetermined time before to the latest is temporarily stored at a high frame rate (for example, 30 frames per second). The image data for which a predetermined time has elapsed from the time of shooting is thinned out at any time so as to have a low frame rate (for example, one frame per second) and stored in the memory card 200.

As described above, if a failure occurs in the work performed by the machine tool 2 in the state where the moving image is constantly captured, the machine tool 2 detects this failure and changes the state of the alarm signal from low to high. Let me. Then, this alarm signal is input to the trigger input terminal 132 of each image pickup apparatus 100. When the CPU 110 detects the change of the alarm signal from low to high, the CPU 110 starts the event occurrence time from a predetermined time before the time when the event occurs (that is, the time when the change from low to high of the alarm signal is detected). Control is performed to store the high frame rate image data captured by the image pickup unit 120 in the memory card 200 by a predetermined time after the above. Specifically, the high frame rate image data temporarily stored in the memory card at the time when the event occurred (that is, the image data from a predetermined time before the event occurrence time to the event occurrence time) and the event High frame rate image data captured during a predetermined time from the time of occurrence is recorded in a file in the memory card 200 without thinning out.

Events such as work mistakes occur in the process of events that cause mistakes, occurrence of mistakes, detection of mistakes, and transmission of information indicating the occurrence of events (for example, changes in alarm signals). In order to investigate the cause of the event, it is necessary to confirm the image before the event occurs. However, according to the present embodiment, the image before the event occurs can be confirmed.

The above-mentioned "predetermined time" is one cycle of the operating time of the machine tool 2. By doing so, it is possible to store the image data including the period from the start to the end of the cycle in which the event occurs, regardless of the event occurrence timing within one cycle of the operation time. Since the image data taken from the start to the end of the cycle including the time when the event occurred can be stored without omission, it is possible to easily confirm the cause of the work error and the subsequent processing. That is, the cause of the work error can be grasped by checking the image before the event occurrence in the cycle in which the event occurs. Further, by confirming the image after the event occurrence in the cycle in which the event occurs, it is possible to confirm whether the processing after the event occurrence is properly performed.

When recording a file for storing detailed image data captured during a predetermined time from the time when the event occurs to the memory card 200, the CPU 110 controls to embed the information for identifying the event in the file. The information for identifying the event is distributed to the image pickup devices 100-2 and 100-3, in which the image pickup device 100-1 functioning as a master functions as a slave. As a result, information for identifying a common event is embedded in the files recorded by each image pickup apparatus 100 when one event occurs, so that the files can be easily classified and managed.

In the example of the present embodiment, the information for identifying the event is information indicating the time when the event occurred, information indicating the place where the event occurred, and an error code. The CPU 110 of the image pickup apparatus 100-1 functioning as a master acquires the time when the event occurs from the time measuring unit 170 included in the image pickup apparatus 100-1. Further, as the information indicating the location where the event has occurred, the information defined in advance in the setting file recorded in the memory card 200 inserted in the image pickup apparatus 100-1 is read and used. The error code output from the machine tool 2 is received and used via the event identification information input terminal 134.

As a method of embedding the information that identifies the event, the information that identifies the event is used as a part of the file name. By including the information for identifying the event in the file name, it is possible to easily grasp the contents of the image data stored in the file without reading the image file into the dedicated software. Also, an error code is embedded in the header of the frame when an event occurs in the moving image to be recorded. By searching for the frame in which the error code is embedded during playback, you can quickly check the image at the moment when the event occurs. Further, when a plurality of files recorded by each image pickup apparatus 100 are simultaneously reproduced when one event occurs, synchronization can be achieved by simultaneously reproducing a frame in which an error code is embedded.

The CPU 110 of each image pickup device 100 constituting the image pickup system 1 embeds the identification information for identifying the image pickup device 100 in the file storing the image data captured by the image pickup unit 120 in addition to the information for identifying the event. It is controlled to be stored in the memory card 200. As the identification information for identifying the image pickup apparatus 100, those defined in advance in the setting file recorded in the memory card 200 inserted in each image pickup apparatus 100 are read out and used.

After a predetermined time has elapsed from the time when the event occurred, the moving image is constantly captured again, and the image data from before the predetermined time to the latest is stored in the memory card 200 inserted in each memory card slot 160. Is temporarily stored at a high frame rate, and the image data for which a predetermined time has passed from the time of shooting is thinned out at any time so as to have a low frame rate and stored in the memory card 200. By doing so, the contents of the image data captured during the time when the event does not occur can be roughly confirmed, and the contents of the image data can be confirmed in detail when the event occurs. Further, it is possible to store the image at the time when the event does not occur while suppressing the size of the file for storing the image data.

As described above, in addition to the case where the machine tool 2 notifies the image pickup system 1 of the occurrence of an event by an alarm signal, each image pickup device 100 constituting the image pickup system 1 of the present embodiment is previously provided with an acceleration sensor 140. The detection of vibration above the set intensity is treated as an event occurrence, and high frame rate image data captured by the imaging unit 120 from a predetermined time before the vibration detection time to a predetermined time after the event occurrence time. Is stored in the memory card 200. The image data that is triggered by the vibration detection is stored only by the image pickup device 100 provided with the acceleration sensor 140 that detects the vibration, and the other image pickup devices 100 do not store the image data. As a result, since there is an event in which only the image pickup device 100 that has detected the vibration stores the file, the image pickup device 100 that may have an abnormality can be easily identified.

By doing so, it is possible to record the images before and after the event as if the event occurred even when the vibration of a predetermined value or more is applied to the device other than the case where the alarm signal is received from the machine tool 2. In a situation where an unexpected vibration such as an impact applied to the image pickup device itself or a change in the shooting direction or an abnormality on the image pickup device side is detected, an event can be generated by itself and an image can be recorded. This makes it easier to notice the change in the shooting direction of the camera, corrects the shooting direction, and prepares to appropriately shoot when an event such as an abnormality of the machine tool 2 occurs.

In the file recorded when the vibration is detected by the acceleration sensor 140, information for identifying an event different from the case triggered by the alarm signal from the machine tool 2 is embedded. Specifically, an error code indicating that an abnormal vibration has been detected is embedded as information for identifying the event.

The file storing the image data recorded by each of the three image pickup devices 100, triggered by the occurrence of a common event, has a function of being synchronously reproduced by a viewer operating on a computer. This viewer synchronizes and reproduces each image data so that the frame in which the error code is embedded in the header is reproduced at the same timing. In addition, the time information, location information, and error code included in the information that identifies the event are displayed in association with the image being played. Also, when selecting the target file to be played, a plurality of files having common information for identifying the event are associated and displayed. This makes it easy to identify the files that should be played back in synchronization. In addition, the viewer has a function to search for the file to be played by using the time information, the location information, and the error code as keys. With such a viewer, files containing image data taken from multiple directions before and after one event can be quickly found and played back in synchronization, so the cause of the event can be investigated and post-processing can be confirmed. It will be easy.

According to the image pickup system 1 described above, it is possible to eliminate the need to manually input the information for identifying the event and the identification information of the image pickup device. Therefore, when the image stored by the device located in the factory in a remote place is collectively sent to the management department or the like and the content of the image is confirmed by the management department, the image pickup device 100 takes a picture. On the side that sends the obtained file, the file in which various information is automatically embedded can be sent as it is. In addition, the side that confirms the sent image can handle a file in which predetermined information is surely embedded. Therefore, labor can be reduced on both the transmitting side and the receiving side. Further, since the image data captured before and after the event occurs can be stored by the plurality of image pickup devices 100, it becomes easy to confirm the situation before and after the event occurs.

Further, when an event occurs, a plurality of image pickup devices 100 constituting the image pickup system 1 embed information for identifying a common event in a file, so that each image pickup device 100 stores the information when the common event occurs. It becomes easy to identify the image data. Further, when the information for identifying the event includes the information indicating the type of the event, the files can be easily classified and managed.
[Modification of the first embodiment]

The present invention is not limited to the above-mentioned first embodiment, and modifications, improvements, and the like to the extent that the object of the present invention can be achieved are included in the present invention.

For example, in the first embodiment, when the machine tool 2 detects that the work performed by the machine tool 2 has failed, an abnormality of the equipment, or the like, the signal to the rotary lamp 21 connected to the machine tool 2 is branched. It is configured to use and receive information indicating the occurrence of an event, but the machine tool 2 is configured to output an alarm signal indicating the occurrence of an abnormality to the outside and use this alarm signal as information indicating the occurrence of an event. You may. Further, when the signal to the rotary light 21 is branched and used, for example, a rotary light 21 that lights up in blue when normal and lights up in red when an abnormality occurs is used, and a control signal for lighting in red. May be diverted as an alarm signal. Further, the image pickup device 100 may be provided with a light receiving element for detecting red light emission, and the red light emission of the rotary lamp 21 may be received as information indicating the occurrence of an event. Further, a rotating light 21 that lights up in red and emits an alarm sound when an abnormality occurs is used, and a microphone for detecting the alarm sound is provided in the image pickup apparatus 100 so that the alarm sound of the rotating light is received as information indicating the occurrence of an event. You may. Further, the object to be photographed by the image pickup apparatus 100 is not limited to the machine tool, but may be various robots, processing machines, etc. arranged on the factory line. As an example, FIG. 6 schematically shows the operation order when an event occurs when a robot arranged on a line for producing strawberry cake and arranging strawberries on the upper surface of the cake is targeted for photography. The robot is not equipped with a rotating light and is configured to be able to output an alarm signal to the outside when a work failure is detected.

In the first embodiment, the master image pickup apparatus 100-1 adds information indicating the time and information indicating the shooting location to the error code received from the machine tool 2, and sets the slave as information for identifying the event. Although it was delivered to the image pickup devices 100-2 and 100-3, the error code received from the machine tool 2 may be distributed to the slaves as it is.

In the first embodiment, the means for transmitting the "distributed" information is wired, but wireless may also be used. In the case of wireless transmission, any wireless communication standard such as Wifi, 3G, Bluetooth (registered trademark), etc. does not matter. Further, the method of distributing information is not limited to the method of directly distributing information from the master to each slave, but also includes the method of indirectly distributing information. For example, a plurality of slaves may be connected in multiple stages starting from one master, and information for identifying an event supplied from the master or information indicating the occurrence of an event may be sequentially transmitted to the subsequent stage. As another example, all the image pickup devices 100 may be connected to the network, and the information distributed on the network may be broadcast from the master to convey the information to all the slaves.

In the first embodiment, the identification information defined in the memory card 200 in advance is used as the identification information for identifying the device, but instead of this, the MAC address or the like is uniquely assigned to each device in advance. Information may be diverted. Further, when setting the configuration of the image pickup system 1, the identification information may be automatically set so as not to be duplicated through communication between the master and the slave.

Further, the CPU 110 of the image pickup apparatus 100 functioning as a slave may be controlled to embed and store the identification information of the image pickup apparatus 100 functioning as a master in a file for storing image data. By doing so, since common information is embedded in the files stored by the slaves connected to the common master, it becomes possible to easily find the image file taken by the common event.

In the first embodiment, the machine tool 2 and each image pickup device 100 are directly connected to transmit information indicating the occurrence of an event (that is, an alarm signal), but the event included in the image pickup device 100-1 functioning as a master. The distribution unit 150 may be configured to distribute information indicating the occurrence of an event to the slave in addition to the information for identifying the event. By doing so, it is possible to distribute the information indicating the occurrence of the event as well as the information for identifying the event, so that it is easy to connect and set each device constituting the system. In this case, the cable that conveys the information that identifies the event and the cable that conveys the information that indicates the occurrence of the event may be integrated. By doing so, the number of cables used for connecting the master and the slave can be reduced, and the connection and setting become easy. Further, the cable for transmitting information indicating the occurrence of an event from the master to the slave may be configured to be compatible with transmitting an alarm signal from the machine tool 2 to the master.

Further, a serial number from the start of recording may be transmitted together with information indicating the occurrence of a trigger event, and the image data file recorded by each image pickup apparatus 100 may be associated with this serial number. The serial number from the start of recording may be a part of the information for identifying the event.

In the first embodiment, when the acceleration sensor 140 detects a vibration of a preset intensity or higher, the image is recorded only by the image pickup device 100 provided with the acceleration sensor 140 that detects the vibration, but other Information indicating the occurrence of an event may be transmitted to the image pickup device 100, and the image may be recorded by another image pickup device 100 as well. In order to distribute information indicating the occurrence of an event from an arbitrary image pickup device 100 to another image pickup device 100, information indicating the occurrence of an event is individually transmitted from the image pickup device of the distribution source to each of the other image pickup devices. However, for example, it is preferable to connect all the image pickup devices 100 to a network and broadcast information indicating the occurrence of an event on the network from the image pickup device 100 of the distribution source. As a result, information indicating the occurrence of an event can be transmitted to all the image pickup devices 100 at substantially the same timing.

In the first embodiment, the image pickup unit 120 captures a moving image as an image, but for example, a still image may be captured. Further, the image may be, for example, a 2D image or a 3D image. Further, it may be a black-and-white image or a color image. The lens unit included in the image pickup unit 120 may be a short focus lens instead of a zoom lens.

In the first embodiment, the memory card 200 inserted into the memory card slot 160 is used as the storage means, but another storage device such as a hard disk drive may be used instead of the memory card. Further, the storage means is not limited to the removable one, and may be built in the housing 105 in a non-detachable form. In the first embodiment, the memory card 200 inserted into the memory card slot 160 of each image pickup device 100 is used as the storage means, but the plurality of image pickup devices 100 use a common storage means (for example, a hard disk drive or a communication network). Image data may be stored in the storage area provided above). However, the best configuration is to store each image pickup device 100 described above. Especially when the production line has just been built in the factory, it can be easily installed by screwing for a period of about 3 to 4 months, for temporary installation such as when monitoring troubles, without building a large-scale system. Can be stored in each image pickup device. Moreover, not only in the case of temporary construction, but also in the case where events do not occur so frequently, it is possible to easily photograph the situation at the time of abnormality of the machine tool without performing large-scale system construction.

In the first embodiment described above, the motion image is constantly captured, but the motion start signal is received at the start of one cycle of the motion, and the video recording is started when the motion start signal is received. It may be configured. Further, for example, the image data corresponding to the cycle is recorded when the operation end signal is received without receiving the signal indicating the occurrence of the described event from the outside by the configuration in which the operation end signal is received at the end of the operation of one cycle. It may be configured not to. For example, when a signal indicating the occurrence of an event is received from the outside, it is preferable to perform a process of extending the recording of image data for at least the recovery time due to the occurrence of the event.

In the first embodiment, the image data captured by the image pickup unit 120 is temporarily stored in the memory card 200 for a predetermined time, but the image data is temporarily stored in a storage element such as SDRAM built in the image pickup device 100. The high frame rate image data when the event occurs and the low frame rate image data when the event does not occur may be finally recorded in the memory card 200.

In the first embodiment, when an event occurs, a high frame rate image is recorded from before a predetermined time to a predetermined time after the event occurrence time, but the predetermined time is the recording time before the event occurrence and the recording time after the event occurrence. May be different, and it is preferable to allow the user to freely set the time. For example, when the machine tool 2 requires a time longer than one cycle of normal operation for processing after the event occurs, the recording time after the event occurrence may be longer. By doing so, it is possible to more reliably investigate the cause of the event occurrence and confirm the post-processing.

In the first embodiment, the information for identifying the event is embedded in the file by using it as a part of the file name, but it is also possible to embed it by another method. For example, information identifying the event may be embedded in the image as a watermark. In this way, information that identifies the event can be embedded without increasing the size of the file and without having a visible effect on the image. In addition, it is possible to make it difficult to falsify the information that identifies the event. As another example, the information identifying the event may be embedded as characters superimposed on the image. As yet another example, the information that identifies the event may be embedded as additional information in the file that stores the data. The "additional information" refers to information other than the image itself, such as a header and a footer, among the files for storing the image data.

Further, in the first embodiment, the information for identifying the three events, that is, the information indicating the time when the event occurred, the information indicating the place where the event occurred, and the information for identifying the event including the error code are stored in the file. Although it was decided to use it for at least a part of the name, for example, the information that identifies the first event (for example, the information indicating the time when the event occurred) is used for at least a part of the file name, and the second event (for example, information indicating the time when the event occurred) is used. For example, the information that identifies the place where the event occurred) is embedded in the image as a watermark, and the information that identifies the third event (for example, the error code) is embedded in the file that stores the image data as additional information. good. For example, the information for identifying the first to third events may be the same information, but in particular, it may be configured to include different information. In particular, these may be completely different information, but it is particularly preferable that the same information is included for some information. By doing so, the user can easily see the same information from the file name, make it difficult to be tampered with, and detect tampering by comparing the information that identifies the first to third events. Can be done easily. In particular, it is preferable to store the same information as information in different expression formats for some information. For example, the information used for the file name is the location code, date and time, and event that can be identified by a person, for example, an alphanumerical string that uniquely corresponds to the location and the date and time when the event occurred. While the event code, which is the code indicating the content, is used as the character string information arranged in this order, the additional information and the watermark include the character string indicating the name of the place corresponding to the place code and the specific event corresponding to the event code. It is advisable to store a character string with similar contents.

In the first embodiment, the file is configured so that the frame in which the event occurs is one in the video of one file, but a plurality of frames in which the event occurs in the video of one file are provided. You may.

In the first embodiment, a high frame rate image is recorded from a predetermined time before the event occurrence time to a predetermined time after the event occurrence time, and a low frame rate image is recorded at other times. Images may not be recorded at other times. Further, from before a predetermined time to after a predetermined time of the event occurrence time, the image file is made into a color image in which the compression rate of the image file is lowered (or not compressed) and the image quality of the image file is high (for example, an HD (High Defintion) image). , Etc. to record an image with a large amount of information, and at other times, reduce the amount of information by increasing the compression rate of the image file, lowering the image quality of the image file (for example, VGA image), making a black-and-white image, etc. You may.

In the first embodiment, the example in which the viewer as the reproduction means is provided as software executed on a computer separate from the image pickup device 100 has been described, but the image pickup device 100 has an image pickup in the housing 105. A reproduction means for reproducing and displaying the image data may be integrally provided.

[Second Embodiment]
FIG. 7 shows an installation example of the image pickup apparatus 100 in the second embodiment of the present invention. In the present embodiment, the image pickup apparatus 100 is arranged on a table in the workplace and monitors the table. For example, when a worker disappears from the work place during lunch break, the tools placed on the table are monitored. In the present embodiment, the image pickup apparatus 100 operates by utilizing the electric power supplied from the battery used for the power tool or the like. The image pickup apparatus 100 of this example receives a sensor signal indicating abnormal vibration output by an internal acceleration sensor and a trigger signal from an external sensor as information indicating the occurrence of an event, and receives image data captured before and after the occurrence of the event. Record.

[Third Embodiment]
FIG. 8 shows an installation example of the image pickup apparatus 100 according to the third embodiment of the present invention. In the present embodiment, the image pickup apparatus 100 is attached to the frame at the rear of the driver's cab of the forklift and photographs the front. The shooting range is set to include the area in front of the driver's cab and forklift, especially the fork. The image pickup device 100 of this example is also provided with a screw hole for attachment on the upper surface of the housing, and is configured so that the image pickup device 100 can be hung from above. The image pickup apparatus 100 of the present embodiment includes a temperature measuring means. When the forklift goes in and out of the freezer, the image pickup unit becomes cloudy. To prevent this, only when the temperature measuring means detects a low temperature, it is heated by a heating wire and a thermostat to prevent clouding. Further, it treats that the temperature measuring means detects a sudden change in temperature (for example, a temperature change accompanying entering and exiting from the freezer) as an event, and records the captured image data.

1 Imaging system 2 Machine tool 3 Monitor 100 Imaging device 105 Housing 110 CPU
120 Imaging unit 130 Event input unit 140 Accelerometer 150 Event distribution unit 160 Memory card slot 170 Timekeeping unit 200 Memory card

Claims (3)

A system that monitors a predetermined target using a plurality of imaging means, and is a system that monitors the same target using the plurality of imaging means installed so as to photograph the same target from different directions .
A function of acquiring information indicating the occurrence of the abnormality when an abnormality occurs in the target imaged by the plurality of imaging means, and a function of acquiring the information indicating the occurrence of the abnormality.
When the information indicating the occurrence of the abnormality is acquired, the control is performed to associate the image data captured by each of the imaging means of the plurality of imaging means within a predetermined time including before the occurrence of the abnormality and store the image data in the storage means. Functions to perform and
Have,
The function to perform the control is
A system that embeds information indicating the types of abnormalities that are common to each other in each of the image data captured by the plurality of imaging means and captured when the abnormality occurs. The predetermined object is a machine tool.
The system according to claim 1 , wherein the function for performing the control embeds information indicating the type of the abnormality received from the machine tool. A program for realizing the function of the system according to claim 1 or 2 on a computer.

Images