JP5111313B2 - Data collection device - Google Patents

Description

  The present invention relates to a data collecting apparatus, and more specifically, in a data collecting apparatus capable of extracting and recording only image data when necessary from image data picked up by an image pickup unit that always picks up an observation object. The present invention relates to a data collection device capable of efficiently transmitting image data to a storage means.

In order to efficiently manufacture products, automatic manufacturing apparatuses are widely used. Such an automatic manufacturing apparatus can efficiently produce a product under preset conditions, but when a part or the like that deviates from the preset condition is supplied into the automatic manufacturing apparatus. Often, device troubles occur. If such a device trouble occurs, the production of the product will be stopped until the cause of the trouble is removed. Therefore, it is necessary to arrange personnel (monitoring personnel) to set the automatic production device to restart. Don't be.
However, in addition to the fact that various automatic manufacturing equipment is installed at the production site, equipment troubles occur suddenly. Therefore, the supervisor removes the cause of the equipment trouble and removes the automatic manufacturing equipment. Although I was able to start, I was unable to witness the moment when a device trouble occurred and to collect materials to resolve the cause of the device trouble.

  Therefore, the image processing apparatus has an image capturing unit that captures the operating state of the automatic manufacturing apparatus, stores image data captured by the image capturing unit in the image storage unit, and among the image data stored in the image storage unit, an apparatus trouble occurrence timing. For example, Patent Document 1 proposes a monitoring apparatus for recording image data for a predetermined time including the trigger occurrence time and at least immediately before the trigger occurrence time.

According to the monitoring device disclosed in Patent Document 1, the timing at which a trouble occurs in the automatic manufacturing apparatus and the operation state of the automatic manufacturing apparatus over the required time before and after the trouble is stored as image data. be able to. As a result, even if the monitoring staff cannot be present at the moment when the device trouble occurs, it is effective because the mechanism at the time of the device trouble can be clarified by the image data.
In recent years, the performance of imaging means has improved, and a monitoring device using a so-called high-speed camera having an imaging performance of several thousand frames per second is also provided, and image data captured by such a high-speed camera is used. As a result, it became possible to elucidate the mechanism when a device trouble occurred in more detail.
Registered Utility Model No. 3049352

The image data picked up by the image pickup means is temporarily stored in the image storage means, and then the image data is transmitted from the image storage means to another storage means when a trigger is generated. If the imaging speed of the imaging means is about several tens of frames per second to several hundreds of frames per second, the frame data constituting each image data has a sufficient data capacity as image data, so that the image storage means transfers to the storage means. When transmitting image data, a method of transmitting individual frame data one by one can be employed.
However, when the imaging speed of the imaging unit is increased, the data capacity per frame data is reduced due to the restriction of the processing capability of the imaging unit. When such small-capacity data is transmitted from the image storage means to the storage means according to the time series of the frame data in the same manner as in the past, overhead is increased and efficient image data transmission is performed. There is a problem that processing cannot be performed.

  Accordingly, the present invention provides an overhead in transmission data in a data collection device using a high-speed camera when transmitting image data before and after the occurrence of a trigger from the first storage means to the second storage means. An object of the present invention is to provide a data collection device that can efficiently transmit image data by reducing the size.

As a result of various studies to achieve the above object, when transmitting data to be transmitted from the first storage unit to the second storage unit, the capacity of the image data in one data transmission process is in an overhead state. In order to prevent this from happening, it is possible to prevent a decrease in transmission efficiency due to the overhead of the transmission file by performing transmission processing in a state where a plurality of frame data constituting the image data are collected in accordance with the imaging speed of the imaging means. As a result, the present invention has been completed.
That is, the present invention provides an image pickup means, a first storage means for temporarily storing image data picked up by the image pickup means, and data in which image data stored in the first storage means is set in advance. A second storage unit that stores data based on the transmission condition; and a control unit that stores the data transmission condition in the storage unit in advance, and the data transmission condition is stored in at least the first storage unit. A condition for storing the stored image data in the second storage means is based on a trigger condition that is defined based on image information of frames constituting the image data or a detection value by a detection means provided in a device to be imaged A data extraction condition that defines a frame of image data that satisfies the trigger condition as a reference frame, and specifies an extraction time of image data before and after the reference frame When the image data stored in the first storage means is transmitted to the second storage means, the data capacity of the transmission data transmitted in one data transmission process is determined according to the imaging speed of the imaging means. A transmission data generation condition that is defined, and the control unit includes at least one of image information of frame data constituting the image data stored in the first storage unit and a detection value of the detection unit When the trigger condition is satisfied, based on the data extraction condition, the image data stored in the first storage means is extracted in a required time range, and the frame data constituting the extracted image data is After the transmission data is generated by combining until the data capacity specified by the transmission data generation condition is reached, the transmission data is stored in the second storage device. A data collecting device data collection device, which comprises carrying out a process of transmitting to.

  The transmission data generation condition is such that adjacent frame data in the transmission data is discontinuous in time series when the frame data constituting the image data extracted from the first storage unit is combined. It is characterized by being set. Thus, it is possible to prevent image data from being lost at a certain timing due to a communication trouble at the time of data transmission from the first storage means to the second storage means, and it is possible to improve reliability at the time of data transmission. Thereby, since the continuity of the image data at the time of the occurrence of the trigger and before and after the trigger is maintained, the subsequent image data can be analyzed accurately.

  Further, the imaging means is characterized in that an imaging speed can be adjusted. As a result, it is possible to perform imaging with the number of frames according to the operation of the observation target and the like, and thus it is possible to collect image data of an appropriate size, and to accurately analyze the subsequent image data.

  Each of the data transmission conditions can be individually changed. Thereby, the versatility of the data collection device can be improved.

  In addition, the data transmission condition further includes a condition for frame reassembly for making each of the divided frame data continuous in time series after being divided into individual frame data constituting the transmission data. The control unit performs a process of reassembling the frame data in the transmission data stored in the second storage unit into image data that is continuous in time series based on the frame reassembly condition. It is characterized by. Thereby, the plurality of transmission data transmitted to the second storage unit can be returned to the image data stored in the first storage unit.

  Further, the second storage means is a portable external recording medium. Thereby, the extracted image data can be used also in other external devices such as other personal computers.

  According to the data collection device of the present invention, when transmitting the necessary part of the image data stored in the first storage means to the second storage means, the frames constituting the transmission data in accordance with the imaging speed of the imaging means By changing the number of combined data, the imaging speed is increased, and even if the data capacity (file capacity) of individual frame data constituting the image data is reduced, the first storage means to the second storage means. The overhead at the time of data transmission can be reduced, and efficient image data transmission processing becomes possible.

Embodiments of a data collection device according to the present invention will be described below with reference to the drawings. FIG. 1 is a perspective view of a data collection device according to this embodiment. FIG. 2 is a block diagram illustrating a schematic configuration of the data collection device according to the present embodiment.
The data collection device 10 according to the present embodiment is housed in a high-speed camera 20 that is an imaging unit and a data collection device main body 30 connected to the high-speed camera 20, and stores image data captured by the high-speed camera 20. Controls the operations of the random access memory 32 as the first storage means, the portable external recording medium 34 composed of the nonvolatile memory as the second storage means, and the high-speed camera 20, the random access memory 32, and the external recording medium 34, respectively. And a control unit 40 including a CPU 42 and a storage unit 44, and an operation unit 50 and a display unit 60 provided integrally with the data collection device main body 30.

  The high-speed camera 20 in the present embodiment is composed of an optical lens and an image sensor. The imaging speed of the high-speed camera 20 can be set to an arbitrary imaging speed of 20 frames per second to 8000 frames per second. The setting of the imaging speed of the high-speed camera 20 can be appropriately set by the user editing a data value that defines the imaging speed of the high-speed camera 20 via the operation unit 50. The high-speed camera 20 is connected to the data collection device main body 30 via the communication cable 22. The image data captured by the high-speed camera 20 is a state in which information such as the high-speed camera 20 captured for each frame and the imaging time is added to the random access memory 32 built in the data collection device main body 30 from the communication cable 22. Is memorized. The storage capacity of the random access memory 32 and the external recording medium 34 has a sufficient margin corresponding to the imaging speed of the high-speed camera 20, the capacity of the captured image data, and the width of the image data extraction time before and after the trigger is generated. Capacity is secured.

The random access memory 32 includes a capture area 32a in which image data picked up by the high-speed camera 20 is sequentially stored in time series, and a transmission data generation area 32b in which transmission data SD to be described later is temporarily stored. It is configured. In the present embodiment, the capacity of the capture area 32a and the transmission data generation area 32b are set at a ratio of 9: 1. The ratio of the storage capacity between the capture area 32a and the transmission data generation area 32b is not limited to this ratio. The random access memory 32 can of course be provided with a separate memory for each of the capture area 32a and the transmission data generation area 32b.
When image data from the high-speed camera 20 is stored one after another in the capture area 32a, the storable capacity of the capture area 32a decreases, and a new image file can no longer be stored. In such a state, the image data to be newly stored is overwritten on the storage area of the image data having the oldest imaging time in the capture area 32a. Thus, in the present embodiment, the capture area 32a of the random access memory 32 is used in the form of a so-called ring buffer.

In the storage unit 44 of the control unit 40 in the present embodiment, a data transmission condition DSJ that is a condition for transmitting image data from the capture area 32a of the random access memory 32 to the external recording medium 34 and a control program for the data collection device 10 PGM is stored in advance.
The data transmission condition DSJ includes a trigger condition TGJ that defines the timing at which image data stored in the random access memory 32 is stored in the external recording medium 34, and a frame at a timing that satisfies the trigger condition TGJ as a reference frame. Frame data in the image data for constituting the transmission data SD in one data transmission process when the image data is transmitted from the random access memory 32. At least transmission data generation conditions SSJ that define the number of connections in accordance with the imaging speed of the high-speed camera 20.
Below, each condition is demonstrated in detail.

The trigger condition TGJ is based on individual frame data constituting image data captured by the high-speed camera 20 and reference frame data stored in advance in the storage unit 44 of the control unit 40 by the CPU 42 of the control unit 40 for each pixel. To determine whether each pixel is the same pixel or a different pixel by comparing the pixels at corresponding positions with each other using a known method (comparison of luminance, lightness, chromaticity, etc. in the comparison target pixel). In addition, an image trigger condition for generating a trigger when it is determined that the number of different pixels in the total number of pixels is greater than or equal to a preset number, and a separate detection means are arranged in the observation target device or its proximity position. In addition, the detection value trigger condition that generates a trigger when the detection value by the detection means exceeds a predetermined allowable value It can be configured by.
The trigger condition TGJ may be configured by combining all of the above-described conditions, or may be configured by any one. It is of course possible to use a combination of trigger conditions as appropriate in accordance with the configuration of the observation target for which data is recorded by this apparatus.

  The data extraction condition DCJ is for defining the image data extraction time before and after the reference frame including the reference frame, with the frame of the image data at the timing satisfying the condition defined by the trigger condition TGJ as a reference frame. It is. In this embodiment, since the image data is generated using the high-speed camera 20, several seconds before and after the reference frame are set as the data extraction time. The data extraction time in this embodiment is set to the same time before and after the reference frame (before and after the trigger is generated), but it is expected that an important image is present either before or after the reference frame. In some cases, the data extraction times before and after the reference frame may be different.

The transmission data generation condition SSJ occurs when a trigger is generated based on the trigger condition TGJ and image data captured by the high-speed camera 20 is transmitted from the capture area 32a of the random access memory 32 to the storage unit 44 of the control unit 40. This is a condition that defines the file capacity of the transmission data SD formed by combining the frame data constituting the image data extracted from the capture area 32a.
The CPU 42 of the control unit 40 generates transmission data SD by binaryly combining the frame data constituting the image data extracted from the capture area 32a in series until the capacity specified by the transmission data generation condition SSJ. The generated transmission data SD is temporarily stored in the transmission data generation area 32b of the random access memory 32. When the transmission data SD is stored in the transmission data generation area 32b, the CPU 42 immediately performs processing for extracting the transmission data SD from the transmission data generation area 32b and transmitting the data to the storage unit 44.

The transmission data generation condition SSJ in the present embodiment is adjacent to the transmission data SD after concatenation when a plurality of frame data constituting the image data stored in the capture area 32a of the random access memory 32 are concatenated in binary. The combination map is set in advance so that the preceding and succeeding frame data is a combination that is not continuous in time.
Hereinafter, a specific example of the combination map will be described in detail.

(Specific example 1 of map for combination)
For example, when the number of frame data constituting the image data to be transmitted is 100 frames, and 10 pieces of frame data are combined to generate one transmission data SD, the frame data frame constituting the image data When the number is assigned as Fxx, the frame numbers are F00 to F99. When 10 pieces of these frame data are combined, 10 pieces of transmission data SD are generated. Assuming that the number of each transmission data SD is SDx, the numbers of the generated transmission data SD are SD0 to SD9.

  The transmission data SD0 is generated by combining frame data whose frame numbers are F00, F10, F20, F30, F40, F50, F60, F70, F80, and F90. Subsequently, the transmission data SD1 is generated by combining frame data whose frame numbers are F01, F11, F21, F31, F41, F51, F61, F71, F81, and F91. Similarly to these, the transmission data SD2 is frame data with frame numbers F02, F12, F22, F32, F42, F52, F62, F72, F82, and F92, and the transmission data SD3 is frame numbers F03, F13, The frame data that are F23, F33, F43, F53, F63, F73, F83, and F93 may be combined. As for the transmission data SD4 to SD9, the transmission data SD can be generated by combining the frame data with the same last digit of the frame number in the same manner as these.

(Specific example 2 of map for combination)
Here, a description will be given of a mode in which the last one digit of the frame number attached to the frame data to be combined is dispersed when the transmission data SDx is generated.
Specifically, the skip number of frame numbers of frame data to be combined may be A. At this time, when the number of frames constituting the image data to be transmitted is Z, it is preferable that ZmodA ≠ 0. Further, when the multiple of the skip number A exceeds the number of Z, frames having a difference number between the multiple of the skip number and Z may be combined.

Here, a specific example in which (Z, A) = (100, 9) and the transmission frame SF is generated by combining 10 frames will be described. First, the transmission data SD1 is composed of frame data with frame numbers F00, F09, F18, F27, F36, F45, F54, F63, F72, and F81, and the transmission data SD2 has frame numbers F90, F99, F08, This is data obtained by combining the frame data F17, F26, F35, F44, F53, F62, and F71, and the frame numbers to be selected in the respective transmission data SD can be defined in the same manner.
At this time, it is preferable to set the least common multiple of the period T of the periodic operation in the observation target apparatus and the time corresponding to the skip number A as much as possible. The transmission data SD generated using the frame data selected in this way is suitable when the observation target apparatus performs a periodic operation.

(Specific example 3 of map for combination)
Specific examples of the above combining maps are regular maps each having regularity. Here, the conditions relating to the number of frames of frame data constituting an image file to be transmitted are not regular, Since the data transmission condition DSJ is set, there is a method of determining the frame number to be combined in the transmission data SD based on the random number table generated within the frame number range.
Since the transmission data SD generated in this convenient mode is not the frame number of the frame data to be combined at a specific interval, the transmission data SD when the observation target device performs a periodic operation. This is particularly convenient.

As described in the specific examples 1 to 3 of the above-described combination map, the frame data constituting the image data extracted in the required time before and after the reference frame are combined in a time-series discontinuous state to transmit data. By generating SDx, a trouble occurs in the middle of data transmission processing from the random access memory 32 to the external recording medium 34, and even if the transmission data SD in this part is lost, the frame of the image data is missing. This is advantageous because damage can be minimized.
Such a data transmission form is particularly convenient when it is necessary to observe a phenomenon occurring in a very short time with a high-speed camera 20 capable of performing imaging at a high speed of several thousand frames per second. is there.

When the CPU 42 receives all the transmission data SD generated based on the transmission data generation condition SSJ, the storage unit 44 of the control unit 40 receives the frame reassembly condition corresponding to the combination map stored in the storage unit 44 in advance. Based on FKJ (frame reassembly map), a plurality of frame data constituting the transmission data SD is once divided into individual frame data. Next, the CPU 42 performs a process of recombining the divided frame data so as to be continuous in time series.
The image data obtained by reassembling the frame data in this way includes a reference frame at a timing suitable for the trigger condition TGJ among the initial image data stored in the capture area 32a of the random access memory 32. It becomes equal to the image data obtained by extracting a portion for several seconds before and after the reference frame.

  As described above, the image data captured in the random access memory 32 is extracted at a required time before and after the reference frame and is formed into transmission data, and then the random access memory 32 to the storage unit 44 of the control unit 40. Is transmitted to the external recording medium 34 from the storage unit 44 of the control unit 40 after being reassembled into time-sequentially continuous image data by the control unit 40. This is required when the frame data of the image data extracted in the required time before and after the reference frame among the image data stored in the capture area 32a in 32 is sequentially transmitted to the external recording medium 34 one by one in time series. Data transmission was completed in 60% of the time.

By operating the operation unit 50 of the data collection device main body 30, the image data recorded in the external recording medium 34 is reproduced and displayed on the display unit 60, so that the noticeable image before and after the occurrence of the trigger is immediately confirmed. It is possible to investigate the cause of the trigger occurrence at the observation site.
Further, since the image data before and after the occurrence of the trigger is recorded on the portable external recording medium 34, it can be easily taken out from the data collection device 10. As a result, the image data in the external recording medium 34 is read by a separate personal computer in which the image processing program is incorporated, so that the image has much higher content than the image processing performed in the data collection device main body 30. It is possible to perform processing, and it is also possible to analyze image data before and after the occurrence of a trigger in more detail.

  Although the present invention has been described in detail above based on the embodiments, the technical scope of the present invention is not limited to the embodiments described above. For example, in the present embodiment, when image data is transmitted from the random access memory 32 to the external recording medium 34, the number of frame data corresponding to the imaging speed of the high-speed camera 20 is combined in a binary combination. In the following description, the mode of combining adjacent frame data so as not to be continuous in time series is described, but the reliability of data transmission between the random access memory 32 and the external recording medium 34 is ensured. Of course, in the combined frame data constituting the transmission data SD, adjacent frame data may be in a form that is continuous in time series. When the frame data constituting the transmission data is combined in a time-series continuous state in this way, the control unit 40 divides the transmission data SD transmitted to the external recording medium 34 into individual frame data, It is possible to omit the process of recombining the frame data so as to be continuous in time series, which is convenient because the configuration of the data collection device 10 can be simplified.

In the present embodiment, a description will be given of a mode in which the frame data constituting the image data captured by the high-speed camera 20 is compared with the reference frame data stored in advance in the storage unit of the control unit 40 as the trigger condition TG. However, the frame data is extracted from the image data captured by the high-speed camera 20 for each required time, and the image information of the extracted frame data before and after is compared by the same method as in the above embodiment. A form in which a trigger is generated when it is determined that the frame data are different may be employed. According to this, since it becomes unnecessary to store the reference frame data in the storage unit of the control unit 40 in advance, the operation can be simplified.
In addition to this, it is of course possible to employ known trigger conditions.

  Further, if the data collection device main body 30 is provided with one or more external connection terminals such as a USB terminal and a LAN terminal and external signal input terminals, the data collection device 10 can be connected to the host computer via the external connection terminals. In addition, an external signal can be input. If this configuration is adopted, the image data stored in the second recording means can be transmitted to the host computer in which the image processing program is set up via the external connection terminal. It is also possible to set a trigger condition based on an external signal.

  Furthermore, the second storage means is not necessarily a portable external recording medium. As a result, it is possible to apply a random access memory or a built-in storage means composed of a nonvolatile memory to the second storage means in the same manner as the first storage means.

  Furthermore, the data collection device 10 according to the present embodiment operates the operation unit 50 configured by an input button, a jog dial, or the like, thereby adjusting the imaging speed of the high-speed camera 20 and adjusting the data transmission condition DSJ to an arbitrary condition. Although it is possible to appropriately operate the setting, the reproduction method of the image data stored in the external recording medium 34, etc., the operation unit 50 and the display unit 60 can be omitted. This is preferable because the configuration of the data collection device 10 is simplified and can be provided at a low cost.

It is a perspective view of the data collection device in this embodiment. It is a block diagram which shows schematic structure of the data collection device in this embodiment.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Data collection device 20 High speed camera 22 Communication cable 30 Data collection device main body 32 Random access memory 32a Capture area 32b Transmission data generation area 34 External recording medium 40 Control part 42 CPU
44 storage unit 50 operation unit 60 display unit

Claims (6)

Imaging means;
First storage means for temporarily storing image data picked up by the image pickup means;
Second storage means for storing image data stored in the first storage means based on preset data transmission conditions;
A data transmission condition stored in the storage unit in advance,
The data transmission condition is at least:
The condition for storing the image data stored in the first storage means in the second storage means is detected by the detection means provided in the image information of the frame constituting the image data or the imaging target device. Trigger condition to be defined based on the value;
A data extraction condition that defines an image data extraction time before and after the reference frame, using a frame of image data that satisfies the trigger condition as a reference frame;
When transmitting image data stored in the first storage means to the second storage means, a data capacity of transmission data transmitted in one data transmission process is defined according to an imaging speed of the imaging means. Transmission data generation conditions, and
The control unit, when at least one of the image information of the frame data constituting the image data stored in the first storage unit or the detection value of the detection unit satisfies the trigger condition,
Based on the data extraction condition, image data stored in the first storage means is extracted in a required time range, and frame data constituting the extracted image data is defined by the transmission data generation condition. After generating the transmission data by combining until the data capacity is reached,
A data collection apparatus for performing a process of transmitting the transmission data to the second storage unit.   The transmission data generation condition is set to a condition in which adjacent frame data in the transmission data is discontinuous in time series when the frame data constituting the image data extracted from the first storage unit is combined. The data storage device according to claim 1, wherein:   The data collection apparatus according to claim 1, wherein the imaging unit is capable of adjusting an imaging speed.   The data collection device according to claim 1, wherein each of the data transmission conditions can be individually set and changed. The data transmission condition further includes a condition for reassembling a frame for chronologically continuing each of the divided frame data after being divided into individual frame data constituting the transmission data,
The control unit performs a process of reassembling the frame data in the transmission data stored in the second storage unit into image data that is continuous in time series based on the frame reassembly condition. The data collection device according to any one of claims 1 to 4, wherein the data collection device is characterized.   6. The data collection device according to claim 1, wherein the second storage unit is a portable external recording medium.

Images