JP6493737B2 - How to store moving images - Google Patents

Description

  The present invention relates to a moving image storage method, and more particularly to a moving image storage method for efficiently storing frame image components constituting a high-quality moving image, that is, continuous still image sequences in time order.

In surveillance systems for manufacturing management at factories and for crime prevention in buildings, stores, stations, etc., moving images taken with a surveillance camera are recorded for a long time with a recording device, and if there is an abnormality, the recorded moving images are played back. -Display and identify the date and time of occurrence of abnormality and investigate the cause. It takes a lot of time and labor to specify the date and time of occurrence of abnormality by human labor and to investigate the cause, and it is desirable to automatically detect abnormality from moving image data using image analysis technology. In the surveillance system, the recorded moving image data can be copied to a portable recording medium such as an optical disk and played back on a general personal computer. However, when copying to a portable recording medium, the viewer software unique to the surveillance system manufacturer Will be included in the original compression format. A personal computer can launch and play back and display its own video viewer software that incorporates video data, but it cannot perform image analysis directly on video data that is built into video viewer software.
For this reason, the original video viewer software is launched to capture and capture the still image data of each frame in the storage device while capturing and playing back the moving image, and image analysis processing is performed on the captured still image data group. It will be.

  By the way, in recent years, the image quality of moving images has been remarkably improved, and frame rates of 30 fps and 60 fps have started to be widespread at full high-definition resolution (1920 × 1080), and an ultra-high resolution called 4K has been put into practical use. Performing playback / display of moving images and continuous screen capture in parallel on a personal computer imposes a heavy processing load, and when the high-resolution moving images are targeted, the processing may not be in time. For example, in the case of a moving image having a full high-definition resolution (1920 × 1080), a time TA required to take a still image for one frame from the video RAM for display output into the main memory and temporarily store it, and a still image from the main memory The total time TC of the time TB required to read and transfer the data to an external SSD drive device connected in accordance with the USB 3.0 standard and complete the writing takes about 35 ms on a non-high class commercially available personal computer. When the moving image is 30fps or 60fps, the frame period is about 33ms or 16.7ms.After the still image is written to the external SSD drive device, when trying to capture the next frame still image from the video RAM, The frame has been rewritten to a frame later than the next frame, and there was a problem that frames were dropped.

JP 2010-98622 A

  The present invention has been made in view of the above-described problems of the prior art, and an object thereof is to provide a moving image accumulation method in which frame dropping is less likely to occur.

In the present invention, a method for accumulating moving images displayed on a computer screen,
Prepare multiple SSD still image storage means for storing still images,
Each time a still image of a new frame of a moving image is written into the display frame storage means,
Cyclically transferring the additional still image for one frame to one of a plurality of SSD-type still image storage means for additional storage;
It is characterized by.
In this case, every time a still image of a new frame of a moving image is written into the display frame storage means by the application program, it is fetched from the display frame storage means into the temporary storage means, and the new one frame taken in is fetched. Still images may be transferred cyclically to one of a plurality of SSD type still image storage means for additional storage. In contrast, every time a still image of a new frame of a moving image is written into the display frame storage means by the application program, the display frame storage means cycles to one of the plurality of temporary storage means. The captured still image for one frame may be transferred cyclically to one of a plurality of SSD type still image storage means for additional storage.
In other inventions,
A method of accumulating moving images displayed on a computer screen,
Prepare multiple SSD still image storage means for storing still images,
The still image is periodically read out from the display frame storage means in which the still image including the frame image component constituting the moving image is periodically written, and is circulated to one of the plurality of SSD type still image storage means. Transfer it and store it additionally
It is characterized by.
In this case, the still image read from the display frame storage means is taken into the temporary storage means, and the taken still image is cyclically transferred to one of a plurality of SSD type still image storage means for addition. You may make it memorize | store. Also, unlike this, the still image read from the display frame storage means is cyclically taken into one of the plurality of temporary storage means, and the taken still image is taken as a plurality of SSD type still image storage means. Alternatively, it may be transferred cyclically to one of them and additionally stored. Each still image may include one frame image component constituting one moving image, or may include a plurality of frame image components constituting a plurality of moving images.

  According to the present invention, each still image of the still image sequence including the frame image components constituting the moving image in time order is additionally stored in one of the plurality of still image storage means. There is a margin in the transfer time per storage means, and it is possible to store moving images without dropping frames without using a high-class personal computer or other devices.

1 is a configuration diagram of a moving image capture device that embodies a moving image storage method according to an embodiment of the present invention (first embodiment); FIG. It is a flowchart which shows the moving image capture process performed by CPU of FIG. It is a time chart explaining a moving image capture method. It is explanatory drawing of the still image sequence which contains the frame image component which comprises a moving image in time order. It is explanatory drawing of still image management information. It is explanatory drawing of still image management information. It is a flowchart explaining the image | video analysis process performed by CPU of FIG. It is a time chart explaining the moving image capture method which concerns on the modification of 1st Example. It is explanatory drawing of the still image sequence which contains several frame image component which comprises several moving images in order of time.

  Hereinafter, the best mode of the present invention will be described based on examples.

With reference to FIG. 1, the structure of a moving image capturing apparatus embodying the moving image storage method according to the present invention will be described.
In FIG. 1, reference numeral 1 denotes a moving image capture device having a personal computer configuration. A system memory 3, a video card 4, and a chip set 5 are connected to a CPU 2 by a high-speed bus. A SATA 3.0 controller 6 is connected to the chip set 5. SSD type system drive device 7, SATA 3.0 controllers 8 to 10, and USB 3.0 controllers 11 and 12 to SSD type first to fifth external drive devices 13 to 17 as still image storage means, An optical disk device 19 is connected via a SATA 2.0 controller 18, and a keyboard 21 and a mouse 22 are connected via a USB 2.0 controller 20. The video card 4 includes a GPU 30, a video RAM 31, and a video output unit 32, and a display device 33 is connected to the video output unit 32. The SATA 3.0 controllers 6 and 8 to 10, the USB 3.0 controllers 11 and 12, the SATA 2.0 controller 18, and the USB 2.0 controller 20 are I / O controllers, and are SATA 3.0 standard, USB 3.0 standard, and SATA 2.0. Data exchange between the CPU 2 and peripheral devices is controlled based on the USB 2.0 standard. SATA 3.0 has a transfer rate of 6 Gb / s, USB 3.0 has a transfer rate of 5 Gb / s, and SATA 2.0 has a transfer rate of 3 Gb / s.

The system drive device 7 stores a capture program, a video viewer program in which moving image data (compressed data) read from the optical disc 40 by the optical disc device 19 is incorporated, a video analysis program, and the like. The CPU 2 controls each part of the personal computer based on a program stored in the system drive device 7 and executes a moving image display process, a moving image capture process, a video analysis process, and the like in accordance with a user instruction from the keyboard 21 and mouse 22. . The GPU 30 of the video card 4 supports the moving image display processing by the CPU 2 (decoded processing of compressed data), and a still image for one screen including the frame image components constituting the moving image in whole or in part at a predetermined cycle. Writing to the display frame buffer area FB while updating. Each of the still image sequences written in the display frame buffer area FB includes frame image components constituting a moving image in time order. Further, the GPU 30 reads a still image for one screen from the display frame buffer area FB based on a capture command from the CPU 2 and passes it to the CPU 2. The still image for one screen written in the display frame buffer area FB of the video RAM 31 is read out by the video output unit 32 at a predetermined refresh rate period and output to the display device 33 to display a moving image on the screen. It is.
The chip set 5 manages data exchange between the peripheral device and the CPU 2 through various I / O controllers.

Next, the operation of the above-described embodiment will be described with reference to FIGS. FIG. 2 is a flowchart of a moving image capture process executed by a moving image capture device having a personal computer configuration, FIG. 3 is a time chart for explaining a moving image capture operation, and FIG. 4 is a description of a still image sequence written in the frame buffer area FB. 5, FIG. 5 and FIG. 6 are explanatory diagrams of still image management information, and FIG. 7 is a flowchart of video analysis processing executed by a moving image capture device having a personal computer configuration.
It is assumed that the video viewer program in which the moving image data (compressed data) recorded on the optical disc 40 is previously copied to the system drive device 7. The moving image data includes only one moving image having a size of one screen, and has a full high-definition resolution (1920 × 1080) and a frame rate of 60 fps. The refresh rate of the display device 33 is set to 60 Hz, which is the same as the frame rate of moving image data.
When the user inputs a start-up command for the video viewer program using the keyboard 21 and the mouse 22, the CPU 2 that has input the command via the USB 2.0 controller 20 and the chipset 5 passes through the chipset 5 and the SATA3.0 controller 6. The video viewer program is read from the system drive device 7 to the system memory 3. Then, the video viewer program is decoded and a video image decoding command is given to the GPU 30 of the video card 4. The GPU 30 draws the still image (= frame image component) of the frame unit constituting the moving image in the display frame buffer area FB of the video RAM 31 while decoding and restoring the moving image data. The GPU 30 repeatedly draws a new still image in the frame period of the moving image (about 16.7 ms). The still image in the display frame buffer area FB is read out at a predetermined refresh rate (60 Hz in this case) by the video output unit 32 and is output to the display device 33. It is displayed on the screen as an image. When the GPU 30 finishes updating the still image in the display frame buffer area FB and enters the vertical synchronization period immediately before the video output unit 32 starts reading a new still image, the GPU 30 notifies the vertical synchronization period in response to a request from the CPU 2. do.

In this state, when the user inputs a capture command with the keyboard 21 and the mouse 22, the CPU 2 reads a moving image capture program from the system drive device 7 to the system memory 3. Then, the moving image capture program is decoded to execute a moving image capture process. Specifically, first, a capture buffer area CB having a still image storage area for one screen is secured in the system memory 3 (step S1 in FIG. 2). Then, the GPU 30 is periodically inquired whether the vertical synchronization period immediately before the video output unit 32 starts reading a new still image. If YES, it is determined that a new still image composed of a new frame image component of the moving image is drawn in the display frame buffer area FB. Then, the GPU 30 reads out and inputs a new still image from the display frame buffer area FB, and captures it by writing it into the capture buffer area CB of the system memory 3 (steps S3 and S4). Then, every time a still image for one screen is captured, the still image is converted into an uncompressed BMP format still image file, and the chipset 5, SATA 3.0 controllers 8 to 10, and USB 3.0 controller 11 are converted. , 12 is cyclically transferred to one of the first to fifth external drive devices 13 to 17 to additionally store still image files (steps S5, S3, S4). Repeat). A BMP format still image file is assigned a sequential file name from 1 in time order (steps S2, S6, S7). As a result, the still images constituting the frame image components constituting the moving image in parallel with the reproduction / display of the moving image are cyclically recorded in the first to fifth external drive devices 13 to 17 and the capture process is executed. Is done.
When the user inputs a capture end command using the keyboard 21 and mouse 22, the CPU 2 assigns the last file name, resolution, frame rate, and external drive device number to each of the first to fifth external drive devices 13 to 17. And still image management information SG1 to SG5 including drive identification characters and the total number of external drive devices (see steps S8 and S9, (1) to (3) in FIG. 5, (1) and (2) in FIG. 6). ).

Next, a more specific capture operation will be described with reference to FIGS. FIG. 3 is a time chart for explaining a moving image capturing method, and FIG. 4 is an explanatory view of a still image sequence including frame image components constituting a moving image in time order.
If the GPU 30 is drawing a still image S _i forming the i-th frame image component d _i of the moving image in the display frame buffer area FB at the time when the user inputs a capture command, the new still image S _i CPU2 when the drawing is completed once, temporarily stores captures still images S _i in the capture buffer area CB of the system memory 3, rewritten by converting the still image file in BMP format. At this time, the file name is, for example, “0000001”. The time required for capturing is about 7 ms, and the conversion to the BMP format is about several ms. Then, a transfer command of the BMP format still image file from the capture buffer area CB is given to the SATA 3.0 controller 8 via the chip set 5 to start writing to the first external drive device 13. At this time, the still image file is transferred from the capture buffer area CB to the buffer memory (not shown) of the first external drive device 13 and then written from the buffer memory to the SSD memory (not shown). The required time T from the start of transfer from the capture buffer area CB to the completion of writing to the SSD memory of the first external drive device 13 is about 30 ms, and the i + 5th frame image of the moving image is displayed in the display frame buffer area FB. writing before the still image S _{i + 5} forming a component d _{i + 5} is drawn is complete.

Thereafter, when the drawing of the still image S _{i + 1} that forms the i + 1-th frame image component d _{i + 1} of the moving image is completed in the display frame buffer area FB, the CPU 2 captures it in the capture buffer area CB of the system memory 3. Temporarily store, convert to BMP format still image file and rewrite. At this time, the file name is “0000002”. Then, a transfer command of the BMP format still image file from the capture buffer area CB is given to the SATA 3.0 controller 9 via the chip set 5 to start writing to the second external drive device 14. Further, when the drawing of the still image S _{i + 2} that forms the _{i + 2nd} frame image component d _{i + 2} of the moving image is completed in the display frame buffer area FB, the CPU ₂ takes in the capture buffer area CB of the system memory 3. Temporarily store it, convert it to a BMP format still image file, and rewrite it to make the file name “0000003”. Then, a transfer command of the BMP format still image file from the capture buffer area CB is given to the SATA 3.0 controller 10 via the chip set 5 to start writing to the third external drive device 15.

Next, when the drawing of the still image S _{i + 3} that forms the _{i + 3rd} frame image component d _{i + 3} of the moving image is completed in the display frame buffer area FB, the CPU 2 takes in the capture buffer area CB of the system memory 3. Is temporarily stored, converted into a BMP format still image file, and rewritten. At this time, the file name is “0000004”. Then, a transfer instruction of the BMP format still image file from the capture buffer area CB is given to the USB 3.0 controller 11 via the chip set 5 to start writing to the fourth external drive device 16. Further, when the drawing of the still image S _{i + 4} that forms the _{i + 4th} frame image component d _{i + 4} of the moving image is completed in the display frame buffer area FB, the CPU 2 takes in the capture buffer area CB of the system memory 3. Temporarily stored, converted to a BMP format still image file and rewritten, and the file name is “0000005”. Then, a transfer command of the BMP format still image file from the capture buffer area CB is given to the USB 3.0 controller 11 via the chip set 5 to start writing to the fifth external drive device 17.

Next, when the drawing of the still image S _{i + 5} that forms the _{i + 5th} frame image component d _{i + 5} of the moving image is completed in the display frame buffer area FB, the CPU 2 takes in the capture buffer area CB of the system memory 3. Is temporarily stored, converted into a BMP format still image file, and rewritten. At this time, the file name is “0000006”. Since writing of the previous still image S _i has already been completed in the first external drive device 13, the BMP format still image file from the capture buffer area CB is transferred to the SATA 3.0 controller 8 via the chipset 5. A transfer command is given to start additional writing to the first external drive device 13.

Next, when the drawing of the still image S _{i + 6} that forms the _{i + 6th} frame image component d _{i + 6} of the moving image is completed in the display frame buffer area FB, the CPU 2 takes in the capture buffer area CB of the system memory 3. Is temporarily stored, converted into a BMP format still image file, and rewritten. At this time, the file name is “0000007”. Since the second external drive device 14 has already written the previous still image S _{i + 1} , the BMP format from the capture buffer area CB is sent to the SATA 3.0 controller 9 via the chipset 5. A still image file transfer command is given, and additional writing to the second external drive device 12 is started.
Thereafter, by repeating the same processing, the first external drive device 13 has the i th, i + 5 th, i + 10 th, frame image components d _i , d _{i + 5} , d _{i + 10} ,. A BMP still image file is stored. The second external drive device 14 has still image files in the BMP format comprising the i + 1th, i + 6th, i + 111th,... Frame image components d _{i + 1} , d _{i + 6} , d _{i + 11} ,. Remembered. The third external drive device 15 has a BMP format still image file comprising i + 2th, i + 7th, i + 12th,... Frame image components d _{i + 2} , d _{i + 7} , d _{i + 12} ,. Remembered. The fourth external drive device 16 has still image files in the BMP format comprising i + 3th, i + 8th, i + 13th,... Frame image components d _{i + 3} , d _{i + 8} , d _{i + 13} ,. Remembered. The fifth external drive device 15 has still image files in the BMP format comprising i + 4th, i + 9th, i + 14th,... Frame image components d _{i + 4} , d _{i + 9} , d _{i + 14} ,. Remembered. Finally, the still image management information SG1 to SG5 of FIGS. 5 (1) to (3) and FIGS. 6 (1) and (2) are stored in the first to fifth external drive devices 13 to 17, respectively.

Next, with reference to FIG. 7, the operation of video analysis processing, which is one of methods for using still image groups captured by the first to fifth external drive devices 13 to 17, will be briefly described.
As described above, after capturing a still image sequence forming a frame image component in time order constituting a moving image and then giving a video analysis command from the keyboard 21 and mouse 22, the CPU 2 executes a video analysis program from the system drive device 7. Read to system memory 3. Then, the video analysis program is decoded, and video analysis processing is executed on the still image groups stored in the first to fifth external drive devices 13 to 17.
First, the SATA 3.0 controllers 8 to 10 and the USB 3.0 controllers 11 and 12 are instructed to read out still image management information via the chipset 5, and still image management is performed from the first to fifth external drive devices 13 to 17. Information SG1 to SG5 is read and stored in the system memory 3 (step S20). With reference to these still image management information SG1 to SG5, the external drive device “SSD1” in which the first still image file (file name = “0000001”) is stored is determined, and the corresponding SATA3.0 controller 8 is determined. The user instructs to read and input the still image file “0000001” from the first external drive device 13 and stores it in the system memory 3 (steps S21 to S23). Further, the external drive device “SSD2” in which the second still image file “0000002” is stored is discriminated, and the corresponding SATA3.0 controller 9 is instructed to send the still image file “0000002” from the second external drive device 14. Is read and input, and stored in the system memory 3 (steps S24 to S27). Then, two still images are compared and image analysis is performed, and the presence / absence of abnormality and the content of abnormality are determined (step S28). If there is an abnormality, analysis information in which two file names and abnormality contents are paired is sent to the GPU 30, and is drawn in the display frame buffer area FB and displayed on the screen (steps S29 and S30). Further, regardless of whether there is an abnormality or not, analysis information in which two file names and analysis results are paired is stored in the system drive device 7 (step S31).

Next, the CPU 2 refers to the still image management information SG1 to SG5, determines the external drive device “SSD3” in which the third still image file “0000003” is stored, and instructs the corresponding SATA 3.0 controller 10 Then, the still image file “0000003” is read from the third external drive device 15 and inputted and stored in the system memory 3 (steps S24 to S27). Then, the second and third still images are compared and analyzed, and the presence / absence of abnormality and the content of abnormality are determined (step S28). If there is an abnormality, analysis information in which two file names and abnormality contents are paired is displayed on the screen (steps S29 and S30). Further, regardless of whether there is an abnormality or not, analysis information in which two file names and analysis results are paired is stored in the system drive device 7 (step S31).
Thereafter, the same processing is sequentially performed until the last still image, and video analysis is performed.
Since the still images constituting the moving image of the portion instructed to be captured by the user are captured by the first to fifth external drive devices 13 to 17 without frame dropping, accurate video analysis can be performed.

According to this embodiment, every time a still image constituting each frame image component constituting a moving image is rendered in the display frame buffer area FB by the GPU 30, the first to fifth external drive devices 13 to 17 are visited. Therefore, there is a margin in the writing time for each of the first to fifth external drive devices 13 to 17, and a moving image can be formed without dropping frames without using a high-class personal computer. It is possible to continuously capture a still image sequence in which still images constituting each frame image component are arranged in time order.
In addition, since the capture is performed from the display frame buffer area FB, even if the moving image is integrated into the dedicated video viewer program, if the dedicated video viewer program can be started and the moving image can be played back, It is possible to continuously capture a still image sequence constituting each frame image component constituting an image.

  In the above-described embodiments, the first to fifth external drive devices as still image storage means are connected to three SATA 3.0 standard and two USB 3.0 standard I / O controllers. As mentioned above, 2 units may be connected to the SATA 3.0 standard, 3 units may be connected to the USB 3.0 standard, or any 5 units may be connected to the SATA 3.0 standard, or all 5 units may be connected to the USB 3.0 standard. It may be connected to a standard. Further, two to four or six or more external drive devices as still image storage means may be provided.

  In the above embodiment, the case where the number of capture buffer areas to be secured in the system memory is set as an example has been described. However, the present invention is not limited to this, and a plurality of capture buffer areas are secured. In addition, a continuous still image as viewed in time is cyclically captured in one of the plurality of capture buffer areas, and the still image captured in each capture buffer area is stored in one of the plurality of external drive devices. May be transferred and stored cyclically. In this way, even if it takes time to capture from the display frame buffer area to the capture buffer area compared to the frame period, or even if it takes time to transfer from the capture buffer area to the external drive device. Thus, it is possible to continuously capture a still image sequence that constitutes each frame image component constituting a moving image.

As an example, a specific capture operation when five capture buffer areas are secured in the system memory will be briefly described with reference to FIG.
As in the first embodiment, the GPU 30 displays a frame buffer for display when a user inputs a capture command while playing a moving image having a full high-definition resolution (1920 × 1080) and a frame rate of 60 fps over the entire screen. Assuming that the still image S _i forming the i-th frame image component d _i of the moving image is being drawn in the area FB, the CPU 2 once holds the first capture buffer area CB1 secured in the system memory 3 when the drawing is completed. The still image S _i is taken in and temporarily stored, converted into a BMP format still image file and rewritten. At this time, the file name is, for example, “0000001”. Then, a transfer command of the BPM format still image file from the first capture buffer area CB 1 is given to the SATA 3.0 controller 8 via the chip set 5 and written to the first external drive device 13.

After that, when the drawing of the still image S _{i + 1} that forms the i + 1-th frame image component d _{i + 1} of the moving image is completed in the frame buffer area FB, the CPU 2 captures it in the second capture buffer area CB2 of the system memory 3. Is temporarily stored, converted into a BMP format still image file, and rewritten. At this time, the file name is “0000002”. Then, a transfer command of the BMP format still image file from the second capture buffer area CB 2 is given to the SATA 3.0 controller 9 through the chip set 5 and written to the second external drive device 14.

Similarly, still images S _{i + 2} and S _{i + 3} forming i + 2, i + 3, i + 4th frame image components d _{i + 2} , d _{i + 3} , d _{i + 4} of the moving image in the display frame buffer area FB. , S _{i + 4} is completed, the CPU 2 sequentially stores the data in the third to fifth capture buffer areas CB3 to CB5 in the system memory 3 sequentially. Each time a still image is captured in the third to fifth capture buffer areas CB3 to CB5, it is converted into the BMP format, and the file names “0000003” to “0000005” are respectively used as the SATA3.0 controller 10, the USB3.0 controller 11, 12 is given a transfer command and is written to the third to fifth external drive devices 15, 16, and 17.

Here, the transfer of the still image “0000001” from the first capture buffer area CB1 to the first external drive device 13 is started last time, and then the i + 5th frame image component d _{i + 5} is stored in the display frame buffer area FB. There is a time of 4 frame cycles or more until the still image S _{i + 5 formed} is drawn. Compared to the frame period, it takes time to capture from the display frame buffer area FB to the first capture buffer area CB1, or the buffer memory capacity of the first external drive device 13 is small, and the capture buffer area CB1 From the start of the transfer to the first external drive device 13, it may take time to complete the writing to the internal SSD memory. Even in this case, when the drawing of the still image S _{i + 5} that forms the _{i + 5th} frame image component d _{i + 5} of the moving image in the display frame buffer area FB is completed next, the first capture of the system memory 3 is performed. The transfer of the still image previously stored in the buffer area CB1 has been completed.

When the drawing of the still image S _{i + 5} that forms the _{i + 5th} frame image component d _{i + 5} of the moving image is completed in the display frame buffer area FB, the CPU 2 takes it into the first capture buffer area CB1 and temporarily stores it. , Convert to BMP still image file and rewrite. At this time, the file name is “0000006”. Then, the transfer command of the BMP format still image file from the first capture buffer area CB 1 is given to the SATA 3.0 controller 8 via the chip set 5 and written to the first external drive device 13.

Next, when the drawing of the still image S _{i + 6} that forms the _{i + 6th} frame image component d _{i + 6} of the moving image is completed in the display frame buffer area FB, the CPU 2 executes the second capture buffer area of the system memory 3. Since the transfer of the still image previously stored in CB2 has been completed, it is temporarily stored in the second capture buffer area CB2 and is taken in, converted into a BMP format still image file and rewritten. At this time, the file name is “0000007”. Then, a transfer command of the BMP format still image file from the second capture buffer area CB 2 is given to the SATA 3.0 controller 9 through the chip set 5 and written to the second external drive device 14.
Thereafter, by repeating the same processing, the first external drive device 13 has the i th, i + 5 th, i + 10 th, frame image components d _i , d _{i + 5} , d _{i + 10} ,. A BMP still image file is stored. The second external drive unit 14 has a BMP-type still image comprising the frame image components d _{i + 1} , d _{i + 6} , d _{i + 11} ,... Of the moving image, i + 1, i + 6, i + 111,. An image file is stored. The third external drive device 15 has a BMP-type still image comprising i + 2th, i + 7th, i + 12th,... Frame image components d _{i + 2} , d _{i + 7} , d _{i + 12} ,. An image file is stored. The fourth external drive device 16 has a BMP-type still image comprising i + 3th, i + 8th, i + 13th,... Frame image components d _{i + 3} , d _{i + 8} , d _{i + 13} ,. An image file is stored. The fifth external drive device 17 has a BMP-type still image comprising i + 4th, i + 9th, i + 14th,... Frame image components d _{i + 4} , d _{i + 9} , d _{i + 14} ,. An image file is stored. Finally, the still image management information file is stored in all of the first to fifth external drive devices 13 to 17.

  Note that the number of capture buffer areas secured in the system memory and the number of external drive devices may be two to four, or six or more. For example, when a moving image to be captured is a full high-definition resolution and a frame rate of 30 fps, the new still image is captured each time a still image that forms a new frame image component of the moving image is written in the display frame buffer area. By capturing in the buffer area (that is, capturing 30 times per second), three capture buffer areas and three external drive devices can be secured in the system memory. Further, even in the case of high resolution such as 4K, it is possible to cope with the problem by increasing the capture buffer area secured in the system memory and the external drive device. The number of capture buffer areas secured in the system memory and the number of external drive devices are not necessarily the same.

  Further, in the above-described embodiments and modifications thereof, the moving image data incorporated in the video viewer program has been described as an example in which one moving image is displayed on the screen, but a plurality of moving images are displayed on the screen. It may be what you do. That is, moving image data displays a plurality of moving images of a small size in one screen, and a GPU periodically updates a still image including a plurality of frame image components constituting a plurality of moving images. However, it may be drawn in the frame buttsfa area. Even in this case, the still image written in the display frame buffer area in synchronization with the refresh rate is periodically taken into the capture buffer area secured in the system memory, converted into a BMP format still image file, It may be transferred to one of a plurality of external drive devices and stored additionally.

For example, four moving images DA to DD having a frame rate of 60 fps, 30 fps, 10 fps, and 1 fps captured by four surveillance cameras are displayed in a quadrant screen, and the GPU has a refresh rate of 60 Hz. Consider a case where a still image for one screen drawn in the frame buttsfa area is updated. As shown in FIG. 9, the still image S ′ _i drawn in the display frame buttsfa area at a certain time by the GPU includes frame image components da _{i to} dd _i constituting the moving images DA to DD. Next, the still image S ′ _{i + 1} drawn after 1/60 second includes frame image components da _{i + 1 to} dd _{i + 1} constituting the moving images DA to DD. Hereinafter, the still image S ′ _{i + 1 + n} drawn every n / 60 seconds includes frame image components da _{i + 1 + n to} dd _{i + 1 + n} constituting the moving images DA to DD. (Where n = 1, 2, 3,...).
Here, since the moving image DA has a frame rate of 60 fps, the frame image components da _i , da _{i + 1} , da _{i + 2} , da _{i + 3} ,... Are all new frame image components. Since the moving image DB has a frame rate of 30 fps, _{every other} frame image component db _i , db _{i + 1} , db _{i + 2} , db _{i + 3} ,. It is an ingredient. Since the moving image DC has a frame rate of 10 fps, the frame image components dc _i , dc _{i + 1} , dc _{i + 2} , dc _{i + 3} ,... Same frame image components. Since the moving image DD has a frame rate of 1 fps, the frame image components dd _i , dd _{i + 1} , dd _{i + 2} , dd _{i + 3} ,... Become new frame image components at intervals of 1 second, and 10 consecutive images are the same. It is a frame image component.
The CPU captures the still images S ′ _i , S ′ _{i + 1} , S ′ _{i + 2} , S ′ _{i + 3} ,... In the capture buffer area secured in the system memory at a refresh rate of 60 Hz, and the BMP format. And cyclically transferred to one of a plurality of external drive devices for additional storage. One or a plurality of capture buffer areas may be secured in the system memory. When securing a plurality of capture buffer areas, the capture memory area may be cyclically captured in one of them (see FIG. 8).

  The present invention is applicable to a case where a still image sequence including frame image components constituting a moving image in time order is continuously captured by a personal computer, a video device, a video analysis device, or the like.

1 moving image capture device 2 CPU
3 System memory 4 Video card 5 Chipset 8, 9, 10 SATA3.0 controller 11, 12 USB3.0 controller 13 First external drive device 14 Second external drive device 15 Third external drive device 16 Fourth External drive device 17 Fifth external drive device 30 GPU
31 Video RAM
33 display device FB display frame buffer area CB capture buffer area CB1 first capture buffer area CB2 second capture buffer area CB3 third capture buffer area CB4 fourth capture buffer area CB5 fifth Capture buffer area

Claims (2)

A method of accumulating moving images displayed on a computer screen,
Prepare multiple SSD still image storage means for storing still images,
Each time a still image of a new frame of a moving image is written into the display frame storage means,
Cyclically transferring the additional still image for one frame to one of a plurality of SSD-type still image storage means for additional storage;
A method of accumulating moving images by a computer. A method of accumulating moving images displayed on a computer screen,
Prepare multiple SSD still image storage means for storing still images,
The still image is periodically read out from the display frame storage means in which the still image including the frame image component constituting the moving image is periodically written, and is circulated to one of the plurality of SSD type still image storage means. Transfer it and store it additionally
  A method of accumulating moving images by a computer.

Images