TWI554114B - Method of seamless recording for continuous video string file - Google Patents

Description

Method for seamlessly recording continuous video stream files

The present invention relates to a method of seamlessly recording video stream files.

In recent days, technology has become a very popular tool, and with the different needs of users, various types of equipment can be installed in the car, such as global positioning system (GPS), or vehicle safety. Monitoring systems, etc., are currently widely used by car owners or drivers.

The vehicle safety monitoring system is generally a device that utilizes audio and video recording, such as a commonly used digital video recorder (DVR, Digital Video Recorder), and is connected to various monitoring devices. However, in the continuous recording process, the traditional driving recorder has many problems, such as the so-called "drop-down phenomenon", so that the overall continuous recording of multiple video files creates a temporal discontinuity, and the bottom will be graphically Description.

Please refer to FIG. 1. FIG. 1 is a schematic diagram showing the flow of data processing for continuous video recording by a conventional digital video recorder and recorder for a vehicle. When the user starts the periodic recording (step S110), the video encoding function is started (step S120), and the time of one cycle (for example, 3 minutes) is started, and a new video file is created at the same time (step S130).

Moreover, on the other hand, it is detected whether a frame is received (step S140), which can be determined by determining whether the vertical synchronization signal (V_sync) of the frame is received. If a frame is received, compression is encoded (step S150) and stored (step S160) to the queue buffer, and then the video file is written (step S170). Then, when the cycle time has not ended, the data of the picture frame is continuously received, but when the cycle time ends, the data of the picture frame is stopped, and the video code is stopped at the same time (step S180).

At this time, in the write file portion, if there is still frame data in the queue buffer, it will be written into the video file until there is no frame data in the queue buffer (step S190). Then, the video file is packaged in step S192 (for example, updating the header file related information, file related information) until the video file is closed.

It is worth noting that, within the time period of waiting for the file to be closed (for example, 2 seconds) in step S194, any frame data cannot be received because the video encoding has been stopped. Therefore, during this period of time (2 seconds), the so-called "drop-down phenomenon" occurs, so that a plurality of video files continuously recorded in the whole cause a temporal discontinuity, and this will become an important issue.

The invention provides a method for seamlessly recording a continuous video stream stream file, which can simultaneously process the storage of the picture frame data and the writing of the picture frame data into the video file, and can not be used when the front and back video files are switched. Record audio and video files continuously in a second-minute manner.

The present invention provides a method for seamlessly recording a continuous video stream file, including the following steps. And continuously receiving a video stream, and storing the plurality of first frame data in the video stream in the first temporary storage space according to a receiving stream timing. According to the receiving stream timing, when receiving a plurality of frame data in the video stream, detecting whether the first temporary storage space is full, if the first temporary storage space is not full, storing the frame data in the first temporary Save space and continuously detect whether the first temporary storage space is full. If the first temporary storage space is full, the second temporary storage space is enabled to store the frame data that has not been stored in the frame data. And writing the first and second frame data stored in the first space and the second space into a video file according to the receiving stream timing and the switching sequence of the video file, wherein the second frame data stored in the second space is It is received during the post-production phase of the video file of the previous video file, and the second temporary storage space is at least sufficient to store the second frame data.

The method for seamlessly recording a continuous video stream in an embodiment further includes: after starting a cycle of recording, establishing a first video file, writing a header file information, and starting timing until the time of the cycle is cut off.

The method for seamlessly recording a continuous video stream file in an embodiment further includes continuing to write the first and second frame data to the video file during the period of the periodic recording.

The method for seamlessly recording a continuous video stream in an embodiment further includes entering the video file post-stage after the time of the periodic recording ends, and continuously receiving the video stream.

In an embodiment of the method for seamlessly recording a continuous video stream file, the steps of the video file post-production stage include writing a plurality of video frame information; updating the header information; and closing the video file.

In an embodiment of the method for seamlessly recording a continuous video stream, the method further includes: after starting the continuous cycle recording, establishing the next video file.

In a method for seamlessly recording a continuous video stream file, the first and the second temporary storage space divide the first temporary storage space into a plurality of first sub-storages of the N area according to a video coding standard. Space, and dividing the second temporary storage space into a plurality of second sub-storage spaces of the M area, wherein N and M are positive integers.

In an embodiment of the method for seamlessly recording a continuous video stream file, wherein each time a data file is written to the video file, the first frame data and the second frame of the first sub-storage space are written at a time. Data, or the second frame of the second sub-storage space.

In an embodiment of the method for seamlessly recording a continuous video stream file, the first or second sub-storage space is composed of a plurality of queues.

In an embodiment of the method of seamlessly recording a continuous video stream, the first and second frames stored in the first and second temporary storage spaces are encoded and compressed.

In an embodiment of the method of seamlessly recording a continuous video stream file, wherein the video coding standard is the H.264/AVC standard.

In a method for seamlessly recording a continuous video stream file, the first temporary storage space is divided into a plurality of first sub-storage spaces of the N area, and stored and written according to the order of the first sub-storage spaces. Enter the first and second frame materials.

In a method for seamlessly recording a continuous video stream file, the second temporary storage space is divided into a plurality of second sub-storage spaces of the M area, and according to the order of the second sub-storage spaces of the M area. Store and write the second frame data.

The above described features and advantages of the present invention will be more apparent from the following description.

The following embodiment will describe a method for seamlessly recording a continuous video stream file, which is suitable for a vehicle security monitoring system, such as a DVR (Digital Video Recorder). The method for seamlessly recording continuous video stream files proposed by the invention can make the digital video recorder (DVR) for the vehicle, that is, the driving recorder, in the continuous recording process, there is no so-called falling-off phenomenon. A plurality of audio and video files capable of achieving continuous continuous recording.

In the method for seamlessly recording a continuous video stream file proposed by the present invention, the video file can continue to receive the frame data during the post-production process, and is encoded and compressed to be stored in an appropriate temporary storage space. By arranging the appropriate temporary storage space, it is possible to continuously record the audio and video files in a time-delay manner when the front and rear audio and video files are switched.

In order to clarify the content of the present invention, the following specific examples are given as examples in which the present invention can be implemented.

Please refer to FIG. 2. FIG. 2 is a flow chart of a method for seamlessly recording a continuous video stream file according to an embodiment of the present invention. In an embodiment of the present invention, the method of seamlessly recording a continuous video stream file may include the following steps: starting video stream processing (step S210), storing operation (step S220), writing operation (step S230), and turning off video and audio. Stream processing (step S240). In this embodiment, if the user starts to write the frame data received in the video stream to the video file, the storing operation (step S220) and the writing operation (step S230) simultaneously operate in parallel.

That is to say, in the stage of starting the video stream processing, as in step S210 described above, after the user initiates the video stream processing, the video recording device (not shown) continuously receives multiple of the video stream continuously. Frame data, such as the speed of 30 frames per second, receives data from the video stream. In the above step S220, according to the timing of receiving the stream data, the plurality of frame data in the received video stream are sequentially stored in the first temporary storage space, and the other portions received in the video stream are subsequently received. The frame data may be stored in the first or second temporary storage space depending on whether the first temporary storage space is full.

In an embodiment, if the user has not started to record video and audio information, the video recording device (not shown) can be regarded as a pre-recorded function, for example, a pre-recorded space having S seconds (S is a positive integer). It is set according to the designer's capacity for the first temporary storage space. Therefore, as the time passes, the data of the video stream is continuously received, and the audio and video data in the first temporary storage space is continuously overwritten so that the first temporary storage space can only pre-record the latest audio and video data for S seconds. . For example, after the user starts the video stream data processing program, the video recording device starts to continuously receive the video stream data, and stores the frame data in the video stream in the first temporary storage space. If the user starts to record video and audio information at the time after 1 minute, the first temporary storage space with pre-recording function can only store the latest audio and video data for 20 seconds. After 1 minute, the user started to record video and audio information, and will record the video and audio information back to the 40th time.

What follows is that during the stage of storing video stream data, when the frame data is received one after another, it will detect whether the first temporary storage space has been filled by the frame data. If the first temporary storage space is not yet filled, and there are other remaining spaces, in an embodiment, the received subsequent frame data may be first stored in the unused space in the first temporary storage space. . Because, in the post-production stage of the audio-visual file, other subsequent frame data is received, and the frame data that is scheduled to be written into the audio-visual file cannot be overwritten (because the frame data is lost, meaning that the second is lost). Therefore, during the process of storing the subsequent frame data in the first temporary storage space, it is continuously detected whether the first temporary storage space is full. If it is detected that the first temporary storage space is full, the second temporary storage space is enabled to store the subsequently received frame data. In addition, in an embodiment of the present invention, the capacity of the second temporary storage space is at least sufficient to store the subsequent frame data received in the post-production phase of the audio-visual file.

In the writing operation of the above step S230, the frame data is sequentially written into the video file according to the receiving stream timing and according to the video file switching sequence, and the subsequently received frame data can be sequentially written to the next video file. . For example, when the first part of the received frame data is written into the fifth video file, the second part of the frame data received (ie, the subsequent frame data) is written into the sixth. A video file. The second part of the frame data received later is the frame data received in the post-production stage of the fifth video file.

In the above step S240, the video recording device stops receiving the first frame data and the second frame data in the video stream after the user closes the video stream processing. Therefore, in an embodiment of the present invention, the storing operation (step S220) and the writing operation (step S230) are performed in the user's activation of the video stream processing (step S210) and the closing of the video stream processing (step S240). That is to say, as long as the user activates the video recording device, the video file can be continuously recorded in a time-out manner.

Please refer to FIG. 3. FIG. 3 is a flow chart of a method for writing operations in FIG. In an embodiment of the invention, the detailed actions of the write operation steps will be further taught herein. In step S310, if the user has not started the periodic recording, the user will continue to wait and continuously detect whether the user has a startup cycle video. On the other hand, if in step S310, when the user activates the function of the periodic recording, the first video file in the above embodiment of Fig. 2 is established. Moreover, the first video file is initialized, so header information such as the file length, the recording start time, the file name, and the file format are written in the first video file (step S320).

It is worth mentioning that after the first video file is created and the header information is written, a cycle time is started to count. For example, a cycle time can be 1 minute or 3 minutes or 5 minutes, which can be set according to the designer to allow the user to select or input. Next, in step S330 (writing the file), the first frame data stored in the video stream in the first temporary storage space is simultaneously written into the first video file in parallel. At this time, the video recording device (not shown) will continue to receive the first frame data in the video stream continuously. After each operation of writing the file ends, it is detected whether the cycle time set by the user has been timed out (step S340), and if it has not been timed, the first stored in the first temporary storage space will continue. A picture frame data is written to this first video file.

Next, if it is detected that the cycle time set by the user has been timed out, it indicates that the cycle time has ended and it is necessary to start entering the video file post-production phase of the first video file. Please note that during the post-production phase of the AV file, the AV recorder will continue to receive video streams continuously. Moreover, the subsequent frame data as described in the embodiment of FIG. 2 above is the data received during the post-production phase of the audio-visual file (ie, the second frame data in the video stream). In step S350 (file post-production), each video frame information will be written in the first video file, and the header information (for example, the end time of the file record or the like) is further updated, and then closed. The first video file. Thereafter, if the user does not activate the continuous cycle recording function, the video recording device turns off the function of the periodic recording (step S370) to stop recording the video information of each cycle. Next, the function of the video stream processing is turned off (step S240).

If the user has the function of starting the continuous cycle recording, the process proceeds to step S320 (create a new file), and after the second video file is created, steps S330 to S360 are repeated, unless the user turns off the video recording device or When there is no power to provide normal operation of the video recording device, the video recording device stops recording the video and audio information. In the process of this continuous cycle recording, assuming that the Xth video file has been created, the Xth video file will be initialized first (for example, the header file information is written) and a cycle time will be restarted (for example, 3). Minutes) to time. Then, within the one cycle time (for 3 minutes), the first frame data and the second frame data are written into the Xth video file in step S330. The second frame data is the frame data received during the audio-visual stage of the X-1 video file. Moreover, after each operation of writing the file ends, it is detected whether the cycle time set by the user has been timed out (step S340), and if it has not been timed, it will continue to be stored in the first and second temporary The first and second frame data of the storage space are written into the Xth video file.

Next, if it is detected that the cycle time set by the user (for example, 3 minutes) has been counted, it means that the time of 3 minutes has expired and it is necessary to start entering the video file post-stage of the Xth video file. During this period, the video recording device will continue to receive the frame data in the video stream (meaning the second frame data).

In step S350, each video frame information will be written in the Xth video file, and the header file information (such as the end time of the file record or other) is further updated, and the Xth video file is closed, and The Xth file is stored to a first storage medium (not shown), such as a hard disc drive (HDD), a solid state disks (SSD), and an erasable programmable read only memory. (electrically erasable programmable read only memory (EEPROM) or other non-volatile memory (NVM). In addition, after the X video file is closed, if the user has the function of starting continuous cycle recording, the next cycle will be started, and the X+1th audio and video file is created in step S320, and then step S320 is repeated. Step S360.

Please refer to FIG. 4. FIG. 4 is a flow chart showing the method of storing operations in FIG. 2. In an embodiment of the invention, the detailed actions of the storage operation are further taught herein. After the user initiates the video stream processing, the video recording device continuously receives the first frame data and the second frame data in the video stream, for example, receiving the frame data at a speed of 30 frames per second. That is to say, an average frame is received every 1/30th of an hour. Therefore, in step S410, it is detected whether a frame is received, which can be determined by determining whether the vertical synchronization signal (V_sync) of the frame is received. If you have not received a frame, you will continue to wait. If a frame is received, the frame will be encoded and compressed according to the video coding standard, for example, according to the video coding standard of H.264/Advanced Video Coding (AVC), but not This embodiment is limited.

In an embodiment of the present invention, the video coding standard H.264/AVC can eliminate the temporal redundancy of the movie by using motion estimation and motion compensation, and utilizes Discrete Cosine Transform (DCT) and scalar quantity. Quantization eliminates redundancy in the film space and combines entropy coding to eliminate coding redundancy. Further, the seven different size and shape blocks (16x16, 16x8, 8x16, 8x8, 8x4, 4x8 and 4x4) provided by H.264/AVC can be used to increase the flexibility of the comparison and reduce the alignment. error. For example, when the received frame data is in an area where the motion is simpler or the material is smoother, a larger block can be used to reduce the motion vector that needs to be encoded. When the received frame data is in a region with more complex motion or finer texture, smaller blocks are used to increase the correctness of the comparison.

Then, in the present embodiment, the 1/4 pixel accuracy search provided by the H.264/AVC standard can be used to improve the accuracy of the motion compensation. For example, a value of a 1/2 pixel position can be obtained by interpolating adjacent integer pixel positions, and a value of a 1/4 pixel position can be obtained by interpolating adjacent 1/2 pixel positions. Moreover, the present embodiment can estimate the similarity of adjacent block pixels in the picture frame by using the H.264/AVC standard for the nine prediction modes provided by the intra-frame, and then The coded block and the residual of the predicted value are converted and encoded. It should be noted that the H.264/AVC standard used in the embodiment of the present invention can retain more frames as reference frames (up to 31), and is utilized in an embodiment of the present invention. The 30 frames are used as a reference frame, so that 30 frames are encoded as a group and compressed for storage to the first or second temporary storage space.

Next, it is to be noted that all of the encoded and compressed first and second frame materials processed in the step S430 are processed in the H.264/AVC standard, and thus, in the embodiment of the present invention, The planning of the storage space of the frame data shall be in accordance with the data processing of the H.264/AVC video coding standard. Please refer to FIG. 5 first. FIG. 5 is a schematic diagram showing the first and second temporary storage spaces. In the first embodiment, the first temporary storage space 510 and the second temporary storage space 520 are respectively divided into a plurality of first sub-storage spaces of the N-region and a plurality of M-regions according to the H.264/AVC standard. The second sub-storage space (N, M is a positive integer). The first temporary storage space 510 stores and writes the first and second frame materials according to the order of the first sub-storage space of the first to Nth regions. The second temporary storage space 520 stores and writes the second frame data in the order of the second sub-storage space of the first to the Mth regions. Note that these first or second child staging spaces can be considered as multiple queues (meaning that one child scratch space is a queue). In addition, in this embodiment, the first temporary storage space 510 and the second temporary storage space 520 are mutually continuous and adjacent spaces. In other embodiments, the first temporary storage space and the second temporary storage space may be discontinuous and non-adjacent spaces. Moreover, the first and second temporary storage spaces may be random-access memory (RAM) or other volatile memory (VM).

Therefore, in one embodiment of the present invention, the 30 frames are further encoded and compressed to be stored in the first temporary storage space 510 in the first sub-storage space or the second in the first temporary storage space 510. The second sub-storage space of the M area of 520 in the temporary storage space. In other words, there are 30 encoded and compressed frame data in each sub-storage space (ie, each queue). Since the 30 frames are dependent on each other, when the frame data of the first temporary storage space 510 or the second temporary storage space 520 is to be written into the Xth video file, it must be written every time. For X video files, write the first frame and the second frame data in the first sub-storage space or the second frame data in the second sub-storage space at a time (ie, write one queue at a time) The amount of frame data). In this way, when the audio and video files are played, the starting frame of each group of frame materials (30 frames) can be read.

Please refer to FIG. 6. FIG. 6 is a flowchart illustrating a method for seamlessly recording a continuous video stream. The method steps of seamlessly recording the continuous video stream file include the following steps: First, the video stream is continuously received (step S610). Then, according to the received stream timing, the first frame data in the video stream is stored in the first temporary storage space (step S620). Then, according to the received stream timing, when the second frame data in the video stream is received, it is detected whether the first temporary storage space is full (step S630). If the first temporary storage space is not full, the second frame data is stored in the first temporary storage space (step S640). Next, it is continuously determined whether or not the second frame material is received (step S660). In step S660, if the second frame data is continuously received, the process returns to step S630 to continue detecting whether the first temporary storage space is full.

On the other hand, in the determination in step S630, if the first temporary storage space is full, the second temporary storage space is enabled to store the frame data that has not been stored in the second frame data (step S650). Then, the first and second frame data are written into the Xth video file in the at least one continuous video file according to the receiving stream timing and the video file switching sequence, where X is a positive integer (step S670). The second frame data is received in the post-production phase of the video file of the X-1th video file, and the second temporary storage space is at least sufficient to store the second frame data. The details of the method for seamlessly recording a continuous video stream file in the embodiment of the present invention are described in detail in the above embodiments and embodiments, and are not described in detail below.

In summary, the method for seamlessly recording a continuous video stream file proposed by the embodiment of the present invention has at least the following advantages, for example, the two operations of storing the frame data and writing the frame data to the video file can be processed simultaneously and in parallel. In addition, when the front and back audio and video files are switched, the audio and video files can be continuously recorded in a time-out manner.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the invention, and any one of ordinary skill in the art can make some modifications and refinements without departing from the spirit and scope of the invention. The scope of the invention is defined by the scope of the appended claims.

S110~S190‧‧‧Steps

S192, S194‧‧‧ steps

S210~S240‧‧‧Steps

S310~S370‧‧‧Steps

S410~S430‧‧‧Steps

S610~S670‧‧‧Steps

510‧‧‧First temporary storage space

520‧‧‧Second temporary storage space

FIG. 1 is a flow chart showing the data of continuous recording under the prior art.

2 is a flow chart of a method for seamlessly recording a continuous video stream file according to an embodiment of the present invention.

FIG. 3 is a flow chart showing the steps of the writing operation in FIG.

4 is a flow chart showing a method of storing operations in FIG. 2.

FIG. 5 is a schematic diagram showing first and second temporary storage spaces.

6 is a flow chart depicting a method of seamlessly recording a continuous video stream.

S210～S240. . . step

Claims (13)

A method for seamlessly recording a continuous video stream file includes: continuously receiving a video stream; storing the plurality of first frame data in the video stream in a first temporary storage space according to a receiving stream timing; According to the receiving stream timing, when receiving the plurality of second frame data in the video stream, detecting whether the first temporary storage space is full, and if the first temporary storage space is not full, storing the The second frame data is in the first temporary storage space and continuously detects whether the first temporary storage space is full. If the first temporary storage space is full, a second temporary storage space is enabled to store the first temporary storage space. The second frame data is not stored in the second frame data; and the first and the second frame data are written into a video file according to the receiving stream timing and a video file switching sequence, wherein the second frame The data is received during the post-production phase of a video file of the previous video file, and the second temporary storage space is at least sufficient to store the second frame data. For example, the method for seamlessly recording a continuous video stream file according to the first aspect of the patent application includes: after starting a period of video recording, establishing a first video file, writing a header file information, and starting timing until The time of the cycle is cut off. The method for seamlessly recording a continuous video stream as described in claim 2, further comprising: continuing to write the first and the second frame data into the video during the recording period of the period file. The method for seamlessly recording a continuous video stream as described in claim 2, further comprising: entering the video file after the end of the period of the video recording, continuously receiving the video stream. The method for seamlessly recording a continuous video stream file according to claim 4, wherein the step of the video file post-production stage comprises: writing a plurality of video frame information; updating the header information; Close the video file. The method for seamlessly recording continuous video stream files as described in claim 2, further comprising: after starting a continuous cycle video recording, establishing a next video file. The method for seamlessly recording a continuous video stream file according to claim 1, wherein the first and the second temporary storage space divide the first temporary storage space into N regions according to a video coding standard. a plurality of first sub-storage spaces, and dividing the second temporary storage space into a plurality of second sub-storage spaces of the M-region, wherein N and M are positive integers. The method for seamlessly recording a continuous video stream as described in claim 7, wherein each time the data is written to the video file, the first one of the first sub-storage spaces is written at a time. And the second frame data, or the second frame materials of the second sub-storage space. The method for seamlessly recording a continuous video stream file according to claim 8, wherein the first or the second sub-storage spaces are a plurality of queues. The method for seamlessly recording a continuous video stream as described in claim 1, wherein the first and second frames stored in the first and second temporary storage spaces are encoded And compressed. A method for seamlessly recording a continuous video stream as described in claim 7, wherein the video coding standard is the H.264/AVC standard. The method for seamlessly recording a continuous video stream file according to claim 1, wherein the first temporary storage space is divided into a plurality of first sub-storage spaces of the N area, and according to the N areas The first sub-storage space sequentially stores and writes the first and the second frame materials, where N is a positive integer. The method for seamlessly recording a continuous video stream file according to claim 1, wherein the second temporary storage space is divided into a plurality of second sub-storage spaces of the M area, and according to the M area The second sub-storage space sequentially stores and writes the second frame materials, where M is a positive integer.