JP2020048182A - Method and device for constituting and displaying integrated image file having image streams of different picture quality successively recorded - Google Patents

Abstract

To provide a method and a device that enable a vehicular video recording device with relatively low specifications to smoothly display a video-recorded image and also enable one vehicular image video recording device to simultaneously and smoothly display images of a plurality of channels.SOLUTION: A method of constituting an integrated image file having image streams of different picture quality recorded successively includes: a procedure for generating a first image stream of first picture quality from an image obtained by imaging the front; a procedure for processing the image or the first image stream to generate a second image stream of second picture quality; a procedure for combining first meta data with the first image stream at intervals of a predetermined first time to constitute a first sub-file and also combining second meta data with the second image stream to constitute a second sub-file; and a procedure for constituting the integrated image file while connecting the second sub-file to a terminal of the first sub-file.SELECTED DRAWING: Figure 5

Description

  The present invention provides a method for continuously recording image streams of different qualities on one permanent storage medium to form one integrated image file and a method for displaying the integrated image file thus recorded on a display device. The present invention relates to a device for displaying an integrated image file.

Technology behind the invention

  Recently, vehicular image recorders such as black boxes can record 4K UHD high resolution, high bit rate, and high frame rate high quality images. Accordingly, in order to check the recorded high-quality image on the display device, a device with a specific high specification (for example, a PC, a smartphone, a tablet, or the like) capable of reproducing the image is required.

  Also, in order to reproduce a high-quality image on such a specific high-spec device, the high-quality image recorded by the vehicular image recording device should be transmitted to the specific high-spec device. In order to transmit a high-quality image with a large capacity, a network use cost and a transfer time are required.

  Therefore, there is a demand to display the stored high-quality image on a display surface built in the in-vehicle image recording apparatus itself.

  However, the image recording device for a vehicle has relatively low specifications, and the power of hardware / software is concentrated on the function of recording a captured image, and there is no problem in recording a high-quality image. The decoding process for displaying high-quality recorded images on the display surface may not be smooth. Therefore, there is a problem that the displayed image is interrupted or delayed.

  Further, recent image recording apparatuses for vehicles provide a function of receiving respective images from a plurality of channels (for example, a front imaging channel and a rear imaging channel) and storing them as separate image files.

  Therefore, when trying to simultaneously display images of a plurality of channels on the display surface of one image recording device, the problem that the images are interrupted or delayed can appear more seriously. The images of the channels may be displayed out of sync.

Issues to be solved

  The present invention has been made to solve the above-described problem, and enables a recorded image to be smoothly displayed by a vehicular image recording device having relatively low specifications.

  Furthermore, the present invention enables images of a plurality of channels to be simultaneously and smoothly displayed on one image recording apparatus for a vehicle.

Solution to the problem

  In order to solve the above-mentioned problem, a method of configuring an integrated image file in which image streams of different image qualities are continuously recorded according to the present invention includes the steps of: (Ii) processing the image or the first image stream to generate a second image stream of a second image quality; and (iii) generating a first image stream. The first image stream is combined with the first metadata to form a first sub-file, and the second image stream is combined with the second metadata to form a second And (iv) connecting the second sub-file to the end of the first sub-file and recording it to form an integrated image file. .

  In the method, the first metadata includes at least information indicating an end of the first image stream or an end of the first subfile, and the second metadata includes at least the It is characterized by including information indicating that the second sub-file is a second image stream of the second image quality.

  Further, the method is characterized in that the second image quality is lower than the first image quality.

  The method also includes the step (i) of: recording the first image stream in a buffer memory, starting the first sub-file on a permanent storage medium, wherein the first sub-file is shorter than the first time. The method further comprising: successively recording the first image stream recorded in the buffer memory in the first sub-file of the permanent storage medium every predetermined second time; The procedure further comprises: at the first time, terminating a first sub-file in the permanent storage medium, and terminating the second file in the buffer memory; The steps of :) concatenate and record the second sub-file terminated in the buffer memory at the end of the first sub-file in the permanent storage medium, and then record the first sub-file. Starting from the beginning, the second sub It is characterized in further comprising configuring the integrated image file ending at the end of the file.

  Further, according to the present invention, an apparatus for forming an integrated image file in which image streams of different image qualities are continuously recorded includes an image receiving unit that receives an image captured in front, and a first image quality based on the received image. A first image stream, a stream extension unit that processes the image or the first image stream to form a second image stream of a second image quality, and a predetermined first time period. Combining a first metadata with the first image stream to form a first sub-file, and combining a second metadata with the second image stream to form a second sub-file. A file generating unit configured to continuously connect the second sub-file to an end of the first sub-file to form an integrated image file.

  Further, the apparatus further includes: a buffer memory for storing the first and second image streams, and a permanent storage medium for storing the integrated image file, wherein the file generation unit stores the image data in the permanent storage medium. The first sub-file is generated, and the first image stream recorded in the buffer memory at every predetermined second time shorter than the first time is stored in the first storage of the permanent storage medium. Recording as a subfile, at the first time, terminating the first subfile in the permanent storage medium, and terminating the second subfile in the buffer memory, the permanent storage medium The integrated image file by continuously recording the second sub-file terminated in the buffer memory at the end of the first sub-file in It is.

  Also, the apparatus: the second image quality is lower than the first image quality, and the first metadata is an end of the first image stream or the first sub-file. Wherein the second metadata includes at least information indicating that the second sub-file is a second image stream of the second image quality. Things.

  Further, according to the present invention, an apparatus for displaying an integrated image file in which image streams of different image qualities are continuously recorded is a first image in which an image captured in the front is recorded as a first image stream of a first image quality. And a second sub-file in which the first image is recorded as a second image stream of a second image quality is a file acquisition that receives an integrated image file that is configured by being continuously connected to each other. Unit, a file analysis unit that investigates whether the input integrated image file contains the second sub-file, and when the second sub-file is identified by the file analysis unit, And an image display unit for displaying the second image stream of the second sub-file on a display surface.

  Also, the apparatus: the first sub-file includes first metadata indicating an end of the first image stream or an end of the first sub-file, and the second sub-file includes at least Including second metadata indicating that the second sub-file is a second image stream of the second image quality, wherein the file analysis unit is configured to execute the first metadata of the integrated image file. Identifying the end of the first sub-file, examining whether the second sub-file starts at the end of the first sub-file, based on The method is characterized in that the second metadata is read to identify the second image stream.

  Further, according to the present invention, in the method of displaying an integrated image file in which image streams of different image qualities are continuously recorded, the first image from the first channel is used as a first image stream of the first image quality. An integrated image file in which a recorded first sub-file and a second sub-file in which the first image is recorded as a second image stream of a second image quality are continuously connected to each other, and A method for simultaneously displaying, on one display device, an arbitrary image file in which a second image from two channels is recorded, wherein (i) a procedure of setting a main area and a sub area on a display surface of the display apparatus (Ii) displaying an image stream included in the arbitrary image file in the main area; and (iii) displaying the integrated image file as an image file to be displayed in the sub area. And selecting the integrated image file and, if the second sub-file is detected, displaying the second image stream in the sub-area.

  Also, the method includes: the first metadata includes information indicating an end of the first image stream or an end of the first sub-file, and the second metadata includes at least the second Including information indicating that the sub-file is a second image stream of the second image quality; the step (iii) comprises: based on the first metadata of the integrated image file, Detecting the end of one subfile, checking whether the second subfile starts at the end of the first subfile, and reading the second metadata of the second subfile Identifying the second image stream and displaying the second image stream in the sub-region.

  Further, the method is characterized in that: the second image quality is lower than the first image quality, and the sub-area is provided in the main area by a PIP method.

  The method further comprises: (a) generating the first image stream having a first image quality from the first image captured in the front and recording the first image stream in a buffer memory; Processing the first image or the first image stream to generate the second image stream of the second image quality and recording the same in a buffer memory; and (c) storing the first sub-file in a permanent storage medium. And recording the first image stream recorded in the buffer memory in the first sub-file of the permanent storage medium at every predetermined second time, and (d) the second time In a longer predetermined first time period, a first sub-file is formed by combining first metadata with the first image stream in the permanent storage medium; and Linking the second metadata to the second image stream of Ending the second sub-file in the buffer memory, and (e) continuously ending the second sub-file in the buffer memory at the end of the first sub-file in the permanent storage medium. The information is recorded in the.

  Further, according to the present invention, an apparatus for displaying an integrated image file in which image streams of different image qualities are continuously recorded, wherein the first image from the first channel is a first image stream of the first image quality An integrated image file in which a recorded first sub-file and a second sub-file in which the first image is recorded as a second image stream of a second image quality are continuously connected to each other, and A file acquisition unit for receiving an arbitrary image file in which a second image from a second channel is recorded, and selecting the integrated image file as an image file to be displayed in the sub-region, wherein the selected integrated image is selected. A file analyzing unit that checks whether the file contains a second sub-file, and a display device when the file analyzing unit identifies the second sub-file. Setting a main area and a sub area on the display surface, displaying an image stream included in the arbitrary image file in the main area, and displaying the second image of the second sub file in the sub area. And an image display unit for displaying a stream.

  Also, the apparatus: the first sub-file includes first metadata indicating an end of the first image stream or an end of the first sub-file, and the second sub-file includes at least Including second metadata indicating that the second sub-file is a second image stream of the second image quality; wherein the file analyzing unit includes the first metadata of the integrated image file. Detecting the end of the first sub-file based on to determine whether the second sub-file has started at the end of the first sub-file, the second sub-file of the second sub-file Is read to identify the second image stream.

  According to the present invention having the above-described configuration, the captured and generated images are respectively formed into a high-quality stream and a low-quality stream, and these are collectively stored in one file, and the stored file is stored. When the is reproduced later, one of the high-resolution stream and the low-quality stream can be selected and displayed, and the image can be smoothly displayed even with a low-spec device.

  Also, when displaying images of multiple channels together on one display surface, at least one image is displayed in a low-quality stream, so that images are displayed smoothly even on a device with low specifications. be able to.

FIG. 1 is a diagram schematically showing a method of using the image recording device of the present invention in a car. FIG. 2A is a diagram for explaining a method of configuring an integrated image file. FIG. 2B is a diagram showing a configuration of an integrated image file embodied in the MP4 file format. FIG. 3 is a block diagram schematically showing a main part of an apparatus for composing an integrated image file according to an embodiment of the present invention. FIG. 4 is a diagram illustrating a main part of a device capable of displaying image files of a plurality of channels including an integrated image file on a single display surface according to another embodiment of the present invention, and images of the plurality of channels in a PIP method. It is a figure showing the example of a display. FIG. 5 is a flowchart of a method for displaying image files of a plurality of channels including an integrated image file on one display surface. FIG. 6 is a flowchart of a method for checking the presence or absence of a second image stream in the method of FIG.

Specific contents for carrying out the invention

  Hereinafter, with reference to the attached drawings, a method of continuously recording image streams of different image quality on one permanent storage medium to form one integrated image file and the integrated image file thus recorded according to the present invention A preferred embodiment of a method for displaying an image on a display device and a device for displaying these integrated image files will be described. Incidentally, the terms indicating the respective components of the present invention are exemplarily named in consideration of their functions, and therefore, it is not necessary to predict or limit the technical contents of the present invention by the terms themselves. .

  First, a method of using the image recording device according to an embodiment of the present invention in a car, that is, an example of using the image recording device as a black box will be described with reference to FIG. On the other hand, a general black box can be provided with an image display unit by itself, and can decode and store an image recorded and stored to visually display the image. Accordingly, an apparatus for continuously recording image streams of different qualities presented in the present invention on one permanent storage medium to form one integrated image file and an apparatus for displaying the integrated image file thus recorded are as follows. Can be described as "black box for vehicle" or "black box". Further, a method of continuously recording image streams of different image quality on one permanent storage medium to form one integrated image file and a method of displaying the integrated image file thus recorded on a display device are also described in a vehicle black box. It can be understood that it is executed in.

  Referring to the drawings, the black box may be composed of a main body (101) and an additional camera (102).

  The black box main body (101) is disposed, for example, in front of the vehicle (C) and can include a front camera (not shown) that looks ahead. The images captured by the front camera are processed in the main unit (101) to form digital image streams, and these image streams are divided into predetermined time units (for example, 60-second cycles) and the main unit (101) It can be recorded and stored as an image file on a permanent storage medium (130), which can be provided internally or externally. The main body (101) can also include a display surface (D) for displaying a captured image in real time or reproducing an arbitrary image file stored in the permanent storage medium (130) to reproduce the image. Can be displayed.

  At this time, the display surface (D) provided in the black box body (101) has a relatively small size and a relatively small number of pixels (for example, CGA, VGA, SVGA, etc.) and can be realized with low performance. it can. Therefore, in order to display an image encoded with a relatively high image quality (for example, HD, FHD, etc.) here, image processing for lowering the image quality is required. The black box is designed primarily for storing captured images, so the minimum hardware / software processing power that can perform the function of encoding and storing captured images It is to have. Therefore, in order to execute a process for displaying an image, in particular, an image conversion process for lowering the image quality and, at the same time, a process for displaying the image on the display surface (D), the processing capability of the image processing device itself is somewhat insufficient.

  Therefore, according to the present invention, when storing a captured image, a high-quality image is stored to form one image file (for example, a first sub-file), and the captured image is added to the image file. A method is used in which a single image file (for example, a second sub-file) is converted into a high-quality image and then combined into one file and stored. Accordingly, when a stored image file is displayed on its own display surface, the use of a low-quality image reduces the burden of image processing and allows the image to be displayed smoothly. In addition, by using a low-quality image, it is possible to smoothly cope with a section search or high-speed reproduction of an image.

  To realize these functions, the black box body (101) according to the present invention forms individual image files of different image qualities based on the captured images, Must be able to implement the function of constructing one integrated image file by linking In addition, if necessary, the black box body (101) according to the present invention selects any one of the single integrated image files configured as described above (for example, a low-quality image file) and selects the selected image file. It must be possible to implement a function of displaying the image stream of the created image file on the display surface.

  Meanwhile, the black box according to the present invention may include another camera (102) directed in a direction other than the direction in which the front camera is looking.

  An image file composed of images captured by the front camera and an image file composed of images captured by the additional camera (102) can be stored together on the same permanent storage medium (130).

  At this time, the black box (101) configures images captured by the front camera (for example, images of the first channel, that is, the first image or the front image) into high-quality and low-quality image streams, The sub-file of the high-quality image stream and the sub-file of the low-quality image stream can be integrated and stored as one integrated image file. In addition, the black box (101) forms images (for example, images of the second channel, that is, the second image or the rear image) captured by the rear camera (102) into high-quality and low-quality image streams. Then, the sub-file of the high-quality image stream and the sub-file of the low-quality image stream can be integrated and stored as another integrated image file.

  When the image of the first channel and the image of the second channel are to be displayed simultaneously on one display surface (D), the main area (M) and the sub area (S ), The image of the channel displayed in the main area (M) can be displayed as a high quality image, and the image of the channel displayed in the sub area (S) can be displayed as a low quality image.

  As a result, after performing the minimum image processing on the high quality image, the image can be displayed in the main area (M) occupying most of the display surface (D), and the minimum image processing can be performed on the low quality image. After that, the image can be displayed in the sub-region (S), which is a small part of the display surface, so that the burden of image processing of the black box (101) is reduced and the images of the two channels can be displayed simultaneously and smoothly. Will be able to

  In order to implement these functions, the black box (101) of the present invention divides the display surface (D) by the PIP method, and places a high-quality image stream stored in an image file in the main area (M). In the sub-region (S), a function of selecting an image stream stored with low image quality in the integrated image file and displaying the selected image stream must be realized.

  On the other hand, in another method, display can be performed using low-quality images in both the main area and the sub area.

  FIG. 2a is a diagram for explaining a method of configuring an integrated image file according to the present invention.

  The integrated image file presented in the present invention is configured such that a first sub-file and a second sub-file that can function independently of each other are continuously connected to each other.

  The first sub-file is a part for encoding a captured image into a high-quality image and storing the encoded image. The first sub-file links a header (or first metadata) of the image itself to a frame of the high-quality image. The first image stream (Video st1 # 1 frame, Video st1 # 2 frame, ..., Video st1 #N frame) is included. The first subfile can also function as one complete image file by itself.

  Similarly, the second sub-file is a part that encodes a captured image into a low-quality image and stores the encoded image, and includes a header (eg, second metadata) of itself and a low-quality image. , And video st2 # 1 frame, Video st2 # 2 frame, ..., Video st2 #N frame. The second subfile can also function as one complete image file by itself.

  FIG. 2B is a diagram showing a configuration of an integrated image file embodied in the MP4 file format. As shown in FIG. 2B, the image file in the present invention uses the MPEG-4 (or MP4) file type as an example. The MP4 file type is composed of a plurality of boxes, and can basically have FTYP, MOOV, and MDAT boxes. Each box includes a portion for displaying the size and type of the box, and a portion for recording data or data of a sub-box.

  Here, data for reproducing an image, for example, an image stream is recorded in the MDAT box. The FTYP box must always be placed at the top of the file with priority, and records information that can confirm file compatibility. The MOOV box stores all information related to the image stream recorded in the MP4 image file. Further, a USER box may be provided, but the present invention will be described assuming that it is not present.

  2a corresponds to, for example, the FTYP box and the MOOV box in FIG. 2b. A series of Video frames corresponds to actual image frames contained in the MDAT box.

  As described above, the integrated image file presented in the present invention is configured in such a manner that two individual image files having different image qualities are continuously connected. Therefore, the black box can select one of the two consecutive sub-files and use the image stream of the selected sub-file as it is.

  By the way, there is a method of storing images of different qualities in one MDAT box at the same time even in the conventional image file. However, in this conventional method, complete image streams are not stored continuously but are alternately stored in frame units. That is, frame units are alternately arranged and stored as in high-quality image frame # 1-low-quality image frame # 1-high-quality image frame # 2-low-quality image frame # 2. Therefore, in order to utilize an image of a desired image quality in a black box, a process of skipping and extracting image frames one by one is necessary, which puts a burden on processing capacity.

  In contrast, according to the integrated image file constructed by the above-described method of the present invention, image frames of the same image quality are successively concatenated to form a complete single image stream, and these complete image streams are formed. Since a single sub-file is composed of a single image stream and these sub-files are concatenated to form a single integrated image file, the black box specifies the desired sub-file within the integrated image file. Select to use the image stream as is.

  To implement these functions, each metadata indicates the end position and / or length of the image stream (or the end position and / or length of each subfile). Must contain information to

  In addition, at least the metadata of the second sub-file must include information indicating that the second sub-file is a sub-file associated with the first sub-file.

  Then, the black box examines the metadata existing at the start of the integrated image file (the first metadata of the first sub-file located at the front of the file is examined), and the first sub-file is examined. Examine the end of the file and examine the metadata (eg, FTYP box) of another image file at the end of the second file, wherein the inspected metadata is dependent on the first subfile. Must be able to identify it as a subfile.

  In the present specification, the first sub-file and the second sub-file have been described as constituting one integrated image file.However, if these constitute one integrated file, the integrated image file itself is included. Does not need to be explicitly displayed. That is, the first subfile and the second subfile are recorded such that the logical (or physical) addresses of the permanent storage medium are consecutive to each other, and the second subfile is associated with the first subfile. If information indicating that the file is a subfile is recorded in the second metadata of the second subfile, the next logical / physical data can be read immediately when any of the subfiles is read by the black box later. Investigate the address, and if it is confirmed that the related second subfile exists, judge the previously read subfile and the second subfile linked thereto as one integrated image file You can also.

  Thus, herein, "composing an integrated image file" explicitly means that the associated second subfile is present in the first metadata or a separate box of the first subfile. May or may not be recorded.

  Next, with reference to FIG. 3, a main part of an image recording device constituting an integrated image file according to an embodiment of the present invention will be schematically described. The image recording device (101) can be part of a black box. The image recording device (101) can include an imaging unit (110), a system unit (120), and a permanent storage medium (130).

  The imaging unit (110) includes a camera and images the front. The captured image can be output in frame units.

  The permanent storage medium (130) is a general term for non-volatile data storage devices, and can include an SD memory, an SSD, an HDD, and the like. Of course, the permanent storage medium (130) may be embodied using a volatile memory.

  The system unit (120) executes a function of encoding an image captured by the imaging unit (110), converting the image into digital image data, and recording the digital image data on the permanent storage medium (130).

  The image acquisition unit (121) receives an image output from the imaging unit (110).

  The stream extension unit (122) creates two streams using the received image. That is, the received image is converted to an image of a first image quality (or high-resolution image quality) to generate a first image stream, and the received image is converted to a second image quality (or a low-resolution image quality). ) To generate a second image stream.

  The encoding unit (123) encodes each image stream into a format for storing as an image file. For example, it can be encoded in the MP4 file format.

  The buffer memory (124) provides a buffer for temporarily storing an image stream generated by imaging in real time.

  When the image recording device (101) starts recording an image, the file generation unit (125) can generate a first sub-file that stores the first image stream. With the present invention, the first sub-file can be immediately created in the permanent storage medium (130). At this time, since the first subfile ends, for example, every first time (for example, 60 seconds), the first subfile generated in the permanent storage medium (130) is stored in the first metadata. Can be generated in a state where a part of the image stream is recorded and an image stream can be added to the MDAT box.

  Then, the file generation unit (125) acquires the first image stream from the buffer memory (124) every second time period (for example, 1 second), additionally records the acquired first image stream in the MDAT box, and Record a file.

  On the other hand, the file generation unit (125) has not yet generated the second sub-file in the permanent storage medium, and the second image stream is just added in the buffer memory (124).

  Thereafter, after recording has been performed during the first time (ie, the first image stream has frames added to the permanent storage medium every second time period, and the second image stream has , The frame is added in the buffer memory), the file generation unit (125) closes the MDAT box of the first sub-file of the permanent storage medium (130), and deletes the first metadata. Exit and exit the first subfile. On the other hand, the file generation unit (125) obtains the second image stream generated during the first time from the buffer memory (124), sets the second metadata, and generates the second sub-file Then, recording of the generated second sub-file is started continuously at the logical / physical address at the end of the first sub-file of the permanent storage medium (130).

  In this way, the second subfile that depends on the first subfile is located consecutively at the logical (or physical) address at the end of the first subfile. When reading the file, if you examine the metadata of the subfile in the next consecutive location, if the subfile in the next location is a second subfile that depends on the immediately preceding subfile You will be able to determine immediately.

  Next, a description will be given of an apparatus capable of displaying an integrated image file configured as described above, that is, an integrated image file in which individual subfiles of image streams of different image qualities are continuously recorded on a display surface. As described above, an image display device that can display an integrated image file on a display surface, for example, a black box having a display surface may include a file acquisition unit, a file analysis unit, a decoding unit, and an image display unit. it can. The configuration of the black box of the present embodiment can be referred to the block diagram of FIG.

  The file acquisition unit includes a first sub-file in which an image captured in the front is recorded as a first image stream of a first image quality, and the first image is recorded as a second image stream of a second image quality. And an integrated image file configured by continuously connecting the second sub-file to the second sub-file. That is, the file acquisition unit can access the permanent storage medium and read the stored image file.

  The file analysis unit checks whether the input image file includes the second sub-file. That is, when reading any of the image files to be displayed, the file analysis unit reads the metadata of the image file to identify the end of the image file, and starts another image file at the identified end position. Check the metadata of the identified image file to identify if the file is a second sub-file that depends on the immediately preceding image file Can be.

  The decoding unit reads out the image stream of each image file and decodes the image stream so as to be visually displayed.

  The image display unit visually displays the decoded image stream on a display surface. At this time, when the file analysis unit identifies the second sub-file, the image display unit can display the second image stream of the second sub-file on the display surface.

  These image display devices can select and display an image stream with the desired image quality from two image streams with different image qualities, even though they are the same image captured in the front. When selecting and displaying a stream, you can select a second subfile and use a series of image streams that have already been stored continuously, so the process of extracting and displaying image frames An image can be displayed smoothly even if the ability is insufficient. In addition, since an image stream in which low-quality frames are continuously formed in a line is used, there is almost no delay in section search, and high-speed reproduction can be smoothly handled.

  FIG. 4 is a view illustrating a main part of an apparatus capable of displaying image files of a plurality of channels including an integrated image file on one display surface according to another embodiment of the present invention, and images of the plurality of channels in a PIP method. It is a figure which shows the example displayed.

  Referring to FIG. 4A, the device (201) capable of displaying the image files of a plurality of channels including the integrated image file on one display surface can also be a black box, Unit (210), a file analysis unit (220), a decoding unit (230), and an image display unit (240).

  Here, for example, a first image generated by imaging an arbitrary direction of the vehicle is output as a first channel, and the first image is recorded as a first image stream of a first image quality. Forming a first sub-file, wherein the first image of the first channel is converted to a second image quality and forms a second sub-file recorded as a second image stream; It is assumed that the and the second sub-file are successively connected to each other to form one integrated image file.

  Further, for example, a second image generated by imaging the other direction of the vehicle is output as a second channel, and another image file in which the second image is recorded with an arbitrary image quality is configured. It is assumed that Here, the another image file was also recorded as a first sub-file in which a second image was recorded as a first image stream of a first image quality and a second image stream of a second image quality. A second sub-file may also be included.

  The image file acquisition unit (210) can read and acquire the image file for each channel from the permanent storage medium (130), for example.

  The file analysis unit (220) selects an image file of the first channel and an image file of the second channel to be displayed on the display surface (D) of the black box (101), and selects the image file of the second channel. Analyze whether it is an integrated image file that includes the subfile of The analysis of whether the image file is an integrated image file detects the end of the image stream or the end of the image file from the metadata of the selected image file, and (if the image file is an integrated image file, the end of the first sub-file Investigate whether another image file has started from the end, check the metadata of another image file that has started, and check that this image file This can be done by identifying whether the second dependent subfile is indicated or not.

  Upon receiving a command to simultaneously display the first image of the first channel and the second image of the second channel on one display surface, the image display unit (240) switches the display surfaces (D) to two. It can be divided into regions and each image can be displayed in each region. In particular, in the present invention, one display surface can be divided into a main area (M) and a sub area (S) by the PIP method.

  When the second sub-file is identified by the file analysis unit (220), the image display unit (240) sets a main area (M) and a sub-area (S) on the display surface (D), The main area (M) displays an image stream included in the arbitrary image file, and the sub area (S) displays the second image stream of the second sub file. Can be.

  That is, it is desirable that the image displayed in the sub-region (S), which is a small portion of the display surface (D), is the second image stream stored with low image quality of the integrated image file.

  As described above, if a low-quality image stream is displayed in a small sub-region, the burden of image processing for converting the size of the image according to the sub-region is small, and the image in the main region (M) and the sub-region (S ) Can be smoothly displayed without losing synchronization with each other.

  FIG. 4B shows the display surface (D) divided by the PIP method. The main area (M) displays a large image of the front that the user wants to see in detail, and the sub area (S) displays a small image of the rear that the user wants to see for reference. ing. Here, for the image captured in the rear, an image stream stored with low image quality can be displayed, whereby the images of the two channels can be smoothly displayed simultaneously on one display surface (D). Can be.

  FIG. 5 is a diagram illustrating a plurality of channels including an integrated image file, which may be executed by an apparatus that displays image files of a plurality of channels including an integrated image file as described with reference to FIG. 4 on one display surface. 6 is a flowchart for explaining a method of displaying image files of a channel together on one display surface.

  The image to be displayed can be selected by the user (S10). For example, the user may combine an image from the first channel (or front image) generated by imaging the front and an image from the second channel (or rear image) generated by imaging the rear into one image. It can be selected to be displayed together on the display surface at the same time.

  Then, the user can select an image to be displayed in the main area and / or the sub area (S12). For example, the user can display an image captured by capturing the front in a large size in the main area, and display an image generated by capturing the rear in a small size in the sub area.

  When the image displayed for each area is selected, the image stream stored in the image file is directly selected from the image files of the channels selected to be displayed in the main area (S18). It can be displayed (S19). If an integrated image file having the first sub file and the second sub file is selected to be displayed in the main area, the image of the sub file at the beginning of the integrated image file is displayed as it is. Alternatively, the present invention may be embodied to select and display an arbitrary image stream from the images of the first image stream and the second image stream.

  On the other hand, it is possible to confirm whether or not the image file of the channel selected to be displayed in the sub area has a sub file stored with low image quality (S13). That is, it is checked whether the second image stream exists in the image file. Such a survey examines the metadata of an image file, examines the end of an image file, examines the metadata of another image file linked to the end of the file, and determines that the image file is This is done in a way that checks to see if it represents a second subfile that depends on the file.

  Here, if the second image stream of the second sub-file exists in the image file of the channel selected to be displayed in the sub-area, the second image stream is selected and decoded. (S14) An image is displayed in a sub-region on the display surface (S15).

  On the other hand, if it is confirmed that the second sub-file does not exist in the image file of the channel selected to be displayed in the sub-area, the image stream contained in the image file is used as it is (S16). After decoding the image stream according to the size of the sub area (S17), it can be displayed in the sub area (S15).

  In this way, the main area has not undergone a separate selection procedure, can be displayed using the provided image stream as it is, and the second area stored in low quality in the sub-area If a stream is present, it can be displayed using that second image stream.

  Next, a method of checking whether a second sub-file of the second image stream exists in the procedure of the method of FIG. 5 will be described with reference to FIG.

  First, when an arbitrary image file (for example, the first sub-file) is selected, the metadata of the image file (the first metadata) is checked to determine the size of the image stream (the first image stream) or The size of the image file (first sub file) is ascertained (S21). When the size of the first image stream is grasped, it is checked whether another image file is linked to the end of the first image stream (S22).

  If there is another linked image file, the metadata of the image file is checked (S23). While the image file has metadata ("Yes" in S24), this image file is displayed as a second sub-file if it is related to the immediately previous image file (ie, the first sub-file) If so, the first sub-file and the second sub-file can be considered as a single integrated image file.

  On the other hand, subsequently, the second metadata is examined in the second sub-file to determine the size of the second image stream (S25). Then, referring to the grasped size, after confirming that the second image stream is completely present (S26), the second image stream is read out (S27) and displayed in the sub area. Next, a second image stream can be selected (S28).

  On the other hand, if the second image stream is incomplete or non-existent, the selection of the second sub-file can be canceled and the first image stream of the first sub-file can be selected to be displayed (S29).

  The embodiments of the present invention described above are merely examples of the technical idea of the present invention, and the protection scope of the present invention should be interpreted by the following claims. Further, those skilled in the art to which the present invention pertains can understand that various modifications and variations are possible without departing from the essential characteristics of the present invention. All technical ideas falling within the scope should be construed as being included in the scope of the present invention.

  The present invention provides a method for continuously recording image streams of different qualities on one permanent storage medium to form one integrated image file and a method for displaying the integrated image file thus recorded on a display device. The present invention relates to a device for displaying an integrated image file.

Technology behind the invention

  Recently, vehicular image recorders such as black boxes can record 4K UHD high resolution, high bit rate, and high frame rate high quality images. Accordingly, in order to check the recorded high-quality image on the display device, a device with a specific high specification (for example, a PC, a smartphone, a tablet, or the like) capable of reproducing the image is required.

  Also, in order to reproduce a high-quality image on such a specific high-spec device, the high-quality image recorded by the vehicular image recording device should be transmitted to the specific high-spec device. In order to transmit a high-quality image with a large capacity, a network use cost and a transfer time are required.

  Therefore, there is a demand to display the stored high-quality image on a display surface built in the in-vehicle image recording apparatus itself.

  However, the image recording device for a vehicle has relatively low specifications, and the power of hardware / software is concentrated on the function of recording a captured image, and there is no problem in recording a high-quality image. The decoding process for displaying high-quality recorded images on the display surface may not be smooth. Therefore, there is a problem that the displayed image is interrupted or delayed.

  Further, recent image recording apparatuses for vehicles provide a function of receiving respective images from a plurality of channels (for example, a front imaging channel and a rear imaging channel) and storing them as separate image files.

  Therefore, when trying to simultaneously display images of a plurality of channels on the display surface of one image recording device, the problem that the images are interrupted or delayed can appear more seriously. The images of the channels may be displayed out of sync.

Korean Patent Publication No. 10-1995-0013268 Korean Patent No. 10-2011-007067 JP-A-2000-320340 Korean Published Patent No. 10-2012-097046

Issues to be solved

  The present invention has been made to solve the above-described problem, and enables a recorded image to be smoothly displayed by a vehicular image recording device having relatively low specifications.

  Furthermore, the present invention enables images of a plurality of channels to be simultaneously and smoothly displayed on one image recording apparatus for a vehicle.

Solution to the problem

  In order to solve the above-mentioned problem, a method of configuring an integrated image file in which image streams of different image qualities are continuously recorded according to the present invention includes the steps of: (Ii) processing the image or the first image stream to generate a second image stream of a second image quality; and (iii) generating a first image stream. In a period of time, the first metadata is combined with the first metadata to form a first subfile, and the second metadata is combined with the second metadata to form the second sub-file. And (iv) connecting the second sub-file to the end of the first sub-file and recording it to form an integrated image file. .

  In the method, the first metadata includes at least information indicating an end of the first image stream or an end of the first subfile, and the second metadata includes at least the It is characterized by including information indicating that the second sub-file is a second image stream of the second image quality.

  Further, the method is characterized in that the second image quality is lower than the first image quality.

  The method also includes the step (i) of: recording the first image stream in a buffer memory, starting the first sub-file on a permanent storage medium, wherein the first sub-file is shorter than the first time. The method further comprising: successively recording the first image stream recorded in the buffer memory in the first sub-file of the permanent storage medium every predetermined second time; The procedure further comprises: at the first time, terminating a first sub-file in the permanent storage medium, and terminating the second file in the buffer memory; The steps of :) concatenate and record the second sub-file terminated in the buffer memory at the end of the first sub-file in the permanent storage medium, and then record the first sub-file. Starting from the beginning, the second sub It is characterized in further comprising configuring the integrated image file ending at the end of the file.

  Further, according to the present invention, an apparatus for forming an integrated image file in which image streams of different image qualities are continuously recorded includes an image receiving unit that receives an image captured in front, and a first image quality based on the received image. A first image stream, a stream extension unit that processes the image or the first image stream to form a second image stream of a second image quality, and a predetermined first time period. Combining a first metadata with the first image stream to form a first sub-file, and combining a second metadata with the second image stream to form a second sub-file. A file generating unit configured to continuously connect the second sub-file to an end of the first sub-file to form an integrated image file.

  Further, the apparatus further includes: a buffer memory for storing the first and second image streams, and a permanent storage medium for storing the integrated image file, wherein the file generation unit stores the image data in the permanent storage medium. The first sub-file is generated, and the first image stream recorded in the buffer memory at every predetermined second time shorter than the first time is stored in the first storage of the permanent storage medium. Recording as a subfile, at the first time, terminating the first subfile in the permanent storage medium, and terminating the second subfile in the buffer memory, the permanent storage medium The integrated image file by continuously recording the second sub-file terminated in the buffer memory at the end of the first sub-file in It is.

  Also, the apparatus: the second image quality is lower than the first image quality, and the first metadata is an end of the first image stream or the first sub-file. Wherein the second metadata includes at least information indicating that the second sub-file is a second image stream of the second image quality. Things.

  Further, according to the present invention, an apparatus for displaying an integrated image file in which image streams of different image qualities are continuously recorded is a first image in which an image captured in the front is recorded as a first image stream of a first image quality. And a second sub-file in which the first image is recorded as a second image stream of a second image quality is a file acquisition that receives an integrated image file that is configured by being continuously connected to each other. Unit, a file analysis unit that investigates whether the input integrated image file contains the second sub-file, and when the second sub-file is identified by the file analysis unit, And an image display unit for displaying the second image stream of the second sub-file on a display surface.

  Also, the apparatus: the first sub-file includes first metadata indicating an end of the first image stream or an end of the first sub-file, and the second sub-file includes at least Including second metadata indicating that the second sub-file is a second image stream of the second image quality, wherein the file analysis unit is configured to execute the first metadata of the integrated image file. Identifying the end of the first sub-file, examining whether the second sub-file starts at the end of the first sub-file, based on The method is characterized in that the second metadata is read to identify the second image stream.

  Further, according to the present invention, in the method of displaying an integrated image file in which image streams of different image qualities are continuously recorded, the first image from the first channel is used as a first image stream of the first image quality. An integrated image file in which a recorded first sub-file and a second sub-file in which the first image is recorded as a second image stream of a second image quality are continuously connected to each other, and A method for simultaneously displaying, on one display device, an arbitrary image file in which a second image from two channels is recorded, wherein (i) a procedure of setting a main area and a sub area on a display surface of the display apparatus (Ii) displaying an image stream included in the arbitrary image file in the main area; and (iii) displaying the integrated image file as an image file to be displayed in the sub area. And selecting the integrated image file and, if the second sub-file is detected, displaying the second image stream in the sub-area.

  Also, the method includes: the first metadata includes information indicating an end of the first image stream or an end of the first sub-file, and the second metadata includes at least the second Including information indicating that the sub-file is a second image stream of the second image quality; the step (iii) comprises: based on the first metadata of the integrated image file, Detecting the end of one subfile, checking whether the second subfile starts at the end of the first subfile, and reading the second metadata of the second subfile Identifying the second image stream and displaying the second image stream in the sub-region.

  Further, the method is characterized in that: the second image quality is lower than the first image quality, and the sub-area is provided in the main area by a PIP method.

  The method further comprises: (a) generating the first image stream having a first image quality from the first image captured in the front and recording the first image stream in a buffer memory; Processing the first image or the first image stream to generate the second image stream of the second image quality and recording the same in a buffer memory; and (c) storing the first sub-file in a permanent storage medium. And recording the first image stream recorded in the buffer memory in the first sub-file of the permanent storage medium at every predetermined second time, and (d) the second time In a longer predetermined first time period, a first sub-file is formed by combining first metadata with the first image stream in the permanent storage medium; and Linking the second metadata to the second image stream of Ending the second sub-file in the buffer memory, and (e) continuously ending the second sub-file in the buffer memory at the end of the first sub-file in the permanent storage medium. The information is recorded in the.

  Further, according to the present invention, an apparatus for displaying an integrated image file in which image streams of different image qualities are continuously recorded, wherein the first image from the first channel is a first image stream of the first image quality An integrated image file in which a recorded first sub-file and a second sub-file in which the first image is recorded as a second image stream of a second image quality are continuously connected to each other, and A file acquisition unit for receiving an arbitrary image file in which a second image from a second channel is recorded, and selecting the integrated image file as an image file to be displayed in the sub-region, wherein the selected integrated image is selected. A file analyzing unit that checks whether the file contains a second sub-file, and a display device when the file analyzing unit identifies the second sub-file. Setting a main area and a sub area on the display surface, displaying an image stream included in the arbitrary image file in the main area, and displaying the second image of the second sub file in the sub area. And an image display unit for displaying a stream.

  Also, the apparatus: the first sub-file includes first metadata indicating an end of the first image stream or an end of the first sub-file, and the second sub-file includes at least Including second metadata indicating that the second sub-file is a second image stream of the second image quality; wherein the file analyzing unit includes the first metadata of the integrated image file. Detecting the end of the first sub-file based on to determine whether the second sub-file has started at the end of the first sub-file, the second sub-file of the second sub-file Is read to identify the second image stream.

  According to the present invention having the above-described configuration, the captured and generated images are respectively formed into a high-quality stream and a low-quality stream, and these are collectively stored in one file, and the stored file is stored. When the is reproduced later, one of the high-resolution stream and the low-quality stream can be selected and displayed, and the image can be smoothly displayed even with a low-spec device.

  Also, when displaying images of multiple channels together on one display surface, at least one image is displayed in a low-quality stream, so that images are displayed smoothly even on a device with low specifications. be able to.

FIG. 1 is a diagram schematically showing a method of using the image recording device of the present invention in a car. FIG. 2A is a diagram for explaining a method of configuring an integrated image file. FIG. 2B is a diagram showing a configuration of an integrated image file embodied in the MP4 file format. FIG. 3 is a block diagram schematically showing a main part of an apparatus for composing an integrated image file according to an embodiment of the present invention. FIG. 4 is a diagram illustrating a main part of a device capable of displaying image files of a plurality of channels including an integrated image file on a single display surface according to another embodiment of the present invention, and images of the plurality of channels in a PIP method. It is a figure showing the example of a display. FIG. 5 is a flowchart of a method for displaying image files of a plurality of channels including an integrated image file on one display surface. FIG. 6 is a flowchart of a method for checking the presence or absence of a second image stream in the method of FIG.

Specific contents for carrying out the invention

  Hereinafter, with reference to the attached drawings, a method of continuously recording image streams of different image quality on one permanent storage medium to form one integrated image file and the integrated image file thus recorded according to the present invention A preferred embodiment of a method for displaying an image on a display device and a device for displaying these integrated image files will be described. Incidentally, the terms indicating the respective components of the present invention are exemplarily named in consideration of their functions, and therefore, it is not necessary to predict or limit the technical contents of the present invention by the terms themselves. .

  First, a method of using the image recording device according to an embodiment of the present invention in a car, that is, an example of using the image recording device as a black box will be described with reference to FIG. On the other hand, a general black box can be provided with an image display unit by itself, and can decode and store an image recorded and stored to visually display the image. Accordingly, an apparatus for continuously recording image streams of different qualities presented in the present invention on one permanent storage medium to form one integrated image file and an apparatus for displaying the integrated image file thus recorded are as follows. Can be described as "black box for vehicle" or "black box". Further, a method of continuously recording image streams of different image quality on one permanent storage medium to form one integrated image file and a method of displaying the integrated image file thus recorded on a display device are also described in a vehicle black box. It can be understood that it is executed in.

  Referring to the drawings, the black box may be composed of a main body (101) and an additional camera (102).

  The black box main body (101) is disposed, for example, in front of the vehicle (C) and can include a front camera (not shown) that looks ahead. The images captured by the front camera are processed in the main unit (101) to form digital image streams, and these image streams are divided into predetermined time units (for example, 60-second cycles) and the main unit (101) It can be recorded and stored as an image file on a permanent storage medium (130), which can be provided internally or externally. The main body (101) can also include a display surface (D) for displaying a captured image in real time or reproducing an arbitrary image file stored in the permanent storage medium (130) to reproduce the image. Can be displayed.

  At this time, the display surface (D) provided in the black box body (101) has a relatively small size and a relatively small number of pixels (for example, CGA, VGA, SVGA, etc.) and can be realized with low performance. it can. Therefore, in order to display an image encoded with a relatively high image quality (for example, HD, FHD, etc.) here, image processing for lowering the image quality is required. The black box is designed primarily for storing captured images, so the minimum hardware / software processing power that can perform the function of encoding and storing captured images It is to have. Therefore, in order to execute a process for displaying an image, in particular, an image conversion process for lowering the image quality and, at the same time, a process for displaying the image on the display surface (D), the processing capability of the image processing device itself is somewhat insufficient.

  Therefore, according to the present invention, when storing a captured image, a high-quality image is stored to form one image file (for example, a first sub-file), and the captured image is added to the image file. A method is used in which a single image file (for example, a second sub-file) is converted into a high-quality image and then combined into one file and stored. Accordingly, when a stored image file is displayed on its own display surface, the use of a low-quality image reduces the burden of image processing and allows the image to be displayed smoothly. In addition, by using a low-quality image, it is possible to smoothly cope with a section search or high-speed reproduction of an image.

  To realize these functions, the black box body (101) according to the present invention forms individual image files of different image qualities based on the captured images, Must be able to implement the function of constructing one integrated image file by linking In addition, if necessary, the black box body (101) according to the present invention selects any one of the single integrated image files configured as described above (for example, a low-quality image file) and selects the selected image file. It must be possible to implement a function of displaying the image stream of the created image file on the display surface.

  Meanwhile, the black box according to the present invention may include another camera (102) directed in a direction other than the direction in which the front camera is looking.

  An image file composed of images captured by the front camera and an image file composed of images captured by the additional camera (102) can be stored together on the same permanent storage medium (130).

  At this time, the black box (101) configures images captured by the front camera (for example, images of the first channel, that is, the first image or the front image) into high-quality and low-quality image streams, The sub-file of the high-quality image stream and the sub-file of the low-quality image stream can be integrated and stored as one integrated image file. In addition, the black box (101) forms images (for example, images of the second channel, that is, the second image or the rear image) captured by the rear camera (102) into high-quality and low-quality image streams. Then, the sub-file of the high-quality image stream and the sub-file of the low-quality image stream can be integrated and stored as another integrated image file.

  When the image of the first channel and the image of the second channel are to be displayed simultaneously on one display surface (D), the main area (M) and the sub area (S ), The image of the channel displayed in the main area (M) can be displayed as a high quality image, and the image of the channel displayed in the sub area (S) can be displayed as a low quality image.

  As a result, after performing the minimum image processing on the high quality image, the image can be displayed in the main area (M) occupying most of the display surface (D), and the minimum image processing can be performed on the low quality image. After that, the image can be displayed in the sub-region (S), which is a small part of the display surface, so that the burden of image processing of the black box (101) is reduced and the images of the two channels can be displayed simultaneously and smoothly. Will be able to

  In order to implement these functions, the black box (101) of the present invention divides the display surface (D) by the PIP method, and places a high-quality image stream stored in an image file in the main area (M). In the sub-region (S), a function of selecting an image stream stored with low image quality in the integrated image file and displaying the selected image stream must be realized.

  On the other hand, in another method, display can be performed using low-quality images in both the main area and the sub area.

  FIG. 2a is a diagram for explaining a method of configuring an integrated image file according to the present invention.

  The integrated image file presented in the present invention is configured such that a first sub-file and a second sub-file that can function independently of each other are continuously connected to each other.

  The first sub-file is a part for encoding a captured image into a high-quality image and storing the encoded image. The first sub-file links a header (or first metadata) of the image itself to a frame of the high-quality image. The first image stream (Video st1 # 1 frame, Video st1 # 2 frame, ..., Video st1 #N frame) is included. The first subfile can also function as one complete image file by itself.

  Similarly, the second sub-file is a part that encodes a captured image into a low-quality image and stores the encoded image, and includes a header (eg, second metadata) of itself and a low-quality image. , And video st2 # 1 frame, Video st2 # 2 frame, ..., Video st2 #N frame. The second subfile can also function as one complete image file by itself.

  FIG. 2B is a diagram showing a configuration of an integrated image file embodied in the MP4 file format. As shown in FIG. 2B, the image file in the present invention uses the MPEG-4 (or MP4) file type as an example. The MP4 file type is composed of a plurality of boxes, and can basically have FTYP, MOOV, and MDAT boxes. Each box includes a portion for displaying the size and type of the box, and a portion for recording data or data of a sub-box.

  Here, data for reproducing an image, for example, an image stream is recorded in the MDAT box. The FTYP box must always be placed at the top of the file with priority, and records information that can confirm file compatibility. The MOOV box stores all information related to the image stream recorded in the MP4 image file. Further, a USER box may be provided, but the present invention will be described assuming that it is not present.

  2a corresponds to, for example, the FTYP box and the MOOV box in FIG. 2b. A series of Video frames corresponds to actual image frames contained in the MDAT box.

  As described above, the integrated image file presented in the present invention is configured in such a manner that two individual image files having different image qualities are continuously connected. Therefore, the black box can select one of the two consecutive sub-files and use the image stream of the selected sub-file as it is.

  By the way, there is a method of storing images of different qualities in one MDAT box at the same time even in the conventional image file. However, in this conventional method, complete image streams are not stored continuously but are alternately stored in frame units. That is, frame units are alternately arranged and stored as in high-quality image frame # 1-low-quality image frame # 1-high-quality image frame # 2-low-quality image frame # 2. Therefore, in order to utilize an image of a desired image quality in a black box, a process of skipping and extracting image frames one by one is necessary, which puts a burden on processing capacity.

  In contrast, according to the integrated image file constructed by the above-described method of the present invention, image frames of the same image quality are successively concatenated to form a complete single image stream, and these complete image streams are formed. Since a single sub-file is composed of a single image stream and these sub-files are concatenated to form a single integrated image file, the black box specifies the desired sub-file within the integrated image file. Select to use the image stream as is.

  To implement these functions, each metadata indicates the end position and / or length of the image stream (or the end position and / or length of each subfile). Must contain information to

  In addition, at least the metadata of the second sub-file must include information indicating that the second sub-file is a sub-file associated with the first sub-file.

  Then, the black box examines the metadata existing at the start of the integrated image file (the first metadata of the first sub-file located at the front of the file is examined), and the first sub-file is examined. Examine the end of the file and examine the metadata (eg, FTYP box) of another image file at the end of the second file, wherein the inspected metadata is dependent on the first subfile. Must be able to identify it as a subfile.

  In the present specification, the first sub-file and the second sub-file have been described as constituting one integrated image file.However, if these constitute one integrated file, the integrated image file itself is included. Does not need to be explicitly displayed. That is, the first subfile and the second subfile are recorded such that the logical (or physical) addresses of the permanent storage medium are consecutive to each other, and the second subfile is associated with the first subfile. If information indicating that the file is a subfile is recorded in the second metadata of the second subfile, the next logical / physical data can be read immediately when any of the subfiles is read by the black box later. Investigate the address, and if it is confirmed that the related second subfile exists, judge the previously read subfile and the second subfile linked thereto as one integrated image file You can also.

  Thus, herein, "composing an integrated image file" explicitly means that the associated second subfile is present in the first metadata or a separate box of the first subfile. May or may not be recorded.

  Next, with reference to FIG. 3, a main part of an image recording device constituting an integrated image file according to an embodiment of the present invention will be schematically described. The image recording device (101) can be part of a black box. The image recording device (101) can include an imaging unit (110), a system unit (120), and a permanent storage medium (130).

  The imaging unit (110) includes a camera and images the front. The captured image can be output in frame units.

  The permanent storage medium (130) is a general term for non-volatile data storage devices, and can include an SD memory, an SSD, an HDD, and the like. Of course, the permanent storage medium (130) may be embodied using a volatile memory.

  The system unit (120) executes a function of encoding an image captured by the imaging unit (110), converting the image into digital image data, and recording the digital image data on the permanent storage medium (130).

  The image acquisition unit (121) receives an image output from the imaging unit (110).

  The stream extension unit (122) creates two streams using the received image. That is, the received image is converted to an image of a first image quality (or high-resolution image quality) to generate a first image stream, and the received image is converted to a second image quality (or a low-resolution image quality). ) To generate a second image stream.

  The encoding unit (123) encodes each image stream into a format for storing as an image file. For example, it can be encoded in the MP4 file format.

  The buffer memory (124) provides a buffer for temporarily storing an image stream generated by imaging in real time.

  When the image recording device (101) starts recording an image, the file generation unit (125) can generate a first sub-file that stores the first image stream. With the present invention, the first sub-file can be immediately created in the permanent storage medium (130). At this time, since the first subfile ends, for example, every first time (for example, 60 seconds), the first subfile generated in the permanent storage medium (130) is stored in the first metadata. Can be generated in a state where a part of the image stream is recorded and an image stream can be added to the MDAT box.

  Then, the file generation unit (125) acquires the first image stream from the buffer memory (124) every second time period (for example, 1 second), additionally records the acquired first image stream in the MDAT box, and Record a file.

  On the other hand, the file generation unit (125) has not yet generated the second sub-file in the permanent storage medium, and the second image stream is just added in the buffer memory (124).

  Thereafter, after recording has been performed during the first time (ie, the first image stream has frames added to the permanent storage medium every second time period, and the second image stream has , The frame is added in the buffer memory), the file generation unit (125) closes the MDAT box of the first sub-file of the permanent storage medium (130), and deletes the first metadata. Exit and exit the first subfile. On the other hand, the file generation unit (125) obtains the second image stream generated during the first time from the buffer memory (124), sets the second metadata, and generates the second sub-file Then, recording of the generated second sub-file is started continuously at the logical / physical address at the end of the first sub-file of the permanent storage medium (130).

  In this way, the second subfile that depends on the first subfile is located consecutively at the logical (or physical) address at the end of the first subfile. When reading the file, if you examine the metadata of the subfile in the next consecutive location, if the subfile in the next location is a second subfile that depends on the immediately preceding subfile You will be able to determine immediately.

  Next, a description will be given of an apparatus capable of displaying an integrated image file configured as described above, that is, an integrated image file in which individual subfiles of image streams of different image qualities are continuously recorded on a display surface. As described above, an image display device that can display an integrated image file on a display surface, for example, a black box having a display surface may include a file acquisition unit, a file analysis unit, a decoding unit, and an image display unit. it can. The configuration of the black box of the present embodiment can be referred to the block diagram of FIG.

  The file acquisition unit includes a first sub-file in which an image captured in the front is recorded as a first image stream of a first image quality, and the first image is recorded as a second image stream of a second image quality. And an integrated image file configured by continuously connecting the second sub-file to the second sub-file. That is, the file acquisition unit can access the permanent storage medium and read the stored image file.

  The file analysis unit checks whether the input image file includes the second sub-file. That is, when reading any of the image files to be displayed, the file analysis unit reads the metadata of the image file to identify the end of the image file, and starts another image file at the identified end position. Check the metadata of the identified image file to identify if the file is a second sub-file that depends on the immediately preceding image file Can be.

  The decoding unit reads out the image stream of each image file and decodes the image stream so as to be visually displayed.

  The image display unit visually displays the decoded image stream on a display surface. At this time, when the file analysis unit identifies the second sub-file, the image display unit can display the second image stream of the second sub-file on the display surface.

  These image display devices can select and display an image stream with the desired image quality from two image streams with different image qualities, even though they are the same image captured in the front. When selecting and displaying a stream, you can select a second subfile and use a series of image streams that have already been stored continuously, so the process of extracting and displaying image frames An image can be displayed smoothly even if the ability is insufficient. In addition, since an image stream in which low-quality frames are continuously formed in a line is used, there is almost no delay in section search, and high-speed reproduction can be smoothly handled.

  FIG. 4 is a view illustrating a main part of an apparatus capable of displaying image files of a plurality of channels including an integrated image file on one display surface according to another embodiment of the present invention, and images of the plurality of channels in a PIP method. It is a figure which shows the example displayed.

  Referring to FIG. 4A, the device (201) capable of displaying the image files of a plurality of channels including the integrated image file on one display surface can also be a black box, Unit (210), a file analysis unit (220), a decoding unit (230), and an image display unit (240).

  Here, for example, a first image generated by imaging an arbitrary direction of the vehicle is output as a first channel, and the first image is recorded as a first image stream of a first image quality. Forming a first sub-file, wherein the first image of the first channel is converted to a second image quality and forms a second sub-file recorded as a second image stream; It is assumed that the and the second sub-file are successively connected to each other to form one integrated image file.

  Further, for example, a second image generated by imaging the other direction of the vehicle is output as a second channel, and another image file in which the second image is recorded with an arbitrary image quality is configured. It is assumed that Here, the another image file was also recorded as a first sub-file in which a second image was recorded as a first image stream of a first image quality and a second image stream of a second image quality. A second sub-file may also be included.

  The image file acquisition unit (210) can read and acquire the image file for each channel from the permanent storage medium (130), for example.

  The file analysis unit (220) selects an image file of the first channel and an image file of the second channel to be displayed on the display surface (D) of the black box (101), and selects the image file of the second channel. Analyze whether it is an integrated image file that includes the subfile of The analysis of whether the image file is an integrated image file detects the end of the image stream or the end of the image file from the metadata of the selected image file, and (if the image file is an integrated image file, the end of the first sub-file Investigate whether another image file has started from the end, check the metadata of another image file that has started, and check that this image file This can be done by identifying whether the second dependent subfile is indicated or not.

  Upon receiving a command to simultaneously display the first image of the first channel and the second image of the second channel on one display surface, the image display unit (240) switches the display surfaces (D) to two. It can be divided into regions and each image can be displayed in each region. In particular, in the present invention, one display surface can be divided into a main area (M) and a sub area (S) by the PIP method.

  When the second sub-file is identified by the file analysis unit (220), the image display unit (240) sets a main area (M) and a sub-area (S) on the display surface (D), The main area (M) displays an image stream included in the arbitrary image file, and the sub area (S) displays the second image stream of the second sub file. Can be.

  That is, it is desirable that the image displayed in the sub-region (S), which is a small portion of the display surface (D), is the second image stream stored with low image quality of the integrated image file.

  As described above, if a low-quality image stream is displayed in a small sub-region, the burden of image processing for converting the size of the image according to the sub-region is small, and the image in the main region (M) and the sub-region (S ) Can be smoothly displayed without losing synchronization with each other.

  FIG. 4B shows the display surface (D) divided by the PIP method. The main area (M) displays a large image of the front that the user wants to see in detail, and the sub area (S) displays a small image of the rear that the user wants to see for reference. ing. Here, for the image captured in the rear, an image stream stored with low image quality can be displayed, whereby the images of the two channels can be smoothly displayed simultaneously on one display surface (D). Can be.

  FIG. 5 is a diagram illustrating a plurality of channels including an integrated image file, which may be executed by an apparatus that displays image files of a plurality of channels including an integrated image file as described with reference to FIG. 4 on one display surface. 6 is a flowchart for explaining a method of displaying image files of a channel together on one display surface.

  The image to be displayed can be selected by the user (S10). For example, the user may combine an image from the first channel (or front image) generated by imaging the front and an image from the second channel (or rear image) generated by imaging the rear into one image. It can be selected to be displayed together on the display surface at the same time.

  Then, the user can select an image to be displayed in the main area and / or the sub area (S12). For example, the user can display an image captured by capturing the front in a large size in the main area, and display an image generated by capturing the rear in a small size in the sub area.

  When the image displayed for each area is selected, the image stream stored in the image file is directly selected from the image files of the channels selected to be displayed in the main area (S18). It can be displayed (S19). If an integrated image file having the first sub file and the second sub file is selected to be displayed in the main area, the image of the sub file at the beginning of the integrated image file is displayed as it is. Alternatively, the present invention may be embodied to select and display an arbitrary image stream from the images of the first image stream and the second image stream.

  On the other hand, it is possible to confirm whether or not the image file of the channel selected to be displayed in the sub area has a sub file stored with low image quality (S13). That is, it is checked whether the second image stream exists in the image file. Such a survey examines the metadata of an image file, examines the end of an image file, examines the metadata of another image file linked to the end of the file, and determines that the image file is This is done in a way that checks to see if it represents a second subfile that depends on the file.

  Here, if the second image stream of the second sub-file exists in the image file of the channel selected to be displayed in the sub-area, the second image stream is selected and decoded. (S14) An image is displayed in a sub-region on the display surface (S15).

  On the other hand, if it is confirmed that the second sub-file does not exist in the image file of the channel selected to be displayed in the sub-area, the image stream contained in the image file is used as it is (S16). After decoding the image stream according to the size of the sub area (S17), it can be displayed in the sub area (S15).

  In this way, the main area has not undergone a separate selection procedure, can be displayed using the provided image stream as it is, and the second area stored in low quality in the sub-area If a stream is present, it can be displayed using that second image stream.

  Next, a method of checking whether a second sub-file of the second image stream exists in the procedure of the method of FIG. 5 will be described with reference to FIG.

  First, when an arbitrary image file (for example, the first sub-file) is selected, the metadata of the image file (the first metadata) is checked to determine the size of the image stream (the first image stream) or The size of the image file (first sub file) is ascertained (S21). When the size of the first image stream is grasped, it is checked whether another image file is linked to the end of the first image stream (S22).

  If there is another linked image file, the metadata of the image file is checked (S23). While the image file has metadata ("Yes" in S24), this image file is displayed as a second sub-file if it is related to the immediately previous image file (ie, the first sub-file) If so, the first sub-file and the second sub-file can be considered as a single integrated image file.

  On the other hand, subsequently, the second metadata is examined in the second sub-file to determine the size of the second image stream (S25). Then, referring to the grasped size, after confirming that the second image stream is completely present (S26), the second image stream is read out (S27) and displayed in the sub area. Next, a second image stream can be selected (S28).

  On the other hand, if the second image stream is incomplete or non-existent, the selection of the second sub-file can be canceled and the first image stream of the first sub-file can be selected to be displayed (S29).

  The embodiments of the present invention described above are merely examples of the technical idea of the present invention, and the protection scope of the present invention should be interpreted by the following claims. Further, those skilled in the art to which the present invention pertains can understand that various modifications and variations are possible without departing from the essential characteristics of the present invention. All technical ideas falling within the scope should be construed as being included in the scope of the present invention.

Claims (15)

(I) generating a first image stream of a first image quality from an image captured in the front;
(Ii) processing the image or the first image stream to generate a second image stream of a second quality;
(Iii) combining a first metadata with the first image stream to form a first sub-file at a predetermined first time period, and a second metadata in the second image stream; Combining the data to form a second subfile;
(Iv) constructing an integrated image file by concatenating and recording the second sub-file at the end of the first sub-file. How to configure an integrated image file. The first metadata includes at least information indicating an end of the first image stream or an end of the first subfile,
The method of claim 1, wherein the second metadata includes at least information indicating that the second sub-file is a second image stream of the second quality. .   The method of claim 1, wherein the second image quality is lower than the first image quality. The (i) procedure is:
Recording the first image stream in a buffer memory,
In the permanent storage medium, start the first sub-file, and copy the first image stream recorded in the buffer memory every predetermined second time shorter than the first time to the permanent storage medium. Further comprising continuously recording in the first sub-file of
The procedure of the above (iii) is:
Further comprising, at the first time, ending a first sub-file in the permanent storage medium and ending the second file in the buffer memory;
The procedure of the above (iv) is:
At the end of the first sub-file in the permanent storage medium, after connecting and recording the second sub-file terminated in the buffer memory, starting from the beginning of the first sub-file The method of claim 1, further comprising constructing the integrated image file ending at the end of the second sub-file. An image receiving unit that receives an image captured in front,
A stream extension unit configured to form a first image stream of a first image quality from the received image, and process the image or the first image stream to form a second image stream of a second image quality;
At a predetermined first time period, a first sub-file is formed by combining first metadata with the first image stream, and second metadata is added with the second image stream. Constructing a second sub-file by combining, including a file generation unit to form an integrated image file by continuously connecting the second sub-file to the end of the first sub-file, A device that forms an integrated image file in which image streams are continuously recorded. The device is:
A buffer memory for storing the first and second image streams;
A permanent storage medium in which the integrated image file is stored,
The file generation unit,
Generating the first sub-file in the permanent storage medium,
Recording the first image stream recorded in the buffer memory for each predetermined second time shorter than the first time as the first sub-file of the permanent storage medium,
At the first time, ending a first subfile in the permanent storage medium and ending the second subfile in the buffer memory;
The integrated image file is configured by recording the second sub-file terminated in the buffer memory continuously at the end of the first sub-file in the permanent storage medium, The device according to claim 5. The second image quality is lower image quality than the first image quality,
The first metadata includes information indicating an end of the first image stream or an end of the first subfile,
The apparatus according to claim 5, wherein the second metadata includes at least information indicating that the second sub-file is a second image stream of the second image quality. . A first subfile in which an image captured in the front is recorded as a first image stream of a first image quality, and a second subfile in which the first image is recorded as a second image stream of a second image quality A file acquisition unit for receiving the integrated image file in which the sub-files are continuously connected to each other;
A file analysis unit that investigates whether the input integrated image file includes the second sub-file,
An image display unit for displaying the second image stream of the second sub-file on the display surface of the display device when the second sub-file is identified by the file analysis unit, A device that displays an integrated image file in which streams are continuously recorded. The first subfile includes first metadata indicating an end of the first image stream or an end of the first subfile,
The second sub-file includes at least second metadata indicating that the second sub-file is a second image stream of the second image quality,
The file analysis unit,
Based on the first metadata of the integrated image file, identify the end of the first sub-file and investigate whether the second sub-file starts at the end of the first sub-file 9. The apparatus according to claim 8, wherein the second metadata of the second sub-file is read to identify the second image stream. A first sub-file in which a first image from a first channel is recorded as a first image stream of a first image quality and the first image is recorded as a second image stream of a second image quality A method in which an integrated image file formed by connecting the second sub-files successively to each other and an arbitrary image file in which the second image from the second channel is recorded is simultaneously displayed on one display device. So,
(I) setting a main area and a sub area on a display surface of a display device;
(Ii) displaying an image stream included in the arbitrary image file in the main area;
(Iii) selecting the integrated image file as an image file to be displayed in the sub-region, examining the integrated image file, and detecting the second sub-file, if the second sub-file is detected, A method for displaying an integrated image file in which image streams of different image qualities are continuously recorded, including a procedure for displaying in a sub-region. The first metadata includes information indicating an end of the first image stream or an end of the first subfile,
The second metadata includes at least information indicating that the second sub-file is a second image stream of the second image quality,
The procedure of the above (iii) is:
Detecting an end of the first sub-file based on the first metadata of the integrated image file and examining whether the second sub-file starts at an end of the first sub-file Reading the second metadata of the second sub-file to identify the second image stream, and displaying the second image stream in the sub-area. The method described in. The second image quality is lower image quality than the first image quality,
The method according to claim 10, wherein the sub-area is provided in the main area in a PIP manner. The integrated image file is
(A) generating the first image stream of the first image quality from the first image captured in the front and recording the first image stream in a buffer memory;
(B) processing the first image or the first image stream to generate a second image stream of a second image quality and recording the generated second image stream in a buffer memory;
(C) generating the first sub-file in a permanent storage medium, and transferring the first image stream recorded in the buffer memory every predetermined second time to the first sub-file of the permanent storage medium; Record in a subfile,
(D) combining a first metadata with the first image stream in the permanent storage medium at a predetermined first time period longer than the second time to form a first sub-file; And combining a second metadata with the second image stream in the buffer memory to end a second sub-file in the buffer memory;
(E) by continuously recording a second sub-file terminated in the buffer memory at an end of the first sub-file in the permanent storage medium. Item 10. The method according to Item 10. A first sub-file in which a first image from a first channel is recorded as a first image stream of a first image quality and the first image is recorded as a second image stream of a second image quality An integrated image file configured such that the second sub-files are successively connected to each other, and a file acquisition unit that receives input of any image file in which the second image from the second channel is recorded,
A file analysis unit that selects the integrated image file as the image file to be displayed in the sub-region, and investigates whether a second sub-file is included in the selected integrated image file,
When the second sub-file is identified by the file analysis unit, a main area and a sub-area are set on the display surface of the display device, and the image stream included in the arbitrary image file is set in the main area. An image display unit for displaying and displaying the second image stream of the second sub-file in the sub-region, the apparatus displaying an integrated image file in which image streams of different qualities are continuously recorded. The first subfile includes first metadata indicating an end of the first image stream or an end of the first subfile,
The second sub-file includes at least second metadata indicating that the second sub-file is a second image stream of the second image quality,
The file analysis unit,
Detecting an end of the first sub-file based on the first metadata of the integrated image file, and examining whether the second sub-file starts at an end of the first sub-file; 15. The apparatus of claim 14, wherein the second metadata of the second sub-file is read to identify the second image stream.