WO2021095584A1 - 記録制御装置、記録制御方法、及び、プログラム - Google Patents

記録制御装置、記録制御方法、及び、プログラム Download PDF

Info

Publication number
WO2021095584A1
WO2021095584A1 PCT/JP2020/041046 JP2020041046W WO2021095584A1 WO 2021095584 A1 WO2021095584 A1 WO 2021095584A1 JP 2020041046 W JP2020041046 W JP 2020041046W WO 2021095584 A1 WO2021095584 A1 WO 2021095584A1
Authority
WO
WIPO (PCT)
Prior art keywords
power supply
image
recording
recording control
image file
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2020/041046
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
雄介 山口
将 渡邉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
JVCKenwood Corp
Original Assignee
JVCKenwood Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by JVCKenwood Corp filed Critical JVCKenwood Corp
Priority to JP2021556028A priority Critical patent/JP7218818B2/ja
Publication of WO2021095584A1 publication Critical patent/WO2021095584A1/ja
Priority to US17/726,411 priority patent/US11700447B2/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/64—Computer-aided capture of images, e.g. transfer from script file into camera, check of taken image quality, advice or proposal for image composition or decision on when to take image
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C5/00—Registering or indicating the working of vehicles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00885—Power supply means, e.g. arrangements for the control of power supply to the apparatus or components thereof
    • H04N1/00904—Arrangements for supplying power to different circuits or for supplying power at different levels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00912—Arrangements for controlling a still picture apparatus or components thereof not otherwise provided for
    • H04N1/00915—Assigning priority to, or interrupting, a particular operation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/21—Intermediate information storage
    • H04N1/2104—Intermediate information storage for one or a few pictures
    • H04N1/2112—Intermediate information storage for one or a few pictures using still video cameras
    • H04N1/2129—Recording in, or reproducing from, a specific memory area or areas, or recording or reproducing at a specific moment
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/65—Control of camera operation in relation to power supply
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60—Control of cameras or camera modules
    • H04N23/65—Control of camera operation in relation to power supply
    • H04N23/651—Control of camera operation in relation to power supply for reducing power consumption by affecting camera operations, e.g. sleep mode, hibernation mode or power off of selective parts of the camera
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Definitions

  • the present invention relates to a recording control device, a recording control method, and a program.
  • Patent Document 1 Japanese Unexamined Patent Publication No. 2008-123501 discloses a drive recorder equipped with a backup power supply. Specifically, when the power supply from the vehicle battery is cut off, the image information recorded in the RAM is thinned out and stored in the CompactFlash card (registered trademark). As a result, even when the amount of power supplied is limited, the information to be recorded can be reliably recorded on the CompactFlash card.
  • Patent Document 1 does not mention processing when a plurality of cameras are mounted on a vehicle.
  • An object of the present invention is to protect the recording of an image file according to its importance with respect to an image file when the power supply source is switched from the main power supply device to the auxiliary power supply device when a plurality of cameras are mounted on the vehicle. And to provide the technology to optimize the recording time.
  • an image capture image acquisition unit that acquires an image taken from a plurality of image pickup units, and an auxiliary power supply device that serves as a power supply source when the power supply from the main power supply device is cut off.
  • a power supply source switching unit that switches the power supply source from the main power supply device to the auxiliary power supply device when the power supply from the main power supply device is cut off, and an amount of power that can be supplied by the auxiliary power supply device.
  • the power amount acquisition unit that acquires the auxiliary power amount
  • the recording control unit that records the captured image acquired by the captured image acquisition unit in an image file for each of the plurality of imaging units, and the importance of the plurality of image files.
  • the recording control unit includes a recording continuation time calculation unit that calculates a recording continuation time that can continue recording the captured image in the first image file based on the auxiliary power amount, and the recording control unit is the main power source.
  • the recording control unit is the main power source.
  • the captured image acquisition unit that acquires the captured image from a plurality of imaging units, and the auxiliary power supply device that serves as a power supply source when the power supply from the main power supply device is cut off.
  • a power supply source switching unit that switches the power supply source from the main power supply device to the auxiliary power supply device when the power supply from the main power supply device is cut off, and an amount of power that can be supplied by the auxiliary power supply device.
  • the power amount acquisition unit that acquires the auxiliary power amount
  • the recording control unit that records the captured image acquired by the captured image acquisition unit in an image file for each of the plurality of imaging units, and the importance of the plurality of image files.
  • Each of the importance determination units is provided, and the recording control unit is provided when the power supply from the main power supply device is cut off and the power supply source switching unit switches the power supply source.
  • the image recording time for recording the captured image from the imaging unit corresponding to the first image file while executing the closing process for the first image file as the most important image file is set as the auxiliary power amount.
  • a recording control device is provided that starts recording the captured image in the second image file set accordingly. According to the third aspect of the present embodiment, it is a recording control method of a recording control device having an auxiliary power supply device that serves as a power supply source when the power supply from the main power supply device is cut off, and is a method of recording control of a plurality of imaging units.
  • the captured image acquisition step of acquiring the captured image from the main power supply device the power supply source switching step of switching the power supply source from the main power supply device to the auxiliary power supply device when the power supply from the main power supply device is cut off, and the above-mentioned Recording control that records the power amount acquisition step for acquiring the auxiliary power amount, which is the power amount that can be supplied by the auxiliary power supply device, and the captured image acquired in the captured image acquisition step in an image file for each of the plurality of imaging units.
  • the recording control step includes a recording continuation time calculation step of calculating a recording continuation time that can continue recording of the captured image in the first image file as a high image file based on the auxiliary power amount.
  • a recording continuation time calculation step of calculating a recording continuation time that can continue recording of the captured image in the first image file as a high image file based on the auxiliary power amount.
  • the image file is recorded according to the importance of the image file when the power supply source is switched from the main power supply device to the auxiliary power supply device.
  • Techniques for protection and optimization of recording time are provided.
  • FIG. 1 shows a functional block diagram of the image recording device 1.
  • the image recording device 1 is a specific example of a recording control device.
  • the image recording device 1 includes a CPU 1a (Central Processing Unit) as a central processing unit, a RAM 1b (Random Access Memory) as a volatile recording medium that is readable and writable, and a read-only ROM 1c (read-only ROM 1c). Read Only Memory) is provided.
  • the image recording device 1 includes a supercapacitor 2 as an auxiliary power supply device and a recording medium interface 3.
  • the control program causes the hardware such as the CPU 1a to function as various functional units.
  • the various functional units include a camera control unit 4, a camera image acquisition unit 5, a power supply source switching unit 6, an electric energy acquisition unit 7, a recording control unit 8, an importance determination unit 9, and a recording sustainable time calculation unit 10.
  • the image recording device 1 is connected to a front camera 20, a rear camera 21, a right camera 22, a left camera 23, and an acceleration sensor 24 as an acceleration detection unit.
  • the imaging directions of the front camera 20, the rear camera 21, the right camera 22, and the left camera 23 are different from each other.
  • the image recording device 1 may include these cameras.
  • the front camera 20 is a specific example of an imaging unit that images the front of the vehicle, and is typically attached to the vicinity of the front grill of the vehicle or the upper part of the windshield.
  • the front camera 20 outputs the captured image to the image recording device 1.
  • the rear camera 21 is a specific example of an imaging unit that images the rear of the vehicle, and is typically mounted near the rear bumper of the vehicle, above the rear glass, or near the rear license plate.
  • the rear camera 21 outputs the captured image to the image recording device 1.
  • the right camera 22 is a specific example of an imaging unit that images the right side of the vehicle, and is typically attached to a right door mirror.
  • the right camera 22 outputs the captured image to the image recording device 1.
  • the left camera 23 is a specific example of an imaging unit that images the left side of the vehicle, and is typically attached to a left door mirror.
  • the left camera 23 outputs the captured image to the image recording device 1.
  • the front camera 20, the rear camera 21, the right camera 22, and the left camera 23 are connected to the image recording device 1, but instead of this, the front camera 20, the rear camera 21, and the right camera are connected. 22. At least two or three of the left camera 23 may be connected to the image recording device 1. Further, for example, a plurality of imaging units having overlapping imaging directions but different imaging ranges may be connected to the image recording device 1. In this case, the plurality of imaging units may be connected to, for example, the front camera 20 and 360 °. Includes an ultra-wide-angle camera capable of shooting in all directions.
  • the acceleration sensor 24 is a specific example of an acceleration detection unit that detects the acceleration acting on the vehicle, and outputs the detection result to the image recording device 1.
  • the image recording device 1, the front camera 20, the rear camera 21, the right camera 22, and the left camera 23 may include an acceleration sensor 24.
  • the supercapacitor 2 is a specific example of the auxiliary power supply device, and serves as a power supply source for the image recording device 1 when the power supply from the main power supply device 12 is cut off.
  • the main power supply device 12 is typically an in-vehicle battery.
  • the image recording device 1 normally receives power from the main power supply device 12.
  • the supercapacitor 2 becomes the power supply source of the image recording device 1 instead of the main power supply device 12.
  • the auxiliary power supply device may be a combination of the supercapacitor 2 and a control circuit that controls the output voltage and the output current.
  • the auxiliary power supply device is not limited to the supercapacitor 2, and may be an auxiliary battery, a battery, or the like.
  • the camera control unit 4 controls the operations of the front camera 20, the rear camera 21, the right camera 22, and the left camera 23.
  • the front camera 20 and the like operate by receiving power supply from the image recording device 1. That is, the camera control unit 4 starts the imaging of the front camera 20 by starting the supply of the operating power to the front camera 20, and stops the supply of the operating power to the front camera 20 to image the front camera 20. To stop.
  • the main power supply device 12 may be configured to directly supply the operating power to the front camera 20 without going through the image recording device 1. The same applies to the rear camera 21, the right camera 22, and the left camera 23.
  • the camera image acquisition unit 5 acquires, for example, 30 captured images per second from each of the front camera 20, the rear camera 21, the right camera 22, and the left camera 23, and stores the acquired captured images in RAM 1b.
  • RAM1b is used as a so-called ring buffer. That is, when the camera image acquisition unit 5 stores the captured image to be newly stored in the RAM 1b, the camera image acquisition unit 5 overwrites the captured image in the storage area of the captured image having the oldest imaging time.
  • FIG. 2 illustrates the stored contents of RAM1b.
  • the camera image acquisition unit 5 stores the captured image acquired from the front camera 20 with the imaging time information indicating the time captured and the identification information of the front camera 20 added to the RAM 1b.
  • “A” of "A27” is identification information for identifying the front camera 20, and "27” indicates the imaging time information of the captured image.
  • the imaging time information is a serial number assigned to each imaging frame, each unit time of imaging such as one minute, each image file, and the like.
  • "A27” may be a file name of the captured image or may be written in the header information of the captured image.
  • “B” indicates the rear camera 21, “C” indicates the right camera 22, and “D” indicates the left camera 23.
  • the storage form of the RAM 1b is not limited to the example of FIG. 2, and the storage area may be separated for each camera.
  • the power supply source switching unit 6 switches the power supply source of the image recording device 1 from the main power supply device 12 to the supercapacitor 2 when the power supply from the main power supply device 12 is cut off.
  • the power supply source switching unit 6 can detect that the power supply from the main power supply device 12 has been cut off by a known technique.
  • the power supply source switching unit 6 may detect that the power supply has been cut off by monitoring the output voltage or output current of the main power supply device 12, for example, and outputs an error signal output from the main power supply device 12. It may be acquired to detect that the power supply has been cut off.
  • the electric energy acquisition unit 7 acquires the auxiliary electric energy which is the electric energy that can be supplied by the supercapacitor 2.
  • the electric energy acquisition unit 7 can acquire an auxiliary electric energy amount which is an electric energy amount that can be supplied by the supercapacitor 2 by a known technique.
  • the electric energy acquisition unit 7 may acquire the auxiliary electric energy by subtracting the cumulative value of the electric power supplied by the super capacitor 2 from the cumulative value of the electric power supplied to the super capacitor 2, and may acquire the auxiliary electric energy.
  • the voltage of the terminal may be acquired, and the auxiliary power amount may be acquired based on the correlation between the output voltage and the auxiliary power amount.
  • the recording medium interface 3 provides read / write access to the SD card 11 (registered trademark), which is a specific example of the recording medium, and provides a slot for inserting the SD card 11 and a controller for reading / writing the SD card 11.
  • the SD card 11 is a specific example of a non-volatile recording medium and a portable recording medium.
  • the non-volatile recording medium may be a compact flash memory (registered trademark), a hard disk, or the like instead of the SD card.
  • the recording control unit 8 creates a separate image file for each camera in the SD card 11, and then records the captured image stored in the RAM 1b in the corresponding image file.
  • FIG. 3 illustrates a part of the stored contents of the SD card 11.
  • the image file corresponding to the front camera 20 is saved in the SD card 11 with the file name "front file_3829”.
  • the image file corresponding to the rear camera 21 is stored in the SD card 11 with the file name "rear file_3829”.
  • the image file corresponding to the right camera 22 is saved in the SD card 11 with the file name "right file_3829”.
  • the image file corresponding to the left camera 23 is saved in the SD card 11 with the file name "left file_3829”.
  • the image recording time which is the total playback time of the images recorded in one image file, is set to a short time such as 1 minute or 5 minutes, and the long-time image is divided into a plurality of image files. I try to save it.
  • “_3829” shown in FIG. 3 is a serial number assigned to a plurality of image files divided in chronological order. That is, in addition to the "forward file_3829", the SD card 11 also stores, for example, "forward file_3828”, “forward file_3827”, and "forward file_3826".
  • the recording control unit 8 records a plurality of captured images of the predetermined number of frames at the end of the corresponding image file of the SD card 11 when the captured images to be newly recorded are accumulated in the RAM 1b with the predetermined number of frames. I am trying to do it.
  • the 10 frames of captured images that is, for example, A20, A21, A22 ... A28
  • the captured image shown by A29 is recorded at the end of the front file_3829 of the SD card 11.
  • the predetermined number of frames is not limited to 10 frames, and may be, for example, 5 frames, 20 frames, or 1 frame.
  • the recording control unit 8 sequentially accumulates the captured images in the image file of the SD card 11, and at the stage of accumulating the captured images for the above-mentioned image recording time, the recording control unit 8 closes the image file and holds the image. The file is confirmed as a valid readable image file.
  • the importance determination unit 9 determines the importance of each of the plurality of image files stored in the SD card 11.
  • a plurality of importance determination units 9 are used so that the image file corresponding to the camera having the image pickup direction closest to the direction opposite to the acceleration direction detected by the acceleration sensor 24 has the highest importance. Determine the importance of each of the image files.
  • the importance determination unit 9 when the own vehicle collides head-on with another vehicle, the own vehicle momentarily accelerates toward the rear, so that the importance determination unit 9 has the front image direction closest to the front opposite to the rear.
  • the importance of each of the plurality of image files is determined so that the image file corresponding to the camera 20, that is, the front file_3829 has the highest importance.
  • the importance determination unit 9 receives an image file corresponding to the front camera 20 and the right camera 22 having imaging directions in the front and the right side, that is, the front Determine the importance of each of the multiple image files so that the file and the right file have the highest importance. It is more preferable to determine which of the forward file and the right file is more important based on the angle of collision.
  • the importance determination unit 9 takes an image closest to the rear opposite to the front.
  • the importance of each of the plurality of image files is determined so that the image file corresponding to the rear camera 21 having the direction, that is, the rear file_3829 has the highest importance.
  • the importance determination unit 9 may determine the importance of each of the plurality of image files only when the acceleration detected by the acceleration sensor 24 is equal to or higher than a predetermined value. Further, the importance determination unit 9 may determine the importance of each of the plurality of image files only when the power supply source switching unit 6 described later switches the power supply source.
  • the importance determination unit 9 determines the predetermined time from that point when the acceleration detected by the acceleration sensor 24 is equal to or higher than a predetermined value or when the power supply from the main power supply is cut off and the power supply source is switched.
  • the image file corresponding to the camera having the closest imaging direction in the direction opposite to the direction in which the largest acceleration was detected within a predetermined period up to the retroactive point in time is of the highest importance. It is preferable to determine the importance of each.
  • the "importance" may be expressed by a numerical value that increases as it becomes more important, or may be expressed as a numerical value that decreases as it becomes more important.
  • the number can be any number, for example, from 0 (the least important) to 100 (the most important), or from 1 (the most important) to 5 (the least important).
  • the recording continuous time calculation unit 10 is the most important image file when the power supply from the main power supply device 12 is cut off and the power supply source is switched by the power supply source switching unit 6. 1
  • the recordable continuous recording time during which the captured image can be continuously recorded in the image file is calculated based on the auxiliary power amount of the supercapacitor 2 acquired by the electric energy acquisition unit 7. That is, the recording continuation time calculation unit 10 determines, for example, the amount of auxiliary power that is the remaining power obtained by subtracting the amount of power required for closing the file, which will be described later, from the amount of auxiliary power of the supercapacitor 2.
  • the time during which the image recording device 1 can continuously operate by supplying power from the supercapacitor 2 can be calculated, and this time can be set as the recordable continuous time. ..
  • the remaining auxiliary power is the amount of power required other than the file closing process, for example, the amount of power required for the process of stopping the power supply to the unnecessary camera described later and the amount of power that becomes a margin of the super capacitor 2. It may be the amount of power subtracted from the amount of auxiliary power.
  • the front camera 20 and the like are configured to operate by supplying power from the image recording device 1, so that the power consumption of the image recording device 1 per unit time is the power consumption of the front camera 20 and the like.
  • the amount of power consumption per unit time will be taken into consideration. Therefore, when the power supply from the main power supply device 12 is cut off and the power supply source is switched by the power supply source switching unit 6, the power supply to the unnecessary camera is stopped, and the subsequent image recording is performed.
  • the amount of power consumed per unit time of the device 1 can be kept low. Similarly, by stopping the recording of unnecessary cameras in the image file, it is possible to keep the power consumption of the image recording device 1 after that per unit time low.
  • the "unnecessary camera” means, for example, a camera other than the camera corresponding to the first image file as the most important image file.
  • the front file_3829 corresponds to the first image file
  • the rear camera 21, the right camera 22, and the left camera 23 correspond to unnecessary cameras.
  • the “unnecessary camera” may mean a camera whose importance determined by the importance determination unit 9 is lower than a predetermined threshold value, or may mean a camera having the lowest importance.
  • the recording control unit 8 records the captured image in the first image file. While continuing, the first image file is closed when the recordable time has elapsed. According to this, even when the power supply from the main power supply device 12 is cut off and the power supply source is switched by the power supply source switching unit 6, the recordable image time of the first image file is possible.
  • the first image file will be very useful for post-accident verification.
  • the close process is a process of completing the information in the format of each file so that the image file can be established as a file that can be handled by other devices.
  • the forward file_3829 shown in FIG. 3 is established as one file together with information such as a file name and a time stamp according to a video format format such as MPEG (Moving Picture Experts Group).
  • Another example of the closing process is a process of determining the end of the storage area of the image file by adding a few bytes of predetermined data to the end of the image file to be closed.
  • the recording control unit 8 records each image file on the SD card 11 that records images captured by each camera, specifically, a front file_3829, a rear file_3829, a right file_3829, and a left file_. Open the file 3829.
  • the file open is a process for securing the storage area required for storing each image file in the SD card 11 in advance without duplication, and the address of the write pointer for writing is set. It is set to the start address of each file.
  • the camera image acquisition unit 5 acquires captured images from the front camera 20, the rear camera 21, the right camera 22, and the left camera 23, and temporarily stores the captured images in RAM 1b as shown in FIG. Store.
  • S120 Recording control step: Next, the recording control unit 8 acquires captured images from the RAM 1b for a predetermined number of frames, and records the acquired plurality of captured images at the positions of the write pointers of the corresponding image files on the SD card 11. It should be noted that this recording process causes the above-mentioned write pointer to be moved down as appropriate.
  • the electric energy acquisition unit 7 acquires the auxiliary electric energy which is the electric energy that can be supplied by the supercapacitor 2.
  • S140 importance determination step: Next, the importance determination unit 9 determines the importance of each of the plurality of image files based on the detection result from the acceleration sensor 24.
  • S150 Power supply source switching step: Next, the recording control unit 8 determines whether or not the power supply from the main power supply device 12 is cut off and the power supply source is switched. When the recording control unit 8 determines that the power supply from the main power supply device 12 is cut off and the power supply source is switched (S150: YES), the recording control unit 8 advances the process to S200. On the other hand, when the recording control unit 8 determines that the power supply source has not been switched (S150: NO), the process returns to S110.
  • the importance determination unit 9 may execute the determination process of S140 after the determination of S150, or may execute the determination process of S140 substantially at the same time as the determination of S150.
  • the explanation will be continued assuming that the first image file as the most important image file determined by the importance determination unit 9 is the forward file_3829.
  • the camera control unit 4 stops the imaging of the cameras other than the front camera 20 corresponding to the front file_3829, that is, the rear camera 21, the right camera 22, and the left camera 23. As a result, the power consumption of the image recording device 1 per unit time is suppressed.
  • the recording sustainable time calculation unit 10 calculates the recording sustainable time based on the amount of auxiliary power of the supercapacitor 2.
  • S220 While continuing to record the captured image in the forward file_3829, the recording control unit 8 determines whether or not the recording sustainability time has elapsed starting from the time when the above-mentioned recording sustainability time is calculated. When the recording control unit 8 determines that the record sustainable time has not elapsed (S220: NO), the recording control unit 8 repeats the process of S220. On the other hand, when the recording control unit 8 determines that the recording continuability time has elapsed (S220: YES), the recording control unit 8 proceeds to the process to S230.
  • the recording control unit 8 determines another image file, that is, the rear file_3829, the right file_3829, at the timing based on the record continuous time. Execute close processing for the left file _3829. In this case, it is preferable to execute the closing process in order from the image file having a relatively high importance. For example, if the own vehicle collides head-on with another vehicle, the following vehicle may collide with the own vehicle after the head-on collision. And it is preferable to judge it higher than the importance of the left file_3829. In this case, after the closing process for the front file_3829 is completed (S230), the recording control unit 8 subsequently executes the closing process for the rear file_3829 at a timing based on the record sustainable time.
  • the image recording device 1 includes a camera image acquisition unit 5 as an image acquisition unit that acquires an image from a front camera 20 or the like, and an auxiliary power source that serves as a power supply source when the power supply from the main power supply device 12 is cut off. It includes a supercapacitor 2 as an apparatus.
  • the image recording device 1 includes a power supply source switching unit 6 that switches the power supply source from the main power supply device 12 to the super capacitor 2 when the power supply from the main power supply device 12 is cut off, and the power that can be supplied by the super capacitor 2.
  • a power amount acquisition unit 7 for acquiring an auxiliary power amount, which is an amount, is provided.
  • the image recording device 1 has a recording control unit 8 that records the captured image acquired by the camera image acquisition unit 5 in a separate image file for each front camera 20, and an importance determination that determines the importance of a plurality of image files.
  • a unit 9 is provided.
  • the image recording device 1 is a first image file as the most important image file when the power supply from the main power supply device 12 is cut off and the power supply source is switched by the power supply source switching unit 6.
  • the recording continuation time calculation unit 10 is provided, which calculates the recording continuation time during which the captured image can be continuously recorded based on the amount of auxiliary power.
  • the recording control unit 8 continues recording the captured image in the first image file when the power supply from the main power supply device 12 is cut off and the power supply source is switched by the power supply source switching unit 6.
  • the closing process is executed for the first image file when the recordable continuous time has elapsed (S230).
  • the image recording device 1 further includes a camera control unit 4 as an image pickup control unit that controls the front camera 20 and the like.
  • the front camera 20 and the like are configured to operate by supplying electric power from the image recording device 1.
  • the camera control unit 4 takes an image of a camera other than the camera corresponding to the first image file. To stop. According to the above configuration, the power consumption per unit time of the image recording device 1 is suppressed, so that the recordable image time of the first image file can be further extended.
  • the recording control unit 8 executes the closing process on the first image file, and then executes the closing process on at least one of the image files other than the first image file. According to the above configuration, image files other than the first image file are also closed, which contributes to post-accident verification.
  • the importance determination unit 9 identifies as the most important image file the image file corresponding to the image pickup unit having the image pickup direction closest to the direction opposite to the acceleration direction detected by the acceleration sensor 24 (acceleration detection unit). To do.
  • the recording sustainability time calculated by the recording sustainability calculation unit 10 may be allocated to each of the plurality of image files. For example, if the forward file_3829 and the right file_3829 have the same importance and the record continuous time calculation unit 10 has calculated the record continuous time of 30 seconds, the forward file_3829 and the right file_3829 have the same importance.
  • the record continuation time of 3829 may be 15 seconds each.
  • the record continuation time of the front file _3829 and the right file _3829 may be allocated to, for example, 20 seconds and 10 seconds based on their importance. .. According to the above configuration, it is possible to reliably close the image file corresponding to the direction in which the collision occurred.
  • the recording control unit 8 After executing the closing process for the first image file, the recording control unit 8 records the captured image other than the imaging unit corresponding to the first image file, and then the first image file is based on the importance of each image file.
  • the recording continuation time is set for each image file that records the captured image other than the image pickup unit corresponding to, and the captured image other than the image pickup unit corresponding to the first image file is recorded at the timing based on the recording continuation time.
  • the closing process may be executed for each image file. For example, when the importance of the rear file _3829 is p1 and the importance of the right file _3829 is p2, the recording control unit 8 sets the record sustainability of the rear file _3829 and the importance of the right file _3829.
  • the recording sustainable time of each image file is set so that the ratio of the recording sustainable time is p1: p2. Then, the recording control unit 8 closes the rear file _3829 at a timing based on the record sustainability time of the rear file _3829 (typically, at the timing when the record sustainability time of the rear file _3829 has elapsed). At the same time, the right file _3829 is closed at a timing based on the record sustainability time of the right file _3829 (typically, at the timing when the record sustainability time of the right file _3829 has elapsed).
  • the recording control unit 8 After executing the closing process for the front file_3829 (S230), the recording control unit 8 creates the front file_3830 (second image file) as a new image file corresponding to the front camera 20 on the SD card 11. Then, the recording of the captured image in the forward file_3830 may be started.
  • the image recording time of the image file is shortened as compared with before the power supply source is switched by the power supply source switching unit 6. That is, for example, when the image recording time of the image file before the power supply source switching by the power supply source switching unit 6 is set to 1 minute, the recording control unit 8 sets the image recording time of the image file. For example, it may be shortened to 10 seconds.
  • the image file corresponding to the front camera 20 is divided into small pieces, so that even if the power supply from the supercapacitor 2 is interrupted and the operation of the image recording device 1 suddenly stops, the image file is captured by the front camera 20.
  • the recording time of the front image is extended as much as possible.
  • the recording control unit 8 may set the image recording time of the forward file_3830 according to the auxiliary power amount acquired by the electric energy acquisition unit 7.
  • the acceleration sensor 24 is connected to the image recording device 1.
  • the acceleration sensor 24 is omitted.
  • the image recording device 1 includes a motion vector calculation unit 30 that calculates a motion vector for each of a plurality of image files.
  • the motion vector calculation unit 30 can be realized as various functional units by a control program stored in the ROM 1c.
  • the motion vector is a vector representation of the motion from the reference frame.
  • the motion vector calculation method is typically a block matching method, but is not limited to this.
  • the importance determination unit 9 determines the importance of each of the plurality of image files based on the motion vector calculated by the motion vector calculation unit 30. Specifically, the importance determination unit 9 calculates the total scalar amount of the motion vector for each of a plurality of image files, determines the importance of the image file having a relatively large total scalar amount to be relatively high, and makes a total. The importance of an image file with a relatively small amount of scalar is judged to be relatively low. Also, when the vehicle is running, the movement of the right file _3829 and the left file _3829, which are images taken in the horizontal direction, becomes large, and the movement of the right file _3829 and the left file _3829 becomes large.
  • the weighting is changed between the front file _3829 and the rear file _3829, and the right file _3829 and the left file _3829, and conversion is performed so that the scalar amount after weighting is the same for each image file.
  • the direction in which the cause of the accident occurred may be determined based on the total scalar amount of the motion vector after weighting.
  • the importance of the image file in which the direction in which the cause of the accident occurred can be determined to be high without using the acceleration sensor 24.
  • the acceleration sensor 24 is connected to the image recording device 1.
  • the acceleration sensor 24 is omitted.
  • the image recording device 1 includes an object detection unit 31 that detects an object appearing in the image file for each of a plurality of image files and calculates the distance to the object.
  • the object detection unit 31 can be realized as various functional units by a control program stored in the ROM 1c. A known technique such as image recognition may be used for detecting an object.
  • the above-mentioned object include, but are not limited to, moving objects such as other vehicles and pedestrians reflected in the captured image, guardrails, side walls, utility poles, and the like.
  • the distance from the front camera 20 to the object reflected in the image file corresponding to the front camera 20 can be typically calculated by configuring the front camera 20 as a stereo camera.
  • the present invention is not limited to this, and a known image processing technique may be used to calculate the distance from the front camera 20 to the object reflected in the image file corresponding to the front camera 20.
  • the importance determination unit 9 determines the importance of each of the plurality of image files based on the distance to the object. Typically, the importance determination unit 9 determines the importance of each of the plurality of image files so that the image file showing the object having the shortest distance from the own vehicle to the object has the highest importance. Specifically, in the importance determination unit 9, the shorter the distance from the own vehicle to the object, the higher the importance of the image file, and the longer the distance from the own vehicle to the object, the relative importance of the image file. The importance of each of the plurality of image files is determined so as to be as low as possible. According to the above configuration, the importance of the image file in which the direction in which the cause of the accident is presumed to have occurred can be determined to be high without using the acceleration sensor 24.
  • the image recording device 1 of the present embodiment omits the recording sustainable time calculation unit 10 shown in FIG.
  • the recording control unit 8 is the first image file as the most important image file when the power supply from the main power supply device 12 is cut off and the power supply source is switched by the power supply source switching unit 6. Is closed. According to the above configuration, it is possible to reliably close the image file having the highest importance, and it is possible to determine the image file having the highest importance as one image file without damaging it. Therefore, the confirmed image file will be very useful for post-accident verification.
  • the recording control unit 8 shortens the image recording time of the image file as compared with before the switching of the power supply source, and then starts recording the captured image in the new image file.
  • the new image file is a specific example of the second image file.
  • the recording control unit 8 may create a front file_3830 in the SD card 11 as an image file following the front file_3829. However, instead of this, an image file corresponding to all the camera control units 4 may be created in the SD card 11.
  • the recording control unit 8 When the recording control unit 8 shortens the image recording time of the image file as compared with before the power supply source is switched, the recording control unit 8 shortens the image recording time of the image file according to the amount of auxiliary power of the supercapacitor 2. For example, when the amount of auxiliary power that is the surplus power of the supercapacitor 2 is 0.05Wh and the amount of power consumption of the image recording device 1 per hour is 5Wh, the image recording device 1 is supplied with power from the supercapacitor 2. It can operate continuously for 36 seconds. Therefore, in this case, the recording control unit 8 sets the image recording time of the image file to 36 seconds or less than 36 seconds.
  • the operation of the image recording device 1 will be described with reference to FIG. Since the processes from S100 to S150 are the same as the processes shown in FIG. 4, the description thereof will be omitted.
  • the description will be continued assuming that the first image file as the most important image file determined by the importance determination unit 9 is the forward file_3829.
  • the camera control unit 4 stops the imaging of the cameras other than the front camera 20 corresponding to the front file_3829, that is, the rear camera 21, the right camera 22, and the left camera 23.
  • the recording control unit 8 shortens the image recording time of the image file according to the amount of auxiliary power.
  • the recording control unit 8 creates a front file_3830 as a new image file for recording the captured image from the front camera 20 in the SD card 11.
  • the camera image acquisition unit 5 acquires an captured image from the front camera 20, and temporarily stores the acquired captured image in the RAM 1b.
  • the recording control unit 8 acquires captured images from the RAM 1b for a predetermined number of frames, and records the acquired plurality of captured images in the forward file_3830.
  • the fourth embodiment has been described above, the fourth embodiment has the following features.
  • the recording control unit 8 is the first image file as the most important image file when the power supply from the main power supply device 12 is cut off and the power supply source is switched by the power supply source switching unit 6.
  • the image file is closed, the image recording time of the image file is shortened according to the amount of auxiliary power, and then the recording of the captured image in the new image file is started.
  • the recording control unit 8 is the first image file as the most important image file when the power supply from the main power supply device 12 is cut off and the power supply source is switched by the power supply source switching unit 6.
  • the image file is closed, and the image recording time of the image file is set according to the amount of auxiliary power, and the recording of the captured image in the second image file is started.
  • the first image file confirmed as one image file is very useful for post-accident verification. Further, since the image recording time of the new image file is determined according to the auxiliary power amount, the image recording time of the new image file can be set to a time suitable for the auxiliary power amount.
  • the recording control unit 8 may record the captured image as an image file on the SD card 11 after executing the closing process on the first image file.
  • Non-temporary computer-readable media include various types of tangible storage media.
  • Examples of non-temporary computer-readable media include magnetic recording media (eg, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (eg, magneto-optical disks).
  • Examples of non-temporary computer-readable media further include CD-ROMs (Read Only Memory), CD-Rs, CD-R / Ws, semiconductor memories (eg, mask ROMs, etc.) of non-temporary computer-readable media. Examples further include PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM (random access memory)).
  • the program may also be supplied to the computer by various types of temporary computer readable media.
  • Examples of temporary computer-readable media include electrical, optical, and electromagnetic waves.
  • the temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.
  • the present disclosure is applicable to an image recording device provided with an auxiliary power supply device such as a supercapacitor.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Television Signal Processing For Recording (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Studio Devices (AREA)
  • Time Recorders, Dirve Recorders, Access Control (AREA)
PCT/JP2020/041046 2019-11-14 2020-11-02 記録制御装置、記録制御方法、及び、プログラム Ceased WO2021095584A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2021556028A JP7218818B2 (ja) 2019-11-14 2020-11-02 記録制御装置、記録制御方法、及び、プログラム
US17/726,411 US11700447B2 (en) 2019-11-14 2022-04-21 Recording control apparatus for plurality of images, recording control method for plurality of images, and non-transitory computer readable medium storing plurality of images

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2019-206397 2019-11-14
JP2019206397 2019-11-14

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/726,411 Continuation US11700447B2 (en) 2019-11-14 2022-04-21 Recording control apparatus for plurality of images, recording control method for plurality of images, and non-transitory computer readable medium storing plurality of images

Publications (1)

Publication Number Publication Date
WO2021095584A1 true WO2021095584A1 (ja) 2021-05-20

Family

ID=75912365

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/041046 Ceased WO2021095584A1 (ja) 2019-11-14 2020-11-02 記録制御装置、記録制御方法、及び、プログラム

Country Status (3)

Country Link
US (1) US11700447B2 (https=)
JP (1) JP7218818B2 (https=)
WO (1) WO2021095584A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023045448A (ja) * 2021-09-22 2023-04-03 トヨタ自動車株式会社 車両用ドライブレコーダーシステム

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115938011A (zh) * 2022-12-07 2023-04-07 重庆航天工业有限公司 一种用于采集坠毁瞬间数据的记录系统

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07304473A (ja) * 1994-05-13 1995-11-21 Toyota Motor Corp 車両周辺画像データ記録装置
JP2010074319A (ja) * 2008-09-16 2010-04-02 Shinano Kenshi Co Ltd データ収集装置
JP2010134745A (ja) * 2008-12-05 2010-06-17 Fujitsu Ten Ltd ドライブレコーダ及びドライブレコーダの映像記録方法
JP2011114850A (ja) * 2009-11-30 2011-06-09 Yupiteru Corp 車両用映像記録装置、再生装置、プログラム
JP2015219531A (ja) * 2014-05-13 2015-12-07 株式会社デンソー 車載装置および走行画像保管システム

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3739693B2 (ja) * 2001-11-09 2006-01-25 本田技研工業株式会社 画像認識装置
JP2008123501A (ja) 2006-10-15 2008-05-29 Fujitsu Ten Ltd 車両用情報記録装置
US7957863B2 (en) * 2006-11-10 2011-06-07 Fujitsu Ten Limited Vehicle information recording apparatus, program, and recording medium
JP2009110137A (ja) * 2007-10-29 2009-05-21 Ricoh Co Ltd 画像処理装置、画像処理方法及び画像処理プログラム
EP2309919B1 (en) * 2008-07-10 2019-03-06 Ecole Polytechnique Federale De Lausanne (EPFL) EPFL-TTO Functional optical coherent imaging

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07304473A (ja) * 1994-05-13 1995-11-21 Toyota Motor Corp 車両周辺画像データ記録装置
JP2010074319A (ja) * 2008-09-16 2010-04-02 Shinano Kenshi Co Ltd データ収集装置
JP2010134745A (ja) * 2008-12-05 2010-06-17 Fujitsu Ten Ltd ドライブレコーダ及びドライブレコーダの映像記録方法
JP2011114850A (ja) * 2009-11-30 2011-06-09 Yupiteru Corp 車両用映像記録装置、再生装置、プログラム
JP2015219531A (ja) * 2014-05-13 2015-12-07 株式会社デンソー 車載装置および走行画像保管システム

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023045448A (ja) * 2021-09-22 2023-04-03 トヨタ自動車株式会社 車両用ドライブレコーダーシステム
JP7593278B2 (ja) 2021-09-22 2024-12-03 トヨタ自動車株式会社 車両用ドライブレコーダーシステム

Also Published As

Publication number Publication date
JP7218818B2 (ja) 2023-02-07
JPWO2021095584A1 (https=) 2021-05-20
US20220247920A1 (en) 2022-08-04
US11700447B2 (en) 2023-07-11

Similar Documents

Publication Publication Date Title
KR100721892B1 (ko) 드라이브 레코더 및 드라이브 레코더의 제어 방법
EP4036873B1 (en) Recording control device, recording control method, and recording control program
KR102053268B1 (ko) 차량용 블랙박스 및 이를 이용한 충격 이벤트 판정방법
US11700447B2 (en) Recording control apparatus for plurality of images, recording control method for plurality of images, and non-transitory computer readable medium storing plurality of images
JP6693357B2 (ja) 画像記録装置、画像記録方法およびプログラム
CN107309874B (zh) 一种机器人控制方法、装置和机器人
KR101475946B1 (ko) 차량용 블랙박스 및 차량용 블랙박스 저장방법
JP6970546B2 (ja) 画像記録装置および画像記録方法
KR20140069855A (ko) 차량용 영상 기록 장치 및 방법
KR20150002305A (ko) 차량용 블랙박스
KR200279994Y1 (ko) 차량용 블랙 박스
JP2015023510A (ja) 車載器
JP6702921B2 (ja) ドライブレコーダ
KR102315541B1 (ko) 시동시 이벤트영상이 출력되는 블랙박스
WO2021054264A1 (ja) 記憶制御装置、記憶制御方法、及び、プログラム
KR20150098039A (ko) 이벤트 영상 촬영 녹화 장치 및 그 방법
KR101544421B1 (ko) 충격 감지 센서를 이용한 차량용 블랙박스 제어 장치 및 방법
JP6014371B2 (ja) 車載器
KR101812254B1 (ko) 차량용 위치 추적 장치
KR20150096867A (ko) 이벤트 영상 촬영 녹화 장치 및 그 방법
JP2023059822A (ja) 車両移動状態検出装置及び方法、電子機器
JP5111314B2 (ja) データ収集装置
JP2011170595A (ja) ドライブレコーダー装置、記録方法、プログラム及び記録媒体
JP7322436B2 (ja) 記録制御装置、記録制御方法、およびプログラム
JP2022136534A (ja) 画像記録装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20886192

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021556028

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20886192

Country of ref document: EP

Kind code of ref document: A1