JP2021150678A - Recording control device, recording device, recording control method, and program - Google Patents

Abstract

To properly save video data taken while a vehicle is running.SOLUTION: A recording control device 100 includes: a video data acquisition unit 120 that acquires first video data taken by a first camera 200 that shoots the interior of a vehicle and second video data taken by a second camera 210 that shoots the surroundings of the vehicle; a face direction determination unit 135 that determines that the faces of a plurality of occupants of the vehicle match on the basis of the first video data acquired by the video data acquisition unit 120; and a recording control unit 136 that records the first video data acquired by the video data acquisition unit 120 and the second video data corresponding to the face orientations of the plurality of occupants of the vehicle in association with each other when the face direction determination unit 135 determines that the face orientations of the plurality of occupants of the vehicle match.SELECTED DRAWING: Figure 1

Description

The present invention relates to a recording control device, a recording device, a recording control method and a program.

A technique related to a digital camera capable of capturing an image of all persons as a subject with the same facial expression is known (see, for example, Patent Document 1). A technique related to an imaging device that automatically takes a picture of an object of interest to a vehicle occupant is known (see, for example, Patent Document 2).

Japanese Unexamined Patent Publication No. 2010-178119 Japanese Unexamined Patent Publication No. 2013-255168

For example, when an object of interest to an occupant appears outside the vehicle while the vehicle is in the vehicle, a plurality of occupants may look in the same direction all at once. In such a case, the reaction of the occupant in the passenger compartment may be interesting or interesting to a third party. Further, in recent years, using SNS (Social Networking Service) or the like, a still image or a moving image taken while the vehicle is running may be disclosed not only to a family member or an acquaintance but also to a third party. For example, it is desired that a still image or a moving image published on SNS or the like is interesting or interesting not only to a family member or an acquaintance but also to a third party.

The present invention has been made in view of the above, and an object of the present invention is to make it possible to appropriately store video data taken while the vehicle is running.

In order to solve the above-mentioned problems and achieve the object, the recording control device according to the present invention photographs the first video data captured by the first imaging unit that photographs the interior of the vehicle and the periphery of the vehicle. Based on the video data acquisition unit that acquires the second video data captured by the second shooting unit and the first video data acquired by the video data acquisition unit, the directions of the faces of the plurality of occupants of the vehicle match. When the face direction determination unit determines that the data has been processed and the face direction determination unit determines that the faces of a plurality of occupants of the vehicle match, the first image data acquired by the image data acquisition unit and the first image data. It is provided with a recording control unit that records the second video data corresponding to the orientations of the faces of a plurality of occupants of the vehicle in association with each other.

The recording device according to the present invention includes the above-mentioned recording control device, at least one of a first photographing unit for photographing the interior of the vehicle and a second photographing unit for photographing the periphery of the vehicle.

The recording control method according to the present invention acquires the first video data taken by the first shooting unit that shoots the interior of the vehicle and the second video data taken by the second shooting unit that shoots the periphery of the vehicle. Based on the video data acquisition step to be performed and the first video data acquired by the video data acquisition step, a face direction determination step for determining that the faces of a plurality of occupants of the vehicle match, and the face direction determination step. When it is determined by the direction determination step that the orientations of the faces of the plurality of occupants of the vehicle match, the first video data acquired by the video data acquisition step and the orientations of the faces of the plurality of occupants of the vehicle are set. It includes a recording control step of associating and recording the corresponding second video data.

The program according to the present invention is an image that acquires the first image data photographed by the first photographing unit that photographs the interior of the vehicle and the second image data photographed by the second photographing unit that photographs the periphery of the vehicle. Based on the data acquisition step and the first video data acquired by the video data acquisition step, a face direction determination step for determining that the faces of a plurality of occupants of the vehicle match, and the face direction determination When it is determined that the face orientations of the plurality of occupants of the vehicle match by the step, the first video data acquired by the video data acquisition step corresponds to the face orientations of the plurality of occupants of the vehicle. A computer operating as a recording control device is made to execute a recording control step of recording in association with the second video data.

According to the present invention, there is an effect that the video data taken while the vehicle is running can be appropriately stored.

FIG. 1 is a block diagram showing a configuration example of a vehicle recording device having the recording control device according to the first embodiment. FIG. 2 is a diagram illustrating an example of a still image in a vehicle interior recorded by the recording control device according to the first embodiment. FIG. 3 is a diagram illustrating an example of a moving image in the vehicle interior recorded by the recording control device according to the first embodiment. FIG. 4 is a diagram illustrating an example of a still image outside the vehicle recorded by the recording control device according to the first embodiment. FIG. 5 is a diagram illustrating an example of a moving image outside the vehicle recorded by the recording control device according to the first embodiment. FIG. 6 is a flowchart showing a flow of recording processing in the recording control device according to the first embodiment. FIG. 7 is a block diagram showing a configuration example of a vehicle recording device having the recording control device according to the second embodiment. FIG. 8 is a diagram illustrating an example of a moving image outside the vehicle recorded by the recording control device according to the second embodiment. FIG. 9 is a flowchart showing a flow of recording processing in the recording control device according to the second embodiment. FIG. 10 is a diagram illustrating an example of a moving image in the vehicle interior recorded by the recording control device according to the third embodiment. FIG. 11 is a diagram illustrating another example of the moving image in the vehicle interior recorded by the recording control device according to the third embodiment. FIG. 12 is a flowchart showing a flow of recording processing in the recording control device according to the third embodiment.

Hereinafter, embodiments of a recording control device, a recording device, a recording control method, and a program according to the present invention will be described in detail with reference to the accompanying drawings. The present invention is not limited to the following embodiments.

[First Embodiment]
FIG. 1 is a block diagram showing a configuration example of a vehicle recording device (recording device) 10 having a recording control device 100 according to the first embodiment. The vehicle recording device 10 stores still images or moving images inside and outside the vehicle when the faces of a plurality of occupants of the vehicle match.

The vehicle recording device 10 is a so-called drive recorder, and may be a portable device that can be used in the vehicle in addition to the device mounted on the vehicle. The vehicle recording device 10 includes a first camera (first photographing unit) 200, a second camera (second photographing unit) 210, a recording unit 220, an operation unit 230, a display unit 240, and GPS (Global Positioning). It has a System) receiving unit 250, a person recognition dictionary storage unit 260, and a recording control device 100.

The first camera 200 is a camera that photographs the interior of the vehicle. The first camera 200 photographs the occupants of the vehicle. The first camera 200 is arranged, for example, in front of the vehicle interior of the vehicle so as to face rearward. The first camera 200 may photograph the occupant with a camera capable of photographing the entire sky at 360 °. The first camera 200 constantly captures an image from the start of the engine to the stop of the engine, that is, while the vehicle is in operation. In the present embodiment, the first camera 200 constantly captures an image while the accessory power supply of the vehicle is ON. The first camera 200 outputs the captured first video data to the video data acquisition unit 120 of the recording control device 100. The first video data is, for example, a moving image composed of an image of 30 frames per second.

The second camera 210 is a camera that photographs the periphery of the vehicle. The second camera 210 photographs the periphery of the vehicle. The second camera 210 may be a camera capable of photographing the entire sky at 360 °, or may be a group of a plurality of cameras that photograph each direction. The second camera 210 is arranged, for example, in front of the vehicle interior of the vehicle. The second camera 210 constantly captures an image from the start of the engine to the stop of the engine, that is, while the vehicle is in operation. In the present embodiment, the second camera 210 constantly captures an image while the accessory power supply of the vehicle is ON. The second camera 210 outputs the captured second video data to the video data acquisition unit 120 of the recording control device 100. The second video data is, for example, a moving image composed of an image of 30 frames per second.

The recording unit 220 is used for temporary storage of data in the vehicle recording device 10. The recording unit 220 is, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory, or a recording unit such as a memory card. Alternatively, it may be an external storage device wirelessly connected via a communication device (not shown). The recording unit 220 records loop recording data based on the control signal output from the recording control unit 136 of the recording control device 100.

The operation unit 230 can accept various operations on the vehicle recording device 10. For example, the operation unit 230 can accept an operation of manually saving the captured video data in the recording unit 220. For example, the operation unit 230 can accept an operation of reproducing the loop recording data recorded in the recording unit 220. For example, the operation unit 230 can accept an operation of erasing the internal / external recorded data recorded in the recording unit 220. For example, the operation unit 230 can accept an operation to end the loop recording. The operation unit 230 outputs the operation information to the operation control unit 125 of the recording control device 100.

As an example, the display unit 240 is a display device unique to the vehicle recording device 10 or a display device shared with other systems including a navigation system. The display unit 240 is a display including, for example, a liquid crystal display (LCD: Liquid Crystal Display) or an organic EL (Organic Electro-Luminence) display. The display unit 240 displays an image based on the image signal output from the display control unit 126 of the recording control device 100. The display unit 240 displays the image captured by the second camera 210 or the image recorded on the recording unit 220.

The GPS receiving unit 250 receives radio waves from GPS satellites (not shown). The GPS receiving unit 250 outputs the signal of the received radio wave to the position information acquisition unit 127 of the recording control device 100.

The person recognition dictionary storage unit 260 stores, for example, recognition dictionary data capable of collating patterns such as the shape, size, and color of a person in each direction. The person recognition dictionary storage unit 260 is, for example, a semiconductor memory element such as a RAM, a ROM, or a flash memory, or a storage device such as a hard disk, an optical disk, or an external storage device via a network.

The recording control device 100 is, for example, an arithmetic processing unit (control device) composed of a CPU (Central Processing Unit) or the like. The recording control device 100 loads the stored program into the memory and executes the instructions included in the program. The recording control device 100 includes an internal memory (not shown), and the internal memory is used for temporary storage of data such as a program in the recording control device 100. The recording control device 100 includes a video data acquisition unit 120, a buffer memory 121, a video data processing unit 122, a playback control unit 124, an operation control unit 125, a display control unit 126, and the like, which are connected to the bus 100X. It has a position information acquisition unit 127, a person recognition unit 131, a face direction determination unit 135, and a recording control unit 136.

The video data acquisition unit 120 acquires video data obtained by photographing the interior of the vehicle and the periphery of the vehicle. More specifically, the video data acquisition unit 120 acquires the first video data output by the first camera 200 and the second video data output by the second camera 210.

The buffer memory 121 is one of the internal memories included in the recording control device 100, and temporarily records the first video data and the second video data for a certain period of time acquired by the video data acquisition unit 120 while updating them. Memory to do.

The video data processing unit 122 stores the video data temporarily stored in the buffer memory 121, for example, by H.I. Convert to any file format encoded by any codec such as 264 or MPEG-4 (Moving Picture Experts Group), for example MP4 format. The video data processing unit 122 generates video data as a file for a certain period of time from the video data temporarily stored in the buffer memory 121. As a specific example, the video data processing unit 122 generates video data temporarily stored in the buffer memory 121 as one file of video data for 60 seconds in the recording order. The video data processing unit 122 outputs the generated video data to the recording control unit 136. Further, the video data processing unit 122 outputs the generated video data to the display control unit 126. The period of the video data generated as a file is set to 60 seconds as an example, but the period is not limited to this. The video data referred to here may be data including audio in addition to the video captured by the first camera 200 and the second camera 210.

The reproduction control unit 124 controls to reproduce the internal / external recording data or the loop recording data recorded in the recording unit 220 based on the control signal of the reproduction operation output from the operation control unit 125.

The operation control unit 125 acquires the operation information of the operation received by the operation unit 230. For example, the operation control unit 125 performs save operation information indicating a manual save operation of video data, selection operation information indicating a video data selection operation, playback operation information indicating a video data playback operation, or video data erasing operation. The indicated erase operation information is acquired and the control signal is output. For example, the operation control unit 125 acquires end operation information indicating an operation for ending loop recording and outputs a control signal.

The display control unit 126 controls the display of video data on the display unit 240. The display control unit 126 outputs a video signal for outputting the video data to the display unit 240. More specifically, the display control unit 126 causes the display unit 240 to display the image reproduced by the reproduction control unit 124. The display control unit 126 outputs a video signal captured by the first camera 200 or the second camera 210, or a video signal to be displayed by reproducing the internal / external recorded data or the loop recorded data recorded in the recording unit 220.

The position information acquisition unit 127 calculates the current position information of the vehicle by a known method based on the radio waves received by the GPS reception unit 250. The position information calculated by the position information acquisition unit 127 is stored together with the internal / external recorded data.

The person recognition unit 131 recognizes the orientation of the faces of all the occupants of the vehicle. The person recognition unit 131 detects all the occupants in the vehicle interior from the first video data. The person recognition unit 131 performs a person recognition process on the video data, detects the person, and recognizes the direction of the face. More specifically, the person recognition unit 131 performs pattern matching on the video data using the recognition dictionary data stored in the person recognition dictionary storage unit 260, and detects the presence of the person. The person recognition unit 131 tracks the detected person by image processing. The method of recognizing a person by the person recognition unit 131 is not limited to this, and a known method may be used.

Based on the first video data acquired by the video data acquisition unit 120, the face direction determination unit 135 determines that the faces of the plurality of occupants of the vehicle match from different orientations. More specifically, the face direction determination unit 135 recognizes the face orientations of all the occupants displayed in the first video data based on the recognition result of the person recognition unit 131. The face direction determination unit 135 determines whether or not the faces of all the recognized occupants have the same face orientation. Matching face orientations is not limited to exact matching, and may include falling within a predetermined range. Matching the faces is not limited to the case where they match at the same timing, but may include matching within a predetermined period.

The face direction determination unit 135 determines whether or not the faces of a plurality of occupants, which are a part of all the occupants, match, and determines that the faces of the occupants match. good. At this time, it is desirable to determine whether or not the faces of more than half of the occupants match.

The face direction determination unit 135 may determine whether or not the faces of all the occupants match, and may determine that the faces of the occupants match.

The face direction determination unit 135 may relax the determination condition of whether or not the faces of the occupants match the faces of the driver. More specifically, the face direction determination unit 135 may make the weighting of the driver lighter than that of the other occupants when determining whether or not the faces of the occupants match. For example, the face direction determination unit 135 may determine that the directions of the occupants are the same when the faces of a plurality of occupants other than the driver are the same. For example, the face determination unit 135 may set the timing of the match determination when the face orientations of a plurality of occupants other than the driver and the face orientations of the driver match. For example, when the face direction determination unit 135 determines whether or not the faces of the occupants match within a predetermined time, the driver can safely move the face direction. The predetermined time may be set longer in consideration of the time lag until.

The recording control unit 136 controls the recording unit 220 to record the video data filed by the video data processing unit 122. During the period when the loop recording process is executed, such as when the accessory power supply of the vehicle is turned on, the recording control unit 136 uses the video data filed by the video data processing unit 122 as overwriteable video data in the recording unit 220. Record in. More specifically, when the recording control unit 136 continues to record the video data generated by the video data processing unit 122 in the recording unit 220 during the period of executing the loop recording processing, and the capacity of the recording unit 220 becomes full, The oldest video data is overwritten with the new video data and recorded.

Further, when the face direction determination unit 135 determines that the faces of the plurality of occupants of the vehicle match, the recording control unit 136 inputs the first video data acquired by the video data acquisition unit 120 and the plurality of occupants of the vehicle. The second video data corresponding to the orientation of the face is associated with the second video data and recorded in the recording unit 220. The recording control unit 136 records the first video data and the second video data as a still image or a moving image. The first video data and the second video data recorded in association with each other are referred to as internal / external recorded data. In the second video data recorded in association with the first video data, the direction of the occupant's face is photographed.

For example, as shown in FIG. 2, the recording control unit 136 cuts out a still image at the time when the face direction determination unit 135 determines that the faces of a plurality of occupants of the vehicle match, and records the still image. do. FIG. 2 is a diagram illustrating an example of a still image in a vehicle interior recorded by the recording control device 100 according to the first embodiment. For example, a still image is recorded in which the faces of a plurality of occupants match.

For example, as shown in FIG. 3, the recording control unit 136 obtains a moving image of a predetermined period before the time when the face direction determination unit 135 determines that the faces of all the occupants of the vehicle match, from the first video data. Cut out and record. FIG. 3 is a diagram illustrating an example of a moving image in the vehicle interior recorded by the recording control device 100 according to the first embodiment. An example of the predetermined period is a period of about 10 seconds or more and 60 seconds or less until the time when it is determined that the faces of all the occupants of the vehicle match. For example, record a video of the process until the faces of all occupants match.

For example, as shown in FIG. 4, the recording control unit 136 cuts out a still image at the time when the face direction determination unit 135 determines that the faces of a plurality of occupants of the vehicle match, and records the still image. do. FIG. 4 is a diagram illustrating an example of a still image outside the vehicle recorded by the recording control device 100 according to the first embodiment. For example, a still image of the scenery outside the vehicle in the direction of the faces of the occupants at the time when the faces of the occupants match is recorded.

For example, as shown in FIG. 5, the recording control unit 136 obtains a moving image of a predetermined period after the time when the face direction determination unit 135 determines that the faces of all the occupants of the vehicle match, from the second video data. Cut out and record. FIG. 5 is a diagram illustrating an example of a moving image outside the vehicle recorded by the recording control device 100 according to the first embodiment. An example of the predetermined period is a period of about 10 seconds or more and 60 seconds or less after the time when it is determined that the faces of all the occupants of the vehicle match. Further, for example, a moving image of the scenery outside the vehicle in the direction of the faces of the occupants may be recorded until the faces of all the occupants match.

Next, the flow of the recording process in the recording control device 100 will be described with reference to FIG. FIG. 6 is a flowchart showing a flow of recording processing in the recording control device 100 according to the first embodiment.

The recording control device 100 starts loop recording by the recording control unit 136 (step S101). More specifically, the recording control device 100 transmits the video data captured by the first camera 200 and the second camera 210 to the buffer memory 121 by the recording control unit 136, and the video for a predetermined period such as every 60 seconds is transmitted. A video file is generated for each, and the recording unit 220 records the video file. The recording control device 100 proceeds to step S102.

The recording control device 100 determines whether or not the directions of the faces of the occupants match based on the first video data by the face direction determination unit 135 (step S102). As described above, whether or not the faces of the occupants match may be determined by determining whether or not the faces of a plurality of occupants who are a part of all the occupants match. It may be determined whether or not the faces of all the occupants match. When the face direction determination unit 135 determines that the faces of the occupants match (Yes in step S102), the recording control device 100 proceeds to step S103. If the face direction determination unit 135 does not determine that the faces of the occupants match (No in step S102), the recording control device 100 proceeds to step S104.

When it is determined that the directions of the faces of the occupants match (Yes in step S102), the recording control device 100 uses the recording control unit 136 to record the inside and outside of the data in which the first video data and the second video data are associated with each other. The data is recorded in the recording unit 220 (step S103). As the first video data, for example, a still image as shown in FIG. 2 or a moving image as shown in FIG. 3 is stored. As the second video data, for example, a still image as shown in FIG. 4 or a moving image as shown in FIG. 5 is stored. The recording control device 100 proceeds to step S104.

The recording control device 100 determines whether or not to end the loop recording (step S104). More specifically, when the recording control device 100 is operated to stop the recording of the video data, or when the control signal for stopping the recording is received from the recording control unit 136 (Yes in step S104), the loop recording is performed. Finish and finish the process. The recording control device 100 returns to step S102 when the operation for stopping the recording of the video data has not been performed and when the control signal for stopping the recording has not been received from the recording control unit 136 (No in step S104). And execute the process again.

As described above, in the present embodiment, when it is determined that the faces of a plurality of occupants of the vehicle match, the still image or moving image inside the vehicle and the still image or moving image outside the vehicle are recorded as internal / external recorded data. Recorded. According to the present embodiment, when the line of sight of the occupant of the vehicle is gathered, the state of the occupant and the state of the outside of the vehicle can be stored in association with each other as internal / external record data. According to the present embodiment, for example, when an object of interest to the occupant appears outside the vehicle while riding in the vehicle, the reaction of the occupant inside the vehicle as well as outside the vehicle can be captured as a still image or a moving image. According to the present embodiment, it is possible to record internal and external recorded data that is interesting or interesting not only to a family member or an acquaintance but also to a third party when it is published on SNS or the like. Further, in the present embodiment, when the vehicle is disclosed on SNS or the like, the state of the occupant and the corresponding state of the outside of the vehicle can be easily associated and disclosed. As described above, the present embodiment can appropriately store the video data taken while the vehicle is running.

[Second Embodiment]
The vehicle recording device 10A according to the present embodiment will be described with reference to FIGS. 7 to 9. FIG. 7 is a block diagram showing a configuration example of a vehicle recording device 10A having the recording control device 100A according to the second embodiment. FIG. 8 is a diagram illustrating an example of a moving image outside the vehicle recorded by the recording control device 100A according to the second embodiment. FIG. 9 is a flowchart showing a flow of recording processing in the recording control device 100A according to the second embodiment. The basic configuration of the vehicle recording device 10A is the same as that of the vehicle recording device 10 of the first embodiment. In the following description, the same components as those of the vehicle recording device 10 are designated by the same reference numerals or corresponding reference numerals, and detailed description thereof will be omitted. The point of having the discontinuity determination unit 132A and the processing in the recording control unit 136A are different from those of the first embodiment.

The discontinuity determination unit 132A performs image processing on the first video data or the second video data to determine the presence or absence of discontinuity in the video. The discontinuity of an image is determined by comparing frames every frame or every few frames to determine whether or not there is a discontinuity such as luminance, color difference, or edge. For the compared frames, for example, when the difference such as the brightness, the color difference, or the edge is equal to or more than a predetermined value, it is determined that the discontinuity has occurred. The occurrence of video discontinuity indicates that a change has occurred inside or outside the vehicle. In the present embodiment, it is determined whether or not there is a discontinuity in the second video data. The occurrence of the discontinuity of the second video data is a change in the scenery outside the vehicle, for example, the field of view suddenly opens, the object suddenly appears, the shape of the object suddenly changes, and so on. Is likely to have occurred. When there is such a change in the scenery outside the vehicle, it is highly likely that the occupants will notice the change in the scenery and the faces of all the occupants in the vehicle will be aligned.

For example, as shown in FIG. 8, the recording control unit 136A uses the second video data for a moving image of a predetermined period including before and after the time when the discontinuity determination unit 132A determines that the second video data has a discontinuity. Cut out from and record. An example of a predetermined period is a period of about 10 seconds or more and 60 seconds or less before and after the time when it is determined that the discontinuity has occurred. Record videos before and after the time when the discontinuity is determined to occur, before the time when the faces of all the occupants of the vehicle match.

Next, the flow of the recording process in the recording control device 100A will be described with reference to FIG. The processing of step S111, step S112, step S115, and step S116 is the same as that of step S101, step S102, step S103, and step S104 of the flowchart shown in FIG.

The recording control device 100A determines whether or not there is a discontinuity in the second video data by the discontinuity determination unit 132A (step S113). When it is determined that there is a discontinuity in the second video data (Yes in step S113), the process proceeds to step S114. If it is not determined that there is a discontinuity in the second video data (No in step S113), the process proceeds to step S115.

The recording control device 100A stores the second video data and the first video data for a predetermined period including the time point of occurrence of the discontinuity by the recording control unit 136A (step S114). As the second video data, a moving image as shown in FIG. 8 is stored. As the first video data, for example, a still image as shown in FIG. 2 or a moving image as shown in FIG. 3 is stored.

As described above, in the present embodiment, a moving image for a predetermined period including before and after the time when it is determined that the second video data has a discontinuity is cut out from the second video data and recorded. According to the present embodiment, it is possible to save a moving image of changes in the scenery outside the vehicle, which causes the faces of the occupants to match in direction.

[Third Embodiment]
The vehicle recording device 10A according to the present embodiment will be described with reference to FIGS. 10 to 12. FIG. 10 is a diagram illustrating an example of a moving image in the vehicle interior recorded by the recording control device 100A according to the third embodiment. FIG. 11 is a diagram illustrating another example of the moving image in the vehicle interior recorded by the recording control device 100A according to the third embodiment. FIG. 12 is a flowchart showing a flow of recording processing in the recording control device 100A according to the third embodiment. The basic configuration of the vehicle recording device 10A is the same as that of the vehicle recording device 10 of the second embodiment. The processing in the discontinuity determination unit 132A and the recording control unit 136A is different from that of the second embodiment.

The discontinuity determination unit 132A determines whether or not there is a discontinuity in the first video data. The occurrence of the discontinuity of the first video data means that, for example, the direction of the occupant's face suddenly changed, the occupant's facial expression suddenly changed, and a recording device for a vehicle (not shown) is generated in the vehicle interior. It is highly probable that the occupant had a movement, such as getting the occupant's cheers from the microphone included in 10. Such occupant movements are likely to be noticed by other occupants and to match the faces of multiple occupants in the vehicle. The time when there is such a movement of the occupant is the start time of the process until the faces of the plurality of occupants of the vehicle match.

For example, as shown in FIG. 10, the recording control unit 136A uses the first video data for a moving image for a predetermined period including before and after the time when the discontinuity determination unit 132A determines that the first video data has a discontinuity. Cut out from and record. An example of a predetermined period is a period of about 10 seconds or more and 60 seconds or less before and after the time when it is determined that the discontinuity has occurred. For example, a moving image cut out from the first video data is recorded from the time before the movement of the occupant to the time when it is determined that the faces of the plurality of occupants in the vehicle match. For example, a moving image cut out from the first video data is recorded from the time before the movement of the occupant to the time after it is determined that the faces of the plurality of occupants in the vehicle match.

As shown in FIG. 11, the recording control unit 136A includes, for example, before and after the time when it is determined that the faces of the plurality of occupants of the vehicle match, and from the time when it is determined that the occupants have moved. Record the moving image cut out from the first video data for the period including the latter. For example, a moving image cut out from the first video data is recorded for a period from before the time when the faces of a plurality of occupants of the vehicle match and after the time when the occupants move.

Next, the flow of the recording process in the recording control device 100A will be described with reference to FIG. The processing of step S121, step S122, step S125, and step S126 is the same as that of step S111, step S112, step S115, and step S116 of the flowchart shown in FIG.

The recording control device 100A determines the presence / absence of discontinuity of the first video data, in other words, the presence / absence of movement of the occupant, by the discontinuity determination unit 132A (step S123). If it is determined that there is movement of the occupant (Yes in step S123), the process proceeds to step S124. If it is not determined that the occupant is moving (No in step S123), the process proceeds to step S125.

The recording control device 100A stores the first video data and the second video data for a predetermined period including the time point of occurrence of the discontinuity by the recording control unit 136A (step S124). As the first video data, a moving image as shown in FIG. 10 is stored. As the second video data, for example, a still image as shown in FIG. 4 or a moving image as shown in FIG. 5 is stored.

As described above, in the present embodiment, a moving image for a predetermined period including before and after the time when it is determined that the first video data is discontinuous and the occupant has moved is cut out from the first video data and recorded. do. According to the present embodiment, it is possible to save a still image or a moving image of the occupant who first noticed the change outside the vehicle and reacted.

Although the vehicle recording device 10 and the reproducing device 20 according to the present invention have been described so far, they may be implemented in various different forms other than the above-described embodiment.

Each component of the vehicle recording device 10 and the reproducing device 20 shown is functionally conceptual, and does not necessarily have to be physically configured as shown in the drawing. That is, the specific form of each device is not limited to the one shown in the figure, and all or part of each device is functionally or physically dispersed or integrated in an arbitrary unit according to the processing load and usage status of each device. You may.

The configuration of the vehicle recording device 10 and the playback device 20 is realized, for example, by a program loaded in a memory as software. In the above embodiment, it has been described as a functional block realized by cooperation of these hardware or software. That is, these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof.

The above-mentioned components include those that can be easily assumed by those skilled in the art and those that are substantially the same. Further, the above configurations can be combined as appropriate. Further, various omissions, substitutions or changes of the configuration can be made without departing from the gist of the present invention.

The recording control unit 136 may record the internal / external recorded data with overwrite prohibition. The recording control unit 136 may set a "candidate flag" indicating that the internal / external recorded data is a candidate for SNS disclosure.

The vehicle recording device 10 may further have a communication unit capable of communicating with an external server device in order to publish internal / external recorded data on SNS or the like.

10 Vehicle recording device (recording device)
100 Recording control device 100X bus 120 Video data acquisition unit 121 Buffer memory 122 Video data processing unit 124 Playback control unit 125 Operation control unit 126 Display control unit 127 Position information acquisition unit 131 Person recognition unit 135 Face direction determination unit 136 Recording control unit 200 First camera (first shooting section)
210 Second camera (second shooting section)
220 Recording unit 230 Operation unit 240 Display unit 250 GPS receiving unit

Claims (9)

A video data acquisition unit that acquires the first video data taken by the first shooting unit that shoots the interior of the vehicle and the second video data taken by the second shooting unit that shoots the periphery of the vehicle.
Based on the first video data acquired by the video data acquisition unit, a face direction determination unit that determines that the faces of a plurality of occupants of the vehicle match.
When the face direction determination unit determines that the face orientations of the plurality of occupants of the vehicle match, the first video data acquired by the video data acquisition unit and the face orientations of the plurality of occupants of the vehicle are set. A recording control unit that records the corresponding second video data in association with each other,
A recording control device. The recording control unit determines that the still images at the time when the face direction determination unit determines that the faces of the plurality of occupants of the vehicle match, or the time when the face directions of all the occupants match. The previous moving image is cut out from the first video data and recorded.
The recording control device according to claim 1. The recording control unit determines that the still images at the time when the face direction determination unit determines that the faces of the plurality of occupants of the vehicle match, or the time when the face directions of all the occupants match. Subsequent moving images are cut out from the second video data and recorded.
The recording control device according to claim 1 or 2. The face direction determination unit determines the orientation of the face of the driver of the vehicle among the occupants by changing the orientation and weighting of the faces of other occupants.
The recording control device according to any one of claims 1 to 3. A discontinuity determination unit for determining the discontinuity of the second video data acquired by the video data acquisition unit, and further
The recording control unit records the second video data including the time when it is determined that the discontinuity of the second video data has occurred.
The recording control device according to any one of claims 1 to 3. A discontinuity determination unit for determining the discontinuity of the first video data acquired by the video data acquisition unit, and further
The recording control unit records the first video data including the time when it is determined that the discontinuity of the first video data has occurred.
The recording control device according to any one of claims 1 to 3. The recording control device according to any one of claims 1 to 5.
It includes at least one of a first photographing unit for photographing the interior of the vehicle and a second photographing unit for photographing the periphery of the vehicle.
Recording device. A video data acquisition step of acquiring the first video data taken by the first shooting unit that shoots the interior of the vehicle and the second video data taken by the second shooting unit that shoots the periphery of the vehicle.
Based on the first video data acquired by the video data acquisition step, a face direction determination step for determining that the faces of a plurality of occupants of the vehicle match, and a face direction determination step.
When it is determined by the face direction determination step that the faces of the plurality of occupants of the vehicle match, the first video data acquired by the video data acquisition step and the faces of the plurality of occupants of the vehicle A recording control step for recording in association with the second video data corresponding to the orientation, and
Recording control methods including. A video data acquisition step of acquiring the first video data taken by the first shooting unit that shoots the interior of the vehicle and the second video data taken by the second shooting unit that shoots the periphery of the vehicle.
Based on the first video data acquired by the video data acquisition step, a face direction determination step for determining that the faces of a plurality of occupants of the vehicle match, and a face direction determination step.
When it is determined by the face direction determination step that the faces of the plurality of occupants of the vehicle match, the first video data acquired by the video data acquisition step and the faces of the plurality of occupants of the vehicle A recording control step for recording in association with the second video data corresponding to the orientation, and
A program that causes a computer that operates as a recording control device to execute.

Images