JP7310196B2 - Recording device, recording method and program - Google Patents

Description

The present invention relates to a recording device, recording method and program.

2. Description of the Related Art A recording device (hereinafter also referred to as a drive recorder) for reproducibly recording video for a predetermined period when an event such as an accident or dangerous driving of a vehicle is detected is widely used. Also, various techniques have been proposed for the drive recorder to properly record events.

For example, the recording apparatus described in Patent Document 1 has a first threshold lower than the second threshold in order to determine that an event candidate has occurred. For example, when it is determined that the sensor information detected by the acceleration sensor exceeds a first threshold value for detecting an event candidate of a vehicle collision, the event candidate determination unit determines that the event candidate has occurred. . Further, for example, when the event candidate determination unit determines that the audio information detected by the microphone exceeds a first threshold value for determining the event candidate of rubbing by a vehicle or the like, it is determined that the event candidate has occurred. judge.

The drive recorder described in Patent Document 2 determines that the recording condition is established when the acceleration information applied to the vehicle exceeds a second threshold that is larger than the first threshold after the acceleration information has become equal to or less than the first threshold. to record video information.

JP 2018-046343 A Japanese Patent Application Laid-Open No. 2009-087007

The technique described in Patent Literature 1 assumes an event such as a contact accident or theft accident that occurs while the vehicle is parked. Further, the technique described in Patent Document 2 is for suppressing malfunction of the acceleration sensor. However, it may be preferable, for example in a moving vehicle, to record even if a certain set threshold is not exceeded. On the other hand, simply lowering the threshold may result in excessive recording of unnecessary information.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a recording apparatus and the like capable of flexibly and appropriately recording events while moving.

A recording apparatus according to the present invention includes a photographed data acquisition section, a photographed data analysis section, an acceleration sensor, an event detection section, and a recording control section. The captured data acquisition unit acquires captured data obtained by capturing an image of the outside of the mobile body by a camera installed on the mobile body. The captured data analysis unit analyzes information included in captured data. The acceleration sensor acquires an acceleration value applied to the moving object. The event detection unit detects that an event has occurred with respect to the moving object when the acceleration value is equal to or greater than a first threshold, and the acceleration value is smaller than the first threshold and equal to or greater than a second threshold smaller than the first threshold. In that case, the occurrence of an event is detected based on the result of the analysis. The recording control unit records, as event record data, photographic data for a preset period from at least a part of the photographic data based on the detection of the event.

A recording method according to the present invention includes a photographed data acquisition step, a photographed data analysis step, an acceleration value acquisition step, an event detection step, and a recording control step. The photographed data acquisition step acquires photographed data obtained by photographing the outside of the mobile body with a camera installed on the mobile body. The photographed data analysis step analyzes information included in the photographed data. The acceleration value detection step acquires an acceleration value applied to the moving body. The event detection step detects that an event has occurred with respect to the moving body when the acceleration value is equal to or greater than a first threshold, In that case, the occurrence of an event is detected based on the result of the analysis. The recording control step records, as event record data, photographic data for a preset period from at least a part of the photographic data based on the detection of the event.

A program according to the present invention causes a computer to execute a recording method having a photographed data acquisition step, a photographed data analysis step, an acceleration value acquisition step, an event detection step, and a recording control step. The photographed data acquisition step acquires photographed data obtained by photographing the outside of the mobile body with a camera installed on the mobile body. The photographed data analysis step analyzes information included in the photographed data. The acceleration value detection step acquires an acceleration value applied to the moving object. The event detection step detects that an event has occurred with respect to the moving body when the acceleration value is equal to or greater than a first threshold, In that case, the occurrence of an event is detected based on the result of the analysis. The recording control step records, as event record data, photographic data for a preset period from at least a part of the photographic data based on the detection of the event.

According to the present invention, it is possible to provide a recording apparatus and the like that can flexibly and appropriately record events while moving.

1 is a top view of a vehicle equipped with a recording device; FIG. 1 is a block diagram of a printing apparatus according to a first embodiment; FIG. FIG. 2 is a first diagram showing the relationship between shooting data stored in a recording device and time; FIG. 4 is a second diagram showing the relationship between shooting data stored in the recording device and time. 4 is a flow chart showing processing of the printing apparatus according to the first embodiment; 4 is a diagram showing an example of photographed data recorded by the recording device according to the first embodiment; FIG. 2 is a block diagram of a printing apparatus according to a second embodiment; FIG. 9 is a flow chart showing processing of the printing apparatus according to the second embodiment;

BEST MODE FOR CARRYING OUT THE INVENTION Hereinafter, the present invention will be described through embodiments of the invention, but the invention according to the scope of claims is not limited to the following embodiments. Moreover, not all the configurations described in the embodiments are essential as means for solving the problems. For clarity of explanation, the following descriptions and drawings are omitted and simplified as appropriate. In each drawing, the same elements are denoted by the same reference numerals, and redundant description is omitted as necessary.

<Embodiment 1>
The configuration of the first embodiment will be described below with reference to the drawings. FIG. 1 is a top view of a vehicle equipped with a recording device. A recording device 10 is fixed to the upper central portion of the windshield of a vehicle 900, which is a moving body. The recording device 10 is set to photograph the front of the vehicle 900 . The camera of the recording device 10 captures the front of the vehicle 900 with a viewing angle of 180 degrees, as shown in the figure. The recording device 10 records and reproduces photographed data photographed by a camera. That is, the recording device 10 has a function as a drive recorder. The recording device 10 in this embodiment may be called a drive recorder.

Next, the details of the functional configuration of the recording apparatus 10 will be described with reference to FIG. FIG. 2 is a block diagram of the recording apparatus according to the first embodiment; The recording apparatus 10 has a control unit 100 that controls each component and a plurality of components connected to the control unit 100 . The control unit 100 is a control device having a circuit board on which a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a memory, a plurality of interfaces, etc. are mounted. process.

Details of the control unit 100 will be described below. The control unit 100 includes a captured data acquisition unit 120, a buffer memory 121, a captured data processing unit 122, a recording control unit 123, a playback control unit 124, an operation control unit 125, a display control unit 126, an event detection unit 127, and a position information acquisition unit. 128 , a photographed data analysis unit 129 and an audio control unit 130 , and the configuration for executing these processes and controls is realized by a program executed by the control unit 100 . For convenience, these configurations are represented as being connected to bus line 110 respectively.

The captured data acquisition unit 120 acquires captured data supplied from the camera 150 . The captured data acquisition unit 120 supplies captured data to the buffer memory 121 via the bus line 110 .

Buffer memory 121 is a volatile or non-volatile memory device. The buffer memory 121 sequentially receives photographed data periodically generated by the camera 150 via the photographed data acquisition unit 120 and temporarily stores the received photographed data. The shooting data temporarily stored in the buffer memory 121 is for a preset period. The buffer memory 121 sequentially erases photographed data that has passed a preset period, or sequentially overwrites it with newly received photographed data.

The photographed data processing unit 122 generates a photographed file in a format conforming to a preset method from the photographed data stored in the buffer memory 121 . The preset method is, for example, H.264. H.264 and MPEG-4 (Moving Picture Experts Group).

Note that the photographed data processing unit 122 may process the photographed data and generate a photographed file with a preset angle of view. Further, the photographed data processing unit 122 processes the photographed data output from the buffer memory 121, generates photographed data for a preset time or a preset angle of view, and adds header information such as a file name. may be used to generate a capture file. Further, the photographed data processing unit 122 may process the photographed data output from the buffer memory 121 and perform noise removal, distortion correction, etc. on the photographed data. A photographed file may be generated that displays the position information of the .

The recording control unit 123 controls the recording unit 160 to record the captured file generated by the captured data processing unit 122 . When the event detection unit 127 detects an event, the recording control unit 123 records, in the recording unit 160, captured files for a period set in advance based on the detection of the event as overwrite-prohibited event recording data. The recording control section 123 records the event recording data in a predetermined recording area in the recording section 160 . A predetermined recording area is, for example, a recording area that is prohibited from being overwritten or erased. Alternatively, the event recording data supplied to the recording unit 160 by the recording control unit 123 may be recorded by including a flag indicating prohibition of overwriting or erasing in the file.

Note that, when the event detection unit 127 does not detect an event, the recording control unit 123 may cause the recording unit 160 to store the photographed file in an overwritable state. A photographed file different from the event record data stored in the recording unit 160 is referred to as a "normal file" here. When the storage capacity of the recording unit 160 reaches the upper limit, the recording control unit 123 may delete the old normal files and record the newly generated normal files in the recording unit 160 .

The reproduction control unit 124 performs processing for reproducing recorded event recording data under preset conditions. The preset condition is, for example, a case where an operation by a user (hereinafter also referred to as a passenger) on board the vehicle 900 is accepted.

The operation control unit 125 acquires operation information received by the operation unit 140, and outputs operation instructions based on the operation information to each component. When the operation control unit 125 receives an instruction to select various data to be reproduced from the operation unit 140, the operation control unit 125 causes the reproduction control unit 124 to select a file or the like recorded in the recording unit 160. FIG. When the operation control unit 125 acquires an instruction regarding reproduction of various data from the operation unit 140, the operation control unit 125 causes the reproduction control unit 124 to perform processing regarding reproduction. Instructions relating to reproduction of various data are, for example, reproduction start, pause, reproduction stop, enlarged display, and the like.

The display control unit 126 controls the display unit 141 to display various information. For example, the display control unit 126 causes the display unit 141 to display captured data being captured by the camera 150 . The display control unit 126 also receives the event recording data supplied from the reproduction control unit 124 and causes the display unit 141 to display the received event recording data. When a touch sensor is superimposed on the display unit 141 as a function of the operation unit 140, the display control unit 126 causes the display unit 141 to appropriately display an icon or the like corresponding to the touch sensor.

The event detection unit 127 receives information about acceleration detected by the acceleration sensor 142, and compares the acceleration value included in the information with a preset first threshold or second threshold. The first threshold is, for example, a value that corresponds to an acceleration value that does not occur during normal running but that occurs due to the impact when colliding with another object. The second threshold is a value that is smaller than the first threshold and corresponds to a certain degree of acceleration that may occur even during normal running. The event detection unit 127 compares the acceleration value with the first threshold value or the second threshold value to detect that a predetermined event has occurred in the vehicle. In the present embodiment, the term "event" refers to events that occur in a vehicle with a predetermined impact, such as dangerous driving such as sudden stops and sudden starts, contact accidents, and collision accidents.

The event detection unit 127 detects that an event has occurred when the acceleration value is greater than or equal to the first threshold. The event detection unit 127 detects that an event has occurred based on the result of the analysis performed by the captured data analysis unit 129 when the acceleration value is smaller than the first threshold and equal to or greater than the second threshold. When the event detection unit 127 detects the occurrence of a predetermined event, the event detection unit 127 supplies the captured data processing unit 122 with a signal indicating the occurrence of the event.

Note that the event detection unit 127 may detect acceleration along the X-, Y-, and Z-axes, which are coordinate axes of triaxial coordinates, or may detect acceleration in at least one of these directions. good too. Also, the acceleration received from these three axial directions may be weighted. The first threshold and the second threshold detected by event detection section 127 may change according to the speed of vehicle 900 . That is, the higher the traveling speed of vehicle 900 is, the larger the first threshold value and the second threshold value may be.

A position information acquisition unit 128 receives signals from GPS satellites received by a GPS (Global Positioning System) reception unit 143, acquires position information that is information about the current position from the received signals, and controls recording of the acquired position information. 123. Location information includes, for example, the latitude and longitude of the vehicle at the time the signal was received from the GPS satellites.

The imaging data analysis unit 129 receives imaging data from the imaging data acquisition unit 120 and analyzes information included in the received imaging data. More specifically, the photographed data analysis unit 129 recognizes an object included in the photographed data, and detects whether or not there is a possibility that the object has come into contact with the vehicle 900 . When the photographed data analysis unit 129 detects the possibility that a preset object has come into contact with the vehicle 900, the event detection unit 129 outputs a signal indicating the possibility that an event has occurred as a result of the analysis. Notify 127.

The voice control unit 130 has preset voice data for transmission, and supplies the voice data to the speaker 144 . For example, after the recording control unit 123 completes saving the event recording data, the audio control unit 130 supplies the speaker 144 with audio data for notifying the passenger that the event recording data has been saved.

Next, each configuration connected to the control unit 100 will be described. The recording device 10 has an operation unit 140 , a display unit 141 , an acceleration sensor 142 , a GPS receiving unit 143 , a speaker 144 , a camera 150 and a recording unit 160 .

The operation unit 140 is a user interface that receives operations performed by the user on the recording apparatus 10 . The user interface may be, for example, an operation button or a touch sensor superimposed on the display unit 141 . The user interface may be a receiver for infrared rays or wireless communication, and may receive signals transmitted from a remote controller or the like. The operation unit 140 supplies operation information, which is information about the received operation, to the control unit 100 via a predetermined interface. The operation information is, for example, an instruction to start event recording, an instruction to reproduce event recorded data, or the like.

The display unit 141 is a display device that displays various information under the control of the display control unit 126 . The display unit 141 has, for example, at least a display panel such as a liquid crystal panel or organic EL (Electro Luminescence). The display unit 141 is connected to the display control unit 126 and displays signals supplied from the display control unit 126 . The display unit 141 is configured to display the video included in the event record data.

The acceleration sensor 142 is, for example, a 3-axis acceleration sensor and is installed at an arbitrary location on the recording device 10 . The acceleration sensor 142 detects acceleration applied to the acceleration sensor 142, and supplies information about the detected acceleration to the control unit 100 according to the detected acceleration. The acceleration sensor 142 is connected to the event detection section 127 and supplies information on the detected acceleration to the event detection section 127 . It should be noted that the information on the acceleration supplied from the acceleration sensor 142 to the control unit 100 can be used in other configurations as appropriate. . Note that the acceleration sensor 142 may be a one-axis or two-axis acceleration sensor instead of the three-axis acceleration sensor.

A GPS receiver 143 receives information about the current position of the vehicle from a satellite positioning system called GPS or GNSS (Global Navigation Satellite System). The GPS receiver 143 may be an antenna for receiving GPS signals, or may be a communication interface for receiving position information acquired by the vehicle. The GPS reception unit 143 supplies the received signal regarding the current position to the position information acquisition unit 128 .

The speaker 144 is a speaker that converts the audio data received from the audio control unit 130 into audio and transmits the audio so that the user can recognize the audio.

The camera 150 is an imaging device having an objective lens, an imaging element, an AD (Analog to Digital) conversion element, and the like. The camera 150 captures an image including scenery around a vehicle, which is a moving object, and generates image data that is data of the captured image. The camera 150 supplies the generated photographed data to the photographed data acquisition unit 120 .

The recording unit 160 is a recording device that stores the photographed data supplied from the camera 150 . The recording unit 160 is, for example, a memory card including a flash memory, or a non-volatile recording device such as an SSD (Solid State Drive) or HDD (Hard Disk Drive). The recording unit 160 is connected to the recording control unit 123, receives predetermined data from the recording control unit 123, and records the received data. In addition, the recording unit 160 supplies an event file containing recorded event record data to the reproduction control unit 124 according to an instruction from the reproduction control unit 124 . The recording unit 160 may be configured to be detachable from the recording device 10, or may be configured not to be detached.

Next, photographing data will be described with reference to FIG. FIG. 3 is a first diagram showing the relationship between shooting data stored in the recording device and time. The horizontal axis of the figure represents time, and indicates that time elapses in the direction of the arrow (to the right) from time t10 toward time t11.

The elongated shape shown along the time axis is imaging data C11 at time t11. The photographed data C11 is photographed data generated by the camera 150 and stored in the buffer memory 121 . The recording device 10 is set so as to always store photographed data for a preset period Pn. The period Pn is, for example, a period of 60 seconds, 120 seconds or 150 seconds. The photographed data C11 at time t11 is photographed data from time t10 to time t11, which is a period Pn before time t11. Further, the photographed data stored in the buffer memory 121 is sequentially erased from the photographed data past the period Pn as time elapses.

Here, in the example shown in FIG. 3, it is assumed that the recording device 10 detects the occurrence of an event at time t11. Therefore, the recording apparatus 10 thereafter performs processing for generating event recording data with reference to time t11.

Next, photographed data and event recording data after detecting the occurrence of an event will be described with reference to FIG. FIG. 4 is a second diagram showing the relationship between shooting data stored in the recording device and time. FIG. 4 shows the structure of data at time t21 after time t11. What is stored in the buffer memory 121 at time t21 is photographed data C21 from time t20 to time t21, which is a period Pn before time t21.

The rectangle shown below the shooting data C21 is the event recording data E11. The event record data E11 is extracted from the photographed data according to the event detected at time t11. In the present embodiment, the recording apparatus 10 sets the start time of the event record data to the time ts, which is the period P1 preceding the time t11 from the time t11 when the event was detected. Further, in the present embodiment, the recording apparatus 10 sets the time te after the period P2 has passed from the time t11 at which the event was detected as the end time of the event recording data. Period P1 and period P2 are periods such as 10 seconds, 15 seconds, or 20 seconds, for example. That is, the recording device 10 saves the shooting data for the period from time ts to time te as event recording data E11.

By generating the event recording data as described above, the recording device 10 can save the shooting data for the period before and after the event that has occurred. Therefore, by reproducing the event recording data saved by the recording device 10 after the event occurs, the user can visually recognize the situation around the vehicle before and after the event occurs.

Note that the recording device 10 may record a normal file in the recording unit 160 in addition to the event recording data. In this case, the recording device 10 extracts the imaged data for a predetermined period from the imaged data stored in the buffer memory 121 and records the extracted imaged data in the recording unit 160 as a normal file. The recording device 10 may perform the process of recording the normal file and the process of saving the event record data in parallel.

Next, processing performed by the recording apparatus 10 will be described with reference to FIG. FIG. 5 is a flowchart illustrating processing of the printing apparatus according to the first embodiment; FIG. 5 shows processing performed by the control unit 100 . The flowchart shown in FIG. 5 is started under arbitrary conditions, such as when power is supplied to the recording device 10 when the vehicle starts operating.

First, the imaging data acquisition unit 120 included in the control unit 100 starts acquiring imaging data. At the same time, the event detection unit 127 of the control unit 100 starts acquiring the acceleration value Gx (step S10). Photographed data is supplied from the camera 150 periodically (for example, 30 frames per second). The acceleration value Gx is also periodically acquired from the acceleration sensor 142 in the same manner. Note that the timing at which the imaging data acquisition unit 120 acquires the imaging data and the timing at which the event detection unit 127 acquires the acceleration value Gx may be different or the same. The photographed data acquisition unit 120 supplies the photographed data supplied from the camera 150 to the buffer memory 121 . The buffer memory 121 stores photographed data for a preset period (for example, 60 seconds), and after the photographed data for the preset period is stored, deletes old photographed data and sequentially stores new photographed data. .

Next, the event detection unit 127 determines whether or not the acceleration value Gx received from the acceleration sensor 142 is greater than or equal to the second threshold (step S11). If it is not determined that the acceleration value Gx is greater than or equal to the second threshold (step S11: No), it means that no event has occurred in the vehicle 900 . In this case, the event detection unit 127 repeats step S11.

On the other hand, when it is determined that the acceleration value Gx is greater than or equal to the second threshold (step S11: Yes), the event detection unit 127 determines whether the acceleration value Gx is less than the first threshold (step S12). If the acceleration value Gx is greater than or equal to the first threshold, the event detection unit 127 (step S12: No). In this case, the event detector 127 detects the occurrence of an event (step S18). Then, the recording control unit 123 proceeds to step S15 and records the event recording data (step S15).

Return to step S12. When the acceleration value Gx is smaller than the first threshold, the event detection unit 127 determines that the acceleration value Gx is smaller than the first threshold (Step S12: Yes). In this case, the captured data analysis unit 129 analyzes captured data for a preset period before and after the time when the event detection unit 127 acquires the acceleration value (step S13). The details of the analysis performed by the photographed data analysis unit 129 will be described later.

Next, the photographed data analysis unit 129 determines whether there is a possibility that an event has occurred in the photographed data in the analyzed period based on the result of the analysis (step S14). If it is not determined that there is a possibility that an event has occurred in the photographed data of the analyzed period (step S14: No), the control unit 100 does not record event record data, and proceeds to step S17.

On the other hand, if it is determined that an event may have occurred in the captured data of the analyzed period (step S14: Yes), the captured data analysis unit 129 determines that an event may have occurred as a result of the analysis. The event detection unit 127 is notified of the signal indicating the event. The event detection unit 127 thereby supplies a signal indicating the occurrence of the event to the captured data processing unit 122 . Then, the photographed data processing unit 122 generates event recording data, and then the recording control unit 123 records the event recording data in the recording unit 160 (step S15).

Next, the control unit 100 notifies the passenger that the event record data has been recorded (step S16). Specifically, the voice control unit 130 outputs a voice such as "The event record data has been saved because I was shocked just now" as the voice data for notifying the passenger that the event record data has been recorded to the speaker 144. make a call from In this way, by notifying the passenger by voice, it is possible to notify the passenger who is driving the vehicle without impairing the safety. Note that the audio control unit 130 may analyze the object that caused the event by the photographed data analysis unit 129 and transmit the object as audio data from the speaker 144 . In this case, for example, the voice control unit 130 may say, "The event record data has been saved because there is a possibility that you have come into contact with an animal just now." The speaker 144 is caused to transmit a voice such as "I have done it".

After notifying the user, the control unit 100 proceeds to step S17. At step S17, the control unit 100 determines whether or not to end the processing shown in FIG. 5 (step S17). If it is not determined to end the process (step S17: No), the control unit 100 returns to step S11 and again compares the acceleration value with the second threshold. On the other hand, when determining to end the process (step S17: Yes), the control unit 100 ends the process.

With the above processing, the recording device 10 performs processing for recording event recording data. Through such processing, the recording apparatus 10 can appropriately record events during movement.

Next, an example of analysis performed by the captured data analysis unit 129 will be described with reference to FIG. 6 is a diagram of an example of photographed data recorded by the recording apparatus according to the first embodiment; FIG. An image A10 shown in FIG. 6 is an image that is subjected to the processing of step S13 described with reference to FIG. That is, the image A10 is an image several seconds before the time when the acceleration value Gx was obtained when the acceleration value Gx was equal to or greater than the second threshold value and less than the first threshold value.

Image A10 shows that vehicle 900 is about to enter an intersection. A bicycle B10 is running near the vehicle 900 on the left front side of the vehicle 900 . In addition, there are human B20 and human B30 who are about to cross the pedestrian crossing ahead. A region Z10 is shown at the bottom of the image A10. A region Z10 indicates a close range of the vehicle 900. FIG. Note that the area Z10 may be preset in the recording apparatus 10, or may be set by the user via the operation unit 140. FIG. If another object is included in region Z10, there is a high possibility that the other object will come into contact with vehicle 900. FIG. In image A10, part of bicycle B10 is included in area Z10. Therefore, image A10 indicates that bicycle B10 is likely to come into contact with vehicle 900 .

In the situation described above, the captured data analysis unit 129 recognizes the bicycle B10, the person B20, and the person B30 included in the image A10. Specifically, the photographed data analysis unit 129 extracts feature amounts in the image data and recognizes objects by using HOG (Histograms of Oriented Gradients), for example. Techniques for recognizing objects from image data are already widely known to those skilled in the art. Therefore, detailed description is omitted here. The photographed data analysis unit 129 is set to recognize, for example, humans, bicycles, motorbikes, automobiles, and animals.

In this way, the captured data analysis unit 129 generates an event when the predetermined object is included in the region Z10 in the image obtained when the acceleration value Gx is equal to or greater than the second threshold value and less than the first threshold value. determine that it is possible. With such a configuration, the photographed data analysis unit 129 determines whether or not there is a possibility that an event has occurred by associating and analyzing the shock received by the acceleration sensor and the photographed data photographed by the camera 150. be able to.

Although the first embodiment has been described above, the configuration of the recording apparatus 10 according to the first embodiment is not limited to the above description. For example, the audio signal output by the audio control unit 130 may notify the type of object that may have come into contact. As a result, the recording device 10 can notify the content of the event more accurately. The audio control unit 130 may output a predetermined beep sound instead of the audio signal. As a result, the recording device 10 can notify the passenger of the recording of the event record data with a simple configuration. Also, the notification about the recording of the event record data may be made by light, a message displayed on the display unit 141, or the like, instead of the sound.

Camera 150 may be an infrared camera, a ranging sensor such as LIDAR (Laser Imaging Detection and Ranging), or a combination thereof. The camera 150 may have a camera for photographing the sides and rear of the vehicle 900 in addition to the camera for photographing the front of the vehicle 900 . Camera 150 may be a 360-degree camera that captures the surroundings of vehicle 900 .

With the above configuration, the recording device 10 can record event record data even when a minor contact accident or the like occurs, as shown in FIG. Further, in the recording device 10, the photographed data analysis unit 129 determines that an event has occurred, for example, when the impact is such that the passenger does not notice that the object has been run over. Therefore, the recording device 10 can prevent the occurrence of a hit-and-run accident due to negligence of the passenger.

<Embodiment 2>
Next, Embodiment 2 will be described. Embodiment 2 differs from Embodiment 1 in that an inquiry is made to the passenger regarding the recording of event record data.

A recording apparatus according to the second embodiment will be described with reference to FIG. FIG. 7 is a block diagram of a printing apparatus according to a second embodiment; The illustrated recording apparatus 20 has a control section 200 instead of the control section 100 . The control unit 200 further has a speech recognition unit 131 in addition to the configuration of the control unit 100 . The recording device 20 also has a microphone 145 as a configuration connected to the control unit 200 .

The voice recognition unit 131 is a voice recognition device that acquires voice input to the microphone 145 and recognizes human words included in the acquired voice. The speech recognition unit 131 detects words from human speech included in the acquired speech, and performs processing according to information about the detected words. The microphone 145 is a microphone that acquires user's utterances and sounds inside and outside the vehicle 900 , converts them into electrical signals, and supplies the converted electrical signals to the voice recognition unit 131 .

In the recording device 20, the voice control unit 130 can make an inquiry to the passenger using a predetermined voice. Also, the recording device 20 can acquire a response from the passenger to the inquiry made by the voice control unit 130 . With such a configuration, the recording device 20 exchanges information with the passenger by voice. As a result, the recording device 20 can easily exchange information with a passenger who is driving, for example, without impairing safety.

Next, an example of processing performed by the recording apparatus according to the second embodiment will be described with reference to FIG. FIG. 8 is a flow chart showing processing of the recording device 20 . The flowchart shown in FIG. 8 has steps S20 to S22 instead of steps S13 and S14 of the flowchart explained in FIG. In the following, the same contents as in the flowchart explained in FIG. 5 will be omitted as appropriate, and points different from the flowchart in FIG. 5 will be explained.

In step S12, when the acceleration value Gx is smaller than the first threshold, the event detection unit 127 determines that the acceleration value Gx is smaller than the first threshold (step S12: Yes). In this case, the captured data analysis unit 129 analyzes captured data for a preset period before and after the time when the event detection unit 127 acquires the acceleration value. Then, the photographed data analysis unit 129 generates information such as whether the predetermined object was included in the analysis result, whether the recognized predetermined object may have come into contact with the vehicle 900, and the like. is sent to the voice control unit 130 (step S20).

Next, the audio control unit 130 uses the information received from the photographed data analysis unit 129 to generate an inquiry message, and supplies the generated message to the speaker 144 to make an inquiry (step S21). The inquiry message may include, for example, the type of recognized object. More specifically, the inquiry message is "There is a possibility that the bicycle has hit the left side of the vehicle just now. Do you want to save the event record data?"

Next, the control unit 200 determines whether or not the passenger instructs to record the event record data (step S22). More specifically, it is determined whether or not the speech recognition unit 131 has recognized words such as "please", "okay", and "save" after the above inquiry.

When it is determined that a recording instruction has been received by recognizing the word (step S22: Yes), the speech recognition section 131 supplies the event detection section 127 with a signal indicating the occurrence of an event. The event detection unit 127 then supplies a signal indicating the occurrence of the event to the captured data processing unit 122 . Then, the photographed data processing unit 122 generates event recording data, and then the recording control unit 123 records the event recording data in the recording unit 160 (step S15).

On the other hand, if the above word is not recognized, or if a word such as "no" is recognized that negates the recording instruction, the speech recognition unit 131 does not determine that the instruction to record the event recording data has been received (step S22: No). ). In this case, the controller 200 proceeds to step S17.

By the above processing, the recording device 20 according to the second embodiment can record the event record data according to the intention of the passenger. Note that the processing of the second embodiment and the processing of the first embodiment may be combined. That is, when it is determined that the event recording data should be recorded as a result of the analysis of the photographed data, the recording device 20 may record the event recording data without inquiring of the passenger. Then, when it is determined that the event record data should not be recorded as a result of the analysis of the photographed data, the above inquiry may be made.

The second embodiment has been described above. In the recording device 20 according to the second embodiment, the control unit 200 has a trained model generated by machine learning, and speech recognition processing may be performed using the trained model.

With the configuration described above, the recording device 20 according to the second embodiment can provide a recording device or the like that can flexibly and appropriately record events during movement by inquiring of passengers.

It should be noted that the programs described above can be stored and supplied to the computer using various types of non-transitory computer-readable media. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-transitory computer-readable media include magnetic recording media (eg, flexible discs, magnetic tapes, hard disk drives), magneto-optical recording media (eg, magneto-optical discs), CD-ROM (Read Only Memory) CD-R, CD - R/W, including semiconductor memory (eg Mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), Flash ROM, RAM (Random Access Memory)). The program may also be delivered to the computer by various types of transitory computer readable media. Examples of transitory computer-readable media include electrical signals, optical signals, and electromagnetic waves. Transitory computer-readable media can deliver the program to the computer through wired channels, such as wires and optical fibers, or wireless channels.

It should be noted that the present invention is not limited to the above embodiments, and can be modified as appropriate without departing from the scope of the invention. The recording device may be connected to a network using a communication function, and may access a computer that performs predetermined analysis via the network. As a result, the recording apparatus may cause the computer to process the analysis of the photographed data, the selection of the audio data, the recognition of the response audio, etc. via the network, and obtain the results of the processing.

10, 20 recording device 100, 200 control unit 110 bus line 120 photographed data acquisition unit 121 buffer memory 122 photographed data processing unit 123 recording control unit 124 reproduction control unit 125 operation control unit 126 display control unit 127 event detection unit 128 position information acquisition Unit 129 Photographed data analysis unit 130 Voice control unit 131 Voice recognition unit 140 Operation unit 141 Display unit 142 Acceleration sensor 143 GPS receiver 144 Speaker 145 Microphone 150 Camera 160 Recording unit 900 Vehicle

Claims (3)

a photographed data acquisition unit for acquiring photographed data obtained by photographing the outside of the movable body by a camera installed on the movable body;
a photographed data analysis unit that analyzes information included in the photographed data;
an acceleration sensor that acquires an acceleration value applied to the moving object;
detecting that an event has occurred with respect to the moving object when the acceleration value is equal to or greater than a first threshold;
an event detection unit configured to detect occurrence of the event based on the analysis result when the acceleration value is smaller than the first threshold and equal to or greater than a second threshold smaller than the first threshold;
a recording control unit that records, as event record data, the photographed data for a period set in advance from the photographed data based on the detection of the event;
an audio controller that outputs audio to a user;
a speech recognition unit that acquires input speech and recognizes human words contained in the acquired speech;
A recording device comprising
When the acceleration value is smaller than the first threshold and equal to or greater than a second threshold smaller than the first threshold, the audio control unit instructs the user to record the event based on the result of the analysis. outputting a voice inquiring whether or not to record data, and notifying the user of the recording of the event recording data when the recording control unit records the event recording data;
The event detection unit detects that the event has occurred based on the user's instruction received via the voice recognition unit in response to the inquiry.
recording device. the computer
a photographed data acquisition step of acquiring photographed data obtained by photographing the exterior of the movable body with a camera installed on the movable body;
a photographed data analysis step of analyzing information included in the photographed data;
an acceleration value acquisition step of acquiring an acceleration value applied to the moving object;
detecting that an event has occurred with respect to the moving object when the acceleration value is equal to or greater than a first threshold;
an event detection step of detecting occurrence of the event based on the result of the analysis when the acceleration value is smaller than the first threshold and equal to or greater than a second threshold smaller than the first threshold;
a recording control step of recording, as event record data, the photographed data for a preset period from at least part of the photographed data based on the detection of the event;
a voice control step for outputting voice to a user;
a speech recognition step of acquiring input speech and recognizing human words contained in the acquired speech;
to perform a recording method comprising
In the voice control step, if the acceleration value is smaller than the first threshold value and equal to or greater than a second threshold value smaller than the first threshold value, the event recording is instructed to the user based on the result of the analysis. outputting a voice inquiring whether or not to record data, and notifying the user of the recording of the event recording data when the recording control step records the event recording data;
The event detection step detects that the event has occurred based on the user's instruction received via the speech recognition step in response to the query.
Recording method. a photographed data acquisition step of acquiring photographed data obtained by photographing the exterior of the movable body with a camera installed on the movable body;
a photographed data analysis step of analyzing information included in the photographed data;
an acceleration value acquisition step of acquiring an acceleration value applied to the moving object;
detecting that an event has occurred with respect to the moving object when the acceleration value is equal to or greater than a first threshold;
an event detection step of detecting occurrence of the event based on the result of the analysis when the acceleration value is smaller than the first threshold and equal to or greater than a second threshold smaller than the first threshold;
a recording control step of recording, as event record data, the photographed data for a preset period from at least part of the photographed data based on the detection of the event;
a voice control step for outputting voice to a user;
a speech recognition step of acquiring input speech and recognizing human words contained in the acquired speech;
In the voice control step, if the acceleration value is smaller than the first threshold value and equal to or greater than a second threshold value smaller than the first threshold value, the event recording is instructed to the user based on the result of the analysis. outputting a voice inquiring whether or not to record data, and notifying the user of the recording of the event recording data when the recording control step records the event recording data;
The event detection step detects that the event has occurred based on the user's instruction received via the speech recognition step in response to the query.
A program that makes a computer execute a recording method.

Images