KR102443843B1 - Vehicle and method for controlling the vehicle - Google Patents

Abstract

The vehicle of the present invention includes a speed detection unit for detecting a traveling speed; a first image acquisition unit for acquiring an external image; a second image acquisition unit for acquiring an image of the interior; Recognizing the behavior of the driver and the passenger based on the image acquired by the second image acquisition unit, capturing an external image acquired based on at least one of behavior information of the recognized behavior and information on the detected driving speed change, a control unit that generates a drive video by connecting the captured external image when driving is finished; and a storage unit for storing the generated drive video.

Description

Vehicle and method for controlling the vehicle}

The present invention relates to a vehicle for acquiring an external image and storing the acquired image, and a control method therefor.

A vehicle is a machine driven by wheels for the purpose of transporting people or cargo, and it moves on the road.

In addition to basic driving functions, these vehicles include radio functions, audio functions, video functions, road guidance functions (navigation functions), air conditioning functions, seat heating functions, external shooting functions (black box functions), communication functions with external user terminals, etc. Additional functions for convenience are further performed.

Here, the radio function is a function of outputting various information such as traffic information and news transmitted from a broadcasting station, or music.

The audio function uses a cassette tape recorder, CD player or a communication module that communicates with a storage medium or user terminal provided in the vehicle to load and play an audio file stored by a cassette tape or CD player, or It is a function to load and play music files stored in the terminal.

In addition, the vehicle performs a content reproduction function, an Internet search function, a call function, and a location search function through communication with the outside.

One aspect provides a vehicle and a control method thereof for capturing an external image being acquired based on at least one of user behavior information and vehicle driving information, and generating and outputting a drive video by connecting the captured images.

Another aspect provides a vehicle for storing user behavior information, location information, and area of interest information when capturing an external image as tag information, and generating and outputting a drive video having the tag information, and a control method thereof.

A vehicle according to an aspect includes a speed detector configured to detect a traveling speed; a first image acquisition unit for acquiring an external image; a control unit that captures an external image obtained based on the detected driving speed change information, and generates a drive video by connecting the captured external image when driving is finished; and a storage unit for storing the generated drive video.

According to one aspect, a vehicle includes: a location receiver configured to receive location information corresponding to a current location; The method further includes an input unit for receiving destination information, wherein the controller determines whether the current location is a destination based on the location information and the destination information, and generates a drive video from the source to the destination.

The control unit of the vehicle according to one aspect further includes, when capturing an external image, confirming the location information of the vehicle at the time of capture, and combining the identified location information with the captured image and storing it.

The vehicle according to one aspect further includes a location receiver configured to receive location information corresponding to a current location, wherein the controller captures the image acquired by the first image acquisition unit when the change in driving speed is a decrease in speed, and captures the acquired image The method further includes confirming the location information of the vehicle at the point of view and combining the identified location information with the captured image and storing.

In the vehicle according to one aspect, the control unit checks the position information of the shift lever, and if the position of the shift lever is at the parking stage, captures the image acquired from the first image acquisition unit, and captures the position information of the vehicle at the time of capturing the acquired image. It further includes confirming and storing the confirmed location information in combination with the captured image.

The control unit of the vehicle according to one aspect image-processes the external image acquired by the first image acquisition unit, recognizes another vehicle in the image-processed image, and the recognized distance to the other vehicle is greater than or equal to the reference distance, and If the change is a decrease in speed, the method further includes capturing the image acquired by the first image acquisition unit.

The vehicle according to one aspect further includes a distance detection unit for detecting a distance to another vehicle, and the control unit is configured to use the first image acquisition unit when the detected distance to the other vehicle is equal to or greater than a reference distance and the change in driving speed is a decrease in speed. The method further includes capturing the acquired image.

The vehicle according to one aspect further includes a second image acquisition unit configured to acquire an image of the interior, wherein the control unit recognizes the behavior of the driver and the passenger based on the image acquired by the second image acquisition unit, and recognizes the behavior The method further includes capturing an external image obtained based on the behavior information of the , and generating a drive video by connecting the captured external image.

The vehicle according to one aspect further includes a location receiver configured to receive location information corresponding to a current location, and the controller image-processes the acquired internal image, recognizes the driver's gaze from the image-processed image, and the driver's gaze The method further includes capturing the image acquired by the first image acquisition unit when the reference time is located in the external gaze region.

The control unit of the vehicle according to one aspect checks the number of repetitions in which at least one occupant of the driver and the passenger alternately gazes at the inside and the outside, and if the number of repetitions is greater than or equal to the reference number, the image acquired by the first image acquisition unit It further includes capturing.

The control unit of the vehicle according to one aspect further includes: recognizing the gaze of the passenger in the image-processed image, and capturing the image obtained by the first image acquisition unit when the gaze of the passenger is at a fixed position for more than a reference time.

The control unit of the vehicle according to one aspect further includes: checking the motion of the passenger and capturing the image obtained by the first image acquisition unit when the confirmed motion of the passenger is an external shooting motion using the terminal.

The control unit of the vehicle according to one aspect further includes image processing the acquired external image, recognizing a sign from the image-processed image, and storing the image of the recognized sign.

According to one aspect, a vehicle includes: a location receiver configured to receive location information corresponding to a current location; Further comprising an input unit for receiving destination information, the control unit generates navigation information from the origin to the destination based on the location information and the destination information, and determines that the current location is an area of interest based on the generated navigation information and the location information of the current location The method further includes capturing the image acquired by the first image acquisition unit.

The control unit of the vehicle according to one aspect further includes: when the engine is turned off, determining whether the current location is the destination;

A vehicle control method according to another aspect includes detecting a driving speed of a vehicle, checking the detected driving speed in real time, and capturing an external image acquired through a first image acquisition unit when the driving speed is reduced, and When capturing an image, the location of the vehicle is checked, the captured image is combined with the location of the vehicle to create a drive image, and when driving is finished, the generated drive image is connected to generate a drive video, and the generated drive video is output. .

Generating the drive image may include recognizing the behavior information of the driver and passenger based on the internal image acquired by the second image acquiring unit, and using the external image acquired by the first image acquiring unit based on the recognized behavior information. capturing, confirming the location of the vehicle when capturing an external image, and generating a drive image by combining the captured image and the location of the vehicle.

Determining whether the driving is finished includes checking the location information received from the location receiving unit, determining whether the current location is a destination based on the confirmed location information and the destination information, and determining whether the current location is the destination, determining that the driving is finished do.

When the destination information is received, the vehicle control method checks the received location information in the location receiving unit, generates navigation information from the source to the destination based on the confirmed location information and the destination information, and determines whether it is a capture point based on the navigation information. and when it is determined that the present is the capture time, capturing an external image acquired by the first image acquisition unit.

Capturing the external image acquired by the first image acquisition unit is to check the distance to another vehicle, and if the confirmed distance is equal to or greater than the reference distance, and the change in driving speed is a decrease in speed, the This includes capturing an external image.

The control method of the vehicle further includes generating a tag corresponding to the speed reduction, combining the generated tag with a captured external image and storing the generated tag.

The control method of the vehicle image-processes the internal image of the vehicle acquired by the second image acquisition unit, recognizes the user's gaze from the image-processed image, determines whether it is a capture point based on the recognized gaze, and captures the time of capture. When it is determined that , the method further includes capturing an external image acquired by the first image acquisition unit, generating a tag corresponding to gaze recognition, and combining the generated tag with the captured image and storing the captured image.

The vehicle control method image-processes the internal image of the vehicle acquired by the second image acquisition unit, recognizes the user's motion in the image-processed image, and if the recognized user's motion is an external shooting motion using the terminal, the first image The method further includes capturing the external image acquired by the acquisition unit, generating a tag corresponding to the recognition of the caption, and combining the generated tag with the captured image and storing the captured image.

The control method of the vehicle checks the position information of the shift lever, captures the image obtained from the first image acquisition unit when the position of the shift lever is the parking stage, checks the position information of the vehicle at the time of capturing the acquired image, The method further includes storing the identified location information in combination with the captured image.

A vehicle according to another aspect includes a speed detector configured to detect a traveling speed; an input unit for receiving a navigation mode and a destination; a location receiving unit for receiving current location information; an image acquisition unit for acquiring an external image; The navigation information is generated based on the received location information and the destination information, and an external image obtained based on at least one of the generated navigation information and the detected driving speed change information is captured, and if the current location is the destination, the captured a control unit for generating a drive video by connecting an external image; and a storage unit for storing the generated drive video.

The present invention can conveniently and easily create a drive video by automatically generating a drive video based on at least one of user behavior information and vehicle driving information.

In addition, since the present invention creates a drive video by combining an external image and a tag, the user can easily recognize the location of each image and the reason for capturing each image when playing the drive video.

In addition, since the present invention can use a tag when searching for any one image from the stored drive video, it is possible to quickly, conveniently and accurately search for an image to be searched.

Since the present invention creates a drive (travel) video using the image of the scene seen by the driver consciously and unconsciously, it is possible to create a drive video that the driver can interact with, and it is possible to create a drive video with the driver's memories, and later It can make it easy for the driver to know the drive history.

According to the present invention, when traveling using a vehicle, it is possible to automatically create a travel video after the trip, thereby improving user convenience, and capturing images of places that you want to leave or inform and store them together with location information to search for images. This is easy, and the time required for video editing can be reduced.

The present invention can adjust the capture time of the image by intentionally reducing the driving speed when capturing the image, thereby providing a personalized service. This can provide great convenience to the driver according to the development of social media, improve the marketability of the vehicle, and further increase user satisfaction, improve user convenience and reliability, and secure product competitiveness. can do.

1 is an exemplary view of the exterior of a vehicle according to an embodiment.
FIG. 2 is an exemplary view showing the interior of the vehicle shown in FIG. 1 .
3 is a control configuration diagram of a vehicle according to an embodiment.
4 is a detailed configuration diagram of a control unit provided in a vehicle according to an embodiment.
5 is a control flowchart of a vehicle according to an exemplary embodiment.
6 and 7 are diagrams illustrating image capture of a vehicle according to an embodiment.
8 to 10 are diagrams illustrating generation of a drive video of a vehicle according to an embodiment.

Hereinafter, the present invention will be described in detail with reference to the accompanying drawings.

The vehicle 100 includes a body having an exterior 110 and an interior 120 , and a chassis in which mechanical devices necessary for driving are installed as the remaining parts except for the vehicle body.

1, the exterior 110 of the vehicle body includes a front panel 111, a bonnet 112, a roof panel 113, a rear panel 114, front and rear left and right doors 115, and front and rear left and right doors ( 115) is provided so as to be able to open and close, and includes a window 116 fixedly installed on the front and rear of the vehicle.

The window 116 may include a driver's side window 116a provided on the driver's door, a passenger's side window 116b provided on the passenger's door, and a front window 116c provided on the dashboard and the bonnet.

The exterior of the car body makes it easy to see information about the surroundings while keeping an eye on the front sight, and a pillar provided at the boundary between the lamp 117, which functions as a signal and communication for other vehicles and pedestrians, and the window glass of the front, rear, left, and right doors and a side mirror 118 that provides a view behind the vehicle 100 to the driver.

The side mirror 118 includes a left side mirror 118a provided on the driver's seat side and a right side mirror 118b provided on the passenger's seat side.

The exterior of the body receives signals from GPS satellites and broadcasting stations, and an antenna 119 for performing a wireless vehicle network (V2X: Vehicle to everything) such as communication with other vehicles (V2V) and communication with infrastructure (V2I). ) is further included.

As shown in FIG. 2 , the interior 120 of the vehicle body includes a seat 121 on which an occupant sits, a dashboard 122, and a dashboard disposed on the dashboard and includes a tachometer, a speedometer, a coolant thermometer, a fuel gauge, and a direction change indicator. , high beam indicator, warning lamp, seat belt warning lamp, odometer, odometer, shift lever indicator, door open warning lamp, engine oil warning lamp, low fuel warning lamp, the instrument panel (ie cluster, 123), and the vent of the air conditioner and the center fascia 124 on which the control plate is disposed, the head unit 125 provided on the center fascia 124 and receiving operation commands of the audio device and the air conditioner, and the center fascia 124 provided with a start command It includes an input start button and a multi-interface provided on the center fascia 124 and connected to the storage device 300 and the terminal.

The seat 121 may include a driver's seat 121a on which the driver sits and a passenger seat 121b on which the passenger sits.

The vehicle includes a shift lever 126 provided on the center fascia 124 and receiving an input of an operation position, and a parking button located in the vicinity of the shift lever or in the head unit 125 and receiving an operation command of an electronic parking brake device (not shown). (EPB button) is further included.

The charang 100 may further include an input unit 127 for receiving operation commands for various functions.

The input unit 127 may be provided on the head unit 125 and the center fascia 124, and includes at least one physical button such as an operation on/off button for various functions, a button for changing setting values of various functions, and the like. can do.

The input unit 127 may further include a jog dial (not shown) or a touch pad (not shown) for inputting a cursor movement command and a selection command displayed on the display unit of the user interface 129 .

Here, the jog dial or the touch pad may be provided on a center fascia or the like.

The vehicle 100 may further include a display unit 128 that is provided in the head unit 125 and displays information about a function being performed in the vehicle and information input by a user.

The vehicle further includes a user interface 129 for user convenience.

The user interface 129 displays an image of at least one function selected by the user among an audio function, a video function, a navigation function, a broadcasting function (DMB function), a radio function, a content reproduction function, and an Internet search function.

The user interface 129 may be installed on the dashboard in a buried or mounted manner.

The user interface 129 may include a display panel as a display unit and may further include a touch panel as an input unit.

That is, the user interface 129 may include only the display panel or a touch screen in which the touch panel is integrated with the display panel.

When the user interface 129 is implemented with only the display panel, a button displayed on the display panel may be selected using the input unit 127 provided on the center fascia.

When the user interface 129 is implemented as a touch screen, a user's operation command may be directly input through the touch panel.

As such, the user interface 129 may include a display unit and may further include an input unit.

The chassis of the vehicle is a frame that supports the vehicle body 110 and 120, and includes the wheels 131 disposed on the front, rear, left and right sides, and a power unit for applying driving force to the front, rear, left, and right wheels 131, a steering device, and front and rear left and right wheels A braking device for applying a braking force to 131 and a suspension device for adjusting the suspension of the vehicle may be provided.

The vehicle 100 includes a steering wheel 132 of a steering device for adjusting a driving direction, a brake pedal 133 pressed by the user according to the user's will to brake, and a brake pedal 133 pressed by the user according to the user's will to accelerate. It may include an accelerator pedal 134 (see FIG. 2 ).

The vehicle may further include a first image acquisition unit 141 for acquiring an image of a surrounding road as an external image. Here, the first image acquisition unit 141 may be an image acquisition unit provided in a black box, an image acquisition unit of an autonomous driving control device for autonomous driving, or an image acquisition unit for obstacle detection.

The first image acquisition unit 141 may be provided on the front window 116c and provided on the window inside the vehicle to face the outside of the vehicle, or provided on the rearview mirror inside the vehicle to face the outside of the vehicle. It may be provided, or it may be provided so as to be provided but exposed to the outside of the roof panel 113 (see FIG. 1 ).

The first image acquisition unit 141 further includes at least one of a left camera and a right camera for acquiring images of the left and right sides of the vehicle as well as a front camera for acquiring an image of the front of the vehicle, and a rear camera for acquiring an image of the rear of the vehicle It is also possible

The first image acquisition unit 141 is a camera, and may include a CCD or CMOS image sensor, and recognizes three-dimensional space such as KINECT (RGB-D sensor), TOF (Structured Light Sensor), and stereo camera. It may include a sensor.

The vehicle 100 may further include a communication unit 170 for communication between various internal electronic devices, communication with an external device, communication with a user terminal, and communication with a storage medium (FIG. 3). Reference).

Here, the external device may include at least one of the server 300 , the user terminal 200 , and a storage device (not shown).

The vehicle may further include a distance detection unit 144 for detecting a distance to the obstacle (see FIG. 3 ).

The distance detector may be provided on the front, rear, left, and right sides of the exterior of the vehicle, respectively.

The distance detection unit 144 includes a lidar sensor.

LiDAR (Light Detection And Ranging) sensor is a non-contact distance detection sensor using the principle of laser radar.

The distance detector 144 may include an ultrasonic sensor or a radar sensor.

3 is a control diagram of a vehicle according to an embodiment, and FIG. 4 is a control diagram of a data processing apparatus provided in a vehicle according to an embodiment.

The vehicle 100 includes an input unit 127 , a display unit 128 , a first image acquisition unit 141 , a second image acquisition unit 142 , a speed detection unit 143 , a distance detection unit 144 , and a starter unit 145 . , a shift lever information receiving unit 146 , a position receiving unit 147 , a sound input unit 148 , a sound output unit 149 , a control unit 150 , a storage unit 160 , and a communication unit 170 .

The input unit 127 may receive commands to start and end the video generation mode, receive a drive video search command, and may receive a drive video edit command.

The input unit 127 may receive an on/off command of the navigation mode and may also receive information on a destination.

The input unit 127 may include a plurality of buttons provided on the head unit, may include a plurality of buttons provided on the steering wheel, and may include buttons provided on an operation lever (not shown) around the steering wheel, and , may include a touch pad and a jog dial provided on the center fascia, and may include an input unit provided on the user interface 129 .

Here, the input unit provided on the user interface 129 may be a touch panel.

The display unit 128 may display an on/off state of the video generation mode and may display an on/off state of the navigation mode.

The display unit 128 may display a drive video stored in the storage unit, display an image corresponding to a search result, and display an edited image.

The display unit 128 may also display the transmission status (ie, in transmission, transmission completion, etc.) of the drive video stored in the storage unit.

The display unit 128 may be a display unit provided on the user interface 129 .

In addition, the display unit of the user interface displays a map image within a certain range from the current location of the vehicle when the navigation mode is performed, and displays map information that matches route information from the current location to the destination when destination information is input, and route guidance information to display

The display unit of the user interface displays a map image within a predetermined range from the current location of the vehicle when the map display mode is selected.

The first image acquisition unit 141 converts shape information about an object around the vehicle into an electrical image signal, and the environment outside the vehicle at the current location of the vehicle, particularly the road on which the vehicle travels and the people around it An image signal corresponding to shape information of an object in the front, left and right sides of the vehicle is transmitted to the controller 150 .

The first image acquisition unit 141 may be a rear camera, a camera of a black box, or a camera of an autonomous driving control device provided for autonomous driving.

That is, the first image acquisition unit 141 performs an image acquisition function of acquiring an image of a road outside the vehicle and an image around the road in real time.

The first image acquisition unit 141 may be turned on based on a control command of the controller 150 in an operation-off state to acquire an external image.

The second image acquisition unit 142 converts shape information of an object inside the vehicle into an electrical image signal, detects occupants such as a driver and a passenger inside the vehicle, and obtains an image signal corresponding to the detected shape information of the occupant. It is transmitted to the control unit 150 .

The second image acquisition unit 142 may be an internal camera installed to photograph the inside of the vehicle.

That is, the second image acquisition unit 142 performs an image acquisition function of acquiring an image inside the vehicle in real time.

The speed detection unit 143 is for detecting driving information of the vehicle, and detects the driving speed of the vehicle.

The speed detector 143 may include a plurality of wheel speed sensors respectively provided on a plurality of wheels of the vehicle, and may include an acceleration sensor that detects the acceleration of the vehicle.

The distance detection unit 144 detects a distance to another vehicle in the front located in front of the own vehicle, and detects a distance to another vehicle in the rear located in the rear of the own vehicle.

The starter 145 receives the start-on signal of the vehicle and the start-off signal of the vehicle, and transmits start-on/off information corresponding to the received start-on signal and the start-off signal to the controller 150 .

The shift lever information receiving unit 146 receives the operation signal of the shift lever and transmits the position information of the stage corresponding to the operation signal of the shift lever corresponding to the received operation signal to the control unit 150 .

Positions at which the shift lever may be operated include a parking stage (P stage), a neutral stage (N stage), a forward driving stage (D stage), and a reverse driving stage (R stage). That is, the shift lever information receiver transmits the position information of the parking stage (P stage), the neutral stage (N stage), the forward driving stage (D stage), and the reverse driving stage (R stage) to the control unit 150 .

The position receiving unit 147 includes a global positioning system (GPS) receiving unit and a signal processing unit processing the GPS signal obtained from the GPS receiving unit.

Here, the GPS (Global Positioning System) receiver includes an antenna module for receiving signals from a plurality of GPS satellites. This antenna module may be provided in the antenna 119 provided on the exterior of the vehicle.

The signal processing unit includes software for obtaining a current position by using distance and time information corresponding to position signals of a plurality of GPS satellites, and an output unit for outputting the obtained vehicle position data.

The location receiving unit 147 transmits location data for the current location to the controller 150 .

The sound input unit 148 receives the sound inside the vehicle.

Here, the sound inside the vehicle may be a user's voice.

The sound input unit 148 may include a microphone that converts sound waves into electrical signals. Here, the number of microphones may be one or two or more, and one microphone may be directional.

And two or more microphones may be implemented as a microphone array.

The sound output unit 149 outputs information about completion of generation and transmission of drive video as sound.

Also, the sound output unit 149 outputs audio data corresponding to the function being performed as sound. The function being performed here may be a radio function, an audio function corresponding to content reproduction and music reproduction, and a navigation function.

The sound output unit 149 may include a speaker.

The speaker converts the amplified low-frequency audio signal into an original sound wave, generates a small wave in the air, and copies the sound wave, thereby outputting audio data as sound that the user can hear.

When the on command of the navigation mode is received and the destination information is received, the controller 150 checks the current location, generates route information based on the current location and destination information, matches the route information generated in the map information, and matches the matched route information. It controls the output of map information and route information, and controls the output of road guidance information.

The controller 150 may generate and output a plurality of route information when generating route information, store any one route information selected by a user among a plurality of route information, and perform a navigation function based on the stored route information. have.

The controller 150 activates the operations of the first and second image acquisition units 141 and 142 when a command to start performing the video generation mode is received, and displays the images acquired by the first and second image acquisition units 141 and 142 . Based on the image information and the speed information of the driving speed detected by the speed detection unit 143, some images among the images acquired by the first image acquisition unit are captured, and the captured images are connected to generate a drive video.

The controller 150 stores the generated drive video and transmits the stored drive video to at least one of the terminal 200 and the server 300 .

The control unit 150 includes an analysis unit 151 that analyzes driving information and user behavior information to obtain a capture time (ie, capture timing) of the image acquired by the first image acquisition unit 141, and the analysis unit Based on the result, the capture unit 152 captures a partial image of the image acquired by the first image acquisition unit 141, and the generation unit 154 combines tag information with the image information of the captured image to generate a drive video. ) may be included.

The analysis unit 151 includes a driving information analysis unit 151a that analyzes driving information of the vehicle to obtain a capture time, and a behavior information analysis unit 151b that analyzes a user's behavior to obtain a capture time.

The driving information analyzing unit 151a determines whether it is a capture time based on the driving speed detected by the speed detecting unit 143 .

The driving information analyzing unit 151a may determine whether it is a capture time based on the driving speed detected by the speed detecting unit 143 and the distance to another vehicle detected by the distance detecting unit 144 .

The driving information analyzing unit 151a may determine whether it is a capture time based on the start-off information transmitted from the starter 145 and the parking stage information received from the shift lever information receiving unit 146 .

The driving information analyzer 151a determines whether the current location is an area of interest based on the navigation information and the current location information, and when it is determined that the current location is an area of interest, it is determined that it is a capture point.

Here, the navigation information may include map information, route information, road guidance information, and the like, and the map information may include a road name, a road number, and location information of a road.

The driving information analysis unit 151a image-processes the image of the road acquired by the first image acquisition unit 141, recognizes a sign from the image-processed image, recognizes the characters and symbols of the recognized sign, and recognizes the recognized characters and symbols It is determined whether it is a capture time based on

The behavior information analysis unit 151b recognizes the user's gaze from the image acquired by the second image acquisition unit 142 and recognizes the user's motion.

The behavior information analysis unit 151b determines that it is a capture time when the recognized gaze gazes at one place for more than a reference time, and determines that it is a capture time when the recognized gaze gazes at one place repeatedly for a reference number of times or more. Here, the user's gaze may be at least one of the driver's gaze and the passenger's gaze.

If the behavior information analysis unit 151b recognizes the driver's gaze and the recognition result determines that the driver gazes at the external gaze areas a2, b2, c2 other than the driving gaze areas a1, b1, c1 for a reference period of time or longer, It is determined that it is a capture time (see FIG. 7).

The behavioral information analysis unit 151b recognizes the gaze of the passenger, and when the recognition result determines that the passenger gazes at any one target for more than a reference time, it is determined that it is a capture time.

The behavior information analysis unit 151b recognizes the driver's gaze, and the recognition result indicates that the driver repeatedly gazes at the external gaze areas a2, b2, c2 other than the driving gaze areas a1, b1, c1 for a reference number of times or more. If it is determined, it is determined that it is a capture time (see FIG. 7 ).

The behavior information analysis unit 151b recognizes the gaze of the passenger, and when it is determined that the passenger gazes at any one target by repeating the recognition result more than a reference number of times, it is determined that it is the capture time.

The behavior information analysis unit 151b determines that when the recognized user's motion is an external shooting motion using the terminal, it is a capture time. Here, the user's motion may be that of a passenger.

The behavior information analysis unit 151b may perform voice recognition of the sound input from the sound input unit 148, recognize an exclamation among voice information of the recognized voice, and determine that it is a capture time when the exclamation is recognized.

When information on a capture time is received from the analysis unit 151, the capture unit 152 captures the image acquired by the first acquisition unit at the capture time.

The generating unit 153 checks the location of the vehicle at the capture time based on the location information received from the location receiving unit, generates the identified vehicle location as a tag, generates analysis information at the capture time as a tag, and captures the captured location. A drive video is created by combining an image and a tag, and when driving is completed, the drive video is created by linking the generated drive images in chronological order until the driving is completed.

The analysis information may be information corresponding to an analysis result of the driving information analyzed by the analysis unit and the user's behavior information.

For example, the analysis information may include speed reduction, stopping, user attention, area of interest, external shooting, user admiration, and the like.

The generation unit 153 stores the drive video in the storage unit 160 or transmits it to the external devices 200 and 300 through the communication unit.

The analysis unit, the capture unit, and the generation unit of the control unit 150 may be implemented as separate chips or as a single chip.

A control configuration of the control unit 150 having an analysis unit, a capture unit, and a generation unit will be described comprehensively.

When the navigation mode is performed, the controller 150 generates navigation information, controls output of map information and route guidance information with a route matched on the basis of the generated navigation information, and acquires a first image from a departure point to a destination A drive video is created by capturing some of the images acquired in the unit and connecting the captured images.

The controller 150 may capture some of the images acquired by the first image acquisition unit on a daily basis and connect the captured images to generate a drive video.

It is also possible for the control unit 150 to generate a drive video by capturing some of the images obtained from the first image acquisition unit between the starting-on time and the starting-off time, and connecting the captured images.

The control unit 150 checks the driving speed of the vehicle in real time and confirms the confirmed change in the driving speed, and when it is determined that the driving speed is decelerating, captures the image obtained from the first image acquisition unit, and determines the location where the image is captured. It checks, creates the identified location as a tag, and stores the captured image and the tag together. The controller 150 may generate the deceleration, which is the capture reason, as a tag, and store the generated tag and the captured image together.

The control unit 150 checks the driving speed of the vehicle in real time, confirms the confirmed change in the driving speed, and determines the distance between the vehicle's front and rear other vehicles based on the image acquired by the first image acquisition unit 141 If the distance to other vehicles in the front and rear is greater than or equal to the reference distance, it is determined whether the distance to other vehicles is maintained over the reference distance for more than a certain period of time, When it is determined that the driving speed is reduced, the image acquired by the first image acquisition unit is captured, the position where the image is captured is checked, the identified position is generated as a tag, and the captured image and the tag are stored together.

The control unit 150 checks the distance from the front and rear other vehicles of the own vehicle based on the detection information detected by the distance detection unit 144, and if the distance from the front and rear other vehicles is equal to or greater than the reference distance, the distance to the other vehicle is It is determined whether the distance is maintained over the reference distance for a certain period of time or more, and when it is determined that the driving speed is reduced while the distance to other vehicles is maintained for a certain period of time or more than the reference distance, the image acquired by the first image acquisition unit is captured, and the image is captured. It is also possible to check the captured location, create the checked location as a tag, and store the captured image and the tag together.

The controller 150 determines whether the current location is an area of interest based on the navigation information and location information of the current location, and when it is determined that the current location is an area of interest, captures an image acquired by the first image acquisition unit, and the confirmed interest Local information is created as a tag, and the captured image and tag are saved together.

The control unit 150 recognizes a sign from the image acquired by the first image acquisition unit, determines whether the sign is a region of interest or a famous region based on the characters and symbols of the recognized sign, and determines whether the sign corresponds to the region of interest or famous region. When it is determined that it is a sign, an image of the sign is captured, the location where the image of the sign is captured is checked, the identified location is generated as a tag, and the captured image of the sign and the tag are stored together.

When the engine is turned off, the control unit 150 determines whether the current location is the destination based on the navigation information, and if it is determined that the current location is not the destination, captures the image obtained from the first image acquisition unit, checks the location where the image is captured, and confirms Creates the location as a tag, and saves the captured image and tag together. The controller 150 may generate a temporary stop, which is the reason for capturing, as a tag, and store the generated tag and the captured image together.

When it is determined that the position of the shift lever is the parking stage, the control unit 150 captures the image obtained from the first image acquisition unit, confirms the position at which the image is captured, generates the identified position as a tag, and the captured image and Save the tags together. It is also possible for the control unit 150 to generate a temporary parking tag, which is the reason for capturing, and to store the generated tag and the captured image together.

The control unit 150 image-processes the image acquired by the second image acquisition unit, recognizes the driver's gaze based on the image-processed image, and determines that the driver's gaze stays in the external gaze area instead of the driving gaze area for a reference time or longer When the image is captured by the first image acquisition unit, the captured position of the image is confirmed, the identified position is generated as a tag, and the captured image and the tag are stored together. The controller 150 may generate the driver's external gaze, which is the capture reason, as a tag, and store the generated tag and the captured image together.

The control unit 150 image-processes the image obtained by the second image acquisition unit, recognizes the driver's gaze based on the image-processed image, and determines that the driver repeatedly gazes at the external gaze area, not the driving gaze area, a reference number of times or more When the image is captured by the first image acquisition unit, the captured position of the image is confirmed, the identified position is generated as a tag, and the captured image and the tag are stored together. The controller 150 may generate the driver's external gaze, which is the capture reason, as a tag, and store the generated tag and the captured image together.

The control unit 150 image-processes the image acquired by the second image acquisition unit 142, recognizes the gaze of the passenger based on the image-processed image, and when it is determined that the gaze of the passenger stays in one place for more than a reference time, the first image The image acquired by the acquisition unit is captured, the position where the image is captured is checked, the identified position is generated as a tag, and the captured image and the tag are stored together. It is also possible for the controller 150 to generate the external gaze of the passenger, which is the capture reason, as a tag, and to store the generated tag and the captured image together.

The control unit 150 image-processes the image acquired by the second image acquisition unit 142, recognizes the passenger's gaze based on the image-processed image, and when it is determined that the passenger repeatedly gazes at any one place more than a reference number of times, 1 Capture the image acquired by the image acquisition unit, confirm the position where the image is captured, create the identified position as a tag, and store the captured image and the tag together. It is also possible for the controller 150 to generate the external gaze of the passenger, which is the capture reason, as a tag, and to store the generated tag and the captured image together.

The control unit 150 image-processes the image acquired by the second image acquisition unit 142, recognizes the motion of the passenger based on the image-processed image, and when it is determined that the motion of the passenger is the motion of external shooting using the terminal, The image acquired by the image acquisition unit is captured, the position where the image is captured is checked, the identified position is generated as a tag, and the captured image and the tag are stored together. The controller 150 may generate a shooting motion, which is the capture reason, as a tag, and store the generated tag and the captured image together.

The controller 150 may also delete unnecessary images from among the captured images.

For example, the unnecessary image may include an image of a traffic light, an image of taking a selfie, an image of a road number and a speed limit sign.

The control unit 150 further includes obtaining road information of a driving road based on the navigation information and storing the obtained road information as a tag.

When a search command and a search word are input to the input unit 127 , the controller 150 searches for a drive image corresponding to the input search word and controls the output of the searched drive image.

The controller 150 deletes the selected drive image from the drive video when a delete command for editing and any one of the drive images are selected from the input unit 127 .

The controller 150 includes a memory (not shown) that stores data for an algorithm for controlling the operation of components in the vehicle or a program reproducing the algorithm, and a processor (not shown) that performs the above-described operation using the data stored in the memory. not shown) may be implemented. In this case, the memory and the processor may be implemented as separate chips. Alternatively, the memory and the processor may be implemented as a single chip.

The storage unit 160 stores the generated drive video.

The storage unit 160 may also store identification information of the terminal for transmitting the drive video.

The storage unit 160 stores the reference distance, the reference time, and the reference number of times.

The storage unit 160 may be a storage unit fixedly mounted inside the vehicle, or may be a storage unit provided detachably from the vehicle.

The storage unit 160 is a nonvolatile memory device or RAM such as a cache, read only memory (ROM), programmable ROM (PROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), and flash memory. It may be implemented as at least one of a volatile memory device such as (Random Access Memory), a hard disk drive (HDD), or a storage medium such as a CD-ROM, but is not limited thereto.

The storage unit 160 may be a memory implemented as a chip separate from the processor described above with respect to the controller 150 , or may be implemented as a single chip with the processor.

The communication unit 170 performs communication between the control unit 150 and an external device, and transmits the drive video to the external device, the terminal 200 or the server 300 according to a control command of the control unit 150 .

The communication unit 170 may include one or more components that enable communication with an external device, and may include, for example, at least one of a short-range communication module, a wired communication module, and a wireless communication module.

The short-distance communication module transmits a signal using a wireless communication network in a short distance such as a Bluetooth module, an infrared communication module, an RFID (Radio Frequency Identification) communication module, a WLAN (Wireless Local Access Network) communication module, an NFC communication module, and a Zigbee communication module. It may include various short-distance communication modules for transmitting and receiving.

The wired communication module includes a variety of wired communication modules such as a Controller Area Network (CAN) communication module, a Local Area Network (LAN) module, a Wide Area Network (WAN) module, or a Value Added Network (VAN) module. Various cable communication such as USB (Universal Serial Bus), HDMI (High Definition Multimedia Interface), DVI (Digital Visual Interface), RS-232 (recommended standard232), power line communication, or POTS (plain old telephone service) as well as communication module It can contain modules.

In addition to the Wi-Fi module and the wireless broadband module, the wireless communication module includes a global system for mobile communication (GSM), a code division multiple access (CDMA), a wideband code division multiple access (WCDMA), and a universal mobile telecommunications system (UMTS). ), Time Division Multiple Access (TDMA), Long Term Evolution (LTE), etc. may include a wireless communication module supporting various wireless communication methods.

The terminal 200 may be implemented as a user terminal, and the user terminal 200 may be implemented as a computer or portable terminal capable of accessing a vehicle through a network.

Here, the computer includes, for example, a laptop equipped with a web browser (WEB Browser), a desktop, a laptop (laptop), a tablet PC, a slate PC, and the like, and the portable terminal has, for example, portability and mobility. As a covered wireless communication device, Personal Communication System (PCS), Global System for Mobile communications (GSM), Personal Digital Cellular (PDC), Personal Handyphone System (PHS), Personal Digital Assistant (PDA), International Mobile Telecommunication (IMT) -2000, CDMA(Code Division Multiple Access)-2000, W-CDMA(W-Code Division Multiple Access), WiBro(Wireless Broadband Internet) terminal, all kinds of handheld based such as smart phone wireless communication devices and wearable devices such as watches, rings, bracelets, anklets, necklaces, glasses, contact lenses, or head-mounted-devices (HMDs).

When the drive video is received, the terminal 200 stores the received drive video.

The terminal 200 may store the drive video together with the date and file name input by the user.

The terminal 200 may play the drive video according to the user's request and transmit it to another external device according to the user's request.

At least one component may be added or deleted according to the performance of the components of the data processing apparatus shown in FIG. 3 . In addition, it will be readily understood by those of ordinary skill in the art that the mutual positions of the components may be changed corresponding to the performance or structure of the system.

4 is a control flowchart of a vehicle according to an embodiment, which will be described with reference to FIGS. 5 to 10 .

When the vehicle is started, the input unit 127, the display unit 128, the first image acquisition unit 141, the second image acquisition unit 142, the speed detection unit 143, the distance detection unit 144, and the starting unit 145 ), the shift lever information receiving unit 146, the position receiving unit 147, the sound input unit 148, the sound output unit 149, the control unit 150, the storage unit 160, and the communication unit 170, such as operation of various devices Activate it.

When a navigation mode is selected and destination information is input, the vehicle checks the current location, searches for a route from the current location, from the origin to the destination, matches the searched route to the map information to generate navigation information, and maps information with the route matched. is displayed through the user interface, and route guidance information is output through the user interface and the sound output unit.

It is also possible that the vehicle automatically performs the video generation mode when the engine is turned on. In addition, when the vehicle is started and the video generation mode is selected through the input unit 127, it is also possible to perform the video generation mode.

The vehicle checks ( 180 ) driving information of the vehicle and user behavior information while performing the video generation mode.

Here, checking the driving information of the vehicle includes checking the speed of the vehicle, checking the position of the shift lever, and checking the ignition-off state.

And confirming the user's behavior information is to acquire an image inside the vehicle, process the acquired image of the vehicle, recognize the driver and passenger based on the image-processed image information, and recognize the recognized driver's behavior information and the recognized driver's behavior information. This includes checking the behavioral information of the passenger.

Here, checking the driver's behavior information includes checking the driver's gaze.

In addition, checking the behavior information of the passenger includes checking the gaze and motion of the passenger.

The vehicle analyzes the identified driving information (381), determines whether it is a capture time of the image being acquired by the first image acquisition unit based on the analysis information, and when it is determined that it is the capture time, the image acquired by the first image acquisition unit Capture.

More specifically, the vehicle checks the driving state.

Here, the checking of the driving state may include checking whether the traveling speed of the vehicle is reduced or whether the vehicle is stopped.

The vehicle checks the driving speed of the vehicle corresponding to the detection information detected by the speed detector in real time, checks the change in the driving speed of the vehicle based on the driving speed checked in real time, and determines whether the change in the driving speed is a decrease in speed. Make a judgment (382).

When it is determined that the driving speed decreases, the vehicle determines that it is the capture time of the image, captures the image acquired by the first image acquisition unit (188), checks the location of the vehicle at the time the image is captured, and confirms the location of the vehicle is created as a tag, a drive image is created by combining the captured image and the tag, and the generated drive image is stored (190).

In addition, it is also possible for the vehicle to generate the deceleration, which is the reason for capturing, as a tag, combine the deceleration tag, the location tag, and the captured image and store it together.

The vehicle checks the distance to another vehicle in front based on the image acquired by the first image acquisition unit, and when it is determined that the driving speed of the vehicle is decreasing despite the confirmed distance being maintained over the reference distance, the image capture time It is also possible to capture (188) the image acquired by the first image acquisition unit by determining that .

As shown in FIG. 6 , the vehicle checks the distance d1 from the other vehicle 100a in the front and the distance d2 to the other vehicle 100b in the rear based on the detection information detected by the distance detector. Although the distance to other vehicles in the front is greater than the reference distance (dr) and the distance (d2) to other vehicles in the rear is maintained to be greater than or equal to the reference distance (dr), the driving speed of the vehicle is reduced (60km/h -> 40 km/h), it is also possible to capture (188) the image acquired by the first image acquisition unit by determining that it is the time of capturing the image.

When it is determined that the vehicle has stopped driving (183), it is determined that it is the capture time of the image, and the image acquired by the first image acquisition unit is captured (188), the location of the vehicle at the time the image is captured, is confirmed, and the vehicle is confirmed The location of the tag is created, the captured image and the tag are combined to create a drive image, and the generated drive image is stored (190).

Determining that the vehicle has stopped driving includes determining that the vehicle is stopped when the traveling speed is zero, determining that the vehicle is stopped when the shift lever is in the parking position, and determining that the vehicle is stopped when the engine is in the OFF state includes judging.

In addition, the vehicle determines whether the current location is the destination based on the navigation information when the engine is in the off state, and when it is determined that the current location is not the destination, it is determined that the image is captured at the time of capturing the image, and the image acquired by the first image acquisition unit is captured, and the image is captured. Check the location, create the checked location as a tag, and save the captured image and tag together. At this time, it is also possible for the vehicle to generate a temporary stop, which is the reason for capturing, as a tag, and to store the generated tag and the captured image together.

The vehicle analyzes (384) the identified user's behavior information, determines whether it is a capture time of the image being acquired by the first image acquisition unit based on the analysis information, and when it is determined that it is the capture time, the first image acquisition unit acquired Capture the video.

More specifically, the vehicle image-processes the image acquired by the second image acquisition unit, recognizes the user's gaze based on the image-processed image, and the user gazes at one place for more than a reference time based on the recognition result of the gaze. It is determined whether there is (185), and if it is determined that the user is looking at one place for more than a reference time, it is determined that it is the capture time of the image, and the image acquired by the first image acquisition unit is captured (188), and the vehicle at the time the image is captured confirms the location of (189), creates the identified vehicle location as a tag, combines the captured image and the tag to generate a drive image, and stores (190) the generated drive image. In this case, the vehicle may generate the user's external gaze, which is the capture reason, as a tag, and store the generated external gaze tag, the location tag, and the captured image together.

Here, a configuration for determining whether it is a capture point by recognizing a user's gaze will be described with reference to FIG. 7 .

The window 116a on the driver's seat side of the vehicle includes a driving gaze area a1 that the driver should focus on for driving and an external gaze area a2 that the driver gazes at to view the external environment or obtain assistance information for driving.

The window 116b on the passenger's side of the vehicle includes a driving gaze area b1 that the driver should focus on for driving and an external gaze area b2 that the driver gazes at to view the external environment or obtain driving assistance information. .

The front window 116c of the vehicle includes a driving gaze region c1 to which the driver should gaze for driving and an external gaze region c2 to which the driver gazes to view an external environment or obtain driving assistance information.

That is, the vehicle acquires an image of the driver located in the driver's seat 121a from the image acquired by the second image acquisition unit, recognizes the driver's gaze from the acquired image, and determines which area the recognized gaze is directed to.

When the vehicle determines that the driver is looking at the external gaze areas ab, b2, and c2 instead of the driving gaze area for a reference time or longer based on the recognition result of the driver's gaze, it is determined that it is the image capture time, and the first image acquisition unit It is possible to capture an image obtained from the , but capture an image of a position corresponding to the direction of the driver's gaze. In this case, the vehicle may generate the driver's external gaze, which is the capture reason, as a tag, and store the generated external gaze tag of the driver, the location tag, and the captured image together.

The vehicle acquires the image of the passenger located on the passenger seat 121b from the image acquired by the second image acquisition unit, recognizes the gaze of the passenger from the acquired image, and based on the recognition result of the gaze, Determines whether you are watching for more than a reference time, and if it is determined that you are looking at any one place for more than the reference time when riding, it is determined that it is the capture time of the image, and captures the image acquired by the first image acquisition unit, but in the direction of the passenger's gaze. It is possible to capture an image of the corresponding position.

In this case, the vehicle may generate the passenger's external gaze tag, which is the reason for capturing, as a tag, and store the generated external gaze tag of the passenger, the location tag, and the captured image together.

The vehicle determines ( 186 ) whether the user repeatedly gazes at any one location, and when it is determined that the user repeatedly gazes at any one location, the vehicle determines that it is a capture point and captures the image acquired by the first image acquisition unit. In this case, it is also possible for the vehicle to generate the user's external repeated gaze, which is the capture reason, as a tag, and store the generated external repeated gaze tag, the location tag, and the captured image together.

More specifically, the vehicle acquires the image of the driver located in the driver's seat 121a from the image acquired by the second image acquisition unit, recognizes the driver's gaze from the acquired image, and determines which area the recognized gaze is directed to. to judge

When it is determined that the driver is looking at the external gaze areas ab, b2, and c2 instead of the driving gaze area for a reference time or longer based on the recognition result of the driver's gaze, the vehicle determines whether the driver repeatedly gazes at the external gaze area.

Determining whether the driver repeatedly gazes at the external gaze region includes determining whether the number of times the driver alternately gazes at the external gaze region and the driving gaze region is more than a reference number of times.

Determining whether the driver repeatedly gazes at the exterior gaze area includes determining whether the number of times the driver alternately gazes at the exterior gaze area and the interior of the vehicle is more than a reference number of times.

When it is determined that the driver repeatedly gazes at a certain area, the vehicle determines that it is the image capture time, and captures the image acquired by the first image acquisition unit, but captures an image of a position corresponding to the direction of the passenger's gaze. . In this case, the vehicle may generate the driver's external repeated gaze tag, which is the reason for capturing, as a tag, and store the generated driver's external repeated gaze tag, the location tag, and the captured image together.

The vehicle acquires the image of the passenger located in the passenger seat 121b from the image acquired by the second image acquisition unit, recognizes the gaze of the passenger from the acquired image, and determines which area the recognized gaze of the passenger is facing do.

When it is determined that the passenger is repeatedly looking at any one place based on the recognition result of the passenger's gaze, the vehicle determines that it is the capture time of the image, determines that it is the capture time of the image, and captures the image acquired by the first image acquisition unit However, it is possible to capture an image of a position corresponding to the direction of the passenger's gaze. In this case, the vehicle may generate the repeated external gaze of the passenger as the reason for capturing as a tag, and store the generated repeated external gaze tag of the passenger, the location tag, and the captured image together.

Determining whether the passenger repeatedly gazes at the external gaze area includes determining whether the number of repetitions in which the passenger alternately gazes at an external location and another location is more than a reference number of repetitions. Other places here may include the interior of the vehicle.

The vehicle image-processes the image acquired by the second image acquisition unit 142 and recognizes the motion of the passenger based on the image-processed image, and the motion of the passenger is the motion of external shooting using the terminal 200a (refer to FIG. 6). If it is determined (187), the image acquired by the first image acquisition unit is captured (188), the location of the vehicle at the time the image is captured is checked (189), the identified location is generated as a tag, and the captured image and the A drive image is created by combining the tags, and the generated drive image is stored (190). In this case, it is also possible for the vehicle to generate a shooting motion, which is the reason for capturing, as a tag, and to store the generated tag and the captured image together.

Additionally, the vehicle determines whether the current location is an area of interest based on the navigation information and location information of the current location, and when it is determined that the current location is an area of interest, captures an image obtained from the first image acquisition unit, and the confirmed interest It is also possible to create local information as a tag, and to store the captured image and tag together.

In addition, the control unit 150 recognizes a sign from the image acquired by the first image acquisition unit, determines whether the sign is a region of interest or a famous region based on the characters and symbols of the recognized sign, and the sign corresponds to the region of interest or famous region If it is determined that it is a sign, it is possible to capture an image of the sign, check the location where the image of the sign is captured, generate the identified location as a tag, and store the captured image of the sign and the tag together.

The vehicle determines whether the driving is finished ( 191 ), and when it is determined that the driving is finished, the drive images captured during driving are connected in chronological order to generate a drive video and store the generated drive video ( 192 ).

Here, determining whether the driving has ended includes determining whether the vehicle is in an off state, and determining whether the current location is a destination.

In addition, when the vehicle saves the drive video, the creation date can be saved together, and information of the origin and destination can be saved together.

As shown in FIG. 8 , the vehicle may generate a drive video by connecting the captured drive images in chronological order from the time the vehicle departs from the origin until the time it arrives at the destination.

The vehicle stops by waiting for a signal after departure. At this time, when the driving speed is zero and it is determined that the vehicle is in a stopped state, it is determined that it is a capture time and the image acquired by the first image acquisition unit is captured (M1).

When the user drives slowly to see the tourist destination, the vehicle determines the reduction in driving speed and determines that it is a capture time, and captures (M2) the image acquired by the first image acquisition unit.

When the user utters an exclamation of 'wow' to see the rainbow, the vehicle determines the capture point through voice recognition and captures (M3) the image acquired by the first image acquisition unit.

When the user stops for a meal, the vehicle determines whether the current location is the destination, and if it is determined that the current location is not the destination, determines that the vehicle is temporarily stopped, and captures the image acquired by the first image acquisition unit (M4).

The vehicle recognizes the sign in the image acquired by the first image acquiring unit while driving, and when it is determined that the information of the recognized sign is information on the area of interest, it is determined that it is a capture point, and the image of the sign acquired by the first image acquiring unit is captured (M5). ) and, based on the navigation information, when a position corresponding to the information on the sign is reached, the image of the first image acquisition unit is captured (M6).

As shown in FIG. 9 , the vehicle checks the unnecessary drive image M1 among the captured drive images M1-M6 and deletes the checked drive image, and the remaining drive images M2 except for the deleted drive image. -M6) is connected in chronological order to create a drive image.

For example, the unnecessary image may include an image of a traffic light, an image of taking a selfie, an image of a road number and a speed limit sign.

As shown in FIG. 10 , the vehicle confirms the image M5 of the sign among the captured images, recognizes the characters and symbols of the image of the identified sign, generates the recognized characters and symbols as tags, and the sign It is also possible to check the external image M6 corresponding to the image of , and create one drive image by combining the characters and symbols of the sign with the tag to the confirmed external image.

That is, the vehicle may generate a drive video by connecting the captured drive images M1-M4 and M6 in chronological order from the time of departure to the time of arrival at the destination.

Meanwhile, the disclosed embodiments may be implemented in the form of a recording medium storing instructions executable by a computer. Instructions may be stored in the form of program code, and when executed by a processor, may generate program modules to perform operations of the disclosed embodiments. The recording medium may be implemented as a computer-readable recording medium.

The computer-readable recording medium includes any type of recording medium in which instructions readable by the computer are stored. For example, there may be a read only memory (ROM), a random access memory (RAM), a magnetic tape, a magnetic disk, a flash memory, an optical data storage device, and the like.

100: vehicle 200: terminal
141: first image acquisition unit 142: second image acquisition unit
143: speed detection unit 144: distance detection unit
145: start unit 146: shift lever information receiving unit
147: location receiver

Claims (25)

a speed detection unit for detecting the traveling speed;
a first image acquisition unit for acquiring an external image;
a control unit that captures the acquired external image based on the detected driving speed change information, and generates a drive video by connecting the captured external image when driving is finished;
a storage unit for storing the generated drive video; and
Including; a location receiving unit for receiving location information corresponding to the current location;
The control unit is
If the change in the driving speed is a decrease in speed, capture the image acquired by the first image acquisition unit, check the position information of the vehicle at the time of capturing the acquired image, combine the identified position information with the captured image, and store ,
If the external image acquired by the first image acquisition unit is image-processed, and another vehicle is recognized from the image-processed image, and the recognized distance to another vehicle is greater than or equal to the reference distance, and the change in the driving speed is a decrease in speed, the A vehicle that captures the image acquired by the first image acquisition unit. According to claim 1,
a location receiver configured to receive location information corresponding to the current location;
Further comprising an input unit for receiving destination information,
and the controller determines whether a current location is a destination based on the location information and the destination information, and generates a drive video from a departure point to a destination. According to claim 1, wherein the control unit,
When capturing the external image, the vehicle further comprising: checking the location information of the vehicle at the time of capture, combining the identified location information with the captured image and storing the captured image. delete According to claim 1, wherein the control unit,
The position information of the shift lever is checked, and if the position of the shift lever is at the parking stage, the image acquired by the first image acquisition unit is captured, the position information of the vehicle at the time of capturing the acquired image is confirmed, and the confirmed position information The vehicle further comprising combining and storing the captured image. delete The method of claim 1,
Further comprising a distance detection unit for detecting the distance to the other vehicle,
The controller may further include capturing the image acquired by the first image acquisition unit when the detected distance to the other vehicle is equal to or greater than a reference distance and the change in the driving speed is a decrease in speed. According to claim 1,
A second image acquisition unit for acquiring an image of the interior; further comprising,
The control unit recognizes the behavior of the driver and the passenger based on the image acquired by the second image acquisition unit, captures the acquired external image based on the behavior information of the recognized behavior, and the captured external Concatenating the video of the vehicle further comprising generating a drive video. 9. The method of claim 8,
Further comprising a location receiving unit for receiving location information corresponding to the current location,
The control unit image-processes the obtained internal image, recognizes the driver's gaze from the image-processed image, and when the driver's gaze is located in the external gaze region for a reference time, the image acquired by the first image acquisition unit The vehicle further comprising capturing 10. The method of claim 9, wherein the control unit,
Checking the number of repetitions in which at least one occupant of the driver and the passenger alternately gazes inside and outside, and capturing the image acquired by the first image acquisition unit if the number of repetitions is greater than or equal to a reference number vehicle that does. The method of claim 9, wherein the control unit,
Recognizing the gaze of a passenger in the image-processed image, and capturing the image acquired by the first image acquisition unit when the gaze of the passenger is at a fixed position for more than a reference time. The method of claim 11, wherein the control unit,
The vehicle further comprising: checking the motion of the passenger, and capturing the image obtained by the first image acquisition unit if the confirmed motion of the passenger is an external shooting motion using a terminal. According to claim 1, wherein the control unit,
The vehicle further comprising image processing the acquired external image, recognizing a sign from the image-processed image, and storing the image of the recognized sign. According to claim 1,
a location receiver configured to receive location information corresponding to the current location;
Further comprising an input unit for receiving destination information,
The controller generates navigation information from a source to a destination based on the location information and the destination information, and acquires the first image when it is determined that the current location is a region of interest based on the generated navigation information and location information of the current location The vehicle further comprising capturing an image obtained from the unit. 15. The method of claim 14, wherein the control unit,
The vehicle further comprising: determining whether the current location is a destination when the engine is turned off; and capturing the image acquired by the first image acquisition unit when it is determined that the current location is not the destination. to detect the vehicle's driving speed,
Check the detected driving speed in real time,
When the driving speed is reduced, an external image acquired through the first image acquisition unit is captured,
Check the location of the vehicle when capturing the external image,
Combining the captured image and the location of the vehicle to generate a drive image,
When driving is finished, the created drive video is linked to create a drive video,
output the generated drive video;
To create the drive image,
Recognizing the behavior information of the driver and passengers based on the internal image acquired by the second image acquisition unit,
Capturing the external image acquired by the first image acquisition unit based on the recognized behavior information,
Check the location of the vehicle when capturing the external image,
Combining the captured image and the location of the vehicle to generate a drive image,
Capturing the external image acquired in the first image acquisition unit,
Check the distance to other vehicles
The identified distance is greater than or equal to the reference distance,
and capturing an external image acquired by the first image acquisition unit when the change in the driving speed is a decrease in speed. delete The method of claim 16, wherein the determining whether the driving is finished comprises:
Check the location information received by the location receiver,
Determining whether the current location is a destination based on the identified location information and destination information,
and determining that driving has ended when the current location is the destination. 17. The method of claim 16,
When the destination information is received, the received location information is checked in the location receiving unit,
generating navigation information from a departure point to a destination based on the identified location information and destination information;
It is determined whether it is a capture point based on the navigation information,
When it is determined that the present is a capture time, the method of controlling a vehicle comprising capturing an external image acquired by the first image acquisition unit. delete 17. The method of claim 16,
generating a tag corresponding to the speed reduction;
The method of controlling a vehicle further comprising storing the generated tag in combination with the captured external image. 17. The method of claim 16,
Image processing the internal image of the vehicle acquired in the second image acquisition unit,
Recognizing the user's gaze in the image-processed image,
Determining whether it is a capture point based on the recognized gaze,
When it is determined that it is the capture time, the external image acquired by the first image acquisition unit is captured,
generating a tag corresponding to the gaze recognition;
The method of controlling a vehicle further comprising combining and storing the generated tag and the captured image. 17. The method of claim 16,
Image processing the internal image of the vehicle acquired in the second image acquisition unit,
Recognizing the user's motion in the image-processed image,
If the recognized user's motion is an external shooting motion using a terminal, capture the external image acquired by the first image acquisition unit,
generating a tag corresponding to the motion recognition;
The method of controlling a vehicle further comprising combining and storing the generated tag and the captured image. 17. The method of claim 16,
Check the position information of the shift lever,
If the position of the shift lever is the parking stage, the image acquired by the first image acquisition unit is captured,
Check the location information of the vehicle at the time of capturing the obtained image,
The method of controlling a vehicle further comprising storing the identified location information in combination with a captured image. a speed detection unit for detecting the traveling speed;
an input unit for receiving a navigation mode and a destination;
a location receiving unit for receiving current location information;
an image acquisition unit for acquiring an external image;
The navigation information is generated based on the received location information and the destination information, and the acquired external image is captured based on at least one of the generated navigation information and the detected driving speed change information, and the current location is the destination. a control unit for generating a drive video by connecting the captured external image;
a storage unit for storing the generated drive video; and
Including; a location receiving unit for receiving location information corresponding to the current location;
The control unit is
If the change in the driving speed is a decrease in speed, capture the image acquired by the first image acquisition unit, check the position information of the vehicle at the time of capturing the acquired image, combine the identified position information with the captured image and store,
If the external image acquired by the first image acquisition unit is image-processed, and another vehicle is recognized from the image-processed image, and the recognized distance to another vehicle is greater than or equal to the reference distance, and the change in the driving speed is a decrease in speed, the A vehicle that captures the image acquired by the first image acquisition unit.

Images