KR20210106855A - Real-Time Vehicle-Related Data Collecting Apparatus and Method - Google Patents

Abstract

One aspect of the present invention discloses a method for collecting data related to a vehicle. The method comprises steps of: obtaining, from a first terminal that handles vehicle operation information, navigation streaming image data related to vehicle operation and data related to vehicle operation; encoding the navigation streaming image data received from the first terminal through a wired or wireless network in real time in an encoder; and synchronizing the real-time encoded navigation streaming image data and data related to the vehicle operation based on time information, and storing the data.

Description

Real-Time Vehicle-Related Data Collecting Apparatus and Method}

The present invention relates to an apparatus and method for collecting and transmitting real-time data, and more particularly, to an apparatus and method for collecting, storing, and transmitting an image in a moving environment of a vehicle.

In relation to a method of collecting vehicle-related data, a conventional method is used in which individual vehicle-related data collection devices collect and store image, audio and formatted data, respectively. For example, one vehicle is equipped with a navigation terminal, a black box terminal, and various other image sensors, so that the navigation terminal handles vehicle operation-related data, and the black box handles front and rear operation images of the vehicle In addition, it has taken a method of individually acquiring vehicle-related image data from various vehicle-mounted image sensors.

However, video, audio, and driving information data in the vehicle moving environment, which are handled separately by multiple devices, are stored and utilized for each device, making it difficult to comprehensively analyze the data related to the vehicle at the time of an accident. In addition, there is a risk that individual data may be lost as each terminal is damaged at the same time as an accident, so there is a problem in that it is not possible to efficiently utilize a plurality of image and non-image data from various terminals or sensors in an actual accident.

An object according to an aspect of the present invention for solving the above problems is to comprehensively collect streaming image data related to vehicle operation in each terminal related to the vehicle, other types of vehicle operation data, and image data around the vehicle. It is to provide an apparatus and method for collecting vehicle-related data to be transmitted to an external terminal.

In a method for collecting vehicle-related data according to an aspect of the present invention for achieving the above object, from a first terminal handling vehicle operation information, navigation streaming image data and vehicle related to vehicle operation Acquiring driving-related data; encoding, in an encoder, real-time navigation streaming image data received from the first terminal through a wired or wireless network; and the real-time encoded navigation streaming image data and the vehicle operation; The method may include synchronizing related data based on time information and storing the same.

The vehicle-related data collection method further includes acquiring image data about the vehicle surroundings from a second terminal for photographing the vehicle surroundings, wherein the storing includes the streaming image data, the vehicle driving-related data, and the The method may include synchronizing and storing image data around the vehicle based on time information.

The vehicle-related data collection method may further include transmitting the real-time encoded navigation streaming image data, the vehicle driving data, and the vehicle surrounding image data to a third terminal outside the vehicle in real time.

The step of transmitting the real-time encoded navigation tree image data, the vehicle driving data, and the vehicle surrounding image data to the third terminal in real time includes the real-time encoded navigation streaming image data and the vehicle surroundings from the third terminal. Acquiring image output condition information related to image data, Adjusting the resolution of the real-time encoded navigation streaming image data and the vehicle surrounding image data based on the obtained image output condition information, and the real-time encoded It may include transmitting the navigation streaming image data and the vehicle surrounding image data with the adjusted resolution to the third terminal.

The step of adjusting the resolution of the real-time encoded navigation streaming image data and the vehicle surrounding image data based on the obtained image output condition information may include: a first of the data encoded in real time by the encoder streaming the navigation streaming image data. The real-time encoded navigation streaming image data and The method may include determining a resolution of the image data around the vehicle.

The step of synchronizing and storing the navigation streaming image data, the vehicle driving data, and the vehicle surroundings image data based on time information may include: the real-time encoded navigation streaming image data, the vehicle operation data, and the vehicle surroundings image Recording a part of data in a queue, relaying the real-time encoded navigation streaming image data, the vehicle driving data, and the vehicle surrounding image data to the third terminal, and periodically from the third terminal Based on the received status report, the real-time encoded navigation streaming image data to the third terminal, a relay mode for relaying the vehicle driving data and the vehicle surrounding image data, and the real-time encoded navigation streaming image data to the local storage , switching the operation mode to one of a recording mode for storing the vehicle driving data and the image data around the vehicle.

In the step of switching the operation mode, the real-time encoded navigation streaming image data buffered from a queue based on a non-response time of the status report from the third terminal, the vehicle driving data, and the vehicle surrounding image data are stored in the local may include switching the operating mode to be written to the storage.

The switching of the operation mode includes periodically receiving a status report from the third terminal, calculating an average report reception time by measuring a report time from the third terminal, and the status from the third terminal Comprising the steps of determining whether a recording failure has occurred by comparing a report reception time with a threshold time, and performing switching to the relay mode or the recording mode according to the determination result, the determination of whether the failure occurs is It may be determined based on the measured report delay time in consideration of at least one of the measured average report reception time and the maximum bufferable time.

The first terminal may include a navigation terminal, and the second terminal may include a black box terminal.

The method further comprises obtaining, from an image sensor, auxiliary image data related to parking of the vehicle, wherein the navigation streaming image data, the vehicle driving data, the vehicle surrounding image data, and the auxiliary image data are synchronized based on time information. can be saved.

An apparatus for collecting vehicle-related data according to another aspect of the present invention for achieving the above object is streaming navigation related to vehicle operation from a first terminal handling vehicle operation information through a wired or wireless network (streaming) an encoder that obtains image data and data related to vehicle operation, and encodes the navigation streaming image data in real time, the real-time encoded navigation streaming image data and data related to the vehicle operation, based on time information It may include a controller for controlling to be synchronized and stored in the local storage and a local storage for storing the real-time encoded navigation streaming image data and data related to the vehicle operation.

The controller acquires image data about the vehicle surroundings from a second terminal that captures the surroundings of the vehicle, and the controller uses the streaming image data, the data related to the vehicle operation, and the image data around the vehicle, based on time information. It can be synchronized and stored in the local storage.

The vehicle-related data collection device may further include a communication unit for transmitting the real-time encoded navigation streaming image data, the vehicle driving data, and the vehicle surrounding image data to a third terminal outside the vehicle in real time.

The controller obtains the video output condition information related to the real-time encoded navigation streaming video data and the vehicle surrounding video data from the third terminal, and based on the obtained video output condition information, the real-time encoded navigation The resolution of the streaming image data and the vehicle surrounding image data may be adjusted, and the real-time encoded navigation streaming image data and the vehicle surrounding image data may be controlled to be transmitted to the third terminal at the adjusted resolution.

The controller is configured to maintain the second reference resolution of the data obtained by encoding the navigation streaming image data in real time by the encoder and the second reference resolution of the vehicle surrounding image data obtained from the second terminal on the image output condition. 3 It is possible to determine the resolution of the real-time encoded navigation streaming image data and the vehicle surrounding image data so that the data transmission bandwidth to the terminal is minimized.

The controller records a part of the real-time encoded navigation streaming image data, the vehicle operation data and the vehicle surrounding image data in a queue, and the real-time encoded navigation streaming image data, the vehicle operation data and The video data around the vehicle is relayed to the third terminal, and based on a status report periodically received from the third terminal, the real-time encoded navigation streaming video data, the vehicle operation data, and the vehicle are transmitted to the third terminal. It is possible to control the operation mode to be switched to one of a relay mode for relaying surrounding image data and a recording mode for storing the real-time encoded navigation streaming image data, the vehicle driving data, and the vehicle surrounding image data in a local storage.

The controller operates so that the real-time encoded navigation streaming image data, the vehicle driving data, and the vehicle surrounding image data buffered from a queue based on a non-response time of the status report from the third terminal are recorded in the local storage It can be controlled to switch modes.

Switching the operation mode in the controller periodically receives a status report from the third terminal, measures the report time from the third terminal, calculates an average report reception time, and the status from the third terminal It is determined whether a recording failure occurs by comparing the report reception time with a threshold time, and switching to the relay mode or the recording mode is performed according to the determination result, but the determination of whether the failure occurs is the measured average report reception It may be determined based on the measured reporting delay time in consideration of at least one of a time and a maximum buffering available time.

The first terminal may include a navigation terminal, and the second terminal may include a black box terminal.

The controller obtains auxiliary image data related to parking of the vehicle from the image sensor, and the navigation streaming image data, the vehicle driving data, the vehicle surrounding image data, and the auxiliary image data are synchronized and stored based on time information. can

A system for collecting vehicle-related data according to another aspect of the present invention for achieving the above object is provided from a first terminal handling vehicle operation information, navigation-related streaming video data and Acquire data related to vehicle operation, encode the navigation streaming image data received from the first terminal in real time, and synchronize the real-time encoded navigation streaming image data and data related to vehicle operation based on time information To include a third terminal for receiving and storing the real-time encoded navigation streaming image data and data related to the vehicle operation from a vehicle-related data collection device and the vehicle-related data collection device that are transmitted to an external third terminal can

According to the vehicle-related data collection apparatus and method of the present invention, streaming image data related to vehicle operation is encoded and secured in real time, and other types of vehicle operation data and vehicle surrounding image data are synchronized and stored on a time-based basis to control the movement environment. It is possible to efficiently manage not only the image but also the driving information data, and there is an effect of achieving the efficiency of real-time transmission to an external terminal.

1 is a block diagram schematically showing a system including an apparatus for collecting vehicle information according to an embodiment of the present invention;
2 is a conceptual diagram for explaining a method for a vehicle information collection apparatus according to an embodiment of the present invention to store vehicle-related data by synchronizing based on time information;
3 is a detailed block diagram showing an encoder of a vehicle information collection device according to an embodiment of the present invention;
4 is a detailed block diagram showing the encoding unit of the vehicle information collection device according to an embodiment of the present invention in detail;
5 is a conceptual diagram illustrating a POD (Pixel On Demand) method applied by an image distributor of a vehicle information collection device according to an embodiment of the present invention;
6 is a view showing an exemplary screen for utilizing data received from a vehicle information collection device according to an embodiment of the present invention in an external third terminal;
7 is a conceptual diagram schematically showing a system for dual recording based on a vehicle information collection device according to another embodiment of the present invention;
8 is a detailed block diagram showing the configuration of a vehicle information collection device that performs dual recording according to another embodiment of the present invention;
9 is a flowchart illustrating a method for determining a failure in the switching unit of FIG. 8 .

Since the present invention can have various changes and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail.

However, this is not intended to limit the present invention to specific embodiments, and it should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention.

Terms such as first, second, etc. may be used to describe various elements, but the elements should not be limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, without departing from the scope of the present invention, a first component may be referred to as a second component, and similarly, a second component may also be referred to as a first component. and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items. When an element is referred to as being "connected" or "connected" to another element, It may be directly connected or connected to the other element, but it should be understood that another element may exist in the middle. On the other hand, when it is mentioned that a certain element is "directly connected" or "directly connected" to another element, it should be understood that the other element does not exist in the middle.

The terminology used in this application is only used to describe specific embodiments, and is not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the accompanying drawings. In describing the present invention, in order to facilitate the overall understanding, the same reference numerals are used for the same components in the drawings, and duplicate descriptions of the same components are omitted.

1 is a block diagram schematically showing a system including a vehicle information collecting apparatus according to an embodiment of the present invention.

As shown in FIG. 1 , a system including a vehicle information collection device according to an embodiment of the present invention includes a vehicle information collection device 110 , a first terminal 120 , a second terminal 130 , and an image sensor ( 140 ) and the third terminal 150 .

Referring to FIG. 1 , the vehicle information collection device 110 is a vehicle-related terminal, which may be mounted on the vehicle, may be detachably connected to the vehicle, and may be a portable terminal that is physically separated from the vehicle. have. The vehicle information collection device 110 may be referred to as a vehicle-related data collection device or the like. The vehicle information collection device 110 may be connected to the first terminal 120 , the second terminal 130 , and the image sensor 140 through a wired and/or wireless network.

The first terminal 120 is a terminal that handles data related to vehicle operation. The first terminal 120 may be a navigation device. The first terminal 120 has the ability to secure Global Positioning System (GPS) and Geographic Information Systems (GIS) information in relation to vehicle operation, and can handle time information together. That is, it handles various information regarding which location the vehicle is located at a specific time (eg, the current time) and which route it is heading from which origin to which destination.

The first terminal 120 calculates at least one route optimized for the current location and the input destination according to the user's input, and supports driving of the vehicle based on one route selected by the user from among the calculated at least one route. . At this time, the first terminal 120 generates image data related to navigation operation indicating the relationship between the generated route and the vehicle. In addition, in the operation of the vehicle, structured or unstructured data related to the current vehicle's geographical location, speed, direction of operation, traffic situation, longitude, latitude, surrounding buildings, etc. can create Then, the first terminal 120 provides the navigation image data to the encoder 112 of the vehicle information collecting device 110 in the form of streaming (streaming). In this case, not only the video in motion is necessarily provided, but screen data in which the user, not driving, inputs data related to settings may also be provided to the encoder 112 in streaming form. In addition, structured or unstructured data related to vehicle operation may be provided to the encoder 112 and/or the controller 114 . When the navigation is off, the transmission of the image data to the encoder 112 may be stopped. In this case, the encoder 112 may not perform encoding.

The second terminal 130 is a terminal including a camera for capturing images around the vehicle. The second terminal 130 may be a black box terminal. A plurality of second terminals 130 may be disposed at the front and/or rear of the vehicle to generate driving images of the front and/or rear of the vehicle. In addition, it is also disposed in the lateral direction of the vehicle, it is possible to generate an image from the side of the vehicle or three-dimensionally in an upward and/or downward direction through photographing. It is possible to record still images not only while driving the vehicle but also while parking, and it is possible to generate images for special situations such as lane departure along with time information. The vehicle surrounding image data generated by the second terminal 130 may be provided to the image distributor 114 of the vehicle information collecting device 110 through a wired and/or wireless network.

In addition, at least one image sensor 140 may be mounted on a vehicle to collect and generate images. The image sensor is equipment that is additionally disposed in the second terminal 130 in the front, rear, side, etc. of the vehicle for parking assistance, etc., and may generate a parking assistance image and the like. In addition, although the expression is called the image sensor 140, it does not necessarily deal with only images, and various sensors such as an ultrasonic sensor and an audio sensor are also available. In addition, text or numeric data collected from the various sensors may also be stored in a local storage and/or transmitted to the third terminal 150 .

The vehicle information collection device 110 includes at least one image data from the first terminal 120 , the second terminal 130 , and the image sensor 140 , and at least one image, audio, fixed and/or unstructured image related to vehicle operation. The data is received and stored in the local storage 116 and/or provided to the external third terminal 150 through the communication unit 118 .

The vehicle information collection device 110 may include an encoder 112 , a controller 114 , a local storage 116 , and a communication unit 118 .

The encoder 112 receives the navigation streaming video data from the first terminal 120 in real time and performs encoding. The encoder 112 may be connected to the first terminal 120 by wire and/or wirelessly. In the case of a wired connection, it may be connected through a digital interface such as a High-Definition Multimedia Interface (HDMI) or a Digital Visual Interface (DVI). When the encoder 112 is connected with the first terminal 120 through the digital interface, the first terminal 120 recognizes the connection with the encoder 112 and displays the display screen data of the first terminal 120 (eg, in navigation). output image data) may be provided to the encoder 112 in real time. At this time, it is preferable that a driver associated with the encoder 112 is installed so that the encoder 112 is recognized in the first terminal 120 . Also, the encoder 112 may receive a control command from the outside to support the control of the first terminal 120 . For example, when the navigation streaming image data of the first terminal 120 is transmitted to the user of the external third terminal 150 in real time, the user of the third terminal 150 or the user connected to the third terminal 150 is While viewing the navigation image in real time, a control command for the first terminal 120 may be provided to the vehicle information collecting device 110 . Then, the control command may be provided to the first terminal 120 via the encoder 112 to enable remote control.

The encoder 112 may include an encoding function, a network function, and a computer instruction interpretation function. The encoder 112 receives display screen information (which may be navigation streaming image data) from the first terminal 120 connected by wire through the digital interface. Then, the encoder 112 encodes the received navigation streaming video data in real time and stores it in the local storage 116 or provides it to the third terminal 150 through the communication unit 118 . At this time, the encoded data is provided to the third terminal 150 through a real-time communication protocol (RTP or RTSP) so that the user of the third terminal 150 can immediately issue a control command from a remote location after viewing the corresponding data.

The encoder 112 provides the screen encoded by itself through the bypass monitor (not shown) to the bypass monitor so that the user of the vehicle information collection device 110 can check the image data transmitted in real time through the encoder 112 . let it be The bypass monitor includes a display capable terminal connected to a wired and/or wireless network. In addition, by providing the encoding, network and/or system setting screen of the encoder 112 to the bypass monitor, the user of the encoder 112 can connect to the encoder 112 with a user interface (eg, keyboard, mouse, touch pad, etc.) It is possible to change the setting information of the encoder 112 through (not shown). The encoder 112 provides structured and/or unstructured data related to vehicle operation other than the navigation streaming image data received from the first terminal 120 to the controller 114 .

The controller 114 performs a function of distributing image data, and also stores data collected in relation to vehicle operation in the local storage 116 . Here, the function of distributing the image data may be performed by the image distributor in the controller 114 . The image distributor is a distributor (which may be called a Media Distributor (MD)) that controls distribution of the collected images. The image distributor may perform the same role as a server. It plays a role of distributing and providing the image in a form optimized for the image output condition of the third terminal 150 for the image collected through the plurality of ports. This will be described in more detail below with reference to FIG. 5 .

In addition, the controller 114 synchronizes the collected vehicle-related video, audio, and structured/unstructured data with each other based on time information, and stores a plurality of synchronized data in the local storage 116 . In addition, the controller 114 may provide various types of vehicle-related data synchronized through the communication unit 118 to the third terminal 150 .

The communication unit 118 is a component including a communication function, and may be implemented as hardware such as an antenna and/or a communication processor.

The third terminal 150 receives synchronized vehicle-related data from the vehicle information collection device 110 . Then, the received data may be displayed through a connected display means (eg, a TV, a monitor, or a touch screen, etc.). In this case, a plurality of image data may be displayed on the display means, and different images may be displayed by logically dividing one physical screen into several cells. In this case, image output condition information may be generated in consideration of the size of the image divided into cells, and the information may be transmitted to the image distributor of the controller 114 through the communication unit 118 . The image distributor may adjust the resolution of the image data to be transmitted in consideration of the received image output condition information.

FIG. 2 is a conceptual diagram for explaining a method of synchronizing, by a vehicle information collecting apparatus, based on time information, and storing vehicle-related data according to an embodiment of the present invention.

Referring to FIG. 2 , the controller of the vehicle information collection device synchronizes the collected vehicle-related data based on time information and stores it in a local storage. In addition, the synchronized vehicle-related data may be provided to the third terminal by inserting time information such as a timestamp.

At this time, the information stored together with the time information is the navigation streaming image data encoded in real time through the encoder, at least one vehicle surrounding image data (vehicle rear image, vehicle front image, etc.), auxiliary image data (vehicle side, parking assistance image, etc.) . Such vehicle-related data may be synchronized with time information and stored in a local storage. In this case, the location of the physically stored file may be the same or different.

3 is a detailed block diagram illustrating an encoder of a vehicle information collecting apparatus according to an embodiment of the present invention. As shown in FIG. 3 , the encoder according to an embodiment of the present invention includes an image receiving unit 310 , a first converting unit 320 , a second converting unit 330 , an encoding unit 340 , and a second converting unit. 350 , a mixer 360 , a command receiving unit 370 , and a command providing unit 380 may be included.

3, the image receiving unit 310 receives the navigation streaming image data from the first terminal. The image receiving unit 310 may receive the navigation streaming image data of the first terminal in real time in a wired (eg, digital interface) or wirelessly connected state.

The image receiving unit 310 may utilize a digital interface such as HDMI/DVI, and may convert the received navigation streaming image data into MIPI CSI (Mobile Industry Processor Interface for Camera Serial Interface). MIPI CSI is an interface between the first terminal and the host processor. It conforms to standard protocols such as CSI-1, CSI-2, CSI-3 and CSI-4.

The first converter 320 receives the MIPI CSI-based navigation streaming image data from the image receiver 310 and converts it into a YUV data format. According to an embodiment of the present invention, the converted YUV data may include a YUV 420 data format. The YUV 420 data formats may include a legacy YUV 420 format for compatibility with existing systems and a non-legacy YUV 420 format for lower cost implementation. The first conversion unit 320 provides the YUV format navigation streaming image data to the second conversion units 330 and 350 through the channel divided into two. At this time, the channel through the second conversion unit 330 is transmitted to the controller through encoding, and the channel through the second conversion unit 350 provides screen data to the bypass monitor 305 through mixing through mixing. can

The second converters 330 and 350 convert the YUV data into RGB data. Since the YUV format can have a high compression ratio, it is preferable to convert it into data of a low compression ratio RGB format having red (R), green (G), and blue (B). At least one of 4:2:0, 4:2:2, and 4:4:4 conversion methods may be used as the conversion method of the second conversion unit 330. However, the present invention is not limited thereto.

The encoding unit 340 encodes the navigation streaming image data of the first terminal in the RGB format converted by the second conversion unit 330 . There are various encoding methods such as HEVC (High Efficiency Video Coding) (H.265), H.264/AVC, SVC (Scalable VideoCoding), MVC (Multiview Video Coding), DivX, WMV (Window Media Video), VP8, VP9, etc. method can be used. This is selectable in user settings and can be changed through the user interface. Also, the encoding unit 340 may encode data by changing a resolution, a frame rate, and/or a bit rate through a user setting. The encoding unit 340 may encode data in units of one frame, or may encode data in units of divided frames (eg, quarter frames) obtained by dividing one frame to provide the encoded data to the controller.

The controller transmits the navigation streaming image data of the first terminal encoded through the encoding unit 340 to the third terminal. The controller may receive one completed frame from the encoding unit 340, packetize it, and then transmit it to the third terminal. Alternatively, encoded data in units of divided frames may be received, packetized, and transmitted to the third terminal. The encoded data is transmitted to the third terminal through a real-time communication protocol such as RTP or RTSP.

The mixer 360 mixes the RGB format navigation streaming image data converted through the second converter 350 in a form that can be output through a digital interface such as HDMI/DVI and/or a wireless network. The mixed data is provided to the bypass monitor 305 connected through the digital interface and/or wireless network.

According to the video stream output through the mixing process, the bypass monitor 305 may display a screen processed by the vehicle information collection device and transmitted to the third terminal to the user of the vehicle information collection device, The user may check the screen of the first terminal that is currently remotely controlled, and may also check the navigation screen of the first terminal that is changed by the remote control. For example, when a user of a third terminal in a remote location clicks a specific icon of the first terminal to open the icon, such a change in the screen of the first terminal is displayed on the bypass monitor 305 and the user of the vehicle information collection device perceives it make it possible

The command receiving unit 370 receives a control command from the third terminal through the controller. The control commands are commands provided by a user of the third terminal using a user interface (not shown) connected to the third terminal while viewing the screen of the first terminal as a remote control command for the first terminal. This may include moving the cursor, clicking the cursor, inputting letters/numbers/signs, inputting commands, and the like.

The command providing unit 380 parses the control command received from the command receiving unit 370 and provides it to the first terminal. The first terminal receives it and implements the user's command associated with the third terminal.

4 is a detailed block diagram showing the encoding unit of the vehicle information collecting apparatus according to an embodiment of the present invention in detail. As shown in FIG. 4 , the encoding unit 400 according to an embodiment of the present invention includes a codec selector 410 , a resolution adjuster 420 , a frame rate adjuster 430 , and a bitrate adjuster 440 . ) may be included.

Referring to FIG. 4 , the codec selector 410 selects one codec method from among a plurality of codecs (codec 1, codec 2, ... codec N). The codec selector 410 may select one of several codecs according to user settings. The codec selector 410 performs encoding with the default codec 1, and when there is a codec change according to a user setting, the codec selector 410 controls the encoding to be performed through the changed codec 2 .

The resolution adjusting unit 420 adjusts the resolution of the frame in relation to encoding. That is, it is possible to adjust the degree of fineness of the expression of the encoded data. This may be defined as the number of horizontal pixels and vertical pixels. Again, there may be a value set as a default value, and the user can change the value arbitrarily through the user interface. Alternatively, a plurality of modes (3840x2160, 1920x1080, 1280x720, 1024x768, 800x600, 320x180, etc.) can be set, and one of them can be variably selected.

The frame rate adjusting unit 430 adjusts the frame rate in relation to encoding, and the bit rate adjusting unit 440 adjusts the bit rate. The frame rate adjusting unit 430 may provide various frame rates such as fps 15, 30, and 60, and may apply the set fps regardless of resolution. The frame rate and bit rate are also set to default values, and the user can arbitrarily change the values through the user interface. Frame rate can be defined as the number of frames entered per second, and bit rate can be defined as the amount of information entered per second. The user can effectively adjust the quality of the navigation image data of the first terminal by arbitrarily adjusting the frame rate and/or the bit rate. That is, when the user of the vehicle information collection device handles high-definition data according to the characteristics of the first terminal, the encoding is performed by matching the encoding-related parameters of the vehicle information collection device to high-definition, so that the user in a remote location can also enjoy high-quality navigation images. Conversely, when data of relatively low quality can be handled, encoding efficiency can be increased by adjusting the encoding-related parameters to values suitable for low quality.

5 is a conceptual diagram illustrating a POD (Pixel On Demand) method applied by an image distributor of a vehicle information collection apparatus according to an embodiment of the present invention.

5A is a conceptual diagram illustrating a case in which a plurality of images are provided to a third terminal in a general manner. Here, the image 1 (510-1) may be navigation streaming image data encoded in real time by the encoder, and the image 2 (510-2) and the image 3 (510-3) are the vehicle front image obtained from the second terminal and It may be an image of the rear of the vehicle. Also, image 4 may be a vehicle side image obtained from an image sensor. Each of the image data 510-1 to 510-4 has a specific resolution, and may have an appropriate quality when provided using a bandwidth of 10 Mbps (bit per second). Accordingly, in order for the vehicle information collecting apparatus to transmit the images 1 to 4 (510-1 to 510-4), each requiring a bandwidth of 10 Mbps, a bandwidth of 10 Mbps x 4 = 40 Mbps is required.

FIG. 5B is a conceptual diagram for explaining a POD method used by an image distributor of a vehicle information collecting apparatus according to an embodiment of the present invention. In FIG. 5(b), it is assumed that, in the same manner as in the situation of FIG. 5(a), a bitrate of 10Mbps is appropriate for all of the navigation streaming image and vehicle surroundings image read from the encoder. Such an appropriate resolution is a standard resolution for transmission. In the case of navigation streaming video data, it represents the encoding resolution of the encoded data, and for video data received by a video distributor without going through other encoders, the resolution at the time of reception. indicates. The reference resolution may be changed according to a user setting. In addition, data other than images

It is preferable not to apply the POD method according to an embodiment of the present invention.

In the above embodiment, the video splitter receives all of the input images 1 to 4 (510-1 to 510-4) using a bandwidth of 40 Mbps, and adjusts the resolution of the received images to adjust the transmission bandwidth. Maximize the efficiency of the video distributor. The video distributor may obtain the video output condition information from the third terminal. The image output condition information is information related to a condition for outputting an image from the third terminal, and includes information on the number and image identification information of output images, and size and arrangement of output images. For example, all of the images 1 to 4 (510-1 to 510-4) are output. At this time, if the images 1 to 4 (510-1 to 510-4) are displayed in the third terminal with a size divided into 4 equal parts, the output image is The identification number and output size information of the image corresponding to the identification number are provided from the third terminal to the video distributor.

The image distributor may specify an image to be transmitted based on the image identification number among the image output condition information received from the third terminal, and determine a corresponding resolution of the specified image based on the output size information of the image. In this case, the resolution may be determined as a resolution value such that the bandwidth for image transmission to the third terminal is minimized while the original resolution of the images is maintained under the image output condition of the third terminal. For example, in the embodiment of FIG. 5 (b), in a situation in which four images with a resolution requiring a transmission bandwidth of 10 Mbps are transmitted, since the corresponding images are output in 1/4 size from the third terminal, all images are Even if the resolution is reduced to 1/4, it can be determined that it is difficult to distinguish it on the output screen of the third terminal. Therefore, by adjusting the resolution to 1/4 and transmitting the bandwidth of 10 Mbps per image, the bandwidth of 2.5 Mbps is used to transmit 4 images with a bandwidth of 2.5 Mbps x 4 = 10 Mbps instead of 40 Mbps as a whole. It is preferable to do so. This is the POD method used in the video splitter of the present invention.

According to an embodiment of the present invention, since an image may be displayed on the display means of the third terminal in a superimposed form, a bandwidth exceeding 10 Mbps may be required even though it is a combined screen of a plurality of images having a reference resolution of 10 Mbps. .In addition, since the image may not be displayed on the entire area of the display means of the third terminal (text, number, or other types of data may be displayed), a bandwidth of 10 Mbps or less may be used. It is a secret theory.

6 is a diagram illustrating an exemplary screen for using data received from the vehicle information collection device according to an embodiment of the present invention in an external third terminal.

Referring to FIG. 6 , the vehicle information collection device directly stores a plurality of images, audio, and structured/unstructured data synchronized based on time information in a local storage, and extracts and reviews them later, or an external third terminal in real time. You can use it by sending it to

Data transmitted from the vehicle information collecting device to the third terminal may be utilized as shown in the drawing of FIG. 6 . That is, the viewer of the vehicle information collection device may determine which image to output through the image selection icon 610 . The type of the output image corresponds to the type of the collected image. That is, it may include a navigation streaming image, a vehicle front image, a vehicle rear image, a vehicle side image, an image obtained by combining other parking assistance images and vehicle driving data.

In the embodiment of FIG. 6 , it is assumed that the navigation image, the vehicle front and rear images, and the vehicle driving data comprehensive image are displayed in four divided cells. One monitor may include a plurality of cells 630 - 1 , 630 - 2 , 630 - 3 , and 630 - 4 to output one meaningful screen from each of the cells. In this case, one physical monitor may be referred to as a canvas 620 (canvas). That is, the canvas 620 may be divided into a plurality of square or rectangular cells 630-1, 630-2, 630-3, and 630-4.

Although described above with reference to the drawings and examples, it does not mean that the scope of protection of the present invention is limited by the drawings or examples, and those skilled in the art can appreciate the spirit of the present invention described in the claims below. And it will be understood that various modifications and changes can be made without departing from the scope of the present invention.

10: central information center 15: call center
20: vehicle terminal 21: mobile phone interface unit
22: GPS receiver 23: arithmetic unit
24: sensor unit 25: information storage unit
26: input/output unit 27: system control unit

Claims (10)

A method of collecting data related to a vehicle, the method comprising:
obtaining, from a first terminal that handles vehicle operation information, navigation streaming image data related to vehicle operation and data related to vehicle operation;
encoding, in an encoder, real-time navigation streaming video data received from the first terminal through a wired or wireless network; and
and storing the real-time encoded navigation streaming image data and data related to the vehicle operation, synchronized based on time information, and storing the data. The method of claim 1,
Further comprising the step of acquiring image data about the vehicle surroundings from the second terminal for photographing the vehicle surroundings,
The storing may include synchronizing the streaming image data, the data related to the vehicle operation, and the image data around the vehicle based on time information, and storing the same. 3. The method of claim 2,
The method further comprising transmitting the real-time encoded navigation streaming image data, the vehicle driving data, and the vehicle surrounding image data to a third terminal outside the vehicle in real time. The method of claim 3, wherein the step of transmitting the real-time encoded navigation streaming image data, the vehicle driving data, and the vehicle surrounding image data to the third terminal in real time comprises:
obtaining image output condition information related to the real-time encoded navigation streaming image data and the vehicle surrounding image data from the third terminal;
adjusting the resolution of the real-time encoded navigation streaming image data and the vehicle surrounding image data based on the obtained image output condition information; and
The method of collecting vehicle-related data further comprising transmitting the real-time encoded navigation streaming image data and vehicle surrounding image data to the third terminal at an adjusted resolution. The method of claim 4, wherein the adjusting the resolution of the real-time encoded navigation streaming image data and the vehicle surrounding image data based on the obtained image output condition information comprises:
A first reference resolution of data obtained by encoding the navigation streaming image data in real time by the encoder and a second reference resolution of vehicle surrounding image data obtained from the second terminal are maintained on the image output condition to the third terminal and determining resolutions of the real-time encoded navigation streaming image data and the vehicle surrounding image data so that the data transmission bandwidth is minimized. The method of claim 3, wherein the step of synchronizing and storing the navigation streaming image data, the vehicle driving data, and the vehicle surrounding image data based on time information comprises:
recording a part of the real-time encoded navigation streaming image data, the vehicle driving data, and the vehicle surrounding image data in a queue;
relaying the real-time encoded navigation streaming image data, the vehicle driving data, and the vehicle surrounding image data to the third terminal; and
Based on the status report periodically received from the third terminal, the real-time encoded navigation streaming image data, the vehicle driving data, and the vehicle surrounding image data are relayed to the third terminal in a relay mode and the local storage in the real time A method for collecting vehicle-related data, comprising: switching an operation mode to one of a recording mode for storing the encoded navigation streaming image data, the vehicle driving data, and the vehicle surrounding image data. The method of claim 6, wherein switching the operation mode comprises:
Switching the operation mode so that the real-time encoded navigation streaming image data buffered from a queue, the vehicle driving data, and the vehicle surrounding image data buffered from the queue based on the non-response time of the status report from the third terminal are recorded in the local storage A method for collecting vehicle-related data, comprising the steps of: 7. The method of claim 6, wherein switching the operation mode comprises:
periodically receiving a status report from the third terminal;
calculating an average report reception time by measuring a report time from the third terminal;
determining whether a recording failure has occurred by comparing the reception time of the status report from the third terminal and a threshold time; and
performing switching to the relay mode or the recording mode according to the determination result,
The determination of whether the failure occurs is a vehicle-related data collection method that is determined based on a measured report delay time in consideration of at least one of the measured average report reception time and maximum buffering time. The method of claim 1,
The first terminal includes a navigation terminal,
The second terminal is a vehicle-related data collection method including a black box (blackbox) terminal. The method of claim 1,
Further comprising the step of obtaining, from the image sensor, auxiliary image data related to parking of the vehicle,
The navigation streaming image data, the vehicle driving data, the vehicle surrounding image data, and the auxiliary image data are synchronized and stored based on time information.

Images