KR102058243B1 - Blackbox Apparatus and Method for Transferring Moving Pictures through the LPWAN - Google Patents

Abstract

Disclosed are a black box terminal and a method for transmitting a video through only low power broadband communication. The black box of the present invention detects a shock of a vehicle to generate a shock event, and uploads an image buffered at a predetermined time unit before and after a shock to an image server through LPWAN as an individual image unit. The video server synthesizes the individually uploaded images into a single video clip and provides them to the user terminal. On the other hand, the black box terminal of the present invention does not generate a shock event for the shock generated in the process of opening and closing the car door of the shock applied to the vehicle.

Description

Blackbox Apparatus and Method for Transferring Moving Pictures through the LPWAN}

The present invention relates to a black box terminal installed in a vehicle. The present invention relates to a method of transmitting a captured image to an external device through a low power broadband network (LPWAN). It is about a method.

The black box installed in the vehicle not only records the front state of the vehicle by using a camera as a video, but also stores a still image when an event occurs using various sensors installed in the vehicle. Meanwhile, the black box may include a user interface such as a display or an input unit to receive various control commands from the user.

1 illustrates a black box 100 installed in a vehicle 10. Normally, the black box 100 is installed in the front window of the vehicle 10 to record and record the situation in front of the window.

The conventional black box 100 functionally includes a camera unit 101, a memory 103, an SD card 105, and a controller 110. The camera unit 101 includes an optical lens and an image sensor, and the memory 103 uses a double data rate (DDR) RAM as RAM, which is a volatile memory. The SD card 105 is a storage means of a type that can be easily attached to or detached from a card slot provided in the black box 100, and a nonvolatile flash memory is used. Under the control of the controller 110, the camera unit 101 generates an image at a predetermined frame rate per second (eg, 16 frames per second). The image photographed by the camera unit 101 is first temporarily stored in the memory 103 and then transferred to the SD card 105. The plurality of image files stored in the SD card 105 are made of one video file in units of a predetermined time (for example, one minute).

The user can view the video stored in the SD card 105 in the black box 100, or can be inserted into another computer device for viewing. In some cases, it is also necessary to transfer a video stored in the SD card 105 to an external device. Since the black box 100 is installed in a moving vehicle, it is necessary to use a wireless network to transmit a video.

Shock event

The conventional black box provides a function of storing a still image or a moving image by detecting a shock applied to a vehicle. The impact of the vehicle can be detected by measuring the vibration generated in the vehicle. Vibration of the vehicle may occur when another vehicle hits a vehicle that is parked or in operation, or may occur while the driver opens or closes the door. Of the vibrations that occur in a vehicle, what is really of interest is when another vehicle or someone impacts the vehicle. For example, vibrations that occur when a driver closes the car door hard are not of interest to the black box.

LPWAN

Conventional black boxes use an SD card as a storage medium, and do not upload or transmit a video over a network. This is because wireless data fees are expensive.

Meanwhile, the applicant has been registered for a patent for a black box system using only low power broadband communication (Korean Patent Registration No. 1797271). The low power wide area network (LPWAN) applied here is a low power broadband communication protocol announced for the Internet of Things. There are commercially available technologies such as LoRa, Sigfox, Ingenu, LTE-M, NB-IoT, and LTE CAT-M1. NB-IoT and Cat-M1 are recently announced standards for LTE technology based on 3rd Generation Partnership Project (3GPP) Release 12 and Release 13, and have been in sleep mode for extended periods of power consumption. It supports eDRX (Extended Discontinuous Reception) / PSM (Power Saving Mode).

LPWAN is capable of low-power transmission, which is suitable for places where there is insufficient power supply such as vehicles. LPWAN can be suitable for on-the-fly data service of in-vehicle devices in terms of low network service costs due to the low data transmission rate. The patent applies LPWAN because it is a service based on low capacity data transmission.

In recent years, black boxes generate high-definition (HD) or full HD (FHD) images in order to analyze the situation effectively. It is difficult to transfer such high quality image or video files through LPWAN. In fact, even if the image can be transmitted, as the data usage increases, the data usage cost increases accordingly, and thus the economic advantage of using the low power broadband communication network disappears.

[Related Advanced Technology]

1. Vehicle black box system (Korea Patent Publication KR1020110107084 A)

2. A service terminal that provides various services using a low-power broadband communication network and can be connected to a black box installed in a vehicle and a method of connecting the black box (Korea Patent KR1797271 B1)

An object of the present invention is to provide a method for uploading an image photographed by a black box installed in a vehicle to a video server through a low power broadband communication network (LPWAN) and a black box terminal thereof.

On the other hand, the shock event that occurs in the actual vehicle is more frequent than the impact that is applied to the vehicle from the outside, the impact event occurs when the driver opens and closes the car door. If the image is uploaded to the video server for each impact event generated in the process of opening and closing the car door, even though a low-cost broadband network, which is relatively inexpensive, is used, the data usage increases and the cost increases.

However, the impact of the driver opening and closing the car door should be properly excluded because it is not an impact on the vehicle from the outside. Accordingly, another object of the present invention is to provide a method of minimizing data use in a low power broadband communication network by appropriately excluding an impact event occurring when a driver opens and closes a door of a vehicle.

The black box terminal installed in the vehicle is installed in the vehicle and connected to the sensor unit for detecting the vibration, the start monitoring unit for monitoring the starting state of the vehicle; It includes an event processing unit.

Shock event

The event processor generates a shock event and transmits an image recorded in a memory or a storage medium to the video server through the low power broadband network (LPWAN) when the shock event occurs. The event processing unit generates the shock event when the vibration detected by the sensor unit is at a reference intensity or more ('shock event-preparation state') when the vehicle is not started within the first set time when the vehicle is not started within the first set time. If the start-up occurs within the first set time, the shock event is not generated.

According to an embodiment of the present disclosure, when the event processing unit becomes the 'shock event-preliminary state' while the vehicle is started, the event processing unit performs the shock when the start-up is turned off within a first preset time before the 'shock event-preliminary state'. It may not generate an event.

Provide minimum image

According to another embodiment of the present disclosure, the black box terminal further includes an event image management unit storing first-in, first-out of an image generated at a point of time that is repeated at a third set time interval among images generated by the camera in a buffer having a predetermined size in the memory. It may include. The third set time is set to a value larger than the photographing period of the camera. In this case, the image transmitted by the event processor to the video server according to the shock event is an image recorded in the buffer, and the video server combines the image provided by the event processor into a video.

According to another embodiment, the event image management unit may downsize an image to be recorded in the buffer and record the image in the buffer to reduce the size of the image transmitted by the event processor to the image server.

According to another embodiment, the buffer may be set to a size to store p images generated by the camera. In this case, p = m (2n + 1), m is the number of the camera, n is a positive integer.

In this case, the event processing unit stores the image after the shock event in the buffer by waiting until the shock event is repeated by the third set time interval (n + 1) times. It can be transmitted to the video server.

According to another embodiment, the event processing unit uploads the image of the buffer to a predetermined URL of the video server, and then provides the service server with an upload report that records the URL, so that the service server uploads the image. The UE may be notified to the user terminal according to the report.

The present invention also extends to an image providing method of a black box terminal. The method comprises the steps of connecting with an image server via a low power broadband network (LPWAN); Repeating a process of first storing an image generated by a camera of the black box terminal at a preset shooting cycle in a memory and then moving the image into a video file format on a storage medium at a second preset time period; Detecting a vibration caused by an impact applied to the vehicle through a sensor unit installed in the vehicle and monitoring a starting state of the vehicle; Generating a shock event when the vibration detected by the sensor unit is equal to or greater than a reference intensity ('shock event-preliminary state'): when the shock event is present, a low-power wideband image of the image recorded in the memory or the storage medium; And transmitting to the image server through a network LPWAN. In the generating of the shock event, when the vibration of the sensor unit senses that the vibration detected by the sensor unit is equal to or greater than a reference intensity ('shock event-preliminary state') while the vehicle is turned off, the shock event is not started within the first set time. Otherwise, the shock event is generated, and the start of the shock event is not generated if the engine is started within the first set time.

The black box terminal of the present invention may transmit an image of a situation immediately before and immediately after the impact event to the server through the low power broadband communication network when a large shock is detected while the vehicle is parked or driving.

Modern black boxes have enough storage space, so they create and store high quality images. Known low power broadband networks, on the other hand, are inexpensive but very slow in transmission, making it impossible to transmit high quality recorded video over low power broadband networks, or require significant transmission time. Since the black box according to the present invention overcomes these limitations and provides a video at the time of an impact event to the user or a third party while using a low power broadband communication network, the user can check the shock situation as a video while using the low power broadband communication network. have.

According to the present invention, since the driver can appropriately exclude the shock event occurring in the process of opening and closing the car door to get on or off the vehicle, the data usage can be significantly reduced.

1 is a view showing a conventional black box terminal,
2 is a view showing the configuration of a black box system of the present invention,
3 is a block diagram showing a detailed configuration of a black box terminal and a service terminal of the present invention;
4 is a flow chart provided in the description of the impact event generation method of the present invention;
5 is a block diagram showing a detailed configuration of a black box terminal and a service terminal according to another embodiment of the present invention;
6 is a flow chart provided in the description of a method for buffering an image in accordance with the present invention;
7 is a flowchart provided to explain an image transmission method during a shock event according to the present invention; and
8 is a view provided to explain the operation at the time of an impact event of the present invention.

Hereinafter, the present invention will be described in more detail with reference to the accompanying drawings.

2 and 3, the black box system 200 of the present invention is a black box terminal (Black-Box, hereinafter simply referred to as a 'black box') having a first camera and a service terminal ( 230, a sensor unit 251, a second camera 253, an image server 291, and a service server 293.

The black box terminal 210, the service terminal 230, the sensor unit 251, and the second camera 253 are installed in the vehicle 10, and the image server 291 and the service server 293 are a low-power broadband network ( LPWAN) 270 is connected to the service terminal 230 or the black box 210.

The LPWAN 270 is preferably NB-IoT and Cat-M1 that supports Extended Discontinuous Reception (eDRX) / Power Saving Mode (PSM), but is not limited thereto. Networks such as Cat-M1, LTE, and 5G are also available.

The LPWAN 270 includes a plurality of LPWAN gateways (including 271) and an LPWAN server 273 to which a plurality of LPWAN gateways (including 271) are connected. The LPWAN 270 includes a service terminal 230, an image server 291, and a service server ( 293). Hereinafter, data included in the LPWAN data packet transmitted and received between the service terminal 230 and the LPWAN gateway 271 will be referred to as 'LPWAN service data'. For example, if the LPWAN 270 is a Cat-M1 network, the LPWAN 270 will include a Cat-M1 gateway 271 and a Cat-M1 server 273 and collect Cat-M1 data packets for LPWAN services. Will be sent.

The black box system 200 of the present invention includes a video server 291 and a service server 293 for the characteristic LPWAN service of the present invention. Here, the LPWAN service, if there is an external shock to the user vehicle 10 while parked or in operation (hereinafter referred to as 'shock event') at least one image of the impact time (below, the event image) black box ( It is provided from the user 210 to the user side. The image server 291 and the service server 293 are connected to the service terminal 230 or the black box 210 installed in the vehicle 10 through the Internet and the LPWAN 270.

The image server 291 receives an image related to the impact event from the black box 210, converts it into a video file, stores it, and manages it. Storage folders 291a, 291b, and 291c for storing images of shock events for each user are created in the internal storage medium of the image server 291. Since the storage folders 291a, 291b, and 291c are allocated for each user and a unique URL is assigned, the black box 210 may store an image (image) related to an impact event in a storage folder assigned to the user. . In the following description, it is assumed that the first storage folder 291a is allocated to the user.

The service server 293 receives the 'upload report' provided by the black box 210 according to the shock event and provides an alarm service to the user. For the alarm service, the service server 293 is connected to the user terminal 295 via the Internet, and transmits the shock event situation confirmed from the 'upload report' to the user.

The alarm service may be provided to a registered user, and the service server 293 may store and manage a terminal identification number (ID) and user information through user registration. The user information may include a login ID, a password, and the like, and may also include information (telephone number, MAC address, etc.) of a user-side portable device that will provide an alarm when a shock event is described below.

The service terminal 230 installed in the vehicle 10 includes an LPWAN interface 231 and connects the black box 210 and the LPWAN 270 to each other. According to an embodiment, the LPWAN interface unit 231 may be embedded in the black box 210, and the black box system 200 may not include the service terminal 230.

The LPWAN interface unit 231 may include an antenna (not shown) and may communicate with the LPWAN gateway 271 through a wireless channel according to the LPWAN service protocol. The service terminal 230 may upload the event image provided by the black box 210 to the image server 291 through the LPWAN gateway 271 at the request of the black box 210.

The service terminal 230 operates by receiving DC power from a vehicle battery (not shown) through an internal battery or a fuse box (not shown) of the vehicle 10. The service terminal 230 may be configured to always operate, but may operate only when the driver has specially operated.

The black box 210 may capture a situation around the vehicle 10 and store it as a moving image or a still image, and generate a shock event by detecting a shock applied to the vehicle 10. For this operation, the black box 210 includes a first camera 301, a memory 303, an SD card 305, and a controller 310, and is installed in the vehicle 10. The black box 210 is connected to the sensor unit 251 and the second camera 253, and although not shown in FIG. 3, the black box 210 further includes a configuration for receiving signals from the sensor unit 251 and the second camera 253. can do. In addition, the black box 210 may be connected to a GPS receiver (not shown) for collecting location information or may have a GPS receiver (not shown).

The black box system 200 may include a plurality of cameras, and the first camera 301 mounted on the black box 210 and the second camera 253 connected to the black box 210 by a cable may be a single camera. This is an example. The first camera 301 and the second camera 253 photograph the front and rear situations of the vehicle 10 to generate a moving image or a still image. The first camera 301 and the second camera 253 each generate a digital image at a predetermined frame rate (eg, 16 frames per second = 16 fps) (or a shooting cycle) and provide the digital image to the controller 310. .

On the other hand, the sensor unit 251 is installed at at least one point of the vehicle 10 detects the impact of the external force applied to the vehicle 10. The vibration of the vehicle may occur when another vehicle collides with the parked vehicle 10, may occur while the driver opens or closes the car door, or may occur when the vehicle 10 in operation collides with another vehicle. The controller 310 of the black box 210 detects an impact through the sensor unit 251. For example, the controller 310 may determine that there is an impact when the vibration sensed by the sensor unit 251 is equal to or greater than a predetermined reference intensity.

The memory 303 is RAM, which is a volatile memory required for the operation of the black box 210, and uses a Double Data Rate (DDR) Synchronous Dynamic RAM (SDRAM). The memory 303 stores images provided by the first camera 301 and the second camera 253. The controller 310 transfers the primary or temporary image file stored in the memory 303 to the SD card 305 in the form of a video file in predetermined unit of time.

The SD card 305 is a nonvolatile flash memory, which is a kind of a multimedia card (MMC) that can be inserted into or detached from a card slot of the black box 210. Complies with Secure Digital High Capacity (SDXC) standard, Secure Digital eXtended Capacity (SDXC) standard, and Secure Digital Input Output (SDIO) standard. The SD card 305 is an example of a nonvolatile storage medium that the black box 210 may include, and the black box 210 may include a storage medium of a type other than the SD card 305.

The controller 310 may be interpreted as a configuration specially installed for the present invention, but is generally implemented as a processor chip which is hardware and an operating system (OS) operating based on the chip. It may be functionally indicated. The controller 310 includes an image processor 311, a starter monitor 313, and an event processor 315 for controlling the overall function of the black box 210 and processing the characteristic events of the present invention.

The image processor 311 performs a 'normal storage mode'. The normal storage mode is the same as the operation mode of the conventional black box, and stores both the image captured by the front camera 301 and the rear camera 253 at a preset frame rate. Assuming the front camera 301 and the rear camera 253 having a frame rate of 20 frames per second, the image processor 311 is configured to generate 100 images and the second camera 253 generated by the first camera 301 for 5 seconds. Each of the 100 images you create can be saved as a video file.

In general, the resolution of an image captured by a black box is a high-definition (HD) or full HD (FHD) -class image, and the first camera 301 and the second camera 253 display the image at a resolution determined by a user's setting. Create The image processor 311 performing the normal storage mode does not manipulate the resolution of the image. First of all, the image processor 311 does not downsize the resolution of the image. The image processor 311 first stores all images generated by the first camera 301 and the second camera 253 in the memory 303, and presets a predetermined time (for example, 5 minutes, the second setting below). At least one video file is generated by combining the images stored in the memory 303 in a time) cycle and stored in the SD card 305.

The start monitoring unit 313 checks the switching state when the start of the vehicle 10 is switched from the on state to the off state or switched from the off state to the on state. Whether the vehicle is started can be confirmed by checking the ACC signal of the vehicle.

The event processor 315 detects a shock applied to the vehicle 10 by using the sensor unit 251, and considers the shock (that is, vibration) in consideration of the starting state of the vehicle checked through the start monitor 313. Ignore or finally generate a shock event. When the shock event is generated, the event processor 315 transmits the image recorded in the memory 303 or the storage medium to the image server 291 through the LPWAN 270.

Hereinafter, a method of generating an impact event according to the present invention will be described with reference to FIG. 4.

<Shock Event-Determination of Preliminary Status: S401, S403>

When the sensor unit 251 detects the vibration (S401), the event processor 315 determines whether the intensity of the corresponding vibration is equal to or greater than a predetermined reference intensity (S403). Here, the reference strength can be experimentally determined to a size that can distinguish the degree of vibration that normally occurs in the vehicle itself while driving.

If the vibration sensed by the sensor unit 251 is equal to or greater than the reference intensity, the event processing unit 315 enters the operation mode into the shock event-preparation state and based on the starting state of the vehicle confirmed by the start monitoring unit 313 as follows. The shock event is finally generated by dividing into two.

<Impact when the vehicle is starting: S405, S407>

The impact on the vehicle when the vehicle is starting is not considered to be due to the driver opening and closing the car door. Accordingly, the event processing unit 315 determines the starting state of the vehicle based on the state information provided by the starting monitoring unit 313 (S405), and immediately impacts the shock event-prepared state while the vehicle is in the starting state. An event is generated (S407).

<Shock in vehicle off>

Ⓐ In case of starting the shock within the first set time after the shock event

If the vehicle start state is confirmed to be off in step S405, the event processing unit 315 checks through the start monitoring unit 313 whether the vehicle start is turned on within the first set time after the shock event-preparation state. (S409).

If the vehicle starts to be turned on within the first set time after the shock event-preparation state, the event processing unit 315 ignores the shock and does not generate a shock event. In other words, the driver considers the car door open and closed (S411).

Ⓑ In the event of a shock event-preparation within the first set time after start-up

When the vehicle start state is off in step S405, the event processing unit 315 determines whether the vehicle start is switched off within the first set time before the shock event-preparation state is made through the start monitoring unit 313. Check (S413).

If the vehicle start has already been turned off within the first set time before the shock event-preparation state, the event processing unit 315 ignores the shock and does not generate a shock event. In other words, the shock event-preliminary state that occurs when the vehicle starts to be turned off and occurs within the first set time is regarded as occurring while the vehicle driver turns off the vehicle and opens and closes the car door and ignores it.

If the vehicle start has not already been turned off within the first set time before the shock event preliminary state, and the vehicle start does not turn on within the first set time after the shock event preliminary state, The event processor 315 generates a shock event as in step S407.

In the above manner, the impact event generation method of the present invention is performed.

In summary, if the vehicle start is turned on within the first set time after the shock event preliminary state or if the vehicle start has already been turned off within the first set time before the shock event preliminary state, the shock is It is assumed that the driver is in the process of opening and closing the car door and ignore the shock and do not generate a shock event. Therefore, by changing the order of steps S409 and S413, the event processing unit 315 first determines whether the vehicle start has already been turned off within the first set time before the shock event-preparation state, and after the shock event-preparation state It may be determined whether the vehicle starting is switched on within the first set time.

Meanwhile, in step S409 and step S413, the same first set time is applied, but is not limited thereto. Therefore, different reference times may be set in steps S409 and S413.

According to an embodiment, the event processing unit 315 may transmit the alarm event to the service server 293 regardless of the case of generating the shock event or ignoring the shock and not generating the shock event.

Example: provision of minimal images

As described above, since the LPWAN 270 is very inexpensive and has a very low transmission speed, it is not practically possible to transmit a video recorded in high definition through a low power broadband communication network, or a considerable transmission time is required. In order to overcome this limitation, the black box 500 of FIG. 5 provides only the minimum image to the image server 291 as described below. The video server 291 generates a video to be provided to the user.

In the black box 500 of FIG. 5, the black box 500 is the same as the black box 310 of FIG. 3. However, the controller 510 of the black box 500 further includes an event image manager 511, and the memory 501 includes an event image buffer.

'Image buffer for events' in memory

In the memory 501 of the black box 500 of FIG. 5, a plurality of 'event image buffers' are allocated to the impact event processing of the present invention, and the 'event image buffers' are first-in-first-out (FIFO), First Output) buffering target image is saved. In consideration of the number of cameras and the number of images to be transmitted to the video server 291 for each camera according to the impact event, the total number of images (p) to be stored in the image buffer for the event, that is, the size of the image buffer for the event is expressed by the following equation. Can be obtained as

Here, p is the number of images to be received by the event image buffer or the number of images to be transmitted to the video server 291 according to the impact event. m is the number of cameras and n is a positive integer.

n corresponds to the number of images before (or after) the shock event to be included in the image to be transmitted to the video server 291 according to the shock event, as described below. If n is 1, three images are transmitted per camera including one before and after the impact event.

5 is an example in which n = 1 and m = 2 are set so that an event image buffer stores six images (p = 6). First buffer 501a, second buffer 501b and third buffer 501c for the first camera 301, fourth buffer 501d and fifth buffer 501e for the second camera 253. ) And the sixth buffer 501f are allocated as the 'image buffer for events'. Each buffer stores one image. The image buffer for the event will be described later.

Buffering events

When there is an impact event, the event processor 315 may reduce the amount of data transmission by transmitting an image stored in the 'image buffer for events' of the memory 501 to the image server 291.

To this end, the controller 510 of the black box 500 of FIG. 5 further includes an event image manager 511. While the image processing unit 311 performs the 'normal storage mode', the event image management unit 511 performs the 'buffering event'.

'Buffering event' is a job to be performed in advance for the shock event, it is performed by the event image management unit 511. The buffering event does not store all of the images captured at the preset frame rate, but instead of the first camera 301 and the second camera 253 every time that is repeated at a third set time (for example, 1 second or 2 seconds). Save the two images that) creates. The third set time is a period for storing an image for an event, and a value which is significantly smaller than a frame rate at which the first camera 301 and the second camera 253 generate an image is preferable. If the image capturing speed of the first camera 301 and the second camera 253 is 20 frames per second and the third setting time is set to 1 second, the first camera 301 and the second camera 253 are 5 seconds each. Generates 100 images. However, the event image manager 511 stores one image at a time interval of one second, that is, five images among the 100 images photographed by the first camera 301 for five seconds, as an event image, and the second camera ( Among the 100 images captured by 253, five images are stored as event images.

Hereinafter, a method of operating a buffering event will be described with reference to FIGS. 6 and 8. In FIG. 8, the horizontal axis is a time axis, and F1, F2, F3, F4, and F5 are images captured by the first camera 301, and R1, R2, R3, R4, and R5 are images captured by the second camera 253. It is a video. In addition, the photographing speeds of the first camera 301 and the second camera 253 are set to 20 frames per second.

<Buffering Event Initiation: S601>

The event image manager 511 generates a 'buffering event' at a third predetermined time interval while counting time. 8 shows an example in which the buffering event is repeatedly generated at a third set time period set to 1 second. In addition, in FIG. 8, the timing at which the buffering event occurs at the third set time interval is also synchronized with the photographing period of the first camera 301 and / or the second camera 253, so that the buffering event occurs every 20 frames.

<Downsizing Buffered Image: S603>

In response to the buffering event, the event image manager 511 downsizes the buffering target image captured by the first camera 301 and / or the second camera 253 to a predetermined size. The event image is an image transmitted to the video server 291 through the LPWAN 270 when a shock event occurs. Therefore, if the size of the data is large due to the high resolution of the image, the transmission may be delayed or the transmission may fail. Therefore, it is desirable to reduce the data size by sufficiently downsizing the resolution of the buffered target image stored as a buffering event. For example, the event image management unit 511 downsizes the HD or FHD image captured by the first camera 301 and the second camera 253 to a WVGA (800 × 480) image, and the image buffer for the event. Can be stored on '.

Meanwhile, the buffering target image according to the buffering event may be determined as follows. (1) When the time point at which the buffering event occurs and the time point at which the first camera 301 and the second camera 253 are synchronized are synchronized, the buffering target image may be an image generated when the buffering event occurs. As described above, FIG. 8 illustrates a state in which a buffering event occurs and a photographing time point of the first camera 301 and the second camera 253 are synchronized.

(2) If the time point at which the buffering event occurs and the time point at which the first camera 301 and the second camera 253 are not synchronized is synchronized, the image to be captured in the shooting cycle immediately after the buffering event occurs. Can be. However, the buffering target event is not necessarily limited to the above (1) and (2), it is also possible to set the image taken after the buffering event occurs a few frames, as the buffering target image.

<Save buffering target image to memory: S605>

The event image manager 511 stores the downsized buffering target image in the event image buffer of the memory 501. In other words, the event image manager 511 may display an image of one frame photographed by the first camera 301 and an image of one frame photographed by the second camera 253 in the event image buffer of the memory 501. In addition, the FIFO method updates the 'image buffer for events' by deleting the oldest image.

In the example of FIG. 8, at time t3, the first buffer 501a and the fourth buffer 501d store the current buffering target images F3 and R3 in the first camera 301 and the second camera 253. In the second buffer 501b and the fifth buffer 501e, the images F2 and R2, which are buffered at the time t2 and stored in the first buffer 501a and the fourth buffer 501d, are transferred, and the third buffer ( 501c and the sixth buffer 501f transfer the buffered images F1 and R1 at the time point t1 two seconds ago. Images stored in the third buffer 501c and the sixth buffer 501f until the time t3 (the buffering target image three seconds ago) are deleted. Therefore, when it is time t3, the event image manager 511 transfers the image F1 stored in the second buffer 501b to the third buffer 501c and stores the image F2 stored in the first buffer 501a. ) Is moved to the second buffer 501b, and the current buffering target image F3 of the first camera 301 is stored in the first buffer 501a. In the same manner, the event image manager 511 transfers the image R1 previously stored in the fifth buffer 501e to the sixth buffer 501f, and transfers the image R2 previously stored in the fourth buffer 501d to the fifth buffer. After moving to 501e, the current buffering target image R3 of the second camera 253 is downsized and stored in the fourth buffer 501d. The event image manager 511 repeatedly performs a buffering event whenever the third set time comes, thereby updating the 'event image buffer' of the memory 501. As a result, images of three views are buffered in the event image buffer of the memory 501.

In the above manner, the buffering event of the event image manager 511 is performed.

If n = 2 is designed in Equation 1, if the event image buffer of the memory 501 includes five for the first camera and five for the second camera, the images at five viewpoints may be buffered.

Transmission of Buffered Event Video

Since the LPWAN 270 is very slow in transmission speed, the LPWAN 270 is not suitable for transmitting a large image file or video. It is very likely that the transmission will be very slow or that the transmission itself will fail. Therefore, in the present invention, instead of transmitting all of the images captured by the first camera 301 and the second camera 253, the event image buffered by the third set time unit is transmitted to the image server 291.

Hereinafter, referring to FIGS. 7 and 8, a method of transmitting an image through LPWAN according to an impact event will be described based on the operations of the event image manager 511 and the event processor 315.

<Storing and buffering the recorded image>

Regardless of the impact event generation, the operations of the image processor 311 and the event image manager 511 are repeatedly performed.

The image processor 311 first stores all images captured by the first camera 301 and / or the second camera 253 at a preset frame rate in the memory 501, and periodically generates a video file to generate an SD file. To the card 305. The event image management unit 511 performs a buffering event for each time point (t1, t2, t3, t4, t5) that is repeated at a third preset time interval and stores the buffering target image in the event image buffer of the memory 501. By doing so, the image buffer for the event is updated.

<Generation of event based on shock detection: S701>

Apart from the operations of the image processor 311 and the event image manager 511, the event processor 315 reads the sensor 251 periodically and aperiodically to sense shock. If a shock is detected, the event processor 315 generates a shock event. The shock detection, the generation of the shock event, and the event image storage of the event image manager 511 are simultaneously performed in parallel. In the example of FIG. 8, the sensor unit 251 detects a shock at a time point tx and a shock event occurs.

<Wait until arrival for the third set time immediately after the shock event: S703>

The event processing unit 315 waits until the time point repeated at the third set time interval arrives (n + 1) times in order to further store an image captured after the impact event in the image buffer for the event. The event image manager 511 further buffers the image for the event. 7 is a case where n = 1 is designed based on FIGS. 3 and 5, so that the second set time waits as much as the third set time arrives through steps S703 and S705.

When the shock event occurs, the event processing unit 315 waits for the arrival of the third set time during which the event image management unit 511 is counting. In FIG. 8, since there was an impact event at time tx, the event processing unit 315 waits until t3, which is the point where the next third set time is repeated again. Since the event image manager 511 has reached the third set time being counted, the event image manager 511 performs a buffering event at t3 to buffer the current images F3 and R3. According to the FIFO, only the images F2 and R2 buffered in the previous t2 buffering event and the images F1 and R1 buffered in the t1 buffering event are maintained.

<Additional wait until the next third set time arrives: S705>

After step S703, the event processing unit 315 waits further until the third set time during which the event image management unit 511 is counting arrives again. In FIG. 8, the event processing unit 315 that waits until t3 counts the third set time again and waits until t4. When t4 is reached, the event image manager 511 buffers the new images F4 and R4 again. Only the images F2 and R2 and F3 and R3 buffered in the previous t2 and t3 buffering events are retained, and the buffered images F1 and R1 are deleted at the time t1.

<Send image stored in image buffer for event to video server: S707>

After waiting for steps S703 and S705, the event processing unit 315 stores the six images F3, F4, F5, R3, R4, and R5 stored in the event image buffer of the memory 501 as individual units. Upload to a preset storage folder (eg, 291a). The event processor 315 separately transmits six images to the service terminal 230 and requests the LPWAN interface unit 231 to transmit them to the image server 291. The reason for delivering the six images separately is to increase the success rate of image transmission as the LPWAN 270 is slow. For example, even if the image transmission fails, only the transmission of the image fails. This is because if a transmission failure occurs while transmitting three data in total or six data in total, the entire data must be transmitted again.

In this case, the six images F3, F4, F5, R3, R4, and R5 uploaded to the first storage folder 291a are preferably given a name in a predetermined format to distinguish the image server 291. For example, the name of the uploaded image includes at least an identifier for distinguishing the first camera from the second camera and information for distinguishing the buffered order, thereby allowing the image server 291 to display six images F3 and F4. , F5, R3, R4, and R5) may be divided into a first camera and a second camera and arranged again in the buffered order.

<Send Upload Report: S709>

The event processing unit 315 transmits the upload report to the service server 293 after transmitting the image to the video server 291 in step S707. The upload report includes information on whether the uploaded image is stored during parking or driving, the UEL and user ID of the first storage folder 291a of the video server 291, the black box identification number (Id), and the impact event. Time and the like.

Upload of the image file is performed in the above manner.

If the event image buffer of the memory 501 includes five for the first camera and five for the second camera, the event processing unit 315 waits for the third set time twice in step S705 to after the shock event. The images of two viewpoints are further buffered and uploaded to the image server 291.

Shock Event Notification to User Terminal

The image server 291 combines the six images F3, F4, F5, R3, R4, and R5 uploaded in operation S707 into a video for the first camera by combining the images for the first camera F3, F4, and F5. The images for the second camera (R3, R4, R5) are combined into a video for the second camera.

The service server 293 notifies the user terminal 295 that the shock event has occurred according to the 'upload report' provided in step S709, and provides the UAL, etc. of the storage folder 291a. The user terminal 295 may check the situation at the time of the impact by connecting to UAL and confirming the video for the first camera or the video for the second camera.

While the above has been shown and described with respect to preferred embodiments of the invention, the invention is not limited to the specific embodiments described above, it is usually in the technical field to which the invention belongs without departing from the spirit of the invention claimed in the claims. Various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

Claims (13)

In the black box terminal is installed in the vehicle and connected to the sensor unit for detecting the vibration of the vehicle,
A start monitoring unit for monitoring a starting state of the vehicle;
An event processor for generating a shock event and transmitting an image recorded in a memory or a storage medium to a video server through a low power broadband network (LPWAN) when the shock event exists; And
An event image management unit for storing the image generated at a point in time repeated at a third set time interval among the images generated by the camera in a buffer having a predetermined size in the memory in a first-in first-out manner;
The third set time is a value larger than the shooting period of the camera,
The event processing unit generates the shock event if the vibration detected by the sensor unit is at a reference intensity or more ('shock event-preliminary state') when the vehicle is not started within the first set time, when the vehicle is not started within the first set time. If the start-up within the first set time does not generate the shock event,
When there is the shock event, the image transmitted by the event processing unit to the video server is an image recorded in the buffer, the video server combines the image provided by the event processing unit into a video box terminal.
The method of claim 1,
The event processing unit does not generate the shock event when the vehicle is turned off within a first preset time before the shock event-prepared state becomes the 'shock event-prepared state' while the vehicle is started. Black box terminal, characterized in that.
delete The method of claim 1,
And the event image manager downsizing the image to be recorded in the buffer and recording the image in the buffer to reduce the size of the image transmitted by the event processor to the image server.
The method of claim 4, wherein
The buffer is a size to store p images generated by the camera,
p = m (2n + 1), m is the number of the camera, n is a black box terminal, characterized in that the positive integer.
The method of claim 5,
The event processing unit,
Storing the image after the shock event in the buffer by waiting until the shock event is repeated by the third set time interval (n + 1) and then transmitting the image to the video server. Characterized in a black box terminal.
The method of claim 1,
The event processing unit uploads the image of the buffer to a predetermined URL of the video server, and then provides the service server with an upload report that records the URL, so that the service server sends a user report according to the upload report. Black box terminal, characterized in that for notifying the UAL.
In the image providing method of the black box terminal,
Detecting a vibration caused by an impact applied to the vehicle through a sensor unit installed in the vehicle and monitoring a starting state of the vehicle;
If the vibration detected by the sensor unit is at a reference intensity or more ('shock event-preliminary state') while the vehicle is turned off, a shock event is generated if the vehicle is not started within a first setting time, and the first setting is performed. Not generating the shock event if it is started within time;
Transmitting an image recorded in a memory or a storage medium to a video server through a low power broadband network (LPWAN) when the shock event occurs; And
Storing an image generated at a point in time repeated at a third set time interval among the images generated by the camera in a first-in first-out method in a buffer having a predetermined size in the memory (the third set time is greater than a shooting period of the camera Value),
The transmitting of the video server to the video server may include transmitting an image recorded in the buffer to the video server through the low power broadband network in individual units when the shock event occurs.
The method of claim 8,
Generating the shock event,
When the vehicle is in the 'shock event-prepared state' while starting the vehicle, the shock event is not generated when the start is turned off within a first preset time before the 'shock event-prepared state' Image providing method of the black box terminal.
delete The method of claim 8,
The first-in, first-out method of storing in the buffer may include:
Downsizing the image to be recorded in the buffer and recording the image in the buffer to reduce the size of the image transmitted to the video server according to the impact event.
The method of claim 11,
The buffer is a size to store p images generated by the camera,
p = m (2n + 1), m is the number of cameras, and n is a positive integer.
The method of claim 12,
The step of transmitting to the video server,
And storing the image after the shock event in the buffer by waiting for the shock event to be repeated (n + 1) times when the shock event is repeated at the third set time interval. Image providing method of the black box terminal, characterized in that the transmission to.

Images