KR102529609B1 - System for offering driving status of personal mobility - Google Patents

Abstract

The present invention relates to a personal mobility driving condition providing system, and more particularly, to a personal mobility driving condition providing system that obtains various contents based on a user while driving through personal mobility and provides the acquired contents to the user.

Description

Personal mobility driving status providing system {SYSTEM FOR OFFERING DRIVING STATUS OF PERSONAL MOBILITY}

The present invention relates to a personal mobility driving state providing system, and more particularly, to a personal mobility driving state providing system that obtains various user-based contents while driving through personal mobility and provides the obtained contents to the user .

Recently, supply of personal mobility (PM), such as an electric wheel, an electric kickboard, an electric bicycle, and a micro electric vehicle, as a means of transportation using electric energy is increasing.

In addition, in the field of personal mobility, interest in sharing economy, which allows multiple users to share and use it, is increasing, and personal mobility related services are provided.

For example, in the case of an electric kickboard, a mobility code (QR code) placed in a specific area is tagged and recognized with a user's mobile terminal, and charging is made according to the moving distance or time so that it can be shared.

However, the electric kickboard is a compact mobility, and although it can drive on various passageways including narrow alleys as well as roads, there is a problem in that it is used only as a means of transportation and cannot generate and provide various contents to users during use.

Republic of Korea Patent No. 10-2117983 Republic of Korea Patent No. 10-2132411

SUMMARY OF THE INVENTION The present invention is intended to solve the above problems, and provides a personal mobility driving state providing system that acquires various user-based contents while driving through personal mobility and provides the acquired contents to the user.

To this end, the personal mobility driving state providing system according to the present invention includes a video camera mounted on the personal mobility and photographing the surroundings; a vibration sensor for detecting vibration of the personal mobility during driving; a road surface monitoring module for extracting a road surface condition by analyzing the detected value of the vibration sensor; a route tracking module for tracking a driving route by analyzing location information of the personal mobility; A communication module for short-range wireless communication with a user's mobile terminal; and a mobility controller providing the captured image, road surface conditions, and driving route to the user's mobile terminal.

At this time, the video camera preferably includes a front camera for photographing the front of the personal mobility.

In addition, an angle adjuster for adjusting the tilting angle of the front camera; And a zoom adjuster for adjusting a zoom lens of the front camera; further comprising, wherein the mobility controller receives an adjustment signal from the user's mobile terminal to adjust the tilting angle and zoom of the front camera desirable.

In addition, the video camera includes a side camera for photographing the side of the personal mobility; and a rear camera for photographing the rear of the personal mobility; It is preferable to further include at least any one or more of them.

In addition, the road surface monitoring module may extract the road surface condition by analyzing at least one of a vibration magnitude and a vibration occurrence interval of the vibration sensor.

In addition, a posture sensor for detecting a posture of the personal mobility while driving; and a correction module for correcting an image captured by the video camera by referring to detection values of at least one of the vibration sensor and the posture sensor.

In addition, an illuminance sensor for measuring the brightness of the road surface on which the personal mobility is driving; and a route evaluation module that evaluates a travel route of the personal mobility; wherein the route evaluation module includes a distance from a starting point to a destination and an average driving speed of the personal mobility read by the route tracking module, and the illuminance sensor It is preferable to evaluate the path traveled by the personal mobility by combining the brightness information of the road surface detected through and the road surface condition read by the road surface monitoring module.

In addition, it is preferable to further include an artificial intelligence module that analyzes the image captured by the video camera to detect protrusions or grooves on the road, and automatically decelerates or stops the personal mobility when the protrusions or grooves are detected. At this time, the artificial intelligence module may include a learned judgment model to determine the road surface, protrusion or groove in a normal state through a machine learning technique.

In addition, it is preferable to further include a radio wave measurement module for receiving a mobile communication signal of a commercial network while the personal mobility is driving, measuring radio wave intensity, and recording the radio wave intensity in a database together with measurement time and location information.

The present invention as described above makes it possible to provide various contents, including surrounding images taken while driving through personal mobility, road surface conditions that can be provided to other sharing users, optimal routes or driving environments that can reach destinations, and commercial network propagation characteristics. .

1 is an application example of a personal mobility driving state providing system according to the present invention.
2 is a block diagram of a personal mobility driving state providing system according to the present invention.
3 is an example of applying the personal mobility driving state providing system according to the present invention to an electric kickboard.
4 is a configuration diagram showing the sensor module of the present invention.
5 shows a map provided by the route tracking module of the present invention.
6 is a configuration diagram showing a front camera of the present invention.
7 is a configuration diagram showing the route evaluation module of the present invention.

Hereinafter, a personal mobility driving state providing system according to a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

However, hereinafter, an electric kickboard is described as personal mobility (PM) as an example, but personal mobility to which the present invention can be applied may include other shareable electric wheels, electric bicycles, and micro electric vehicles.

As shown in FIG. 1, the personal mobility driving state providing system 100 according to the present invention is installed in the electric kickboard 10 as an embodiment, and provides various contents including images taken while driving to the mobile terminal 20 of the user. to provide.

The mobile terminal 20 receiving the content may upload the content to social media 30 such as VLOG (Video + Blog). Uploaded video content may also include location information received from the GPS satellites 40 .

In addition, various contents may be uploaded and stored in the management server 50 provided at the sharing service provider side of the personal mobility 10, and the user may download the corresponding contents after logging in with his/her account.

To this end, as shown in FIG. 2, the personal mobility driving state providing system 100 according to the present invention includes a video camera 110, a sensor module 120, a road monitoring module 130, a route tracking module 140, and a communication module ( 150) and a mobility controller 160.

Here, the video camera 110 includes a front camera 111 to photograph the surroundings while the personal mobility 10 is driving. In addition, the video camera 110 may further include any one or more of a rear camera 112 and a side camera 113 in addition to the front camera 111 .

The sensor module 120 is for analyzing a personal mobility driving state and includes a vibration sensor 121 . In addition, the sensor module 120 may further include a posture sensor 122 and an illuminance sensor 123, and the posture sensor 122 and the illuminance sensor 123 are integrated with the vibration sensor 121 in the sensor module 120. can be provided as

In addition, as another preferred embodiment, at least one of the correction module 170, the path evaluation module 180, the artificial intelligence module 190a, and the radio wave measurement module 190b may be further included, and the system including the memory 161 It can also contain many other configurations required for deployment.

As shown in FIG. 3, the present invention provides user-based video content by photographing the front with the front camera 111, and, if necessary, images of the rear and side cameras respectively photographed through the rear camera 112 and the side camera 113. provided together.

Accordingly, the front camera 111 and the side camera 113 are installed on the front and side of the box-type mobility controller 160, respectively, and the rear camera 112 is installed on the rear of the vehicle body to prevent being covered by the occupant (user). It can be.

As shown in FIG. 4 , the sensor module 120 includes a vibration sensor 121 . The vibration sensor 121 together with the road surface monitoring module 130 provides road surface information such as whether the road surface is flat or heavily uneven. In addition, the vibration sensor 121 may be used to correct an image captured by the video camera 110 together with the posture sensor 122 and the correction module 170 .

The illuminance sensor 123, together with the path evaluation module 180, applies weights to the road surface condition information, the path condition information, and the illuminance information, respectively, and then combines the resultant values to provide evaluation information on the path traveled by the user.

The artificial intelligence module 190a performs machine learning on the captured images to monitor speed bumps, construction sites, or pine grooves on the road surface along the driving route to ensure safe driving.

The radio wave measurement module 190b receives radio waves from a commercial network (eg, 4G/LTE, 5G) on a driving route on the electric kickboard 10 and measures reception environments such as the size of radio waves. The measured value may be provided to a commercial network provider or the like.

Accordingly, the present invention makes it possible to provide various contents, including surrounding images captured while driving on the personal mobility 10, detected road surface conditions, optimal routes among routes to reach destinations, and commercial network propagation characteristics.

More specifically, the video camera 110 is mounted on the personal mobility 10 (hereinafter, referred to as 'electric kickboard') to take pictures of the surroundings. The captured image may be stored and provided as either a still image or a moving image.

This video camera 110 includes a front camera 111. In addition, the video camera 110 further includes any one or more of a rear camera 112 or a side camera 113, and preferably includes all of the front, rear and side cameras 111 to 113 to photograph all directions. do.

These video cameras 110 are installed in each part of the electric kickboard. The electric kickboard 10 has a handle or operating device 11 on the upper part of the vehicle body, and the driving control module 12 controls driving according to a user's operation. In addition, wheels (W-F, W-B) are provided at the front and rear of the footrest 13, respectively, and are driven by a battery and a motor.

Among them, the front camera 111 is installed in the front part of the mobility controller 160 as an embodiment. The mobility controller 160, which will be described again below, is usually fixed in a box type in the center between the left and right handles or the operating device 11, and a code (eg, QR code) is provided on the upper surface.

The rear camera 112 is installed at the rear of the body of the electric kickboard 10 so that the user can take a picture of the rear even when riding. For example, the rear wheel (W-B) upper cover is installed so that the shooting angle faces the rear.

Like the front camera 111, the side camera 113 is installed in the box of the mobility controller 160 and is installed to look in both directions, respectively. Here, the lateral direction is a direction looking toward the handle 11 perpendicular to the driving direction.

An image captured by the video camera 110 is provided to the user's mobile terminal 20 through the communication module 150 . The image provided in this way is image content obtained by photographing the route traveled by the user, and may be shared according to the user's selection.

The sensor module 120 detects the driving state of the electric kickboard 10, and the driving state detected by the sensor module 120 may include vibration caused by the road surface generated during driving. In addition, as will be described later, the posture of the electric kickboard 10 can also be sensed by the sensor module 120.

The sensor module 120 may be installed at a location optimized for measuring a sensing value among the electric kickboards 10, and as shown, several sensors of different types may be modularized in one package.

In an embodiment, the sensor module 120 includes a vibration sensor 121 . The sensing value detected by the vibration sensor 121 is provided to the road monitoring module 130 under the control of the mobility controller 160 . The road surface monitoring module 130 analyzes the detected value of the vibration sensor 121 to extract the road surface condition.

For example, the road surface monitoring module 130 extracts the road surface condition by analyzing at least one of the amplitude of vibration and interval between occurrences of vibration detected by the vibration sensor 121 . If the vibration is large and the vibration generation interval is uneven, it may be determined that the road surface condition is not good. The judgment result can be shared for other users as road surface information, which is a kind of content.

In addition, the road surface monitoring module 130 may apply weights to each of the maximum amount of vibration, the minimum amount of vibration, and the average amount of vibration to detect the road surface condition, and then may additionally reflect the weight when calculating the road surface condition information.

The path tracking module 140 analyzes the location information of the electric kickboard 10 to track the driving path. The driving route of the personal mobility 10 can be read by sequentially listing the location information received from the GPS communication module (not shown) from departure to arrival time.

Alternatively, the location information of the electric kickboard 10 may be provided by a triangulation technique or by using an accelerometer and a gyro sensor (direction sensor) mounted therein while maintaining communication with various base stations.

As shown in FIG. 5 , the path of the personal mobility 10 extracted by the path tracking module 140 may be displayed and provided on a map. In this case, the location information may be provided to the mobile terminal 20 as driving information content along with a captured image.

The communication module 150 performs short-range wireless communication with the user's mobile terminal 20 . For short-distance wireless communication, a Bluetooth module that performs wireless communication with the mobile terminal 20 according to a typical Bluetooth communication protocol may be applied.

Specifically, Bluetooth Low Energy may be applied to the communication module 150 to minimize battery consumption of mobility, and when the mobile terminal 20 is a smartphone owned by the user, a terminal supporting Bluetooth 4.0 is required. can

The purpose of this short-distance wireless communication function is to transmit content generated while driving to remote servers 30 and 50 through the mobile terminal 20 possessed by the user.

Since the current communication environment provided by the electric kickboard 10 only transmits mobility ID and location information or is vulnerable to shadow areas, instead of transmitting data itself, the user's mobile terminal 20 relays all.

To this end, a cradle (HL) for mounting a mobile terminal 20 such as a smartphone is further included on the upper surface of the control box in which the mobility controller 160 is mounted, and is used for communication while the mobile terminal 20 is mounted.

Accordingly, various contents including captured images are provided and stored in the remote servers 30 and 50 through the mobile terminal 20 . The server includes a social media 30 server such as VLOG, and other shared mobility management servers 50 may also be included.

The mobility controller 160 provides the captured image, the road surface condition, and the driving route to the user's mobile terminal 20 . Specifically, the mobility controller 160 controls generation of various contents while the electric kickboard 10 is driving, and provides the generated contents to the mobile terminal 20 of the user.

The driving control module 12 may also be mounted on the mobility controller 160 . The driving control module 12 is an operating device that controls the driving of the mobility according to a user's operation command, and may be provided together with the mobility controller 160 in a control box or integrally mounted in one chipset.

Meanwhile, as described above, the front camera 111 may upload the captured image to social media 30 such as VLOG through the mobile terminal 20 of the user (passenger). The uploaded image content may also include location information of the GPS satellite 40 .

At this time, in order to provide a captured image based on the user, the front camera 111 further includes an angle adjuster 111a for adjusting a tilting angle and a zoom adjuster 111b for adjusting a zoom lens. In addition, the mobility controller 160 receives an adjustment signal from the user's mobile terminal 20 and adjusts the tilting angle and zoom of the front camera 111 .

As shown in FIG. 6 , the angle adjuster 111a includes, as an embodiment, a rotational unit in which the front camera 111 is rotated, and a small motor for operating the rotational unit. The small motor receives operating power supplied from the battery (BAT) through a DC-AC inverter.

The zoom controller 111b is provided in the front camera 111 and controls a zoom lens capable of zooming according to forward and backward movement. The zoom lens is operated forward and backward by a motor to perform zoom control (zoom-in/zoom-out).

The tilting angle and zoom adjustment are performed by tagging the code (QR code) provided on the upper surface of the mobility controller 160 to register the use of the electric kickboard 10, and then the adjustment signal transmitted from the mobile terminal 20 It is executed in the mobility controller 160 according to.

To this end, an application (app) is installed in the mobile terminal 20 . In addition, the adjustment signal generated by the application is transmitted to the communication module 150 (BLE_B) of the present invention through the Bluetooth communication module 150 (BLE_M) mounted in the mobile terminal 20.

Accordingly, the tilting angle and/or zoom of the front camera 111 is adjusted according to the setting environment based on the user, such as the user's body size, driving environment, or the user's preferred setting value.

The posture sensor 122 detects the posture of the driving electric kickboard 10 . In addition, the correction module 170 corrects the image captured by the video camera 110 by referring to any one or more of the vibration sensor 121 and the attitude sensor 122 .

For example, the correction module 170 corrects that the image captured by the front camera 111 is shaken by vibration with the detection value of the vibration sensor 121, and the electric kickboard 10 while driving with the detection value of the posture sensor 122. ) corrects the tilted image by the posture. That is, the correction module 170 performs shake correction and posture correction using an image processing method.

Image quality is improved through shake correction and posture correction in the correction module 170 . The corrected image is provided to the user. Therefore, it is possible to provide high-quality images even when shaking or tilting posture during driving.

However, the correction module 170 may be provided in the electric kickboard 10 itself, but it may also be mounted in the remote management server 50. In this case, the captured image and sensing values are transmitted together to be corrected in the server work can be done.

The illuminance sensor 123 measures the brightness of the road surface on which the electric kickboard 10 is running, and the path evaluation module 180 evaluates the driving path of the electric kickboard 10 including the detection value of the illuminance sensor 123. .

As shown in FIG. 7 , the evaluation of the driving route does not simply infer the condition of the road surface, but comprehensively reflects the time taken for various routes from the starting point to the destination and the lighting condition applied to the road surface.

To this end, the distance traveled by the electric kickboard 10 (distance from the starting point to the destination) and average driving speed, the brightness of the road surface detected through the illuminance sensor 123, and the road surface condition read by the road surface monitoring module 130 To evaluate the travel path of the electric kickboard (10).

At this time, the distance and average driving speed from the starting point to the destination may be provided from the above-described route tracking module 140, and the detection value of the illuminance sensor 123 is provided together with time information by the timer Ti. It can read whether the lighting condition is appropriate for each time of day (eg, daytime or nighttime).

The information evaluated in this way is provided to the user of the electric kickboard 10, which is a personal mobile, as well as to sharing users other than the current user, so that a path with a good evaluation can be selected. Preferably, personal information can be protected when sharing the content created as above.

Returning to FIG. 2, the artificial intelligence module 190a performs machine learning on the front image captured by the video camera 110 to determine whether there are protrusions or grooves on the road, and detects protrusions or grooves When the electric kickboard (10) is automatically decelerated or stopped.

In addition, the suspension of the electric kickboard 10 may be automatically adjusted. For example, in the case of the electric kickboard 10 equipped with a cylinder-type suspension, the amount of shock absorption according to obstacle driving may be adjusted by adjusting the operating hydraulic pressure (or pneumatic pressure).

Machine learning is to classify unstructured data such as images captured through the front camera 111, and through machine learning, various obstacles, hazards, or speed bumps that may exist on the road (road) are distinguished from surrounding objects.

Such machine learning may apply an artificial neural network to classify obstacles on the road surface from several comparable reference images (data).

For example, a plurality of blocks are sequentially arranged by a recurrent neural network (RNN), and feature points are extracted by applying a convolutional neural network (CNN) to the blocks, and obstacles are classified therefrom. .

Therefore, the present invention can reduce the speed or automatically stop according to the result read from the image, so that the user can be protected from dangers caused by not only protrusions such as bumps, but also pitted grooves and sinkholes while driving. You can also adjust the suspension to improve ride comfort while driving.

The radio wave measurement module 190b receives a mobile communication signal of a commercial network while the personal mobility 10 is driving, measures radio wave intensity, and records the radio wave intensity in a database together with measurement time and location information.

The database may be built as a server's own data store, a separately built database, or various memory devices, and this data store may include the user's mobile terminal 20 or the shared mobility provider's management server 50.

The measured radio wave environment refers to the radio wave environment of a band that provides communication services to smartphone subscribers in commercial networks such as 4G/LTE and 5G. The radio wave environment observed while riding an electric kickboard can be provided to commercial network service providers. .

In the above, specific embodiments of the present invention have been described in detail. However, the spirit and scope of the present invention is not limited to these specific embodiments, but those skilled in the art can make various modifications and variations without changing the gist of the present invention. You will understand when you grow up.

Therefore, since the embodiments described above are provided to completely inform those skilled in the art of the scope of the invention to which the present invention pertains, it should be understood that it is illustrative and not limiting in all respects, The invention is only defined by the scope of the claims.

110: video camera 111: front camera
111a: angle adjuster 111b: zoom adjuster
112: rear camera 113: side camera
120: sensor module 121: vibration sensor
122: posture sensor 123: illuminance sensor
130: road monitoring module 140: path tracking module
150: communication module 160: mobility controller
170: correction module 180: path evaluation module
190a: artificial intelligence module 190b: radio wave measurement module
10: electric kickboard 20: mobile terminal (smartphone)
30: social media 40: GPS satellites
50: management server

Claims (6)

a vibration sensor 121 that detects vibration of the personal mobility 10;
a road monitoring module 130 for extracting a road surface condition by analyzing the detected value of the vibration sensor 121;
a route tracking module 140 for tracking a driving route by analyzing location information of the personal mobility 10;
A communication module 150 that performs short-range wireless communication with the user's mobile terminal 20;
a mobility controller 160 providing the user's mobile terminal 20 with road surface conditions and driving routes;
a path evaluation module 180 that evaluates a driving path of the personal mobility 10; and
An illuminance sensor 123 for measuring the brightness of the road surface on which the personal mobility 10 is driving;
The road surface monitoring module 130 analyzes any one or more of the vibration magnitude and the vibration occurrence interval to extract the road surface condition,
The route evaluation module 180 transmits the driving route tracked by the route tracking module, the road surface condition read by the road surface monitoring module 130, and the brightness information of the road surface detected through the illuminance sensor 123. Personal mobility driving state providing system, characterized in that for evaluating the path traveled by the personal mobility (10) by combining. delete delete an illuminance sensor 123 for measuring the brightness of the road surface on which the personal mobility 10 is driving;
a route tracking module 140 for tracking a driving route by analyzing location information of the personal mobility 10;
a path evaluation module 180 that evaluates a driving path of the personal mobility 10;
A communication module 150 for short-range wireless communication with the user's mobile terminal 20; and
A mobility controller 160 providing road surface conditions and driving routes to the user's mobile terminal 20;
The path evaluation module 180,
The distance and average traveling speed from the departure point to the destination of the personal mobility 10 read by the route tracking module 140;
Personal mobility driving state providing system, characterized in that for evaluating the path traveled by the personal mobility (10) by combining the brightness information of the road surface detected through the illuminance sensor (123). According to claim 4,
a vibration sensor 121 for detecting vibration of the personal mobility 10 while driving;
Further comprising a road surface monitoring module 130 for extracting a road surface condition by analyzing the detected value of the vibration sensor 121,
The path evaluation module 180,
The personal mobility driving state providing system, characterized in that the path traveled by the personal mobility 10 is evaluated by further combining the road surface conditions read by the road surface monitoring module 130. delete

Images