KR20220040426A - System for offering driving status of personal mobility - Google Patents

Abstract

The present invention relates to a personal mobility driving state providing system. In particular, through personal mobility, user-based various contents are acquired while driving, and the acquired contents are provided to the user. The personal mobility driving state providing system includes a vibration sensor, a road surface monitoring module, a route tracking module, a communication module, and a mobility controller.

Description

SYSTEM FOR OFFERING DRIVING STATUS OF PERSONAL MOBILITY

The present invention relates to a personal mobility driving state providing system, and more particularly, to a personal mobility driving state providing system that obtains various contents based on a user while driving through personal mobility and provides the obtained contents to a user. .

Recently, as a means of transportation using electric energy, the supply of personal mobility (PM) such as electric wheels, electric kickboards, electric bicycles, and micro electric vehicles is increasing.

In addition, interest in the sharing economy that allows multiple users to share and use it in the field of personal mobility is also increasing, and related personal mobility-related services are being provided.

For example, in the case of an electric kickboard, a code (QR code) of mobility arranged in a specific area is tagged and recognized by the user's mobile terminal, and it can be shared by charging according to the moving distance or time.

However, as a small mobility, the electric kickboard is used only as a means of transportation even though it can travel on various passages including narrow alleys as well as roads.

Republic of Korea Patent Registration No. 10-2117983 Republic of Korea Patent Registration No. 10-2132411

An object of the present invention is to provide a system for providing a personal mobility driving state that obtains various contents based on a user while driving through personal mobility and provides the obtained contents to the user in order to solve the above problems.

To this end, the personal mobility driving state providing system according to the present invention includes: an image camera mounted on personal mobility to photograph the surroundings; a vibration sensor that detects vibration of the personal mobility while driving; a road surface monitoring module for extracting a road surface condition by analyzing the detection value of the vibration sensor; a route tracking module for tracking a driving route by analyzing the location information of the personal mobility; a communication module for short-range wireless communication with the user's mobile terminal; and a mobility controller that provides the captured image, a road surface condition, and a driving route to the user's mobile terminal.

In this case, the video camera may include a front camera for photographing the front of the personal mobility.

In addition, the angle adjuster for adjusting the tilt angle of the front camera; and a zoom controller for adjusting a zoom lens of the front camera, wherein the mobility controller receives an adjustment signal from the user's mobile terminal to adjust the tilt angle and zoom of the front camera desirable.

In addition, the video camera may include: a side camera for photographing a side of the personal mobility; and a rear camera for photographing the rear of the personal mobility. It is preferable to further include at least any one or more of.

In addition, it is preferable that the road surface monitoring module extracts the road surface condition by analyzing any one or more of the vibration magnitude and the vibration generation interval of the vibration sensor.

In addition, a posture sensor for detecting a posture while driving of the personal mobility; and a correction module for correcting the image captured by the video camera with reference to the detection value of any one or more of the vibration sensor and the posture sensor.

In addition, the light sensor for measuring the brightness of the road surface on which the personal mobility is driving; and a path evaluation module for evaluating the driving path of the personal mobility; wherein the path evaluation module includes a distance and an average driving speed from the source to the destination of the personal mobility read by the path tracking module, and the illuminance sensor It is preferable to evaluate the path traveled by the personal mobility by combining the brightness information of the road surface detected through , and the road surface condition read by the road surface monitoring module.

In addition, it is preferable to further include; an artificial intelligence module that analyzes the image captured by the video camera to detect a protrusion or groove on the road, and automatically decelerates or stops the personal mobility when the protrusion or groove is detected. In this case, the artificial intelligence module may include a judgment model learned to determine a road surface, a protrusion, or a groove in a steady state through a machine learning technique.

In addition, it is preferable to further include a radio wave measurement module for receiving the mobile communication signal of the commercial network while driving the personal mobility, measuring the radio wave strength, and recording the radio wave strength in a database together with the measurement time and location information.

The present invention as described above makes it possible to provide various contents including surrounding images captured while driving through personal mobility, road surface conditions that can be provided to other shared users, the optimal route or driving environment to reach the destination, and commercial network propagation characteristics. .

1 is an application example of a personal mobility driving state providing system according to the present invention.
2 is a block diagram of a system for providing a personal mobility driving state according to the present invention.
3 is an example in which the personal mobility driving state providing system according to the present invention is applied to an electric kickboard.
4 is a block diagram showing the sensor module of the present invention.
5 shows a map provided by the route tracking module of the present invention.
6 is a block diagram showing the front camera of the present invention.
7 is a block diagram showing a path evaluation module of the present invention.

Hereinafter, a personal mobility driving state providing system according to a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

However, hereinafter, an electric kickboard will be described as an example of personal mobility (PM), but personal mobility to which the present invention is applicable may include other shareable electric wheels, electric bicycles, and micro electric vehicles.

As shown in FIG. 1 , the personal mobility driving state providing system 100 according to the present invention is installed on the electric kickboard 10 as an embodiment, and various contents, including images captured while driving, are transmitted to the user's mobile terminal 20. to provide.

The mobile terminal 20 that has received the content may upload the content to the social media 30 such as a VLOG (Video + Blog). The uploaded image content may also include location information received from the GPS satellite 40 .

In addition, various contents may be uploaded and stored in the management server 50 provided on the shared service provider side of the personal mobility 10, and the user may log in to his/her account and download the corresponding contents.

To this end, as shown in FIG. 2 , the personal mobility driving state providing system 100 according to the present invention includes an image camera 110 , a sensor module 120 , a road surface monitoring module 130 , a route tracking module 140 , and a communication module ( 150 ) and a mobility controller 160 .

Here, the video camera 110 includes a front camera 111 to photograph the surroundings while the personal mobility 10 is driving. In addition, the video camera 110 may further include any one or more of the rear camera 112 and the side camera 113 in addition to the front camera 111 .

The sensor module 120 is for analyzing the personal mobility driving state and includes a vibration sensor 121 . In addition, the sensor module 120 may further include an attitude sensor 122 and an illumination sensor 123 , and the attitude sensor 122 and the illumination sensor 123 are integrated with the vibration sensor 121 in the sensor module 120 . can be provided as

In addition, as another preferred embodiment, the system may further include at least one of a correction module 170 , a path evaluation module 180 , an artificial intelligence module 190a and a radio wave measurement module 190b , and a memory 161 . It can also include several other configurations needed for deployment.

As shown in Figure 3, the present invention provides user-based image content by photographing the front with the front camera 111, and when necessary, the rear and side images are also photographed through the rear camera 112 and the side camera 113 provided together

Accordingly, the front camera 111 and the side camera 113 are installed in front and on the side of the box-type mobility controller 160, respectively, and the rear camera 112 is installed in the rear part of the vehicle body to prevent being obscured by the occupant (user). can be

4 , the sensor module 120 includes a vibration sensor 121 . The vibration sensor 121 provides road surface information, such as whether the road surface is flat or uneven, together with the road surface monitoring module 130 . In addition, the vibration sensor 121 may be used to correct an image captured by the image camera 110 together with the posture sensor 122 and the correction module 170 .

The illuminance sensor 123, together with the path evaluation module 180, adds weights to the road surface state information, the path state information, and the illuminance information, respectively, and combines the result values to provide evaluation information on the path the user has traveled.

The artificial intelligence module 190a performs machine learning on the photographed image and monitors the speed bumps, construction sites, or pine grooves existing on the road surface on the driving route to ensure safe driving.

The radio wave measurement module 190b receives radio waves from a commercial network (eg, 4G/LTE, 5G) on a driving route driven by the electric kickboard 10 and measures the reception environment such as the size of the radio waves. The measured value may be provided to a commercial network provider or the like.

Accordingly, the present invention makes it possible to provide various contents including surrounding images captured while riding the personal mobility 10, detected road surface conditions, optimal routes among routes to reach destinations, and commercial network propagation characteristics.

More specifically, the video camera 110 is mounted on the personal mobility 10 (hereinafter, referred to as an 'electric kickboard') to photograph the surroundings. The captured image may be stored and provided either a still image or a moving image.

The video camera 110 includes a front camera 111 . In addition, the video camera 110 further includes any one or more of the rear camera 112 or the side camera 113, and preferably includes all of the front, rear, and side cameras 111 to 113 to shoot all directions. do.

These video cameras 110 are installed in each part of the electric kickboard. The electric kickboard 10 includes a handle or a manipulation device 11 on the upper part of the vehicle body, and the driving control module 12 controls the driving according to the user's manipulation. In addition, wheels (W-F, W-B) are provided in front and rear of the footrest 13, respectively, and are driven by a battery and a motor.

Among them, the front camera 111 is installed in the front part of the mobility controller 160 as an embodiment. The mobility controller 160, which will be described again below, is usually fixedly installed in a box type in the center between the left and right handles or the manipulation device 11, and a code (eg, a QR code) is provided on the upper surface.

The rear camera 112 is installed at the rear of the vehicle body of the electric kickboard 10 so that the user can photograph the rear even when boarding. For example, in the upper cover of the rear wheel (W-B), the shooting angle is installed to face the rear.

The side camera 113 is installed in the box of the mobility controller 160 like the front camera 111 and is installed to face both directions. Here, the lateral direction is a direction facing the handle 11 in a direction perpendicular to the driving direction.

The image captured by the video camera 110 is provided to the user's mobile terminal 20 through the communication module 150 . The provided image as described above may be shared according to the user's selection as image content obtained by photographing a route traveled by the user.

The sensor module 120 detects the driving state of the electric kickboard 10 , and the driving state sensed by the sensor module 120 may include vibration caused by the road surface while driving. In addition, as will be described later, the posture of the electric kickboard 10 may also be detected by the sensor module 120 .

The sensor module 120 may be installed in a position optimized for measuring a sensing value of the electric kickboard 10 , and as shown, several sensors of different types may be modularized in one package.

In an embodiment, the sensor module 120 includes a vibration sensor 121 . The sensed value detected by the vibration sensor 121 is provided to the road surface monitoring module 130 under the control of the mobility controller 160 . The road surface monitoring module 130 extracts the road surface condition by analyzing the detection value of the vibration sensor 121 .

For example, the road surface monitoring module 130 extracts the road surface condition by analyzing one or more of the vibration magnitude detected by the vibration sensor 121 and the vibration generation interval. If the vibration is large and the interval between vibrations is uneven, it may be judged that the road surface condition is not good. The determination result may be shared for other users as road surface information, which is a type of content.

In addition, the road surface monitoring module 130 may add weights to each of the maximum vibration amount, the minimum vibration amount, and the average vibration amount to detect the road surface condition, and then additionally reflect the weight when calculating the road surface condition information.

The route tracking module 140 tracks the driving route by analyzing the location information of the electric kickboard 10 . The driving route of the personal mobility 10 may be read by sequentially arranging location information received from a GPS communication module (not shown) from departure to arrival time.

Alternatively, the location information of the electric kickboard 10 may be provided by a triangulation technique while maintaining communication with several base stations, or by using an acceleration sensor and a gyro sensor (direction sensor) mounted therein.

5 , the path of the personal mobility 10 extracted by the path tracking module 140 may be displayed and provided on a map. In this case, the location information may be provided to the mobile terminal 20 together with a captured image as driving information content.

The communication module 150 performs short-range wireless communication with the user's mobile terminal 20 . For short-distance wireless communication, a Bluetooth module performing wireless communication with the mobile terminal 20 according to a representative Bluetooth communication protocol may be applied.

Specifically, the communication module 150 may apply Bluetooth Low Energy to minimize battery consumption of mobility, and if the mobile terminal 20 is a smartphone possessed by the user, a terminal supporting Bluetooth 4.0 is required. can

This short-range wireless communication function aims to transmit content generated while driving to remote servers 30 and 50, etc. through the mobile terminal 20 possessed by the user.

Currently, the communication environment provided by the electric kickboard 10 only transmits the ID and location information of mobility or is vulnerable to the shaded area, so instead of transmitting data from itself, the user's mobile terminal 20 all.

To this end, the upper surface of the control box on which the mobility controller 160 is mounted further includes a cradle HL for mounting the mobile terminal 20 such as a smartphone, and is used for communication while the mobile terminal 20 is mounted.

Accordingly, various contents including the captured image are provided and stored to the remote servers 30 and 50 through the mobile terminal 20 . The server includes a social media 30 server such as VLOG, and other shared mobility management servers 50 may also be included.

The mobility controller 160 provides the captured image, the road surface condition, and the driving route to the user's mobile terminal 20 . Specifically, the mobility controller 160 controls the generation of various contents while the electric kickboard 10 is driving, and provides the generated contents to the user's mobile terminal 20 .

The driving control module 12 may also be mounted on the mobility controller 160 . The driving control module 12 is an operating device that controls the driving of mobility according to a user's manipulation command, and may be provided together with the mobility controller 160 in the control box or may be integrally mounted on one chipset.

Meanwhile, as described above, the front camera 111 may upload the captured image to the social media 30 such as VLOG through the mobile terminal 20 of the user (passenger). The uploaded image content may also include location information of the GPS satellite 40 .

In this case, in order to provide a user-based captured image, the front camera 111 further includes an angle adjuster 111a for adjusting a tilting angle and a zoom controller 111b for adjusting a zoom lens. In addition, the mobility controller 160 receives an adjustment signal from the user's mobile terminal 20 to adjust the tilt angle and zoom of the front camera 111 .

As shown in FIG. 6 , the angle adjuster 111a includes a rotating part installed to rotate the front camera 111 as an embodiment and a small motor operating the rotating part. The small motor receives the operating power supplied from the battery (BAT) through the DC-AC inverter.

The zoom controller 111b is provided in the front camera 111 and controls a zoom lens capable of zooming according to a forward and backward movement. The zoom lens is operated back and forth by a motor to adjust zoom (zoom-in/zoom-out).

Tilt angle and zoom adjustment is performed by tagging a code (QR code) provided on the upper surface of the mobility controller 160 for registration of use of the electric kickboard 10, and after interlocking with the adjustment signal transmitted from the mobile terminal 20 Accordingly, it is executed in the mobility controller 160 .

To this end, an application (app) is installed in the mobile terminal 20 . In addition, the adjustment signal generated by the application is transmitted to the communication module (150, BLE_B) of the present invention through the Bluetooth communication module (150, BLE_M) mounted on the mobile terminal (20).

Accordingly, the tilting angle and/or zoom of the front camera 111 is adjusted according to a user-based setting environment such as a user's body size, driving environment, or a user's preferred setting value.

The posture sensor 122 detects the posture of the electric kickboard 10 while driving. In addition, the correction module 170 corrects the image captured by the image camera 110 with reference to any one or more of the vibration sensor 121 and the posture sensor 122 .

For example, the correction module 170 corrects an image captured by the front camera 111 with a value detected by the vibration sensor 121 that is shaken due to vibration, and uses the value detected by the posture sensor 122 for the electric kickboard 10 while driving. ) corrects the tilted image by the posture. That is, the correction module 170 performs shake correction and posture correction by the image processing method.

Image quality is improved through shake correction and posture correction in the correction module 170 . The image corrected in this way is provided to the user. Accordingly, it is possible to provide a high-quality image even when shaking or tilted in posture while driving.

However, the correction module 170 may be provided in the electric kickboard 10 itself, but may be mounted on the remote management server 50. In this case, the captured image and the sensed value are transmitted together and corrected in the server. work can be done.

The illuminance sensor 123 measures the brightness of the road surface on which the electric kickboard 10 is running, and the path evaluation module 180 evaluates the driving path of the electric kickboard 10 including the detection value of the illuminance sensor 123 .

As shown in FIG. 7 , the evaluation of the driving route does not simply infer the condition of the road surface, but comprehensively reflects the review of the time taken for various routes from the starting point to the destination and the lighting condition applied to the road surface.

To this end, the distance traveled by the electric kickboard 10 (distance from the starting point to the destination) and the average running speed, the brightness of the road surface detected through the illuminance sensor 123, and the road surface condition read by the road surface monitoring module 130 To evaluate the driving path of the electric kickboard 10 by summarizing.

At this time, the distance from the starting point to the destination and the average driving speed may be provided from the above-described route tracking module 140 , and the detection value of the illuminance sensor 123 is provided together with time information by the timer Ti. It is possible to read whether the lighting conditions are appropriate for each time period (eg day or night).

The evaluated information is provided to the user of the electric kickboard 10, which is a personal mobility, as well as to other shared users other than the current user, so that a good evaluation path can be selected. Preferably, when sharing the content generated as above, personal information can be protected.

2, the artificial intelligence module 190a performs machine learning on the front image captured by the video camera 110 to determine whether a protrusion or groove exists on the road, and detects the protrusion or groove. When the electric kickboard 10 is automatically decelerated or stopped.

In addition, the suspension of the electric kickboard 10 may be automatically adjusted. For example, in the case of the electric kickboard 10 equipped with a cylinder-type suspension, it is possible to adjust the amount of shock absorption according to obstacle driving by adjusting the operating hydraulic pressure (or pneumatic pressure).

Machine learning classifies unstructured data such as images taken through the front camera 111, and through machine learning, various obstacles, dangerous objects, or speed bumps that may exist on the road surface (road) are distinguished from the surrounding objects.

Such machine learning can apply artificial neural networks to classify obstacles on the road surface from several comparable reference images (data).

For example, a plurality of blocks are sequentially arranged by a recurrent neural network (RNN), and feature points are extracted by applying a convolutional neural network (CNN) thereto, and obstacles are classified therefrom. .

Accordingly, the present invention enables the user to be protected from dangers caused by not only protruding bumps while driving, but also fine grooves or sinkholes, by forcing the speed to be reduced or automatically stopped according to the result read from the image. You can also adjust the suspension to improve ride comfort while driving.

The radio wave measurement module 190b receives the mobile communication signal of the commercial network while the personal mobility 10 is driving, measures the radio wave strength, and records the radio wave strength in the database together with the measurement time and location information.

The database may be constructed as a data storage of the server itself, a separately constructed database, or various memory devices, and such data storage may include the user's mobile terminal 20 or the management server 50 of the shared mobility provider.

The measured radio wave environment means the radio wave environment of the band that provides communication services to smartphone subscribers in commercial networks such as 4G/LTE and 5G, and the radio wave environment observed while riding an electric kickboard can be provided to commercial network service providers. .

In the above, specific embodiments of the present invention have been described above. However, the spirit and scope of the present invention is not limited to these specific embodiments, and various modifications and variations can be made within the scope that does not change the gist of the present invention. You will understand when you grow up.

Therefore, since the embodiments described above are provided to fully inform those of ordinary skill in the art to which the present invention belongs the scope of the invention, it should be understood that they are exemplary in all respects and not limiting, The invention is only defined by the scope of the claims.

110: video camera 111: front camera
111a: angle adjuster 111b: zoom adjuster
112: rear camera 113: side camera
120: sensor module 121: vibration sensor
122: attitude sensor 123: illuminance sensor
130: road surface monitoring module 140: path tracking module
150: communication module 160: mobility controller
170: correction module 180: path evaluation module
190a: artificial intelligence module 190b: radio wave measurement module
10: electric kickboard 20: mobile terminal (smartphone)
30: social media 40: GPS satellite
50: management server

Claims (6)

a vibration sensor 121 for detecting vibration of the personal mobility 10;
a road surface monitoring module 130 for extracting a road surface condition by analyzing the detection value of the vibration sensor 121;
a route tracking module 140 for tracking a driving route by analyzing the location information of the personal mobility 10;
Communication module 150 for short-range wireless communication with the user's mobile terminal 20; and
It includes; a mobility controller 160 that provides the captured image, the road surface condition, and the driving route to the mobile terminal 20 of the user;
The road surface monitoring module 130 analyzes any one or more of a vibration magnitude and a vibration generation interval to extract the road surface condition. According to claim 1,
Further comprising; a path evaluation module 180 for evaluating the driving path of the personal mobility 10;
The path evaluation module 180,
Providing a personal mobility driving state, characterized in that the path traveled by the personal mobility 10 is evaluated by combining the driving path tracked by the path tracking module and the road surface condition read by the road surface monitoring module 130 system. 3. The method of claim 2,
Illuminance sensor 123 for measuring the brightness of the road surface on which the personal mobility 10 is driving; further comprising,
The path evaluation module 180,
By combining the driving path tracked by the path tracking module, the road surface condition read by the road surface monitoring module 130, and the brightness information of the road surface detected through the illuminance sensor 123, the personal mobility 10 is A personal mobility driving state providing system, characterized in that it evaluates the route traveled. an illuminance sensor 123 for measuring the brightness of the road surface on which the personal mobility 10 is driving;
a route tracking module 140 for tracking a driving route by analyzing the location information of the personal mobility 10;
a path evaluation module 180 for evaluating the driving path of the personal mobility 10;
Communication module 150 for short-range wireless communication with the user's mobile terminal 20; and
A mobility controller 160 that provides the road surface condition and the driving route to the user's mobile terminal 20;
The path evaluation module 180,
Distance and average travel speed from the origin to the destination of the personal mobility 10 read by the route tracking module 140;
The personal mobility driving state providing system, characterized in that the path traveled by the personal mobility (10) is evaluated by combining the brightness information of the road surface detected through the illuminance sensor (123). 5. The method of claim 4,
a vibration sensor 121 that detects vibration of the personal mobility 10 while driving;
A road surface monitoring module 130 for extracting a road surface condition by analyzing the detection value of the vibration sensor 121; further comprising,
The path evaluation module 180,
The personal mobility driving state providing system, characterized in that the path traveled by the personal mobility (10) is evaluated by further combining the road surface state read by the road surface monitoring module (130). 6. The method of claim 5,
The road surface monitoring module 130,
The personal mobility driving state providing system, characterized in that the road surface condition is extracted by analyzing any one or more of the vibration magnitude and the vibration generation interval of the vibration sensor (121).

Images