KR102480424B1 - Personal mobility having local monitogring function - Google Patents

Abstract

The present invention relates to personal mobility having a regional monitoring function, and in particular, to personal mobility having a regional monitoring function that enables monitoring and storing cases of violation of restrictions specified in a restricted area using personal mobility and providing the information to related organizations, etc. will be.

Description

Personal mobility with local monitoring function {PERSONAL MOBILITY HAVING LOCAL MONITOGRING FUNCTION}

The present invention relates to personal mobility having a local monitoring function, and more particularly, personal mobility having a local monitoring function that enables monitoring and storing cases of violation of restrictions specified in a restricted area using personal mobility and providing the information to related organizations, etc. It's about mobility.

Recently, the supply of personal mobility (PM) such as electric wheels, electric kickboards, electric bicycles, and micro electric vehicles as means of transportation for one person using electric energy is increasing.

In addition, in the field of personal mobility, interest in sharing economy, which allows multiple users to share and use it, is increasing, and personal mobility related services are provided.

For example, in the case of an electric kickboard, a mobility code (QR code) placed in a specific area is tagged and recognized with a user's mobile terminal, and charging is made according to the moving distance or time so that it can be shared.

However, the electric kickboard is a compact mobility that is used only as a means of transportation even though it is used by many users to move to various places, and does not provide a role of monitoring various problems that may occur in the community while driving or stopping.

Republic of Korea Patent No. 10-2117983 Republic of Korea Patent No. 10-2132411

The present invention is to solve the above problems, and to provide personal mobility having a local monitoring function that can monitor violation cases of restrictions specified in restricted areas using personal mobility and provide them to related organizations.

To this end, personal mobility having an area monitoring function according to the present invention includes a location information providing module for receiving location information of personal mobility; a restriction information analysis module that receives restrictions specified in the outdoor restricted area; a surveillance mode setting module that analyzes whether the personal mobility is located in a restricted area using current location information of the personal mobility; a video camera mounted on the personal mobility and taking pictures of surroundings when the personal mobility enters a restricted area; a regulation violation reading module that analyzes an image captured by the video camera and determines whether an object located in the restricted area violates the specified restrictions; and a mobility control module for receiving information on a target object that violates the specified restrictions and storing it in a data recording medium.

At this time, the location information providing module receives absolute coordinates from GPS satellites and analyzes the location information of the personal mobility, and the restriction information analysis module periodically receives information on restricted areas and restrictions provided from related organizations It is desirable to update

In addition, the video camera is installed on the body of the personal mobility, and preferably includes a plurality of camera modules that take pictures in different directions so that all directions are possible.

In addition, the regulation violation reading module detects an illegally parked vehicle stopped in a parking prohibited zone from the photographed image, and the video camera adjusts focusing so that the license plate of the illegally parked vehicle is the center point and retakes the picture. it is desirable

In addition, a mobility speedometer for detecting a traveling speed of the personal mobility; an attitude sensor for detecting a driving direction of the personal mobility; a speed gun for measuring the moving speed of the target; and a speed measuring module configured to measure an actual speed of the target using the driving speed of the personal mobility, the driving direction of the personal mobility, and the moving speed of the target, wherein the rule violation reading module determines whether the target is the target. It is desirable to determine whether the speed limit specified in the restricted area is violated.

In addition, the mobility control module preferably stores information on the date, time, mobility travel speed, and restricted area at the time when the target object violating restrictions in the restricted area was photographed in a data recording medium.

The directional sound wave receivers may further include the same number of directional sound wave receivers as the plurality of camera modules, wherein the directional sound wave receivers are installed to face different directions in order to receive sound in a direction facing an imaging angle of the camera module, Preferably, the mobility control module controls the camera module in the direction in which the voice is received to start shooting.

In addition, the rule violation reading module analyzes the height and duration of the voice received from the directional sound wave receiver to determine the occurrence of an emergency situation, and determines the occurrence of an emergency situation among the plurality of camera modules in the direction in which the voice was received. Shooting is preferably started from a corresponding camera module.

In addition, it is preferable that the regulation violation reading module detects trash abandoned in an illegal dumping prohibited area from the photographed image, and the mobility control module transmits location information of a restricted area where illegally dumped trash is located to a related institution. .

The present invention as described above enables personal mobility to detect and photograph objects such as vehicles that violate them when entering a restricted area with restrictions such as speed or parking prohibition, and further monitor cases of violation of designated restrictions to to be provided to organizations, etc.

1 is an application example of personal mobility having an area monitoring function according to the present invention.
2 is a configuration diagram showing personal mobility having a local monitoring function according to the present invention.
3 is a diagram showing a speed measurement module of the present invention.
4 is a diagram showing an electric kickboard to which the present invention is applied.

Hereinafter, personal mobility having an area monitoring function according to a preferred embodiment of the present invention will be described in detail with reference to the accompanying drawings.

However, in the following, an electric kickboard is described as personal mobility (PM) as an example, but personal mobility applicable to the present invention is applicable to other shareable electric wheels, electric bicycles, and micro electric vehicles.

As shown in FIG. 1, the personal mobility 100 having an area monitoring function according to the present invention is installed in personal mobility such as an electric kickboard 10 as an example, and violates this when entering a restricted area with designated restrictions while driving A target object 20 is photographed.

Restricted areas are specific outdoor areas designated by relevant organizations such as cities/counties/districts, and restrictions include speed limits (overspeed) and prohibition of parking and stopping. In addition, regardless of the restricted area, the direction in which a human accident occurred can be automatically detected and photographed.

Therefore, the present invention monitors and stores violations of the specified restrictions within the restricted area, provides them to the relevant institution (institution server) 30, and, if necessary, provides them to the management server 40 that provides the personal mobility sharing service. may be

Violation case monitoring information is transmitted directly from the electric kickboard (10) or transmitted from the electric kickboard (10) to the user's mobile terminal (MP), such as a smart phone, and then sent from the mobile terminal (MP) to each server (30, 40) can be sent to

As shown in FIG. 2, the personal mobility 100 having a local monitoring function according to the embodiment includes a location information providing module 110, a restriction information analysis module 120, a monitoring mode setting module 130, a video camera 140, It includes a regulation violation reading module 150 and a mobility control module 160.

In another preferred embodiment, the speed measuring module 170 for measuring the speed of the target object 20 and the directional sound wave receiver 180 for confirming the occurrence of an accident by analyzing a voice in a specific direction are further included.

As shown in FIG. 3, the speed measurement module 170 described above can measure the accurate speed of the target object 20 on the electric kickboard 10 running together with the mobility speedometer 171, the posture sensor 172, and the speed gun 173. let it be

In the above configuration, the location information providing module 110, the restriction information analysis module 120, the monitoring mode setting module 130, the regulation violation reading module 150, and the speed measurement module 170 are capable of processing information by the processor. As such, it may be integrally mounted in the mobility control module 160 or implemented as separate chipsets.

In addition, the mobility control module 160 may be a travel controller 12 that controls the travel of the electric kickboard 10 or may be mounted on the travel controller 12 . In addition, the video camera 140, the mobility speedometer 171, the posture sensor 172, the speed gun 173, and the directional sound wave receiver 180 are designed for each part of the body of the electric kickboard 10 according to their respective purposes. can be installed

As shown in FIG. 4, the electric kickboard 10, which is personal mobility, has a handle or operating device 11 on the upper part of the body, and the driving controller 12 controls the driving according to the user's operation. In addition, wheels (W-F, W-B) are provided at the front and rear of the footrest 13, respectively, and are driven by a battery and a driving motor.

This electric kickboard 10 tags and recognizes the mobility code (QR code) provided on the upper surface of the travel controller 12 with the user's mobile terminal to apply for use, and then charges according to the moving distance or time. allow this to be shared.

At this time, the location information providing module 110 provides location information of personal mobility (hereinafter referred to as 'electric kickboard'), and in an embodiment, GPS capable of communicating with GPS satellites (see '50' in FIG. 1) Absolute coordinates may be provided from the receiver 110a.

Therefore, the location information providing module 110 extracts absolute coordinates included in the GPS signal by data processing. The extracted absolute coordinates of the electric kickboard 10 are provided to the monitoring mode setting module 130.

As will be described later, the monitoring mode setting module 130 reads whether the corresponding electric kickboard 10 is located in the restricted area by using the absolute coordinates of the electric kickboard 10 while driving or stopped and information on the restricted area.

Restriction information analysis module 120 receives restrictions (e.g., speed, parking and stopping, prohibition of dumping, etc.) specified in outdoor restricted areas, processes and sorts data, and provides 'restricted areas' and 'restrictions' specified therein. do.

At this time, the restriction information analysis module 120 periodically receives and updates information on restricted areas and restrictions provided from the related organizations 30 . Updates can be recorded in the data storage medium (memory, 161) provided in each electric kickboard (10).

Representative restricted areas include specific outdoor areas designated by various related organizations 30 including cities/counties/districts, and restrictions include driving speed limits (overspeed) and prohibition of parking and stopping in designated restricted areas.

For example, a vehicle traveling more than 30 km in a child protection area or a vehicle temporarily stopped in a parking prohibited area may be a target 20 violating restrictions in a restricted area. In addition, areas with high crime rates, habitual garbage dumping, and habitual urination on the street can be set as restricted areas.

The monitoring mode setting module 130 uses current location information of the electric kickboard 10 to analyze whether personal mobility enters or is located within a restricted area.

To this end, the monitoring mode setting module 130 receives current location information of the electric kickboard 10 from the location information providing module 110 . In addition, location information about the restricted area is received from the restricted information analysis module 120 and compared with them.

If it is analyzed that the electric kickboard 10 has entered the restricted area through the monitoring mode setting module 130, power is consumed only during monitoring by activating various monitoring components including the video camera 140 described later, and unnecessary power consumption prevent

Since the electric kickboard 10 uses a battery pack as a power source, it is desirable to maintain an idle state outside the restricted area and operate only the minimum monitoring function, and then start monitoring when the electric kickboard 10 enters the restricted area. .

The video camera 140 is mounted on the electric kickboard 10 and takes pictures of the surroundings when the electric kickboard 10 enters a restricted area. In an embodiment, the video camera 140 is installed on the kickboard body 14 connecting the handle 11 and the footrest 13.

Kickboard body 14 means an external fixed frame in particular. A rotation shaft 14a is installed in the hollow of the external fixed frame, and steering of the front wheels is controlled through the rotation shaft 14a.

Therefore, even if the handle 11 and the rotating shaft 14a are rotated for steering, the kickboard body 14 maintains a fixed state, so that shaking of the video camera 140 installed on the kickboard body 14 is minimized even when steering is performed. .

In addition, when the video camera 140 is installed in the body of personal mobility (eg, an external fixed frame), a plurality of camera modules ('CM in FIG. ' reference).

In an embodiment, the video camera 140 is composed of three camera modules (CM) spaced apart from each other at 120 ° angles from the outer circumferential surface of the external fixed frame 14, and the three camera modules (CM) are 360 ° in all directions. It has a wide viewing angle of 120° or more to enable shooting.

Preferably, each camera module (CM) may be composed of a multi-camera (induction camera) composed of two or more sub-camera modules, and allows shooting start, zoom and wide control.

The regulation violation reading module 150 analyzes the video captured by the video camera 140 and determines whether the target 20 located in the restricted area violates the restrictions specified in the restricted area.

The object 20 located in the restricted area is representative of a vehicle such as a car, and includes illegally dumped garbage as described later in addition to vehicles.

Accordingly, the regulation violation reading module 150 reads occurrences of various violations including speeding of vehicles, violation of parking and stopping prohibition, illegal dumping of garbage, and the like.

To read violation cases, the violation reading module 150 may apply techniques such as simple comparison, absolute speed determination, Doppler effect application, and image analysis, and machine learning may be applied to image analysis.

It is possible to classify unstructured data such as images captured by the video camera 140 using a machine-learned judgment model, and other objects, people, or surroundings such as vehicles or illegally dumped garbage in restricted areas can be classified. can be distinguished from

To this end, machine learning can apply artificial neural networks to classify illegal vehicles, etc., which are violation cases, from several comparable reference images (data).

For example, by sequentially arranging a plurality of blocks by a recurrent neural network (RNN), applying a convolutional neural network (CNN) thereto to extract feature points, and from them, corresponding to a violation case Objects can be classified.

Therefore, the mobility control module 160 receives information on the target object 20 violating the restrictions from the regulation violation reading module 150 and stores it in the data recording medium 161, and the stored violations are directly or by the user. It is reported to related institutions 30 and the like through the mobile terminal (MP) of .

To this end, the present invention may further include a communication module 162 for short-range wireless communication with a user's mobile terminal (MP), and a communication protocol such as Bluetooth Low Energy (BLE) may be used as the communication module 162 there is.

[Example 1]

On the other hand, the present invention made up of the technical configuration as described above can detect the license plate after confirming the existence of an illegally parked vehicle as an embodiment.

Accordingly, the regulation violation reading module 150 detects an illegally parked vehicle stopped in a parking prohibited zone from the captured image. To this end, when the electric kickboard 10 enters a parking prohibited area, it starts detecting an illegally parked vehicle.

For vehicle detection, a method of extracting a vehicle (object) from an image captured by the video camera 140 that starts (activates) a photograph when entering a restricted area is used. At this time, whether or not the vehicle is stopped depends on the speed measuring module 170 described later.

However, the video camera 140 may be photographed regardless of whether or not the restricted area is entered, and when entering the restricted area, detection of violation of restrictions may begin. In this case, there is a disadvantage in that battery usage is increased compared to the case where shooting starts only when entering a restricted area.

In addition, after discovering an illegal vehicle parked in a restricted area through the video camera 140, the license plate of the vehicle is photographed so that the illegally parked vehicle can be identified.

To this end, the video camera 140 adjusts the focusing so that the license plate of the vehicle is the center point under the control of the mobility control module 160 and takes a picture again.

Therefore, the video camera 140 takes a new image centered on the license plate, and the newly captured image centered on the license plate proves a parking violation together with the first photograph of the vehicle in order to determine whether or not the vehicle exists.

The vehicle license plate photographed in this way may be automatically reported to the relevant agency 30 or the like according to settings, and as described above for proof, a vehicle photograph is also transmitted together at the time of initial detection.

At this time, the mobility control module 160 stores in the data recording medium 161 various necessary information such as the date, time, and restricted area at the time when the target object 20 violating restrictions in the restricted area was photographed.

In the case of the above embodiment, the target object 20 is a vehicle that violates parking and stopping, and the stored violation information is the date and time of the violation and the location or absolute coordinates of the violation restriction area. Violation information may be transmitted to the related organization 30 or the like together with the captured image.

[Example 2]

As an embodiment of the present invention, after confirming the presence of an illegally parked vehicle violating the speed limit (restriction) specified in a restricted area, the license plate may be detected.

To this end, the vehicle speed is calculated in the speed measurement module 170, and the vehicle speed can be calculated using information provided from the mobility speedometer 171, the attitude sensor 172, and the speed gun 173 as shown in FIG. there is.

Among them, the mobility speedometer 171 detects the traveling speed of personal mobility. The detection method may detect the driving speed by a measurement value sensed through a speed sensor or by reading a driving manipulation signal.

The posture sensor 172 detects the driving direction of the electric kickboard 10. A gyro sensor (direction sensor) may be used as the attitude sensor 172, and it is determined whether the electric kickboard 10 moves away from or approaches the vehicle to be read by the attitude sensor 172.

The speed gun 173 measures the moving speed of the target object 20, the vehicle. As is known, the speed gun 173 measures the speed of the target 20 using the Doppler effect, and based on this, the absolute speed of the vehicle can be extracted together with the mobility speedometer 171 and the attitude sensor 172.

Although the speed gun 173 in a general case is in a stationary state by the observer, in the present invention, since the speed gun 173 is installed on the electric kickboard 10, the mobility speedometer 171 and the attitude sensor 172 are used as variables other than the absolute speed of the vehicle Remove

However, the speed gun 173 does not necessarily have to be formed in a gun shape, and various shapes that can be installed on the electric kickboard 10 are possible. Therefore, in the present invention, the speed gun 173 should be understood as any device that measures the speed of the target object 20 .

According to the configuration as described above, the speed measurement module 170 determines the actual speed (absolute speed) is measured.

Furthermore, the regulation violation reading module 150 receives driving speed information of the vehicle provided from the speed measurement module 170 and compares it with the speed limit specified in the restricted area to determine whether the corresponding vehicle is speeding.

As a result of determination by the regulation violation reading module 150, if the speed limit is violated, such as speeding, the license plate image of the speeding vehicle is transmitted along with the date, time, restricted area, and mobility driving speed. By providing the mobility driving speed, objectivity for the measurement conditions at the time of vehicle speed observation is provided.

[Example 3]

As an embodiment, the present invention detects the occurrence of an accident not only in a restricted area but also in other general areas and photographs the area. Shooting is possible not only when the electric kickboard 10 is running, but also when it is stopped.

To this end, the present invention further includes the same number of directional sound wave receivers 180 as the number of camera modules CM constituting the video camera 140 . Sound waves are received in each specific direction by directivity.

In addition, each of the plurality of directional sound wave receivers 180 is installed to face the direction of the imaging angle of the camera module CM. At this time, the mobility control module 160 controls the camera module CM in the direction where the voice is received to start shooting.

Therefore, when a specific voice is received in a specific direction while being monitored in all directions by the plurality of directional sound wave receivers 180, the corresponding direction is photographed to automatically photograph a human or material accident or incident occurrence situation. .

In particular, the regulation violation reading module 150 determines the occurrence of an emergency situation by analyzing the pitch of the voice received from the directional sound wave receiver 180 and the duration (occurrence duration) of the received voice. For example, if a woman screams in a high tone for a long time, it is judged as a crime.

In this case, among the plurality of camera modules (CM) constituting the video camera 140, the camera module (CM) corresponding to the direction in which the voice is received starts shooting, and crimes targeting people as well as damage to parked vehicles or Monitor emergency situations, etc.

Therefore, the CCTV function is provided using the electric kickboard 10, and the captured image can be provided to the police station.

[Example 4]

As an embodiment of the present invention, the presence of garbage can be reported to the related organizations 30, such as cities/districts/guns, by detecting garbage dumped in an unauthorized dumping restricted area.

Accordingly, the regulation violation reading module 150 detects the garbage dumped in the illegal dumping prohibited area from the image captured by the video camera 140 . The mobility control module 160 transmits location information of a restricted area where illegally dumped garbage is located to the relevant agency 30 .

Whether or not it is garbage is confirmed by analyzing the captured image through machine learning, etc., as described above, and as a result of the check, if unauthorized dumping garbage exists, it is reported to the related agency 30 so that a person in charge can be dispatched.

In the above, specific embodiments of the present invention have been described in detail. However, the spirit and scope of the present invention is not limited to these specific embodiments, but those skilled in the art can make various modifications and variations without changing the gist of the present invention. You will understand when you grow up.

Therefore, since the embodiments described above are provided to completely inform those skilled in the art of the scope of the invention to which the present invention pertains, it should be understood that it is illustrative and not limiting in all respects, The invention is only defined by the scope of the claims.

10: Electric kickboard (personal mobility)
20: target (vehicle)
30: Related organization (server)
40: management server
50: GPS satellites
110: location information providing module
120: restricted information analysis module
130: monitoring mode setting module
140: video camera (camera module, CM)
150: regulation violation reading module
160: mobility control module
170: speed measurement module
180: directional sound wave receiver

Claims (9)

delete delete delete delete a location information providing module 110 receiving location information of the personal mobility 10;
a restriction information analysis module 120 that receives restrictions specified in the outdoor restricted area;
a monitoring mode setting module 130 that analyzes whether the personal mobility 10 is located in a restricted area by using current location information of the personal mobility 10;
a video camera 140 mounted on the personal mobility 10 and photographing surroundings when the personal mobility 10 enters a restricted area;
a regulation violation reading module 150 that analyzes the video captured by the video camera 140 and determines whether the target 20 located in the restricted area violates the specified restrictions; and
A mobility control module 160 for receiving information on the object 20 that violates the specified restrictions and storing it in a data recording medium; including,
The location information providing module 110 receives absolute coordinates from GPS satellites and analyzes the location information of the personal mobility 10,
The restriction information analysis module 120 periodically receives and updates information on restricted areas and restrictions provided from related organizations 30 including cities/counties/districts, processes and sorts the data, provide for specified restrictions;
a mobility speedometer 171 for detecting a traveling speed of the personal mobility 10;
a posture sensor 172 for detecting a driving direction of the personal mobility 10;
a speed gun 173 for measuring the moving speed of the target object 20; and
A speed measurement module 170 for measuring the actual speed of the target object 20 using the traveling speed of the personal mobility 10, the traveling direction of the personal mobility 10, and the moving speed of the target object 20; Including more
The regulation violation reading module 150 determines whether the target object 20 violates the speed limit specified in the restricted area. According to claim 5,
The mobility control module 160,
Personal mobility with an area monitoring function, characterized by storing information on the date, time, mobility driving speed, and restricted area at the time of photographing the object 20 violating the restrictions in the restricted area in a data recording medium . a location information providing module 110 receiving location information of the personal mobility 10;
a restriction information analysis module 120 that receives restrictions specified in the outdoor restricted area;
a monitoring mode setting module 130 that analyzes whether the personal mobility 10 is located in a restricted area by using current location information of the personal mobility 10;
a video camera 140 mounted on the personal mobility 10 and photographing surroundings when the personal mobility 10 enters a restricted area;
a regulation violation reading module 150 that analyzes the video captured by the video camera 140 and determines whether the target 20 located in the restricted area violates the specified restrictions; and
A mobility control module 160 for receiving information on the object 20 that violates the specified restrictions and storing it in a data recording medium; including,
The location information providing module 110 receives absolute coordinates from GPS satellites and analyzes the location information of the personal mobility 10,
The restriction information analysis module 120 periodically receives and updates information on restricted areas and restrictions provided from related organizations 30 including cities/counties/districts, processes and sorts the data, provide for specified restrictions;
The video camera 140,
It is installed on the body of the personal mobility 10, and includes a plurality of camera modules (CM) that take pictures in different directions so that all directions are possible,
Further comprising the same number of directional sound wave receivers 180 as the plurality of camera modules (CM),
The directional sound wave receivers 180 are installed to face different directions in order to receive voices in directions facing the shooting angle of the camera module CM,
The mobility control module 160 is personal mobility having a local monitoring function, characterized in that for controlling to start shooting in the camera module (CM) in the direction in which the voice is received. According to claim 7,
The rule violation reading module 150 determines the occurrence of an emergency situation by analyzing the pitch and duration of the received voice from the directional sound wave receiver 180,
Personal mobility with a local monitoring function, characterized in that the shooting starts from a camera module (CM) corresponding to the direction in which the voice was received among the plurality of camera modules (CM). a location information providing module 110 receiving location information of the personal mobility 10;
a restriction information analysis module 120 that receives restrictions specified in the outdoor restricted area;
a monitoring mode setting module 130 that analyzes whether the personal mobility 10 is located in a restricted area by using current location information of the personal mobility 10;
a video camera 140 mounted on the personal mobility 10 and photographing surroundings when the personal mobility 10 enters a restricted area;
a regulation violation reading module 150 that analyzes the video captured by the video camera 140 and determines whether the target 20 located in the restricted area violates the specified restrictions; and
A mobility control module 160 for receiving information on the object 20 that violates the specified restrictions and storing it in a data recording medium; including,
The location information providing module 110 receives absolute coordinates from GPS satellites and analyzes the location information of the personal mobility 10,
The restriction information analysis module 120 periodically receives and updates information on restricted areas and restrictions provided from related organizations 30 including cities/counties/districts, processes and sorts the data, provide for specified restrictions;
The regulation violation reading module 150 detects garbage dumped in an illegal dumping prohibited area from the captured image,
The mobility control module 160 is personal mobility having an area monitoring function, characterized in that for transmitting the location information of the restricted area where the illegally dumped garbage is located to the related agency 30.

Images