KR20240043856A - IoT-based electric wheelchair operation assistance solution provision system - Google Patents

Abstract

The present invention provides safe and optimized routes so that electric wheelchair users can easily and safely find their destination using the subway, etc., and guides realistic travel times by reflecting elevator waiting times when transferring, so that electric wheelchair users can communicate with the other party. We provide route guidance so that you do not deviate too far from your appointed time, and we edit and process the video taken from the perspective of the electric wheelchair user, taking into account the eye level, viewing angle, and visibility of the electric wheelchair user, and create a road view exclusively for electric wheelchair users. This is about the IoT-based electric wheelchair operation assistance solution provision system.
To this end, the present invention includes a destination input unit that receives a saved destination, a destination based on a set scenario, or a new destination from the electric wheelchair user; a special item selection unit that selects special items including an avoidance route or waypoint to set a route for destination information input from the destination input unit; a route search unit that searches a route based on data input and selected from the destination input unit and the special information selection unit; a route selection unit that displays the route searched by the route search unit on a map so that the electric wheelchair user can check and select the route; Once the final travel route is confirmed by the route selection unit, the entire travel time is provided on screen or by voice. For electric wheelchair users, it is essential to use the elevator when moving between floors when boarding or transferring to the subway, but in stations with a large floating population, waiting for the elevator is required. A travel time information section that reflects the overall travel time as time occurs; And if facilities that provide convenience to the general public, including signs and landscape stones, are likely to act as obstacles to users of electric wheelchairs, it includes a facility disability determination unit that sets the facilities as obstacles, stores them in a database, and matches them with a map. Provides an IoT-based electric wheelchair operation assistance solution providing system.

Description

IoT-based electric wheelchair operation assistance solution provision system{omitted}

The present invention relates to a system for providing an electric wheelchair operation assistance solution. More specifically, it is about an IoT-based electric wheelchair operation assistance solution provision system.

The Act on Guaranteeing the Promotion of Convenience for the Elderly, the Elderly, and Pregnant Women stipulates the guarantee of access rights. However, the accessibility of the building is poor in terms of the building's access road, effective width of the main entrance, height difference (level difference), slope, and inclination, so the right of movement of the elderly, etc., is not sufficiently guaranteed.

Even when an access road of an appropriate width is installed, there are many places where the appropriate slope of the ramp is not sufficient or the road surface is not finished with slip-resistant material, so the conditions for practical use of the ramp are insufficient.

In addition, there are obstacles such as parked cars that block the passage of wheelchairs, blocking access for the elderly or threatening pedestrian safety.

In the case of electric wheelchair users, there is a strong tendency to give up going out due to road surfaces, illegal structures, etc. or to only go on the road they have always traveled, and they have a potential fear of new roads. The majority of electric wheelchair users are elderly, and they are alienated from society, have low social and economic activities, and have a higher level of depression compared to the general population.

According to the Act on the Promotion of Pedestrian Safety and Convenience, electric assistive devices such as electric wheelchairs are classified as pedestrians and must be driven only on sidewalks, but they are having difficulty driving due to uneven sidewalk blocks and narrow pedestrian paths.

Even if you enter the sidewalk using an electric wheelchair, you experience inconvenience in moving because there are no places with low slopes, and there are many roads where electric wheelchairs cannot travel because the sidewalks are blocked by street trees, electric poles, illegal cargo, etc. For this reason, the number of elderly people traveling on roads with relatively good road conditions has increased, and as a result, traffic accidents involving electric vehicles continue to occur, and although the risks of driving on roads are constantly being raised, related measures are insufficient.

Meanwhile, social services for electric wheelchair users are also lacking.

Unlike navigation services for vehicles, the construction of detailed pedestrian road network data including sidewalks, crosswalks, obstacles, etc. is essential for navigation services for non-disabled pedestrians. However, construction work requires significant costs and manpower, so active promotion is being carried out. It is not losing.

In the case of elderly people who travel in electric wheelchairs, etc., it is difficult to pass by the same route as non-disabled pedestrians using existing services. Elderly people who use electric wheelchairs must be able to minimize the trial and error that may occur in the process of finding their way to their destination. For this reason, in order to guide elderly people on more accurate travel routes, they must be able to avoid obstacles that they cannot pass, as well as obstacles while moving. It is necessary to establish detailed location and status information of various facilities that can be used.

Prior art literature: KR Registered Patent Publication No. 2395094 (2022.05.09.)

The present invention was created to solve the above problems, and its purpose is to provide an electric wheelchair driving assistance solution that can accurately find and operate a safe route from the perspective of elderly people using electric wheelchairs.

The IoT-based electric wheelchair operation assistance solution providing system according to the present invention developed to achieve the above object includes a destination input unit that receives a saved destination, a destination based on a set scenario, or a new destination from the electric wheelchair user; a special item selection unit that selects special items including an avoidance route or waypoint to set a route for destination information input from the destination input unit; a route search unit that searches a route based on data input and selected from the destination input unit and the special information selection unit; a route selection unit that displays the route searched by the route search unit on a map so that the electric wheelchair user can check and select the route; Once the final travel route is confirmed by the route selection unit, the entire travel time is provided on screen or by voice. For electric wheelchair users, it is essential to use the elevator when moving between floors when boarding or transferring to the subway, but in stations with a large floating population, waiting for the elevator is required. A travel time information section that reflects the overall travel time as time occurs; And if facilities that provide convenience to the general public, including signs and landscape stones, are likely to act as obstacles to users of electric wheelchairs, it includes a facility disability determination unit that sets the facilities as obstacles, stores them in a database, and matches them with a map. do.

In addition, an embodiment of the present invention is not based on road images taken from a data collection-only vehicle, like existing road views and map data, but is based on images of paths that can be moved by electric wheelchairs, including sidewalks, steps, and indoors, from the perspective of the electric wheelchair user. An image capture unit that secures data; A road view generator that edits and processes the video captured by the video capture unit, taking into account the eye height, viewing angle, and viewing distance of the electric wheelchair user, and generates a road view exclusively for the electric wheelchair user; And when the movement route of the electric wheelchair user is set and a point on the route displayed on the map is selected, a road view of that point is provided, so that the electric wheelchair user can acquire route information in advance, a road view created by the road view generator. It may further include a matching unit that matches with the map.

In addition, one embodiment of the present invention divides the management status of sidewalk blocks into a plurality of grades based on criteria including whether the sidewalk pavement is plastically deformed, whether it is uniform, and whether resurfacing is necessary according to the degree of aging of the sidewalk pavement surface, and the corresponding grades are classified into a plurality of grades. A manual input unit for road surface data that receives manual input, stores it in a database, and matches it with a map; and the flatness of the road surface, the material of the sidewalk, the type of floor irregularities, the state of sidewalk blocks, the type of sidewalk blocks, the shape and state of curbs, the type and state of ledges, the shape and state of drain covers, the shape and state of braille blocks, and the material of the road surface. At this point of change, the continuity of the joint, the presence and type of non-slip slope, the condition of the bicycle road, the condition of the crosswalk, the condition of the partial ramp, the type of speed reduction facility, the presence of weeds, the presence of flower beds, the type of parking space, A data set construction unit that builds a data set for artificial intelligence learning through road surface-related data object classes, including the presence of tire bumps, the presence and shape of landscaping stones, the presence of main entrance rails, and the presence of fire shutter floor grooves. More may be included.

According to the present invention, a safe and optimized route is provided so that electric wheelchair users can easily and safely find their destination using the subway, etc., and realistic travel time is provided by reflecting the waiting time for the elevator when transferring, so that the electric wheelchair user can easily and safely reach the destination. It is effective in providing directions so that you do not deviate too far from your appointment time.

In addition, according to the present invention, there is an effect of generating and providing a road view exclusively for the electric wheelchair user by editing and processing the image taken from the viewpoint of the electric wheelchair user by taking into account the eye height, viewing angle, and viewing distance of the electric wheelchair user.

In addition, according to the present invention, floor lighting is projected so that other people in a narrow space such as an elevator can spot the electric wheelchair user and consider them in advance, so that the electric wheelchair user does not have to individually ask for separate understanding from the surrounding elevator users. It has the effect of providing unnecessary convenience.

1 is a block diagram of a system for providing an IoT-based electric wheelchair operation assistance solution according to a preferred embodiment of the present invention.
Figure 2 is a conceptual diagram of a system for providing an IoT-based electric wheelchair operation assistance solution according to a preferred embodiment of the present invention.
Figure 3 is a diagram illustrating the process of initial route designation and search, route confirmation and guidance, road view selection, and route information dictionary acquisition through road view.
Figure 4 is an example photo to explain road view creation
Figure 5 is an example photo to explain the manual road data input unit in Figure 1
Figure 6 is a flowchart for explaining the sidewalk block state detection unit in Figure 1

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the attached drawings. First, when adding reference numerals to components in each drawing, it should be noted that identical components are given the same reference numerals as much as possible even if they are shown in different drawings. Additionally, in describing the present invention, if it is determined that a detailed description of a related known configuration or function may obscure the gist of the present invention, the detailed description will be omitted. In addition, preferred embodiments of the present invention will be described below, but the technical idea of the present invention is not limited or restricted thereto, and of course, it can be modified and implemented in various ways by those skilled in the art.

Figure 1 is a block diagram of an IoT-based electric wheelchair driving assistance solution providing system according to a preferred embodiment of the present invention, and Figure 2 is a block diagram of an IoT-based electric wheelchair driving assistance solution providing system according to a preferred embodiment of the present invention. It is a concept diagram. Figure 3 is a diagram for explaining the process of initial route designation and search, route confirmation and guidance, road view selection, and route information dictionary acquisition through road view, Figure 4 is an example photo to explain road view creation, and Figure 5 is an example photo for explaining the manual road data input unit in FIG. 1, and FIG. 6 is a flowchart for explaining the sidewalk block status detection unit in FIG. 1.

Referring to FIG. 1, the IoT-based electric wheelchair driving assistance solution providing system according to a preferred embodiment of the present invention includes a destination input unit (2), a specific item selection unit (4), a route search unit (6), and a route selection unit. Unit (8), travel time information unit (10), convenience facility failure determination unit (12), video capture unit (14), road view creation unit (16), matching unit (18), road surface data manual input unit (20) ), a data set construction unit 22, a tilt asymmetric road surface detection unit 25, a floor lighting projection unit 26, a sidewalk block status detection unit 28, and a road surface abnormality determination unit 30.

Referring to FIG. 3, the destination input unit 2 receives input of a saved destination, a destination based on a set scenario, or a new destination from the electric wheelchair user.

For example, the destination according to the set scenario may be a course including a specific ecological park as today's daily rest course or a rest course, and a no-threshold restaurant course may be set as a dinner date course or a lunch date course.

The special item selection unit 4 receives special items including an avoidance route or a waypoint to set the route of the destination information input from the destination input unit 2.

The route search unit 6 searches the route based on data input and selected from the destination input unit 2 and the special item selection unit 4.

The route selection unit 8 displays the route searched by the route search unit 6 on the map so that the electric wheelchair user can check and select the route.

When the final travel route is determined by the route selection unit 8, the travel time information unit 10 provides information on the total travel time on screen or by voice.

For electric wheelchair users, it is essential to use the elevator when moving between floors when boarding or transferring subways. At this time, in the case of stations with a large floating population, waiting time for the elevator occurs, so the travel time information unit 10 reflects this and guides the total travel time.

For example, the travel time information unit 10 calculates the number of elevators that exist on the subway boarding and transfer route by adding a preset time to the time required for walking when boarding and transferring the subway, and calculating the number of elevators for each elevator. Methods such as adding a set time can be used.

More specifically, considering the fact that the inside of the station is crowded at the transfer station, the movement of electric wheelchairs is relatively difficult, and the waiting time for the elevator is long, we detect whether a transfer station with a particularly high number of users exists on the travel route, and check the time zone. Considering that the number of users is different for each user, the time required can be calculated based on a time zone other than commuting time, reflecting a preset weight as it approaches commuting time.

If facilities that provide convenience to the general public, including signs and landscape stones, are likely to act as an obstacle to users of electric wheelchairs, the convenience facility obstacle determination unit (12) sets the facility as an obstacle, stores it in the database, and displays it on a map. Match.

To determine whether a facility that provides convenience to the general public has the potential to act as an obstacle to electric wheelchair users, the data collector determines when collecting data on the road surface and stores it in a database. A method such as automatically detecting facilities that exceed a certain width and height in the video, judging them as obstacles, and storing them in a database can be used.

More specifically, after detecting a facility exceeding a certain width and height in the camera image (hereinafter referred to as 'first condition'), if it exceeds a preset value compared to the road width in the area where the facility is installed (hereinafter referred to as 'first condition') The program can be designed to only judge obstacles as obstacles (the 'second condition').

In addition, the program may be designed to judge the facility as an obstacle only when the first and second conditions are simultaneously satisfied and the space within which the electric wheelchair user can avoid the facility is less than a preset value (hereinafter referred to as the 'third condition). there is.

In addition, it is considered an obstacle only when the first to third conditions are simultaneously satisfied and the travel distance extended by the electric wheelchair user detouring to avoid the facility exceeds a preset value (hereinafter, 'fourth condition'). A program can also be designed to make judgments.

The video capture unit 14 captures video data of the path on which the electric wheelchair can travel, including sidewalks, steps, and indoors, from the perspective of the electric wheelchair user, rather than based on road images captured from a vehicle dedicated to data collection, such as existing road view and map data. Secure.

Compared to the general public who walk, from the perspective of electric wheelchair users, the road surface and steps of the sidewalk, the curb that forms the boundary between the roadway and the sidewalk, and the sill of the main indoor entrance are not only easily visible, but are also perceived as large obstacles and are objects of fear. .

Therefore, the road view provided to electric wheelchair users must also be created from the electric wheelchair user's perspective and perspective to reduce discomfort and maximize practicality and efficiency.

To this end, the video capture unit 14 of the present invention creates a road view from images captured while directly driving an electric wheelchair instead of a conventional data collection-only vehicle.

The road view generator 16 edits and processes the image captured by the video capture unit 14, taking into account the eye height, viewing angle, and viewing distance of the electric wheelchair user, and creates a road view exclusively for the electric wheelchair user.

Referring to FIGS. 3 and 4, the road view generator 16 generates electric motors for the road surface of the sidewalk, the boundary between the roadway and the sidewalk, obstacles such as bumps at the main entrance to the interior, motorcycles, street lights, and street trees. It can be confirmed that an edited and processed road view is provided taking into account the wheelchair user's eye height, viewing angle, and visibility distance.

Electric wheelchair users, in particular, when they want to go to a new destination or when they want to go to a destination by a different route than the existing one because there is a stopover for an already visited destination, the road provided through the road view generator 16 before departure or at an intermediate point You can use the view to obtain information about the route in advance.

The matching unit 18 is a road view generator that provides a road view of the point when the movement route of the electric wheelchair user is set and a point on the route displayed on the map is selected, so that the electric wheelchair user can acquire route information in advance. The road view generated in (16) is matched with the map.

When the electric wheelchair user selects a point on the route expressed on the map as shown in FIG. 3, the matching unit 18 can check the road view of the corresponding area.

The road surface data manual input unit 20 divides the sidewalk block management status into a plurality of grades based on predetermined standards, manually inputs the grades, stores them in the database, and matches them with the map.

Predetermined standards include whether the sidewalk pavement is plastically deformed, whether it is uniform, and whether resurfacing is necessary depending on the degree of deterioration of the sidewalk pavement surface.

Referring to Figure 5, an example is shown in which the road surface data manual input unit 20 divides the sidewalk block management status into five grades from 1 to 5 and presents standards.

Grade 1 means that the sidewalk pavement has no plastic deformation or cracks and is in a new or like-new condition.

Grade 2 means that the sidewalk pavement is not smooth overall, but is maintained in a uniform condition.

Grade 3 allows pedestrians and those with mobility impairments to pass, but resurfacing is necessary depending on the age of the pavement.

Grade 4 is a condition that affects the normal passage of pedestrians and transportation vulnerable people, and is when more than 50% of the pavement is hazardous.

Grade 5 is a state in which normal passage is impossible and there is a risk in more than 75% of the pavement.

For example, in the case of grades 3 to 5, where it is dangerous for the data collector to photograph the road surface while operating an electric wheelchair or there is a possibility of an accident, the data collector can refer to the contents and photos of the above-mentioned grade to determine the road surface data. The grade is determined, entered manually, stored in the database, and matched with the map.

The data set construction unit 22 builds a data set for artificial intelligence learning through a road surface-related data object class.

Road surface-related data object classes for artificial intelligence learning include road surface flatness, sidewalk material, type of floor irregularities, sidewalk block status, sidewalk block type, curb shape and status, ledge type and status, drain cover shape and status, Shape and condition of braille blocks, continuity of joints at points where road surface material changes, presence and type of non-slip slope, condition of bicycle road, condition of crosswalk, condition of partial slope, type of speed reduction facility, presence of weeds This includes the presence or absence of a flower bed, the shape of the parking space, the presence or absence of tire bumps, the presence and shape of landscaping stones, the presence or absence of a main entrance door rail, and the presence of a groove in the bottom of a fire shutter.

The flatness of the road surface can be assigned by dividing the flatness of the road surface into a plurality of grades, like the manual road surface data input unit 20.

The materials of sidewalks can be classified into asphalt, sidewalk blocks, cement, damaged, soil, stone, and urethane.

Types of floor irregularities can be classified into elevations around street trees, local sagging (settlement), cracks, etc.

The condition of sidewalk blocks can be classified as lost, worn, contaminated, damaged, or normal.

Types of sidewalk blocks can be classified into grass blocks, stone tiles, ortholithic tiles, herringbone blocks, clay bricks, permeable blocks, small high-pressure blocks, and granite blocks.

Curb shapes and conditions can be classified into round curbs, square curbs, inclined curbs, fallen or damaged curbs, completely destroyed curbs, protruding curbs, embedded curbs, etc.

The type and condition of the sill can be divided into general steps, damage, thresholds, indoor space separation sills, asphalt sills, and sidewalk separation sills.

The shape and condition of the drain cover can be classified into grid-type drain, straight drain, damaged or crumpled, partially installed type, and continuously installed type.

The shape and state of the Braille block can be divided into dot-shaped blocks, linear blocks, damaged blocks (chipped), and damaged blocks (removed).

The continuity of the seam at the point where the road surface material changes can be divided into continuous (seam when the road surface material changes) and non-continuous.

The presence and type of non-slip ramps can be divided into straight anti-slip, pattern-type anti-slip, and non-slip.

The condition of the bicycle road can be classified into cracked pavement, broken road, completely destroyed, and general.

The condition of the crosswalk can be classified as cracked, damaged, or normal.

The state of a partial ramp can be divided into a steep slope, a gentle slope, etc.

Types of speed reduction facilities can be divided into speed bumps, zigzag roads, etc.

The presence or absence of weeds and the presence of flower beds can be classified as presence or absence.

Parking space types can be divided into those on asphalt, on sidewalk blocks, etc.

The presence or absence of tire bumps can be classified as presence or absence.

The presence and shape of landscaping stones can be divided into embedded, protruding, and general types.

The presence or absence of the main door rail can be divided into presence or absence.

The presence or absence of a fire shutter floor groove can be divided into presence or absence.

The inclination asymmetric road surface detection unit 25 measures the left and right inclinations of the road surface through a inclination sensor, and when the difference exceeds a threshold, it is determined to be an inclination asymmetric road surface and stores the location or area in the database.

If the slope of the road surface is asymmetric, there is a risk of overturning or falling accidents for electric wheelchair users. Therefore, if a child exceeds the threshold for the measured left and right slope, the slope is stored in the database as an asymmetric road surface, so that electric wheelchair users can use it in the future. If you need to pass through an area, provide a detour route or provide danger signals in advance to prevent safety accidents.

The floor lighting projection unit 26 is installed on the floor with logos and letters in certain areas on all sides of the electric wheelchair so that the electric wheelchair user can secure a certain amount of space for people around him when he has to enter a narrow space, including an elevator. Project light.

For example, the floor lighting projection unit 26 displays a character or logo along with the phrase 'Thank you for your consideration', allowing other people in a small space to discover the electric wheelchair user and give them consideration in advance. In addition, since others can recognize the existence of the electric wheelchair by the projected floor lighting, it provides the convenience of the electric wheelchair user without having to individually seek permission from elevator users around him.

The sidewalk block status detection unit 28 extracts feature values including the shape, shape, color, structure, and texture of the sidewalk block through analysis of image data acquired from the image capture unit 14, classifies the sidewalk block, and then classifies the sidewalk block. Detect the status of sidewalk blocks.

Sidewalk blocks have the following characteristics.

First, sidewalk blocks are separated from the roadway and come in a variety of colors, from achromatic white to chromatic red, yellow, and green.

Second, the structured blocks are assembled piece by piece and packaged. A block is a two-dimensional polygon with a specific image and has an interconnectable structure. If the boundary shape between neighboring blocks is the same, blocks of similar shapes can be detected by geometrically analyzing the characteristics of the polygon.

Third, the texture features are similar. Since blocks of the same material are mass-produced to ensure a large road, the blocks all have a similar organizational structure.

Referring to FIG. 6, the sidewalk block state detection unit 28 retrieves image data from the viewpoint of the electric wheelchair user obtained from the image capture unit 14 and automatically corrects the shaken image through deblurring.

Using Open CV (Open Source Computer Vision), etc., and applying ROI (Region of Interest), etc., some areas of sidewalk blocks are extracted and area settings are performed.

Edge detection is performed on some extracted areas to detect edges.

Labeling is performed to classify each region in the binarized image, and the center of gravity for an area of 0.35 to 4% of the existing region is calculated.

Calculate the azimuth of the surrounding intersections, and define the shape pattern of each area using the intersections corresponding to the azimuth.

Using shape patterns, sidewalk blocks are recognized by analyzing the similarity of shape patterns and textures for all areas. To analyze texture features, four values, including variance, entropy, homogeneity, and contrast, can be used.

By analyzing and collecting 4 texture features from all previously detected sidewalk blocks, analyzing values of 4 texture features from each undetected area are obtained, standard deviation is derived, and learned to prevent road surface abnormalities such as contaminated blocks and damaged blocks. judge.

The road surface abnormality determination unit 30 determines the road surface abnormality grade through an IMU (Inertial Measurement Unit) sensor and road surface image data.

To this end, the road surface abnormality determination unit 30 considers sudden changes in pattern and amplitude among IMU sensor data as abnormal situations and collects related data. Among the vibration data, the amplitude change data is defined as road surface abnormality and the data for that part is used.

Next, errors in sensor values are resolved through mean normalization, and a network is designed and trained using CNN (Convolution Neural Network) deep learning.

Next, vibration data from the IMU sensor is analyzed using a learning model to determine and detect abnormal road surfaces.

Next, an abnormal road surface is detected and determined through image data coming through the video capture unit, and when an abnormal road surface is detected, information about the location of the abnormal road surface is stored.

The above description is merely an illustrative explanation of the technical idea of the present invention, and various modifications, changes, and substitutions can be made by those skilled in the art without departing from the essential characteristics of the present invention. will be. Accordingly, the embodiments disclosed in the present invention and the attached drawings are not intended to limit the technical idea of the present invention, but are for illustrative purposes, and the scope of the technical idea of the present invention is not limited by these embodiments and the attached drawings. . The scope of protection of the present invention should be interpreted in accordance with the claims below, and all technical ideas within the equivalent scope should be construed as being included in the scope of rights of the present invention.

2: Destination input section 4: Special information selection section
6: Path search unit 8: Path selection unit
10: Travel time information section 12: Convenience facility disability determination section
14: video recording unit 16: road view generation unit
18: matching unit 20: road surface data manual input unit
22: Data set construction unit 24: Tilt asymmetric road surface detection unit
26: floor lighting projection unit 28: sidewalk block status detection unit
30: Road surface abnormality judgment unit

Claims (3)

A destination input unit that receives a saved destination, a destination based on a set scenario, or a new destination from the electric wheelchair user;
a special item selection unit that selects special items including an avoidance route or waypoint to set a route for destination information input from the destination input unit;
a route search unit that searches a route based on data input and selected from the destination input unit and the special information selection unit;
a route selection unit that displays the route searched by the route search unit on a map so that the electric wheelchair user can check and select the route;
Once the final travel route is confirmed by the route selection unit, the entire travel time is provided on screen or by voice. For electric wheelchair users, it is essential to use the elevator when moving between floors when boarding or transferring to the subway, but in stations with a large floating population, waiting for the elevator is required. A travel time information section that reflects the overall travel time as time occurs; and
If facilities that provide convenience to the general public, including signs and landscape stones, are likely to act as an obstacle to users of electric wheelchairs, the convenience facility disability determination department sets the facility as an obstacle, stores it in the database, and matches it with a map.
An IoT-based electric wheelchair operation assistance solution providing system including. According to paragraph 1,
A video capture unit that secures video data of the path where the electric wheelchair can travel, including sidewalks, steps, and indoors, from the perspective of the electric wheelchair user, rather than based on road images captured from a data collection-only vehicle, such as existing road view and map data;
A road view generation unit that edits and processes the video captured by the video capture unit by considering the eye height, viewing angle, and visibility distance of the electric wheelchair user to create a road view exclusively for the electric wheelchair user; and
When the electric wheelchair user's movement route is set and a point on the route displayed on the map is selected, a road view of that point is provided, and the road view created by the road view generator is provided so that the electric wheelchair user can acquire route information in advance. Matching unit that matches the map
An IoT-based electric wheelchair operation assistance solution providing system that further includes. According to paragraph 1,
The sidewalk block management status is divided into multiple grades based on criteria including whether the sidewalk pavement is plastically deformed, whether it is uniform, and whether resurfacing is necessary depending on the age of the sidewalk pavement surface. The grades are manually entered, stored in the database, and mapped. A manual input unit for road surface data that matches with; and
The flatness of the road surface, the material of the sidewalk, the type of floor irregularities, the condition of sidewalk blocks, the type of sidewalk blocks, the shape and condition of curbs, the type and condition of ledges, the shape and condition of drain covers, the shape and condition of braille blocks, and the material of the road surface. Continuity of joints at changing points, presence and type of non-slip slope, condition of bicycle road, condition of crosswalk, condition of partial slope, type of speed reduction facility, presence of weeds, presence of flower beds, type of parking space, tires. A data set construction unit that builds a data set for artificial intelligence learning through road surface-related data object classes, including the presence of bumps, the presence and shape of landscaping stones, the presence of main entrance door rails, and the presence of fire shutter floor grooves.
An IoT-based electric wheelchair operation assistance solution providing system that further includes.