JP2019105632A - System and method for providing navigation services for disabled people based on image analysis - Google Patents

Abstract

To allow for generating a database that reflects relevant road information by crawling information necessary for free movement of a wheelchair on roads or sidewalks, and providing a navigation service based the generated database.SOLUTION: Provided are a system and a method for providing navigation service for disabled people. The system of the present invention crawls information necessary for free movement of a wheelchair on roads or sidewalks, generates a database reflecting relevant road information, and provides a navigation service based on the generated database to allow a disabled person to safely travel to a destination.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a system and method for providing a navigation service for persons with disabilities, and more specifically, a wheelchair crawls information necessary for free movement on a road to generate and generate a database on which road information is reflected. The present invention relates to a system and method for providing a navigation service for persons with disabilities that provide navigation services based on a selected database.

  In recent years, as the demand for geographic information systems that provide services such as route information or facility search to a user's desired destination such as navigation systems and global positioning systems (GPS) increases, the technology is subdivided Various technologies have been proposed to further emphasize the convenience of the users or the users.

  Compared to this, the technology for providing geographical information specified to not only general users but also users with senility or disabilities is also in increasing need, but to general users In comparison, there is a problem that a relatively sufficient technical base is not provided.

  Therefore, a navigation system for a wheelchair as disclosed in Japanese Patent Application Laid-Open No. 2007-139486 is also provided so that a user who uses a wheelchair, such as a disabled person, can conveniently access location-based geographic information. It is provided.

  However, it is the most difficult thing for a person with a disability to move using a wheelchair to find the safe way by avoiding the step or stairs of the boundary stone and the steep slope.

  In this case, the footsteps of the road where wheelchairs can not easily pass, steep ups and downs, uneven ground, and areas or buildings where there are no wheelchair lifts or wheelchair ramps and only stairs for ordinary people There is a problem that it has to be avoided.

  An object of the present invention is to provide a navigation service based on a database generated by crawling information necessary for free movement on a road by a wheelchair, generating a database on which the road information is reflected, and It is providing a navigation service providing system and method.

The navigation service providing system for the disabled includes route guidance information for moving from the service server 200 to any destination, and POI (Point Of
Navigation 100 for receiving and displaying navigation map information including Interest and information and transmitting movement information based on GPS signals to the service server 200, and route guidance information searched for moving to the destination. A service server that transmits navigation map information including POI information convenient for a disabled person provided from the POI management server 300 to the navigation 100 and transmits movement information transmitted from the navigation 100 to the POI management server 300 200, POI information convenient for the disabled collected from the crawling unit 400 is analyzed to generate POI map information convenient for the disabled matching the road information, and the generated POI map information for the disabled created is generated The service server 20 The POI management server 300, which is provided to manage the error information of the navigation 100 transmitted from the service server 200 by analyzing movement information of the navigation 100 so as to be reflected in the navigation map information, through online and offline And a crawling unit 400 for inputting the POI information convenient for the disabled person to be collected into the POI management server 300.

  The POI information convenient for the disabled may include at least one of Braille blocks on the road, height of boundary stone, ramp entrance of a building, toilet or elevator information.

  The crawling unit 400 analyzes an image of a street view provided from any portal server connected through a network to extract position information of a Braille block of a road and height information of a boundary stone, and the POI management An online information collection unit 410 provided to the server 300, and an off-line information collection unit 420 extracting the ramp entrance, toilet or elevator information of a building from an image photographed by an arbitrary POI and providing the information to the POI management server 300; It is characterized by including.

  The online information collection unit 410 may classify an image including braille blocks from the image of the street view provided by the portal server using a classification model.

  The image of the street view provided by the optional portal server is composed of a reference number of images per reference distance, and the online information collection unit 410 is configured to receive latitude and longitude information provided by the optional portal server. The latitude and longitude information of the current image may be determined based on the current number of images among the reference number of images.

  The service server 200 may generate the route guidance information based on POI information convenient for the disabled person.

  In the navigation service providing method for the disabled, a) the POI management server 300 collects POI information convenient for the disabled through the crawling unit 400 to generate a database, and reflects the road information on the generated database to update the database And b) when the optional navigation 100 is connected to the service server 200 to request provision of navigation map information, the service server 200 searches the route guidance information searched for moving to the destination, and the POI management server Generating navigation map information including POI map information convenient for a disabled person provided from 300 and transmitting it to the navigation 100; c) when the service server 200 receives movement information of the navigation 100, Receive The movement information of the navigation 100 is transmitted to the POI management server 300, and the POI management server 300 analyzes the movement information of the navigation 100 to search for error information, and the searched error information is used as POI map information for the disabled person. And the step of

  The crawling unit 400 in the above a) connects with any portal server through a network, analyzes the image of the street view provided from the portal server, and detects the position information of the Braille block of the road and the height information of the boundary stone And extracting the image captured at any POI to extract ramp entry, toilet or elevator information of the building.

The crawling unit 400 of the step a) may include the step of classifying an image including Braille blocks from the image of the street view provided from the optional portal server using a classification model.

  The image of the street view provided by the optional portal server is comprised of a reference number of images per reference distance, and the crawling unit 400 of the step a) comprises latitude and longitude information provided by the optional portal server. And determining the latitude and longitude information of the current image based on the reference image and the order of the current image.

  The service server 200 in step b) may include generating the route guidance information based on POI information convenient to the disabled person.

  According to the present invention, a wheelchair crawls information necessary for free movement on a road or humanitarian to generate a database on which road information is reflected, and provides a navigation service based on the generated database. There is an advantage that persons with disabilities can move safely.

It is a block diagram which shows the structure of the navigation service provision system for persons with disabilities concerning one example of the present invention. It is a flowchart which shows the service provision method using the navigation service provision system for persons with disabilities concerning one example of the present invention. It is a flowchart which shows the collection process of POI data of the service provision method using the navigation service provision system for persons with disabilities concerning FIG. 2 of this invention. It is a result of the image analysis which concerns on one Example of this invention. It is the navigation map on which POI (Point Of Interest) information convenient for the person with a disability concerning one example of the present invention was displayed.

  Hereinafter, preferred embodiments of a navigation service providing system and method according to the present invention will be described in detail with reference to the attached drawings.

  In the present specification, the expression "including" a certain component means that the component does not exclude other components, and may further include other components.

  Also, the terms “... Unit”, “... Machine”, “... Module” and the like mean a unit that processes at least one function or operation, and these may be hardware or software or both. Can be divided into

  FIG. 1 is a block diagram showing the configuration of a navigation service providing system for the disabled according to the present invention, and FIG. 2 is a flow chart showing a service providing method using the navigation service providing system for a disabled according to the present invention. FIG. 3 is a flowchart showing a process of collecting POI data of the service providing method using the navigation service providing system for a person with a disability according to FIG.

  Referring to FIGS. 1 to 3, the service providing system according to the present invention includes a navigation 100, a service server 200, a POI management server 300, and a crawling unit 400.

When the navigation 100 is connected to the service server 200 through a wireless network, position information is displayed on a map using a GPS signal, and arbitrary destination information input by the user is transmitted to the service server 200. Navigation map information including route guidance information for moving to the destination from the service server 200 and POI (Point Of Interest) information convenient for a disabled person, and displaying the navigation map information; There may be multiple navigations, such as 1 110, navigation 2 120, navigation n 130, and so on.

  The navigation 100 transmits movement information of the navigation 100 to the service server 200 based on GPS signals while moving according to the navigation map information.

  That is, it detects misguided information between the movement information by the navigation 100 and the route guidance information transmitted from the service server 200, the disconnection of the route, the disagreement information of the POI position convenient for obstacles, etc. and transmits it to the service server 200. Do.

  When the service server 200 receives the route guidance information for the destination requested by the navigation 100, the service server 200 searches the map database (not shown) for the route guidance information for moving to the destination.

  Also, the service server 200 receives POI information convenient for the disabled from the POI management server 300 connected through the network, merges it with the searched route guidance information, and generates navigation map information. The generated navigation map information is transmitted to the navigation 100. In one embodiment, the service server 200 can generate the route guidance information based on the POI information convenient for the disabled received from the POI management server 300. For example, the service server 200 can generate the route guidance information so as to be able to bypass the stairs or a road having a high level difference. Alternatively, the service server 200 can generate optimized route guidance information centering on a facility with a toilet for disabled persons and an elevator for disabled persons. Alternatively, the service server 200 can generate route guidance information centering on a Braille block.

  The navigation map information is provided in an arbitrary format including information on sidewalks and pedestrian crossings, elevator position information for crossing overpasses and underground roads, position information on lifts / lifts of wheelchairs, etc., so that wheelchairs can move. Displayed along with the travel route on the FIG. 5 shows navigation map information according to an embodiment. Referring to FIG. 5, a path on which a disabled person can travel (e.g., a sidewalk on which a wheelchair can travel) can be displayed as a pin (Pin).

  In addition, the navigation map information is provided as a movement path including a place where the step of the boundary stone where the wheelchair can move is low, using the height information of the boundary stone.

  Furthermore, the navigation map information may be transmitted as map information of 2D image or 3D image, and may be provided as including latitude and longitude information.

  In addition, the service server 200 receives movement information transmitted from the navigation 100 and transmits the movement information to the POI management server 300.

  The POI management server 300 analyzes POI information convenient for the disabled person collected from the crawling unit 400, and generates POI map information convenient for the disabled person matched with the prestored road information.

  In addition, the POI management server 300 provides the generated POI map information convenient for the disabled person to the service server 200 connected through the network, and analyzes the movement information of the navigation 100 transmitted from the service server 200. When the aspiration information is retrieved, the retrieved aspiration information is reflected on POI map information convenient for the disabled person and periodically updated and managed.

  That is, the POI management server 300 detects misguided information between the movement information by the navigation 100 and the route guidance information transmitted from the service server 200, leaving the route, misplaced POI information suitable for obstacles, etc. The information is compared with the information set in the POI map information convenient for the person with a disability, and the comparison result is managed such that correction etc. of the POI information convenient for the person with a disability is performed.

  The crawling unit 400 analyzes street view (or road view) image information and arbitrary image information collected through online or offline, and divides POI information convenient for a person with a disability, and the classified failure The POI information convenient for the user is input to the POI management server 300, and includes an online information collection unit 410 and an offline information collection unit 420.

  The online information collection unit 410 classifies the road blocks and boundary stones using an image processing program in which an image of a street view provided by any portal server connected through a network is stored in advance, and the classification is performed. It is configured to extract positional information of the Braille block and height information of the boundary stone from the image of the braille block and the boundary stone, and provide the information to the POI management server 300, including OPEN API, WEB CRAWLER, etc. It is.

  That is, Braille blocks can be extracted by classifying standardized shapes and unique hues (yellow), and boundary stones can be extracted by dividing the hues of roads, lanes, shapes of boundary stones, and the level difference with roads, etc. it can.

  In one embodiment, the original street view images provided by any portal server may be configured of a predetermined number of images per reference distance, and the online information collection unit 410 may generate the original street view images. Only a part can be crawled and used for analysis. For example, the original street view image can be configured with 60 images per 10 meters, and the online information collection unit 410 can sample and crawl only 20 of the 60 original images. .

  As one example, the online information collection unit 410 may classify an image including Braille blocks from the crawled image using a classification model. Learning on classification models can be done based on machine learning. For example, learning on a classification model can be performed by using as input a number of images containing braille blocks. Open source software such as Tensor Flow may be used as a classification model according to one embodiment, but should not be limited thereto.

FIG. 4 illustrates the result of classifying a plurality of images into block, road, and sidewalk according to one embodiment. For example, the online information collection unit 410 may classify the crawled street view image into one of a Braille block, a road, and a human road, and label the classified information. The on-line information collection unit 410 obtains the probability that the image of the current street view is the image of the Braille block, the probability of the image of the roadway, and the probability of the image of humanity based on the classification model. It is possible to determine an image of a street view in which is not less than a critical value as an image of a Braille block.

  Referring again to FIGS. 1 to 3, the on-line information collection unit 410 uses the classification model to classify an image such as a height difference of a step, a division to a slope, a division to a stair, etc. with respect to a crawled image. Work can be done further. Further image classification operations can be performed on images classified into images that include Braille blocks, but should not be limited thereto.

  In one embodiment, the online information collection unit 410 corrects the latitude and longitude information for the original street view image provided by the portal server to determine the latitude and longitude information for each of the crawled images. be able to. The online information collection unit 410 determines latitude and longitude information of the current image based on the latitude and longitude information provided by the arbitrary portal server and the order of the current image among the reference number of images. Can. For example, if the original street view image is composed of a predetermined number of images per reference distance, and the image allocated according to the reference distance is one frame, the latitude and longitude provided for each frame Corrections can be made to the information to provide latitude and longitude information for any image in the frame.

  For example, if there are 20 crawled images for each frame, the online information collection unit 410 may select the nth based on the first latitude and longitude information of the nth frame and the second latitude and longitude information for the n + 1th frame. The latitude and longitude information of the first image (that is, the first image among 20 images) included in the frame is 1/20 of the difference between the second latitude and longitude information and the first latitude and longitude information It can be corrected on the basis of.

  The on-line information collection unit 410 can transmit the extracted POI information convenient for the disabled person to the POI management server 300 together with the POI information of the surrounding buildings.

  The off-line information collection unit 420 is a POI management server using a wireless network, photographing means such as a camera (for example, 360 degree action cam), current position information using a GPS signal and image information photographed by the photographing means It is a configuration to be transmitted to 300, and the disabled person is an image of an arbitrary POI, that is, an image of a specific building, an overpass, an underpass, a public toilet, a ramp entrance of a building taken at a subway station, etc. The POI information convenient for the user is extracted and provided to the POI management server 300 together with the location information of the POI information convenient for the person with a disability.

  As an example, the off-line information collection unit 420 may be used to generate POI information convenient for the disabled to a place where the street view is not provided by the portal server. For example, in the case of a narrow road where cars can not pass easily and only people can pass, the off-line information collection unit 420 may be used for camera-captured images and / or people with disabilities who have acquired it directly. Such POI information can be sent to the cloud server (or POI management server 300). As one example, the POI convenient for the disabled sent from the offline information collection unit 420 to the cloud server may also be provided to the portal server, whereby the portal server is more extensive and accurate based on this. It becomes possible to secure various POI data.

  The POI information convenient for the disabled includes, but is not limited to, Braille blocks on the road, height of boundary stone, ramp entrance of a building, toilet, elevator information, etc., and various disabled people Facilities can be used as POI information.

  As one example, the image information collected by the off-line information collection unit 420 or the POI information convenient for the disabled can be provided to the POI management server 300 in conjunction with the image crawled by the on-line information collection unit 410. . For example, the image collected from the off-line information collection unit 420 can be merged with the original street view image and transmitted to the POI management server 300.

  Next, a service providing method of the system for providing a navigation service for the disabled according to the present invention will be described.

  The POI management server 300 stores POI information convenient for the disabled person collected through the crawling unit 400 in the database (S100).

  In the step of S100, the crawling unit 400 collects an image of a street view provided from any portal server connected through the network using the online information collection unit 410 consisting of OPEN API, WEB CRAWLER, etc. Classification of road blocks and boundary stones using stored image processing program, and extraction of position information of the Braille blocks and height information of boundary stones from images of the classified Braille blocks and boundary stones The stored POI information and position information convenient for the disabled person are stored in the database (S110).

  In addition, at the stage of S100, the crawling unit 400 uses the off-line information collection unit 420 to enter a ramp entrance of a building taken at a particular building, viaduct, underground road, public toilet, subway station, etc. POI information convenient for the disabled person is extracted from the image obtained by photographing the toilet entrance, elevator entrance etc. through the image processing program, and the position information of the POI information convenient for the extracted disabled person is stored in the database (S120).

  Furthermore, in the step S100, the crawling unit 400 can classify the image including the Braille block from the image of the street view provided from the arbitrary portal server using the classification model. Learning on classification models can be done based on machine learning. For example, learning on a classification model can be performed by using as input a number of images containing braille blocks. Open source software such as Tensor Flow may be used as a classification model according to one embodiment, but should not be limited thereto.

  In addition, in step S100, the crawling unit 400 may use latitude and longitude information for the original street view image provided by the portal server to determine information on latitude and longitude for each of the crawled images. It can be corrected. The crawling unit 400 may obtain latitude and longitude information of the current image based on the latitude and longitude information provided by the arbitrary portal server and the order of the current image among the reference number of images. For example, if the original street view image is composed of a predetermined number of images per reference distance, and the image allocated according to the reference distance is one frame, latitude and longitude information provided for each frame Corrections can be made to provide latitude and longitude information for any image in the frame.

For example, if there are 20 crawled images for each frame, the crawling unit 400 may use the nth frame based on the first latitude and longitude information of the nth frame and the second latitude and longitude information for the n + 1th frame. The first image contained in (ie 2
The latitude and longitude information of the first image (0 images) can be corrected based on 1/20 of the difference between the second latitude and longitude information and the first latitude and longitude information.

  After performing the step of S100, the POI management server 300 updates the database stored in the step of S100 by reflecting POI information and road information convenient for the disabled person, and using the updated information. Then, POI map information convenient for the disabled person is generated (S200).

  The POI map information convenient for the disabled person generated at the step S200 is provided to the service server 200, and the service server 200 detects a request for navigation service (S300).

  In the step of S300, when an arbitrary navigation 100 connects to the service server 200 to request provision of navigation map information, the service server 200 guides information for moving to a destination input by the navigation 100. Is generated from map information stored in advance, navigation map information including the searched route guidance information and POI map information convenient for the disabled person provided by the POI management server 300 is generated, and Send (S400).

  As one example, the service server 200 may generate the route guidance information based on the POI information convenient for the disabled received from the POI management server 300. For example, the service server 200 can generate route guidance information such that stairs or high-step roads can be diverted. Alternatively, the service server 200 can generate optimized route guidance information centering on a facility with a toilet for disabled persons and an elevator for disabled persons. Alternatively, the service server 200 can generate route guidance information centering on a Braille block.

  After performing the step of S400, the service server 200 receives the movement information transmitted to the navigation 100 while providing the navigation service, and transmits the movement information of the received navigation 100 to the POI management server 300. The POI management server 300 analyzes movement information of the navigation 100 (S500).

In the step of S500, when various error information including a guidance error, a route departure, a position mismatch of POI convenient for an obstacle, etc. are searched from the movement information of the navigation 100, the POI management server 300 detects the error The information is analyzed and reflected in POI map information convenient for the disabled person (S600).

  Therefore, a wheelchair can safely travel to a specific destination by crawling information necessary for free movement on the road or humanitarianism and providing navigation services that reflect the relevant road information. Will be able to

  Although the foregoing has described the preferred embodiments of the present invention as an example, those skilled in the art will appreciate that the present invention may be practiced without departing from the spirit and scope of the invention as set forth in the appended claims. It can be understood that the invention can be modified and changed in many ways.

In addition, drawing reference numerals described in the claims of the present invention are merely described for the sake of clarity of the description for convenience, and should not be limited to these, and it should be noted that the drawings in the process of describing the embodiments. The thickness of the indicated line, the size of the component, etc. may be exaggerated for the clarity of the explanation and the convenience, and the terms described above are terms defined in consideration of the function of the present invention Since this may change depending on the intention or practice of the user or operator, interpretation for such terms should be made based on the contents throughout the present specification.

Claims (11)

Navigation map information including route guidance information for moving to an arbitrary destination from the service server 200 and POI (Point Of Interest) information convenient for the disabled person is received and displayed, and movement based on GPS signals A navigation 100 for sending information to the service server 200;
Navigation map information including the route guidance information searched for moving to the destination and the POI information convenient for the disabled person provided from the POI management server 300 is transmitted to the navigation 100 and transmitted from the navigation 100 A service server 200 for transmitting the transfer information to the POI management server 300;
The POI information convenient for the disabled collected from the crawling unit 400 is analyzed to generate POI map information convenient for the disabled matching the road information, and the generated POI map information for the disabled is the service server 200. A POI management server 300 which is provided to 200 and manages error information retrieved from the navigation server 100 by analyzing movement information of the navigation 100 transmitted from the service server 200 so as to be reflected in the navigation map information.
The system for providing a navigation service for the disabled, including a crawling unit 400 which inputs POI information convenient for the disabled and collected through online and offline into the POI management server 300.   The navigation service according to claim 1, wherein the POI information convenient for the disabled person includes at least one of a Braille block on a road, a height of a boundary stone, a ramp entrance of a building, a toilet or elevator information. Provision system. The crawling unit 400 analyzes an image of a street view provided from any portal server connected through a network to extract position information of a Braille block of a road and height information of a boundary stone, and the POI management An online information collection unit 410 provided to the server 300;
3. The navigation service for the disabled according to claim 2, further comprising: an off-line information collection unit 420 for extracting information on a ramp entrance of a building, a toilet or an elevator from an image captured by an arbitrary POI and providing the same to the POI management server 300. Provision system.   The navigation service according to claim 3, wherein the online information collection unit 410 classifies an image including a Braille block from the image of the street view provided from the arbitrary portal server using a classification model. system. The image of the street view provided by the optional portal server comprises a reference number of images per reference distance,
The on-line information collection unit 410 may use the latitude and longitude information of the current image based on the latitude and longitude information provided from the arbitrary portal server and the order of the current image among the reference number of images. The navigation service providing system for a person with a disability according to claim 3, which decides.   The navigation service providing system according to claim 1, wherein the service server (200) generates the route guidance information based on POI information convenient for the disabled person. a) The POI management server 300 collects POI information convenient for the disabled through the crawling unit 400, generates a database, reflects the road information in the generated database, and updates the database;
b) When the optional navigation 100 connects to the service server 200 and requests provision of navigation map information, the service server 200 is provided from the POI management server 300 with the route guidance information searched for moving to the destination. Generating navigation map information including POI map information convenient for persons with disabilities and transmitting it to the navigation 100;
c) When the service server 200 receives movement information of the navigation 100, the received movement information of the navigation 100 is transmitted to the POI management server 300, and the POI management server 300 analyzes the movement information of the navigation 100. And searching for the aspiration information and reflecting the retrieved aspiration information in the POI map information of the disabled person. The crawling unit 400 in the above a) connects with any portal server through a network, analyzes the image of the street view provided from the portal server, and detects the position information of the Braille block of the road and the height information of the boundary stone Stage of extracting
The method for providing a navigation service for the disabled according to claim 7, further comprising the steps of: analyzing an image taken with an arbitrary POI to extract ramp information, toilet or elevator information of a building.   The obstacle according to claim 8, wherein the crawling unit 400 in the step a) classifies an image including a Braille block from the image of the street view provided from the any portal server using a classification model. Navigation service provision method for the disabled. The image of the street view provided by the optional portal server comprises a reference number of images per reference distance,
The crawling unit 400 of the step a) performs latitude and longitude information of the current image based on the latitude and longitude information provided from the arbitrary portal server and the order of the current image among the reference number of images. The method for providing navigation service for the disabled according to claim 8, comprising the step of determining The method according to claim 7, wherein the service server 200 in step b) generates the route guidance information based on POI information convenient for the disabled person.