Embodiment
Below by drawings and Examples, the technical scheme of the embodiment of the invention is described in further detail.
Fig. 1 is the process flow diagram of the embodiment of the invention one road information acquisition method.As shown in Figure 1, present embodiment specifically comprises the steps:
Step 101, employing camera head are gathered pavement image;
Step 102, pavement image and images and standard images in image database are carried out classification and matching;
Can comprise before this step: the road pavement image carries out feature extraction.
This step can be specially: according to the result of feature extraction, judge the standard picture that whether exists in the picture database with the pavement image coupling.
Step 103, when the standard picture that exists in the picture database with the pavement image coupling, obtain the information of road surface of standard picture correspondence;
Step 104, voice suggestion information of road surface.
Present embodiment obtains the corresponding information of road surface of standard picture that mates with pavement image, this information of road surface of voice suggestion by gathering pavement image after carrying out classification and matching.For the blind person, by the method that present embodiment provides, the blind person need not blind man's stick can learn information of road surface timely and conveniently.
Fig. 2 is the process flow diagram of the embodiment of the invention two road information acquisition methods.It is that example describes that present embodiment obtains information of road surface with mobile phone, and mobile phone is the means of communication that a kind of people often carry, and for the blind person, is the most easily if the mobile phone of oneself has the function of obtaining and pointing out information of road surface.The standard picture of various sidewalk for visually impaired people sign has been preserved in store picture data storehouse in advance in the mobile phone in this picture database.
As shown in Figure 2, present embodiment specifically comprises the steps:
The camera collection pavement image of step 201, mobile phone.
The blind person aims at the road surface of front all the time with the camera of mobile phone in use, and camera is gathered pavement image in real time.
Step 202, road pavement image carry out feature extraction.
Present embodiment can carry out edge and feature extraction by the road pavement image, extracts edge and characteristic information.
Step 203, according to edge and characteristic information, pavement image and images and standard images in image database are carried out classification and matching, just, judge the standard picture that whether exists in the picture database with pavement image coupling, if then execution in step 205; Otherwise execution in step 204.
If there is the standard picture that mates with pavement image in the picture database, illustrate that the position of the camera shooting of user mobile phone this moment is the sidewalk for visually impaired people, pavement image is the pavement image of sidewalk for visually impaired people sign; If there is not the standard picture that mates with pavement image in the picture database, illustrate that the position of the camera shooting of user mobile phone is not the sidewalk for visually impaired people or departs from the sidewalk for visually impaired people.
Step 204, voice suggestion user adjust camera position, execution in step 201.
When the position that the camera of user mobile phone is taken is not sidewalk for visually impaired people or when departing from the sidewalk for visually impaired people, the voice prompt of mobile phone user adjusts camera position.
Step 205, obtain the information of road surface of standard picture correspondence.
According to the standard picture of pavement image coupling, mobile phone can obtain its corresponding information of road surface.
Step 206, judge whether information of road surface and the last information of road surface that obtains are forthright information, if then execution in step 207; Otherwise execution in step 208.
The information of road surface that the last herein information of road surface that obtains obtains when being meant the pavement image of handling the last shooting of camera.
If information of road surface is forthright information with the last information of road surface that obtains, illustrate that then the user walks this moment on forthright; Otherwise, illustrate that the user walks this moment on domain transformation, or the user walks on non-forthright.
Step 207, judge whether the current time surpass the schedule time apart from time of last voice suggestion information of road surface, if then execution in step 208; Otherwise execution in step 201.
This schedule time can be 30s or 1min.
Step 208, voice suggestion user information of road surface, execution in step 201.
In the present embodiment, user's picture database in the mobile phone that can customize or upgrade.Like this, when changing,, need not to change algorithm, and, can be fit to the demand of different regions by the customization picture database by the upgrading picture database when sidewalk for visually impaired people sign increase or because of areal variation.
Present embodiment obtains the corresponding information of road surface of standard picture that mates with pavement image, this information of road surface of voice suggestion by gathering pavement image after the classification and matching success.For the blind person, by the method that present embodiment provides, the blind person need not blind man's stick can learn information of road surface timely and conveniently.After the classification and matching failure, mobile phone can the voice suggestion user be adjusted camera position, in order to obtain information of road surface accurately.If user's walking is on forthright, mobile phone can be pointed out information of road surface every the schedule time; If information of road surface changes, or user walking is on non-forthright, and mobile phone can be prompted to the user with information of road surface in real time, guarantees that the user is current smoothly.
Fig. 3 obtains the structural representation of equipment for embodiment of the invention information of road surface.As shown in Figure 3, present embodiment specifically comprises: acquisition module 11, matching module 12, acquisition module 13 and reminding module 14, and wherein, acquisition module 11 is used to gather pavement image; Matching module 12 is used for pavement image and images and standard images in image database are carried out classification and matching; Acquisition module 13 is used for obtaining the information of road surface of standard picture correspondence when there is the standard picture that mates with pavement image in picture database; Reminding module 14 is used for the voice suggestion information of road surface.
Further, present embodiment can also comprise characteristic extracting module 15, and this characteristic extracting module 15 is used for the road pavement image and carries out feature extraction.Above-mentioned matching module 12 specifically is used for the result according to feature extraction, and pavement image and images and standard images in image database are carried out classification and matching.
The information of road surface that present embodiment provides obtains equipment can be a separate equipment, and the electronic equipment as mobile phone, PDA or video camera etc. are convenient to carry also can be the part in the above-mentioned electronic equipment of being convenient to carry.With the mobile phone is example, and acquisition module can be specially the camera in the mobile phone, and the user aims at the road surface of front all the time with the camera of mobile phone in use, and camera is gathered pavement image in real time; Characteristic extracting module can be carried out edge and feature extraction by the road pavement image, extracts edge and characteristic information; Matching module can be judged the standard picture that whether exists in the picture database with the pavement image coupling; When matching module was judged in the picture database standard picture that exists with the pavement image coupling, acquisition module obtained the information of road surface of standard picture correspondence; Reminding module voice suggestion information of road surface.
Above-mentioned reminding module 14 can also be used for when there is not the standard picture that mates with pavement image in picture database, and camera position is adjusted in voice suggestion.Like this, when the position that the camera of user mobile phone is taken be not sidewalk for visually impaired people or when departing from the sidewalk for visually impaired people, mobile phone can the voice suggestion user be adjusted camera position.
Further again, present embodiment can also comprise first judge module 16 and second judge module 17, and wherein, first judge module 16 is used to judge whether information of road surface and the last information of road surface that obtains are forthright information; Second judge module 17 is used for when first judge module 16 is judged information of road surface and is forthright information with the last information of road surface that obtains, judge the current time apart from time of last voice suggestion information of road surface whether above the schedule time.Above-mentioned reminding module 14 specifically is used for when first judge module 16 is judged information of road surface and is not forthright information with the last information of road surface that obtains, or judge the current time when surpassing the schedule time, the voice suggestion information of road surface when second judge module 17 apart from time of last voice suggestion information of road surface.By first judge module 16 and second judge module 17 are set, make that mobile phone can be pointed out information of road surface every the schedule time when user's walking is on forthright; When information of road surface changes, or user's walking is on non-forthright the time, and mobile phone can be prompted to the user with information of road surface in real time, thereby guarantees that the user is current smoothly.
Present embodiment can also comprise upgrading module 18, and this upgrading module 18 is used to the picture database of upgrading.Like this, when changing,, need not to change algorithm, can be fit to the demand of different regions by upgrading module 18 upgrading picture databases when sidewalk for visually impaired people sign increase or because of areal variation.
Present embodiment obtains the corresponding information of road surface of standard picture that mates with pavement image, this information of road surface of voice suggestion by gathering pavement image after carrying out classification and matching.For the blind person, by the equipment that present embodiment provides, the blind person need not blind man's stick can learn information of road surface timely and conveniently.
One of ordinary skill in the art will appreciate that: all or part of step that realizes said method embodiment can be finished by the relevant hardware of programmed instruction, aforesaid program can be stored in the computer read/write memory medium, this program is when carrying out, execution comprises the step of said method embodiment, and aforesaid storage medium comprises: various media that can be program code stored such as ROM, RAM, magnetic disc or CD.
It should be noted that at last: above embodiment only in order to the technical scheme of the explanation embodiment of the invention, is not intended to limit; Although the embodiment of the invention is had been described in detail with reference to previous embodiment, those of ordinary skill in the art is to be understood that: it still can be made amendment to the technical scheme that aforementioned each embodiment put down in writing, and perhaps part technical characterictic wherein is equal to replacement; And these modifications or replacement do not make the essence of appropriate technical solution break away from the spirit and scope of each embodiment technical scheme of the embodiment of the invention.