CN104219628A - Blind person information service method and blind person information service system based on enhancement of combination of reality with smart phone - Google Patents
Blind person information service method and blind person information service system based on enhancement of combination of reality with smart phone Download PDFInfo
- Publication number
- CN104219628A CN104219628A CN201410439132.4A CN201410439132A CN104219628A CN 104219628 A CN104219628 A CN 104219628A CN 201410439132 A CN201410439132 A CN 201410439132A CN 104219628 A CN104219628 A CN 104219628A
- Authority
- CN
- China
- Prior art keywords
- module
- instruction
- blind person
- information service
- article
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Landscapes
- Navigation (AREA)
Abstract
The invention provides a blind person information service method and a blind person information service system based on enhancement of combination of the reality with a smart phone. The method includes the steps of voice signal acquisition, instruction header matching, instruction content matching, execution instruction sending, turn-on instruction sending, data getting, real-time service and service termination. The system comprises a real-time voice acquisition module, a matching failure processing module, an equipment turn-on module, a navigation module, an instruction header matching module, an instruction content matching module, an execution instruction sending module and an instruction executing module. The method and the system have the advantages that by means of enhancement of effective combination of the reality technology with the smart phone, perception capability of blind persons for the reality can be enhanced effectively, and living quality of the blind persons is improved.
Description
Technical field
The present invention relates to a kind of information service method and system, especially a kind of information service method for blind person and system.
Background technology
Along with the development of mobile Internet and smart mobile phone, by position and ubiquitous wireless network, people use smart mobile phone to download Mobile solution, enjoy whenever and wherever possible to navigate, shopping, the various Informatization Service such as amusement, the extreme enrichment life of people.Particularly by means of the construction of the cordless communication networks such as 4G, WIFI at a high speed, based on the glasses of augmented reality, the helmet, navigation, the Mobile solution such as game also get more and more.By augmented reality and smart mobile phone, by virtual Information application to real world, for many applications such as amusement, traffic, life provide a great convenience.
Current augmented reality application, mostly synthesizes the shooting interface of virtual information and mobile phone camera, then maps on mobile phone display screen, is supplied to people's viewing.Such as in the real scene navigation application of augmented reality application, apply based on real picture captured by mobile phone camera, in conjunction with mobile phone sensor such as GPS, gyroscope, earth magnetism, judge the position residing for current people and direction; Obtain the guidance path needed for people by wireless network again, in street, crossing, the region such as market, by mobile phone display screen in camera picture, Overlapping display goes out the guidance paths such as left-hand rotation, right-hand rotation.For ordinary people, by watching the means of display screen, obtain augmented reality information without a doubt.But for blind person, the eyesights such as the elderly have the special population of obstacle, they cannot watch mobile phone display screen clearly, and therefore current augmented reality application cannot provide effective support for this kind of special population.
China is one of country that whole world blind person is maximum, and eye disease is also a main public health problem in China.About there is blind person 600-700 ten thousand in China, accounts for 18% of world blind person sum, separately has eyes low visual acuity patient 1,200 ten thousand.For this kind of special population, the application at present for blind person is really confined to navigation field, announcing in the navigation application patent based on blind person, mostly utilizes GPS or GPRS location technology, for blind person provides the service of path navigation.Adopt GPS or GPRS location, higher in the depletion region precision of outdoor; But in built-up down town or indoor place, positioning precision is low, and due to the road conditions in down town or indoor place very complicated, existing based on GPS or GPRS location navigation system for blinds be difficult to be used widely.In addition, the life requirement of blind person is the same with ordinary people, is not merely traffic trip, and existing blind person application cannot meet other demands such as they life, amusement.
Summary of the invention
The technical problem to be solved in the present invention is that existing blind guiding system only has navigation feature, can't meet the demand of the aspects such as article identification.
In order to solve the problems of the technologies described above, the invention provides a kind of blind person's information service method based on augmented reality and smart mobile phone, comprise smart mobile phone and server, smart mobile phone comprises cell phone processor, camera, microphone, loud speaker, mobile phone wireless communication module and GPS/LBS locating module, camera, microphone, loud speaker, mobile phone wireless communication module and GPS/LBS locating module are all connected with cell phone processor, camera is right against the dead ahead of blind users, described server comprises controller, database and server wireless communication module, mobile phone wireless communication module and the wireless connections of server wireless communication module, be specially following steps:
Step 1, the voice signal that cell phone processor real-time reception microphone gathers, and in chronological sequence voice signal is sent to server by order one by one;
Step 2, it is corresponding that the voice signal of reception and the instruction head preset in database are carried out coupling by controller, instruction head shows whether voice signal is blind person's information service instruction, if the blind person's information service instruction preset, then enter step 4, if not the blind person's information service instruction preset, then return the unsuccessful information of coupling by controller to cell phone processor, and enter step 3;
Step 3, cell phone processor, after receiving the unsuccessful information of coupling, sends the unsuccessful voice broadcast instruction of coupling to loud speaker, and returns step 1;
Step 4, it is corresponding that the voice signal of reception and the command content preset in database are carried out coupling by controller, command content shows blind person's information service project that voice signal needs perform, blind person's information service project comprises navigation, shopping and search article, if the blind person's information service project preset, then further voice signal is identified, extract and obtain corresponding service item keyword, service item keyword comprises the title of the destination of navigation, the destination of shopping and article;
Step 5, controller sends to cell phone processor and performs instruction accordingly, if blind person's information service project is navigating items or shopping project, then send to cell phone processor and open the instruction of GPS/LBS locating module, if blind person's information service project is search item of articles, then sends to cell phone processor and open camera instruction;
Step 6, cell phone processor opens GPS/LBS locating module or camera according to execution instruction, gathers, and the positional information of collection or image are sent to controller to current location information or image;
Step 7, controller carries out respective handling according to blind person's information service project, if blind person's information service project is navigating items, then controller inquires about suitable navigation way in a database according to the destination of positional information and navigation, again navigation way is sent to cell phone processor, if blind person's information service project is shopping project, then controller inquires about suitable shopping route in a database according to positional information and shopping destination, again shopping route is sent to cell phone processor, if blind person's information service project is search article, then first controller inquires about corresponding article characteristics in a database according to Item Title, again article characteristics and image are carried out coupling corresponding, if there are the article of character pair in image, then judge these article relative position in the picture further, again relative position is sent to cell phone processor, if there are not the article of character pair in image, then send to cell phone processor and open camera instruction, and return step 6,
Step 8, cell phone processor receives navigation way, shopping route or article relative position in the picture, and send voice broadcast instruction to loud speaker, navigation way, shopping route or article relative position are in the picture reported out in the form of speech, again in conjunction with the GPS/LBS locating module of real-time reception or the positional information of camera collection or image, real-time update navigation way, shopping route or article relative position in the picture, and the navigation way of renewal, shopping route or article relative position are in the picture reported out in the form of speech.
Adopt cell phone processor real-time reception voice signal, voice signal is analyzed and just can obtain corresponding instruction, and just can open correlation function without the need to other auxiliary touches, be more applicable to blind person and use, improve the convenience of use; Adopt image to carry out the relative position of identify objects, blind person's fast search can be helped to the article wanting to obtain, enhance the functional of use; Adopt the navigation of shopping route and judge that article relative position in the picture combines, blind person can be facilitated to go out shopping, improve the quality of life of blind person; The realization of the method only needs a smart mobile phone, implements more convenient and cost is also very low.
Scheme as a further improvement on the present invention, also comprise step 9, cell phone processor judges whether the dead ahead arriving the destination of navigation, the destination of shopping or be positioned at article according to real-time navigation way, shopping route or article relative position in the picture, if arrived the destination of navigation, the destination of shopping or be positioned at the dead ahead of article, then send voice alerting instruction to loud speaker.By sending voice alerting instruction to loud speaker, when arriving the destination of navigation, the destination of shopping or be positioned at the dead ahead of article, prompting service for blind readers project completes, and blind person is known, and service completes.
As further restriction scheme of the present invention, relative position comprise left side, right side, upside, downside and just before.By arranging left side, right side, upside, downside and just the first five relative position relation, be convenient to the position of accurate blind person's judgement place article.
Present invention also offers a kind of blind person's information service system based on augmented reality and smart mobile phone, comprise smart mobile phone and server, smart mobile phone comprises cell phone processor, camera, microphone, loud speaker, mobile phone wireless communication module and GPS/LBS locating module, camera, microphone, loud speaker, mobile phone wireless communication module and GPS/LBS locating module are all connected with cell phone processor, camera is right against the dead ahead of blind users, server comprises controller, database and server wireless communication module, mobile phone wireless communication module and the wireless connections of server wireless communication module, cell phone processor comprises real-time voice acquisition module, mate unsuccessful processing module, opening of device module and navigation module, controller comprises instruction head matching module, command content matching module, perform instruction sending module and instruct execution module,
Real-time voice acquisition module, for the voice signal that real-time reception microphone gathers, and in chronological sequence voice signal is sent to instruction head matching module by order one by one;
Mate unsuccessful processing module, for after receiving the unsuccessful information of coupling, send the unsuccessful voice broadcast instruction of coupling to loud speaker, and start real-time voice acquisition module;
Opening of device module, for opening GPS/LBS locating module or camera according to execution instruction, gathering current location information or image, and the positional information of collection or image is sent to controller;
Navigation module, for receiving navigation way, shopping route or article relative position in the picture, and send voice broadcast instruction to loud speaker, navigation way, shopping route or article relative position are in the picture reported out in the form of speech, again in conjunction with the GPS/LBS locating module of real-time reception or the positional information of camera collection or image, real-time update navigation way, shopping route or article relative position in the picture, and the navigation way of renewal, shopping route or article relative position are in the picture reported out in the form of speech;
Instruction head matching module, corresponding for the voice signal of reception and the instruction head preset in database being carried out coupling, instruction head shows whether voice signal is blind person's information service instruction, if the blind person's information service instruction preset, then enabled instruction content matching module, if not the blind person's information service instruction preset, then return the unsuccessful information of coupling to the unsuccessful processing module of coupling, and start the unsuccessful processing module of coupling;
Command content matching module, corresponding for the voice signal of reception and the command content preset in database being carried out coupling, command content shows blind person's information service project that voice signal needs perform, blind person's information service project comprises navigation, shopping and search article, if the blind person's information service project preset, then further voice signal is identified, extract and obtain corresponding service item keyword, service item keyword comprises the title of the destination of navigation, the destination of shopping and article, and starts and perform instruction sending module;
Perform instruction sending module, for performing instruction according to blind person's information service project accordingly to the transmission of opening of device module, if blind person's information service project is navigating items or shopping project, then send to opening of device module and open the instruction of GPS/LBS locating module, if blind person's information service project is search item of articles, then sends to opening of device module and open camera instruction;
Instruct execution module, for carrying out respective handling according to blind person's information service project, if blind person's information service project is navigating items, then inquire about suitable navigation way in a database according to the destination of positional information and navigation, again navigation way is sent to navigation module, if blind person's information service project is shopping project, then inquire about suitable shopping route in a database according to positional information and shopping destination, again shopping route is sent to navigation module, if blind person's information service project is search article, then first inquire about corresponding article characteristics in a database according to Item Title, again article characteristics and image are carried out coupling corresponding, if there are the article of character pair in image, then judge these article relative position in the picture further, again relative position is sent to navigation module, if there are not the article of character pair in image, then send to opening of device module and open camera instruction, and starting device opening module.
Beneficial effect of the present invention is: (1) adopts cell phone processor real-time reception voice signal, voice signal is analyzed and just can obtain corresponding instruction, and just can open correlation function without the need to other auxiliary touches, being more applicable to blind person uses, and improves the convenience of use; (2) adopt image to carry out the relative position of identify objects, blind person's fast search can be helped to the article wanting to obtain, enhance the functional of use; (3) adopt the navigation of shopping route and judge that article relative position in the picture combines, blind person can be facilitated to go out shopping, improve the quality of life of blind person; (4) realization of this method only needs a smart mobile phone, the form of voice is provided to show the real time information that mobile phone can obtain, for blind person provides a kind of implementation method of augmented reality, and implement also more convenient and cost is also very low.
Accompanying drawing explanation
Fig. 1 is method flow diagram of the present invention;
Fig. 2 is system configuration schematic diagram of the present invention.
Embodiment
As shown in Figure 1, the blind person's information service method based on augmented reality and smart mobile phone of the present invention, specifically comprises the steps:
Step 1, the voice signal that cell phone processor real-time reception microphone gathers, and in chronological sequence voice signal is sent to server by order one by one;
Step 2, it is corresponding that the voice signal of reception and the instruction head preset in database are carried out coupling by controller, instruction head shows whether voice signal is blind person's information service instruction, if the blind person's information service instruction preset, then enter step 4, if not the blind person's information service instruction preset, then return the unsuccessful information of coupling by controller to cell phone processor, and enter step 3;
Step 3, cell phone processor, after receiving the unsuccessful information of coupling, sends the unsuccessful voice broadcast instruction of coupling to loud speaker, and returns step 1;
Step 4, it is corresponding that the voice signal of reception and the command content preset in database are carried out coupling by controller, command content shows blind person's information service project that voice signal needs perform, blind person's information service project comprises navigation, shopping and search article, if the blind person's information service project preset, then further voice signal is identified, extract and obtain corresponding service item keyword, service item keyword comprises the title of the destination of navigation, the destination of shopping and article;
Step 5, controller sends to cell phone processor and performs instruction accordingly, if blind person's information service project is navigating items or shopping project, then send to cell phone processor and open the instruction of GPS/LBS locating module, if blind person's information service project is search item of articles, then sends to cell phone processor and open camera instruction;
Step 6, cell phone processor opens GPS/LBS locating module or camera according to execution instruction, gathers, and the positional information of collection or image are sent to controller to current location information or image;
Step 7, controller carries out respective handling according to blind person's information service project, if blind person's information service project is navigating items, then controller inquires about suitable navigation way in a database according to the destination of positional information and navigation, again navigation way is sent to cell phone processor, if blind person's information service project is shopping project, then controller inquires about suitable shopping route in a database according to positional information and shopping destination, again shopping route is sent to cell phone processor, if blind person's information service project is search article, then first controller inquires about corresponding article characteristics in a database according to Item Title, again article characteristics and image are carried out coupling corresponding, if there are the article of character pair in image, then judge these article relative position in the picture further, wherein, relative position comprises left side, right side, upside, downside and just before, again relative position is sent to cell phone processor, if there are not the article of character pair in image, then send to cell phone processor and open camera instruction, and return step 6,
Step 8, cell phone processor receives navigation way, shopping route or article relative position in the picture, and send voice broadcast instruction to loud speaker, navigation way, shopping route or article relative position are in the picture reported out in the form of speech, again in conjunction with the GPS/LBS locating module of real-time reception or the positional information of camera collection or image, real-time update navigation way, shopping route or article relative position in the picture, and the navigation way of renewal, shopping route or article relative position are in the picture reported out in the form of speech;
Know that in order to enable blind person further service completes, method of the present invention also comprises step 9, cell phone processor judges whether the dead ahead arriving the destination of navigation, the destination of shopping or be positioned at article according to real-time navigation way, shopping route or article relative position in the picture, if arrived the destination of navigation, the destination of shopping or be positioned at the dead ahead of article, then send voice alerting instruction to loud speaker.
Adopt cell phone processor real-time reception voice signal, voice signal is analyzed and just can obtain corresponding instruction, and just can open correlation function without the need to other auxiliary touches, be more applicable to blind person and use, improve the convenience of use; Adopt image to carry out the relative position of identify objects, blind person's fast search can be helped to the article wanting to obtain, enhance the functional of use; Adopt the navigation of shopping route and judge that article relative position in the picture combines, blind person can be facilitated to go out shopping, improve the quality of life of blind person; The realization of the method only needs a smart mobile phone, implements more convenient and cost is also very low.
As shown in Figure 2, blind person's information service system based on augmented reality and smart mobile phone of the present invention, comprise smart mobile phone and server, smart mobile phone comprises cell phone processor, camera, microphone, loud speaker, mobile phone wireless communication module and GPS/LBS locating module, camera, microphone, loud speaker, mobile phone wireless communication module and GPS/LBS locating module are all connected with cell phone processor, camera is right against the dead ahead of blind users, server comprises controller, database and server wireless communication module, mobile phone wireless communication module and the wireless connections of server wireless communication module, cell phone processor comprises real-time voice acquisition module, mate unsuccessful processing module, opening of device module and navigation module, controller comprises instruction head matching module, command content matching module, perform instruction sending module and instruct execution module,
Real-time voice acquisition module, for the voice signal that real-time reception microphone gathers, and in chronological sequence voice signal is sent to instruction head matching module by order one by one;
Mate unsuccessful processing module, for after receiving the unsuccessful information of coupling, send the unsuccessful voice broadcast instruction of coupling to loud speaker, and start real-time voice acquisition module;
Opening of device module, for opening GPS/LBS locating module or camera according to execution instruction, gathering current location information or image, and the positional information of collection or image is sent to controller;
Navigation module, for receiving navigation way, shopping route or article relative position in the picture, and send voice broadcast instruction to loud speaker, navigation way, shopping route or article relative position are in the picture reported out in the form of speech, again in conjunction with the GPS/LBS locating module of real-time reception or the positional information of camera collection or image, real-time update navigation way, shopping route or article relative position in the picture, and the navigation way of renewal, shopping route or article relative position are in the picture reported out in the form of speech;
Instruction head matching module, corresponding for the voice signal of reception and the instruction head preset in database being carried out coupling, instruction head shows whether voice signal is blind person's information service instruction, if the blind person's information service instruction preset, then enabled instruction content matching module, if not the blind person's information service instruction preset, then return the unsuccessful information of coupling to the unsuccessful processing module of coupling, and start the unsuccessful processing module of coupling;
Command content matching module, corresponding for the voice signal of reception and the command content preset in database being carried out coupling, command content shows blind person's information service project that voice signal needs perform, blind person's information service project comprises navigation, shopping and search article, if the blind person's information service project preset, then further voice signal is identified, extract and obtain corresponding service item keyword, service item keyword comprises the title of the destination of navigation, the destination of shopping and article, and starts and perform instruction sending module;
Perform instruction sending module, for performing instruction according to blind person's information service project accordingly to the transmission of opening of device module, if blind person's information service project is navigating items or shopping project, then send to opening of device module and open the instruction of GPS/LBS locating module, if blind person's information service project is search item of articles, then sends to opening of device module and open camera instruction;
Instruct execution module, for carrying out respective handling according to blind person's information service project, if blind person's information service project is navigating items, then inquire about suitable navigation way in a database according to the destination of positional information and navigation, again navigation way is sent to navigation module, if blind person's information service project is shopping project, then inquire about suitable shopping route in a database according to positional information and shopping destination, again shopping route is sent to navigation module, if blind person's information service project is search article, then first inquire about corresponding article characteristics in a database according to Item Title, again article characteristics and image are carried out coupling corresponding, if there are the article of character pair in image, then judge these article relative position in the picture further, wherein, relative position comprises left side, right side, upside, downside and just before, again relative position is sent to navigation module, if there are not the article of character pair in image, then send to opening of device module and open camera instruction, and starting device opening module.
Information transmission in native system between smart mobile phone and server is all completed by the radio communication between mobile phone wireless communication module and server wireless communication module.
Claims (4)
1. the blind person's information service method based on augmented reality and smart mobile phone, comprise smart mobile phone and server, described smart mobile phone comprises cell phone processor, camera, microphone, loud speaker, mobile phone wireless communication module and GPS/LBS locating module, described camera, microphone, loud speaker, mobile phone wireless communication module and GPS/LBS locating module are all connected with cell phone processor, described camera is right against the dead ahead of blind users, described server comprises controller, database and server wireless communication module, described mobile phone wireless communication module and the wireless connections of server wireless communication module, it is characterized in that, be specially following steps:
Step 1, the voice signal that cell phone processor real-time reception microphone gathers, and in chronological sequence voice signal is sent to server by order one by one;
Step 2, it is corresponding that the voice signal of reception and the instruction head preset in database are carried out coupling by controller, described instruction head shows whether voice signal is blind person's information service instruction, if the blind person's information service instruction preset, then enter step 4, if not the blind person's information service instruction preset, then return the unsuccessful information of coupling by controller to cell phone processor, and enter step 3;
Step 3, cell phone processor, after receiving the unsuccessful information of coupling, sends the unsuccessful voice broadcast instruction of coupling to loud speaker, and returns step 1;
Step 4, it is corresponding that the voice signal of reception and the command content preset in database are carried out coupling by controller, described command content shows blind person's information service project that voice signal needs perform, described blind person's information service project comprises navigation, shopping and search article, if the blind person's information service project preset, then further voice signal is identified, extract and obtain corresponding service item keyword, described service item keyword comprises the title of the destination of navigation, the destination of shopping and article;
Step 5, controller sends to cell phone processor and performs instruction accordingly, if blind person's information service project is navigating items or shopping project, then send to cell phone processor and open the instruction of GPS/LBS locating module, if blind person's information service project is search item of articles, then sends to cell phone processor and open camera instruction;
Step 6, cell phone processor opens GPS/LBS locating module or camera according to execution instruction, gathers, and the positional information of collection or image are sent to controller to current location information or image;
Step 7, controller carries out respective handling according to blind person's information service project, if blind person's information service project is navigating items, then controller inquires about suitable navigation way in a database according to the destination of positional information and navigation, again navigation way is sent to cell phone processor, if blind person's information service project is shopping project, then controller inquires about suitable shopping route in a database according to positional information and shopping destination, again shopping route is sent to cell phone processor, if blind person's information service project is search article, then first controller inquires about corresponding article characteristics in a database according to Item Title, again article characteristics and image are carried out coupling corresponding, if there are the article of character pair in image, then judge these article relative position in the picture further, again relative position is sent to cell phone processor, if there are not the article of character pair in image, then send to cell phone processor and open camera instruction, and return step 6,
Step 8, cell phone processor receives navigation way, shopping route or article relative position in the picture, and send voice broadcast instruction to loud speaker, navigation way, shopping route or article relative position are in the picture reported out in the form of speech, again in conjunction with the GPS/LBS locating module of real-time reception or the positional information of camera collection or image, real-time update navigation way, shopping route or article relative position in the picture, and the navigation way of renewal, shopping route or article relative position are in the picture reported out in the form of speech.
2. the blind person's information service method based on augmented reality and smart mobile phone according to claim 1, it is characterized in that, also comprise step 9, cell phone processor judges whether the dead ahead arriving the destination of navigation, the destination of shopping or be positioned at article according to real-time navigation way, shopping route or article relative position in the picture, if arrived the destination of navigation, the destination of shopping or be positioned at the dead ahead of article, then send voice alerting instruction to loud speaker.
3. the blind person's information service method based on augmented reality and smart mobile phone according to claim 1 and 2, is characterized in that, described relative position comprise left side, right side, upside, downside and just before.
4. the blind person's information service system based on augmented reality and smart mobile phone, comprise smart mobile phone and server, described smart mobile phone comprises cell phone processor, camera, microphone, loud speaker, mobile phone wireless communication module and GPS/LBS locating module, described camera, microphone, loud speaker, mobile phone wireless communication module and GPS/LBS locating module are all connected with cell phone processor, described camera is right against the dead ahead of blind users, described server comprises controller, database and server wireless communication module, described mobile phone wireless communication module and the wireless connections of server wireless communication module, it is characterized in that, described cell phone processor comprises real-time voice acquisition module, mate unsuccessful processing module, opening of device module and navigation module, described controller comprises instruction head matching module, command content matching module, perform instruction sending module and instruct execution module,
Described real-time voice acquisition module, for the voice signal that real-time reception microphone gathers, and in chronological sequence voice signal is sent to instruction head matching module by order one by one;
The unsuccessful processing module of described coupling, for after receiving the unsuccessful information of coupling, sends the unsuccessful voice broadcast instruction of coupling to loud speaker, and starts real-time voice acquisition module;
Described opening of device module, for opening GPS/LBS locating module or camera according to execution instruction, gathering current location information or image, and the positional information of collection or image is sent to controller;
Described navigation module, for receiving navigation way, shopping route or article relative position in the picture, and send voice broadcast instruction to loud speaker, navigation way, shopping route or article relative position are in the picture reported out in the form of speech, again in conjunction with the GPS/LBS locating module of real-time reception or the positional information of camera collection or image, real-time update navigation way, shopping route or article relative position in the picture, and the navigation way of renewal, shopping route or article relative position are in the picture reported out in the form of speech;
Described instruction head matching module, corresponding for the voice signal of reception and the instruction head preset in database being carried out coupling, described instruction head shows whether voice signal is blind person's information service instruction, if the blind person's information service instruction preset, then enabled instruction content matching module, if not the blind person's information service instruction preset, then return the unsuccessful information of coupling to the unsuccessful processing module of coupling, and start the unsuccessful processing module of coupling;
Described command content matching module, corresponding for the voice signal of reception and the command content preset in database being carried out coupling, described command content shows blind person's information service project that voice signal needs perform, described blind person's information service project comprises navigation, shopping and search article, if the blind person's information service project preset, then further voice signal is identified, extract and obtain corresponding service item keyword, described service item keyword comprises the destination of navigation, the destination of shopping and the title of article, and start execution instruction sending module,
Described execution instruction sending module, for performing instruction according to blind person's information service project accordingly to the transmission of opening of device module, if blind person's information service project is navigating items or shopping project, then send to opening of device module and open the instruction of GPS/LBS locating module, if blind person's information service project is search item of articles, then sends to opening of device module and open camera instruction, described instruct execution module, for carrying out respective handling according to blind person's information service project, if blind person's information service project is navigating items, then inquire about suitable navigation way in a database according to the destination of positional information and navigation, again navigation way is sent to navigation module, if blind person's information service project is shopping project, then inquire about suitable shopping route in a database according to positional information and shopping destination, again shopping route is sent to navigation module, if blind person's information service project is search article, then first inquire about corresponding article characteristics in a database according to Item Title, again article characteristics and image are carried out coupling corresponding, if there are the article of character pair in image, then judge these article relative position in the picture further, again relative position is sent to navigation module, if there are not the article of character pair in image, then send to opening of device module and open camera instruction, and starting device opening module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410439132.4A CN104219628B (en) | 2014-08-29 | 2014-08-29 | A kind of blind person's information service method and system based on augmented reality and smart mobile phone |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410439132.4A CN104219628B (en) | 2014-08-29 | 2014-08-29 | A kind of blind person's information service method and system based on augmented reality and smart mobile phone |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104219628A true CN104219628A (en) | 2014-12-17 |
| CN104219628B CN104219628B (en) | 2017-08-29 |
Family
ID=52100695
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410439132.4A Active CN104219628B (en) | 2014-08-29 | 2014-08-29 | A kind of blind person's information service method and system based on augmented reality and smart mobile phone |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104219628B (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104463659A (en) * | 2014-12-23 | 2015-03-25 | 江苏天使电子科技有限公司 | Blind person shopping system |
| CN105788597A (en) * | 2016-05-12 | 2016-07-20 | 深圳市联谛信息无障碍有限责任公司 | Voice recognition-based screen reading application instruction input method and device |
| CN106289254A (en) * | 2016-07-18 | 2017-01-04 | 乐视控股（北京）有限公司 | Air navigation aid and device |
| CN106782569A (en) * | 2016-12-06 | 2017-05-31 | 深圳增强现实技术有限公司 | A kind of augmented reality method and device based on voiceprint registration |
| CN107480129A (en) * | 2017-07-18 | 2017-12-15 | 上海斐讯数据通信技术有限公司 | A kind of article position recognition methods and the system of view-based access control model identification and speech recognition |
| CN107886944A (en) * | 2017-11-16 | 2018-04-06 | 出门问问信息科技有限公司 | A kind of audio recognition method, device, equipment and storage medium |
| CN108052860A (en) * | 2017-11-06 | 2018-05-18 | 珠海格力电器股份有限公司 | Item retrieval method and device |
| CN109410483A (en) * | 2018-10-08 | 2019-03-01 | 珠海格力电器股份有限公司 | A kind of voice interface processing method and processing device |
| CN109460209A (en) * | 2018-12-20 | 2019-03-12 | 广东小天才科技有限公司 | A kind of control method and electronic equipment for dictating the progress that enters for |
| CN109724620A (en) * | 2018-12-28 | 2019-05-07 | 广州欧科信息技术股份有限公司 | User's guidance system, method and the electronic equipment at cultural heritage scenic spot |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090157299A1 (en) * | 2003-07-22 | 2009-06-18 | Pioneer Corporation | Navigation system and method, and computer program product |
| CN102186141A (en) * | 2011-05-06 | 2011-09-14 | 中国华录集团有限公司 | Blind user navigation service system based on global positioning system (GPS) and 3rd-generation (3G) network |
| CN102629313A (en) * | 2012-03-02 | 2012-08-08 | 浙江工贸职业技术学院 | Blind person shopping guide system |
| CN103245345A (en) * | 2013-04-24 | 2013-08-14 | 浙江大学 | Indoor navigation system, indoor navigation method and indoor searching method based on image sensing technology |
| CN103438896A (en) * | 2013-08-19 | 2013-12-11 | 惠州Tcl移动通信有限公司 | Navigation method and system for blindman |
-
2014
- 2014-08-29 CN CN201410439132.4A patent/CN104219628B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090157299A1 (en) * | 2003-07-22 | 2009-06-18 | Pioneer Corporation | Navigation system and method, and computer program product |
| CN102186141A (en) * | 2011-05-06 | 2011-09-14 | 中国华录集团有限公司 | Blind user navigation service system based on global positioning system (GPS) and 3rd-generation (3G) network |
| CN102629313A (en) * | 2012-03-02 | 2012-08-08 | 浙江工贸职业技术学院 | Blind person shopping guide system |
| CN103245345A (en) * | 2013-04-24 | 2013-08-14 | 浙江大学 | Indoor navigation system, indoor navigation method and indoor searching method based on image sensing technology |
| CN103438896A (en) * | 2013-08-19 | 2013-12-11 | 惠州Tcl移动通信有限公司 | Navigation method and system for blindman |
Non-Patent Citations (1)
| Title |
|---|
| SAMLEO L. JOSEPH等: "Semantic indoor navigation with a blind-user oriented augmented reality", 《SYSTEMS，MAN，AND CYBERNETICS(SMC)，2013 IEEE INTERNATIONAL CONFERENCE ON》 * |
Cited By (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104463659A (en) * | 2014-12-23 | 2015-03-25 | 江苏天使电子科技有限公司 | Blind person shopping system |
| CN105788597A (en) * | 2016-05-12 | 2016-07-20 | 深圳市联谛信息无障碍有限责任公司 | Voice recognition-based screen reading application instruction input method and device |
| CN106289254A (en) * | 2016-07-18 | 2017-01-04 | 乐视控股（北京）有限公司 | Air navigation aid and device |
| CN106782569A (en) * | 2016-12-06 | 2017-05-31 | 深圳增强现实技术有限公司 | A kind of augmented reality method and device based on voiceprint registration |
| CN107480129A (en) * | 2017-07-18 | 2017-12-15 | 上海斐讯数据通信技术有限公司 | A kind of article position recognition methods and the system of view-based access control model identification and speech recognition |
| CN108052860A (en) * | 2017-11-06 | 2018-05-18 | 珠海格力电器股份有限公司 | Item retrieval method and device |
| CN107886944A (en) * | 2017-11-16 | 2018-04-06 | 出门问问信息科技有限公司 | A kind of audio recognition method, device, equipment and storage medium |
| CN107886944B (en) * | 2017-11-16 | 2021-12-31 | 出门问问创新科技有限公司 | Voice recognition method, device, equipment and storage medium |
| CN109410483A (en) * | 2018-10-08 | 2019-03-01 | 珠海格力电器股份有限公司 | A kind of voice interface processing method and processing device |
| CN109460209A (en) * | 2018-12-20 | 2019-03-12 | 广东小天才科技有限公司 | A kind of control method and electronic equipment for dictating the progress that enters for |
| CN109460209B (en) * | 2018-12-20 | 2022-03-01 | 广东小天才科技有限公司 | Control method for dictation and reading progress and electronic equipment |
| CN109724620A (en) * | 2018-12-28 | 2019-05-07 | 广州欧科信息技术股份有限公司 | User's guidance system, method and the electronic equipment at cultural heritage scenic spot |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104219628B (en) | 2017-08-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104219628A (en) | Blind person information service method and blind person information service system based on enhancement of combination of reality with smart phone | |
| US9836996B2 (en) | Methods, apparatus and systems for providing remote assistance for visually-impaired users | |
| JP5709906B2 (en) | Augmented reality panorama for the visually impaired | |
| CN103335657B (en) | A kind of method and system based on image capture and recognition technology example of enhanced navigational functionality | |
| JP5871952B2 (en) | Camera-compatible headset for navigation | |
| US20130002452A1 (en) | Light-weight, portable, and wireless navigator for determining when a user who is visually-impaired and/or poorly-oriented can safely cross a street, with or without a traffic light, and know his/her exact location at any given time, and given correct and detailed guidance for translocation | |
| JP6296056B2 (en) | Image processing apparatus, image processing method, and program | |
| EP3427233B1 (en) | Method and apparatus for providing augmented reality services | |
| WO2017128895A1 (en) | Location sharing-based navigation assistance method and terminal | |
| CN102829788A (en) | Live action navigation method and live action navigation device | |
| CN103954276A (en) | Shopping navigation system and method based on smart glasses | |
| KR20180079116A (en) | System and method for providing information service for people with visually impairment | |
| CN107014395A (en) | Directive property panoramic navigation system based on virtual reality technology | |
| CN104390641B (en) | A kind of two-way navigation system and method | |
| KR101726227B1 (en) | Method for providing location based service using augmented reality and terminal thereof | |
| Baranski et al. | Field trials of a teleassistance system for the visually impaired | |
| CN102594900A (en) | Intelligent guiding method based on satellite equipment | |
| CN109938974A (en) | A kind of visually impaired people is with portable intelligent guide equipment and blind-guiding method | |
| CN206214372U (en) | A kind of intelligent navigation glasses system | |
| CN112468970A (en) | Campus navigation method based on augmented reality technology | |
| CN113532442A (en) | Indoor AR pedestrian navigation method | |
| US9710486B2 (en) | Determination of a filtered map interaction descriptor | |
| CN105222794A (en) | A kind of information processing method and electronic equipment | |
| CA3017574A1 (en) | Advanced wireless push button for accessible pedestrian system | |
| KR101596256B1 (en) | Methods for Building Volunteered Disabled Facility Information for Navigation Using Wearable Devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |