CN108491485A - Information cuing method, device and electronic equipment - Google Patents

Information cuing method, device and electronic equipment Download PDF

Info

Publication number
CN108491485A
CN108491485A CN201810205322.8A CN201810205322A CN108491485A CN 108491485 A CN108491485 A CN 108491485A CN 201810205322 A CN201810205322 A CN 201810205322A CN 108491485 A CN108491485 A CN 108491485A
Authority
CN
China
Prior art keywords
identification
information
navigation marker
shop
preview image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201810205322.8A
Other languages
Chinese (zh)
Inventor
刘任
张建春
赖永永
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Xiaomi Mobile Software Co Ltd
Original Assignee
Beijing Xiaomi Mobile Software Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Xiaomi Mobile Software Co Ltd filed Critical Beijing Xiaomi Mobile Software Co Ltd
Priority to CN201810205322.8A priority Critical patent/CN108491485A/en
Publication of CN108491485A publication Critical patent/CN108491485A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/20Scenes; Scene-specific elements in augmented reality scenes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • G06F9/453Help systems

Abstract

This disclosure relates to which a kind of information cuing method, device and electronic equipment, generate navigation marker by AR technologies, and by way of voice broadcast in actual scene, inform user's navigation information.This method includes:According to the target location of setting, navigation marker is generated in the scene preview image that electronic equipment acquires by AR technologies;Wherein, the navigation marker is used to indicate the direction of user's traveling;Identify the object for including in the scene preview image;According to the object of identification and the navigation marker, the information of voice prompt of object and navigation marker of the output comprising the identification.

Description

Information cuing method, device and electronic equipment
Technical field
This disclosure relates to field of computer technology, and in particular, to a kind of information cuing method, device and electronic equipment.
Background technology
With the continuous development of science and technology, electronic technology is also developed rapidly, and various electronic equipments are Through as a part indispensable in people's entertainment life, for example, mobile phone, PAD (Personal Digital Assistant, tablet computer), etc., these electronic equipments enrich people’s lives, and people can be set using these electronics It is standby to navigate.
But the navigation screen of these electronic equipments is often two-dimensional map, user cannot combine actual field well Scape is taken one's bearings.Also, for some special populations, such as low visual acuity crowd, it is led using these electronic equipments When boat, the navigation screen on electronic equipment possibly can not be seen clearly, to accurately reach target according to guidance path Place, using upper more inconvenient.
Invention content
To overcome the problems in correlation technique, a kind of information cuing method of disclosure offer, device and electronic equipment, New function is added for electronic equipment.
According to the first aspect of the embodiments of the present disclosure, a kind of information cuing method is provided, electronic equipment is applied to, including:
According to the target location of setting, clearing mark is generated in the scene preview image that electronic equipment acquires by AR technologies Will;Wherein, the navigation marker is used to indicate the direction of user's traveling;
Identify the object for including in the scene preview image;
According to the object of identification and the navigation marker, object of the output comprising the identification and the navigation marker voice Prompt message.
Optionally, after the object for including in identifying the scene preview image, further include:
Determine the position relationship relative to the electronic equipment of each object of identification in space;
According to the object of identification and the navigation marker, the object of the identification and the navigation marker voice prompt are exported Information, including:
According to the object of identification, the position relationship and the navigation marker, information of voice prompt is exported.
Optionally, the method further includes:
It identifies the road information in the scene preview image, or is determined according to the electronic map built in the electronic equipment Present road information;
According to the object of identification and the navigation marker, object of the output comprising the identification and the navigation marker voice Prompt message, including:
It is object of the output comprising the identification, described according to the object of identification, the road information and the navigation marker The information of voice prompt of road information and the navigation marker.
Optionally, the object for including in the scene preview image is identified, including:
Identify in the scene preview image whether include store identification;
It is raw in the scene preview image according to AR technologies when including store identification in the scene preview image At shop corresponding with store identification Warning Mark;
According to the object of identification and the navigation marker, the voice of object of the output comprising the identification and navigation marker carries Show information, including:
Include according to the object of identification, the corresponding shop Warning Mark of the store identification and the navigation marker, output The information of voice prompt of the object of the identification, the shop Warning Mark and the navigation marker.
Optionally, the method further includes:
The store information that determination includes from the electronic equipment current location to the path of the target location;
According to AR technologies, shop corresponding with store information Warning Mark is generated in the scene preview image;
According to the object of identification and the virtual Warning Mark, the language of object and navigation marker of the output comprising the identification Sound prompt message, including:
Include according to the object of identification, the corresponding shop Warning Mark of the store information and the navigation marker, output The information of voice prompt of the object of the identification, the shop Warning Mark and the navigation marker.
Optionally, the method further includes:
Receive shop type information input by user;
Whether detect in the scene preview image includes shop Warning Mark corresponding with the shop type information;
When in detecting the scene preview image including shop Warning Mark corresponding with the shop type information, Output includes the prompt message of the corresponding shop Warning Mark of the shop type information, where indicating that user corresponds to shop Position.
Optionally, the method further includes:
Receive voice messaging;
The voice messaging is identified, to obtain the place that the voice messaging includes;
Set the place for including in the voice messaging to target location.
According to the second aspect of the embodiment of the present disclosure, a kind of information presentation device is provided, described device includes:
First generation module is configured as the target location according to setting, by AR technologies in the field that electronic equipment acquires Navigation marker is generated in scape preview image;Wherein, the navigation marker is used to indicate the direction of user's traveling;
First identification module is configured as identifying the object for including in the scene preview image;
Output module, is configured as the object according to identification and the navigation marker, and output includes the object of the identification With the information of voice prompt of the navigation marker.
Optionally, described device further includes:
First determining module is configured as after the object for including in identifying the scene preview image, determines identification Each object position relationship relative to the electronic equipment in space;
The output module includes:
First output sub-module is configured as the object according to identification, the position relationship and the navigation marker, output Include the information of voice prompt of the object of the identification, the position relationship and the navigation marker.
Optionally, described device further includes:
Second identification module is configured as identifying the road information in the scene preview image, or according to the electronics Electronic map built in equipment determines present road information;
The output module includes:
Second output sub-module is configured as the object according to identification, the road information and the navigation marker, output Include the information of voice prompt of the object of the identification, the road information and the navigation marker.
Optionally, the first identification module further includes:
First detection module is configured as identifying in the scene preview image whether including store identification;
Second generation module is configured as in the scene preview image when including store identification, according to AR technologies, Shop corresponding with store identification Warning Mark is generated in the scene preview image;
The output module includes:
Third output sub-module is configured as the object according to identification, the corresponding shop Warning Mark of the store identification It is carried with the voice of the navigation marker, object of the output comprising the identification, the shop Warning Mark and the navigation marker Show information.
Optionally, described device further includes:
Second determining module is configured to determine that from the electronic equipment current location to the path of the target location Including store information;
Third generation module is configured as according to AR technologies, is generated in the scene preview image and is believed with the shop Cease corresponding shop Warning Mark;
The output module includes:
4th output sub-module is configured as the object according to identification, the corresponding shop Warning Mark of the store information With the navigation marker, output includes object, the shop Warning Mark and the navigation marker voice prompt of the identification Information.
Optionally, described device further includes:
First receiving module is configured as receiving shop type information input by user;
Second detection module, be configured as detecting in the scene preview image whether include and the shop type information Corresponding shop Warning Mark;
The output module includes:
5th output sub-module is configured as in detecting the scene preview image including to believe with the shop type When ceasing corresponding shop Warning Mark, output includes the prompt message of the corresponding shop Warning Mark of the shop type information, To indicate the position where user corresponds to shop.
Optionally, described device further includes:
Second receiving module is configured as receiving voice messaging;
Third identification module is configured as that the voice messaging is identified, and includes to obtain the voice messaging Target location;
4th generation module is configured as setting the place for including in the voice messaging to target location.
According to the third aspect of the embodiment of the present disclosure, a kind of electronic equipment is provided, the electronic equipment includes
Processor;
Memory for storing processor-executable instruction;
Wherein, the processor is configured as:
According to the target location of setting, clearing mark is generated in the scene preview image that electronic equipment acquires by AR technologies Will;
Identify the object for including in the scene preview image;
According to the object of identification and the navigation marker, the language of object and the navigation marker of the output comprising the identification Sound prompt message.
According to the fourth aspect of the embodiment of the present disclosure, a kind of non-transitorycomputer readable storage medium is provided, when described When instruction in storage medium is executed by the processor of electronic equipment so that electronic equipment is able to carry out a kind of information alert side Method, the method includes:
According to the target location of setting, clearing mark is generated in the scene preview image that electronic equipment acquires by AR technologies Will;
Identify the object for including in the scene preview image;
According to the object of identification and the navigation marker, information of voice prompt is exported.
The technical scheme provided by this disclosed embodiment can include the following benefits:Pass through AR (Augmented Reality, augmented reality) technology, navigation marker is generated in actual scene image, and identify the object for including in actual scene Body, each object that user's navigation marker is then informed by way of voice broadcast and is identified so that user can pass through AR Technology and information of voice prompt obtain the guidance path under actual scene, are conducive to help user (such as low visual acuity crowd) accurate Ground reaches target location, and in navigation procedure, user is assisted easily to know (such as the barrier etc. of each object in environment Deng), it provides convenience for the trip of low visual acuity crowd, while being also that electronic equipment adds new function, improves electronic equipment Intelligence degree.
It should be understood that above general description and following detailed description is only exemplary and explanatory, not The disclosure can be limited.
Description of the drawings
Attached drawing is for providing further understanding of the disclosure, and a part for constitution instruction, with following tool Body embodiment is used to explain the disclosure together, but does not constitute the limitation to the disclosure.In the accompanying drawings:
Fig. 1 is a kind of flow chart of information cuing method shown according to an exemplary embodiment.
Fig. 2 is a kind of electronic equipment display interface figure of information cuing method shown according to an exemplary embodiment.
Fig. 3 is a kind of another electronic equipment display interface of information cuing method shown according to an exemplary embodiment Figure.
Fig. 4 is a kind of block diagram of information presentation device shown according to an exemplary embodiment.
Fig. 5 is a kind of another block diagram of information presentation device shown according to an exemplary embodiment.
Fig. 6 is a kind of another block diagram of information presentation device shown according to an exemplary embodiment.
Fig. 7 is a kind of another block diagram of information presentation device shown according to an exemplary embodiment.
Fig. 8 is a kind of another block diagram of information presentation device shown according to an exemplary embodiment.
Fig. 9 is a kind of another block diagram of information presentation device shown according to an exemplary embodiment.
Figure 10 is a kind of another block diagram of information presentation device shown according to an exemplary embodiment.
Figure 11 is the block diagram according to a kind of electronic equipment shown in an exemplary embodiment.
Specific implementation mode
Example embodiments are described in detail here, and the example is illustrated in the accompanying drawings.Following description is related to When attached drawing, unless otherwise indicated, the same numbers in different drawings indicate the same or similar elements.Following exemplary embodiment Described in embodiment do not represent all implementations consistent with this disclosure.On the contrary, they be only with it is such as appended The example of the consistent device and method of some aspects be described in detail in claims, the disclosure.
Electronic equipment in the embodiment of the present disclosure for example can be the different electronic equipment of mobile phone, PAD etc., as long as tool There is the electronic equipment of GPS (Global Positioning System, global positioning system) functions and shooting function may each be Electronic equipment in the embodiment of the present disclosure, the embodiment of the present disclosure are not construed as limiting this.
Fig. 1 is a kind of flow chart of information cuing method shown according to an exemplary embodiment, as shown in Figure 1, the letter Reminding method is ceased in electronic equipment, including the following steps:
In step s 11, according to the target location of setting, the scene preview image acquired in electronic equipment by AR technologies Middle generation navigation marker;Wherein, the navigation marker is used to indicate the direction of user's traveling
In step s 12, the object for including in scene preview image is identified;
In step s 13, according to the object of identification and navigation marker, output includes the object and navigation marker of the identification Information of voice prompt.
Target location can according to demand be set by user, and the disclosure is not construed as limiting this.
Generate what navigation marker can be realized by AR technologies in the scene preview image of electronic equipment acquisition, the navigation Mark is used to indicate the direction of user's traveling, can be the arrow that direction is indicated in the preview image of actual scene, for example, with It opens camera when being navigated using mobile phone and has taken the actual scene image at a crossing, and root in family According to guidance path, which should turn left behind this crossing, then can in the actual scene image at crossing by AR technologies To generate the arrow, etc. that an instruction is turned left, the disclosure is not construed as limiting this, as long as direction can be explicitly indicated in the navigation marker .
The object for including in identification scene preview image can be realized by image recognition technology, can identify that scene is pre- The each object look in image.For example, as shown in Fig. 2, user with mobile phone 21 navigate during, 21 collected scene of mobile phone Include a stair 22 in preview image, then can identify in the scene preview image comprising there are one stair 22.So Afterwards according to the object and navigation marker identified, informs user's navigation information by way of exporting information of voice prompt, refer to Quote the direction that family is advanced.For example, during above-mentioned user's navigation, if including one in identifying scene preview image It is instruction by the navigation marker 23 that AR technologies generate in the scene preview image that electronic equipment acquires while a stair 22 The arrow of right-hand rotation, then output information of voice prompt is accordingly:It please turn right and go on stair.
Certainly, the object of identification may be the barrier in user navigation path, for example, the process of user's Mobile Telephone Gps In, first according to the target location of setting, leading for straight trip is generated in the scene preview image that mobile phone acquires by AR technologies Navigation mark will, but it includes a passerby to identify in the scene preview image, then according to the passerby of identification and navigation marker, it is defeated The information of voice prompt gone out can be:There is passerby in straight trip front, it is noted that evacuation.
By above mode, user can be allowed to obtain the guidance path under actual scene, be conducive to help user (such as Low visual acuity crowd) target location is accurately arrived at, easily know each object information on guidance path, increases for electronic equipment New function, improves the intelligence degree of electronic equipment.
It is worth noting that the information of voice prompt in the embodiment of the present disclosure can carry out personalization according to different users Setting, for example, according to the user's choice, information of voice prompt is exported using the language (English, dialect, etc.) of respective classes, Or according to the user's choice, information of voice prompt, etc. is exported using corresponding tone, the embodiment of the present disclosure does not make this It limits.
Optionally, after the object for including in identifying the scene preview image, each object of identification can also be determined The position relationship relative to electronic equipment in space, then according to the object of identification, the position relationship and the navigation Mark, output include the information of voice prompt of the object of the identification, the position relationship and the navigation marker.
Position relationship can be the distant relationships relative to electronic equipment in space, can also be in space relative to Left-right relation of electronic equipment, etc., the embodiment of the present disclosure are not construed as limiting this.Determine the phase of each object of identification in space Mode for the position relationship of the electronic equipment can determine each object by identifying the size of each object in image Relative to the position relationship of the electronic equipment, for example, the larger object of form can be determined as in the close of the electronic equipment Place, the smaller object of form can be determined as in the distant place of the electronic equipment.Or depth camera can also be used true Fixed position relationship, etc. of each object relative to the electronic equipment, the embodiment of the present disclosure is also not construed as limiting this.
For example, during user's Mobile Telephone Gps, first according to the target location of setting, adopted in mobile phone by AR technologies The navigation marker that instruction is turned right is generated in the scene preview image of collection, and is had identified in the scene preview image and included Then one ten grades of stair determine that ten grades of the stair are in space relative to the position relationship of mobile phone:In mobile phone At 5 meters of right front, then the information of voice prompt exported is:There are stair at 5 meters of right front, please turn right upper ten grades of stair.
It, can be with that is, each object position relationship relative to electronic equipment in space by determining identification The object in each orientation relative to electronic equipment in space is obtained in real time, and can pass through the side of output information of voice prompt Formula informs user.For example, during user's Mobile Telephone Gps, first according to the target location of setting, by AR technologies in hand The navigation marker of straight trip is generated in the scene preview image of machine acquisition, meanwhile, during user keeps straight on according to navigation marker, Mobile phone can with the left of real-time broadcasting user, right, it is left front, right before etc. each orientation object, for example, output voice prompt Information can be:Left is non-motorized lane, and right is barber shop, and left front is crossroad, is cafe, etc. before right.
By above mode, user can be allowed clearly to know the position relationship of each object in scene preview image, For the current location of oneself, there are one the understandings being more clear, thus more accurately with reaching target according to guidance path Point is provided convenience using the navigation feature of electronic equipment for low visual acuity crowd, improves hommization and the intelligence of electronic equipment Change degree.
Optionally, can also identify the road information in scene preview image, or according to built in electronic equipment electronically Figure determines present road information, and then according to the object of identification, road information and navigation marker, output includes the object of the identification The information of voice prompt of body, the road information and the navigation marker.
Road information can be the traffic lights information of road, can also be grade information of road, etc., the disclosure is to this It is not construed as limiting.For example, during user's Mobile Telephone Gps, when reaching a crossroad, traffic lights is exactly red light, then It can identify that traffic lights is red light at this time.Or during user's Mobile Telephone Gps, road ahead is level road, that It can identify road ahead gradient very little, be level road.Or it can be according to built in the electronic equipment that user uses Electronic map determines present road information, for example, user reaches a crossroad using during Mobile Telephone Gps, then It can determine that present road is a crossroad according to the electronic map built in mobile phone.
Then information of voice prompt can be exported according to the object, road information and navigation marker of identification.For example, such as Fig. 3 Shown, user with mobile phone 31 during being navigated, and first according to the target location of setting, is acquired in mobile phone 31 by AR technologies Scene preview image in generate the navigation marker 32 of instruction straight trip, and have identified in the scene preview image and include One stair 33 and a carriageway 35 for having traffic lights 34, that is to say, that user, which needs to keep straight on, passes through this carriageway 35, the traffic lights 34 then gone on this stair 33, but have identified carriageway 35 at this time is exactly red light, then export Information of voice prompt is:It is currently red light, please bears with.After detecting red light greening, voice prompt can be continued to output Information:It is currently green light, please keeps straight on through present road, go on stair.Or user is during with Mobile Telephone Gps, First according to the target location of setting, leading for instruction straight trip is generated in the scene preview image that mobile phone acquires by AR technologies Navigation mark will, and it includes that there are one stair to have identified in the scene preview image, has then also identified that the slope of road ahead Very little is spent, is level road, then the information of voice prompt exported is:Front is level road, please keep straight on and go on stair.
By above mode, user can be allowed clearly to know the road information in scene preview image, for front There are one the understandings being more clear for condition of road surface, are low visual acuity to more accurately reach target location according to guidance path Crowd is provided convenience using the navigation feature of electronic equipment, improves hommization and the intelligence degree of electronic equipment.
Optionally, it can also identify in scene preview image whether include store identification, include in scene preview image When store identification, according to AR technologies, shop corresponding with store identification Warning Mark is generated in scene preview image, then root According to the object of identification, the corresponding shop Warning Mark of store identification and navigation marker, object of the output comprising identification, shop instruction The information of voice prompt of mark and navigation marker.
Store identification can be the shop signboard comprising store name, billboard, etc., and the disclosure is not construed as limiting this.Only The corresponding shop of the store identification can be determined by store identification.For example, passing through the shop trick with " barber shop " Board, it may be determined that the corresponding shop signboard is barber shop.Or pass through the billboard with " dining room ", it may be determined that should Corresponding billboard is dining room.That is, can determine that the store identification is corresponded to by identifying the keyword on store identification Shop, then when in scene preview image including store identification, so that it may raw in scene preview image with according to AR technologies At shop corresponding with store identification Warning Mark.
Then, according to the object of identification, the corresponding shop Warning Mark of store identification and navigation marker, voice prompt is exported Information.For example, user, first according to the target location of setting, is adopted by AR technologies in mobile phone using during Mobile Telephone Gps The navigation marker that instruction is turned left is generated in the scene preview image of collection, and is had identified if user turns left, and is needed One ten grades of stair are gone on, while recognizing above stair and has a dining room, that is to say, that are wrapped in the scene preview image Store identification is included, then the information of voice prompt such as exported can be:It please turn left, go on ten grades of stair, have later upstairs One dining room.
By above mode, user can be allowed clearly to know the store information in scene preview image, for current Shop near position, to meet the various demands of user in time, improves the people of electronic equipment there are one clearly understanding Property and intelligence degree.
Optionally, the store information for including on the path from electronic equipment current location to target location can also be determined, Further according to AR technologies, shop corresponding with store information Warning Mark is generated in scene preview image, then according to knowledge The corresponding shop Warning Mark of other object, store information and navigation marker, object of the output comprising the identification, the shop The information of voice prompt of Warning Mark and the navigation marker.
The store information for including on electronic equipment current location to the path of target location may be current scene preview graph The store information for not including as in, for example, user is defined during using Mobile Telephone Gps from mobile phone current location The store information for including on to the path of target location is:There are one restaurants in 200 meters of front, then just according to AR technologies, it is on the scene The restaurant Warning Mark in 200 meters of front is generated in scape preview image.Then according to the object of identification, the corresponding shop of store information Warning Mark and navigation marker export information of voice prompt.For example, during above-mentioned user uses Mobile Telephone Gps, root is gone back The navigation marker of right-hand rotation is generated in the scene preview image that mobile phone acquires according to AR technologies, and has identified the scene preview The stair for including one ten grades in image, then the information of voice prompt exported is:Please turn right upper ten grades of stair, upstairs after 200 meters at there are one restaurant.
By above mode, user can be allowed clearly to know the shop for including on current location to the path of target location Information is spread, there are one advance understandings for the shop on guidance path, to meet the various demands of user in time, improve The hommization of electronic equipment and intelligence degree.
Optionally, shop type information input by user can also be received, then detects and whether is wrapped in scene preview image Containing shop corresponding with shop type information Warning Mark, and include and the shop type in detecting scene preview image When the corresponding shop Warning Mark of information, prompt of the output comprising the corresponding shop Warning Mark of the shop type information is believed Breath, to indicate the position where user corresponds to shop.
Shop type information is that user inputs according to demand, such as can be restaurant, barber shop, coffee shop, etc., this It is open that this is not construed as limiting.For example, user can input restaurant, then detect in the scene preview image of acquisition whether include The corresponding shop Warning Mark in restaurant, if detect shop Warning Mark corresponding comprising restaurant in scene preview image, The prompt message for including the corresponding shop Warning Mark of the shop type information is so just exported, to indicate user restaurant place Position.In this way, be conducive to the shop for helping user to be quickly found out demand, electronic equipment is more intelligent.
Optionally, voice messaging can also be received, and voice messaging is identified, to obtain the mesh that voice messaging includes Place is marked, then sets the place for including in the voice messaging to target location.
Voice messaging can be the action command that user sends out electronic equipment, can also be that user sends out electronic equipment Noun instruction, the embodiment of the present disclosure is not construed as limiting this.For example, user sends out an action command to electronic equipment:Go One street.Or user sends out a noun instruction to electronic equipment:First Street.
Electronic equipment is identified voice messaging after receiving voice messaging, to obtain the mesh that voice messaging includes Mark place.For example, the voice messaging received is " going to First Street ", identifies the voice messaging, get the voice messaging packet The target location contained is " First Street ".Or the voice messaging received is " First Street ", identifies the voice messaging, It is " First Street " to get the target location that the voice messaging includes.Then the place that can will include in the voice messaging It is set as target location.
By above mode, user can be allowed to pass through voice to be arranged target location, and by identify voice messaging come It obtains target location and facilitates user's to a certain extent to allow user that can quickly carry out the setting of target location It uses, provides convenience for the trip of low visual acuity crowd, while also improving hommization and the intelligence degree of electronic equipment.
Fig. 4 is a kind of block diagram of information presentation device 100 shown according to an exemplary embodiment.With reference to Fig. 4, the information Suggestion device 100 includes the first generation module 101, the first identification module 102 and output module 103.
First generation module 101 is configured as the target location according to setting, is acquired in electronic equipment by AR technologies Scene preview image in generate navigation marker;Wherein, the navigation marker is used to indicate the direction of user's traveling;
First identification module 102 is configured as identifying the object for including in the scene preview image;
The output module 103 is configured as the object according to identification and the navigation marker, and output includes the identification The information of voice prompt of object and the navigation marker.
Optionally, as shown in figure 5, information presentation device 100 further includes:
First determining module 104 is configured as after the object for including in identifying the scene preview image, is determined and is known The position relationship relative to the electronic equipment of other each object in space.
Output module 103 includes:
First output sub-module 1031 is configured as the object according to identification, the position relationship and the navigation marker, Export information of voice prompt.
Optionally, as shown in fig. 6, it includes the first generation module 101, the first identification module 102 that information presentation device 100, which removes, Outside output module 103, further include:
Second identification module 105 is configured as identifying the road information in the scene preview image, or according to the electricity Electronic map built in sub- equipment determines present road information;
Output module 103 includes:
Second output sub-module 1032 is configured as the object according to identification, the road information and the navigation marker, The information of voice prompt of object of the output comprising the identification, the position relationship and the navigation marker.
Optionally, as shown in fig. 7, the first identification module 102 further includes:
First detection module 106 is configured as identifying in the scene preview image whether including store identification;
Second generation module 107, when being configured as in the scene preview image comprising store identification, according to AR skills Art generates shop corresponding with store identification Warning Mark in the scene preview image;
The output module 103 includes:
Third output sub-module 1033 is configured as the corresponding shop instruction of the object according to identification, the store identification Mark and the navigation marker, output include the language of the object of the identification, the shop Warning Mark and the navigation marker Sound prompt message.
Optionally, as shown in figure 8, information presentation device 100 further includes:
Second determining module 108 is configured to determine that from the electronic equipment current location to the road of the target location The store information for including on diameter;
Third generation module 109 is configured as according to AR technologies, is generated and the shop in the scene preview image The corresponding shop Warning Mark of information;
The output module 103 includes:
4th output sub-module 1034 is configured as the corresponding shop instruction of the object according to identification, the store information Mark and the navigation marker, output include object, the shop Warning Mark and the navigation marker voice of the identification Prompt message.
Optionally, as shown in figure 9, information presentation device 100 further includes:
First receiving module 110 is configured as receiving shop type information input by user;
Second detection module 111, be configured as detecting in the scene preview image whether include and the shop type The corresponding shop Warning Mark of information;
The output module 103 includes:
5th output sub-module 1035, be configured as in detecting the scene preview image include and the shop class When the corresponding shop Warning Mark of type information, prompt of the output comprising the corresponding shop Warning Mark of the shop type information is believed Breath, to indicate the position where user corresponds to shop.
Optionally, as shown in Figure 10, information presentation device 100 further includes;
Second receiving module 112 is configured as receiving voice messaging;
Third identification module 113 is configured as that the voice messaging is identified, and includes to obtain the voice messaging Target location;
4th generation module 114 is configured as setting the place for including in the voice messaging to target location.
About the device in above-described embodiment, wherein modules execute the concrete mode of operation in related this method Embodiment in be described in detail, explanation will be not set forth in detail herein.
Figure 11 is a kind of block diagram for electronic equipment 1100 shown according to an exemplary embodiment.For example, device 1100 can be mobile phone, computer, digital broadcast terminal, messaging devices, game console, tablet device, medical treatment Equipment, body-building equipment, personal digital assistant etc..
Referring to Fig.1 1, device 1100 may include following one or more components:Processing component 1102, memory 1104, Electric power assembly 1106, multimedia component 1108, audio component 1111, the interface 1112 of input/output (I/O), sensor module 1114 and communication component 1116.
The integrated operation of 1102 usual control device 1100 of processing component, such as with display, call, data communication, Camera operation and record operate associated operation.Processing component 1102 may include one or more processors 1120 to execute Instruction, to complete all or part of step of above-mentioned information cuing method.In addition, processing component 1102 may include one or Multiple modules, convenient for the interaction between processing component 1102 and other assemblies.For example, processing component 1102 may include multimedia Module, to facilitate the interaction between multimedia component 1108 and processing component 1102.
Memory 1104 is configured as storing various types of data to support the operation in device 1100.These data Example includes the instruction for any application program or method that are operated on device 1100, contact data, telephone book data, Message, picture, video etc..Memory 1104 can by any kind of volatibility or non-volatile memory device or they Combination is realized, such as static RAM (SRAM), electrically erasable programmable read-only memory (EEPROM), it is erasable can Program read-only memory (EPROM), programmable read only memory (PROM), read-only memory (ROM), magnetic memory, flash memory Reservoir, disk or CD.
Electric power assembly 1106 provides electric power for the various assemblies of device 1100.Electric power assembly 1106 may include power management System, one or more power supplys and other generated with for device 1100, management and the associated component of distribution electric power.
Multimedia component 1108 is included in the screen of one output interface of offer between described device 1100 and user. In some embodiments, screen may include liquid crystal display (LCD) and touch panel (TP).If screen includes touch panel, Screen may be implemented as touch screen, to receive input signal from the user.Touch panel includes that one or more touch passes Sensor is to sense the gesture on touch, slide, and touch panel.The touch sensor can not only sense touch or sliding is dynamic The boundary of work, but also detect duration and pressure associated with the touch or slide operation.In some embodiments, more Media component 1108 includes a front camera and/or rear camera.When device 1100 is in operation mode, mould is such as shot When formula or video mode, front camera and/or rear camera can receive external multi-medium data.Each preposition camera shooting Head and rear camera can be a fixed optical lens system or have focusing and optical zoom capabilities.
Audio component 1110 is configured as output and/or input audio signal.For example, audio component 1110 includes a wheat Gram wind (MIC), when device 1100 is in operation mode, when such as call model, logging mode and speech recognition mode, microphone quilt It is configured to receive external audio signal.The received audio signal can be further stored in memory 1104 or via communication Component 1116 is sent.In some embodiments, audio component 1110 further includes a loud speaker, is used for exports audio signal.
I/O interfaces 1112 provide interface, above-mentioned peripheral interface module between processing component 1102 and peripheral interface module Can be keyboard, click wheel, button etc..These buttons may include but be not limited to:Home button, volume button, start button and Locking press button.
Sensor module 1114 includes one or more sensors, and the state for providing various aspects for device 1100 is commented Estimate.For example, sensor module 1114 can detect the state that opens/closes of device 1100, the relative positioning of component, such as institute The display and keypad that component is device 1100 are stated, sensor module 1114 can be with detection device 1100 or device 1,100 1 The position change of a component, the existence or non-existence that user contacts with device 1100,1100 orientation of device or acceleration/deceleration and dress Set 1100 temperature change.Sensor module 1114 may include proximity sensor, be configured in not any physics It is detected the presence of nearby objects when contact.Sensor module 1114 can also include optical sensor, as CMOS or ccd image are sensed Device, for being used in imaging applications.In some embodiments, which can also include acceleration sensing Device, gyro sensor, Magnetic Sensor, pressure sensor or temperature sensor.
Communication component 1116 is configured to facilitate the communication of wired or wireless way between device 1100 and other equipment.Dress The wireless network based on communication standard, such as WiFi can be accessed by setting 1100,2G or 3G or combination thereof.It is exemplary at one In embodiment, communication component 1116 receives broadcast singal or broadcast correlation from external broadcasting management system via broadcast channel Information.In one exemplary embodiment, the communication component 1116 further includes near-field communication (NFC) module, to promote short distance Communication.For example, radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra wide band can be based in NFC module (UWB) technology, bluetooth (BT) technology and other technologies are realized.
In the exemplary embodiment, device 1100 can be by one or more application application-specific integrated circuit (ASIC), number Signal processor (DSP), digital signal processing appts (DSPD), programmable logic device (PLD), field programmable gate array (FPGA), controller, microcontroller, microprocessor or other electronic components are realized, for executing the above method.
In the exemplary embodiment, it includes the non-transitorycomputer readable storage medium instructed, example to additionally provide a kind of Such as include the memory 1104 of instruction, above-metioned instruction can be executed by the processor 1120 of device 1100 to complete the above method.Example Such as, the non-transitorycomputer readable storage medium can be ROM, it is random access memory (RAM), CD-ROM, tape, soft Disk and optical data storage devices etc..
The preferred embodiment of the disclosure is described in detail above in association with attached drawing, still, the disclosure is not limited to above-mentioned reality The detail in mode is applied, in the range of the technology design of the disclosure, a variety of letters can be carried out to the technical solution of the disclosure Monotropic type, these simple variants belong to the protection domain of the disclosure.
It is further to note that specific technical features described in the above specific embodiments, in not lance In the case of shield, can be combined by any suitable means, in order to avoid unnecessary repetition, the disclosure to it is various can The combination of energy no longer separately illustrates.
In addition, arbitrary combination can also be carried out between a variety of different embodiments of the disclosure, as long as it is without prejudice to originally Disclosed thought equally should be considered as disclosure disclosure of that.

Claims (15)

1. a kind of information cuing method, which is characterized in that the method includes:
According to the target location of setting, navigation marker is generated in the scene preview image that electronic equipment acquires by AR technologies; Wherein, the navigation marker is used to indicate the direction of user's traveling;
Identify the object for including in the scene preview image;
According to the object of identification and the navigation marker, the voice prompt letter of object of the output comprising the identification and navigation marker Breath.
2. according to the method described in claim 1, it is characterized in that, the object for including in identifying the scene preview image it Afterwards, further include:
Determine the position relationship relative to the electronic equipment of each object of identification in space;
According to the object of identification and the navigation marker, the voice prompt letter of object of the output comprising the identification and navigation marker Breath, including:
According to the object of identification, the position relationship and the navigation marker, object of the output comprising the identification, the position The information of voice prompt of relationship and the navigation marker.
3. according to the method described in claim 1, it is characterized in that, the method further includes:
It identifies the road information in the scene preview image, or is determined currently according to the electronic map built in the electronic equipment Road information;
According to the object of identification and the navigation marker, the voice prompt letter of object of the output comprising the identification and navigation marker Breath, including:
According to the object of identification, the road information and the navigation marker, output includes object, the road of the identification The information of voice prompt of information and the navigation marker.
4. according to the method described in claim 1, it is characterized in that, identify the object for including in the scene preview image, wrap It includes:
Identify in the scene preview image whether include store identification;
When including store identification in the scene preview image, according to AR technologies, generated in the scene preview image with The corresponding shop Warning Mark of the store identification;
According to the object of identification and the navigation marker, the voice prompt letter of object of the output comprising the identification and navigation marker Breath, including:
According to the object of identification, the corresponding shop Warning Mark of the store identification and the navigation marker, output is comprising described The information of voice prompt of the object of identification, the shop Warning Mark and the navigation marker.
5. according to the method described in claim 1, it is characterized in that, the method further includes:
The store information that determination includes from the electronic equipment current location to the path of the target location;
According to AR technologies, shop corresponding with store information Warning Mark is generated in the scene preview image;
According to the object of identification and the navigation marker, the voice prompt letter of object of the output comprising the identification and navigation marker Breath, including:
According to the object of identification, the corresponding shop Warning Mark of the store information and the navigation marker, output is comprising described The information of voice prompt of the object of identification, the shop Warning Mark and the navigation marker.
6. method according to claim 4 or 5, which is characterized in that the method further includes:
Receive shop type information input by user;
Whether detect in the scene preview image includes shop Warning Mark corresponding with the shop type information;
When in detecting the scene preview image including shop Warning Mark corresponding with the shop type information, output The prompt message for including the corresponding shop Warning Mark of the shop type information, to indicate the position where user corresponds to shop It sets.
7. according to the method described in claim 1, it is characterized in that, the method further includes:
Receive voice messaging;
The voice messaging is identified, to obtain the place that the voice messaging includes;
Set the place for including in the voice messaging to target location.
8. a kind of information presentation device, which is characterized in that described device includes:
First generation module is configured as the target location according to setting, and the scene acquired in electronic equipment by AR technologies is pre- It lookes in image and generates navigation marker;Wherein, the navigation marker is used to indicate the direction of user's traveling;
First identification module is configured as identifying the object for including in the scene preview image;
Output module is configured as the object according to identification and the navigation marker, object of the output comprising the identification and institute State the information of voice prompt of navigation marker.
9. device according to claim 8, which is characterized in that described device further includes:
First determining module is configured as after the object for including in identifying the scene preview image, determines each of identification The position relationship relative to the electronic equipment of object in space;
The output module includes:
First output sub-module, being configured as the object according to identification, the position relationship and the navigation marker, output includes The information of voice prompt of the object of the identification, the position relationship and the navigation marker.
10. device according to claim 8, which is characterized in that described device further includes:
Second identification module is configured as identifying the road information in the scene preview image, or according to the electronic equipment Built-in electronic map determines present road information;
The output module includes:
Second output sub-module, being configured as the object according to identification, the road information and the navigation marker, output includes The information of voice prompt of the object of the identification, the road information and the navigation marker.
11. device according to claim 8, which is characterized in that first identification module further includes:
First detection module is configured as identifying in the scene preview image whether including store identification;
Second generation module, when being configured as in the scene preview image comprising store identification, according to AR technologies, described Shop corresponding with store identification Warning Mark is generated in scene preview image;
The output module includes:
Third output sub-module is configured as the object according to identification, the corresponding shop Warning Mark of the store identification and institute State navigation marker, the voice prompt letter of object of the output comprising the identification, the shop Warning Mark and the navigation marker Breath.
12. device according to claim 8, which is characterized in that described device further includes:
Second determining module, is configured to determine that from the electronic equipment current location to the path of the target location and includes Store information;
Third generation module is configured as according to AR technologies, is generated and the store information pair in the scene preview image The shop Warning Mark answered;
The output module includes:
4th output sub-module is configured as the object according to identification, the corresponding shop Warning Mark of the store information and institute Navigation marker is stated, output includes object, the shop Warning Mark and the navigation marker information of voice prompt of the identification.
13. device according to claim 11 or 12, which is characterized in that described device further includes:
First receiving module is configured as receiving shop type information input by user;
Whether the second detection module is configured as detecting in the scene preview image comprising corresponding with the shop type information Shop Warning Mark;
The output module includes:
5th output sub-module, be configured as in detecting the scene preview image include and the shop type information pair When the shop Warning Mark answered, output includes the prompt message of the corresponding shop Warning Mark of the shop type information, to refer to Show the position where user corresponds to shop.
14. device according to claim 8, which is characterized in that described device further includes:
Second receiving module is configured as receiving voice messaging;
Third identification module is configured as that the voice messaging is identified, to obtain the place that the voice messaging includes;
4th generation module is configured as setting the place for including in the voice messaging to target location.
15. a kind of electronic equipment, which is characterized in that the electronic equipment includes:
Processor;
Memory for storing processor-executable instruction;
Wherein, the processor is configured as:
According to the target location of setting, navigation marker is generated in the scene preview image that electronic equipment acquires by AR technologies;
Identify the object for including in the scene preview image;
According to the object of identification and the navigation marker, the voice of object of the output comprising the identification and the navigation marker carries Show information.
CN201810205322.8A 2018-03-13 2018-03-13 Information cuing method, device and electronic equipment Pending CN108491485A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201810205322.8A CN108491485A (en) 2018-03-13 2018-03-13 Information cuing method, device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201810205322.8A CN108491485A (en) 2018-03-13 2018-03-13 Information cuing method, device and electronic equipment

Publications (1)

Publication Number Publication Date
CN108491485A true CN108491485A (en) 2018-09-04

Family

ID=63338740

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201810205322.8A Pending CN108491485A (en) 2018-03-13 2018-03-13 Information cuing method, device and electronic equipment

Country Status (1)

Country Link
CN (1) CN108491485A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109472989A (en) * 2018-12-05 2019-03-15 斑马网络技术有限公司 Reminding method, device, equipment and the readable storage medium storing program for executing of traffic lights
CN110716645A (en) * 2019-10-15 2020-01-21 北京市商汤科技开发有限公司 Augmented reality data presentation method and device, electronic equipment and storage medium
CN111176338A (en) * 2019-12-31 2020-05-19 维沃移动通信有限公司 Navigation method, electronic device and storage medium
CN111595346A (en) * 2020-06-02 2020-08-28 浙江商汤科技开发有限公司 Navigation reminding method and device, electronic equipment and storage medium
CN111986332A (en) * 2020-08-28 2020-11-24 深圳市慧鲤科技有限公司 Method and device for displaying message board, electronic equipment and storage medium
CN112742038A (en) * 2019-10-29 2021-05-04 珠海市一微半导体有限公司 Toy robot and moving method and chip thereof
CN113432596A (en) * 2021-07-07 2021-09-24 中国工商银行股份有限公司 Navigation method and device and electronic equipment
CN114726999A (en) * 2021-01-05 2022-07-08 北京小米移动软件有限公司 Image acquisition method, image acquisition device and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102519475A (en) * 2011-12-12 2012-06-27 杨志远 Intelligent navigation method and equipment based on augmented reality technology
CN104833368A (en) * 2015-05-12 2015-08-12 寅家电子科技(上海)有限公司 Live-action navigation system and method
CN106289254A (en) * 2016-07-18 2017-01-04 乐视控股(北京)有限公司 Air navigation aid and device
CN107045844A (en) * 2017-04-25 2017-08-15 张帆 A kind of landscape guide method based on augmented reality
CN107727103A (en) * 2017-08-30 2018-02-23 深圳市金立通信设备有限公司 Air navigation aid, terminal and computer-readable medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102519475A (en) * 2011-12-12 2012-06-27 杨志远 Intelligent navigation method and equipment based on augmented reality technology
CN104833368A (en) * 2015-05-12 2015-08-12 寅家电子科技(上海)有限公司 Live-action navigation system and method
CN106289254A (en) * 2016-07-18 2017-01-04 乐视控股(北京)有限公司 Air navigation aid and device
CN107045844A (en) * 2017-04-25 2017-08-15 张帆 A kind of landscape guide method based on augmented reality
CN107727103A (en) * 2017-08-30 2018-02-23 深圳市金立通信设备有限公司 Air navigation aid, terminal and computer-readable medium

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
中国卫星导航定位协会编: "《卫星导航定位与北斗系统应用星参北半位联世界2016》", 30 September 2016 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109472989A (en) * 2018-12-05 2019-03-15 斑马网络技术有限公司 Reminding method, device, equipment and the readable storage medium storing program for executing of traffic lights
CN110716645A (en) * 2019-10-15 2020-01-21 北京市商汤科技开发有限公司 Augmented reality data presentation method and device, electronic equipment and storage medium
CN112742038A (en) * 2019-10-29 2021-05-04 珠海市一微半导体有限公司 Toy robot and moving method and chip thereof
CN111176338A (en) * 2019-12-31 2020-05-19 维沃移动通信有限公司 Navigation method, electronic device and storage medium
CN111176338B (en) * 2019-12-31 2024-03-22 维沃移动通信有限公司 Navigation method, electronic device and storage medium
CN111595346A (en) * 2020-06-02 2020-08-28 浙江商汤科技开发有限公司 Navigation reminding method and device, electronic equipment and storage medium
CN111595346B (en) * 2020-06-02 2022-04-01 浙江商汤科技开发有限公司 Navigation reminding method and device, electronic equipment and storage medium
CN111986332A (en) * 2020-08-28 2020-11-24 深圳市慧鲤科技有限公司 Method and device for displaying message board, electronic equipment and storage medium
CN114726999A (en) * 2021-01-05 2022-07-08 北京小米移动软件有限公司 Image acquisition method, image acquisition device and storage medium
CN114726999B (en) * 2021-01-05 2023-12-26 北京小米移动软件有限公司 Image acquisition method, image acquisition device and storage medium
CN113432596A (en) * 2021-07-07 2021-09-24 中国工商银行股份有限公司 Navigation method and device and electronic equipment

Similar Documents

Publication Publication Date Title
CN108491485A (en) Information cuing method, device and electronic equipment
CN105261227B (en) Arrival prompting method and device
CN110377365B (en) Method and device for showing small program
CN105138259B (en) Operation executes method and device
KR101606727B1 (en) Mobile terminal and operation method thereof
CN104918107B (en) The identification processing method and device of video file
JP5398970B2 (en) Mobile communication device and control method
EP2282169B1 (en) Method, mobile device and computer program product for recording parking information
KR20110123141A (en) Mobile terminal and operation method thereof
CN108362279A (en) Based on the shopping air navigation aid of augmented reality AR, apparatus and system
CN104977010A (en) Navigation prompting method and apparatus
WO2017186009A1 (en) Service display method, apparatus, device, and system
CN109151719A (en) Safety guide method, device and storage medium
CN110490186B (en) License plate recognition method and device and storage medium
RU2667417C1 (en) Method and device for management of the balancing trolley
WO2020258935A1 (en) Positioning method and device, electronic device and storage medium
CN106533913A (en) Method and apparatus for sharing position information
CN109696166A (en) A kind of air navigation aid and device
CN107292306A (en) Object detection method and device
CN108572979A (en) A kind of position service method and device, a kind of device for location-based service
CN108983971A (en) Labeling method and device based on augmented reality
CN112146676B (en) Information navigation method, device, equipment and storage medium
CN108509863A (en) Information cuing method, device and electronic equipment
CN105320749A (en) Travel route generation method and apparatus
CN109900281A (en) Air navigation aid, device based on point of interest and the device for navigation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20180904

RJ01 Rejection of invention patent application after publication