CN111858993B - Article finding guiding system for special article - Google Patents
Article finding guiding system for special article Download PDFInfo
- Publication number
- CN111858993B CN111858993B CN202010757110.8A CN202010757110A CN111858993B CN 111858993 B CN111858993 B CN 111858993B CN 202010757110 A CN202010757110 A CN 202010757110A CN 111858993 B CN111858993 B CN 111858993B
- Authority
- CN
- China
- Prior art keywords
- information
- article
- module
- searching
- voice
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 claims abstract description 22
- 230000007613 environmental effect Effects 0.000 claims abstract description 15
- 230000000875 corresponding effect Effects 0.000 claims description 38
- 238000001514 detection method Methods 0.000 claims description 19
- 239000011521 glass Substances 0.000 claims description 11
- 238000004458 analytical method Methods 0.000 claims description 8
- 238000012790 confirmation Methods 0.000 claims description 8
- 238000012098 association analyses Methods 0.000 claims description 4
- 238000004891 communication Methods 0.000 claims description 3
- 230000002596 correlated effect Effects 0.000 claims description 3
- 239000004984 smart glass Substances 0.000 claims description 2
- 230000009286 beneficial effect Effects 0.000 description 10
- 238000000034 method Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 3
- 238000010276 construction Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 241001122767 Theaceae Species 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/58—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/5866—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, manually generated location and time information
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
- G01C21/20—Instruments for performing navigational calculations
- G01C21/206—Instruments for performing navigational calculations specially adapted for indoor navigation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
- G06F16/29—Geographical information databases
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/53—Querying
- G06F16/532—Query formulation, e.g. graphical querying
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/53—Querying
- G06F16/538—Presentation of query results
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/9032—Query formulation
- G06F16/90332—Natural language query formulation or dialogue systems
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/003—Navigation within 3D models or images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B7/00—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00
- G08B7/06—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00 using electric transmission, e.g. involving audible and visible signalling through the use of sound and light sources
- G08B7/066—Signalling systems according to more than one of groups G08B3/00 - G08B6/00; Personal calling systems according to more than one of groups G08B3/00 - G08B6/00 using electric transmission, e.g. involving audible and visible signalling through the use of sound and light sources guiding along a path, e.g. evacuation path lighting strip
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
- G10L2015/225—Feedback of the input speech
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Databases & Information Systems (AREA)
- General Engineering & Computer Science (AREA)
- Remote Sensing (AREA)
- Radar, Positioning & Navigation (AREA)
- Data Mining & Analysis (AREA)
- Mathematical Physics (AREA)
- Software Systems (AREA)
- Computer Hardware Design (AREA)
- Computer Graphics (AREA)
- Computational Linguistics (AREA)
- Acoustics & Sound (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Health & Medical Sciences (AREA)
- Library & Information Science (AREA)
- Artificial Intelligence (AREA)
- Automation & Control Theory (AREA)
- Navigation (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
Abstract
The application relates to the technical field of article searching, and particularly discloses an article searching guiding system for special articles, which comprises a guiding terminal and a detecting terminal, wherein an image acquisition module acquires environmental information of different positions; the voice processing module analyzes and identifies the voice information of the object searching of the user to obtain object information; the article searching module is used for searching article characteristic information in a pre-stored article image library according to the article information, searching target environment information in the environment information according to the article characteristic information, measuring the position of the searched article in the target environment information according to a preset reference object to obtain a target position parameter, and calculating according to the target position parameter and the position parameter of the preset reference object to obtain the position information of the searched article; and the path generation module performs guiding path planning according to the position information to generate guiding path information. The technical scheme of the application has higher efficiency of searching the articles and is simpler.
Description
Technical Field
The application relates to the technical field of article searching, in particular to an article searching guiding system for special articles.
Background
In daily life, the specific placement position of the forgotten articles is the situation that most people can encounter in daily life, for example, when going out, looking for a mobile phone, a wallet and a key; when watching TV, find the remote controller. The problem of forgetting the article, especially when the time is intense, the key and the mobile phone can not be found when the user works, and the user can get to work later, so that great inconvenience is caused to the life of people.
In order to solve the above-mentioned problems, an article search system is disclosed in chinese patent publication No. CN109522811a, which includes a terminal unit and a detection unit, the terminal unit being communicatively connected to the detection unit; the terminal unit acquires voice information of a user and outputs article information according to the voice information; the detection unit detects and acquires environment information of different positions and transmits the image information to the terminal unit. Through the technical scheme, when a user searches for things, the user can shoot the environmental information of different positions by speaking the names of the things, the terminal unit searches for the things from the shot environmental information according to the information of the things to be searched, and when the user searches for the things, the user is guided to the position of the things to be searched through a voice playing mode, so that the user can conveniently search for the forgotten things.
However, this solution still has some problems, the position of the object to be searched is given according to the proximity of other objects to be searched as a reference, if the object to be searched is a remote controller, and the remote controller is on a table, and a cup is beside the remote controller, in the above solution, the search system gives a similar "the remote controller is on the table, beside the cup". In real life, there are many types of tables, tea tables, dining tables, small tables, etc. in the house, and more than one cup is provided, especially for the families with many people, which is especially common. When hearing the voice played by the system, a desk-by-desk search is needed, and searching for objects is still inconvenient.
Disclosure of Invention
The application provides an object searching guiding system for special objects, which aims to solve the technical problem that a user can be guided to search for the forgotten objects more quickly in a designated place.
The basic scheme of the application is as follows:
the object searching guide system for the special object comprises a guide terminal and a detection terminal, wherein the guide terminal is in communication connection with the detection terminal, the detection terminal comprises a plurality of position acquisition modules and a plurality of image acquisition modules, and the image acquisition modules are used for acquiring environment information of different positions; the guiding terminal is characterized by comprising a voice processing module, an article searching module, a path generating module and a voice playing module, wherein:
the voice processing module is used for receiving voice information of the object searching of the user, analyzing and identifying the voice information and obtaining object information of the object searching;
the article searching module is used for searching article characteristic information in a pre-stored article image library according to the article information, searching target environment information in environment information according to the article characteristic information, measuring the position of the searched article according to a preset reference object in the target environment information to obtain a target position parameter of the searched article, and calculating according to the target position parameter and the position parameter of the preset reference object to obtain position information of the searched article;
the path generation module is used for planning a guiding path according to the position information and generating guiding path information;
the voice playing module is used for playing the guiding voice according to the guiding path information.
The basic scheme has the beneficial effects that: according to the scheme, when a user needs to find things, the user speaks the names of the things to be found, the voice processing module analyzes and identifies the voice information of the names of the things spoken by the user to obtain the information of the things, then the corresponding characteristic information of the things is found out from the image library of the things through the information searching module, and target environment information containing the characteristic information of the things to be found out from environment information of different positions; the article searching module measures the position of the found article according to the preset reference object in the target environment information to obtain a target position parameter of the found article taking the reference object as a standard, and then calculates the position information of the found article according to the original position parameter of the reference object and the target position parameter. The path generation module performs path planning according to the position information corresponding to the environment information, generates guide path strength information, and plays the guide path information through the voice playing module.
Compared with the prior art, the method has the advantages that the position of the article can be obtained, the position indication is not similar to the position indication on a table, the path generation module performs path planning according to the specific position of the found article to generate guide path information, the guide path information is carried and played through the voice playing module, and therefore a user can go forward according to the guide path information which indicates playing, and the article can be found. Unlike the current technical scheme, the user also needs to prompt according to the position to want the position. Therefore, the method and the device find the articles according to the guiding path information, the time spent for finding is shorter, the efficiency for finding the articles is higher, and the method and the device are simpler.
Further, the guiding terminal also comprises a display module,
the guiding terminal also comprises a display module, and the article image library also comprises article image information
The voice processing module is also used for carrying out association analysis and recognition on the voice information, and sending an article confirmation instruction and all the associated article information to the article searching module when 2 or more article information are associated;
the article searching module is also used for searching article image information in the article image library according to the received article information after receiving the article confirmation instruction, generating image selection information by the searched article image information and the article information corresponding to the article image information, and sending the image selection information to the display module;
the display module is used for analyzing the received image selection information to obtain article image information and article information corresponding to the article image information, displaying the article image information and feeding back the article information corresponding to the selected article image information to the article search module.
The beneficial effects are that: for the objects with similar names or geographic differences, the image of the object is searched after the user is further determined, so that the object which the user really wants to search can be accurately found, and the situation that the object searching efficiency is low due to the fact that the object name identification errors are greatly avoided.
Further, the article searching module is also used for selecting the position of the article to be searched from the target environment information according to the article characteristic information, and sending the target environment information after the selection to the display module;
the display module is also used for displaying the received target image information.
The beneficial effects are that: the object to be searched is selected from the object image information, and a user can determine the specific position of the object to be searched according to other objects in the object image and the placement positions among the objects.
The guiding terminal further comprises a position recording module, wherein the position recording module is used for acquiring position information filled in according to a preset position template, and storing the position information of the article and the article information in an associated mode to generate an article position record library;
the article searching module is also used for searching the position information corresponding to the article information from the article grade position record library according to the article information when the article information is received.
The beneficial effects are that: for the articles with unchanged position information, the position information corresponding to the article information is directly searched out from the article position record library, so that the position parameter measurement and the position information calculation process of the article searching module for searching the articles can be omitted, and the article searching efficiency is further improved.
The position recording module is further used for acquiring environment information of each position, comparing and analyzing whether articles in the images are missing or added or not according to the environment information acquired in the adjacent time, if the comparison and analysis result is that the articles are added, capturing the image information of the added articles in the environment information, capturing the image information of the articles added in the environment information, carrying out article characteristic identification on the image information to obtain article characteristic information, then matching corresponding article information in an article image library according to the article characteristic information, and sending the article information to the article searching module; and the position information corresponding to the original position information of the article in the article position record library is changed according to the position information fed back by the article searching module.
The beneficial effects are that: and obtaining the article with the changed position by comparing and analyzing the environmental information of the front frame and the rear frame, and updating the position information of the article with the changed position in time by an article searching module so as to ensure the accuracy of the position information recorded in the article position record library.
And the position recording module is further used for capturing the image information of the reduced articles in the environment information of the next frame in the environment information of the previous frame if the comparison and analysis result is reduced, carrying out article characteristic recognition on the image information to obtain article characteristic information, and then deleting the position information corresponding to the article information in the article position record library according to the article characteristic information matched with the corresponding article information.
The beneficial effects are that: and obtaining the missing article through comparing and analyzing the environmental information of the front frame and the rear frame, and deleting the position information corresponding to the article information of the article in the article position record library so as to ensure the accuracy of the position information recorded in the article position record library.
The detection terminal further comprises a detection module, wherein the detection module is used for detecting an entrance signal and an exit signal of a person entering and exiting a room, and sending the detected entrance signal and the detected exit signal to all image acquisition modules in the room corresponding to the entrance signal and the exit signal;
the image acquisition module is also used for acquiring environment information when receiving an entrance signal and an exit signal.
The beneficial effects are that: under normal conditions, the positions of objects are likely to change before and after the movement of a person, so that the environment information in a room is acquired after the entrance signal and the exit signal of the person entering and exiting the room are detected, the environment information acquired by an image acquisition module is reduced, the analysis and processing process of the environment information by a position recording module is further reduced, and the analysis efficiency of the environment information is improved.
The system comprises a guiding terminal, a three-dimensional map building module, intelligent glasses, a display module and a display module, wherein the guiding terminal is used for acquiring house information and building a three-dimensional map according to the house information; the route guidance map is generated according to the guidance route information and is sent to the intelligent glasses;
the smart glasses are used to project a route guidance map in front of the eyes of the user, the route guidance map including guide landmarks.
The beneficial effects are that: the route guiding map is projected in front of the eyes of the user through the intelligent glasses, so that three-dimensional guiding road signs appear in front of the eyes of the user, and the objects to be searched can be found more intuitively and simply along with the guiding road signs.
The guiding terminal further comprises a voice learning module, wherein the voice learning module is used for acquiring voiceprint features of a user in advance, creating a voice learning library according to the voiceprint features, identifying voiceprint features of voice information, acquiring article information corresponding to the voice information from the voice processing module when the voiceprint features of the voice information are the voiceprint features acquired in advance, acquiring article information fed back by the display module when 2 or more article information exist, and storing the acquired article information and the voice information in the voice learning library in a correlated mode.
The beneficial effects are that: different users call the same article and possibly have differences, users in rooms are distinguished through voiceprint features, then a voice learning library is created for each user according to the voiceprint features, and voice information and associated article information which correspond to the users are stored in the voice learning library, so that article information of articles to be searched by different users can be distinguished more accurately.
Further, the voice processing module is further configured to process the voice information preferentially to obtain voiceprint features, then retrieve a voice learning library according to the voiceprint features, and obtain associated article information from the voice learning library according to the voice information.
The beneficial effects are that: and aiming at different voiceprint characteristics, acquiring associated article information from different voice learning libraries so as to improve the acquired article information to be more attached to articles found by different users.
Drawings
FIG. 1 is a logic block diagram of a first embodiment of an hunting guidance system for a particular item;
FIG. 2 is a logic block diagram of a second embodiment of an hunting guidance system for a particular item;
FIG. 3 is a logic block diagram of a third embodiment of an hunting guidance system for a particular item.
Detailed Description
The following is a further detailed description of the embodiments:
example 1
The object searching guiding system for special objects, as shown in figure 1, comprises intelligent glasses, a guiding terminal and a detecting terminal, wherein the guiding terminal is in communication connection with the detecting terminal, the detecting terminal comprises a display module, a detecting module and a plurality of image acquisition modules,
the detection module is used for detecting the entrance signals and the exit signals of people entering and exiting the room, and sending the detected entrance signals and the detected exit signals to all image acquisition modules in the room corresponding to the entrance signals and the exit signals. The detection module may employ an infrared detector or a laser detector, with the infrared detector being preferred in this embodiment.
The image acquisition module is used for acquiring environmental information of different positions; the image acquisition module is also used for acquiring environment information when receiving an entrance signal and an exit signal.
The guiding terminal comprises a voice processing module, an article searching module, a path generating module, a three-dimensional map building module and a voice playing module, wherein:
the voice processing module is used for receiving voice information of the object searching of the user, analyzing and identifying the voice information and obtaining object information of the object searching; the voice processing module is also used for carrying out association analysis and recognition on the voice information, and when 2 or more article information are associated, the article confirmation instruction and all the associated article information are sent to the article searching module.
The article searching module pre-stores an article image information base, wherein the article image information base comprises article image information and article characteristic information. The article searching module is used for searching article characteristic information in a pre-stored article image library according to the article information, searching target environment information in environment information according to the article characteristic information, measuring the position of the searched article according to a preset reference object in the target environment information to obtain a target position parameter of the searched article, and calculating according to the target position parameter and the position parameter of the preset reference object to obtain position information of the searched article; the article searching module is also used for searching article image information in the article image library according to the received article information after receiving the article confirmation instruction, generating image selection information by the searched article image information and the article information corresponding to the article image information, and sending the image selection information to the display module. In this embodiment, the preset reference object selects an object with a fixed position in the room as a reference object, such as a window, a bed, a table, a cabinet, etc., and then selects a reference point on the reference object, where the position parameters of the reference object include the spatial size of the reference object and the spatial position relationship of the reference point. In this embodiment, a space rectangular coordinate system is established with a point of a door frame foot of a room as a reference, and then the size of the space position of a reference object is measured.
The object searching module is also used for selecting the position where the object to be searched is located in the object environment information by utilizing the object detection technology frame according to the object characteristic information, and sending the object environment information after the frame selection to the display module.
The path generation module is used for planning a guiding path according to the position information and generating guiding path information.
The voice playing module is used for playing the guiding voice according to the guiding path information.
The display module is used for analyzing the received image selection information to obtain article image information and article information corresponding to the article image information, displaying the article image information and feeding back the article information corresponding to the selected article image information to the article search module. The display module is also used for displaying the received target image information.
The three-dimensional map construction module is used for acquiring house information and then constructing a three-dimensional map according to the house information; and the system is also used for generating a path guiding map according to the guiding path information and sending the path guiding map to the intelligent glasses. The three-dimensional map in this embodiment is constructed in the same manner as the 3D model.
Be equipped with laser emitter on the picture frame of intelligent glasses, laser emitter is used for projecting the route guidance map in user's eyes, and route guidance map includes the guidepost.
The specific implementation process comprises the following steps: the old people want to find the key, say 'find the key' to the guide terminal, the voice processing module receives voice information of the old people for finding the key, then carry out association analysis and recognition on the voice information to obtain 2 item information about the key, namely item information A and item information B, respectively, and the voice processing module sends an item confirmation instruction and 2 item information to the item searching module.
After receiving the article confirmation instruction, the article searching module searches corresponding article image information in an article image library according to the received article information of 2 related keys, namely article image information a and article image information B, generates image selection information according to the searched article information A and article information B and the article image information a and article image information B, sends the image selection information to the display module, the display module analyzes the received image selection information to obtain article information A and article information B and article image information a and article image information B, then displays the article image information a and article image information B, the old people select the image of the key which needs to be searched in the displayed article information A and article information B as article image a, and the display module feeds the article information A corresponding to the article image information a back to the article searching module.
The article searching module searches article characteristic information A in the article image library according to the article information A fed back by the display module, wherein the article characteristic information A comprises a plurality of article characteristics. And then searching the target environmental information containing the article characteristic information A from the environmental information acquired at different positions according to the article characteristic information A. The method comprises the steps of presetting a reference object in target environment information in advance, taking a table and a sofa as reference objects, taking the center point of the table and the center point of a single sofa as reference points, establishing a space rectangular coordinate system by taking one point of a door frame bottom foot of a room as a reference, and measuring the space position size of the table and the sofa. In the target environment information, the key is positioned on the dining table, the article searching module calculates the position information of the key in the space rectangular coordinate system according to the target position parameter and the position parameter of the table reference object, the position information is sent to the path generating module, the path generating module performs guiding path planning according to the position information to generate guiding path information, then the voice playing module plays guiding voice according to the guiding path information to go to the dining table, and the old on the dining table finds the key according to the guiding path information.
In addition, for a plurality of objects stacked on the dining table, when the old people does not see the key on the dining table, the object searching module can also utilize the object detection technology to frame the position of the key in the object environment information according to the object characteristic information of the key, the frame-selected object environment information is sent to the display module, the display module displays the frame-line object environment information, the old people can view the frame-selected object environment information displayed by the display module on the guiding terminal, after the frame selection, the position of the key is more striking, and the old people can conveniently see the key.
The old person can also choose to wear intelligent glasses, the three-dimensional map construction module obtains house information of the old person living, then constructs a three-dimensional map according to the house information, then generates a path guiding map according to the guiding path information, sends the path guiding map to the intelligent glasses, the intelligent glasses project the path guiding map to the eyes of the old person to form a virtual environment, guiding road signs are arranged in the path guiding map, and the old person can find keys on a dining table according to the guiding road signs.
Example two
The difference from the first embodiment is that: as shown in fig. 2, the guiding terminal further includes a position recording module, where the position recording module is configured to obtain position information filled according to a preset position template, and store the position information of the article and the article information in an associated manner, so as to generate an article position record library; the position recording module is also used for acquiring the environmental information of each position, comparing and analyzing whether the articles in the images are missing or added or not according to the environmental information acquired in the adjacent time, if the comparison and analysis result is that the articles are added, capturing the image information of the articles added in the environmental information, carrying out article characteristic identification on the image information to obtain article characteristic information, then matching corresponding article information in an article image library according to the article characteristic information, and sending the article information to the article searching module; and the position information corresponding to the original position information of the article in the article position record library is changed according to the position information fed back by the article searching module. And the position recording module is also used for capturing the image information of the reduced articles in the environment information of the next frame in the environment information of the previous frame if the comparison and analysis result is reduced, carrying out article characteristic recognition on the image information to obtain article characteristic information, and then deleting the position information corresponding to the article information in the article position record library according to the article characteristic information matched with the corresponding article information.
The article searching module is also used for searching the position information corresponding to the article information from the article grade position record library according to the article information when the article information is received.
Example two
The difference from the first embodiment is that: as shown in fig. 3, the guiding terminal further includes a voice learning module, where the voice learning module is configured to collect voiceprint features of a user in advance, create a voice learning library according to the voiceprint features, and identify voiceprint features of voice information, and when the voiceprint features of the voice information are identified as the voiceprint features collected in advance, acquire article information corresponding to the voice information from the voice processing module, and when there are 2 or more article information, acquire article information fed back by the display module, and store the acquired article information and the voice information in the voice learning library in an associated manner. The voice processing module is also used for preferentially processing the voice information to obtain voiceprint characteristics, then searching the voice learning library according to the voiceprint characteristics, and acquiring associated article information from the voice learning library according to the voice information.
For example, a key in a home is taken as an example, each family member has a key, and the family members call the keys, and at this time, the keys are distinguished according to voiceprint features of the user speaking, and the user looking for the key to be found by the user corresponding to the voiceprint features. And if the family members refer to the same article, the differences exist in habit references due to the differences of accents, and at the moment, according to the voiceprint characteristics of the speaker, the corresponding article is searched when the speaker is used for historical references, so that the user experience effect is improved.
The foregoing is merely exemplary embodiments of the present application, and specific structures and features that are well known in the art are not described in detail herein. It should be noted that modifications and improvements can be made by those skilled in the art without departing from the structure of the present application, and these should also be considered as the scope of the present application, which does not affect the effect of the implementation of the present application and the utility of the patent. The protection scope of the present application is subject to the content of the claims, and the description of the specific embodiments and the like in the specification can be used for explaining the content of the claims.
Claims (7)
1. The object searching guide system for the special object comprises a guide terminal and a detection terminal, wherein the guide terminal is in communication connection with the detection terminal, the detection terminal comprises a plurality of image acquisition modules, and the image acquisition modules are used for acquiring environmental information at different positions; the guiding terminal is characterized by comprising a voice processing module, an article searching module, a path generating module and a voice playing module, wherein:
the voice processing module is used for receiving voice information of the object searching of the user, analyzing and identifying the voice information and obtaining object information of the object searching;
the article searching module is used for searching article characteristic information in a pre-stored article image library according to the article information, searching target environment information in environment information according to the article characteristic information, measuring the position of the searched article according to a preset reference object in the target environment information to obtain a target position parameter of the searched article, and calculating according to the target position parameter and the position parameter of the preset reference object to obtain position information of the searched article;
the path generation module is used for planning a guiding path according to the position information and generating guiding path information;
the voice playing module is used for playing the guiding voice according to the guiding path information;
the guiding terminal also comprises a display module, and the article image library also comprises article image information;
the voice processing module is also used for carrying out association analysis and recognition on the voice information, and sending an article confirmation instruction and all the associated article information to the article searching module when 2 or more article information are associated; the article searching module is also used for searching article image information in the article image library according to the received article information after receiving the article confirmation instruction, generating image selection information by the searched article image information and the article information corresponding to the article image information, and sending the image selection information to the display module; the display module is used for analyzing the received image selection information to obtain article image information and article information corresponding to the article image information, displaying the article image information and feeding back the article information corresponding to the selected article image information to the article search module;
the guiding terminal also comprises a voice learning module, wherein the voice learning module is used for acquiring voiceprint characteristics of a user in advance, creating a voice learning library according to the voiceprint characteristics, identifying voiceprint characteristics of voice information, acquiring article information corresponding to the voice information from the voice processing module when the voiceprint characteristics of the voice information are identified as the voiceprint characteristics acquired in advance, acquiring article information fed back by the display module when the article information with the number of 2 or more exists, and storing the acquired article information and the voice information in the voice learning library in a correlated manner;
the voice processing module is also used for preferentially processing the voice information to obtain voiceprint characteristics, then searching the voice learning library according to the voiceprint characteristics, and acquiring associated article information from the voice learning library according to the voice information.
2. The hunting guidance system for special objects of claim 1, wherein: the article searching module is also used for selecting the position of the article to be searched from the target environment information according to the article characteristic information and sending the target environment information after the selection to the display module;
the display module is also used for displaying the received target image information.
3. The hunting guidance system for special objects of claim 1, wherein: the guiding terminal further comprises a position recording module, wherein the position recording module is used for acquiring position information filled in according to a preset position template, and storing the position information of the article and the article information in a correlated mode to generate an article position record library; the article searching module is also used for searching the position information corresponding to the article information from the article grade position record library according to the article information when the article information is received.
4. The hunting guidance system for special objects of claim 1, wherein: the position recording module is also used for acquiring the environmental information of each position, comparing and analyzing whether the articles in the images are missing or added or not according to the environmental information acquired in the adjacent time, if the comparison and analysis result is that the articles are added, capturing the image information of the articles added in the environmental information, carrying out article characteristic identification on the image information to obtain article characteristic information, then matching corresponding article information in an article image library according to the article characteristic information, and sending the article information to the article searching module; and the position information corresponding to the original position information of the article in the article position record library is changed according to the position information fed back by the article searching module.
5. The hunting guide system for specific items according to claim 4, wherein: and the position recording module is also used for capturing the image information of the reduced articles in the environment information of the next frame in the environment information of the previous frame if the comparison and analysis result is reduced, carrying out article characteristic recognition on the image information to obtain article characteristic information, and then deleting the position information corresponding to the article information in the article position record library according to the article characteristic information matched with the corresponding article information.
6. The hunting guidance system for special objects of claim 1, wherein: the detection terminal also comprises a detection module, wherein the detection module is used for detecting an entrance signal and an exit signal of a person entering and exiting a room, and sending the detected entrance signal and the detected exit signal to all image acquisition modules in the room corresponding to the entrance signal and the exit signal;
the image acquisition module is also used for acquiring environment information when receiving an entrance signal and an exit signal.
7. The hunting guidance system for special objects of claim 1, wherein: the system comprises a guiding terminal, intelligent glasses, a three-dimensional map building module and a control module, wherein the guiding terminal further comprises the three-dimensional map building module which is used for acquiring house information and then building a three-dimensional map according to the house information; the route guidance map is generated according to the guidance route information and is sent to the intelligent glasses;
the smart glasses are used to project a route guidance map in front of the eyes of the user, the route guidance map including guide landmarks.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010757110.8A CN111858993B (en) | 2020-07-31 | 2020-07-31 | Article finding guiding system for special article |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010757110.8A CN111858993B (en) | 2020-07-31 | 2020-07-31 | Article finding guiding system for special article |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111858993A CN111858993A (en) | 2020-10-30 |
| CN111858993B true CN111858993B (en) | 2023-10-20 |
Family
ID=72952670
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010757110.8A Active CN111858993B (en) | 2020-07-31 | 2020-07-31 | Article finding guiding system for special article |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111858993B (en) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022099651A1 (en) * | 2020-11-13 | 2022-05-19 | 南京瑞祥信息技术有限公司 | Apparatus for searching for target object |
| CN112327659A (en) * | 2020-11-26 | 2021-02-05 | 深圳市友进科技有限公司 | Intelligent household control method, device and system based on 5G |
| CN112861753B (en) * | 2021-02-23 | 2024-03-19 | 河南宏昌科技有限公司 | Management method in common space |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103954276A (en) * | 2014-04-21 | 2014-07-30 | 中国科学院深圳先进技术研究院 | Shopping navigation system and method based on smart glasses |
| TW201447825A (en) * | 2013-06-14 | 2014-12-16 | Taiwan Secom Co Ltd | Surveillance system for image recognition |
| CN107133573A (en) * | 2017-04-12 | 2017-09-05 | 宇龙计算机通信科技(深圳)有限公司 | A kind of method and apparatus for finding article |
| CN108833688A (en) * | 2018-05-30 | 2018-11-16 | Oppo广东移动通信有限公司 | Position reminding method, apparatus, storage medium and electronic equipment |
| CN109325153A (en) * | 2018-08-30 | 2019-02-12 | 上海与德科技有限公司 | Storing approaches to IM, electronic equipment and computer-readable deposit medium |
| CN109522811A (en) * | 2018-10-23 | 2019-03-26 | 中国人民解放军海军航空大学 | A kind of reaching materials system and method |
| CN110390300A (en) * | 2019-07-24 | 2019-10-29 | 北京洛必德科技有限公司 | A kind of target follower method and device for robot |
| CN110910876A (en) * | 2019-11-25 | 2020-03-24 | 杭州智芯科微电子科技有限公司 | Article sound searching device and control method, and voice control setting method and system |
| CN111401325A (en) * | 2020-04-21 | 2020-07-10 | 英华达（上海）科技有限公司 | System and method for quickly searching for articles |
-
2020
- 2020-07-31 CN CN202010757110.8A patent/CN111858993B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TW201447825A (en) * | 2013-06-14 | 2014-12-16 | Taiwan Secom Co Ltd | Surveillance system for image recognition |
| CN103954276A (en) * | 2014-04-21 | 2014-07-30 | 中国科学院深圳先进技术研究院 | Shopping navigation system and method based on smart glasses |
| CN107133573A (en) * | 2017-04-12 | 2017-09-05 | 宇龙计算机通信科技(深圳)有限公司 | A kind of method and apparatus for finding article |
| CN108833688A (en) * | 2018-05-30 | 2018-11-16 | Oppo广东移动通信有限公司 | Position reminding method, apparatus, storage medium and electronic equipment |
| CN109325153A (en) * | 2018-08-30 | 2019-02-12 | 上海与德科技有限公司 | Storing approaches to IM, electronic equipment and computer-readable deposit medium |
| CN109522811A (en) * | 2018-10-23 | 2019-03-26 | 中国人民解放军海军航空大学 | A kind of reaching materials system and method |
| CN110390300A (en) * | 2019-07-24 | 2019-10-29 | 北京洛必德科技有限公司 | A kind of target follower method and device for robot |
| CN110910876A (en) * | 2019-11-25 | 2020-03-24 | 杭州智芯科微电子科技有限公司 | Article sound searching device and control method, and voice control setting method and system |
| CN111401325A (en) * | 2020-04-21 | 2020-07-10 | 英华达（上海）科技有限公司 | System and method for quickly searching for articles |
Non-Patent Citations (2)
| Title |
|---|
| Hybrid neural-based guiding system for mobile robots;P. Sanchez 等;《NAFIPS 2008 - 2008 Annual Meeting of the North American Fuzzy Information Processing Society》;1-6 * |
| 基于蓝牙方式的智能防丢语音寻物器的设计;彭井花;《绵阳师范学院学报》;第38卷(第2期);88-92 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111858993A (en) | 2020-10-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111858993B (en) | Article finding guiding system for special article | |
| US10275945B2 (en) | Measuring dimension of object through visual odometry | |
| JP4630146B2 (en) | Position management system and position management program | |
| US11158128B2 (en) | Spatial and semantic augmented reality autocompletion in an augmented reality environment | |
| US9292936B2 (en) | Method and apparatus for determining location | |
| US7539556B2 (en) | Face image acquisition method and face image acquisition system | |
| CN101101520B (en) | User interface system based on pointing device | |
| EP1696354A1 (en) | Method, system and portable device for real-time provision of gallery guide and exhibit information | |
| CN108062098B (en) | Map construction method and system for intelligent robot | |
| US20120230581A1 (en) | Information processing apparatus, information processing method, and program | |
| CN107480129A (en) | A kind of article position recognition methods and the system of view-based access control model identification and speech recognition | |
| CN103245345B (en) | A kind of indoor navigation system based on image sensing technology and navigation, searching method | |
| JP5127237B2 (en) | Group analysis system and group analysis apparatus | |
| CN110487262A (en) | Indoor orientation method and system based on augmented reality equipment | |
| JP2010016443A (en) | Situation recognizing apparatus, situation recognizing method, and radio terminal apparatus | |
| GB2379309A (en) | Recognition and identification apparatus | |
| CN104094588A (en) | Imaging device | |
| US20170282373A1 (en) | Reception system and reception method | |
| JP2008509457A (en) | Pointing device and method for item position detection and / or selection support | |
| CN111512370A (en) | Voice tagging of video while recording | |
| JP6959888B2 (en) | A device, program and method for estimating the terminal position using a model related to object recognition information and received electromagnetic wave information. | |
| JPH0723012A (en) | Audience rating survey system | |
| CN112511757B (en) | Video conference implementation method and system based on mobile robot | |
| JP2006101013A (en) | Guide information display | |
| KR101809444B1 (en) | Exhibition Guide Information Providing System Basesd Positional Information Of Beacon |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |