CN109324693A - AR searcher, the articles search system and method based on AR searcher - Google Patents
AR searcher, the articles search system and method based on AR searcher Download PDFInfo
- Publication number
- CN109324693A CN109324693A CN201811474803.5A CN201811474803A CN109324693A CN 109324693 A CN109324693 A CN 109324693A CN 201811474803 A CN201811474803 A CN 201811474803A CN 109324693 A CN109324693 A CN 109324693A
- Authority
- CN
- China
- Prior art keywords
- searcher
- image
- space
- article
- search
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/012—Head tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/20—Scenes; Scene-specific elements in augmented reality scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Abstract
The present invention provides AR searcher, based on the articles search system and method for AR searcher, which includes: wearable AR main equipment, for obtaining and enhancing the image data of the article in display environment space and the environment space；Articles search equipment, for constantly reducing search range among the image data, until locking searched object.The present invention is based on the articles search devices of AR technology, make articles search more intelligent, it is known that orientation locating for article, it is known that user wishes the object of search, interaction, help user's environment-identification and object, thus it is convenient, accurate, fast and efficiently scan for and locked items.
Description
Technical field
The present invention relates to search technique field, espespecially searcher, the articles search system and method based on searcher.
Background technique
Regardless of the age, especially after material abundance, article is more and more, such as office appliance, family
Various objects or hypercomplex structure device for mechanical, everybody can encounter the time and can not find article/part situation.
In daily life, work or production process, when facing a large amount of article, if without effective articles search system, searched
Rope equipment, the article needs that find urgent need take a long time and energy, will cause the waste of very big time and efforts,
It even can not find, many consequences for extending out, be not that time and efforts can measure.
The solution often having now is to need to paste each article RFID tag before use, and carry out label substance
Data input and system typing, but complied with one's wishes not to the utmost using upper, such as not bad to big article, be attached to small article will limit with it
The small article is watched, plays or is operated.More sometimes, RFID tag is easily lost, once losing, can not just pass through RFID
Searcher carries out article scanning and searches.
How to allow articles search more intelligent, it is known that orientation locating for article, it is known that user wish search, interaction
Object helps user's environment-identification and object, to conveniently, accurately, fast and efficiently scan for locked items being urgently
Problem to be solved.
Application No. is 201810050821.4 inventions, provide a kind of aobvious optical system of the see-through head of nearly eye, including first
Lens, the second lens and a miniature image display, the first lens are all bonded with miniature image display with the second lens, and
First lens and the second lens are all equal thick free-form surface lens.Optics is shown by the nearly see-through head of eye provided by the present invention
System architecture can also eliminate miniature image and show other than it can reduce the number that light reflects in this optical system framework
The aberration of the light that device is issued in all directions, makes it see that image not will cause aberration with angle in all directions.
Application No. is 201821172477.8 inventions, and an AR is provided on the basis of above-mentioned optical system and shows equipment,
Wherein the AR shows that equipment includes at least one display/projector and at least one Optical devices, and real image passes through the optics
Device building, the virtual image are constructed in the Optical devices by the display/projector, and the real image and the virtual image are combined and appeared in
In same visual field, wherein the Optical devices include at least one main lens and at least one free-form surface lens, it is described from
By toroidal lens, the image that is projected for reflecting the display/projector；The main lens, for being shown described in secondary reflection again
Show/the image that projects of projector.The AR equipment can accomplish big visual angle, small size, light weight, and it is heavy that wearing user can have
The experience sense of immersion AR.
Application No. is 201810994555.0 inventions, further provide one on the basis of aforementioned AR shows equipment
Formula actual situation interactive device and actual situation exchange method are worn, wherein the wear-type actual situation interactive device includes wearing AR to show equipment,
For by least showing 3D virtual image in described wear in the visual field that AR shows equipment；Device is interacted with actual situation, for obtaining
AR is worn described in wearing shows the behavior act of equipment person perhaps control instruction and according to the behavior act or control instruction
And change or control the content of the 3D virtual image.
Summary of the invention
Can be on the Nonopaque type AR technology of above-mentioned referenced patents or the basis of image-type AR technology, the purpose of the present invention
It is to provide AR searcher, the articles search system and method based on AR searcher, and it is an object of the present invention to provide a kind of new search
Method and searcher make articles search more intelligent, it is known that orientation locating for article also can know that user wishes to search
The object seek, interacted conveniently, accurately, is fast and efficiently scanned for and is locked to help user's environment-identification and object
Earnest product.
Technical solution provided by the invention is as follows:
The present invention provides a kind of AR searcher, comprising: wearable AR main equipment and articles search equipment, it is described to wear
AR main equipment is worn to be electrically connected with articles search equipment；
The wearable AR main equipment, for obtaining and enhancing the article in display environment space and the environment space
Image data；
The articles search equipment, for constantly reducing search range among the image data, until locking is searched
Rope object.
Further, the articles search equipment includes: instruction acquisition unit and object confirmation unit, and described instruction obtains
Unit is electrically connected with object confirmation unit；
Described instruction acquiring unit, for obtaining the object confirmation instruction of input；
The object confirmation unit, for constantly reducing search range according to object confirmation instruction, until confirmation is aobvious
The target search range in the image data shown and/or the searched object.
Further, described instruction acquiring unit includes: that gesture interaction component, head take aim at component, eye-tracking component, language control
In component any one or it is a variety of；The object confirmation unit and the gesture interaction component, head take aim at component, eye-tracking
Any one in component, language control component or a variety of electrical connections；The gesture interaction component includes wisdom gloves, wisdom ring
Refer to, control handle, body-sensing sensor, in gesture controller any one or it is a variety of；
The gesture interaction component is acted for detection gesture, according to the determination of the gesture motion, generates object confirmation
Instruction；
The head takes aim at component, for detecting the headwork of wearer, is generated according to the article that the headwork determines
Object confirmation instruction；
The eye-tracking component watches movement attentively for detect eyeball, and to watch the determining article of movement attentively raw according to described
In pairs as confirmation instructs；
Institute's predicate control component, for receiving the object confirmation instruction of voice input.
Further, the AR searcher further include: information storage unit, the information storage unit are worn with described
Wear AR main equipment and/or the electrical connection of articles search equipment；
The information storage unit, for prestore the image data and article and/or prestore the article and space it
Between corresponding relationship.It is called when so as to for searching for the target search object.
Further, the articles search equipment includes: orientation range lock cell；
The orientation range lock cell, for obtaining sensing data, and the AR according to the sensing data acquisition is searched
Spatial dimension where rope device.
Further, the orientation range lock cell includes: positioning auxiliary subelement, and/or, image recognition positioning is single
Member；The positioning auxiliary subelement and/or image recognition positioning unit are electrically connected with the wearable AR main equipment；
The positioning auxiliary subelement, for positioning the spatial position where the AR searcher；
Described image identifies positioning unit, for carrying out feature extraction to the ambient image, by characteristics of image and presets
The environmental characteristic in space is compared, and identification positions the spatial dimension where the AR searcher.
Further, the positioning auxiliary subelement includes: satellite positioning identification module, sensing fixation and recognition module, leads to
Believe fixation and recognition module in any one or it is a variety of；
The satellite positioning identification module is positioned for longitude and latitude, and according to longitude and latitude data identification positioning
Spatial dimension where AR searcher；
The sensing fixation and recognition module, for the preset motion sensor from the environment space, or from set on institute
Acquisition exercise data at the motion sensor of AR searcher is stated, and the AR search dress is positioned according to exercise data identification
Spatial dimension where setting, further comprises the IMU such as gyroscope, magnetometer, accelerometer sensor to determine spatial position
The direction position and/or；
The communication fixation and recognition module, for being carried out at least one wireless access point preset in the environment space
Communication positions the spatial dimension where the AR searcher according to communication signal strength identification.
Further, the wearable AR main equipment includes: image acquisition unit, and image processing unit and AR display are single
Member；
Described image acquiring unit, for capturing reality scene image；
Described image processing unit, for generating virtual reality scenario image according to the reality scene image；
The AR display unit shows the virtual reality scenario image for enhancing.
Further, the AR searcher further include: environment sensor device, the environment sensor device are worn with described
Wear the electrical connection of AR main equipment；
The environment sensor device for obtaining ambient condition, and feeds back to the articles search equipment, trigger/does not touch
It sends out articles search equipment described and obtains the guide for controlling to adjust the relative article of the ambient condition.
Further, the AR searcher further include: zoom camera, the zoom camera and the wearable AR
Main equipment electrical connection；The zoom camera, for the image in the different zones after dividing visual field that further.
Further, the gesture of the mono-/bis-hand for identification of the body-sensing sensor on AR glasses, by the gesture of identification be superimposed into
In visual field, such zoom camera just further in visual field in the box that both hands gesture is constituted image, in the visual field that furthers in both hands
The image in circular frame that gesture is constituted, or the image in the visual field that furthers in the circular frame that singlehanded gesture is constituted.
The present invention also provides a kind of articles search systems based on AR searcher, comprising: AR searcher and auxiliary are taken the photograph
As equipment；The second camera equipment and the AR searcher communication connection；
The second camera equipment, for obtaining the image data of the article in environment space and the environment space, and
It is sent to the AR searcher；
The AR searcher, for obtaining and enhancing the image of the article in display environment space and the environment space
Data constantly reduce search range among the image data, until locking searched object.
Further, the second camera equipment includes: that IP Camera, unmanned aerial vehicle onboard camera, unmanned vehicle are vehicle-mounted
Camera, robot load camera in any one or it is a variety of.
Further, the second camera equipment further include: orientation range lock cell；
The orientation range lock cell, for obtaining sensing data, and according to the sensing data acquisition articles search
Spatial dimension where carrier；The articles search carrier includes Virtual Space intermediary, the AR searcher or described auxiliary
Help picture pick-up device.
Further, the ambient image in space where the second camera equipment shooting obtains, and be sent to the AR and search
Rope device:
The AR searcher further include: image recognition positioning unit；
Described image identifies positioning unit, for carrying out feature extraction to the ambient image, by characteristics of image and presets
The environmental characteristic in space is compared, and identification positions the spatial dimension where the second camera equipment.
Further, the orientation range lock cell include: satellite positioning identification module, sensing fixation and recognition module,
Communicate fixation and recognition module in any one or it is a variety of；
The satellite positioning identification module, for obtaining longitude and latitude data from position location satellite, and according to the longitude and latitude
Data identification positions the spatial dimension where the articles search carrier；
The sensing fixation and recognition module, for the preset motion sensor from the environment space, or from set on institute
Acquisition exercise data at the motion sensor of articles search carrier is stated, and the article is positioned according to exercise data identification and is searched
Spatial dimension where Suo Zaiti；
The communication fixation and recognition module, for being carried out at least one wireless access point preset in the environment space
Communication positions the spatial dimension where the articles search carrier according to communication signal strength identification.
Further, the AR searcher further include: virtual objects generation unit；
The virtual objects generation unit, the search that the searched object is searched for for enhancing display reminding are guided.
Further, the virtual objects generation unit includes: virtual guide module, and/or, virtual instruction generates mould
Block；
The virtual guide module, for guiding user to find and the clearly described searched object；
The virtual instruction generation module, for being superimposed virtual guiding plan on the virtual reality scenario image of display
Shape, the virtual guide figure include；Virtual direction arrow and/or virtual dividing line.
Further, the virtual guide module includes: Virtual Space intermediary；
Space and the storage are administered for the storage where prompting the AR searcher by the Virtual Space intermediary
Deposit the image data and/or article situation information of each article in administration space；The image data include article image and/or
Item identification code；The article situation information include article orientation, article function, in article condition any one or it is more
Kind.
Further, the articles search system further include: environment sensor device, the environment sensor device are set to institute
State environment space, AR searcher and/or second camera equipment；
The environment sensor device for obtaining environmental state information, and feeds back to the AR searcher, and triggering/no
It triggers the AR searcher and obtains the guide for controlling to adjust the relative article of the ambient condition.
Further, the articles search system further include: zoom camera, the zoom camera are searched with the article
Cable system electrical connection；The zoom camera, in the different zones after dividing visual field that further image, in the visual field that furthers
In image, the visual field that furthers in the box of (AR glasses end) both hands gesture composition in the circular frame that (AR glasses end) both hands gesture is constituted
Image, or the image in the visual field that furthers in the circular frame that (AR glasses end) singlehanded gesture is constituted.
Further, the gesture of the mono-/bis-hand for identification of the body-sensing sensor on AR glasses, by the gesture of identification be superimposed into
In visual field, such zoom camera can further in visual field in the box that both hands gesture is constituted image, in the visual field that furthers
The image in circular frame that both hands gesture is constituted, or the image in the visual field that furthers in the circular frame that singlehanded gesture is constituted.
The present invention also provides a kind of articles search methods based on AR searcher, comprising:
S200: the environment space determined where articles search carrier is positioned；
S400: it is obtained by AR searcher and enhances the article in the display environment space and the environment space
Image data；
S500: constantly reducing search range among the image data, until locking searched object.
Further, include: before the S200
S100: prestoring the image data and article and/or prestores corresponding relationship between the article and space.
Further, after the S200 comprising steps of
S201: the image data of the article for the environment space that second camera equipment is sent is received.
Further, the S200 further comprises step:
S210: sensing data are obtained, and according to the spatial dimension where the sensing data acquisition articles search carrier；Institute
Stating articles search carrier includes Virtual Space intermediary, the AR searcher or the second camera equipment；
The S400 further comprises step:
S410: the object confirmation instruction of input is obtained；
The S500 further comprises step:
S510: search range is constantly reduced according to object confirmation instruction, until confirmation shows that the articles search carries
Spatial dimension where body corresponds to target search range and/or the searched object in image data.
Further, the S510 further comprises following either step:
S511: the image to further in the different zones after dividing visual field；
S512: the image in the visual field that furthers in the box that both hands gesture is constituted；
S513: the image in the visual field that furthers in the circular frame that both hands gesture is constituted；
S514: the image in the visual field that furthers in the circular frame that singlehanded gesture is constituted.
Further, the S410 further comprises following either step:
S411: detection gesture movement generates object confirmation instruction according to the determination of the gesture motion；
S412: detecting the headwork of wearer, generates object confirmation instruction according to the article that the headwork determines；
S413: that detects eyeball watches movement attentively, watches the determining article generation object confirmation instruction of movement attentively according to described；
S414: the object for receiving voice input confirms instruction.
Further, the S210 further comprises following either step；
S211: longitude and latitude data are obtained from position location satellite, and the article is positioned according to longitude and latitude data identification
Spatial dimension where search vector；
S212: the preset motion sensor from the environment space, or from be set to the articles search carrier movement
Exercise data is obtained at sensor, and the space model where the articles search carrier is positioned according to exercise data identification
It encloses；
S213: being communicated at least one wireless access point preset in the environment space, strong according to signal of communication
Degree identification positions the spatial dimension where the articles search carrier；
S214: the ambient image in space where shooting obtains the AR searcher carries out feature to the ambient image
It extracts, characteristics of image is compared with the environmental characteristic of pre-set space, identification positions the space where the AR searcher
Range；
S215: the ambient image in space where obtaining the second camera equipment from the second camera equipment, to institute
It states ambient image and carries out feature extraction, characteristics of image is compared with the environmental characteristic of pre-set space, identification positions the AR
Spatial dimension where searcher.
Further, the S400 further comprises:
S450: reality scene image is captured；
S460: generating virtual reality scenario image according to the reality scene image, and enhances the display virtual reality
Scene image；
S470: virtual guide figure is superimposed on the virtual reality scenario image of display, enhancing display superposition is
The virtual virtual reality scenario image for guiding figure is stated, searches for the searched object to guide；
Wherein, the virtual guide figure includes；Virtual direction arrow and/or virtual dividing line.
It further, further include step before the S200；
S120: environmental state information is obtained；
S130: the articles search equipment trigger/is not triggered according to the environmental state information and is obtained described in control and regulation
The guide of the relative article of ambient condition.
AR searcher, the articles search system and method based on AR searcher provided through the invention is based on AR
The articles search device of technology, makes articles search more intelligent, it is known that orientation locating for article, it is known that user wish search,
Interactive object helps user's environment-identification and object, to facilitate, is accurate, fast and efficiently scan for and lock object
Product.
Detailed description of the invention
Below by clearly understandable mode, preferred embodiment is described with reference to the drawings, is searched to AR searcher, based on AR
Above-mentioned characteristic, technical characteristic, advantage and its implementation of the articles search system and method for rope device are further described.
Fig. 1 is the structural schematic diagram of AR searcher first embodiment of the present invention；
Fig. 2 is the structural schematic diagram of the image-type AR helmet of the present invention with gesture interaction component；
Fig. 3 is the structural schematic diagram of the Nonopaque type AR helmet of the present invention with gesture interaction component；
Fig. 4 is the schematic diagram of the default coordinate system of body-sensing sensor of the present invention；
Fig. 5 is the schematic diagram of gesture interaction component induction finger tip of the present invention；
Fig. 6 is the work flow diagram of AR searcher of the present invention；
Fig. 7 is the topological schematic diagram of AR searcher of the present invention；
Fig. 8 is the topological schematic diagram of the articles search system the present invention is based on AR searcher；
Fig. 9 is another topological schematic diagram of the articles search system the present invention is based on AR searcher；
Figure 10 is another topological schematic diagram of the articles search system the present invention is based on AR searcher；
Figure 11 is a flow chart of the articles search method the present invention is based on AR searcher.
Drawing reference numeral explanation: 8- gesture interaction component；100-AR searcher；The wearable AR main equipment of 110-；120-
Articles search equipment；121- instruction acquisition unit；122- object confirmation unit；130- camera；200- article；300- auxiliary is taken the photograph
As equipment；The Virtual Space 400- intermediary.
Specific embodiment
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, Detailed description of the invention will be compareed below
A specific embodiment of the invention.It should be evident that drawings in the following description are only some embodiments of the invention, for
For those of ordinary skill in the art, without creative efforts, it can also be obtained according to these attached drawings other
Attached drawing, and obtain other embodiments.
To make simplified form, part related to the present invention is only schematically shown in each figure, they are not represented
Its practical structures as product.In addition, there is identical structure or function in some figures so that simplified form is easy to understand
Component only symbolically depicts one of those, or has only marked one of those.Herein, "one" is not only indicated
" only this ", can also indicate the situation of " more than one ".
AR (AugmentedReality, augmented reality) be a kind of position for calculating camera image in real time and angle simultaneously
In addition the technology of respective image, video, 3D model, the target of this technology is on the screen virtual world " set " in real generation
Boundary is simultaneously interacted.
First embodiment
A kind of AR searcher 100 (searcher), as shown in Figure 1, comprising: wearable AR main equipment 110 and article are searched
Rope equipment 120, wearable AR main equipment 110 are electrically connected with articles search equipment 120；Wearable AR main equipment 110, is used for
Obtain and enhance the image data of the article 200 in display environment space and environment space；Articles search equipment 120 is used for
Search range is constantly reduced among image data, until locking searched object.
Specifically, wearable AR main equipment 110 includes: AR glasses, AR all-in-one machine etc..Wearable AR main equipment 110
It may also include that intelligent movable equipment, such as: smart phone, Intelligent flat etc., and the AR head of intelligent movable equipment can be connected
Helmet, AR aobvious etc..
Wearable AR main equipment 110 is according to the environment space where user, the shadow of article 200 in display environment space
As data, when user is in some environment space, wearable AR main equipment 110 shows the object in the environment space
The image data of product 200, then by articles search equipment 120 according to the image of wearable AR main equipment 110 enhancing display
Search range is constantly reduced in the operation of data and user among image data, i.e., successively shows in the environment space
Then the image data of article 200 shows the image data of the article 200 of some regions in the environment space, until locking quilt
Search for object.
Optionally, articles search equipment 120 includes: instruction acquisition unit 121 and object confirmation unit 122；Instruction obtains
Unit 121 is electrically connected with object confirmation unit 122；Instruction acquisition unit 121, for obtaining the object confirmation instruction of input；It is right
As confirmation unit 122, for constantly reducing search range according to object confirmation instruction, until in the image data of confirmation display
Target search range and/or searched object.
Optionally, instruction acquisition unit 121 includes: that gesture interaction component 8, head take aim at component, eye-tracking component, language control portion
In part any one or it is a variety of；Object confirmation unit 122 and the gesture interaction component 8, head take aim at component, eye-tracking portion
Any one in part, language control component or a variety of electrical connections；Gesture interaction component 8 includes wisdom gloves, wisdom ring, control
Handle, body-sensing sensor, in gesture controller any one or it is a variety of；
Gesture interaction component 8 is acted for detection gesture, according to the determination of gesture motion, generates object confirmation instruction；
Preferably, gesture interaction component 8 is acted for detection gesture, the generation pair of article 200 determined according to gesture motion
As confirmation instructs.Gesture interaction component 8 is the body-sensing sensor about gesture, such as: LEAPMOTION body-sensing sensor,
uSensFingo。
It is explained using LEAPMOTION body-sensing sensor as gesture interaction component 8:
LEAPMOTION body-sensing sensor is a manual interactive device of micron order 3D, can track as low as 0.01 millimeter
Movement, possess 150 degree of visual angle, the movement of 10 fingers of 1 people can be tracked, maximum frequency is 290 frame per second.
Gesture is captured in the space that LEAPMOTION body-sensing sensor is built, and shows that hand and arm skeleton, the hand of people there are 29 pieces of bones
Head, 29 joints, 123 ligaments, 48 nerves and 30 arteries.LEAPMOTION body-sensing sensor also almost grasps this
One technology, that is to say, that it can not detect non-manpower energy and gesture come out.
LEAPMOTION body-sensing sensor space is superimposed into AR three-dimensional display space, in gesture and AR three-dimensional display space
Object interact/feed back, and LEAPMOTION body-sensing sensor can be tracked accurately.Technically, this is 8 cubic feet pers
The interactive 3d space of ruler.10 fingers of the traceable whole people of LEAPMOTION body-sensing sensor, precision are up to 1/100 milli
Rice.It is more accurate more than existing movement control technology.The spatial field of view of 150 ° of ultra-wides, can be as in real world
With the mobile both hands in the space for being intended to 3D.LEAPMOTION body-sensing sensor is with the Velocity Pursuit user's more than 200 frame per second
Hand is mobile, realizes perfect synchronization.
Identified object include thumb (Thumbfinger), index finger (Indexfinger), middle finger (Middlefinger),
The third finger (Ringfinger), little finger (Pinkyfinger), available its initial position start of each finger (X, Y,
Z), final position end (X, Y, Z) and direction direction (pitch, roll, yaw).If passed by LEAPMOTION body-sensing
Sensor can will be directed toward by unarmed finger, carry out spatially extended calculating, lock specific article 200.The specific object of the locking
Product 200, can be shown by " picture-in-picture " mode or " hawkeye " mode is shown.
Fig. 2 is that AR head-mounted display (image-type HMD) and Fig. 3 with gesture interaction component 8 are another with hand
The AR head-mounted display (Nonopaque type HMD) of gesture interactive component 8.
Based on AR searcher 100, in conjunction with LeapMotion (2 infrared cameras 130) sensor, to realize gesture
Grab the function of dummy object.
1. utilizing Unity3D engine, the virtual scene space of a 3D is built, creates certain 3D void in the virtual scene space
Quasi- object, such as virtual selection menu.
2. accessing SDK (Software Development Kit (the foreign language acronym: SDK, foreign language of the six degree of freedom of high pass production
Full name: SoftwareDevelopmentKit) be typically all some software engineers be specific software package, it is software frame, hard
The set of developing instrument when part platform, operating system etc. establish application software.).By the gyroscope location data in equipment,
Position of the equipment in virtual scene is calculated, while being mapped in the virtual scene space of Unity3D creation, so that realizing can
The 6DOF effect for rotating and walking in the 3 d space.
3. the SDK for the identification gesture (spatial parameter) that LEAPMOTION body-sensing sensor provides is accessed, in virtual scene sky
Between middle addition hand model (including hand and arm).Need exist for driving and the hardware device of LEAPMOTION body-sensing sensor
It supports.The gesture information parameter that driving detects can be transmitted to Unity3D. and map these information to hand model by leapSDK
On, it can be realized and true hand is modeled to virtual hand, and be presented in virtual 3D scene space.
4. the information of gesture is carried out analytical calculation in Unity3D engine, some specific gesture shapes are obtained, such as
The movement of " direction " of index finger finger on hand.Analysis obtains the beginning and end for " being directed toward " movement.At the beginning and end of according to food
Refer on the direction of the extension line of finger tip (as shown in Figure 5) whether within the scene face that AR glasses (depth camera 130) are watched attentively.
It is to enter " direction " when certain point on the extension line of finger tip has intersection point with the scene face that AR glasses (depth camera 130) watches attentively
State, when the scene face that certain point on the extension line of finger tip is watched attentively with AR glasses (depth camera 130) does not have intersection point, as
Leave the state of " direction ".
5. analysis obtains focus, the search that AR glasses (depth camera 130) are watched attentively after capable of identifying " direction " movement
Scene face further reduces (display can be to synchronize to be further amplified, zoom camera 130), according to the search field of Focus hold
The radius size in scape face is set according to need.
6. using platform (including Android, iOS, PSP, xbox and PC etc.) at corresponding hardware by the publication of Unity3D engine
Application program.
(unarmed) gesture control can be identified except through LEAPMOTION body-sensing sensor and coordinate-system (as shown in Figure 4)
In addition, can with the body-sensings sensor such as uSensFingo, Kinect, XtionPro, RealSense, or by handle control,
The controllers such as wisdom gloves, watch style IMU sensor obtain the spatial value of hand motion parameter and value of feedback identifies gesture control.
Illustratively, both hands finger constitutes rectangle or circular scope, and fingers of single hand constitutes circular scope, to be formed
Pattern range in lock range where searched object, specifically searched object is determined further according to gesture motion, to generate
Object confirmation instruction.
Head takes aim at component, and for detecting the headwork of wearer, it is true to generate object according to the article 200 that headwork determines
Recognize instruction；Eye-tracking component watches movement attentively for detect eyeball, generates object according to the determining article 200 of movement is watched attentively
Confirmation instruction；Language control component, for receiving the object confirmation instruction of voice input.Language control component includes: microphone and semantic language
Sound judging submodule.Head takes aim at the use of component, to rely on gyroscope, magnetometer, the accelerometer etc. in AR searcher 100
IMU sensor determines orientation.Or replace head to take aim at by eye-tracking camera 130, realize the positioning and operation of mouse
Function.Or it can also be by wearable device, such as wisdom gloves, wisdom ring, control handle etc., to realize determining for mouse
Position and operating function.
Search interactive mode on wearable AR main equipment 110 is also varied, including head is taken aim at, eye-tracking, sound
Sound, wisdom gloves, control handle, free hand gestures, and scanned for the interaction mode of Virtual Space intermediary 400, all greatly
Ground enriches the realization possibility and application range of AR search equipment.Such as search range is constantly reduced among image data,
Until locking searched object, searched object includes smart home and non intelligent household, smart home such as TV, sound equipment, illumination
Lamp, air-conditioning, humidifier, electric fan, air purifier, intelligent curtain, sweeping robot, IP Camera 130, intelligent desk, door
Prohibit etc..Non intelligent household includes clothes, books etc..
Optionally, AR searcher 100 further include: information storage unit；Information storage unit is set with wearable AR main body
It is electrically connected for 110 and/or articles search equipment 120, for prestoring the image data and article 200 and/or prestoring the object
Corresponding relationship between product 200 and space.Graph image library, intelligent electric appliance/wisdom in information storage unit including each network level
The search instruction library of electric appliance, user use file record (the i.e. graph image library of typical stage and common intelligent electric appliance/wisdom electricity
The search instruction library of device) etc..In addition to being based on AR technology, it is also based on weak AI technology, i.e., builds the early period of various databases, belongs to this
System prior learning, the process stored.
There are information storage unit, such as storage chip, the wearable AR main equipment of storage chip in AR searcher 100
110 or articles search equipment 120 in any one place.To store the graph image (feature) of wisdom electric appliance and other items 200
Library, alternatively, the graph image of wisdom electric appliance and other items 200 and size (feature) library, when for using operation, as a comparative reference
(a kind of simple graph control, another kind is that the figure of depth camera 130 adds size to compare)；Also it is stored with specific household electrical appliances
Control instruction library when for using operation, is called.It is all stored in wearable AR main equipment 110 or in network various
The image graphic data library of article 200, the instruction database of various peripheral hardwares and user's usage record etc., these are all in order into one
Step exploitation and improvement user's experience, allow article 200 to search for more humane, more intelligent, provide strong background support.Such as
Shown in Fig. 7, article 200 is directly carried out by AR searcher 100 and is searched for, if article 200 is wisdom electric appliance, wearable AR master
It is all stored with the image graphic data libraries of various wisdom electric appliances, search instruction database in body equipment 110 or in network and makes
User's usage record etc., these all in order to further develop and improve user's experience, make electrical equipment control more humane, are more convenient
Change, provides strong background support.
Optionally, articles search equipment 120 includes: orientation range lock cell；Orientation range lock cell, for obtaining
Data are sensed, and according to the spatial dimension where sensing data acquisition AR searcher 100.
Optionally, orientation range lock cell includes: positioning auxiliary subelement, and/or, image recognition positioning unit；It is fixed
Position auxiliary subelement and/or image recognition positioning unit are electrically connected with wearable AR main equipment；Positioning auxiliary subelement, is used for
Position the spatial position where wearable AR main equipment 110；Image recognition positioning unit, for carrying out feature to ambient image
It extracts, characteristics of image is compared with the environmental characteristic of pre-set space, the space model where identification positioning AR searcher 100
It encloses.
Optionally, positioning auxiliary subelement includes: satellite positioning identification module, sensing fixation and recognition module, communication positioning
In identification module any one or it is a variety of；
Satellite positioning identification module is positioned for longitude and latitude, and according to longitude and latitude data identification positioning AR search dress
Set the spatial dimension where 100；Position location satellite includes: GPS positioning satellite, Beidou position location satellite, GLONASS position location satellite and
In Galileo position location satellite any one or it is a variety of.
Fixation and recognition module is sensed, is searched for for the preset motion sensor from the environment space, or from AR is set to
Exercise data is obtained at the motion sensor of device 100, and the sky where positioning AR searcher 100 is identified according to exercise data
Between range；Motion sensor includes: altimeter, acceleration transducer, weight sensor, magnetic field instrument, gyroscope, laser acquisition
Device, in ultrasonic detector any one or it is a variety of.
Fixation and recognition module is communicated, for being led to at least one wireless access point preset in the environment space
Letter identifies the spatial dimension where positioning AR searcher 100 according to communication signal strength.
There are space positioning system (Beidou, GPS, GLONASS etc.) and altimeter in AR glasses, by information such as longitudes and latitudes,
(big) space where positioning is at home, still in an office.AR glasses or head are aobvious, that room of place can be by room
Interior positioning system come determine its enter space, indoor locating system such as intelligent router, weight sensor, magnetic field instrument, top
Spiral shell instrument, IP Camera 130, Lifi lamps and lanterns, laser probe, ultrasonic detector, depth camera 130 (TOF) etc..AR glasses
Or head is aobvious, faces some face in the space, is determined by electronic compass/magnetometer, towards east, south, west, north.House is built
The direction built seldom is the direction towards positive direction, therefore described, refers to main direction mostly.
Perhaps the aobvious wearer of head faces upward head or bows AR glasses, its angle changing is determined by gyroscope, level meter.
Ornaments in such as family of (big) space or in office are relatively fixed, so, when the wearer that AR glasses or head are shown determines
Behind its spatial position, towards some direction, then visual object in this direction is substantially reduced.
Further, AR glasses or head it is aobvious in there is eye-tracking device, head to take aim at or centainly may be used centered on optic centre point
Regarding range can closer reduce as (big) central vision region of circumference range according to these above-mentioned technical measures.
The present invention makes AR searcher 100 more intelligent, it is known that locating orientation, it is known that wears user and wants to search
The object seek, interacted helps user's environment-identification and object, thus further progress search and the searched object of locking.
Optionally, wearable AR main equipment 110 includes: image acquisition unit, image processing unit and AR display unit；
Image acquisition unit, for capturing reality scene image；Image processing unit, it is virtual existing for being generated according to reality scene image
Real scene image；AR display unit, for enhancing display virtual real scene image.
The technical program is also based on AI technology in addition to being based on AR technology, and following first steps belongs to the system and learns in advance
A step of storage is practised, as shown in fig. 6, wherein mainly realizing that step includes:
S10: 200 (inventory) database establishment of article early period
Initialization of the S20:AR searcher 100 in each specific space
S30: large space (longitude and latitude, height) positioning
S40: small space (specific room/interior/direction) positioning
S50: visual range (direction) locking
S60: specific article 200 locks
S70: terminate search, or the virtual operation and control interface of triggering.
User is directed at certain wisdom electric appliance object (refrigerator, sky by (depth) camera 130 on AR searcher 100
Tune, TV, electric fan, computer, electric light, washing machine, refrigerator etc.), the wisdom electric appliance data library in head video memory reservoir (need to be pre-stored and set
Set) pass through the household electrical appliances graph image that comparison camera 130 transmits, determine specific household electrical appliances object, user passes through head again and takes aim at component
Into the virtual selection menu of the household electrical appliances object, the instruction such as inquired, switched, adjusted or controlled, AR searcher 100 is also
Have short-range communication chip (instruction sender), also there is corresponding short-range communication chip (instruction reciever) on wisdom electric appliance,
Wisdom electric appliance after receiving instruction carries out relevant operation, is able to the control instruction of feedback user.
Wisdom electric appliance data library, to carry out graphic image data collection and corresponding wisdom to wisdom electric appliance in family in advance
The storage of electrical equipment control instruction.Head takes aim at the use of component, to rely on the IMU sensor such as gyroscope in AR searcher 100
Determine orientation.Or replace head to take aim at by eye-tracking camera 130, realize the positioning and operating function of mouse.Or
It can be by wearable device, such as wisdom gloves, wisdom ring, control handle etc., to realize the positioning and operating work of mouse
Energy.The surface of various objects can post specific two dimensional code or bar coded sticker in advance, and AR searcher 100 is changed by scanning
Two dimensional code or bar coded sticker can directly determine locked target zone.Hawkeye (zoom) camera 130 can help
Remote recognizing two dimensional code or bar code.
Certainly, if user is by microphone and AI language chip, the target for telling AR searcher 100 to be searched
Object, then having corresponding virtual arrow in AR searcher 100 and user being guided to find, while passing through headset
Equipment can also tell user, the general orientation of target object and specific orientation by sound.
By AR searcher 100, it can also be seen that searched article 200 in the visible range by luminance,
The user of the modes prompting search such as flashing.Then, the virtual selection menu shown in AR searcher 100, from the specific head of a quilt
It takes aim in the wisdom electric appliance of alignment and draws, i.e., see the scene that virtual object and physical objects be combined with each other from AR searcher 100, it is empty
The presentation mode of quasi- selection menu can be text push button, icon formula, be also possible to one section of animation or video image is broadcast
It puts.It is worth mentioning that AR searcher 100 also includes earpiece/speaker, there is the feedback of sound or sound equipment, reinforces user and exist
Experience effect when being interacted with virtual selection menu.
The helmet is shown can be replaced by common display screen (such as smart phone, Intelligent flat), wear camera 130 and moved
The camera 130 of smart machine replaces.Display screen is to obtain true picture, then be superimposed virtual selection menu image；User every
Flat-faced screen carry out the operation to wisdom electric appliance.Operating result can also carry out in the intelligent movable equipment of user
Confirmation feedback.
Optionally, AR searcher 100 further include: environment sensor device, environment sensor device are set with wearable AR main body
Standby 110 electrical connection；For obtaining ambient condition, and articles search equipment 120 is fed back to, triggering/do not trigger articles search equipment
120 obtain the guide for controlling to adjust the relative article 200 of ambient condition.
When eyes are that user finds article 200, main organ, and AR glasses are exactly mainly by vision (figure
Picture) identification and other supplementary means, help user to carry out target search and object lock, it is more efficient and intelligent.
It walks to enter any space in family, inductor (gravity sensor, IP Camera 130 or the nothing in the space
Line AP) sense that the entrance of AR glasses or the camera 130 of AR glasses go out the sky by the decoration Context awareness to the space
Between functional localization.Assuming that having in family with down space, and corresponding space serial number:
1, porch；2, living room；3, dining room；4, master bedroom；5, secondary room；6, child room；7, study；8, kitchen；9, washroom；
10, storeroom etc..
In addition to the above-mentioned corresponding database entry in each space, into after certain space, AR glasses further open the room
The database in (space) understands the letter such as 200 situation of article in the room (space) and position, function, the state of article 200
Breath.
Some physical quantitys are invisible, but really cause the reason of being regulated and controled, such as temperature or light.It is situated between below
It continues, the search caused according to these physical quantitys and target determine.
AR glasses or head have temperature sensor in showing, when the temperature in the space is pre- more than temperature sensor in the AR glasses
If temperature value when, in AR glasses, in the visual range of user, have a virtual direction arrow, it is guided
The direction of AR glasses, when user is worn over AR glasses, and virtual arrow is followed to rotate, final arrow can be specified into AR glasses
Air-conditioning position promotes user to open the control interface of the air-conditioning, carries out temperature regulation.
More intelligent, AR glasses perceive the same day according to system calendar temperature sensor and are in the summer of high temperature still
The winter of low temperature takes the lead in choosing refrigeration or heating mode.AR glasses or head have light sensor in showing, when the space
When light intensity is more than the preset light intensity value of light intensity sensor in the AR glasses, in AR glasses, in the vision model of user
In enclosing, a virtual direction arrow is had, it guides the direction of AR glasses, follows virtual arrow when user is worn over AR glasses
When head rotation, final arrow can specify the shade position into AR glasses, and user is promoted to draw high curtain, reduce in the space
Light is injected.
Equally, when the light intensity in space light intensity value preset lower than light intensity sensor in the AR glasses, in AR
In glasses, in the visual range of user, a virtual direction arrow is had, it guides the direction of AR glasses, when making
User be worn over AR glasses follow virtual arrow rotate when, final arrow can specify the headlamp position into AR glasses, promote to make
User opens illuminator, and the light increased in the space is injected.
More intelligently, AR glasses were in normal daylight more sufficient daytime according to Time Perception at that time, or at night.Then
Above-mentioned introduction, time-division, AR glasses sensitive time can also guide user to go to draw the curtain together by virtual arrow at night, rather than
Only reminding user to open electric light just terminates.
Short-range communication chip can be equipped on AR searcher 100, it is indoor indirectly fixed to help by short-range communication chip
Position, for example, it is indoor have multiple users with AR glasses, by the communication exchanges between AR glasses, can mutually determine its
Indoor orientation distance.Short-range communication chip includes infrared emission component, NFC (NearFieldCommunication, near field
Communication), Wi-Fi, bluetooth, the communication standards such as ZigBee, Li-Fi, Z-Wave chip.
The visible light wireless communication of LiFi--LightFidelity, light online, i.e. illumination are surfed the Internet -- it is sent out with LED illumination lamp
Light out is to utilize quick light pulse wireless transmission information as the delivery means of network signal.That is it is not necessarily to WiFi
Signal, putting a LED light can surf the Internet.Its principle be according to different rates in light encoded information, such as LED game clock shows 1, closes
It indicates 0, information can be transmitted by quick HF switch.LED light network is by visible light come transmission network signal, Ke Yizhi
It connects using the existing energy consumption output such as flashlight, headlamp, street lamp, room lighting and public illumination and completes dual role.
The characteristics of light is surfed the Internet is Low emissivity, low energy consumption, low-carbon environment-friendly.
Camera 130 further comprises: zoom camera, depth camera, RGB camera, TOF camera, flake are taken the photograph
As head and/or wide-angle camera.
Different modes can be used instead of original searcher based on RFID, user in the AR searcher of the present embodiment
Constantly search range is reduced until determining searched object, is given multiple choices, is improved the range of target user.Based on AR skill
The searcher of art, no matter short distance or local area network and wide area network, the effect of article 200 required for searching for are more intuitive, efficient.
It is versatile, it need to only achieve that article 200 is searched for by AR searcher, actual situation based on AR technology combines, and allows any search
The user of device feels succinctly and conveniently.
The present invention is based on the void of AR technology (virtual controlling command menu, virtual intermediary object, the Virtual Space 3D environment and/or
3D map image) real (specific article 200) combine, and allows the user of any searcher, all feel succinctly and conveniently.Visually
200 research tool of article overcomes the inadequate natural endowment of human eye search, and large information capacity can aggravate the difficulty of human eye search, but to AR
It is not a problem for glasses.Based on the searcher of AR technology, no matter short distance or local area network and wide area network, search effect is more
Intuitively, efficiently.The AR research tool of short distance, user have on AR glasses, space where AR glasses energy intelligent recognition user,
Then with search range that user is reduced only by " seeing ", it is worth mentioning at this point that, AR glasses and not knowing at the beginning make
What user searching for, it only in the use process with user, slowly reduces the range of search, and user is helped to complete
The purpose that article 200 is searched for.
Second embodiment
200 search system of article based on AR searcher 100, including AR searcher 100, AR searcher 100 wrap
It includes: wearable AR main equipment 110 and articles search equipment 120；Wearable AR main equipment 110, it is aobvious for obtaining and enhancing
Show the image data of the article 200 in environment space；Articles search equipment 120 is searched for constantly reducing among image data
Rope range, until locking searched object.
Improvement based on the above embodiment, in addition to same as described above, as shown in figure 8, AR searcher 100/ is searched for
Device, further includes: second camera equipment 300, and 100 communication connection of AR searcher, for obtaining the article 200 of environment space
Image data, and it is sent to AR searcher 100.
Second camera equipment 300 includes: IP Camera 130, unmanned aerial vehicle onboard camera 130, unmanned vehicle vehicle-mounted pick-up
First 130, any one in robot loading camera 130 or a variety of.Specifically, wearable AR main equipment 110 with it is auxiliary
After helping picture pick-up device 300 to communicate to connect, the Reconnaissance, Long Range to smart home may be implemented.
Optionally, second camera equipment 300 further include: orientation range lock cell；
Orientation range lock cell, for obtaining sensing data, and according to where sensing data acquisition articles search carrier
Spatial dimension；Articles search carrier includes Virtual Space intermediary 400, AR searcher 100 or second camera equipment 300.
Optionally, the ambient image in space where the shooting of second camera equipment 300 obtains, and it is sent to AR searcher
100:
AR searcher 100 further include: image recognition positioning unit；
Image recognition positioning unit, for carrying out feature extraction to ambient image, by the ring of characteristics of image and pre-set space
Border feature is compared, and the spatial dimension where articles search carrier is stated in identification surely.
When articles search carrier is AR searcher 100, user wears AR searcher 100, carries out short distance
Articles search, i.e., search range when constantly reducing when user wears AR searcher 100 within the scope of large space, until lock
Surely it is searched object.When articles search carrier is auxiliary picture pick-up device 300, if user wears AR searcher 100 and is located at the
One space, and when second camera equipment 300 is set to second space, then may not need user and walk about and position large space, pass through
The large space range for the positioning object that second camera equipment 300 can help user long-range fills to be searched for again by AR
It sets 100 and constantly reduces search range within the scope of the large space that second camera equipment 300 determines, until locking searched object.
Specifically, by taking unmanned aerial vehicle onboard camera 130 and AR searcher 100 communicate to connect as an example: airborne camera 130
The image data that can be moved, and will acquire under the control of the user is sent to AR searcher 100, therefore, is searched for using AR
The user of device 100 can long-range search article 200.
Relative to Installation practice, whether by from longitude and latitude data, exercise data, communication signal strength or environment
Image carries out the spatial dimension where fixation and recognition second camera equipment, and the present invention is based on 4G, 5G, internet or object at a distance
The articles search of networking, by second cameras equipment such as IP Camera 130 or the cameras of mobile robot 130 come real
It is existing, to any article 200 at home or in any space of office, search not at the scene can be carried out, it is accurate, quasi-
Really, specifically, intuitively.In the present embodiment, articles search at a distance based on 4G, 5G, internet or Internet of Things is taken the photograph by auxiliary
It is realized as equipment 300, to any smart home in any space at home, visual search operation can be carried out, accurate,
Accurately, specifically, intuitively.Based on the searcher of AR technology, no matter short distance or local area network and wide area network, articles search effect is more
Intuitively, efficiently.The long-range search scene of a cell phone application more corresponding than an existing smart home is conveniently very much.
Preferably, AR searcher 100 further include: virtual objects generation unit；
Virtual objects generation unit, the search that searched object is searched for for enhancing display reminding are guided.
Preferably, virtual objects generation unit includes: virtual guide module, and/or, virtually indicate generation module；
It is virtual to guide module, for guiding user to find and clearly searched object；
Virtual instruction generation module, for being superimposed virtual guide figure on the virtual reality scenario image of display, virtually
Guide figure include；Virtual direction arrow and/or virtual dividing line.
Virtual guide module includes: Virtual Space intermediary 400；
Space, and storage administration are administered for the storage where prompting AR searcher 100 by Virtual Space intermediary 400
200 situation information of the image data of each article 200 and/or article in space；Image data include 200 image of article and/or
200 identification code of article；200 situation information of article includes 200 orientation of article, 200 function of article, any in 200 state of article
It is one or more kinds of.
The introduction of 400 technology of Virtual Space intermediary introduces Virtual Space intermediary on the basis of above-mentioned technology
400 technology, so-called Virtual Space intermediary 400 are for entity cognitive mediation, and entity cognitive mediation is exactly this family
Owner or office administrative personnel, he/her can tell you the purposes of each space (room), such as the hostess of family,
Can neck guest walk around everywhere at home, tell bedroom at which? is washroom at which? TV is seen where? game is played where? it is used where
Meal? etc., further, it can tell position and the application method of some electric appliances of guest or article 200, for example washing machine is one
In the laundry in building, computer is in study etc..
As shown in Figure 9.Virtual Space intermediary 400, can it be referred to as that space is smart or virtual caretaker, space spirit are pre-
First set, the environment in space where setting " it " understands, function, orientation, the furniture commonly using in people, space, ornaments,
Intelligent electric appliance/wisdom electric appliance on wisdom electric appliance etc. and certain direction.There is a relatively independent space essence in each space
Spirit.Space spirit just (three-dimensionally) is shown in the AR searcher 100 of user's wearing, and image can be set according to user
Determine and determine, for example be the virtual Britain house keeper image in position, is also possible to virtual cartoon character.
For example enter child room, inductor (gravity sensor, the IP Camera 130 or wireless aps) sense in the space
The camera 130 of entrance or AR glasses that AR glasses should be arrived, which goes out the space by the decoration Context awareness to child room, is
Virgin room, then AR glasses are docked with child room (space) spirit in system, obtain household electrical appliances, the household, equipment of child room
Deng graphic image data library.In (child room) graphic image data library, it is as shown in table 1 relevant information can be checked in:
Table 1: child room graphic image data library
3 dimension outdoor scenes of space spirit and child room combine appearance, according in AR glasses eye movement sensor device or
The direction for the head that LEAPMOTION body-sensing sensor sensing arrives or the direction of finger, space spirit determine user's direction or refer to
To, provide be directed toward object relevant information or control interface.
For example enter living room, inductor (gravity sensor, the IP Camera 130 or wireless aps) sense in the space
The camera 130 of entrance or AR glasses that AR glasses should be arrived, which goes out the space by the decoration Context awareness to living room, has been
Room, then AR glasses are docked with living room (space) spirit in system, obtain household electrical appliances, the household, equipment in living room
Deng graphic image data library.In (living room) graphic image data library, it is as shown in table 2 relevant information can be checked in:
| Serial number | Item name | Classification | Position | Function | Remarks |
| 1 | French window | Door and window | Towards south, between living room and balcony | Smart machine can be remotely controlled | |
| 2 | French window curtain | Soft dress | On the inside of southern French window | Shading | Smart machine can be remotely controlled |
| 3 | Air-conditioning | Household electrical appliances | Xi Qiang, nearly French window curtain | Temperature is adjusted | Smart machine can be remotely controlled |
| 4 | TV | Household electrical appliances | Xi Qiang, cabinet for TV top | Audiovisual entertainment | Smart machine can be remotely controlled |
| 5 | Cabinet for TV | Household | By Xi Qiang, near-space tune | Place article | Unintelligent device |
| 6 | Pendent lamp | Lamps and lanterns | Living room roof center | Illumination | Smart machine can be remotely controlled |
| 7 | Tea table | Household | Nearly sofa | Place article | Unintelligent device |
| 8 | Floriculture | Ornaments | On tea table | Decoration | Unintelligent device |
| 9 | Decoration painting 1 | Ornaments | Paste Dong Qiang | Decoration | Unintelligent device |
| … | … | … | … | … | … |
| 20 | Sofa | Household | By Dong Qiang | Seat | Unintelligent device |
| 21 | Sweeping robot | Household electrical appliances | The berth of the nearly power supply of Dong Qiang | Ground cleaning | Smart machine can be remotely controlled |
| … | … | … | … | … | … |
Table 2: living room graphic image data library
The 3 dimension outdoor scenes in space spirit and living room combine appearance, according in AR glasses eye movement sensor device or
The direction or finger for the head that LEAPMOTION body-sensing sensor sensing arrives are directed toward, and space spirit determines that user is directed toward, and provide finger
To the relevant information or fictitious control interface of object.
Above-mentioned example is to be scanned for by 100 short distance of AR searcher to the article 200 in environment space.
It walks to enter any space of office, inductor (gravity sensor, IP Camera 130 in the space
Perhaps wireless aps) sense that the entrance of AR glasses or the camera 130 of AR glasses pass through the decoration Context awareness to the space
The functional localization in the space out.Assuming that having in office with down space, and corresponding space serial number: 1, foreground；2, Office Area；3, big
Meeting room；4, small meeting room；5, President Office；6, office of the director；7, manager office；8, accounting office；9, IT computer room；
10, Tea Room；11, washroom etc..The introduction of networking control technology, as shown in Figure 10:
For not searching target object in space nearby, it is necessary to introduce network technology, can be used at home
Carrier of the WIFI signal as control instruction；The wide area network or IoT skill of wisdom electric appliance needs in remote control man of office
Art.It is equipped with IP Camera 130 in possible search space, AR glasses need to be cooperated to be manipulated, i.e. AR glasses first pass through local area network
Or the wide area network connection such as IP Camera 130 in the room, specific target object is searched for by IP Camera 130.
In addition to the above-mentioned corresponding database entry in each room, into after certain room, AR glasses further open the room (space)
Database understands the information such as 200 situation of article in the room (space) and position, function, the state of article 200.
The maximum difference of Administrative Area space and domestic space is, the former rare barrier wall or passes through transparent big landing
Glass is split, for example has the colleague of 2~3 departments handling official business simultaneously in a big Office Area, so cannot pass through
It distinguishes to distinguish the space of office in relative closure space.Therefore in initial (200 space of article) database establishment process
In, it needs to introduce space division, i.e., in a big physical space, carries out the division of Virtual Space (size), Virtual Space
It has been divided that, user can be according to the sensors such as gyroscope, the variation of first time sensing region with AR glasses.
So the contextual definition of article 200 and space will be in most previous article 200 (inventory) database establishment
Highly important, it will affect the process, efficiency or even result of subsequent searches.In practice, Virtual Space boundary line can be set,
User can be clearly seen that the Virtual Space boundary line being not present in real world by AR glasses.Pass through internet ring
Border, identifiable target object will be expanded significantly, also can access the cloud database of major brand manufacturers, find and contrast product figure
Shape image carries out the remote operation of internet of things (LoRa or Nb-IoT), has all embedded object in certain each wisdom electric appliance
Connected network communication chip to receive the command signal from Internet of Things, and is responded.
One emerging skill of NB-IoT (Narrow Band Internet of Things) cellular narrowband Internet of Things
Art supports low power consuming devices to connect in the cellular data of wide area network, is an important branch of all things on earth internet.NB-IoT structure
It is built in cellular network, the bandwidth of about 180KHz is only consumed, GSM network, UMTS network or LTE network can be deployed directly into, with
It reduces lower deployment cost, realize smooth upgrade.NB-IoT, which has the following characteristics that, supports stand-by time long, battery life at least 10 years；
The ability of magnanimity connection is supported, mono- sector NB-IoT can support 100,000 connections；To network connectivity requirements higher device
Efficiently connection, while very comprehensive indoor cellular data connection covering can also be provided；Module is at low cost.
Most of article 200 has oneself LOGO now, the identification by wearable AR main equipment 110 to LOGO,
Brand manufacturers is more easily locked, the cloud database of access brand manufacturers is also easier to, determines specific search article 200, than
If the article 200 of three color boards is mostly sofa, rather than computer；Apple brand is mobile phone, rather than TV, etc..
In addition, compared to the IP Camera 130 fixed at one, intelligent mobile small machine people is then flexibly many, with it
Sensor with indoor positioning drives it that can enter any room in family, then passes through its eyes (camera 130)
AR " capture " can be carried out to specific article 200, then realize remote object locking.IP Camera 130 or mobile machine
People has geomagnetic sensor, is determined for the direction of its camera 130.
Intelligent mobile terminal (mobile phone or PAD) can also pass through short message, wechat, multimedia message, APP or cellular mobile communication side
Formula issues the wireless search command signal of wisdom electric appliance, carries out target search.
Void (virtual vision grid, gesture) based on AR technology real (concrete scene) combines, and allows the use of any searcher
Person feels succinctly and conveniently, is Gospel mind especially to (temporary) sufferer for losing language competence and muscle control ability
Device, then assist with language semantic identification technology, the search efficiency of user is faster, more acurrate, also allows old man and children user
Feel and uses upper convenience.On wearable AR main equipment 110, including AR all-in-one machine, AR glasses, smart phone or
PAD generates Virtual Space intermediary 400 --- and space is smart, carries out well with the user of search target item 200 benign mutual
Dynamic, clear and apparent user specific range, range degree and target object, this greatly simplifies the realization of technology, intelligence
It is stronger that degree can be changed, high reliablity has a wide range of application.
Optionally, 200 search system of article further include: environment sensor device is set to environment space, AR searcher
100 and/or second camera equipment 300；Environment sensor device feeds back to AR searcher for obtaining environmental state information
100, AR searcher 100 trigger/is not triggered obtains the guide for controlling to adjust the relative article 200 of ambient condition.
Specifically, the present embodiment for the embodiment of above-mentioned AR searcher 100, is set to AR searcher 100
Environment sensor device can only closely use.Environment sensor device is independent, it can be set to AR search dress according to demand
It sets on 100, any one place or many places of second camera equipment 300, environment space.In this way, environment sensor device can be set to
In second camera equipment 300 and/or environment space man, if second camera equipment 300 is set at environment space, user's energy
It enough realizes long-range wearing or carries out the search of article 200 and remote according to user's control instruction using AR searcher 100
Process control has the wisdom electric appliance of communication function.
3rd embodiment
Applied to above-mentioned apparatus embodiment and system embodiment, a kind of 200 searcher of article based on AR searcher 100
Method, as shown in figure 11, this method comprises:
S200: the environment space determined where articles search carrier is positioned；
S400: it is obtained by AR searcher 100 and enhances the object shown in the environment space and the environment space
The image data of product 200；
S500: constantly reducing search range among image data, until locking searched object.
Specifically, the present invention can be combined based on the actual situation of AR technology, the user of any searcher is allowed, all feel succinct
Conveniently.Visual search device based on AR technology, search effect are more intuitive, efficient.Optionally, include: before S200
S100: corresponding relationship between the image data and article 200 and/or the article 200 and space is prestored.
Fourth embodiment
The present invention is the improvement based on 3rd embodiment, this method comprises:
S210: sensing data are obtained, and according to the spatial dimension where sensing data acquisition articles search carrier；Article is searched
Suo Zaiti includes Virtual Space intermediary 400, AR searcher 100 or second camera equipment 300；
S410: the object confirmation instruction of input is obtained；
S510: constantly reducing search range according to object confirmation instruction, until where confirmation display articles search carrier
Spatial dimension corresponds to target search range and/or searched object in image data.
Optionally, the S510 further comprises following either step:
S511: the image to further in the different zones after dividing visual field；
S512: the image in the visual field that furthers in the box that both hands gesture is constituted；
S513: the image in the visual field that furthers in the circular frame that both hands gesture is constituted；
S514: the image in the visual field that furthers in the circular frame that singlehanded gesture is constituted.
Specifically, S511, S512, S513 and S514 are coordinations.Ornaments in family or in office are relatively fixed,
So, towards some direction, then should after AR glasses or the aobvious wearer for waiting AR searcher of head determine its spatial position
Visual object on direction is substantially reduced.Have in the aobvious equal AR searcher of AR glasses or head eye-tracking device, head take aim at or with
Certain visual range is (big) central vision region of circumference range centered on optic centre point, is arranged according to these above-mentioned technologies
It applies, can closer reduce.Still further, if being somebody's turn to do (big) central vision region still has many objects in kind, AR
Meeting virtual cut-off rule of Overlapping display in (big) the central vision area in glasses, such as " well ", " rice " or round " returning " word
Line, user further adjust the direction of AR glasses, further determine that the specific cut zone in (big) central vision area, or even can
To cover projection (camera capture) amplified area image in the cut zone, (function of similar " picture-in-picture ", needs
Illustrate: big visual range is user to be immediately seen through AR glasses, but the small visual range of " picture-in-picture " be
The picture of Projection Display captured by camera is covered in AR glasses), such as in (small) the central vision area of round " returning " wordline
In, further reduce search range, lock onto target object.
Alternatively, the scene in (small) the central vision area of locking is amplified in (big) central vision area, " hawk is presented
Eye " display function, at this moment zoom lens operates the amplification for participating in concrete scene.If passing through leapmotion body-sensing
Device can will be directed toward by unarmed finger, carry out spatially extended calculating, lock specific article.The specific article of the locking, can
To pass through, " picture-in-picture " mode is shown or " hawkeye " mode is shown.
Optionally, after S200 comprising steps of
S201: the image data of the article 200 for the environment space that second camera equipment 300 is sent is received.
Optionally, S410 further comprises following either step:
S411: detection gesture movement generates object confirmation instruction according to the article 200 that gesture motion determines；
S412: detecting the headwork of wearer, generates object confirmation instruction according to the article 200 that headwork determines；
S413: that detects eyeball watches movement attentively, generates object confirmation instruction according to the determining article 200 of movement is watched attentively；
S414: the object for receiving voice input confirms instruction.
Optionally, S210 further comprises following either step；
S211: longitude and latitude data are obtained from position location satellite, and identify positioning object search vector according to longitude and latitude data
The spatial dimension at place；
S212: the preset motion sensor from the environment space, or from be set to articles search carrier motion-sensing
Exercise data is obtained at device, and the spatial dimension where positioning object search vector is identified according to exercise data；
S213: being communicated at least one wireless access point preset in the environment space, strong according to signal of communication
Spatial dimension where degree identification positioning object search vector；
S214 shooting obtains the ambient image in 100 place space of AR searcher, carries out feature extraction to ambient image, will
Characteristics of image is compared with the environmental characteristic of pre-set space, the spatial dimension where identification positioning AR searcher 100；
S215: the ambient image in 300 place space of second camera equipment is obtained from second camera equipment 300, to environment
Image carries out feature extraction, and characteristics of image is compared with the environmental characteristic of pre-set space, identification positioning AR searcher 100
The spatial dimension at place.
Specifically, user wears AR when articles search carrier is AR searcher 100 or Virtual Space intermediary 400
Searcher 100 carries out the articles search of short distance, i.e., constantly reduces when user wears AR searcher 100 in large space
Search range when in range, until locking searched object.When articles search carrier is auxiliary picture pick-up device 300 or Virtual Space
When intermediary 400, if user wears AR searcher 100 and is located at the first space, and second camera equipment 300 is set to the second sky
Between when, then may not need user and walk about and position large space, pass through 400 energy of second camera equipment 300 or Virtual Space intermediary
The large space range for the positioning object for enough helping user long-range, thus again by AR searcher 100 in second camera equipment
300 or the large space that determines of Virtual Space intermediary 400 within the scope of constantly reduce search range, until locking searched object.
The present invention from longitude and latitude data, exercise data, communication signal strength or ambient image whether by determining
Spatial dimension where position identification second camera equipment, article of the present invention at a distance based on 4G, 5G, internet or Internet of Things
Search, passes through second cameras equipment or the Virtual Space intermediaries such as IP Camera 130 or the camera of mobile robot 130
400 realize, to any article 200 at home or in any space of office, can carry out search not at the scene,
Accurately, accurately, specifically, intuitively.In the present embodiment, pass through second camera equipment 300 and/or Virtual Space intermediary 400 at a distance
It realizes, to any smart home in any space at home, visual search operation can be carried out, accurate, accurate, tool
It is body, intuitive.Based on the searcher of AR technology, no matter short distance or remote or local area network and wide area network, articles search effect
Fruit is more intuitive, efficient.
Optionally, 200 searching method of article based on AR, S400 further comprises:
S450: reality scene image is captured；
S460: virtual reality scenario image is generated according to reality scene image, and enhances display virtual real scene image；
S470: being superimposed virtual guide figure on the virtual reality scenario image of display, and enhancing display is superimposed with virtual finger
Draw the virtual reality scenario image of figure, searches for searched object to guide；
Wherein, virtually guide figure includes；Virtual direction arrow and/or virtual dividing line.
It optionally, further include step before S200；
S120: environmental state information is obtained；
S130: the articles search equipment trigger/is not triggered according to the environmental state information and is obtained described in control and regulation
The guide of the relative article 200 of ambient condition.
Specifically, environment sensor device, is set to environment space, AR searcher 100 and/or second camera equipment 300.
Environment sensor device set on AR searcher 100 can only be used closely.Environment sensor device is independent, it can basis
Demand is set on AR searcher 100, any one place or many places of second camera equipment 300, environment space.In this way, environment
Sensor device can be set in second camera equipment 300 and/or environment space man, if second camera equipment 300 is set to environment sky
Between, then user can be realized as long-range wearing or using AR searcher 100 carry out the search of article 200 and according to
User's control instruction remotely controls the wisdom electric appliance with communication function.
It should be noted that above-described embodiment can be freely combined as needed.The above is only of the invention preferred
Embodiment, it is noted that for those skilled in the art, in the premise for not departing from the principle of the invention
Under, several improvements and modifications can also be made, these modifications and embellishments should also be considered as the scope of protection of the present invention.
Claims (28)
1. a kind of AR searcher characterized by comprising wearable AR main equipment and articles search equipment；
The wearable AR main equipment, for obtaining and enhancing the shadow of the article in display environment space and the environment space
As data；
The articles search equipment, for constantly reducing search range among the image data, until locking searched object.
2. AR searcher according to claim 1, which is characterized in that the articles search equipment includes: that instruction obtains
Unit and object confirmation unit；
Described instruction acquiring unit, for obtaining the object confirmation instruction of input；
The object confirmation unit, for constantly reducing search range according to object confirmation instruction, until confirmation display
Target search range and/or the searched object in the image data.
3. AR searcher according to claim 2, which is characterized in that described instruction acquiring unit includes: gesture interaction
Component, head take aim at component, eye-tracking component, in language control component any one or it is a variety of；The object confirmation unit and institute
State gesture interaction component, head takes aim at component, any one or a variety of electrical connections in eye-tracking component, language control component；It is described
Gesture interaction component includes wisdom gloves, wisdom ring, control handle, body-sensing sensor, any one in gesture controller
Or it is a variety of；
The gesture interaction component is acted for detection gesture, according to the determination of the gesture motion, is generated object confirmation and is referred to
It enables；
The head takes aim at component, for detecting the headwork of wearer, generates object according to the article that the headwork determines
Confirmation instruction；
The eye-tracking component watches movement attentively for detect eyeball, watches the determining article of movement attentively according to described and generates pair
As confirmation instructs；
Institute's predicate control component, for receiving the object confirmation instruction of voice input.
4. AR searcher according to claim 1, which is characterized in that the AR searcher further include: information storage
Unit；
The information storage unit, for prestore the image data and article and/or prestore it is right between the article and space
It should be related to.
5. AR searcher according to claim 1, which is characterized in that the articles search equipment includes: orientation range
Lock cell；
The orientation range lock cell, for obtaining sensing data, and the search dress of the AR according to the sensing data acquisition
Spatial dimension where setting.
6. AR searcher according to claim 5, which is characterized in that the orientation range lock cell includes: positioning
Subelement is assisted, and/or, image recognition positioning unit；
The positioning auxiliary subelement, for positioning the spatial position where the AR searcher；
Described image identifies positioning unit, for carrying out feature extraction to the ambient image, by characteristics of image and pre-set space
Environmental characteristic be compared, identification positions the spatial dimension where the AR searcher.
7. AR searcher according to claim 6, which is characterized in that the positioning auxiliary subelement includes: satellite
Position identification module, sensing fixation and recognition module, communication fixation and recognition module in any one or it is a variety of；
The satellite positioning identification module is positioned for longitude and latitude, and is positioned the AR according to longitude and latitude data identification and searched
Spatial dimension where rope device；
The sensing fixation and recognition module, for the preset motion sensor from the environment space, or from set on the AR
Exercise data is obtained at the motion sensor of searcher, and the AR searcher institute is positioned according to exercise data identification
Spatial dimension；
The communication fixation and recognition module, for being led to at least one wireless access point preset in the environment space
Letter positions the spatial dimension where the AR searcher according to communication signal strength identification.
8. AR searcher according to claim 1, which is characterized in that the wearable AR main equipment includes: image
Acquiring unit, image processing unit and AR display unit；
Described image acquiring unit, for capturing reality scene image；
Described image processing unit, for generating virtual reality scenario image according to the reality scene image；
The AR display unit shows the virtual reality scenario image for enhancing.
9. AR searcher according to claim 1, which is characterized in that the AR searcher further include: environment sensing
Equipment, the environment sensor device are electrically connected with the wearable AR main equipment；
The environment sensor device for obtaining ambient condition, and feeds back to the articles search equipment, triggering/do not trigger institute
It states articles search equipment and obtains the guide for controlling to adjust the relative article of the ambient condition.
10. a kind of articles search system based on AR searcher characterized by comprising AR searcher and second camera
Equipment；
The second camera equipment, for obtaining the image data of the article in environment space and the environment space, and sends
To the AR searcher；
The AR searcher, for obtaining and enhancing the image number of the article in display environment space and the environment space
According to search range constantly being reduced among the image data, until locking searched object.
11. as claimed in claim 10 based on the articles search system of AR searcher, which is characterized in that the second camera
Equipment include: IP Camera, unmanned aerial vehicle onboard camera, unmanned vehicle vehicle-mounted camera, robot load camera in appoint
Meaning is one or more kinds of.
12. the articles search system according to claim 10 based on AR searcher, which is characterized in that the auxiliary is taken the photograph
As equipment further include: orientation range lock cell；
The orientation range lock cell, for obtaining sensing data, and according to the sensing data acquisition articles search carrier
The spatial dimension at place；The articles search carrier includes that Virtual Space intermediary, the AR searcher or the auxiliary are taken the photograph
As equipment.
13. the articles search system according to claim 12 based on AR searcher, which is characterized in that the auxiliary is taken the photograph
The ambient image in space as where equipment shoots acquisition, and it is sent to the AR searcher:
The AR searcher further include: image recognition positioning unit；
Described image identifies positioning unit, for carrying out feature extraction to the ambient image, by characteristics of image and pre-set space
Environmental characteristic be compared, identification positions the spatial dimension where the second camera equipment.
14. the articles search system according to claim 12 based on AR searcher, which is characterized in that the positioning model
Lock cell is enclosed to include: satellite positioning identification module, sense fixation and recognition module, communicate any one in fixation and recognition module
Or it is a variety of；
The satellite positioning identification module, for obtaining longitude and latitude data from position location satellite, and according to the longitude and latitude data
Identification positions the spatial dimension where the articles search carrier；
The sensing fixation and recognition module, for the preset motion sensor from the environment space, or from set on the object
Exercise data is obtained at the motion sensor of product search vector, and the articles search is positioned according to exercise data identification and is carried
Spatial dimension where body；
The communication fixation and recognition module, for being led to at least one wireless access point preset in the environment space
Letter positions the spatial dimension where the articles search carrier according to communication signal strength identification.
15. the articles search system according to claim 10 based on AR searcher, which is characterized in that the AR search
Device further include: virtual objects generation unit；
The virtual objects generation unit, the search that the searched object is searched for for enhancing display reminding are guided.
16. the articles search system according to claim 15 based on AR searcher, which is characterized in that described virtual right
As generation unit include: it is virtual guide module, and/or, virtually indicate generation module；
The virtual guide module, for guiding user to find and the clearly described searched object；
The virtual instruction generation module, for being superimposed virtual guide figure on the virtual reality scenario image of display,
The virtual guide figure includes；Virtual direction arrow and/or virtual dividing line.
17. the articles search system according to claim 16 based on AR searcher, which is characterized in that the virtual finger
Drawing module includes: Virtual Space intermediary；
Space and the memotron are administered for the storage where prompting the AR searcher by the Virtual Space intermediary
Have jurisdiction over the image data and/or article situation information of each article in space；The image data includes article image and/or article
Identification code；The article situation information include article orientation, article function, in article condition any one or it is a variety of.
18. the articles search system according to claim 10 based on AR searcher, which is characterized in that the article is searched
Cable system further include: zoom camera, the zoom camera, in the different zones after dividing visual field that further image,
In the image in the box that both hands gesture is constituted, the image in the visual field that furthers in the circular frame that both hands gesture is constituted in the visual field that furthers,
Or the image in the visual field that furthers in the circular frame that singlehanded gesture is constituted.
19. the articles search system according to claim 10 based on AR searcher, which is characterized in that the article is searched
Cable system further include: environment sensor device, the environment sensor device be set to the environment space, AR searcher and/or
Second camera equipment；
The environment sensor device for obtaining environmental state information, and feeds back to the AR searcher, trigger/does not trigger
The AR searcher obtains the guide for controlling to adjust the relative article of the ambient condition.
20. a kind of articles search method based on AR searcher characterized by comprising
S200: the environment space determined where articles search carrier is positioned；
S400: being obtained by AR searcher and enhances the image for showing the article in the environment space and the environment space
Data；
S500: constantly reducing search range among the image data, until locking searched object.
21. the articles search method according to claim 20 based on AR searcher, which is characterized in that the S200 it
Before include:
S100: prestoring the image data and article and/or prestores corresponding relationship between the article and space.
22. the articles search method according to claim 20 based on AR searcher, which is characterized in that the S200 it
Afterwards comprising steps of
S201: the image data of the article for the environment space that second camera equipment is sent is received.
23. the articles search method according to claim 22 based on AR searcher, which is characterized in that the S200 into
One step comprising steps of
S210: sensing data are obtained, and according to the spatial dimension where the sensing data acquisition articles search carrier；The object
Product search vector includes Virtual Space intermediary, the AR searcher or the second camera equipment；
The S400 further comprises step:
S410: the object confirmation instruction of input is obtained；
The S500 further comprises step:
S510: search range is constantly reduced according to object confirmation instruction, until confirmation shows the articles search carrier institute
Spatial dimension correspond to target search range and/or the searched object in image data.
24. the articles search method according to claim 23 based on AR searcher, which is characterized in that the S510 into
One step includes following either step:
S511: the image to further in the different zones after dividing visual field；
S512: the image in the visual field that furthers in the box that both hands gesture is constituted；
S513: the image in the visual field that furthers in the circular frame that both hands gesture is constituted；
S514: the image in the visual field that furthers in the circular frame that singlehanded gesture is constituted.
25. the articles search method according to claim 23 based on AR, which is characterized in that the S410 further comprises
Following either step:
S411: detection gesture movement generates object confirmation instruction according to the determination of the gesture motion；
S412: detecting the headwork of wearer, generates object confirmation instruction according to the article that the headwork determines；
S413: that detects eyeball watches movement attentively, watches the determining article generation object confirmation instruction of movement attentively according to described；
S414: the object for receiving voice input confirms instruction.
26. the articles search method according to claim 23 based on AR, which is characterized in that the S210 further comprises
Following either step；
S211: longitude and latitude data are obtained from position location satellite, and the articles search is positioned according to longitude and latitude data identification
Spatial dimension where carrier；
S212: the preset motion sensor from the environment space, or from be set to the articles search carrier motion-sensing
Exercise data is obtained at device, and the spatial dimension where the articles search carrier is positioned according to exercise data identification；
S213: it is communicated at least one wireless access point preset in the environment space, is known according to communication signal strength
The spatial dimension where the articles search carrier is not positioned；
S214: the ambient image in space where shooting obtains the AR searcher carries out feature extraction to the ambient image,
Characteristics of image is compared with the environmental characteristic of pre-set space, identification positions the spatial dimension where the AR searcher；
S215: the ambient image in space where obtaining the second camera equipment from the second camera equipment, to the ring
Border image carries out feature extraction, and characteristics of image is compared with the environmental characteristic of pre-set space, and identification positions the AR search
Spatial dimension where device.
27. the articles search method according to claim 20 based on AR searcher, which is characterized in that the S400 into
One step includes:
S450: reality scene image is captured；
S460: generating virtual reality scenario image according to the reality scene image, and enhances the display virtual reality scenario
Image；
S470: being superimposed virtual guide figure on the virtual reality scenario image of display, and enhancing display is superimposed with the void
The quasi- virtual reality scenario image for guiding figure searches for the searched object to guide；
Wherein, the virtual guide figure includes；Virtual direction arrow and/or virtual dividing line.
28. the articles search method according to claim 20 based on AR searcher, which is characterized in that the S200 it
Before further include step；
S120: environmental state information is obtained；
S130: the articles search equipment trigger/is not triggered according to the environmental state information and obtains the control and regulation environment
The guide of the relative article of state.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811474803.5A CN109324693A (en) | 2018-12-04 | 2018-12-04 | AR searcher, the articles search system and method based on AR searcher |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811474803.5A CN109324693A (en) | 2018-12-04 | 2018-12-04 | AR searcher, the articles search system and method based on AR searcher |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN109324693A true CN109324693A (en) | 2019-02-12 |
Family
ID=65256665
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811474803.5A Pending CN109324693A (en) | 2018-12-04 | 2018-12-04 | AR searcher, the articles search system and method based on AR searcher |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109324693A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110109384A (en) * | 2019-04-18 | 2019-08-09 | 武汉中天冠捷信息技术有限公司 | A kind of storehouse management sampling observation monitoring system based on wearable device |
| CN111522142A (en) * | 2020-06-14 | 2020-08-11 | 深圳市安之眼科技有限公司 | AR intelligence glasses |
| CN111650594A (en) * | 2020-05-08 | 2020-09-11 | 江苏杰瑞科技集团有限责任公司 | Beyond-the-horizon target positioning system and method based on unmanned aerial vehicle |
| CN112733620A (en) * | 2020-12-23 | 2021-04-30 | 深圳酷派技术有限公司 | Information prompting method and device, storage medium and electronic equipment |
| CN113440050A (en) * | 2021-05-13 | 2021-09-28 | 深圳市无限动力发展有限公司 | Cleaning method and device for interaction of AR equipment and sweeper and computer equipment |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103968824A (en) * | 2013-01-28 | 2014-08-06 | 华为终端有限公司 | Method for discovering augmented reality target, and terminal |
| US20140245160A1 (en) * | 2013-02-22 | 2014-08-28 | Ubiquiti Networks, Inc. | Mobile application for monitoring and controlling devices |
| CN105955043A (en) * | 2016-05-27 | 2016-09-21 | 浙江大学 | Augmented-reality type visible controllable intelligent household control system and method |
| CN107238172A (en) * | 2017-05-18 | 2017-10-10 | 青岛海尔空调器有限总公司 | The energy-saving control method and house system of house system |
| KR20170139365A (en) * | 2016-06-09 | 2017-12-19 | 엘지전자 주식회사 | A time notification device |
| CN107992814A (en) * | 2017-11-28 | 2018-05-04 | 北京小米移动软件有限公司 | Object finding method and device |
| CN108573293A (en) * | 2018-04-11 | 2018-09-25 | 广东工业大学 | A kind of unmanned supermarket shopping assisted method and system based on augmented reality |
| CN108829251A (en) * | 2018-06-14 | 2018-11-16 | 北京小米移动软件有限公司 | The method, apparatus and storage medium of information alert |
-
2018
- 2018-12-04 CN CN201811474803.5A patent/CN109324693A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103968824A (en) * | 2013-01-28 | 2014-08-06 | 华为终端有限公司 | Method for discovering augmented reality target, and terminal |
| US20140245160A1 (en) * | 2013-02-22 | 2014-08-28 | Ubiquiti Networks, Inc. | Mobile application for monitoring and controlling devices |
| CN105955043A (en) * | 2016-05-27 | 2016-09-21 | 浙江大学 | Augmented-reality type visible controllable intelligent household control system and method |
| KR20170139365A (en) * | 2016-06-09 | 2017-12-19 | 엘지전자 주식회사 | A time notification device |
| CN107238172A (en) * | 2017-05-18 | 2017-10-10 | 青岛海尔空调器有限总公司 | The energy-saving control method and house system of house system |
| CN107992814A (en) * | 2017-11-28 | 2018-05-04 | 北京小米移动软件有限公司 | Object finding method and device |
| CN108573293A (en) * | 2018-04-11 | 2018-09-25 | 广东工业大学 | A kind of unmanned supermarket shopping assisted method and system based on augmented reality |
| CN108829251A (en) * | 2018-06-14 | 2018-11-16 | 北京小米移动软件有限公司 | The method, apparatus and storage medium of information alert |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110109384A (en) * | 2019-04-18 | 2019-08-09 | 武汉中天冠捷信息技术有限公司 | A kind of storehouse management sampling observation monitoring system based on wearable device |
| CN111650594A (en) * | 2020-05-08 | 2020-09-11 | 江苏杰瑞科技集团有限责任公司 | Beyond-the-horizon target positioning system and method based on unmanned aerial vehicle |
| CN111522142A (en) * | 2020-06-14 | 2020-08-11 | 深圳市安之眼科技有限公司 | AR intelligence glasses |
| CN112733620A (en) * | 2020-12-23 | 2021-04-30 | 深圳酷派技术有限公司 | Information prompting method and device, storage medium and electronic equipment |
| CN113440050A (en) * | 2021-05-13 | 2021-09-28 | 深圳市无限动力发展有限公司 | Cleaning method and device for interaction of AR equipment and sweeper and computer equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110770678B (en) | Object holographic enhancement | |
| CN109324693A (en) | AR searcher, the articles search system and method based on AR searcher | |
| US10130548B2 (en) | System and method to assist users having reduced visual capability utilizing lighting device provided information | |
| US11699271B2 (en) | Beacons for localization and content delivery to wearable devices | |
| CN109088803A (en) | A kind of AR remote control device, intelligent domestic remote control system and method | |
| CN103562968B (en) | The system that shared digital interface is rendered for the viewpoint relative to each user | |
| WO2018145447A1 (en) | Terminal operation control method and apparatus, and terminal | |
| WO2018043732A1 (en) | Object display system, user terminal device, object display method, and program | |
| CN105913497A (en) | Virtual reality space mobile positioning system and virtual reality space mobile positioning method for virtual house inspecting | |
| CN108604129A (en) | Based on wireless distance finding come control electronics and display information | |
| CN105631773A (en) | Electronic device and method for providing map service | |
| CN106063245A (en) | Smart necklace with stereo vision and onboard processing | |
| JP6705124B2 (en) | Head-mounted display device, information system, head-mounted display device control method, and computer program | |
| US11375559B2 (en) | Communication connection method, terminal device and wireless communication system | |
| WO2019240208A1 (en) | Robot, method for controlling robot, and program | |
| US9569660B2 (en) | Control system, control method and computer program product | |
| US20220084303A1 (en) | Augmented reality eyewear with 3d costumes | |
| CN209514548U (en) | AR searcher, the articles search system based on AR searcher | |
| JP7287950B2 (en) | COMMUNICATION METHOD, COMMUNICATION DEVICE, AND PROGRAM | |
| CN205845105U (en) | A kind of for the virtual virtual reality space running fix device seeing room | |
| CN109272549A (en) | A kind of location determining method and terminal device of infrared heat point | |
| CN111033606A (en) | Information processing apparatus, information processing method, and program | |
| KR101756289B1 (en) | Mobile terminal and information providing method thereof | |
| WO2022009338A1 (en) | Information processing terminal, remote control method, and program | |
| JP2019139793A (en) | Character image generation device, character image generation method, program and recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |