CN208689267U - A kind of intelligent glasses Focus tracking device and intelligent glasses - Google Patents

A kind of intelligent glasses Focus tracking device and intelligent glasses Download PDF

Info

Publication number
CN208689267U
CN208689267U CN201821571798.5U CN201821571798U CN208689267U CN 208689267 U CN208689267 U CN 208689267U CN 201821571798 U CN201821571798 U CN 201821571798U CN 208689267 U CN208689267 U CN 208689267U
Authority
CN
China
Prior art keywords
image
intelligent glasses
user
focal position
present
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201821571798.5U
Other languages
Chinese (zh)
Inventor
蔡海蛟
冯歆鹏
周骥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kunshan Zhaoguan Electronic Technology Co Ltd
Shanghai Zhao Ming Electronic Technology Co Ltd
NextVPU Shanghai Co Ltd
Original Assignee
Kunshan Zhaoguan Electronic Technology Co Ltd
Shanghai Zhao Ming Electronic Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Kunshan Zhaoguan Electronic Technology Co Ltd, Shanghai Zhao Ming Electronic Technology Co Ltd filed Critical Kunshan Zhaoguan Electronic Technology Co Ltd
Priority to CN201821571798.5U priority Critical patent/CN208689267U/en
Application granted granted Critical
Publication of CN208689267U publication Critical patent/CN208689267U/en
Priority to PCT/CN2019/107669 priority patent/WO2020063614A1/en
Priority to KR1020207034439A priority patent/KR102242719B1/en
Priority to EP19199836.8A priority patent/EP3640840B1/en
Priority to JP2019175346A priority patent/JP6734602B2/en
Priority to US16/669,919 priority patent/US10860165B2/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • User Interface Of Digital Computer (AREA)

Abstract

The utility model provides a kind of intelligent glasses Focus tracking device and intelligent glasses, is related to smart machine, which after acquiring the image, identifies the object in image, and object present in the focal position or region set in image is broadcasted to user.By the device, object present in the focal position or region set to user's casting, rather than directly all broadcast the object in image, to improve the casting efficiency of intelligent glasses, improve the experience of user.

Description

A kind of intelligent glasses Focus tracking device and intelligent glasses
Technical field
The utility model belongs to smart machine field, and in particular to a kind of intelligent glasses Focus tracking device and Brilliant Eyes Mirror.
Background technique
Currently, having a kind of intelligent glasses for user visually impaired design, which can be with for convenient for user visually impaired life Image information is acquired, after user wears the intelligent glasses, which can broadcast the content in present image to user, To provide convenience for the life of user visually impaired.
But the utility model inventors have found that user use intelligent glasses when, can not actively select the friendship of glasses Mutual center, the mode that intelligent glasses are usually taken at this time are that information in all images is once all broadcasted, and cannot One time accurately locked text, the object range for needing to identify, need to be directed toward by external physical equipment (such as finger) identified Point, similar to the equipment one external instruction intervened, equipment can just complete its function according to this instruction.
Therefore, current intelligent glasses casting efficiency is lower, and user can not experience the orientation of object in the visual field, user's body It tests bad.
Utility model content
In view of drawbacks described above in the prior art or deficiency, it is intended to provide a kind of intelligent glasses Focus tracking device and intelligence Glasses improve the experience of user to improve the casting efficiency of intelligent glasses.
According to the utility model in a first aspect, providing a kind of intelligent glasses Focus tracking device, comprising:
Recognition unit identifies the object in image after acquiring image;
Unit is broadcasted, for broadcasting object present in the focal position or region that set in image to user.
Further, the casting unit is also used to:
When object is not present in the focal position or region set in image, user is prompted to rotate head, or prompt Object is not present in the focal position or region set in user images.
Further, the casting unit is prompted when object is not present in the focal position or region set in image User rotates head, specifically includes:
When object is not present in the focal position or region set in image, the orientation where objects in images is determined, And the orientation where prompting user to object rotates head.
Further, the casting unit is also used to:
When user rotates head, the degree of the focal position or region that are set in image according to object, variation is mentioned Show sound.
Preferably, the focal position set in described image, the specially center of image;
The focus area set in described image, the specially circle or rectangle of the area accounting 1/3-1/2 of picture centre Region.
Second aspect, the utility model embodiment also provide a kind of intelligent glasses, comprising: processor, camera, voice are broadcast Reporting device, in which:
The processor connects the camera and the sound broadcasting device, and by the camera collection image, After object in the processor identification image, the focus position set in image is broadcasted to user by the sound broadcasting device Set or region present in object.
Further, the sound broadcasting device is specially loudspeaker.
Further, the intelligent glasses further include:
For judging the inertia sensing device assembly of intelligent glasses motion state, which connects the processing Device.
Further, the inertia sensing device assembly includes one of following or combination:
For determining the velocity sensor of intelligent glasses movement velocity;
For determining the acceleration transducer of intelligent glasses movement velocity;
For determining the magnetometer of intelligent glasses directional information;
For determining that intelligent glasses are vertically to the gyroscope of the angle information of the axis of orientation in the earth's core.
The utility model embodiment provides a kind of intelligent glasses Focus tracking device and intelligent glasses, after acquiring the image, It identifies the object in image, and broadcasts object present in the focal position or region set in image to user.Pass through the dress It sets, object present in the focal position or region set to user's casting, rather than it is directly that the object in image is whole It broadcasts, to improve the casting efficiency of intelligent glasses, improves the experience of user.
It should be appreciated that the above description is merely an outline of the technical solution of the present invention, so as to more clearly understand this The technological means of utility model, so as to be implemented in accordance with the contents of the specification.In order to allow the above-mentioned of the utility model and its Its objects, features and advantages can be more clearly understood, and special lift illustrates specific embodiment of the present utility model below.
Detailed description of the invention
By reading the detailed description of following example embodiments, those of ordinary skill in the art are readily apparent that described herein A little with benefit and other advantage and benefit.Attached drawing is only used for showing the purpose of exemplary embodiment, and is not considered as Limitations of the present invention.And throughout the drawings, identical component is indicated by the same numeral.In the accompanying drawings:
Fig. 1 is intelligent glasses Focus tracking method flow diagram provided by the embodiment of the utility model;
Fig. 2 is the focal position set in image provided by the embodiment of the utility model and the focus area set in image Schematic diagram;
Fig. 3 is the intelligent glasses Focus tracking method flow in a specific embodiment provided by the embodiment of the utility model Figure;
Fig. 4 is intelligent glasses Focus tracking apparatus structure schematic diagram provided by the embodiment of the utility model;
Fig. 5 is intelligent glasses structural schematic diagram provided by the embodiment of the utility model;
Fig. 6 is the intelligent glasses structural schematic diagram in a specific embodiment provided by the embodiment of the utility model.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure It is fully disclosed to those skilled in the art.
In the present invention, it should be appreciated that it is public that the terms such as " comprising " or " having " are intended to refer to institute in this specification The presence of the feature opened, number, step, behavior, component, part or combinations thereof, and be not intended to exclusion it is one or more other Feature, number, step, behavior, component, part or combinations thereof there are a possibility that.
It also should be noted that in the absence of conflict, in the embodiments of the present invention and embodiment Feature can be combined with each other.The utility model will be described in detail below with reference to the accompanying drawings and embodiments.
In fig. 1 it is shown that intelligent glasses Focus tracking method provided by the embodiment of the utility model, this method comprises:
Step S101, after acquiring image, the object in image is identified;
Step S102, object present in the focal position or region set in image is broadcasted to user.
By the intelligent glasses Focus tracking method, object present in the focal position or region set to user's casting Body, rather than directly all broadcast the object in image, to improve the casting efficiency of intelligent glasses, improve use The experience at family.
Object in step S101 can be arbitrary objects, or the specified object of predefined.
Further, for user visually impaired, it may be difficult to by the good alignment target object of the focus of intelligent glasses, this When, there is no when object, prompting user to rotate head in the focal position or region that can set in the picture, or prompt is used Object is not present in the focal position or region set in the image of family.
User is hearing the prompt on rotation head or there is no after the prompt of object, can arbitrarily rotate head to find Object.
Further, for convenient for user's searching object, when object is not present in the focal position or region set in image When body, the orientation where objects in images can be determined, and prompt the orientation rotation head where user to object.For example, if It there are text or two dimensional code on the left of focus in image, can prompt have text or two dimensional code on the left of user focus, allow use Family turns left head.
It, can be according to the journey for the focal position or region that object is set in image during user rotates head Degree changes voice prompt, consequently facilitating user visually impaired determines the degree on rotation head, is conducive to user and more accurately carries out focus Positioning is also possible to user and arbitrarily rotates head at this point, user, which can be, rotates head according to the orientation where the object of prompt Searching object.
For example, voice prompt can be more rapid when the focal position or region that object is set in image, thus Judge whether correct and head rotation the degree in head rotation direction is suitable convenient for user.Can also have by other only The voice prompting of characteristic reminds user, and whether object arrived the center of intake range.
As shown in Fig. 2, the focal position set in image, can be specially the center of image;It is set in image Focus area then can be specially circle or the rectangular area of the area accounting 1/3-1/2 of picture centre, those skilled in the art Can the range to the focus area set in the focal position and image set in image according to the actual situation initial setting up It is adjusted, user can also adjust the focal position set in image according to the use habit of oneself and set in image The range of focus area.
In a preferred embodiment, intelligent glasses Focus tracking method provided by the embodiment of the utility model, such as Fig. 3 institute Show, comprising:
Step S301, the image of camera acquisition is obtained;
Step S302, the object in image is identified;
Step S303, image center location is judged with the presence or absence of object, if so, otherwise executing step S304 executes step Rapid S305;
Step S304, the object of voice broadcast image center location;
Step S305, judge with the presence or absence of object in whole image region, if so, executing step S306, otherwise, execute Step S307;
Step S306, it determines the orientation where objects in images, and prompts the orientation rotation head where user to object;
Step S307, it prompts that object is not present in user images, or prompt user rotates head.
In step S301, in camera collection image, relatively steady state typically is in intelligent glasses In, if intelligent glasses generally do not acquire image at this time with the movement of higher speed, can be moved by intelligent glasses Speed, acceleration, to judge the head rotation situation of user.
In step S303, it only can whether there is object by identification image center location, can also identify picture centre position Set and its surrounding setting regions in the presence or absence of object.
In step S307, prompt there is no after object in user images, user can arbitrarily rotate head according to prompt Searching object.
The prompt facility of step S306 and step S307 can also be determined to open or close, if user does not open by user Prompt is opened, then user etc. are less than casting, so that it may determine that, there is no object in image, user can be according to the random rotary head of prompt Portion's searching object.
By the intelligent glasses, when user wants to understand environmental information, specific orientation can be understood by head rotation Object information.For example, user visually impaired to a hall, wants to understand the layout in hall, when what having, head can be passed through It rotates to understand the object information of particular orientation.For specific informations such as text, two dimensional codes, if picture centre has text, It directly broadcasts, if text at the left side of central area, prompts left to have a text, user can turn left head, work as text Word in the picture the heart when then broadcast.
The focal position of the setting of image, can be according to user setting noting marker or not noting marker, for eyesight For the wearable device (such as VR) that normal user uses, cross mark can be filled in the focal position of the setting of image, As shown in Figure 2, so that the point be illustrated to be visual pattern central point, judge convenient for user and adjust, for user visually impaired, It then can not noting marker.
Likewise, the focus area of the setting of image, can also according to user setting noting marker or not noting marker, It, can be by the focus area of the setting of image with special for the wearable device (such as VR) that twenty-twenty user uses Frame outlines, such as red frame judges and adjusted convenient for user so that the region be illustrated to be visual pattern central area It is whole, it, then can not noting marker for user visually impaired.
When there is characteristic information in the focal position of the setting of image (such as the characteristic informations such as text, two dimensional code), directly broadcast Report, the range of casting are diffused in 1/3-1/2 (ratio is adjustable) image area region around with the position.
The utility model embodiment correspondingly provides a kind of intelligent glasses Focus tracking device, as shown in Figure 4, comprising:
Recognition unit 401 identifies the object in image after acquiring image;
Unit 402 is broadcasted, for broadcasting object present in the focal position or region that set in image to user.
Further, casting unit 402 is also used to:
When object is not present in the focal position or region set in image, user is prompted to rotate head, or prompt Object is not present in the focal position or region set in user images.
Further, casting unit 402 prompts to use when object is not present in the focal position or region set in image Family rotates head, specifically includes:
When object is not present in the focal position or region set in image, the orientation where objects in images is determined, And the orientation where prompting user to object rotates head.
Further, casting unit 402 is also used to:
When user rotates head, the degree of the focal position or region that are set in image according to object, variation is mentioned Show sound.
Further, the focal position set in image, the specially center of image;
The focus area set in image, the specially circle of the area accounting 1/3-1/2 of picture centre or rectangular area.
The utility model embodiment also provides a kind of intelligent glasses, as shown in Figure 5, comprising: processor 501, camera 502, sound broadcasting device 503, in which:
Processor 501 connects camera 502 and sound broadcasting device 503, and acquires image, processing by camera 502 After device 501 identifies the object in image, the focal position or area that set in image are broadcasted to user by sound broadcasting device 503 Object present in domain.
Sound broadcasting device 503 can be specially loudspeaker.
Further, as shown in fig. 6, can also include: in the intelligent glasses
For judging the inertia sensing device assembly 504 of intelligent glasses motion state, 504 junctions of the inertial sensor group Manage device 501.
Further, inertia sensing device assembly 504 includes one of following or combination:
For determining the velocity sensor of intelligent glasses movement velocity;
For determining the acceleration transducer of intelligent glasses movement velocity;
For determining that intelligent glasses are vertically to the gyroscope of the angle information of the axis of orientation in the earth's core.
By intelligent glasses Focus tracking device provided by the embodiment of the utility model and intelligent glasses, can be broadcast to user Object in the focus area of the focal position or setting that set in the report visual field, avoids and all broadcasts out the object in the visual field Come, and can further prompt the orientation of user's object, is convenient for usertracking object, improves the usage experience of user.
Flow chart and block diagram in attached drawing, illustrating can according to the method, apparatus and calculating machine of the various embodiments of the disclosure Read the architecture, function and operation in the cards of storage medium.It should be noted that represented by each box in flow chart Step may not can be basically executed in parallel sometimes according to sequentially carrying out shown in label, sometimes can also be in the opposite order It executes, this depends on the function involved.It is also noted that each box and block diagram in block diagram and or flow chart And/or the combination of the box in flow chart, it can be realized with the hardware for executing defined functions or operations, or can be with firmly Combination that part is instructed with calculating machine is realized.
Being described in the embodiment of the present disclosure involved unit or module can be realized by way of software, can also be with It is realized by way of hardware.
By above to the description of embodiment, those skilled in the art can be understood that each embodiment can be by Software adds the mode of required general hardware platform to realize, naturally it is also possible to pass through hardware.Based on this understanding, above-mentioned skill Substantially the part that contributes to existing technology can be embodied in the form of software products art scheme in other words, the operation Machine software product can store in calculating machine readable storage medium storing program for executing, such as ROM/RAM, magnetic disk, CD, including some instructions are used So that operation machine equipment (can be personal calculating machine, server or the network equipment etc.) execute each embodiment or Method described in certain parts of person's embodiment.
Finally, it should be noted that above embodiments are only to illustrate the technical solution of the utility model, rather than its limitations; Although the utility model is described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: It is still possible to modify the technical solutions described in the foregoing embodiments, or part of technical characteristic is carried out etc. With replacement;And these are modified or replaceed, various embodiments of the utility model technology that it does not separate the essence of the corresponding technical solution The spirit and scope of scheme.

Claims (9)

1. a kind of intelligent glasses Focus tracking device characterized by comprising
Recognition unit identifies the object in image after acquiring image;
Unit is broadcasted, for broadcasting object present in the focal position or region that set in image to user.
2. device as described in claim 1, which is characterized in that the casting unit is also used to:
When object is not present in the focal position or region set in image, user is prompted to rotate head, or prompt user Object is not present in the focal position or region set in image.
3. device as claimed in claim 2, which is characterized in that the casting unit is when the focal position or area set in image When object being not present in domain, prompts user to rotate head, specifically includes:
When object is not present in the focal position or region set in image, the orientation where objects in images is determined, and mention Show the orientation rotation head where user to object.
4. device as claimed in claim 2, which is characterized in that the casting unit is also used to:
When user rotates head, the degree of the focal position or region that are set in image according to object changes prompting sound Sound.
5. device as described in claim 1, which is characterized in that the focal position that is set in described image, specially image Center;
The focus area set in described image, the specially circle of the area accounting 1/3-1/2 of picture centre or rectangular area.
6. a kind of intelligent glasses characterized by comprising processor, camera, sound broadcasting device, in which:
The processor connects the camera and the sound broadcasting device, and by the camera collection image, described After processor identifies the object in image, by the sound broadcasting device to user broadcast in image the focal position that sets or Object present in region.
7. intelligent glasses as claimed in claim 6, which is characterized in that the sound broadcasting device is specially loudspeaker.
8. intelligent glasses as claimed in claim 6, which is characterized in that further include:
For judging the inertia sensing device assembly of intelligent glasses motion state, which connects the processor.
9. intelligent glasses as claimed in claim 8, which is characterized in that the inertia sensing device assembly includes one of following or group It closes:
For determining the velocity sensor of intelligent glasses movement velocity;
For determining the acceleration transducer of intelligent glasses movement velocity;
For determining that intelligent glasses are vertically to the gyroscope of the angle information of the axis of orientation in the earth's core.
CN201821571798.5U 2018-09-26 2018-09-26 A kind of intelligent glasses Focus tracking device and intelligent glasses Active CN208689267U (en)

Priority Applications (6)

Application Number Priority Date Filing Date Title
CN201821571798.5U CN208689267U (en) 2018-09-26 2018-09-26 A kind of intelligent glasses Focus tracking device and intelligent glasses
PCT/CN2019/107669 WO2020063614A1 (en) 2018-09-26 2019-09-25 Smart glasses tracking method and apparatus, and smart glasses and storage medium
KR1020207034439A KR102242719B1 (en) 2018-09-26 2019-09-25 Smart glasses tracking method and device, and smart glasses and storage media
EP19199836.8A EP3640840B1 (en) 2018-09-26 2019-09-26 Tracking method and apparatus for smart glasses, smart glasses and storage medium
JP2019175346A JP6734602B2 (en) 2018-09-26 2019-09-26 Tracking method and tracking device for smart glasses, smart glasses, and storage media
US16/669,919 US10860165B2 (en) 2018-09-26 2019-10-31 Tracking method and apparatus for smart glasses, smart glasses and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201821571798.5U CN208689267U (en) 2018-09-26 2018-09-26 A kind of intelligent glasses Focus tracking device and intelligent glasses

Publications (1)

Publication Number Publication Date
CN208689267U true CN208689267U (en) 2019-04-02

Family

ID=65889144

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201821571798.5U Active CN208689267U (en) 2018-09-26 2018-09-26 A kind of intelligent glasses Focus tracking device and intelligent glasses

Country Status (1)

Country Link
CN (1) CN208689267U (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020063614A1 (en) * 2018-09-26 2020-04-02 上海肇观电子科技有限公司 Smart glasses tracking method and apparatus, and smart glasses and storage medium
CN110955043A (en) * 2018-09-26 2020-04-03 上海肇观电子科技有限公司 Intelligent glasses focus tracking method and device, intelligent glasses and storage medium
CN111176439A (en) * 2019-11-19 2020-05-19 广东小天才科技有限公司 Reading control method based on visual tracking, intelligent glasses and system
US10860165B2 (en) 2018-09-26 2020-12-08 NextVPU (Shanghai) Co., Ltd. Tracking method and apparatus for smart glasses, smart glasses and storage medium

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020063614A1 (en) * 2018-09-26 2020-04-02 上海肇观电子科技有限公司 Smart glasses tracking method and apparatus, and smart glasses and storage medium
CN110955043A (en) * 2018-09-26 2020-04-03 上海肇观电子科技有限公司 Intelligent glasses focus tracking method and device, intelligent glasses and storage medium
US10860165B2 (en) 2018-09-26 2020-12-08 NextVPU (Shanghai) Co., Ltd. Tracking method and apparatus for smart glasses, smart glasses and storage medium
CN111176439A (en) * 2019-11-19 2020-05-19 广东小天才科技有限公司 Reading control method based on visual tracking, intelligent glasses and system

Similar Documents

Publication Publication Date Title
CN208689267U (en) A kind of intelligent glasses Focus tracking device and intelligent glasses
CN208722145U (en) A kind of intelligent glasses Focus tracking device and intelligent glasses
JP6011938B2 (en) Sensor-based mobile search, related methods and systems
JP5879637B2 (en) Intuitive computing method and system
JP5843207B2 (en) Intuitive computing method and system
Bigham et al. Vizwiz: nearly real-time answers to visual questions
JP6527507B2 (en) Smart Prostheses to Promote Artificial Vision Using Scene Abstraction
CN110249359A (en) Geography fence assessment system
CN107742107A (en) Facial image sorting technique, device and server
CN108399409A (en) Image classification method, device and terminal
KR102626290B1 (en) Augmented reality guidance interface
CN112287928A (en) Prompting method and device, electronic equipment and storage medium
CN106339738A (en) Intelligent sensing system and method for running exercise
Jafri et al. User-centered design of a depth data based obstacle detection and avoidance system for the visually impaired
KR20220163430A (en) Identification of Physical Products for Augmented Reality Experiences in Messaging Systems
CN107084740A (en) A kind of air navigation aid and device
CN110298850A (en) The dividing method and device of eye fundus image
CN106846438A (en) A kind of jewellery try-in method, apparatus and system based on augmented reality
KR102248706B1 (en) System for intergrated education management based on intelligent image analysis technology and method thereof
JP2004127285A (en) Image recognition apparatus, image recognition processing method and image recognition program
Coughlan et al. -Camera-Based Access to Visual Information
CN111611812A (en) Translating into braille
CN109035686A (en) A kind of pre- anti-lost alarm method and device
CN110084187A (en) Location recognition method, device, equipment and storage medium based on computer vision
CN113192072B (en) Image segmentation method, device, equipment and storage medium

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant