CN110287872A - A kind of recognition methods of point of interest direction of visual lines and device based on mobile terminal - Google Patents

A kind of recognition methods of point of interest direction of visual lines and device based on mobile terminal Download PDF

Info

Publication number
CN110287872A
CN110287872A CN201910554426.4A CN201910554426A CN110287872A CN 110287872 A CN110287872 A CN 110287872A CN 201910554426 A CN201910554426 A CN 201910554426A CN 110287872 A CN110287872 A CN 110287872A
Authority
CN
China
Prior art keywords
information
mobile terminal
interest
point
visual lines
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910554426.4A
Other languages
Chinese (zh)
Inventor
周青
曹志超
刘云浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
Original Assignee
Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University filed Critical Tsinghua University
Priority to CN201910554426.4A priority Critical patent/CN110287872A/en
Publication of CN110287872A publication Critical patent/CN110287872A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/10Terrestrial scenes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/62Text, e.g. of license plates, overlay texts or captions on TV images
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/021Services related to particular areas, e.g. point of interest [POI] services, venue services or geofences
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V30/00Character recognition; Recognising digital ink; Document-oriented image-based pattern recognition
    • G06V30/10Character recognition

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Telephone Function (AREA)

Abstract

The embodiment of the present invention provides a kind of point of interest direction of visual lines recognition methods based on mobile terminal and device, this method comprises: the interest point information in acquisition for mobile terminal ambient enviroment;Obtain the central instant information that the interest point information appears in mobile terminal preview frame center;According to the central instant acquisition of information direction of visual lines information.The embodiment of the present invention grabs the multiple image of ambient enviroment by mobile terminal, and it is identified in multiple image with the presence or absence of text by technologies such as Text regions, obtain the character image information with text, then interest point information is identified according to literal image content, when the interest point information is in the preview frame center of mobile terminal, think at this time mobile terminal to the angle of point of interest be target angle, pass through the acceleration transducer of mobile terminal, magnetometric sensor and gravity sensor are determined when interest point information is in the preview frame center of mobile terminal, direction of visual lines of the point of interest to mobile terminal.

Description

A kind of recognition methods of point of interest direction of visual lines and device based on mobile terminal
Technical field
The present invention relates to Information locating technical field more particularly to a kind of point of interest direction of visual lines knowledges based on mobile terminal Other method and device.
Background technique
Indoor positioning technologies refer in environment indoors realize position positioning, mainly using wireless telecommunications, base station location and The multiple technologies such as inertial navigation positioning are to realize the positioning indoors in space such as personnel, object.
And indoor positioning technologies in the prior art usually require additional hardware, or need in advance the scene of progress survey It surveys, is unfavorable for promoting the use of in practice, and scene can be alleviated by generally existing indoor plane figure in market and surveyed Problem caused by surveying, but the indoor plane figure in true use occasion and market may have scale bar and be difficult to determining etc. ask Topic, therefore user can be further determined that by considering to be positioned so that using the direction of visual lines of some point of interest to user Position.
And the direction of visual lines for obtaining point of interest to user is the basis that user's positioning is carried out with the program, therefore how to be obtained The direction of visual lines for taking point of interest to user has become a urgent problem to be solved.
Summary of the invention
The embodiment of the present invention provides a kind of point of interest direction of visual lines recognition methods based on mobile terminal and device, to solve Technical problem certainly mentioned above in the background art, or at least partly solve technical problem mentioned above in the background art.
In a first aspect, the embodiment of the present invention provides a kind of point of interest direction of visual lines recognition methods based on mobile terminal, institute The method of stating includes:
Interest point information in acquisition for mobile terminal ambient enviroment;
Obtain the central instant information that the interest point information appears in mobile terminal preview frame center;
According to the central instant acquisition of information direction of visual lines information.
More specifically, the interest point information in the acquisition for mobile terminal ambient enviroment specifically includes:
Multiple image in acquisition for mobile terminal ambient enviroment;
Text region operation is carried out to the multiple image, obtains text image information;
It is analyzed and processed according to text image information described in editing distance standard, determines point of interest text image information;
Interest point information is obtained according to the point of interest text image information.
More specifically, described the step of direction of visual lines information is obtained according to the central instant information and interest point information, It specifically includes:
Mobile terminal is obtained in the acceleration transducer reading information of the central instant information, gravity direction information and magnetic Force snesor information;
Mobile terminal world coordinate system angle information is determined according to acceleration transducer reading information and gravity direction information;
Mobile terminal world coordinate system directional information is determined according to magnetometric sensor information;
View is determined according to the mobile terminal world coordinate system angle information and mobile terminal world coordinate system directional information Line directional information.
More specifically, before the interest point information in the acquisition for mobile terminal ambient enviroment the step of, the method Further include:
It obtains and collects director information;
The multiple image in ambient enviroment is obtained according to the collection director information.
Second aspect, the embodiment of the present invention provide a kind of point of interest direction of visual lines identification device based on mobile terminal, institute Stating device includes:
Module is obtained, for the interest point information in acquisition for mobile terminal ambient enviroment;
Analysis module appears in the central instant letter of mobile terminal preview frame center for obtaining the interest point information Breath;
Identification module, for according to the central instant acquisition of information direction of visual lines information.
More specifically, the acquisition module is specifically used for:
Multiple image in acquisition for mobile terminal ambient enviroment;
Text region operation is carried out to the multiple image, obtains text image information;
It is analyzed and processed according to text image information described in editing distance standard, determines point of interest text image information;
Interest point information is obtained according to the point of interest text image information.
More specifically, the identification module is specifically used for:
Mobile terminal is obtained in the acceleration transducer reading information of the central instant information, gravity direction information and magnetic Force snesor information;
Mobile terminal world coordinate system angle information is determined according to acceleration transducer reading information and gravity direction information;
Mobile terminal world coordinate system directional information is determined according to magnetometric sensor information;
View is determined according to the mobile terminal world coordinate system angle information and mobile terminal world coordinate system directional information Line directional information.
The third aspect, the embodiment of the present invention provides a kind of electronic equipment, including memory, processor and is stored in memory Computer program that is upper and can running on a processor, the processor realize base as described in relation to the first aspect when executing described program In the point of interest direction of visual lines recognition methods of mobile terminal the step of.
Fourth aspect, the embodiment of the present invention provide a kind of non-transient computer readable storage medium, are stored thereon with calculating Machine program realizes the point of interest sight side based on mobile terminal as described in relation to the first aspect when the computer program is executed by processor To the step of recognition methods.
A kind of recognition methods of point of interest direction of visual lines and device based on mobile terminal provided in an embodiment of the present invention, passes through Mobile terminal grabs the multiple image of ambient enviroment, and by technologies such as Text regions to whether there is text in multiple image It is identified, obtains the character image information with text, interest point information is then identified according to literal image content, when this When interest point information is in the preview frame center of mobile terminal, it is believed that the angle of mobile terminal to point of interest is target at this time Then angle is determined by the acceleration transducer of mobile terminal, magnetometric sensor and gravity sensor in interest point information When preview frame center in mobile terminal, the direction of visual lines of the point of interest to mobile terminal.
Detailed description of the invention
In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is this hair Bright some embodiments for those of ordinary skill in the art without creative efforts, can be with root Other attached drawings are obtained according to these attached drawings.
Fig. 1 is the point of interest direction of visual lines recognition methods process based on mobile terminal described in one embodiment of the invention Figure;
Fig. 2 is point of interest described in one embodiment of the invention to user terminal direction of visual lines schematic diagram;
Fig. 3 is that the point of interest direction of visual lines identification device structure based on mobile terminal described in one embodiment of the invention is shown It is intended to;
Fig. 4 is the electronic devices structure schematic diagram of one embodiment of the invention description.
Specific embodiment
In order to make the object, technical scheme and advantages of the embodiment of the invention clearer, below in conjunction with the embodiment of the present invention In attached drawing, technical scheme in the embodiment of the invention is clearly and completely described, it is clear that described embodiment is A part of the embodiment of the present invention, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art Every other embodiment obtained without creative efforts, shall fall within the protection scope of the present invention.
Point of interest described in the embodiment of the present invention (Point Of Interest, abbreviation POI) refers to that people are interested Geographical entity, such as restaurant, school, hotel and market, each POI includes much information, for example, title, classification, longitude and latitude Degree.
Mobile terminal described in the embodiment of the present invention refers to comprising camera, acceleration transducer, magnetometric sensor With the mobile terminal of gravity sensor, the mobile terminal in the embodiment of the present invention can also include a display module, to provide Preview function;The mobile terminal can be the equipment such as smart phone or tablet computer.
Fig. 1 is the point of interest direction of visual lines recognition methods process based on mobile terminal described in one embodiment of the invention Figure, as shown in Figure 1, comprising:
Step S1, the interest point information in acquisition for mobile terminal ambient enviroment;
Step S2 obtains the central instant information that the interest point information appears in mobile terminal preview frame center;
Step S3, according to the central instant acquisition of information direction of visual lines information.
Specifically, retouched step S1 is specifically, mobile terminal is connected by its included camera in the embodiment of the present invention It is continuous to obtain multiframe ambient enviroment picture information, Word Input is then carried out to each frame image of acquisition and Text region is grasped Make, is text image information by the image tagged with text, then specifically the text in text image information is being known Not, when the content of text similarity of the text results of identification and POI is sufficiently high, then the part of the text in picture content is marked It is denoted as interest point information.
Step S2 described in the embodiment of the present invention is specifically, divide the image information with interest point information Analysis, when interest point information appears precisely at mobile terminal preview frame center, then obtains central instant information this moment.
Preview frame described in the embodiment of the present invention refers to by shown by display module entrained by mobile terminal For the frame image information of preview.
Preview frame center described in the embodiment of the present invention refers to the centre bit of display module entrained by mobile terminal It sets, the range of the center can be preset, such as one piece of region is preset in display module, as center Position, when interest point information is that then will be considered to it to appear in mobile terminal preview frame center into region is preset.
Fig. 2 is point of interest described in one embodiment of the invention to user terminal direction of visual lines schematic diagram, as shown in Fig. 2, User's H hand-held mobile terminal keeps facial direction consistent simultaneously in the projecting direction of horizontal plane with the world coordinates z-axis of mobile terminal And when using POI (POI in figure being indicated with P) of the camera " observation " of mobile terminal surrounding, mobile terminal camera lens is given Optical centre O and as plane center C, C and O user carry out " observation " operate when remain the same line.Therefore, when with When family is towards P, the direction of visual lines HP and CO of P is identical, while the direction of CO can pass through the sensing in mobile terminal Device information obtains, therefore the direction of visual lines of P can deduce and.However during user carries out " observation " operation, User's face is towards being to continue variation, therefore HP and CO are not always identical, such as in Fig. 2, and C1-O1 and C2-O2 are just It is not to be aligned with HP, when the face orientation of user not faces P, P appears in C1 in the imaging F1 (F2) of optical centre (C2) the left side (the right), and when user faces P, F and C are overlapped.This means that the key of CO and HP alignment is P's Be imaged F whether with C be overlapped (i.e. the middle whether POI appears in mobile terminal display module preview frame).
Step S3 described in the embodiment of the present invention is specifically, when point of interest appears in mobile terminal preview frame central instant When, obtain acceleration transducer reading information, gravity direction information and the magnetometric sensor information of the moment mobile terminal;According to Acceleration transducer reading information and gravity direction information determine mobile terminal world coordinate system angle information;It is sensed according to magnetic force Device information determines mobile terminal world coordinate system directional information;According to the mobile terminal world coordinate system angle information and movement Terminal world coordinate system directional information determines direction of visual lines information.
The embodiment of the present invention grabs the multiple image of ambient enviroment by mobile terminal, and passes through the technologies such as Text region It being identified to whether there is text in multiple image, the character image information with text is obtained, then according to character image Content recognition goes out interest point information, when the interest point information is in the preview frame center of mobile terminal, it is believed that this time shift The angle of dynamic terminal to point of interest is target angle, then passes through the acceleration transducer of mobile terminal, magnetometric sensor and again Force snesor determines when interest point information is in the preview frame center of mobile terminal, the sight of the point of interest to mobile terminal Direction.
On the basis of the above embodiments, the interest point information in the acquisition for mobile terminal ambient enviroment specifically includes:
Multiple image in acquisition for mobile terminal ambient enviroment;
Text region operation is carried out to the multiple image, obtains text image information;
It is analyzed and processed according to text image information described in editing distance standard, determines point of interest text image information;
Interest point information is obtained according to the point of interest text image information.
Specifically, editing distance standard described in the embodiment of the present invention is in text information by each POI Distance between word content and text carrys out preset standard, if the word content of the content of text in text image information and Distance between text is similar to preset editorial logic calibrated altitude, then at this time it is considered that in text image information Include interest point information.
Then the interest point information in text image information is analyzed, judges that the interest point information is in text diagram As the position in information, to carry out subsequent step.
The embodiment of the present invention is selected from the multiple image continuously acquired by acquisition for mobile terminal to be believed with point of interest The image information of breath, and interest point information is therefrom got, be conducive to the progress of subsequent step.
On the basis of the above embodiments, it is described according to the central instant acquisition of information direction of visual lines information the step of, It specifically includes:
Mobile terminal is obtained in the acceleration transducer reading information of the central instant information, gravity direction information and magnetic Force snesor information;
Mobile terminal world coordinate system angle information is determined according to acceleration transducer reading information and gravity direction information;
Mobile terminal world coordinate system directional information is determined according to magnetometric sensor information;
View is determined according to the mobile terminal world coordinate system angle information and mobile terminal world coordinate system directional information Line directional information.
Specifically, acceleration transducer reading information described in the embodiment of the present invention, gravity direction information and magnetic force Sensor information is mobile terminal letter acquired at the time of interest point information appears in mobile terminal preview frame center Breath.
During mobile terminal live preview ambient enviroment, while utilizing the acceleration transducer and magnetic of mobile terminal Force snesor obtains 3 axis reading of the mobile terminal under local Coordinate System in real time.Due to when POI appears in picture center It carves, mobile terminal is close to stationary state, therefore combines gravity direction that can determine using acceleration transducer reading Two angles of the mobile terminal relative to world coordinate system can determine that mobile terminal is alive in conjunction with magnetometric sensor reading The direction of boundary's coordinate system, so that it is determined that projecting direction of the mobile terminal z-axis direction in world coordinate system, the projecting direction are out For direction of visual lines.
The embodiment of the present invention is by determining that point of interest is in the central instant information of mobile terminal preview frame center, then obtains The acceleration transducer reading information of mobile terminal, gravity direction information and magnetometric sensor letter when taking the central instant information Breath, so that direction of visual lines information is finally obtained, the direction of visual lines of the point of interest accurately identified to user.
On the basis of the above embodiments, the step of interest point information in the acquisition for mobile terminal ambient enviroment it Before, the method also includes:
It obtains and collects director information;
The multiple image in ambient enviroment is obtained according to the collection director information.
Collection director information described in the embodiment of the present invention may include that user terminal is guided to rotate to the left or to the right Rotation also may include that user terminal is guided to rotate or be rotated down upwards.
It according to director information, rotates to the left or rotates to the right, be also possible to rotate or be rotated down upwards to obtain week Multiple image in collarette border.
The embodiment of the present invention can help to collect ambient enviroment image information, to avoid omitting emerging by director information The acquisition of interest point information.
Fig. 3 is that the point of interest direction of visual lines identification device structure based on mobile terminal described in one embodiment of the invention is shown It is intended to, as shown in Figure 3, comprising: obtain module 310, analysis module 320 and identification module 330;Wherein, module 310 is obtained to be used for Obtain the interest point information in ambient enviroment;Wherein, analysis module 320 appears in movement eventually for obtaining the interest point information Hold the central instant information of preview frame center;Wherein, identification module 330 is used for according to central instant acquisition of information sight side To information.
Specifically, obtaining module 310 continuously acquires multiframe ambient enviroment picture information by its included camera, so Word Input is carried out to each frame image of acquisition afterwards and Text region operates, is text diagram by the image tagged with text As information, then specifically the text in text image information is being identified, it will be in the text of the text results of identification and POI When appearance similarity is sufficiently high, then the part of the text in picture content is labeled as interest point information.
Analysis module 320 analyzes the image information with interest point information, when interest point information appears precisely at When mobile terminal preview frame center, then the central instant information at this moment is obtained.
Identification module 330 is used for when point of interest appears in mobile terminal preview frame central instant, and identification module 330 obtains Acceleration transducer reading information, gravity direction information and the magnetometric sensor information of the moment mobile terminal;According to acceleration Sensor reading information and gravity direction information determine mobile terminal world coordinate system angle information;According to magnetometric sensor information Determine mobile terminal world coordinate system directional information;According to the mobile terminal world coordinate system angle information and mobile terminal generation Boundary's coordinate system directional information determines direction of visual lines information
On the basis of the above embodiments, the acquisition module is specifically used for:
Multiple image in acquisition for mobile terminal ambient enviroment;
Text region operation is carried out to the multiple image, obtains text image information;
It is analyzed and processed according to text image information described in editing distance standard, determines point of interest text image information;
Interest point information is obtained according to the point of interest text image information.
On the basis of the above embodiments, the identification module is specifically used for:
Mobile terminal is obtained in the acceleration transducer reading information of the central instant information, gravity direction information and magnetic Force snesor information;
Mobile terminal world coordinate system angle information is determined according to acceleration transducer reading information and gravity direction information;
Mobile terminal world coordinate system directional information is determined according to magnetometric sensor information;
View is determined according to the mobile terminal world coordinate system angle information and mobile terminal world coordinate system directional information Line directional information.
Device provided in an embodiment of the present invention is for executing above-mentioned each method embodiment, detailed process and detailed content Above-described embodiment is please referred to, details are not described herein again.
The embodiment of the present invention grabs the multiple image of ambient enviroment by mobile terminal, and passes through the technologies such as Text region It being identified to whether there is text in multiple image, the character image information with text is obtained, then according to character image Content recognition goes out interest point information, when the interest point information is in the preview frame center of mobile terminal, it is believed that this time shift The angle of dynamic terminal to point of interest is target angle, then passes through the acceleration transducer of mobile terminal, magnetometric sensor and again Force snesor determines when interest point information is in the preview frame center of mobile terminal, the sight of the point of interest to mobile terminal Direction.
Fig. 4 is the electronic devices structure schematic diagram of one embodiment of the invention description, as shown in figure 4, the electronic equipment can be with It include: processor (processor) 401,402, memory communication interface (Communications Interface) (memory) 403 and communication bus 404, wherein processor 401, communication interface 402, memory 403 pass through communication bus 404 Complete mutual communication.Processor 401 can call the logical order in memory 403, to execute following method: mobile whole End obtains the interest point information in ambient enviroment;Obtain the center that the interest point information appears in mobile terminal preview frame center Time information;According to the central instant acquisition of information direction of visual lines information.
In addition, the logical order in above-mentioned memory 403 can be realized by way of SFU software functional unit and conduct Independent product when selling or using, can store in a computer readable storage medium.Based on this understanding, originally Substantially the part of the part that contributes to existing technology or the technical solution can be in other words for the technical solution of invention The form of software product embodies, which is stored in a storage medium, including some instructions to So that a computer equipment (can be personal computer, server or the network equipment etc.) executes each implementation of the present invention The all or part of the steps of example the method.And storage medium above-mentioned include: USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), magnetic or disk etc. it is various It can store the medium of program code.
On the other hand, the embodiment of the present invention also provides a kind of non-transient computer readable storage medium, is stored thereon with meter Calculation machine program, the computer program be implemented to carry out when being executed by processor the various embodiments described above offer based on mobile terminal Point of interest direction of visual lines recognition methods, for example, the interest point information in acquisition for mobile terminal ambient enviroment;It obtains described emerging Interest point information appears in the central instant information of mobile terminal preview frame center;According to central instant acquisition of information sight side To information.
The apparatus embodiments described above are merely exemplary, wherein described, unit can as illustrated by the separation member It is physically separated with being or may not be, component shown as a unit may or may not be physics list Member, it can it is in one place, or may be distributed over multiple network units.It can be selected according to the actual needs In some or all of the modules achieve the purpose of the solution of this embodiment.Those of ordinary skill in the art are not paying creativeness Labour in the case where, it can understand and implement.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can It realizes by means of software and necessary general hardware platform, naturally it is also possible to pass through hardware.Based on this understanding, on Stating technical solution, substantially the part that contributes to existing technology can be embodied in the form of software products in other words, should Computer software product may be stored in a computer readable storage medium, such as ROM/RAM, magnetic disk, CD, including several fingers It enables and using so that a computer equipment (can be personal computer, server or the network equipment etc.) executes each implementation Method described in certain parts of example or embodiment.
Finally, it should be noted that the above embodiments are merely illustrative of the technical solutions of the present invention, rather than its limitations;Although Present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that: it still may be used To modify the technical solutions described in the foregoing embodiments or equivalent replacement of some of the technical features; And these are modified or replaceed, technical solution of various embodiments of the present invention that it does not separate the essence of the corresponding technical solution spirit and Range.

Claims (9)

1. a kind of point of interest direction of visual lines recognition methods based on mobile terminal, which is characterized in that the described method includes:
Interest point information in acquisition for mobile terminal ambient enviroment;
Obtain the central instant information that the interest point information appears in mobile terminal preview frame center;
According to the central instant acquisition of information direction of visual lines information.
2. the point of interest direction of visual lines recognition methods based on mobile terminal according to claim 1, which is characterized in that the shifting The interest point information that dynamic terminal obtains in ambient enviroment specifically includes:
Multiple image in acquisition for mobile terminal ambient enviroment;
Text region operation is carried out to the multiple image, obtains text image information;
It is analyzed and processed according to text image information described in editing distance standard, determines point of interest text image information;
Interest point information is obtained according to the point of interest text image information.
3. the point of interest direction of visual lines recognition methods based on mobile terminal according to claim 1, which is characterized in that described It the step of according to the central instant acquisition of information direction of visual lines information, specifically includes:
Mobile terminal is obtained to pass in the acceleration transducer reading information of the central instant information, gravity direction information and magnetic force Sensor information;
Mobile terminal world coordinate system angle information is determined according to acceleration transducer reading information and gravity direction information;
Mobile terminal world coordinate system directional information is determined according to magnetometric sensor information;
Sight side is determined according to the mobile terminal world coordinate system angle information and mobile terminal world coordinate system directional information To information.
4. the point of interest direction of visual lines recognition methods based on mobile terminal according to claim 1, which is characterized in that described Before the step of interest point information in acquisition for mobile terminal ambient enviroment, the method also includes:
It obtains and collects director information;
The multiple image in ambient enviroment is obtained according to the collection director information.
5. a kind of point of interest direction of visual lines identification device based on mobile terminal, which is characterized in that described device includes:
Module is obtained, for obtaining the interest point information in ambient enviroment;
Analysis module appears in the central instant information of mobile terminal preview frame center for obtaining the interest point information;
Identification module, for according to the central instant acquisition of information direction of visual lines information.
6. the point of interest direction of visual lines identification device based on mobile terminal according to claim 5, which is characterized in that described to obtain Modulus block is specifically used for:
Multiple image in acquisition for mobile terminal ambient enviroment;
Text region operation is carried out to the multiple image, obtains text image information;
It is analyzed and processed according to text image information described in editing distance standard, determines point of interest text image information;
Interest point information is obtained according to the point of interest text image information.
7. the point of interest direction of visual lines identification device based on mobile terminal according to claim 5, which is characterized in that the knowledge Other module is specifically used for:
Mobile terminal is obtained to pass in the acceleration transducer reading information of the central instant information, gravity direction information and magnetic force Sensor information;
Mobile terminal world coordinate system angle information is determined according to acceleration transducer reading information and gravity direction information;
Mobile terminal world coordinate system directional information is determined according to magnetometric sensor information;
Sight side is determined according to the mobile terminal world coordinate system angle information and mobile terminal world coordinate system directional information To information.
8. a kind of electronic equipment including memory, processor and stores the calculating that can be run on a memory and on a processor Machine program, which is characterized in that the processor is realized as described in any one of Claims 1-4 when executing described program based on shifting The step of point of interest direction of visual lines recognition methods of dynamic terminal.
9. a kind of non-transient computer readable storage medium, is stored thereon with computer program, which is characterized in that the computer journey The point of interest direction of visual lines identification as described in any one of Claims 1-4 based on mobile terminal is realized when sequence is executed by processor The step of method.
CN201910554426.4A 2019-06-25 2019-06-25 A kind of recognition methods of point of interest direction of visual lines and device based on mobile terminal Pending CN110287872A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910554426.4A CN110287872A (en) 2019-06-25 2019-06-25 A kind of recognition methods of point of interest direction of visual lines and device based on mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910554426.4A CN110287872A (en) 2019-06-25 2019-06-25 A kind of recognition methods of point of interest direction of visual lines and device based on mobile terminal

Publications (1)

Publication Number Publication Date
CN110287872A true CN110287872A (en) 2019-09-27

Family

ID=68005541

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910554426.4A Pending CN110287872A (en) 2019-06-25 2019-06-25 A kind of recognition methods of point of interest direction of visual lines and device based on mobile terminal

Country Status (1)

Country Link
CN (1) CN110287872A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112580631A (en) * 2020-12-24 2021-03-30 北京百度网讯科技有限公司 Indoor positioning method and device, electronic equipment and storage medium

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN201663612U (en) * 2010-03-05 2010-12-01 东莞市华业龙图信息技术有限公司 User interest modeling system based on location service
CN102483824A (en) * 2009-06-25 2012-05-30 微软公司 Portal services based on interactions with points of interest discovered via directional device information
US20140354688A1 (en) * 2013-05-31 2014-12-04 Korea Electronics Technology Institute Augmented reality information providing apparatus and method
CN104221056A (en) * 2010-02-05 2014-12-17 英特尔公司 Method for providing information on object within view of terminal device, terminal device for same and computer-readable recording medium
CN104615978A (en) * 2015-01-23 2015-05-13 清华大学 Sight direction tracking method and device
CN106575299A (en) * 2014-08-01 2017-04-19 索尼公司 Information processing device, information processing method, and program
CN106663338A (en) * 2014-08-01 2017-05-10 索尼公司 Information processing device, information processing method, and program

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102483824A (en) * 2009-06-25 2012-05-30 微软公司 Portal services based on interactions with points of interest discovered via directional device information
CN104221056A (en) * 2010-02-05 2014-12-17 英特尔公司 Method for providing information on object within view of terminal device, terminal device for same and computer-readable recording medium
CN201663612U (en) * 2010-03-05 2010-12-01 东莞市华业龙图信息技术有限公司 User interest modeling system based on location service
US20140354688A1 (en) * 2013-05-31 2014-12-04 Korea Electronics Technology Institute Augmented reality information providing apparatus and method
CN106575299A (en) * 2014-08-01 2017-04-19 索尼公司 Information processing device, information processing method, and program
CN106663338A (en) * 2014-08-01 2017-05-10 索尼公司 Information processing device, information processing method, and program
CN104615978A (en) * 2015-01-23 2015-05-13 清华大学 Sight direction tracking method and device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112580631A (en) * 2020-12-24 2021-03-30 北京百度网讯科技有限公司 Indoor positioning method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN106920279B (en) Three-dimensional map construction method and device
US9767363B2 (en) System and method for automatic detection of spherical video content
TWI443588B (en) Image recognition algorithm, method of identifying a target image using same, and method of selecting data for transmission to a portable electronic device
CN108304835A (en) character detecting method and device
CN111914812B (en) Image processing model training method, device, equipment and storage medium
US9275278B2 (en) Systems and methods for implementing and using off-center embedded media markers
CN108229418B (en) Human body key point detection method and apparatus, electronic device, storage medium, and program
CN107084740B (en) Navigation method and device
CN110807361A (en) Human body recognition method and device, computer equipment and storage medium
CN112749613B (en) Video data processing method, device, computer equipment and storage medium
Porzi et al. Learning contours for automatic annotations of mountains pictures on a smartphone
CN110570460A (en) Target tracking method and device, computer equipment and computer readable storage medium
CN110168615A (en) Information processing equipment, information processing method and program
CN113395542A (en) Video generation method and device based on artificial intelligence, computer equipment and medium
CN112232260A (en) Subtitle region identification method, device, equipment and storage medium
CN111738199A (en) Image information verification method, image information verification device, image information verification computing device and medium
CN109816628B (en) Face evaluation method and related product
CN114332648A (en) Position identification method and electronic equipment
CN109840885A (en) Image interfusion method and Related product
CN110287872A (en) A kind of recognition methods of point of interest direction of visual lines and device based on mobile terminal
CN111310595B (en) Method and device for generating information
CN113570510A (en) Image processing method, device, equipment and storage medium
CN115731370A (en) Large-scene element universe space superposition method and device
CN108235764B (en) Information processing method and device, cloud processing equipment and computer program product
CN109785439A (en) Human face sketch image generating method and Related product

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190927

RJ01 Rejection of invention patent application after publication