CN109389082A - Sight acquisition method, device, system, computer readable storage medium - Google Patents

Sight acquisition method, device, system, computer readable storage medium Download PDF

Info

Publication number
CN109389082A
CN109389082A CN201811166331.7A CN201811166331A CN109389082A CN 109389082 A CN109389082 A CN 109389082A CN 201811166331 A CN201811166331 A CN 201811166331A CN 109389082 A CN109389082 A CN 109389082A
Authority
CN
China
Prior art keywords
target photo
sight
coordinate
picture
line point
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811166331.7A
Other languages
Chinese (zh)
Other versions
CN109389082B (en
Inventor
陈曦
王塑
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Wuhu Maichi Zhixing Technology Co ltd
Original Assignee
Beijing Megvii Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Megvii Technology Co Ltd filed Critical Beijing Megvii Technology Co Ltd
Priority to CN201811166331.7A priority Critical patent/CN109389082B/en
Publication of CN109389082A publication Critical patent/CN109389082A/en
Application granted granted Critical
Publication of CN109389082B publication Critical patent/CN109389082B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation
    • G06V40/166Detection; Localisation; Normalisation using acquisition arrangements

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Position Input By Displaying (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

The present invention provides a kind of sight acquisition method, device, systems, computer storage medium, when getting replacement picture instruction by controller, based on the Target Photo that pre-saves generate data determine one include a sight line point current Target Photo, the display equipment is controlled simultaneously shows the current Target Photo, and the face picture of control image capture device collecting test person;Then the coordinate of face picture sight line point corresponding with current Target Photo that the image capture device acquires in display equipment is corresponded into caching and forms alternative pictorial information, when the subsequent sight line point for getting sensing apparatus transmission in controller acquires signal, a Target Photo information is determined from alternative pictorial information corresponding with image capture device, and the corresponding Target Photo information of the image capture device and device coordinate corresponding with the image capture device is saved to form sight acquisition data, improves the accuracy of sight data sample.

Description

Sight acquisition method, device, system, computer readable storage medium
Technical field
The present invention relates to Image Acquisition fields, in particular to a kind of sight acquisition method, device, system, computer Readable storage medium storing program for executing.
Background technique
Line-of-sight detection model needs a large amount of sight data sample as training basis, it is however generally that, sight data sample It is obtained by sight data acquisition technology.
Existing sight data acquisition technology is that gathered person is commanded by picker to observe the required sight acquired Point, then using the image of sight line point observed by sampling instrument shooting gathered person, while recording the sight line point of acquisition Label, label is generally relatively simple, such as watches a-quadrant attentively and do not watch a-quadrant attentively.
However, being directed to existing sight data acquisition technology, the commander of gathered person's height cooperation cammander is needed to infuse Depending on sight line point, once when picker is without supervision, when gathered person mismatches the commander of picker, picker's also more difficult hair Existing, the sight data sample error rate caused is higher.
Summary of the invention
In view of this, the embodiment of the present invention is designed to provide a kind of sight acquisition method, device, system, computer Readable storage medium storing program for executing, to improve the accuracy of sight data sample.
In a first aspect, the embodiment of the invention provides a kind of sight acquisition methods, applied to the control in sight acquisition system Device processed, the sight acquisition system further include display equipment, sensing apparatus, memory and the image coupled with the controller Acquire equipment, be previously stored in the memory the relatively described display equipment of described image acquisition equipment device coordinate and Target Photo generates data, which comprises when the controller gets replacement picture instruction, is based on the Target Photo It generates data and determines that includes a current Target Photo for a sight line point, and control the display equipment simultaneously and show one A includes the current goal picture an of sight line point, and the face picture of control described image acquisition equipment collecting test person; The controller exists the face picture sight line point corresponding with the current Target Photo of described image acquisition equipment acquisition Coordinate in the display equipment corresponds caching, forms alternative pictorial information;The controller is getting the induction When the sight line point that equipment is sent acquires signal, from least one alternative pictorial information corresponding with described image acquisition equipment really Make a Target Photo information, wherein the sight line point acquisition signal is that the sensing apparatus is detecting the tester The signal generated when clicking the sight line point;The controller will be acquired with described image the corresponding Target Photo information of equipment with And device coordinate is saved in the memory and forms sight acquisition data.
Second aspect, the embodiment of the invention provides a kind of sight acquisition devices, applied to the control in sight acquisition system Device processed, the sight acquisition system further include display equipment, sensing apparatus, memory and the image coupled with the controller Acquire equipment, be previously stored in the memory the relatively described display equipment of described image acquisition equipment device coordinate and Target Photo generates data, and described device includes: selection display module, cache module, determining module and preserving module.Selection Display module when for getting replacement picture instruction, generating data based on the Target Photo and determining that one includes one The current Target Photo of sight line point, and control the display equipment simultaneously and show the current Target Photo, and control The face picture of described image acquisition equipment collecting test person;Cache module, the people for acquiring described image acquisition equipment Coordinate of the face picture sight line point corresponding with the current Target Photo in the display equipment corresponds caching, is formed Alternative pictorial information;Determining module, for when getting the sight line point that the sensing apparatus is sent and acquiring signal, from it is described A Target Photo information is determined at least one corresponding alternative pictorial information of image capture device, wherein the sight Point acquisition signal is the signal that the sensing apparatus is generated when detecting that the tester clicks the sight line point;Save mould Block, for the corresponding Target Photo information of equipment will to be acquired with described image and device coordinate is saved in the memory and is formed Sight acquires data.
The third aspect, the embodiment of the invention provides a kind of sight acquisition systems, comprising: controller and the controller Display equipment, sensing apparatus, memory and the image capture device of coupling are previously stored with described image in the memory The device coordinate and Target Photo for acquiring the relatively described display equipment of equipment generate data, are also stored with meter in the memory Calculation machine program, when the computer program is executed by the controller, so that the sight acquisition system executes first aspect Any one of method described in embodiment.
Fourth aspect, the embodiment of the invention provides a kind of computer readable storage medium, the computer-readable storage Computer program is stored in medium, when the computer program is run on computers, so that the computer executes the Method described in any one of one side embodiment.
Compared with prior art, various embodiments of the present invention propose sight acquisition method, device, system, computer-readable Storage medium generates data based on the Target Photo pre-saved and determines when getting replacement picture instruction by controller One includes the current Target Photo of a sight line point, and controls the display equipment simultaneously and show the current target figure Piece, and the face picture of control described image acquisition equipment collecting test person;Then it is directed to each image capture device, it is described The face picture that controller acquires image capture device sight line point corresponding with current Target Photo is in display equipment Coordinate correspond caching, form alternative pictorial information, the subsequent sight line point for getting sensing apparatus transmission in controller is adopted When collecting signal, for each image capture device, from least one alternative pictorial information corresponding with the image capture device It determines a Target Photo information, Target Photo information corresponding with the image capture device and will be set with the Image Acquisition Standby corresponding device coordinate is saved in the memory and forms sight acquisition data.Due to when sight line point is clicked, acquisition It is the portrait before clicking moment, guarantees that the sight got acquisition data are correctly, so improving sight number as far as possible According to the accuracy of sample;In addition, avoiding the occurrence of cammander and test since overall process only needs a tester that can complete Person takes action, and perhaps tester does not submit onself to someone's direction the case where person commands situation or cammander is needed to supervise to inconsistent situation.
Other feature and advantage of the disclosure will illustrate in the following description, alternatively, Partial Feature and advantage can be with Deduce from specification or unambiguously determine, or by implement the disclosure above-mentioned technology it can be learnt that.
To enable the above objects, features and advantages of the present invention to be clearer and more comprehensible, preferred embodiment is cited below particularly, and cooperate Appended attached drawing, is described in detail below.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be to needed in the embodiment attached Figure is briefly described, it should be understood that the following drawings illustrates only certain embodiments of the present invention, therefore is not construed as pair The restriction of range for those of ordinary skill in the art without creative efforts, can also be according to this A little attached drawings obtain other relevant attached drawings.
Fig. 1 is the structural schematic diagram of sight acquisition system provided in an embodiment of the present invention;
Fig. 2 is the flow chart of sight acquisition method provided in an embodiment of the present invention;
Fig. 3 is the schematic diagram of the sight line point of sight acquisition method provided in an embodiment of the present invention;
Fig. 4 is the structural block diagram of sight acquisition device provided in an embodiment of the present invention.
Specific embodiment
Below in conjunction with attached drawing in the embodiment of the present invention, technical solution in the embodiment of the present invention carries out clear, complete Ground description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.Based on this The embodiment of invention, those skilled in the art's every other implementation obtained without making creative work Example, shall fall within the protection scope of the present invention.
One line-of-sight detection model of training needs a large amount of sight data sample as training basis.Existing sight data Acquisition technique is limited to the mutual cooperation of picker and gathered person between the two, needs to command by picker collected Person is come the sight line point that acquires required for observing, then using the image of sight line point observed by sampling instrument shooting gathered person, The label of the sight line point of acquisition is recorded simultaneously, and label is generally relatively simple, such as watches a-quadrant attentively and do not watch a-quadrant attentively.? In above scheme, once when picker is without supervision, when gathered person mismatches the commander of picker, picker's also more difficult hair Existing, the sight data sample error rate caused is higher.
In order to improve the above problem, the embodiment of the invention provides a kind of sight acquisition method, device, systems, computer Readable storage medium storing program for executing, the mode which can be used corresponding software, hardware and soft or hard combination are realized.Below to of the invention real Example is applied to describe in detail.
Firstly, the sight acquisition to describe the sight acquisition method for realizing the embodiment of the present invention, device is referring to Fig.1 System 100.
Sight acquisition system 100 may include controller 120, the memory 110 coupled with the controller 120, display Equipment 130, sensing apparatus 140, image capture device 150 and sight acquisition device, memory 110, controller 120, display Equipment 130, sensing apparatus 140, image capture device 150 and sight acquisition device these components can pass through bus system And/or bindiny mechanism's (not shown) interconnection of other forms.It should be noted that sight acquisition system 100 shown in FIG. 1 component and Structure be it is illustrative, and not restrictive, as needed, the sight acquisition system 100 also can have other assemblies And structure.Wherein, memory 110, display equipment 130, sensing apparatus 140, image capture device 150 can integrate in a mould In block, a module can also be separately configured to.
The sight acquisition device includes described at least one can be stored in the form of software or firmware (firmware) In memory 110 or the software function that is solidificated in the operating system (operating system, OS) of sight acquisition system 100 Module.The controller 120 is for executing the executable module stored in memory 110, such as the sight acquisition device packet The software function module or computer program included.
The memory 110 may include one or more computer program products, and the computer program product can be with Including various forms of computer readable storage mediums, such as volatile memory and/or nonvolatile memory.It is described volatile Property memory for example may include random access memory (RAM) and/or cache memory (cache) etc..It is described non-easy The property lost memory for example may include read-only memory (ROM), hard disk, flash memory etc..On the computer readable storage medium It can store one or more computer program instructions, controller 120 can run described program instruction, described below to realize The embodiment of the present invention in it is expected realize function.It can also be stored in the computer readable storage medium various using journey Sequence and various data, such as application program use and/or the various data generated etc..It certainly, can also be pre- in memory 110 The device coordinate and Target Photo for being first stored with the relatively described display equipment 130 of image capture device 150 generate data.
Controller 120 may be a kind of IC chip, the processing capacity with signal.Above-mentioned controller 120 can To be general processor, including central processing unit (Central Processing Unit, abbreviation CPU), network processing unit (Network Processor, abbreviation NP) etc.;Can also be digital signal processor (DSP), specific integrated circuit (ASIC), Field programmable gate array (FPGA) either other programmable logic device, discrete gate or transistor logic, discrete hard Part component.Controller 120 may be implemented or execute disclosed each method, step and logic diagram in the embodiment of the present invention.
Display equipment 130 provides an interactive interface (such as user's operation between sight acquisition system 100 and tester Interface) or for display image data give tester reference, in this example it is shown that equipment 130 can be with display function Plate, the mobile terminal etc. of energy.
Sensing apparatus 140 is a kind of input equipment, can be the capacitance type touch control screen for supporting single-point and multi-point touch operation Or resistance type touch control screen etc..Single-point and multi-point touch operation is supported to refer to that touching display screen can be sensed from the touching display screen The touch control operation that upper one or more positions generate simultaneously, and the touch control operation that this is sensed transfers to controller 120 to carry out It calculates and handles.Certainly, in a kind of optional embodiment, sensing apparatus 140 is also possible to mouse, for incuding user's point The position hit.
Image capture device 150 is used for the face picture of collecting test person, can be the equipment such as camera, camera.
It will be situated between below for the sight acquisition method carried out in the acquisition of sight data in order to reach optimization purpose It continues:
Referring to figure 2., Fig. 2 is a kind of flow chart of sight acquisition method provided in an embodiment of the present invention, the method from The angle of the controller 120 of sight acquisition system 100 is described.Wherein, pre- in the memory 110 of sight acquisition system 100 First it is stored with the device coordinate that Target Photo generates data and the opposite display equipment 130 of multiple images acquisition equipment 150.
Process shown in Fig. 2 will be described in detail below, which comprises
Step S110: when controller gets replacement picture instruction, data is generated based on the Target Photo and determine one It is a to include the current Target Photo an of sight line point, and control the display equipment simultaneously and show the current target figure Piece, and the face picture of control described image acquisition equipment collecting test person.
Due to sight acquire data what is desired is that tester pupil of human image data, the face picture It can be each image capture device 150 connecting with controller 120 face figure collected including tester's eye Piece.
As an alternative embodiment, it may include multiple pictures that the Target Photo, which generates data, it is each described It include a preset sight line point on picture, controller 120 can be when getting replacement picture instruction, from the multiple picture In determine a Target Photo as the current Target Photo.
Under this embodiment, optionally, the controller 120 can be when getting replacement picture instruction, from institute It states and a picture is randomly selected in multiple pictures is determined as the current Target Photo.
Under this embodiment, optionally, the multiple picture can be stored in described deposit sequentially in time in advance In reservoir 110, the controller 120 can be when getting replacement picture instruction, according to the holding time of the multiple picture Sequencing, a picture is successively selected from the multiple picture and is determined as the current Target Photo.Optionally, Multiple pictures can be stored in a queue in memory 110, since the reading rule of queue is first in, first out, because This, the picture being first stored in queue can first be read out by controller 120, and be determined as current Target Photo.
Controller 120 controls the display equipment 130 and shows the current mesh after current Target Photo has been determined It marks on a map piece.Wherein, it may include a sight line point in each Target Photo, and be stored with each Target Photo in memory 110 The coordinate of interior included sight line point.Equipment 130 is shown when showing the current Target Photo, the sight for being included by it Point is shown together.
The sight line point that Target Photo is included can be shown in a specific shape in Target Photo, such as Fig. 3 institute The cross shown is also possible to any other irregular shape.Certainly, the shape of the sight line point in each Target Photo can also With not identical, at this point, easy testee's discovery can be set as the background of Target Photo in order to enable sight line point is prominent Pure color is set as the color of sight line point and other biggish colors of the background color contrast of Target Photo.
As another optional embodiment, it may include: a picture, a view that the Target Photo, which generates data, Line point identification and multiple sight line point coordinates, wherein one picture is as background picture.Controller 120 can obtain To when replacement picture instruction, a line of sight point coordinate is determined from the multiple sight line point coordinate, then in Background The sight point identification is shown at line of sight point coordinate in piece, to obtain current Target Photo.
Under this embodiment, optionally, the multiple sight line point coordinate can be by being stored in the memory 110 Interior function is stored in memory 110 after generating, and is also possible to be sent by being stored in after the function outside memory 110 generates It is saved to the memory 110.Certainly, under this embodiment, it is raw to can be function between multiple sight line point coordinates At regular coordinate, such as { (1,1), (1,2), (1,3), (Isosorbide-5-Nitrae), (2,1), (2,2), (2,3), (2,4) } etc., this When, sight point identification shows from left to right on picture, variation sequence from top to bottom;It can also between multiple sight line point coordinates To be random coordinate that random function generates at random.
As another optional embodiment, it may include: a picture, a view that the Target Photo, which generates data, Line point identification and random number generation function, wherein one picture is as background picture.Controller 120 can obtain To when replacement picture instruction, controls the random number generation function and generate a line of sight point coordinate at random, then in background The sight point identification is shown at line of sight point coordinate in picture, to obtain current Target Photo.
Under this embodiment, optionally, in order to increase the diversity of line of sight point coordinate, the Target Photo is raw It further include multiple existing sight line point coordinates at data, for example, (1,1), (1,2), (1,3), (Isosorbide-5-Nitrae), (2,1), (2,2), (2, 3), (2,4) } etc..Controller 120 controls after the random number generation function generates a coordinate at random, which is added to On a coordinate in existing multiple sight line point coordinates, to generate a line of sight point coordinate, and in background picture Line of sight point coordinate at the display sight point identification, to obtain current Target Photo.It is worth noting that above-mentioned A coordinate in multiple sight line point coordinates can be and be randomly selected from above-mentioned multiple sight line point coordinates, is also possible to According to the preservation sequence of above-mentioned multiple sight line point coordinates, successively select.
Optionally, above-mentioned replacement picture instruction can be by the controller 120 every preset time (such as 2 seconds) from It is dynamic to generate, it is also possible to by the controller 120 generation when getting the sight line point that sensing apparatus 140 is sent and acquiring signal. Certainly, the instruction of replacement picture can also be generates in combination with both above-mentioned situation, for example, controller 120 is being more than described When the sight line point acquisition signal of the transmission of sensing apparatus 140 having not been obtained in preset time, replacement picture instruction is automatically generated.
The sight acquisition data obtained as required for the embodiment of the present invention are that display equipment 130 shows the current mesh Mark on a map piece when tester eye see into the current Target Photo pupil data of included sight line point, if when test Controller 120 just controls image capture device 150 when person sees to the current Target Photo A sight line point for being included and provides feedback The face picture of collecting test person, then the face picture is particularly likely that tester is presented to next time point seeing The face picture when sight line point that current Target Photo B is included reduces the accuracy of sight acquisition data.In order to avoid The above problem ensures the accuracy of sight acquisition data as far as possible, and controller 120 is while showing current Target Photo, also Need to control the face picture of 150 collecting test person of image capture device.
Step S120: the face picture and the current target figure that the controller acquires described image acquisition equipment Coordinate of the corresponding sight line point of piece in the display equipment corresponds caching, forms alternative pictorial information.
No matter current Target Photo is determined by which kind of above-mentioned mode, and controller 120 can obtain current mesh Coordinate of the corresponding sight line point of piece of marking on a map in display equipment 130.Certainly, it is worth noting that, display equipment 130 can be shown Show that a vertex at interface is defined as coordinate origin, so that it is determined that coordinate of the sight line point in display equipment.
Wherein, the quantity of image capture device 150 can be one, and image capture device 150 is collecting face picture It afterwards, can be by coordinate of the sight line point included by face picture and current Target Photo in the display equipment 130 one by one Corresponding caching, forms an alternative pictorial information.Over time, which can take multiple Face picture, each face picture correspond to different current goal pictures, eventually form multiple alternative pictorial informations and are stored in and deposit In reservoir 110.
Optionally, in order to accelerate the acquisition speed that sight acquires data, the quantity of image capture device 150 may be more A, the device coordinate of the opposite display equipment 130 of each image capture device 150 is different.
Under this embodiment, for the same current Target Photo, controller 120 is in control image capture device It, can be according to the difference of image capture device 150, to obtain multiple face pictures when the face picture of 150 collecting test persons. Similarly, when being subsequently formed alternative pictorial information, for coordinate of the same sight line point in the display equipment 130, control Device 120 can obtain alternatively scheming with the one-to-one multiple groups of image capture device 150 according to the difference of image capture device 150 Piece information.
By image capture device 150 collected face picture may be unsatisfactory for forming the requirement of sight data, because This optionally can also pre-save face orientation mode preset condition in the memory 110.Wherein, the face Orientation mode preset condition may is that in face picture corresponding with the image capture device 150, face is set with the display Standby 130 distance is within the scope of pre-determined distance;It is also possible in face picture corresponding with the image capture device 150, people The direction of face is within the scope of predetermined angle;It is also possible in face picture corresponding with the image capture device 150, human eye is not It is blocked;It can also be while meeting any two condition in above three condition or all three conditions.
When controller 120 is in the face picture and the current target figure for acquiring some image capture device 150 Coordinate of the corresponding sight line point of piece in the display equipment corresponds caching, is formed before alternative pictorial information, the control It is default that device 120 processed may determine that whether face picture corresponding with the image capture device 150 meets the face orientation mode Condition;When meeting, face picture and the current target figure that 120 ability of controller acquires the image capture device 150 Coordinate of the corresponding sight line point of piece in the display equipment 130 corresponds caching, forms alternative pictorial information.It is being unsatisfactory for When, controller 120 can redefine next current Target Photo, and acquire and survey again through image capture device 150 The face picture of examination person.
Certainly, optionally, controller 120 can also control institute before redefining next current Target Photo It states display equipment 130 and issues acquisition miscue, so that posture of the tester to oneself is adjusted.The acquisition miscue can To be to show according to the concrete condition of face orientation mode preset condition is unsatisfactory for for correcting the indicative of tester's posture Content, such as: " apart from too far, please be close to display equipment ".
Next current Target Photo will be redefined for controller 120 below to be introduced.
As an alternative embodiment, when controller 120 redefines next current Target Photo, it is described Next current Target Photo can be identical as a upper current Target Photo, i.e., controller 120 can directly be shown again Show that a current Target Photo is identical.
As another optional embodiment, when controller 120 redefines next current Target Photo, institute Stating next current Target Photo can be different from a upper current Target Photo.
Under this embodiment, if it includes multiple pictures that Target Photo, which generates data, controller 120 is from the multiple figure After excluding current Target Photo in piece, determine a picture as next current Target Photo.
Under this embodiment, if Target Photo generate data include a picture, a sight point identification and with Machine number generating function, next line of sight point coordinate that the available random number generation function of controller 120 generates, thus really A Target Photo is made as next current Target Photo.
Under this embodiment, if it includes a picture, a sight point identification and more that Target Photo, which generates data, A sight line point coordinate, controller 120 exclude the view of target corresponding to current Target Photo from the multiple sight line point coordinate After line point coordinate, a new line of sight point coordinate is determined, so that it is determined that a Target Photo is as described next out Current Target Photo.
Under this embodiment, if it includes a picture, sight point identification, a random number that Target Photo, which generates data, Generating function and multiple sight line point coordinates, controller 120 can be after random number generation function generate a random coordinates, will Random coordinates are added to the point coordinate of line of sight corresponding to current Target Photo, form a new line of sight point and sit Mark a, so that it is determined that Target Photo is as next current Target Photo out.
Step S130: the controller when getting the sight line point that the sensing apparatus is sent and acquiring signal, from institute It states at least one corresponding alternative pictorial information of image capture device and determines a Target Photo information.
Wherein, the sight line point acquisition signal can detect tester's finger for the sensing apparatus 140 Or stylus touches generated signal when sight line point, or generated when tester is by mouse click sight line point Signal.
When controller 120 gets sight line point acquisition signal, from least one acquired with described image acquisition equipment 150 A Target Photo information is determined in alternative pictorial information, may include:
The available sight line point of controller 120 acquires the generation time of signal, after then the generation time subtracting preset value Obtain comparison time.Preset value characterization test person sees the time interval of triggering sight line point acquisition signal after sight line point, generally It can be set to 300 milliseconds.Then, at least one alternative pictorial information that controller 120 is acquired from the image capture device 150 In select an alternative pictorial information as the Target Photo information, wherein the holding time of the Target Photo information It is closest with the comparison time.
Optionally, the controller 120 is detecting that the mouse moves or detect in the display equipment 130 When sliding on the sensing apparatus 140, the controller 120 can also acquire the mouse for the finger or the stylus The operating position coordinate of mark, the finger or the stylus in the display equipment 130, and using the coordinate as reference Coordinate is stored in the memory 110.
Certainly, it is worth noting that, if controller 120 detects finger or the stylus on sensing apparatus 140 Sliding, at this point, controller can also detect finger or the stylus in the stop of the same position of sensing apparatus 140 Between, if the residence time is less than the default residence time, operating position coordinate at this time is saved as reference coordinate, if stop Between be more than the default residence time, then finger or the stylus are long-pressing sensing apparatus 140, and what is triggered at this time is that sight line point is adopted Collect signal.
Under this embodiment, controller 120 is worked as in the face picture for acquiring the image capture device 150 with described Coordinate of the corresponding sight line point of preceding Target Photo in the display equipment 130 corresponds caching, forms alternative picture letter When breath, controller 120 can also by face picture that the image capture device 150 acquires, acquire the face picture when it is corresponding Reference coordinate and the corresponding sight line point of the current Target Photo it is described display equipment 130 in coordinate correspond Caching, forms alternative pictorial information.
It is worth noting that sliding shape may be not on due to the finger of stylus or mouse or gathered person State and cause when acquiring some face picture, be not present reference coordinate corresponding with the time point.At this point, controller 120 can With in the reference coordinate being saved, the time that will save reference coordinate is right closest to the time point institute for acquiring the face picture Reference coordinate of the reference coordinate answered as the face picture.Correspondingly, controller 120 is from right with the image capture device 150 When determining a Target Photo information in the alternative pictorial information of at least one answered, controller 120 can be from the Image Acquisition An alternative pictorial information is selected at least one alternative pictorial information that equipment 150 acquires to believe as the Target Photo Breath.Wherein, reference coordinate corresponding with the Target Photo information is with sight line point included by the Target Photo information in institute The distance between the coordinate stated in display equipment 150 is greater than preset value (i.e. reference coordinate is except sight line point coordinate range), and The holding time of the Target Photo information and the comparison time are closest, and it is mobile not yet can to find testee in this way But it will be moved into the picture of sight line point, such human eye state most concentrates on sight line point.
Since tester is clicking sight line point triggering generation sight line point acquisition signal with finger or stylus or mouse When, and the coordinate of point that is contacted of sensing apparatus 140 and the coordinate of the current corresponding sight line point of Target Photo have deviation, because This is optionally determining a Target Photo from least one alternative pictorial information corresponding with the image capture device Before information, the judgement of controller 120 triggers the coordinate and the current Target Photo pair of the sight line point acquisition signal Whether error of the sight line point answered between the coordinate in the display equipment is more than preset error threshold;When to be no, institute It states controller 120 and determines a target figure from least one alternative pictorial information corresponding with the image capture device 150 Piece information;When to be, the controller 120 redefines next current Target Photo.
Controller 120 herein redefines the case where next current Target Photo and describes in above step S120 Controller 120 the case where redefining next current Target Photo it is identical, in order to avoid repeating, details are not described herein again.
Step S140: the controller will Target Photo information corresponding with described image acquisition equipment and device coordinate It is saved in the memory and forms sight acquisition data.
Due to being previously stored with device coordinate of the image capture device 150 relative to display equipment 130 in memory 110, After Target Photo information has been determined, controller 120 is by the equipment of the corresponding image capture device 150 of Target Photo information Coordinate is saved in memory 110, is formed sight and is acquired data.
Wherein, seat of the sight acquisition data by device coordinate, face picture and sight line point in display equipment 130 Mark uniquely determines.
It is provided in an embodiment of the present invention it is a kind of applied to sight acquisition method, by controller get replacement picture refer to Enable, based on the Target Photo that pre-saves generate data determine one include a sight line point current Target Photo, and The display equipment is controlled simultaneously shows the current Target Photo, and the people of control image capture device collecting test person Face picture;Then the face picture sight line point corresponding with current Target Photo that the image capture device acquires is set in display Standby interior coordinate corresponds caching, forms alternative pictorial information, the subsequent sight that sensing apparatus transmission is got in controller When point acquisition signal, a Target Photo is determined from least one alternative pictorial information corresponding with the image capture device Target Photo information corresponding with the image capture device and device coordinate are saved in the memory and form sight by information Acquire data.Due to when sight line point is clicked, acquisition is portrait before clicking moment, guarantees the view got as far as possible Line acquisition data are correctly, so improving the accuracy of sight data sample;In addition, since overall process only needs a survey Examination person can complete, and avoid the occurrence of cammander and situation that tester takes action inconsistent or tester do not submit onself to someone's direction person The case where commanding situation, or cammander needed to supervise.
Corresponding to the sight acquisition method that Fig. 2 is provided, Fig. 4 is please referred to, the embodiment of the invention also provides a kind of sights to adopt Acquisition means 400, applied to the controller 120 in sight acquisition system 100, which may include: that selection is aobvious Show module 410, cache module 420, determining module 430 and preserving module 440.
Display module 410 is selected, when for getting replacement picture instruction, data being generated based on Target Photo and determine one It is a to include the current Target Photo an of sight line point, and control the display equipment simultaneously and show the current target figure Piece, and the portrait picture of control described image acquisition equipment collecting test person;
Cache module 420, face picture and the current Target Photo pair for acquiring the image capture device Coordinate of the sight line point answered in the display equipment corresponds caching, forms alternative pictorial information;
Determining module 430, for when getting the sight line point that the sensing apparatus is sent and acquiring signal, from the image A Target Photo information is determined at least one corresponding alternative pictorial information of acquisition equipment, wherein the sight line point is adopted Collection signal is the signal that the sensing apparatus is generated when detecting that the tester clicks the sight line point;
Preserving module 440, being used for will Target Photo information corresponding with the image capture device and device coordinate preservation Sight, which is formed, to the memory acquires data.
Optionally, it includes a picture, a sight point identification and multiple sight line points that the Target Photo, which generates data, Coordinate, the selection display module 410, when for getting replacement picture instruction, from the multiple sight line point coordinate Determine a line of sight point coordinate;The position of the line of sight point coordinate shows the sight line point mark on the picture Know, obtains the current Target Photo.
Optionally, the multiple sight line point coordinate is generated by saving function in the memory, or by being stored in Function outside the memory is sent to the memory after generating.
Optionally, it includes a picture, a sight point identification and generating random number that the Target Photo, which generates data, Function, the selection display module 410 control the random number generation function when for getting replacement picture instruction A line of sight point coordinate is generated at random;The position of the line of sight point coordinate shows the sight line point on the picture Mark, obtains the current Target Photo.
Optionally, it further includes multiple sight line point coordinates that the Target Photo, which generates data, the selection display module 410, A coordinate is generated at random for controlling the random number generation function;The coordinate is added to the multiple sight line point coordinate In a coordinate on, generate a line of sight point coordinate.
Optionally, it includes multiple pictures that the Target Photo, which generates data, includes one preset on each picture Sight line point, the selection display module 410 are determined from the multiple picture when for getting replacement picture instruction A Target Photo is as the current Target Photo out.
Optionally, the selection display module 410, when for getting replacement picture instruction, from the multiple mesh It marks on a map and a picture is randomly selected in piece is determined as the current Target Photo.
Optionally, the multiple Target Photo saves in the memory sequentially in time in advance, and the selection is aobvious Show module 410, for get the replacement picture instruction when, according to the multiple Target Photo holding time it is successive suitable Sequence successively selects a picture from the multiple Target Photo and is determined as the current Target Photo.
Optionally, replacement picture instruction every preset time automatically generate or by described device get it is described Sight line point generates when acquiring signal.
Optionally, face orientation mode preset condition has been pre-saved in the memory, described device further includes judgement Module and redefine module.The judgment module, for whether judging face picture corresponding with the image capture device Meet the face orientation mode preset condition.When the judgment result is yes, 420 ability of cache module sets the Image Acquisition Coordinate one of the face picture sight line point corresponding with the current Target Photo of standby acquisition in the display equipment is a pair of It should cache, form alternative pictorial information, it is otherwise, described to redefine module, for redefining next current target figure Piece.
Optionally, described to redefine module, it can be used for after the display equipment issues acquisition miscue again Redefine next current Target Photo.
Optionally, the face orientation mode preset condition can be with are as follows: in face figure corresponding with the image capture device In piece, face at a distance from the display equipment within the scope of pre-determined distance, and/or in people corresponding with the image capture device In face picture, the direction of face is not blocked within the scope of predetermined angle and/or at human eye.
The judgment module is also used to judge to trigger the coordinate and the current target figure of the sight line point acquisition signal Whether error of the corresponding sight line point of piece between the coordinate in the display equipment is more than preset error threshold.It is tied in judgement When fruit is no, the determining module 430 is determined from least one alternative pictorial information corresponding with the image capture device One Target Photo information;When the judgment result is yes, described to redefine module, for redefining next current mesh It marks on a map piece.
Optionally, next current Target Photo and a upper current Target Photo can be identical or not Together.
Optionally, the determining module 430, when obtaining the generation of the sight line point acquisition signal for the controller Between;The controller obtains comparison time after the generation time is subtracted preset value;The controller is set from the Image Acquisition An alternative pictorial information is selected at least one alternative pictorial information of standby acquisition as the Target Photo information, In, the holding time of the Target Photo information and the comparison time are closest.
Optionally, sight line point acquisition signal be finger or stylus touch signal caused by the sight line point or Person is that mouse clicks signal caused by the sight line point.
Optionally, the controller 120 is detecting that the mouse moves or detect in the display equipment 130 When sliding on the sensing apparatus 140, the controller 120 can also acquire the mouse for the finger or the stylus The operating position coordinate of mark, the finger or the stylus in the display equipment 130, and using the coordinate as reference Coordinate is stored in the memory 110.
Certainly, it is worth noting that, if controller 120 detects finger or the stylus on sensing apparatus 140 Sliding, stops at this point, controller 120 can also detect finger or the stylus in the same position of sensing apparatus 140 The time is stayed, if the residence time is less than the default residence time, saves coordinate at this time as reference coordinate, if the residence time is super The default residence time is spent, then finger or the stylus are long-pressing sensing apparatus 140, and what is triggered at this time is sight line point acquisition letter Number.
Under this embodiment, controller 120 is worked as in the face picture for acquiring the image capture device 150 with described Coordinate of the corresponding sight line point of preceding Target Photo in the display equipment 130 corresponds caching, forms alternative picture letter When breath, controller 120 can also by face picture that the image capture device 150 acquires, acquire the face picture when it is corresponding Reference coordinate and the corresponding sight line point of the current Target Photo it is described display equipment 130 in coordinate correspond Caching, forms alternative pictorial information.
Correspondingly, the determining module 430, is used for from least one alternative figure corresponding with the image capture device 150 When determining a Target Photo information in piece information, controller 120 can be from least the one of the image capture device 150 acquisition An alternative pictorial information is selected in a alternative pictorial information as the Target Photo information.Wherein, with the target figure Coordinate of the sight line point included by the corresponding reference coordinate of piece information and the Target Photo information in the display equipment 150 The distance between be greater than preset value (i.e. reference coordinate is except sight line point coordinate range), and the preservation of the Target Photo information Time and the comparison time are closest, can find testee in this way there are no movement but will be moved into the figure of sight line point Piece, such human eye state most concentrate on sight line point.
The technical effect of device provided by the present embodiment, realization principle and generation is identical with previous embodiment, for letter It describes, Installation practice part does not refer to place, can refer to Fig. 1-Fig. 3 corresponding contents in preceding method embodiment.
In addition, the embodiment of the invention also provides a kind of sight acquisition systems, comprising: controller and the controller coupling Display equipment, sensing apparatus, memory and the image capture device of conjunction are previously stored with described image in the memory and adopt The device coordinate and Target Photo for collecting the relatively described display equipment of equipment generate data, are also stored with calculating in the memory Machine program, when the computer program is executed by the controller, so that the sight acquisition system executes first embodiment Any one of method described in embodiment.Wherein, the structure of sight acquisition system can be as shown in Figure 1.
Specific implementation process about sight acquisition system please refers to previous embodiment, no longer excessively repeats herein.
In addition, the embodiment of the invention also provides a kind of computer readable storage medium, in the computer-readable storage medium Computer program is stored in matter, when the computer program is run on computers, so that the computer executes this hair Sight acquisition method provided by any one of bright embodiment.
In addition, the embodiment of the invention also provides a kind of computer program, the computer program can store beyond the clouds or On the storage medium of person local, when the computer program is run on computers, so that the computer executes the present invention Sight acquisition method provided by any one embodiment.
In conclusion sight acquisition method, device, system, computer readable storage medium that the embodiment of the present invention proposes, When getting replacement picture instruction by controller, data are generated based on the Target Photo pre-saved and determine that one includes one The current Target Photo of a sight line point, and control the display equipment simultaneously and show the current Target Photo, and control The face picture of described image acquisition equipment collecting test person processed;Then the people that the controller acquires the image capture device Coordinate of the face picture sight line point corresponding with current Target Photo in display equipment corresponds caching, forms alternative picture Information, when the subsequent sight line point for getting sensing apparatus transmission in controller acquires signal, from corresponding with the image capture device At least one alternative pictorial information in determine a Target Photo information, will target figure corresponding with the image capture device Piece information and device coordinate corresponding with the image capture device are saved in the memory and form sight acquisition data.Due to When sight line point is clicked, the portrait before clicking moment is obtained, guarantees that the sight got acquisition data are correct as far as possible , so improving the accuracy of sight data sample;In addition, since overall process only needs a tester that can complete, It avoids the occurrence of cammander and situation that tester takes action inconsistent or tester does not submit onself to someone's direction person and command situation, Huo Zhexu The case where wanting cammander to supervise.
In several embodiments provided herein, it should be understood that disclosed device and method can also pass through Other modes are realized.The apparatus embodiments described above are merely exemplary, for example, flow chart and block diagram in attached drawing Show the device of multiple embodiments according to the present invention, the architectural framework in the cards of method and computer program product, Function and operation.In this regard, each box in flowchart or block diagram can represent the one of a module, section or code Part, a part of the module, section or code, which includes that one or more is for implementing the specified logical function, to be held Row instruction.It should also be noted that function marked in the box can also be to be different from some implementations as replacement The sequence marked in attached drawing occurs.For example, two continuous boxes can actually be basically executed in parallel, they are sometimes It can execute in the opposite order, this depends on the function involved.It is also noted that every in block diagram and or flow chart The combination of box in a box and block diagram and or flow chart can use the dedicated base for executing defined function or movement It realizes, or can realize using a combination of dedicated hardware and computer instructions in the system of hardware.
In addition, each functional module in each embodiment of the present invention can integrate one independent portion of formation together Point, it is also possible to modules individualism, an independent part can also be integrated to form with two or more modules.
It, can be with if the function is realized and when sold or used as an independent product in the form of software function module It is stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially in other words The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a People's computer, server or network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention. And storage medium above-mentioned includes: that USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), arbitrary access are deposited The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic or disk.
It should be noted that, in this document, relational terms such as first and second and the like are used merely to a reality Body or operation are distinguished with another entity or operation, are deposited without necessarily requiring or implying between these entities or operation In any actual relationship or order or sequence.Moreover, the terms "include", "comprise" or its any other variant are intended to Non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those Element, but also including other elements that are not explicitly listed, or further include for this process, method, article or equipment Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that There is also other identical elements in process, method, article or equipment including the element.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain Lid is within protection scope of the present invention.Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims (15)

1. a kind of sight acquisition method, which is characterized in that applied to the controller in sight acquisition system, sight acquisition system System further includes display equipment, sensing apparatus, memory and the image capture device coupled with the controller, the memory The device coordinate and Target Photo for being inside previously stored with the relatively described display equipment of described image acquisition equipment generate data, institute The method of stating includes:
When getting replacement picture instruction, data are generated based on the Target Photo and determine that one includes working as a sight line point Preceding Target Photo, and control the display equipment simultaneously and show that the current Target Photo, and control described image are adopted Collect the face picture of equipment collecting test person;
By the face picture sight line point corresponding with the current Target Photo of described image acquisition equipment acquisition described aobvious Show that the coordinate in equipment corresponds caching, forms alternative pictorial information;
It is corresponding at least from equipment is acquired with described image when getting the sight line point acquisition signal that the sensing apparatus is sent A Target Photo information is determined in one alternative pictorial information, wherein the sight line point acquisition signal is that the induction is set The standby signal generated when detecting that the tester clicks the sight line point;
It will acquire the corresponding Target Photo information of equipment with described image and device coordinate is saved in the memory and is formed and regarded Line acquires data.
2. the method according to claim 1, wherein it includes picture, one that the Target Photo, which generates data, A sight point identification and multiple sight line point coordinates generate data based on the Target Photo when getting replacement picture instruction Determine the current Target Photo including a sight line point, comprising:
When getting replacement picture instruction, a line of sight point coordinate is determined from the multiple sight line point coordinate;
The position of the line of sight point coordinate shows the sight point identification on the picture, obtains the current target Picture.
3. according to the method described in claim 2, it is characterized in that, the multiple sight line point coordinate is by being stored in the memory Interior function generates, or is sent to the memory by being stored in after the function outside the memory generates.
4. the method according to claim 1, wherein it includes picture, one that the Target Photo, which generates data, A sight point identification and random number generation function generate data based on the Target Photo when getting replacement picture instruction Determine the current Target Photo including a sight line point, comprising:
When getting replacement picture instruction, controls the random number generation function and generate a line of sight point seat at random Mark;
The position of the line of sight point coordinate shows the sight point identification on the picture, obtains the current target Picture.
5. according to the method described in claim 4, it is characterized in that, it further includes multiple sight line points that the Target Photo, which generates data, Coordinate controls the random number generation function and generates a line of sight point coordinate at random, comprising:
It controls the random number generation function and generates a coordinate at random;
The coordinate is added on a coordinate in the multiple sight line point coordinate, a line of sight point coordinate is generated.
6. the method according to claim 1, wherein it includes multiple pictures that the Target Photo, which generates data, often Include a preset sight line point on a picture, when getting replacement picture instruction, number is generated based on the Target Photo According to determine one include a sight line point current Target Photo, comprising:
When getting replacement picture instruction, a picture is randomly selected from the multiple picture as described current Target Photo;Or
When getting replacement picture instruction, according to the sequencing of the holding time of the multiple picture, successively from described A picture is selected in multiple pictures as the current Target Photo, wherein the multiple picture is in advance according to the time Sequence saves in the memory.
7. -6 any method according to claim 1, which is characterized in that the replacement picture instruction is every by the controller It is automatically generated every preset time or by controller generation when getting the sight line point acquisition signal.
8. -6 any method according to claim 1, which is characterized in that pre-saved face orientation in the memory State preset condition, in the face picture sight corresponding with the current Target Photo for acquiring described image acquisition equipment Coordinate of the point in the display equipment corresponds caching, is formed before alternative pictorial information, the method also includes:
Whether judgement face picture corresponding with described image acquisition equipment meets the face orientation mode preset condition;
When to be, by the face picture sight line point corresponding with the current Target Photo of described image acquisition equipment acquisition Coordinate in the display equipment corresponds caching, forms alternative pictorial information;
When to be no, next current Target Photo is redefined.
9. -6 any method according to claim 1, which is characterized in that from it is corresponding with described image acquisition equipment to Before determining a Target Photo information in a few alternative pictorial information, the method also includes:
Judgement triggers the coordinate sight line point corresponding with the current Target Photo of the sight line point acquisition signal described aobvious Show whether the error between the coordinate in equipment is more than preset error threshold;
When to be no, a target figure is determined from least one alternative pictorial information corresponding with described image acquisition equipment Piece information;
When to be, next current Target Photo is redefined.
10. method according to claim 1-6, which is characterized in that described to acquire equipment pair from described image A Target Photo information is determined in the alternative pictorial information of at least one answered, comprising:
Obtain the generation time of the sight line point acquisition signal;
Comparison time is obtained after the generation time is subtracted preset value;
An alternative pictorial information conduct is selected from least one alternative pictorial information that described image acquisition equipment acquires The Target Photo information, wherein the holding time of the Target Photo information and the comparison time are closest.
11. according to the method described in claim 10, it is characterized in that, sight line point acquisition signal is finger or stylus It touches signal caused by the sight line point or clicks signal caused by the sight line point for mouse.
12. according to the method for claim 11, which is characterized in that the controller is detecting the mouse described aobvious Show move or detect in equipment the finger or the stylus when being slided on the sensing apparatus, the controller The mouse, the finger or the stylus are acquired in the operating position coordinate shown in equipment and is sat as reference Mark saves in the memory;The alternative pictorial information further includes corresponding reference coordinate when acquiring the face picture; Sight line point included by the corresponding reference coordinate of Target Photo information and the Target Photo information is in the display equipment The distance between interior coordinate is greater than preset value.
13. a kind of sight acquisition device, which is characterized in that applied to the controller in sight acquisition system, the sight acquisition System further includes display equipment, sensing apparatus, memory and the image capture device coupled with the controller, the storage The device coordinate and Target Photo that the relatively described display equipment of described image acquisition equipment is previously stored in device generate data, Described device includes:
Display module is selected, when for getting replacement picture instruction, data being generated based on the Target Photo and determine one Current Target Photo including a sight line point, and control the display equipment simultaneously and show the current Target Photo, And the face picture of control described image acquisition equipment collecting test person;
Cache module, the face picture view corresponding with the current Target Photo for acquiring described image acquisition equipment Coordinate of the line point in the display equipment corresponds caching, forms alternative pictorial information;
Determining module, for being acquired from described image when getting the sight line point acquisition signal that the sensing apparatus is sent A Target Photo information is determined at least one corresponding alternative pictorial information of equipment, wherein the sight line point acquisition letter Number signal generated when detecting that the tester clicks the sight line point for the sensing apparatus;
Preserving module, for will acquire the corresponding Target Photo information of equipment with described image and device coordinate be saved in it is described Memory forms sight and acquires data.
14. a kind of sight acquisition system, which is characterized in that the sight acquisition system includes: controller and the controller coupling Display equipment, sensing apparatus, memory and the image capture device of conjunction are previously stored with described image in the memory and adopt The device coordinate and Target Photo for collecting the relatively described display equipment of equipment generate data, are also stored with calculating in the memory Machine program, when the computer program is executed by the controller, so that the sight acquisition system perform claim requires 1- Method described in any one of 12.
15. a kind of computer readable storage medium, which is characterized in that be stored with computer in the computer readable storage medium Program, when the computer program is run on computers, so that the computer is executed as any in claim 1-12 Method described in one.
CN201811166331.7A 2018-09-30 2018-09-30 Sight line acquisition method, device, system and computer readable storage medium Active CN109389082B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811166331.7A CN109389082B (en) 2018-09-30 2018-09-30 Sight line acquisition method, device, system and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811166331.7A CN109389082B (en) 2018-09-30 2018-09-30 Sight line acquisition method, device, system and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN109389082A true CN109389082A (en) 2019-02-26
CN109389082B CN109389082B (en) 2021-05-04

Family

ID=65426586

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811166331.7A Active CN109389082B (en) 2018-09-30 2018-09-30 Sight line acquisition method, device, system and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN109389082B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112363626A (en) * 2020-11-25 2021-02-12 广州魅视电子科技有限公司 Large screen interaction control method based on human body posture and gesture posture visual recognition
CN112633165A (en) * 2020-12-23 2021-04-09 远光软件股份有限公司 Vehicle compartment-based sampling supervision method and system, storage medium and electronic equipment
CN114706484A (en) * 2022-04-18 2022-07-05 Oppo广东移动通信有限公司 Sight line coordinate determination method and device, computer readable medium and electronic equipment

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040222301A1 (en) * 2003-05-05 2004-11-11 Willins Bruce A. Arrangement for and method of collecting and displaying information in real time along a line of sight
CN1623498A (en) * 2004-12-14 2005-06-08 江苏科技大学 Vision detecting device based on computer media technology and its detecting method
CN101419672A (en) * 2008-12-03 2009-04-29 中国科学院计算技术研究所 Device and method for synchronistically acquiring human face image and gazing angle
CN202615668U (en) * 2012-03-07 2012-12-19 安徽工程大学 Teaching demonstration device
CN103870058A (en) * 2012-12-17 2014-06-18 Lg伊诺特有限公司 Method of designing random pattern, apparatus for designing random pattern, and optical substrate including random pattern according to the same method
CN104966070A (en) * 2015-06-30 2015-10-07 北京汉王智远科技有限公司 Face recognition based living body detection method and apparatus
CN108171152A (en) * 2017-12-26 2018-06-15 深圳大学 Deep learning human eye sight estimation method, equipment, system and readable storage medium storing program for executing
CN108200340A (en) * 2018-01-12 2018-06-22 深圳奥比中光科技有限公司 The camera arrangement and photographic method of eye sight line can be detected
CN108427503A (en) * 2018-03-26 2018-08-21 京东方科技集团股份有限公司 Human eye method for tracing and human eye follow-up mechanism
CN108447159A (en) * 2018-03-28 2018-08-24 百度在线网络技术(北京)有限公司 Man face image acquiring method, apparatus and access management system
CN108519824A (en) * 2018-04-13 2018-09-11 京东方科技集团股份有限公司 A kind of virtual reality display device, equipment and sight angle computational methods

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040222301A1 (en) * 2003-05-05 2004-11-11 Willins Bruce A. Arrangement for and method of collecting and displaying information in real time along a line of sight
CN1623498A (en) * 2004-12-14 2005-06-08 江苏科技大学 Vision detecting device based on computer media technology and its detecting method
CN101419672A (en) * 2008-12-03 2009-04-29 中国科学院计算技术研究所 Device and method for synchronistically acquiring human face image and gazing angle
CN202615668U (en) * 2012-03-07 2012-12-19 安徽工程大学 Teaching demonstration device
CN103870058A (en) * 2012-12-17 2014-06-18 Lg伊诺特有限公司 Method of designing random pattern, apparatus for designing random pattern, and optical substrate including random pattern according to the same method
CN104966070A (en) * 2015-06-30 2015-10-07 北京汉王智远科技有限公司 Face recognition based living body detection method and apparatus
CN108171152A (en) * 2017-12-26 2018-06-15 深圳大学 Deep learning human eye sight estimation method, equipment, system and readable storage medium storing program for executing
CN108200340A (en) * 2018-01-12 2018-06-22 深圳奥比中光科技有限公司 The camera arrangement and photographic method of eye sight line can be detected
CN108427503A (en) * 2018-03-26 2018-08-21 京东方科技集团股份有限公司 Human eye method for tracing and human eye follow-up mechanism
CN108447159A (en) * 2018-03-28 2018-08-24 百度在线网络技术(北京)有限公司 Man face image acquiring method, apparatus and access management system
CN108519824A (en) * 2018-04-13 2018-09-11 京东方科技集团股份有限公司 A kind of virtual reality display device, equipment and sight angle computational methods

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
JESSE SOSTRIN: "Determine Your Line of Sight", 《THE MANAGER’S DILEMMA》 *
千承辉等: "运动物体的头戴式视线追踪控制系统设计", 《MICROCONTROLLERS & EMBEDDED SYSTEMS》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112363626A (en) * 2020-11-25 2021-02-12 广州魅视电子科技有限公司 Large screen interaction control method based on human body posture and gesture posture visual recognition
CN112633165A (en) * 2020-12-23 2021-04-09 远光软件股份有限公司 Vehicle compartment-based sampling supervision method and system, storage medium and electronic equipment
CN114706484A (en) * 2022-04-18 2022-07-05 Oppo广东移动通信有限公司 Sight line coordinate determination method and device, computer readable medium and electronic equipment

Also Published As

Publication number Publication date
CN109389082B (en) 2021-05-04

Similar Documents

Publication Publication Date Title
RU2019116179A (en) SYSTEM FOR MEASURING CLINICAL PARAMETERS OF VISION FUNCTIONS
CN105165004B (en) Camera chain
CN109389082A (en) Sight acquisition method, device, system, computer readable storage medium
CN110245623A (en) A kind of real time human movement posture correcting method and system
KR101930652B1 (en) Gait analysis system and computer program recorded on recording medium
CN105608467A (en) Kinect-based non-contact type student physical fitness evaluation method
CN106484098B (en) The real time interactive operation system and method for user interface
CN109117893A (en) A kind of action identification method and device based on human body attitude
KR20150117553A (en) Method, apparatus and computer readable recording medium for eye gaze tracking
CN104364733A (en) Position-of-interest detection device, position-of-interest detection method, and position-of-interest detection program
CN104914988A (en) Gesture recognition apparatus and control method of gesture recognition apparatus
CN110083202A (en) With the multi-module interactive of near-eye display
JP6604271B2 (en) Gaze position detection device, gaze position detection method, and computer program for gaze position detection
US20160125758A1 (en) Assessing cognitive function using a multi-touch device
US20120281918A1 (en) Method for dynamically setting environmental boundary in image and method for instantly determining human activity
CN103914130A (en) Display device and method for adjusting observation distance of display device
CN105760809A (en) Method and apparatus for head pose estimation
US10877647B2 (en) Estimations within displays
CN110020628A (en) Sitting posture detecting method, system, equipment and storage medium based on face detection
WO2015079054A1 (en) Estimating gaze from un-calibrated eye measurement points
CN107256375A (en) Human body sitting posture monitoring method before a kind of computer
TW200919336A (en) Method for positioning a non-structural object in a series of continuing images
JP2014182628A (en) Space importance determination device, space importance determination method and program
CN109344757B (en) Data acquisition method and device and electronic equipment
CN108495584A (en) For determining oculomotor device and method by tactile interface

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20230331

Address after: 1201, China Vision Valley Building, 88 Ruixiang Road, Guandou Street, Jiujiang District, Wuhu City, Anhui Province, 241005

Patentee after: Wuhu Maichi Zhixing Technology Co.,Ltd.

Address before: 313, block a, No.2, south academy of Sciences Road, Haidian District, Beijing

Patentee before: BEIJING KUANGSHI TECHNOLOGY Co.,Ltd.