CN109344757A - Collecting method, device and electronic equipment - Google Patents

Collecting method, device and electronic equipment Download PDF

Info

Publication number
CN109344757A
CN109344757A CN201811116049.8A CN201811116049A CN109344757A CN 109344757 A CN109344757 A CN 109344757A CN 201811116049 A CN201811116049 A CN 201811116049A CN 109344757 A CN109344757 A CN 109344757A
Authority
CN
China
Prior art keywords
watched attentively
image
attentively
facial image
acquisition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201811116049.8A
Other languages
Chinese (zh)
Other versions
CN109344757B (en
Inventor
王塑
陈曦
刘毅博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Megvii Technology Co Ltd
Original Assignee
Beijing Megvii Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Megvii Technology Co Ltd filed Critical Beijing Megvii Technology Co Ltd
Priority to CN201811116049.8A priority Critical patent/CN109344757B/en
Publication of CN109344757A publication Critical patent/CN109344757A/en
Application granted granted Critical
Publication of CN109344757B publication Critical patent/CN109344757B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/20Scenes; Scene-specific elements in augmented reality scenes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/50Context or environment of the image
    • G06V20/52Surveillance or monitoring of activities, e.g. for recognising suspicious objects
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161Detection; Localisation; Normalisation

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the present invention provides a kind of collecting method, this method comprises: obtaining the location information of position to be watched attentively;The prompt for highlighting the position to be watched attentively is executed according to the positional information;In response to the image acquisition instruction of input, the gathered person for acquiring designated position watches the facial image of the position to be watched attentively attentively;And the location information of the facial image and the position to be watched attentively is associated storage, form acquisition data.

Description

Collecting method, device and electronic equipment
Technical field
The present invention relates to field of computer technology, set in particular to a kind of collecting method, device and electronics It is standby.
Background technique
With the development of computer technology, every field all uses computer disposal to improve treatment effeciency.Certainly, it improves It also can more technical problems to be treated while efficiency.Therefore, all types of problems is handled for convenience, proposes nerve Network model can identify all types of data by neural network model.But neural network model is gone back before it is being used It needs to obtain by the training of a large amount of data.
Summary of the invention
In view of this, the embodiment of the present invention is designed to provide a kind of collecting method, device and electronic equipment.
In a first aspect, a kind of collecting method provided in an embodiment of the present invention, comprising:
Obtain the location information of position to be watched attentively;
The prompt for highlighting the position to be watched attentively is executed according to the positional information;
In response to the image acquisition instruction of input, the gathered person for acquiring designated position watches the people of the position to be watched attentively attentively Face image;And
The location information of the facial image and the position to be watched attentively is associated storage, forms acquisition data.
Optionally, the location information for obtaining position to be watched attentively, comprising:
According to the location information of setting Rule position to be watched attentively from the dot matrix image prestored.
Optionally, from the dot matrix image prestored according to setting Rule position to be watched attentively location information the step of Later, further includes:
Show the dot matrix image;
The step of prompt executed according to the positional information for highlighting the position to be watched attentively, comprising:
Suggestion content of the display about the position to be watched attentively in the dot matrix image of display.
Optionally, the step that the suggestion content about the position to be watched attentively is shown in the dot matrix image of display Suddenly, comprising:
Setting identification is shown in the dot matrix image, and the setting identification is gradually moved to the position pair to be watched attentively The position answered, the setting identification on the move form suggestion content;Or,
The corresponding position in the position to be watched attentively described in the dot matrix image uses the display mode for being different from other positions It has been shown that, to form suggestion content.
Optionally, described image acquisition instruction is moved to described when watching the corresponding position in position attentively in the setting identification It generates.
Optionally, the step of prompt executed according to the positional information for highlighting the position to be watched attentively, packet It includes:
It generates according to the positional information corresponding for controlling the external mechanical pointing tool direction position to be watched attentively It is corresponding to control the external mechanical pointing tool direction position to be watched attentively according to the hint instructions for the hint instructions of position Position.
Optionally, described image acquisition instruction points to production when watching the corresponding position in position attentively in mechanical pointing tool It is raw.
Optionally, include multiple display intervals in the dot matrix image, include sight line point in each display interval, described The step of executing the prompt for highlighting the position to be watched attentively according to the location information, comprising:
The prompt for prompting the corresponding sight line point in the position to be watched attentively is executed according to the positional information.
Optionally, the step of the gathered person for acquiring designated position watches the facial image of the position to be watched attentively attentively it Before, the method also includes:
The qualifications of display acquisition data, the qualifications include that the face wearing of gathered person requires, this is adopted The position of collection person.
Optionally, the gathered person of the acquisition designated position watches the facial image of the position to be watched attentively attentively, comprising: adopts Collect the gathered person of designated position in multiple facial images for generating the described image acquisition instruction timing node corresponding period;
The location information of the facial image and the position to be watched attentively is being associated storage, formed acquire data it Before, the method also includes: a determining facial image is as target facial image from multiple described facial images;
The location information by the facial image and the position to be watched attentively is associated storage, forms acquisition number According to, comprising: the location information of the target facial image and the position to be watched attentively is associated storage, forms acquisition number According to.
It is optionally, described to determine a facial image as target facial image from multiple described facial images, comprising:
Setting time before choosing described image acquisition instruction timing node is worth the face that corresponding timing node obtains Image is as target facial image.
Second aspect, the embodiment of the present invention also provide a kind of data acquisition device, comprising:
Module is obtained, for obtaining the location information of position to be watched attentively;
Cue module, for executing the prompt for highlighting the position to be watched attentively according to the positional information;
Acquisition module, for the image acquisition instruction in response to input, acquire designated position gathered person watch attentively it is described The facial image of position to be watched attentively;And
Memory module, for the location information of the facial image and the position to be watched attentively to be associated storage, shape At acquisition data.
The third aspect, the embodiment of the present invention also provide a kind of electronic equipment, comprising: memory and processor, it is described to deposit Reservoir for storing computer program, the processor is used to that the computer program to be read and run from the memory, To execute the above method.
Fourth aspect, the embodiment of the present invention also provide a kind of computer readable storage medium, the computer-readable storage Computer program is stored on medium, the computer program executes above-mentioned method when being run by processor the step of.
Compared with prior art, the collecting method of the embodiment of the present invention, according to the location information pair of position to be watched attentively It should give and prompt, further on the basis of prompt, then obtain the facial image of gathered person, collect through the above way Facial image can with need blinkpunkt accurate, so as to improve the accuracy of acquisition data.
To enable the above objects, features and advantages of the present invention to be clearer and more comprehensible, special embodiment below, and appended by cooperation Attached drawing is described in detail below.
Detailed description of the invention
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be to needed in the embodiment attached Figure is briefly described, it should be understood that the following drawings illustrates only certain embodiments of the present invention, therefore is not construed as pair The restriction of range for those of ordinary skill in the art without creative efforts, can also be according to this A little attached drawings obtain other relevant attached drawings.
Fig. 1 is the block diagram of electronic equipment provided in an embodiment of the present invention.
Fig. 2 is the flow chart of collecting method provided in an embodiment of the present invention.
Fig. 3 is the schematic diagram of the dot matrix image in an example provided in an embodiment of the present invention.
Fig. 4 is the schematic diagram of the display interface in an example provided in an embodiment of the present invention.
Fig. 5 is the functional block diagram of data acquisition device provided in an embodiment of the present invention.
Specific embodiment
Below in conjunction with attached drawing in the embodiment of the present invention, technical solution in the embodiment of the present invention carries out clear, complete Ground description, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.Usually exist The component of the embodiment of the present invention described and illustrated in attached drawing can be arranged and be designed with a variety of different configurations herein.Cause This, is not intended to limit claimed invention to the detailed description of the embodiment of the present invention provided in the accompanying drawings below Range, but it is merely representative of selected embodiment of the invention.Based on the embodiment of the present invention, those skilled in the art are not doing Every other embodiment obtained under the premise of creative work out, shall fall within the protection scope of the present invention.
It should also be noted that similar label and letter indicate similar terms in following attached drawing, therefore, once a certain Xiang Yi It is defined in a attached drawing, does not then need that it is further defined and explained in subsequent attached drawing.Meanwhile of the invention In description, term " first ", " second " etc. are only used for distinguishing description, are not understood to indicate or imply relative importance.
With the development of technology, many technical fields can be identified by the state to eyes of user now, still The identification of eye state may require that and train line-of-sight detection model first.Further, it would be desirable to which sight data acquire.Hair Bright people has studied a kind of sight data acquisition technology used and mainly commands acquisition required for gathered person's observation by picker Sight line point, shoot gathered person's image using sampling instrument, while recording the sight line point label of acquisition.
But it may existing major defect by above-mentioned acquisition mode:
In such a way that picker commands gathered person, the cooperation of gathered person's height is needed to watch sight line point attentively, picker compared with Whether hardly possible discovery gathered person watches sight line point attentively, leads to error rate height;
Transplanting difficulty is big, and above-mentioned acquisition mode needs picker to have the training of long period, has more rich acquisition to pass through Quality could be obtained by, which testing, preferably acquires image, depends on picker's experience, it is difficult to which extension increases acquisition scale;
Acquisition data label does not refine, and the adjustment of later period demand is difficult.
Based on above-mentioned research, inventor has carried out further Depth Study and has gone out efficiently can effectively acquire face figure Picture is specifically described in detail by following embodiment.
Embodiment one
Firstly, describing the exemplary electronic device of the collecting method for realizing the embodiment of the present invention referring to Fig.1 100.The exemplary electronic device 100 can be computer, be also possible to the mobile terminals such as smart phone, tablet computer.
As shown in Figure 1, electronic equipment 100 include one or more processors 102, it is one or more storage device 104, defeated Enter device 106, output device 108 and image collecting device 110, these components pass through bus system 112 and/or other forms Bindiny mechanism's (not shown) interconnection.It should be noted that the component and structure of electronic equipment 100 shown in FIG. 1 are only exemplary, And not restrictive, as needed, the electronic equipment also can have other assemblies and structure.
The processor 102 can be central processing unit (CPU), graphics processing unit (GPU) or have at data The processing unit of reason ability and/or the other forms of instruction execution capability, and can control its in the electronic equipment 100 Its component is to execute desired function.
The storage device 104 may include one or more computer program products, and the computer program product can To include various forms of computer readable storage mediums, such as volatile memory and/or nonvolatile memory.It is described easy The property lost memory for example may include random access memory (RAM) and/or cache memory (cache) etc..It is described non- Volatile memory for example may include read-only memory (ROM), hard disk, flash memory etc..In the computer readable storage medium On can store one or more computer program instructions, processor 102 can run described program instruction, to realize hereafter institute The client functionality (realized by processor) in the embodiment of the present invention stated and/or other desired functions.In the meter Can also store various application programs and various data in calculation machine readable storage medium storing program for executing, for example, the application program use and/or The various data etc. generated.
The input unit 106 can be the device that user is used to input instruction, and may include keyboard, mouse, wheat One or more of gram wind and touch screen etc..
The output device 108 can export various information (for example, image or sound) to external (for example, user), and It and may include one or more of display, loudspeaker etc..
Described image acquisition device 110 can shoot the desired image of user (such as photo, video etc.), and will be clapped The image taken the photograph is stored in the storage device 104 for the use of other components.
Illustratively, for realizing collecting method according to an embodiment of the present invention, the exemplary electron of apparatus and system Each device in system can integrate setting, such as can also be filled processor 102, storage device 104, input with scattering device Set 106 and output device 108 it is integrally disposed in one, and it is image collecting device 110 is separately positioned.
Above-mentioned electronic equipment 100 can execute each step in following collecting methods.Stream is just combined below Control method is described in detail in journey figure.
Embodiment two
Referring to Fig. 2, being the flow chart of collecting method provided in an embodiment of the present invention.It below will be to shown in Fig. 2 Detailed process is described in detail.
Step S201 obtains the location information of position to be watched attentively.
Position to be watched attentively in the present embodiment can be picture of the storage in the electronic device for watching attentively for gathered person In a location point.Wherein, should the corresponding location information in position be watched attentively can be expressed as, when showing the figure according to setting format When piece, it is somebody's turn to do the coordinate information of position to be watched attentively.It is appreciated that when the position of electronic equipment is fixed, on electronic equipment The coordinate of each point also just uniquely determines.Setting format can be maximization display, full screen display, according to the display of electronic equipment The modes such as the length-width ratio matching display of device.
As shown in figure 3, above-mentioned is used to can be dot matrix image for the picture that gathered person watches attentively.In an example, Dot matrix image may include multiple display areas, and ten rows 12 are shown in figure and arrange a display interval, line number respectively includes A extremely J column, columns respectively include the 1st column to the 12nd column.Certainly, dot matrix image also may include more or fewer line numbers and column Number, the embodiment of the present application are not limited with the line number of dot matrix image or columns.
Further, as shown in figure 3, including sight line point in each display area.
Therefore, if being based on foregoing description, step S201 may include: from the dot matrix image prestored according to setting rule Obtain the location information of position to be watched attentively.
Wherein, above-mentioned setting rule can be random acquisition, be also possible to obtain one by one according to sequence laterally or longitudinally It takes.
Further, from the dot matrix image prestored according to setting Rule position to be watched attentively location information step After rapid, further includes: show corresponding dot matrix image.
In other embodiments, above-mentioned for can be for the picture that gathered person watches attentively including multiple marker graphics Picture.Marker graphic can be animal figure, graphical diagram, Chinese character figure etc..Step S201 may include: from prestoring for for quilt According to the location information of setting Rule position to be watched attentively in the picture that picker watches attentively.
Position to be watched attentively in the present embodiment is also possible to be placed on the location point in the solid images of setting position, In, the location point when solid images are placed on setting position should can be expressed as wait watch the corresponding location information in position attentively Coordinate information.It is appreciated that after the placement location of solid images determines, the coordinate of each location point in solid images Also it just uniquely determines.
When can be previously stored with solid images and being placed on setting position, the coordinate of each mark in solid images.
Step S202 executes the prompt for highlighting the position to be watched attentively according to the positional information.
Step S202 may include: to be executed according to the positional information for prompting the corresponding sight in the position to be watched attentively The prompt of point.
For example, position to be watched attentively is display interval A2, then the prompt shown in the display interface can be to display interval In A2 point prompt.
It, can also for prompting the prompt of the position to be watched attentively to can be some graphical cues being displayed in the display interface To be the tangible prompt of some machinery provided by external other equipment, carried out below by several embodiments detailed Description.
In the first embodiment, the step S202 may include: to show pass in the dot matrix image of display Suggestion content in the position to be watched attentively.
Further, the suggestion content in the dot matrix image of display can be static prompt, be also possible to move The prompt of state.
It is described can be with the step of suggestion content of the display about the position to be watched attentively in the dot matrix image of display It include: setting identification to be shown in the dot matrix image, and the setting identification is gradually moved to the position to be watched attentively and is corresponded to Position, the setting identification on the move forms suggestion content.
In an example, setting identification can be the mark of the shapes such as arrow, diamond shape, finger type.For example, in prompt Before, setting identification is shown in the edge of display interface, postpones when obtaining to fixation position, and setting identification is moved from the edge of display interface It moves to position to be watched attentively.Further, setting identification can be directed toward the sight line point in corresponding display interval.
It is described can be with the step of suggestion content of the display about the position to be watched attentively in the dot matrix image of display It include: that the corresponding position in the position to be watched attentively described in the dot matrix image is aobvious using the display mode for being different from other positions Show, to form suggestion content.
The display mode for being different from other positions, which shows can be, is highlighted the corresponding position in position to be watched attentively;It can be with It is that inclination, overstriking, distortion show position to be watched attentively.
It is prompted by above-mentioned mode, can preferably guide gathered person to watch position to be watched attentively attentively according to prompt, Improve the accuracy of last collected facial image.Further, by using dot matrix image, the picture of acquisition can be made to have The label of sight line point facilitates content or direction of gaze angle of acquisition of later period adjustment acquisition etc..
In the second embodiment, step S202 may include: generate according to the positional information it is external for controlling Mechanical pointing tool is directed toward the hint instructions of the corresponding position in the position to be watched attentively, is controlled according to the hint instructions external Mechanical pointing tool is directed toward the corresponding position in the position to be watched attentively.
For example, the electronic equipment for executing the method in the present embodiment is connect with a mechanical indication instrument communications, when needs are held Row is described when watching the prompt of position attentively for prompting, and first can generate hint instructions according to the location information of position to be watched attentively, Hint instructions can be the coordinate including position to be watched attentively.When mechanical pointing tool receives hint instructions, can be moved to Watch attentively at the coordinate of position.
Specifically, mechanical pointing tool can be robot.Further, robot may include mechanical finger, machine After people receives hint instructions, it can be pointed to mobile manipulator at the coordinate of position to be watched attentively.Further, robot can be with Including holding Pointing stick, after robot receives hint instructions, Pointing stick can be moved at the coordinate of position to be watched attentively.
It is directed toward position to be watched attentively by using tangible mechanical physical objects, during indication, gathered person's sight is more It is absorbed in position to be watched attentively well, improves the state that gathered person collects sight concentration.
Further, in order to enable gathered person or picker to be best understood from, acquisition is related to limit content, the application Embodiment can further show definitions relevant condition, to make data acquisition that can preferably carry out.The number of the present embodiment According to acquisition method further include: the qualifications of display acquisition data, the qualifications include that the face wearing of gathered person is wanted It asks, the position of the gathered person.
In an example, qualifications, which can be, to wear glasses, distance acquires equipment 20cm etc..In an example In, qualifications, which can be, wears glasses, apart from acquisition equipment 20cm etc..
As shown in figure 4, the display interface in diagram includes three parts, wherein first part is for showing current acquisition Scheme to first;Second part is for showing qualifications;Part III is for showing dot matrix image.
It include the progress bar of the current acquisition progress of display in first part, the both ends of the progress bar show button respectively "-" and button "+", wherein button "-" can be used for checking collected previous facial image, and button "+" is for touching Hair obtains the position to be watched attentively that next acquisition image needs to watch attentively.In an example, after button "-" is selected, Part III It can show previous facial image.Below progress bar further include which figure display currently collects, and needs to acquire The quantity of image.Example shown in figure is currently to collect second, and chief engineer needs to acquire 120.
Second part can be the modes such as Chinese character, English, Arabic numerals and show qualifications.In example shown in figure It shows that qualifications include: " 20cm ", indicates that gathered person needs 20 centimetres of equipment of distance acquisition;" NO_glass ", table Showing cannot wear glasses.Further, the position to be watched attentively for currently needing to acquire can also be shown in second part, " A2 " is indicated The position A2 for needing gathered person to see in Part III.Further, by showing that qualifications, position to be watched attentively can also be square Just the second people can understand the position to be watched attentively for currently needing to watch attentively, so that the prompt of gathered person's correlation can be also given, thus Improve the accuracy of acquisition data.
Part III shows the dot matrix image in an example.
Step S203, in response to the image acquisition instruction of input, acquire designated position gathered person watch attentively it is described wait infuse Depending on the facial image of position.
In the present embodiment, when for prompting the prompt of the position to be watched attentively to be shown in some figures in display interface Prompt, described image acquisition instruction can form in graphical cues and effectively prompt generation when watching position attentively.For example, for mentioning The prompt for showing the position to be watched attentively is setting identification to be shown in the dot matrix image, and the setting identification is gradually moved to The corresponding position in the position to be watched attentively, when the setting identification on the move forms the mode of suggestion content, described image is obtained Instruction fetch can be moved to generation when watching the corresponding position in position attentively in the setting identification.
In the present embodiment, provided when for prompting the prompt of the position to be watched attentively can be by external other equipment Some machinery tangible prompt, it is corresponding that described image acquisition instruction in mechanical pointing tool points to the position to be watched attentively It is generated when position.
The location information of the facial image and the position to be watched attentively is associated storage by step S204, and formation is adopted Collect data.
For example, it is desired to which the position watched attentively is the position A2 shown in Fig. 4, collect after watching the facial image of A2 attentively, by the people The coordinate associated storage of face image and the position A2 is stored in A2 it is further possible to which the label of A2 is arranged for the facial image In corresponding image library.
In the present embodiment, step S201 includes: to acquire the gathered person of designated position in generation described image acquisition instruction Multiple facial images of timing node corresponding period.
Specifically, multiple facial images that above-mentioned image acquisition instruction generates a period of time before and after the moment can be acquired.
Further, before being associated storage, collecting method further include: from multiple described facial images really A fixed facial image is as target facial image.
In one embodiment, described to determine a facial image as target face figure from multiple described facial images Picture, comprising: the first setting time before choosing described image acquisition instruction timing node is worth what corresponding timing node obtained Facial image is as target facial image.
Wherein, the first setting time value can be several hundred milliseconds.
For example, image acquisition instruction was generated at the first moment, then chooses the several hundred milliseconds of moment before the first moment and adopt The facial image collected is as target facial image.
Since the expression in the eyes focus point of gathered person may be moved with the movement of indication signal, believe mobile Number positioning first few hundred millisecond when, the focus point of the expression in the eyes of gathered person is preferably gathered in position to be watched attentively, therefore, choose first Several hundred milliseconds of moment collected facial images are as target facial image, the expression in the eyes of available gathered person before moment Most it is gathered in position to be watched attentively.
In another embodiment, described to determine a facial image as target face from multiple described facial images Image, comprising: choose the corresponding timing node acquisition of the second setting time value after described image acquisition instruction timing node Facial image as target facial image.
Wherein, the second setting time value is also possible to several hundred milliseconds.
For example, image acquisition instruction was generated at the second moment, then several hundred milliseconds of moment acquisitions after the second moment are chosen The facial image arrived is as target facial image.
If it is static standby signal, then expression in the eyes focus point president standby signal can just be concerned about prompt position after generating It sets, therefore, in several hundred milliseconds after static standby signal generates, the focus point of the expression in the eyes of gathered person is preferably gathered in Position to be watched attentively, therefore, several hundred milliseconds of moment collected facial images are as target face figure behind the second moment of selection Picture, the expression in the eyes of available gathered person are most gathered in position to be watched attentively.
The step S204 includes: to be associated the target facial image and the location information of the position to be watched attentively Storage forms acquisition data.
It can make to acquire data validity by determining that a target facial image is associated storage from multiple images It is higher.
Embodiment three
Conceived based on same application, additionally provides control device corresponding with control method in the embodiment of the present application, due to The principle that device in the embodiment of the present application solves the problems, such as is similar to the above-mentioned control method of the embodiment of the present application, therefore the reality of device The implementation for the method for may refer to is applied, overlaps will not be repeated.
Referring to Fig. 5, being the functional block diagram of data acquisition device provided in an embodiment of the present invention.The data are adopted Acquisition means include: to obtain module 301, cue module 302, acquisition module 303 and memory module 304;Wherein:
Module 301 is obtained, for obtaining the location information of position to be watched attentively;
Cue module 302, for executing the prompt for highlighting the position to be watched attentively according to the positional information;
Acquisition module 303, for the image acquisition instruction in response to input, the gathered person for acquiring designated position watches institute attentively State the facial image of position to be watched attentively;And
Memory module 304, for the location information of the facial image and the position to be watched attentively to be associated storage, Form acquisition data.
In a kind of possible embodiment, the acquisition module 301 is also used to:
According to the location information of setting Rule position to be watched attentively from the dot matrix image prestored.
In a kind of possible embodiment, data acquisition device further include:
Display module, for showing the dot matrix image;
The cue module 302, is also used to: display is about the position to be watched attentively in the dot matrix image of display Suggestion content.
In a kind of possible embodiment, the cue module 302 is also used to:
Setting identification is shown in the dot matrix image, and the setting identification is gradually moved to the position pair to be watched attentively The position answered, the setting identification on the move form suggestion content;Or,
The corresponding position in the position to be watched attentively described in the dot matrix image uses the display mode for being different from other positions It has been shown that, to form suggestion content.
In a kind of possible embodiment, described image acquisition instruction is moved to described to fixation position in the setting identification Generation when setting corresponding position.
In a kind of possible embodiment, the cue module 302 is also used to:
It generates according to the positional information corresponding for controlling the external mechanical pointing tool direction position to be watched attentively It is corresponding to control the external mechanical pointing tool direction position to be watched attentively according to the hint instructions for the hint instructions of position Position.
In a kind of possible embodiment, described image acquisition instruction points to the position to be watched attentively in mechanical pointing tool It is generated when corresponding position.
In a kind of possible embodiment, includes multiple display intervals in the dot matrix image, wrapped in each display interval Sight line point is included, the cue module 302 is also used to:
The prompt for prompting the corresponding sight line point in the position to be watched attentively is executed according to the positional information.
In a kind of possible embodiment, the display module of data acquisition device is also used to:
The qualifications of display acquisition data, the qualifications include that the face wearing of gathered person requires, this is adopted The position of collection person.
In a kind of possible embodiment, acquisition module 303, the gathered person for being also used to acquire designated position is generating institute State multiple facial images of image acquisition instruction timing node corresponding period;
The data acquisition device further include: determining module, for determining a face from multiple described facial images Image is as target facial image;
The memory module 304, is also used to: by the location information of the target facial image and the position to be watched attentively into Row associated storage forms acquisition data.
In a kind of possible embodiment, the determining module is also used to:
Setting time before choosing described image acquisition instruction timing node is worth the face that corresponding timing node obtains Image is as target facial image.
In addition, the embodiment of the present application also provides a kind of computer readable storage medium, on the computer readable storage medium It is stored with computer program, control method described in above method embodiment is executed when which is run by processor The step of.
The computer program product of control method provided by the embodiment of the present application, the calculating including storing program code Machine readable storage medium storing program for executing, the instruction that said program code includes can be used for executing control method described in above method embodiment The step of, for details, reference can be made to above method embodiments, and details are not described herein.
In several embodiments provided herein, it should be understood that disclosed device and method can also pass through Other modes are realized.The apparatus embodiments described above are merely exemplary, for example, flow chart and block diagram in attached drawing Show the device of multiple embodiments according to the present invention, the architectural framework in the cards of method and computer program product, Function and operation.In this regard, each box in flowchart or block diagram can represent the one of a module, section or code Part, a part of the module, section or code, which includes that one or more is for implementing the specified logical function, to be held Row instruction.It should also be noted that function marked in the box can also be to be different from some implementations as replacement The sequence marked in attached drawing occurs.For example, two continuous boxes can actually be basically executed in parallel, they are sometimes It can execute in the opposite order, this depends on the function involved.It is also noted that every in block diagram and or flow chart The combination of box in a box and block diagram and or flow chart can use the dedicated base for executing defined function or movement It realizes, or can realize using a combination of dedicated hardware and computer instructions in the system of hardware.
In addition, each functional module in each embodiment of the present invention can integrate one independent portion of formation together Point, it is also possible to modules individualism, an independent part can also be integrated to form with two or more modules.
It, can be with if the function is realized and when sold or used as an independent product in the form of software function module It is stored in a computer readable storage medium.Based on this understanding, technical solution of the present invention is substantially in other words The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a People's computer, server or network equipment etc.) it performs all or part of the steps of the method described in the various embodiments of the present invention. And storage medium above-mentioned includes: that USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), arbitrary access are deposited The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic or disk.It needs Illustrate, herein, relational terms such as first and second and the like be used merely to by an entity or operation with Another entity or operation distinguish, and without necessarily requiring or implying between these entities or operation, there are any this realities The relationship or sequence on border.Moreover, the terms "include", "comprise" or its any other variant are intended to the packet of nonexcludability Contain, so that the process, method, article or equipment for including a series of elements not only includes those elements, but also including Other elements that are not explicitly listed, or further include for elements inherent to such a process, method, article, or device. In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that including the element Process, method, article or equipment in there is also other identical elements.
The foregoing is only a preferred embodiment of the present invention, is not intended to restrict the invention, for the skill of this field For art personnel, the invention may be variously modified and varied.All within the spirits and principles of the present invention, made any to repair Change, equivalent replacement, improvement etc., should all be included in the protection scope of the present invention.It should also be noted that similar label and letter exist Similar terms are indicated in following attached drawing, therefore, once being defined in a certain Xiang Yi attached drawing, are then not required in subsequent attached drawing It is further defined and explained.
The above description is merely a specific embodiment, but scope of protection of the present invention is not limited thereto, any Those familiar with the art in the technical scope disclosed by the present invention, can easily think of the change or the replacement, and should all contain Lid is within protection scope of the present invention.Therefore, protection scope of the present invention should be subject to the protection scope in claims.

Claims (14)

1. a kind of collecting method characterized by comprising
Obtain the location information of position to be watched attentively;
The prompt for highlighting the position to be watched attentively is executed according to the positional information;
In response to the image acquisition instruction of input, the gathered person for acquiring designated position watches the face figure of the position to be watched attentively attentively Picture;And
The location information of the facial image and the position to be watched attentively is associated storage, forms acquisition data.
2. collecting method as described in claim 1, which is characterized in that the location information for obtaining position to be watched attentively, Include:
According to the location information of setting Rule position to be watched attentively from the dot matrix image prestored.
3. collecting method as claimed in claim 2, which is characterized in that advised from the dot matrix image prestored according to setting After the step of then obtaining the location information of position to be watched attentively, further includes:
Show the dot matrix image;
The step of prompt executed according to the positional information for highlighting the position to be watched attentively, comprising:
Suggestion content of the display about the position to be watched attentively in the dot matrix image of display.
4. collecting method as claimed in claim 3, which is characterized in that described to be shown in the dot matrix image of display The step of suggestion content about the position to be watched attentively, comprising:
Show setting identification in the dot matrix image, and it is corresponding that the setting identification is gradually moved to the position to be watched attentively Position, the setting identification on the move form suggestion content;Or,
The corresponding position in the position to be watched attentively described in the dot matrix image shown using the display mode for being different from other positions, To form suggestion content.
5. collecting method as claimed in claim 4, which is characterized in that described image acquisition instruction is in the setting identification It is moved to generation when watching the corresponding position in position attentively.
6. collecting method as described in claim 1, which is characterized in that described to be executed according to the positional information for dashing forward The step of prompt of the aobvious position to be watched attentively, comprising:
It generates according to the positional information and is directed toward the corresponding position in the position to be watched attentively for controlling external mechanical pointing tool Hint instructions, control external mechanical pointing tool according to the hint instructions and be directed toward the corresponding position in the position to be watched attentively It sets.
7. collecting method as claimed in claim 6, which is characterized in that described image acquisition instruction is in mechanical pointing tool Point to generation when watching the corresponding position in position attentively.
8. the collecting method as shown in claim 1-7 any one, which is characterized in that include more in the dot matrix image A display interval includes sight line point in each display interval, it is described execute according to the positional information it is described wait infuse for highlighting Depending on position prompt the step of, comprising:
The prompt for prompting the corresponding sight line point in the position to be watched attentively is executed according to the positional information.
9. collecting method as described in claim 1, which is characterized in that the gathered person in acquisition designated position watches institute attentively Before the step of stating the facial image of position to be watched attentively, the method also includes:
The qualifications of display acquisition data, the qualifications include the face wearing requirement of gathered person, the gathered person Position.
10. collecting method as described in claim 1, which is characterized in that gathered person's note of the acquisition designated position Depending on the facial image of the position to be watched attentively, comprising: the gathered person for acquiring designated position is generating described image acquisition instruction Multiple facial images of timing node corresponding period;
The location information of the facial image and the position to be watched attentively is being associated storage, is being formed before acquisition data, The method also includes: a determining facial image is as target facial image from multiple described facial images;
The location information by the facial image and the position to be watched attentively is associated storage, forms acquisition data, packet It includes: the location information of the target facial image and the position to be watched attentively is associated storage, form acquisition data.
11. collecting method as claimed in claim 10, which is characterized in that described to be determined from multiple described facial images One facial image is as target facial image, comprising:
Setting time before choosing described image acquisition instruction timing node is worth the facial image that corresponding timing node obtains As target facial image.
12. a kind of data acquisition device characterized by comprising
Module is obtained, for obtaining the location information of position to be watched attentively;
Cue module, for executing the prompt for highlighting the position to be watched attentively according to the positional information;
Acquisition module, for the image acquisition instruction in response to input, acquire designated position gathered person watch attentively it is described wait infuse Depending on the facial image of position;And
Memory module, for the location information of the facial image and the position to be watched attentively to be associated storage, formation is adopted Collect data.
13. a kind of electronic equipment characterized by comprising memory and processor, the memory is for storing computer Program, the processor require 1~10 for the computer program to be read and run from the memory, with perform claim Any one the method.
14. a kind of computer readable storage medium, computer program, feature are stored on the computer readable storage medium It is, the computer program executes method described in any one of above-mentioned claim 1~11 when being run by processor Step.
CN201811116049.8A 2018-09-25 2018-09-25 Data acquisition method and device and electronic equipment Active CN109344757B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811116049.8A CN109344757B (en) 2018-09-25 2018-09-25 Data acquisition method and device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811116049.8A CN109344757B (en) 2018-09-25 2018-09-25 Data acquisition method and device and electronic equipment

Publications (2)

Publication Number Publication Date
CN109344757A true CN109344757A (en) 2019-02-15
CN109344757B CN109344757B (en) 2021-05-28

Family

ID=65306696

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811116049.8A Active CN109344757B (en) 2018-09-25 2018-09-25 Data acquisition method and device and electronic equipment

Country Status (1)

Country Link
CN (1) CN109344757B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113900518A (en) * 2021-09-30 2022-01-07 Oppo广东移动通信有限公司 Human eye gazing data acquisition method and device, storage medium and electronic equipment

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101419672A (en) * 2008-12-03 2009-04-29 中国科学院计算技术研究所 Device and method for synchronistically acquiring human face image and gazing angle
JP2014071693A (en) * 2012-09-28 2014-04-21 Fujifilm Corp Graph display control device and method, and program
CN104881227A (en) * 2015-05-04 2015-09-02 联想(北京)有限公司 Display method and electronic equipment
CN107223246A (en) * 2017-03-20 2017-09-29 深圳前海达闼云端智能科技有限公司 Image labeling method, device and electronic equipment
CN107390863A (en) * 2017-06-16 2017-11-24 北京七鑫易维信息技术有限公司 Control method and device, electronic equipment, the storage medium of equipment
CN108551587A (en) * 2018-04-23 2018-09-18 刘国华 Method, apparatus, computer equipment and the medium of television set automatic data collection

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101419672A (en) * 2008-12-03 2009-04-29 中国科学院计算技术研究所 Device and method for synchronistically acquiring human face image and gazing angle
JP2014071693A (en) * 2012-09-28 2014-04-21 Fujifilm Corp Graph display control device and method, and program
CN104881227A (en) * 2015-05-04 2015-09-02 联想(北京)有限公司 Display method and electronic equipment
CN107223246A (en) * 2017-03-20 2017-09-29 深圳前海达闼云端智能科技有限公司 Image labeling method, device and electronic equipment
CN107390863A (en) * 2017-06-16 2017-11-24 北京七鑫易维信息技术有限公司 Control method and device, electronic equipment, the storage medium of equipment
CN108551587A (en) * 2018-04-23 2018-09-18 刘国华 Method, apparatus, computer equipment and the medium of television set automatic data collection

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
于明轩: "眼动跟踪系统关键技术研究与实现", 《中国优秀硕士学位论文全文数据库》 *
罗兴贤: "基于视频图像处理的视线方向跟踪研究", 《中国优秀硕士学位论文全文数据库》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113900518A (en) * 2021-09-30 2022-01-07 Oppo广东移动通信有限公司 Human eye gazing data acquisition method and device, storage medium and electronic equipment

Also Published As

Publication number Publication date
CN109344757B (en) 2021-05-28

Similar Documents

Publication Publication Date Title
US11663784B2 (en) Content creation in augmented reality environment
US9916008B2 (en) Microfluidics three-dimensional touch screen display
CN102915112A (en) System and method for close-range movement tracking
CN109343700B (en) Eye movement control calibration data acquisition method and device
TW201207717A (en) Image processing device, image processing method and program
CN109584374A (en) The method, apparatus and computer readable storage medium of interactive navigation auxiliary are provided for using removable leader label
CN103154858A (en) Operation input apparatus, operation input method, and program
CN102792255A (en) Image processing device, image processing method and program
CN108027656B (en) Input device, input method, and program
CN111047947A (en) Writing guider based on AR technology and writing guiding method
CN109375765A (en) Eyeball tracking exchange method and device
CN106462379A (en) Voice-controllable image display device and voice control method for image display device
CN107179839A (en) Information output method, device and equipment for terminal
CN106155308A (en) A kind of based on the eye-tracking method and system recalled and mark
Stearns et al. The design and preliminary evaluation of a finger-mounted camera and feedback system to enable reading of printed text for the blind
US20220366717A1 (en) Sensor-based Bare Hand Data Labeling Method and System
CN110199324A (en) Display device and its control method
Cheng et al. Smooth gaze: a framework for recovering tasks across devices using eye tracking
Aranyanak et al. A system for tracking braille readers using a Wii Remote and a refreshable braille display
Lin et al. The effects of augmented reality interaction techniques on egocentric distance estimation accuracy
CN109344757A (en) Collecting method, device and electronic equipment
JP2016045724A (en) Electronic apparatus
CN107229330A (en) A kind of character input method and device based on Steady State Visual Evoked Potential
CN107272880A (en) A kind of cursor positioning, cursor control method and device
CN113986032B (en) Method and device for adjusting writing track deviation of intelligent handwriting pen

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant