CN106293031B - Information processing method, information processing unit and user equipment - Google Patents

Information processing method, information processing unit and user equipment Download PDF

Info

Publication number
CN106293031B
CN106293031B CN201510303129.4A CN201510303129A CN106293031B CN 106293031 B CN106293031 B CN 106293031B CN 201510303129 A CN201510303129 A CN 201510303129A CN 106293031 B CN106293031 B CN 106293031B
Authority
CN
China
Prior art keywords
blinkpunkt
visual lines
setting
sight
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201510303129.4A
Other languages
Chinese (zh)
Other versions
CN106293031A (en
Inventor
杜琳
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Zhigu Ruituo Technology Services Co Ltd
Original Assignee
Beijing Zhigu Ruituo Technology Services Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Zhigu Ruituo Technology Services Co Ltd filed Critical Beijing Zhigu Ruituo Technology Services Co Ltd
Priority to CN201510303129.4A priority Critical patent/CN106293031B/en
Priority to US15/170,140 priority patent/US10268265B2/en
Publication of CN106293031A publication Critical patent/CN106293031A/en
Application granted granted Critical
Publication of CN106293031B publication Critical patent/CN106293031B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the present application discloses a kind of information processing method, information processing unit and user equipment, which comprises obtains sight information of at least user in a space;There is at least one setting direction of visual lines in response to determining according to the sight information, generates an operational order;Wherein, one first blinkpunkt and one second blinkpunkt with front and back distribution on each setting direction of visual lines in at least one setting direction of visual lines, and two starting points of first blinkpunkt and corresponding two sights of second blinkpunkt are before first blinkpunkt.The technical solution of the embodiment of the present application easily detects that there are transparent object or mirror surface objects in a space, are conducive to user or equipment using the object detection result and carry out subsequent operation according to the sight information of user.

Description

Information processing method, information processing unit and user equipment
Technical field
This application involves a kind of information processing technology more particularly to a kind of information processing methods, information processing unit and use Family equipment.
Background technique
Transparent object present in one space or mirror surface object can bring difficulty to the automatic detection of the object in the space, make The use for obtaining some smart machines will appear problem.For example, in some possible scenes, it is some to be based on optical object detection Equipment possibly can not detect the presence of the transparent object or mirror surface object, it is thus regarded that in the transparent object or mirror surface pair As the position at place does not have the presence of object, wherein for mirror surface object, it is also possible to will be considered that object in mirror surface object Picture be a physical presence object.In this way, when the result detected based on these body detection devices carries out subsequent operation, meeting Go wrong, for example, instruct user or equipment ignore the transparent object or mirror surface object reach the position after transparent object or The position of picture in mirror surface object.
Summary of the invention
The possible purpose of the embodiment of the present application is: providing a kind of information processing scheme.
In a first aspect, the possible embodiment of the application provides a kind of information processing method, comprising:
Obtain sight information of at least user in a space;
There is at least one setting direction of visual lines in response to determining according to the sight information, generates an operational order;
Wherein, one first be distributed on each setting direction of visual lines in at least one setting direction of visual lines with front and back Blinkpunkt and one second blinkpunkt, and the two of first blinkpunkt and corresponding two sights of second blinkpunkt A starting point is before first blinkpunkt.
With reference to first aspect, described in response to being determined according to the sight information in second of possible embodiment In the presence of at least one setting direction of visual lines, generating an operational order includes:
There is at least one setting direction of visual lines in response to determining according to the sight information, determines that described at least one sets Determine that there is at least one setting object on direction of visual lines;
It generates and sets the object accordingly operational order with described at least one;
Wherein, at least one setting object includes: an at least transparent object and/or an at least mirror surface object.
Any of the above-described kind of possible embodiment with reference to first aspect, it is described in the third possible embodiment Determining has described at least one to set object on an at least direction of visual lines includes:
Determine that the position of corresponding at least one first blinkpunkt of at least one setting direction of visual lines has described at least one Set object.
Any of the above-described kind of possible embodiment with reference to first aspect, in the 4th kind of possible embodiment, in life It is described to there is at least one setting direction of visual lines in response to determining according to the sight information before the operational order, it generates One operational order further include:
According to the position distribution of at least one first blinkpunkt rule, the location of at least one setting object is determined Domain.
Any of the above-described kind of possible embodiment with reference to first aspect, it is described in the 5th kind of possible embodiment Operational order includes:
Warning instruction.
Any of the above-described kind of possible embodiment with reference to first aspect, it is described in the 6th kind of possible embodiment Method further include:
It is operated according to the warning instruction execution one.
Any of the above-described kind of possible embodiment with reference to first aspect, it is described in the 7th kind of possible embodiment Operational order includes:
Modeling instruction.
Any of the above-described kind of possible embodiment with reference to first aspect, it is described in the 8th kind of possible embodiment Method further include:
According to modeling instruction execution modelling operability corresponding at least one setting object.
Any of the above-described kind of possible embodiment with reference to first aspect, it is described in the 9th kind of possible embodiment An at least user includes multiple users.
Any of the above-described kind of possible embodiment with reference to first aspect, it is described in the tenth kind of possible embodiment Sight information includes:
A plurality of sight of at least user in the space: directional information, start position information and watching attentively Dot position information.
Any of the above-described kind of possible embodiment with reference to first aspect, in a kind of the tenth possible embodiment, institute State sight information further include:
The acquisition time information of a plurality of sight.
Any of the above-described kind of possible embodiment with reference to first aspect, in the 12nd kind of possible embodiment, Before determining an at least mirror surface object according at least to the sight information, the method also includes:
At least noise sight in a plurality of sight is excluded according to the acquisition time information.
Any of the above-described kind of possible embodiment with reference to first aspect, in the 13rd kind of possible embodiment, institute Stating an at least noise sight includes: to watch an at least sight for Moving Objects.
Second aspect, the possible embodiment of the one of the application provide a kind of information processing unit, comprising:
Data obtaining module, for obtaining sight information of at least user in a space;
Directive generation module, for there is at least one setting direction of visual lines, life in response to determining according to the sight information At an operational order;
Wherein, one first be distributed on each setting direction of visual lines in at least one setting direction of visual lines with front and back Blinkpunkt and one second blinkpunkt, and the two of first blinkpunkt and corresponding two sights of second blinkpunkt A starting point is before first blinkpunkt.
In conjunction with second aspect, in second of possible embodiment, described instruction generation module includes:
Object determination unit, for there is at least one setting sight side in response to determining according to the sight information To determining has at least one setting object on at least one setting direction of visual lines;
Instruction generation unit sets the object accordingly operational order with described at least one for generating;
Wherein, at least one setting object includes: an at least transparent object and/or an at least mirror surface object.
It is described in the third possible embodiment in conjunction with any of the above-described kind of possible embodiment of second aspect Object determination unit is further used for:
Determine that the position of corresponding at least one first blinkpunkt of at least one setting direction of visual lines has described at least one Set object.
It is described in the 4th kind of possible embodiment in conjunction with any of the above-described kind of possible embodiment of second aspect Directive generation module further include:
Subject area determination unit, it is regular for the position distribution according at least one first blinkpunkt, described in determination The region of at least one setting object.
It is described in the 5th kind of possible embodiment in conjunction with any of the above-described kind of possible embodiment of second aspect Operational order includes:
Warning instruction.
It is described in the 6th kind of possible embodiment in conjunction with any of the above-described kind of possible embodiment of second aspect Device further include:
First execution module, for being operated according to the warning instruction execution one.
It is described in the 7th kind of possible embodiment in conjunction with any of the above-described kind of possible embodiment of second aspect Operational order includes:
Modeling instruction.
It is described in the 8th kind of possible embodiment in conjunction with any of the above-described kind of possible embodiment of second aspect Device further include:
Second execution module, for being grasped according to modeling instruction execution modeling corresponding at least one setting object Make.
It is described in the 9th kind of possible embodiment in conjunction with any of the above-described kind of possible embodiment of second aspect An at least user includes multiple users.
It is described in the tenth kind of possible embodiment in conjunction with any of the above-described kind of possible embodiment of second aspect Sight information includes:
A plurality of sight of at least user in the space: directional information, start position information and watching attentively Dot position information.
In conjunction with any of the above-described kind of possible embodiment of second aspect, in a kind of the tenth possible embodiment, institute State sight information further include:
The acquisition time information of a plurality of sight.
In conjunction with any of the above-described kind of possible embodiment of second aspect, in the 12nd kind of possible embodiment, institute State device further include:
Noise excludes module, for excluding the view of at least noise in a plurality of sight according to the acquisition time information Line.
In conjunction with any of the above-described kind of possible embodiment of second aspect, in the 13rd kind of possible embodiment, institute Stating an at least noise sight includes: to watch an at least sight for Moving Objects.
The third aspect, the possible embodiment of the one of the application provide a kind of user equipment, and the user equipment includes:
Memory, for storing instruction;
Processor, for executing the instruction of the memory storage, described instruction makes the processor execute following behaviour Make:
Obtain sight information of at least user in a space;
There is at least one setting direction of visual lines in response to determining according to the sight information, generates an operational order;
Wherein, one first be distributed on each setting direction of visual lines in at least one setting direction of visual lines with front and back Blinkpunkt and one second blinkpunkt, and the two of first blinkpunkt and corresponding two sights of second blinkpunkt A starting point is before first blinkpunkt.
At least one embodiment of the embodiment of the present application is easily detected according to the sight information of user in a space In there are transparent object or mirror surface object, be conducive to user or equipment using the object detection result and carry out subsequent operation, such as It can be to avoid bumping against in transparent object or mirror surface object.
Detailed description of the invention
Fig. 1 is a kind of flow chart of information processing method of the embodiment of the present application;
Fig. 2 a~2b is a kind of application scenarios schematic diagram of information processing method of the embodiment of the present application;
Fig. 3 is a kind of structural schematic block diagram of information processing unit of the embodiment of the present application;
Fig. 4 a~4e is the structural schematic block diagram of five kinds of information processing units of the embodiment of the present application;
Fig. 5 is a kind of structural schematic block diagram of user equipment of the embodiment of the present application.
Specific embodiment
(identical label indicates identical element in several attached drawings) and embodiment with reference to the accompanying drawing, to the tool of the application Body embodiment is described in further detail.Following embodiment is not limited to scope of the present application for illustrating the application.
It will be understood by those skilled in the art that the terms such as " first ", " second " in the application be only used for distinguishing it is asynchronous Suddenly, equipment or module etc., neither represent any particular technology meaning, also do not indicate the inevitable logical order between them.
As shown in Figure 1, the embodiment of the present application provides a kind of information processing method, comprising:
S110 obtains sight information of at least user in a space;
There is at least one setting direction of visual lines in response to determining according to the sight information in S120, generate an operational order;
Wherein, one first be distributed on each setting direction of visual lines in at least one setting direction of visual lines with front and back Blinkpunkt and one second blinkpunkt, and the two of first blinkpunkt and corresponding two sights of second blinkpunkt A starting point is before first blinkpunkt.
The inventors of the present application found that when transparent object or mirror surface object of the user in viewing space, in one direction Sight can not only fall on object itself, but also the rear of object can be fallen in, wherein for transparent object, Ke Yiluo On the object at transparent object rear, for mirror surface object, the picture for the object that mirror surface object faces mirror surface can be fallen in On.Therefore, by determining, there are such sights in space, can determine transparent object present in space or mirror surface object, And then it carries out generating corresponding operational order.
For example, executing subject of the information processing unit provided by the present application as the present embodiment, execution S110~ S120.Specifically, user equipment can be arranged in a manner of software, hardware or software and hardware combining in the information processing unit In, alternatively, the inherently described user equipment of the information processing unit;The user equipment includes but is not limited to: computer, pen Remember this computer, tablet computer, smart phone, intelligent glasses, intelligent helmet, intelligent robot.The wherein intelligent robot example It such as can be the robot that can be automatically moved, such as sweeping robot etc..
The above embodiment of the embodiment of the present application easily detects to deposit in a space according to the sight information of user In transparent object or mirror surface object, be conducive to user or equipment using the object detection result and carry out subsequent operation, such as can be with It avoids bumping against in transparent object or mirror surface object.
Each step of the embodiment of the present application is further illustrated by following embodiment:
S110 obtains sight information of at least user in a space.
In some possible embodiments, the sight information includes:
A plurality of sight of at least user in the space: directional information, start position information and watching attentively Dot position information.
Those skilled in the art it is recognised that since the sight of user can not focus on the aerial of not no object, Every sight of user can all correspond to an object.When watching an object, the position where the eyes of user is one user The start position of the corresponding sight of the eyes, the position of user's viewing is the blinkpunkt position of the sight on the object, described The direction of eyes viewing is the direction of the sight.Wherein, in the embodiment of the present application, the direction of a sight is with spatial position Direction, for example, in the embodiment of the present application, other direction of visual lines that are parallel with a direction of visual lines but not being overlapped be considered as with The different direction of visual lines of the direction of visual lines, alternatively, but distance parallel with a direction of visual lines can be set according to the needs of precision Other direction of visual lines outside error range are being set as the direction of visual lines different from the direction of visual lines.
In the embodiment of the present application, an at least user can be a user, or multiple users.
For example, optionally, a plurality of sight may is that in a kind of possible embodiment
One user passes through one or more snippets time in the space, repeatedly watches the institute of object present in the space Corresponding a plurality of sight.
Alternatively, a plurality of sight may is that in a kind of possible embodiment
Multiple users pass through one or more snippets time in the space, repeatedly watch the institute of object present in the space Corresponding a plurality of sight.
Wherein, in the embodiment of the present application, the quantity of the corresponding sight of the sight information is more, and distribution is more uniform, then It can more accurately determine the position of each object, shape etc. in space.In some possible embodiments, with the time Passage, sight quantity of at least user in the space may be continuously increased, therefore can be according to a setting Rule update the sight information.For example, constantly updating the sight information with a setting period.In some possible implementations In mode, it can be constantly improve by the corresponding information of the sight newly increased and the information of a object is determined.
In a kind of possible embodiment, a plurality of sight can be the unconscious viewing institute of an at least user It is collected when stating each object in space.Alternatively, also can indicate that described at least one uses in a kind of possible embodiment Family it is intentional go to watch corresponding object (for example, indicate an at least user go mirror surface object present in viewing space or Transparent object), and then obtain corresponding sight information.
In some possible application scenarios, the position of one or more sight blinkpunkts of an at least user is not On a fixed object, for example, an at least user may due to being possible to will appear the object of movement in the space The object of the movement can be watched, therefore in the embodiment of the present application, in order to avoid watching the noise sight band of such object The noise come can first exclude the noise sight.
Wherein, due to the object of movement a region appearance there may be temporal random or intermittence, can To determine such noise sight according to the acquisition time information of a plurality of sight, for example, the region in the space Only occurred blinkpunkt within a period in the sight in the region, then such sight may be the noise sight.Therefore, In a kind of possible embodiment, the sight information further include:
The acquisition time information of a plurality of sight.
In a kind of possible embodiment, according at least to the sight information determine an at least mirror surface object it Before, the method also includes:
At least noise sight in a plurality of sight is excluded according to the acquisition time information.
In a kind of possible embodiment, the S110 can obtain the sight information from an at least external equipment. For example, in a kind of possible embodiment the sight information can be obtained from a data server;Alternatively, one kind can In the embodiment of energy, it can be obtained from at least eye tracking device of an at least user and an at least positioning device The sight information.
Wherein, an at least eye tracking device for example can be with are as follows: two an eye line direction of a user is tracked respectively, according to Two an eye line direction determines eye tracking device of the blinkpunkt relative to the position of user.Alternatively, the eye tracker Part can be with are as follows: the direction of visual lines of tracking one user, one eyes and the focus information of the eyes, according to the direction of visual lines and The focus information obtains eye tracking device of the blinkpunkt relative to the position of user.
An at least positioning device can be used for obtaining the location information of at least user in the space, into And obtain the start position information of corresponding sight.
In a kind of possible embodiment, for example, an at least user is a user, at this point, at the information Managing device for example can be the headset equipment of the user, and the headset equipment can acquire the sight information of user, The S110 can be for example the acquisition sight information at this time.
There is at least one setting direction of visual lines in response to determining according to the sight information in S120, generate an operational order.
Wherein, one first be distributed on each setting direction of visual lines in at least one setting direction of visual lines with front and back Blinkpunkt and one second blinkpunkt, and the two of first blinkpunkt and corresponding two sights of second blinkpunkt A starting point is before first blinkpunkt.
In a kind of possible embodiment, there is at least one setting sight in described determined according to the sight information Direction for example may include:
At least one set of sight is determined according to the sight information, wherein including on same direction of visual lines in every group of sight Two sights, and the blinkpunkt of two sights is one in front and one in back distributed, and the starting point of two sights is preceding Blinkpunkt front;
A direction of visual lines corresponding to every group of sight is a setting direction of visual lines.
It is only complete with the direction of visual lines in two direction of visual lines of two sights in a kind of possible embodiment When identical, just think first blinkpunkt and second blinkpunkt is the front and back distribution on the direction of visual lines;At it In its possible embodiment, difference is needed according to precision, it can also two direction of visual lines in two sights and institute When stating difference between direction of visual lines within the set range, it is believed that described two direction of visual lines are identical as the direction of visual lines, i.e., First blinkpunkt and second blinkpunkt are on the direction of visual lines.
In the embodiment of the present application, it is each it is forward and backward be for direction of visual lines, wherein for example, in direction of visual lines The position of upstream is located at before the position of direction of visual lines upstream and downstream.In the embodiment of the present application, in corresponding setting sight side Upwards, first blinkpunkt is in the upstream of second blinkpunkt.
In a kind of possible scene, on a direction of visual lines, a sight is likely located at the front side of an object, corresponds to Blinkpunkt position on the object;Another sight is likely located at the rear side of the object, corresponding blinkpunkt position Another pair after the object is as upper.At this point, although the object may not be mirror surface object or transparent object, described Direction of visual lines still has one first blinkpunkt and one second blinkpunkt that front and back is distributed.Therefore, in the embodiment of the present application, it is The such situation of exclusion improves the accuracy that mirror surface object determines, needs to respectively include first blinkpunkt and described the Two sight starting points of two sights of two blinkpunkts are before first blinkpunkt.In this way, being general in an object When object (for example, neither transparent object, and non-specular surface object), since the sight of user can not pass through described in the object reaches Therefore the rear side of object is not in the front side of starting point blinkpunkt on the direction of visual lines, blinkpunkt is on rear side of the blinkpunkt Sight.
A kind of the first blinkpunkt and the in possible embodiment, with front and back distribution on a direction of visual lines Two blinkpunkts, and when the starting point of two sights is before first blinkpunkt, just explanation is on the direction of visual lines With a mirror surface object or a transparent object, corresponding operation can be carried out according to such setting direction of visual lines.For example, As soon as determining that the warning that generation warns user or equipment instructs when there is at least setting direction of visual lines.
It is described in response to determining that there is at least one setting regards according to the sight information in a kind of possible embodiment Line direction, generating an operational order includes:
There is at least one setting direction of visual lines in response to determining according to the sight information, determines that described at least one sets Determine that there is at least one setting object on direction of visual lines;
It generates and sets the object accordingly operational order with described at least one;
Wherein, at least one setting object includes: an at least transparent object and/or an at least mirror surface object.
Unlike a upper embodiment, in present embodiment, there is at least one setting sight side determining Backward, it increases and determines that there is the step of at least one setting object on at least one setting direction of visual lines.Wherein, institute When stating at least one and setting direction of visual lines as a setting direction of visual lines, can determine on the setting direction of visual lines has a setting Object.When described at least one sets direction of visual lines as multiple setting direction of visual lines, the multiple setting direction of visual lines can be Watch the direction of visual lines of same setting object attentively;Or watch the direction of visual lines of multiple setting objects attentively.
In the present embodiment, once can then have a setting in space there are a setting direction of visual lines in the space Object, but can not set direction of visual lines according to described and determine the setting object as transparent object or mirror surface object. In the embodiment of the present application, it does not need to be that the transparent object or the mirror image object are distinguished by the setting object Come;In other embodiments, if necessary to further the two is distinguished, can according to other means further into Row is distinguished.Such as: determine one second blinkpunkt on a setting direction of visual lines whether with an object surface matching, if it does, Then illustrate that the setting object is a transparent object;If it does not match, illustrating that the setting object is a mirror surface object;Or Determine second blinkpunkt relative to the setting object surface mirror point whether with an object surface matching, if Match, then illustrates that the setting object is a mirror surface object;If it does not match, illustrating that the setting object is a transparent object. Wherein, a little with an object surface match for example can the position difference between the point and the subject surface setting Deviation range in.
In some possible application scenarios, it is only necessary to knowing has the setting object in a direction of visual lines, and Require no knowledge about the position of the setting object.For example, being determined after a direction of visual lines in a kind of application scenarios, it is only necessary to User is warned, informs that user has the setting object, call user's attention on the direction of visual lines.
In other possible application scenarios, it may be desirable to the further position for determining at least one setting object, Such as remind user or equipment that there is at how many distance a setting object before front direction, so that user or equipment carry out in advance Prepare.In the embodiment of the present application, since at least one first blinkpunkt is to watch watching attentively for at least one setting object attentively Point, therefore there is at least one setting in a kind of possible embodiment, on an at least direction of visual lines described in the determination Object may include:
Determine that the position of corresponding at least one first blinkpunkt of at least one setting direction of visual lines has described at least one Set object.
In a kind of possible embodiment, further, described at least one can also be determined according to the sight information Set the region of object.The region of at least one setting object described here may include at least one setting object Bounds;In addition, it can include the shape on the surface that at least one setting object is watched attentively by user.Can be in this way User or equipment provide the information of the more accurate at least one setting object.For example, can be for at least one setting The modeling of object provides more information.At this point, in the present embodiment, the method can also include:
According to the position distribution of at least one first blinkpunkt rule, the location of at least one setting object is determined Domain.
In the present embodiment, at least one first blinkpunkt on at least one setting direction of visual lines is corresponding Fall on at least one setting object, therefore, the position at least where one first blinkpunkt be assured that it is described extremely Region where few setting object.
It wherein, can be by the dividing method of spatial point come to described all first in a kind of possible embodiment Blinkpunkt is split, and finds multiple set of at least one first blinkpunkt, and each set corresponds to described at least one and sets Determine the region of the setting object in object.For example, converting a cloud, each first blinkpunkt for all first blinkpunkts For point corresponding in cloud, then corresponding cloud sector of different set object is separated by the method for point cloud segmentation;Pass through One method of surface reconstruction obtains the corresponding region of the setting object, such as Poisson come the point cloud according to corresponding to a setting object Method of surface reconstruction.Certainly, other possible method of surface reconstruction can also be using in the embodiment of the present application.
Those skilled in the art it is recognised that it is described at least one setting direction of visual lines quantity it is more, be distributed more uniform, institute It is at least more accurate once the determination of setting object region to state.
In a kind of possible embodiment, optionally, the operational order may include:
Warning instruction.
Wherein, the warning instruction is for informing that user or equipment have the setting pair on a setting direction of visual lines The instruction of elephant.
Wherein, the warning of a user, which instructs, is informed for user, can referred to for sound warning instruction, picture and text showing warning It enables, indicator light warns one of the warnings such as instruction instruction or a variety of.
In a kind of possible embodiment, the method also includes:
It is operated according to the warning instruction execution one.
For example, with sound warning instruction, picture and text showing warning instruction, indicator light warning instruction corresponding sending warning Sound, display warning picture and text and light corresponding indicator light etc..
Alternatively, a mobile equipment can also be controlled according to the information warning in a kind of possible embodiment Kinetic characteristic slows down in a position (such as position where the setting object), stops, turning for example, controlling the equipment Or it turns around.
In alternatively possible embodiment, optionally, the operational order may include:
Modeling instruction.
The modeling instruction is virtual corresponding with the space one for carrying out to the setting object in the space The instruction that space is modeled.
In a kind of possible embodiment, the method also includes:
According to modeling instruction execution modelling operability corresponding at least one setting object.
For example, determining position, shape, characteristic etc. of at least one setting object in the Virtual Space.
Other than several operational orders recited above, the operational order can also be other possible operational orders, Such as the communication instruction etc. for sending the setting object and its corresponding information to an at least external equipment.
The embodiment of the present application is further illustrated by following application scenarios.
In a kind of possible scene, sight information corresponding with a space includes the letter of a plurality of sight as shown in Figure 2 a Breath, wherein every sight indicates that certainly, for the readability of drawing, Fig. 2 a is merely exemplary to be shown by a straight line with the arrow Part sight out.
Present embodiment it is described below in, on a direction of visual lines with front and back distribution two blinkpunkts, And previous blinkpunkt is located at the case where rear of the starting point of described two blinkpunkts, and the previous blinkpunkt is known as The latter blinkpunkt is known as the second blinkpunkt by one blinkpunkt, which is known as a setting direction of visual lines.In a sight Direction have a blinkpunkt, alternatively, have it is multiple be unsatisfactory for the blinkpunkt of situation above in the case where, which is known as Third blinkpunkt.
In the present embodiment, it according to the sight information, obtains having on one first setting direction of visual lines Ea along institute State the one first blinkpunkt 211a and one second blinkpunkt 221a being distributed before and after the first setting direction of visual lines Ea, wherein the first note Viewpoint 211a is the blinkpunkt of the first sight 210, and the second blinkpunkt 221a is the blinkpunkt of the second sight 220, the first sight 210 The first starting point 212 and the second sight the second starting point 222 in the front side of the first blinkpunkt 211a.
As described above as can be seen that on the first setting direction of visual lines Ea, with first blinkpunkt The corresponding position 211a has a setting object.
Further, in order to determine that the region of the setting object can also will have one in the present embodiment All setting direction of visual lines of first blinkpunkt and one second blinkpunkt are found out.In the present embodiment, as shown in Figure 2 a, also show Example property shows several such direction of visual lines that set: third sets direction of visual lines Ec, the 4th setting direction of visual lines Ed, the 5th The setting direction of visual lines Ef of direction of visual lines Ee and the 6th is set, multiple first blinkpunkt 211c~211f, Duo Ge are corresponded respectively to Two blinkpunkt 221c~221f.Those skilled in the art are it is recognised that such setting direction of visual lines can also have does not exist very much It is shown in Fig. 2 a.Position where all first blinkpunkt 211a, 211c~211f on all setting direction of visual lines It sets, can determine the region where the setting object 240, (those skilled in the art are it is recognised that be terrible as shown in Figure 2 b To the region of the setting object 240 in figure 2b, other than recited above first, third~6th setting direction of visual lines, Other unshowned setting direction of visual lines with the first blinkpunkt are also used).
In the present embodiment, other than the setting object 240, it is other right to be determined according to the sight information The position of elephant.For example, also being had in available space according to the location information of all third blinkpunkts in the sight information Just like the first object 250, the second object 260 shown in Fig. 2 b.
After the setting object 240 being determined and region corresponding to it, modeling instruction can be generated, to described Setting object 240 is modeled.
It will be understood by those skilled in the art that in the above method of the application specific embodiment, the serial number of each step Size is not meant that the order of the execution order, and the execution sequence of each step should be determined by its function and internal logic, without answering Any restriction is constituted to the implementation process of the application specific embodiment.
As shown in figure 3, the embodiment of the present application provides a kind of information processing unit 300, comprising:
Data obtaining module 310, for obtaining sight information of at least user in a space;
Directive generation module 320, for there is at least one setting direction of visual lines in response to determining according to the sight information, Generate an operational order;
Wherein, one first be distributed on each setting direction of visual lines in at least one setting direction of visual lines with front and back Blinkpunkt and one second blinkpunkt, and the two of first blinkpunkt and corresponding two sights of second blinkpunkt A starting point is before first blinkpunkt.
The inventors of the present application found that when transparent object or mirror surface object of the user in viewing space, in one direction Sight can not only fall on object itself, but also the rear of object can be fallen in, wherein for transparent object, Ke Yiluo On the object at transparent object rear, for mirror surface object, the picture for the object that mirror surface object faces mirror surface can be fallen in On.Therefore, by determining, there are such sights in space, can determine transparent object present in space or mirror surface object, And then it carries out generating corresponding operational order.
The above embodiment of the embodiment of the present application easily detects to deposit in a space according to the sight information of user In transparent object or mirror surface object, be conducive to user or equipment using the object detection result and carry out subsequent operation, such as can be with It avoids bumping against in transparent object or mirror surface object.
The embodiment of the present application is further illustrated by following embodiment.
In some possible embodiments, the sight information includes:
A plurality of sight of at least user in the space: directional information, start position information and watching attentively Dot position information.To corresponding description in the explanations of these information referring to Fig. 1 and Fig. 2 a~2b illustrated embodiment.
In the embodiment of the present application, an at least user can be a user, or multiple users.
For example, optionally, a plurality of sight may is that in a kind of possible embodiment
One user passes through one or more snippets time in the space, repeatedly watches each object present in the space Corresponding a plurality of sight.
Alternatively, a plurality of sight may is that in a kind of possible embodiment
Multiple users pass through one or more snippets time in the space, repeatedly watch each object present in the space Corresponding a plurality of sight.
Wherein, in the embodiment of the present application, the quantity of the corresponding sight of the sight information is more, and distribution is more uniform, then It can more accurately determine the position of each object, shape etc. in space.In some possible embodiments, with the time Passage, sight quantity of at least user in the space may be continuously increased, therefore can be according to a setting Rule update the sight information.For example, constantly updating the sight information with a setting period.In some possible implementations In mode, it can be constantly improve by the corresponding information of the sight newly increased and the information of a object is determined.
In a kind of possible embodiment, a plurality of sight can be the unconscious viewing institute of an at least user It is collected when stating each object in space.Alternatively, also can indicate that described at least one uses in a kind of possible embodiment Family it is intentional go to watch corresponding object (for example, indicate an at least user go mirror surface object present in viewing space or The boundary position of transparent object, especially mirror surface object or transparent object), and then obtain corresponding sight information.
In some possible application scenarios, the position of one or more sight blinkpunkts of an at least user is not On a fixed object, for example, an at least user may due to being possible to will appear the object of movement in the space The object of the movement can be watched, therefore in the embodiment of the present application, in order to avoid watching the noise sight band of such object The noise come can first exclude the noise sight.
Wherein, due to the object of movement a region appearance there may be temporal random or intermittence, can To determine such noise sight according to the acquisition time information of a plurality of sight, for example, the region in the space Only occurred blinkpunkt within a period in the sight in the region, then such sight may be the noise sight.Therefore, In a kind of possible embodiment, the sight information further include:
The acquisition time information of a plurality of sight.
As shown in fig. 4 a, in the present embodiment, described device 300 further include:
Noise excludes module 330, makes an uproar for excluding at least one in a plurality of sight according to the acquisition time information Sound sight.
Wherein, an at least noise sight includes: to watch an at least sight for Moving Objects.
In a kind of possible embodiment, the data obtaining module 310 may include multiple sensors, for acquiring The sight information.The sensor for example may include determining what the position of an at least user in space was positioned Position device and the eye tracking device for acquiring the position of the direction of visual lines and blinkpunkt of an at least user relative to user.
In alternatively possible embodiment, the data obtaining module 310 may include communication device, for to A few external equipment obtains the sight information.An at least external equipment for example can be include the aforementioned plurality of biography The equipment of sensor, or can also be at least data server for having had collected the sight information.
In a kind of possible embodiment, described instruction generation module 320 determines that there are institutes according to the sight information Stating at least one setting direction of visual lines for example may include:
At least one set of sight is determined according to the sight information, wherein including on same direction of visual lines in every group of sight Two sights, and the blinkpunkt of two sights is one in front and one in back distributed, and the starting point of two sights is preceding Blinkpunkt front;
A direction of visual lines corresponding to every group of sight is a setting direction of visual lines.
It is only complete with the direction of visual lines in two direction of visual lines of two sights in a kind of possible embodiment When identical, just think first blinkpunkt and second blinkpunkt is the front and back distribution on the direction of visual lines;At it In its possible embodiment, difference is needed according to precision, it can also two direction of visual lines in two sights and institute When stating difference between direction of visual lines within the set range, it is believed that described two direction of visual lines are identical as the direction of visual lines, i.e., First blinkpunkt and second blinkpunkt are on the direction of visual lines.
In the embodiment of the present application, it is each it is forward and backward be for direction of visual lines, wherein for example, in direction of visual lines The position of upstream is located at before the position of direction of visual lines upstream and downstream.In the embodiment of the present application, in corresponding setting sight side Upwards, first blinkpunkt is in the upstream of second blinkpunkt.
As shown in Figure 4 b, in a kind of possible embodiment, described instruction generation module 320 includes:
Object determination unit 321, for there is at least one setting sight in response to determining according to the sight information Direction, determining has at least one setting object on at least one setting direction of visual lines;
Instruction generation unit 322 sets the object accordingly operational order with described at least one for generating;
Wherein, at least one setting object includes: an at least transparent object and/or an at least mirror surface object.
Wherein, when described at least one sets direction of visual lines as a setting direction of visual lines, the setting view can be determined There is a setting object on line direction.It is the multiple when described at least one sets direction of visual lines as multiple setting direction of visual lines Setting direction of visual lines can be the direction of visual lines for watching same setting object attentively;Or watch the sight side of multiple setting objects attentively To.
In some possible application scenarios, it is only necessary to knowing has the setting object in a direction of visual lines, and Require no knowledge about the position of the setting object.For example, being determined after a direction of visual lines in a kind of application scenarios, it is only necessary to User is warned, informs that user has the setting object, call user's attention on the direction of visual lines.
In other possible application scenarios, it may be desirable to the further position for determining at least one setting object, Such as remind user or equipment that there is at how many distance a setting object before front direction, so that user or equipment carry out in advance Prepare.Therefore, in a kind of possible embodiment, the object determination unit 321 is further used for:
Determine that the position of corresponding at least one first blinkpunkt of at least one setting direction of visual lines has described at least one Set object.
In a kind of possible embodiment, further, described at least one can also be determined according to the sight information Set the region of object.In this way the letter of the more accurate at least one setting object can be provided for user or equipment Breath.For example, more information can be provided for the modeling at least one setting object.At this point, in the present embodiment, such as Shown in Fig. 4 c, described instruction generation module 320 further include:
Subject area determination unit 323 determines institute for the position distribution rule according at least one first blinkpunkt State the region of at least one setting object.
Described instruction generation unit 322 can be corresponding to generate according at least one setting object and its region Operational order.
In the present embodiment, at least one first blinkpunkt on at least one setting direction of visual lines is corresponding Fall on at least one setting object, therefore, the position at least where one first blinkpunkt be assured that it is described extremely Region where few setting object.
In a kind of possible embodiment, the operational order may include:
Warning instruction.
In the present embodiment, as shown in figure 4d, described device 300 can also include:
First execution module 340, for being operated according to the warning instruction execution one.
In a kind of possible embodiment, the operational order may include:
Modeling instruction.
In the present embodiment, as shown in fig 4e, described device 300 can also include:
Second execution module 350, for being set according to the modeling instruction execution with described at least one, object is corresponding to be built Modulo operation.
The description that each module, the further function of unit are realized in the embodiment of the present application is referring to right in above method embodiment The description answered.
Fig. 5 is a kind of structural schematic diagram of user equipment 500 provided by the embodiments of the present application, and the application specific embodiment is simultaneously The specific implementation of user equipment 500 is not limited.As shown in figure 5, the user equipment 500 may include:
Processor (processor) 510,520, memory communication interface (Communications Interface) (memory) 530 and communication bus 540.Wherein:
Processor 510, communication interface 520 and memory 530 complete mutual communication by communication bus 540.
Communication interface 520, for being communicated with the network element of such as client etc..
Processor 510 can specifically execute the correlation step in above method embodiment for executing instruction 532.
Specifically, instruction 532 may include computer operation instruction.
Processor 510 may be a central processor CPU or specific integrated circuit ASIC (Application Specific Integrated Circuit), or be arranged to implement the integrated electricity of one or more of the embodiment of the present application Road.
Memory 530, for storing instruction 532.Memory 530 may include high speed RAM memory, it is also possible to further include Nonvolatile memory (non-volatile memory), for example, at least a magnetic disk storage.Instruction 532 can specifically be used In making the user equipment 500 execute following steps:
Obtain sight information of at least user in a space;
There is at least one setting direction of visual lines in response to determining according to the sight information, generates an operational order;
Wherein, one first be distributed on each setting direction of visual lines in at least one setting direction of visual lines with front and back Blinkpunkt and one second blinkpunkt, and the two of first blinkpunkt and corresponding two sights of second blinkpunkt A starting point is before first blinkpunkt.
The specific implementation of each step may refer to corresponding in corresponding steps and unit in above-described embodiment in instruction 532 Description, this will not be repeated here.It is apparent to those skilled in the art that for convenience and simplicity of description, it is above-mentioned to retouch The specific work process of the equipment and module stated can refer to corresponding processes in the foregoing method embodiment description, herein no longer It repeats.
Those of ordinary skill in the art may be aware that list described in conjunction with the examples disclosed in the embodiments of the present disclosure Member and method and step can be realized with the combination of electronic hardware or computer software and electronic hardware.These functions are actually It is implemented in hardware or software, the specific application and design constraint depending on technical solution.Professional technician Each specific application can be used different methods to achieve the described function, but this realization is it is not considered that exceed Scope of the present application.
It, can be with if the function is realized in the form of SFU software functional unit and when sold or used as an independent product It is stored in a computer readable storage medium.Based on this understanding, the technical solution of the application is substantially in other words The part of the part that contributes to existing technology or the technical solution can be embodied in the form of software products, the meter Calculation machine software product is stored in a storage medium, including some instructions are used so that a computer equipment (can be a People's computer, server or network equipment etc.) execute each embodiment the method for the application all or part of the steps. And storage medium above-mentioned includes: that USB flash disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), arbitrary access are deposited The various media that can store program code such as reservoir (RAM, Random Access Memory), magnetic or disk.
Embodiment of above is merely to illustrate the application, and is not the limitation to the application, in relation to the common of technical field Technical staff can also make a variety of changes and modification in the case where not departing from spirit and scope, therefore all Equivalent technical solution also belongs to the scope of the application, and the scope of patent protection of the application should be defined by the claims.

Claims (10)

1. a kind of information processing method characterized by comprising
Obtain sight information of at least user in a space;
There is at least one setting direction of visual lines in response to determining according to the sight information, generates an operational order;
Wherein, watch attentively on each setting direction of visual lines in at least one setting direction of visual lines with front and back is distributed one first Point and one second blinkpunkt, and two of first blinkpunkt and corresponding two sights of second blinkpunkt For point before first blinkpunkt, direction of visual lines is the direction with spatial position.
2. the method as described in claim 1, which is characterized in that described in response to determining exist at least according to the sight information One setting direction of visual lines, generating an operational order includes:
There is at least one setting direction of visual lines in response to determining according to the sight information, determines at least one setting view There is at least one setting object on line direction;
It generates and sets the object accordingly operational order with described at least one;
Wherein, at least one setting object includes: an at least transparent object and/or an at least mirror surface object.
3. method according to claim 2, which is characterized in that described in having on an at least direction of visual lines described in the determination extremely Few one, which sets object, includes:
Determine that the position of corresponding at least one first blinkpunkt of at least one setting direction of visual lines has at least one setting Object.
4. method according to claim 2, which is characterized in that described in response to basis before generating the operational order The sight information, which determines, has at least one setting direction of visual lines, generates an operational order further include:
According to the position distribution of at least one first blinkpunkt rule, the region of at least one setting object is determined.
5. the method as described in claim 1, which is characterized in that the sight information includes:
A plurality of sight of at least user in the space: directional information, start position information and watching point attentively Confidence breath.
6. a kind of information processing unit characterized by comprising
Data obtaining module, for sight information of at least user in a space;
Directive generation module generates one for there is at least one setting direction of visual lines in response to determining according to the sight information Operational order;
Wherein, watch attentively on each setting direction of visual lines in at least one setting direction of visual lines with front and back is distributed one first Point and one second blinkpunkt, and two of first blinkpunkt and corresponding two sights of second blinkpunkt For point before first blinkpunkt, direction of visual lines is the direction with spatial position.
7. device as claimed in claim 6, which is characterized in that described instruction generation module includes:
Object determination unit, for there is at least one setting direction of visual lines in response to determining according to the sight information, really There is at least one setting object on the fixed at least one setting direction of visual lines;
Instruction generation unit sets the object accordingly operational order with described at least one for generating;
Wherein, at least one setting object includes: an at least transparent object and/or an at least mirror surface object.
8. device as claimed in claim 7, which is characterized in that the object determination unit is further used for:
Determine that the position of corresponding at least one first blinkpunkt of at least one setting direction of visual lines has at least one setting Object.
9. device as claimed in claim 7, which is characterized in that described instruction generation module further include:
Subject area determination unit, for the position distribution rule according at least one first blinkpunkt, determine it is described at least The region of one setting object.
10. a kind of user equipment, which is characterized in that the user equipment includes:
Memory, for storing instruction;
Processor, for executing the instruction of the memory storage, described instruction makes the processor execute following operation:
Obtain sight information of at least user in a space;
There is at least one setting direction of visual lines in response to determining according to the sight information, generates an operational order;
Wherein, watch attentively on each setting direction of visual lines in at least one setting direction of visual lines with front and back is distributed one first Point and one second blinkpunkt, and two of first blinkpunkt and corresponding two sights of second blinkpunkt Point is before first blinkpunkt.
CN201510303129.4A 2015-06-04 2015-06-04 Information processing method, information processing unit and user equipment Active CN106293031B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201510303129.4A CN106293031B (en) 2015-06-04 2015-06-04 Information processing method, information processing unit and user equipment
US15/170,140 US10268265B2 (en) 2015-06-04 2016-06-01 Information processing method, information processing apparatus and user equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201510303129.4A CN106293031B (en) 2015-06-04 2015-06-04 Information processing method, information processing unit and user equipment

Publications (2)

Publication Number Publication Date
CN106293031A CN106293031A (en) 2017-01-04
CN106293031B true CN106293031B (en) 2019-05-21

Family

ID=57451798

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201510303129.4A Active CN106293031B (en) 2015-06-04 2015-06-04 Information processing method, information processing unit and user equipment

Country Status (2)

Country Link
US (1) US10268265B2 (en)
CN (1) CN106293031B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111723828A (en) * 2019-03-18 2020-09-29 北京市商汤科技开发有限公司 Watching region detection method and device and electronic equipment

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103431840A (en) * 2013-07-31 2013-12-11 北京智谷睿拓技术服务有限公司 System and method for detecting optical parameters of eyes

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030160736A1 (en) 2002-02-25 2003-08-28 Faso Charles M. Portable heads-up display for vehicle
JP4604190B2 (en) 2004-02-17 2010-12-22 国立大学法人静岡大学 Gaze detection device using distance image sensor
US8031947B2 (en) 2007-04-03 2011-10-04 Jacobsen Kenneth P Method and system for rapid matching of video streams
JP4226639B1 (en) 2007-11-01 2009-02-18 株式会社コナミデジタルエンタテインメント Image processing apparatus, image processing method, and program
US20110169730A1 (en) 2008-06-13 2011-07-14 Pioneer Corporation Sight line input user interface unit, user interface method, user interface program, and recording medium with user interface program recorded
WO2012132495A1 (en) 2011-03-30 2012-10-04 本田技研工業株式会社 Operation device
US20140043229A1 (en) 2011-04-07 2014-02-13 Nec Casio Mobile Communications, Ltd. Input device, input method, and computer program
US9025252B2 (en) 2011-08-30 2015-05-05 Microsoft Technology Licensing, Llc Adjustment of a mixed reality display for inter-pupillary distance alignment
KR101850035B1 (en) * 2012-05-02 2018-04-20 엘지전자 주식회사 Mobile terminal and control method thereof
TWI486629B (en) 2012-11-21 2015-06-01 Ind Tech Res Inst Optical-see-through head mounted display system and interactive operation
JP6410022B2 (en) 2013-09-06 2018-10-24 パナソニックIpマネジメント株式会社 Master-slave robot control device and control method, robot, master-slave robot control program, and integrated electronic circuit for master-slave robot control
CN103475893B (en) 2013-09-13 2016-03-23 北京智谷睿拓技术服务有限公司 The pick-up method of object in the pick device of object and three-dimensional display in three-dimensional display
KR20150039355A (en) * 2013-10-02 2015-04-10 엘지전자 주식회사 Mobile terminal and control method thereof
JP2015152939A (en) 2014-02-10 2015-08-24 ソニー株式会社 information processing apparatus, information processing method, and program
US20160280136A1 (en) 2014-03-05 2016-09-29 Guy M. Besson Active-tracking vehicular-based systems and methods for generating adaptive image
CN104182043B (en) 2014-08-15 2017-05-03 北京智谷睿拓技术服务有限公司 Object picking-up method, object picking-up device and user equipment
CN104156069B (en) * 2014-08-15 2017-04-12 北京智谷睿拓技术服务有限公司 Object picking method and device and user equipment
CN106475893A (en) * 2016-11-09 2017-03-08 安徽千禧精密轴承制造有限公司 A kind of bearing inner race raceway groove lapping device

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103431840A (en) * 2013-07-31 2013-12-11 北京智谷睿拓技术服务有限公司 System and method for detecting optical parameters of eyes

Also Published As

Publication number Publication date
US10268265B2 (en) 2019-04-23
US20160358023A1 (en) 2016-12-08
CN106293031A (en) 2017-01-04

Similar Documents

Publication Publication Date Title
US11157725B2 (en) Gesture-based casting and manipulation of virtual content in artificial-reality environments
US10674142B2 (en) Optimized object scanning using sensor fusion
US20190213792A1 (en) Providing Body-Anchored Mixed-Reality Experiences
CN106062614B (en) It is detected on the head of head-mounted display
CN107390863B (en) Device control method and device, electronic device and storage medium
CN105191282B (en) Method and apparatus for augmented reality target detection
WO2020076396A1 (en) Real-world anchor in a virtual-reality environment
US10663729B2 (en) Peripheral device for head-mounted display
US20190212828A1 (en) Object enhancement in artificial reality via a near eye display interface
EP4361771A1 (en) Gesture recognition method and apparatus, system, and vehicle
US20170176748A1 (en) Text enhancements for head-mounted displays
CN108431667A (en) Information processing unit, information processing method and program
KR20170031733A (en) Technologies for adjusting a perspective of a captured image for display
CN108351522A (en) Direction of gaze maps
US10896545B1 (en) Near eye display interface for artificial reality applications
US20170140215A1 (en) Gesture recognition method and virtual reality display output device
CN106296796B (en) Information processing method, information processing unit and user equipment
JP2016096449A (en) Image display device, brightness change method, and program
JP2015118442A (en) Information processor, information processing method, and program
CN105630155B (en) Computing device and method for providing three-dimensional (3D) interaction
CN113318435A (en) Control method and device of handle control tracker and head-mounted display equipment
JP6516464B2 (en) Wearable search system
CN106293031B (en) Information processing method, information processing unit and user equipment
EP3651144A1 (en) Method and apparatus for information display, and display device
CN109584361B (en) Equipment cable virtual preassembling and track measuring method and system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant