CN104951059B

CN104951059B - A kind of data processing method, device and a kind of electronic equipment

Info

Publication number: CN104951059B
Application number: CN201410126484.4A
Authority: CN
Inventors: 崔恒利
Original assignee: Lenovo Beijing Ltd
Current assignee: Lenovo Beijing Ltd
Priority date: 2014-03-31
Filing date: 2014-03-31
Publication date: 2018-08-10
Anticipated expiration: 2034-03-31
Also published as: CN104951059A

Abstract

The invention discloses a kind of data processing methods, device and a kind of electronic equipment, the data processing method is applied to electronic equipment, the electronic equipment includes display unit and the first collecting unit, display unit enables the viewer outside first surface to perceive the image outside second surface, first collecting unit can detect the operation of the operating body outside second surface, this method determines the first distance of the image distance display unit outside the second surface of user's perception first, then determine operating body outside second surface for the second distance of the first collecting unit of operating distance of the image of user's perception, finally according to the first determining distance, second distance and preset configuration generate and response control instruction.Disclosed data processing method, device and electronic equipment through the embodiment of the present invention so that user directly can operate the things in the three-dimensional interface of display with hand, realizes three-dimensional interaction, improves the man-machine interaction experience sense of user and electronic equipment.

Description

A kind of data processing method, device and a kind of electronic equipment

Technical field

The present invention relates to human-computer interaction technique fields, and more specifically, it relates to a kind of data processing method, device and one Kind electronic equipment.

Background technology

In recent years, intelligent electronic device has obtained rapid development.Miscellaneous intelligent electronic device is into access customer Routine work and life.

Presently, there are a kind of relatively popular intelligent electronic device, this class of electronic devices makes user when in use, energy Enough watch some three-dimensional interfaces, and can by input equipment operating to these interfaces of display, in realization The various activities such as net, electronic transaction, amusement, to provide a kind of completely new intelligence experience.In the prior art, user is by setting The touch tablet for being placed in intelligent electronic device side is operated accordingly to control intelligent electronic device.In operation, it uses The finger at family moves on a touchpad, and the mouse on three-dimensional interface that user sees will move accordingly, wait for that mouse is moved to When user is wanted in the things of triggering, finger double-click touch tablet, which can trigger, chooses operation.

In summary as can be seen that in the prior art, the interface that intelligent electronic device is shown is three-dimensional interface, and user couple The things at three-dimensional interface, which carries out operation, to be realized by two-dimensional touch tablet, therefore, in the prior art, passes through touch in user During plate opposition body interface is operated, user can not be obtained by tending to occur the input signal of user on a touchpad The case where response operation needed.

Invention content

In view of this, the present invention provides a kind of data processing method, device and a kind of electronic equipment, so that user's energy Enough hands directly operate the things in the three-dimensional interface of display, realize three-dimensional interaction.

To achieve the above object, the present invention provides the following technical solutions：

A kind of data processing method, is applied to electronic equipment, and the electronic equipment is adopted including at least display unit and first Collecting unit, the display unit is used to that the viewer outside first surface to be enable to perceive the image outside second surface, The first surface and the second surface are the opposite outer surfaces of the electronic equipment；First collecting unit is for detecting The operation of operating body outside the second surface；The method includes：

The display unit shows the first image with the first display parameters, wherein first display parameters to watch For person when watching the display unit, the distance for perceiving display unit described in the first object distance in described first image is the One distance；

First operation of the first collecting unit acquisition operations body acupuncture to first object；

According to first operation, second distance is determined；Wherein, the second distance is the operative position of first operation Set the distance apart from first collecting unit；

According to first distance and the second distance, control instruction is determined；

The control instruction is responded, the second image, described first image and second figure are shown with the second display parameters As different.

Optionally, the display unit shows the first image with the first display parameters, including：

The display unit shows the first image with the first display parameters so that the first distance is within a preset range.

Optionally, before determining control instruction, further include according to first distance and the second distance described：

Determine the distance between the display unit and first collecting unit difference；

It is then described to determine control instruction according to first distance and the second distance, including：

Difference relationship between first distance and the second distance is corrected using the distance difference；

Control instruction is determined according to the difference relationship after first distance and correction.

Optionally, described first image includes left view and right view, and the display unit includes the first display subelement With the second display subelement, wherein the first display subelement is used to show the left view of first object, the second display Subelement is used to show the right view of first object, then shows the first image in the display unit with the first display parameters Afterwards, further include：

Determine first distance；

Determination first distance includes：It is calculated according to the left view of first object and right view described in determining The distance of display unit described in first object distance.

Optionally, first collecting unit be depth camera, then it is described according to it is described first operation, determine second away from From, including：

Depth camera determines second distance according to acquisition and the relevant position data of first operation.

Optionally, first operation is clicking operation or slide, then described according to first operation, determines the Two distances, including：

Determine the action type of first operation；

When the action type of first operation is slide, the sliding trace information of the slide is determined；

The distance range of second distance is determined according to the sliding trace information；

According to the distance range of first distance and the second distance, determine that the control for first object refers to It enables.

Optionally, before the determining control instruction, further include：

Judge whether the difference of first distance and the second distance is less than preset value；

When the difference is less than preset value, control instruction is determined into according to first distance and the second distance The step of.

A kind of data processing equipment, is applied to electronic equipment, and the electronic equipment is adopted including at least display unit and first Collecting unit, the display unit is used to that the viewer outside first surface to be enable to perceive the image outside second surface, The first surface and the second surface are the opposite outer surfaces of the electronic equipment；First collecting unit is for detecting The operation of operating body outside the second surface；Described device includes:

Display module, for showing the first image by the display unit with the first display parameters；Wherein, described first Display parameters make viewer when watching the display unit, perceive and are shown described in the first object distance in described first image Show that the distance of unit is the first distance；

Acquisition module is operated, is used for through the first collecting unit acquisition operations body acupuncture to the first of first object Operation；

Operating distance determining module, for according to first operation, determining second distance；Wherein, the second distance Distance of the operating position operated for described first apart from first collecting unit；

Determining module is instructed, for according to first distance and the second distance, determining control instruction；

Respond module is instructed, for responding the control instruction, the second image is shown with the second display parameters, described first Image and second image difference.

Optionally, the display module is specifically used for：

The first image is shown with the first display parameters so that the first distance is within a preset range by the display unit.

Optionally, further include：

Correction parameter determining module, for described instruction determining module according to first distance and described second away from From before determining control instruction, determining the distance between the display unit and first collecting unit difference；

Then described instruction determining module includes：

Difference correction module, for being corrected between first distance and the second distance using the distance difference Difference relationship；

Directive generation module, for determining control instruction according to the difference relationship after first distance and correction.

Optionally, described first image includes left view and right view, and the display unit includes the first display subelement With the second display subelement, wherein the first display subelement is used to show the left view of first object, the second display Subelement is used to show the right view of first object, then the data processing equipment further includes：

First apart from determining module, for determining first distance；Described first is specifically used for apart from determining module：Root The distance for determining display unit described in first object distance is calculated according to the left view and right view of first object.

Optionally, first collecting unit includes two sub- collecting units, and described two sub- collecting units are for distinguishing The left view and right view outside the second surface are acquired, then the operating distance determining module includes：

View acquisition module distinguishes the left view of collected first operation for obtaining described two sub- collecting units Figure and right view；

Operating position determining module, left view and right view for being operated according to described first determine first operation Spatial position；

Operating distance determination sub-module, for determining described in first operating distance that first adopts according to the spatial position Collect the distance of unit.

Optionally, it is described first operation be clicking operation or slide, then the operating distance determining module include：

Action type determining module, the action type for determining first operation；

Track determining module, for the action type determining module determine it is described first operation be slide when, Determine the sliding trace information of the slide；

Distance range determining module, the distance range for determining second distance according to the sliding trace information；

Then described instruction determining module is specifically used for：According to the distance range of first distance and the second distance, Determine the control instruction for first object.

Optionally, further include：

Difference determining module, for before described instruction determining module determines control instruction, judge first distance and Whether the difference of the second distance is less than preset value.

A kind of electronic equipment, including：

Fixing device, for maintaining at least part of relative position relation of the electronic equipment and user head；

Display, the display are located at user and dress in the visible area of the eyes after the electronic equipment, be used for The first image is shown with the first display parameters, and the viewer outside display first surface is enable to perceive positioned at display The first image outside second surface；Wherein, first display parameters make viewer when watching the display, perceive institute The distance for stating display described in the first object distance in the first image is the first distance；The display includes that two displays are single Member, position of described two display units after user dresses the electronic equipment respectively with the left eye eyeball of the user and Right eye eyeball is corresponding；

Collector, for detecting first behaviour of the operating body outside the display second surface for first object Make；

Processor, for according to first operation, determining second distance；According to first distance and described second away from From determining control instruction；And the control instruction is responded, show the second image with the second display parameters；Wherein, described second away from The distance of first collecting unit with a distance from the operating position for first operation；Described first image and second figure As different.

Optionally, the collector includes two cameras, and described two cameras are separately positioned on described two displays On the frame of unit, and the line of symmetry relative to described two display units is symmetrical, and the electronics is dressed for acquiring user Image information in the visible area of eyes after equipment.

It can be seen via above technical scheme that compared with prior art, the embodiment of the invention discloses a kind of data processings Method, apparatus and a kind of electronic equipment, the data processing method are applied to electronic equipment, which includes display unit With the first collecting unit, display unit enables the viewer outside first surface to perceive the figure outside second surface Picture, the first collecting unit can detect the operation of the operating body outside second surface, and this method determines the second of user's perception first Then first distance of the image distance display unit outside surface determines operating body outside second surface for the figure of user's perception The second distance of the first collecting unit of operating distance of picture, finally according to determining the first distance, second distance and preset configuration It generates and response control instructs.Disclosed data processing method, device and electronic equipment through the embodiment of the present invention so that user Directly the things in the three-dimensional interface of display can be operated with hand, realizes three-dimensional interaction, improve user and electronics is set Standby man-machine interaction experience sense.

Description of the drawings

In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this The embodiment of invention for those of ordinary skill in the art without creative efforts, can also basis The attached drawing of offer obtains other attached drawings.

Fig. 1 is the flow chart of data processing method disclosed by the embodiments of the present invention；

Fig. 2 is the flow chart of determining second distance disclosed by the embodiments of the present invention；

Fig. 3 is the flow chart of another data processing method disclosed by the embodiments of the present invention；

Fig. 4 is the flow chart of another data processing method disclosed by the embodiments of the present invention；

Fig. 5 is the structural schematic diagram of data processing equipment disclosed by the embodiments of the present invention；

Fig. 6 is the structural schematic diagram of operating distance determining module disclosed by the embodiments of the present invention；

Fig. 7 is the structural schematic diagram of another data processing equipment disclosed by the embodiments of the present invention；

Fig. 8 is the structural schematic diagram disclosed by the embodiments of the present invention there are one data processing equipment；、

Fig. 9 is the appearance assumption diagram of a kind of electronic equipment disclosed by the embodiments of the present invention.

Specific implementation mode

Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation describes, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall within the protection scope of the present invention.

Fig. 1 is the flow chart of data processing method disclosed by the embodiments of the present invention, and this method is applied to electronic equipment, described Electronic equipment includes at least display unit and the first collecting unit, and the display unit is used to make the viewing outside first surface Person can perceive the image outside second surface, and the first surface and the second surface are that the electronic equipment is opposite Outer surface, first collecting unit is used to detect the operation of the operating body outside the second surface, shown in Figure 1, described Data processing method may include：

Step 101：The display unit shows the first image with the first display parameters；

Wherein, first display parameters make viewer when watching the display unit, perceive described first image In the first object distance described in display unit distance be the first distance.Since all stereoscopic image file data are to make Make or generate just to have had determined when the stereoscopic image data, therefore, when presenting, distance is thrown for each stereo-picture What the distance of shadow equipment was also to determine, in this way, the distance for the first object that user is perceived by the display unit is also true Fixed, in other words, the first distance described in the present embodiment is numerical value known to system.

First display parameters it is required that display unit described in the first object distance after display first apart from position In in preset range, so that operating body, the i.e. hand of user or other users can hold the entity devices such as the triggering pen of control, Relevant operation can be carried out by the first image that the electronic equipment is seen to user.According to the practical application field of this method The preset range can be determined as 5-100cm by scape.Directly electronic equipment is presented with finger due to user's general custom Can interactive object carry out trigger action, and the arm length of user is usually in 60-80cm, therefore, from the aspect of physiological structure, For the ease of user's operation, the preset range can be preferably 10-30cm.Certainly, there is no fixed for the preset range Limit value can specifically be directed to the electronic equipment that different types of user sets different parameters standard, the electronic equipment of various criterion In the preset range of the first different distances can be set, to meet the custom and hobby of different user.

It should be noted that for rendering the display parameters of the first image can also there are many, different display parameters can So that user by the first image that the electronic equipment perceives there is different presentations to fill state, such as different displays Parameter can make user perceive the difference of the first image far and near distance, the difference of left and right position, difference, the thickness of side view angle Difference of degree etc..

In the present embodiment, it is contemplated that the arm length of different user may be different from, therefore in order to adapt to different use Family, needs to configure the display parameters with different parameters standard, and the display parameters of different parameters standard can be such that user perceives Image be presented on different spatial positions, for example, for a same icon image, the display parameters of the first parameter and standard So that user perceives at the 30cm before the icon image is located at the display unit, the display parameters of the second parameter and standard to use Family perceives at the 40cm before icon image is located at the display unit.In a variety of displays for being pre-configured with the first image for rendering When parameter, the perceived distance of the first image can be made to have than broad range, for example, described first image for rendering A variety of display parameters the first image that user can be made to perceive be at multiple positions or arbitrary within the scope of 10-60cm Subsequently first figure can be presented to automatically determine according to the physiological characteristic of user in position using which display parameters Picture.As a result, before step 101 shows the first image with the first display parameters, it can also include detection predefined operation, determine behaviour Then the step of making the maximum operating distance of body selects the first display parameters, here institute further according to determining maximum operating distance The first display parameters stated can be that system is that the first image that user's selection is suitble to user to perceive it is operated automatically Display parameters.Wherein, the predefined operation can acquire user when extending straight forward arm, and finger tip is single apart from the display The maximum operating distance of the distance of member, the distance namely operating body.For example, system detectio to user when extending straight forward arm, Distance of the finger tip apart from the display unit is 50cm, and a variety of display parameters of described first image can use for rendering The first image that family perceives is at multiple positions within the scope of 30-50cm, then will user can be felt at this time The display parameters of display unit 40cm described in the first image distance known are determined as the first display parameters.

Further, base of principle of human engineering is based on, in order to allow users to being perceived to it for more comfort and convenient Image in solid space is operated, and after above-mentioned detection predefined operation, the maximum operating distance for determining operating body, may be used also The 20%-80% of the maximum operating distance is determined as comfortable operation range, thus in follow-up determining first display parameters, Ensure that the first image that first display parameters can be such that user perceives is within the scope of the comfortable operation.In this way The distance for allowing for the first image distance display unit of user's perception is between the 20%-80% of user's arm length, user It operates also pleasant random.

Certainly, in practical application, user can also manually select according to own characteristic is suitble to the display parameters of oneself.Specifically Can be that user is manually entered the indication range of oneself the first desired image, then system after starting the electronic equipment It can be automatically found corresponding one or more display parameters according to indication range input by user, and can be selected according to default principle Best image parameter is selected as the first display parameters.

Step 102：First operation of the first collecting unit acquisition operations body acupuncture to first object；

First collecting unit can be depth camera, which can be TOF camera, be passed through by calculating The transmitting of the near infrared light of modulation and reflection interval difference or phase difference, converse the distance of subject, and generate depth Information.The depth camera can also be structure light scan camera or dual-camera, i.e. dual camera camera.Wherein, it ties The operation principle of structure optical scanning camera can be simply expressed as：Using structured light three-dimensional vision technology, surveyed based on optic triangle method Principle is measured, by optical projection device by the project structured light of certain pattern in body surface, and is formed on the surface by measured object The striation 3-D view that body surface shape is modulated, the 3-D view is by the camera detection in another location, to obtain Striation two dimension fault image, and the three-dimensional shaped that body surface is further reappeared according to two-dimentional fault image is wide, determines depth information； The operation principle of dual camera camera can be simply expressed as：The object arrived according to two camera acquisitions in different location The location information of image and dual camera determines the three-dimensional depth of object according to Space Theory knowledge.Due to above-mentioned several depth Camera realizes that the technology of depth survey is all to have also been employed that realization in the prior art, therefore, no longer specific to its herein Operation principle, which is done, to be excessively discussed in detail.

Step 103：According to first operation, second distance is determined；

Wherein, the second distance is distance of the operating position of first operation apart from first collecting unit. It has already described above, first collecting unit can be depth camera, then the step 103 can be specifically：Depth is taken the photograph As head determines second distance according to acquisition and the relevant position data of first operation.

It is understood that first operation can be conventional clicking operation or slide.In first behaviour When as clicking operation, adopted apart from described first specifically, the second distance can be finger tip of the user when triggering image Collect the distance of unit.For example, user is perceived by the display unit in space, there are a folder icons, at this moment, lead to It crosses the file that quick double-click on operation can be perceived to open, correspondingly, system is receiving and identifying the operation Afterwards, relevant response can be made to the operation, that is, opens the file, and the data in the file are presented for user. And when first operation is slide, tool is there are one sliding trace, and the related data of this sliding trace can be with It is stereoscopic three-dimensional data, at this moment, distance of the slide apart from a first collecting unit just not instead of definite value, One value range.This gives a schematical realization methods of step 103 as a result,.Fig. 2 is the embodiment of the present invention The flow chart of disclosed determining second distance, as shown in Fig. 2, determining second distance specifically may include according to the first operation：

Step 201：Determine the action type of first operation；

Step 202：When the action type of first operation is slide, the sliding rail of the slide is determined Mark information；

The sliding trace information can be the three-dimensional trace information in space, for example, user passes through the display unit There are one beads at the eyes 30cm of perceived distance oneself, can choose the bead with finger first, and choose institute in finger It states and is dragged at the eyes 40cm apart from oneself in the state of bead, certainly, in addition to bead depth distance eyes of user Becoming outside the pale of civilization, user can also by the bead, left and right drags in the visual range of user simultaneously, in the operable range of user, The no any restrictions of variation of bead depth location and left and right position.The sliding trace information can be user's triggering as a result, Its perception can interactive object multiple spatial coordinated informations set, by space multistory indication, each space is sat It may include three numerical value to mark information, can be determined as X axis coordinate value, Y axis coordinate value and Z axis coordinate value herein.Its In, X axis coordinate value and Y axis coordinate value can determine can interactive object can in the plane parallel with eyes that user perceives The location of interactive object, Z axis coordinate value can determine it is described can be between interactive object and display unit or eyes of user Distance.Since user is after wearing the electronic equipment, in general eyes are to be in an error at a distance from display unit In the range of very little, therefore as, eyes can be regarded to a fixed value at a distance from display unit, and electronic equipment itself also can User's perceptual image is enough obtained at a distance from display unit, to determine above-mentioned interact according to the sliding trace information The distance of object distance eyes of user.

Step 203：The distance range of second distance is determined according to the sliding trace information.

Front has also made referrals to, and the sliding trace information may include the set of multiple spatial coordinated informations, and every The numerical value that one spatial coordinated information includes can also be different, therefore, the operating position distance for stating the first operation finally determined The distance namely second distance of first collecting unit are not a fixed value, but a distance range.Continue with For bead in the space of above-mentioned user's perception, if in sliding trace information, the X-axis in all spatial coordinated informations is sat Scale value and Y axis coordinate value are all identical, and only Z axis coordinate value differs, and value is between 30cm-40cm, and it is by small to change To big, then illustrate the actual operation of user be the bead is dragged it is farther apart from eyes, subsequently then can be according in system The glide direction and distance of preset slide and the correspondence of control instruction determine the corresponding control of the slide Instruction, and determining control instruction is further executed, to respond user's operation.

Fig. 1 is gone back to, after step 103, enters step 104.

Step 104：According to first distance and the second distance, control instruction is determined；

The electronic equipment can determine that the image distance of user's perception shows list according to the stereoscopic image data in system First distance of member can also detect the second distance of first the first collecting unit of operating distance by the first collecting unit, by This, the operation object of user's triggering can be determined according to second distance, and first operation can be determined according to preset configuration Corresponding control instruction.

Step 105：The control instruction is responded, the second image is shown with the second display parameters.

Wherein, described first image and second image difference.Second display parameters can be shown with described first Show that parameter is identical, it can also be different from first display parameters.In first display parameters and second display parameters When identical, the first object that user perceives can realize the change of left and right position in the plane apart from eyes of user fixed range It changes or interacts, i.e., space coordinate pertains only to the variation of X axis coordinate value and Y axis coordinate value, is not related to the variation of Z axis coordinate value；And When first display parameters and the second display parameters differ, the first object that user perceives can be apart from user's eye Realize that far and near or front and back position variation or interaction, i.e. space coordinate are centainly related to Z axis coordinate in the plane of eyeball different distance The variation of value, while the variation of X axis coordinate value and Y axis coordinate value can be related to, X axis coordinate value can not also be related to and Y-axis is sat The variation of scale value.

In the present embodiment, the data processing method determines that the image distance outside the second surface of user's perception is shown first Then first distance of unit determines that operating body acquires outside second surface for the operating distance first of the image of user's perception The second distance of unit finally generates according to determining the first distance, second distance and preset configuration and response control instructs, from And the interaction of user and space multistory image are realized, improve the man-machine interaction experience sense of user and electronic equipment.

On the basis of the above disclosed embodiments of the present invention, the invention also discloses another data processing methods.By In in the above-described embodiments, the first distance is the distance between display unit and the first object, second distance be the first operation and The distance between first collecting unit, finally determining control instruction is to be determined according to the first distance and second distance, and show Show unit and the different function module of the first collecting unit data, there is no unified for first distance and the second distance Measuring basis, therefore, in order to enable finally determining control instruction is more accurate, it can be to first distance and described second Distance is corrected, so that first distance and the second distance have same measuring basis.Fig. 3 is that the present invention is real The flow chart of another data processing method disclosed in example is applied, it is shown in Figure 3, the method may include：

Step 301：The display unit shows the first image with the first display parameters；

Wherein, first display parameters make viewer when watching the display unit, perceive described first image In the first object distance described in display unit distance be the first distance.

Step 302：First operation of the first collecting unit acquisition operations body acupuncture to first object；

Step 303：According to first operation, second distance is determined；

Wherein, the second distance is distance of the operating position of first operation apart from first collecting unit.

Step 304：Determine the distance between the display unit and first collecting unit difference；

Although the display unit and first collecting unit are included among the electronic equipment, still, relatively For the eyes of user, front and back position might have difference, for example, the electronic equipment is wearable intelligent glasses, institute Two eyeglasses that display unit is the wearable intelligent glasses are stated, and first collecting unit is for acquiring the electricity Therefore the unit of the first operation outside sub- equipment second surface may be arranged in the outside of two eyeglasses namely above-mentioned implementation Outside the second surface of electronic equipment described in example, therefore, the display unit may be away from relative to first collecting unit Eyes from user more recently, have distance difference between the display unit and first collecting unit, and at this time the One distance is different with the measuring basis of the second distance, for the ease of correction, needs to determine the display unit and institute first State the distance between the first collecting unit difference.

Step 305：Difference relationship between first distance and the second distance is corrected using the distance difference；

If the display unit is relative to first collecting unit closer to the eyes of user, first distance It is equivalent to when determining and has added a distance than the second distance, this segment distance is the display unit and described first The distance between collecting unit difference.Such as the difference between first distance and the second distance is 2cm, and it is described aobvious Show that the distance between unit and first collecting unit are after 0.5cm, then first distance and the second distance are corrected Difference be 2-0.5=1.5cm.

Step 306：Control instruction is determined according to the difference relationship after first distance and correction；

According to first object relative to after the position of the display unit, correction the first distance and described second away from Difference relationship between and preset configuration, so that it may to determine for first object, corresponding with first operation Control instruction.

Step 307：The control instruction is responded, the second image is shown with the second display parameters.

In the present embodiment, the data processing method is directed to the position between display unit and the first collecting unit not Together, the difference relationship between the first distance and second distance is corrected, and in the final control instruction of determination, foundation The difference relationship of the first distance and second distance after first distance and correction, therefore, the accuracy of obtained control instruction increase Height is conducive to the three-dimensional interactive experience for promoting user.

In other examples, the step of determining control instruction before, can also include judge first distance with The step of whether difference of the second distance is less than preset value, and when the difference is less than preset value, into according to the The step of one distance and second distance determine control instruction.The control that such flow is also to ensure finally to determine refers to Enabling has higher accuracy.If first distance and the difference of the second distance are more than preset value, may explanation Maloperation occurs by user or it wants the object of triggering and its practical object triggered is inconsistent, and in this case, electronics is set It is standby to respond, or the response made may not be what user wanted, therefore, only first distance with In the case that the difference of the second distance is less than preset value, enters back into and determine control instruction according to the first distance and second distance The step of.

In above-mentioned each embodiment, the described first image of user's perception may include left view and right view, left view Figure and right view are projected respectively by two projection devices in different location, to finally determine described first image Spatial position.The display unit may include the first display unit and the second display unit as a result, wherein the first display Unit is used to show the left view of first object, and the right side that the second display unit is displayed for first object regards Figure.For example, user's eyes, which are perceived by the electronic equipment at the display unit 50cm described in the positional distance of middle, one A bead perceives the bead relative to centre position when user closes left eye, only watches the electronic equipment with right eye It is to the left, and can not determine general distance of the bead apart from oneself；When user closes right eye, only the electronic equipment is watched with left eye When, it perceives that the bead is to the right relative to centre position, equally can not also determine Position Approximate of the bead apart from oneself.Only Have when the left eye of user and right eye watch the electronic equipment simultaneously, can determine the general spatial position of the bead.

Based on the above, the embodiment of the invention discloses the flow charts of another data processing method, referring to Fig. 4 institutes Show, the data processing method may include：

Step 401：The display unit shows the first image with the first display parameters；

Step 402：Determine first distance；

When not having the related data of the space length of the first object of record and position in the system of the electronic equipment, it is System can also calculate the spatial display location information for determining first object according to the given data of first object.Specifically , step 402 can be：It is calculated and is determined described in first object distance according to the left view of first object and right view The distance of display unit.According to space multistory knowledge, left view and right view can be overlapped in intersection, and it is aobvious that fusion forms space Diagram picture.It, can according to the relevant parameter, such as projection angle, projector distance of left view and right view etc. of first object The space length of display unit described in first object distance is calculated.

Step 403：First operation of the first collecting unit acquisition operations body acupuncture to first object；

Step 404：According to first operation, second distance is determined；

Step 405：According to first distance and the second distance, control instruction is determined；

Step 406：The control instruction is responded, the second image is shown with the second display parameters.

Wherein, described first image and second image difference.

In the present embodiment, electronic equipment can be according to known file data in system, that is, a left side for the stereo-picture presented The related data of view and right view determine its present stereo-picture spatial display position and distance, i.e. the first distance, from And convenient for subsequently determining control instruction according to first distance and other data, realize the solid of user and stereoscopic display interface Interaction.

Method is described in detail in aforementioned present invention disclosed embodiment, diversified forms can be used for the method for the present invention Device realize that therefore the invention also discloses a kind of devices, and specific embodiment is given below and is described in detail.

Fig. 5 is the structural schematic diagram of data processing equipment disclosed by the embodiments of the present invention, which is applied to Electronic equipment, the electronic equipment include at least display unit and the first collecting unit, and the display unit is for making in the Viewer outside one surface can perceive the image outside second surface, and the first surface and the second surface are described The opposite outer surface of electronic equipment；First collecting unit is used to detect the operation of the operating body outside the second surface, ginseng As shown in Figure 5, the data processing equipment 50 may include：

Display module 501, for showing the first image by the display unit with the first display parameters；

The display module 501 specifically can be used for：By the display unit the first figure is shown with the first display parameters Picture so that first apart within a preset range, so that operating body, the i.e. hand of user or other users can hold touching for control The entity devices such as pen are sent out, relevant operation can be carried out by the first image that the electronic equipment is seen to user.According to the party The preset range can be determined as 5-100cm by the practical application scene of method.

Since the arm length of different user may be different from, in order to adapt to different users, tool is needed to configure There are the display parameters of different parameters standard, the image that the display parameters of different parameters standard can be such that user perceives is presented on not Same spatial position can make the sense of the first image when being pre-configured with a variety of display parameters of the first image for rendering Know that distance has than broad range, subsequently which display ginseng can be used to automatically determine according to the physiological characteristic of user It counts described first image is presented.As a result, in other examples, can also include detection module, it is predefined for detecting Operation, determines the maximum operating distance of operating body, then selects the first display parameters further according to determining maximum operating distance.This In first display parameters can be system be that the first image that the suitable user of user's selection perceives it is grasped automatically The display parameters of work.Wherein, the predefined operation can acquire user when extending straight forward arm, and finger tip is apart from described aobvious Show the distance of unit, the maximum operating distance of the distance namely operating body.

Acquisition module 502 is operated, is used for through the first collecting unit acquisition operations body acupuncture to first object First operation；

First collecting unit can be depth camera, which can be TOF camera, can also be knot Structure optical scanning camera or dual-camera, i.e. dual camera camera.

Operating distance determining module 503, for according to first operation, determining second distance；

Wherein, the second distance is distance of the operating position of first operation apart from first collecting unit. It has already described above, first collecting unit can be depth camera, then the operating distance determining module 503 specifically may be used For：Depth camera determines second distance according to acquisition and the relevant position data of first operation.

It is understood that first operation can be conventional clicking operation or slide.In first behaviour When as clicking operation, adopted apart from described first specifically, the second distance can be finger tip of the user when triggering image Collect the distance of unit.And when first operation is slide, tool is there are one sliding trace, and this sliding trace Related data can be stereoscopic three-dimensional data, and at this moment, distance of the slide apart from first collecting unit is not just One definite value, but a value range.This gives a signals of the operating distance determining module 503 as a result, Property structure, shown in Figure 6, the operating distance determining module 503 may include：

Action type determining module 601, the action type for determining first operation；

Track determining module 602, for determining that first operation is slide in the action type determining module When, determine the sliding trace information of the slide；

The sliding trace information can be the three-dimensional trace information in space, and the sliding trace information can be user Its perception of triggering can interactive object multiple spatial coordinated informations set, by space multistory indication, each is empty Between coordinate information may include three numerical value, X axis coordinate value, Y axis coordinate value and Z axis coordinate can be determined as herein Value.Wherein, can determine can flat parallel with eyes of perceive in user one of interactive object for X axis coordinate value and Y axis coordinate value In face can the location of interactive object, Z axis coordinate value can determine it is described can interactive object and display unit or eyes of user The distance between.Since user is after wearing the electronic equipment, in general eyes are to be in one at a distance from display unit In the range of a error very little, therefore as, eyes can regard to a fixed value at a distance from display unit, and electronic equipment sheet Body can also obtain user's perceptual image at a distance from display unit, above-mentioned to be determined according to the sliding trace information It can distance of the interactive object apart from eyes of user.

Distance range determining module 603, the distance range for determining second distance according to the sliding trace information.

Front has also made referrals to, and the sliding trace information may include the set of multiple spatial coordinated informations, and every The numerical value that one spatial coordinated information includes can also be different, therefore, the operating position distance for stating the first operation finally determined The distance namely second distance of first collecting unit are not a fixed value, but a distance range.

In another example, first collecting unit may include two sub- collecting units, and described two sons are adopted Collection unit is used to acquire the left view and right view outside the second surface respectively, then the operating distance determining module 503 can To include：View acquisition module distinguishes the left view of collected first operation for obtaining described two sub- collecting units Figure and right view；Operating position determining module, left view and right view for being operated according to described first determine described first The spatial position of operation；Operating distance determination sub-module, for determining the first operating distance institute according to the spatial position State the distance of the first collecting unit.

Determining module 504 is instructed, for according to first distance and the second distance, determining control instruction；

In the case where first operation is slide, described instruction determining module 504 specifically can be used for：Foundation The distance range of first distance and the second distance determines the control instruction for first object.

Instruction respond module 505 shows the second image for responding the control instruction with the second display parameters.

In the present embodiment, the data processing equipment determines that the image distance outside the second surface of user's perception is shown first Then first distance of unit determines that operating body acquires outside second surface for the operating distance first of the image of user's perception The second distance of unit finally generates according to determining the first distance, second distance and preset configuration and response control instructs, from And the interaction of user and space multistory image are realized, improve the man-machine interaction experience sense of user and electronic equipment.

On the basis of the above disclosed embodiments of the present invention, the invention also discloses another data processing equipments.By In in the above-described embodiments, the first distance is the distance between display unit and the first object, second distance be the first operation and The distance between first collecting unit, finally determining control instruction is to be determined according to the first distance and second distance, and show Show unit and the different function module of the first collecting unit data, there is no unified for first distance and the second distance Measuring basis, therefore, in order to enable finally determining control instruction is more accurate, it can be to first distance and described second Distance is corrected, so that first distance and the second distance have same measuring basis.Fig. 7 is that the present invention is real The structural schematic diagram of another data processing equipment disclosed in example is applied, shown in Figure 7, the data processing equipment 70 can wrap It includes：

Correction parameter determining module 701, for determining the distance between the display unit and first collecting unit Difference；

Difference correction module 702, for using the distance difference correct first distance and the second distance it Between difference relationship；

If the display unit is relative to first collecting unit closer to the eyes of user, first distance It is equivalent to when determining and has added a distance than the second distance, this segment distance is the display unit and described first The distance between collecting unit difference.

Directive generation module 703, for determining control instruction according to the difference relationship after first distance and correction；

Instruction respond module 505 shows the second image for responding the control instruction with the second display parameters, described First image and second image difference.

In the present embodiment, the data processing equipment is directed to the position between display unit and the first collecting unit not Together, the difference relationship between the first distance and second distance is corrected, and in the final control instruction of determination, foundation The difference relationship of the first distance and second distance after first distance and correction, therefore, the accuracy of obtained control instruction increase Height is conducive to the three-dimensional interactive experience for promoting user.

In other examples, it can also include difference determining module, be controlled for being determined in described instruction determining module Before system instruction, judge whether the difference of first distance and the second distance is less than preset value.It is less than in the difference pre- If when value, described instruction determining module 504 determines control instruction.It can also ensure that the control instruction finally determined has more in this way High accuracy.If first distance and the difference of the second distance are more than preset value, it may illustrate user The object and its practical object triggered of maloperation or its desired triggering are inconsistent, and in this case, electronic equipment may not It can respond, or the response made may not be what user wanted, therefore, only in first distance and described second In the case that the difference of distance is less than preset value, the step of determining control instruction according to the first distance and second distance is entered back into.

Based on the above, the embodiment of the invention discloses the structural schematic diagrams of another data processing equipment, referring to Fig. 8 Shown, the data processing equipment 80 may include：

First apart from determining module 801, for determining first distance；

When not having the related data of the space length of the first object of record and position in the system of the electronic equipment, it is System can also calculate the spatial display location information for determining first object according to the given data of first object.It is described First is specifically used for apart from determining module 801：It is calculated according to the left view of first object and right view and determines described first The distance of display unit described in object distance.According to space multistory knowledge, left view and right view can be overlapped in intersection, be melted Conjunction forms spatial display image.According to the relevant parameter of the left view and right view of first object, such as projection angle, throwing Shadow distance etc., can be calculated the space length of display unit described in first object distance.

Fig. 9 is the appearance assumption diagram of a kind of electronic equipment disclosed by the embodiments of the present invention, shown in Figure 9, the electronics Equipment may include：

Fixing device 901, for maintaining at least part of relative position relation of the electronic equipment and user head；

The electronic equipment can be that head-wearing type intelligent equipment uses, institute such as wearable intelligent glasses in order to facilitate user It states electronic equipment and needs to include that the electronic equipment can be fixed on to the fixing device of user's head, such as spectacle frame or elastic Shroud.

Display 902, the display are located at user and dress in the visible area of the eyes after the electronic equipment, use In showing the first image with the first display parameters, and the viewer outside display first surface is enable to perceive positioned at display The first image outside device second surface；Wherein, first display parameters make viewer when watching the display, perception The distance of display described in the first object distance in described first image is the first distance；The display includes two displays Unit, position of described two display units after user dresses the electronic equipment respectively with the left eye eyeball of the user It is corresponding with right eye eyeball；

Specifically, the display may include two projection devices, left view for projecting an image respectively and Right view makes the two cross on the outside of head-wearing type intelligent equipment, and user is made to perceive the display of described image in space.Its Described in two display units can be wearable intelligent glasses two eyeglasses.

Collector 903, be directed to first object for detecting the operating body outside the display second surface first Operation；

The collector 903 may include two cameras, and described two cameras can be separately positioned on described two On the frame of display unit, and the line of symmetry relative to described two display units is symmetrical, for acquiring described in user's wearing Image information in the visible area of eyes after electronic equipment.

By the way that the picture in the collected same target different angle of camera of different location is arranged, determination can be calculated The spatial position of the target.

Processor 904, for according to first operation, determining second distance；According to first distance and described Two distances, determine control instruction；And the control instruction is responded, show the second image with the second display parameters；Wherein, described Two distances are distance of the operating position of first operation apart from first collecting unit；Described first image and described Two images are different.

In the present embodiment, the electronic equipment can determine the image distance display unit outside the second surface of user's perception The first distance, then determine operating body outside second surface for user perception image the first collecting unit of operating distance Second distance, finally generated according to determining first distance, second distance and preset configuration and response control instruct, to real The interaction for having showed user and space multistory image improves the man-machine interaction experience sense of user and electronic equipment.

Each embodiment is described by the way of progressive in this specification, the highlights of each of the examples are with other The difference of embodiment, just to refer each other for identical similar portion between each embodiment.For device disclosed in embodiment For, since it is corresponded to the methods disclosed in the examples, so description is fairly simple, related place is said referring to method part It is bright.

It should also be noted that, herein, relational terms such as first and second and the like are used merely to one Entity or operation are distinguished with another entity or operation, without necessarily requiring or implying between these entities or operation There are any actual relationship or orders.Moreover, the terms "include", "comprise" or its any other variant are intended to contain Lid non-exclusive inclusion, so that the process, method, article or equipment including a series of elements is not only wanted including those Element, but also include other elements that are not explicitly listed, or further include for this process, method, article or equipment Intrinsic element.In the absence of more restrictions, the element limited by sentence "including a ...", it is not excluded that There is also other identical elements in process, method, article or equipment including the element.

The step of method described in conjunction with the examples disclosed in this document or algorithm, can directly be held with hardware, processor The combination of capable software module or the two is implemented.Software module can be placed in random access memory（RAM）, memory, read-only deposit Reservoir（ROM）, electrically programmable ROM, electrically erasable ROM, register, hard disk, moveable magnetic disc, CD-ROM or technology In any other form of storage medium well known in field.

The foregoing description of the disclosed embodiments enables those skilled in the art to implement or use the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, as defined herein General Principle can be realized in other embodiments without departing from the spirit or scope of the present invention.Therefore, of the invention It is not intended to be limited to the embodiments shown herein, and be to fit to cause with the principles and novel features disclosed herein Widest range.

Claims

1. a kind of data processing method is applied to electronic equipment, which is characterized in that the electronic equipment includes at least display unit With the first collecting unit, the display unit is used to that the viewer outside first surface to be enable to perceive outside second surface Image, the first surface and the second surface are the opposite outer surfaces of the electronic equipment；First collecting unit Operation for detecting the operating body outside the second surface；The method includes：

The display unit shows the first image with the first display parameters, wherein first display parameters make viewer exist When watching the display unit, perceive described first image in the first object distance described in display unit distance be first away from From；

First operation of the first collecting unit acquisition operations body acupuncture to first object；First operation is dragging behaviour Make；

According to first operation, second distance is determined；Wherein, the second distance be it is described first operation operating position away from With a distance from first collecting unit；

The control instruction is responded, shows the second image with the second display parameters, described first image and second image are not It together, can be so that first object implementatio8 that perceives of the viewer be far and near or the variation or interaction of front and back position.

2. data processing method according to claim 1, which is characterized in that the display unit is aobvious with the first display parameters Show the first image, including：

3. data processing method according to claim 1, which is characterized in that described according to first distance and described Second distance before determining control instruction, further includes：

4. data processing method according to claim 1, which is characterized in that described first image includes that left view and the right side regard Figure, the display unit include the first display subelement and the second display subelement, wherein the first display subelement is used for Show the left view of first object, the second display subelement is used to show the right view of first object, then described After display unit shows the first image with the first display parameters, further include：

Determine first distance；

Determination first distance includes：It is calculated according to the left view of first object and right view and determines described first The distance of display unit described in object distance.

5. data processing method according to claim 1, which is characterized in that first collecting unit is depth camera Head, then it is described to determine second distance according to first operation, including：

6. data processing method according to claim 1, which is characterized in that first operation is clicking operation or sliding Operation, then it is described to determine second distance according to first operation, including：

Determine the action type of first operation；

According to the distance range of first distance and the second distance, the control instruction for first object is determined.

7. data processing method according to claim 1, which is characterized in that before the determining control instruction, further include：

When the difference is less than preset value, into the step for determining control instruction according to first distance and the second distance Suddenly.

8. a kind of data processing equipment is applied to electronic equipment, which is characterized in that the electronic equipment includes at least display unit With the first collecting unit, the display unit is used to that the viewer outside first surface to be enable to perceive outside second surface Image, the first surface and the second surface are the opposite outer surfaces of the electronic equipment；First collecting unit Operation for detecting the operating body outside the second surface；Described device includes:

Display module, for showing the first image by the display unit with the first display parameters；Wherein, first display Parameter makes viewer when watching the display unit, perceives and shows list described in the first object distance in described first image The distance of member is the first distance；

Acquisition module is operated, for the first behaviour by the first collecting unit acquisition operations body acupuncture to first object Make；First operation is drag operation；

Operating distance determining module, for according to first operation, determining second distance；Wherein, the second distance is institute State distance of the operating position of the first operation apart from first collecting unit；

Instruction respond module shows the second image, described first image for responding the control instruction with the second display parameters It is different with second image, it can be so that first object implementatio8 that perceives of the viewer be far and near or front and back position Variation or interaction.

9. data processing equipment according to claim 8, which is characterized in that the display module is specifically used for：

10. data processing equipment according to claim 8, which is characterized in that further include：

Correction parameter determining module is used in described instruction determining module according to first distance and the second distance, really Before determining control instruction, the distance between the display unit and first collecting unit difference are determined；

Then described instruction determining module includes：

Difference correction module, for correcting the difference between first distance and the second distance using the distance difference Relationship；

11. data processing equipment according to claim 8, which is characterized in that described first image includes left view and the right side View, the display unit include the first display subelement and the second display subelement, wherein the first display subelement is used In the left view for showing first object, the second display subelement is used to show the right view of first object, then described Data processing equipment further includes：

First apart from determining module, for determining first distance；Described first is specifically used for apart from determining module：According to institute The left view and right view for stating the first object calculate the distance for determining display unit described in first object distance.

12. data processing equipment according to claim 8, which is characterized in that first collecting unit includes two sons Collecting unit, described two sub- collecting units are used to acquire the left view and right view outside the second surface respectively, then described Operating distance determining module includes：

View acquisition module, for obtain described two sub- collecting units distinguish it is collected it is described first operation left view and Right view；

Operating position determining module, left view and right view for being operated according to described first determine the sky of first operation Between position；

Operating distance determination sub-module, for determining that the first acquisition described in first operating distance is single according to the spatial position The distance of member.

13. data processing equipment according to claim 8, which is characterized in that first operation is clicking operation or cunning Dynamic operation, then the operating distance determining module includes：

Track determining module, for when the action type determining module determines that first operation is slide, determining The sliding trace information of the slide；

Then described instruction determining module is specifically used for：According to the distance range of first distance and the second distance, determine For the control instruction of first object.

14. data processing equipment according to claim 8, which is characterized in that further include：

Difference determining module, for before described instruction determining module determines control instruction, judging first distance and described Whether the difference of second distance is less than preset value.

15. a kind of electronic equipment, which is characterized in that including：

Display, the display are located at user and dress in the visible area of the eyes after the electronic equipment, for the One display parameters show the first image, and the viewer outside display first surface is enable to perceive positioned at display second The first image outside surface；Wherein, first display parameters make viewer when watching the display, perception described the The distance of display described in the first object distance in one image is the first distance；The display includes two display units, Position of described two display units after user dresses the electronic equipment respectively with the left eye eyeball of the user and the right side Eyes are corresponding；

Collector, for detecting first operation of the operating body outside the display second surface for first object；Institute It is drag operation to state the first operation；

Processor, for according to first operation, determining second distance；According to first distance and the second distance, Determine control instruction；And the control instruction is responded, show the second image with the second display parameters；Wherein, the second distance For the distance of the first collecting unit of operating position distance of first operation；Described first image and second image are not It together, can be so that first object implementatio8 that perceives of the viewer be far and near or the variation or interaction of front and back position.

16. electronic equipment according to claim 15, which is characterized in that the collector includes two cameras, described Two cameras are separately positioned on the frame of described two display units, and relative to the line of symmetry of described two display units Symmetrically, the image information in the visible area of the eyes after the electronic equipment is dressed for acquiring user.