CN103984101B - Display contents controlling method and device - Google Patents
Display contents controlling method and device Download PDFInfo
- Publication number
- CN103984101B CN103984101B CN201410239854.5A CN201410239854A CN103984101B CN 103984101 B CN103984101 B CN 103984101B CN 201410239854 A CN201410239854 A CN 201410239854A CN 103984101 B CN103984101 B CN 103984101B
- Authority
- CN
- China
- Prior art keywords
- display
- operating body
- display content
- display object
- hmd
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The embodiment of the present application provides a kind of display contents controlling method and device, it is applied in head-wearing type intelligent equipment, described head-wearing type intelligent equipment includes head mounted display HMD and image acquisition device, user realizes the control to the display content in the viewing area of described HMD by operating body, and described method includes: determined the initial position of described operating body by described image acquisition device;Determine that the initial position of described operating body is mapped to the operating position in the viewing area of described HMD, and determine the first display object in described display content according to described operating position;The action message of described operating body is gathered by described image acquisition device;According to described action message, adjusting described first display object morphological feature in described display content, it is convenient that the embodiment of the present application controls operation, meets the demand for control of user to a certain extent.
Description
Technical field
The application relates to electronic technology field, particularly relates to a kind of display contents controlling method and device.
Background technology
Head-wearing type intelligent equipment refers to utilize wearable technology that headset equipment is carried out intelligentized design, and
The smart machine developed, such as intelligent glasses etc..
(English: Head-mounted display is called for short: head HMD) to possess head mounted display
Wearing formula smart machine, by exporting contents such as images to HMD, user is wearing head-wearing type intelligent equipment
Time, i.e. may be viewed by the display content of HMD, and the display content of the HMD watched due to user
The display interface of visual imaging space and head mounted display also differs, in the display that user is watched
The visual imaging space held is virtual vision space.On user perspective, the HMD's that user is watched
Display content is virtual content, and virtual content is added on the actual environment of user's viewing, thus
Actual situation can be realized combine, such as, in real scene navigation scene, pavement image can be observed user
In directly display navigation map etc..
During realizing the present invention, inventor finds, the head-wearing type intelligent of the existing HMD of possessing sets
Standby, the control to HMD display content is only limitted to the control to the display parameters showing content, as bright in display
Degree, and be only capable of being realized by the physical button of equipment, operate not convenient, it is impossible to meet the control need of user
Ask.
Summary of the invention
In view of this, this application provides a kind of display contents controlling method and device, facility simple to operate,
Add the control mode to display content, improve Consumer's Experience.
For achieving the above object, the application provides following technical scheme:
First aspect, it is provided that a kind of display contents controlling method, is applied in head-wearing type intelligent equipment,
Described head-wearing type intelligent equipment includes head mounted display HMD and image acquisition device, and user is by operation
Body realizes the control to the display content in the viewing area of described HMD, and described method includes:
The initial position of described operating body is determined by described image acquisition device;
Determine that the initial position of described operating body is mapped to the operating position in the viewing area of described HMD,
And the first display object in described display content is determined according to described operating position;
The action message of described operating body is gathered by described image acquisition device;
According to described action message, adjust described first display object form in described display content special
Levying, described morphological feature at least includes showing the one in position, display size and display shape.
Implementation described may determine the initial of described operating body in the first of described first aspect
Position is mapped to the operating position in the viewing area of described HMD, and determines institute according to described operating position
The the first display object stated in display content includes:
According to the initial position of described operating body, calculate described operating body and be mapped in virtual vision space
Position relatively;Described virtual vision space is user visual imaging space when watching described display content;
Distance according to eyes of user to described HMD and the ratio of the distance to described virtual vision space,
Calculate the operating position that described relative position is mapped in the display content of described HMD output;
Determine the first display object being positioned in described display content at described operating position.
In conjunction with the first possible implementation of described first aspect or described first aspect, additionally provide institute
State the possible implementation of the second of first aspect, described according to described action message, adjust described first
Display object morphological feature in described display content includes:
Determine the pending region blocked by described operating body in described first display object;
In described display content, described pending region is carried out transparent processing, after being adjusted
One display object.
In conjunction with described first aspect the second may implementation, additionally provide the of described first aspect
Three kinds may implementations, described determine in described first display object located by waiting of blocking of described operating body
Reason region includes:
The shield portions of the described operating body corresponding with described action message that inquiry is preset;
Determine the pending region blocked by the shield portions of described operating body in described first display object.
In conjunction with the first possible implementation of described first aspect or described first aspect, additionally provide institute
Stating the 4th kind of possible implementation of first aspect, described in the action message of described operating body, operating body is dynamic
Make operating body described in information representation to move to end position from described initial position;
Described according to described action message, adjust described first display object shape in described display content
State feature, including:
Obtain described operating body primary importance in described collection space and the second place, described first
Position and the described second place are that initial position described in described operating body moves the fortune formed to end position
Any two position in dynamic track;
Determine the described first display object the 3rd position in described display content;
According to the variation relation of described primary importance Yu the described second place, determine in described display content with
The 4th position that described 3rd position is relevant;
Adjust the described first display object the 3rd position from described display content to move to described 4th
Put.
In conjunction with the first possible implementation of described first aspect or described first aspect, additionally provide institute
State the 5th kind of possible implementation of first aspect, described according to described action message, adjust described first
Display object morphological feature in described display content includes:
Obtain the first control strategy that described action message is corresponding;
According to described first control strategy, adjust the display shape of described first display object.
Second aspect, it is provided that a kind of display content control device, is applied in head-wearing type intelligent equipment,
Described head-wearing type intelligent equipment includes head mounted display HMD and image acquisition device, and user is by operation
Body realizes the control to the display content in the viewing area of described HMD, and described device includes:
Initial position determines module, for being determined the initial bit of described operating body by described image acquisition device
Put;
Position mapping block, for determining that the initial position of described operating body is mapped to the display of described HMD
Operating position in region;
Object determines module, for determining the first display in described display content according to described operating position
Object;
Action acquisition module, for gathering the action message of described operating body by described image acquisition device;
Adjusting module, for according to described action message, adjusts described first display object in described display
Morphological feature in content, described morphological feature at least includes showing position, display size and display shape
One in shape.
In the first possible implementation of described second aspect, described position mapping block includes:
First map unit, for the initial position according to described operating body, calculates described operating body and maps
Relative position in virtual vision space;Described virtual vision space is that user watches described display content
Time visual imaging space;
Second map unit, for the distance according to eyes of user to described HMD and to described virtual vision
The ratio of the distance in space, calculates in the display content that described relative position is mapped to described HMD output
Operating position.
In conjunction with the first possible implementation of described second aspect or described second aspect, additionally provide institute
Stating the possible implementation of the second of second aspect, described adjusting module includes:
Area determination unit, is located by waiting of blocking of described operating body for determining in described first display object
Reason region;
First adjustment unit, in described display content, carries out transparent place by described pending region
Reason, the first display object after being adjusted.
In conjunction with described second aspect the second may implementation, additionally provide the of described second aspect
Three kinds of possible implementations, described area determination unit includes:
Query unit, for inquiring about the occlusion part of the default described operating body corresponding with described action message
Point;
Region determines subelement, for determining in described first display object by the occlusion part of described operating body
Divide the pending region blocked.
In conjunction with the first possible implementation of described second aspect or described second aspect, additionally provide institute
Stating the 4th kind of possible implementation of second aspect, the action message of described operating body characterizes described operating body
Move to end position from described initial position;Described adjusting module includes:
Position acquisition unit, for obtain described operating body primary importance in described collection space and
The second place, described primary importance and the described second place are that initial position described in described operating body moves
Any two position to the movement locus that end position is formed;
First determines unit, for determining the 3rd in described display content of described first display object
Put;
Second determines unit, for the variation relation according to described primary importance Yu the described second place, really
The 4th position relevant to described 3rd position in fixed described display content;
Second adjustment unit, for adjusting the 3rd from described display content of described first display object
Put mobile to described 4th position.
In conjunction with the first possible implementation of described second aspect or described second aspect, additionally provide institute
Stating the 5th kind of possible implementation of second aspect, described adjusting module includes:
Strategy acquiring unit, for obtaining the first control strategy that described action message is corresponding;
3rd adjustment unit, for according to described first control strategy, adjusting described first display object
Display shape.
Understand via above-mentioned technical scheme, compared with prior art, this application provides in a kind of display
Holding control method and device, user can realize the control to display content by operating body, it is possible to will be aobvious
Show that the display object in content is adjusted, it is not necessary to the physical button of touching head-wearing type intelligent equipment,
To realize the control to display content, simple to operate, add the control mode to display content, one
Determine to meet in degree user's request.And add user and show the interactive of content, to display content
Adjustment consider operating body operating position in viewing area so that can accurately determine operation
First display object, it is possible to realize the most virtual combination display effect.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present application or technical scheme of the prior art, below will be to reality
Execute the required accompanying drawing used in example or description of the prior art to be briefly described, it should be apparent that below,
Accompanying drawing in description is only embodiments herein, for those of ordinary skill in the art, not
On the premise of paying creative work, it is also possible to obtain other accompanying drawing according to the accompanying drawing provided.
A kind of flow process showing one embodiment of contents controlling method that Fig. 1 provides for the embodiment of the present application
Figure;
Fig. 2 is a kind of imaging schematic diagram of head-wearing type intelligent equipment in the embodiment of the present application;
A kind of flow process showing another embodiment of contents controlling method that Fig. 3 provides for the embodiment of the present application
Figure;
A kind of flow process showing another embodiment of contents controlling method that Fig. 4 provides for the embodiment of the present application
Figure;
Fig. 4 a is a kind of display schematic diagram of the first display object in the embodiment of the present application;
Fig. 4 b is a kind of display schematic diagram of the second display object in the embodiment of the present application;
Fig. 4 c is the another kind of display schematic diagram of the first display object in the embodiment of the present application;
Fig. 4 d is the another kind of display schematic diagram of the second display object in the embodiment of the present application.
A kind of structure showing one embodiment of content control device that Fig. 5 provides for the embodiment of the present application is shown
It is intended to;
A kind of structure showing another embodiment of content control device that Fig. 6 provides for the embodiment of the present application
Schematic diagram;
The a kind of of Fig. 7 the embodiment of the present application offer shows a kind of structure of adjusting module in content control device
Schematic diagram;
Fig. 8 a kind of shows the another kind of adjusting module in content control device for what the embodiment of the present application provided
Structural representation;
Fig. 9 a kind of shows in content control device adjusting module another for what the embodiment of the present application provided
Structural representation;
The structural representation of a kind of one embodiment of head-wearing type intelligent equipment that Figure 10 provides for the embodiment of the present application
Figure.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present application, the technical scheme in the embodiment of the present application is carried out
Clearly and completely describe, it is clear that described embodiment is only some embodiments of the present application, and
It is not all, of embodiment.Based on the embodiment in the application, those of ordinary skill in the art are not doing
Go out the every other embodiment obtained under creative work premise, broadly fall into the scope of the application protection.
The technical scheme of the application, can apply in head-wearing type intelligent equipment, and head-wearing type intelligent equipment leads to
Often include fixing firmware, can be worn by the user at head.
The head-wearing type intelligent equipment applied of technical scheme include head mounted display (English:
Head-mounted display, is called for short: HMD), HMD is visual display, it is possible to achieve empty
Intend the combination of content and actual environment.
In the embodiment of the present application, in the case of user wears head-wearing type intelligent equipment, user can pass through
Operating body realizes the control to display content, it is possible to is adjusted by the display object in display content, uses
Family, without touching the physical button of head-wearing type intelligent equipment, i.e. can realize the control to display content, behaviour
Make simple, add the control mode to display content, meet user's request to a certain extent.And
Adding user and show the interactive of content, the adjustment to display content considers operating body in viewing area
Operating position in territory so that can accurately determine the first display object of operation, it is possible to realize more accurate
True virtual combination display effect, improves Consumer's Experience.
Below in conjunction with the accompanying drawings technical scheme is described in detail.
A kind of flow chart showing one embodiment of contents controlling method that Fig. 1 provides for the embodiment of the present application,
Control method described in the embodiment of the present application is mainly used in head-wearing type intelligent equipment, and this head-wearing type intelligent sets
For including HMD and image acquisition device, user is capable of the display to described HMD by operating body
The control of the display content in region.
The method can include following step:
101: determined the initial position of described operating body by described image acquisition device.
Described head-wearing type intelligent equipment is worn user, and by described head mounted display output display
In the case of appearance, can be acquired gathering space by described image acquisition device.
The initial position of described operating body is i.e. that image acquisition device arrives in collection space acquisition.This initial bit
Put is i.e. that operating body is positioned at the position gathered in space.
When user wears head-wearing type intelligent equipment, the imaging space of viewed display content and wear-type
The display interface of display also differs.The imaging space of the display content that user observes is user's
Virtual vision space.
In virtual vision space, user's viewed display content, i.e. in the viewing area of HMD
Display content map is to the virtual content in virtual vision space, on user perspective, is i.e. added to use
On the actual environment that family is observed.
As shown in Figure 2, it is shown that a kind of imaging schematic diagram of head-wearing type intelligent equipment.Display at HMD
Region 100 output display content, when user wears head-wearing type intelligent equipment, viewed virtual content
Being imaged in virtual vision space 200, described virtual vision space is that user is when watching described display content
Visual imaging space.
Gather space 300 and virtual vision space 200 can at least part of space overlap, may refer to adopt
Collection space includes virtual vision space.
Wherein, gathering space 300 is by the angular field of view of the image acquisition device 400 of head-wearing type intelligent equipment
Determining, image acquisition device 400 specifically may refer to image first-class.
Operating body refers to the object collected by wear-type smart machine of user's true operation, Yi Zhongke
The implementation of energy, this operating body is the hand of the user collected, and the action message of operating body is specifically
May refer to gesture information, such as the operating body 500 in Fig. 2.
Certainly, this operating body can also refer to the object that user's hand is managed, such as rod shape thing etc..
102: determine the operation that the initial position of described operating body is mapped in the viewing area of described HMD
Position, and the first display object in described display content is determined according to described operating position.
In order to realize the control to display content of action message according to operating body, need accurately to determine operation
First display object in the display content that gymnastics is made.And in prior art, be generally not capable of knowing operating body
Operational motion is which part in corresponding display content, thus can not realize the accurate control to display content,
Poor with user interaction.
In the embodiment of the present application, operating body is mapped at the initial position gathering space the viewing area of HMD
In territory, determine the operating position being mapped in viewing area, such that it is able to accurately determine operation gymnastics
Display object in the display content made.
Owing to there are differences, if head-wearing type intelligent equipment is wanted to know human eye between human eye visual angle and collection visual angle
In visual angle, operating body is when virtual content is accurately combined, and operating body is mapped to the operative position of HMD viewing area
Put, can know that operating body is in virtual vision space according to the proportionate relationship of virtual content with display content
In relative position be mapped to the operating position in HMD viewing area.
In a kind of possible implementation, this first display object, may refer to presetting with operating body
Position is reference point, and the display content at operating position that this reference point maps is the first display object.
Such as when operating body is hand, reference point can select forefinger summit.
In alternatively possible implementation, this first display object, may refer to show quilt in content
The content that the operating body collected blocks.
In the implementation that another is possible, this first display object, can be the ginseng according to operating body
Content indicated at the operating position of examination point, or the content that operated member is blocked, determined by wherein have
There is given shape or to meet pre-conditioned information be the first display object.This given shape or meet pre-
If condition can be obtained by the information analyzing display content.Such as including that there is the letter such as water tumbler, school bag
In the display content of breath, according to the action message of operating body, the forefinger summit identifying operating body is positioned at water
Any position of cup viewing area, place, then the first display object i.e. can be defined as water tumbler.
103: gathered the action message of described operating body by described image acquisition device.
The action message of operating body can include that operating body is in the action message of two dimensional surface or at three-dimensional space
Between action message, specifically may refer to operating body from initial position move to end position formed motion
In the positional information of trace information, the profile information of operating body, the deformation characteristics of operating body and operating body
At least one etc..
Operating body can pass through depth camera in a kind of possible implementation of three-dimensional action message
Or the depth information that binocular camera gathers obtains.
The action of the execution of operating body can be user when wearing head-wearing type intelligent equipment, regards according to virtual
The virtual content that feel space observation is arrived, controls the operation that the virtual objects in virtual content is performed by operating body,
Such as clicking on a certain virtual objects, now head-wearing type intelligent equipment can gather space acquisition to operating body
Action message.
Collection identification to the action message of operating body, as a example by operating body is as staff, can pre-build
Hand model, thus when operating body being detected, according to hand model, can identify the profile of staff with
And key point, key point such as finger, joint etc..It is thus possible to the action message of operating body is recognized accurately.
104: according to described action message, adjust described first display object shape in described display content
State feature.
Described morphological feature at least includes showing the one in position, display size and display shape.
The morphological feature of the first display object is adjusted so that described in described first display object matching
Action message, when being mapped in virtual vision space, from the point of view of user perspective, the first display object and behaviour
Make body can accurately combine, and mate described action message.
In the present embodiment, user wears head-wearing type intelligent equipment, and it is right that user can be realized by operating body
HMD viewing area shows the control of content, the display object in display content is adjusted, user
Without touching the physical button of head-wearing type intelligent equipment, the control to display content, operation i.e. can be realized
Simply, add the control mode to display content, meet user's request to a certain extent.And increase
Having added user and shown the interactive of content, the adjustment to display content considers operating body in viewing area
In operating position so that can accurately determine the first display object, it is achieved the most virtual combination
Display effect.
How head-wearing type intelligent equipment determines that the initial position of described operating body is mapped to described HMD's
Operating position in viewing area, can have multiple implementation, in a kind of possible implementation, as
Shown in Fig. 3, it is shown that a kind of display another embodiment of contents controlling method that the embodiment of the present application provides
Flow chart, in the present embodiment, step 101, step 103~104 may refer to embodiment illustrated in fig. 1, its
In, step 102 may comprise steps of:
301: according to the initial position of described operating body, calculate described operating body and be mapped to virtual vision space
In relative position.
Described virtual vision space is user visual imaging space when watching described display content.
Head-wearing type intelligent equipment can gather space at it and set up space coordinates, may thereby determine that out
Operating body is at the initial position of these space coordinates.
This initial position can with the coordinate representation of a pixel in the operating body image that collects,
Or multiple pixel coordinate representation.
As a example by initial position is with a pixel coordinate representation, initial position has as follows with relative position
Mapping relations:
Wherein, (m, n) represents collection position coordinates, and (M, N) represents relative position coordinates, by this
Formula understands, W=am+bn+1.
(a, b, c, d, e, f, g h) are parameter.
When collection position is known, by solving, (a, b, c, d, e, f, g h), are i.e. appreciated that phase
To position (M, N).
Wherein, (a, b, c, d, e, f, g, solving h) can be carried out according to equation below:
(xi, yj) represent the coordinate of any pixel point in gathering the image that space any position gathers,
I=1,2 ... n, j=1,2 ... n, (Xi, Yj) represent (xi, yj) be mapped to virtual vision space after right
The coordinate answered.
Assume that λ is the vector [a b c d e f g h] solved.
Above formula can be reduced to A* λ=B.
Such that it is able to obtain λ=(ATA)-1ATB
(X is obtained according to test in advancei, Yj) and (xi, yj) coordinate value, can obtain in the hope of solution
λ, thus according to initial position co-ordinates (m, n) i.e. can obtain operating body relative position coordinates (M,
N)。
When initial positions is by multiple pixel coordinate representation, each pixel can be solved respectively according to above-mentioned
Point is mapped to the relative position coordinates in virtual vision space, thus position relatively is i.e. many by multiple pixels
Individual relative position coordinates represents.
302: the distance according to eyes of user to described HMD and the distance to described virtual vision space
Ratio, calculates the operating position that described relative position is mapped in the display content of described HMD output.
In a kind of possible implementation, it is assumed that in space coordinates, with human eye position as coordinate
Initial point.Assume that HMD place plane is parallel with the imaging surface in virtual vision space.Then arrive according to eyes of user
The distance of HMD is a with the ratio of the distance to virtual vision space, it is assumed that the relative position calculated is sat
It is designated as (M, N), then can be calculated (M, N) and be mapped to the relative position in virtual vision space
Coordinate is (M/a, N/a).
303: determine the first display object being positioned in described display content at described operating position.
In order to know the first display object in the display content that operating body operates, need operating body in void
The relative position intending visual space is mapped in the viewing area of HMD, to obtain the display of operating body operation
First display object in content.
Certainly, wear-type electronic equipment can also predefine out the virtual content in virtual vision space with aobvious
Show the ratio of content, thus described relative position correspondence in display content can be obtained according to this ratio
Operating position.
Wherein, according to described action message, adjust described first display object in described display content
Morphological feature can have multiple implementation, in a kind of possible implementation, as shown in Figure 4, for
A kind of flow chart showing another embodiment of contents controlling method that the embodiment of the present application provides, step
101~the operation of step 103 may refer to embodiment illustrated in fig. 1, the operation of step 102 specifically can be by
Performing according to embodiment illustrated in fig. 3, in the present embodiment, step 104 may include that
401: determine the pending region blocked by described operating body in described first display object.
Proportionate relationship determined by initial position according to operating body and step 302, can will operate
Body proportionally relation etc. zooms to, in the viewing area of HMD, may thereby determine that out the first display object
The pending region blocked by described operating body.
402: in described display content, described pending region is carried out transparent processing, after being adjusted
First display object.
Now, in the viewed virtual content of user, pending region is transparent image, therefore at this
Pending region is it is observed that actual environment, the most described operating body.
Transparent processing is carried out, it is possible to achieve Yong Huyu by the pending region that described operating body is blocked
Display content mutual of HMD output, is favorably improved the display effect of actual situation combination, brings user more
Good Consumer's Experience.
Such as Fig. 4 a, it is shown that the display schematic diagram of the first display object being mapped in virtual vision space.
Fig. 4 b shows the display schematic diagram being mapped in virtual vision space after the first display object adjustment.Figure
4a and Fig. 4 b is from user perspective, viewed view.From Fig. 4 a and Fig. 4 b, operating body
500 is staff, and its action message performed is " crawl ".First display object 600 of operating body operation
For water tumbler, thus according to the operating body collected and action message thereof, it may be determined that go out the first display object
The middle pending region blocked by described operating body, carries out transparent processing by pending region, is Fig. 4 b
The first display object after shown adjustment.From Fig. 4 b, after the first display object is adjusted i.e.
Achieve " water tumbler " that " staff " in actual environment accurately grabs in virtual content, have matched dynamic
Making information, from user perspective, staff and water tumbler realize accurately combining, and improve the aobvious of actual situation combination
Show effect, be not only that virtual content is added in actual environment, add user and display content
Alternately, improve Consumer's Experience.
Fig. 4 a and Fig. 4 b is exemplary illustration, can also realize multiple by technical scheme
Complex interaction.
Wherein, the determination in the pending region of the first display object can have multiple possible implementation,
In a kind of possible implementation, can be according to the action message pre-set and operating body shield portions
Corresponding relation determine, therefore, it can inquiry preset the described operating body corresponding with described action message
Shield portions;So that it is determined that described first display object is blocked by the shield portions of described operating body
Pending region.Such as, as a example by action message is as gesture information, when performing " crawl " action, hide
The staff part that stopper is divided into including thumb;When performing " click " operation, shield portions is behaved
Hand whole etc..
Additionally, as alternatively possible implementation, described according to described action message, adjust described
First display object morphological feature in described display content may is that
Obtain the first control strategy that described action message is corresponding.
According to described first control strategy, adjust the display shape of described first display object.
Namely the corresponding relation of different action message and different control strategies can be preset, such that it is able to
Inquiry obtains the first control strategy that described action message is corresponding, according to described first control strategy to described
First display object is adjusted.
As Fig. 4 c and Fig. 4 d, Fig. 4 c show aobvious in virtual vision space of the first display object map
Show that schematic diagram, Fig. 4 d show that the second display object map is to the display schematic diagram in virtual vision space.
Understanding in conjunction with Fig. 4 c and Fig. 4 d, operating body is user's both hands, and action message is " lifting " action.
First display object 600 is unopened flower, by identifying described " lifting " action, shows first
Showing that object is adjusted, the first display object after being adjusted is the flower bursted forth.
Wherein, the first control strategy can also refer to the display according to described action message of described first object
Change in shape meets the natural law.Such as first display object is assumed to be " inflatable balloon ", and action is believed
During the action that breath " stabs " for handheld information, then according to the natural law, it is somebody's turn to do " inflatable balloon " " stamp "
Action under, i.e. " rupture ", thus " balloon is changed into state of rupture by inflated condition ", shape occur
State change as.
Seen from the above description, in the embodiment of the present application, the first display object is not limited to static object.
As the implementation that another is possible, the action message of described operating body characterize described operating body from
Described initial position moves to end position;
Described according to described action message, adjust described first display object shape in described display content
State feature may is that
Obtain described operating body primary importance in described collection space and the second place, wherein, institute
State primary importance and the described second place is that initial position described in described operating body moves to end position shape
Any two position in the movement locus become;
Determine the described first display object the 3rd position in described display content;
According to the variation relation of described primary importance Yu the described second place, determine in described display content with
The 4th position that described 3rd position is relevant;
Adjust the described first display object the 3rd position from described display content to move to described 4th
Put.
It is achieved thereby that the mobile realization that can follow operating body is moved in the position of display object.
In the embodiment of the present application, in the case of user wears head-wearing type intelligent equipment, user can be by behaviour
Making body to realize the control showing content in the viewing area of HMD, user sets without touching head-wearing type intelligent
Standby physical button, i.e. can realize the control to display content, simple to operate, adds in display
The control mode held, meets user's request to a certain extent.And add user and display content
Interactive, the adjustment to display content considers operating body operating position in viewing area so that can
Accurately to determine the first display object, it is achieved the most virtual combination display effect.
For aforesaid each method embodiment, in order to be briefly described, therefore it is all expressed as a series of dynamic
Combining, but those skilled in the art should know, the application is not by described sequence of movement
Limiting, because according to the application, some step can use other orders or carry out simultaneously.Secondly,
Those skilled in the art also should know, embodiment described in this description belongs to preferred embodiment,
Necessary to involved action and module not necessarily the application.
A kind of structure showing one embodiment of content control device that Fig. 5 provides for the embodiment of the present application is shown
Being intended to, this display content control device is applied particularly in head-wearing type intelligent equipment, described head-wearing type intelligent
Equipment includes HMD and image acquisition device, and user realizes the viewing area to described HMD by operating body
The control of the display content in territory, wherein, this display content control device is desirably integrated into head-wearing type intelligent
In the processor of equipment, the function that can realize as processor, or as single device with
Processor is connected, and described device may include that
Initial position determines module 501, for determining the initial of described operating body by described image acquisition device
Position.
The initial position of described operating body is i.e. that image acquisition device is gathering this initial position that space acquisition arrives
It is i.e. that operating body is positioned at the position gathered in space.
Position mapping block 502, for determining that the initial position of described operating body is mapped to described HMD's
Operating position in viewing area.
Operating body is mapped in the viewing area of HMD at the initial position gathering space, determines mapping
Operating position in viewing area, such that it is able to accurately determine in the display content that operating body operates aobvious
Show object.
Object determines module 503, for determining that first in described display content shows according to described operating position
Show object.
Action acquisition module 504, is believed for being gathered the action of described operating body by described image acquisition device
Breath.
The action message of operating body can include that operating body is in the action message of two dimensional surface or at three-dimensional space
Between action message, specifically may refer to operating body from initial position move to end position formed motion
In the positional information of trace information, the profile information of operating body, the deformation characteristics of operating body and operating body
At least one etc..
The action of the execution of operating body can be user when wearing head-wearing type intelligent equipment, regards according to virtual
The virtual content that feel space observation is arrived, controls the operation that the virtual objects in virtual content is performed by operating body,
Such as clicking on a certain virtual objects, now head-wearing type intelligent equipment can gather space acquisition to operating body
Action message.
Adjusting module 505, for according to described action message, adjusts described first display object described aobvious
Show the morphological feature in content.
Described morphological feature at least includes showing the one in position, display size and display shape.
The morphological feature of the first display object is adjusted so that described in described first display object matching
Action message, when being mapped in virtual vision space, from the point of view of user perspective, the first display object and behaviour
Make body can accurately combine, and mate described action message.
In the present embodiment, when user wears head-wearing type intelligent equipment, user can be realized by operating body
To HMD viewing area shows the control of content, content can will be shown by display content control device
In display object be adjusted, user is without touching the physical button of head-wearing type intelligent equipment, the most permissible
Realize the control to display content, simple to operate, add the control mode to display content, necessarily
User's request is met in degree.And add user and show the interactive of content, to display content
Adjust and consider operating body operating position in viewing area so that can accurately determine the first display
Object, it is achieved the most virtual combination display effect.
Wherein, position mapping block 502 determines that the initial position of described operating body is mapped to described HMD's
Operating position in viewing area, can have multiple implementation, in a kind of possible implementation, as
Shown in Fig. 6, it is shown that a kind of display another embodiment of content control device that the embodiment of the present application provides
Structural representation, this device can include initial position determine module 501, position mapping block 502,
Object determines module 503, action acquisition module 504 and adjusting module 505, and each functions of modules can be joined
Embodiment as shown in Figure 5, is with embodiment illustrated in fig. 5 difference, described position mapping block 502
May include that
First map unit 601, for the initial position according to described operating body, calculates described operating body and reflects
The relative position being mapped in virtual vision space;
Wherein, described virtual vision space is user visual imaging space when watching described display content.
Second map unit 602, for according to the distance of eyes of user to described HMD with to described virtual
The ratio of the distance of visual space, calculates described relative position and is mapped to the display content of described HMD output
In operating position.
Wherein, according to described action message, adjust described first display object in described display content
Morphological feature can have multiple implementation, in a kind of possible implementation, as it is shown in fig. 7, adjust
Mould preparation block 505 may include that
Area determination unit 701, for determining in described first display object by treating that described operating body blocks
Processing region.
First adjustment unit 702, in described display content, carries out transparent by described pending region
Process, the first display object after being adjusted.
Wherein, wherein, the determination in the pending region of the first display object can have multiple possible realization
Mode, in a kind of possible implementation, can hide with operating body according to the action message pre-set
The corresponding relation that stopper is divided determines, therefore, this area determination unit may include that
Query unit, for inquiring about the occlusion part of the default described operating body corresponding with described action message
Point;
Region determines subelement, for determining in described first display object by the occlusion part of described operating body
Divide the pending region blocked.
Additionally, in alternatively possible implementation, the action message of described operating body characterizes described operation
Body moves to end position from described initial position;As shown in Figure 8, described adjusting module 505 can wrap
Include:
Position acquisition unit 801, for obtain described operating body primary importance in described collection space with
And the second place, described primary importance and the described second place are that initial position described in described operating body moves
Move any two position to the movement locus of end position formation;
First determines unit 802, for determining described first display object the 3rd in described display content
Position;
Second determines unit 803, for the variation relation according to described primary importance Yu the described second place,
Determine the 4th position relevant to described 3rd position in described display content;
Second adjustment unit 804, for adjusting described first display object the 3rd from described display content
Position is moved to described 4th position.
It is achieved thereby that the mobile realization that can follow operating body is moved in the position of display object.
In the embodiment of the present application, user, i.e. can be real without touching the physical button of head-wearing type intelligent equipment
The now control to display content, operation is convenient, adds the control mode to display content, in certain journey
User's request is met on degree.And add user and show the interactive of content, the tune to display content
Whole consider operating body operating position in viewing area so that can accurately determine that the first display is right
As, it is achieved the most virtual combination display effect.
In another possible implementation, as it is shown in figure 9, adjusting module 505 can include
Strategy acquiring unit 901, for obtaining the first control strategy that described action message is corresponding;
3rd adjustment unit 902, for according to described first control strategy, adjusts described first display object
Display shape.
Namely the corresponding relation of different action message and different control strategies can be preset, such that it is able to
Inquiry obtains the first control strategy that described action message is corresponding, according to described first control strategy to described
First display object is adjusted.
This first control strategy can also refer to described first object display shape according to described action message
Change meets the natural law.
Adjusting module in Fig. 5 or Fig. 6 specifically can use the realization of any one adjusting module of Fig. 7~Fig. 9
Mode.
Display content control device described in above-described embodiment, in actual applications, is desirably integrated into and wears
In formula smart machine.Disposing the electronic equipment of the embodiment of the present application display content control device, operation is convenient,
Add the control mode to display content, meet user's request to a certain extent.
By above description, those skilled in the art is it can be understood that can be by the application
Software adds the mode of required general hardware platform and realizes.Therefore, as shown in Figure 10, the application implements
Example additionally provides a kind of head-wearing type intelligent equipment, and this head-wearing type intelligent equipment can be worn by fixing device
At user's head.
This head-wearing type intelligent equipment at least include connecing memory 1001, processor 1002, HMD1003 with
And image acquisition device 1004.
This memory 1001 stores batch processing instruction, and this memory can be high-speed RAM memory,
It is also likely to be nonvolatile memory (non-volatile memory), for example, at least one magnetic disc store
Deng.
This processor 1002, for calling the programmed instruction of this memory 1001 storage, performs to operate as follows:
By described HMD1003, in the viewing area output display content of HMD1003;
By described image acquisition device 1004 acquisition operations body, determine the initial position of described operating body;
Determine that the initial position of described operating body is mapped to the operation in the viewing area of described HMD1003
Position, and the first display object in described display content is determined according to described operating position;
The action message of described operating body is gathered by described image acquisition device 1004;
According to described action message, adjust described first display object form in described display content special
Levying, described morphological feature at least includes showing the one in position, display size and display shape.
In this specification, each embodiment uses the mode gone forward one by one to describe, and each embodiment stresses
Being the difference with other embodiments, between each embodiment, identical similar portion sees mutually.
For device disclosed in embodiment, owing to it corresponds to the method disclosed in Example, so describing
Fairly simple, relevant part sees method part and illustrates.
Finally, in addition it is also necessary to explanation, in this article, the relational terms of such as first and second or the like
It is used merely to separate an entity or operation with another entity or operating space, and not necessarily requires
Or imply relation or the order that there is any this reality between these entities or operation.And, art
Language " includes ", " comprising " or its any other variant are intended to comprising of nonexcludability, thus
Make to include that the process of a series of key element, method, article or equipment not only include those key elements, and
Also include other key elements being not expressly set out, or also include for this process, method, article or
The key element that person's equipment is intrinsic.In the case of there is no more restriction, by statement " including ... "
The key element limited, it is not excluded that also deposit in including the process of described key element, method, article or equipment
At other identical element.
Described above to the disclosed embodiments, makes professional and technical personnel in the field be capable of or uses
The application.Multiple amendment to these embodiments will be aobvious and easy for those skilled in the art
See, generic principles defined herein can in the case of without departing from the application protection domain,
Other embodiments realizes.Therefore, the application is not intended to be limited to the embodiments shown herein,
And it is to fit to the widest scope consistent with principles disclosed herein and features of novelty.
Claims (12)
1. a display contents controlling method, it is characterised in that be applied in head-wearing type intelligent equipment, institute
Stating head-wearing type intelligent equipment and include head mounted display HMD and image acquisition device, user passes through operating body
Realizing the control to the display content in the viewing area of described HMD, described method includes:
The initial position of described operating body is determined by described image acquisition device;
Determine that the initial position of described operating body is mapped to the operating position in the viewing area of described HMD,
And the first display object in described display content is determined according to described operating position;
The action message of described operating body is gathered by described image acquisition device;
According to described action message, adjust described first display object form in described display content special
Levying, described morphological feature at least includes showing the one in position, display size and display shape.
Method the most according to claim 1, it is characterised in that described determine at the beginning of described operating body
Beginning position is mapped to the operating position in the viewing area of described HMD, and determines according to described operating position
The first display object in described display content includes:
According to the initial position of described operating body, calculate described operating body and be mapped in virtual vision space
Position relatively;Described virtual vision space is user visual imaging space when watching described display content;
Distance according to eyes of user to described HMD and the ratio of the distance to described virtual vision space,
Calculate the operating position that described relative position is mapped in the display content of described HMD output;
Determine the first display object being positioned in described display content at described operating position.
Method the most according to claim 1 and 2, it is characterised in that described believe according to described action
Breath, adjusts described first display object morphological feature in described display content and includes:
Determine the pending region blocked by described operating body in described first display object;
In described display content, described pending region is carried out transparent processing, after being adjusted
One display object.
Method the most according to claim 3, it is characterised in that described determine described first display right
As the middle pending region blocked by described operating body includes:
The shield portions of the described operating body corresponding with described action message that inquiry is preset;
Determine the pending region blocked by the shield portions of described operating body in described first display object.
Method the most according to claim 1 and 2, it is characterised in that the action letter of described operating body
Breath characterizes described operating body and moves to end position from described initial position;
Described according to described action message, adjust described first display object shape in described display content
State feature includes:
Obtain primary importance and the second place of described operating body, described primary importance and described second
Position is that initial position described in described operating body moves any two to the movement locus of end position formation
Individual position;
Determine the described first display object the 3rd position in described display content;
According to the variation relation of described primary importance Yu the described second place, determine in described display content with
The 4th position that described 3rd position is relevant;
Adjust the described first display object the 3rd position from described display content to move to described 4th
Put.
Method the most according to claim 1 and 2, it is characterised in that described believe according to described action
Breath, adjusts described first display object morphological feature in described display content and includes:
Obtain the first control strategy that described action message is corresponding;
According to described first control strategy, adjust the display shape of described first display object.
7. a display content control device, it is characterised in that be applied in head-wearing type intelligent equipment, institute
Stating head-wearing type intelligent equipment and include head mounted display HMD and image acquisition device, user passes through operating body
Realizing the control to the display content in the viewing area of described HMD, described device includes:
Initial position determines module, for being determined the initial bit of described operating body by described image acquisition device
Put;
Position mapping block, for determining that the initial position of described operating body is mapped to the display of described HMD
Operating position in region;
Object determines module, for determining the first display in described display content according to described operating position
Object;
Action acquisition module, for gathering the action message of described operating body by described image acquisition device;
Adjusting module, for according to described action message, adjusts described first display object in described display
Morphological feature in content, described morphological feature at least includes showing position, display size and display shape
One in shape.
Device the most according to claim 7, it is characterised in that described position mapping block includes:
First map unit, for the initial position according to described operating body, calculates described operating body and maps
Relative position in virtual vision space;Described virtual vision space is that user watches described display content
Time visual imaging space;
Second map unit, for the distance according to eyes of user to described HMD and to described virtual vision
The ratio of the distance in space, calculates in the display content that described relative position is mapped to described HMD output
Operating position.
9. according to the device described in claim 7 or 8, it is characterised in that described adjusting module includes:
Area determination unit, is located by waiting of blocking of described operating body for determining in described first display object
Reason region;
First adjustment unit, in described display content, carries out transparent place by described pending region
Reason, the first display object after being adjusted.
Device the most according to claim 9, it is characterised in that described area determination unit includes:
Query unit, for inquiring about the occlusion part of the default described operating body corresponding with described action message
Point;
Region determines subelement, for determining in described first display object by the occlusion part of described operating body
Divide the pending region blocked.
11. according to the device described in claim 7 or 8, it is characterised in that the action of described operating body
Operating body described in information representation moves to end position from described initial position;
Described adjusting module includes:
Position acquisition unit, for obtaining described operating body gathering in space at described image acquisition device
Primary importance and the second place, described primary importance and the described second place are described in described operating body
Initial position moves any two position to the movement locus of end position formation;
First determines unit, for determining the 3rd in described display content of described first display object
Put;
Second determines unit, for the variation relation according to described primary importance Yu the described second place, really
The 4th position relevant to described 3rd position in fixed described display content;
Second adjustment unit, for adjusting the 3rd from described display content of described first display object
Put mobile to described 4th position.
12. according to the device described in claim 7 or 8, it is characterised in that described adjusting module includes:
Strategy acquiring unit, for obtaining the first control strategy that described action message is corresponding;
3rd adjustment unit, for according to described first control strategy, adjusting described first display object
Display shape.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410239854.5A CN103984101B (en) | 2014-05-30 | 2014-05-30 | Display contents controlling method and device |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201410239854.5A CN103984101B (en) | 2014-05-30 | 2014-05-30 | Display contents controlling method and device |
Publications (2)
Publication Number | Publication Date |
---|---|
CN103984101A CN103984101A (en) | 2014-08-13 |
CN103984101B true CN103984101B (en) | 2016-08-24 |
Family
ID=51276136
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201410239854.5A Active CN103984101B (en) | 2014-05-30 | 2014-05-30 | Display contents controlling method and device |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN103984101B (en) |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160196693A1 (en) * | 2015-01-06 | 2016-07-07 | Seiko Epson Corporation | Display system, control method for display device, and computer program |
CN104598036B (en) * | 2015-03-02 | 2019-03-08 | 联想(北京)有限公司 | A kind of information processing method and device |
WO2018103072A1 (en) * | 2016-12-09 | 2018-06-14 | 深圳市柔宇科技有限公司 | Adjustment method and adjustment system for user interface, and head-mounted display device |
CN110837764B (en) * | 2018-08-17 | 2022-11-15 | 广东虚拟现实科技有限公司 | Image processing method and device, electronic equipment and visual interaction system |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH086708A (en) * | 1994-04-22 | 1996-01-12 | Canon Inc | Display device |
JP2009245392A (en) * | 2008-03-31 | 2009-10-22 | Brother Ind Ltd | Head mount display and head mount display system |
JP4674634B2 (en) * | 2008-12-19 | 2011-04-20 | ソニー株式会社 | Head-mounted display |
CN102346544A (en) * | 2010-07-30 | 2012-02-08 | 鸿富锦精密工业(深圳)有限公司 | Head-worn display system with interactive function and display method thereof |
US20120249587A1 (en) * | 2011-04-04 | 2012-10-04 | Anderson Glen J | Keyboard avatar for heads up display (hud) |
CN103698884A (en) * | 2013-12-12 | 2014-04-02 | 京东方科技集团股份有限公司 | Opening type head-mounted display device and display method thereof |
-
2014
- 2014-05-30 CN CN201410239854.5A patent/CN103984101B/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN103984101A (en) | 2014-08-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6393367B2 (en) | Tracking display system, tracking display program, tracking display method, wearable device using them, tracking display program for wearable device, and operation method of wearable device | |
JP6057396B2 (en) | 3D user interface device and 3D operation processing method | |
US8933886B2 (en) | Instruction input device, instruction input method, program, recording medium, and integrated circuit | |
WO2016185845A1 (en) | Interface control system, interface control device, interface control method and program | |
CN103984101B (en) | Display contents controlling method and device | |
JP6177872B2 (en) | I / O device, I / O program, and I / O method | |
JP6333801B2 (en) | Display control device, display control program, and display control method | |
CN107004275A (en) | For determining that at least one of 3D in absolute space ratio of material object reconstructs the method and system of the space coordinate of part | |
JP6250024B2 (en) | Calibration apparatus, calibration program, and calibration method | |
WO2020124976A1 (en) | Image processing method and apparatus, and electronic device and storage medium | |
CN104598037B (en) | Information processing method and device | |
WO2014128751A1 (en) | Head mount display apparatus, head mount display program, and head mount display method | |
JP6250025B2 (en) | I / O device, I / O program, and I / O method | |
JP6446465B2 (en) | I / O device, I / O program, and I / O method | |
CN106919928A (en) | gesture recognition system, method and display device | |
CN107884930B (en) | Head-mounted device and control method | |
CN106295570A (en) | Block filtration system and method alternately | |
CN109426419B (en) | Interface display method and related equipment | |
JP2017111537A (en) | Head-mounted display and program for head-mounted display | |
JPWO2016051429A1 (en) | I / O device, I / O program, and I / O method | |
CN106896904A (en) | A kind of control method and electronic equipment | |
CN106502376A (en) | A kind of 3D touch operation methods, electronic equipment and 3D glasses |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
C14 | Grant of patent or utility model | ||
GR01 | Patent grant |