CN106127171A - Display packing, device and the terminal of a kind of augmented reality content - Google Patents
Display packing, device and the terminal of a kind of augmented reality content Download PDFInfo
- Publication number
- CN106127171A CN106127171A CN201610507158.7A CN201610507158A CN106127171A CN 106127171 A CN106127171 A CN 106127171A CN 201610507158 A CN201610507158 A CN 201610507158A CN 106127171 A CN106127171 A CN 106127171A
- Authority
- CN
- China
- Prior art keywords
- information
- content
- display
- pupil
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/19—Sensors therefor
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/193—Preprocessing; Feature extraction
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses display packing, device and the terminal of a kind of augmented reality content.Including: obtain the positional information of user's eyes pupil；Positional information according to described eyes pupil determines rectification information；According to described rectification information, the display position of targets improvement real content is adjusted.The embodiment of the present invention can determine rectification information according to user's eyes pupil, and the display position of targets improvement real content is adjusted according to the information of rectification, the display position of the targets improvement real content after adjustment and the rectification information matches of user's eyes, therefore user can watch targets improvement real content clearly, improve display efficiency, improve Consumer's Experience.
Description
Technical field
The present embodiments relate to augmented reality, particularly relate to the display packing of a kind of augmented reality content, device
And terminal.
Background technology
Augmented reality (Augmented Reality, AR), is that the information provided by computer system increases user
Technology to real world perception, by virtual Information application to real world, and by the dummy object of computer generation, scene
Or system prompt information superposition is in real scene, thus realize the enhancing to reality.By by real world information and virtual
The augmented reality that world information " seamless " is integrated, being originally difficult to experience in the certain time spatial dimension of real world
Superposition again after the entity information analog simulation arrived, by virtual Information application to real world, by the perception of human sensory institute, thus
Reach the sensory experience of exceeding reality.
In prior art, augmented reality is when display, and acquiescence user has the eyes of health, and therefore show is interior
Hold the user being applicable to eye health.But, when user's eye existing defects, as there is stravismus etc., use the aobvious of acquiescence
The mode of showing cannot improve the display effect of high-quality for the user of eye existing defects, and the display content causing user to obtain is unclear
Clear, the problem of poor user experience.
Summary of the invention
The present invention provides display packing, device and the terminal of a kind of augmented reality content, to be embodied as eye existing defects
User provide clearly strengthen content show, raising Consumer's Experience.
First aspect, embodiments provides the display packing of a kind of augmented reality content, including:
Obtain the positional information of user's eyes pupil；
Positional information according to described eyes pupil determines rectification information；
According to described rectification information, the display position of targets improvement real content is adjusted.
Second aspect, the embodiment of the present invention additionally provides the display device of a kind of augmented reality content, including:
Pupil position acquisition unit, for obtaining the positional information of user's eyes pupil；
Correct information determination unit, the position of the described eyes pupil for obtaining according to described pupil position acquisition unit
Information determines rectification information；
Display unit, for determining that according to described rectification information the described rectification information singly determined is in targets improvement reality
The display position held is adjusted.
The third aspect, the embodiment of the present invention additionally provides a kind of terminal, including the augmented reality content described in second aspect
Display device.
The embodiment of the present invention can determine rectification information according to user's eyes pupil, and adjusts target increasing according to the information of rectification
The display position of strong real content.Prior art cannot differentiate the eye whether existing defects of user, and then cannot be according to user
Eye defects the display position of augmented reality content is adjusted, the display content causing user to obtain is unintelligible, user
It is poor to experience.The embodiment of the present invention can determine rectification information according to the positional information of user's eyes pupil, then according to correcting letter
Breath adjusts the display position of targets improvement real content, the display position of the targets improvement real content after adjustment and user's eyes
Rectification information matches, therefore user can watch targets improvement real content clearly, improves display efficiency, improves user's body
Test.
Accompanying drawing explanation
Fig. 1 is the flow chart of the display packing of the augmented reality content in the embodiment of the present invention one；
Fig. 2 is the pupil position view in the embodiment of the present invention one；
Fig. 3 is the flow chart of the display packing of the augmented reality content in the embodiment of the present invention two；
Fig. 4 is the default test content schematic diagram in the embodiment of the present invention two；
Fig. 5 is the flow chart of the display packing of the augmented reality content in the embodiment of the present invention three；
Fig. 6 is the schematic diagram of the pupil relative position coordinates system in the embodiment of the present invention three；
Fig. 7 is the flow chart of the display packing of the augmented reality content in the embodiment of the present invention four；
Fig. 8 is the first plan-position schematic diagram in the embodiment of the present invention four；
Fig. 9 is the flow chart of the display packing of the augmented reality content in the embodiment of the present invention five；
Figure 10 is the second plan-position schematic diagram in the embodiment of the present invention five；
Figure 11 is the flow chart of the display packing of the augmented reality content in the embodiment of the present invention six；
Figure 12 is the structural representation of the display device of the augmented reality content in the embodiment of the present invention seven；
Figure 13 is the structural representation of the mobile terminal in the embodiment of the present invention eight.
Detailed description of the invention
The present invention is described in further detail with embodiment below in conjunction with the accompanying drawings.It is understood that this place is retouched
The specific embodiment stated is used only for explaining the present invention, rather than limitation of the invention.It also should be noted that, in order to just
Part related to the present invention is illustrate only rather than entire infrastructure in description, accompanying drawing.
Embodiment one
The flow chart of the display packing of the augmented reality content that Fig. 1 provides for the embodiment of the present invention one, the present embodiment can be fitted
For showing the situation of augmented reality content, the method can be performed by the terminal of display augmented reality, and this terminal can be
The mobile devices such as smart mobile phone, panel computer, augmented reality eyes and the augmented reality helmet, the method specifically includes following step
Rapid:
Step 110, the positional information of acquisition user's eyes pupil.
First passing through photographic head and obtain the eyes image of user, wherein, eyes image includes the eyes image of eyes.So
After, from eyes image, the contour feature according to eye determines eye contour.Finally, from eye contour, pupil is searched.Shooting
Head can obtain the image of eyeball front end, as in figure 2 it is shown, eyeball front end is made up of pupil and white of the eye two parts, wherein pupil is eye
On ball, the part of black includes pupil and iris, and the white of the eye is eyeball front end part in addition to pupil.
Exemplary, persistently the pupil position of eyes is tracked, obtains the position letter of eyes pupil in a period of time
Breath.Positional information can be the movement locus of eyes pupil, can determine the seat of pupil according to pupil position in eyes image
Mark.
Step 120, positional information according to eyes pupil determine rectification information.
Determine corresponding eye defects according to positional information, then determine the rectification information of correspondence according to eye defects.As
Really there is stravismus defect in user, then determine whether for looking side ways defect according to the positional information of eyes pupil, if stravismus defect,
Then determine the rectification information of stravismus according to positional information, the rectification information of stravismus is for carrying out laterally targets improvement real content
Mobile.The most such as, if user exists cross-eye defect (also known as cross-eye), then determine whether according to the positional information of eyes pupil
For cross-eye defect, if cross-eye defect, then determining the rectification information of stravismus according to positional information, the rectification information of stravismus is used for
Targets improvement real content is carried out the movement on focal length axle.
Step 130, according to rectification information, the display position of targets improvement real content is adjusted.
The rectification information determined according to step 120 would know that targets improvement real content adjustment direction and adjust away from
From.Such as, according to rectification information display position adjustment to targets improvement real content in the first plane of stravismus defect, the
One plane is vertical with direction of visual lines.The most such as, according to the rectification information (also known as focus information) of cross-eye defect in the second plane
Display position adjustment to targets improvement real content, described second plane is parallel with direction of visual lines.
The present embodiment can determine rectification information according to user's eyes pupil, and it is existing to adjust targets improvement according to the information of rectification
The display position of real content.Prior art cannot differentiate the eye whether existing defects of user, and then cannot be according to the eye of user
The display position of augmented reality content is adjusted by portion's defect, and the display content causing user to obtain is unintelligible, Consumer's Experience
Difference.The present embodiment can determine rectification information according to the positional information of user's eyes pupil, then adjusts mesh according to the information of rectification
The display position of mark augmented reality content, the display position of the targets improvement real content after adjustment and the rectification letter of user's eyes
Breath coupling, therefore user can watch targets improvement real content clearly, improves display efficiency, improves Consumer's Experience.
Embodiment two
The flow chart of the display packing of the augmented reality content that Fig. 3 provides for the embodiment of the present invention two, as to embodiment
One further illustrate, step 110, the positional information of acquisition user's eyes pupil, can be implemented by following manner:
Step 111, display targets improvement real content or default test content.
Targets improvement real content is effective content that user needs viewing.Preset test content scarce for being used for carrying out eye
Fall into the test content of detection.Corresponding presetting can be set according to no eye defects classification and test content.
The position letter of eyes pupil when step 112, acquisition user watch targets improvement real content or preset test content
Breath.
Exemplary, as shown in Figure 4, presetting test content is in the screen of white background, to screen on the left of screen
The stain of right side movement.When test content is preset in display, user can be pointed out to observe this stain.User watch this white point time,
Pupil can move to right side edge from the left side edge of eye contour.If pupil cannot move to the edge of eye contour, then
Illustrate that eyes exist stravismus defect.
Exemplary, targets improvement real content exists object on the left of screen, moves to the scene on the right side of screen,
Then when being played to this scene, obtain the positional information of user's eyes pupil.
The present embodiment can obtain user's eyes pupil when playing targets improvement real content or presetting test content
Positional information.Use default test content to have targetedly different eye defects to be tested.Real-world objects increases
During strong real content, it is possible to determine during user watches augmented reality content whether user has eye defects, and then
While not affecting playing progress rate, it is achieved the adjustment of the display position of targets improvement real content, improve Consumer's Experience.
Embodiment three
The display packing of the augmented reality content that Fig. 5 provides for the embodiment of the present invention three, enters as to above-described embodiment
One step explanation, step 110, the positional information of acquisition user's eyes pupil, can be implemented by following manner:
Step 110 ', obtain user's eyes pupil relative position information in eye contour.
As shown in Figure 6, after determining eye contour, determine pupil position during direct-view, set up eye with this position for initial point
Black coordinate system, each eyes set up coordinate system respectively.Determine the phase para-position of pupil with the relative position of initial point by calculating pupil
Confidence ceases.If eye does not has defect, then when observing the object of transverse shifting, eyes lead to equidistant mobile.If eye exists
Stravismus defect, then moving direction or the displacement of eyes pupil differs, and then can determine that existence stravismus defect.
The present embodiment can obtain user's eyes pupil relative position information in eye contour, facilitates eye defects
Assert, improve eye defects detection efficiency.
Embodiment four
The flow chart of the display packing of the augmented reality content that Fig. 7 provides for the embodiment of the present invention four, as to above-mentioned reality
Executing further illustrating of example, step 120, positional information according to eyes pupil determine rectification information, can be entered by following manner
Row is implemented:
Step 120a, relative position information according to pupil Yu eye contour edge determine stravismus information.
In one implementation, when the pupil of eyes arrives eye contour edge (such as canthus, left side), check
Whether the pupil of another eyes is positioned at corresponding eye contour edge (such as canthus, left side).If the pupil position of another eyes
Stravismus information is the most there is not in corresponding eye contour edge.If the pupil of another eyes is not at corresponding eyes wheel
Wide edge, then obtain the another eyes pupil relative position relative to this eye contour edge, according to this relative position calculation mesh
The displacement information of mark real content i.e. looks side ways information.
In another kind of implementation, when targets improvement real content or default test content move to screen edge
(such as the left side edge of screen), checks whether the eyes of user are positioned at corresponding eye contour edge (such as canthus, left side).If
The eyes of user are positioned at corresponding eye contour edge, then orthotropia information.If the eyes of user are not at corresponding eye
Eyeball contour edge, and eyes are identical relative to the position at respective eye contour edge, then obtain the most respective eye of eyes
The relative position of eyeball contour edge, i.e. looks side ways information according to the displacement information of this relative position calculation target real content.
Accordingly, step 130, according to rectification information, the display position of targets improvement real content is adjusted, can lead to
Cross following manner to implement:
Step 130a, according to stravismus information display position adjustment to targets improvement real content in the first plane.
As shown in Figure 8, the first plane is vertical with direction of visual lines.First plane is projection plane, and i.e. display screen place is flat
Face.If display screen is the cambered surface with radian, then on this lake surface, carry out the adjustment of the display position of targets improvement real content.
The display position of targets improvement real content can be adjusted in the first plane by the present embodiment, it is achieved to tool
There is the user of bucket stravismus defect when watching targets improvement real content, the position of targets improvement real content is adjusted.
Embodiment five
The flow chart of the display packing of the augmented reality content that Fig. 9 provides for the embodiment of the present invention five, as to above-mentioned reality
Executing further illustrating of example, step 120, positional information according to eyes pupil determine rectification information, including:
Step 120b, determine focus information according to the distance between two pupils.
If the distance between two pupils is less than presetting pupil distance, it is determined that there is cross-eye defect.Due to cross-eye meeting
Cause two focal lengths to shorten, therefore determine reducing the distance of focal length according to the distance between two pupils of user.If two eyes
Distance between black is more than presetting pupil distance, it is determined that outer eight defects.Owing to cross-eye can cause two focal lengths to increase even
Without focal length, therefore determine the increase distance of focal length according to the distance between two pupils of user.Further, if outer eight tight
Weight, then can be shown by left eye that two screens are respectively user and right eye respectively by two projector equipments and strengthen accordingly
Real content.
Accordingly, step 130, according to rectification information, the display position of targets improvement real content is adjusted, including:
Step 130b, according to focus information display position adjustment to targets improvement real content in the second plane.
As shown in Figure 10, the second plane is parallel with direction of visual lines.When direction of visual lines refers to see thing with eyes, eyes and object
Between imaginary line.Second plane is vertical with the first plane.If display screen is the cambered surface with radian, then enterprising at this lake surface
The adjustment of the display position of row targets improvement real content.
The display position of targets improvement real content can be adjusted in the second plane by the present embodiment, it is achieved to tool
There is the user of cross-eye defect and outer eight defects when watching targets improvement real content, the position to targets improvement real content
It is adjusted.
Embodiment six
The flow chart of the display packing of the augmented reality content that Figure 11 provides for the embodiment of the present invention six, as to above-mentioned reality
Execute further illustrating of example, in step 130, according to rectification information, the display position of targets improvement real content is adjusted it
After, also include:
Step 140, the adjustment instruction of reception user's input.
Adjustment instruction according to user's input determines displacement information.Instruction can be adjusted by touch screen input.Such as, user
In touch screen, input sliding trace, determine direction of displacement according to the direction of this sliding trace, according to the length of this adjustment track
Determine shift length.Further, velocity of displacement is determined according to the sliding speed of this sliding trace.
Further, adjusting instruction can be also gesture instruction, phonetic order etc..
Step 150, the display position of targets improvement real content is adjusted according to adjusting instruction.
If user is unsatisfied with the adjustment result of step 130 in the present embodiment, then user can be right by input adjustment instruction
Targets improvement real content carries out secondary adjustment, it is achieved the display position of self-defined augmented reality content, improve operability and
Consumer's Experience.
Embodiment seven
The display device of the augmented reality content that Figure 12 provides for the embodiment of the present invention seven, described device is used for realizing above-mentioned
The method that embodiment provides, this device is positioned in augmented reality equipment, and augmented reality equipment can be the augmented reality helmet, enhancing
Reality glasses, smart mobile phone or panel computer etc., this device specifically includes:
Pupil position acquisition unit 11, for obtaining the positional information of user's eyes pupil；
Correct information determination unit 12, for the described eyes pupil according to the acquisition of described pupil position acquisition unit 11
Positional information determines rectification information；
Display unit 13, for determining that according to described rectification information the described rectification information singly determined is to targets improvement reality
The display position of content is adjusted.
Further, described pupil position acquisition unit 11 specifically for:
Show described targets improvement real content or preset test content；
Obtain the position of eyes pupil when described user watches described targets improvement real content or described default test content
Confidence ceases.
Further, described pupil position acquisition unit 11 specifically for, obtain described user's eyes pupil eyes take turns
Relative position information in exterior feature.
Further, described rectification information determination unit 12 specifically for, according to described pupil and eye contour edge
Relative position information determines stravismus information；
Accordingly, described display unit 13 specifically for, according to described rectification information determination unit 12 determine described tiltedly
Visual information display position adjustment to targets improvement real content in the first plane, described first plane is hung down with direction of visual lines
Directly.
Further, described rectification information determination unit 12 specifically for, determine Jiao according to the distance between two pupils
Away from information；
Accordingly, described display unit 13 is specifically for, described Jiao determined according to described rectification information determination unit 12
Away from information display position adjustment to targets improvement real content in the second plane, described second plane is put down with direction of visual lines
OK.
Further, also include:
Receive unit 14, for receiving the adjustment instruction of user's input；
Adjustment unit 15, existing to described targets improvement for the described adjustment instruction received according to described reception unit 14
The display position of real content is adjusted.
The method that said apparatus can perform the embodiment of the present invention one and embodiment two is provided, possesses execution said method phase
The functional module answered and beneficial effect.The ins and outs of the most detailed description, can be found in the embodiment of the present invention one
The method provided with embodiment two.
By the description above with respect to embodiment, those skilled in the art it can be understood that arrive, the present invention
Can realize by software and required common hardware, naturally it is also possible to realized by hardware, but a lot of in the case of the former is more
Good embodiment.Based on such understanding, prior art is contributed by technical scheme the most in other words
Part can embody with the form of software product, and this computer software product can be stored in computer-readable recording medium
In, such as the floppy disk of computer, read only memory (Read-Only Memory, ROM), random access memory (Random
Access Memory, RAM), flash memory (FLASH), hard disk or CD etc., including some instructions with so that a computer sets
Standby (can be personal computer, server, or the network equipment etc.) performs the method described in each embodiment of the present invention.
Embodiment eight
The structural representation of a kind of terminal that Figure 13 provides for the embodiment of the present invention eight, described terminal includes embodiment seven institute
The display device of the augmented reality content shown.Terminal is mobile terminal in one implementation, such as smart mobile phone or flat board electricity
Brain.This mobile terminal can include communication unit 21, the memorizer 22 including at least one computer-readable recording medium, defeated
Enter unit 23, display unit 24, sensor 25, voicefrequency circuit 26, WIFI (Wireless Fidelity, Wireless Fidelity) module
27, at least one parts such as the processor 28 processing core and power supply 29 is included.It will be understood by those skilled in the art that
Mobile terminal structure shown in figure is not intended that the restriction to mobile terminal, can include that ratio illustrates more or less of portion
Part, or combine some parts, or different parts are arranged.Concrete:
Communication unit 21 can be used for receiving and sending messages or in communication process, the reception of signal and transmission, and this communication unit 21 can
Think RF (Radio Frequency, radio frequency) circuit, router, modem, etc. network communication equipment.Especially, when logical
Letter unit 21 is when be RF circuit, after the downlink information reception of base station, transfers to one or more than one processor 28 processes；Separately
Outward, it is sent to base station by relating to up data.Antenna, at least is included but not limited to usually as the RF circuit of communication unit
One amplifier, tuner, one or more agitator, subscriber identity module (SIM) card, transceiver, bonder, LNA
(Low Noise Amplifier, low-noise amplifier), duplexer etc..Additionally, communication unit 21 can also pass through radio communication
Communicate with network and other equipment.Described radio communication can use arbitrary communication standard or agreement, includes but not limited to GSM
(Global System of Mobile communication, global system for mobile communications), GPRS (General Packet
Radio Service, general packet radio service), CDMA (Code Division Multiple Access, CDMA),
WCDMA (Wideband Code Division Multiple Access, WCDMA), LTE (Long Term
Evolution, Long Term Evolution), Email, SMS (Short Messaging Service, Short Message Service) etc..Memorizer
22 can be used for storing software program and module, and processor 28 is stored in software program and the mould of memorizer 22 by operation
Block, thus perform the application of various function and data process.Memorizer 22 can mainly include storing program area and storage data field,
Wherein, storage program area can store application program (the such as sound-playing function, figure needed for operating system, at least one function
As playing function etc.) etc.；Storage data field can store data that the use according to mobile terminal created (such as voice data,
Phone directory etc.) etc..Additionally, memorizer 22 can include high-speed random access memory, it is also possible to include nonvolatile memory,
For example, at least one disk memory, flush memory device or other volatile solid-state parts.Correspondingly, memorizer 22 is also
Memory Controller can be included, to provide processor 28 and the input block 23 access to memorizer 22.
Input block 23 can be used for receiving numeral or the character information of input, and produces and user setup and function control
It is shaped with the keyboard of pass, mouse, action bars, optics or the input of trace ball signal.Preferably, input block 23 can include touch-sensitive table
Face 231 and other input equipments 232.Touch sensitive surface 231, also referred to as touches display screen or Trackpad, can collect user and exist
(such as user uses any applicable object such as finger, stylus or adnexa at Touch sensitive surface 231 in touch operation on or near it
Operation above or near Touch sensitive surface 231), and drive corresponding attachment means according to formula set in advance.Optionally, touch
Sensitive surfaces 231 can include touch detecting apparatus and two parts of touch controller.Wherein, touch detecting apparatus detection user's is tactile
Touch orientation, and detect the signal that touch operation brings, transmit a signal to touch controller；Touch controller is from touching detection dress
Put reception touch information, and be converted into contact coordinate, then give processor 28, and the life that processor 28 is sent can be received
Order is also performed.Furthermore, it is possible to use the polytypes such as resistance-type, condenser type, infrared ray and surface acoustic wave to realize touch-sensitive
Surface 231.Except Touch sensitive surface 231, input block 23 can also include other input equipments 232.Preferably, other inputs set
Standby 232 can include but not limited to physical keyboard, function key (such as volume control button, switch key etc.), trace ball, Mus
One or more in mark, action bars etc..
Display unit 24 can be used for the information that inputted by user of display or the information being supplied to user and mobile terminal
Various graphical user interface, these graphical user interface can be made up of figure, text, icon, video and its combination in any.
Display unit 24 can include display floater 241, optionally, can use LCD (Liquid Crystal Display, liquid crystal
Show device), the form such as OLED (Organic Light-Emitting Diode, Organic Light Emitting Diode) configure display floater
241.Further, Touch sensitive surface 231 can cover display floater 241, when Touch sensitive surface 231 detects thereon or neighbouring touching
After touching operation, send processor 28 to determine the type of touch event, exist according to the type of touch event with preprocessor 28
Corresponding visual output is provided on display floater 241.Although in fig. 13, Touch sensitive surface 231 and display floater 241 are as two
Individual independent parts realize input and input function, but in some embodiments it is possible to by Touch sensitive surface 231 and display surface
Plate 241 is integrated and realizes input and output function.
Mobile terminal may also include at least one sensor 25, such as optical sensor, motion sensor and other sensings
Device.Optical sensor can include ambient light sensor and proximity transducer, and wherein, ambient light sensor can bright according to ambient light
Secretly regulating the brightness of display floater 241, proximity transducer can cut out display floater 241 when mobile terminal moves in one's ear
And/or backlight.As the one of motion sensor, Gravity accelerometer can detect (generally three axles) in all directions and add
The size of speed, can detect that size and the direction of gravity time static, can be used for identifying application (the such as horizontal/vertical screen of mobile phone attitude
Switching, dependent game, magnetometer pose calibrating), Vibration identification correlation function (such as pedometer, percussion) etc.；Mobile terminal is also
Other sensors such as configurable gyroscope, barometer, drimeter, thermometer, infrared ray sensor, do not repeat them here.
Voicefrequency circuit 26, speaker 261, microphone 262 can provide the audio interface between user and mobile terminal.Audio frequency
The signal of telecommunication after the voice data conversion that circuit 26 can will receive, is transferred to speaker 261, speaker 261 is converted to sound
Tone signal exports；On the other hand, the acoustical signal of collection is converted to the signal of telecommunication by microphone 262, voicefrequency circuit 26 after receiving
Be converted to voice data, then after being processed by voice data output processor 28, another moves to be sent to such as through RF circuit 21
Terminal, or voice data is exported to memorizer 22 to process further.Voicefrequency circuit 26 is also possible that earphone jack,
To provide the communication of peripheral hardware earphone and mobile terminal.
In order to realize radio communication, this first mobile terminal can be configured with wireless communication unit 27, this radio communication
Unit 27 can be WIFI module.WIFI belongs to short range wireless transmission technology, and mobile terminal can by wireless communication unit 27
To help user to send and receive e-mail, to browse webpage and access streaming video etc., it has provided the user wireless broadband interconnection
Net accesses.Although figure shows wireless communication unit 27, but it is understood that, it is also not belonging to the necessary of mobile terminal
Constitute, can omit in the scope not changing disclosed essence as required completely.
Processor 28 may utilize various interface and the various piece of the whole mobile phone of connection, by running or performing storage
Software program in memorizer 22 and/or module, and call the data being stored in memorizer 22, perform mobile terminal
Various functions and process data, thus mobile phone is carried out integral monitoring.Optionally, processor 28 can include one or more process
Core；Preferably, processor 28 can integrated application processor and modem processor, wherein, application processor mainly processes
Operating system, user interface and application program etc., modem processor mainly processes radio communication.On it is understood that
State modem processor can not also be integrated in processor 28.
Mobile terminal also includes the power supply 29 (such as battery) powered to all parts, it is preferred that power supply can be by electricity
Management system is logically contiguous with processor 28, thus realizes management charging, electric discharge and power consumption pipe by power-supply management system
The functions such as reason.Power supply 29 can also include one or more direct current or alternating current power supply, recharging system, power failure inspection
Slowdown monitoring circuit, power supply changeover device or the random component such as inverter, power supply status indicator.
It should be noted that mobile terminal can also include photographic head, bluetooth module etc., do not repeat them here.
In the present embodiment, described processor 28 is used for:
Obtain the positional information of user's eyes pupil；
Positional information according to described eyes pupil determines rectification information；
According to described rectification information, the display position of targets improvement real content is adjusted.
Further, the described positional information obtaining user's eyes pupil, including:
Show described targets improvement real content or preset test content；
Obtain the position of eyes pupil when described user watches described targets improvement real content or described default test content
Confidence ceases.
Further, the described positional information obtaining user's eyes pupil, including:
Obtain described user's eyes pupil relative position information in eye contour.
Further, the described positional information according to described eyes pupil determines rectification information, including:
Relative position information according to described pupil Yu eye contour edge determines stravismus information；
Accordingly, described according to described rectification information, the display position of targets improvement real content is adjusted, including:
According to the display position adjustment to targets improvement real content in the first plane of described stravismus information, described first
Plane is vertical with direction of visual lines.
Further, the described positional information according to described eyes pupil determines rectification information, including:
Focus information is determined according to the distance between two pupils.
Accordingly, described according to described rectification information, the display position of targets improvement real content is adjusted, including:
According to the display position adjustment to targets improvement real content in the second plane of described focus information, described second
Plane is parallel with direction of visual lines.
Further, after the display position of targets improvement real content being adjusted according to described rectification information,
Also include:
Receive the adjustment instruction of user's input；
According to described adjustment instruction, the display position of described targets improvement real content is adjusted.
Note, above are only presently preferred embodiments of the present invention and institute's application technology principle.It will be appreciated by those skilled in the art that
The invention is not restricted to specific embodiment described here, can carry out for a person skilled in the art various obvious change,
Readjust and substitute without departing from protection scope of the present invention.Therefore, although by above example, the present invention is carried out
It is described in further detail, but the present invention is not limited only to above example, without departing from the inventive concept, also
Other Equivalent embodiments more can be included, and the scope of the present invention is determined by scope of the appended claims.
Claims (13)
1. the display packing of an augmented reality content, it is characterised in that including:
Obtain the positional information of user's eyes pupil；
Positional information according to described eyes pupil determines rectification information；
According to described rectification information, the display position of targets improvement real content is adjusted.
The display packing of augmented reality content the most according to claim 1, it is characterised in that described acquisition user's eyes eye
Black positional information, including:
Show described targets improvement real content or preset test content；
Obtain the position letter of eyes pupil when described user watches described targets improvement real content or described default test content
Breath.
The display packing of augmented reality content the most according to claim 1, it is characterised in that described acquisition user's eyes eye
Black positional information, including:
Obtain described user's eyes pupil relative position information in eye contour.
The display packing of augmented reality content the most according to claim 3, it is characterised in that described according to described eyes eye
Black positional information determines rectification information, including:
Relative position information according to described pupil Yu eye contour edge determines stravismus information；
Accordingly, described according to described rectification information, the display position of targets improvement real content is adjusted, including:
According to the display position adjustment to targets improvement real content in the first plane of described stravismus information, described first plane
Vertical with direction of visual lines.
The display packing of augmented reality content the most according to claim 3, it is characterised in that described according to described eyes eye
Black positional information determines rectification information, including:
Focus information is determined according to the distance between two pupils.
Accordingly, described according to described rectification information, the display position of targets improvement real content is adjusted, including:
According to the display position adjustment to targets improvement real content in the second plane of described focus information, described second plane
Parallel with direction of visual lines.
The display packing of augmented reality content the most according to claim 1, it is characterised in that according to described rectification information
After the display position of targets improvement real content is adjusted, also include:
Receive the adjustment instruction of user's input；
According to described adjustment instruction, the display position of described targets improvement real content is adjusted.
7. the display device of an augmented reality content, it is characterised in that including:
Pupil position acquisition unit, for obtaining the positional information of user's eyes pupil；
Correct information determination unit, the positional information of the described eyes pupil for obtaining according to described pupil position acquisition unit
Determine rectification information；
Display unit, for determining that according to described rectification information the described rectification information singly determined is to targets improvement real content
Display position is adjusted.
The display device of augmented reality content the most according to claim 7, it is characterised in that described pupil position acquisition list
Unit specifically for:
Show described targets improvement real content or preset test content；
Obtain the position letter of eyes pupil when described user watches described targets improvement real content or described default test content
Breath.
The display device of augmented reality content the most according to claim 7, it is characterised in that described pupil position acquisition list
Unit specifically for, obtain described user's eyes pupil relative position information in eye contour.
The display device of augmented reality content the most according to claim 9, it is characterised in that described rectification information determines
Unit specifically for, determine stravismus information according to the relative position information of described pupil Yu eye contour edge；
Accordingly, described display unit specifically for, exist according to the described stravismus information that described rectification information determination unit determines
The interior display position adjustment to targets improvement real content of first plane, described first plane is vertical with direction of visual lines.
The display device of 11. augmented reality contents according to claim 9, it is characterised in that described rectification information determines
Unit specifically for, determine focus information according to the distance between two pupils；
Accordingly, described display unit specifically for, exist according to the described focus information that described rectification information determination unit determines
The interior display position adjustment to targets improvement real content of second plane, described second plane is parallel with direction of visual lines.
The display device of 12. augmented reality contents according to claim 7, it is characterised in that also include:
Receive unit, for receiving the adjustment instruction of user's input；
Adjustment unit, instructs described targets improvement real content for the described adjustment received according to described reception unit
Display position is adjusted.
13. 1 kinds of terminals, it is characterised in that include that the display of the augmented reality content according to any one of claim 7-12 fills
Put.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610507158.7A CN106127171A (en) | 2016-06-28 | 2016-06-28 | Display packing, device and the terminal of a kind of augmented reality content |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610507158.7A CN106127171A (en) | 2016-06-28 | 2016-06-28 | Display packing, device and the terminal of a kind of augmented reality content |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106127171A true CN106127171A (en) | 2016-11-16 |
Family
ID=57467706
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610507158.7A Pending CN106127171A (en) | 2016-06-28 | 2016-06-28 | Display packing, device and the terminal of a kind of augmented reality content |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106127171A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107784693A (en) * | 2017-09-22 | 2018-03-09 | 西安点云生物科技有限公司 | A kind of information processing method and device |
| CN108196669A (en) * | 2017-12-14 | 2018-06-22 | 网易（杭州）网络有限公司 | Modification method, device, processor and the head-mounted display apparatus of avatar model |
| CN108717234A (en) * | 2018-05-21 | 2018-10-30 | 云谷（固安）科技有限公司 | Sight protectio method and display device |
| CN110134228A (en) * | 2018-02-09 | 2019-08-16 | 联想（新加坡）私人有限公司 | Information processing method, information processing equipment and the product for information processing |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102540464A (en) * | 2010-11-18 | 2012-07-04 | 微软公司 | Head-mounted display device which provides surround video |
| CN102944935A (en) * | 2012-11-13 | 2013-02-27 | 京东方科技集团股份有限公司 | Binocular head-wearing display device and method thereof for adjusting image spacing |
| CN103853326A (en) * | 2012-12-06 | 2014-06-11 | 国际商业机器公司 | Dynamic augmented reality media creation |
| CN104767972A (en) * | 2015-04-02 | 2015-07-08 | 深圳市虚拟现实科技有限公司 | Visual defect help system and method |
| CN104918036A (en) * | 2014-03-12 | 2015-09-16 | 联想(北京)有限公司 | Augmented reality display device and method |
| CN105068659A (en) * | 2015-09-01 | 2015-11-18 | 陈科枫 | Reality augmenting system |
| CN105095885A (en) * | 2015-09-06 | 2015-11-25 | 广东小天才科技有限公司 | Human eye state detection method and detection device |
| CN105182662A (en) * | 2015-09-28 | 2015-12-23 | 神画科技（深圳）有限公司 | Projection method and system with augmented reality effect |
| CN105353512A (en) * | 2015-12-10 | 2016-02-24 | 联想(北京)有限公司 | Image display method and device |
| CN105607255A (en) * | 2014-11-17 | 2016-05-25 | 精工爱普生株式会社 | Head-mounted display device, method of controlling head-mounted display device, and computer program |
-
2016
- 2016-06-28 CN CN201610507158.7A patent/CN106127171A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102540464A (en) * | 2010-11-18 | 2012-07-04 | 微软公司 | Head-mounted display device which provides surround video |
| CN102944935A (en) * | 2012-11-13 | 2013-02-27 | 京东方科技集团股份有限公司 | Binocular head-wearing display device and method thereof for adjusting image spacing |
| CN103853326A (en) * | 2012-12-06 | 2014-06-11 | 国际商业机器公司 | Dynamic augmented reality media creation |
| CN104918036A (en) * | 2014-03-12 | 2015-09-16 | 联想(北京)有限公司 | Augmented reality display device and method |
| CN105607255A (en) * | 2014-11-17 | 2016-05-25 | 精工爱普生株式会社 | Head-mounted display device, method of controlling head-mounted display device, and computer program |
| CN104767972A (en) * | 2015-04-02 | 2015-07-08 | 深圳市虚拟现实科技有限公司 | Visual defect help system and method |
| CN105068659A (en) * | 2015-09-01 | 2015-11-18 | 陈科枫 | Reality augmenting system |
| CN105095885A (en) * | 2015-09-06 | 2015-11-25 | 广东小天才科技有限公司 | Human eye state detection method and detection device |
| CN105182662A (en) * | 2015-09-28 | 2015-12-23 | 神画科技（深圳）有限公司 | Projection method and system with augmented reality effect |
| CN105353512A (en) * | 2015-12-10 | 2016-02-24 | 联想(北京)有限公司 | Image display method and device |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107784693A (en) * | 2017-09-22 | 2018-03-09 | 西安点云生物科技有限公司 | A kind of information processing method and device |
| CN107784693B (en) * | 2017-09-22 | 2021-06-04 | 西安点云生物科技有限公司 | Information processing method and device |
| CN108196669A (en) * | 2017-12-14 | 2018-06-22 | 网易（杭州）网络有限公司 | Modification method, device, processor and the head-mounted display apparatus of avatar model |
| CN108196669B (en) * | 2017-12-14 | 2021-04-02 | 网易（杭州）网络有限公司 | Game role model correction method and device, processor and head-mounted display equipment |
| CN110134228A (en) * | 2018-02-09 | 2019-08-16 | 联想（新加坡）私人有限公司 | Information processing method, information processing equipment and the product for information processing |
| CN108717234A (en) * | 2018-05-21 | 2018-10-30 | 云谷（固安）科技有限公司 | Sight protectio method and display device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN103473494B (en) | A kind of run the method for application, device and terminal unit | |
| CN103826065B (en) | A kind of image processing method and device | |
| CN103458219A (en) | Method, device and terminal device for adjusting face in video call | |
| CN108319338A (en) | Display screen determines method, mobile terminal and computer readable storage medium | |
| CN106203254A (en) | A kind of adjustment is taken pictures the method and device in direction | |
| CN103530520A (en) | Method and terminal for obtaining data | |
| CN107396193B (en) | The method and apparatus of video playing | |
| CN108170392A (en) | Double screen switching method, dual-screen mobile terminal and computer readable storage medium | |
| CN104820546B (en) | Function information methods of exhibiting and device | |
| CN106127171A (en) | Display packing, device and the terminal of a kind of augmented reality content | |
| CN109739394A (en) | A kind of processing method of SAR value, mobile terminal | |
| CN109995391A (en) | A kind of image display method, intelligently wearing terminal and computer readable storage medium | |
| CN108184023A (en) | screen state control method, mobile terminal and computer readable storage medium | |
| CN108227934A (en) | display area lighting method, mobile terminal and computer readable storage medium | |
| CN106951139A (en) | Message notifying frame display methods and device | |
| CN103530624B (en) | Information generating method, device and terminal equipment | |
| CN103399657B (en) | The control method of mouse pointer, device and terminal unit | |
| CN110069122A (en) | A kind of screen control method, terminal and computer readable storage medium | |
| CN108920081A (en) | A kind of interaction regulation method, equipment and computer readable storage medium | |
| CN108184011A (en) | A kind of reminder announced method, terminal and computer readable storage medium | |
| CN107977261A (en) | Method, equipment, mobile terminal and the computer-readable storage medium of limiting process | |
| CN108226880A (en) | Ultrasonic distance detects anti-tampering method, apparatus and storage medium | |
| CN107330867A (en) | Image combining method, device, computer-readable recording medium and computer equipment | |
| CN109558009A (en) | Video broadcasting method, mobile terminal and computer readable storage medium | |
| CN109088986A (en) | Mobile terminal guard method, mobile terminal and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20161116 |
|
| RJ01 | Rejection of invention patent application after publication |