CN108962182A - 3-D image display device and its implementation based on eyeball tracking - Google Patents
3-D image display device and its implementation based on eyeball tracking Download PDFInfo
- Publication number
- CN108962182A CN108962182A CN201810623038.2A CN201810623038A CN108962182A CN 108962182 A CN108962182 A CN 108962182A CN 201810623038 A CN201810623038 A CN 201810623038A CN 108962182 A CN108962182 A CN 108962182A
- Authority
- CN
- China
- Prior art keywords
- period
- time
- user
- photos
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0442—Handling or displaying different aspect ratios, or changing the aspect ratio
Abstract
The invention discloses a kind of 3-D image display device and its implementation based on eyeball tracking, the device includes: a display module, it include the threedimensional model at least one place and/or the threedimensional model of at least one article in the 3-D image for showing one or more 3-D images；One shooting module, for shooting at least two photos of user within period first time；One processor for obtaining eye trajectory of the user within period first time according to shooting module at least two photos captured within period first time, and changes the state of 3-D image according to the eye trajectory；The present invention identifies the eye trajectory of user by shooting the multiple pictures of user, and changes the state of 3-D image according to eye trajectory, realizes touchless interaction, and the display module of 3-D image is applied in more different occasions.The present invention can be widely applied to three-dimensional image display device field.
Description
Technical field
The present invention relates to three-dimensional image display device field, especially a kind of three-dimensional image apparatus based on eyeball tracking and
Its implementation.
Background technique
With the development of 3-D image technology, more and more 3-D images are applied in our life.Present production
Their product can be scanned into threedimensional model by three-dimensional scanning device to show to customer by product manufacturer, such as automobile factory
Quotient can be by an automobile scanning at threedimensional model, and customer can browse production from different angles by some electronic equipments
Product.Therefore businessman does not need to worry that shop does not have enough areas to show the product of oneself, they can be by shop
Or its show venue places some three dimensional image apparatus to show the threedimensional model of its product to user.
The main of this kind of product is interacted in a manner of touch screen method at present, if three dimensional image apparatus needs to be placed on people
It is difficult to the place touched, such as the demand for being then unable to satisfy customer's interaction aloft or after being placed on fence is set.
Summary of the invention
In order to solve the above technical problems, it is an object of the invention to: provide it is a kind of may be implemented touch free operation based on
The three-dimensional image apparatus and its implementation of eyeball tracking.
The first technical solution adopted by the present invention is:
3-D image display device based on eyeball tracking, comprising:
One display module includes at least one place in the 3-D image for showing one or more 3-D images
Threedimensional model and/or at least one article threedimensional model；
One shooting module, for shooting at least two photos of user within period first time；
One processor, for being obtained according to shooting module at least two photos captured within period first time
Eye trajectory of the user within period first time, and according to the state of eye trajectory change 3-D image；
The state for changing 3-D image include: the whole display view angle for changing 3-D image, shape, size and/
Or color, and change display view angle, shape, size and/or the color of the part of 3-D image.
Further, the processor is specifically used for: being shot at least within period first time according to shooting module
Two photos in two photos obtain eye trajectory of the user within period first time.
Further, the processor is at least two photos shot within period first time according to shooting module
In two photos when obtaining eye trajectory of the user within period first time, first selected from least two photos
Two photos therein are taken, the first position of user eyeball is then identified from the photo first shot in two photos being selected
The second position coordinate that user eyeball is identified in coordinate, and the photo that shoots after in two photos being selected, finally will
The second position coordinate of user eyeball subtracts first position coordinate and obtains a vector, using the vector as user at described first
Between eye trajectory in the period.
Further, the shooting module is also used to shoot the multiple pictures of user in a second time period；
The processor is also used to be used according to the multiple pictures that shooting module is shot in the second time period
Number of winks of the family in the second time period, and according to the state of number of winks change 3-D image.
Further, including a memory, the memory are used to store one or more of 3-D images, the storage
Device can be the local storage either memory of deployment on the remote server.
Second of technical solution adopted by the present invention is:
The implementation method of 3-D image display device based on eyeball tracking, comprising the following steps:
One or more 3-D images are shown by display module, include the three of at least one place in the 3-D image
The threedimensional model of dimension module and/or at least one article；
At least two photos of user are shot within period first time by shooting module；
It is used by processor according to shooting module at least two photos captured within period first time
Eye trajectory of the family within period first time；
Change the state of 3-D image according to the eye trajectory by processor；
The state for changing 3-D image include: the whole display view angle for changing 3-D image, shape, size and/
Or color, and change display view angle, shape, size and/or the color of the part of 3-D image.
Further, it is described by processor according to captured within period first time at least two of shooting module
Photo obtains the step of eye trajectory of the user within period first time specifically:
Two at least two photos shot within period first time by processor according to shooting module
Photo obtains eye trajectory of the user within period first time.
Further, at least two photographs shot within period first time by processor according to shooting module
Two photos in piece obtain the step of eye trajectory of the user within period first time and include:
Two photos therein are chosen from least two photos,
The first position coordinate of user eyeball is identified from the photo first shot in two photos being selected, and from quilt
The second position coordinate of user eyeball is identified in the photo shot after in two photos chosen,
The second position coordinate of user eyeball is subtracted into first position coordinate and obtains a vector, is existed using the vector as user
Eye trajectory in period first time.
Further, further comprising the steps of:
The multiple pictures of user are shot also in a second time period by the shooting module；
User is obtained according to the multiple pictures that shooting module is shot in the second time period by the processor
Number of winks in the second time period, and according to the state of number of winks change 3-D image.
Further, further comprising the steps of:
One or more of 3-D images are stored by memory, the memory can be local storage either
The memory of deployment on the remote server.
The beneficial effects of the present invention are: the present invention identifies the eye trajectory of user by shooting the multiple pictures of user,
And change the state of 3-D image according to eye trajectory, touchless interaction is realized, so that the display mould of 3-D image
Block can be applied in more different occasions.
Detailed description of the invention
Fig. 1 is a kind of module frame chart of the 3-D image display device based on eyeball tracking of specific embodiment of the present invention；
Fig. 2 is a kind of implementation method of the 3-D image display device based on eyeball tracking of specific embodiment of the present invention
Flow chart.
Specific embodiment
It is carried out below with reference to technical effect of the embodiment and attached drawing to design of the invention, specific structure and generation clear
Chu, complete description, to be completely understood by the purpose of the present invention, scheme and effect.
It should be noted that unless otherwise specified, when a certain feature referred to as " fixation ", " connection " are in another feature,
It can directly fix, be connected to another feature, and can also fix, be connected to another feature indirectly.In addition, this
The descriptions such as the upper and lower, left and right used in open are only the mutual alignment pass relative to each component part of the disclosure in attached drawing
For system.The "an" of used singular, " described " and "the" are also intended to including most forms in the disclosure, are removed
Non- context clearly expresses other meaning.In addition, unless otherwise defined, all technical and scientific terms used herein
It is identical as the normally understood meaning of those skilled in the art.Term used in the description is intended merely to describe herein
Specific embodiment is not intended to be limiting of the invention.Term as used herein "and/or" includes one or more relevant
The arbitrary combination of listed item.
It will be appreciated that though various elements, but this may be described using term first, second, third, etc. in the disclosure
A little elements should not necessarily be limited by these terms.These terms are only used to for same type of element being distinguished from each other out.For example, not departing from
In the case where disclosure range, first element can also be referred to as second element, and similarly, second element can also be referred to as
One element.The use of provided in this article any and all example or exemplary language (" such as ", " such as ") is intended merely to more
Illustrate the embodiment of the present invention well, and unless the context requires otherwise, otherwise the scope of the present invention will not be applied and be limited.
With reference to Fig. 1, present embodiment discloses a kind of 3-D image display device based on eyeball tracking, the 3-D image is aobvious
Showing device includes a display module 101, a shooting module 102 and a processor 103.
Wherein, display module 101 includes at least one in the 3-D image for showing one or more 3-D images
The threedimensional model of the threedimensional model in place and/or at least one article.Display module 101 can be display screen, projector or
The display module of air imaging device etc..In some embodiments, 3-D image can be the threedimensional model of an exhibition room, described
It may include the threedimensional model of one or more article in exhibition room, for example, user can see an exhibition by display module 101
It placed several articles in the Room.In other embodiments, 3-D image can be the threedimensional model of single item, e.g.
The threedimensional model of one automobile.
Shooting module 102 within period first time for shooting at least two photos of user.Period first time
It can be configured, such as can be set to 0.1 second, 0.5 second, 1 second etc. according to actual needs, within period first time, clap
At least two photos should be shot by taking the photograph module 102, such as it shoots two photos in 0.1 second, or shoots 15 in 0.5 second
Open photo.The shooting module can be camera or video recorder.In addition, photo should include the figure in video recording in the present invention
As frame, therefore shoots one section of video and be also considered as having taken several photos.Those skilled in the art can be according to shooting
Module 102 type selecting and human eye variation speed come period first time is set length and shooting module 102 first
The number of pictures shot in time cycle.
Processor 103, at least two photos captured within period first time according to shooting module 102
Obtain eye trajectory of the user within period first time.In some embodiments, processor 103 can be according to described
All photos for shooting in period first time describe eye trajectory of the user within period first time, i.e., successively identify institute
Have an eyeball position in photo, and depict a curve in same coordinate according to chronological order, and using the curve as
Eye trajectory.In further embodiments, processor 103 can be according to the Part of photos taken shot within period first time
To describe eye trajectory of the user within period first time, wherein Part of photos taken can be randomly selected from all photos or
Person regularly extracts, for example, shooting module 102 has taken the photo that number is 1 to 10, this field within period first time
Technical staff can set a random function, and at least two photos are extracted in ten photos.Those skilled in the art can also be with
It is fixed to extract two photos that number is 1 and 10.Or those skilled in the art can also extract the photograph that all numbers are even number
Piece.
Processor 103 is also used to change according to the eye trajectory state of 3-D image.Processor 103 can be by first
Input signal of the eye trajectory as user within period first time in time cycle, processor can be believed according to the input
Number change the state of 3-D image.The state for changing 3-D image includes: to change the whole display view of 3-D image
Angle, shape, size and/or color, and change display view angle, shape, size and/or the color of the part of 3-D image.One
In a little embodiments, 3-D image is an exhibition room, and when the eyeball of user is toward when moving right, processor 103 can be by the exhibition room left side
The visual angle on (or the right) is moved to the center of display module 101, and similarly, user can change a quotient by eye trajectory
The visual angle of the threedimensional model of product.In some embodiments, the commodity are the commodity that can change shape, such as one can beat
The automobile of door opening.User can be realized by specific eye trajectory opens car door or closed door, for example, this field
Technical staff can be by " o " type eye trajectory as the input signal for opening car door or closed door.In some embodiments,
User can also be zoomed in or out article by specific eye trajectory, and in the present invention, size refers to three-dimensional
The relative size of image.In further embodiments, user can change the color of article, example by specific eye trajectory
To the left or the color that can switch article is moved right such as eyeball.In addition, some while comprising place or article three
It ties up in image, processor 103 can determine the object of operation selected by user, example by identifying the specific eye trajectory of user
Such as, user will can first need the object that operates to be moved to the center of display module, then by a specific eye trajectory come
Determine object of some article as operation in 3-D image, after choosing object of some article as operation, processor
103 can change the state of the article, i.e. the present invention can be operated for the part in 3-D image.
As preferred embodiment, those skilled in the art increase the place of processor 103 to reduce data processing amount
Speed is managed, selected part carries out the object as data processing in the photo that can be shot within period first time, but answers
When at least choose two photos.Meanwhile if the case where Part of photos taken appearance can not identify eyeball, it should be arranged what replacement was chosen
The mechanism of photo, to guarantee the validity of two selected photos.
As preferred embodiment, those skilled in the art increase processor to be further reduced data processing amount
103 processing speed in the photo that can be shot within period first time, only chooses two photos.And in the same coordinate system
In, it identifies the position coordinates of eyeball in two selected photos, the position coordinates of eyeball in the photo of rear shooting is subtracted
The position coordinates of eyeball in the photo first shot, to obtain a vector, which can be used as user in period first time
Interior eye trajectory.
As preferred embodiment, the processor 103 is also used to according to shooting module 102 in second time period
The multiple pictures of shooting obtain number of winks of the user in the second time period, and change three according to the number of winks
Tie up the state of image.The processor 103 can successively identify the eyeball in the multiple pictures shot in second time period,
And the photo for not recognizing eyeball is marked, with an isolated photo not being labeled or it is continuous multiple do not have
For labeled photo as timing point, the quantity of timing point is then the number of blink.Described one isolated not to be labeled
Two photos are marked with before and after photo refers to the photo not being labeled.Such as 10 are had taken in second time period
Photo is opened, indicates labeled with 1,0 indicates unmarked, which is respectively labeled as 1010001011, it is believed that
In second time period, user is blinked three times.Processor 103 can be according to blink of the user in second time period
Number changes the state of 3-D image.By increasing the judgement of number of winks, can be obtained with eye trajectory cooperation more
Interactive mode.For example, user can choose some article in 3-D image by blinking twice, by eye trajectory come
Change the visual angle of 3-D image.
As preferred embodiment, the present apparatus can also include a memory 104, and the memory 104 is for storing
Shown one or more 3-D image, the memory 104 can be the local storages such as hard disk or USB flash disk.It is also possible to portion
Administration's memory in remote server.Local storage can pass through the interfaces such as such as USB/SATA and processor 103 and/or display
Module 101 connects, and the memory being deployed in remote server can be by internet and processor 103 or display module
101 connections.One or more of 3-D images can be neatly stored in by those skilled in the art according to actual needs
Different positions.
Referring to Fig. 2, one kind 3-D image display device based on eyeball tracking as shown in Figure 1 is present embodiments provided
Implementation method.The device includes a display module 101, a shooting module 102 and a processor 103.The method packet of the present embodiment
Include following steps:
S201, one or more 3-D images are shown by display module 101.It include at least one in the 3-D image
The threedimensional model of the threedimensional model in place and/or at least one article.In some embodiments, 3-D image can be an exhibition
The threedimensional model in the Room may include the threedimensional model of one or more article in the exhibition room, for example, user can be by aobvious
Showing that module 101 is seen placed several articles in an exhibition room.In other embodiments, 3-D image can be single item
Threedimensional model, the threedimensional model of e.g. one automobile.
S202, at least two photos for shooting user within period first time by shooting module 102.At the first time
Period can be configured according to actual needs, such as can be set to 0.1 second, 0.5 second, 1 second etc., in period first time
Interior, shooting module 102 should shoot at least two photos, such as it shoots two photos in 0.1 second, or in 0.5 second
Shoot 15 photos.The shooting module can be camera or video recorder.In addition, photo should include video recording in the present invention
In picture frame, therefore shoot one section of video be also considered as having taken several photos.Those skilled in the art can root
The length and shooting module 102 in period first time are set according to the speed that the type selecting and human eye of shooting module 102 change
The number of pictures shot within period first time.
S203, by processor 103 according to captured within period first time at least two of shooting module 102
Photo obtains eye trajectory of the user within period first time.In some embodiments, processor 103 can according to
All photos for shooting in period first time describe eye trajectory of the user within period first time, i.e., successively know
Eyeball position in not all photos, and a curve is depicted in same coordinate according to chronological order, and with the curve
As eye trajectory.In further embodiments, processor 103 can be according to the part shot within period first time
Photo describes eye trajectory of the user within period first time, wherein Part of photos taken can take out at random from all photos
It takes or regularly extracts, for example, shooting module 102 has taken the photo that number is 1 to 10 within period first time, this
Field technical staff can set a random function, and at least two photos are extracted in ten photos.Those skilled in the art
Two photos for extracting that number is 1 and 10 can be fixed.Or it is even number that those skilled in the art, which can also extract all numbers,
Photo.
S204, processor 103 change the state of 3-D image according to the eye trajectory.The shape for changing 3-D image
State includes: to change whole display view angle, shape, size and/or the color of 3-D image, and change the part of 3-D image
Display view angle, shape, size and/or color.Processor 103 can exist the eye trajectory in period first time as user
Input signal in period first time, processor can change the state of 3-D image according to the input signal.It is described to change
The state for becoming 3-D image includes: to change whole display view angle, shape, size and/or the color of 3-D image, and change three
Tie up display view angle, shape, size and/or the color of the part of image.In some embodiments, 3-D image is an exhibition room,
When the eyeball of user is toward when moving right, the visual angle on the exhibition room left side (or the right) can be moved to display module by processor 103
101 center, similarly, user can change the visual angle of the threedimensional model of a commodity by eye trajectory.In some implementations
In example, the commodity are the commodity that can change shape, such as an automobile that can open car door.User can be by specific
Eye trajectory open car door or closed door to realize, for example, those skilled in the art can make " o " type eye trajectory
For the input signal for opening car door or closed door.In some embodiments, user can also pass through specific eye trajectory
Article is zoomed in or out, in the present invention, size refers to the relative size of 3-D image.In other embodiments
In, user can change the color of article by specific eye trajectory, such as eyeball to the left or is moved right and can be cut
Change the color of article.In addition, processor 103 can pass through knowledge in some while 3-D images comprising place or article
The specific eye trajectory of other user determines the selected object operated of user, for example, pair that user first will can need operate
Then center as being moved to display module determines some article conduct in 3-D image by a specific eye trajectory
The object of operation, after choosing object of some article as operation, processor 103 can only change the state of the article, i.e., originally
Invention can be operated for the part in 3-D image.
As preferred embodiment, those skilled in the art increase the place of processor 103 to reduce data processing amount
Speed is managed, selected part carries out pair as data processing in the photo that step S203 can be shot within period first time
As, but should at least choose two photos.Meanwhile if the case where Part of photos taken appearance can not identify eyeball, should be arranged
The mechanism for the photo chosen is replaced, to guarantee the validity of two selected photos.
As preferred embodiment, those skilled in the art increase processor to be further reduced data processing amount
103 processing speed only chooses two photos in the photo that step S203 can be shot within period first time.And
In the same coordinate system, the position coordinates of eyeball in two selected photos are identified, by the position of eyeball in the photo of rear shooting
The position coordinates that coordinate subtracts eyeball in the photo first shot are set, to obtain a vector, which can be used as user
Eye trajectory in a period of time.
As preferred embodiment, further includes step S205, passes through processor 103 according to shooting module 102 second
The multiple pictures shot in time cycle obtain number of winks of the user in the second time period, and according to the blink
The state of number change 3-D image.The processor 103 can successively identify multiple photographs shot in second time period
Eyeball in piece, and the photo for not recognizing eyeball is marked, with an isolated photo not being labeled or
Continuously for multiple photos not being labeled as timing point, the quantity of timing point is then the number of blink.Described one isolated
Two photos are marked with before and after the photo not being labeled refers to the photo not being labeled.Such as in week the second time
10 photos are had taken in phase, indicate labeled with 1, and 0 indicates unmarked, which is respectively labeled as
1010001011, it is believed that in second time period, user is blinked three times.Processor 103 can be according to user
Number of winks in second time period changes the state of 3-D image.By increasing the judgement of number of winks, Ke Yiyu
Eye trajectory cooperates to obtain more interactive modes.For example, user can be chosen in 3-D image twice by blink
Some article changes the visual angle of 3-D image by eye trajectory.
Be additionally provided with as preferred embodiment, before step S201: S200, stored by memory 104 it is one
Or multiple 3-D images, the memory 104 can be the local storage either memory of deployment on the remote server.
One or more of 3-D images can be stored in different positions by those skilled in the art according to actual needs.
It should be appreciated that the embodiment of the present invention can be by computer hardware, the combination of hardware and software or by depositing
The computer instruction in non-transitory computer-readable memory is stored up to be effected or carried out.Standard volume can be used in the method
Journey technology-includes that the non-transitory computer-readable storage media configured with computer program is realized in computer program,
In configured in this way storage medium computer is operated in a manner of specific and is predefined --- according in a particular embodiment
The method and attached drawing of description.Each program can with the programming language of level process or object-oriented come realize with department of computer science
System communication.However, if desired, the program can be realized with compilation or machine language.Under any circumstance, which can be volume
The language translated or explained.In addition, the program can be run on the specific integrated circuit of programming for this purpose.
In addition, the operation of process described herein can be performed in any suitable order, unless herein in addition instruction or
Otherwise significantly with contradicted by context.Process described herein (or modification and/or combination thereof) can be held being configured with
It executes, and is can be used as jointly on the one or more processors under the control of one or more computer systems of row instruction
The code (for example, executable instruction, one or more computer program or one or more application) of execution, by hardware or its group
It closes to realize.The computer program includes the multiple instruction that can be performed by one or more processors.
Further, the method can be realized in being operably coupled to suitable any kind of computing platform, wrap
Include but be not limited to PC, mini-computer, main frame, work station, network or distributed computing environment, individual or integrated
Computer platform or communicated with charged particle tool or other imaging devices etc..Each aspect of the present invention can be to deposit
The machine readable code on non-transitory storage medium or equipment is stored up to realize no matter be moveable or be integrated to calculating
Platform, such as hard disk, optical reading and/or write-in storage medium, RAM, ROM, so that it can be read by programmable calculator, when
Storage medium or equipment can be used for configuration and operation computer to execute process described herein when being read by computer.This
Outside, machine readable code, or part thereof can be transmitted by wired or wireless network.When such media include combining microprocessor
Or other data processors realize steps described above instruction or program when, invention as described herein including these and other not
The non-transitory computer-readable storage media of same type.When methods and techniques according to the present invention programming, the present invention
It further include computer itself.
Computer program can be applied to input data to execute function as described herein, to convert input data with life
At storing to the output data of nonvolatile memory.Output information can also be applied to one or more output equipments as shown
Device.In the preferred embodiment of the invention, the data of conversion indicate physics and tangible object, including the object generated on display
Reason and the particular visual of physical objects are described.
The above, only presently preferred embodiments of the present invention, the invention is not limited to above embodiment, as long as
It reaches technical effect of the invention with identical means, all within the spirits and principles of the present invention, any modification for being made,
Equivalent replacement, improvement etc., should be included within the scope of the present invention.Its technical solution within the scope of the present invention
And/or embodiment can have a variety of different modifications and variations.
Claims (10)
1. the 3-D image display device based on eyeball tracking characterized by comprising
One display module includes the three of at least one place in the 3-D image for showing one or more 3-D images
The threedimensional model of dimension module and/or at least one article；
One shooting module, for shooting at least two photos of user within period first time；
One processor, for obtaining user according to shooting module at least two photos captured within period first time
Eye trajectory within period first time, and according to the state of eye trajectory change 3-D image；
The state for changing 3-D image includes: to change whole display view angle, shape, size and/or the face of 3-D image
Color, and change display view angle, shape, size and/or the color of the part of 3-D image.
2. the 3-D image display device according to claim 1 based on eyeball tracking, it is characterised in that: the processor
Be specifically used for: two photos at least two photos shot within period first time according to shooting module are used
Eye trajectory of the family within period first time.
3. the 3-D image display device according to claim 2 based on eyeball tracking, it is characterised in that: the processor
Two photos at least two photos shot within period first time according to shooting module obtain user in institute
When stating the eye trajectory in period first time, first from least two photos choose two photos therein, then from
The first position coordinate of user eyeball is identified in the photo first shot in two photos being selected, and from two be selected
The second position coordinate that user eyeball is identified in the photo shot after in photo, finally subtracts the second position coordinate of user eyeball
First position coordinate is gone to obtain a vector, the eye trajectory using the vector as user within period first time.
4. the 3-D image display device according to any one of claims 1 to 3 based on eyeball tracking, it is characterised in that:
The shooting module is also used to shoot the multiple pictures of user in a second time period；
The processor is also used to obtain user according to the multiple pictures that shooting module is shot in the second time period to exist
Number of winks in the second time period, and according to the state of number of winks change 3-D image.
5. the 3-D image display device according to any one of claims 1 to 3 based on eyeball tracking, it is characterised in that:
Including a memory, the memory can be local deposit for storing one or more of 3-D images, the memory
Reservoir either disposes memory on the remote server.
6. the implementation method of the 3-D image display device based on eyeball tracking, it is characterised in that: the following steps are included:
One or more 3-D images are shown by display module, include the three-dimensional mould at least one place in the 3-D image
The threedimensional model of type and/or at least one article；
At least two photos of user are shot within period first time by shooting module；
User is obtained according to shooting module at least two photos captured within period first time by processor to exist
Eye trajectory in period first time；
Change the state of 3-D image according to the eye trajectory by processor；
The state for changing 3-D image includes: to change whole display view angle, shape, size and/or the face of 3-D image
Color, and change display view angle, shape, size and/or the color of the part of 3-D image.
7. the implementation method of the 3-D image display device according to claim 6 based on eyeball tracking, it is characterised in that:
It is described user is obtained according to shooting module at least two photos captured within period first time by processor to exist
The step of eye trajectory in period first time specifically:
Two photos at least two photos shot within period first time by processor according to shooting module
Obtain eye trajectory of the user within period first time.
8. the implementation method of the 3-D image display device according to claim 7 based on eyeball tracking, it is characterised in that:
Two photos at least two photos shot within period first time by processor according to shooting module
The step of obtaining eye trajectory of the user within period first time include:
Two photos therein are chosen from least two photos,
The first position coordinate of user eyeball is identified from the photo first shot in two photos being selected, and from being selected
Two photos in after shoot photo in identify user eyeball second position coordinate,
The second position coordinate of user eyeball is subtracted into first position coordinate and obtains a vector, using the vector as user described
Eye trajectory in period first time.
9. according to the implementation method of the described in any item 3-D image display devices based on eyeball tracking of claim 6-8,
It is characterized in that: further comprising the steps of:
The multiple pictures of user are shot also in a second time period by the shooting module；
User is obtained in institute according to the multiple pictures that shooting module is shot in the second time period by the processor
The number of winks in second time period is stated, and changes the state of 3-D image according to the number of winks.
10. according to the implementation method of the described in any item 3-D image display devices based on eyeball tracking of claim 6-8,
It is characterized in that: further comprising the steps of:
One or more of 3-D images are stored by memory, the memory can be local storage and either dispose
Memory on the remote server.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810623038.2A CN108962182A (en) | 2018-06-15 | 2018-06-15 | 3-D image display device and its implementation based on eyeball tracking |
| PCT/CN2018/101061 WO2019237499A1 (en) | 2018-06-15 | 2018-08-17 | Eyeball tracking-based three-dimensional image display device and implementation method therefor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810623038.2A CN108962182A (en) | 2018-06-15 | 2018-06-15 | 3-D image display device and its implementation based on eyeball tracking |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108962182A true CN108962182A (en) | 2018-12-07 |
Family
ID=64489186
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810623038.2A Pending CN108962182A (en) | 2018-06-15 | 2018-06-15 | 3-D image display device and its implementation based on eyeball tracking |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN108962182A (en) |
| WO (1) | WO2019237499A1 (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103336581A (en) * | 2013-07-30 | 2013-10-02 | 黄通兵 | Human eye movement characteristic design-based human-computer interaction method and system |
| KR20140055987A (en) * | 2012-10-31 | 2014-05-09 | 김대영 | Method of display control for image |
| CN104391567A (en) * | 2014-09-30 | 2015-03-04 | 深圳市亿思达科技集团有限公司 | Display control method for three-dimensional holographic virtual object based on human eye tracking |
| CN107562208A (en) * | 2017-09-27 | 2018-01-09 | 上海展扬通信技术有限公司 | The intelligent terminal control method and intelligent terminal control system of a kind of view-based access control model |
| WO2018055332A1 (en) * | 2016-09-23 | 2018-03-29 | Displaylink (Uk) Limited | Compositing an image for display |
| CN107885325A (en) * | 2017-10-23 | 2018-04-06 | 上海玮舟微电子科技有限公司 | A kind of bore hole 3D display method and control system based on tracing of human eye |
| CN108090463A (en) * | 2017-12-29 | 2018-05-29 | 腾讯科技（深圳）有限公司 | Object control method, apparatus, storage medium and computer equipment |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10007336B2 (en) * | 2013-09-10 | 2018-06-26 | The Board Of Regents Of The University Of Texas System | Apparatus, system, and method for mobile, low-cost headset for 3D point of gaze estimation |
| US20150324568A1 (en) * | 2014-05-09 | 2015-11-12 | Eyefluence, Inc. | Systems and methods for using eye signals with secure mobile communications |
| CN105955471A (en) * | 2016-04-26 | 2016-09-21 | 乐视控股（北京）有限公司 | Virtual reality interaction method and device |
| CN106407772A (en) * | 2016-08-25 | 2017-02-15 | 北京中科虹霸科技有限公司 | Human-computer interaction and identity authentication device and method suitable for virtual reality equipment |
| CN106445173A (en) * | 2016-11-25 | 2017-02-22 | 四川赞星科技有限公司 | Method and device for converting objective state |
-
2018
- 2018-06-15 CN CN201810623038.2A patent/CN108962182A/en active Pending
- 2018-08-17 WO PCT/CN2018/101061 patent/WO2019237499A1/en active Application Filing
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR20140055987A (en) * | 2012-10-31 | 2014-05-09 | 김대영 | Method of display control for image |
| CN103336581A (en) * | 2013-07-30 | 2013-10-02 | 黄通兵 | Human eye movement characteristic design-based human-computer interaction method and system |
| CN104391567A (en) * | 2014-09-30 | 2015-03-04 | 深圳市亿思达科技集团有限公司 | Display control method for three-dimensional holographic virtual object based on human eye tracking |
| WO2018055332A1 (en) * | 2016-09-23 | 2018-03-29 | Displaylink (Uk) Limited | Compositing an image for display |
| CN107562208A (en) * | 2017-09-27 | 2018-01-09 | 上海展扬通信技术有限公司 | The intelligent terminal control method and intelligent terminal control system of a kind of view-based access control model |
| CN107885325A (en) * | 2017-10-23 | 2018-04-06 | 上海玮舟微电子科技有限公司 | A kind of bore hole 3D display method and control system based on tracing of human eye |
| CN108090463A (en) * | 2017-12-29 | 2018-05-29 | 腾讯科技（深圳）有限公司 | Object control method, apparatus, storage medium and computer equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019237499A1 (en) | 2019-12-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7078275B2 (en) | Product detection system and product detection method based on video monitoring | |
| TWI708152B (en) | Image processing method, device, and storage medium | |
| JP6644833B2 (en) | System and method for rendering augmented reality content with albedo model | |
| WO2022021980A1 (en) | Virtual object control method and apparatus, and electronic device and storage medium | |
| CN109085966A (en) | A kind of three-dimensional display system and method based on cloud computing | |
| CN103731583B (en) | Intelligent synthetic, print processing method is used for taking pictures | |
| JP2017531950A (en) | Method and apparatus for constructing a shooting template database and providing shooting recommendation information | |
| CN109242961A (en) | A kind of face modeling method, apparatus, electronic equipment and computer-readable medium | |
| CN105869216A (en) | Method and apparatus for presenting object target | |
| CN108961149A (en) | Image processing method, device and system and storage medium | |
| CN111178294A (en) | State recognition method, device, equipment and storage medium | |
| CN111860252A (en) | Image processing method, apparatus and storage medium | |
| Elhayek et al. | Fully automatic multi-person human motion capture for vr applications | |
| JP2013120556A (en) | Object attribute estimation device and video plotting device | |
| CN109918005A (en) | A kind of displaying control system and method based on mobile terminal | |
| CN111625100A (en) | Method and device for presenting picture content, computer equipment and storage medium | |
| JP2019174920A (en) | Article management system and article management program | |
| CN111627115A (en) | Interactive group photo method and device, interactive device and computer storage medium | |
| CN103164809A (en) | Method and system for displaying using effect of product | |
| CN105139248A (en) | Method and apparatus for displaying wearable article | |
| CN112333498A (en) | Display control method and device, computer equipment and storage medium | |
| CN111640190A (en) | AR effect presentation method and apparatus, electronic device and storage medium | |
| CN108962182A (en) | 3-D image display device and its implementation based on eyeball tracking | |
| WO2019137186A1 (en) | Food identification method and apparatus, storage medium and computer device | |
| CN202810235U (en) | Interactive multifunctional fitting room |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181207 |
|
| RJ01 | Rejection of invention patent application after publication |