CN103677704B - Display device and display methods - Google Patents
Display device and display methods Download PDFInfo
- Publication number
- CN103677704B CN103677704B CN201210353335.2A CN201210353335A CN103677704B CN 103677704 B CN103677704 B CN 103677704B CN 201210353335 A CN201210353335 A CN 201210353335A CN 103677704 B CN103677704 B CN 103677704B
- Authority
- CN
- China
- Prior art keywords
- image
- user
- area
- display device
- scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Controls And Circuits For Display Device (AREA)
Abstract
A kind of display methods an embodiment of the present invention provides display device and applied to the display device.Display device according to the ... of the embodiment of the present invention, including：Processing unit configures to determine in scene that user is watched with the presence or absence of the first area that can not be seen clearly when user's direct viewing；Image acquisition unit, configuration determine in the scene that user is watched there are when first area when processing unit, the first image corresponding to first area are obtained, wherein the size of first area is more than the size for the first area that user's direct viewing is arrived in the first image；Display unit is arranged on the first surface of display device, and configuration shows the first image of first area, wherein when user watches the first image, first surface is towards user, wherein image acquisition unit includes：Image capture module on the second surface of display device is set.
Description
Technical field
The embodiment of the present invention is related to a kind of display device and the display methods applied to the display device.
Background technology
With the development of technology, various portable electronic devices are widely used, for example, portable computer, flat
Computer, smart mobile phone and portable media player etc..Currently, in order to provide a user multifarious function, Hen Duobian
The formula electronic equipment of taking is equipped with the image acquisition units of such as camera etc, in order to which user carries out image, video capture
Deng operation.
On the other hand, when scene of the user around viewing, it is often found that there is people etc of such as distant place in scene
Do not see the literal order on the scenery such as billboard of Chu can not accurately identify content.Although the portable electric of user
Sub- equipment may include image acquisition units, but image acquisition units cannot obtain user do not see Chu scenery or can not
Accurately identify content, and the scenery of Chu do not seen according to user or can not accurately identify content carry out targetedly image,
The operations such as video capture, to assist user to watch.
Invention content
The embodiment of the present invention is designed to provide a kind of display device and the display methods applied to display device, with solution
The certainly above problem.
An embodiment provides a kind of display devices, including：Processing unit configures to determine that user is seen
With the presence or absence of the first area that can not be seen clearly when user's direct viewing in the scene seen；Image acquisition unit, configuration are located to work as
Reason unit determines in the scene that user is watched there are when first area, obtains the first image corresponding to first area, wherein
The size of first area is more than the size for the first area that user's direct viewing is arrived in the first image；Display unit, setting exist
On the first surface of display device, configure to show the first image of first area, wherein when user watches the first image, the
One surface is towards user, wherein image acquisition unit includes：The Image Acquisition mould being arranged on the second surface of display device
Block.
Another embodiment of the present invention provides a kind of display methods, is applied to display device.The method includes：It determines
With the presence or absence of the first area that can not be seen clearly when user's direct viewing in the scene that user is watched；It is used when processing unit determines
There are when first area in the scene that family is watched, the first image corresponding to first area is obtained, wherein in the first image
The size of first area is more than the size for the first area that user's direct viewing is arrived；And the first image of display first area.
By display device according to the ... of the embodiment of the present invention and display methods, whether there is in the scene that user is watched
In the case of the first area that can not be seen clearly when user's direct viewing, the first figure corresponding to first area can be obtained automatically
Picture, to assist user to watch the scenery or content can not be accurately identified that it can not directly see.
Description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, making below by required in the description to embodiment
Attached drawing is briefly described.The accompanying drawings in the following description is only exemplary embodiment of the present invention.
Fig. 1 shows the exemplary block diagram of display device according to an embodiment of the invention.
Fig. 2 is the definition graph for an illustrative case for showing display device shown in Fig. 1.
Fig. 3 is that one of the first image for showing that the image acquisition unit of display device shown in Fig. 2 is obtained shows
The definition graph of example situation.
Fig. 4 is the definition graph for another illustrative case for showing display device shown in Fig. 1.
Fig. 5 is that one of the first image for showing that the image acquisition unit of display device shown in Fig. 4 is obtained shows
The definition graph of example situation.
Fig. 6 is the exemplary process diagram for showing display methods according to an embodiment of the invention.
Specific implementation mode
Hereinafter, by preferred embodiments of the present invention will be described in detail with reference to the annexed drawings.Note that in the specification and drawings
In, there is substantially the same step and element to be denoted by the same reference numerals, and to the repetition solution of these steps and element
Releasing will be omitted.
In the following embodiment of the present invention, the concrete form of display device includes but not limited to for example flat calculating
Hand-held electric equipment, the portable computing of machine, personal digital assistant, smart mobile phone, game machine, portable media player etc
Machine and wear-type electronic equipment etc..
Fig. 1 is the exemplary block diagram for showing display device 100 according to an embodiment of the invention.As shown in Figure 1,
Display device 100 includes processing unit 110, image acquisition unit 120 and display unit 130.
Specifically, processing unit 110 can determine in the scene that user is watched with the presence or absence of when user's direct viewing without
The first area that method is seen clearly.When processing unit 110 determines that image obtains single there are when first area in the scene that user is watched
Member 120 obtains the first image corresponding to first area.Specifically, the size of first area is straight more than user in the first image
Connect the size for the first area watched.Image acquisition unit 120 may include being arranged on the second surface of display device 100
Image capture module 121.The size that image capture module 121 can acquire wherein first area with the first image acquisition parameter is more than
First image of the size for the first area that user's direct viewing is arrived.That is, when image capture module 121 is with the first image
When acquisition parameter carries out Image Acquisition to the first area, the size that can directly obtain wherein first area is direct more than user
First image of the size for the first area watched.Alternatively, it is contemplated that production cost, the light of image capture module 121
Circle may be smaller, and the focal length of camera lens may be shorter.Image capture module 121 may not be able to directly take corresponding to first
The image with large-size in region.In the case, image capture module 121 can be acquired with the second image acquisition parameter and be closed
The second image in first area.And image acquisition unit 120 may also include image processing module.Image processing module can be put
The part comprising first area is to obtain the first image in big second image.More specifically, image processing module can pass through amplification
The size of the part comprising first area obtains the first image in second image, in addition, image processing module can also be by right
The part comprising first area is sharpened processing to obtain the first image in second image, so that interior in image after processing
Appearance is more clear.
According to an example of the present invention, display device 100 may also include line-of-sight detection unit.Line-of-sight detection unit can be examined
The view direction of eyes of user is surveyed, wherein when user uses display device, line-of-sight detection unit is towards user, with to user's
Eyeball is detected.It is more than the predetermined time in a first direction when line-of-sight detection unit detects that the view direction of eyes of user is kept
When, processing unit 110 determines in a first direction to exist in the scene that user is watched can not see clearly when user's direct viewing
First area.
When processing unit 110 is according to the testing result of the line-of-sight detection unit determination field that user is watched in a first direction
There are when first area in scape, as described above, image capture module 121 can be straight in a first direction with the first image acquisition parameter
Connect the first image of acquisition.
For example, the scenery that can not directly see due to user or content can not be accurately identified usually between user
First image acquisition parameter farther out, therefore can be set in advance as used Image Acquisition when the scenery of shooting distant place by distance
Parameter.For example, when acquiring the first image using the first image acquisition parameter, the focal length of image capture module 121 can be set
It is longer.It is adopted in addition, can also set the first image acquisition parameter to image of the image capture module 121 under big depth of field pattern
Collect parameter.Such as when acquiring the first image using the first image acquisition parameter, the aperture of image capture module 121 can be set
It is larger.To which the distance between user is farther out or closer object can clearly be shot by image capture module 121.
Alternatively, as described above, when processing unit 110 is determined according to the testing result of line-of-sight detection unit in first party
There are when first area in the scene that upward user is watched, image capture module 121 can be with the second image acquisition parameter the
Second image of the acquisition about first area on one direction.And image acquisition unit 120 may also include image processing module.Figure
As processing module can amplify in the second image comprising first area part to obtain the first image.In addition, image processing module
Can also processing be sharpened to the second image, so that the content after processing in image is more clear.
In the above examples, the view direction of eyes of user is detected by using line-of-sight detection unit, display device can be true
Determine with the presence or absence of the first area that can not be seen clearly when user's direct viewing in the scene that user is watched, and determines to work as and exist
When first area, display device can obtain the first image corresponding to the first area automatically, be executed without user defeated
Enter to obtain the first image of its viewing of auxiliary, to simplify the operation of user.
However, the invention is not limited thereto.Another example according to the present invention determines that user is watched in processing unit 110
Scene in the presence or absence of before the first area that can not see clearly when user's direct viewing, image capture module 121 can be with
Third image acquisition parameter acquires third image, wherein pre-setting third image acquisition parameter.For example, can be according to ordinary people's
Third image acquisition parameter is arranged in example, the third figure acquired with third image acquisition parameter to image capture module 121
As similar with the scene that ordinary people's direct viewing is arrived.Alternatively, also third Image Acquisition can be arranged according to the eyesight of user to join
Number so that the field that the third image that image capture module 121 is acquired with third image acquisition parameter is arrived with user's direct viewing
Scape is close.Processing unit 110 can whether there is first area according to pre-set criterion of identification in identification third image, and
And when there are first area, identified first area is obtained.For example, can pre-set processing unit 110 only to face into
Row identification can be by face when there are faces in third image, and the size of the facial image is less than predetermined face picture size
Region where image is determined as first area.Only character is identified in another example processing unit 110 can be pre-set, when
There are characters in third image, and corresponding to the character image size be less than predetermined character size when, can will correspond to should
Region where the image of character is determined as first area.
When processing unit 110 determines that there are when first area in third image.As described above, image capture module 121 can
It is more than the size for the first area that user's direct viewing is arrived with the size of the first image acquisition parameter acquisition wherein first area
First image.For example, according to third image acquisition parameter, the focal length of the camera lens of image capture module 121 be possibly set to compared with
It is short, so that captured third image and the scene that user's direct viewing is arrived are close.And since user can not directly see clearly
The scenery of Chu or can not accurately identify content usually with the distance between user farther out, therefore joined according to the first Image Acquisition
Number, the focal length of the camera lens of image capture module 121 be possibly set to it is longer so that in the first captured image, energy
The enough scenery that clearly presentation user can not directly see can not accurately identify content.Alternatively, Image Acquisition mould
Block 121 can acquire the second image about first area with the second image acquisition parameter.And image acquisition unit 120 can also wrap
Include image processing module.Image processing module can amplify in the second image comprising first area part to obtain the first image.
Second image acquisition parameter can be identical or different with third image acquisition parameter.
In this example, it is arrived with user's direct viewing with the shooting of third image acquisition parameter by using image capture module
The similar third image of scene, and image recognition is carried out to third image, display device can determine the scene that user is watched
In with the presence or absence of the first area that can not see clearly when user's direct viewing, and determine when there are first area, display dress
The first image that can be obtained automatically corresponding to the first area is set, executing input without user, it is watched to obtain auxiliary
The first image, to simplify the operation of user.
However, the invention is not limited thereto.Another example according to the present invention determines that user is watched in processing unit 110
Scene in the presence or absence of before the first area that can not see clearly when user's direct viewing, image capture module 121 can be with
4th image acquisition parameter acquires the 4th image, wherein pre-setting the 4th image acquisition parameter.For example, can be according to ordinary people's
The 4th image acquisition parameter is arranged in example, the 4th figure acquired with the 4th image acquisition parameter to image capture module 121
As similar with the scene that ordinary people's direct viewing is arrived.Alternatively, also the 4th Image Acquisition can be arranged according to the eyesight of user to join
Number so that the field that the 4th image that image capture module 121 is acquired with the 4th image acquisition parameter is arrived with user's direct viewing
Scape is close.The 4th image that 130 displayable image acquisition module 121 of display unit is acquired.Display device may also include input
Unit is inputted with receiving regional choice from the user.The regional choice that processing unit 110 can be received according to input unit is defeated
Enter and obtains first area in the 4th image.
When processing unit 110 determines that there are when first area in the 4th image.As described above, image capture module 121 can
It is more than the size for the first area that user's direct viewing is arrived with the size of the first image acquisition parameter acquisition wherein first area
First image.For example, according to the 4th image acquisition parameter, the focal length of the camera lens of image capture module 121 be possibly set to compared with
It is short, so that the 4th captured image and the scene that user's direct viewing is arrived are close.And since user can not directly see clearly
The scenery of Chu or can not accurately identify content usually with the distance between user farther out, therefore joined according to the first Image Acquisition
Number, the focal length of the camera lens of image capture module 121 be possibly set to it is longer so that in the first captured image, energy
The enough scenery that clearly presentation user can not directly see can not accurately identify content.Alternatively, Image Acquisition mould
Block 121 can acquire the second image about first area with the second image acquisition parameter.And image acquisition unit 120 can also wrap
Include image processing module.Image processing module can amplify in the second image comprising first area part to obtain the first image.
Second image acquisition parameter can be identical or different with the 4th image acquisition parameter.
In this example, it is arrived with user's direct viewing with the acquisition of the 4th image acquisition parameter by using image capture module
Similar the 4th image of scene, and inputted by regional choice from the user and determine first area, so as to reduce display
Device is to determine operation to be performed needed for first area, and can more accurately determine in the scene that user is watched
It is no to there is the first area that seen clearly when user's direct viewing.
In addition, another example according to the present invention, whether there is in processing unit 110 determines the scene that user is watched
Before the first area that can not be seen clearly when user's direct viewing, image capture module 121 can acquire in predetermined operation region
Corresponding to the 5th image of the operating body of such as finger etc.Processing unit 120 can recognize that the operating body in the 5th image is signified
The direction shown, and determine in the scene watched there are user on the direction indicated by identified operating body when user is direct
The first area that can not be seen clearly when viewing.
Although having shown that and describing the processing unit and image acquisition unit of some embodiments of the present invention, ability
Field technique personnel it should be understood that can be dependent on design requirement and other factors above-described embodiment is carry out various modifications, is combined, portion
Subassembly and replacement.For example, in the case where display device may include line-of-sight detection unit, when line-of-sight detection unit detects use
When the view direction of family eyes was kept in a first direction more than the predetermined time, image capture module 121 can be adopted with the 6th image
Collect parameter and acquires the 6th image along first direction.The 6th image acquisition parameter can be set to image capture module 121 in big scape
Image acquisition parameter under deep pattern.Such as when acquiring six images using the 6th image acquisition parameter, image capture module
121 aperture can be arranged to larger.To which the distance between user is farther out or closer object can be by Image Acquisition mould
Block 121 is clearly shot.The 6th image that 130 displayable image acquisition module 121 of display unit is acquired.Display device may be used also
Including input unit, inputted with receiving regional choice from the user.The area that processing unit 110 can be received according to input unit
Domain selection input obtains first area in the 6th image.In this example, the eyes in the acquisition direction and user of the 6th image
View direction it is consistent, improve the specific aim of Image Acquisition, and reduce user find first area range so that use
Family can quickly determine first area.
Fig. 1 is returned to, display unit 130 may be provided on the first surface of display device 100.It is obtained in image acquisition unit
After the first image of the first area, display unit 130 can show the first image of first area.Display device
100 first surface is when user watches the first image, towards the surface of user.Above-mentioned image capture module 121 can be arranged
On the second surface different from the first surface where display unit 130.According to an example of the present invention, display unit
130 can show the first image of first area in predetermined display area.
In addition, another example according to the present invention, display unit has predetermined light transmittance so that user can penetrate display
Unit watches external scene.Second surface can be the surface opposite with first surface.In this case it is preferably to place
Manage unit 110 can also obtain position of the object in first area relative to user, and root according to identified first area
Display location according to the object in first area relative to the first image of location determination of user.Display unit 130 can handled
The first image is shown on display location determined by unit 110.In this example, the first area shown by display unit 130
The first image position it is corresponding with the position of the first area in the scene for the outside that user is watched, user need not be
The first image of first area is found in predetermined display area to assist its viewing, so as to improve the usage experience of user.
By the display device according to the present embodiment, with the presence or absence of when user's direct viewing in the scene that user is watched
In the case of the first area that Shi Wufa sees clearly, the first image corresponding to first area can be obtained automatically, to assist user to see
See the scenery or content can not be accurately identified that it can not directly see.
Fig. 2 is the definition graph for an illustrative case for showing display device shown in Fig. 1.Display device 200 is just
Take formula electronic equipment.As shown in Fig. 2, in display device 200, the first surface in display device 200 is arranged in display unit 230
On 201.Display unit has predetermined light transmittance.It is corresponding to the shell of 200 installation position of display device in display device 200
Transparent shell so that user can penetrate display unit 230 and watch external scene.
Display device 200 may also include the line-of-sight detection unit 240 being arranged on the first surface 201 of display device 200.
Line-of-sight detection unit 240 can detect the view direction of eyes of user.When user uses display device 200, line-of-sight detection unit
240, towards user, are detected with the eyeball to user.Assuming that user's direction instruction billboard 251 shown in the arrow A is to try
Figure sees the content shown on billboard 251 clearly.When line-of-sight detection unit 240 detect the view direction of eyes of user be maintained at as
When first direction shown in arrow A is more than the predetermined time, the processing unit of display device 200（It is not shown）It determines in a first direction
On the first area that can not see clearly when user's direct viewing in the scene watched there are user.In this example, the firstth area
Domain is the region where billboard 251.
The image acquisition unit of display device 200 includes that the image being arranged on the second surface 202 of display device 200 is adopted
Collect module 221, wherein second surface 202 is opposite with first surface 201.When processing unit is according to the inspection of line-of-sight detection unit 240
It surveys result to determine in user is watched in a first direction scene there are when first area, image capture module 221 can be with the
One image acquisition parameter acquires the first image in a first direction.
Fig. 3 is that one of the first image for showing that the image acquisition unit of display device shown in Fig. 2 is obtained shows
The definition graph of example situation.As shown in figure 3, the size of the billboard 251 ' in the first image 300 in first area is more than user
Direct viewing to first area in billboard 251 size.Display unit 230 is obtained in image capture module 221 and is corresponded to
After the first image of the first area, the first image 300 of first area is shown to user.User can pass through viewing first
The content in billboard 251 can be clearly seen in image 300.
In addition, another example according to the present invention, display device shown in Fig. 1 may also include fixed cell and connection
Unit.Display device can be worn on the head of user by fixed cell.For example, fixed cell may include such as head
The wearable components such as helmet, headband.And connection unit can be connected and fixed at least first part of unit and display unit, wherein connecting
Unit at least has first state, and in the first state, at least first part is located in the visible area of user and towards user.
To which display device according to an embodiment of the invention can be worn over head by user, display dress is held when without using
It sets.
In this example, image capture module may be provided at when display device is worn on the head of user, not towards
On the second surface on the head of user.Selectively, image capture module can be arranged by rotary part the of display device
On two surfaces.Rotary part can be rotated around the axle center of the rotary part so that image capture module can be relative to rotating part
The axle center of part rotates, and carries out panning in order to control image capture module according to the position of first area, or adjustment image is adopted
Collect the acquisition pitch angle etc. of module.
In addition, display unit may include in the visible area positioned at user and towards the complete viewing area of user
Domain.Alternatively, display unit may also comprise in the visible area of user and respectively for two points of two eyes of user
From display area.
Fig. 4 is the definition graph for another illustrative case for showing display device shown in Fig. 1.Display device 400 is head
Wear formula electronic equipment.Similar with display device 100, display device 400 may include processing unit（It is not shown）, image acquisition unit
And display unit, in addition, display device 400 further includes fixed cell 440 and connection unit.
Specifically, display device 400 can be worn on head by fixed cell 440.And processing unit can be arranged
In fixed cell 440.
Image acquisition unit includes the image capture module 421 being arranged on the second surface 402 of display device.Image is adopted
Collection module 421 passes through rotary part（It is not shown）It is connected to fixed cell 440.As shown in figure 4, second surface 402 is when described
When display device is worn on the head of user by fixed cell 440, fixed cell 440 corresponds to the surface of user's face.
Display unit includes corresponding respectively to user's left eye and the first sub- display unit of right eye and the second sub- display unit.Even
Order member includes the first sub- connection unit 441 and the second sub- connection unit 442.First sub- connection unit 441 is connected and fixed unit
First subdivision of 440 first end and the first sub- display unit, the second sub- connection unit 442 are connected and fixed the of unit 440
Second subdivision at two ends and the second sub- display unit.In the example depicted in fig. 4, the display list being located in user visible area
The first part of member includes the first subdivision 431 of the first sub- display unit and the second subdivision 432 of the second sub- display unit.
In the example depicted in fig. 4, direct with the presence or absence of user is worked as in processing unit determines the scene that user is watched
Before the first area that can not be seen clearly when viewing, the acquisition of image capture module 421 corresponds to user hand in predetermined operation region
The 5th image referred to.As shown in figure 4, user's finger direction instruction billboard 451 shown in the arrow B.Processing unit identification the
The direction indicated by finger in five images, and watched there are user on the direction indicated by determining identified finger
The first area that can not be seen clearly when user's direct viewing in scene.In this example, first area is 451 place of billboard
Region.
When processing unit determines in user is watched in a first direction scene there are when first area, Image Acquisition mould
Block 421 can acquire the first image in a first direction with the first image acquisition parameter.
Fig. 5 is one of the first image for showing that the image acquisition unit of display device 400 shown in Fig. 4 is obtained
The definition graph of illustrative case.It is used as shown in figure 5, the size of the billboard 451 ' in the first image 500 in first area is more than
Family direct viewing to first area in billboard 451 size.Display unit corresponds in the acquisition of image capture module 421
After first image of the first area, the first image 500 of first area is shown to user.
In the present embodiment, second in the first subdivision 431 and the second sub- display unit in the first sub- display unit
Subdivision 432 can be directed to the display screen of user's left eye and right eye respectively, in addition, the first sub- display unit and the second son are aobvious
The image transmitting device being connected with the processing unit being arranged in fixed cell 440 can be respectively included by showing unit also.
Alternatively, display unit may also include the sub- display unit of the third being arranged in fixed cell 440 and optical system
System.The first image acquired in the sub- display unit displayable image acquisition module of third 421.Optical system can receive from third
The light that display unit is sent out, and the light to being sent out from the sub- display unit of third carries out light path converting, to form the amplification virtual image.
In the case, the first sub- display unit may include：Including the first lens component of the first eyeglass, setting are first
The first light guide member in eyeglass and the third light guide portion for the light for passing through optical system to be transmitted to the first light guide member
Part.Similarly, the second sub- display unit may include：Including the second lens component of the second eyeglass, being arranged in the second eyeglass
Second light guide member and the 4th light guide member that the light Jing Guo optical system is transmitted to the 4th light guide member.First light
The receivable light transmitted by third light guide member of component is led to reflect to user.And the second light guide member, which can receive, to be passed through
The light of 4th light guide member transmission is reflected to user.The first subdivision 431 in first sub- display unit may include
First lens component of the first eyeglass, the first light guide member being arranged in the first eyeglass, and in the second sub- display unit
Second subdivision 432 can be the second lens component comprising the second eyeglass, the second light guide member being arranged in the second eyeglass.
First eyeglass and the second eyeglass have predetermined light transmittance so that user can penetrate the first eyeglass and the second eyeglass watches outside
Scene.To when watching the first image shown by display unit, it can be seen that the case where actual environment, to prevent viewer
The fortuitous event fallen, knock barrier down etc occurs.In this example, the firstth area that can not be seen clearly when user's direct viewing
Domain refer to when user through the first lens component and the second lens component viewing outside scene when can not see clearly in the scene
Region.
In the following, illustrating the display methods of the embodiment of the present invention with reference to Fig. 6.Fig. 6 is depicted according to embodiments of the present invention
Display methods 600 flow chart.Each step in display methods 600 can be respectively by the display device in above-mentioned Fig. 1
Corresponding module executes, therefore, succinct in order to describe, and no longer specifically describes.
As shown in fig. 6, in step s 601, determining in the scene that user is watched with the presence or absence of when user's direct viewing
The first area that can not be seen clearly.When in step s 601, determining in the scene that user is watched there are when first area, in step
In S602, the first image corresponding to first area is obtained.Specifically, the size of first area is more than user in the first image
The size for the first area that direct viewing is arrived.It according to an example of the present invention, can be with the first Image Acquisition in step S602
The size of parameter acquisition wherein first area is more than the first image of the size for the first area that user's direct viewing is arrived.Namely
It says, when carrying out Image Acquisition to first area with the first image acquisition parameter, the size of wherein first area can be directly obtained
First image of the size for the first area arrived more than user's direct viewing.Alternatively, it is contemplated that production cost, display device
The aperture of image capture module may be smaller, and the focal length of camera lens may be shorter, it is thus possible to cannot directly take pair
It should be in the image with large-size of first area.It in the case, can be with the second image acquisition parameter in step S602
The second image about first area is acquired, then amplifies in the second image the part comprising first area to obtain the first figure
Picture.More specifically, the first image can be obtained by amplifying the size of the part comprising first area in the second image, in addition,
Also the first image can be obtained by being sharpened processing to the part comprising first area in the second image, so that after processing
Content in image is more clear.
According to an example of the present invention, in step s 601, the view direction that can detect eyes of user, wherein working as user
When using display device, line-of-sight detection unit is detected towards user with the eyeball to user.In step s 601, it detects
To eyes of user view direction keep be more than the predetermined time in a first direction when, determine and there is user in a first direction and seen
The first area that can not be seen clearly when user's direct viewing in the scene seen.
It is determined in user is watched in a first direction scene there are when first area, such as when according to line-of-sight detection result
It is upper described, in step S602, the first image can be directly acquired in a first direction with the first image acquisition parameter.
Alternatively, as described above, ought user in a first direction be determined according to line-of-sight detection result in step s 601
There are when first area in the scene watched, in step S602, can in a first direction be adopted with the second image acquisition parameter
Collect the second image about first area, then amplifies in the second image the part comprising first area to obtain the first image.
In addition, in step S602, can also processing be sharpened to the second image, so that the content after processing in image is more clear
It is clear.
In the above examples, pass through detect eyes of user view direction, it may be determined that in the scene that user is watched whether
It in the presence of the first area that can not be seen clearly when user's direct viewing, and determines when there are first area, can obtain automatically pair
First image of first area described in Ying Yu, without user's execution input to obtain the first image of its viewing of auxiliary, from
And simplify the operation of user.
However, the invention is not limited thereto.Another example according to the present invention can be adopted in step s 601 with third image
Collect parameter acquisition third image, wherein pre-setting third image acquisition parameter.For example, can be arranged according to the example of ordinary people
Third image acquisition parameter, to the scene arrived with ordinary people's direct viewing with the third image of third image acquisition parameter acquisition
It is similar.Alternatively, also can third image acquisition parameter be set according to the eyesight of user so that adopt with third image acquisition parameter
The third image of collection and the scene that user's direct viewing is arrived are close.In step s 601, it can be marked according to pre-set identification
Standard identifies and whether there is first area in third image, and when there are first area, obtains identified first area.
Only face is identified in step s 601 for example, can pre-set, when there are faces in third image, and the facial image
Size be less than predetermined face picture size when, the region where facial image can be determined as first area.In another example can be pre-
First it is arranged and only character is identified in step s 601, when there are character in third image, and corresponding to the image of the character
Size be less than predetermined character size when, the region where the image corresponding to the character can be determined as first area.
When there are when first area in determining third image in step s 601.As described above, can be in step S602
The size of first image acquisition parameter acquisition wherein first area is more than the of the size of first area that user's direct viewing is arrived
One image.For example, according to third image acquisition parameter, the focal length of the camera lens of image capture module be possibly set to it is shorter, with
So that captured third image and the scene that user's direct viewing is arrived are close.And the scape that can not be directly seen due to user
Object or can not accurately identify content usually with the distance between user farther out, therefore according to the first image acquisition parameter, image
The focal length of the camera lens of acquisition module is possibly set to longer, so that in the first captured image, can be in clearly
The scenery or content can not be accurately identified that current family can not directly be seen.It alternatively, can be with second in step S602
Image acquisition parameter acquires the second image about first area, then amplify in the second image the part comprising first area with
Obtain the first image.Second image acquisition parameter can be identical or different with third image acquisition parameter.
In this example, by shooting the third similar with the scene that user's direct viewing is arrived with third image acquisition parameter
Image, and image recognition is carried out to third image, it may be determined that with the presence or absence of when user's direct viewing in the scene that user is watched
The first area that Shi Wufa sees clearly, and determine when there are first area, display device can be obtained automatically corresponding to described the
First image in one region executes input to obtain the first image of its viewing of auxiliary, to simplify use without user
The operation at family.
However, the invention is not limited thereto.Another example according to the present invention in step s 601 can be with the 4th image
Acquisition parameter acquires the 4th image, wherein pre-setting the 4th image acquisition parameter.For example, can be set according to the example of ordinary people
The 4th image acquisition parameter is set, to straight with the 4th image of the 4th image acquisition parameter acquisition and ordinary people in step s 601
It is similar to connect the scene watched.Alternatively, also can the 4th image acquisition parameter be set according to the eyesight of user so that in step
It is approached with the 4th image of the 4th image acquisition parameter acquisition and the scene that user's direct viewing is arrived in S601, then can be shown
The 4th image acquired receives regional choice input from the user, and defeated according to the regional choice that input unit is received
Enter and obtains first area in the 4th image.
When there are when first area in determining 4th image in step s 601.As described above, can be in step S602
The size of first image acquisition parameter acquisition wherein first area is more than the of the size of first area that user's direct viewing is arrived
One image.For example, according to the 4th image acquisition parameter, the focal length of the camera lens of image capture module be possibly set to it is shorter, with
So that the 4th captured image and the scene that user's direct viewing is arrived are close.And the scape that can not be directly seen due to user
Object or can not accurately identify content usually with the distance between user farther out, therefore according to the first image acquisition parameter, image
The focal length of the camera lens of acquisition module is possibly set to longer, so that in the first captured image, can be in clearly
The scenery or content can not be accurately identified that current family can not directly be seen.It alternatively, can be with second in step S602
Image acquisition parameter acquires the second image about first area, then amplify in the second image the part comprising first area with
Obtain the first image.Second image acquisition parameter can be identical or different with the 4th image acquisition parameter.
In this example, by shooting fourth similar with the scene that user's direct viewing is arrived with the 4th image acquisition parameter
Image, and inputted by regional choice from the user and determine first area, so as to reduce display device in order to determine the
Operation to be performed needed for one region, and can more accurately determine in the scene that user is watched with the presence or absence of when user is direct
The first area that can not be seen clearly when viewing.
In addition, another example according to the present invention can acquire in step s 601 and correspond to example in predetermined operation region
Such as the 5th image of the operating body of finger etc, the direction indicated by the operating body in the 5th image is then identified, and determine
It can not see clearly when user's direct viewing in the scene watched there are user on the direction indicated by operating body identified
First area.
Although having shown that and describing the processing unit and image acquisition unit of some embodiments of the present invention, ability
Field technique personnel it should be understood that can be dependent on design requirement and other factors above-described embodiment is carry out various modifications, is combined, portion
Subassembly and replacement.For example, in step s 601 when line-of-sight detection unit detects that the view direction of eyes of user is maintained at
When one direction is more than the predetermined time, the 6th image can be acquired along first direction with the 6th image acquisition parameter, wherein can be by the
Six image acquisition parameters are set as image acquisition parameter of the image capture module under big depth of field pattern, between user
Distance farther out or closer object can clearly be shot by image capture module 121.Then acquired the 6th can be shown
Image, and receive regional choice input from the user.It can be inputted in the 6th image and be obtained according to the regional choice received
Obtain first area.In this example, the acquisition direction of the 6th image is consistent with the view direction of the eyes of user, improves image
The specific aim of acquisition, and reduce the range that user finds first area so that user can quickly determine first area.
Fig. 6 is returned, in step S603, shows acquired the first image corresponding to first area.According to the present invention
An example in step S603 can according to identified first area, obtain first area in object relative to user's
Position, and the display location according to the object in first area relative to the first image of location determination of user, and in institute
The first image is shown on determining display location.
By the display methods according to the present embodiment, with the presence or absence of when user's direct viewing in the scene that user is watched
In the case of the first area that Shi Wufa sees clearly, the first image corresponding to first area can be obtained automatically, to assist user to see
See the scenery or content can not be accurately identified that it can not directly see.
Those of ordinary skill in the art may realize that lists described in conjunction with the examples disclosed in the embodiments of the present disclosure
Member, module, can be realized with electronic hardware, computer software, or a combination of the two, in order to clearly demonstrate hardware and soft
The interchangeability of part generally describes each exemplary composition and step according to function in the above description.These work(
It can be implemented in hardware or software actually, depend on the specific application and design constraint of technical solution.Professional skill
Art personnel can use different methods to achieve the described function each specific application, but this realization should not be recognized
It is beyond the scope of this invention.
Although having shown that and describing some embodiments of the present invention, it is understood by one skilled in the art that not departing from
In the case of the principle and spirit of the invention, these embodiments can be carry out various modifications, such modification should fall into the present invention
In the range of.
Claims (17)
1. a kind of display device, including：
Processing unit configures to determine in scene that user is watched with the presence or absence of can not see clearly when user's direct viewing the
One region；
Image acquisition unit, to work as, there are the first areas in the scene that the processing unit determines that user is watched for configuration
When, the first image corresponding to the first area is obtained, wherein the size of the first area described in described first image is big
Size in the first area that user's direct viewing is arrived；
Display unit is arranged on the first surface of the display device, configures to show the first image of the first area,
Wherein when user watches described first image, the first surface towards user,
Wherein, described image acquiring unit includes：Image capture module on the second surface of the display device is set；
Wherein, the display device further includes：Line-of-sight detection unit configures to detect the view direction of eyes of user, wherein when
User use the display device when, the line-of-sight detection unit towards user, and, wherein when the line-of-sight detection unit examine
The view direction for measuring eyes of user is kept when being more than the predetermined time in a first direction, and the processing unit is determined described first
The first area that can not be seen clearly when user's direct viewing in the scene watched there are user on direction；Or,
The configuration of described image acquisition module corresponds to the 5th image of operating body to acquire in predetermined operation region；The processing
Unit identifies the direction indicated by the operating body in the 5th image, and determines the direction indicated by identified operating body
On the first area that can not see clearly when user's direct viewing in the scene watched there are user.
2. display device as described in claim 1, wherein
There are firstth areas in the scene that the processing unit determines that user is watched to work as the configuration of described image acquisition module
When domain, described first image is acquired with the first image acquisition parameter, wherein when described image acquisition module is with described first image
When acquisition parameter carries out Image Acquisition to the first area, described first image can be directly obtained.
3. display device as described in claim 1, wherein
There are firstth areas in the scene that the processing unit determines that user is watched to work as the configuration of described image acquisition module
When domain, the second image about the first area is acquired with the second image acquisition parameter；
Described image acquiring unit further includes：
Image processing module, configure amplify in second image comprising the first area part to obtain described first
Image.
4. display device as claimed in claim 3, wherein
Described image acquisition module is acquired with big depth of field pattern, so that with the distance between display device in preset range
Interior object can be acquired clearly.
5. display device as described in claim 1, wherein
The configuration of described image acquisition module to acquire third image with third image acquisition parameter, wherein the third Image Acquisition
Parameter is pre-set；
The processing unit according to pre-set criterion of identification, identify described in the third image exist whether described first
Region, and when there are the first area, obtain identified first area.
6. display device as described in claim 1, wherein
The configuration of described image acquisition module to acquire the 4th image with the 4th image acquisition parameter, wherein the 4th Image Acquisition
Parameter is to pre-set；
The display unit is further configured to show the 4th image；
The display device further includes：
Input unit, configuration input to receive regional choice from the user；
The processing unit obtains the first area according to regional choice input in the 4th image.
7. display device as described in claim 1, further includes：
Fixed cell, wherein the display device can be worn on the head of user by the fixed cell；
Connection unit configures to connect at least first part of the fixed cell and the display unit, wherein the connection
Unit at least have first state, in said first condition, at least described first part be located in the visible area of user and
Towards the user；
The second surface is when the display device is worn on the head of user, not towards the surface on the head of user.
8. display device as claimed in claim 7, wherein
The connection unit includes the first sub- connection unit and the second sub- connection unit；
The display unit includes the first sub- display unit and the second sub- display unit,
The wherein described first sub- connection unit connect the fixed cell first end and the first sub- display unit first
Subdivision, the second sub- connection unit connect the second end of the fixed cell and the second son of the second sub- display unit
Part；
The first part includes the first subdivision being located in the described first sub- display unit and is shown positioned at second son
The second subdivision in unit.
9. display device as claimed in claim 8, wherein
The display unit further includes：
The sub- display unit of third configures to show the first image,
Optical system configures to receive the light sent out from the sub- display unit of the third, and single to being shown from third
The light that member is sent out carries out light path converting, to form the amplification virtual image；
The first sub- display unit includes：
First lens component, including the first eyeglass
First light guide member is arranged in first eyeglass,
Light Jing Guo the optical system is transmitted to first light guide member by third light guide member, configuration；
The second sub- display unit includes：
Second lens component is connected with first lens component, including the second eyeglass
Second light guide member is arranged in second eyeglass,
Light Jing Guo the optical system is transmitted to the 4th light guide member by the 4th light guide member, configuration, wherein
First light guide member, configuration are reflected to receive the light transmitted by the third light guide member to user；And
And
Second light guide member, configuration are reflected to receive the light transmitted by the 4th light guide member to user,
Wherein described first eyeglass and second eyeglass have predetermined light transmittance so that user can penetrate first eyeglass
External scene is watched with second eyeglass；
The first area that can not be seen clearly when user's direct viewing refers to when user is through first lens component and described the
The region that can not see clearly in scene when scene outside the viewing of two lens components.
10. display device as described in claim 1, wherein
The display unit has predetermined light transmittance so that user can penetrate the display unit and watch external scene；
The second surface is the surface opposite with the first surface.
11. the display device as described in claim 7 or 10, wherein
The processing unit be further configured to be obtained according to identified first area the object in the first area relative to
The position at family, and the display position according to the object in the first area relative to the location determination described first image of user
It sets；
The display unit shows described first image on the display location determined by the processing unit.
12. a kind of display methods is applied to display device, the method includes：
It determines in the scene that user is watched with the presence or absence of the first area that can not be seen clearly when user's direct viewing；
When processing unit determines that acquisition corresponds to the first area there are when the first area in the scene that user is watched
The first image, wherein the size of the first area described in described first image be more than user's direct viewing arrive described first
The size in region；
Show the first image of the first area；
Wherein, with the presence or absence of the first area that can not be seen clearly when user's direct viewing in the scene that the determining user is watched
Including：Detect the view direction of eyes of user；And when detect eyes of user view direction keep be more than in a first direction
When the predetermined time, the processing unit determination exists in the scene that user is watched in said first direction when user directly sees
The first area that can not be seen clearly when seeing；Or,
Include with the presence or absence of the first area that can not be seen clearly when user's direct viewing in the scene that the determining user is watched：
Acquire the 5th image for corresponding to operating body in predetermined operation region；It identifies indicated by the operating body in the 5th image
Direction, and determine in the scene watched there are user on the direction indicated by identified operating body when user's direct viewing
The first area that Shi Wufa sees clearly.
13. display methods as claimed in claim 12, wherein the first image packet obtained corresponding to the first area
It includes：
When determining in the scene that user is watched there are when the first area, described first is acquired with the first image acquisition parameter
Image.
14. display methods as claimed in claim 12, wherein the first image packet obtained corresponding to the first area
It includes：
When determining in the scene that user is watched there are when the first area, acquired about described with the second image acquisition parameter
Second image of first area；And
Amplify in second image comprising the first area part to obtain described first image.
15. display methods as claimed in claim 12 is used wherein whether there is to work as in the scene that the determining user is watched
The first area that can not be seen clearly when the direct viewing of family includes：
Third image is acquired with third image acquisition parameter, wherein the third image acquisition parameter is pre-set；
According to pre-set criterion of identification, identify described in the third image exist whether the first area, and work as
There are when the first area, identified first area is obtained.
16. display methods as claimed in claim 12 is used wherein whether there is to work as in the scene that the determining user is watched
The first area that can not be seen clearly when the direct viewing of family includes：
The 4th image is acquired with the 4th image acquisition parameter, wherein pre-setting the 4th image acquisition parameter；
Show the 4th image；
Receive regional choice input from the user；And
According to the regional choice input first area is obtained in the 4th image.
17. display methods as claimed in claim 12, wherein the first image of the display first area includes：
According to identified first area, position of the object in the first area relative to user is obtained；
Display location according to the object in the first area relative to the location determination described first image of user；And
Described first image is shown on identified display location.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210353335.2A CN103677704B (en) | 2012-09-20 | 2012-09-20 | Display device and display methods |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210353335.2A CN103677704B (en) | 2012-09-20 | 2012-09-20 | Display device and display methods |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103677704A CN103677704A (en) | 2014-03-26 |
| CN103677704B true CN103677704B (en) | 2018-11-09 |
Family
ID=50315391
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210353335.2A Active CN103677704B (en) | 2012-09-20 | 2012-09-20 | Display device and display methods |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103677704B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107223224A (en) * | 2016-12-19 | 2017-09-29 | 深圳前海达闼云端智能科技有限公司 | A kind of amblyopia householder method and device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002058883A (en) * | 2000-08-17 | 2002-02-26 | Omron Corp | Method and system for appreciation support |
| CN101520690A (en) * | 2006-09-08 | 2009-09-02 | 索尼株式会社 | Image capturing and displaying apparatus and image capturing and displaying method |
| CN101566875A (en) * | 2008-04-24 | 2009-10-28 | 索尼株式会社 | Image processing apparatus, image processing method, program, and recording medium |
| CN102375235A (en) * | 2010-08-18 | 2012-03-14 | 索尼公司 | Display apparatus |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3692321B2 (en) * | 2000-10-31 | 2005-09-07 | ヒューレット・パッカード・カンパニー | Illuminated display and method of using the same |
-
2012
- 2012-09-20 CN CN201210353335.2A patent/CN103677704B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002058883A (en) * | 2000-08-17 | 2002-02-26 | Omron Corp | Method and system for appreciation support |
| CN101520690A (en) * | 2006-09-08 | 2009-09-02 | 索尼株式会社 | Image capturing and displaying apparatus and image capturing and displaying method |
| CN101566875A (en) * | 2008-04-24 | 2009-10-28 | 索尼株式会社 | Image processing apparatus, image processing method, program, and recording medium |
| CN102375235A (en) * | 2010-08-18 | 2012-03-14 | 索尼公司 | Display apparatus |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103677704A (en) | 2014-03-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10579320B2 (en) | Display system, display device, information display method, and program | |
| US10165176B2 (en) | Methods, systems, and computer readable media for leveraging user gaze in user monitoring subregion selection systems | |
| US10874284B2 (en) | Display control device, display device, surgical endoscopic system and display control system | |
| EP2800281B1 (en) | Spectacle-type communication device, system and method | |
| EP2824541B1 (en) | Method and apparatus for connecting devices using eye tracking | |
| CN204595327U (en) | Head-mounted display apparatus | |
| CN111630477A (en) | Apparatus for providing augmented reality service and method of operating the same | |
| KR20170039622A (en) | Device for detecting line of sight | |
| CN105739095B (en) | Display device and control method of display device | |
| CN104977716A (en) | Eyepiece-type display apparatus and display control method therefor | |
| US20160109703A1 (en) | Head mounted display, method for controlling head mounted display, and computer program | |
| EP4035348A1 (en) | Automated video capture and composition system | |
| JP2018174003A (en) | Display device, display system, control method of display device, and program | |
| KR101650706B1 (en) | Device for wearable display | |
| CN204595328U (en) | Head-mounted display apparatus | |
| CN107908002A (en) | Enhancing and the device and method of mixed reality | |
| WO2016101861A1 (en) | Head-worn display device | |
| JP2017191546A (en) | Medical use head-mounted display, program of medical use head-mounted display, and control method of medical use head-mounted display | |
| CN103677704B (en) | Display device and display methods | |
| US20160189341A1 (en) | Systems and methods for magnifying the appearance of an image on a mobile device screen using eyewear | |
| CN104065952A (en) | Wearable electronic device and image processing method | |
| CN104239877B (en) | The method and image capture device of image procossing | |
| CN111722401A (en) | Display device, display control method, and display system | |
| KR200410513Y1 (en) | Military remote accuracy observation apparatus | |
| WO2023129295A1 (en) | Hyper-connected and synchronized ar glasses |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |