CN103677704A - Display device and display method - Google Patents
Display device and display method Download PDFInfo
- Publication number
- CN103677704A CN103677704A CN201210353335.2A CN201210353335A CN103677704A CN 103677704 A CN103677704 A CN 103677704A CN 201210353335 A CN201210353335 A CN 201210353335A CN 103677704 A CN103677704 A CN 103677704A
- Authority
- CN
- China
- Prior art keywords
- image
- user
- area
- display device
- scene
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Abstract
An embodiment of the invention provides a display device and a display method applied to the display device. The display device comprises a processing unit, an image acquisition unit and a display unit, wherein the processing unit is configured for determining whether a scene watched by users has a first area which cannot be seen clearly by users when users watch the first area directly; the image acquisition unit is configured for acquiring a first image corresponding to the first area when the processing unit determines that a scene watched by users has the first area, wherein the dimension of the first area in the first image is larger than that of the first area watched by users directly; the display unit is arranged on a first surface of the display device and configured for displaying the first image of the first area, wherein the first surface is towards users when users watch the first image; the image acquisition unit comprises an image collection module arranged on a second surface of the display device.
Description
Technical field
Embodiments of the invention relate to a kind of display device and are applied to the display packing of described display device.
Background technology
Along with the development of technology, various portable electric appts are widely used, for example, and portable computer, tablet computer, smart mobile phone and portable media player etc.Current, for multifarious function is provided to user, a lot of portable electric appts are all equipped with for example image acquisition units of camera and so on, so that user carries out the operations such as image, video capture.
On the other hand, user when the scene of watching around, for example usually find to exist in scene people's at a distance and so on the scenery that does not see Chu or for example the literal order on billboard cannot accurately identify content.Although user's portable electric appts may comprise image acquisition units, but image acquisition units can not obtain user and not see the scenery of Chu or cannot accurately identify content, and do not see the scenery of Chu or cannot accurately identify content and carry out the operation such as image, video capture targetedly according to user, with assisted user, watch.
Summary of the invention
The display packing that the object of the embodiment of the present invention is to provide a kind of display device and is applied to display device, to address the above problem.
One embodiment of the present of invention provide a kind of display device, comprising: processing unit, and configuration determines in the scene that user watches whether have the first area that cannot see clearly when user's direct viewing; Image acquisition unit, configuration is worked as while there is first area in the scene that processing unit determines that user watches, obtain the first image corresponding to first area, wherein in the first image, the size of first area is greater than the size of the first area that user's direct viewing arrives; Display unit, is arranged on the first surface of display device, and configuration shows the first image of first area, wherein when user watches the first image, first surface is towards user, and wherein, image acquisition unit comprises: be arranged on the image capture module on the second surface of display device.
Another embodiment of the present invention provides a kind of display packing, is applied to display device.Described method comprises: determine in the scene that user watches whether have the first area that cannot see clearly when user's direct viewing; When processing unit, determine while there is first area in the scene that user watches, obtain the first image corresponding to first area, wherein in the first image, the size of first area is greater than the size of the first area that user's direct viewing arrives; And the first image that shows first area.
By according to the display device of the embodiment of the present invention and display packing, in the situation that whether there is the first area that cannot see clearly in the scene that user watches when user's direct viewing, can automatic acquisition corresponding to the first image of first area, with assisted user, watch its scenery that cannot directly see clearly or cannot accurately identify content.
Accompanying drawing explanation
In order to be illustrated more clearly in the technical scheme of the embodiment of the present invention, will the accompanying drawing of required use in the description of embodiment be briefly described below.Accompanying drawing in the following describes is only exemplary embodiment of the present invention.
Fig. 1 shows the block diagram of display device according to an embodiment of the invention.
Fig. 2 shows the key diagram of an illustrative case of the display device shown in Fig. 1.
Fig. 3 shows the key diagram of an illustrative case of the first image that the image acquisition unit of the display device shown in Fig. 2 obtains.
Fig. 4 shows the key diagram of another illustrative case of the display device shown in Fig. 1.
Fig. 5 shows the key diagram of an illustrative case of the first image that the image acquisition unit of the display device shown in Fig. 4 obtains.
Fig. 6 shows the exemplary process diagram of display packing according to an embodiment of the invention.
Embodiment
Hereinafter, with reference to accompanying drawing, describe the preferred embodiments of the present invention in detail.Note, in this instructions and accompanying drawing, there is substantially the same step and represent with identical Reference numeral with element, and will be omitted the repetition of explanation of these steps and element.
In following examples of the present invention, the concrete form of display device includes but not limited to hand-held electric equipment, portable computer and the wear-type electronic equipment etc. such as tablet computer, personal digital assistant, smart mobile phone, game machine, portable media player.
Fig. 1 shows the block diagram of display device 100 according to an embodiment of the invention.As shown in Figure 1, display device 100 comprises processing unit 110, image acquisition unit 120 and display unit 130.
Particularly, processing unit 110 can determine in the scene that user watches whether have the first area that cannot see clearly when user's direct viewing.While there is first area in the scene that the definite user of processing unit 110 watches, image acquisition unit 120 obtains the first image corresponding to first area.Particularly, in the first image, the size of first area is greater than the size of the first area that user's direct viewing arrives.Image acquisition unit 120 can comprise the image capture module 121 on the second surface that is arranged on display device 100.Image capture module 121 can the first image acquisition parameter gathers the first image that the size of first area is wherein greater than the size of the first area that user's direct viewing arrives.That is to say, when image capture module 121 carries out image acquisition with the first image acquisition parameter to described first area, can directly obtain the first image that the size of first area is wherein greater than the size of the first area that user's direct viewing arrives.Alternatively, consider production cost, the aperture of image capture module 121 may be less, and the focal length of camera lens may be shorter.Image capture module 121 may not directly photograph the image with large-size corresponding to first area.In the case, image capture module 121 can the second image acquisition parameter collection about the second image of first area.And image acquisition unit 120 also can comprise image processing module.Image processing module can amplify in the second image, comprise first area part to obtain the first image.More specifically, image processing module can obtain the first image by amplifying the size of the part that comprises first area in the second image, in addition, image processing module also can process to obtain the first image by the part that comprises first area in the second image is carried out to sharpening, so that the content in image is more clear after processing.
According to an example of the present invention, display device 100 also can comprise line-of-sight detection unit.Line-of-sight detection unit can detect the view direction of eyes of user, and wherein, when user uses display device, line-of-sight detection unit, towards user, detects with the eyeball to user.When line-of-sight detection unit inspection remains on first direction and surpasses the schedule time to the view direction of eyes of user, processing unit 110 is determined the first area that cannot see clearly when user's direct viewing in the scene that exists in a first direction user to watch.
When there is first area according to the testing result of line-of-sight detection unit in definite scene that user watches in a first direction in processing unit 110, as mentioned above, image capture module 121 can directly gather the first image by the first image acquisition parameter in a first direction.
For example, the scenery that cannot directly see clearly due to user or cannot accurately identify distant conventionally and between user of content, the image acquisition parameter using in the time of therefore the first image acquisition parameter can being set in advance as to the scenery of taking at a distance.For example, when using the first image acquisition parameter to gather the first image, the focal length of image capture module 121 can be set to long.In addition, also can be set to the image acquisition parameter of image capture module 121 under large depth of field pattern by the first image acquisition parameter.For example, when using the first image acquisition parameter to gather the first image, the aperture of image capture module 121 can be set to larger.Thereby, and the distant or nearer object between user all can clearly be taken by image capture module 121.
Alternatively, as mentioned above, when processing unit 110 exists first area according to the testing result of line-of-sight detection unit in definite scene that user watches in a first direction, image capture module 121 can gather the second image about first area by the second image acquisition parameter in a first direction.And image acquisition unit 120 also can comprise image processing module.Image processing module can amplify in the second image, comprise first area part to obtain the first image.In addition, image processing module also can carry out sharpening processing to the second image, so that the content in image is more clear after processing.
In above example, by using the view direction of line-of-sight detection unit inspection eyes of user, display device can determine in the scene that user watches whether have the first area that cannot see clearly when user's direct viewing, and determine when there is first area, display device can automatic acquisition corresponding to the first image of described first area, and do not need user to carry out input to obtain auxiliary its first image of watching, thereby simplified user's operation.
Yet, the invention is not restricted to this.According to another example of the present invention, before the first area that cannot see clearly while whether existing when user's direct viewing in the scene of watching the definite user of processing unit 110, image capture module 121 can gather the 3rd image with the 3rd image acquisition parameter, wherein sets in advance the 3rd image acquisition parameter.For example, can the 3rd image acquisition parameter be set according to ordinary people's example, thereby the scene that image capture module 121 arrives with the 3rd image and ordinary people's direct viewing of the 3rd image acquisition parameter collection is similar.Alternatively, also can the 3rd image acquisition parameter be set according to user's eyesight, the scene that image capture module 121 arrives with the 3rd image and this user's direct viewing of the 3rd image acquisition parameter collection is approached.Processing unit 110 can be according to the criterion of identification setting in advance, and in identification the 3rd image, whether has first area, and when there is first area, obtains the first area of identifying.For example, can set in advance processing unit 110 and only people's face be identified, in the 3rd image, have people's face, and the size of this facial image is while being less than predetermined face picture size, the region at facial image place can be defined as to first area.Again for example, can set in advance processing unit 110 and only character be identified, in the 3rd image, have character, and while being less than book character size corresponding to the size of the image of this character, the region at the image place corresponding to this character can be defined as to first area.
While there is first area in definite the 3rd image of processing unit 110.As mentioned above, image capture module 121 can the first image acquisition parameter gathers the first image that the size of first area is wherein greater than the size of the first area that user's direct viewing arrives.For example, according to the 3rd image acquisition parameter, the focal length of the camera lens of image capture module 121 may be set to shorter, so that the scene that the 3rd captured image and this user's direct viewing are arrived approaches.And the scenery that cannot directly see clearly due to user or cannot accurately identify distant conventionally and between user of content, therefore according to the first image acquisition parameter, the focal length of the camera lens of image capture module 121 may be set to long, so that in the first captured image, can clearly present the scenery that user cannot directly see clearly or cannot accurately identify content.Alternatively, image capture module 121 can the second image acquisition parameter collection about the second image of first area.And image acquisition unit 120 also can comprise image processing module.Image processing module can amplify in the second image, comprise first area part to obtain the first image.The second image acquisition parameter can be identical or different with the 3rd image acquisition parameter.
In this example, by using image capture module, with the 3rd image acquisition parameter, take similar the 3rd image of scene arriving with user's direct viewing, and the 3rd image is carried out to image recognition, display device can determine in the scene that user watches whether have the first area that cannot see clearly when user's direct viewing, and determine when there is first area, display device can automatic acquisition corresponding to the first image of described first area, and do not need user to carry out input to obtain auxiliary its first image of watching, thereby simplified user's operation.
Yet, the invention is not restricted to this.According to another example of the present invention, before the first area that cannot see clearly while whether existing when user's direct viewing in the scene of watching the definite user of processing unit 110, image capture module 121 can gather the 4th image with the 4th image acquisition parameter, wherein sets in advance the 4th image acquisition parameter.For example, can the 4th image acquisition parameter be set according to ordinary people's example, thereby the scene that image capture module 121 arrives with the 4th image and ordinary people's direct viewing of the 4th image acquisition parameter collection is similar.Alternatively, also can the 4th image acquisition parameter be set according to user's eyesight, the scene that image capture module 121 arrives with the 4th image and this user's direct viewing of the 4th image acquisition parameter collection is approached.The 4th image that display unit 130 displayable image acquisition modules 121 gather.Display device also can comprise input block, to receive from user's region, selects input.The region that processing unit 110 can receive according to input block selects input to obtain first area in the 4th image.
While there is first area in definite the 4th image of processing unit 110.As mentioned above, image capture module 121 can the first image acquisition parameter gathers the first image that the size of first area is wherein greater than the size of the first area that user's direct viewing arrives.For example, according to the 4th image acquisition parameter, the focal length of the camera lens of image capture module 121 may be set to shorter, so that the scene that the 4th captured image and this user's direct viewing are arrived approaches.And the scenery that cannot directly see clearly due to user or cannot accurately identify distant conventionally and between user of content, therefore according to the first image acquisition parameter, the focal length of the camera lens of image capture module 121 may be set to long, so that in the first captured image, can clearly present the scenery that user cannot directly see clearly or cannot accurately identify content.Alternatively, image capture module 121 can the second image acquisition parameter collection about the second image of first area.And image acquisition unit 120 also can comprise image processing module.Image processing module can amplify in the second image, comprise first area part to obtain the first image.The second image acquisition parameter can be identical or different with the 4th image acquisition parameter.
In this example, by similar the 4th image of scene that uses image capture module to arrive with the 4th image acquisition parameter collection and user's direct viewing, and select input to determine first area by the region from user, thereby can reduce display device in order to determine the operation of the required execution in first area, and can determine more accurately in the scene that user watches whether have the first area that cannot see clearly when user's direct viewing.
In addition, according to another example of the present invention, before the first area that cannot see clearly while whether existing when user's direct viewing in the scene of watching the definite user of processing unit 110, image capture module 121 can be captured in scheduled operation region corresponding to for example the 5th image of the operating body of finger and so on.Processing unit 120 can be identified the indicated direction of operating body in the 5th image, and determines the first area that cannot see clearly when user's direct viewing in the scene that exists user to watch in the indicated direction of the operating body identify.
Although illustrated and described processing unit and the image acquisition unit of some embodiments of the present invention, but it should be appreciated by those skilled in the art that can be dependent on design requirement and other factors carries out various modifications, combination, part combination and replace above-described embodiment.For example, in the situation that display device can comprise line-of-sight detection unit, when line-of-sight detection unit inspection remains on first direction and surpasses the schedule time to the view direction of eyes of user, image capture module 121 can gather the 6th image along first direction with the 6th image acquisition parameter.Can be set to the image acquisition parameter of image capture module 121 under large depth of field pattern by the 6th image acquisition parameter.For example, when using the 6th image acquisition parameter to gather the 6th image, the aperture of image capture module 121 can be set to larger.Thereby, and the distant or nearer object between user all can clearly be taken by image capture module 121.The 6th image that display unit 130 displayable image acquisition modules 121 gather.Display device also can comprise input block, to receive from user's region, selects input.The region that processing unit 110 can receive according to input block selects input to obtain first area in the 6th image.In this example, the collection direction of the 6th image is consistent with the view direction of user's eyes, has improved the specific aim of image acquisition, and has dwindled the scope that user finds first area, makes the user can to determine quickly first area.
Return to Fig. 1, display unit 130 can be arranged on the first surface of display device 100.At image acquisition unit, obtain after the first image corresponding to described first area, display unit 130 can show the first image of first area.The first surface of display device 100 is for when user watches the first image, towards user's surface.Above-mentioned image capture module 121 can be arranged on the second surface different from the first surface at display unit 130 places.According to an example of the present invention, display unit 130 can show the first image of first area in predetermined display area.
In addition, according to another example of the present invention, display unit has predetermined transmittance, makes user to watch outside scene in transmission display unit.Second surface can be the surface relative with first surface.In the case, preferably, processing unit 110 also can be according to determined first area, obtains object in first area with respect to user's position, and according to the object in first area the display position with respect to location positioning the first image of user.Display unit 130 can show the first image on the determined display position of processing unit 110.In this example, the position of the first area in the outside scene that the position of the first image of the first area that display unit 130 is shown is watched with user is corresponding, user need to not find the first image of first area to assist it to watch in predetermined display area, thereby has improved user's experience.
By according to the display device of the present embodiment, in the situation that whether there is the first area that cannot see clearly in the scene that user watches when user's direct viewing, can automatic acquisition corresponding to the first image of first area, with assisted user, watch its scenery that cannot directly see clearly or cannot accurately identify content.
Fig. 2 shows the key diagram of an illustrative case of the display device shown in Fig. 1.Display device 200 is portable electric appts.As shown in Figure 2, in display device 200, display unit 230 is arranged on the first surface 201 of display device 200.Display unit has predetermined transmittance.Housing corresponding to display device 200 setting positions in display device 200 is transparent shell, makes user to watch outside scene in transmission display unit 230.
The image acquisition unit of display device 200 comprises the image capture module 221 on the second surface 202 that is arranged on display device 200, and wherein second surface 202 is relative with first surface 201.When processing unit exists first area according to the testing result of line-of-sight detection unit 240 in definite scene that user watches in a first direction, image capture module 221 can gather the first image by the first image acquisition parameter in a first direction.
Fig. 3 shows the key diagram of an illustrative case of the first image that the image acquisition unit of the display device shown in Fig. 2 obtains.As shown in Figure 3, in the first image 300 size of the billboard 251 ' in first area be greater than user's direct viewing to first area in the size of billboard 251.Display unit 230 obtains after the first image corresponding to described first area at image capture module 221, shows the first image 300 of first area to user.User can be by watching the first image 300 to be clear that the content in billboard 251.
In addition,, according to another example of the present invention, the display device shown in Fig. 1, also can comprise fixed cell and linkage unit.Display device can be worn on by fixed cell user's head.For example, fixed cell can comprise wearable components such as the helmet, headband.And linkage unit can be connected and fixed at least first of unit and display unit, and wherein linkage unit at least has the first state, under the first state, at least first is positioned at user's viewing area and towards user.Thereby user can be worn over head by display device according to an embodiment of the invention, and hand-held this display device while not needing to use.
In this example, image capture module can be arranged on when display device is worn on user's head, not on the second surface of user's head.Selectively, image capture module can be arranged on the second surface of display device by rotary part.Rotary part can be around the rotation of the axle center of this rotary part, image capture module can be rotated with respect to the axle center of rotary part, so that carry out pan according to the position control image capture module of first area, or the collection angle of pitch of adjustment image capture module etc.
In addition, display unit can comprise and is positioned at user's viewing area and towards one of user complete viewing area.Alternatively, display unit also can comprise in user's viewing area and respectively for two separated viewing areas of two eyes of user.
Fig. 4 shows the key diagram of another illustrative case of the display device shown in Fig. 1.Display device 400 is wear-type electronic equipment.Similar with display device 100, display device 400 can comprise processing unit (not shown), image acquisition unit and display unit, and in addition, display device 400 also comprises fixed cell 440 and linkage unit.
Particularly, display device 400 can be worn on head by fixed cell 440.And processing unit can be arranged in fixed cell 440.
Image acquisition unit comprises the image capture module 421 on the second surface 402 that is arranged on display device.Image capture module 421 is connected to fixed cell 440 by rotary part (not shown).As shown in Figure 4, second surface 402 is for when described display device is worn on user's head by fixed cell 440, and fixed cell 440 is corresponding to the surface of user's face.
Display unit comprises and corresponds respectively to user's left eye and the sub-display unit of right eye first and the second sub-display unit.Linkage unit comprises the first sub-connection unit 441 and the second sub-connection unit 442.The first sub-connection unit 441 is connected and fixed the first subdivision of first end and the first sub-display unit of unit 440, and the second sub-connection unit 442 is connected and fixed the second subdivision of the second end and the second sub-display unit of unit 440.In the example depicted in fig. 4, the first that is arranged in the display unit of user viewing area comprises the first subdivision 431 of the first sub-display unit and the second subdivision 432 of the second sub-display unit.
In the example depicted in fig. 4, before processing unit is determined the first area that cannot see clearly while whether existing when user's direct viewing in the scene that user watches, image capture module 421 is captured in scheduled operation region the 5th image corresponding to user's finger.As shown in Figure 4, user's finger is along the direction billboard 451 shown in arrow B.The indicated direction of finger in processing unit identification the 5th image, and determine the first area that cannot see clearly in the scene that exists user to watch in the indicated direction of the finger identified when user's direct viewing.In this example, first area is the region at billboard 451 places.
While there is first area in the definite scene that user watches in a first direction of processing unit, image capture module 421 can gather the first image by the first image acquisition parameter in a first direction.
Fig. 5 shows the key diagram of an illustrative case of the first image that the image acquisition unit of the display device 400 shown in Fig. 4 obtains.As shown in Figure 5, in the first image 500 size of the billboard 451 ' in first area be greater than user's direct viewing to first area in the size of billboard 451.Display unit obtains after the first image corresponding to described first area at image capture module 421, shows the first image 500 of first area to user.
In the present embodiment, the first subdivision 431 in the first sub-display unit and the second subdivision 432 in the second sub-display unit can be respectively for the display screen of user's left eye and right eye, in addition, the first sub-display unit also can comprise respectively the image transmitting parts that are connected with the processing unit being arranged in fixed cell 440 with the second sub-display unit.
Alternatively, display unit also can comprise the 3rd sub-display unit and the optical system being arranged in fixed cell 440.The first image that the 3rd sub-display unit displayable image acquisition module 421 obtains.Optical system can receive the light sending from the 3rd sub-display unit, and the light sending from the 3rd sub-display unit is carried out to light path converting, to form the amplification virtual image.
In the case, the first sub-display unit can comprise: the first mirror chip part that comprises the first eyeglass, be arranged on the first light guide member in the first eyeglass and for the light through optical system being sent to the 3rd light guide member of the first light guide member.Similarly, the second sub-display unit can comprise: the second lens component that comprises the second eyeglass, the 4th light guide member that is arranged on the second light guide member in the second eyeglass and the light through optical system is sent to the 4th light guide member.The first light guide member can receive the light transmitting by the 3rd light guide member and reflect to user.And the second light guide member can receive the light transmitting by the 4th light guide member and reflect to user.The first subdivision 431 in the first sub-display unit can comprise the first mirror chip part that comprises the first eyeglass, be arranged on the first light guide member in the first eyeglass, and the second subdivision 432 in the second sub-display unit can be the second lens component of comprising the second eyeglass, be arranged on the second light guide member in the second eyeglass.The first eyeglass and the second eyeglass have predetermined transmittance, make user to watch outside scene through the first eyeglass and the second eyeglass.Thereby when watching shown the first image of display unit, can see the situation of actual environment, to prevent that beholder from falling, knocking down the fortuitous event of barrier and so on.In this example, the first area that cannot see clearly when user's direct viewing refers to and sees through the region that cannot see clearly when first mirror chip part and the second lens component are watched outside scene as user in scene.
Below, the display packing of embodiments of the invention is described with reference to Fig. 6.Fig. 6 is the process flow diagram of having described according to the display packing 600 of the embodiment of the present invention.Each step in display packing 600 can be carried out by the corresponding module in the display device in above-mentioned Fig. 1 respectively, therefore, succinct in order to describe, and no longer specifically describes.
As shown in Figure 6, in step S601, determine in the scene that user watches whether have the first area that cannot see clearly when user's direct viewing.When in step S601, determine while there is first area in the scene that user watches, in step S602, obtain the first image corresponding to first area.Particularly, in the first image, the size of first area is greater than the size of the first area that user's direct viewing arrives.According to an example of the present invention, in step S602, can the first image acquisition parameter gather the first image that the size of first area is wherein greater than the size of the first area that user's direct viewing arrives.That is to say, when image acquisition being carried out in first area with the first image acquisition parameter, can directly obtain the first image that the size of first area is wherein greater than the size of the first area that user's direct viewing arrives.Alternatively, consider production cost, the aperture of the image capture module of display device may be less, and the focal length of camera lens may be shorter, therefore may not directly photograph the image with large-size corresponding to first area.In the case, in step S602, can the second image acquisition parameter collection about the second image of first area, then amplify in the second image, comprise first area part to obtain the first image.More specifically, can obtain the first image by amplifying the size of the part that comprises first area in the second image, in addition, also can process to obtain the first image by the part that comprises first area in the second image is carried out to sharpening, so that the content in image is more clear after processing.
According to an example of the present invention, in step S601, can detect the view direction of eyes of user, wherein, when user uses display device, line-of-sight detection unit, towards user, detects with the eyeball to user.In step S601, when the view direction that eyes of user detected remains on first direction and surpasses the schedule time, determine the first area that cannot see clearly in the scene that exists in a first direction user to watch when user's direct viewing.
While there is first area in definite scene that user watches in a first direction according to line-of-sight detection result, as mentioned above, in step S602, can directly gather in a first direction the first image by the first image acquisition parameter.
Alternatively, as mentioned above, when there is first area according to line-of-sight detection result in definite scene that user watches in a first direction in step S601, in step S602, can gather in a first direction the second image about first area by the second image acquisition parameter, then amplify in the second image, comprise first area part to obtain the first image.In addition, in step S602, also can carry out sharpening processing to the second image, so that the content in image is more clear after processing.
In above example, by detecting the view direction of eyes of user, can determine in the scene that user watches and whether have the first area that cannot see clearly when user's direct viewing, and determine when there is first area, can automatic acquisition corresponding to the first image of described first area, and do not need user to carry out input to obtain auxiliary its first image of watching, thereby simplified user's operation.
Yet, the invention is not restricted to this.According to another example of the present invention, in step S601, can gather the 3rd image with the 3rd image acquisition parameter, wherein set in advance the 3rd image acquisition parameter.For example, can the 3rd image acquisition parameter be set according to ordinary people's example, thereby the scene arriving with the 3rd image and ordinary people's direct viewing of the 3rd image acquisition parameter collection is similar.Alternatively, also can the 3rd image acquisition parameter be set according to user's eyesight, the scene arriving with the 3rd image and this user's direct viewing of the 3rd image acquisition parameter collection is approached.In step S601, can be according to the criterion of identification setting in advance, in identification the 3rd image, whether there is first area, and when there is first area, obtain the first area of identifying.For example, can set in advance in step S601 and only people's face be identified, in the 3rd image, have people's face, and the size of this facial image is while being less than predetermined face picture size, the region at facial image place can be defined as to first area.Again for example, can set in advance in step S601 and only character be identified, in the 3rd image, there is character, and while being less than book character size corresponding to the size of the image of this character, the region at the image place corresponding to this character can be defined as to first area.
While there is first area in definite the 3rd image in step S601.As mentioned above, can the first image acquisition parameter in step S602 gather the first image that the size of first area is wherein greater than the size of the first area that user's direct viewing arrives.For example, according to the 3rd image acquisition parameter, the focal length of the camera lens of image capture module may be set to shorter, so that the scene that the 3rd captured image and this user's direct viewing are arrived approaches.And the scenery that cannot directly see clearly due to user or cannot accurately identify distant conventionally and between user of content, therefore according to the first image acquisition parameter, the focal length of the camera lens of image capture module may be set to long, so that in the first captured image, can clearly present the scenery that user cannot directly see clearly or cannot accurately identify content.Alternatively, can the second image acquisition parameter collection in step S602 about the second image of first area, then amplify in the second image, comprise first area part to obtain the first image.The second image acquisition parameter can be identical or different with the 3rd image acquisition parameter.
In this example, by take similar the 3rd image of scene arriving with user's direct viewing with the 3rd image acquisition parameter, and the 3rd image is carried out to image recognition, can determine in the scene that user watches and whether have the first area that cannot see clearly when user's direct viewing, and determine when there is first area, display device can automatic acquisition corresponding to the first image of described first area, and do not need user to carry out input to obtain auxiliary its first image of watching, thereby simplified user's operation.
Yet, the invention is not restricted to this.According to another example of the present invention, in step S601, can gather the 4th image with the 4th image acquisition parameter, wherein set in advance the 4th image acquisition parameter.For example, can the 4th image acquisition parameter be set according to ordinary people's example, thereby the scene arriving with the 4th image and ordinary people's direct viewing of the 4th image acquisition parameter collection is similar in step S601.Alternatively, also can the 4th image acquisition parameter be set according to user's eyesight, the scene arriving with the 4th image and this user's direct viewing of the 4th image acquisition parameter collection in step S601 is approached, then can show the 4th gathered image, reception is selected input from user's region, and the region receiving according to input block selects input to obtain first area in the 4th image.
While there is first area in definite the 4th image in step S601.As mentioned above, can the first image acquisition parameter in step S602 gather the first image that the size of first area is wherein greater than the size of the first area that user's direct viewing arrives.For example, according to the 4th image acquisition parameter, the focal length of the camera lens of image capture module may be set to shorter, so that the scene that the 4th captured image and this user's direct viewing are arrived approaches.And the scenery that cannot directly see clearly due to user or cannot accurately identify distant conventionally and between user of content, therefore according to the first image acquisition parameter, the focal length of the camera lens of image capture module may be set to long, so that in the first captured image, can clearly present the scenery that user cannot directly see clearly or cannot accurately identify content.Alternatively, can the second image acquisition parameter collection in step S602 about the second image of first area, then amplify in the second image, comprise first area part to obtain the first image.The second image acquisition parameter can be identical or different with the 4th image acquisition parameter.
In this example, by take similar the 4th image of scene arriving with user's direct viewing with the 4th image acquisition parameter, and select input to determine first area by the region from user, thereby can reduce display device in order to determine the operation of the required execution in first area, and can determine more accurately in the scene that user watches whether have the first area that cannot see clearly when user's direct viewing.
In addition, according to another example of the present invention, in step S601, can be captured in scheduled operation region corresponding to for example the 5th image of the operating body of finger and so on, then identify the indicated direction of operating body in the 5th image, and determine the first area that cannot see clearly in the scene that exists user to watch in the indicated direction of the operating body identify when user's direct viewing.
Although illustrated and described processing unit and the image acquisition unit of some embodiments of the present invention, but it should be appreciated by those skilled in the art that can be dependent on design requirement and other factors carries out various modifications, combination, part combination and replace above-described embodiment.For example, in step S601 when line-of-sight detection unit inspection remains on first direction and surpasses the schedule time to the view direction of eyes of user, can along first direction, gather the 6th image with the 6th image acquisition parameter, wherein can be set to the image acquisition parameter of image capture module under large depth of field pattern by the 6th image acquisition parameter, thereby, and the distant or nearer object between user all can clearly be taken by image capture module 121.Then can show the 6th gathered image, and receive the region selection input from user.Can select input to obtain first area in the 6th image according to received region.In this example, the collection direction of the 6th image is consistent with the view direction of user's eyes, has improved the specific aim of image acquisition, and has dwindled the scope that user finds first area, makes the user can to determine quickly first area.
Return to Fig. 6, in step S603, show the first image corresponding to first area obtaining.An example according to the present invention can be according to determined first area in step S603, object in acquisition first area is with respect to user's position, and the display position according to the object in first area with respect to location positioning the first image of user, and on determined display position, show the first image.
By according to the display packing of the present embodiment, in the situation that whether there is the first area that cannot see clearly in the scene that user watches when user's direct viewing, can automatic acquisition corresponding to the first image of first area, with assisted user, watch its scenery that cannot directly see clearly or cannot accurately identify content.
Those of ordinary skills can recognize, unit, the module of each example of describing in conjunction with embodiment disclosed herein, can realize with electronic hardware, computer software or the combination of the two, for the interchangeability of hardware and software is clearly described, composition and the step of each example described according to function in the above description in general manner.These functions are carried out with hardware or software mode actually, depend on application-specific and the design constraint of technical scheme.Professional and technical personnel can specifically should be used for realizing described function with distinct methods to each, but this realization should not thought and exceeds scope of the present invention.
Although illustrated and described some embodiments of the present invention, it will be understood by those skilled in the art that without departing from the principles and spirit of the present invention, can carry out various modifications to these embodiment, such modification should fall within the scope of the present invention.
Claims (21)
1. a display device, comprising:
Processing unit, configuration determines in the scene that user watches whether have the first area that cannot see clearly when user's direct viewing;
Image acquisition unit, configuration is worked as while there is described first area in the scene that described processing unit determines that user watches, obtain the first image corresponding to described first area, wherein the size in first area described in described the first image is greater than the size of the described first area that user's direct viewing arrives;
Display unit, is arranged on the first surface of described display device, and configuration shows the first image of described first area, and wherein when user watches described the first image, described first surface is towards user,
Wherein, described image acquisition unit comprises: be arranged on the image capture module on the second surface of described display device.
2. display device as claimed in claim 1, also comprises:
Line-of-sight detection unit, configuration detects the view direction of eyes of user, and wherein when user uses described display device, described line-of-sight detection unit is towards user, and
Wherein, when described line-of-sight detection unit inspection remains on first direction and surpasses the schedule time to the view direction of eyes of user, described processing unit is determined the described first area that cannot see clearly when user's direct viewing in the scene that exists user to watch on described first direction.
3. display device as claimed in claim 1 or 2, wherein
Described image capture module configures works as while there is described first area in the scene that described processing unit determines that user watches, with the first image acquisition parameter, gather described the first image, wherein, when described image capture module carries out image acquisition with described the first image acquisition parameter to described first area, can directly obtain described the first image.
4. display device as claimed in claim 1 or 2, wherein
Described image capture module configures works as while there is described first area in the scene that described processing unit determines that user watches, the second image with the second image acquisition parameter collection about described first area;
Described image acquisition unit also comprises:
Image processing module, configuration amplify in described the second image, comprise described first area part to obtain described the first image.
5. the display device as described in claim 3 or 4, wherein
Described image capture module gathers with large depth of field pattern so that and the object of the distance between display device in preset range all can clearly be gathered.
6. display device as claimed in claim 1, wherein
Described image capture module configuration comes to gather the 3rd image with the 3rd image acquisition parameter, and wherein said the 3rd image acquisition parameter sets in advance;
Described processing unit is according to the criterion of identification setting in advance, and identify and whether described in described the 3rd image, have described first area, and when there is described first area, the first area that acquisition is identified.
7. display device as claimed in claim 1, wherein
Described image capture module configuration comes to gather the 4th image with the 4th image acquisition parameter, and wherein said the 4th image acquisition parameter is to set in advance;
Described display unit also configures to show described the 4th image;
Described display device also comprises:
Input block, configuration receives from user's region and selects input;
Described processing unit, selects input to obtain described first area in described the 4th image according to described region.
8. display device as claimed in claim 1, also comprises:
Fixed cell, wherein said display device can be worn on by this fixed cell user's head;
Linkage unit, configuration connects at least first of described fixed cell and described display unit, wherein said linkage unit at least has the first state, and under described the first state, at least described first is positioned at user's viewing area and towards described user;
Described second surface is for when described display device is worn on user's head, not towards the surface of user's head.
9. display device as claimed in claim 8, wherein
Described linkage unit comprises the first sub-connection unit and the second sub-connection unit;
Described display unit comprises the first sub-display unit and the second sub-display unit,
Wherein said the first sub-connection unit connects the first subdivision of first end and the described first sub-display unit of described fixed cell, and described the second sub-connection unit connects the second subdivision of the second end and the described second sub-display unit of described fixed cell;
Described first comprises the first subdivision that is arranged in described the first sub-display unit and the second subdivision that is arranged in described the second sub-display unit.
10. display device as claimed in claim 9, wherein
Described display unit also comprises:
The 3rd sub-display unit, configuration shows the first image,
Optical system, configuration receives the light sending from described the 3rd sub-display unit, and the light sending from described the 3rd sub-display unit is carried out to light path converting, to form the amplification virtual image;
Described the first sub-display unit comprises:
First mirror chip part, comprises the first eyeglass
The first light guide member, is arranged in described the first eyeglass,
The 3rd light guide member, configuration is sent to described the first light guide member by the light through described optical system;
Described the second sub-display unit comprises:
The second lens component, is connected with described first mirror chip part, comprises the second eyeglass
The second light guide member, is arranged in described the second eyeglass,
The 4th light guide member, configuration is sent to described the 4th light guide member by the light through described optical system, wherein
Described the first light guide member, configuration receives the light transmitting by described the 3rd light guide member and reflects to user; And
Described the second light guide member, configuration receives the light transmitting by described the 4th light guide member and reflects to user,
Wherein said the first eyeglass and described the second eyeglass have predetermined transmittance, make user to watch outside scene through described the first eyeglass and described the second eyeglass;
The first area that cannot see clearly when user's direct viewing refers to and sees through the region that cannot see clearly when described first mirror chip part and described the second lens component are watched outside scene as user in described scene.
11. display device as claimed in claim 1, wherein
Described display unit has predetermined transmittance, makes user can see through described display unit and watches outside scene;
Described second surface is the surface relative with described first surface.
12. display device described in claim 8 or 11, wherein
Described image capture module configures to be captured in scheduled operation region the 5th image corresponding to operating body;
Described processing unit is identified the indicated direction of operating body in described the 5th image, and determines the described first area that cannot see clearly when user's direct viewing in the scene that exists user to watch in the indicated direction of the operating body identify.
13. display device as described in claim 8 or 11, wherein
Described processing unit also configures and comes according to determined first area, obtains object in described first area with respect to user's position, and according to the object in described first area the display position with respect to the first image described in user's location positioning;
Described display unit shows described the first image on the determined display position of described processing unit.
14. 1 kinds of display packings, are applied to display device, and described method comprises:
Determine in the scene that user watches and whether have the first area that cannot see clearly when user's direct viewing;
When described processing unit is determined while there is described first area in the scene that user watches, obtain the first image corresponding to described first area, wherein the size in first area described in described the first image is greater than the size of the described first area that user's direct viewing arrives;
The first image that shows described first area.
Whether 15. display packings as claimed in claim 14, exist the first area that cannot see clearly when user's direct viewing to comprise in the scene that wherein said definite user watches:
Detect the view direction of eyes of user; And
When the view direction of eyes of user being detected and remain on first direction and surpass the schedule time, described processing unit is determined the described first area that cannot see clearly when user's direct viewing in the scene that exists user to watch on described first direction.
16. display packings as described in claims 14 or 15, wherein said the first image obtaining corresponding to described first area comprises:
While there is described first area in determining the scene that user watches, with the first image acquisition parameter, gather described the first image.
17. display packings as described in claims 14 or 15, wherein said the first image obtaining corresponding to described first area comprises:
While there is described first area in determining the scene that user watches, the second image with the second image acquisition parameter collection about described first area; And
Amplify in described the second image, comprise described first area part to obtain described the first image.
Whether 18. display packings as claimed in claim 14, exist the first area that cannot see clearly when user's direct viewing to comprise in the scene that wherein said definite user watches:
With the 3rd image acquisition parameter, gather the 3rd image, wherein said the 3rd image acquisition parameter sets in advance;
According to the criterion of identification setting in advance, identify described in described the 3rd image and whether to have described first area, and when there is described first area, the first area that acquisition is identified.
Whether 19. display packings as claimed in claim 14, exist the first area that cannot see clearly when user's direct viewing to comprise in the scene that wherein said definite user watches:
With the 4th image acquisition parameter, gather the 4th image, wherein set in advance described the 4th image acquisition parameter;
Show described the 4th image;
Reception is selected input from user's region; And
According to described region, select input to obtain described first area in described the 4th image.
Whether 20. display packings as claimed in claim 14, exist the first area that cannot see clearly when user's direct viewing to comprise in the scene that wherein said definite user watches:
Be captured in scheduled operation region the 5th image corresponding to operating body;
Identify the indicated direction of operating body in described the 5th image, and determine the described first area that cannot see clearly in the scene that exists user to watch in the indicated direction of the operating body identify when user's direct viewing.
21. display packings as claimed in claim 14, the first image of the described first area of wherein said demonstration comprises:
According to determined first area, obtain object in described first area with respect to user's position;
Display position according to the object in described first area with respect to the first image described in user's location positioning; And
On determined display position, show described the first image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210353335.2A CN103677704B (en) | 2012-09-20 | 2012-09-20 | Display device and display methods |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201210353335.2A CN103677704B (en) | 2012-09-20 | 2012-09-20 | Display device and display methods |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN103677704A true CN103677704A (en) | 2014-03-26 |
| CN103677704B CN103677704B (en) | 2018-11-09 |
Family
ID=50315391
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201210353335.2A Active CN103677704B (en) | 2012-09-20 | 2012-09-20 | Display device and display methods |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN103677704B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107223224A (en) * | 2016-12-19 | 2017-09-29 | 深圳前海达闼云端智能科技有限公司 | A kind of amblyopia householder method and device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002058883A (en) * | 2000-08-17 | 2002-02-26 | Omron Corp | Method and system for appreciation support |
| US20050046728A1 (en) * | 2000-10-31 | 2005-03-03 | Schinner Charles E. | Illuminated display and method of using same |
| CN101520690A (en) * | 2006-09-08 | 2009-09-02 | 索尼株式会社 | Image capturing and displaying apparatus and image capturing and displaying method |
| CN101566875A (en) * | 2008-04-24 | 2009-10-28 | 索尼株式会社 | Image processing apparatus, image processing method, program, and recording medium |
| CN102375235A (en) * | 2010-08-18 | 2012-03-14 | 索尼公司 | Display apparatus |
-
2012
- 2012-09-20 CN CN201210353335.2A patent/CN103677704B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002058883A (en) * | 2000-08-17 | 2002-02-26 | Omron Corp | Method and system for appreciation support |
| US20050046728A1 (en) * | 2000-10-31 | 2005-03-03 | Schinner Charles E. | Illuminated display and method of using same |
| CN101520690A (en) * | 2006-09-08 | 2009-09-02 | 索尼株式会社 | Image capturing and displaying apparatus and image capturing and displaying method |
| CN101566875A (en) * | 2008-04-24 | 2009-10-28 | 索尼株式会社 | Image processing apparatus, image processing method, program, and recording medium |
| CN102375235A (en) * | 2010-08-18 | 2012-03-14 | 索尼公司 | Display apparatus |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107223224A (en) * | 2016-12-19 | 2017-09-29 | 深圳前海达闼云端智能科技有限公司 | A kind of amblyopia householder method and device |
| WO2018112688A1 (en) * | 2016-12-19 | 2018-06-28 | 深圳前海达闼云端智能科技有限公司 | Method and device for amblyopia assistance |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103677704B (en) | 2018-11-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6387825B2 (en) | Display system and information display method | |
| JP4681629B2 (en) | Display device calibration method and apparatus | |
| US10757335B2 (en) | Mobile terminal | |
| EP2824541B1 (en) | Method and apparatus for connecting devices using eye tracking | |
| CN104115100A (en) | Head-mounted display, program for controlling head-mounted display, and method of controlling head-mounted display | |
| CN111630477A (en) | Apparatus for providing augmented reality service and method of operating the same | |
| JPWO2016038971A1 (en) | Imaging control apparatus, imaging control method, camera, camera system, and program | |
| US20150015542A1 (en) | Control Method And Electronic Device | |
| KR20150096948A (en) | The Apparatus and Method for Head Mounted Display Device displaying Augmented Reality image capture guide | |
| CN103873959A (en) | Control method and electronic device | |
| CN104932675A (en) | Display Device, Image Display System, And Information Processing Method | |
| CN103970258A (en) | Wearable electronic equipment and display method | |
| EP3617851B1 (en) | Information processing device, information processing method, and recording medium | |
| US20210063746A1 (en) | Information processing apparatus, information processing method, and program | |
| EP3086216B1 (en) | Mobile terminal and controlling method thereof | |
| JP6638392B2 (en) | Display device, display system, display device control method, and program | |
| US20240077722A1 (en) | Linked display system and head-mounted display | |
| CN104702848A (en) | Method and device for displaying framing information | |
| US20160189341A1 (en) | Systems and methods for magnifying the appearance of an image on a mobile device screen using eyewear | |
| CN104077784A (en) | Method for extracting target object and electronic device | |
| US20140015937A1 (en) | Electronic device | |
| CN104065952A (en) | Wearable electronic device and image processing method | |
| TWI603225B (en) | Viewing angle adjusting method and apparatus of liquid crystal display | |
| US20200073621A1 (en) | Systems, Devices, Components and Associated Computer Executable Code For Providing Remote Viewing of a Display Associated with a Computational Device | |
| CN103677704A (en) | Display device and display method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |