US20160165197A1 - Projection processor and associated method - Google Patents
Projection processor and associated method Download PDFInfo
- Publication number
- US20160165197A1 US20160165197A1 US14/905,290 US201514905290A US2016165197A1 US 20160165197 A1 US20160165197 A1 US 20160165197A1 US 201514905290 A US201514905290 A US 201514905290A US 2016165197 A1 US2016165197 A1 US 2016165197A1
- Authority
- US
- United States
- Prior art keywords
- image
- projection
- projected
- source
- processor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/349—Multi-view displays for displaying three or more geometrical viewpoints without viewer tracking
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/3173—Constructional details thereof wherein the projection device is specially adapted for enhanced portability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
- G03B21/14—Details
- G03B21/145—Housing details, e.g. position adjustments thereof
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B21/00—Projectors or projection-type viewers; Accessories therefor
- G03B21/14—Details
- G03B21/28—Reflectors in projection beam
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/106—Processing image signals
- H04N13/161—Encoding, multiplexing or demultiplexing different image signal components
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
- H04N13/194—Transmission of image signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
- H04N13/243—Image signal generators using stereoscopic image cameras using three or more 2D image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/282—Image signal generators for generating image signals corresponding to three or more geometrical viewpoints, e.g. multi-view systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/363—Image reproducers using image projection screens
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3141—Constructional details thereof
- H04N9/315—Modulator illumination systems
- H04N9/3155—Modulator illumination systems for controlling the light source
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
- H04N9/3185—Geometric adjustment, e.g. keystone or convergence
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3191—Testing thereof
- H04N9/3194—Testing thereof including sensor feedback
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/011—Head-up displays characterised by optical features comprising device for correcting geometrical aberrations, distortion
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0118—Head-up displays characterised by optical features comprising devices for improving the contrast of the display / brillance control visibility
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
Definitions
- the present invention relates to image processing, and more particularly, to a projection processor and associated method.
- 3D display technology has been receiving more attention because of its superior visual effects and vivid images.
- 3D glasses results in an uncomfortable experience, but holographic display is too expensive to be widely acceptable for most users.
- One of the objectives of the present invention is to provide a projection processor and associated method applied in the projection processor.
- an exemplary projection processor includes a receiving circuit and an image processing circuit.
- the receiving circuit is arranged to receive an input image.
- the image processing circuit is arranged to perform at least one predetermined image processing operation upon the input image to generate an output image, wherein a projection source is generated according to the output image.
- the projection source is displayed or projected by a projection source component of an electronic device, such that a first cover of a projection display component partially reflects the projection source.
- an exemplary projection method employed by a projection processor includes: receiving an input image; and performing at least one predetermined image processing operation upon the input image to generate an output image, wherein a projection source is generated according to the output image.
- the projection source is displayed or projected by a projection source component of an electronic device, such that a first cover of a projection display component partially reflects the projection source.
- FIG. 1 is a schematic illustrating a projection display component of an electronic device according to an embodiment of the present invention.
- FIG. 2 is a diagram illustrating the projection display component extended for projection according to an embodiment of the present invention.
- FIG. 3 is a diagram illustrating a projection processor of an electronic device carried by a projection display component according to an embodiment of the present invention.
- FIG. 4 is a diagram illustrating the image processing circuit of the projection processor according to an embodiment of the present invention.
- FIG. 5 is a diagram illustrating a working condition of an image flip engine according to an embodiment of the present invention.
- FIG. 6 is a flowchart illustrating an image flip operation performed by the image flip engine according to an embodiment of the present invention.
- FIG. 7 is a diagram illustrating a working condition of an image distortion correction circuit according to an embodiment of the present invention.
- FIG. 8 is a diagram illustrating a working condition of the image distortion correction circuit according to another embodiment of the present invention.
- FIG. 9 is a flowchart illustrating an image distortion correction operation performed by the image distortion correction circuit according to an embodiment of the present invention.
- FIG. 10 is a diagram illustrating a working condition of an image segmentation engine according to an embodiment of the present invention.
- FIG. 11 is a diagram illustrating a working condition of the image segmentation engine according to another embodiment of the present invention.
- FIG. 12 is a flowchart illustrating an image segmentation operation performed by the image segmentation engine according to an embodiment of the present invention.
- FIG. 13 is a flowchart illustrating an image enhancement operation performed by the image enhancement engine according to an embodiment of the present invention.
- FIG. 14 is a diagram illustrating a data processing system employing the projection processor according to an embodiment of the present invention.
- FIG. 15 is a diagram illustrating a photograph application for the projection processor installed in the data processing system according to the embodiment of FIG. 14 .
- FIG. 16 is a diagram illustrating a recording application for the projection processor installed in the data processing system according to the embodiment of FIG. 14 .
- FIG. 17 is a diagram illustrating a video playback application for the projection processor installed in the data processing system according to the embodiment of FIG. 14 .
- FIG. 18 is a diagram illustrating a gaming application for the projection processor installed in the data processing system according to the embodiment of FIG. 14 .
- FIG. 19 is a diagram illustrating a gallery application for the projection processor installed in the data processing system according to the embodiment of FIG. 14 .
- FIG. 1 is a schematic illustrating a projection display component 100 for an electronic device 101 according to an embodiment of the present invention.
- the sub-diagram (A) of FIG. 1 shows a perspective view of the electronic device 101 carried by the projection display component 100 .
- the sub-diagram (B) of FIG. 1 shows a sectional view along line X-X′ of the electronic device 101 and the projection display component 100 shown in sub-diagram (A).
- FIG. 2 is a diagram illustrating the projection display component 100 unfolded for projection according to an embodiment of the present invention.
- the electronic device 101 may be integrated with the projection display component 100 . However, it is not a limitation of the present invention.
- the electronic device 101 may be detachably placed onto a carrier of the projection display component 100 via physical connection, where the carrier is arranged to carry the electronic device.
- the carrier may be part of the electronic device 101 or an independent structure other than the electronic device 101 .
- the present invention has no limitation on the engagement or integration of the electronic device 101 and the projection display component 100 . Any electronic device using the proposed projection display component falls within the scope of the present invention.
- the projection display component 100 is arranged to place the electronic device 101 and is also a projection set when it is unfolded.
- the projection display component 100 may comprise at least one of a carrier CA, a first cover C 1 , a second cover C 2 , a base plate BP and an optical set OS.
- the first cover C 1 is arranged to partially reflect an image of a projection source PS generated from the electronic device 101 , such that a projected image PI may be shown through the first cover C 1 .
- some intensity of the projected image PI may be projected through the first cover C 1 , and some other intensity of the projected image PI may be reflected by the first cover C 1 , such that the first cover C 1 partially reflects the image of the projection source PS.
- a user may see the projected image displayed on the first cover C 1 or floating behind the first cover C 1 .
- a display panel of the electronic device 101 such as an LCD panel or any other passive or active display panel, may be taken as a projection source component PSC to display the image.
- a solid-state (laser or LED) light or any other type of light source may be taken as a projection source component PSC to project the image.
- the second cover C 2 is arranged to adjust an angle between the second cover C 2 and the electronic device 101 , such that a projection direction of the projected image PI from the projection source PS to the first cover C 1 may be adjusted.
- the base plate BP is arranged to adjust a distance between the first cover C 1 and the electronic device 101 , wherein the base plate BP is detachable, foldable or extendible.
- the optical set OS may be placed between the first cover C 1 and the electronic device 101 .
- the optical set OS is arranged to redirect a projected direction of the projected image, such that a user may see the projected image PI with adjusted size displayed on or behind the first cover C 1 .
- the projection display component 100 shown in FIG. 1 is only an example.
- first cover C 1 , the second cover C 2 , and the optical set OS may be respectively attached to the base plate BP via a first hinge set HS 1 (which may include one or more hinge mechanisms), a second hinge set HS 2 (which may include one or more hinge mechanisms), and a third hinge set HS 3 (which may include one or more hinge mechanisms). Therefore, a first angle between the base plate BP and the first cover C 1 , a second angle between the base plate BP and the second cover C 2 , or the angle between the second cover C 2 and the electronic device 101 may be adjustable.
- first hinge set HS 1 which may include one or more hinge mechanisms
- second hinge set HS 2 which may include one or more hinge mechanisms
- a third hinge set HS 3 which may include one or more hinge mechanisms
- first hinge set HS 1 , the second hinge set HS 2 or the third hinge set HS 3 may be implemented using magnetic hinge sets, so that the first cover C 1 , second cover C 2 or the optical set may be detachable.
- first hinge set HS 1 , the second hinge set HS 2 and the third hinge set HS 3 may include any other type of hinge mechanisms, which should not be limited in this disclosure.
- the optical set or the second cover C 2 may be removable.
- FIG. 3 is a diagram illustrating a projection processor 300 to provide an image to an electronic device 101 carried by a projection display component 100 according to an embodiment of the present invention.
- the projection processor 300 may have a receiving circuit 301 and an image processing circuit 302 . It should be noted that only the components pertinent to the present invention are shown in FIG. 3 . In practice, the projection processor 300 may include additional element(s) to achieve other function(s).
- the receiving circuit 301 is arranged to receive an input image II and transmits the input image II to the image processing circuit 302 .
- the input image II may be a single-view image (e.g., a two-dimensional image) or a multi-view image (e.g., an image pair of a left-view image and a right-view image, or multiple images captured or generated for different viewing angles of the same scene/object).
- the image processing circuit 304 is arranged to perform at least one predetermined image processing operation on the input image II to generate an output image OI, wherein the projection source PS shown in FIG. 2 is generated according to the output image OI.
- the projection processor 300 may be a processor installed within the electronic device 101 and may transmit the output image OI via an internal bus of the electronic device 101 ; however, in other embodiments, the projection processor 300 may be installed within another device external to the electronic device 101 and may transmit the output image OI to the electronic device 101 via wired/wireless transmission. Furthermore, the projection processor 300 can be applied to a 2D image projection application or 3D image projection application, which is not limited in the present invention. These alternative designs should fall within the scope of the present invention.
- FIG. 4 is a diagram illustrating the image processing circuit 302 of the projection processor 300 according to an embodiment of the present invention.
- the image processing circuit 302 may comprise at least one of an image flip engine 401 , an image distortion correction engine 402 , an image segmentation engine 403 , an image enhancement engine 404 and a notification circuit 405 .
- this embodiment is for illustrative purposes only. In practice, the input image II is not required to be processed in the exact order shown in FIG. 4 .
- the arrangement of the image flip engine 401 , the image distortion correction engine 402 , the image segmentation engine 403 and the image enhancement engine 404 may be adjusted, depending upon the actual design considerations. Further, at least one of the image flip engine 401 , the image distortion correction engine 402 , the image segmentation engine 403 , the image enhancement engine 404 and a notification circuit 405 may be omitted, depending upon the actual design considerations.
- the image flip engine 401 is arranged to perform an image flip operation. In some embodiments, the image flip engine 401 performs an image flip operation to ensure that an orientation of the projected image PI matches an orientation of the input image II. In some other embodiments, the image flip engine 401 performs an image flip operation to ensure that a user can see the projected image PI shown on or behind the first cover C 1 with a correct orientation.
- the image distortion correction engine 402 is arranged to perform the image distortion correction operation to correct an appearance of the projection source PS.
- the image segmentation engine 403 is arranged to perform an image segmentation operation and change a background of a segmented image to generate the projection source PS.
- the image enhancement engine 404 is arranged to perform an image enhancement operation to adjust a brightness of the projection source PS, a brightness of the background or a contrast of the whole image.
- the notification circuit 405 is arranged to control the electronic device 101 to show a projection notice PN according to the status of at least one of the image flip engine 401 , the image distortion correction engine 402 , the image segmentation engine 403 , the image enhancement engine 404 , and the projection display component 100 , as the status of the projected image PI or any other factors may result in a poor user experience.
- FIG. 5 is a diagram illustrating an embodiment of the optical set OS of the present invention.
- two convex lenses L 1 and L 2 are included to form the optical set OS for projection.
- the image flip engine 401 may flip the projection source PS (e.g. upside down or reversing left to right) to ensure that the orientation of the projected image PI matches the orientation of the input image II.
- the reverse projected image can be detected by a sensor installed on the second hinge set HS 2 for detecting distances of the lenses.
- the sensor can be installed on any other place of the projection display component 100 for achieving the same goal.
- the image flip engine 401 flips the projection source PS. More specifically, as shown in FIG. 5 , the projection source PS is reflected by the lens L 1 and forms a reflected image RI on the other side of the lens L 1 , wherein the reflected image RI is reversed with respect to the projection source PS due to the projection source PS is disposed between the focal point f and the twofold focal point 2 f of the lens L 1 .
- the reflected image RI is reflected by the lens L 2 and forms the projected image PI, wherein the projected image PI is reversed with respect to the projection source PS as well due to the reflected image RI is disposed in the focal point of the lens L 2 .
- the detection can be done by other means, such as a sensor installed in the base plate BP to detect the distances of the lenses, or a front camera of the electronic device 101 to capture the projected image PI for analysis.
- the image flip engine 401 may flip the projection source PS.
- the detection may be done by a sensor installed in the first hinge set HS 1 .
- the sensor can be installed on any other place of the projection display component for achieving the same goal.
- FIG. 6 is a flowchart illustrating an image flip operation performed by the image flip engine 401 according to an embodiment of the present invention. The flow shown in FIG. 6 is described as follows.
- the notification circuit 405 may control the electronic device 101 (particularly, a projection source component PSC of the electronic device 101 ) to show the projection notice PN for notifying the user.
- the steps shown in FIG. 6 are not required to be executed in the exact order shown.
- the projection notice PN may be displayed or projected by the projection source component PSC of the electronic device 101 after any step in FIG. 6 when a malfunction of the projection display component 100 or the image processing circuit 302 occurs, or any other factor causes a fail projection.
- FIG. 7 is a diagram illustrating a scenario about a working condition of the image distortion correction circuit according to an embodiment of the present invention.
- a small-sized lens L 1 is used for projection. Therefore, only a portion of the projection source PS is projected via the small-sized lens L 1 , which causes a distortion of the projected image PI shown on or behind the first cover C 1 as shown in the sub-diagram (B) of FIG. 7 .
- the image distortion correction circuit 402 may correct the appearance of the projection source PS, such that a user may see an un-distorted projected image PI, which looks like the original appearance of the projection source PS, shown on or behind the first cover C 1 after distortion correction.
- the image distortion correction circuit 402 may correct at least one of the distorted parts of the projection source PS (for example, enlarge the upper part of the projection source PS to a size matching the lower part of the distorted projected image PI), such that after correction, the projected image PI may look like the original appearance of the projection source PS.
- FIG. 8 is a diagram illustrating another embodiment of the optical set OS of the present invention.
- the lens L 3 included in the optical set OS is set to a position not parallel with the electronic device 101 , which causes the size of the projected image PI to be smaller than the desired size.
- the image distortion correction circuit 402 may enlarge the size of the projection source PS to ensure a projected image PI is perceived by the user with a suitable size.
- any other type of correction may be performed corresponding to different image distortion, which should not be limited in this disclosure.
- FIG. 9 is a flowchart illustrating an image distortion correction operation performed by the image distortion correction circuit 402 according to an embodiment of the present invention. The flow in FIG. 9 is described as follows.
- step 904 if an incorrect setting that causes a fail projection (for example, the lens included in the optical set OS is set to a position that tilts too much, which makes the projection source PS not able to be projected on the first cover C 1 via the lens), or an incorrect setting which means the user cannot observe the projected image PI correctly is detected, the notification circuit 405 may further control the electronic device 101 (e.g. a projection source component PSC or a speaker of the electronic device 101 ) to display, project or generate the projection notice PN for notifying the user.
- the steps shown in FIG. 9 are not required to be executed in the exact order shown.
- FIG. 10 is a diagram illustrating a scenario related to a working condition of the image segmentation engine 403 according to an embodiment of the present invention.
- the image segmentation engine 403 separates the projection source PS from the background.
- any other method may be utilized to check if the background of the projection source PS is too complicated, which should not be limited in this disclosure.
- the image segmentation engine 403 fills the background with a plain color, wherein a contrast value between the plain color of the background and a color of the projection source PS may be controlled to be higher than a threshold value TH 2 .
- FIG. 11 is a diagram illustrating a scenario related to a working condition of the image segmentation engine 403 according to another embodiment of the present invention.
- the complexity of the background is not higher than the threshold value TH 1 , so the image segmentation engine 403 may not separate the projection source PS from the background.
- the image segmentation engine 403 may further fill the background with a plain color such that the contrast value between the color of the projection source PS and the plain color of the background is controlled to be higher than the threshold value TH 2 . In this way, the background is suitable for user observation.
- FIG. 12 is a flowchart illustrating an image segmentation operation performed by the image segmentation engine 403 according to an embodiment of the present invention. The flow in FIG. 12 is described as follows.
- step 1206 The image segmentation engine 403 checks if the complexity of the background is higher than the threshold value TH 1 , and checks if the contrast value between the color of the background and the color of the projection source PS is sufficient to determine whether to perform the image segmentation operation.
- step 1210 when the image segmentation engine 403 detects a segmentation failure (for example, after the segmentation, the complexity of the background is still higher than the threshold value TH 1 which means the user may not observe the projected image PI clearly), the notification circuit 405 controls the electronic device 101 (particularly, a projection source component PSC of the electronic device 101 ) to display or project the projection notice PN for notifying the user. Provided that the result is substantially the same, the steps shown in FIG.
- the projection notice PN may be displayed or projected by the projection source component PSC of the electronic device 101 after any step in FIG. 12 when a malfunction of the projection display component 100 occurs or any other factor causes a fail projection.
- FIG. 13 is a flowchart illustrating an image enhancement operation performed by the image enhancement engine 404 according to an embodiment of the present invention. The flow in FIG. 13 is described as follows.
- the image enhancement engine 404 may adjust the brightness of the projection source PS and/or the brightness of the background.
- the notification circuit 405 controls the electronic device 101 (particularly, a projection source component PSC of the electronic device 101 ) to display or project the projection notice PN for notifying the user.
- the ambient light can be detected by a red/green/blue (RGB) light sensor installed in the electronic device 101 .
- RGB red/green/blue
- the steps shown in FIG. 13 are not required to be executed in the exact order shown.
- the projection notice PN may be displayed or projected by the projection source component PSC of the electronic device 101 after any step in FIG. 13 when a malfunction of the projection display component 100 occurs or any other factor causes a fail projection.
- the projection source PS can be divided into four segments on the projection source component PSC of the electronic device 101 , so the projected image PI can be seen from four different viewpoints, wherein these four segments is processed by the projection processor 300 in parallel.
- the number of segments is only for illustrative purpose, not a limitation of the present invention.
- the view number is derived from H.264's Supplemental Enhancement Information (SEI) transmitted from a transmitter.
- SEI Supplemental Enhancement Information
- FIG. 14 is a diagram illustrating a data processing system 1400 employing the projection processor 300 according to an embodiment of the present invention.
- the data processing system 1400 may be part of an electronic device such as a mobile phone.
- the data processing system 1400 may comprise at least one of a sensor 1401 (e.g.
- the projection processor 300 receives the input image II from the display processor 1411 for a plurality of applications, and generates the output image OI to the driver IC 1412 .
- the driver IC 1412 drives the projection source component 1413 such that the projection source PS is displayed or projected by the projection source component 1413 according to the output image OI.
- the other exemplary embodiments of the plurality of applications of the projection processor 300 installed in the data processing system 1400 will be discussed later.
- FIG. 15 is a diagram illustrating an embodiment related to a photograph application for the projection processor 300 installed in the data processing system 1400 according to the embodiment of FIG. 14 .
- the sensor 1401 may transmit the captured image into the ISP 1402 for processing, and the ISP 1402 may transmit the processed image to the image encoder 1403 so it can be stored in an external storage device, and may also transmit it to the display processor 1411 .
- the display processor 1411 may perform additional image processing (e.g. scaling, rotation) upon the processed image generated from the ISP 1402 to generate the input image II to the projection processor 300 where it can undergo the predetermined processing operation described above for projection.
- the projection processor generates the output image OI.
- the projection source PS is displayed or projected by the projection source component 1413 according to the output image OI.
- FIG. 16 is a diagram illustrating an embodiment for a recording application for the projection processor 300 installed in the data processing system 1400 according to the embodiment of FIG. 14 .
- the sensor 1401 may transmit a video sequence composed of a plurality of successive captured images to the ISP 1402 for processing.
- the ISP 1402 may then transmit the processed video sequence to the video encoder 1405 where it can be stored in an external storage device, and may also transmit it to the display processor 1411 .
- the display processor 1411 may perform additional image processing (e.g.
- the projection processor 300 generates the output image OI.
- the projection source PS is displayed or projected by the projection source component 1413 according to the output image OI.
- FIG. 17 is a diagram illustrating an embodiment related to a video playback application for the projection processor 300 installed in the data processing system 1400 according to the embodiment of FIG. 14 .
- the video decoder 1406 may transmit a video sequence composed of successive decoded images to the display processor 1411 by decoding a video sequence composed of successive encoded images read from an external storage device.
- the display processor 1411 may perform additional image processing (e.g. scaling, rotation) upon each image included in the decoded video sequence to generate the input image II to the projection processor 300 so it can undergo the predetermined processing operation described above for projection.
- the projection processor 300 generates the output image OI.
- the projection source PS is displayed or projected by the projection source component 1413 according to the output image OI.
- FIG. 18 is a diagram illustrating an embodiment related to a gaming application for the projection processor 300 installed in the data processing system 1400 according to the embodiment of FIG. 14 .
- the graphic engine 1407 may generate a graphic image of a game to the display processor 1411 .
- the display processor 1411 may perform additional image processing (e.g. scaling, rotation) upon the graphic image to generate the input image II to the projection processor 300 so it can undergo the predetermined processing operation described above for projection.
- the projection processor 300 generates the output image OI.
- the projection source PS is displayed on the projection source component 1413 according to the output image OI.
- FIG. 19 is a diagram illustrating an embodiment related to a gallery application for the projection processor 300 installed in the data processing system 1400 according to the embodiment of FIG. 14 .
- the image decoder 1404 may generate a decoded image to the display processor 1411 by decoding an encoded image read from an external storage device.
- the display processor 1411 may perform additional image processing (e.g. scaling, rotation) upon the decoded image to generate the input image II to the projection processor 300 so it can undergo the predetermined processing operation described above for projection.
- the projection processor generates the output image OI.
- the projection source PS is displayed or projected by the projection source component 1413 according to the output image OI.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Geometry (AREA)
- Optics & Photonics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Projection Apparatus (AREA)
- Controls And Circuits For Display Device (AREA)
- Transforming Electric Information Into Light Information (AREA)
- Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)
Abstract
A projection processor includes a receiving circuit and an image processing circuit. The receiving circuit receives an input image. The image processing circuit performs at least one predetermined image processing operation upon the input image to generate an output image, wherein a projection source is generated according to the output image. The projection source is displayed or projected by a projection source component of an electronic device, such that a first cover of a projection display component partially reflects the projection source.
Description
- This application claims the benefit of U.S. Provisional Application No. 62/003,260, filed on May 27, 2014, and U.S. Provisional Application No. 62/034,952, filed on Aug. 8, 2014. The entire contents of the related applications are incorporated herein by reference.
- The present invention relates to image processing, and more particularly, to a projection processor and associated method.
- Devices which can provide customers with high-quality visual effects are desirable because of the recent progress in multimedia entertainment systems. In particular, 3D display technology has been receiving more attention because of its superior visual effects and vivid images. For customers, using 3D glasses results in an uncomfortable experience, but holographic display is too expensive to be widely acceptable for most users.
- One of the objectives of the present invention is to provide a projection processor and associated method applied in the projection processor.
- According to an embodiment of the present invention, an exemplary projection processor is disclosed. The exemplary projection processor includes a receiving circuit and an image processing circuit. The receiving circuit is arranged to receive an input image. The image processing circuit is arranged to perform at least one predetermined image processing operation upon the input image to generate an output image, wherein a projection source is generated according to the output image. The projection source is displayed or projected by a projection source component of an electronic device, such that a first cover of a projection display component partially reflects the projection source.
- According to an embodiment of the present invention, an exemplary projection method employed by a projection processor is disclosed. The exemplary projection method includes: receiving an input image; and performing at least one predetermined image processing operation upon the input image to generate an output image, wherein a projection source is generated according to the output image. The projection source is displayed or projected by a projection source component of an electronic device, such that a first cover of a projection display component partially reflects the projection source.
- These and other objectives of the present invention will no doubt become obvious to those of ordinary skill in the art after reading the following detailed description of the preferred embodiment that is illustrated in the various figures and drawings.
-
FIG. 1 is a schematic illustrating a projection display component of an electronic device according to an embodiment of the present invention. -
FIG. 2 is a diagram illustrating the projection display component extended for projection according to an embodiment of the present invention. -
FIG. 3 is a diagram illustrating a projection processor of an electronic device carried by a projection display component according to an embodiment of the present invention. -
FIG. 4 is a diagram illustrating the image processing circuit of the projection processor according to an embodiment of the present invention. -
FIG. 5 is a diagram illustrating a working condition of an image flip engine according to an embodiment of the present invention. -
FIG. 6 is a flowchart illustrating an image flip operation performed by the image flip engine according to an embodiment of the present invention. -
FIG. 7 is a diagram illustrating a working condition of an image distortion correction circuit according to an embodiment of the present invention. -
FIG. 8 is a diagram illustrating a working condition of the image distortion correction circuit according to another embodiment of the present invention. -
FIG. 9 is a flowchart illustrating an image distortion correction operation performed by the image distortion correction circuit according to an embodiment of the present invention. -
FIG. 10 is a diagram illustrating a working condition of an image segmentation engine according to an embodiment of the present invention. -
FIG. 11 is a diagram illustrating a working condition of the image segmentation engine according to another embodiment of the present invention. -
FIG. 12 is a flowchart illustrating an image segmentation operation performed by the image segmentation engine according to an embodiment of the present invention. -
FIG. 13 is a flowchart illustrating an image enhancement operation performed by the image enhancement engine according to an embodiment of the present invention. -
FIG. 14 is a diagram illustrating a data processing system employing the projection processor according to an embodiment of the present invention. -
FIG. 15 is a diagram illustrating a photograph application for the projection processor installed in the data processing system according to the embodiment ofFIG. 14 . -
FIG. 16 is a diagram illustrating a recording application for the projection processor installed in the data processing system according to the embodiment ofFIG. 14 . -
FIG. 17 is a diagram illustrating a video playback application for the projection processor installed in the data processing system according to the embodiment ofFIG. 14 . -
FIG. 18 is a diagram illustrating a gaming application for the projection processor installed in the data processing system according to the embodiment ofFIG. 14 . -
FIG. 19 is a diagram illustrating a gallery application for the projection processor installed in the data processing system according to the embodiment ofFIG. 14 . - Certain terms are used throughout the following description and claims, which refer to particular components. As one skilled in the art will appreciate, electronic equipment manufacturers may refer to a component by different names. This document does not intend to distinguish between components that differ in name but not in function. In the following description and in the claims, the terms “include” and “comprise” are used in an open-ended fashion, and thus should be interpreted to mean “include, but not limited to . . . ”. Also, the term “couple” is intended to mean either an indirect or direct electrical connection. Accordingly, if one device is coupled to another device, that connection may be through a direct electrical connection, or through an indirect electrical connection via other devices and connections.
- Refer to
FIG. 1 andFIG. 2 .FIG. 1 is a schematic illustrating aprojection display component 100 for anelectronic device 101 according to an embodiment of the present invention. The sub-diagram (A) ofFIG. 1 shows a perspective view of theelectronic device 101 carried by theprojection display component 100. The sub-diagram (B) ofFIG. 1 shows a sectional view along line X-X′ of theelectronic device 101 and theprojection display component 100 shown in sub-diagram (A).FIG. 2 is a diagram illustrating theprojection display component 100 unfolded for projection according to an embodiment of the present invention. It should be noted that theelectronic device 101 may be integrated with theprojection display component 100. However, it is not a limitation of the present invention. In other embodiments, theelectronic device 101 may be detachably placed onto a carrier of theprojection display component 100 via physical connection, where the carrier is arranged to carry the electronic device. The carrier may be part of theelectronic device 101 or an independent structure other than theelectronic device 101. To put it simply, the present invention has no limitation on the engagement or integration of theelectronic device 101 and theprojection display component 100. Any electronic device using the proposed projection display component falls within the scope of the present invention. - As shown in
FIG. 1 andFIG. 2 , theprojection display component 100 is arranged to place theelectronic device 101 and is also a projection set when it is unfolded. Theprojection display component 100 may comprise at least one of a carrier CA, a first cover C1, a second cover C2, a base plate BP and an optical set OS. When theprojection display component 100 is unfolded for projection, as shown inFIG. 2 , the first cover C1 is arranged to partially reflect an image of a projection source PS generated from theelectronic device 101, such that a projected image PI may be shown through the first cover C1. In detail, some intensity of the projected image PI may be projected through the first cover C1, and some other intensity of the projected image PI may be reflected by the first cover C1, such that the first cover C1 partially reflects the image of the projection source PS. As a result, a user may see the projected image displayed on the first cover C1 or floating behind the first cover C1. In some embodiments, a display panel of theelectronic device 101, such as an LCD panel or any other passive or active display panel, may be taken as a projection source component PSC to display the image. In some other embodiments, a solid-state (laser or LED) light or any other type of light source may be taken as a projection source component PSC to project the image. Accordingly, a user may see the projected image PI displayed on or behind the first cover C1. The second cover C2 is arranged to adjust an angle between the second cover C2 and theelectronic device 101, such that a projection direction of the projected image PI from the projection source PS to the first cover C1 may be adjusted. The base plate BP is arranged to adjust a distance between the first cover C1 and theelectronic device 101, wherein the base plate BP is detachable, foldable or extendible. The optical set OS may be placed between the first cover C1 and theelectronic device 101. For example, the optical set OS is arranged to redirect a projected direction of the projected image, such that a user may see the projected image PI with adjusted size displayed on or behind the first cover C1. It should be noted that theprojection display component 100 shown inFIG. 1 is only an example. - In the embodiment of
FIG. 2 , the first cover C1, the second cover C2, and the optical set OS may be respectively attached to the base plate BP via a first hinge set HS1 (which may include one or more hinge mechanisms), a second hinge set HS2 (which may include one or more hinge mechanisms), and a third hinge set HS3 (which may include one or more hinge mechanisms). Therefore, a first angle between the base plate BP and the first cover C1, a second angle between the base plate BP and the second cover C2, or the angle between the second cover C2 and theelectronic device 101 may be adjustable. In some embodiments, but not limitation, the first hinge set HS1, the second hinge set HS2 or the third hinge set HS3 may be implemented using magnetic hinge sets, so that the first cover C1, second cover C2 or the optical set may be detachable. In some other embodiments, the first hinge set HS1, the second hinge set HS2 and the third hinge set HS3 may include any other type of hinge mechanisms, which should not be limited in this disclosure. The optical set or the second cover C2 may be removable. -
FIG. 3 is a diagram illustrating aprojection processor 300 to provide an image to anelectronic device 101 carried by aprojection display component 100 according to an embodiment of the present invention. Theprojection processor 300 may have a receivingcircuit 301 and animage processing circuit 302. It should be noted that only the components pertinent to the present invention are shown inFIG. 3 . In practice, theprojection processor 300 may include additional element(s) to achieve other function(s). The receivingcircuit 301 is arranged to receive an input image II and transmits the input image II to theimage processing circuit 302. For example, the input image II may be a single-view image (e.g., a two-dimensional image) or a multi-view image (e.g., an image pair of a left-view image and a right-view image, or multiple images captured or generated for different viewing angles of the same scene/object). The image processing circuit 304 is arranged to perform at least one predetermined image processing operation on the input image II to generate an output image OI, wherein the projection source PS shown inFIG. 2 is generated according to the output image OI. - It should be noted that the
projection processor 300 may be a processor installed within theelectronic device 101 and may transmit the output image OI via an internal bus of theelectronic device 101; however, in other embodiments, theprojection processor 300 may be installed within another device external to theelectronic device 101 and may transmit the output image OI to theelectronic device 101 via wired/wireless transmission. Furthermore, theprojection processor 300 can be applied to a 2D image projection application or 3D image projection application, which is not limited in the present invention. These alternative designs should fall within the scope of the present invention. -
FIG. 4 is a diagram illustrating theimage processing circuit 302 of theprojection processor 300 according to an embodiment of the present invention. As shown inFIG. 4 , theimage processing circuit 302 may comprise at least one of animage flip engine 401, an imagedistortion correction engine 402, animage segmentation engine 403, animage enhancement engine 404 and anotification circuit 405. It should be noted that this embodiment is for illustrative purposes only. In practice, the input image II is not required to be processed in the exact order shown inFIG. 4 . The arrangement of theimage flip engine 401, the imagedistortion correction engine 402, theimage segmentation engine 403 and theimage enhancement engine 404 may be adjusted, depending upon the actual design considerations. Further, at least one of theimage flip engine 401, the imagedistortion correction engine 402, theimage segmentation engine 403, theimage enhancement engine 404 and anotification circuit 405 may be omitted, depending upon the actual design considerations. - The
image flip engine 401 is arranged to perform an image flip operation. In some embodiments, theimage flip engine 401 performs an image flip operation to ensure that an orientation of the projected image PI matches an orientation of the input image II. In some other embodiments, theimage flip engine 401 performs an image flip operation to ensure that a user can see the projected image PI shown on or behind the first cover C1 with a correct orientation. The imagedistortion correction engine 402 is arranged to perform the image distortion correction operation to correct an appearance of the projection source PS. Theimage segmentation engine 403 is arranged to perform an image segmentation operation and change a background of a segmented image to generate the projection source PS. Theimage enhancement engine 404 is arranged to perform an image enhancement operation to adjust a brightness of the projection source PS, a brightness of the background or a contrast of the whole image. Thenotification circuit 405 is arranged to control theelectronic device 101 to show a projection notice PN according to the status of at least one of theimage flip engine 401, the imagedistortion correction engine 402, theimage segmentation engine 403, theimage enhancement engine 404, and theprojection display component 100, as the status of the projected image PI or any other factors may result in a poor user experience. -
FIG. 5 is a diagram illustrating an embodiment of the optical set OS of the present invention. As shown inFIG. 5 , two convex lenses L1 and L2 are included to form the optical set OS for projection. According to optical principles of image forming using convex lenses, a user may see that the orientation of the projected image PI is reversed with respect to the orientation of the projection source PS after projecting through the optical set OS. In this case, theimage flip engine 401 may flip the projection source PS (e.g. upside down or reversing left to right) to ensure that the orientation of the projected image PI matches the orientation of the input image II. For example, the reverse projected image can be detected by a sensor installed on the second hinge set HS2 for detecting distances of the lenses. However, it is only for illustrative purpose. In other embodiments, the sensor can be installed on any other place of theprojection display component 100 for achieving the same goal. Once the distances fit the condition of reverse image formation, theimage flip engine 401 flips the projection source PS. More specifically, as shown inFIG. 5 , the projection source PS is reflected by the lens L1 and forms a reflected image RI on the other side of the lens L1, wherein the reflected image RI is reversed with respect to the projection source PS due to the projection source PS is disposed between the focal point f and the twofoldfocal point 2 f of the lens L1. Then, the reflected image RI is reflected by the lens L2 and forms the projected image PI, wherein the projected image PI is reversed with respect to the projection source PS as well due to the reflected image RI is disposed in the focal point of the lens L2. In other embodiments, the detection can be done by other means, such as a sensor installed in the base plate BP to detect the distances of the lenses, or a front camera of theelectronic device 101 to capture the projected image PI for analysis. These alternative designs fall within the scope of the present invention. In another embodiment, when a user sets the first cover C1 on the wrong side of theelectronic device 101 causing that a user may see the projected image PI shown on or behind the first cover C1 with a wrong orientation, theimage flip engine 401 may flip the projection source PS. Similarly, the detection may be done by a sensor installed in the first hinge set HS1. However, it is only for illustrative purpose. In other embodiments, the sensor can be installed on any other place of the projection display component for achieving the same goal. -
FIG. 6 is a flowchart illustrating an image flip operation performed by theimage flip engine 401 according to an embodiment of the present invention. The flow shown inFIG. 6 is described as follows. -
- Step 600: Start.
- Step 602: The user may enable the projection display mode.
- Step 604: The
image flip engine 401 may check if theprojection display component 100 is set correctly. If yes, the flow goes to step 606; otherwise, it goes to step 610. - Step 606: The
image flip engine 401 may check if the orientation of the projected image PI is identical with the input image PI. If yes, the flow goes to step 612; otherwise, it goes to step 608. - Step 608: The
image flip engine 401 performs the image flip operation. - Step 610: The
notification circuit 405 controls theelectronic device 101 to show the projection notice PN. - Step 612: End.
- In
step 604, if there is an incorrect setting which may cause a fail projection (for example, the optical set OS or the first cover C1 is not attached to the base plate BP), an incorrect setting which may cause the size of the projected image PI too small or too large, or an incorrect setting which may cause that the user can not observe the projected image PI correctly, thenotification circuit 405 may control the electronic device 101 (particularly, a projection source component PSC of the electronic device 101) to show the projection notice PN for notifying the user. Provided that the end result is substantially the same, the steps shown inFIG. 6 are not required to be executed in the exact order shown. For example, the projection notice PN may be displayed or projected by the projection source component PSC of theelectronic device 101 after any step inFIG. 6 when a malfunction of theprojection display component 100 or theimage processing circuit 302 occurs, or any other factor causes a fail projection. -
FIG. 7 is a diagram illustrating a scenario about a working condition of the image distortion correction circuit according to an embodiment of the present invention. As shown in the sub-diagram (A) ofFIG. 7 , a small-sized lens L1 is used for projection. Therefore, only a portion of the projection source PS is projected via the small-sized lens L1, which causes a distortion of the projected image PI shown on or behind the first cover C1 as shown in the sub-diagram (B) ofFIG. 7 . In this case, the imagedistortion correction circuit 402 may correct the appearance of the projection source PS, such that a user may see an un-distorted projected image PI, which looks like the original appearance of the projection source PS, shown on or behind the first cover C1 after distortion correction. In detail, the imagedistortion correction circuit 402 may correct at least one of the distorted parts of the projection source PS (for example, enlarge the upper part of the projection source PS to a size matching the lower part of the distorted projected image PI), such that after correction, the projected image PI may look like the original appearance of the projection source PS. -
FIG. 8 is a diagram illustrating another embodiment of the optical set OS of the present invention. As shown inFIG. 8 , the lens L3 included in the optical set OS is set to a position not parallel with theelectronic device 101, which causes the size of the projected image PI to be smaller than the desired size. In this case, the imagedistortion correction circuit 402 may enlarge the size of the projection source PS to ensure a projected image PI is perceived by the user with a suitable size. In other embodiments, any other type of correction may be performed corresponding to different image distortion, which should not be limited in this disclosure. In the embodiments ofFIG. 7 andFIG. 8 , an incorrect setting of the optical set OS causing a distortion of the projected image PI can be detected by a sensor installed in the second hinge set HS2. However, it is only for illustrative purpose. In other embodiments, the sensor can be installed on any other place of the projection display component for achieving the same goal. Alternatively, the detection can be performed by other means: for example, a front camera of theelectronic device 101 captures the projected image PI. These alternative designs also fall within the scope of the present invention. -
FIG. 9 is a flowchart illustrating an image distortion correction operation performed by the imagedistortion correction circuit 402 according to an embodiment of the present invention. The flow inFIG. 9 is described as follows. -
- Step 900: Start.
- Step 902: The user may enable the projection display mode.
- Step 904: The image
distortion correction engine 402 may check if theprojection display component 100 is set correctly. If yes, the flow goes to step 906; otherwise, the flow goes to step 910. - Step 906: The image
distortion correction engine 402 may check if the optical lens covers all the projection sources or if the optical lens is set to a position parallel with the device. If yes, the flow goes to step 912; otherwise, the flow goes to step 908. - Step 908: The image
distortion correction engine 402 performs the image distortion correction operation. - Step 910: The
notification circuit 405 controls theelectronic device 101 to show the projection notice PN. - Step 912: End.
- In
step 904, if an incorrect setting that causes a fail projection (for example, the lens included in the optical set OS is set to a position that tilts too much, which makes the projection source PS not able to be projected on the first cover C1 via the lens), or an incorrect setting which means the user cannot observe the projected image PI correctly is detected, thenotification circuit 405 may further control the electronic device 101 (e.g. a projection source component PSC or a speaker of the electronic device 101) to display, project or generate the projection notice PN for notifying the user. Provided that the result is substantially the same, the steps shown inFIG. 9 are not required to be executed in the exact order shown. -
FIG. 10 is a diagram illustrating a scenario related to a working condition of theimage segmentation engine 403 according to an embodiment of the present invention. As shown inFIG. 10 , when a complexity of a background of the projection source PS is higher than a threshold value TH1 to check if the background of the projection source PS is too complicated, theimage segmentation engine 403 separates the projection source PS from the background. In some other embodiments, any other method may be utilized to check if the background of the projection source PS is too complicated, which should not be limited in this disclosure. Then theimage segmentation engine 403 fills the background with a plain color, wherein a contrast value between the plain color of the background and a color of the projection source PS may be controlled to be higher than a threshold value TH2. In this way, the background is suitable for user observation.FIG. 11 is a diagram illustrating a scenario related to a working condition of theimage segmentation engine 403 according to another embodiment of the present invention. As shown inFIG. 11 , the complexity of the background is not higher than the threshold value TH1, so theimage segmentation engine 403 may not separate the projection source PS from the background. Theimage segmentation engine 403 may further fill the background with a plain color such that the contrast value between the color of the projection source PS and the plain color of the background is controlled to be higher than the threshold value TH2. In this way, the background is suitable for user observation. -
FIG. 12 is a flowchart illustrating an image segmentation operation performed by theimage segmentation engine 403 according to an embodiment of the present invention. The flow inFIG. 12 is described as follows. -
- Step 1200: Start.
- Step 1202: The user may enable the projection display mode.
- Step 1204: The
image segmentation engine 403 analyzes the content of the projection source PS according to side information generated from a camera, depth sensor or algorithm, etc. - Step 1206: The
image segmentation engine 403 checks if the background is suitable for user observing. If yes, the flow goes to step 1214; otherwise, the flow goes to step 1208. - Step 1208: The
image segmentation engine 403 performs an image segmentation operation. - Step 1210: The
image segmentation engine 403 checks if the image segmentation operation succeeds. If yes, the flow goes to step 1214; otherwise, the flow goes to step 1212. - Step 1212: The
notification circuit 405 controls theelectronic device 101 to show the projection notice PN. - Step 1214: End.
- In
step 1206, Theimage segmentation engine 403 checks if the complexity of the background is higher than the threshold value TH1, and checks if the contrast value between the color of the background and the color of the projection source PS is sufficient to determine whether to perform the image segmentation operation. Instep 1210, when theimage segmentation engine 403 detects a segmentation failure (for example, after the segmentation, the complexity of the background is still higher than the threshold value TH1 which means the user may not observe the projected image PI clearly), thenotification circuit 405 controls the electronic device 101 (particularly, a projection source component PSC of the electronic device 101) to display or project the projection notice PN for notifying the user. Provided that the result is substantially the same, the steps shown inFIG. 12 are not required to be executed in the exact order shown. For example, the projection notice PN may be displayed or projected by the projection source component PSC of theelectronic device 101 after any step inFIG. 12 when a malfunction of theprojection display component 100 occurs or any other factor causes a fail projection. -
FIG. 13 is a flowchart illustrating an image enhancement operation performed by theimage enhancement engine 404 according to an embodiment of the present invention. The flow inFIG. 13 is described as follows. -
- Step 1300: Start.
- Step 1302: The
image enhancement engine 404 checks if the brightness of the projection source PS is lower than a threshold value TH3. If yes, the flow goes to step 1304; otherwise, the flow goes to step 1306. - Step 1304: The
image enhancement engine 404 increases the brightness of the projection source PS. - Step 1306: The
image enhancement engine 404 checks if a difference between the brightness of the background and the brightness of the projection source PS is lower than a threshold value TH4. If yes, the flow goes to step 1308; otherwise, the flow goes to step 1310. - Step 1308: The
image enhancement engine 404 increases the contrast by, for example, decreasing the brightness of the background. - Step 1310: The
image enhancement engine 404 checks if a similarity between an ambient light and the color of projection source PS is higher than a threshold value TH5. If yes, the flow goes to step 1312; otherwise, the flow goes to step 1314. - Step 1312: The
notification circuit 405 controls theelectronic device 101 to show the projection notice PN. - Step 1314: End.
- In this embodiment, the
image enhancement engine 404 may adjust the brightness of the projection source PS and/or the brightness of the background. Instep 1310, if the similarity between the color of the ambient light and the color of the projection source PS is higher than the threshold value TH5, thenotification circuit 405 controls the electronic device 101 (particularly, a projection source component PSC of the electronic device 101) to display or project the projection notice PN for notifying the user. In this embodiment, the ambient light can be detected by a red/green/blue (RGB) light sensor installed in theelectronic device 101. Provided that the result is substantially the same, the steps shown inFIG. 13 are not required to be executed in the exact order shown. For example, the projection notice PN may be displayed or projected by the projection source component PSC of theelectronic device 101 after any step inFIG. 13 when a malfunction of theprojection display component 100 occurs or any other factor causes a fail projection. - In one embodiment, the projection source PS can be divided into four segments on the projection source component PSC of the
electronic device 101, so the projected image PI can be seen from four different viewpoints, wherein these four segments is processed by theprojection processor 300 in parallel. It should be noted that the number of segments is only for illustrative purpose, not a limitation of the present invention. To have the information of the video view number, in one embodiment, the view number is derived from H.264's Supplemental Enhancement Information (SEI) transmitted from a transmitter. -
FIG. 14 is a diagram illustrating adata processing system 1400 employing theprojection processor 300 according to an embodiment of the present invention. Thedata processing system 1400 may be part of an electronic device such as a mobile phone. Thedata processing system 1400 may comprise at least one of a sensor 1401 (e.g. an image sensor), an image signal processor (ISP) 1402, animage encoder 1403, animage decoder 1404, avideo encoder 1405, avideo decoder 1406, agraphic engine 1407, abattery meter 1408, abattery 1409, a micro control unit (MCU) 1410, adisplay processor 1411, a driver integrated circuit (IC) 1412, aprojection source component 1413 and theaforementioned projection processor 300. Theprojection processor 300 receives the input image II from thedisplay processor 1411 for a plurality of applications, and generates the output image OI to thedriver IC 1412. Thedriver IC 1412 drives theprojection source component 1413 such that the projection source PS is displayed or projected by theprojection source component 1413 according to the output image OI. The other exemplary embodiments of the plurality of applications of theprojection processor 300 installed in thedata processing system 1400 will be discussed later. -
FIG. 15 is a diagram illustrating an embodiment related to a photograph application for theprojection processor 300 installed in thedata processing system 1400 according to the embodiment ofFIG. 14 . As shown inFIG. 15 , when a projection display mode is enabled by the user and theelectronic device 101 is used for taking photographs, thesensor 1401 may transmit the captured image into theISP 1402 for processing, and theISP 1402 may transmit the processed image to theimage encoder 1403 so it can be stored in an external storage device, and may also transmit it to thedisplay processor 1411. Thedisplay processor 1411 may perform additional image processing (e.g. scaling, rotation) upon the processed image generated from theISP 1402 to generate the input image II to theprojection processor 300 where it can undergo the predetermined processing operation described above for projection. The projection processor generates the output image OI. The projection source PS is displayed or projected by theprojection source component 1413 according to the output image OI. -
FIG. 16 is a diagram illustrating an embodiment for a recording application for theprojection processor 300 installed in thedata processing system 1400 according to the embodiment ofFIG. 14 . As shown inFIG. 16 , when a projection display mode is enabled by the user and theelectronic device 101 is used for video recording, thesensor 1401 may transmit a video sequence composed of a plurality of successive captured images to theISP 1402 for processing. TheISP 1402 may then transmit the processed video sequence to thevideo encoder 1405 where it can be stored in an external storage device, and may also transmit it to thedisplay processor 1411. Thedisplay processor 1411 may perform additional image processing (e.g. scaling, rotation) upon each captured image included in the processed video sequence generated from theISP 1402 to generate the input image II to theprojection processor 300 so it can undergo the predetermined processing operation described above for projection. Theprojection processor 300 generates the output image OI. The projection source PS is displayed or projected by theprojection source component 1413 according to the output image OI. -
FIG. 17 is a diagram illustrating an embodiment related to a video playback application for theprojection processor 300 installed in thedata processing system 1400 according to the embodiment ofFIG. 14 . As shown inFIG. 17 , when a projection display mode is enabled by the user and theelectronic device 101 is used for video playback, thevideo decoder 1406 may transmit a video sequence composed of successive decoded images to thedisplay processor 1411 by decoding a video sequence composed of successive encoded images read from an external storage device. Thedisplay processor 1411 may perform additional image processing (e.g. scaling, rotation) upon each image included in the decoded video sequence to generate the input image II to theprojection processor 300 so it can undergo the predetermined processing operation described above for projection. Theprojection processor 300 generates the output image OI. The projection source PS is displayed or projected by theprojection source component 1413 according to the output image OI. -
FIG. 18 is a diagram illustrating an embodiment related to a gaming application for theprojection processor 300 installed in thedata processing system 1400 according to the embodiment ofFIG. 14 . As shown inFIG. 18 , thegraphic engine 1407 may generate a graphic image of a game to thedisplay processor 1411. Thedisplay processor 1411 may perform additional image processing (e.g. scaling, rotation) upon the graphic image to generate the input image II to theprojection processor 300 so it can undergo the predetermined processing operation described above for projection. Theprojection processor 300 generates the output image OI. The projection source PS is displayed on theprojection source component 1413 according to the output image OI. -
FIG. 19 is a diagram illustrating an embodiment related to a gallery application for theprojection processor 300 installed in thedata processing system 1400 according to the embodiment ofFIG. 14 . As shown inFIG. 19 , theimage decoder 1404 may generate a decoded image to thedisplay processor 1411 by decoding an encoded image read from an external storage device. Thedisplay processor 1411 may perform additional image processing (e.g. scaling, rotation) upon the decoded image to generate the input image II to theprojection processor 300 so it can undergo the predetermined processing operation described above for projection. The projection processor generates the output image OI. The projection source PS is displayed or projected by theprojection source component 1413 according to the output image OI. - Those skilled in the art will readily observe that numerous modifications and alterations of the device and method may be made while retaining the teachings of the invention. Accordingly, the above disclosure should be construed as limited only by the metes and bounds of the appended claims.
Claims (26)
1. A projection processor, comprising:
a receiving circuit, arranged to receive an input image; and
an image processing circuit, arranged to perform at least one predetermined image processing operation upon the input image to generate an output image, wherein a projection source is generated according to the output image;
wherein the projection source is displayed or projected by a projection source component of an electronic device, such that a first cover of a projection display component partially reflects the projection source.
2. The projection processor of claim 1 , wherein the first cover comprises:
at least one non-opaque plate, arranged to partially reflects the projection source, such that a projected image is shown on or behind the at least one non-opaque plate.
3. The projection processor of claim 1 , wherein the image processing circuit comprises an image flip engine, and the predetermined image processing operation comprises an image flip operation controlled by the image flip engine.
4. The projection processor of claim 3 , wherein the image flip engine performs the image flip operation to ensure that an orientation of the projected image matches an orientation of the input image or the projected image is shown on or behind the first cover with a correct orientation.
5. The projection processor of claim 3 , wherein the image flip engine performs the image flip operation when an orientation of the projected image is not identical with the input image or the projected image is shown on or behind the first cover with an incorrect orientation.
6. The projection processor of claim 1 , wherein the image processing circuit comprises an image distortion correction engine, and the predetermined image processing operation comprises an image distortion correction operation controlled by the image distortion correction engine.
7. The projection processor of claim 6 , wherein the image distortion correction engine performs the image distortion correction operation to correct an appearance of the projection source when only a portion of the projection source is projected through a lens.
8. The projection processor of claim 6 , wherein the image distortion correction engine performs the image distortion correction operation when the optical lens is not parallel with the electronic device.
9. The projection processor of claim 1 , wherein the image processing circuit comprises an image segmentation engine, and the predetermined image processing operation comprises an image segmentation operation controlled by the image segmentation engine.
10. The projection processor of claim 9 , wherein the image segmentation engine separates the projection source from a background of the projection source and fills the background with a plain color.
11. The projection processor of claim 9 , wherein the image segmentation engine performs the image segmentation operation when a background corresponding to the projection source is not suitable for observing.
12. The projection processor of claim 1 , wherein the image processing circuit comprises an image enhancement engine, and the predetermined image processing operation comprises an image enhancement operation controlled by the image enhancement engine.
13. The projection processor of claim 12 , wherein the image enhancement engine performs the image enhancement operation when brightness of the projection source is lower than a first threshold or a difference between brightness of background and brightness of the projection source is lower than a second threshold value.
14. A projection method employed by a projection processor, comprising:
receiving an input image; and
performing at least one predetermined image processing operation upon the input image to generate an output image, wherein a projection source is generated according to the output image;
wherein the projection source is displayed or projected by a projection source component of an electronic device, such that a first cover of a projection display component partially reflects the projection source.
15. The projection method of claim 14 , wherein the first cover comprises at least one non-opaque plate arranged to partially reflects the projection source, such that a projected image is shown on or behind the at least one non-opaque plate.
16. The projection method of claim 14 , wherein the predetermined image processing operation comprises an image flip operation.
17. The projection method of claim 16 , wherein the image flip operation comprises:
flipping the input image to ensure that an orientation of the projected image matches an orientation of the input image or the projected image is shown on or behind the first cover with a correct orientation.
18. The projection method of claim 16 , wherein the image flip operation is performed when an orientation of the projected image is not identical with the input image or the projected image is shown on or behind the first cover with an incorrect orientation.
19. The projection method of claim 14 , wherein the predetermined image processing operation comprises an image distortion correction operation.
20. The projection method of claim 19 , wherein the image distortion correction operation is performed to correct an appearance of the projection source when only a portion of the projection source is projected through a lens.
21. The projection method of claim 19 , wherein the image distortion correction operation is performed when the optical lens is not parallel with the electronic device.
22. The projection method of claim 14 , wherein the predetermined image processing operation comprises an image segmentation operation.
23. The projection method of claim 22 , wherein the image segmentation operation comprising:
separating the projection source from a background the projection source and fills the background with a plain color.
24. The projection method of claim 22 , wherein the image segmentation operation is performed when a background corresponding to the projection source is not suitable for observing.
25. The projection method of claim 14 , wherein the predetermined image processing operation comprises an image enhancement operation.
26. The projection method of claim 25 , wherein the image enhancement operation is performed when brightness of the projection source is lower than a first threshold or a difference between brightness of background and brightness of the projection source is lower than a second threshold value.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/905,290 US20160165197A1 (en) | 2014-05-27 | 2015-05-27 | Projection processor and associated method |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201462003260P | 2014-05-27 | 2014-05-27 | |
US201462034952P | 2014-08-08 | 2014-08-08 | |
US14/905,290 US20160165197A1 (en) | 2014-05-27 | 2015-05-27 | Projection processor and associated method |
PCT/CN2015/079933 WO2015180645A1 (en) | 2014-05-27 | 2015-05-27 | Projection processor and associated method |
Publications (1)
Publication Number | Publication Date |
---|---|
US20160165197A1 true US20160165197A1 (en) | 2016-06-09 |
Family
ID=54698113
Family Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/904,699 Abandoned US20160156887A1 (en) | 2014-05-27 | 2015-05-27 | Projection processor for projective display system |
US14/905,290 Abandoned US20160165197A1 (en) | 2014-05-27 | 2015-05-27 | Projection processor and associated method |
US14/902,591 Active US10136114B2 (en) | 2014-05-27 | 2015-05-27 | Projection display component and electronic device |
US14/904,700 Abandoned US20160165208A1 (en) | 2014-05-27 | 2015-05-27 | Systems for providing image or video to be displayed by projective display system and for displaying or projecting image or video by a projective display system |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/904,699 Abandoned US20160156887A1 (en) | 2014-05-27 | 2015-05-27 | Projection processor for projective display system |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/902,591 Active US10136114B2 (en) | 2014-05-27 | 2015-05-27 | Projection display component and electronic device |
US14/904,700 Abandoned US20160165208A1 (en) | 2014-05-27 | 2015-05-27 | Systems for providing image or video to be displayed by projective display system and for displaying or projecting image or video by a projective display system |
Country Status (3)
Country | Link |
---|---|
US (4) | US20160156887A1 (en) |
CN (4) | CN105519098A (en) |
WO (4) | WO2015180645A1 (en) |
Families Citing this family (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20160156887A1 (en) * | 2014-05-27 | 2016-06-02 | Mediatek Inc. | Projection processor for projective display system |
CN105791882B (en) * | 2016-03-22 | 2018-09-18 | 腾讯科技(深圳)有限公司 | Method for video coding and device |
TWI653563B (en) * | 2016-05-24 | 2019-03-11 | 仁寶電腦工業股份有限公司 | Projection touch image selection method |
US10386648B2 (en) * | 2016-08-08 | 2019-08-20 | Innolux Corporation | Image display system |
JP6830112B2 (en) * | 2017-02-01 | 2021-02-17 | シャープ株式会社 | Projection suitability detection system, projection suitability detection method and projection suitability detection program |
US10241386B2 (en) * | 2017-03-20 | 2019-03-26 | The Eli Whitney Museum, Inc. | Flat folding projection device |
CN108732772B (en) * | 2017-04-25 | 2020-06-30 | 京东方科技集团股份有限公司 | Display device and driving method thereof |
TWI678644B (en) * | 2017-05-09 | 2019-12-01 | 瑞軒科技股份有限公司 | Device for mixed reality |
WO2019161570A1 (en) * | 2018-02-26 | 2019-08-29 | 神画科技(深圳)有限公司 | Projector and temperature compensation method for trapezoidal correction thereof |
US11258890B2 (en) | 2018-07-30 | 2022-02-22 | IKIN, Inc. | Portable terminal accessory device for holographic projection and user interface |
CN114096922A (en) | 2019-03-11 | 2022-02-25 | 艾肯公司 | Portable terminal accessory device for holographic projection and user interface |
CN112783456B (en) * | 2019-11-08 | 2024-06-11 | 博泰车联网科技(上海)股份有限公司 | Screen connection realization method and screen connection system |
US20210304357A1 (en) * | 2020-03-27 | 2021-09-30 | Alibaba Group Holding Limited | Method and system for video processing based on spatial or temporal importance |
USD994011S1 (en) | 2021-06-16 | 2023-08-01 | IKIN, Inc. | Holographic projection device |
USD1009969S1 (en) | 2021-06-17 | 2024-01-02 | IKIN, Inc. | Holographic device housing |
USD988277S1 (en) * | 2021-06-17 | 2023-06-06 | IKIN, Inc. | Portable holographic projection device |
CN114660916A (en) * | 2022-03-16 | 2022-06-24 | 李�杰 | Multi-angle holographic image display system and method |
Citations (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050030494A1 (en) * | 2003-08-07 | 2005-02-10 | Olympus Corporation | Projector apparatus and desk incorporating the same |
US20080018591A1 (en) * | 2006-07-20 | 2008-01-24 | Arkady Pittel | User Interfacing |
US7396133B2 (en) * | 2004-12-06 | 2008-07-08 | N-Lighten Technologies | System and method for self-aligning collapsible display |
US20110043766A1 (en) * | 2009-08-19 | 2011-02-24 | Tatsuo Itoh | Information processor with projector |
US20120092567A1 (en) * | 2010-10-15 | 2012-04-19 | Panasonic Corporation | Image display device and information processing apparatus including the same |
US8194001B2 (en) * | 2009-03-27 | 2012-06-05 | Microsoft Corporation | Mobile computer device display postures |
US20120300275A1 (en) * | 2011-05-23 | 2012-11-29 | 360Brandvision, LLC | Accessory for reflecting an image from a display screen of a portable electronic device |
US20130127716A1 (en) * | 2010-07-29 | 2013-05-23 | Funai Electric Co., Ltd. | Projector |
US8827465B2 (en) * | 2011-03-11 | 2014-09-09 | Panasonic Corporation | Image display apparatus and mobile information processing apparatus equipped with the same |
US8911096B2 (en) * | 2008-12-10 | 2014-12-16 | Nikon Corporation | Projection apparatus for projecting and processing an image |
US9134598B2 (en) * | 2012-11-13 | 2015-09-15 | Lenovo (Beijing) Co., Ltd. | Electronic device |
US20160182872A1 (en) * | 2014-05-27 | 2016-06-23 | Mediatek Inc. | Projection display component and electronic device |
US9429832B2 (en) * | 2009-01-08 | 2016-08-30 | Hitachi Maxell, Ltd. | Oblique projection optical system and projection type display apparatus using the same |
US9430096B2 (en) * | 2013-04-02 | 2016-08-30 | Fujitsu Limited | Interactive projector |
US9483080B2 (en) * | 2014-09-26 | 2016-11-01 | Intel Corporation | Electronic device with convertible touchscreen |
US20170006267A1 (en) * | 2015-06-30 | 2017-01-05 | Motorola Mobility Llc | Method and apparatus configured for combined vibratory and projection fuctions |
US9678703B2 (en) * | 2013-12-11 | 2017-06-13 | Beijing Lenovo Software Ltd. | Information processing method and electronic device thereof |
US9717981B2 (en) * | 2012-04-05 | 2017-08-01 | Microsoft Technology Licensing, Llc | Augmented reality and physical games |
Family Cites Families (53)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5851060A (en) | 1995-09-13 | 1998-12-22 | Nikon Corporation | Projective display device |
JPH10138794A (en) * | 1996-11-06 | 1998-05-26 | Denso Corp | Head-up display device |
DE10105482A1 (en) | 2001-02-07 | 2002-08-08 | Design & Dev Ct Gmbh & Co Kg | Portable projection screen has stand formed from plates which are hinged to protect screen when in transit |
RU2227314C1 (en) | 2002-09-17 | 2004-04-20 | Самсунг Электроникс Ко., Лтд. | Optical system of projection tv receiver |
JP2004177654A (en) * | 2002-11-27 | 2004-06-24 | Fuji Photo Optical Co Ltd | Projection picture display device |
DE602004031274D1 (en) | 2004-04-01 | 2011-03-10 | Musion Systems Ltd | Projection device and method for Pepper's ghost illusion |
CN102053472B (en) | 2004-04-01 | 2013-08-28 | 穆森系统有限公司 | Projection equipment and method for illusion of Peppers' ghost |
CN103235472B (en) | 2004-04-01 | 2015-11-04 | Mdh全息股份有限公司 | For projector equipment and the method for pepper's ghost illusion |
JP2006267222A (en) | 2005-03-22 | 2006-10-05 | Toshiba Corp | Projection screen and image projection system |
US7843449B2 (en) | 2006-09-20 | 2010-11-30 | Apple Inc. | Three-dimensional display system |
CN101183342A (en) * | 2006-11-14 | 2008-05-21 | 明基电通股份有限公司 | Projection device control system |
KR20080044370A (en) * | 2006-11-16 | 2008-05-21 | 최해용 | Stereoscopic screen |
CN101311769A (en) | 2007-05-24 | 2008-11-26 | 创盟科技股份有限公司 | Reflection imaging system |
CN101398596A (en) | 2007-09-25 | 2009-04-01 | 海尔集团公司 | Projector |
US20090219985A1 (en) | 2008-02-28 | 2009-09-03 | Vasanth Swaminathan | Systems and Methods for Processing Multiple Projections of Video Data in a Single Video File |
CN101256672B (en) | 2008-03-21 | 2011-10-12 | 北京中星微电子有限公司 | Object image depth restruction apparatus based on video camera apparatus as well as projecting apparatus thereof |
WO2009119808A1 (en) | 2008-03-27 | 2009-10-01 | 三洋電機株式会社 | Projection video display device |
US7869204B2 (en) * | 2008-09-15 | 2011-01-11 | International Business Machines Corporation | Compact size portable computer having a fully integrated virtual keyboard projector and a display projector |
JP5349010B2 (en) | 2008-11-06 | 2013-11-20 | 三菱電機株式会社 | Rear projection display |
US8330673B2 (en) | 2009-04-02 | 2012-12-11 | GM Global Technology Operations LLC | Scan loop optimization of vector projection display |
CN201594167U (en) | 2009-11-20 | 2010-09-29 | 江苏惠通集团有限责任公司 | Portable projecting apparatus for miniature terminal device |
JP5511360B2 (en) | 2009-12-22 | 2014-06-04 | キヤノン株式会社 | Image display device |
US20130278631A1 (en) * | 2010-02-28 | 2013-10-24 | Osterhout Group, Inc. | 3d positioning of augmented reality information |
EP2372512A1 (en) * | 2010-03-30 | 2011-10-05 | Harman Becker Automotive Systems GmbH | Vehicle user interface unit for a vehicle electronic device |
US8322863B1 (en) | 2010-06-18 | 2012-12-04 | Samuel Seungmin Cho | Apparatus and method for automated visual distortion adjustments for a portable projection device |
CN102109750A (en) | 2011-01-20 | 2011-06-29 | 杨绿 | 360-degree floating three-dimensional phantom imaging system |
US10083639B2 (en) * | 2011-02-04 | 2018-09-25 | Seiko Epson Corporation | Control device for controlling image display device, head-mounted display device, image display system, control method for the image display device, and control method for the head-mounted display device |
US8988512B2 (en) | 2011-04-14 | 2015-03-24 | Mediatek Inc. | Method for adjusting playback of multimedia content according to detection result of user status and related apparatus thereof |
CN102972024A (en) | 2011-05-11 | 2013-03-13 | 松下电器产业株式会社 | Video transmission device and video transmission method |
US9058687B2 (en) | 2011-06-08 | 2015-06-16 | Empire Technology Development Llc | Two-dimensional image capture for an augmented reality representation |
US20130147686A1 (en) | 2011-12-12 | 2013-06-13 | John Clavin | Connecting Head Mounted Displays To External Displays And Other Communication Networks |
CN103164024A (en) | 2011-12-15 | 2013-06-19 | 西安天动数字科技有限公司 | Somatosensory interactive system |
CN102520900B (en) | 2011-12-20 | 2015-03-25 | Tcl集团股份有限公司 | Multilayer display device and display control method thereof |
CN202548527U (en) | 2012-01-19 | 2012-11-21 | 郭振 | Wide-angle naked-eye stereoscopic projection quasi-holographic imaging system |
KR101320052B1 (en) * | 2012-01-31 | 2013-10-21 | 한국과학기술연구원 | 3-dimensional display apparatus using extension of viewing zone width |
CN103293838A (en) | 2012-02-22 | 2013-09-11 | 光宝电子(广州)有限公司 | Minitype projecting device and method for prolonging play time of minitype projecting device and enabling image quality to be optimal |
GB2499793B (en) | 2012-02-28 | 2018-01-17 | Bae Systems Plc | A deployment apparatus for a partially reflective combiner. |
JP5970887B2 (en) | 2012-03-19 | 2016-08-17 | 株式会社リコー | Image processing system, image processing apparatus and display apparatus used therefor, and image processing method in image processing system |
CN103428472B (en) | 2012-05-18 | 2016-08-10 | 郑州正信科技发展股份有限公司 | A kind of full interactive exchange communication method in kind based on collaborative perception and device thereof |
CN202535428U (en) | 2012-05-22 | 2012-11-14 | 广东欧珀移动通信有限公司 | Clamshell mobile phone structure with projection screen |
US8888295B2 (en) | 2012-07-02 | 2014-11-18 | Disney Enterprises, Inc. | Reflective surface tensioning and cleaning system for pepper's ghost illusion |
JP6213812B2 (en) * | 2012-07-31 | 2017-10-18 | Tianma Japan株式会社 | Stereoscopic image display apparatus and stereoscopic image processing method |
CN203101796U (en) | 2012-12-14 | 2013-07-31 | 王奕盟 | Integrated transparent-screen projection apparatus |
JP6136246B2 (en) | 2012-12-25 | 2017-05-31 | セイコーエプソン株式会社 | Projector and projector control method |
WO2014103072A1 (en) * | 2012-12-28 | 2014-07-03 | 楽天株式会社 | Access control system, access control method, mobile terminal, method for controlling mobile terminal, recording medium on which program for controlling mobile terminal is recorded, and program for controlling mobile terminal |
WO2014162420A1 (en) * | 2013-04-01 | 2014-10-09 | パイオニア株式会社 | Virtual-image display device |
JP2014230051A (en) | 2013-05-22 | 2014-12-08 | ソニー株式会社 | Information processing apparatus, information processing method, and program |
CN103309048A (en) | 2013-06-18 | 2013-09-18 | 彭波 | Method and device for stereo laser imaging and autostereoscopic displaying |
CN203422528U (en) | 2013-07-05 | 2014-02-05 | 张家港康得新光电材料有限公司 | Projection-type naked-eye stereo display system |
CN105531624B (en) | 2013-09-13 | 2017-07-28 | 日立麦克赛尔株式会社 | Projection-type image display device |
CN103595996B (en) | 2013-12-02 | 2016-05-04 | 南京航空航天大学 | A kind of multiview data transmission method that is applicable to real three-dimensional display system |
US20150268838A1 (en) * | 2014-03-20 | 2015-09-24 | Institute For Information Industry | Methods, systems, electronic devices, and non-transitory computer readable storage medium media for behavior based user interface layout display (build) |
CN105223761B (en) | 2014-07-01 | 2017-05-24 | 中强光电股份有限公司 | Projection device and illumination system |
-
2015
- 2015-05-27 US US14/904,699 patent/US20160156887A1/en not_active Abandoned
- 2015-05-27 US US14/905,290 patent/US20160165197A1/en not_active Abandoned
- 2015-05-27 CN CN201580001608.9A patent/CN105519098A/en active Pending
- 2015-05-27 WO PCT/CN2015/079933 patent/WO2015180645A1/en active Application Filing
- 2015-05-27 WO PCT/CN2015/079940 patent/WO2015180646A1/en active Application Filing
- 2015-05-27 CN CN201580001751.8A patent/CN105531625B/en active Active
- 2015-05-27 CN CN201580001601.7A patent/CN105474638A/en active Pending
- 2015-05-27 WO PCT/CN2015/079942 patent/WO2015180647A1/en active Application Filing
- 2015-05-27 WO PCT/CN2015/079979 patent/WO2015180653A1/en active Application Filing
- 2015-05-27 CN CN201580001603.6A patent/CN105474071A/en active Pending
- 2015-05-27 US US14/902,591 patent/US10136114B2/en active Active
- 2015-05-27 US US14/904,700 patent/US20160165208A1/en not_active Abandoned
Patent Citations (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050030494A1 (en) * | 2003-08-07 | 2005-02-10 | Olympus Corporation | Projector apparatus and desk incorporating the same |
US7396133B2 (en) * | 2004-12-06 | 2008-07-08 | N-Lighten Technologies | System and method for self-aligning collapsible display |
US20080018591A1 (en) * | 2006-07-20 | 2008-01-24 | Arkady Pittel | User Interfacing |
US8911096B2 (en) * | 2008-12-10 | 2014-12-16 | Nikon Corporation | Projection apparatus for projecting and processing an image |
US9429832B2 (en) * | 2009-01-08 | 2016-08-30 | Hitachi Maxell, Ltd. | Oblique projection optical system and projection type display apparatus using the same |
US8194001B2 (en) * | 2009-03-27 | 2012-06-05 | Microsoft Corporation | Mobile computer device display postures |
US20110043766A1 (en) * | 2009-08-19 | 2011-02-24 | Tatsuo Itoh | Information processor with projector |
US20130127716A1 (en) * | 2010-07-29 | 2013-05-23 | Funai Electric Co., Ltd. | Projector |
US20120092567A1 (en) * | 2010-10-15 | 2012-04-19 | Panasonic Corporation | Image display device and information processing apparatus including the same |
US8827465B2 (en) * | 2011-03-11 | 2014-09-09 | Panasonic Corporation | Image display apparatus and mobile information processing apparatus equipped with the same |
US20120300275A1 (en) * | 2011-05-23 | 2012-11-29 | 360Brandvision, LLC | Accessory for reflecting an image from a display screen of a portable electronic device |
US9717981B2 (en) * | 2012-04-05 | 2017-08-01 | Microsoft Technology Licensing, Llc | Augmented reality and physical games |
US9134598B2 (en) * | 2012-11-13 | 2015-09-15 | Lenovo (Beijing) Co., Ltd. | Electronic device |
US9430096B2 (en) * | 2013-04-02 | 2016-08-30 | Fujitsu Limited | Interactive projector |
US9678703B2 (en) * | 2013-12-11 | 2017-06-13 | Beijing Lenovo Software Ltd. | Information processing method and electronic device thereof |
US20160182872A1 (en) * | 2014-05-27 | 2016-06-23 | Mediatek Inc. | Projection display component and electronic device |
US9483080B2 (en) * | 2014-09-26 | 2016-11-01 | Intel Corporation | Electronic device with convertible touchscreen |
US20170006267A1 (en) * | 2015-06-30 | 2017-01-05 | Motorola Mobility Llc | Method and apparatus configured for combined vibratory and projection fuctions |
Also Published As
Publication number | Publication date |
---|---|
CN105519098A (en) | 2016-04-20 |
US10136114B2 (en) | 2018-11-20 |
WO2015180646A1 (en) | 2015-12-03 |
US20160165208A1 (en) | 2016-06-09 |
WO2015180645A1 (en) | 2015-12-03 |
WO2015180653A1 (en) | 2015-12-03 |
CN105474071A (en) | 2016-04-06 |
WO2015180647A1 (en) | 2015-12-03 |
CN105531625B (en) | 2018-06-01 |
US20160182872A1 (en) | 2016-06-23 |
CN105474638A (en) | 2016-04-06 |
CN105531625A (en) | 2016-04-27 |
US20160156887A1 (en) | 2016-06-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20160165197A1 (en) | Projection processor and associated method | |
US11335079B2 (en) | Method and system of reflection suppression for image processing | |
US9544574B2 (en) | Selecting camera pairs for stereoscopic imaging | |
EP2549762B1 (en) | Stereovision-image position matching apparatus, stereovision-image position matching method, and program therefor | |
US8791989B2 (en) | Image processing apparatus, image processing method, recording method, and recording medium | |
EP2589226B1 (en) | Image capture using luminance and chrominance sensors | |
US20120075432A1 (en) | Image capture using three-dimensional reconstruction | |
JP5849811B2 (en) | Video data generation method for autostereoscopic viewing | |
US20130231157A1 (en) | Cellular phone with camera at front edge area | |
TWI637288B (en) | Image processing method and system for eye-gaze correction | |
TW201351959A (en) | Method of stereo 3D image synthesis and related camera | |
WO2013108285A1 (en) | Image recording device, three-dimensional image reproduction device, image recording method, and three-dimensional image reproduction method | |
TWI613904B (en) | Stereo image generating method and electronic apparatus utilizing the method | |
US20230033956A1 (en) | Estimating depth based on iris size | |
US20120007819A1 (en) | Automatic Convergence Based on Touchscreen Input for Stereoscopic Imaging | |
TWI486052B (en) | Three-dimensional image processing device and three-dimensional image processing method | |
US9185395B2 (en) | Method and system for automatically adjusting autostereoscopic 3D display device | |
JP2006267767A (en) | Image display device | |
CN102802012A (en) | Three-dimensional automatic signal identifying method | |
TWI541761B (en) | Image processing method and electronic device thereof | |
CN104054333A (en) | Image processing device, method and program, and recording medium therefor | |
US20100164945A1 (en) | Digital photo frame and method for displaying photos in digital photo frame | |
KR20200061488A (en) | 2D 3D Dual Display for smartphone | |
TW201133124A (en) | Apparatus and method for capturing three-dimensional image | |
CN220554028U (en) | Mobile phone capable of shooting stereoscopic image |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: MEDIATEK INC., TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LIU, TSU-MING;CHANG, CHIH-KAI;JU, CHI-CHENG;AND OTHERS;REEL/FRAME:037496/0554 Effective date: 20150528 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |