US20150010236A1 - Automatic image refocusing method - Google Patents
Automatic image refocusing method Download PDFInfo
- Publication number
- US20150010236A1 US20150010236A1 US13/936,501 US201313936501A US2015010236A1 US 20150010236 A1 US20150010236 A1 US 20150010236A1 US 201313936501 A US201313936501 A US 201313936501A US 2015010236 A1 US2015010236 A1 US 2015010236A1
- Authority
- US
- United States
- Prior art keywords
- image
- electronic device
- target objects
- processor
- display screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
-
- G06K9/46—
-
- G06T5/003—
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/21—Indexing scheme for image data processing or generation, in general involving computational photography
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10052—Images from lightfield camera
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/161—Detection; Localisation; Normalisation
Definitions
- the present invention relates to image adjustment, and in particular, relates to an electronic device and an automatic image refocusing method capable of illustrating a photo slideshow by automatically refocusing on objects at different depth distances.
- an automatic image adjusting method for use in an electronic device comprises a processor and a display screen.
- the automatic image adjusting method comprises the following steps of: analyzing an image to determine multiple target objects in the image; estimating corresponding depth distances of the target objects in the image; and displaying the image on the display screen by switching focus between the target objects according to the corresponding depth distances in a display order.
- an electronic device comprising: a display screen configured to display an image; and a processor configured to analyze an image to determine multiple target objects in the image, estimate corresponding depth distances of the target object in the image, and switch focus of the image between the target objects according to the corresponding depth distances in a display order.
- FIG. 1 is a schematic diagram illustrating an electronic device 100 according to an embodiment of the invention
- FIGS. 2A ⁇ 2D are diagrams illustrating the refocusing operations in an image according to an embodiment of the invention.
- FIG. 3 is a flow chart illustrating the automatic image adjusting method according to an embodiment of the invention
- FIG. 1 is a schematic diagram illustrating an electronic device 100 according to an embodiment of the invention.
- the electronic device 100 may comprise a processor 110 , a memory unit 120 , a display screen 140 , and an image capture unit 150 .
- the electronic device 100 may be a personal computer or portable device such as mobile phone, tablet, digital camera/camcorder, game console or any suitable device equipped with image recording function.
- the processor 110 may be data processors, image processors, application processor and/or central processors, and is capable of executing one or more types of computer readable medium stored in the memory unit 120 .
- the electronic device 100 may further comprise an RF circuitry 130 .
- the display screen 140 may be a touch-sensitive screen.
- the RF circuitry 130 may be coupled to one or more antennas 135 and may allow communications with one or more additional devices, computers and/or servers via a wireless network.
- the electronic device 100 may support various communications protocols, such as the code division multiple access (CDMA), Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High-Speed Downlink Packet Access (HSDPA), Wi-Fi (such as IEEE 802.11a/b/g/n), Bluetooth, and Wi-MAX communication protocol, and a protocol for emails, instant messaging (IM), and/or a short message services (SMS), but the invention is not limited thereto.
- CDMA code division multiple access
- GSM Global System for Mobile Communications
- EDGE Enhanced Data GSM Environment
- HSDPA High-Speed Downlink Packet Access
- Wi-Fi such as IEEE 802.11a/b/g/n
- Bluetooth and Wi-MAX communication protocol
- Wi-MAX such as IEEE 802.11a/b/g/n
- Wi-MAX such as IEEE
- the display screen 140 When the display screen 140 is implemented as a touch-sensitive screen, it may detect contact and any movement or break thereof by using any of a plurality of touch sensitivity technologies now known or to be later developed, including, but not limited to, capacitive, resistive, infrared, and surface acoustic wave touch sensitivity technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch-sensitive screen.
- the touch-sensitive screen may also display visual output of the electronic device 100 .
- the electronic device 100 may include circuitry (not shown in FIG. 1 ) for supporting a location determining capability, such as that provided by a Global Positioning System (GPS).
- GPS Global Positioning System
- the image capture unit 150 may be one or more optical sensors configured to capture images.
- the image capture unit 150 may be one or more CCD or CMOS sensors, but the invention is not limited thereto.
- the memory unit 120 may comprise one or more types of computer readable medium.
- the memory unit 120 may be high-speed random access memory (e.g. SRAM or DRAM) and/or non-volatile memory, such as flash memory (for example embedded multi-media card).
- the memory unit 120 may store program codes of an operating system 122 , such as LINUX, UNIX, OS X, Android, iOS or WINDOWS operating system, or an embedded operating system such as VxWorks therein.
- the operating system 122 may executes procedures for handling basic system services and for performing hardware dependent tasks.
- the memory unit 120 may also store communication programs 124 for executing communication procedures. The communication procedures may be used for communicating with one or more additional devices, one or more computers and/or one or more servers.
- the memory unit 120 may comprise display programs 125 , contact/motion programs 126 to determine one or more points of contact and/or their movement, and a graphics processing programs 128 .
- the graphics processing programs 128 may support widgets, i.e., modules or applications with embedded graphics.
- the widgets may be implemented using JavaScript, HTML, Adobe Flash, or other suitable computer programming languages and technologies.
- the memory unit 120 may also comprise one or more application programs 130 .
- application programs stored in the memory unit 120 may be telephone applications, email applications, text messaging or instant messaging applications, memo pad applications, address books or contact lists, calendars, picture taking and management applications, and music playback and management applications.
- the application programs 130 may comprise a web browser (not shown in FIG. 1 ) for rendering pages written in the Hypertext Markup Language (HTML), Wireless Markup Language (WML), or other languages suitable for composing web pages or other online content.
- the memory unit 120 may further comprise keyboard input programs (or a set of instructions) 131 .
- the keyboard input programs 131 operates one or more soft keyboards.
- each of the above identified programs and applications correspond to a set of instructions for performing one or more of the functions described above.
- These programs i.e., sets of instructions
- the various programs and sub- programs may be rearranged and/or combined.
- Various functions of the electronic device 100 may be implemented in software and/or in hardware, including one or more signal processing and/or application specific integrated circuits.
- FIGS. 2A ⁇ 2D are diagrams illustrating the refocusing operations in an image according to an embodiment of the invention.
- the image 200 may be an instantly-retrieved image by the image capture unit 150 or a pre-stored photograph in the memory unit 120 .
- the processor 110 may analyze the retrieved image 200 to determine multiple target objects (e.g. human faces 215 , 225 and 235 ) from the image 200 .
- target objects e.g. human faces 215 , 225 and 235
- the processor 110 may use known face detection techniques to recognize human faces (e.g. human faces 215 , 225 and 235 ) in the image 200 .
- the processor 110 may also use known object recognition techniques to identify different objects in the image 200 .
- the processor 110 may estimate a depth map (e.g. a grey level map of luminance values from 0 to 255) corresponding to the image 200 , thereby estimating the depth distance of each target object in the image 200 .
- a depth map e.g. a grey level map of luminance values from 0 to 255
- the depth distances can be determined from stereoscopic images captured by a plenoptic camera with “light field” technology and an all-in-focus function.
- the processor 110 may calculate a ranking based on the estimated depth distances of the target objects, and automatically focus each of the target objects in a specific display order associated with the calculated ranking of the estimated depth distances of the target objects to alter the focus on different target objects.
- the human faces 215 , 225 and 235 have corresponding first depth distance d1, second depth distance d2, and third depth distance d3, and the ranking of the depth distances can be expressed as: d1>d2>d3, where the largest value of the depth distance (e.g. with a smallest grey level in the depth image) indicates that the corresponding target object is located at the farthest place of the scene, and the smallest value of the depth distance (e.g.
- the processor 110 may focus on the human face 215 first, as illustrated in FIG. 2B . Then, the processor 110 may switch focus on the human face 225 , as illustrated in FIG. 2C . Last, the processor 110 may switch focus again on the human face 235 , as illustrated in FIG. 2D .
- the display screen 140 provides viewing of the image 200 with focus switching from the human faces 215 , 225 and 235 in rotation order with desired viewing effect. The refocusing operations are executed sequentially in rotation. In some embodiments, only the focused target object is the clearest object in the image 200 during the refocusing procedure, and remaining portions of the image 200 may be blurred.
- the focus order and viewing effect may be in any other fashion predefined or specified by the user.
- the focus order may be designated by position (left to right or right to left, etc.), by object size (large to small or small to large, etc.) or by object type (human, animal, etc.)
- the viewing effect may be enhancing focused target object and blurring non-focused portions within the image 200 (i.e. portions except the focused target object), fish eye effect on the focused target, or applying predetermined or user specified filter on the focused target object/non-focused portions, etc.
- the electronic device 100 may further comprise a motion detection unit (not shown in FIG. 1 ), such as an accelerometer and a gyroscope, for detecting motion information (e.g. acceleration and angle speed) of the electronic device.
- the processor 110 may retrieve the detected motion information from the motion detection unit, and detect any shaking motion of the electronic device 100 .
- the processor 110 may refocus on a next one of the target objects in the display order. Accordingly, a user may shake the electronic device 100 to switch the focused target object in the image.
- the display screen 140 may comprise a touch-sensitive module capable of detecting user inputs (e.g. swiping touch actions) on the display screen 140 , and the focused target object can be altered manually. For example, a user may use his/her finger or a stylus to swipe or tap the display screen 140 , and thus the display screen 140 may detect one or more swiping touch actions. Then, the processor 110 may switch to the next target object in display order (i.e. in the rotation) and focus on the switched target object in response to detecting a user input.
- user inputs e.g. swiping touch actions
- the processor 110 may further adjust the position of display area within the image 200 , so that the focused target object is located at the center of the display screen 140 .
- the image can be blurred until the focused target object is moved to the center of the display screen.
- FIG. 3 is a flow chart illustrating the automatic image refocusing method according to an embodiment of the invention.
- the processor 110 may analyze an image (e.g. image 200 ) to determine multiple target objects (e.g. human faces 215 , 225 and 235 ) in the image.
- the determined target objects may be human faces, which are recognized from the image by using face detection techniques.
- Other object detection/identification techniques known in the art may also be applied to embodiments of the invention.
- the processor may estimate the corresponding depth distances of the target objects in the image. For example, the processor 110 may generate a corresponding depth map of the image, thereby estimating the corresponding depth distance of each target object.
- the processor 110 may display the image on the display screen by switching focus between the target objects according to the corresponding depth distances in a display order.
- the aforementioned display order may indicate that each of the target objects is displayed in a rotation.
- the user may also change the target object to be focused by sending a user input on the display screen (i.e. a touch-sensitive screen).
- the methods, or certain aspects or portions thereof, may take the form of a program code embodied in tangible media, such as floppy diskettes, CD-ROMs, hard drives, or any other machine-readable (e.g., computer-readable) storage medium, or computer program products without limitation in external shape or form thereof, wherein, when the program code is loaded into and executed by a machine, such as a computer, the machine thereby becomes an apparatus for practicing the methods.
- the methods may also be embodied in the form of a program code transmitted over some transmission medium, such as an electrical wire or a cable, or through fiber optics, or via any other form of transmission, wherein, when the program code is received and loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing the disclosed methods.
- the program code When implemented on a general-purpose processor, the program code combines with the processor to provide a unique apparatus that operates analogously to application specific logic circuits.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Studio Devices (AREA)
Abstract
An automatic image adjusting method for use in an electronic device is provided. The electronic device has a processor and a display screen. The automatic image adjusting method has the following steps of: analyzing an image to determine multiple target objects in the image; estimating corresponding depth distances of the target objects; and displaying the image on the display screen by switching focus between the target objects according to the corresponding depth distances in a display order.
Description
- 1. Field of the Invention
- The present invention relates to image adjustment, and in particular, relates to an electronic device and an automatic image refocusing method capable of illustrating a photo slideshow by automatically refocusing on objects at different depth distances.
- 2. Description of the Related Art
- Currently, electronic devices, such as smart phones and tablet PCs, have become more and more popular. When viewing a picture comprising several people in a scene, each of the people may be located at different depth distances within the scene (or distance from the lens of the camera). However, a conventional electronic device can not use the depth information in the picture to focus and refocus on different people in the picture, and thus user experience for viewing a picture cannot be enhanced from a conventional image.
- A detailed description is given in the following embodiments with reference to the accompanying drawings.
- In an exemplary embodiment, an automatic image adjusting method for use in an electronic device is provided. The electronic device comprises a processor and a display screen. The automatic image adjusting method comprises the following steps of: analyzing an image to determine multiple target objects in the image; estimating corresponding depth distances of the target objects in the image; and displaying the image on the display screen by switching focus between the target objects according to the corresponding depth distances in a display order.
- In another exemplary embodiment, an electronic device is provided. The electronic device comprises: a display screen configured to display an image; and a processor configured to analyze an image to determine multiple target objects in the image, estimate corresponding depth distances of the target object in the image, and switch focus of the image between the target objects according to the corresponding depth distances in a display order.
- The present invention can be more fully understood by reading the subsequent detailed description and examples with references made to the accompanying drawings, wherein:
-
FIG. 1 is a schematic diagram illustrating anelectronic device 100 according to an embodiment of the invention; -
FIGS. 2A˜2D are diagrams illustrating the refocusing operations in an image according to an embodiment of the invention; and -
FIG. 3 is a flow chart illustrating the automatic image adjusting method according to an embodiment of the invention - The following description is of the best-contemplated mode of carrying out the invention. This description is made for the purpose of illustrating the general principles of the invention and should not be taken in a limiting sense. The scope of the invention is best determined by reference to the appended claims.
-
FIG. 1 is a schematic diagram illustrating anelectronic device 100 according to an embodiment of the invention. Theelectronic device 100 may comprise aprocessor 110, amemory unit 120, adisplay screen 140, and animage capture unit 150. In an exemplary embodiment, theelectronic device 100 may be a personal computer or portable device such as mobile phone, tablet, digital camera/camcorder, game console or any suitable device equipped with image recording function. Theprocessor 110 may be data processors, image processors, application processor and/or central processors, and is capable of executing one or more types of computer readable medium stored in thememory unit 120. Specifically, theelectronic device 100 may further comprise anRF circuitry 130. In the embodiments, thedisplay screen 140 may be a touch-sensitive screen. - In addition, the
RF circuitry 130 may be coupled to one ormore antennas 135 and may allow communications with one or more additional devices, computers and/or servers via a wireless network. Theelectronic device 100 may support various communications protocols, such as the code division multiple access (CDMA), Global System for Mobile Communications (GSM), Enhanced Data GSM Environment (EDGE), High-Speed Downlink Packet Access (HSDPA), Wi-Fi (such as IEEE 802.11a/b/g/n), Bluetooth, and Wi-MAX communication protocol, and a protocol for emails, instant messaging (IM), and/or a short message services (SMS), but the invention is not limited thereto. - When the
display screen 140 is implemented as a touch-sensitive screen, it may detect contact and any movement or break thereof by using any of a plurality of touch sensitivity technologies now known or to be later developed, including, but not limited to, capacitive, resistive, infrared, and surface acoustic wave touch sensitivity technologies, as well as other proximity sensor arrays or other elements for determining one or more points of contact with the touch-sensitive screen. However, the touch-sensitive screen may also display visual output of theelectronic device 100. In some other embodiments, theelectronic device 100 may include circuitry (not shown inFIG. 1 ) for supporting a location determining capability, such as that provided by a Global Positioning System (GPS). - The
image capture unit 150 may be one or more optical sensors configured to capture images. For example, theimage capture unit 150 may be one or more CCD or CMOS sensors, but the invention is not limited thereto. - The
memory unit 120 may comprise one or more types of computer readable medium. Thememory unit 120 may be high-speed random access memory (e.g. SRAM or DRAM) and/or non-volatile memory, such as flash memory (for example embedded multi-media card). Thememory unit 120 may store program codes of anoperating system 122, such as LINUX, UNIX, OS X, Android, iOS or WINDOWS operating system, or an embedded operating system such as VxWorks therein. Theoperating system 122 may executes procedures for handling basic system services and for performing hardware dependent tasks. Thememory unit 120 may also storecommunication programs 124 for executing communication procedures. The communication procedures may be used for communicating with one or more additional devices, one or more computers and/or one or more servers. Thememory unit 120 may comprisedisplay programs 125, contact/motion programs 126 to determine one or more points of contact and/or their movement, and agraphics processing programs 128. Thegraphics processing programs 128 may support widgets, i.e., modules or applications with embedded graphics. The widgets may be implemented using JavaScript, HTML, Adobe Flash, or other suitable computer programming languages and technologies. - The
memory unit 120 may also comprise one ormore application programs 130. For example, application programs stored in thememory unit 120 may be telephone applications, email applications, text messaging or instant messaging applications, memo pad applications, address books or contact lists, calendars, picture taking and management applications, and music playback and management applications. Theapplication programs 130 may comprise a web browser (not shown inFIG. 1 ) for rendering pages written in the Hypertext Markup Language (HTML), Wireless Markup Language (WML), or other languages suitable for composing web pages or other online content. Thememory unit 120 may further comprise keyboard input programs (or a set of instructions) 131. Thekeyboard input programs 131 operates one or more soft keyboards. - It should be noted that each of the above identified programs and applications correspond to a set of instructions for performing one or more of the functions described above. These programs (i.e., sets of instructions) need not be implemented as separate software programs, procedures or modules. The various programs and sub- programs may be rearranged and/or combined. Various functions of the
electronic device 100 may be implemented in software and/or in hardware, including one or more signal processing and/or application specific integrated circuits. -
FIGS. 2A˜2D are diagrams illustrating the refocusing operations in an image according to an embodiment of the invention. Referring to bothFIG. 1 andFIG. 2A , theimage 200 may be an instantly-retrieved image by theimage capture unit 150 or a pre-stored photograph in thememory unit 120. Then, theprocessor 110 may analyze the retrievedimage 200 to determine multiple target objects (e.g. human faces 215, 225 and 235) from theimage 200. For example, theprocessor 110 may use known face detection techniques to recognize human faces (e.g. human faces 215, 225 and 235) in theimage 200. Alternatively, theprocessor 110 may also use known object recognition techniques to identify different objects in theimage 200. Since the 210, 220, and 230 may be located at different depth distances within the scene (or say from the lens of the image capture unit 150), theusers processor 110 may estimate a depth map (e.g. a grey level map of luminance values from 0 to 255) corresponding to theimage 200, thereby estimating the depth distance of each target object in theimage 200. In another embodiment, the depth distances can be determined from stereoscopic images captured by a plenoptic camera with “light field” technology and an all-in-focus function. - After determining corresponding depth distances, the
processor 110 may calculate a ranking based on the estimated depth distances of the target objects, and automatically focus each of the target objects in a specific display order associated with the calculated ranking of the estimated depth distances of the target objects to alter the focus on different target objects. For example, given that the human faces 215, 225 and 235 have corresponding first depth distance d1, second depth distance d2, and third depth distance d3, and the ranking of the depth distances can be expressed as: d1>d2>d3, where the largest value of the depth distance (e.g. with a smallest grey level in the depth image) indicates that the corresponding target object is located at the farthest place of the scene, and the smallest value of the depth distance (e.g. with a largest grey level in the depth image) indicates that the corresponding target object is located at the nearest place of the scene. Accordingly, theprocessor 110 may focus on thehuman face 215 first, as illustrated inFIG. 2B . Then, theprocessor 110 may switch focus on thehuman face 225, as illustrated inFIG. 2C . Last, theprocessor 110 may switch focus again on thehuman face 235, as illustrated inFIG. 2D . In short, thedisplay screen 140 provides viewing of theimage 200 with focus switching from the human faces 215, 225 and 235 in rotation order with desired viewing effect. The refocusing operations are executed sequentially in rotation. In some embodiments, only the focused target object is the clearest object in theimage 200 during the refocusing procedure, and remaining portions of theimage 200 may be blurred. In other embodiments of the invention, the focus order and viewing effect may be in any other fashion predefined or specified by the user. For example, the focus order may be designated by position (left to right or right to left, etc.), by object size (large to small or small to large, etc.) or by object type (human, animal, etc.) the viewing effect may be enhancing focused target object and blurring non-focused portions within the image 200 (i.e. portions except the focused target object), fish eye effect on the focused target, or applying predetermined or user specified filter on the focused target object/non-focused portions, etc. - In another embodiment, the
electronic device 100 may further comprise a motion detection unit (not shown inFIG. 1 ), such as an accelerometer and a gyroscope, for detecting motion information (e.g. acceleration and angle speed) of the electronic device. Theprocessor 110 may retrieve the detected motion information from the motion detection unit, and detect any shaking motion of theelectronic device 100. When a shaking motion of theelectronic device 100 is detected, theprocessor 110 may refocus on a next one of the target objects in the display order. Accordingly, a user may shake theelectronic device 100 to switch the focused target object in the image. - In yet another embodiment, the
display screen 140 may comprise a touch-sensitive module capable of detecting user inputs (e.g. swiping touch actions) on thedisplay screen 140, and the focused target object can be altered manually. For example, a user may use his/her finger or a stylus to swipe or tap thedisplay screen 140, and thus thedisplay screen 140 may detect one or more swiping touch actions. Then, theprocessor 110 may switch to the next target object in display order (i.e. in the rotation) and focus on the switched target object in response to detecting a user input. In the aforementioned embodiments, assuming the resolution of theimage 200 is larger than that of thedisplay screen 140, theprocessor 110 may further adjust the position of display area within theimage 200, so that the focused target object is located at the center of thedisplay screen 140. In addition, during the transition from one to another focused target object, the image can be blurred until the focused target object is moved to the center of the display screen. For one having ordinary skill in the art, it is appreciated that various image effects can be illustrated during the transition, and the invention is not limited to the aforementioned image effects. -
FIG. 3 is a flow chart illustrating the automatic image refocusing method according to an embodiment of the invention. Referring to bothFIGS. 1˜3 , in step S310, theprocessor 110 may analyze an image (e.g. image 200) to determine multiple target objects (e.g. human faces 215, 225 and 235) in the image. For example, the determined target objects may be human faces, which are recognized from the image by using face detection techniques. Other object detection/identification techniques known in the art may also be applied to embodiments of the invention. In step S320, the processor may estimate the corresponding depth distances of the target objects in the image. For example, theprocessor 110 may generate a corresponding depth map of the image, thereby estimating the corresponding depth distance of each target object. In step S330, theprocessor 110 may display the image on the display screen by switching focus between the target objects according to the corresponding depth distances in a display order. For example, the aforementioned display order may indicate that each of the target objects is displayed in a rotation. Additionally, the user may also change the target object to be focused by sending a user input on the display screen (i.e. a touch-sensitive screen). - The methods, or certain aspects or portions thereof, may take the form of a program code embodied in tangible media, such as floppy diskettes, CD-ROMs, hard drives, or any other machine-readable (e.g., computer-readable) storage medium, or computer program products without limitation in external shape or form thereof, wherein, when the program code is loaded into and executed by a machine, such as a computer, the machine thereby becomes an apparatus for practicing the methods. The methods may also be embodied in the form of a program code transmitted over some transmission medium, such as an electrical wire or a cable, or through fiber optics, or via any other form of transmission, wherein, when the program code is received and loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for practicing the disclosed methods. When implemented on a general-purpose processor, the program code combines with the processor to provide a unique apparatus that operates analogously to application specific logic circuits.
- While the invention has been described by way of example and in terms of the preferred embodiments, it is to be understood that the invention is not limited to the disclosed embodiments. To the contrary, it is intended to cover various modifications and similar arrangements (as would be apparent to those skilled in the art). Therefore, the scope of the appended claims should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements.
Claims (19)
1. An automatic image refocusing method for use in an electronic device comprising at least a display screen, the automatic image refocusing comprising:
analyzing an image to determine multiple target objects in the image;
estimating a corresponding depth distance of each target object in the image; and
displaying the image on the display screen by switching focus between target objects according to the corresponding depth distances in a display order.
2. The image adjusting method as claimed in claim 1 , wherein the analyzing step comprises:
performing face detection on the image to determine human faces as the target objects from the image.
3. The image adjusting method as claimed in claim 1 , further comprising:
determining a depth map of the image; and
estimating the corresponding depth distance of each target object according to the depth map.
4. The image adjusting method as claimed in claim 1 , wherein the display order is determined according to ranking of the corresponding depth distances of the target objects.
5. The image adjusting method as claimed in claim 1 , further comprises:
detecting a motion of the electronic device by a motion detection unit of the electronic device; and
in response to a motion is detected, displaying a next one of the target objects in the display order.
6. The image adjusting method as claimed in claim 1 , further comprising:
enlarging a region of the focused target object; and
displaying the enlarged region at the center of the display screen.
7. The image adjusting method as claimed in claim 1 , wherein the display screen is a touch-sensitive screen, and the image adjusting method further comprises:
selecting one of the target objects by tapping on the touch screen manually by a user; and
switching focus on the selected target object.
8. The image adjusting method as claimed in claim 1 , further comprises:
rotating and focusing between the target objects by detecting user inputs on the display screen.
9. The image adjusting method as claimed in claim 1 , further comprising:
applying viewing effect to the target object being focused.
10. An electronic device, comprising:
a display screen, configured to display an image; and
a processor configured to analyze an image to determine multiple target objects in the image, estimate corresponding depth distances of the target objects in the image, and switch focus of the image between the target objects according to the corresponding depth distances in a display order.
11. The electronic device as claimed in claim 10 , wherein the processor is further configured to perform face detection to the image to determine human faces as the target objects from the image.
12. The electronic device as claimed in claim 10 , wherein the processor is further configured to determine a depth map of the image, and estimates the corresponding depth distance of each target object according to the depth image.
13. The electronic device as claimed in claim 10 , wherein the display order is determined according to a ranking of the corresponding depth distances of the target objects.
14. The electronic device as claimed in claim 10 , further comprising:
a motion detection unit, configured to detect a motion of the electronic device, wherein in response to a motion of the electronic device is detected by the motion detection unit, the processor switches focus to a next one of the target objects in the display order.
15. The electronic device as claimed in claim 10 , wherein the processor is further configured to enlarge a region of the focused target object, and displays the enlarged region at the center of the display screen.
16. The electronic device as claimed in claim 10 , wherein the display screen is a touch-sensitive screen for receiving a user input, and the processor further selects one of the target objects and focuses on the selected target object according to the user input.
17. The electronic device as claimed in claim 10 , wherein the display screen is a touch-sensitive screen for receiving a user input, and the processor is further configured to switch focus between the target objects according to the user input.
18. The electronic device as claimed in claim 10 , wherein the display order is predetermined or specified by a user.
19. The electronic device as claimed in claim 10 , wherein the processor is further configured to apply viewing effect to the target object being focused.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US13/936,501 US20150010236A1 (en) | 2013-07-08 | 2013-07-08 | Automatic image refocusing method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US13/936,501 US20150010236A1 (en) | 2013-07-08 | 2013-07-08 | Automatic image refocusing method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| US20150010236A1 true US20150010236A1 (en) | 2015-01-08 |
Family
ID=52132868
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US13/936,501 Abandoned US20150010236A1 (en) | 2013-07-08 | 2013-07-08 | Automatic image refocusing method |
Country Status (1)
| Country | Link |
|---|---|
| US (1) | US20150010236A1 (en) |
Cited By (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150242982A1 (en) * | 2014-02-25 | 2015-08-27 | Samsung Electronics Co., Ltd. | Method and apparatus for displaying image |
| US20150277092A1 (en) * | 2014-03-27 | 2015-10-01 | The Board Of Trustees Of The Leland Stanford Junior University | Phase mask imaging |
| CN107409205A (en) * | 2015-03-16 | 2017-11-28 | 深圳市大疆创新科技有限公司 | Device and method for focus adjustment and depth map determination |
| EP3379821A1 (en) * | 2017-03-24 | 2018-09-26 | Samsung Electronics Co., Ltd. | Electronic device for providing graphic indicator for focus and method of operating electronic device |
| CN109087235A (en) * | 2017-05-25 | 2018-12-25 | 钰立微电子股份有限公司 | Image processor and related image system |
| CN110602397A (en) * | 2019-09-16 | 2019-12-20 | RealMe重庆移动通信有限公司 | Image processing method, device, terminal and storage medium |
| US10721390B2 (en) * | 2016-04-18 | 2020-07-21 | Moonlightning Industries Ab | Focus pulling with distance information from a secondary camera system |
| US10999499B2 (en) * | 2015-03-25 | 2021-05-04 | Avaya, Inc. | Background replacement from video images captured by a plenoptic camera |
| US20210349616A1 (en) * | 2017-04-26 | 2021-11-11 | Samsung Electronics Co., Ltd. | Electronic device and method for electronic device displaying image |
| CN120769181A (en) * | 2024-05-27 | 2025-10-10 | 荣耀终端股份有限公司 | Image processing method and device |
| WO2026050064A1 (en) * | 2024-08-30 | 2026-03-05 | Zebra Technologies Corporation | Intelligent focus adjustment of a variable focus imaging assembly |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060290932A1 (en) * | 2005-06-23 | 2006-12-28 | Pentax Corporation | Photographing device with auto focusing function |
| US20090009652A1 (en) * | 2007-07-03 | 2009-01-08 | Canon Kabushiki Kaisha | Image display control apparatus |
| US20120013786A1 (en) * | 2010-07-16 | 2012-01-19 | Canon Kabushiki Kaisha | Focus adjustment apparatus and method, and image capturing apparatus and control method thereof |
| US20120019703A1 (en) * | 2010-07-22 | 2012-01-26 | Thorn Karl Ola | Camera system and method of displaying photos |
| US20120194709A1 (en) * | 2011-01-31 | 2012-08-02 | Sanyo Electric Co., Ltd. | Image pickup apparatus |
| US20130070145A1 (en) * | 2011-09-20 | 2013-03-21 | Canon Kabushiki Kaisha | Image capturing apparatus and control method thereof |
| US20130201355A1 (en) * | 2010-09-15 | 2013-08-08 | Olympus Corporation | Imaging apparatus, imaging method, and recording medium |
| US20140219576A1 (en) * | 2013-02-01 | 2014-08-07 | Canon Kabushiki Kaisha | Image processing apparatus and control method thereof |
-
2013
- 2013-07-08 US US13/936,501 patent/US20150010236A1/en not_active Abandoned
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060290932A1 (en) * | 2005-06-23 | 2006-12-28 | Pentax Corporation | Photographing device with auto focusing function |
| US20090009652A1 (en) * | 2007-07-03 | 2009-01-08 | Canon Kabushiki Kaisha | Image display control apparatus |
| US20120013786A1 (en) * | 2010-07-16 | 2012-01-19 | Canon Kabushiki Kaisha | Focus adjustment apparatus and method, and image capturing apparatus and control method thereof |
| US20120019703A1 (en) * | 2010-07-22 | 2012-01-26 | Thorn Karl Ola | Camera system and method of displaying photos |
| US20130201355A1 (en) * | 2010-09-15 | 2013-08-08 | Olympus Corporation | Imaging apparatus, imaging method, and recording medium |
| US20120194709A1 (en) * | 2011-01-31 | 2012-08-02 | Sanyo Electric Co., Ltd. | Image pickup apparatus |
| US20130070145A1 (en) * | 2011-09-20 | 2013-03-21 | Canon Kabushiki Kaisha | Image capturing apparatus and control method thereof |
| US20140219576A1 (en) * | 2013-02-01 | 2014-08-07 | Canon Kabushiki Kaisha | Image processing apparatus and control method thereof |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9621810B2 (en) * | 2014-02-25 | 2017-04-11 | Samsung Electronics Co., Ltd. | Method and apparatus for displaying image |
| US20150242982A1 (en) * | 2014-02-25 | 2015-08-27 | Samsung Electronics Co., Ltd. | Method and apparatus for displaying image |
| US20150277092A1 (en) * | 2014-03-27 | 2015-10-01 | The Board Of Trustees Of The Leland Stanford Junior University | Phase mask imaging |
| US9810893B2 (en) * | 2014-03-27 | 2017-11-07 | The Board Of Trustees Of The Leland Stanford Junior University | Phase mask imaging with characterization of rotational mobility |
| US10574970B2 (en) | 2015-03-16 | 2020-02-25 | SZ DJI Technology Co., Ltd. | Apparatus and method for focal length adjustment and depth map determination |
| CN107409205A (en) * | 2015-03-16 | 2017-11-28 | 深圳市大疆创新科技有限公司 | Device and method for focus adjustment and depth map determination |
| US10999499B2 (en) * | 2015-03-25 | 2021-05-04 | Avaya, Inc. | Background replacement from video images captured by a plenoptic camera |
| US10721390B2 (en) * | 2016-04-18 | 2020-07-21 | Moonlightning Industries Ab | Focus pulling with distance information from a secondary camera system |
| US10868954B2 (en) | 2017-03-24 | 2020-12-15 | Samsung Electronics Co., Ltd. | Electronic device for providing graphic indicator for focus and method of operating electronic device |
| EP3379821A1 (en) * | 2017-03-24 | 2018-09-26 | Samsung Electronics Co., Ltd. | Electronic device for providing graphic indicator for focus and method of operating electronic device |
| US20210349616A1 (en) * | 2017-04-26 | 2021-11-11 | Samsung Electronics Co., Ltd. | Electronic device and method for electronic device displaying image |
| US11604574B2 (en) * | 2017-04-26 | 2023-03-14 | Samsung Electronics Co., Ltd. | Electronic device and method for electronic device displaying image |
| US20190007590A1 (en) * | 2017-05-25 | 2019-01-03 | Eys3D Microelectronics, Co. | Image processor and related image system |
| US10805514B2 (en) * | 2017-05-25 | 2020-10-13 | Eys3D Microelectronics, Co. | Image processor and related image system |
| CN109087235A (en) * | 2017-05-25 | 2018-12-25 | 钰立微电子股份有限公司 | Image processor and related image system |
| CN110602397A (en) * | 2019-09-16 | 2019-12-20 | RealMe重庆移动通信有限公司 | Image processing method, device, terminal and storage medium |
| CN120769181A (en) * | 2024-05-27 | 2025-10-10 | 荣耀终端股份有限公司 | Image processing method and device |
| WO2026050064A1 (en) * | 2024-08-30 | 2026-03-05 | Zebra Technologies Corporation | Intelligent focus adjustment of a variable focus imaging assembly |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7590612B2 (en) | User interface for capturing and managing visual media | |
| AU2021254567C1 (en) | User interfaces for capturing and managing visual media | |
| US20240080543A1 (en) | User interfaces for camera management | |
| EP4358501B1 (en) | Wallpaper display method, electronic device and storage medium | |
| KR102381985B1 (en) | User interface for camera effects | |
| US9973677B2 (en) | Refocusable images | |
| EP3128411B1 (en) | Interface display method, terminal, computer program and recording medium | |
| US10290120B2 (en) | Color analysis and control using an electronic mobile device transparent display screen | |
| CN111783175A (en) | Display interface privacy protection method, terminal and computer-readable storage medium | |
| WO2019095235A1 (en) | Display method and device, and terminal | |
| US11627244B1 (en) | Synchronization of camera focus movement control with frame capture | |
| US20150009363A1 (en) | Video tagging method | |
| US9350918B1 (en) | Gesture control for managing an image view display | |
| US10585485B1 (en) | Controlling content zoom level based on user head movement | |
| US20240177272A1 (en) | Image processing method and apparatus, and electronic device and storage medium | |
| WO2019095811A1 (en) | Interface display method and apparatus | |
| CN107783704B (en) | Image effect adjustment method, device and terminal | |
| CN106293398B (en) | Method, device and terminal for recommending virtual reality resources | |
| CN114245015B (en) | A shooting prompt method, device, electronic device and medium | |
| CN109683779B (en) | Mobile terminal and interaction method thereof | |
| HK40053997A (en) | Information display method and apparatus, device and storage medium | |
| HK40027364A (en) | Method and apparatus for editing social circle message, device and medium | |
| CN113536167A (en) | Information display method, device, device and storage medium | |
| HK40025595A (en) | Information display method and device, apparatus, and storage medium | |
| HK1250402A1 (en) | Method and device for displaying the interface |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: HTC CORPORATION, TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:CHANG, RUEY-JER;CHU, LUN-CHENG;CHIANG, CHI-PANG;AND OTHERS;REEL/FRAME:030760/0941 Effective date: 20130704 |
|
| STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |