US20130021489A1 - Regional Image Processing in an Image Capture Device - Google Patents
Regional Image Processing in an Image Capture Device Download PDFInfo
- Publication number
- US20130021489A1 US20130021489A1 US13/245,941 US201113245941A US2013021489A1 US 20130021489 A1 US20130021489 A1 US 20130021489A1 US 201113245941 A US201113245941 A US 201113245941A US 2013021489 A1 US2013021489 A1 US 2013021489A1
- Authority
- US
- United States
- Prior art keywords
- region
- image
- capture device
- logic
- image capture
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000012545 processing Methods 0.000 title claims abstract description 59
- 238000000034 method Methods 0.000 claims abstract description 70
- 230000001815 facial effect Effects 0.000 claims description 4
- 239000000284 extract Substances 0.000 claims 1
- 230000006854 communication Effects 0.000 description 6
- 238000004891 communication Methods 0.000 description 6
- 238000012512 characterization method Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000003909 pattern recognition Methods 0.000 description 2
- 239000004065 semiconductor Substances 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 1
- 230000007175 bidirectional communication Effects 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 238000012805 post-processing Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000013024 troubleshooting Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
- H04N19/139—Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
- H04N19/192—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding the adaptation method, adaptation tool or adaptation type being iterative or recursive
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/436—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation using parallelised computational arrangements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/537—Motion estimation other than block-based
- H04N19/54—Motion estimation other than block-based using feature points or meshes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/56—Motion estimation with initialisation of the vector search, e.g. estimating a good candidate to initiate a search
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/681—Motion detection
- H04N23/6811—Motion detection based on the image signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/68—Control of cameras or camera modules for stable pick-up of the scene, e.g. compensating for camera body vibrations
- H04N23/682—Vibration or motion blur correction
- H04N23/683—Vibration or motion blur correction performed by a processor, e.g. controlling the readout of an image memory
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20172—Image enhancement details
- G06T2207/20201—Motion blur correction
Definitions
- Image capture devices can apply various image processing techniques. These techniques can be applied globally or, in other words, to an entire image. Images captured by an image capture device can often contain various objects and/or subjects such that application of a single image processing technique to the entirety of the image can result in a less than desirable result.
- FIGS. 1A-1B are drawings of a mobile device incorporating an image capture device according to various embodiments of the disclosure.
- FIG. 2 is a drawing of an image capture device that can be incorporated into the mobile device of FIG. 1 according to various embodiments of the disclosure.
- FIGS. 3-4 are drawings of an example image that can be captured and processed by an image capture device of FIG. 2 according to various embodiments of the disclosure.
- FIG. 5 is a flowchart depicting one example of a process that can be executed in an image capture device according to various embodiments of the disclosure.
- Embodiments of the present disclosure relate to systems and methods that can be executed in an image capture device. More specifically, embodiments of the present disclosure further comprise tailored regional image processing techniques applied to various regions of an image based at least upon an identification and characterization of various image elements and/or objects that can be isolated within the captured imagery and/or video.
- An image capture device can include a camera, video camera, a mobile device with an integrated image capture device, or other devices suitable to capturing imagery and/or video as can be appreciated.
- an image capture device according to an embodiment of the disclosure can include a device such as a smartphone, tablet computing system, laptop computer, desktop computer, or any other computing device that has the capability to receive and/or capture imagery via image capture hardware.
- image capture device hardware can include components such as lenses, image sensors (e.g., charge coupled devices, CMOS image sensor, etc.), processor(s), image signal processor(s), a main processor, memory, mass storage, or any other hardware or software components that can facilitate capture of imagery and/or video.
- an image signal processor can be incorporated as a part of a main processor in an image capture device module that is in turn incorporated into a device having its own processor, memory and other components.
- An image capture device can provide a user interface via a display that is integrated into the image capture device.
- the display can be integrated with a mobile device, such as a smartphone and/or tablet computing device, and can include a touchscreen input device (e.g., a capacitive touchscreen, etc.) with which a user may interact with the user interface that is presented thereon.
- the image capture device hardware can also include one or more buttons, dials, toggles, switches, or other input devices with which the user can interact with software executed in the image capture device.
- FIGS. 1A-1B show a mobile device 102 that can comprise and/or incorporate an image capture device according to various embodiments of the disclosure.
- the mobile device 102 may comprise, for example, a processor-based system, such as a computer system.
- a computer system may be embodied in the form of a desktop computer, a laptop computer, a personal digital assistant, a mobile device (e.g., cellular telephone, smart phone, etc.), tablet computing system, set-top box, music players, or other devices with like capability.
- the mobile device can include, for example, an image capture device 104 , which can further include a lens system as well as other hardware components that can be integrated with the device to facilitate image capture.
- the mobile device 102 can also include a display device 141 upon which various content and other user interfaces may be rendered.
- the mobile device 102 can also include one or more input devices with which a user can interact with a user interface rendered on the display device 141 .
- the mobile device 102 can include or be in communication with a mouse, touch input device (e.g., capacitive and/or resistive touchscreen incorporated with the display device 141 ), keyboard, or other input devices.
- the mobile device 102 may be configured to execute various applications, such as a camera application that can interact with an image capture module that includes various hardware and/or software components that facilitate capture and/or storage of images and/or video.
- the camera application can interact with application programming interfaces (API's) and/or other software libraries and/or drivers that are provided for the purpose interacting with image capture hardware, such as the lens system and other image capture hardware.
- API's application programming interfaces
- the camera application can be a special purpose application, a plug-in or executable library, one or more API's, image control algorithms, image capture device firmware, or other software that can facilitate communication with image capture hardware in communication with the mobile device 102 .
- a camera application according to embodiments of the present disclosure can capture imagery and/or video via the various image capture hardware as well as facilitate storage of the captured imagery and/or video in memory and/or mass storage associated with the mobile device 102 .
- FIG. 2 illustrates an embodiment of the various image capture components, or one example of an image capture device 104 , that can be incorporated in the mobile device 102 illustrated in FIGS. 1A-1B .
- an image capture device according to an embodiment of the disclosure more generally comprises an image capture device that can provide images in digital form.
- the image capture device 104 includes a lens system 200 that conveys images of viewed scenes to an image sensor 202 .
- the image sensor 202 comprises a charge-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) sensor that is driven by one or more sensor drivers 204 .
- the analog image signals captured by the sensor 202 are provided to an analog-to-digital (A/D) converter 206 for conversion into binary code that can be processed by a processor 208 .
- the processor can also execute a regional image processing application 151 that can carry out the regional image processing discussed herein.
- the regional image processing application 151 can take the form of API's, control algorithms, or other software accessible to the image capture device 104 and/or a mobile device 102 or other system in which the image capture device 104 is integrated.
- Operation of the sensor driver(s) 204 is controlled through a camera controller 210 that is in bi-directional communication with the processor 208 .
- the controller 210 can control one or more motors 212 that are used to drive the lens system 200 (e.g., to adjust focus, zoom, and/or aperture settings).
- the controller 210 can also communicate with a flash system, user input devices (e.g., buttons, dials, toggles, etc.) or other components associated with the image capture device 104 . Operation of the camera controller 210 may be adjusted through manipulation of a user interface.
- a user interface comprises the various components used to enter selections and commands into the image capture device 104 and therefore can include various buttons as well as a menu system that, for example, is displayed to the user in, for example, a camera application executed on a mobile device 102 and/or on a back panel associated with a standalone digital camera.
- the digital image signals are processed in accordance with instructions from an image signal processor 218 stored in permanent (non-volatile) device memory. Processed (e.g., compressed) images may then be stored in storage memory, such as that contained within a removable solid-state memory card (e.g., Flash memory card).
- the embodiment shown in FIG. 2 further includes a device interface 224 through which the image capture device 104 can communicate with a mobile device or other computing system in which it may be integrated.
- the device interface 224 can allow the image capture device to communicate with a main processor associated with a mobile device as well as memory, mass storage, or other resources associated with the mobile device.
- the device interface 224 can communicate with a mobile device in various communications protocols, and this communication can be facilitated, at a software level, by various device drivers, libraries, API's or other software associated with the image capture device 104 that is executed in the mobile device.
- An image capture device e.g., camera, mobile device with integrated camera, etc.
- processing system can be configured with tailored regional processing that is based at least upon an identification and characterization of various image elements.
- Image and video adjustments associated with prior art image capture systems e.g., post processing outside of the camera or image capture device
- adjusting brightness, tone, color intensity, contrast, gamma, etc., or other aspects of an image generally involves application of such an adjustment to the entire image or sequence of frames in prior art systems.
- the following drawings illustrate various examples of logic that can, alone or in combination, be implemented in an image capture device.
- An image capture device can apply various image processing techniques to various regions of an image that can be associated with a particular region type.
- the identification and characterization of regions within captured imagery as well as application of various image processing techniques can be accomplished via software executed by the processor 208 , the ISP 218 as well as a processor associated with a device in communication with the image capture device 104 . It should be appreciated that the specific implementation and/or embodiments disclosed herein are merely examples.
- FIG. 3 illustrates an example image that can be captured by the image capture device 104 ( FIG. 2 ) according to various embodiments according to the disclosure.
- the image capture device 104 is incorporated into a mobile device 102 , which can execute a camera application that renders a user interface for display on a display device associated with the mobile device 102 .
- FIG. 3 additionally illustrates how an image capture device according to the disclosure can apply regional image processing techniques to potentially enhance the visual appeal of an image and/or video captured by the image capture device.
- Prior art image capture devices may identify a scene represented by an image and apply an image processing technique globally (e.g., to the image in its entirety). Accordingly, embodiments of the disclosure can identify various regions in an image, characterize the region by associating the region with a known region type, and selectively apply image processing techniques to the various identified regions based at least upon their region types.
- FIG. 3 illustrates an example of an image 300 that can be captured by the image capture device.
- the image 300 can be captured via a camera application executed on a mobile device where the camera application is configured to communicate with API's associated with the image capture device for the purposes of initiating capture of imagery, display of imagery on a display of the mobile device as well as storage of captured imagery in the form of still images and/or video in memory or mass storage associated with the mobile device.
- the example image 300 can include various objects and/or regions that can be identified by employing image recognition, pattern recognition, and other techniques that can be utilized to identify and/or isolate certain regions from others within the image 300 .
- FIG. 4 continues the example of FIG. 3 by illustrating an example of the various regions that can be identified in an image captured by an image capture device.
- the image capture device can initiate an analysis of the image 300 upon capture.
- the image capture device can identify various regions 302 , 304 , 306 , 308 , 310 of the image by employing various image recognition and/or pattern recognition techniques.
- the image capture device can identify edges that are depicted in the image and identify the region of the image within the various edges as a region.
- the image capture device can also analyze color properties, lighting properties, or any other properties of the various portions of an image to isolate the various regions. Accordingly, the image capture device can maintain or reference a region library that defines the various properties associated with known region types.
- the region library can specify various parameters or parameter ranges, which can include color, shape, size, etc., that correspond to various known region types.
- the image capture device can calculate a signature corresponding to the region and determine whether the calculated signature corresponds to or is within a range of a signature specified by the region library.
- the region library can specify parameters and/or signatures corresponding to various region types, which can include, but are not limited to, a landscape region, a portrait region, a low light region, a fireworks region, a backlight region, a high motion region, a facial region, or any other region for which various image parameters and/or ranges of parameters can be defined.
- the image capture device can employ facial recognition algorithms to isolate and/or determine whether a region in the image 300 corresponds to a human face.
- the image capture device can determine whether region 302 corresponds to a human face by analyzing its relative size, color, shape, and other properties as can be appreciated. Accordingly, the image capture device can associate region 302 with a region type corresponding to a human face or head.
- the image capture device can employ the various image recognition techniques to determine whether a portion of the image corresponds to a background and/or sky region type.
- the image capture device can determine whether region 304 corresponds to a set of parameter and/or parameter ranges specified by a region library as associated with a sky.
- the image capture device can also calculate a confidence score that is based at least upon how closely a region isolated in the image 300 matches the parameters associated with a known region type specified by the region library. In other words, the image capture device can isolate the various regions of an image and characterize certain regions as a known region type of the parameters specified by the region library are within a certain range.
- the image capture device can isolate other regions 306 , 308 , 310 as well as other regions correspond to known region types in a region library.
- the region library can be stored in memory associated with a mobile device with which the image capture device is integrated, in memory associated with the image capture device, hard coded into the processor and/or ISP of the image capture device, or provided in other ways as can be appreciated.
- the image capture device can apply various image processing techniques that can be associated with the region types.
- Image processing techniques can include, but are not limited to, adjusting color levels, sharpness, brightness, contrast, or any other parameter or property associated with a region of the image.
- An image processing technique can also include, but is not limited to, the application of one or more signal processing techniques, filters, or any other process that receives as an input image data associated with a region and outputs image data that is altered or modified in some form.
- one or more image processing techniques can be associated with a known region type corresponding to a human face and applied only to the region 302 corresponding to the face rather than globally to the entire image 300 . Accordingly, the image capture device can apply smoothing, blemish removal, or other image processing techniques to the facial region 302 .
- the image capture device can employ various image recognition techniques to determine whether a portion of the image 300 corresponds to a background or sky region.
- the image capture device can determine whether region 304 corresponds to a sky region and apply image processing techniques specific to such a region type only to the region 304 .
- these image processing techniques can include color enhancement, adjustment of various color levels, modifying sharpness, contrast, application of one or more image filters, or other image processing techniques as can be appreciated.
- the image processing techniques associated with a particular region type can be preconfigured so that the image capture device applies these image processing techniques only to the region types that are identified within the image 300 rather than to the entire image 300 globally.
- the image capture device can also determine whether the other regions 306 , 308 , 310 correspond to other region types for which image processing techniques are defined and apply the preconfigured image processing techniques that are associated with the identified region types to these regions.
- the image capture device can calculate a confidence score that is associated with an identification of a region type in an image. Accordingly, the image capture device can apply the image processing techniques to an identified region at higher levels when a confidence score associated with identification of the region type is higher. In other words, the image capture device can more aggressively apply image processing techniques associated with a region type when a confidence score reflects a high degree of confidence that identification of a region is accurate. Additionally, in the case of video captured by the image capture device, the image capture device can employ the same techniques described above to each frame associated with a video. In some embodiments, the image capture device can apply the image processing techniques to a sampling of frames associated with a video. Additionally, the image capture device can employ object tracking techniques to track a particular object throughout the various frames of a video so that the same image processing techniques are applied to the object in the various video frames.
- the image capture device can apply the image processing techniques that are associated with identified regions in an image and/or video frames by modifying the captured image data prior to storage in memory and/or a mass storage device.
- the image capture device can record the image processing techniques that are applied in meta data associated with the image while retaining the originally captured image data.
- a camera application or other software generating a user interface associated with content captured by the image capture device can display either the originally captured image data or the image after application of the image processing techniques.
- FIG. 5 shown is a flowchart that provides one example of the operation of a portion of a regional image processing application 151 executed by an image capture device 104 , a mobile device 102 or any other device in which an image capture device 104 is integrated according to various embodiments of the disclosure. It is understood that the flowchart of FIG. 5 provides merely an example of the many different types of functional arrangements that may be employed to implement the operation of the portion of logic employed by the image capture device as described herein. As an alternative, the flowchart of FIG. 5 may be viewed as depicting an example of steps of a method implemented in a computing device, processor, or other circuits according to one or more embodiments.
- image capture can be initiated in the image capture device so that one or more images are captured by the lens system, image sensor, and other image capture device hardware as discussed above.
- the image capture device can isolate a region within the captured imagery.
- the image capture device can associate the isolated region with an image type. If a region type can be identified, then in box 507 the image capture device can apply image processing techniques that can be preconfigured as associated with the identified region type.
- the image capture device can determine whether there are additional regions to be processed in the captured image and repeat the process if so.
- Embodiments of the present disclosure can be implemented in various devices, for example, having a processor, memory as well as image capture hardware that can be coupled to a local interface.
- the logic described herein can be executable by one or more processors integrated with a device.
- an application executed in a computing device such as a mobile device, can invoke API's that provide the logic described herein as well as facilitate interaction with image capture hardware.
- any component discussed herein is implemented in the form of software, any one of a number of programming languages may be employed such as, for example, processor specific assembler languages, C, C++, C#, Objective C, Java, Javascript, Perl, PHP, Visual Basic, Python, Ruby, Delphi, Flash, or other programming languages.
- executable means a program file that is in a form that can ultimately be run by a processor.
- executable programs may be, for example, a compiled program that can be translated into machine code in a format that can be loaded into a random access portion of memory and run by a processor, source code that may be expressed in proper format such as object code that is capable of being loaded into a random access portion of the memory and executed by the processor, or source code that may be interpreted by another executable program to generate instructions in a random access portion of the memory to be executed by the processor, etc.
- An executable program may be stored in any portion or component of the memory including, for example, random access memory (RAM), read-only memory (ROM), hard drive, solid-state drive, USB flash drive, memory card, optical disc such as compact disc (CD) or digital versatile disc (DVD), floppy disk, magnetic tape, or other memory components.
- RAM random access memory
- ROM read-only memory
- hard drive solid-state drive
- USB flash drive USB flash drive
- memory card such as compact disc (CD) or digital versatile disc (DVD), floppy disk, magnetic tape, or other memory components.
- CD compact disc
- DVD digital versatile disc
- each block may represent a module, segment, or portion of code that comprises program instructions to implement the specified logical function(s).
- the program instructions may be embodied in the form of source code that comprises human-readable statements written in a programming language or machine code that comprises numerical instructions recognizable by a suitable execution system such as a processor in a computer system or other system.
- the machine code may be converted from the source code, etc.
- each block may represent a circuit or a number of interconnected circuits to implement the specified logical function(s).
- FIG. 5 shows a specific order of execution, it is understood that the order of execution may differ from that which is depicted. For example, the order of execution of two or more blocks may be scrambled relative to the order shown. Also, two or more blocks shown in succession in FIG. 5 may be executed concurrently or with partial concurrence. Further, in some embodiments, one or more of the blocks shown in FIG. 5 may be skipped or omitted. In addition, any number of counters, state variables, warning semaphores, or messages might be added to the logical flow described herein, for purposes of enhanced utility, accounting, performance measurement, or providing troubleshooting aids, etc. It is understood that all such variations are within the scope of the present disclosure.
- any logic or application described herein that comprises software or code can be embodied in any non-transitory computer-readable medium for use by or in connection with an instruction execution system such as, for example, a processor in a computer device or other system.
- the logic may comprise, for example, statements including instructions and declarations that can be fetched from the computer-readable medium and executed by the instruction execution system.
- a “computer-readable medium” can be any medium that can contain, store, or maintain the logic or application described herein for use by or in connection with the instruction execution system.
- the computer-readable medium can comprise any one of many physical media such as, for example, magnetic, optical, or semiconductor media.
- a suitable computer-readable medium would include, but are not limited to, magnetic tapes, magnetic floppy diskettes, magnetic hard drives, memory cards, solid-state drives, USB flash drives, or optical discs.
- the computer-readable medium may be a random access memory (RAM) including, for example, static random access memory (SRAM) and dynamic random access memory (DRAM), or magnetic random access memory (MRAM).
- the computer-readable medium may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or other type of memory device.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computing Systems (AREA)
- Studio Devices (AREA)
- Image Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
- This application claims priority to co-pending U.S. provisional application entitled, “Image Capture Device Systems and Methods,” having Ser. No. 61/509,747, filed Jul. 20, 2011, which is entirely incorporated herein by reference.
- Image capture devices (e.g., still cameras, video cameras, etc.) can apply various image processing techniques. These techniques can be applied globally or, in other words, to an entire image. Images captured by an image capture device can often contain various objects and/or subjects such that application of a single image processing technique to the entirety of the image can result in a less than desirable result.
- Many aspects of the invention can be better understood with reference to the following drawings. The components in the drawings are not necessarily to scale, emphasis instead being placed upon clearly illustrating the principles of the present invention. Moreover, in the drawings, like reference numerals designate corresponding parts throughout the several views.
-
FIGS. 1A-1B are drawings of a mobile device incorporating an image capture device according to various embodiments of the disclosure. -
FIG. 2 is a drawing of an image capture device that can be incorporated into the mobile device ofFIG. 1 according to various embodiments of the disclosure. -
FIGS. 3-4 are drawings of an example image that can be captured and processed by an image capture device ofFIG. 2 according to various embodiments of the disclosure. -
FIG. 5 is a flowchart depicting one example of a process that can be executed in an image capture device according to various embodiments of the disclosure. - Embodiments of the present disclosure relate to systems and methods that can be executed in an image capture device. More specifically, embodiments of the present disclosure further comprise tailored regional image processing techniques applied to various regions of an image based at least upon an identification and characterization of various image elements and/or objects that can be isolated within the captured imagery and/or video. An image capture device can include a camera, video camera, a mobile device with an integrated image capture device, or other devices suitable to capturing imagery and/or video as can be appreciated. In some embodiments, an image capture device according to an embodiment of the disclosure can include a device such as a smartphone, tablet computing system, laptop computer, desktop computer, or any other computing device that has the capability to receive and/or capture imagery via image capture hardware.
- Accordingly, image capture device hardware can include components such as lenses, image sensors (e.g., charge coupled devices, CMOS image sensor, etc.), processor(s), image signal processor(s), a main processor, memory, mass storage, or any other hardware or software components that can facilitate capture of imagery and/or video. In some embodiments, an image signal processor can be incorporated as a part of a main processor in an image capture device module that is in turn incorporated into a device having its own processor, memory and other components.
- An image capture device according to an embodiment of the disclosure can provide a user interface via a display that is integrated into the image capture device. The display can be integrated with a mobile device, such as a smartphone and/or tablet computing device, and can include a touchscreen input device (e.g., a capacitive touchscreen, etc.) with which a user may interact with the user interface that is presented thereon. The image capture device hardware can also include one or more buttons, dials, toggles, switches, or other input devices with which the user can interact with software executed in the image capture device.
- Referring now to the drawings,
FIGS. 1A-1B show amobile device 102 that can comprise and/or incorporate an image capture device according to various embodiments of the disclosure. Themobile device 102 may comprise, for example, a processor-based system, such as a computer system. Such a computer system may be embodied in the form of a desktop computer, a laptop computer, a personal digital assistant, a mobile device (e.g., cellular telephone, smart phone, etc.), tablet computing system, set-top box, music players, or other devices with like capability. The mobile device can include, for example, animage capture device 104, which can further include a lens system as well as other hardware components that can be integrated with the device to facilitate image capture. Themobile device 102 can also include adisplay device 141 upon which various content and other user interfaces may be rendered. Themobile device 102 can also include one or more input devices with which a user can interact with a user interface rendered on thedisplay device 141. For example, themobile device 102 can include or be in communication with a mouse, touch input device (e.g., capacitive and/or resistive touchscreen incorporated with the display device 141), keyboard, or other input devices. - The
mobile device 102 may be configured to execute various applications, such as a camera application that can interact with an image capture module that includes various hardware and/or software components that facilitate capture and/or storage of images and/or video. In one embodiment, the camera application can interact with application programming interfaces (API's) and/or other software libraries and/or drivers that are provided for the purpose interacting with image capture hardware, such as the lens system and other image capture hardware. The camera application can be a special purpose application, a plug-in or executable library, one or more API's, image control algorithms, image capture device firmware, or other software that can facilitate communication with image capture hardware in communication with themobile device 102. Accordingly, a camera application according to embodiments of the present disclosure can capture imagery and/or video via the various image capture hardware as well as facilitate storage of the captured imagery and/or video in memory and/or mass storage associated with themobile device 102. -
FIG. 2 illustrates an embodiment of the various image capture components, or one example of animage capture device 104, that can be incorporated in themobile device 102 illustrated inFIGS. 1A-1B . Although one implementation is shown inFIG. 2 and described herein, an image capture device according to an embodiment of the disclosure more generally comprises an image capture device that can provide images in digital form. - The
image capture device 104 includes alens system 200 that conveys images of viewed scenes to animage sensor 202. By way of example, theimage sensor 202 comprises a charge-coupled device (CCD) or a complementary metal oxide semiconductor (CMOS) sensor that is driven by one ormore sensor drivers 204. The analog image signals captured by thesensor 202 are provided to an analog-to-digital (A/D)converter 206 for conversion into binary code that can be processed by aprocessor 208. The processor can also execute a regionalimage processing application 151 that can carry out the regional image processing discussed herein. In some embodiments, the regionalimage processing application 151 can take the form of API's, control algorithms, or other software accessible to theimage capture device 104 and/or amobile device 102 or other system in which theimage capture device 104 is integrated. - Operation of the sensor driver(s) 204 is controlled through a
camera controller 210 that is in bi-directional communication with theprocessor 208. In some embodiments, thecontroller 210 can control one ormore motors 212 that are used to drive the lens system 200 (e.g., to adjust focus, zoom, and/or aperture settings). Thecontroller 210 can also communicate with a flash system, user input devices (e.g., buttons, dials, toggles, etc.) or other components associated with theimage capture device 104. Operation of thecamera controller 210 may be adjusted through manipulation of a user interface. A user interface comprises the various components used to enter selections and commands into theimage capture device 104 and therefore can include various buttons as well as a menu system that, for example, is displayed to the user in, for example, a camera application executed on amobile device 102 and/or on a back panel associated with a standalone digital camera. - The digital image signals are processed in accordance with instructions from an
image signal processor 218 stored in permanent (non-volatile) device memory. Processed (e.g., compressed) images may then be stored in storage memory, such as that contained within a removable solid-state memory card (e.g., Flash memory card). The embodiment shown inFIG. 2 further includes adevice interface 224 through which theimage capture device 104 can communicate with a mobile device or other computing system in which it may be integrated. For example, thedevice interface 224 can allow the image capture device to communicate with a main processor associated with a mobile device as well as memory, mass storage, or other resources associated with the mobile device. Thedevice interface 224 can communicate with a mobile device in various communications protocols, and this communication can be facilitated, at a software level, by various device drivers, libraries, API's or other software associated with theimage capture device 104 that is executed in the mobile device. - An image capture device (e.g., camera, mobile device with integrated camera, etc.) and/or processing system can be configured with tailored regional processing that is based at least upon an identification and characterization of various image elements. Image and video adjustments associated with prior art image capture systems (e.g., post processing outside of the camera or image capture device) is often applied to the entirety of an image. For example, adjusting brightness, tone, color intensity, contrast, gamma, etc., or other aspects of an image generally involves application of such an adjustment to the entire image or sequence of frames in prior art systems. The following drawings illustrate various examples of logic that can, alone or in combination, be implemented in an image capture device.
- An image capture device according to an embodiment of the disclosure can apply various image processing techniques to various regions of an image that can be associated with a particular region type. The identification and characterization of regions within captured imagery as well as application of various image processing techniques can be accomplished via software executed by the
processor 208, theISP 218 as well as a processor associated with a device in communication with theimage capture device 104. It should be appreciated that the specific implementation and/or embodiments disclosed herein are merely examples. - Accordingly, reference is now made to
FIG. 3 , which illustrates an example image that can be captured by the image capture device 104 (FIG. 2 ) according to various embodiments according to the disclosure. In the depicted non-limiting examples ofFIGS. 3-4 , theimage capture device 104 is incorporated into amobile device 102, which can execute a camera application that renders a user interface for display on a display device associated with themobile device 102. It should be appreciated that this is only one non-limiting illustrative implementation.FIG. 3 additionally illustrates how an image capture device according to the disclosure can apply regional image processing techniques to potentially enhance the visual appeal of an image and/or video captured by the image capture device. Prior art image capture devices may identify a scene represented by an image and apply an image processing technique globally (e.g., to the image in its entirety). Accordingly, embodiments of the disclosure can identify various regions in an image, characterize the region by associating the region with a known region type, and selectively apply image processing techniques to the various identified regions based at least upon their region types. - Therefore,
FIG. 3 illustrates an example of animage 300 that can be captured by the image capture device. As one example, theimage 300 can be captured via a camera application executed on a mobile device where the camera application is configured to communicate with API's associated with the image capture device for the purposes of initiating capture of imagery, display of imagery on a display of the mobile device as well as storage of captured imagery in the form of still images and/or video in memory or mass storage associated with the mobile device. Theexample image 300 can include various objects and/or regions that can be identified by employing image recognition, pattern recognition, and other techniques that can be utilized to identify and/or isolate certain regions from others within theimage 300. -
FIG. 4 continues the example ofFIG. 3 by illustrating an example of the various regions that can be identified in an image captured by an image capture device. In the example ofFIG. 4 , the image capture device can initiate an analysis of theimage 300 upon capture. The image capture device can identifyvarious regions - The region library can specify parameters and/or signatures corresponding to various region types, which can include, but are not limited to, a landscape region, a portrait region, a low light region, a fireworks region, a backlight region, a high motion region, a facial region, or any other region for which various image parameters and/or ranges of parameters can be defined.
- In the depicted example, the image capture device can employ facial recognition algorithms to isolate and/or determine whether a region in the
image 300 corresponds to a human face. In the depicted example, the image capture device can determine whetherregion 302 corresponds to a human face by analyzing its relative size, color, shape, and other properties as can be appreciated. Accordingly, the image capture device can associateregion 302 with a region type corresponding to a human face or head. The image capture device can employ the various image recognition techniques to determine whether a portion of the image corresponds to a background and/or sky region type. In the depicted example, the image capture device can determine whetherregion 304 corresponds to a set of parameter and/or parameter ranges specified by a region library as associated with a sky. The image capture device can also calculate a confidence score that is based at least upon how closely a region isolated in theimage 300 matches the parameters associated with a known region type specified by the region library. In other words, the image capture device can isolate the various regions of an image and characterize certain regions as a known region type of the parameters specified by the region library are within a certain range. - Similarly, the image capture device can isolate
other regions - Upon identification of region types associated with the various regions of the image, the image capture device can apply various image processing techniques that can be associated with the region types. Image processing techniques can include, but are not limited to, adjusting color levels, sharpness, brightness, contrast, or any other parameter or property associated with a region of the image. An image processing technique can also include, but is not limited to, the application of one or more signal processing techniques, filters, or any other process that receives as an input image data associated with a region and outputs image data that is altered or modified in some form. For example, one or more image processing techniques can be associated with a known region type corresponding to a human face and applied only to the
region 302 corresponding to the face rather than globally to theentire image 300. Accordingly, the image capture device can apply smoothing, blemish removal, or other image processing techniques to thefacial region 302. - As another example, the image capture device can employ various image recognition techniques to determine whether a portion of the
image 300 corresponds to a background or sky region. In the depicted example, the image capture device can determine whetherregion 304 corresponds to a sky region and apply image processing techniques specific to such a region type only to theregion 304. For example, these image processing techniques can include color enhancement, adjustment of various color levels, modifying sharpness, contrast, application of one or more image filters, or other image processing techniques as can be appreciated. The image processing techniques associated with a particular region type can be preconfigured so that the image capture device applies these image processing techniques only to the region types that are identified within theimage 300 rather than to theentire image 300 globally. Similarly, the image capture device can also determine whether theother regions - Additionally, as noted above, the image capture device can calculate a confidence score that is associated with an identification of a region type in an image. Accordingly, the image capture device can apply the image processing techniques to an identified region at higher levels when a confidence score associated with identification of the region type is higher. In other words, the image capture device can more aggressively apply image processing techniques associated with a region type when a confidence score reflects a high degree of confidence that identification of a region is accurate. Additionally, in the case of video captured by the image capture device, the image capture device can employ the same techniques described above to each frame associated with a video. In some embodiments, the image capture device can apply the image processing techniques to a sampling of frames associated with a video. Additionally, the image capture device can employ object tracking techniques to track a particular object throughout the various frames of a video so that the same image processing techniques are applied to the object in the various video frames.
- In some embodiments, the image capture device can apply the image processing techniques that are associated with identified regions in an image and/or video frames by modifying the captured image data prior to storage in memory and/or a mass storage device. In other embodiments, the image capture device can record the image processing techniques that are applied in meta data associated with the image while retaining the originally captured image data. In such a scenario, a camera application or other software generating a user interface associated with content captured by the image capture device can display either the originally captured image data or the image after application of the image processing techniques.
- Referring next to
FIG. 5 , shown is a flowchart that provides one example of the operation of a portion of a regionalimage processing application 151 executed by animage capture device 104, amobile device 102 or any other device in which animage capture device 104 is integrated according to various embodiments of the disclosure. It is understood that the flowchart ofFIG. 5 provides merely an example of the many different types of functional arrangements that may be employed to implement the operation of the portion of logic employed by the image capture device as described herein. As an alternative, the flowchart ofFIG. 5 may be viewed as depicting an example of steps of a method implemented in a computing device, processor, or other circuits according to one or more embodiments. - First, in
box 501, image capture can be initiated in the image capture device so that one or more images are captured by the lens system, image sensor, and other image capture device hardware as discussed above. Inbox 503, the image capture device can isolate a region within the captured imagery. Inbox 505, the image capture device can associate the isolated region with an image type. If a region type can be identified, then inbox 507 the image capture device can apply image processing techniques that can be preconfigured as associated with the identified region type. Inbox 509, if the image capture device can determine whether there are additional regions to be processed in the captured image and repeat the process if so. - Embodiments of the present disclosure can be implemented in various devices, for example, having a processor, memory as well as image capture hardware that can be coupled to a local interface. The logic described herein can be executable by one or more processors integrated with a device. In one embodiment, an application executed in a computing device, such as a mobile device, can invoke API's that provide the logic described herein as well as facilitate interaction with image capture hardware. Where any component discussed herein is implemented in the form of software, any one of a number of programming languages may be employed such as, for example, processor specific assembler languages, C, C++, C#, Objective C, Java, Javascript, Perl, PHP, Visual Basic, Python, Ruby, Delphi, Flash, or other programming languages.
- As such, these software components can be executable by one or more processors in various devices. In this respect, the term “executable” means a program file that is in a form that can ultimately be run by a processor. Examples of executable programs may be, for example, a compiled program that can be translated into machine code in a format that can be loaded into a random access portion of memory and run by a processor, source code that may be expressed in proper format such as object code that is capable of being loaded into a random access portion of the memory and executed by the processor, or source code that may be interpreted by another executable program to generate instructions in a random access portion of the memory to be executed by the processor, etc. An executable program may be stored in any portion or component of the memory including, for example, random access memory (RAM), read-only memory (ROM), hard drive, solid-state drive, USB flash drive, memory card, optical disc such as compact disc (CD) or digital versatile disc (DVD), floppy disk, magnetic tape, or other memory components.
- Although various logic described herein may be embodied in software or code executed by general purpose hardware as discussed above, as an alternative the same may also be embodied in dedicated hardware or a combination of software/general purpose hardware and dedicated hardware. If embodied in dedicated hardware, each can be implemented as a circuit or state machine that employs any one of or a combination of a number of technologies. These technologies may include, but are not limited to, discrete logic circuits having logic gates for implementing various logic functions upon an application of one or more data signals, application specific integrated circuits having appropriate logic gates, or other components, etc. Such technologies are generally well known by those skilled in the art and, consequently, are not described in detail herein.
- The flowchart of
FIG. 5 shows the functionality and operation of an implementation of portions of an image capture device according to embodiments of the disclosure. If embodied in software, each block may represent a module, segment, or portion of code that comprises program instructions to implement the specified logical function(s). The program instructions may be embodied in the form of source code that comprises human-readable statements written in a programming language or machine code that comprises numerical instructions recognizable by a suitable execution system such as a processor in a computer system or other system. The machine code may be converted from the source code, etc. If embodied in hardware, each block may represent a circuit or a number of interconnected circuits to implement the specified logical function(s). - Although the flowchart of
FIG. 5 shows a specific order of execution, it is understood that the order of execution may differ from that which is depicted. For example, the order of execution of two or more blocks may be scrambled relative to the order shown. Also, two or more blocks shown in succession inFIG. 5 may be executed concurrently or with partial concurrence. Further, in some embodiments, one or more of the blocks shown inFIG. 5 may be skipped or omitted. In addition, any number of counters, state variables, warning semaphores, or messages might be added to the logical flow described herein, for purposes of enhanced utility, accounting, performance measurement, or providing troubleshooting aids, etc. It is understood that all such variations are within the scope of the present disclosure. - Also, any logic or application described herein that comprises software or code can be embodied in any non-transitory computer-readable medium for use by or in connection with an instruction execution system such as, for example, a processor in a computer device or other system. In this sense, the logic may comprise, for example, statements including instructions and declarations that can be fetched from the computer-readable medium and executed by the instruction execution system. In the context of the present disclosure, a “computer-readable medium” can be any medium that can contain, store, or maintain the logic or application described herein for use by or in connection with the instruction execution system. The computer-readable medium can comprise any one of many physical media such as, for example, magnetic, optical, or semiconductor media. More specific examples of a suitable computer-readable medium would include, but are not limited to, magnetic tapes, magnetic floppy diskettes, magnetic hard drives, memory cards, solid-state drives, USB flash drives, or optical discs. Also, the computer-readable medium may be a random access memory (RAM) including, for example, static random access memory (SRAM) and dynamic random access memory (DRAM), or magnetic random access memory (MRAM). In addition, the computer-readable medium may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or other type of memory device.
- It should be emphasized that the above-described embodiments of the present disclosure are merely possible examples of implementations set forth for a clear understanding of the principles of the disclosure. Many variations and modifications may be made to the above-described embodiment(s) without departing substantially from the spirit and principles of the disclosure. All such modifications and variations are intended to be included herein within the scope of this disclosure and protected by the following claims.
Claims (20)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US13/245,941 US20130021489A1 (en) | 2011-07-20 | 2011-09-27 | Regional Image Processing in an Image Capture Device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201161509747P | 2011-07-20 | 2011-07-20 | |
US13/245,941 US20130021489A1 (en) | 2011-07-20 | 2011-09-27 | Regional Image Processing in an Image Capture Device |
Publications (1)
Publication Number | Publication Date |
---|---|
US20130021489A1 true US20130021489A1 (en) | 2013-01-24 |
Family
ID=47555520
Family Applications (9)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/232,045 Abandoned US20130021488A1 (en) | 2011-07-20 | 2011-09-14 | Adjusting Image Capture Device Settings |
US13/232,052 Abandoned US20130021512A1 (en) | 2011-07-20 | 2011-09-14 | Framing of Images in an Image Capture Device |
US13/235,975 Abandoned US20130021504A1 (en) | 2011-07-20 | 2011-09-19 | Multiple image processing |
US13/245,941 Abandoned US20130021489A1 (en) | 2011-07-20 | 2011-09-27 | Regional Image Processing in an Image Capture Device |
US13/281,521 Abandoned US20130021490A1 (en) | 2011-07-20 | 2011-10-26 | Facial Image Processing in an Image Capture Device |
US13/313,345 Abandoned US20130022116A1 (en) | 2011-07-20 | 2011-12-07 | Camera tap transcoder architecture with feed forward encode data |
US13/313,352 Active 2032-01-11 US9092861B2 (en) | 2011-07-20 | 2011-12-07 | Using motion information to assist in image processing |
US13/330,047 Abandoned US20130021484A1 (en) | 2011-07-20 | 2011-12-19 | Dynamic computation of lens shading |
US13/413,863 Abandoned US20130021491A1 (en) | 2011-07-20 | 2012-03-07 | Camera Device Systems and Methods |
Family Applications Before (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/232,045 Abandoned US20130021488A1 (en) | 2011-07-20 | 2011-09-14 | Adjusting Image Capture Device Settings |
US13/232,052 Abandoned US20130021512A1 (en) | 2011-07-20 | 2011-09-14 | Framing of Images in an Image Capture Device |
US13/235,975 Abandoned US20130021504A1 (en) | 2011-07-20 | 2011-09-19 | Multiple image processing |
Family Applications After (5)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/281,521 Abandoned US20130021490A1 (en) | 2011-07-20 | 2011-10-26 | Facial Image Processing in an Image Capture Device |
US13/313,345 Abandoned US20130022116A1 (en) | 2011-07-20 | 2011-12-07 | Camera tap transcoder architecture with feed forward encode data |
US13/313,352 Active 2032-01-11 US9092861B2 (en) | 2011-07-20 | 2011-12-07 | Using motion information to assist in image processing |
US13/330,047 Abandoned US20130021484A1 (en) | 2011-07-20 | 2011-12-19 | Dynamic computation of lens shading |
US13/413,863 Abandoned US20130021491A1 (en) | 2011-07-20 | 2012-03-07 | Camera Device Systems and Methods |
Country Status (1)
Country | Link |
---|---|
US (9) | US20130021488A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130135499A1 (en) * | 2011-11-28 | 2013-05-30 | Yong-Bae Song | Method of eliminating a shutter-lag, camera module, and mobile device having the same |
CN106550227A (en) * | 2016-10-27 | 2017-03-29 | 成都西纬科技有限公司 | A kind of image saturation method of adjustment and device |
Families Citing this family (83)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10116839B2 (en) | 2014-08-14 | 2018-10-30 | Atheer Labs, Inc. | Methods for camera movement compensation for gesture detection and object recognition |
KR100495338B1 (en) | 1997-01-27 | 2005-06-14 | 피터 디. 하랜드 | Coatings, methods and apparatus for reducing reflection from optical substrates |
JP5781351B2 (en) * | 2011-03-30 | 2015-09-24 | 日本アビオニクス株式会社 | Imaging apparatus, pixel output level correction method thereof, infrared camera system, and interchangeable lens system |
JP5778469B2 (en) | 2011-04-28 | 2015-09-16 | 日本アビオニクス株式会社 | Imaging apparatus, image generation method, infrared camera system, and interchangeable lens system |
US9118876B2 (en) * | 2012-03-30 | 2015-08-25 | Verizon Patent And Licensing Inc. | Automatic skin tone calibration for camera images |
US9462255B1 (en) | 2012-04-18 | 2016-10-04 | Amazon Technologies, Inc. | Projection and camera system for augmented reality environment |
US9619036B2 (en) * | 2012-05-11 | 2017-04-11 | Comcast Cable Communications, Llc | System and methods for controlling a user experience |
US9438805B2 (en) * | 2012-06-08 | 2016-09-06 | Sony Corporation | Terminal device and image capturing method |
US8957973B2 (en) * | 2012-06-11 | 2015-02-17 | Omnivision Technologies, Inc. | Shutter release using secondary camera |
US20130335587A1 (en) * | 2012-06-14 | 2013-12-19 | Sony Mobile Communications, Inc. | Terminal device and image capturing method |
TWI498771B (en) * | 2012-07-06 | 2015-09-01 | Pixart Imaging Inc | Gesture recognition system and glasses with gesture recognition function |
KR101917650B1 (en) * | 2012-08-03 | 2019-01-29 | 삼성전자 주식회사 | Method and apparatus for processing a image in camera device |
US9554042B2 (en) * | 2012-09-24 | 2017-01-24 | Google Technology Holdings LLC | Preventing motion artifacts by intelligently disabling video stabilization |
US9286509B1 (en) * | 2012-10-19 | 2016-03-15 | Google Inc. | Image optimization during facial recognition |
JP2014086849A (en) * | 2012-10-23 | 2014-05-12 | Sony Corp | Content acquisition device and program |
US8957988B2 (en) * | 2013-01-23 | 2015-02-17 | Orcam Technologies Ltd. | Apparatus for processing images to prolong battery life |
JP2014176034A (en) * | 2013-03-12 | 2014-09-22 | Ricoh Co Ltd | Video transmission device |
US9552630B2 (en) * | 2013-04-09 | 2017-01-24 | Honeywell International Inc. | Motion deblurring |
US9595083B1 (en) * | 2013-04-16 | 2017-03-14 | Lockheed Martin Corporation | Method and apparatus for image producing with predictions of future positions |
US9916367B2 (en) | 2013-05-03 | 2018-03-13 | Splunk Inc. | Processing system search requests from multiple data stores with overlapping data |
US8738629B1 (en) | 2013-05-03 | 2014-05-27 | Splunk Inc. | External Result Provided process for retrieving data stored using a different configuration or protocol |
US10003792B2 (en) | 2013-05-27 | 2018-06-19 | Microsoft Technology Licensing, Llc | Video encoder for images |
US10796617B2 (en) * | 2013-06-12 | 2020-10-06 | Infineon Technologies Ag | Device, method and system for processing an image data stream |
US9529513B2 (en) * | 2013-08-05 | 2016-12-27 | Microsoft Technology Licensing, Llc | Two-hand interaction with natural user interface |
US9270959B2 (en) | 2013-08-07 | 2016-02-23 | Qualcomm Incorporated | Dynamic color shading correction |
DE112014004664T5 (en) * | 2013-10-09 | 2016-08-18 | Magna Closures Inc. | DISPLAY CONTROL FOR VEHICLE WINDOW |
US9973672B2 (en) | 2013-12-06 | 2018-05-15 | Huawei Device (Dongguan) Co., Ltd. | Photographing for dual-lens device using photographing environment determined using depth estimation |
US10931866B2 (en) | 2014-01-05 | 2021-02-23 | Light Labs Inc. | Methods and apparatus for receiving and storing in a camera a user controllable setting that is used to control composite image generation performed after image capture |
US9251594B2 (en) * | 2014-01-30 | 2016-02-02 | Adobe Systems Incorporated | Cropping boundary simplicity |
US9245347B2 (en) * | 2014-01-30 | 2016-01-26 | Adobe Systems Incorporated | Image Cropping suggestion |
US10121060B2 (en) * | 2014-02-13 | 2018-11-06 | Oath Inc. | Automatic group formation and group detection through media recognition |
KR102128468B1 (en) * | 2014-02-19 | 2020-06-30 | 삼성전자주식회사 | Image Processing Device and Method including a plurality of image signal processors |
CN103841328B (en) * | 2014-02-27 | 2015-03-11 | 深圳市中兴移动通信有限公司 | Low-speed shutter shooting method and device |
WO2015139165A1 (en) | 2014-03-17 | 2015-09-24 | Microsoft Technology Licensing, Llc | Encoder-side decisions for screen content encoding |
US20150297986A1 (en) * | 2014-04-18 | 2015-10-22 | Aquifi, Inc. | Systems and methods for interactive video games with motion dependent gesture inputs |
US10104316B2 (en) * | 2014-05-08 | 2018-10-16 | Sony Corporation | Information processing device and information processing method |
US10051196B2 (en) * | 2014-05-20 | 2018-08-14 | Lenovo (Singapore) Pte. Ltd. | Projecting light at angle corresponding to the field of view of a camera |
US10460544B2 (en) * | 2014-07-03 | 2019-10-29 | Brady Worldwide, Inc. | Lockout/tagout device with non-volatile memory and related system |
WO2016019450A1 (en) * | 2014-08-06 | 2016-02-11 | Warrian Kevin J | Orientation system for image recording devices |
KR102225947B1 (en) * | 2014-10-24 | 2021-03-10 | 엘지전자 주식회사 | Mobile terminal and method for controlling the same |
CN105549302B (en) | 2014-10-31 | 2018-05-08 | 国际商业机器公司 | The coverage suggestion device of photography and vedio recording equipment |
US10334158B2 (en) * | 2014-11-03 | 2019-06-25 | Robert John Gove | Autonomous media capturing |
US20160148648A1 (en) * | 2014-11-20 | 2016-05-26 | Facebook, Inc. | Systems and methods for improving stabilization in time-lapse media content |
WO2016123792A1 (en) | 2015-02-06 | 2016-08-11 | Microsoft Technology Licensing, Llc | Skipping evaluation stages during media encoding |
US11721414B2 (en) * | 2015-03-12 | 2023-08-08 | Walmart Apollo, Llc | Importing structured prescription records from a prescription label on a medication package |
WO2016154123A2 (en) | 2015-03-21 | 2016-09-29 | Mine One Gmbh | Virtual 3d methods, systems and software |
US10853625B2 (en) | 2015-03-21 | 2020-12-01 | Mine One Gmbh | Facial signature methods, systems and software |
US20160316220A1 (en) * | 2015-04-21 | 2016-10-27 | Microsoft Technology Licensing, Llc | Video encoder management strategies |
EP3295372A4 (en) * | 2015-05-12 | 2019-06-12 | Mine One GmbH | Facial signature methods, systems and software |
US10447926B1 (en) | 2015-06-19 | 2019-10-15 | Amazon Technologies, Inc. | Motion estimation based video compression and encoding |
US10165186B1 (en) * | 2015-06-19 | 2018-12-25 | Amazon Technologies, Inc. | Motion estimation based video stabilization for panoramic video from multi-camera capture device |
US10136132B2 (en) | 2015-07-21 | 2018-11-20 | Microsoft Technology Licensing, Llc | Adaptive skip or zero block detection combined with transform size decision |
EP3136726B1 (en) * | 2015-08-27 | 2018-03-07 | Axis AB | Pre-processing of digital images |
US9648223B2 (en) * | 2015-09-04 | 2017-05-09 | Microvision, Inc. | Laser beam scanning assisted autofocus |
US9456195B1 (en) | 2015-10-08 | 2016-09-27 | Dual Aperture International Co. Ltd. | Application programming interface for multi-aperture imaging systems |
US9578221B1 (en) * | 2016-01-05 | 2017-02-21 | International Business Machines Corporation | Camera field of view visualizer |
JP6514140B2 (en) * | 2016-03-17 | 2019-05-15 | 株式会社東芝 | Imaging support apparatus, method and program |
WO2017205597A1 (en) * | 2016-05-25 | 2017-11-30 | Gopro, Inc. | Image signal processing-based encoding hints for motion estimation |
US9639935B1 (en) | 2016-05-25 | 2017-05-02 | Gopro, Inc. | Apparatus and methods for camera alignment model calibration |
EP3466051A1 (en) | 2016-05-25 | 2019-04-10 | GoPro, Inc. | Three-dimensional noise reduction |
US10140776B2 (en) * | 2016-06-13 | 2018-11-27 | Microsoft Technology Licensing, Llc | Altering properties of rendered objects via control points |
US9851842B1 (en) * | 2016-08-10 | 2017-12-26 | Rovi Guides, Inc. | Systems and methods for adjusting display characteristics |
US10366122B2 (en) * | 2016-09-14 | 2019-07-30 | Ants Technology (Hk) Limited. | Methods circuits devices systems and functionally associated machine executable code for generating a searchable real-scene database |
CN109154979A (en) * | 2016-10-26 | 2019-01-04 | 奥康科技有限公司 | For analyzing image and providing the wearable device and method of feedback |
US10477064B2 (en) | 2017-08-21 | 2019-11-12 | Gopro, Inc. | Image stitching with electronic rolling shutter correction |
US10791265B1 (en) | 2017-10-13 | 2020-09-29 | State Farm Mutual Automobile Insurance Company | Systems and methods for model-based analysis of damage to a vehicle |
US11587046B1 (en) | 2017-10-25 | 2023-02-21 | State Farm Mutual Automobile Insurance Company | Systems and methods for performing repairs to a vehicle |
WO2019082628A1 (en) * | 2017-10-26 | 2019-05-02 | 京セラ株式会社 | Image processing device, image capturing device, driving support device, moving body, and image processing method |
JP2020507094A (en) * | 2017-12-25 | 2020-03-05 | 歌爾科技有限公司GoerTek Technology Co., Ltd. | Laser beam scanning display device and augmented reality glasses |
KR20200029270A (en) | 2018-09-10 | 2020-03-18 | 삼성전자주식회사 | Electronic apparatus for recognizing an object and controlling method thereof |
WO2020084999A1 (en) * | 2018-10-25 | 2020-04-30 | ソニー株式会社 | Image processing device, image processing method, and program |
US10771696B2 (en) * | 2018-11-26 | 2020-09-08 | Sony Corporation | Physically based camera motion compensation |
WO2020142471A1 (en) * | 2018-12-30 | 2020-07-09 | Sang Chul Kwon | Foldable mobile phone |
US11289078B2 (en) * | 2019-06-28 | 2022-03-29 | Intel Corporation | Voice controlled camera with AI scene detection for precise focusing |
US10861127B1 (en) * | 2019-09-17 | 2020-12-08 | Gopro, Inc. | Image and video processing using multiple pipelines |
US11064118B1 (en) | 2019-12-18 | 2021-07-13 | Gopro, Inc. | Systems and methods for dynamic stabilization adjustment |
US11006044B1 (en) * | 2020-03-03 | 2021-05-11 | Qualcomm Incorporated | Power-efficient dynamic electronic image stabilization |
US11284157B2 (en) | 2020-06-11 | 2022-03-22 | Rovi Guides, Inc. | Methods and systems facilitating adjustment of multiple variables via a content guidance application |
TWI774039B (en) * | 2020-08-12 | 2022-08-11 | 瑞昱半導體股份有限公司 | System for compensating image with fixed pattern noise |
US11563899B2 (en) * | 2020-08-14 | 2023-01-24 | Raytheon Company | Parallelization technique for gain map generation using overlapping sub-images |
CN114079735B (en) * | 2020-08-19 | 2024-02-23 | 瑞昱半导体股份有限公司 | Image compensation system for fixed image noise |
US11902671B2 (en) * | 2021-12-09 | 2024-02-13 | Fotonation Limited | Vehicle occupant monitoring system including an image acquisition device with a rolling shutter image sensor |
CN117678225A (en) * | 2022-02-07 | 2024-03-08 | 高途乐公司 | Method and apparatus for real-time guided encoding |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20030126622A1 (en) * | 2001-12-27 | 2003-07-03 | Koninklijke Philips Electronics N.V. | Method for efficiently storing the trajectory of tracked objects in video |
US20040086265A1 (en) * | 2001-05-31 | 2004-05-06 | Canon Kabushiki Kaisha | Information storing apparatus and method thereof |
US20040131276A1 (en) * | 2002-12-23 | 2004-07-08 | John Hudson | Region-based image processor |
US20090116702A1 (en) * | 2007-11-07 | 2009-05-07 | Microsoft Corporation | Image Recognition of Content |
US20100034464A1 (en) * | 2008-08-05 | 2010-02-11 | Kabushiki Kaisha Toshiba | Apparatus and method for tracking image |
US20100157084A1 (en) * | 2008-12-18 | 2010-06-24 | Olympus Imaging Corp. | Imaging apparatus and image processing method used in imaging device |
US20120314971A1 (en) * | 2011-06-07 | 2012-12-13 | Microsoft Corporation | Automatic exposure correction of images |
Family Cites Families (41)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100325253B1 (en) * | 1998-05-19 | 2002-03-04 | 미야즈 준이치롯 | Motion vector search method and apparatus |
US6486908B1 (en) * | 1998-05-27 | 2002-11-26 | Industrial Technology Research Institute | Image-based method and system for building spherical panoramas |
US20010047517A1 (en) * | 2000-02-10 | 2001-11-29 | Charilaos Christopoulos | Method and apparatus for intelligent transcoding of multimedia data |
JP2001245303A (en) * | 2000-02-29 | 2001-09-07 | Toshiba Corp | Moving picture coder and moving picture coding method |
US6407680B1 (en) * | 2000-12-22 | 2002-06-18 | Generic Media, Inc. | Distributed on-demand media transcoding system and method |
US7034848B2 (en) * | 2001-01-05 | 2006-04-25 | Hewlett-Packard Development Company, L.P. | System and method for automatically cropping graphical images |
US7801215B2 (en) * | 2001-07-24 | 2010-09-21 | Sasken Communication Technologies Limited | Motion estimation technique for digital video encoding applications |
KR100850705B1 (en) * | 2002-03-09 | 2008-08-06 | 삼성전자주식회사 | Method for adaptive encoding motion image based on the temperal and spatial complexity and apparatus thereof |
JP4275358B2 (en) * | 2002-06-11 | 2009-06-10 | 株式会社日立製作所 | Image information conversion apparatus, bit stream converter, and image information conversion transmission method |
US7259784B2 (en) * | 2002-06-21 | 2007-08-21 | Microsoft Corporation | System and method for camera color calibration and image stitching |
US7711253B2 (en) * | 2002-12-25 | 2010-05-04 | Nikon Corporation | Blur correction camera system |
KR100566290B1 (en) * | 2003-09-18 | 2006-03-30 | 삼성전자주식회사 | Image Scanning Method By Using Scan Table and Discrete Cosine Transform Apparatus adapted it |
JP4123171B2 (en) * | 2004-03-08 | 2008-07-23 | ソニー株式会社 | Method for manufacturing vibration type gyro sensor element, vibration type gyro sensor element, and method for adjusting vibration direction |
WO2005094270A2 (en) * | 2004-03-24 | 2005-10-13 | Sharp Laboratories Of America, Inc. | Methods and systems for a/v input device to diplay networking |
US8315307B2 (en) * | 2004-04-07 | 2012-11-20 | Qualcomm Incorporated | Method and apparatus for frame prediction in hybrid video compression to enable temporal scalability |
US20060109900A1 (en) * | 2004-11-23 | 2006-05-25 | Bo Shen | Image data transcoding |
JP2006203682A (en) * | 2005-01-21 | 2006-08-03 | Nec Corp | Converting device of compression encoding bit stream for moving image at syntax level and moving image communication system |
WO2007044556A2 (en) * | 2005-10-07 | 2007-04-19 | Innovation Management Sciences, L.L.C. | Method and apparatus for scalable video decoder using an enhancement stream |
TW200816798A (en) * | 2006-09-22 | 2008-04-01 | Altek Corp | Method of automatic shooting by using an image recognition technology |
US7843824B2 (en) * | 2007-01-08 | 2010-11-30 | General Instrument Corporation | Method and apparatus for statistically multiplexing services |
US7924316B2 (en) * | 2007-03-14 | 2011-04-12 | Aptina Imaging Corporation | Image feature identification and motion compensation apparatus, systems, and methods |
JP4983917B2 (en) * | 2007-05-23 | 2012-07-25 | 日本電気株式会社 | Moving image distribution system, conversion device, and moving image distribution method |
WO2009017105A1 (en) * | 2007-07-30 | 2009-02-05 | Nec Corporation | Connection terminal, distribution system, conversion method, and program |
US20090060039A1 (en) * | 2007-09-05 | 2009-03-05 | Yasuharu Tanaka | Method and apparatus for compression-encoding moving image |
US8098732B2 (en) * | 2007-10-10 | 2012-01-17 | Sony Corporation | System for and method of transcoding video sequences from a first format to a second format |
US8063942B2 (en) * | 2007-10-19 | 2011-11-22 | Qualcomm Incorporated | Motion assisted image sensor configuration |
JP2009152672A (en) * | 2007-12-18 | 2009-07-09 | Samsung Techwin Co Ltd | Recording apparatus, reproducing apparatus, recording method, reproducing method, and program |
JP5242151B2 (en) * | 2007-12-21 | 2013-07-24 | セミコンダクター・コンポーネンツ・インダストリーズ・リミテッド・ライアビリティ・カンパニー | Vibration correction control circuit and imaging apparatus including the same |
JP2009159359A (en) * | 2007-12-27 | 2009-07-16 | Samsung Techwin Co Ltd | Moving image data encoding apparatus, moving image data decoding apparatus, moving image data encoding method, moving image data decoding method and program |
US20090217338A1 (en) * | 2008-02-25 | 2009-08-27 | Broadcom Corporation | Reception verification/non-reception verification of base/enhancement video layers |
US20090323810A1 (en) * | 2008-06-26 | 2009-12-31 | Mediatek Inc. | Video encoding apparatuses and methods with decoupled data dependency |
US7990421B2 (en) * | 2008-07-18 | 2011-08-02 | Sony Ericsson Mobile Communications Ab | Arrangement and method relating to an image recording device |
US8311115B2 (en) * | 2009-01-29 | 2012-11-13 | Microsoft Corporation | Video encoding using previously calculated motion information |
US20100194851A1 (en) * | 2009-02-03 | 2010-08-05 | Aricent Inc. | Panorama image stitching |
US20100229206A1 (en) * | 2009-03-03 | 2010-09-09 | Viasat, Inc. | Space shifting over forward satellite communication channels |
US8520083B2 (en) * | 2009-03-27 | 2013-08-27 | Canon Kabushiki Kaisha | Method of removing an artefact from an image |
US20100309987A1 (en) * | 2009-06-05 | 2010-12-09 | Apple Inc. | Image acquisition and encoding system |
JP5473536B2 (en) * | 2009-10-28 | 2014-04-16 | 京セラ株式会社 | Portable imaging device with projector function |
US20110170608A1 (en) * | 2010-01-08 | 2011-07-14 | Xun Shi | Method and device for video transcoding using quad-tree based mode selection |
US8681255B2 (en) * | 2010-09-28 | 2014-03-25 | Microsoft Corporation | Integrated low power depth camera and projection device |
US9007428B2 (en) * | 2011-06-01 | 2015-04-14 | Apple Inc. | Motion-based image stitching |
-
2011
- 2011-09-14 US US13/232,045 patent/US20130021488A1/en not_active Abandoned
- 2011-09-14 US US13/232,052 patent/US20130021512A1/en not_active Abandoned
- 2011-09-19 US US13/235,975 patent/US20130021504A1/en not_active Abandoned
- 2011-09-27 US US13/245,941 patent/US20130021489A1/en not_active Abandoned
- 2011-10-26 US US13/281,521 patent/US20130021490A1/en not_active Abandoned
- 2011-12-07 US US13/313,345 patent/US20130022116A1/en not_active Abandoned
- 2011-12-07 US US13/313,352 patent/US9092861B2/en active Active
- 2011-12-19 US US13/330,047 patent/US20130021484A1/en not_active Abandoned
-
2012
- 2012-03-07 US US13/413,863 patent/US20130021491A1/en not_active Abandoned
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040086265A1 (en) * | 2001-05-31 | 2004-05-06 | Canon Kabushiki Kaisha | Information storing apparatus and method thereof |
US20030126622A1 (en) * | 2001-12-27 | 2003-07-03 | Koninklijke Philips Electronics N.V. | Method for efficiently storing the trajectory of tracked objects in video |
US20040131276A1 (en) * | 2002-12-23 | 2004-07-08 | John Hudson | Region-based image processor |
US20090116702A1 (en) * | 2007-11-07 | 2009-05-07 | Microsoft Corporation | Image Recognition of Content |
US20100034464A1 (en) * | 2008-08-05 | 2010-02-11 | Kabushiki Kaisha Toshiba | Apparatus and method for tracking image |
US20100157084A1 (en) * | 2008-12-18 | 2010-06-24 | Olympus Imaging Corp. | Imaging apparatus and image processing method used in imaging device |
US20120314971A1 (en) * | 2011-06-07 | 2012-12-13 | Microsoft Corporation | Automatic exposure correction of images |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20130135499A1 (en) * | 2011-11-28 | 2013-05-30 | Yong-Bae Song | Method of eliminating a shutter-lag, camera module, and mobile device having the same |
US9232125B2 (en) * | 2011-11-28 | 2016-01-05 | Samsung Electronics Co., Ltd. | Method of eliminating a shutter-lag, camera module, and mobile device having the same |
CN106550227A (en) * | 2016-10-27 | 2017-03-29 | 成都西纬科技有限公司 | A kind of image saturation method of adjustment and device |
Also Published As
Publication number | Publication date |
---|---|
US20130021504A1 (en) | 2013-01-24 |
US20130021490A1 (en) | 2013-01-24 |
US20130021484A1 (en) | 2013-01-24 |
US20130022116A1 (en) | 2013-01-24 |
US20130021512A1 (en) | 2013-01-24 |
US20130021488A1 (en) | 2013-01-24 |
US9092861B2 (en) | 2015-07-28 |
US20130021491A1 (en) | 2013-01-24 |
US20130021483A1 (en) | 2013-01-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20130021489A1 (en) | Regional Image Processing in an Image Capture Device | |
US9609221B2 (en) | Image stabilization method and electronic device therefor | |
US9019415B2 (en) | Method and apparatus for dual camera shutter | |
KR101349699B1 (en) | Apparatus and method for extracting and synthesizing image | |
WO2018058934A1 (en) | Photographing method, photographing device and storage medium | |
KR101605771B1 (en) | Digital photographing apparatus, method for controlling the same, and recording medium storing program to execute the method | |
US9092659B2 (en) | Subject determination apparatus that determines whether or not subject is specific subject | |
US8712207B2 (en) | Digital photographing apparatus, method of controlling the same, and recording medium for the method | |
US10382734B2 (en) | Electronic device and color temperature adjusting method | |
US9973687B2 (en) | Capturing apparatus and method for capturing images without moire pattern | |
US9413922B2 (en) | Photographing apparatus and method for synthesizing images | |
US8682024B2 (en) | Apparatus for and method of processing image data | |
CN106464799A (en) | Automatic zooming method and device | |
WO2016004819A1 (en) | Shooting method, shooting device and computer storage medium | |
US20130070143A1 (en) | Display apparatus and method | |
US8582813B2 (en) | Object detection device which detects object based on similarities in different frame images, and object detection method and computer-readable medium recording program | |
US11416974B2 (en) | Image processing method and electronic device supporting the same | |
US9888206B2 (en) | Image capturing control apparatus that enables easy recognition of changes in the length of shooting time and the length of playback time for respective settings, control method of the same, and storage medium | |
US8717491B2 (en) | Auto focusing method, recording medium for recording the method, and auto focusing apparatus | |
KR20150141059A (en) | Apparatus and method for providing thumbnail image of moving picture | |
US9225906B2 (en) | Electronic device having efficient mechanisms for self-portrait image capturing and method for controlling the same | |
US20160127651A1 (en) | Electronic device and method for capturing image using assistant icon | |
US20090190835A1 (en) | Method for capturing image to add enlarged image of specific area to captured image, and imaging apparatus applying the same | |
CN115516495A (en) | Optimizing High Dynamic Range (HDR) image processing based on selection regions | |
KR20120121748A (en) | An apparatus and a method for setting a setting information of a camera using a chart |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: BROADCOM CORPORATION, CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SEWELL, BENJAMIN;PLOWMAN, DAVID;LEE, GORDON (CHONG MING GORDON);AND OTHERS;SIGNING DATES FROM 20110914 TO 20110926;REEL/FRAME:027152/0285 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: BANK OF AMERICA, N.A., AS COLLATERAL AGENT, NORTH CAROLINA Free format text: PATENT SECURITY AGREEMENT;ASSIGNOR:BROADCOM CORPORATION;REEL/FRAME:037806/0001 Effective date: 20160201 Owner name: BANK OF AMERICA, N.A., AS COLLATERAL AGENT, NORTH Free format text: PATENT SECURITY AGREEMENT;ASSIGNOR:BROADCOM CORPORATION;REEL/FRAME:037806/0001 Effective date: 20160201 |
|
AS | Assignment |
Owner name: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD., SINGAPORE Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BROADCOM CORPORATION;REEL/FRAME:041706/0001 Effective date: 20170120 Owner name: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:BROADCOM CORPORATION;REEL/FRAME:041706/0001 Effective date: 20170120 |
|
AS | Assignment |
Owner name: BROADCOM CORPORATION, CALIFORNIA Free format text: TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNOR:BANK OF AMERICA, N.A., AS COLLATERAL AGENT;REEL/FRAME:041712/0001 Effective date: 20170119 |