US20170285922A1 - Systems and methods for creation and sharing of selectively animated digital photos - Google Patents

Systems and methods for creation and sharing of selectively animated digital photos Download PDF

Info

Publication number
US20170285922A1
US20170285922A1 US15/631,673 US201715631673A US2017285922A1 US 20170285922 A1 US20170285922 A1 US 20170285922A1 US 201715631673 A US201715631673 A US 201715631673A US 2017285922 A1 US2017285922 A1 US 2017285922A1
Authority
US
United States
Prior art keywords
animated
user
computer program
mobile
client computer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US15/631,673
Inventor
Philippe Louis Leblanc
Mark Harris Pavlidis
Bretton James Maclean
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
FLIXEL PHOTOS Inc
Original Assignee
FLIXEL PHOTOS Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US201261596908P priority Critical
Priority to PCT/CA2013/000116 priority patent/WO2013116937A1/en
Priority to US201414377732A priority
Application filed by FLIXEL PHOTOS Inc filed Critical FLIXEL PHOTOS Inc
Priority to US15/631,673 priority patent/US20170285922A1/en
Assigned to FLIXEL PHOTOS INC. reassignment FLIXEL PHOTOS INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: PAVLIDIS, MARK HARRIS, LEBLANC, PHILIPPE LOUIS, MACLEAN, BRETTON JAMES
Publication of US20170285922A1 publication Critical patent/US20170285922A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object or an image, setting a parameter value or selecting a range
    • G06F3/04845Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object or an image, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03547Touch pads, in which fingers can move on a surface
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object or an image, setting a parameter value or selecting a range
    • G06F3/04842Selection of a displayed object
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object or an image, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders, dials
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for entering handwritten data, e.g. gestures, text
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T13/00Animation
    • G06T13/802D [Two Dimensional] animation, e.g. using sprites
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00132Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
    • H04N1/00137Transmission
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00132Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
    • H04N1/00148Storage
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00132Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
    • H04N1/00161Viewing or previewing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/00127Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture
    • H04N1/00132Connection or combination of a still picture apparatus with another apparatus, e.g. for storage, processing or transmission of still picture signals or of information associated with a still picture in a digital photofinishing system, i.e. a system where digital photographic images undergo typical photofinishing processing, e.g. printing ordering
    • H04N1/00167Processing or editing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41407Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance embedded in a portable device, e.g. video client on a mobile phone, PDA, laptop
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223Cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/47205End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/472End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4728End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for selecting a Region Of Interest [ROI], e.g. for requesting a higher resolution version of a selected region
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/8146Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics
    • H04N21/8153Monomedia components thereof involving graphical data, e.g. 3D object, 2D graphics comprising still images, e.g. texture, background image
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048Indexing scheme relating to G06F3/048
    • G06F2203/04804Transparency, e.g. transparent or translucent windows
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10016Video; Image sequence
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2213/00Indexing scheme for animation
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2213/00Indexing scheme for animation
    • G06T2213/08Animation software package
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N1/00Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
    • H04N1/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device
    • H04N1/32101Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N1/32144Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title embedded in the image data, i.e. enclosed or integrated in the image, e.g. watermark, super-imposed logo or stamp
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/475End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • H04N21/4755End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data for defining user preferences, e.g. favourite actors or genre
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • H04N21/4882Data services, e.g. news ticker for displaying messages, e.g. warnings, reminders
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device
    • H04N2201/3201Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3261Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of multimedia information, e.g. a sound signal
    • H04N2201/3267Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title of multimedia information, e.g. a sound signal of motion picture signals, e.g. video clip
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device
    • H04N2201/3201Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3273Display
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2201/00Indexing scheme relating to scanning, transmission or reproduction of documents or the like, and to details thereof
    • H04N2201/32Circuits or arrangements for control or supervision between transmitter and receiver or between image input and image output device
    • H04N2201/3201Display, printing, storage or transmission of additional information, e.g. ID code, date and time or title
    • H04N2201/3278Transmission

Abstract

A method of generating distributable and/or shareable selectively animated images comprising the steps of: (a) opening a client computer program, implemented as client computer program loaded on a mobile device; (b) capturing or accessing a video content; (c) using a user interface of the client computer program, a user drawing a path or region on an image frame from the video content to be animated (“animated region”), wherein the client computer program generated based on the animated region a mask, wherein the mask represents the static portion of a selectively animated image, and the mask is operable to mask underlying animated regions; and (d) the client computer program initiating, at the mobile device or via a server linked to the mobile device, the composition of a series of images including user selected animated regions, by rendering an animated image based on mask and the underlying masked animated regions. A computer program is provided for implementing the steps of the method, which may consist of a mobile application. The computer program may include a server application that cooperates with the mobile application for enabling the animated image composition processes and/or distribution and sharing of the animated images. A computer system is provided that includes a mobile device implementing the mobile application and optionally a server implementing the server application.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • The present application is a continuation of U.S. patent application Ser. No. 14/377,732, filed on Aug. 8, 2014, which is incorporated by reference in its entirety. U.S. patent application Ser. No. 14/377,732 is a national phase entry of PCT Application No. PCT/CA2013/000116, filed on Feb. 11, 2013, which is incorporated by reference in its entirety. PCT Application No. PCT/CA2013/000116 and U.S. patent application Ser. No. 14/377,732 claim a priority benefit under 35 U.S.C. §119(e) to U.S. Provisional Patent Application No. 61/596,208, filed on Feb. 9, 2012, which is hereby incorporated by reference in its entirety.
  • FIELD OF THE INVENTION
  • The present invention relates generally to computer systems and more specifically to methods and systems for creation, distribution, and sharing, of digital media content. The present invention relates more specifically to methods and systems for creation, distribution, and sharing of selectively animated digital photos.
  • BACKGROUND OF THE INVENTION
  • People like to take and share photos. There is increased interest in taking photos from mobile devices, and then sharing photos using a mobile device, whether using a mobile application, or by accessing a remote Internet service using a mobile device.
  • There is interest in more, and more engaging, content; especially to meet the demands of consumers for content that is easy to create and to share through their social networks. Social media creates significant demand for content that can be created and shared regularly through social networks, and that is interesting to recipients. The pursuit of a significant social media footprint by a large number of consumers through social networks, and associated business models that target these consumers through social networks, means that digital media platforms that allow consumers to create and share this content easily and efficiently, can be very valuable.
  • Video content in particular is very popular, and this has resulted in the growing interest in interactive content. Creation and consumption of content from a mobile device is advantageous to users who are on the go, and for many activities users do not want to be tethered to a desktop computer. In fact increasingly computer users are mobile computing users. As a result there is growing interest in technologies that enable the creation of content using smart phones and tablet computers for example.
  • A fairly new form of visual content has emerged recently, namely selectively animated photographs sometimes referred to as “cinemagraphs”, “cinegraphs” or “living photographs”. These consist of still photographs in which a selected area is animated or moves. This animation or movement may occur once, or may be repeated. These selectively animated photographs are referred to as “cinemagraphs” in this disclosure.
  • Cinemagraphs generally convey to the viewer the impression that s/he is consuming video. Moreover, design choices as to what portions of an image are animated and which are not can result in very interesting and beautiful compositions, for which there is increasing demand.
  • A number of methods for creating cinemagraphs are known in the art. These generally involve taking a series of photographs or a video recording, and using an image editing computer program to create a seamless loop of sequential image frames, and then using an animated GIF file format for example, to create the animated portions of the living images.
  • There is growing interest in cinemagraphs, however, generally speaking publicly available methods are relatively complicated, and quite time consuming. There is a need for a more streamlined, simpler, and/or shorter method for creating cinemagraphs.
  • Also, conventional methods for creating cinemagraphs generally require the use of computer programs such as PHOTOSHOP™ that typically cannot run on mobile devices, and even on tablet computers operation of such computer programs as PHOTOSHOP™ may not operate optimally.
  • There is a need therefore for a method that enables the creation of cinemagraphs efficiently, and that provides an intuitive workflow that allows consumers to creating beautiful cinemagraphs using a computer device, including a smart phone or a tablet computer. There is a further need for a computer system and a computer program, operable on a mobile device, that enables the creation of cinemagraphs.
  • SUMMARY OF THE INVENTION
  • In one aspect, a method of generating distributable and/or shareable selectively animated images comprises: opening a client computer program, implemented as a client computer program loaded on a mobile device; capturing or accessing video content; a user using a user interface of the client computer program to: (a) select one or more base frames from the video content for use as a still image or images; and (b) draw or paint one or more paths or regions on the one or more base frames so as to select a path or region of the one or more base frames to be animated using moving content from the video content (“animated region(s)”); and compiling one or more parameters related to the animated region(s), and also optionally one or more other parameters generated using one or more editing features or utilities of the client computer program, so as to define a set of instructions for creating selectively animated images within the animated region(s), based on the video content, and the client computer program initiating, at the mobile device or via a server linked to the mobile device, the composition of a series of images including user selected animated regions, by rendering one or more animated images based on the one or more base frames and selected animated region(s).
  • In another aspect, the method comprises the client computer program displaying a mask as an overlay over the one or more base frames, wherein the mask represents the region of the one or more base frames that will remain still, wherein the user draws on or paints on the mask, and thereby removes portions of the mask, and these portions are used to select the animated region(s).
  • In another aspect, the method comprises a further step of displaying to the user a preview of the selective animated images by displaying the one or more base images as a still image or images, and revealing underneath the aligned portions of the moving content in the animated region(s).
  • In a till other aspect, the method comprises the further steps of: playing the video content, while displaying in the background a transparency showing the currently selected one or more base frames; and the user in a selectively animated image creation mode touching selected regions of a touch screen display of the mobile device, thereby initiating the client computer program to display a mask consisting of the one or more base frames, as an overlay to the moving content, thereby permitting the user to touch the touch screen so as to select portions of the mask and thereby selected portions of the one or more base frames for animation.
  • In a still other aspect, the method comprises: dynamically displaying a preview of the current selectively animated images based on the portions of the one or more base frames selected for animation, upon the user ceasing touch input to the selected regions of the touch screen display of the mobile device.
  • In yet another aspect, the method comprises the steps of the user iteratively providing the one or more parameters for the animated region(s) by touching selected regions of the touch screen display and viewing a corresponding preview, until the user provides input to the client computer program indicating completion of the selectively animated images.
  • In a still other aspect, the method comprises the further step of the client computer program automatically analyzing the video content based on one or more parameters for determining whether the video content is suitable for creating selectively animated images.
  • In another aspect, the method comprises the step of initiating from the mobile device, by operation of the client computer program, the distribution and/or sharing of the animated image.
  • In one aspect of the invention, a computer system is provided for generating distributable and/or shareable selectively animated images comprising: one or more server computers being linked to a server computer program; and at least one mobile device linked to the one more server computers, the mobile device implementing a client computer program; the server computer program and the client computer program, when executed: presenting at the mobile device a user interface enabling a user of the mobile device to: select one or more base frames from the video content for use as a still image or images; and draw or paint one or more paths or regions on the one or more base frames so as to select a path or region of the one or more base frames to be animated using moving content from the video content (“animated region(s)”); and compiling one or more parameters related to the animated region(s), and also optionally one or more other parameters generated using one or more editing features or utilities of the client computer program, so as to define a set of instructions for creating selectively animated images within the animated region(s), based on the video content, and the client computer program initiating, at the mobile device or at the one or more server computers, the composition of a series of images including user selected animated regions, by rendering one or more animated images based on the one or more base frames and selected animated region(s).
  • In another aspect of the computer system, client computer program displays a mask as an overlay over the one or more base frames, wherein the mask represents the region of the one or more base frames that will remain still, wherein when executed the client computer program permits the user to draw on or paint on the mask, and thereby remove portions of the mask, and these portions are used to select the animated region(s).
  • In a still other aspect of the computer system, the client computer program when executed displays to the user a preview of the selective animated images by displaying the one or more base images as a still image or images, and revealing underneath the aligned portions of the moving content in the animated region(s).
  • In yet another aspect of the computer system, the client computer program when executed: plays the video content, while displaying in the background a transparency showing the currently selected one or more base frames; and enables the user in a selectively animated image creation mode to touch selected regions of a touch screen display of the mobile device, thereby initiating the client computer program to display a mask consisting of the one or more base frames, as an overlay to the moving content, thereby permitting the user to touch the touch screen so as to select portions of the mask and thereby selected portions of the one or more base frames for animation.
  • In another aspect of the computer system, the client computer program when executed: dynamically displays a preview of the current selectively animated images based on the portions of the one or more base frames selected for animation, upon the user ceasing touch input to the selected regions of the touch screen display of the mobile device.
  • In a still other aspect of the computer system, the client computer program when executed enables the user to iteratively provide the one or more parameters for the animated region(s) by touching selected regions of the touch screen display and viewing a corresponding preview, until the user provides input to the client computer program indicating completion of the selectively animated images.
  • In another aspect of the computer system, the client computer program when executed, based on input from the user, connects to the one or more servers so as to enable the distribution and/or sharing of the selectively images based on one or more user preferences.
  • In this respect, before explaining at least one embodiment of the invention in detail, it is to be understood that the invention is not limited in its application to the details of construction and to the arrangements of the components set forth in the following description or the examples provided therein, or illustrated in the drawings. The invention is capable of other embodiments and of being practiced and carried out in various ways. Also, it is to be understood that the phraseology and terminology employed herein are for the purpose of description and should not be regarded as limiting.
  • DESCRIPTION OF THE DRAWINGS
  • In the drawings, embodiments of the invention are illustrated by way of example. It is to be expressly understood that the description and drawings are only for the purpose of illustration and as an aid to understanding, and are not intended as a definition of the limits of the invention.
  • FIGS. 1-2 are a series of representative screens of the mobile application of the present invention that illustrate the overall method of the invention, and the program workflow for the mobile application of the invention.
  • FIG. 3 illustrates a representative architecture for the system of the present invention.
  • FIG. 4 represents a generic computer implementation of the features of the invention.
  • DETAILED DESCRIPTION
  • In one aspect of the invention, a novel computer system and computer implemented method for generating digital photos with user defined animated regions is provided that is easy and efficient to use, as described below.
  • A computer program for generating digital photos with user defined animated regions is also provided. Conveniently, the computer program described may be implemented as a mobile application; in fact the present invention in large part is explained by referring to a mobile application embodiment of the present invention. It should be understood, however, that the present invention may be implemented as a tablet computer program, and further may also be implemented as an Internet application or a desktop application that provides improved ease of use over prior art solutions for creating similar content. Certain aspects of the invention may also be implemented as one or more hardware/middleware functions of a relevant computer device, such as a mobile device or a tablet computer.
  • The term “mobile device” as used in this disclosure refers to any manner of wireless device including computing resources capable to initiate the functions described and includes for example a smart phone.
  • In regards to the functions described, it should be understood that the various features of the mobile application described may be implemented as part of a client server architecture, where aspects of the mobile application may be implemented to a server application, such that creation of digital photos with user defined animated regions occurs by operation of a server application for example, linked to a server, which server is accessible from the mobile device via an mobile Internet connection for example. The explanation of the invention by reference to operations of the mobile application should not be read as limiting implementation of the invention to a mobile application implementation only.
  • General Description of Product and Computer Implemented Method
  • What follows is a description of possible elements of a computer system of the present invention (including a mobile device), and also possible steps of a computer implemented method of the present invention, based on a particular workflow for creating cinemagraphs in an efficient and engaging way that provides a compelling user experience. A skilled reader will understand that particularly on a mobile device, designing the workflow that is easy to use and appeals to smart phone users in particular requires development of user insights and resolution of technical challenges. As such the invention represents an important contribution to the art.
  • FIGS. 1 and 2 represent an example of implementation of the present invention, and more particularly a possible user interface design for enabling a user to initiate the execution of the computer implemented method of the present invention. FIGS. 1 and 2 more particularly illustrate the operation of the streamlined workflow described below. FIGS. 1 and 2 are also indicative of general elements of a user interface that presents, as described below, on a display of a mobile device (including touch input elements), a base image (or “anchor” image), and touch initiated functionality that allows a user to selectively determine portions of the base image to animate using associated video content.
  • More particularly:
  • (1) A video segment is captured, for example using a camera of a mobile device, in a video capture mode.
  • (2) Optionally, the video segment captured is analyzed to determine whether it meets one or more quality thresholds related to creating a cinemagraph. In one aspect, a threshold is established for video shake, and if shake is detected past the threshold then, in one aspect a signal is displayed to the user. Alternatively, the mobile computer application may be configured so that the recording does not commence until the mobile device is sufficiently still such that the shake threshold is not exceeded. In one aspect of the invention, shake is detected using one or more motion sensors built into the device, the mobile application being configured to access output from the motion sensors, and to apply the mentioned shake threshold. In a still other aspect, the mobile computer application may initiate the capture of video content, because the mobile device is sufficiently still however, the mobile device may commence shaking past the threshold, in which case the mobile computer program may initiate the deletion of the video content at the point in the video where the shaking passed the threshold, and the user is given the option of either using the video segment that is sufficiently still, or rerecording. A skilled reader will understand that other possible features or functions may be used to address the impact of shake on video capture using a mobile device.
  • It should be understood that a number of image stabilization algorithms may be used prior to editing, and for creating user directed animations of digital photos, in order to avoid the drift that otherwise would be noticeable at the boundary of the static and dynamic regions of the digital image.
  • For example a Fast Fourier Transform (FFT) may be used, and more specifically an image stabilization routine may be implemented consisting of:
  • a) applying a Fast Fourier Transform (FFT) on the captured source images;
  • b) For each of the non-base frame images: (A) using the FFTs of the image and the base frame image and computing the Cross Power Spectrum, (B) obtaining the phase correlation by performing IFFT on the result from (A), and (C) offsetting the image by the phase correction, thus aligning it with the base frame.
  • In one aspect, the mobile application may be configured to provide step by step instructions to the user for creating cinemagraphs using the mobile application.
  • Optionally, the mobile application presents a menu that enables the user to pre-select a particular duration for the video. In another particular implementation of the invention, mobile application presents a countdown button showing during the capture of the video the expiry of the selected duration of the video. This feature may help the user to keep the mobile device still during the entire duration of the selected video capture. Various other mechanisms are possible for addressing stability. For example motion sensing features of the mobile device may be used to sense when motion is crossing one or more different thresholds, and if these thresholds are crossed, an indicator may be initiated such as a visual or sound indicator, alerting the user to the need to stabilize the mobile device.
  • (4) The mobile application may generate and display to the user one or more image frames from the video segment. Alternatively, the mobile application may include a slider that enables the user to navigate within the video segment to access image frames extracted from particular points in the video segment. The frame selected is referred to in this disclosure as the “base frame”. A slider or similar tool may also be used to select one or more portions of video content to be used as the moving content to animate the base image.
  • (5) The user of the mobile application selects one or more regions of the base frame for animation, using a suitable input means. In a particular aspect of the present invention, the mobile application implements a masking feature similar for example to the masking metaphor use in PHOTOSHOP™ for other purposes, such that the user “paints” the regions of the base frame that are selected for animation. By “painting” the following is meant: the path of the movement of the user's finger over the image (or of a stylus or other input means), based on touch functionality for example of screen of a mobile device or a tablet computer.
  • In one particular aspect of the invention, the mask is inverted such that it represents the region of the image that will remain static. The base frame image (the image from the set of captured images that will remain static) is masked with the inverted mask so that the animated region is transparent. The set of images are animated underneath the marked base frame image to give the illusion of the final product, thus providing the animated preview feature of the present invention.
  • The selective, and possibly iterative editing of the image, using painting, and then revealing the underlying animation (generated based on the preview feature mentioned) and adjusting the boundaries of the animation as they relate to the still image, provides an easy to use and highly tunable mechanism that translates well to all manner of computer programs, including mobile applications and tablet computer applications. The application of this technique for the purpose of the invention, and also in the manner described in this disclosure, represents a novel and innovative departure from the prior art.
  • In one aspect of the technical implementation of the present invention, a base frame is used as a mask for the underlying animation. Once the cinemagraph is generated, the viewer is viewing the still base frame, and underneath the still base frame selected animated portions of the video, the boundaries of which correspond to the regions of the still base frame “painted” by the user.
  • In a particular implementation, the mobile application is configured to enable the user to select a “paint” button or equivalent, and then using a touch screen interface of the mobile device, using a finger or a stylus, touching the touch screen of the mobile device in a cinemagraph creation mode to “paint” the regions of the base frame for animation. In another possible feature of the present invention, the pinch/unpinch gesture may be used to zoom in and out respective from the base frame to enable more precise definition of the regions selected from animation.
  • In a particular implementation of the invention, the mobile application is configured such that a live animation preview is generated and displayed during the cinemagraph creation phase, in order to provide a preview of the high level view of the appearance of the to be generated cinemagraph. This permits the user to determine whether s/he is happy with the expected cinemagraph, or alternatively whether s/he wishes to modify the selected animation of the image frame, for example, by adjusting contours of the one or more regions for animation. In one implementation, this preview is generated and displayed upon clicking a “PREVIEW” button or equivalent.
  • (6) Once the user has selected the desired animated features (and optionally enhanced the cinemagraph using any other tools provided) the cinemagraph is rendered and stored. The output file is created, for example as an animated GIF based on the set of images. The output file may be generated by the mobile application, or a remote computer (such as an associated server computer and server application) upon receipt of a message containing instructions from the mobile application based on compilation of user instructions for creating the cinemagraph. The output file in the case of iOS may be an animated GIF created using the Core Graphic library. In other platforms other graphics libraries may be used. It should be understood that movie file formats or FLASH™ may also be used to create the selective animations at issue. The output file may also be generated as an HDI file.
  • Possible Streamlined Workflow
  • In another possible aspect of the invention, a streamlined workflow is provided for creating cinemagraphs.
  • The streamlined workflow is based on the use of a solid base frame (or anchor frame) but the video plays in transparency behind it, allowing the user to view the entirety of the video in real time, and still seeing the difference between the anchor frame and the rest of the video. The mobile application allows the user to selectively touch the mobile device's screen to “remove” a mask on touch and reveal underlying selected animated features as shown in FIG. 1. FIG. 1. shows an image of a shoreline, in which the cloud is moving and the waves are moving. A region of the shore and moving waves is selected by a user. In the embodiment of the invention previously described a “preview” feature or equivalent was selected by the user in order to view a cinemagraph preview, in which the partially still, and partially animated (the wave portion being animated) image is generated and presented.
  • In accordance with another aspect of the streamlined workflow, the mobile device includes an automated rendering feature, such that once a region of the mask is removed by the user, to reveal a region that is associated with animated content, the mobile application automatically integrates the selected portion of animated content so as to reveal, dynamically in conjunction with the selection of the animated portions by the user, one or more previews of the cinemagraph generated based on the user's selections. The preview cinemagraph, in one aspect, consists of the mask consisting of the base image and including selectively animated portions, shown in their moving state.
  • In another aspect of the invention, the mobile application includes a touch sensing feature. The touch sensing feature may be operable to determine when a user is touching the touch screen, and then when the user has ceased touching the touch screen. In one particular implementation of the invention, the mobile application is configured such that the cinemagraph preview feature is initiated upon the user, in connection with a cinemagraph creation session that involves touching portions of the image on a touch screen, ceasing to touch the touch screen. The method may be used iteratively so as to view the preview, and—initiating a “back” button or equivalent—redo an aspect of the selection of portions of the image to animate, or by touching an additional portion of the image to select additional portions of the image to animate. This may be repeated until the user selects “STORE CINEMAGRAPH” or equivalent.
  • A skilled reader will understand that this particular feature streamlines the workflow of the mobile application and computer implemented method described to the following steps:
  • (A) a user initiates a cinemagraph creation session;
  • (B) a user is presented a still image in the form of a mask, or a user selects a still image which is presented in the form of a mask;
  • (B) the user, in one or more iterations, selects portions of the still image for animation by rubbing the touch screen to remove selectively portions of the mask; and
  • (D) upon the user ceasing the rubbing of the touch screen in connection with the cinemagraph creation session, a preview cinemagraph showing the still portions and selectively animated portions is generated and presented to the user.
  • More specifically, in one embodiment of the present invention, in the cinemagraph session: (i) the computer system displays the video in full, (ii) with a transparency in the background that shows the currently selected anchor frame while the video is playing (such that at this point no mask is displayed), (iii) upon the user initiating the editing features of the computer system for selectively animating portions of the cinemagraph (which may be triggered by the user touching the display area showing the video during the cinemagraph), the mask appears automatically to aid the user in selecting with precision the regions to be animated, and (iv) as previously described, upon the user removing pressure to the touch screen, the computer automatically shows the final cinemagraph without the mask and with only the selected regions moving.
  • In a further possible implementation of the present invention the transparency in the background may be implemented by showing a currently selected anchor frame without, or with close to no, opacity while the video segment is played with a reduced opacity. In a further example of implementation, the anchor frame is displayed at around 100% clarity (i.e. no opacity or close to no opacity), and the video segment is played at around 50% opacity. Given that the anchor frame and the video segment are aligned, the user receives visual indication as to the nature and extent of the motion prior to painting or drawing. Thereafter, for example even if the user draws one line, and disengages from the touch screen, the transparency effect disappears and the cinemagraph (or cinemagraph created to this point) is shown in a preview.
  • Once the user is satisfied with the result, the cinemagraph may be rendered, either on the mobile device or in the cloud.
  • A skilled reader will understand that the process described is very intuitive, and permits the user to easily create high quality cinemagraphs by allowing the user to view their work immediately, and where further changes may be required, make further selections for animation and view their work. This workflow integrates the generation of previews with the cinemagraph creation process so as to provide an efficient workflow for achieving the desired result, a beautiful cinemagraph.
  • Other Possible Features
  • In another possible features, illustrated in one embodiment in FIG. 2., the mobile application may include a motion detection feature that automatically detects areas of video content that are moving, for example beyond a threshold. In the content displayed in FIG. 2, the mobile application may detect that the waves, and the cloud are the two main areas that are moving in the video. In another aspect, the motion detection feature may include one or more filters that detect areas of motion that are suitable for use for creation of cinemagraphs. The motion detection feature may be further configured to designate the general area of motion, by circumscribing same to indicate the general area of movement, using one or more suitable cropping algorithms. Where the motion detection feature detects two or more moving areas, the mobile application may generate thumbnails indicating the possible combinations of these moving areas, including combinations where one or more of the moving areas is filtered out, as shown in the bottom portion of the user interface displayed as part of FIG. 2. This allows the user to select a particular base image with the desired moving areas being shown. The shown moving areas may be used as a starting point to select the moving portions to be shown, or alternatively, the user may select a preview to be shown using the specific areas already shown. The user may also select different animation effects for different moving areas, which is aided by this feature of the invention.
  • Optionally, the user may access one or more editing functions of the mobile application. These editing functions may be accessed by means of one or more “trays” disposed around the bottom of the user interface. These trays may include “Start/End”, “Looping” and “Filters”.
  • In another possible feature of the mobile application, program features may be included that enable the selection of the start frame and end frame for a cinemagraph. In the particular implementation shown, a line (optionally a dotted line) is shown, representing the sequence of image frames obtainable from the video segment, from the first frame to the last frame. The user may select a point along the line to access particular frames to consider whether the frame is suitable as the starting frame or the ending frame. It may be desirable to choose a starting frame and an ending frame that are a close match. A user may toggle between the “Starting Frame” button and the “Ending Frame” to test the appearance of different selections.
  • In particular aspect, the mobile application is configured so that when a particular point on the line is selected, the corresponding image frame number may also be displayed. In another particular aspect, the tray may be closed once the user is happy with the selected “Starting Frame” and the “Ending Frame”.
  • The mobile application may include one or more possible editing functions for example one or more looping functions. These functions enable the user to loop the animation one or more times from the beginning to the end, or from then end to the beginning. This is to avoid the “snap back” to the beginning of the animation that would normally occur, and therefore presents as a smoother animation. In addition, the loop functions enable the definition of the length of the delay between animations.
  • The mobile application may include various other editing functions such as for example image/video filters such as “MOODY” or “RETRO” or “Black & White”.
  • System Implementation
  • As best illustrated in FIG. 3, the mobile application (2) may define: a video capture utility (3), which links to the camera of the mobile device, a video library (4), consisting of a media store located on the mobile device (1) or associated with a server (20) or web service link. The mobile application (2) also includes a video editor (6) that incorporates the various functions described above. The mobile application (2) includes a preview creator (7) for generating the easy to use animation previews described above. The mobile application (2) also includes a rendering utility (9) for generating the images with user defined animated regions.
  • As mentioned above, this component may also be linked to a server computer (20), and implemented to an associated server application (22). Various functions of the mobile application (2) may be implemented on the mobile device (1), the server application (22), or a combination of the two. The present invention contemplates various distributions of the functions described, including the use of a cloud service for one or more of the functions.
  • The system of the present invention is best understood as the mobile application (2) implemented to a mobile device (1), but the system may also include the server computer (20), or in fact the system may include a desktop computer (not shown) including or linked to a computer program that is configured to implement the features or operations described herein.
  • The system of the invention may include or be linked to a communication platform (24) that enables email messaging and also linking with established social networking platforms such as as FACEBOOK™ or TWITTER™ for example, including for the purpose of sharing the animated digital photos of described herein.
  • It should be understood that the mobile application (10) may include a settings utility (13) that enables the user to create a user profile (23) for the user, which may include for example first, name, last name, country of domicile, a valid email, and password. The user profile (23) may include other information such as contact information, application login information, account information for social networks (for example username and password), and also preferences related to for example (a) settings for uploading the animated digital photos to remote resources whether the server computer (20) or related services such as social networking platforms or image sharing platforms, or (b) preferences for automated creation or editing of animated digital photos, as described.
  • The user profile (23) may include for example a social sharing profile that specifies the social networks that the user belongs to and also preferences for sharing content with specific social networks.
  • A plurality of mobile devices linked to the mobile application may be used to create, and publish to an Internet server or service a plurality of cinemagraphs, which may be stored to one or more databases. The cinemagraphs may be organized into one or more libraries. The Internet service may be organized as a community to share and distribute cinemagraphs, similar to other prior art online communities based on image sharing. In one implementation, streaming and discovery features similar to those used for example in Youtube™ may be used in order to create a platform for multiple users to discover and consume cinemagraphs.
  • In another aspect, the mobile application may include functionality that enables users to aid in the tagging of their cinemagraphs. This information may improve the ability of the Internet service to enable users (including different types of users) to locate cinemagraphs of interest.
  • The Internet service may include or link to a computer program that analyzes cinemagraphs based on one or more criteria so relevant to the character or quality of cinemagraphs. This feature may be used for example to filter out or rank low images that either do not contain animated features, or for which substantially all of a baseline image was selected for animation such that the resulting image is essentially the video content.
  • The Internet service may include an automated ranking utility for ranking cinemagraphs.
  • The Internet service may include various social media features, and may include or link to a social media platform. Users may recommend cinemagraphs to their friends; receive cinemagraphs meeting one or more criteria as social feeds; and share cinemagraphs based on content important to a user's social network, to the user's social network, and so on.
  • Various revenue models may be associated with the mobile application and also the Internet service described. For example, the Internet service may be used to find high quality cinemagraphs, and these may be stored to a library presented for example to premium clients of the platform through a dashboard. The operator of the Internet service may acquire distribution rights to cinemagraphs and commercialize these rights, or the Internet service may act as conduit between creators (using the mobile application and the platform) and possible consumers of the cinemagraphs such as advertisers and brands.
  • Regarding (a), the settings utility (13) may implement one or more known features for minimizing the cost of wireless data transfer, for example one or more rules that may enable the user to select the transfer of the animated digital photos to remote computer only once the mobile device is connected to a preferred network meeting one or more parameters, for example a free WFi network. These rules may be for example user defined, using one or more drop down menus or other mechanisms for selecting rules presented by a user interface associated with the settings facility (13), or may be obtained based on other user defined settings associated with other mobile applications of the user.
  • Different Possible Implementations
  • It should be understood that the present disclosure may explain the invention by reference to a number of example implementations that describe certain functionality being implemented by the mobile application (2) and other functionality being implemented by the server application (22). It should be understood that various of these features associated in the disclosure with the mobile application (10) may also be implemented by the server application (22), or alternatively features associated in the disclosure with the server application (22) may be implemented by the mobile application (22). As a still other alternative, some features may be implemented on a distributed basis with some operations occurring on the mobile device (12) and others on the server (20) side. Depending on the particular implementation and various associated factors such as the resources of the mobile device, wireless network parameters, and requirements of the content distribution of social media platforms, different implementation architectures may be used for the present invention.
  • It should also be understood that the server (20) may be implemented as one or more servers in any possible server architecture or configuration including for example in a distributed server architecture, a server farm, or a cloud based computing environment.
  • The present system and method may be practiced in various embodiments. A suitably configured computer device, and associated communications networks, devices, software and firmware may provide a platform for enabling one or more embodiments as described above.
  • By way of example, FIG. 4 shows a generic computer device 100 that may include a central processing unit (“CPU”) 102 connected to a storage unit 104 and to a random access memory 106. The CPU 102 may process an operating system 101, application program 103, and data 123. The operating system 101, application program 103, and data 123 may be stored in storage unit 104 and loaded into memory 106, as may be required. Computer device 100 may further include a graphics processing unit (GPU) 122 which is operatively connected to CPU 102 and to memory 106 to offload intensive image processing calculations from CPU 102 and run these calculations in parallel with CPU 102. An operator 107 may interact with the computer device 100 using a video display 108 connected by a video interface 105, and various input/output devices such as a keyboard 110, mouse 112, and disk drive or solid state drive 114 connected by an I/O interface 109. In known manner, the mouse 112 may be configured to control movement of a cursor in the video display 108, and to operate various graphical user interface (GUI) controls appearing in the video display 108 with a mouse button. The disk drive or solid state drive 114 may be configured to accept computer readable media 116. The computer device 100 may form part of a network via a network interface 111, allowing the computer device 100 to communicate with other suitably configured data processing systems (not shown). One or more different types of sensors 130 may be used to receive input from various sources.
  • The present system and method may be practiced on virtually any manner of computer device including a desktop computer, laptop computer, tablet computer or wireless handheld. The present system and method may also be implemented as a computer-readable/useable medium that includes computer program code to enable one or more computer devices to implement each of the various process steps in a method in accordance with the present invention. In case of more than computer devices performing the entire operation, the computer devices are networked to distribute the various steps of the operation. It is understood that the terms computer-readable medium or computer useable medium comprises one or more of any type of physical embodiment of the program code. In particular, the computer-readable/useable medium can comprise program code embodied on one or more portable storage articles of manufacture (e.g. an optical disc, a magnetic disk, a tape, etc.), on one or more data storage portioned of a computing device, such as memory associated with a computer and/or a storage system.
  • The mobile application of the present invention may be implemented as a web service, where the mobile device includes a link for accessing the web service, rather than a native application.
  • The functionality described may be implemented to any mobile platform, including the iOS platform, ANDROID™, WINDOWS™ or BLACKBERRY™.
  • It will be appreciated by those skilled in the art that other variations of the embodiments described herein may also be practiced without departing from the scope of the invention. Other modifications are therefore possible.

Claims (17)

1. A method of generating distributable and/or shareable selectively animated images comprising the steps of:
(a) opening a client computer program, implemented as a client computer program loaded on a mobile device;
(b) capturing or accessing video content;
(c) a user using a user interface of the client computer program to:
(i) select one or more base frames from the video content for use as a still image or images; and
(ii) draw or paint one or more paths or regions on the one or more base frames so as to select a path or region of the one or more base frames to be animated using moving content from the video content (“animated region(s)”);
(d) compiling one or more parameters related to the animated region(s), and also optionally one or more other parameters generated using one or more editing features or utilities of the client computer program, so as to define a set of instructions for creating selectively animated images within the animated region(s), based on the video content, and the client computer program initiating, at the mobile device or via a server linked to the mobile device, the composition of a series of images including user selected animated regions, by rendering one or more animated images based on the one or more base frames and selected animated region(s).
2. The method of claim 1, wherein the client computer program displays a mask as an overlay over the one or more base frames, wherein the mask represents the region of the one or more base frames that will remain still, wherein the user draws on or paints on the mask, and thereby removes portions of the mask, and these portions are used to select the animated region(s).
3. The method of claim 1, comprising the further step of displaying to the user a preview of the selective animated images by displaying the one or more base images as a still image or images, and revealing underneath the aligned portions of the moving content in the animated region(s).
4. The method of claim 1, comprising the steps of:
(a) playing the video content, while displaying in the background a transparency showing the currently selected one or more base frames; and
(b) the user in a selectively animated image creation mode touching selected regions of a touch screen display of the mobile device, thereby initiating the client computer program to display a mask consisting of the one or more base frames, as an overlay to the moving content, thereby permitting the user to touch the touch screen so as to select portions of the mask and thereby selected portions of the one or more base frames for animation.
5. The method of claim 4, comprising the further step of:
(a) dynamically displaying a preview of the current selectively animated images based on the portions of the one or more base frames selected for animation, upon the user ceasing touch input to the selected regions of the touch screen display of the mobile device.
6. The method of claim 5, comprising the steps of the user iteratively providing the one or more parameters for the animated region(s) by touching selected regions of the touch screen display and viewing a corresponding preview, until the user provides input to the client computer program indicating completion of the selectively animated images.
7. The method of claim 1, comprising the further step of the client computer program automatically analyzing the video content based on one or more parameters for determining whether the video content is suitable for creating selectively animated images.
8. The method of claim 7, further comprising the further step of analyzing the video segment for shake.
9. The method of claim 7, further comprising the further step of applying an image stabilization mechanism
10. The method of claim 1, comprising the step of initiating from the mobile device, by operation of the client computer program, the distribution and/or sharing of the animated image.
11. A computer system for generating distributable and/or shareable selectively animated images comprising:
(a) one or more server computers being linked to a server computer program; and
(b) at least one mobile device linked to the one more server computers, the mobile device implementing a client computer program;
(c) the server computer program and the client computer program, when executed:
(i) presenting at the mobile device a user interface enabling a user of the mobile device to:
(A) select one or more base frames from the video content for use as a still image or images; and
(B) draw or paint one or more paths or regions on the one or more base frames so as to select a path or region of the one or more base frames to be animated using moving content from the video content (“animated region(s)”); and
(ii) compiling one or more parameters related to the animated region(s), and also optionally one or more other parameters generated using one or more editing features or utilities of the client computer program, so as to define a set of instructions for creating selectively animated images within the animated region(s), based on the video content, and the client computer program initiating, at the mobile device or at the one or more server computers, the composition of a series of images including user selected animated regions, by rendering one or more animated images based on the one or more base frames and selected animated region(s).
12. The computer system of claim 11, wherein the client computer program displays a mask as an overlay over the one or more base frames, wherein the mask represents the region of the one or more base frames that will remain still, wherein when executed the client computer program permits the user to draw on or paint on the mask, and thereby remove portions of the mask, and these portions are used to select the animated region(s).
13. The computer system of claim 11, wherein the client computer program when executed displays to the user a preview of the selective animated images by displaying the one or more base images as a still image or images, and revealing underneath the aligned portions of the moving content in the animated region(s).
14. The computer system of claim 11, wherein the client computer program when executed:
(a) plays the video content, while displaying in the background a transparency showing the currently selected one or more base frames; and
(b) enables the user in a selectively animated image creation mode to touch selected regions of a touch screen display of the mobile device, thereby initiating the client computer program to display a mask consisting of the one or more base frames, as an overlay to the moving content, thereby permitting the user to touch the touch screen so as to select portions of the mask and thereby selected portions of the one or more base frames for animation.
15. The computer system of claim 13, wherein the client computer program when executed:
(a) dynamically displays a preview of the current selectively animated images based on the portions of the one or more base frames selected for animation, upon the user ceasing touch input to the selected regions of the touch screen display of the mobile device.
16. The computer system of claim 15, where the client computer program when executed enables the user to iteratively provide the one or more parameters for the animated region(s) by touching selected regions of the touch screen display and viewing a corresponding preview, until the user provides input to the client computer program indicating completion of the selectively animated images.
17. The computer system of claim 1, wherein the client computer program when executed, based on input from the user, connects to the one or more servers so as to enable the distribution and/or sharing of the selectively images based on one or more user preferences.
US15/631,673 2012-02-09 2017-06-23 Systems and methods for creation and sharing of selectively animated digital photos Abandoned US20170285922A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US201261596908P true 2012-02-09 2012-02-09
PCT/CA2013/000116 WO2013116937A1 (en) 2012-02-09 2013-02-11 Systems and methods for creation and sharing of selectively animated digital photos
US201414377732A true 2014-08-08 2014-08-08
US15/631,673 US20170285922A1 (en) 2012-02-09 2017-06-23 Systems and methods for creation and sharing of selectively animated digital photos

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US15/631,673 US20170285922A1 (en) 2012-02-09 2017-06-23 Systems and methods for creation and sharing of selectively animated digital photos

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
PCT/CA2013/000116 Continuation WO2013116937A1 (en) 2012-02-09 2013-02-11 Systems and methods for creation and sharing of selectively animated digital photos
US201414377732A Continuation 2014-08-08 2014-08-08

Publications (1)

Publication Number Publication Date
US20170285922A1 true US20170285922A1 (en) 2017-10-05

Family

ID=48946860

Family Applications (2)

Application Number Title Priority Date Filing Date
US14/377,732 Active 2034-04-11 US9704281B2 (en) 2012-02-09 2013-02-11 Systems and methods for creation and sharing of selectively animated digital photos
US15/631,673 Abandoned US20170285922A1 (en) 2012-02-09 2017-06-23 Systems and methods for creation and sharing of selectively animated digital photos

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US14/377,732 Active 2034-04-11 US9704281B2 (en) 2012-02-09 2013-02-11 Systems and methods for creation and sharing of selectively animated digital photos

Country Status (2)

Country Link
US (2) US9704281B2 (en)
WO (1) WO2013116937A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180089512A1 (en) * 2016-09-23 2018-03-29 Microsoft Technology Licensing, Llc Automatic selection of cinemagraphs
US20190019320A1 (en) * 2017-01-04 2019-01-17 Samsung Electronics Co., Ltd Interactive Cinemagrams
US10891032B2 (en) 2012-04-03 2021-01-12 Samsung Electronics Co., Ltd Image reproduction apparatus and method for simultaneously displaying multiple moving-image thumbnails

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9373187B2 (en) * 2012-05-25 2016-06-21 Nokia Corporation Method and apparatus for producing a cinemagraph
US8957915B1 (en) * 2012-06-14 2015-02-17 Cinemagram Inc. Method, apparatus and system for dynamic images
KR102127351B1 (en) * 2013-07-23 2020-06-26 삼성전자주식회사 User terminal device and the control method thereof
GB2518144A (en) * 2013-08-30 2015-03-18 Nokia Technologies Oy An image enhancement apparatus and method
US9207857B2 (en) * 2014-02-14 2015-12-08 EyeGroove, Inc. Methods and devices for presenting interactive media items
US9230355B1 (en) 2014-08-21 2016-01-05 Glu Mobile Inc. Methods and systems for images with interactive filters
US10154196B2 (en) * 2015-05-26 2018-12-11 Microsoft Technology Licensing, Llc Adjusting length of living images
EP3226210A1 (en) * 2016-03-29 2017-10-04 Thomson Licensing Method and device for generating a cinemagraph from light field images
US9911223B2 (en) 2016-05-13 2018-03-06 Yahoo Holdings, Inc. Automatic video segment selection method and apparatus
US10678929B2 (en) * 2018-03-09 2020-06-09 Citrix Systems, Inc. Systems and methods for embedding data in remote session displays

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
AU2002345270B2 (en) 2001-07-11 2007-11-29 Ecole Polytechnique Federale De Lausanne Images incorporating microstructures
US7693341B2 (en) * 2006-04-21 2010-04-06 Apple Inc. Workflows for color correcting images
US20080140502A1 (en) * 2006-12-07 2008-06-12 Viewfour, Inc. Method and system for creating advertisements on behalf of advertisers by consumer-creators
US8004529B2 (en) * 2007-10-01 2011-08-23 Apple Inc. Processing an animation file to provide an animated icon
US20090140887A1 (en) * 2007-11-29 2009-06-04 Breed David S Mapping Techniques Using Probe Vehicles
IL192478D0 (en) 2008-06-26 2009-02-11 Shimon Elnatan System and method for simplifying the creation and storage of complex animation objects and movies
JP5170771B2 (en) * 2009-01-05 2013-03-27 任天堂株式会社 Drawing processing program, information processing apparatus, information processing system, and information processing control method
US9380292B2 (en) * 2009-07-31 2016-06-28 3Dmedia Corporation Methods, systems, and computer-readable storage media for generating three-dimensional (3D) images of a scene

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10891032B2 (en) 2012-04-03 2021-01-12 Samsung Electronics Co., Ltd Image reproduction apparatus and method for simultaneously displaying multiple moving-image thumbnails
US20180089512A1 (en) * 2016-09-23 2018-03-29 Microsoft Technology Licensing, Llc Automatic selection of cinemagraphs
US10262208B2 (en) * 2016-09-23 2019-04-16 Microsoft Technology Licensing, Llc Automatic selection of cinemagraphs
US20190019320A1 (en) * 2017-01-04 2019-01-17 Samsung Electronics Co., Ltd Interactive Cinemagrams
US10586367B2 (en) * 2017-01-04 2020-03-10 Samsung Electronics Co., Ltd. Interactive cinemagrams

Also Published As

Publication number Publication date
US9704281B2 (en) 2017-07-11
US20150324096A1 (en) 2015-11-12
WO2013116937A1 (en) 2013-08-15

Similar Documents

Publication Publication Date Title
US10621270B2 (en) Systems, methods, and media for content management and sharing
US9911239B2 (en) Augmenting a live view
AU2018206841B2 (en) Image curation
JP6408019B2 (en) Photo composition and position guidance on image devices
US20200380565A1 (en) Dynamic binding of video content
US20190087742A1 (en) Extracting live camera colors for application to a digital design
AU2015231761B2 (en) Object tracking in zoomed video
US10775959B2 (en) Defining, displaying and interacting with tags in a three-dimensional model
US10359927B2 (en) Methods and systems for photo, page, and spread arrangement on space-constrained user devices
KR102054548B1 (en) Multi-view audio and video interactive playback
US9626103B2 (en) Systems and methods for identifying media portions of interest
US20200019562A1 (en) Method and system for storytelling on a computing device via social media
US10008015B2 (en) Generating scenes and tours in a spreadsheet application
US10896284B2 (en) Transforming data to create layouts
US20190339830A1 (en) Multi-Directional and Variable Speed Navigation of Collage Multi-Media
US20170300597A1 (en) Data feeds with peripherally presented interesting content
JP6496848B2 (en) Method and system for extracting and providing highlight video of video content
KR102161230B1 (en) Method and apparatus for user interface for multimedia content search
US10681391B2 (en) Computerized system and method for automatic highlight detection from live streaming media and rendering within a specialized media player
US10607382B2 (en) Adapting content to augumented reality virtual objects
US10540423B2 (en) Dynamic content mapping
AU2014324841B2 (en) N-level replication of supplemental content
US20180210614A1 (en) Hierarchical, zoomable presentations of media sets
KR101535579B1 (en) Augmented reality interaction implementation method and system
US20190132642A1 (en) Video processing method, video processing device, and storage medium

Legal Events

Date Code Title Description
AS Assignment

Owner name: FLIXEL PHOTOS INC., CANADA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LEBLANC, PHILIPPE LOUIS;MACLEAN, BRETTON JAMES;PAVLIDIS, MARK HARRIS;SIGNING DATES FROM 20130222 TO 20130226;REEL/FRAME:042964/0382

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION