WO2011124880A2 - Personalised video generating and delivery - Google Patents

Personalised video generating and delivery Download PDF

Info

Publication number
WO2011124880A2
WO2011124880A2 PCT/GB2011/000525 GB2011000525W WO2011124880A2 WO 2011124880 A2 WO2011124880 A2 WO 2011124880A2 GB 2011000525 W GB2011000525 W GB 2011000525W WO 2011124880 A2 WO2011124880 A2 WO 2011124880A2
Authority
WO
WIPO (PCT)
Prior art keywords
video
message
link
recipient
video content
Prior art date
Application number
PCT/GB2011/000525
Other languages
French (fr)
Other versions
WO2011124880A3 (en
Inventor
Simon Daniel Mellamphy
Victor Michael Askew
Terry Lee Turner
Original Assignee
Cm Online Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Cm Online Limited filed Critical Cm Online Limited
Priority to EP11722851.0A priority Critical patent/EP2556634B1/en
Publication of WO2011124880A2 publication Critical patent/WO2011124880A2/en
Publication of WO2011124880A3 publication Critical patent/WO2011124880A3/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/58Message adaptation for wireless communication
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q90/00Systems or methods specially adapted for administrative, commercial, financial, managerial or supervisory purposes, not involving significant data processing
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L51/00User-to-user messaging in packet-switching networks, transmitted according to store-and-forward or real-time protocols, e.g. e-mail
    • H04L51/06Message adaptation to terminal or network requirements
    • H04L51/063Content adaptation, e.g. replacement of unsuitable content

Definitions

  • the present invention relates to a method and system for generating and delivering personalised video content.
  • Digital communications systems have in recent times enabled users to send video and audio messages to other people using email and/or mobile telephone networks.
  • a user can send a prerecorded video clip of a media personality to a friend, relative or colleague in which the personality delivers a message such as 'happy birthday', 'good luck' and so on.
  • the clip is either sent as a link in an email to the recipient's address, or as a link or HTTP request in a SMS message to the recipient's mobile telephone.
  • Such messages are, however, not personalised to the recipient.
  • the invention provides a method of generating a personalised video message, the method comprising: selecting a first, personalised video file from a first database of personalised files each of which refers in the video content to a respective name or entity; selecting a second, message video file from a second database of files each of which contains in the video content a respective message or greeting, and processing the selected first and second video files to generate a single video file comprising the concatenated video content.
  • a personalised video message system comprising a first database of personalised video files each of which refers in the video content to a respective name or entity; a second database of video message files each of which contains in the video content a respective message or greeting; a selection system enabling a user to select from a remote terminal a first video file from the first database, a second video file from the second database, and to identify an intended recipient; video processing means arranged to join the selected first and second video files to produce in a single video file a personalised message comprising the concatenated video content; and a delivery system for sending a message to the identified recipient which message includes a means to access the concatenated video content.
  • a personalised video message in which (i) the name of the intended recipient, be it an individual, a subset of individuals from an identifiable group, or the name of an organisation, and (ii) a message is provided in a single video file comprising the concatenated personalised and general message parts.
  • Concatenated in this sense means placing one piece of video content after the other, i.e. in series.
  • the video incorporates an audio or speech track.
  • the video content in the first and second databases may comprise prerecorded video from a particular personality.
  • a user can select a sports personality to deliver a video message comprising the personality saying the recipient's forename to camera followed by them delivering a message such as 'happy birthday' or 'good luck' to camera.
  • the personalised and general message parts may be recorded in advance by a manager or senior member of the corporation for subsequent delivery to individual employees, or subsets of employees.
  • the system and method is also applicable to blogs, particularly video blogs. In this case, the general message part comprises the blog. This provides an efficient way of adding personalisation currently not available in video blogging.
  • the system and method has many potential applications. Businesses may select video content delivered by well-known business leaders, politicians or inspirational personalities.
  • the system and method also has application in the charity sector, e.g. whereby well-known celebrities can issue personalised charity appeals.
  • the delivery system may be arranged to send a link to the intended recipient using a communications network in an email, SMS or WAP push message, activation of the link enabling said recipient to receive over the communications network a streamed version of the concatenated video content from the message system.
  • the video processing means may be arranged to produce the single video file in response to activation of the link at a recipient's device. In this way, the single video file is not generated until the intended recipient actually activates the link at their end, e.g. at their computer terminal or mobile communications device. This avoids the need for the video processing means to store potentially many different sets of joined video clips before the intended recipients actually activate their links. Less memory is therefore needed at the video messaging system.
  • the video processing means may be arranged to produce the single video file in one of a plurality of available video formats, the format being selected in accordance with the video playing capabilities of the recipient's device which is or are determined using information received from said recipient device in response to activation of the link.
  • the video playing capabilities of the recipient's device can be determined by means of a the system being arranged to receive in response to activation of the link header information identifying the recipient device and a browser of the device and to interrogate a database indicating a format appropriate for said device and browse.
  • the system may further comprise a time specification system arranged to prompt the user to enter a time and/or date when the message should be delivered to the recipient.
  • the time specification system may further be arranged to identify the user's local time zone and, in the event that said local time zone differs from that of the link delivery system's local time zone, to calculate the appropriate different delivery time and/or date to send the link relative to the local time zone.
  • the video processing system may arranged automatically to join the video content in the second file to the end of the video content in the first video file to produce the concatenated video content.
  • the video processing means can be arranged automatically to generate the concatenated video content for storage and linking in the message subsequently delivered to the intended recipient.
  • the video processing means may be arranged automatically to generate the concatenated video content only after the link is remotely activated whereafter the video processing means is arranged automatically to generate the concatenated video for transmission to the recipient device.
  • a method of generating a personalised video message comprising selecting a first, personalised video file from a first database of personalised files each of which refers in the video content to a respective name or entity, selecting a second, message video file from a second database of files each of which contains in the video content a respective message or greeting, and processing the selected first and second video files to generate a single video file comprising the concatenated video content.
  • Selection may be received from a user over a data or communications network, e.g. the Internet, the method further comprising prompting a user to select the first, personalised video file from a list of available names or entities, select the second, message video file from a list of available messages or greetings, and to input an email address or telephone number associated with an intended recipient or group of recipients.
  • the method may further comprise delivering a link to the intended recipient in an email, SMS or WAP push message, activation of the link enabling said recipient to receive a streamed version of the concatenated video content.
  • the processing step may be performed in response to activation of the link at a recipient device.
  • Activation of the link can cause information enabling identification of the recipient device type to be received, and, prior to the processing step, the method further comprises determining from the identification information the video playing capabilities of the recipient device, the processing step further comprising generating the single video file using a codec appropriate to the video playing capabilities.
  • the method may further comprise prompting the user to enter the time and/or date when the message is to be delivered to the recipient and delivering the link in accordance with the specification.
  • the name and message files may be identified by metadata prior to the specified time and/or date, the video files corresponding to the metadata being processed to generate the concatenated file subsequent to the specified time and/or date.
  • the aim here is to use memory efficiently and this avoids storing concatenated video files for long periods before they are intended to be viewed by the recipient.
  • the method may further comprise identifying the user's local time zone and, in the event that said local time zone differs from that of the link delivery system, calculating the appropriate delivery time and/or date to send the link relative to the local time zone. Identifying the user's local time zone is preferably performed by prompting the user to enter a location and converting the location to a time zone. Alternatively, identifying the user's local time zone can be performed automatically using GPS or the network address of the user's computer terminal.
  • the video content in the first and second databases preferably comprises pre- recorded video and speech from a particular personality.
  • the personality may be selected by the user from a plurality of available personalities.
  • the plurality of available personalities can be grouped in the databases by sector, e.g. sports, music, film, business leaders, political leaders, inspirational personalities.
  • the video processing preferably comprises automatically joining the video content in the second file to the end of the video content in the first video file to produce concatenated video content which is stored as a single file.
  • video processing preferably occurs automatically in accordance with said time-based identification to generate the concatenated video content for storage and linking in a message subsequently delivered to the intended recipient.
  • the joining of video content may include placing a transition effect between the video content from the first and second video files, e.g. a fade or dissolve effect. This is preferably performed automatically.
  • the invention in a second aspect, provides a computer program or suite of computer programs comprising code which, when executed on a processor, performs the steps as defined in the first aspect, or any preferred feature thereof.
  • a personalised video message system comprising a first database of personalised video files each of which refers in the video content to a respective name or entity; a second database of video message files each of which contains in the video content a respective message or greeting; a selection system enabling a user to select from a remote computer a first video file from the first database, a second video file from the second database, and to identify an intended recipient; video processing means arranged to join the selected first and second video files to produce in a single video file a personalised message comprising the concatenated video content; and a delivery system for sending a message to the identified recipient which includes a means to access the concatenated video content.
  • the delivery system is preferably arranged to send a link to the intended recipient in an email, SMS or WAP push message, activation of the link enabling said recipient to receive a streamed version of the concatenated video content from the message system.
  • the system may further comprise a time specification system arranged to prompt the user to enter the time and/or date when the message is to be delivered to the recipient.
  • the time specification system can be further arranged to identify the user's local time zone and, in the event that said local time zone differs from that of the link delivery system, to calculate the appropriate delivery time and/or date to send the link relative to the local time zone.
  • the system may further comprise means to store an identifier associated with each of the selected first and second video files in memory, the identifier being retrieved at, or subsequent to, the time and/or date so specified in order generate the concatenated video file.
  • the aim here is to use memory in the system efficiently and avoid storing concatenated video files for long periods before they are intended to be viewed by the recipient.
  • a method of generating a personalised video message comprising, at a first computer system, (i) receiving selection of a first, personalised video file from a first database of personalised files each of which refers in the video content to a respective name or entity, (ii) receiving selection of a second message video file from a second database of files each of which contains in the video content a respective message or greeting, (iii) generating a link for transmission over a network to a remote recipient device, the link being associated with the selected first and second video files, (iv) receiving in response to activation of said link, data identifying the recipient device type, (v) using the received identifying data to determine the video playback capabilities of the recipient device; and (vi) processing the selected first and second video files to generate a single video file comprising the concatenated video content encoded in a format appropriate to the video playback capabilities determined in step (v).
  • Figure 1 is a block diagram showing a typical communications network over which messages generated in accordance with a preferred embodiment can be transmitted;
  • FIG. 2 is block diagram of a personalised messaging system, arranged to operate in accordance with the invention
  • Figure 3 is a flow diagram indicating the various steps performed between a user computer and the personalised messaging system to generate a personalised message in preparation for sending to a recipient;
  • Figure 4 shows a first pull-down menu displayed at the user computer
  • Figure 5 shows a second pull-down menu displayed at the user computer
  • Figure 6 shows an input text control displayed at the user computer
  • Figure 7 shows a third pull-down menu displayed at the user computer
  • Figure 8 is a schematic diagram indicating how video processing of individual video files is performed to generate concatenated video content
  • Figure 9 shows a fourth pull-down menu displayed at the user computer'
  • Figure 10 shows a data entry system for specifying the email address or mobile telephone number of an intended recipient
  • Figure 1 1 is a flow diagram indicating the steps involved in generating a delivery time specification at the messaging system end;
  • Figure 12 is a flow diagram indicating the steps involved in a send control process at the messaging system end.
  • Figure 13 is a flow diagram indicating the steps involved in a video delivery process for converting video clips to a format appropriate to a particular receiving device at the time the delivered message is opened or activated by a user.
  • FIG. 1 there is shown a network arrangement in which a user operating a user terminal 1 can generate a personalised video message for subsequent delivery to a recipient communications terminal such as a computer, PDA or mobile telephone 3.
  • the personalised message is generated by the user 1 accessing a personalised video service (PVS) 5 via the Internet.
  • the PVS 5 uses information provided by the user 1 via its website portal to generate, store and send the video message to the recipient terminal 3.
  • the PVS 5 comprises a number of system modules that prompt the user, via the website portal, to enter selections in a particular order.
  • a personality who will appear in the video content This may be, for example, a media celebrity, sports person, business leader or politician.
  • a name process 11 prompts the user to select one of a number of stored names from a name database 13.
  • the database 13 stores a limited number of names corresponding to the more common forenames in current usage.
  • the names are stored in alphabetical order and are selected by means of the user initially specifying the first initial of the name, following which an expanded list of names beginning with the specified letter are shown for selection.
  • the next process is a message select process 15. Based on the name selected in the name process 11 , a video file (MPEG) is retrieved from a name clip database 17 that, as part of its content, includes a pre-recorded greeting to the selected name delivered by the selected personality.
  • MPEG video file
  • a further part of the message select process 15 prompts the user to select the second part of the message, namely the generalised message content from a predefined list. These may be categorised as, for example, “birthday greetings”, “congratulations”, “good luck”, “motivational”, “charity appeals", “blogs” and so on. Selecting a particular category will expand a more specific set of selectable messages such as “18 th birthday”, “21 st birthday” and so on. Selection of a particular message causes a video file (MPEG) to be retrieved from a message clip database 19 that, as part of its content, includes the appropriate pre-recorded message from the selected personality.
  • MPEG video file
  • a video processing system 21 generates a preview of the personalised message. This comprises joining or splicing the selected message clip to the end of the selected name clip, the result being a concatenated MPEG video clip which is generated and stored as a single file.
  • the concatenated MPEG clip is converted to the FLV format and can be streamed back to the user over the Internet 7. This video processing is performed automatically without user intervention.
  • the next part 23 of the system 5 prompts the user to enter a date and/or time specification (DTS).
  • DTS 23 enables the user to specify on which date and at what approximate time the message is notified to the recipient 3. This is likely to be important where the message relates to a birthday or similar date-related event. Further details will be specified below.
  • a delivery specification 25 particularly to indicate how the message is to be notified to the recipient. This may be by means of sending an activatable link to the concatenated file in an email message or by means of sending the link in a SMS or WAP Push message to the recipient's mobile telephone number.
  • the output from the video processing, DTS and delivery specification processes 21 , 23, 25 are stored together as a 'job' in a combined message database 27 for later use by a send control process 33, to be described below.
  • the user When the user is satisfied with their selections, they proceed to the 'My Basket' page 29 of the web portal, which is a standard e-commerce process.
  • the user can specify further messages at this time or can simply proceed to 'checkout' by giving their payment details.
  • the payment details are checked by an external verification service 31 which will return either an 'accept' or 'deny' response. If payment is accepted, the job stored in the combined message database 27 is committed for sending and the user is informed accordingly.
  • a send control process 33 this process is responsible for handling the sending and timing of the email or mobile telephone message notifying the recipient that a message is waiting for them to view, together with the activatable link.
  • a first step 3.1 the user accesses the PVS web portal.
  • the user Upon selecting the option to generate a new video message, in step 3.2 the user is prompted to select a particular personality who will deliver the message in the video content; selection may be made via a hierarchical menu of personality types (sports; music; film; business, and so on.)
  • the user makes their selection in step 3.3.
  • the PVS 5 prompts the user to select from a menu referred to herein as List A.
  • List A 31 comprises a drop down menu from which the user can select the first initial of the recipient's forename, e.g. D. Selection is made in step 3.5 at the user's end.
  • step 3.6 the PVS 5 prompts the user to select a specific forename from a further menu (retrieved in step 3.7) referred to as List B.
  • List B 32 comprises a drop down menu from which the user can select a name beginning with the selected initial, e.g. Dan. The user selects the required name in step 3.8.
  • the PVS 5 In response to selection of the forename the PVS 5 displays a text input control box 33 in step 3.9 which allows the user to modify the spelling of the selected name, for example to change Claire to Clare (step 3.10). This edited name will appear in the email or SMS message generated by the send control process 3.29, but will not affect the video content itself.
  • Figure 6 shows a text control box 33 with submit button 34.
  • step 3.11 the user is prompted to select the main message from a menu of message types or styles (step 3.11).
  • the user is presented with a menu 35 of different messages, such as 'happy birthday' and so on, for which see Figure 7.
  • Selection of the main message by the user takes place in step 3.12. causes the PVS 5 to retrieve the name clip from the name clip database 17 and the message clip from the message clip database 19, both clips corresponding to content delivered by the selected personality.
  • step 3.13 the video process 21 performs the task of joining (or splicing) the two selected clips together to form the concatenated video clip. This involves retrieving the personalised 'name' video clip and selected message clip as delivered to camera by the selected personality (step 3.14).
  • a transition effect 49 is automatically placed between the two joined clips 41 , 47 to make the join, when viewed, appear as seamless as possible with no obvious jumping or jitter.
  • the transition effect 49 may be a fade or dissolve effect, for example.
  • each of the name and message clips 41 , 47 comprises video data 43 and audio data 45. References herein to video files or clips are assumed to incorporate audio data in the form of speech.
  • the above video processing step 3.13 is performed automatically without human intervention. This automatic processing may also involve processing the resulting concatenated video file 48 to correct any format errors or differences. This involves generating from the joined MPEG clips a file suitable for streaming, such as a .FLV file, using a MPEG-FLV codec 51.
  • step 3.14 the user is given the option of previewing the concatenated FLV file 48. Selection causes the PVS 5 to stream the FLV file 48 to the user's terminal (step 3.16) where it can be previewed in a suitable viewer such as Windows Media Player or Quicktime.
  • the next step 3.17 requires the user to enter a date and time specification, corresponding to the data and preferred time when the concatenated message should be notified to the intended recipient 3.
  • the term 'preferred' is used in regard to the notification time as it is not considered so important for the send control process to send the email or SMS at the exact specified time. Rather, the email or SMS is sent shortly after the specified time.
  • step 3.17 is a relatively straightforward procedure involving selecting the time from a first drop-down menu 55 and the date from a further calendar menu 57. If the date and time occurs in the past, an error message is displayed. Upon receiving the date and time specification, the PVS 5 logs this information against a current job number for the message in the combined message database 27 and performs a date normalisation process (step 3.18).
  • normalisation initially involves prompting the user to indicate their location (step 11.1) by entering their town, country or postal or ZIP code. From this, the location is converted to geographical coordinates (step 11.2) using the Google Maps Application Programming Interface (API). Next (step 11.3), the co-ordinates are converted into a time zone via a request to the GeoNames.org service. In step 11.4, the time zone is used to calculate the equivalent local server time (ELST) corresponding to the time actually specified by the user. So, for the above example, 0900 becomes 1400, which is the time stored against the relevant job number in the combined message database 27.
  • ELST equivalent local server time
  • step 3.19 the user enters their delivery specification, essentially requiring them to specify either an email notification or mobile phone notification. Referring to Figure 0, this is achieved by simply entering the recipient's email or mobile telephone details into the appropriate text box.
  • step 3.20 the delivery specification is logged against the relevant job number in the combined message database 27.
  • the user is also prompted with the option of entering further messages.
  • step 3.21 if the user chooses to do so, the current job number remains stored against the user's ID and they return to step 3.2.
  • step 3.22 If no further messages are required, the PVS 5 presents to the user their 'shopping cart' and requests payment details in step 3.22. Payment details are entered in step 3.23 and subsequently sent to an external verification service in step 3.24. The result of the verification is notified to the user in step 3.25 and displayed in step 3.26.
  • a positive verification in step 3.24 causes the PVS 5 to commit the relevant job number (or numbers in the case of multiple messages) in the database 27.
  • the final step 3.27 is the send control process which is described below.
  • the send control process is a separate time-initiated process that is responsible for notifying recipients that someone has sent them a video message. It may be regarded as a background process, operating independently from the message generating process, which polls (step 12.1) the database 27 at periodic intervals to identify those committed jobs whose date and time specification (normalised, if necessary) is earlier than the current time (step 12.2). This of course assumes the relevant message for that job has not yet been sent.
  • the selection information (name clip; message clip) and delivery specification are retrieved from the database 27.
  • video processing is performed as in step 3.13 described above, namely retrieving the selected name clip and message clip in MPEG format, splicing them together by concatenating the files (step 12.4), processing the resultant file to correct its format (step 12.5), and then further processing it according to the delivery specification.
  • the concatenated MPEG file is converted to 3GP format (step 12.6), a HTTP request generated (step 12.7) and the resulting link sent in a SMS or WAP Push HTTP to the recipient's telephone number (step 12.8).
  • Each step is performed automatically.
  • the concatenated MPEG file is converted to .FLV format (step 12.9), a URL to the .FLV file generated (step 12.10) and an email generated which includes the URL (step 12.11). Finally, the email is sent to the recipient's email address in step 12.12. Again, each step is performed automatically.
  • the method steps performed by the PVS 5 are implemented in software, or a suite of software systems running on suitable hardware computer systems.
  • the PVS 5 was developed using the PHP programming language and the Zend Framework library which provides a Model-View-Controller (MVC) structure. Consequently, many of the constituent files fall into the categories of 'controllers' or 'views'. An initial selection of three files demonstrate key elements of the process. These files are:
  • PersonalController.php the server logic behind the 'personal' message page; index.phtml - the 'personal' message page view including the client-side logic; and
  • SenderController.php the server logic involved in the actual sending of the SMS messages.
  • the files created in step 12.6 will always be suited for playback at the recipient's device 3.
  • the receiving device 3 is a computer
  • the recipient's device and the software running on it
  • the recipient's device is not known to the PVS 5 when the job is initially set up; all that is known is the recipient's mobile telephone number.
  • Different mobile telephones and PDAs have different capabilities and can use a number of different browsers which may be unsuited to decoding a particular codec, or may show it in a non-optimal format.
  • a refinement of the above embodiment therefore provides a video delivery process (VDP) for converting video clips to a format appropriate to a particular receiving device at the time the delivered message is opened or activated by the recipient.
  • VDP video delivery process
  • RDIP Receiving Device Identifier Program
  • the role of the RDIP is to use the known Wireless Universal Resource File (WURFL) to identify the requesting device, and more particularly its video playing capabilities, at the time the link to the video is activated by the recipient at their device. Details of the WURFL can be found at http://sch.sourceforge.net .
  • an appropriate format in this case a 3GP format, is identified and a check is performed to see if there is already stored at the PVS 5 the video combination in the identified 3GP format. If so, it can be delivered; if not, it is generated at the PVS and then delivered.
  • 3GP is used in this example, other formats can be used if this is the requirement of the requesting mobile device. Examples include 3GP (for general phones), MP4/H264 (for iPhones/Android), AVI (to view on Blackberrys), and FLV (For PC's).
  • a first step 13.1 the recipient activates their link to the video, and a connection is established.
  • the recipient's request contains 'header' information which identifies the device agent (indicating the device and browser).
  • the request is passed to a 'controller' which uses a MediaFormat class to identify the appropriate delivery format for the device agent.
  • This is a 3-stage process: a. a device database is interrogated to build the fall back tree of devices (the concept of WURFL fall back trees is discussed below); b. a media format database table is interrogated to find the active formats that match the fall back tree of devices; and c. the active format that relates to the most specialised device in the fallback tree is selected.
  • step 13.3 the recipient's request is used to identify the contents of the personalised video, e.g. according to the specification stored in the combined message database 27.
  • step 13.4 a check is performed to identify whether a video with the required content in the selected active format exists. If it does, then in step 13.5 it can be delivered to the device. If it does not exist then in step 13.6, it is created and delivered. It can also be stored for later use, e.g. in case a further request is received for the particular message combination in the particular format.
  • identifying the requesting device and creating the video are two separate processes.
  • the requesting device, and therefore the format to be delivered can only be identified at the time of the request.
  • the latest point at which the video can be created is after identification and immediately before delivery. This is the default; there is nothing to prevent a video of specific content and format being created at any time before a request is received, however.
  • the challenge is to balance the cost of the resources required to pre-create and store all possible combinations of content and format that could be requested against the delay incurred when a non-existent video has to be created at the time of the request.
  • a telephone number does not define the capabilities of the device used to request a video.
  • a smart phone could have a choice of software and the requestor could repeat the same request using a different browser (requiring a different video format) for each request.
  • a WURFL PHP library (see the above link) is bundled as part of the RDIP library structure.
  • the WURFL library includes amongst other things:
  • the means to generate 3GP files for all mobile phones and PDAs is provided plus it is useful to hold a format to be provided to non-mobile client devices.
  • 2 pseudo devices, 'generic_mobile' and 'generic_streaming_mobile' are included.
  • the former is injected into the fall back tree above 'generic ⁇ xhtml' and the latter is injected above that if the device supports streaming video.
  • the MediaFormat.php model class provides an interface to the both the WURFL database and the a media_format table.
  • the significant members of the media format table are: application The application used to convert videos; for now always
  • the file extension to be used for files of this format e.g.
  • active Identifies the active format for the application/SCHl_device. There should only be a row for each application/device with the active one set to ; all others should be set to ' ⁇ '.
  • CM_Wurfl which is simply a wrapper for the Tera WURFL class
  • CM_Wurfl to determine the device that best matches the request user agent
  • CM_Wurfl is queried for the 'fall back tree' of devices, whether streaming video is supported and if the requestor is a mobile device;
  • CM_Resource_Video A class called CM_Resource_Video is responsible for creating and retrieving video files.
  • the class focuses on the name and message requirements of the PVS 5 providing 2 main functions:
  • the paths and some filenames related to video management are retrieved from the app.ini configuration file.
  • the calling class can then proceed knowing the video file exists in the required delivery format.
  • the paths and some filenames are retrieved from the app.ini file.
  • the video process folders are grouped together.
  • the configuration file allows for the following separate folders:
  • names source ('base' format) name clips e.g.
  • message clips in preview formats e.g. kara_email_for_you.flv;
  • kara_adam_kara_email_for_you.mpg and in 'delivery' formats, e.g. kara_adam_kara_email_for_you.3gp;
  • trailers source ('base' format) clips to be spliced at the end of messages; watermarks images ('gif or 'png') used to overlay on videos.
  • the WURFL is a dynamic database that is constantly maintained by volunteers as information is corrected and new models introduced. It is currently a manual process to update the local copy.
  • the WURFL library included in the CM library tree includes some utilities to manage the WURFL and these could be exposed within the 'admin' area of the site. Alternatively, an automated process could be created. Human intervention is required to identify if new MediaFormat instances are required to be generated.
  • Administration pages exist to help test device recognition, create and update media format records and test media formats.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Economics (AREA)
  • Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

In a personalised video message system, the system comprises a first database of personalised video files each of which refers in the video content to a respective name or entity and a second database of video message files each of which contains in the video content a respective message or greeting. A selection system enables a user to select from a remote computer a first video file from the first database, a second video file from the second database, and to identify an intended recipient. A video processing means is arranged to join the selected first and second video files to produce in a single video file a personalised message comprising the concatenated video content and and a delivery system sends a message to the identified recipient which includes a means to access the concatenated video content, for example through a SMS message containing a link, activation of which causes the video to be sent to the recipient's device.

Description

Personalised Video Generating and Delivery
Field of the Invention
The present invention relates to a method and system for generating and delivering personalised video content.
Background of the Invention
Digital communications systems, particularly the Internet, have in recent times enabled users to send video and audio messages to other people using email and/or mobile telephone networks. For example, a user can send a prerecorded video clip of a media personality to a friend, relative or colleague in which the personality delivers a message such as 'happy birthday', 'good luck' and so on. The clip is either sent as a link in an email to the recipient's address, or as a link or HTTP request in a SMS message to the recipient's mobile telephone. Such messages are, however, not personalised to the recipient.
In the corporate arena, it is also known for managers to send broadcast-type messages to all, or a sub-set of, employees. This may be for information purposes or to offer some form of congratulations, gratitude or motivational message. Typically, the message is sent by email with, at best, the employee's forename merged into the start of the email to give some degree of personalisation. The use of weblogs or 'blogs' is also very popular, although there is little or no personalisation used with this type of content at the present time.
Summary of the Invention
In a broad sense, the invention provides a method of generating a personalised video message, the method comprising: selecting a first, personalised video file from a first database of personalised files each of which refers in the video content to a respective name or entity; selecting a second, message video file from a second database of files each of which contains in the video content a respective message or greeting, and processing the selected first and second video files to generate a single video file comprising the concatenated video content.
According to a first aspect of the invention, there is provided a personalised video message system, the system comprising a first database of personalised video files each of which refers in the video content to a respective name or entity; a second database of video message files each of which contains in the video content a respective message or greeting; a selection system enabling a user to select from a remote terminal a first video file from the first database, a second video file from the second database, and to identify an intended recipient; video processing means arranged to join the selected first and second video files to produce in a single video file a personalised message comprising the concatenated video content; and a delivery system for sending a message to the identified recipient which message includes a means to access the concatenated video content.
In this way it is possible to generate a personalised video message in which (i) the name of the intended recipient, be it an individual, a subset of individuals from an identifiable group, or the name of an organisation, and (ii) a message is provided in a single video file comprising the concatenated personalised and general message parts. Concatenated in this sense means placing one piece of video content after the other, i.e. in series.
For the purposes of this application, it is assumed that the video incorporates an audio or speech track.
The video content in the first and second databases may comprise prerecorded video from a particular personality. For example, a user can select a sports personality to deliver a video message comprising the personality saying the recipient's forename to camera followed by them delivering a message such as 'happy birthday' or 'good luck' to camera. In the corporate arena, the personalised and general message parts may be recorded in advance by a manager or senior member of the corporation for subsequent delivery to individual employees, or subsets of employees. The system and method is also applicable to blogs, particularly video blogs. In this case, the general message part comprises the blog. This provides an efficient way of adding personalisation currently not available in video blogging. The system and method has many potential applications. Businesses may select video content delivered by well-known business leaders, politicians or inspirational personalities. The system and method also has application in the charity sector, e.g. whereby well-known celebrities can issue personalised charity appeals.
The delivery system may be arranged to send a link to the intended recipient using a communications network in an email, SMS or WAP push message, activation of the link enabling said recipient to receive over the communications network a streamed version of the concatenated video content from the message system.
The video processing means may be arranged to produce the single video file in response to activation of the link at a recipient's device. In this way, the single video file is not generated until the intended recipient actually activates the link at their end, e.g. at their computer terminal or mobile communications device. This avoids the need for the video processing means to store potentially many different sets of joined video clips before the intended recipients actually activate their links. Less memory is therefore needed at the video messaging system.
The video processing means may be arranged to produce the single video file in one of a plurality of available video formats, the format being selected in accordance with the video playing capabilities of the recipient's device which is or are determined using information received from said recipient device in response to activation of the link.
In this respect, there are many different types of potential recipient receiving device, including computers and portable communications devices, including mobile telephones, smartphones and PDAs, each of which may use a different respective operating system and browser having different video decoding and playback capabilities. By detecting the video playing capabilities of the recipient's device at the time the link is activated, then at that time the video can be generated and converted into a format suitable for the device.
The video playing capabilities of the recipient's device can be determined by means of a the system being arranged to receive in response to activation of the link header information identifying the recipient device and a browser of the device and to interrogate a database indicating a format appropriate for said device and browse.
The system may further comprise a time specification system arranged to prompt the user to enter a time and/or date when the message should be delivered to the recipient.
The time specification system may further be arranged to identify the user's local time zone and, in the event that said local time zone differs from that of the link delivery system's local time zone, to calculate the appropriate different delivery time and/or date to send the link relative to the local time zone.
The video processing system may arranged automatically to join the video content in the second file to the end of the video content in the first video file to produce the concatenated video content.
In the case where the link delivery system is arranged to identify that a link should be sent in accordance with a particular time specification, the video processing means can be arranged automatically to generate the concatenated video content for storage and linking in the message subsequently delivered to the intended recipient.
Alternatively, the video processing means may be arranged automatically to generate the concatenated video content only after the link is remotely activated whereafter the video processing means is arranged automatically to generate the concatenated video for transmission to the recipient device.
In accordance with a second aspect, there is provided a method of generating a personalised video message, the method comprising selecting a first, personalised video file from a first database of personalised files each of which refers in the video content to a respective name or entity, selecting a second, message video file from a second database of files each of which contains in the video content a respective message or greeting, and processing the selected first and second video files to generate a single video file comprising the concatenated video content.
Selection may be received from a user over a data or communications network, e.g. the Internet, the method further comprising prompting a user to select the first, personalised video file from a list of available names or entities, select the second, message video file from a list of available messages or greetings, and to input an email address or telephone number associated with an intended recipient or group of recipients. The method may further comprise delivering a link to the intended recipient in an email, SMS or WAP push message, activation of the link enabling said recipient to receive a streamed version of the concatenated video content.
The processing step may be performed in response to activation of the link at a recipient device. Activation of the link can cause information enabling identification of the recipient device type to be received, and, prior to the processing step, the method further comprises determining from the identification information the video playing capabilities of the recipient device, the processing step further comprising generating the single video file using a codec appropriate to the video playing capabilities.
The method may further comprise prompting the user to enter the time and/or date when the message is to be delivered to the recipient and delivering the link in accordance with the specification.
The name and message files may be identified by metadata prior to the specified time and/or date, the video files corresponding to the metadata being processed to generate the concatenated file subsequent to the specified time and/or date. The aim here is to use memory efficiently and this avoids storing concatenated video files for long periods before they are intended to be viewed by the recipient. The method may further comprise identifying the user's local time zone and, in the event that said local time zone differs from that of the link delivery system, calculating the appropriate delivery time and/or date to send the link relative to the local time zone. Identifying the user's local time zone is preferably performed by prompting the user to enter a location and converting the location to a time zone. Alternatively, identifying the user's local time zone can be performed automatically using GPS or the network address of the user's computer terminal.
The video content in the first and second databases preferably comprises pre- recorded video and speech from a particular personality. The personality may be selected by the user from a plurality of available personalities. The plurality of available personalities can be grouped in the databases by sector, e.g. sports, music, film, business leaders, political leaders, inspirational personalities.
The video processing preferably comprises automatically joining the video content in the second file to the end of the video content in the first video file to produce concatenated video content which is stored as a single file. When the delivery system identifies that a link should be sent in accordance with a particular time specification, video processing preferably occurs automatically in accordance with said time-based identification to generate the concatenated video content for storage and linking in a message subsequently delivered to the intended recipient.
The joining of video content may include placing a transition effect between the video content from the first and second video files, e.g. a fade or dissolve effect. This is preferably performed automatically.
The invention, in a second aspect, provides a computer program or suite of computer programs comprising code which, when executed on a processor, performs the steps as defined in the first aspect, or any preferred feature thereof.
According to a third aspect, there is provided a personalised video message system, the system comprising a first database of personalised video files each of which refers in the video content to a respective name or entity; a second database of video message files each of which contains in the video content a respective message or greeting; a selection system enabling a user to select from a remote computer a first video file from the first database, a second video file from the second database, and to identify an intended recipient; video processing means arranged to join the selected first and second video files to produce in a single video file a personalised message comprising the concatenated video content; and a delivery system for sending a message to the identified recipient which includes a means to access the concatenated video content.
The delivery system is preferably arranged to send a link to the intended recipient in an email, SMS or WAP push message, activation of the link enabling said recipient to receive a streamed version of the concatenated video content from the message system. The system may further comprise a time specification system arranged to prompt the user to enter the time and/or date when the message is to be delivered to the recipient. The time specification system can be further arranged to identify the user's local time zone and, in the event that said local time zone differs from that of the link delivery system, to calculate the appropriate delivery time and/or date to send the link relative to the local time zone.
The system may further comprise means to store an identifier associated with each of the selected first and second video files in memory, the identifier being retrieved at, or subsequent to, the time and/or date so specified in order generate the concatenated video file. The aim here is to use memory in the system efficiently and avoid storing concatenated video files for long periods before they are intended to be viewed by the recipient.
According to a fourth aspect, there is provided a method of generating a personalised video message, the method comprising, at a first computer system, (i) receiving selection of a first, personalised video file from a first database of personalised files each of which refers in the video content to a respective name or entity, (ii) receiving selection of a second message video file from a second database of files each of which contains in the video content a respective message or greeting, (iii) generating a link for transmission over a network to a remote recipient device, the link being associated with the selected first and second video files, (iv) receiving in response to activation of said link, data identifying the recipient device type, (v) using the received identifying data to determine the video playback capabilities of the recipient device; and (vi) processing the selected first and second video files to generate a single video file comprising the concatenated video content encoded in a format appropriate to the video playback capabilities determined in step (v).
Brief Description of the Drawings
The invention will now be described, by way of example, with reference to the accompanying drawings in which: Figure 1 is a block diagram showing a typical communications network over which messages generated in accordance with a preferred embodiment can be transmitted;
Figure 2 is block diagram of a personalised messaging system, arranged to operate in accordance with the invention;
Figure 3 is a flow diagram indicating the various steps performed between a user computer and the personalised messaging system to generate a personalised message in preparation for sending to a recipient;
Figure 4 shows a first pull-down menu displayed at the user computer;
Figure 5 shows a second pull-down menu displayed at the user computer;
Figure 6 shows an input text control displayed at the user computer;
Figure 7 shows a third pull-down menu displayed at the user computer;
Figure 8 is a schematic diagram indicating how video processing of individual video files is performed to generate concatenated video content;
Figure 9 shows a fourth pull-down menu displayed at the user computer'
Figure 10 shows a data entry system for specifying the email address or mobile telephone number of an intended recipient;
Figure 1 1 is a flow diagram indicating the steps involved in generating a delivery time specification at the messaging system end;
Figure 12 is a flow diagram indicating the steps involved in a send control process at the messaging system end; and
Figure 13 is a flow diagram indicating the steps involved in a video delivery process for converting video clips to a format appropriate to a particular receiving device at the time the delivered message is opened or activated by a user.
Detailed Description of a Preferred Embodiment
Referring to Figure 1 , there is shown a network arrangement in which a user operating a user terminal 1 can generate a personalised video message for subsequent delivery to a recipient communications terminal such as a computer, PDA or mobile telephone 3. The personalised message is generated by the user 1 accessing a personalised video service (PVS) 5 via the Internet. The PVS 5 uses information provided by the user 1 via its website portal to generate, store and send the video message to the recipient terminal 3.
Referring to Figure 2, the PVS 5 comprises a number of system modules that prompt the user, via the website portal, to enter selections in a particular order.
Initially, the user is prompted to select a personality who will appear in the video content. This may be, for example, a media celebrity, sports person, business leader or politician. Next, a name process 11 prompts the user to select one of a number of stored names from a name database 13. The database 13 stores a limited number of names corresponding to the more common forenames in current usage. The names are stored in alphabetical order and are selected by means of the user initially specifying the first initial of the name, following which an expanded list of names beginning with the specified letter are shown for selection.
The next process is a message select process 15. Based on the name selected in the name process 11 , a video file (MPEG) is retrieved from a name clip database 17 that, as part of its content, includes a pre-recorded greeting to the selected name delivered by the selected personality.
A further part of the message select process 15 prompts the user to select the second part of the message, namely the generalised message content from a predefined list. These may be categorised as, for example, "birthday greetings", "congratulations", "good luck", "motivational", "charity appeals", "blogs" and so on. Selecting a particular category will expand a more specific set of selectable messages such as "18th birthday", "21st birthday" and so on. Selection of a particular message causes a video file (MPEG) to be retrieved from a message clip database 19 that, as part of its content, includes the appropriate pre-recorded message from the selected personality.
Next, a video processing system 21 generates a preview of the personalised message. This comprises joining or splicing the selected message clip to the end of the selected name clip, the result being a concatenated MPEG video clip which is generated and stored as a single file. The concatenated MPEG clip is converted to the FLV format and can be streamed back to the user over the Internet 7. This video processing is performed automatically without user intervention.
Assuming the user is satisfied with the concatenated clip, the next part 23 of the system 5 prompts the user to enter a date and/or time specification (DTS). The DTS 23 enables the user to specify on which date and at what approximate time the message is notified to the recipient 3. This is likely to be important where the message relates to a birthday or similar date-related event. Further details will be specified below.
Next, the user is prompted to enter a delivery specification 25, particularly to indicate how the message is to be notified to the recipient. This may be by means of sending an activatable link to the concatenated file in an email message or by means of sending the link in a SMS or WAP Push message to the recipient's mobile telephone number. The output from the video processing, DTS and delivery specification processes 21 , 23, 25 are stored together as a 'job' in a combined message database 27 for later use by a send control process 33, to be described below.
When the user is satisfied with their selections, they proceed to the 'My Basket' page 29 of the web portal, which is a standard e-commerce process. The user can specify further messages at this time or can simply proceed to 'checkout' by giving their payment details. The payment details are checked by an external verification service 31 which will return either an 'accept' or 'deny' response. If payment is accepted, the job stored in the combined message database 27 is committed for sending and the user is informed accordingly.
As indicated above, there is also provided a send control process 33; this process is responsible for handling the sending and timing of the email or mobile telephone message notifying the recipient that a message is waiting for them to view, together with the activatable link.
Referring to Figure 3, in conjunction with Figures 4 to 10, there will now be described the main communication steps that occur between the user's computer 1 and the PVS 5 in the process of generating a personalised video message.
In a first step 3.1 the user accesses the PVS web portal. Upon selecting the option to generate a new video message, in step 3.2 the user is prompted to select a particular personality who will deliver the message in the video content; selection may be made via a hierarchical menu of personality types (sports; music; film; business, and so on.) The user makes their selection in step 3.3. In step 3.4 the PVS 5 prompts the user to select from a menu referred to herein as List A. As shown in Figure 4, List A 31 comprises a drop down menu from which the user can select the first initial of the recipient's forename, e.g. D. Selection is made in step 3.5 at the user's end. In step 3.6, the PVS 5 prompts the user to select a specific forename from a further menu (retrieved in step 3.7) referred to as List B. As shown in Figure 5, List B 32 comprises a drop down menu from which the user can select a name beginning with the selected initial, e.g. Dan. The user selects the required name in step 3.8.
In response to selection of the forename the PVS 5 displays a text input control box 33 in step 3.9 which allows the user to modify the spelling of the selected name, for example to change Claire to Clare (step 3.10). This edited name will appear in the email or SMS message generated by the send control process 3.29, but will not affect the video content itself. Figure 6 shows a text control box 33 with submit button 34.
Next, the user is prompted to select the main message from a menu of message types or styles (step 3.11). The user is presented with a menu 35 of different messages, such as 'happy birthday' and so on, for which see Figure 7. Selection of the main message by the user takes place in step 3.12. causes the PVS 5 to retrieve the name clip from the name clip database 17 and the message clip from the message clip database 19, both clips corresponding to content delivered by the selected personality. In the next step, 3.13, the video process 21 performs the task of joining (or splicing) the two selected clips together to form the concatenated video clip. This involves retrieving the personalised 'name' video clip and selected message clip as delivered to camera by the selected personality (step 3.14). Referring to Figures 6 to 8, in an exemplary case we assume that the user has selected David Beckham to deliver the message, the forename 'Dan' from List B 32 and a birthday greeting message from menu 35. As shown in Figure 8(a), this results in a name clip 41 being retrieved from the name clip database 17 having as its content David Beckham saying "Hello Dan, it's David here" to camera. As shown in Figure 8(b), a message clip 47 is retrieved from the message clip database 19 having as its content David Beckham saying "Your friends have asked me to wish you a happy birthday" to camera. Figure 8(c) shows the result of processing the clips 41 , 47 in step 3.13 which involves joining the start of the message clip 47 to the end of the name clip 41.
Preferably, a transition effect 49 is automatically placed between the two joined clips 41 , 47 to make the join, when viewed, appear as seamless as possible with no obvious jumping or jitter. The transition effect 49 may be a fade or dissolve effect, for example.
As will be appreciated, each of the name and message clips 41 , 47 comprises video data 43 and audio data 45. References herein to video files or clips are assumed to incorporate audio data in the form of speech. The above video processing step 3.13 is performed automatically without human intervention. This automatic processing may also involve processing the resulting concatenated video file 48 to correct any format errors or differences. This involves generating from the joined MPEG clips a file suitable for streaming, such as a .FLV file, using a MPEG-FLV codec 51. In step 3.14, the user is given the option of previewing the concatenated FLV file 48. Selection causes the PVS 5 to stream the FLV file 48 to the user's terminal (step 3.16) where it can be previewed in a suitable viewer such as Windows Media Player or Quicktime.
The next step 3.17 requires the user to enter a date and time specification, corresponding to the data and preferred time when the concatenated message should be notified to the intended recipient 3. The term 'preferred' is used in regard to the notification time as it is not considered so important for the send control process to send the email or SMS at the exact specified time. Rather, the email or SMS is sent shortly after the specified time.
As indicated in Figure 9, step 3.17 is a relatively straightforward procedure involving selecting the time from a first drop-down menu 55 and the date from a further calendar menu 57. If the date and time occurs in the past, an error message is displayed. Upon receiving the date and time specification, the PVS 5 logs this information against a current job number for the message in the combined message database 27 and performs a date normalisation process (step 3.18).
Data normalisation is required in case the situation arises where the time zone of the user differs from the local time zone of the PVS 5, which is assumed to be at Greenwich Mean Time (GMT) in this case. If the user enters the time 0900 and is located in the time zone GMT- 5 hours, then, without normalisation, the notification message may be sent to the recipient at 0400 if they are in the same time zone as the user.
Referring to Figure 11 , normalisation initially involves prompting the user to indicate their location (step 11.1) by entering their town, country or postal or ZIP code. From this, the location is converted to geographical coordinates (step 11.2) using the Google Maps Application Programming Interface (API). Next (step 11.3), the co-ordinates are converted into a time zone via a request to the GeoNames.org service. In step 11.4, the time zone is used to calculate the equivalent local server time (ELST) corresponding to the time actually specified by the user. So, for the above example, 0900 becomes 1400, which is the time stored against the relevant job number in the combined message database 27.
In step 3.19, the user enters their delivery specification, essentially requiring them to specify either an email notification or mobile phone notification. Referring to Figure 0, this is achieved by simply entering the recipient's email or mobile telephone details into the appropriate text box.
In step 3.20, the delivery specification is logged against the relevant job number in the combined message database 27. The user is also prompted with the option of entering further messages. In step 3.21, if the user chooses to do so, the current job number remains stored against the user's ID and they return to step 3.2. If no further messages are required, the PVS 5 presents to the user their 'shopping cart' and requests payment details in step 3.22. Payment details are entered in step 3.23 and subsequently sent to an external verification service in step 3.24. The result of the verification is notified to the user in step 3.25 and displayed in step 3.26. A positive verification in step 3.24 causes the PVS 5 to commit the relevant job number (or numbers in the case of multiple messages) in the database 27. The final step 3.27 is the send control process which is described below.
The send control process (SCP) is a separate time-initiated process that is responsible for notifying recipients that someone has sent them a video message. It may be regarded as a background process, operating independently from the message generating process, which polls (step 12.1) the database 27 at periodic intervals to identify those committed jobs whose date and time specification (normalised, if necessary) is earlier than the current time (step 12.2). This of course assumes the relevant message for that job has not yet been sent.
For each job identified in step 12.2, the selection information (name clip; message clip) and delivery specification are retrieved from the database 27. For each job, video processing is performed as in step 3.13 described above, namely retrieving the selected name clip and message clip in MPEG format, splicing them together by concatenating the files (step 12.4), processing the resultant file to correct its format (step 12.5), and then further processing it according to the delivery specification. If mobile telephone delivery is specified, the concatenated MPEG file is converted to 3GP format (step 12.6), a HTTP request generated (step 12.7) and the resulting link sent in a SMS or WAP Push HTTP to the recipient's telephone number (step 12.8). Each step is performed automatically. If email delivery is specified, the concatenated MPEG file is converted to .FLV format (step 12.9), a URL to the .FLV file generated (step 12.10) and an email generated which includes the URL (step 12.11). Finally, the email is sent to the recipient's email address in step 12.12. Again, each step is performed automatically. It will be appreciated from the foregoing that the method steps performed by the PVS 5 are implemented in software, or a suite of software systems running on suitable hardware computer systems. In this case, the PVS 5 was developed using the PHP programming language and the Zend Framework library which provides a Model-View-Controller (MVC) structure. Consequently, many of the constituent files fall into the categories of 'controllers' or 'views'. An initial selection of three files demonstrate key elements of the process. These files are:
PersonalController.php - the server logic behind the 'personal' message page; index.phtml - the 'personal' message page view including the client-side logic; and
SenderController.php - the server logic involved in the actual sending of the SMS messages.
The above embodiment assumes that the files created in step 12.6 will always be suited for playback at the recipient's device 3. Where the receiving device 3 is a computer, this will usually be the case since most computers will have media playing software capable of playing the most common codecs. However, in the case of mobile telephones and PDAs, it will be appreciated that the recipient's device (and the software running on it) is not known to the PVS 5 when the job is initially set up; all that is known is the recipient's mobile telephone number. Different mobile telephones and PDAs have different capabilities and can use a number of different browsers which may be unsuited to decoding a particular codec, or may show it in a non-optimal format. A refinement of the above embodiment therefore provides a video delivery process (VDP) for converting video clips to a format appropriate to a particular receiving device at the time the delivered message is opened or activated by the recipient. In the refined system, described here with reference to Figure 13, a so-called Receiving Device Identifier Program (RDIP) is provided as part of the PVS 5; the role of the RDIP is to use the known Wireless Universal Resource File (WURFL) to identify the requesting device, and more particularly its video playing capabilities, at the time the link to the video is activated by the recipient at their device. Details of the WURFL can be found at http://wurfl.sourceforge.net . Having identified the requesting device and its capabilities, an appropriate format, in this case a 3GP format, is identified and a check is performed to see if there is already stored at the PVS 5 the video combination in the identified 3GP format. If so, it can be delivered; if not, it is generated at the PVS and then delivered.
Although 3GP is used in this example, other formats can be used if this is the requirement of the requesting mobile device. Examples include 3GP (for general phones), MP4/H264 (for iPhones/Android), AVI (to view on Blackberrys), and FLV (For PC's).
Referring to Figure 13, in a first step 13.1 , the recipient activates their link to the video, and a connection is established. The recipient's request contains 'header' information which identifies the device agent (indicating the device and browser). In step 13.2, the request is passed to a 'controller' which uses a MediaFormat class to identify the appropriate delivery format for the device agent. This is a 3-stage process: a. a device database is interrogated to build the fall back tree of devices (the concept of WURFL fall back trees is discussed below); b. a media format database table is interrogated to find the active formats that match the fall back tree of devices; and c. the active format that relates to the most specialised device in the fallback tree is selected.
In step 13.3, the recipient's request is used to identify the contents of the personalised video, e.g. according to the specification stored in the combined message database 27. In step 13.4, a check is performed to identify whether a video with the required content in the selected active format exists. If it does, then in step 13.5 it can be delivered to the device. If it does not exist then in step 13.6, it is created and delivered. It can also be stored for later use, e.g. in case a further request is received for the particular message combination in the particular format.
It will be appreciated that identifying the requesting device and creating the video are two separate processes. Generally, the requesting device, and therefore the format to be delivered, can only be identified at the time of the request. The latest point at which the video can be created is after identification and immediately before delivery. This is the default; there is nothing to prevent a video of specific content and format being created at any time before a request is received, however. The challenge is to balance the cost of the resources required to pre-create and store all possible combinations of content and format that could be requested against the delay incurred when a non-existent video has to be created at the time of the request. In terms of whether a video file can be created before a request is received based on the telephone number specified by the 'giver' of the message, it will be appreciated that a telephone number does not define the capabilities of the device used to request a video. In fact, a smart phone could have a choice of software and the requestor could repeat the same request using a different browser (requiring a different video format) for each request.
In practice, one could envisage a few situations where pre-creation would be practicable. Firstly, a corporate campaign for staff where the requesting devices are known, e.g. all staff use Blackberry phones. Also, a corporate campaign for external customers where the device agent of each customer's mobile has already been identified and stored in a customer/recipient database (assuming each had to register using their phone at some point in the past). This might still require a 'dynamic create' where customers change their phone but keep their number and do not Ye-register' but after a single request the new device agent could be stored for future reference.
There will now be described in greater detail the above identification and video generating steps of the RDIP with specific reference to WURFL and fall back trees.
To recap, the objectives of the VDP and RDIP may be summarised:
1. to use the WURFL to identify requesting devices. 2. to automatically select the appropriate video format for the requesting device.
3. to store the parameters required to create the chosen format in a database.
4. to define a structure for data (videos, logs, etc.) folders. Identifying the Requesting Device
A WURFL PHP library (see the above link) is bundled as part of the RDIP library structure. The WURFL library includes amongst other things:
• a version of the WURFL XML file used to create a MySQL database (see TeraWurflConfig.php for database configuration settings);
• PHP classes to interrogate the database;
• an 'admin' folder that, if made visible to a web server, exposes various utilities.
It is important to appreciate the WURFL concept of the 'fall back tree' of devices. This is a hierarchical tree with the most generic set of capabilities at the root which becomes more specific as one moves up the tree. Each set of capabilities has an identifying 'device' string. For example, the fall back tree for a Blackberry 8800 is:
blackberry8800_ver1
blackberry_generic_ver4_sub20
blackberry_generic_ver4_sub10
blackberry_generic_ver4
blackberry_generic_ver3_sub70
blackberry_generic_ver3_sub60
blackberry_generic_ver3_sub50
blackberry_generic_ver3_sub30
blackberry_generic_ver2
blackberry_generic
generic_xhtml
generic
Ideally, the means to generate 3GP files for all mobile phones and PDAs is provided plus it is useful to hold a format to be provided to non-mobile client devices. To achieve this, 2 pseudo devices, 'generic_mobile' and 'generic_streaming_mobile' are included. For mobile devices, the former is injected into the fall back tree above 'generic^xhtml' and the latter is injected above that if the device supports streaming video.
The MediaFormat.php model class provides an interface to the both the WURFL database and the a media_format table. The significant members of the media format table are: application The application used to convert videos; for now always
'ffmpeg'.
wurfl device A WURFL device string; additional values added
('generic_mobile' and 'generic_streaming_mobile') as keys for fallback formats.
extension The file extension to be used for files of this format, e.g.
'3gp' or one of the aforementioned alternatives.
revision An integer to distinguish between older and newer versions of parameters.
active Identifies the active format for the application/wurfl_device. There should only be a row for each application/device with the active one set to ; all others should be set to 'Ν'.
params The parameters to be passed to the video creation application; an array stored as a JSON-encoded string. comments Optional; a free-format string.
The most important method that MediaFormat provides is called getFormatForClient(). This method:
• instantiates CM_Wurfl (which is simply a wrapper for the Tera WURFL class); • calls CM_Wurfl to determine the device that best matches the request user agent;
• CM_Wurfl is queried for the 'fall back tree' of devices, whether streaming video is supported and if the requestor is a mobile device;
• if necessary, the fall back tree is extended by adding CM Online's own generic device strings;
• the media_format table is queried to find all the active formats that match devices in the fall back tree; and
• the format selected for the device that is furthest from the root, i.e. the most specialised.
At this point, we know the extension of the video file we require to service the device and the parameters needed to create that file if it does not already exist.
Creating the Video File
A class called CM_Resource_Video is responsible for creating and retrieving video files. The class focuses on the name and message requirements of the PVS 5 providing 2 main functions:
create($name, $message, $mediaFormat, $watermark = false) createMessage($message, $mediaFormat, $watermark = false) In both cases, the class adopts the following approach:
1. construct the necessary path, filename and extension and check if the file exists;
2. if it does then return 'success';
3. if it doesn't, check if the source video files exist;
4. if they do then convert them to the required format using the parameters returned by the MediaFormat class and return. For create(), if the concatenated source video does not exist, the source name and message files are spliced together to create a personalised video in 'base' format then this file is converted to the required 'delivery' format. Currently, the 'base' video format is 'mpg' as this allows for concatenation of the component videos.
The paths and some filenames related to video management are retrieved from the app.ini configuration file.
Assuming the CM_Resource_Video class returns 'success', the calling class can then proceed knowing the video file exists in the required delivery format.
Locations of Video Files
As already stated, the paths and some filenames (e.g. watermark images) are retrieved from the app.ini file. Typically, the video process folders are grouped together. The configuration file allows for the following separate folders:
names source ('base' format) name clips, , e.g.
kara_adam.mpg;
messages source ('base' format) message clips, e.g.
kara_email_for_you.mpg. Also, message clips in preview formats, e.g. kara_email_for_you.flv;
personal spliced videos (in 'base' format), e.g.
kara_adam_kara_email_for_you.mpg, and in 'delivery' formats, e.g. kara_adam_kara_email_for_you.3gp;
trailers source ('base' format) clips to be spliced at the end of messages; watermarks images ('gif or 'png') used to overlay on videos.
Maintenance Aspects of the Process Review the media format devices and parameters
It is likely with the development of video processing software that media formats will be able to be optimised or formats for a different video processor could be created.
Keeping the WURFL up to date
The WURFL is a dynamic database that is constantly maintained by volunteers as information is corrected and new models introduced. It is currently a manual process to update the local copy. The WURFL library included in the CM library tree includes some utilities to manage the WURFL and these could be exposed within the 'admin' area of the site. Alternatively, an automated process could be created. Human intervention is required to identify if new MediaFormat instances are required to be generated.
Administration pages to maintain the media format table
Administration pages exist to help test device recognition, create and update media format records and test media formats. The balance between disk resource and 'time-to-deliver'
As indicated above, all the unique combinations of a video (performer, name, message and format), once requested and created, are retained to provide the quickest response. The more combinations, the more disk space required.
In some situations this can mitigated quite simply: e.g. once a corporate campaign has ended, all videos for that particular message could be deleted or archived - automatically or manually. Normally, the type of the requesting device is not known until the request for the video is received (although this may not be the case in some corporate scenarios). In an ideal world, all combinations of delivery format videos will be pre-created and able to be delivered 'on demand'. In the event that this approach is constrained by some factor (disk space, processor resource or time to create) then it is desirable to identify the combinations that will be the most popular and focus resources on those. It is anticipated that 'most popular' could be defined by any combination of performer, name, message or format and that the prediction of popularity will be improved by the analysis of previous deliveries.

Claims

1. A personalised video message system, the system comprising a first database of personalised video files each of which refers in the video content to a respective name or entity; a second database of video message files each of which contains in the video content a respective message or greeting; a selection system enabling a user to select from a remote terminal a first video file from the first database, a second video file from the second database, and to identify an intended recipient; video processing means arranged to join the selected first and second video files to produce in a single video file a personalised message comprising the concatenated video content; and a delivery system for sending a message to the identified recipient which message includes a means to access the concatenated video content.
2. A system according to claim 1 , wherein the delivery system is arranged to send a link to the intended recipient using a communications network in an email, SMS or WAP push message, activation of the link enabling said recipient to receive over the communications network a streamed version of the concatenated video content from the message system.
3. A system according to claim 2, wherein the video processing means is arranged to produce the single video file in response to activation of the link at a recipient's device.
4. A system according to claim 3, wherein the video processing means is arranged to produce the single video file in one of a plurality of available video formats, the format being selected in accordance with the video playing capabilities of the recipient's device which is or are determined using information received from said recipient device in response to activation of the link.
5. A system according to claim 4, wherein the video playing capabilities of the recipient's device is or are determined by means of a the system being arranged to receive in response to activation of the link header information identifying the recipient device and a browser of the device and to interrogate a database indicating a format appropriate for said device and browse.
6. A system according to any one of claims 1 to 5, further comprising a time specification system arranged to prompt the user to enter a time and/or date when the message should be delivered to the recipient.
7. A system according to claim 6, wherein the time specification system is further arranged to identify the user's local time zone and, in the event that said local time zone differs from that of the link delivery system's local time zone, to calculate the appropriate different delivery time and/or date to send the link relative to the local time zone.
8. A system according to any one of claims 1 to 7, wherein the video content in the first and second databases comprises pre-recorded video and speech from the same personality.
9. A system according to according to claim 8, wherein the plurality of available personalities are grouped in the databases by sector, e.g. sports, music, film, business leaders, political leaders, inspirational personalities.
10. A system according to any one of claims 1 to 9, wherein the video processing system automatically joins the video content in the second file to the end of the video content in the first video file to produce the concatenated video content.
11. A system according to claim 10, wherein the joining includes placing a transition effect between the video content from the first and second video files.
12. A system according to claim 6 and any claim dependent thereon, wherein when the link delivery system identifies that a link should be sent in accordance with a particular time specification, the video processing means is arranged automatically to generate the concatenated video content for storage and linking in the message subsequently delivered to the intended recipient.
13. A system according to claim 6 and any claim dependent thereon, wherein when the link delivery system identifies that a link should be sent in accordance with a particular time specification, the video processing means is arranged automatically to generate the concatenated video content only after the link is remotely activated whereafter the video processing means is arranged automatically to generate the concatenated video for transmission to the recipient device.
14. A method of generating a personalised video message, the method comprising selecting a first, personalised video file from a first database of personalised files each of which refers in the video content to a respective name or entity, selecting a second, message video file from a second database of files each of which contains in the video content a respective message or greeting, and processing the selected first and second video files to generate a single video file comprising the concatenated video content.
15. A method according to claim 14, wherein selection is received from a user over a data network, the method further comprising prompting a user to select the first, personalised video file from a list of available names or entities, select the second, message video file from a list of available messages or greetings, and to input an email address or telephone number associated with an intended recipient or recipients.
16. A method according to claim 15, further comprising delivering a link to a device associated with the intended recipient in an email, SMS or WAP push message over a data or communications network, activation of the link causing delivery of a streamed version of the concatenated video content to the recipient device.
17. A method according to claim 16, wherein the processing step is performed in response to activation of the link at the recipient device.
18. A method according to claim 17, wherein activation of the link causes information enabling identification of the recipient device type to be received, and, prior to the processing step, the method further comprises determining from the identification information the video playing capabilities of the recipient device, the processing step further comprising generating the single video file using a codec appropriate to the video playing capabilities.
19. A method according to claim 18, wherein the video playing capabilities of the recipient device type is or are determined by means of receiving in response to activation of the link header information identifying the recipient device type and a browser of the device and interrogating a database indicating a format appropriate for said device and browser.
20. A method according to any one of claims 15 to 19, further comprising prompting the user to enter a time and/or date specification indicative of when the message is to be delivered to the recipient and delivering the link in accordance with the specification.
21. A method according to claim 20, further comprising identifying the user's local time zone and, in the event that said local time zone differs from that of a system arranged to deliver the link, calculating the appropriate delivery time and/or date to send the link relative to the local time zone.
22. A method according to claim 21 , wherein identifying the user's local time zone is performed by prompting the user to enter a location and converting the location to a time zone.
23. A method according to claim 21 , wherein identifying the user's local time zone is performed automatically using GPS or the network address of the user's computer terminal.
24. A method according to any one of claims 14 to 23, wherein the video content in the first and second databases comprises pre-recorded video and speech from the same personality.
25. A method according to claim 24, wherein the personality is selected by the user from a plurality of available personalities.
26. A method according to claim 25, wherein the plurality of available personalities are grouped in the databases by sector, e.g. sports, music, film, business leaders, political leaders, inspirational personalities.
27. A method according to any one of claims 14 to 26, wherein the video processing comprises automatically joining the video content in the second file to the end of the video content in the first video file to produce the concatenated video content.
28. A method according to claim 20 or any claim dependent thereon, wherein, if it is identified that a link should be sent in accordance with a particular time specification, video processing occurs automatically to generate the concatenated video content for storage and linking in the message subsequently delivered to the intended recipient.
29. A method according to claim 20 or any claim dependent thereon, wherein, if it is identified that a link should be sent in accordance with a particular time specification, video processing occurs automatically to generate the concatenated video content only after the link is remotely activated whereafter it is delivered to the intended recipient.
30. A method of generating a personalised video message, the method comprising, at a first computer system, (i) receiving selection of a first, personalised video file from a first database of personalised files each of which refers in the video content to a respective name or entity, (ii) receiving selection of a second message video file from a second database of files each of which contains in the video content a respective message or greeting, (iii) generating a link for transmission over a network to a remote recipient device, the link being associated with the selected first and second video files, (iv) receiving in response to activation of said link, data identifying the recipient device type, (v) using the received identifying data to determine the video playback capabilities of the recipient device; and (vi) processing the selected first and second video files to generate a single video file comprising the concatenated video content encoded in a format appropriate to the video playback capabilities determined in step (v).
31. A computer program or suite of computer programs comprising computer-readable code which, when executed on a processor, performs the steps as defined in any one of claims 14 to 30.
32. A non-transitory computer-readable storage medium having stored thereon computer-readable code, which, when executed by computing apparatus, causes the computing apparatus to perform a method as claimed in any one of claims 1 to 30.
PCT/GB2011/000525 2010-04-06 2011-04-05 Personalised video generating and delivery WO2011124880A2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP11722851.0A EP2556634B1 (en) 2010-04-06 2011-04-05 Personalised video generating and delivery

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
GB1005702A GB2479355A (en) 2010-04-06 2010-04-06 Personalised Video Generation and Delivery
GB1005702.4 2010-04-06
GB1017865.5 2010-10-22
GB1017865A GB2479425A (en) 2010-04-06 2010-10-22 Personalised Video Generation and Delivery

Publications (2)

Publication Number Publication Date
WO2011124880A2 true WO2011124880A2 (en) 2011-10-13
WO2011124880A3 WO2011124880A3 (en) 2012-01-12

Family

ID=42228903

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2011/000525 WO2011124880A2 (en) 2010-04-06 2011-04-05 Personalised video generating and delivery

Country Status (4)

Country Link
US (1) US20110246890A1 (en)
EP (1) EP2556634B1 (en)
GB (2) GB2479355A (en)
WO (1) WO2011124880A2 (en)

Families Citing this family (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10410237B1 (en) 2006-06-26 2019-09-10 Sprint Communications Company L.P. Inventory management integrating subscriber and targeting data
US10664851B1 (en) 2006-11-08 2020-05-26 Sprint Communications Company, L.P. Behavioral analysis engine for profiling wireless subscribers
US10068261B1 (en) 2006-11-09 2018-09-04 Sprint Communications Company L.P. In-flight campaign optimization
US8824645B2 (en) * 2011-09-30 2014-09-02 Verizon Patent And Licensing Inc. Video messaging systems and methods
GB201211353D0 (en) * 2012-06-26 2012-08-08 Cm Online Ltd Interactive video
US9886173B2 (en) 2013-03-15 2018-02-06 Ambient Consulting, LLC Content presentation and augmentation system and method
US10365797B2 (en) 2013-03-15 2019-07-30 Ambient Consulting, LLC Group membership content presentation and augmentation system and method
US10405173B1 (en) 2013-06-05 2019-09-03 Sprint Communications Company L.P. Method and systems of collecting and segmenting device sensor data while in transit via a network
US9590938B1 (en) 2013-09-11 2017-03-07 Sprint Communications Company L.P. System and method for identifying a mobile device with near real time visualization to action
US9922347B1 (en) 2013-11-27 2018-03-20 Sprint Communications Company L.P. Ad management using ads cached on a mobile electronic device
US9734515B1 (en) 2014-01-09 2017-08-15 Sprint Communications Company L.P. Ad management using ads cached on a mobile electronic device
US10055757B1 (en) 2014-01-21 2018-08-21 Sprint Communications Company L.P. IP address hashing in advertisement gateway
US9836771B1 (en) 2014-01-21 2017-12-05 Sprint Communications Company L.P. Client mediation and integration to advertisement gateway
US9984395B1 (en) 2014-01-21 2018-05-29 Sprint Communications Company L.P. Advertisement mediation of supply-demand communications
US10013707B1 (en) 2014-01-21 2018-07-03 Sprint Communications Company L.P. Address modification for advertisement mediation
US9537811B2 (en) 2014-10-02 2017-01-03 Snap Inc. Ephemeral gallery of ephemeral messages
US9396354B1 (en) 2014-05-28 2016-07-19 Snapchat, Inc. Apparatus and method for automated privacy protection in distributed images
US9779532B2 (en) * 2014-07-31 2017-10-03 Emonster, Inc. Customizable animations for text messages
US9508090B1 (en) * 2014-09-24 2016-11-29 Sprint Communications Company L.P. End user participation in mobile advertisement
US9818133B1 (en) 2014-10-20 2017-11-14 Sprint Communications Company L.P. Method for consumer profile consolidation using mobile network identification
US10311916B2 (en) 2014-12-19 2019-06-04 Snap Inc. Gallery of videos set to an audio time line
US10133705B1 (en) * 2015-01-19 2018-11-20 Snap Inc. Multichannel system
CN112040410B (en) 2015-03-18 2022-10-14 斯纳普公司 Geo-fence authentication provisioning
US20180139408A1 (en) * 2016-11-17 2018-05-17 Parrotty, LLC Video-Based Song Comparison System

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2290195A1 (en) * 1998-11-20 2000-05-20 Star Greetings Llc System and method for generating audio and/or video communications
US7123696B2 (en) * 2002-10-04 2006-10-17 Frederick Lowe Method and apparatus for generating and distributing personalized media clips
US20050278773A1 (en) * 2003-07-08 2005-12-15 Telvue Corporation Method and system for creating a virtual television network
US20060136556A1 (en) * 2004-12-17 2006-06-22 Eclips, Llc Systems and methods for personalizing audio data
US8156176B2 (en) * 2005-04-20 2012-04-10 Say Media, Inc. Browser based multi-clip video editing
US20090154665A1 (en) * 2005-11-28 2009-06-18 Galvin Brian M Authenticated audiographs from voice mail
US20090228919A1 (en) * 2007-11-16 2009-09-10 Zott Joseph A Media playlist management and viewing remote control
US8893171B2 (en) * 2007-05-24 2014-11-18 Unityworks! Llc Method and apparatus for presenting and aggregating information related to the sale of multiple goods and services
WO2009004636A2 (en) * 2007-07-05 2009-01-08 Playwagon Ltd. A method, device and system for providing rendered multimedia content to a message recipient device
US20090300685A1 (en) * 2008-05-30 2009-12-03 Airme Inc. System, method, and device for transmitting video captured on a wireless device
US8364765B2 (en) * 2008-11-13 2013-01-29 International Business Machines Corporation Prioritizing electronic messages based upon geographical location of the recipient
US8775668B2 (en) * 2008-12-10 2014-07-08 At&T Intellectual Property I, Lp Redirection of multimedia content between receiver devices associated with a user
US20100299687A1 (en) * 2009-05-23 2010-11-25 Adrian Bertino-Clarke Peer-to-peer video content distribution

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None

Also Published As

Publication number Publication date
GB2479425A (en) 2011-10-12
GB201017865D0 (en) 2010-12-01
GB2479355A (en) 2011-10-12
WO2011124880A3 (en) 2012-01-12
EP2556634A2 (en) 2013-02-13
GB201005702D0 (en) 2010-05-19
US20110246890A1 (en) 2011-10-06
EP2556634B1 (en) 2019-12-04

Similar Documents

Publication Publication Date Title
EP2556634B1 (en) Personalised video generating and delivery
US10375136B2 (en) Method for creating and providing layered syndicated data for multimedia content to users
US9749368B2 (en) Social network media sharing with client library
US20160342377A1 (en) Synchronizing presentation states between multiple applications
US20100122170A1 (en) Systems and methods for interactive reading
US20060136556A1 (en) Systems and methods for personalizing audio data
US20070288836A1 (en) System, apparatus and method for creating and accessing podcasts
US20070088832A1 (en) Subscription control panel
US20070220048A1 (en) Limited and combined podcast subscriptions
US20070118801A1 (en) Generation and playback of multimedia presentations
US20140337761A1 (en) Locating and sharing audio/visual content
US20090307602A1 (en) Systems and methods for creating and sharing a presentation
US20100070862A1 (en) In-page embeddable platform for media selection and playlist creation
US20120177345A1 (en) Automated Video Creation Techniques
CN103518220A (en) Changes to documents automatically summarized in electronic messages
EP3036925A1 (en) Method and arrangement for processing and providing media content
CN111209727A (en) Picture processing method and device, electronic equipment and storage medium
US20150180946A1 (en) Interactive System
US9762703B2 (en) Method and apparatus for assembling data, and resource propagation system
WO2002001392A2 (en) Networked audio posting method and system
US9002841B2 (en) Feed validator
JP2008523759A (en) Method and system for synthesizing video messages
US11921999B2 (en) Methods and systems for populating data for content item
Lahti et al. A mobile phone-based context-aware video management application
US20230042209A1 (en) Tag Element System for User Content

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 11722851

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2011722851

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 9320/CHENP/2012

Country of ref document: IN