WO2010063070A1 - Procédé et système pour l'affichage de données sur un terminal mobile - Google Patents
Procédé et système pour l'affichage de données sur un terminal mobile Download PDFInfo
- Publication number
- WO2010063070A1 WO2010063070A1 PCT/AU2009/001573 AU2009001573W WO2010063070A1 WO 2010063070 A1 WO2010063070 A1 WO 2010063070A1 AU 2009001573 W AU2009001573 W AU 2009001573W WO 2010063070 A1 WO2010063070 A1 WO 2010063070A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- content
- segments
- text
- display
- data
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/957—Browsing optimisation, e.g. caching or content distillation
- G06F16/9577—Optimising the visualization of content, e.g. distillation of HTML documents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/103—Formatting, i.e. changing of presentation of documents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/12—Use of codes for handling textual entities
- G06F40/131—Fragmentation of text files, e.g. creating reusable text-blocks; Linking to fragments, e.g. using XInclude; Namespaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72445—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting Internet browser applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W8/00—Network data management
- H04W8/22—Processing or transfer of terminal data, e.g. status or physical capabilities
Definitions
- the invention relates to displaying data on a mobile terminal such as a mobile phone or personal digital assistant (PDA).
- a mobile terminal such as a mobile phone or personal digital assistant (PDA).
- PDA personal digital assistant
- An example of an application of the invention is displaying information from web sites on a mobile phone.
- Mobile terminals such as mobile phones and personal digital assistants (PDAs) have become items regularly carried by people. These devices are commonly used as replacements for manual pocketbooks or diaries, we use them to keep track of phone numbers and to keep or send notes to others using messaging services.
- PDAs personal digital assistants
- the small size of mobile terminals generally means these are less powerful processing devices than desktop or portable computers.
- Mobile terminals also generally have small screens and the user input interface is limited to either a keypad or very small keyboard unit with multi function individual keys which is often awkward to use. Due to these limitations it is generally more awkward to download and read information on a mobile terminal than on a typical personal computer.
- a method of formatting content for display on a mobile terminal with a display comprising the steps of: reading values of predetermined formatting parameters including one or more of: parameters based on display limitations for the mobile terminal, and user specified parameters; dividing the content data into a sequence of consecutive segments according to the read parameter values by performing the steps of: determining portions of content based on text and non-text content types; optionally replacing content portions with marker segments, each marker segment being associated with a content object comprising the replaced content portion, based on one or more predetermined parameter values; and for each text content portion not being replaced with a marker segment, segmenting the text portion into one or more text segments based on at least one predetermined parameter value.
- a method of displaying content data on a mobile terminal wherein the content data comprises a sequence of consecutive segments based on predetermined formatting parameter values, wherein the consecutive segments include at least one marker segment associated with a content object, ordered such that markers appear with any text when displayed, and the predetermined formatting parameter values include one or more of: parameter values based on display limitations for the mobile terminal, and user specified parameter values.
- an application for installation on a mobile terminal to adapt the mobile terminal to display content comprising a sequence of consecutive segments based on predetermined formatting parameter values including parameter values based on display limitations for the mobile terminal and user specified parameter values, wherein the consecutive segments include at least one marker segment associated with a content object, whereby the content data is displayed on a mobile terminal display with markers appearing with any text.
- a method for providing and displaying content on a mobile terminal with a display comprising the steps of: acquiring a content data stream by a mobile terminal; formatting the content data stream acquired by the mobile terminal by: reading values of predetermined formatting parameters including one or more of: parameters based on display limitations for the mobile terminal, and user specified parameters; dividing the content data into a sequence of consecutive segments according to the read parameter values by performing the steps of: determining portions of content based on text and non-text content types; optionally replacing content portions with marker segments, each marker segment being associated with a content object comprising the replaced content, if directed to do so based on a predetermined parameter value; and for each text content portion not being replaced with a marker segment, segmenting the text portion into one or more text segments based on at least one predetermined parameter value, and displaying the formatted content on the display.
- a system arranged to format provided content data for display on a display of a mobile device, the system comprising: a parameter module adapted to store values of predetermined formatting parameters including one or more of: parameters based on display limitations for the mobile terminal, and user specified parameters; a text module arranged to segment text portions of content data into one or more text segments based on at least one predetermined parameter value; a marker module arranged to generate a marker segment associated with a content object; and a formatter arranged to control the operation of the text module and marker module, based on one or more predetermined parameter values, to divide provided content data into a sequence of consecutive segments.
- the above dividing the content data into consecutive segments may be undertaken before transmission of the content to the mobile terminal so that is it received by the mobile terminal as consecutive segments, or the content may be segmented at the mobile terminal.
- content formatted for display on a mobile terminal as a sequence of consecutive segments and including instructions executable by a mobile terminal browser to adapt the mobile terminal to display content comprising a sequence of consecutive segments based on predetermined formatting parameter values including parameter values based on display limitations for the mobile terminal and user specified parameter values, wherein the consecutive segments include at least one of: text segments; and marker segments each associated with a content object, whereby the content data is displayed on a mobile terminal display with markers appearing with any text.
- Figure 1 is a block diagram of an embodiment of a system for acquiring and displaying content on a mobile phone.
- Figure 2 is a flowchart representing an embodiment of a content formatting method.
- Figure 3 is an example of a configuration screen for viewing and setting user variable parameters.
- Figure 4 is a block diagram illustrating the interaction between a mobile terminal, content providers, and support applications according to one embodiment.
- Figure 5 illustrates an embodiment of formatting and displaying scrolling text on a mobile terminal.
- Figure 6 illustrates an embodiment of formatting and displaying scrolling text as images on a mobile terminal.
- Figure 7 illustrates an embodiment of formatting and displaying scrolling text and markers for non-text content on a mobile terminal.
- Figure 8 illustrates an example of a mobile terminal displaying text and markers for non-text content.
- Figure 9 is a flow chart of an example of a display process for displaying text and markers for non-text content.
- Figure 10 is a block diagram of an example of a system for formatting content data for display on a mobile terminal.
- Figure 1 1 is a flowchart of a process for embedding instructions for player functions into content being formatted for display on a mobile terminal using a generic browser. Detailed Description:
- Embodiments of the formatting method can be applied during the preparation and storage of content data for subsequent display. Embodiments also provide methods for scrolling displayed data.
- the system 100 enables content to be provided to and displayed on a mobile terminal 105.
- the system 100 comprises a content acquisition interface 1 10, an engine 120 for formatting and controlling display of the acquired content 120 and a display 130.
- the content acquisition interface 110 is adapted to enable the mobile terminal 105 to acquire a content data stream from one or more content providers 140, 141 and 142.
- the content providers could include a dedicated device 140 adapted to transmit content data directly to the mobile 105, a personal computer 141 adapted to transfer content data files to the mobile phone, or an internet site 142 which can be accessed from the mobile phone via a telecommunication network to acquire content data, data may also be acquired via e-mail capability provided in the mobile terminal.
- the content data stream may be displayed as it is acquired or stored on the mobile phone for later display.
- the engine 120 is adapted to format the acquired content data stream according to one or more predetermined parameters.
- the engine 120 can also control presentation and playing of the content on the display 130.
- the parameters include parameters based on the limitations of the device display limitations for the mobile terminal 105, and user specified parameters.
- parameters based on the device display capabilities can include: parameters based on screen resolution, colour display capability, image display capability, screen size, screen refresh rate, display buffer size and the like.
- Examples of user specified parameters include: font size, font type, scroll rate, scrolling direction, colour mode etc.
- the formatted data is then displayed using the display component 130, and the engine can be used control how the formatted content is displayed, for example based on user parameters for scrolling speed and font size.
- the display component typically includes a screen.
- the display component may also include features such audio output, tactile output such as vibration, or other visual outputs such as visual projection or lights.
- Content data may be acquired in a format ready for display on the mobile terminal or as a data stream which is then formatted for display using the formatting component of the engine 120 of the mobile terminal.
- the formatting component of the engine 120 may perform some re-formatting of the content data after download to the mobile terminal in response to user input, for example a user input which modifies a user specified parameter value.
- An example of formatting data for display is illustrated in Figure 2.
- the content data may be formatted in two stages with a first formatting stage being performed prior to content access by the mobile terminal and the second stage performed as the content data is streamed to the mobile terminal either at the point of transmission or at the mobile terminal.
- the content data may be partially formatted based on preset parameter values prior to streaming the content data to a target mobile terminal, as the content data is streamed to the target mobile terminal it may be divided into segments of a given size based on parameter values for the target mobile terminal. This dividing into segments may be performed by the streaming server or by the mobile terminal as the content is received.
- content data may be pre-formatted for display on a mobile terminal and include embedded formatting instructions.
- the embedded formatting instructions can enable enhanced display features to be provided using a standard mobile terminal browser.
- the embedded formatting instructions may include tags or scripts which, when executed by the standard browser, can be used control how the formatted content data is displayed, for example based on user parameters for scrolling speed and font size.
- Embedded instructions can also enable content data to be replaced with markers associated with the content data to enable later retrieval.
- embedded instructions can enable editing of the content.
- the editing of content can include editing using markers.
- the mobile terminal can be a mobile phone, personal digital assistant (PDA), portable computer, media player, e-book reader or the like.
- PDA personal digital assistant
- a mobile terminal can also be a content provider as well as a content acquirer, for example where terminal to terminal data sharing or transfer is possible.
- a method of formatting content for display on a mobile terminal is proposed where the content data is divided into a sequence of consecutive segments according to predetermined parameters. Some of the parameter values may be based on the display capability of the mobile terminal.
- the formatting method enables content objects, such as text, images, hyperlinks, animations, video clips, data entry fields, audio files, or other types of non-text content to be replaced by markers.
- Each marker is linked to the associated content object using linking data which can be used to retrieve the replaced content data for display in response to a user command.
- Whether or not some content objects or which types of content objects are replaced by markers when content data is formatted can be based on user specified parameters. For example a user may specify that images are to be replaced but not hyperlinks or text.
- the markers can be icons or shapes which can appear in line with content text. The style, shape, size, appearance etc of markers can be controlled using user specified parameters.
- the marker's linking data is used to retrieve the associated content object in response to a user command.
- the content objects may be subject to some processes for preparing the content object for rendering on the mobile terminal. Such processes can include, but are not limited to, any one or more of reformatting, resizing, image or video resolution reduction, sound quality reduction, data compression etc. Such processes can reduce the amount of data required to be downloaded to the mobile terminal and/or reduce the amount of processing required to be performed at the mobile terminal to render the content object.
- the text can be divided into segments based on at least one predetermined parameter value. For example, the text segment size may be based on screen width.
- Replaced content objects may be downloaded along with the content and stored in device memory for retrieval using the linking data in response to user commands.
- the replaced content objects are not downloaded with the formatted content but downloaded selectively in response to user commands to retrieve the selected object. It should be appreciated that this enables a user to control and potentially minimise the amount of data downloaded to the mobile device, by only retrieving data for content objects which are selected by the user.
- Some embodiments also enable a user to edit or annotate downloaded content.
- the user's edits or annotations can be added to the user's version of the content using markers.
- a user may edit the content by overwriting some text.
- the overwritten text may be stored as a content object associated with a marker indicating where the user edited the original text.
- a user may wish to record their thoughts in respect of a portion of the content and a marker can be added for an annotation.
- the user may type or record their comments using a voice recorder or voice to text.
- comments may be captured as images of handwriting using a touch screen or using handwriting to text conversion.
- photographs, drawings, images, animations, videos or sound recordings may also be appended to content using markers.
- the marker is added to the sequence of segments and the associated content object can be stored locally on the user's device.
- the user created marker and content object can also be transmitted for storage with the original content or a user's version of the content, for example on a server or PC.
- new content objects may be inserted into the displayed content rather than using markers.
- markers from original content may invite the user to enter data.
- the original content is a survey, form, test etc
- the original content may include data entry fields, check boxes, spaces etc for a user to enter data.
- the formatter is adapted to identify such content fields and associate each field with a data entry marker.
- the content object associated with the data entry marker is editable by the user. For example, when a user selects a data entry marker the associated content object is opened in an editable manner to invite the user to enter data.
- Data entry may be selecting an option, for example in the case of a multiple choice question, or entering content by typing, writing using a stylus, audio recording, voice to text, taking a photograph or video, etc.
- the difference between a data entry marker and a user created marker is that there may be limitation on the type of editing allowed for the data entry marker and associated content object. For example, changing the position of data entry markers may be inhibited. Further, the user does not need to select an edit option for the data entry marker as the content object will open automatically in an editable mode.
- the data entry marker may open in a predetermined editing mode, for example the content object, when opened, instruct the user to perform an action such as take a photograph using the mobile terminal and automatically switch the mobile terminal camera to an operational mode.
- the content object may be opened in a user preferred editing mode, for example voice to text, automatically detected from user preferences stored in the mobile terminal.
- the mobile terminal application may be adapted offer choices for data entry, for example using keypad, voice recording, voice to text, handwriting on a touch screen etc, for selection by the user.
- the mobile terminal may also automatically detect the method being used to enter data rather than requiring the user to make a selection. For example, as a user starts to enter data using a keypad, then this method is selected, alternatively if a user begins speaking a voice recording or voice to text mode is automatically selected.
- An advantage of using the markers is enabling easy reading of content on a small display screen of a mobile terminal.
- This formatting method is particularly well suited for re-formatting content such as web pages for display on a mobile terminal.
- content such as web pages for display on a mobile terminal.
- web pages contain a combination of text images and hyperlinks, and often hyperlinks appear in line with text or text wraps around images. This can cause difficulties when trying to read the content on a small display, such as typical for a mobile terminal. Formatting such content using markers to replace some content objects in line with text can make the content more readable on a small display.
- embodiments where content object data is only downloaded for selected objects provide a user with a high level of control over the amount of data which is downloaded. Markers can also be used to selectively replace some text content.
- an article may comprise a plurality of text portions, such as a title, abstract, body text and references.
- User preferences may define that the body text and references text be replaced with markers, leaving only the article title and abstract to be formatted into text segments for download and display.
- a marker is created for each of the body text and references, which in turn are stored as content objects associated with the created markers.
- the title text and abstract text are displayed and the body text marker and references marker are displayed after the abstract text.
- the user chooses to read the full article after looking at the abstract, then the user can select the body text marker.
- the body text content object can be downloaded and displayed.
- the formatter may be adapted to selectively replace text using markers based on the text type in accordance with user preferences.
- the markers can also be used for scrolling through the content.
- Step 201 indicates the start of the formatting.
- the formatting component 120 determines the segment size for the mobile terminal based on predetermined parameters in step 202.
- the segments are based on device display capability parameters such as screen size and resolution as well as user specified parameters, such as font size, colour mode, automatic scrolling mode or one-screen-at-a-time display mode.
- the segment size may be based on the number of characters displayable across the screen for a particular terminal screen size and user designated font size.
- Predetermined parameters can also indicate types of content objects which are to be replaced using marker segments. For example user parameter values can be used to specify that all content objects are replaced by markers, selected types of content may be replaced by markers or no content is to be replaced by markers. Any content not replaced by markers will be appropriated reformatted for display along with the text portions of the content.
- the content data is read in step 203.
- the manner in which the content data is read for processing will vary depending on the type of data and how the data is provided to the formatter and for download to the mobile terminal. For example, where content is streamed to a mobile terminal, the content data may be formatted for the mobile terminal as it is streamed. Alternatively this step can include a step of retrieving a content data file from a server or database etc.
- step 203 may include an initial content data conversion step.
- this may comprise reformatting a document, such as a PDF, HTML or rich text document to convert the document to an XML or plain text and non-text content data format, such as a text and image format which strips out unnecessary data such as text formatting, page boarders or wallpaper images.
- This step 203 may also include a mapping step where the layout of text and non-text content portions is analysed to determine a formatting order for portions of the content.
- This step of reading the content data enables the formatter to determine the types of data comprising the content. This in turn enables the content data to be divided into portions based on the content data type. For example, sections of text, images, hyperlinks, video clips etc can all be treated as separate portions of the content by the formatter.
- the output of this step may be a dynamically allocated array of strings representing each of the portions of the content as separate strings. In an embodiment implemented using Java scripting language this output may be a vector of strings representing text, links, images etc.
- text can be divided into one or more text segments, which can stored as one or more text content objects associated with one or more marker segments or displayed on the mobile terminal.
- Non-text content can optionally be replaced with marker segments or formatted appropriately for the non-text content based on one or more predetermined parameter values, such as image size and resolution reductions based on target device display parameters and user preferences.
- the first content portion is identified in step 204 and the type 205 of content comprising the portion determines the next processing steps.
- a new text segment is started and a segment pointer is initiated (for the first segment) or incremented (for subsequent segments) in step 210 the size of each text segment is based on predetermined parameters, for example text segment size can be determined based on the number of characters which may be displayed across a mobile terminal display given the user allocated font size.
- text data is allocated to the segment. Depending on the amount of text data in the portion more than one text segment may be required. If the portion is not fully allocated 214 then the segment pointer is incremented in step 216 and the formatting repeats steps 212 to 214 until the portion is fully allocated into a number of segments. Once the portion is fully allocated 214 attributes can be applied to the segments to transform the text segments into one or more text content objects.
- processing and content attributes for use by an application player can be applied.
- the original content data can be transformed into a new content object including scripting representing processing and content attributes whereby formatting instructions are embedded in the content.
- the scripting is executable by a generic browser to enable enhanced formatting and display functionality.
- the text portion processing then ends 218 and the formatter looks at the next portion 240 and, provided the end 245 of the content data has not been reached, continues to process the next portion based on type 205.
- text or some types of text may be replaced by markers.
- the formatter may perform the above formatting steps and generate marker segments associated with each text content object.
- the above formatting steps may be omitted and a text portion for replacement transformed in to a single text content object to which attributes are applied.
- a marker segment can be generated for the text content object including linking data to the text content object.
- the text content object may be subject to further processing, as described above, when display of the content object is requested.
- the formatter checks predetermined parameters to determine whether the non-text content object should be replaced by a marker segment or not 220. Whether or not to replace the non-text content with a marker may depend on the content type. For example, user specified parameter values may indicate that all images, video clips, animations and audio files are to be replaced with markers but not to replace hyperlinks.
- the formatter will create a marker segment comprising a marker 222 and link data 224 associated with the replaced object.
- the marker 222 can be an icon, shape or other indicator which can be displayed in line with the text when displayed on the mobile terminal.
- other types of indicators can be a generic image representing a marker type or a small image representing the original image.
- the marker may be a side bar, border, frame or divider around beside or dividing displayed content.
- the size, colour or shape of the marker may be used to distinguish between content types.
- the size of the marker and other aspects of the markers appearance when displayed can be controlled by the user through setting parameter values.
- a number or letter may optionally be displayed in a marker which may be used as a navigation aid.
- the link data 224 is used to associate the marker with the replaced object and can be used to retrieve the replaced object data in response to a user command. Additional data may also be included in the marker segment depending on the embodiment. Depending on the embodiment attributes can also be applied to the content object. For example, processing and content attributes for use by a player application can be applied to the content object. In some embodiments the original content data can be transformed into a new content object including scripting representing processing and content attributes executable by a generic browser to enable enhanced formatting and display functionality. In an embodiment implemented using Java language each marker segment can be represented as a token object.
- all content data is replaced by marker segments and whether or not associate content objects are displayed initially, without a user command, can be based on player parameter values. For example, a user may set player options in a player application of their mobile terminal to display all text content automatically and to display non text content only in response to user commands. Thus, when a sequence of marker segments is acquired by the mobile terminal the content objects associated with text markers are automatically displayed and only markers displayed for all non-text content objects.
- a different marker can be used for each content object type to give a visual indication of the type of replaced content, for example rectangles may be used for image markers, ovals for hyperlink markers, stars for audio files, pens for data entry markers etc.
- Markers associated with text or hyperlink content objects may also include the first word of the text content or hyperlink title. The word may be highlighted using a different, colour, background, font, formatting, etc to distinguish the marker form the surrounding text. Alternatively, a border, side bar, underline, section divider, frame etc may be used as a marker. Special images or animations may also be used to represent markers. The nature of the marker or attributes of the marker such as colour, position, size, etc may be used to distinguish between marker types.
- a marker segment can comprise additional data associated with the object or marker and this data can be optionally displayed based on user specified parameter values or user commands.
- additional data associated with an image marker may include an image name or description which can be optionally displayed.
- Other data can include data for navigation, such as an index number, indicator of order of the nontext object in the content, or an indicator of the previous and next markers.
- additional information such as a title, artist/author, download file size, copyright information etc may be included as additional information which can be displayed on request to the user, for example by pressing a given key to provide additional information to the user before retrieving and displaying the content object.
- giving information regarding the download file size may assist the user in making a decision whether or not to retrieve the non-text content object data via download from a server to the mobile device based on the data size and cost for data download.
- marker segments are created as XML objects, wherein the displayable marker, link data and any additional data are defined.
- the formatter can select a predefined generic descriptor for the given content object type and insert the appropriate data for the individual object to create the marker segment.
- the generic descriptor may include different fields depending on the object type.
- the generic descriptors used may vary between embodiments.
- marker segments may include such embedded instruction in the form of scripts executable by a generic browser.
- each marker XML object contains link data, such as address data (URL or address in memory) which enables the associated non-text content object to be retrieved.
- link data included in a marker XML object can be a reference to an index or look up table where the link data to the associated object is stored.
- the link data in the marker XML object may contain an address for a marker look up table and a pointer or relative address within the lookup table to the data associated with the non-content object.
- the index or look up table may be included in the content data downloaded to the mobile terminal or be a separate file stored in mobile terminal memory or accessible to the mobile for example via a portal server to enable access to the associated non-text content.
- the size of text segments adjacent a marker may be adjusted to allow space in the line when for the marker when displayed. For example, if a marker takes up the equivalent space as two characters when displayed, this can be taken into account when determining the segment size for a first text segment following a marker segment.
- the text segment size can be reduced based on the number of character spaces, displayable on the mobile terminal display, which have been occupied by other text and markers on the display line.
- content objects can be optionally replaced based on defined parameter values.
- the formatter may perform some formatting of the object 230 for display. For example, for image or video data the display size and resolution may be adjusted, based on defined parameter values, for display on the small display of the mobile terminal. This can reduce the amount of data required for download to the mobile terminal to reproduce the image or video. The quality of the video or image reproduction may also be reduced to match the capability of the mobile terminal. Quality reduction may alternatively be defined by the user by setting parameter values in order to further reduce the amount of data required to download. For example, a user may be able to specify a target resolution for images and video or a qualitative parameter value may be set.
- “best”, “optimised” and “low” resolution parameters may be set by the user.
- Each of these setting can be associated with a given target resolution and optionally image/video size or with an algorithm used to determine the target resolution and optionally size based on image or video parameters.
- “best” may be associated with the highest possible resolution that can be achieved for the target device display.
- “Optimal” may be associated with an algorithm which determines a compromise between a target resolution and a download data size target.
- “Low” may be associated with a minimum target resolution.
- Data compression and codec conversion may also be used to minimise the amount of data downloaded. Similar reformatting or reduction in quality can be used for audio files to minimise the amount of data downloaded.
- audio files in wave (.wav) format may be converted to MP3 format to take advantage of the smaller file size for MP3 files.
- the parameters used for the audio codec encoding may also be set to cause a reduction in the sound quality reproduced in order to minimise the audio file size.
- a hyperlink may be divided into a number of consecutive segments similarly to a text portion to enable the link to be displayed, and one or more of these portions may comprise link data equivalent to that used in the marker segment to enable the hyperlink to be followed in response to a user command.
- the segment or segments comprising the non-text object are included in the sequence of segments 235 and formatting continues with the next portion. Once all portions have been formatted 245 the formatting ends.
- the output of the formatting process is a sequence of consecutive segments which comprise the formatted content data.
- An optional data compression step 250 can be performed on all or sections of the formatted data to further reduce the file size for download.
- the entire formatted content data may be compressed into a single downloadable data file.
- the sequence of consecutive segments may be compressed into one data file and the data of associated content objects compressed as one or more additional data files, for example this alternative may be used where data of associated content objects is selectively downloaded form a server in response to user commands.
- the manner in which the data is compressed may depend on the manner in which the data is to be acquired by the mobile terminal and the user parameters.
- a different compression algorithm may be used for a data file prepared to be downloaded in its entirety to a mobile terminal for display compared to a data file adapted to be streamed to the mobile terminal for simultaneous streaming and display.
- the formatted segments may be displayed by the display component concurrently with the formatting, or the entire data stream may be formatted before display depending on the capabilities of the mobile terminal or user preferences.
- the formatting can also include a document format conversion step.
- documents may be provided in a number of formats such as: Word, PDF, WEB, WAP, WML, HTML, HXTML, XML, XSL etc documents in messaging formats such as SMS, MMS, EMS, or HMS (Hand Written Messaging) can also be provided.
- Such documents can be converted to a pure text or text and image format before executing the above formatting.
- This pre-processing step may be performed on the mobile terminal or by a formatting component provided in another device, such as a PC or server, before the mobile terminal acquires the content data.
- the formatting processing as described above can also be implemented by an external device such as a PC or server, such that the data stream is acquired by the mobile terminal already divided into segments appropriate for display.
- this formatting may be performed on documents by the user's PC for subsequent downloading of the formatted data stream for later display on a mobile terminal, to reduce the processing and hence the battery power required by the mobile terminal later to display the documents.
- the user's PC may be provided with an application to enable the PC to operate as a home server.
- the PC can format content for download to the user's mobile terminal.
- the content may be the user's own content, stored in PC accessible memory, or content downloaded to the PC via the internet.
- the PC can also be adapted to operate an agent program whereby content specified by a user can be automatically sourced and formatted for download to the user's mobile phone. For example, a user can configure the agent program to monitor for updates to RSS feeds, blogs, stock prices etc and automatically format and forward information regarding this updated information to the user's mobile device.
- the PC can be adapted to perform search and formatting functions to minimise the about of user interaction and data transfer required via the mobile terminal. This can be particularly advantageous where high time and data transfer costs are incurred for a mobile network.
- a formatter may be provided at a portal server, whereby a user accesses content data such as internet web pages, multimedia content, e-mails, social networking, documents, RSS feeds etc.
- the server can be adapted to format content data, as described above, in accordance with user preferences prior to downloading the content to a mobile terminal.
- the portal server may provide a hosted service accessible via the internet. For example a user can subscribe to the service which enables a user to store their own content in memory accessible via a public internet server providing the hosting service.
- the portal server performs formatting of the content for download to the user's mobile device.
- the user may be able to control a user profile which can be used to specify both a user's own and internet accessible content data to be formatted for download to the user's mobile terminal via the portal server.
- the system 1000 comprises a formatter 1010 adapted to format content data as described above for display on a mobile terminal.
- the parameter module 1012 is adapted to store values of predetermined formatting parameters including one or more of: parameters based on display limitations for the mobile terminal, and user specified parameters. These parameter values may be acquired for a target mobile device or be default parameters used where no specific target device has been identified. Default parameters may be based on common mobile terminal characteristics and common user settings, or based on an exemplary target device and user settings set as default by the content provider.
- a text module 1014 is arranged to segment text portions of content data into one or more text segments based on at least one predetermined parameter value to transform the original text content into one or more text content objects.
- a marker module 1016 is arranged to generate a marker segment associated with a content object, which can be used to replace a content object in the formatted content.
- the formatter 1010 is arranged to control the operation of the text module 1014 and marker module 1016, based on one or more predetermined parameter values, to divide provided content data into a sequence of consecutive segments.
- the parameter module 1012, text module 1014 and marker module 1016 are shown as functions of the formatter, for example these modules may be developed as subroutines of the formatter software. However, various other embodiments are envisaged and these modules may be implemented as separate programs or scripts accessed by the formatter.
- the system may also be provided with additional functionality to recognise particular types of content and adapt the formatting method used accordingly.
- content data which has a relatively standardised format, such as RSS feeds or an internet version of a newspaper, may be recognised by the formatter or content manager and formatting templates given for the type of content applied.
- a newspaper web site typically includes advertising content, banners, logos etc as well as text of news articles. These different sections of content are typically presented using a standardised layout.
- a formatting template may be provided which defines an order based on the content types and web page layout for the sequence of consecutive segments which comprise the formatted data. The template may be specified by the site designer or developed based on the manner in which users access the content.
- a template may be used to order sections of the content so that the most typically popular sections of the content appear towards the start of the sequence of segments.
- the portal content manager 1020 may be adapted to monitor 1025 use by consumers for popular web sites and automatically generate templates based on user download statistics or the monitored use may be fed back to the web site controller for analysis and development of a formatting template which can then be provided to the formatter for subsequent use.
- the system 1000 can also include a content manager 1020 for controlling storage of content data in a database 1040 or linking to external content data sources via a network such as the internet 1070.
- the content manager 1020 can also control access to content data via a content delivery interface 1030. Controlling access to content data can also include causing formatting of content data to take place in response to a download request.
- the portal server may store a copy of the pre-formatted content data for subsequent users to download.
- a copy of the formatted content data could be stored in cache memory or a database 1040.
- the content data may be reformatted. This reformatting may require only minor modification to the formatted content data, such as adjusting segment size, replacing some non-text content with markers, or replacing some markers with their associated non text content. In some embodiments these formatting modifications may be performed in conjunction with the downloading of the content data or prior to download.
- the content manager 1020 can also monitor 1025 the popularity of various types of content to manage stored versions, for example preformatted versions of a popular web site may be stored in cache memory, whereas a preformatted version of a web site having only a few hits may be stored in the database 1040 marked for deletion after a given period of time.
- a formatting tool or system such as the system of
- Figure 10 can be provided to content providers for installation on their server to enable content to be reformatted as described above for download to mobile terminals.
- This embodiment has the advantage that a content provider can pre-format and store versions of web pages for download to mobile devices, or perform reformatting in response to a download request.
- the content provider may be provided with some control over the appearance of the reformatted content.
- a content provider may specify a template giving an order for the reformatting of different components of the content or other aspects of presentation, such as content provider specified icons to use as markers in re- formatted content.
- a music content provider may use a musical note icon as a marker for audio content, a television icon as a marker for a video clip, a drum icon for a hyperlink marker etc.
- a display simulator 1060 may also be provided to enable a content provider to review how content will appear when re-formatted.
- the display simulator 1060 can be designed to emulate any mobile terminal formatting and display functions to demonstrate how the re-formatted content will appear on a mobile terminal display.
- the simulator 1060 can include scrolling player engine software 1065 identical to the application used on the mobile terminal.
- the engine 1065 is adapted to control display of the formatted content on a mobile terminal display and, if necessary, dynamically reformat the content in response to user commands. This enable the content provider to test how their content will appear when displayed on a mobile terminal. Further the content provider can test the response to user commands such as altering font size or requesting display of non-text objects.
- Visual effects for displaying retrieved content such as scrolling the non-text object onto the display, zoom effects where the marker appears to expand to show the retrieved content in a window or full screen, flipped or rotated to best fit the display, etc can also be reviewed.
- Such display effect preferences for retrieved content can be set by the content provider using control commands embedded in the marker segment. Such control commands may be overruled by user display settings or specific user controls.
- An editor 1050 or composer tool may also be provided to enable a content provider to develop or edit content specifically for display on a mobile terminal.
- the editor 1050 can include an orchestrator module 1052 and a customizer module 1054.
- the orchestrator module 1052 can be used to control aspects of the appearance of the formatted content such as the flow or order various portions of content.
- the appearance aspects controlled by the orchestrator can be based on standard reformatting characteristics required for presenting content data on a small display, such as re-ordering frames of a web page which typically have a tiled layout into a linear style layout, better adapted for scrolling content in one direction on a small display.
- the orchestrator can be used to define how content will appear when content is replaced with markers and when content objects associated with markers are retrieved.
- the orchestrator may be used to define how markers appear, define the appearance for makers for different types of content, size of markers, whether or not markers appear in line with text, etc.
- the orchestrator may also be used to define aspects of how content objects are displayed when they are retrieved, for example in a full screen mode or embedded in the displayed content.
- the orchestrator may also be used to apply display effects for displaying the retrieved content. For example, scrolling the retrieved content onto the display and scrolling out previously displayed content, the direction of scrolling may also be defined for example scrolling the content in left, right, up or down.
- zoom or scale up effects where the content appears to expand out from the marker or a point on the display, say one corner or the centre of the display, to fill the display, flipping or rotating the content may also be performed, for example to achieve a best fit for the display or to adjust the orientation to match the viewing orientation of the user.
- a content provider can define aspect of appearance such as the order for portions of content, content which can be removed when reformatting, such as banners or wallpaper, and default colour schemes (if any) to use when reformatting, any specific marker icons or symbols etc. and other general aspects of appearance.
- the orchestrator can also be used to define editing modes or options for data entry markers. For example, where an operator is defining an electronic form to use for a car accident insurance claim, some data entry fields may be defined as text data entry fields, say for the accident date, time, location and the vehicle registration for the parties involved. Other data entry fields may be defined to enable a set of photographs to be entered, for example photographs of the accident site, any damage to vehicles, people or property. A further data entry field or set of fields may enable sketches of the accident and vocal or text descriptions to be entered. These respective fields can be formatted as content objects associated with markers in line with text which provides instructions for recording information at the scene of the accident and making the claim. For example, the text may instruct the user to select the marker to record the vehicles' registration numbers.
- text instructions may be included in the content objects associated with each marker and the user simply steps through each marker replacing the instruction text with the entered data. For example, selecting a marker may cause text to be displayed instructing the user to now take photographs of any damage at the scene, and the mobile terminal can be automatically switched to a camera mode. The captured images stored in the data entry content object. A text box requesting whether the image capture is "done” can be displayed and when the user presses a "yes” key the mobile terminal switches back from camera mode to show the next marker. The next marker may instruct the user to record a description of the incident. The user may be offered to select a voice recording, text entry, or handwritten/sketch entry.
- the user may also be offered to enter data using two entry modes at once, for example voice input or voice to text data entry while simultaneously entering a sketch drawing.
- This method of inputting data can be beneficial as this is how a person would typically describe an incident to another person face to face.
- the vocal recording and an animation of the sketch drawing may be recorded as two separate content objects or as a combined content object, such as an animation which can be played back showing the sketch being drawn and narrated by the voice recording.
- a form can be pre-prepared for use in a mobile terminal for convenient use at any time. This insurance claim form of this example can enable a person to conveniently capture all information at the scene of an accident required for the completion of a claim.
- a form adapted to be completed utilising the capability of the phone such as capturing photographs and voice recordings at the scene may enable more accurate recording of an incident than where a person completes an insurance claim form several hours or even days after the accident.
- the form can also prompt users, who may be shaken by the accident, to record information they may otherwise overlook.
- Such forms can be prepared for a variety of uses, for example test, recording laboratory experiments, surveys, market research, feedback forms, student teacher interaction etc. It should be appreciated that the form may be prepared initially with markers and associated content objects or a pre-existing form can be formatted through the formatter to add data entry markers.
- the customizer 1054 is a component of the editor where end user defined parameter values are applied, the values set in the customizer may override parameter values used in the orchestrator.
- the customizer 1054 may read user parameters from user preferences or a target device and apply these parameters during content reformatting, or apply these parameter values in a second formatting pass for already formatted content to customize the content for a target user and mobile device before downloading.
- Such parameters can include whether or not non-text objects are to be replaced using markers, font size, display width, image and video data resolution preferences, audio quality preferences, retrieved content display effects etc.
- a user may define customised templates which can have the effect or reordering content portions from a default order or an order defined by the content provider using the orchestrator.
- a user may use the customizer to define a template for a newspaper web site which defines the order in which the user wished to view sections of the content, for example sport-weather-local-travel-business- technology-world which differs from the standard order defined by the content provider which may be local-world-business-technology-sport-travel-weather.
- the editor/composer tool 1050 can be adapted to prepare content data files formatted as a sequence of consecutive segments with markers optionally replacing non-text content objects, and any index or look up tables, as required.
- the content and any index or look up tables can then be stored by the content manager 1020 in the database 1040. Users can download the sequence of consecutive segments for display and link to and retrieve content objects via the markers.
- the index or look up tables may be downloaded with the content data or remain on the server for access, as needed, by the mobile terminal to retrieve non-text content object data via the markers.
- the formatter 1010 or editor/composer 1050 can be adapted to include instructions for display of the content in the formatted content file.
- instructions to provide the above described display functionality are embedded in the formatted content data as executable instructions.
- scripts or tags which enable display of optional markers and retrieval of content or automatic scrolling of content are included in the formatted data. These instructions can be executed by a standard browser of a mobile terminal.
- Embedded instructions may also enable editing of the content, as described above, in some embodiments.
- scripts may enable editing using markers and storing edited content as a local version in mobile device memory or transmitting edits to a server for making corresponding edits in the original content or a stored version thereof. Whether or not editing functions can be implemented may depend on the capability of the standard browser as well as the functionality enabled by the embedded instructions.
- Scripts can be embedded in content to adapt a standard browser to perform substantially any of the content display functions described above, including using markers to acquire additional content not originally displayed. Scripts for performing such functions can be embedded in formatted content data.
- the scripts are executed by the standard browser either automatically or in response to a user input. For example, some scripts may be designed to execute automatically when the content is displayed, such scripts may include one or more scripts which cause a request for user input to perform a function. For example, where a marker is displayed in place of an image, a script may cause a query "do you want to view this image?" to be displayed. In response to a user responding by giving a "yes" input will cause the script to continue to execute or another script be executed to download and display the image content data.
- the Formatter application which performs formatting in response to a request may be resident on a server to format the content before download to the mobile terminal or resident of the mobile terminal to perform formatting after download.
- the formatter is adapted to first remove any unnecessary formatting from the document 11 10.
- a document is a standard HTML document, formatted for a laptop or PC screen
- the document can include borders, wallpaper, multiple frames and complex structures which cannot be represented easily or are unnecessary on a small mobile terminal display. These excess elements can be stripped out of the document.
- Mobi web pages conform to the dot Mobi standard and are designed specifically for mobile browsers. Such documents do not include complex frames or structures. Such documents do not need to be "cleaned" for display on a mobile terminal.
- Mobi page is design with usability on a small screen in mind, the font size for the content is static, further display of the content is dependent on the browser capability in respect of functions such as scrolling and editing the content.
- the content can be divided into a sequence of segments 1 120 as described above with reference to Figure 2.
- the segments are then transformed into content objects having attributes and scripts appended to enable player functions in the browser 1 130.
- attributes and scripts can be added to content objects using XML tags and javascripts which can be interpreted and executed by the mobile terminal browser.
- Some scripts may be embedded as a type of content object which is linked to using XML tags from other content objects for execution.
- the nature of the embedded attributes and scripts may vary depending on the embodiment. For example, where the formatting software resides on the mobile terminal, the formatter edits the page to append attributes and each link in the page is also edited so that the linked page is directed to the formatting software rather than directly the browser.
- the formatter can further append attributes to any linked content.
- the formatting software resides on a server or PC so the content is pre-formatted before being downloaded to the mobile terminal
- the formatter appends attributes and modifies links such that each link within the page is redirected to the server rather than directly to the page. This enables the server formatter to format these subsequent pages for the mobile terminal before download.
- linked pages may be downloaded and pre-formatted as described above on the user's PC and links to the pages modified to link to the preformatted versions on the PC for download.
- the formatted content is then loaded to the mobile terminal browser 1140.
- the browser can then execute the embedded scripts and use the attributes appended to the content to perform enhanced player functions 1150.
- enhanced player functions include automatic playing of content in a scrolling mode, editing of content, using markers, dynamically altering font size, etc.
- the type of enhanced functions enabled may be controlled based on user or content provider preference. For example, where a player function is to be enabled, the scripts and attributes for enabling the function are embedded into the content during formatting as described above. Where a player function is to be inhibited for the given content, the scripts and attributes which enable this functionality are omitted or disabled during the content formatting.
- the content manager 1020 can be provided with additional functionality to track use of content by users and provide feedback to content providers regarding this use. This feedback can include information such as most frequently requested non-text objects, any trends in order changes applied using the customizer etc.
- the content manager may be provided with intelligent functionality to suggest alternative orchestration templates based on analysis of the monitored use.
- the content data stream is plain text data.
- An input line of text from the document 500 is divided into a number of segments 530a-n based on the number of characters that can be displayed on one line across the screen of the mobile terminal. This division into segments can be based on whole words 520 to avoid words being split across more than one line, where possible. For example, this is illustrated in line 530a which comprises two words 520a and 520b. Where the number of characters in a word is greater than the number of characters displayable on one line it will be necessary to split the word across more than one line. Alternatively another operation such as reducing the font size for that word or substituting with an abbreviation may also be performed to enable the word to be more clearly displayed.
- each segment 530 in the sequence 510 corresponds to a line of text to be displayed on the mobile terminal screen 540 and a number of lines can be simultaneously displayed.
- the position coordinates where each segment is displayed on the screen 540 are incremented and the display refreshed after each increment such that for each successive increment the displayed text will appear to have moved up, down, left or right on the screen 540 depending on the scrolling direction. As one segment reaches the edge of the screen and ceases to be displayed the next segment will be begin to be displayed on the opposite edge of the screen.
- the scrolling may increment by line or by a number of pixels.
- the text can be drawn as an image on the screen, rather than using text characters an example is illustrated in Figure 6.
- the text document 600 is converted into the sequence 610 of segments 630.
- Each text segment is drawn on the screen 640 as an image 650.
- the images represent the content of the text document in an image format displayable by the mobile terminal.
- the scrolling effect is achieved by incrementing the absolute display position of each segment on the screen by a number of image pixels.
- Drawing text as images also enables the text font and text size to me modified easily based on user preferences.
- a user settable parameter can be used to set the font size (i.e. small, medium or large).
- the drawing of text as images also enables support for text content in a variety of languages such as Chinese, Arabic, Hebrew, Japanese, Korean etc.
- Figure 7 illustrates an embodiment where content comprising text and images is formatted for display on a mobile terminal.
- a document 700 comprises text, hyperlinks 703 and images 701 , 702, for example a HTML web page.
- a first formatting pass or conversion step can be performed to convert the original document 700 into a text and non-text object format 705.
- This step can include ordering the portions of content, for example the frames of the web page, into a sequence for formatting. This ordering can be based on a template orchestrated by the content provider or defined by the user, alternatively the document may be mapped and an order determined by the formatter.
- the formatter may be adapted to directly format the content into a sequence of consecutive segments from the original document format, in this case HTML, without performing a preliminary formatting step as described above.
- the text and non-text objects 701-703 of the content are divided into a sequence 710 of consecutive segments. Portions of text are divided into text segments 720a-n using a procedure as described above. Image objects 701-702 are replaced by image marker segments 730a, 730b and hyperlink objects 703 replaced by hyperlink marker segments 740.
- the formatter is adapted to identify images, hyperlinks and other non-text objects in the content data. Whether or not text and non-text objects are to be replaced by marker segments is based on specified parameter values, which can be user controlled. Where a content object is to be replaced, a marker segment is created.
- the marker segment can include data identifying: object type; symbol or icon for the marker; object title or name, for example an image title, text title or a hyperlink URL data; link data; navigation data, such as order in the document or identifiers for the next and previous markers; content object description data etc. Different data may be provided in different marker segments depending on the content object type.
- One type of marker or icon may be displayed for each type of content object.
- a different marker or icon may be used for each type of content object, for example during display on a mobile terminal the display controller may select an icon to display for each marker based on the object type defined in the marker segment.
- Generic descriptors may be provided for marker segments for each content object type, and the individual content object marker segments created using the appropriate generic descriptors.
- a generic descriptor for an image marker segment may define the symbol to use for the marker, a generic title "Image", and automatically generated navigation data such as a marker number identifying the order of the marker in the context of the document, next and previous marker numbers for the next and previous images, an address in an index where linking data will be stored etc.
- Other data such as the image name and any description data can be added to the marker segment based on actual image data read from the document.
- Address information for the content object can be included in the marker segment as link data, to enable direct linking to the replaced content object.
- the address data for the replaced content object may reside in a look up table or index and a link to this index and the relevant item within the index included in he marker segment as link data.
- each marker segment may include the address for a look up table of content object URLs and the URL associated with a marker segment can be looked up in the table using the order number.
- the look up table may be downloaded to the mobile terminal along with the content and stored in device memory or remain on a server accessible by the mobile terminal. Where a hyperlink is attached to a word or sentence in the text, this may be identified by the formatter and a different treatment given to the hyperlink during replacement than where the full uniform resource locator (URL) is included in line with the text.
- URL uniform resource locator
- the word or group of words which represents the hyperlink can be included as text in a regular text segment and a hyperlink marker added to replace the hyperlink.
- the word may be identified as a marker using formatting such as a border around the word of a change of colour.
- the non-replaced text segments and marker segments are composed into a sequence of consecutive segments 710 for display.
- the markers 770, 775, 780 can appear as symbols in line with text 765.
- the text and markers can be displayed on the screen 750 either as images and the scrolling effect achieved by position increments based on pixels as described above, or as text and marker images and the scrolling effect achieved by a combination of line position increments for the text and pixel based position increments for the marker images. As is illustrated one symbol may be used for image markers 770, 775 and an alternative symbol for hyperlink markers 780.
- Figure 8 illustrates an example of how a document may be displayed on a mobile terminal display 800 with some content objects replaced by markers.
- the display 800 is optionally divided into two sections a main section 810 where the document is displayed and a section 820 where summary information for the content, such as the content source address or for markers can be displayed.
- the display section 820 may be expanded in response to a user command, for example pressing a given key or area of a touch screen, to show further additional information for a marker, for example to display the download file size for the replaced content.
- the section 820 may automatically revert to its original size after a given time period or in response to a user command, such as pressing the given key again.
- Markers 830a-c, 840a-b, 850, 860 appear in line with text.
- each marker can vary depending on marker type, for example as illustrated a different marker shape is used for image markers 830a-c, hyperlink markers 840a-b, video clip markers 850 and audio clip markers 860.
- Embodiments enable normally hidden information associated with a marker, such as the title and description of the replaced image, to be displayed in the second section of the display 820.
- the marker for which this information is displayed may be automatically selected, for example as content is scrolled, or selected by a user.
- the selected marker 830c may be highlighted in some manner, for example by changing colour or holding the outline, to make it clear to the user which marker is selected.
- the user may be able to press a single key on the mobile terminal, touch an area of a touch screen or use another simple command to retrieve the replaced content object. For example, the user may simply push a "select" key to cause the mobile terminal to retrieve and display the actual image associated with the highlighted image marker 830c.
- the full image data may already be stored in mobile terminal memory ready for display, or the image data may be downloaded in response to the user command.
- a number is also displayed on each marker. This is an optional feature which can be used to assist navigating through the document based on the markers.
- a selection key may be used to select the content object type of interest then number keys or next and previous commands, which may be up and down arrow keys or other controls such as joy sticks or track balls, used by the user to select the desired marker.
- transformation and scaling of images to enable them to be displayed on the mobile terminal screen may be performed as part of the display process. This may be performed on a server side to minimise the amount of data downloaded.
- an image 800 in a common image format such as PDF, JPEG, TIFF etc, can be transformed into an image format displayable by the mobile terminal and scaled to fit the size and resolution of the mobile terminal display.
- This transformation can include reducing the resolution of the image, for example converting a high resolution JPEG image to a lower resolution JPEG image, scaling the image to the screen size, conversion of image format for example converting a JPEG to a bitmap or thumbnail format, cropping the image to the size of the screen or a combination of two or more of these operations.
- the user settable parameters can be set using the user interface of the mobile terminal or using associated support functions for example installed on a PC or on a web site which is enabled to communicate with the mobile terminal.
- user parameters can include the users personal details 350; parameters relating to the display settings, such as font size 310 and scrolling speed 320 and manual scrolling increments 370; and parameters related to stored content, such as a document to display when the application is opened/launched 360, or parameters to enable content acquisition such as feed sources 330, 340. Selection of the feed sources from the mobile terminal menu will automatically trigger the mobile terminal to establish a connection to the feed source to acquire and display the content data stream as described above. Parameters such as types of content to replace using markers can also be set by the user.
- Support (backend) applications are also provided on a PC 420.
- the support applications include several programs. These include a Dashboard 440, a Local Server 450 as well as a number of Agent Programs such as Feeds Agent 460, Email Agent 470, Message Agent 480, multimedia agent 454, and social networking agent 456.
- the Local Server 450 connects to the Mobile terminal via a serial or Bluetooth connection and sends information from the PC to the mobile terminal (e.g. feeds).
- the Agent Programs are services that are designed to automatically download specific information via the Internet 430. There are several types:
- the Feeds Agent 460 downloads specific information from particular feeds sources 431 (e.g. news , weather, movie times, etc.). These feeds are stored as files on the PC 420 in local directories 461 and can be sent to the mobile terminal 410 via the Local Server 450.
- the feed agent can be adapted to monitor the feeds and update the files stored locally for download accordingly.
- the feeds agent 460 can also be adapted to download information from user subscribed services.
- the feeds agent may also provide a simplified user interface to aid setup of such services. For example a user may subscribe to stock market price updates for certain shares. This data can be updated via the feed agent.
- the feed agent may be provided with functionality to monitor or search the subscribed data for certain events, such as the share price of a particular company dropping below a threshold and prepare data formatted to highlight this event.
- the system may enable such data to also be pushed to the user's mobile terminal.
- the Email Agent 470 retrieves e-mails from the email server 432 and stores them as files on the PC 420 in local directories 471. As with Feeds, Emails can be sent to the mobile terminal 410 via the Local Server 450.
- the Message Agent 480 retrieves messages sent from another mobile phone or via messaging services and stores them as files on the PC 420 in local directories 481. As with Feeds and Emails, messages can be sent to the mobile terminal 410 via the Local Server 450.
- the Multimedia Agent 452 facilitates interwork with multimedia content web sites and programs for uploading and downloading multimedia content such as audio, video, images etc.
- the Multimedia Agent can retrieve audio files from a music download site which are then stored to a local database 453.
- the multimedia agent can also facilitate uploading of data such as video, images, audio and animation to multimedia web sites such as photo sharing web sites, video sharing web sites, home pages etc.
- the multimedia agent can also perform actions to optimise downloaded content for transfer to the mobile terminal such as image size and resolution reduction to match the capability of the mobile terminal or based on user preferences, compressing or reducing the quality of video and audio files to reduce the file size for download to the mobile terminal etc.
- Data can be uploaded and downloaded via the local server 450.
- the social networking agent 456 retrieves data posted to a users social networking account and stores the data 455 on the PC for downloading to the mobile terminal via the local server.
- the social networking agent can perform reformatting of downloaded data for display on the mobile terminal.
- the user can also upload data via the local server for posting to their social networking account or friend's social networking accounts facilitated via the social networking agent.
- the Dashboard 440 is used to perform a number if functions and provides a user interface via the PC for updating user parameters for subsequent downloading to modify the user parameters on the mobile terminal 410, some examples are given below:
- the Dashboard Feeds function 441 can be used to start, stop, create and customise parameters for the feeds agent 460.
- the Feeds function 441 also sends particular feeds to the user's Internet Space 435.
- the Dashboard Email function 442 can be used to start, stop, create and customise the Email agent 470.
- the Email function 442 also sends particular emails to My Internet Space 435.
- the Dashboard Message function 443 can be used to start, stop, create and customize the message agent 480.
- the Message function 443 also sends particular messages to My Internet Space 435.
- the Dashboard Docs function 444 opens a browser where documents can be saved into a directory 449.
- the Local Server 450 is configured to access the directory 449 and will retrieve the document and send it to the mobile terminal 410 (via a serial or Bluetooth connection) upon initiation by the user.
- the Dashboard Help function 445 contains a help file to assist with the operation of system including the applications on the mobile terminal 410.
- the Dashboard Admin function 446 performs housekeeping functions such as clearing, maintaining and updating directories.
- the Admin function 446 also copies files from the local directories 461 , 471 , 481 , 449 to the user's Internet Space 435 (the files are stored in web-space directories 436).
- the Dashboard Config function 447 is used to customise user specified parameters such as scrolling speed, scrolling mode, marker settings, directory names, colours, formatting templates etc.
- the Config function 447 also defines the directory pathway for Local directories and the URL for WebSpace Directories. Parameter values updated using the Config function 447 are updated on the mobile terminal 410 via the local server 450.
- the Dashboard Server function 448 starts, stops and customizes the Local Server 450 operations.
- Placing files on user's Internet Space 435 enables a user to access their files directly via an internet connection from the mobile terminal 410. This allows you the user to read their files without having to download them from their PC 420 to the mobile terminal 410, for example the document is transmitted as a content data stream to the mobile terminal 410 via HTTP connection 437. The content data can be deleted automatically from the mobile terminal 410 memory once the document is closed. E-mails can be copied to the user's internet space by the e-mail agent 470 for viewing as above. Alternatively the mobile terminal can be configured to communicate with the e-mail server via a telecommunication network and the Internet or e-mails can be downloaded to the mobile terminal by the e-mail agent and local server for storage and viewing on the mobile terminal.
- Formatter functionality can be provided on the server to pre-format content data, including e-mails, RSS feeds, web pages, documents etc, as described above, for display on the mobile terminal using markers to replace content objects.
- this also provides an advantage of enabling a user to control, using download parameter settings, whether or not to download data for replaced non-text objects, when to do so, and controlling how retrieved data is displayed. For example, using user parameters, the user may designate that no replaced content object data is to be downloaded initially with the formatted content data. Therefore, the sequence of consecutive text and marker segments will be downloaded initially.
- Replaced content object data can be selectively downloaded in response to user commands, for example triggered by a user selecting a marker and giving a command to download the associated content object data.
- the content acquisition and display functionality is provided as a software application or engine which can be run on the mobile terminal.
- the software can be pre-installed on the mobile terminal by the manufacturer or downloaded to the mobile terminal by the user.
- the application will typically be launched by selecting the application from the mobile terminal application menu. Alternatively, a specific key press sequence or other means such as a voice command may a used to open/launch the application.
- the application may also be set to automatically launch when the mobile terminal is turned on or in response to another action such as a phone call ending. On opening or launching the application can be programmed to open and display a user specified document or feed automatically.
- the scrolling player engine 410 is adapted to perform all the mobile terminal side functions required for displaying formatted content in a scrolling mode including dynamically re-formatting the content in response to user commands, such as changing displayed font size, and retrieving and displaying any content replaced by markers. Additional functionality for facilitating user interaction with web content, such as use of social networking sites or uploading images, video or other multimedia content to a sharing web site can also be included in the engine. In some embodiments the scrolling player engine 410 is also provided with additional functionality to enable local editing or annotation of content on the mobile terminal.
- the scrolling player enables text and markers to be scrolled automatically on a mobile terminal, so a user can read it without the need to use a key stroke.
- the user can control the size of the font, the speed of the scrolling and many other attributes.
- An example of an earlier scrolling player is disclosed in international patent application publication number WO 2007/073584 the disclosure of which is incorporated herein by reference.
- the content data is "played" like music, the user can scroll faster or slower, pause, increase or decrease font size and change the scrolling direction.
- the ability to adjust the font size is particularly advantageous to long sighted, elderly, or vision impaired users.
- An alternative scrolling mode can be adapted to automatically scroll a section of the content, for example one screen full, at a constant rate an then pause the scrolling for a period of time, for example 3 seconds, before automatically scrolling a further section of the content, both the scrolling speed and the pause length may be controlled by the user. In response to a manual command the scroll or pause may be overridden to pause or continue scrolling.
- the scrolling can be paused for a given period after a given number of increments of the display coordinates, for example the number of segments may correspond to one half of the display.
- given segments may be identified to trigger a pause in scrolling. For example, every fifteenth segment may trigger a scrolling pause.
- marker segments can be used to trigger a pause.
- a pause may be triggered by each marker segment or by selected marker segments, for example each image marker segment or every third marker segment of any type.
- pauses may be triggered based on the proximity of marker segments, for example where there are two or more marker segments displayed at one time, only one of these marker segments may be used to trigger a pause.
- additional pausing may be performed if there is a plurality of marker segments displayed at one time. This may be coupled to a display time for information associated with a marker, such as an image title or link URL which may be displayed in a designated window at an edge of the display to enable a user to see what the marker corresponds to.
- Further information associated with a marker may also be revealed in response to a user command.
- the user may manually scroll based on markers, in this scrolling mode the user hits a next or previous control to select the next or previous marker, the content is automatically scrolled so that the selected target marker appears on the display.
- the speed of the scrolling can be controlled by user parameters.
- the displayed content may be "jumped" to the selected target marker without scrolling.
- This scrolling/navigating could be performed based on one type of marker only, for example hyperlink markers, or two or more types of markers based on user settings.
- a user command may also enable a user to switch from navigating based on one type of marker to another.
- FIG. 9 An example of a process for navigating through displayed content using markers is illustrated in Figure 9.
- the content data is downloaded as or formatted into a sequence of consecutive segments 910.
- Initial display position coordinates are allocated for the first screen of content 915 which is then displayed 920.
- a selected marker can be highlighted 930, by default this may be the first marker in the document or the first marker of a given type in the document. If the selected marker is not presently displayed the display coordinates can be updated 935 and the display updated or refreshed 940 so that the selected marker appears in a given region on the display, for example the content may be scrolled so that the selected marker appears in a region in the middle or upper part of the display.
- the document may be scrolled by incrementally updating the display coordinates and refreshing the display until the selected marker is displayed in the given region.
- the marker can be displayed highlighted in some manner and optionally description information for the marker can be displayed, for example in a designated region at the bottom of the display.
- the user may then select an action 945 for example by pressing a key. Where the user selects to navigate to the next marker the target marker is selected and steps 930 to 940 repeated. If the user gives a command 945 to show the replaced content object then the link data is used to access the data for the content object 950. This may optionally involve downloading the data for the content object from a server 955. Alternatively the data may already be stored in device memory. For example, in an embodiment where content object data associated with each marker is downloaded along with the formatted content data, the associated data can be stored in locally device memory, thus the content can be retrieved even if the device goes offline or disconnects from the content server. In this case when the user give a command to retrieve the content object data the data is simply retrieved from device memory.
- This retrieval step could include a step of formatting the content object data for rendering on the mobile terminal, for example reducing the size and resolution of an image or video before downloading to the mobile device, or dividing text into a sequence of segments. This step may not be necessary if the content object has already been optimised, if necessary, for the mobile device.
- the retrieved content object data is displayed or otherwise rendered for the user 960, for example an image or video can be displayed or audio content played using mobile terminal speakers. If the selected marker is a hyperlink marker then the full URL may be displayed on the display in line with the text, this may require some refresh of the displayed data. Displaying the content may also include display effects such as zooming out of a marker, flipping/rotating an image or scrolling the content onto the display. The display positions of the originally displayed content may be adjusted to accommodate the retrieved content data. For example, text may be scrolled off the display or replaced by the retrieved content. Once the user has viewed the retrieved content the user can continue scrolling through the content and the retrieved content removed from the display or scrolled off the display as the user resumes viewing the content.
- the user can then chose a further action 965, for example, navigating to a next marker, which causes the process to return to step 930 or some other action which causes a new process to start 980.
- a further action 965 for example, navigating to a next marker, which causes the process to return to step 930 or some other action which causes a new process to start 980.
- the link data from the marker segment is used to access the hyperlink address and download new data from the hyperlink address 970, which can then be displayed 975.
- the user may select to follow the hyperlink directly from the marker 945 or after selecting to show the full URL at step 945 and then selecting to follow the hyperlink at step 965.
- a return command can be used to return to the content from subsequent content downloaded in response to following a hyperlink or from another process.
- the above process relates to a substantially manual process for scrolling through content based on markers.
- An alternative embodiment combines automatic scrolling with selecting markers.
- the next marker is automatically selected by the player.
- the period of time for which a marker is selected can be set by the user, and this time period may be a minimum period of time.
- the content is downloaded 910, initial position coordinates allocated 915 and the content displayed 920 using the initial coordinates.
- the first marker segment is automatically selected 930 by the player and can be highlighted if the marker is currently displayed. Highlighting the marker can also cause a marker descriptor to be displayed.
- the length of time the marker remains selected can be a given period of time or based on the scrolling speed, for example the marker may remain highlighted for 4 seconds or for the total time it is displayed.
- rules may be defined for how each of the markers is highlighted. For example, if three markers are visible on the display at the one time, each marker may be highlighted consecutively for one third of the time taken to scroll the content up the screen.
- a minimum highlighting time may be defined and the scrolling speed adjusted or scrolling paused to enable each marker to be highlighted for the given minimum time.
- a default scrolling speed may be used based on user parameters, a first marker is selected automatically 930 and the content scrolled 935, 940 using the default scrolling speed. The selected marker is highlighted once it appears on the display and marker descriptor information can also be displayed. The highlighting of the marker can set a timer for the marker highlight.
- this next marker can be selected and highlighted, setting a new minimum highlight timer. If the timer has not expired at the time the highlighted marker would scroll off the display, then the scrolling can be automatically paused and scrolling restarted when the minimum time has expired. At the time scrolling restarts, the next marker can be selected. While a marker is highlighted a user can enter a command to show the content object replaced by the marker or for hyperlink markers follow the hyperlink. User commands can also be used to override the automatic scrolling or pause, or manually select a next marker.
- content may be divided into consecutive segments at the point of transmission.
- the data may be downloaded per segment or in batches of segments depending on the embodiment implemented or the buffer size of the mobile terminal.
- a document such as a web page may be preformatted to order portions of the document in accordance with a given template order and replace selected content objects with marker segments.
- the segment size for any non-replaced text segments may be determined based on mobile terminal parameters and user parameters. For example, the segment size may be based on a number of characters which can be displayed on the mobile terminal display for a given, user defined, font size.
- the text portions of the data can then be divided into segments of the determined segment size as the data is downloaded.
- the mobile terminal may request a given number of segments be downloaded at a time, for example based on buffer size, and request the next group of segments be downloaded as the previous are displayed.
- the preformatted data is streamed to the mobile terminal and text portions are divided into segments at the mobile terminal as the data stream is received. It should be appreciated that many alternative embodiments are envisaged.
- Some embodiments enable local editing and annotation of content on the mobile device.
- the scrolling player application may be adapted to generate additional markers in response to user commands. These markers can be used, for example, for adding an annotation or comment into the document or keeping track of a user's edits.
- markers examples include: creating a new markers and its associated content object; updating a marker and its corresponding content object; deleting a marker and its corresponding content object; and moving a marker and its corresponding content object to a different displayed position and/or position in the content.
- the editing functionality can also enable a user to add content objects into the displayed content, for example by inserting text, images, videos, handwritten annotations etc.
- data entry markers may be provided to enable a user to input data but make no other modifications to the content, for example for filling out a survey form.
- a user may wish to make a comment regarding a paragraph of text.
- the user hits a button, selects an option from the player controls, selects an icon or touches a touch screen at a particular point in the content.
- a menu can be displayed from which a user can select the edit action to be performed, for example, add, delete, modify etc.
- the user selects the desired action, say to add content.
- a sub-menu can then be displayed to select the type of content to be added, for example, photo, writing, typing, audio recording, voice to text, download etc.
- a function is called that enables the capture of the data.
- the new data can be inserted into the content.
- the new content can be inserted directly into the content data or as a marker and associated content object.
- the scrolling player creates a new marker segment at the selected point in the content, for example in line with the text.
- the new content is captured and stored as a content object.
- a text comment can be captured using a device keyboard, keypad or recording an audio comment. Any audio comment may be stored as an audio file or as text using voice to text conversion functionality.
- This comment data is stored as the content object associated with the new marker. Thus when the user reviews the document, they can retrieve their comment data similarly to retrieving a content object replaced by a marker in the original content.
- a new marker and associated object can be created to show the place and nature of the edit.
- a user modifies existing content, such as editing a drawing or text, a marker segment can be added associated with the original content object to enable the original content to be recovered or changes tracked.
- a user may also edit content by deleting markers or changing the location of markers within the content.
- the edited content can be stored as a new version of the content or overwriting the original content file, several version of content data, each a different edited version, could also be stored.
- a user can add content, such as images, photographs, audio content, documents, handwritten text or video clips to the content. Further content may be added by linking to content from other sources using markers. For example, a marker segment may be generated to add a new hyperlink to a web page, document, e-mail, message (i.e. SMS, MMS, EMS, HMS etc) which may be stored in the mobile terminal memory or externally, such as on an e-mail server.
- a marker segment may be generated to add a new hyperlink to a web page, document, e-mail, message (i.e. SMS, MMS, EMS, HMS etc) which may be stored in the mobile terminal memory or externally, such as on an e-mail server.
- the editor may be adapted to enable a user to edit a content object associated with a marker.
- a marker may be selected and an "edit content object" option selected. For example from a menu displayed when the marker is selected.
- the editor displays the associated content object in an editable manner. For example, text may be displayed for editing using a keypad, touch screen, or handwriting converter as described above.
- a suitable editor may be launched.
- the user edits the content object which can be stored in its edited form associated with the marker segment.
- the storing of the edited content object may require a corresponding modification of the marker segment, for example to update linking data where the edited version of the content object is stored in a different location in memory to the original content object.
- Some marker segment or content object attributes may also be updated to indicate the content object has been modified.
- Data entry markers can be automatically opened in an "edit content object" mode to enable a user to enter data.
- marker types can include: original markers; user markers, data entry markers; and system markers.
- Original markers represent content objects in the originally formatted multimedia content.
- User markers represent content objects added or modified by the user, for example text annotations, audio content, handwriting drawing stored as an image, pictures etc.
- Data entry markers represent data entry fields or place holders in content for a user to insert data by modifying the content object associated with the data entry marker.
- System markers represent or define system events or information and may enable specific operations on the content. For example, a system marker could be associated with a content object defining content details such as version and copyright information.
- a system marker could also be associated with a content object comprising storage and/or distribution instructions associated with the content, for example digital rights management control instructions.
- a content object comprising storage and/or distribution instructions associated with the content, for example digital rights management control instructions.
- digital rights management control instructions may be restricted. For example, a user may be prohibited from deleting system marker associated with a digital rights management (DRM) content object.
- DRM digital rights management
- a user may be allowed to alter the position of the DRM associated system marker in the content only.
- a user may be enabled to delete or edit the DRM associated marker only after performing another action, such as paying a fee to use copyright work, which may be controlled through scripts of the DRM content object of the system marker segment.
- the editor can be adapted to synchronise with a content formatting and storing agent on a PC or server to also copy the edits in a stored copy of the content.
- the original document may be stored in memory of a user's PC which is provided with the local server or content agent functionality as described above.
- the original document was formatted and forwarded to the user's mobile terminal and edits subsequently made using the mobile terminal editor functionality.
- the editor may be adapted to communicate the edits to the PC agent to update the original document. This may be done automatically or in response to a synchronisation request.
- the mobile terminal editor may be configured to transmit edit data to the PC agent via a communication network or the internet when edits are made.
- the mobile terminal editor may be adapted to transmit edit data to the PC only when it is possible to do so without incurring network charges.
- transmission of edit data may be delayed until in proximity for Bluetooth connectivity between the mobile terminal and PC or when a data connection is established via a cable.
- a function is called that allows the capture of the data.
- the new data is then inserted into the document at the position indicated by the user (which can be either a screen coordinate or the end of an existing block of data).
- the new data can be either completely visible, or, it may be represented by an icon which when clicked renders it visible.
- the source of content is varied, such as web pages (i.e. html, xml, Java scripting, and other types), documents (PDF, Word and other document types), Email, Messaging (i.e. SMS, MMS, HMS-handwriting messages), etc.
- web pages i.e. html, xml, Java scripting, and other types
- documents PDF, Word and other document types
- Email i.e. SMS, MMS, HMS-handwriting messages
- Content formatted and displayed on the screen consists of multimedia components defined as Content Objects (multimedia raw sequential components that the content is formatted to) such as Text, Images, Links, Audio, Video and any other type.
- Content Objects multimedia raw sequential components that the content is formatted to
- Step 1 The original document
- Step 2 The user clicks on spot (or presses Insert Handwriting key, or there may be an icon inserted at Insert Picture every line which the user may click) menu Insert Movie pops up and user selects insert text
- Step 3 As a result of choosing enter text, a window pops up which allows the user to type in text. On pressing OK, the system inserts the typed data into the original document.
- Step 4 The new document including the with short strings, string output will often text inserted be too long to be readable on one line.
- the annotation is keyboard data, as indicated above, it could be a photo, or handwriting (on touch-screen phones) etc.
- the editing features can be implemented either as a software application that interacts directly with the phone's operating system (i.e, using an Application Player) or via modification of documents so that they perform the editing functions, for example using embedded scripting, when running on a phone's generic browser.
- This example relates to an embodiment where embedded instructions are included in content to enable a generic browser to provide enhanced features for the given content.
- Content can be altered including altering html tags (and inserting javascript and links to Java applications) for the purposes of scrolling or resizing of content by the generic browser. Further, extra tags are altered and scripts inserted so that dynamic annotation is also enabled.
- the example below shows some of the adaptations that may be made to original content to transform the content into a content object enabling enhanced functionality in a generic browser.
- tags would be modified as follows...
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Artificial Intelligence (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- Human Computer Interaction (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Information Transfer Between Computers (AREA)
Abstract
Des modes de réalisation de la présente invention concernent des procédés, des applications et des systèmes permettant de formater, d'afficher et de modifier des contenus sur un terminal mobile. Les données de contenu formatées pour l'affichage sont constituées d'une séquence de segments consécutifs, basés sur des valeurs prédéterminées de paramètres de formatage. Les segments consécutifs incluent au moins un segment marqueur, associé à un objet de contenu, et sont ordonnés de telle sorte que les marqueurs apparaissent en association avec un texte quelconque lorsqu'il est affiché. Les valeurs prédéterminées des paramètres de formatage incluent une ou plusieurs des valeurs suivantes : valeurs de paramètres basées sur des limites d'affichage pour le terminal mobile et valeurs de paramètres spécifiées par un utilisateur.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2008906275A AU2008906275A0 (en) | 2008-12-03 | Method and system for displaying data on a mobile terminal | |
AU2008906275 | 2008-12-03 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010063070A1 true WO2010063070A1 (fr) | 2010-06-10 |
Family
ID=42232815
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/AU2009/001573 WO2010063070A1 (fr) | 2008-12-03 | 2009-12-02 | Procédé et système pour l'affichage de données sur un terminal mobile |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2010063070A1 (fr) |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2011023109A1 (fr) * | 2009-08-26 | 2011-03-03 | 华为技术有限公司 | Procédé, dispositif et système pour le traitement d'un chapitre de livre électronique |
CN103488731A (zh) * | 2013-09-17 | 2014-01-01 | 天脉聚源(北京)传媒科技有限公司 | 一种统一资源定位符的处理方法及装置 |
CN103593333A (zh) * | 2013-10-16 | 2014-02-19 | 小米科技有限责任公司 | 一种电子书文档的处理方法、终端及电子设备 |
US20140214935A1 (en) * | 2013-01-28 | 2014-07-31 | International Business Machines Corporation | Managing Content Across Different Device Types |
CN104093067A (zh) * | 2014-06-23 | 2014-10-08 | 广州三星通信技术研究有限公司 | 在终端中分享、播放视听片段的设备和方法 |
RU2621643C2 (ru) * | 2013-10-30 | 2017-06-06 | Сяоми Инк. | Способ и устройство для отображения информации |
CN110704573A (zh) * | 2019-09-04 | 2020-01-17 | 平安科技(深圳)有限公司 | 目录存储方法、装置、计算机设备及存储介质 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020059367A1 (en) * | 2000-09-27 | 2002-05-16 | Romero Richard D. | Segmenting electronic documents for use on a device of limited capability |
US20030182628A1 (en) * | 2002-03-19 | 2003-09-25 | Luigi Lira | Reformatting columns of content for display |
US20060136491A1 (en) * | 2004-12-22 | 2006-06-22 | Kathrin Berkner | Semantic document smartnails |
AU2006331285A1 (en) * | 2005-12-29 | 2007-07-05 | Ozmiz Pty. Ltd. | Method and system for displaying data on a mobile terminal |
US7278117B2 (en) * | 2002-07-02 | 2007-10-02 | Hewlett-Packard Development Company, L.P. | Image segmentation and warping for specialized display viewing |
-
2009
- 2009-12-02 WO PCT/AU2009/001573 patent/WO2010063070A1/fr active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020059367A1 (en) * | 2000-09-27 | 2002-05-16 | Romero Richard D. | Segmenting electronic documents for use on a device of limited capability |
US20030182628A1 (en) * | 2002-03-19 | 2003-09-25 | Luigi Lira | Reformatting columns of content for display |
US7278117B2 (en) * | 2002-07-02 | 2007-10-02 | Hewlett-Packard Development Company, L.P. | Image segmentation and warping for specialized display viewing |
US20060136491A1 (en) * | 2004-12-22 | 2006-06-22 | Kathrin Berkner | Semantic document smartnails |
AU2006331285A1 (en) * | 2005-12-29 | 2007-07-05 | Ozmiz Pty. Ltd. | Method and system for displaying data on a mobile terminal |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2011023109A1 (fr) * | 2009-08-26 | 2011-03-03 | 华为技术有限公司 | Procédé, dispositif et système pour le traitement d'un chapitre de livre électronique |
US20140214935A1 (en) * | 2013-01-28 | 2014-07-31 | International Business Machines Corporation | Managing Content Across Different Device Types |
CN103488731A (zh) * | 2013-09-17 | 2014-01-01 | 天脉聚源(北京)传媒科技有限公司 | 一种统一资源定位符的处理方法及装置 |
CN103593333A (zh) * | 2013-10-16 | 2014-02-19 | 小米科技有限责任公司 | 一种电子书文档的处理方法、终端及电子设备 |
EP2863320A3 (fr) * | 2013-10-16 | 2015-09-02 | Xiaomi Inc. | Procédé, terminal et dispositif électronique de traitement d'un document de livre électronique |
RU2617388C2 (ru) * | 2013-10-16 | 2017-04-24 | Сяоми Инк. | Способ, терминал и электронное устройство для обработки документа электронной книги |
CN103593333B (zh) * | 2013-10-16 | 2017-09-22 | 小米科技有限责任公司 | 一种电子书文档的处理方法、终端及电子设备 |
RU2621643C2 (ru) * | 2013-10-30 | 2017-06-06 | Сяоми Инк. | Способ и устройство для отображения информации |
CN104093067A (zh) * | 2014-06-23 | 2014-10-08 | 广州三星通信技术研究有限公司 | 在终端中分享、播放视听片段的设备和方法 |
CN104093067B (zh) * | 2014-06-23 | 2017-08-25 | 广州三星通信技术研究有限公司 | 在终端中分享、播放视听片段的设备和方法 |
CN110704573A (zh) * | 2019-09-04 | 2020-01-17 | 平安科技(深圳)有限公司 | 目录存储方法、装置、计算机设备及存储介质 |
CN110704573B (zh) * | 2019-09-04 | 2023-12-22 | 平安科技(深圳)有限公司 | 目录存储方法、装置、计算机设备及存储介质 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11256848B2 (en) | Automated augmentation of text, web and physical environments using multimedia content | |
US8584002B2 (en) | Automatic sub-template selection based on content | |
US8566301B2 (en) | Document revisions in a collaborative computing environment | |
US20070162845A1 (en) | User interface for webpage creation/editing | |
US7581176B2 (en) | Document display system and method | |
US9135341B2 (en) | Method and arrangement for paginating and previewing XHTML/HTML formatted information content | |
US8452783B2 (en) | Document processing device and program | |
US10210142B1 (en) | Inserting linked text fragments in a document | |
WO2010063070A1 (fr) | Procédé et système pour l'affichage de données sur un terminal mobile | |
US20100332512A1 (en) | System and method for creating and manipulating thumbnail walls | |
US20080301555A1 (en) | System and method for providing animated browser thumbnails | |
US20090313574A1 (en) | Mobile document viewer | |
KR20070020086A (ko) | 이미지 및 기타 사용자 데이터의 자동 그룹화 | |
EP3008622A2 (fr) | Interaction entre un contenu web et un document d'application électronique | |
CN110647624A (zh) | 呈现企业消息传递中的文档差异的动画预览的自动生成 | |
CN116579295B (zh) | 多格式文件合订本动态插页、挪位、隐藏展现的方法 | |
JP4386011B2 (ja) | Webページ再編集方法及びシステム | |
US11314757B2 (en) | Search results modulator | |
JP2004178512A (ja) | リンク先コンテンツ閲覧支援装置、リンク先コンテンツ閲覧支援方法及びプログラム並びに記録媒体 | |
CN112507670A (zh) | 一种文本编辑方法、装置、电子设备及存储介质 | |
JP2006215681A (ja) | 文書内容把握支援システム | |
KR20100137252A (ko) | 전자앨범장치 및 이의 구동방법, 전자앨범에 객체정보를 포함하는 동영상 제공방법 및 장치 | |
KR20140098929A (ko) | 사용자 지향적 개인 출판물 저작 도구를 이용하는 웹 기반의 온라인 전자책 출판 방법 및 웹 기반의 온라인 전자책 출판 시스템 | |
CN107066437B (zh) | 数字作品标注的方法及装置 | |
KR102465870B1 (ko) | 이미지에 대한 음성합성에 기반하여 영상 컨텐츠를 생성하는 방법 및 시스템 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 09829885 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 09829885 Country of ref document: EP Kind code of ref document: A1 |