WO2017177257A1 - Method and system for machine-assisted cross-platform design synchronisation - Google Patents
Method and system for machine-assisted cross-platform design synchronisation Download PDFInfo
- Publication number
- WO2017177257A1 WO2017177257A1 PCT/AU2017/000084 AU2017000084W WO2017177257A1 WO 2017177257 A1 WO2017177257 A1 WO 2017177257A1 AU 2017000084 W AU2017000084 W AU 2017000084W WO 2017177257 A1 WO2017177257 A1 WO 2017177257A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- hints
- hint
- design
- user
- computer
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/10—Text processing
- G06F40/103—Formatting, i.e. changing of presentation of documents
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/20—Natural language analysis
- G06F40/279—Recognition of textual entities
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/30—Semantic analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F40/00—Handling natural language data
- G06F40/40—Processing or translation of natural language
Definitions
- the present invention generally relates to handling of digital content.
- the present invention relates to the creation and design of digital content. It will be convenient to hereinafter describe the invention in relation to the use of hints, as defined herein, accompanying components of digital content in order to invoke a design brief for composing cross-platform digital media content for publication, however it should be appreciated that the present invention is not limited to that use, only.
- Ferrel et al discloses the use of style sheets for application to individual display regions of a page (document). Specifically, Ferrel describes a feature where styling is performed in pre-allocated regions of a display that may not contain any text yet; as text is added later, this text is styled according to the pre-determined style sheet for this display region. Ferrel et al is an example of simple, rigid, must-follow directions that pertain to styling for specific media and uses, specifically mentioning regions of pages, displays and documents. As such Ferrel et al is considered an example of a conventional naive approach to styling content.
- US patent application publication No. 2004/0205588 (Purvis et al) addresses the drawback of pre-determining style sheets in that the styling cannot easily be dynamic, changing with different output devices, or with different document content. Thus, if different styles are required for different sets of content, or a different style for each output device, a style sheet is required for each scenario, which is problematic in terms of anticipating all potential scenarios, as well as a difficult maintenance problem.
- the solution of Purvis et al is to provide a means to automatically generate a style sheet based on the input content and the output device characteristics by way of the steps of first determining a set of layout constraints such as design criteria ('soft' constraints), the requirements of a particular output device, or alternatively, the constraints could be explicitly specified or expressed as properties of a good layout design.
- the method has the step of representing the style properties of the document as problem variables. These variables could advantageously include font, text line, or colour properties in addition to positioning properties including graphical style.
- US patent application publication No. 2017/0032554 (O'Donovan et al) highlights the problems that arise for many content providers who are not trained or experienced in creating professional and eye-catching digital media. For example, a content provider may wish to design a digital image that has the same "look and feel" as an existing image, but does not have the design experience to do so. This process, however, is frustrating to the untrained and wastes time. O'Donovan also highlights that software packages for editing digital media are generally bulky and require a substantial amount of processing power and memory from the computing device on which the software is running. Thus, in order to successfully edit digital images, a user generally utilizes a larger computing device, such as a laptop or desktop computer.
- O'Donovan addresses these problems with a system that filters and presents template digital designs to a user that have been scored based on a compatibility between each template digital design and the user's input digital design.
- the system of O'Donovan alters the user's input digital design to match the look-and-feel of the selected template digital design.
- O'Donovan not only requires pre-prepared templates but it also proposes to match an already existing design to this set of prepared templates and lets the user select the closest template, upon which the existing design is modified using the template as a guide. It is considered that this is a clumsy solution in that it is trying to derive styling cues from a piece of existing styled content.
- a method of producing a user-preferred digital media content design by automatically configuring one or a combination of hints for representing content which is non-specific to a terminating platform comprising the steps of: mapping components of at least one imperative derived from user input to respective hint classes; matching all hints from a set of known hints with the hint classes that have been mapped with the components of the at least one imperative derived from user input.
- the steps of mapping and matching are repeated, and furthermore the method may further include the step of combining the matched hints with an existing collection of hints. In these preferred aspects, the process becomes an iterative process.
- the hints comprise a composite of parent and/or child hints.
- the composite of parent and/or child hints is derived from an archetypal graph.
- the at least one imperative is derived from user input by use of natural language processing.
- the components of derived imperatives comprise a range of progressively conceptually abstract user input.
- the step of mapping further may include mapping a vector associated with a hint as a measure of specificity and in preferred embodiments, the method further comprises the step of searching for hints based on predetermined specificity criteria.
- the step of combining further includes effecting changes to one or more hints within the existing collection of hints or the combined hints.
- the effected changes may include turning a hint on or off.
- the method further comprises the step of solving the archetypal graph to determine a path from first source set of hints to a second target set of hints.
- the step of solving may further include determining one or a combination of points on the path between the first source set of hints and the second target set of hints.
- the solving step may further include the step of associating a visual impact score with at least one hint by application of a weighting factor.
- the method further includes the step of calculating the distance between two collections of hints.
- apparatus adapted to produce a user-preferred digital media content design by automatically configuring one or a combination of hints for representing content which is non-specific to a terminating platform, said apparatus comprising: processor means adapted to operate in accordance with a predetermined instruction set, said apparatus, in conjunction with said instruction set, being adapted to perform the method as stated above and herein described.
- the article comprises one or a combination of: a printable document; a visual display; an audio-visual display; an audio playback file; a multi-media file; a multi-media display.
- the present invention provides a computer program product comprising: a computer usable medium having computer readable program code and computer readable system code embodied on said medium for producing a user-preferred digital media content design by automatically configuring one or a combination of hints for representing content which is non-specific to a terminating platform within a data processing system, said computer program product comprising: computer readable code within said computer usable medium for performing the steps of the method as stated above and herein described.
- the present invention provides a terminating platform, service or media residing in a digital media system adapted to interpret hints and produce a user- preferred digital media content design according to a method as stated above and herein described.
- the embodiments described herein for the present invention further solves the problem of providing such cross-platform design services over multiple platforms and media; even when regarding single platform content delivery products (such as WixTM, WeeblyTM, SquarespaceTM), the design tools associated with such content delivery platforms tend to work only one particular platform as well.
- a drag & drop interface presumes that the rendering hardware provides a means to select and hold down a graphical object while "dragging" it across a screen.
- the present invention still works in the absence of a graphical user interface - for example when only a text interface or audio channel is available.
- embodiments of the present invention stem from the realization that the use of hint classes to map user input and all hints being matched to the mapped input mean that, a user defined content design can be expressed as a sum of graphed hints as nodes of a graph and thus address various deficiencies of the prior art such as, for example, insufficient abstracting of styling cues for the purpose of cross-platform or cross-medium use and graceful degradation of styling directives, the lack of a data structure to aid agent-like (ie Artificially Intelligent) behaviour and interfaces, including, but not limited to, natural language interfaces and semantic processing thereof.
- Embodiments of the present invention propose to reduce the cost and complexity of the creation of tailor-made and custom designed experiences
- Embodiments of the present invention allow for simultaneous directions for the "styling" of the same text in an audio channel, in addition to visually oriented platforms/media;
- Embodiments of the present invention provide a system that can autonomously establish and resolve very complex, interdependent, sometimes conflicting or ambiguous, styling preferences and directions;
- Embodiments of the present invention provide a method for constraint satisfaction/optimisation, elegantly resolving conflicting styling directions, even being able to communicate in natural language the rationale behind the way it solved the conflicting directions;
- Embodiments of the present invention first establish the desired design cues, upon which those styling cues are applied to a set of content still devoid of styling;
- Embodiments of the present invention not only do away with templates (the amount of possible combinations allowed by a moderately large hint graph are virtually innumerable), but make it wholly unnecessary to display anything visually in the first place as part of an interface. Further, natural language can be used to steer the design into the desired direction and that a preferred design can be reflected in more than just a visual way.
- Figure 1 is a flow chart for the recursive processing of representation hints in accordance with an embodiment of the present invention
- Figure 2 is an archetype graph depicting directional dependencies of nodes representing "text box styling" attributes for use with hints in accordance with an embodiment of the present invention
- Figure 3 is 2-dimensional matrix displaying closeness of fit of archetypes to a current design in accordance with a preferred embodiment of the present invention
- Figure 4 is a flow chart of an iterative algorithm for finding a path from a first (source) set of hints to a second (target) set of hints in accordance with embodiments of the present invention
- Figure 5a illustrates the association of hints with different styling instructions for a target platform in accordance with an embodiment of the present invention
- Figure 5b illustrates the association of the hints of Figure 5a with different styling instructions for another target platform in accordance with an embodiment of the present invention
- Figure 6a is an exemplary representation of a single hint and a description of associated data in accordance with an embodiment of the present invention
- Figure 6b is an exemplary representation of a single hint and examples of associated data in accordance with an embodiment of the present invention
- Figure 7a is a system flow chart exemplifying the use of hint class mapping and vector direction mapping in accordance with a preferred embodiment of the present invention
- Figure 7b is a system flow chart exemplifying the further use of hint class mapping and vector direction mapping in accordance with a preferred embodiment of the present invention.
- Figure 8a is a system flow chart illustrating an example of how user input is mapped to hint classes and then hints in accordance with an embodiment of the present invention
- Figure 8b is a system flow chart illustrating another example of how user input is mapped to hint classes and then hints in accordance with an embodiment of the present invention
- Figure 9a is an archetype graph depicting directional dependencies of nodes representing attributes for use with hints in accordance with an embodiment of the present invention
- Figure 9b is an archetype graph depicting directional dependencies of nodes which illustrate a selection of nodes representing hints that are set for a feminine archetype in accordance with an embodiment of the present invention
- Figure 9c is an archetype graph depicting directional dependencies of nodes which illustrate a selection of nodes representing hints that are set for a masculine archetype in accordance with an embodiment of the present invention
- Figure 9d is an archetype graph depicting directional dependencies of nodes which illustrate a selection of nodes representing hints that are set for a valid half-way solution between the feminine archetype of Figure 9b and the masculine archetype of Figure 9c in accordance with an embodiment of the present invention
- Figure 9e is an archetype graph depicting directional dependencies of nodes which illustrate a selection of nodes representing hints that are set for another valid half-way solution between the feminine archetype of Figure 9b and the masculine archetype of Figure 9c in accordance with an embodiment of the present invention.
- WO 2014/165933 discusses the use of "hints” that accompany a piece of content.
- "hints” are instructional information that provide the terminating rendering platform, service or medium, clues much like “serving suggestions” on how to best represent the content it is given.
- a hint may indicate to a terminating platform, service or medium that preferably, text is to be rendered in a particular colour or in a particular font.
- hints may in certain cases be ignored by a terminating platform, service or medium. For example, this may be the case if a hint is inappropriate, or no associated means of interpreting the hint exists, for example, missing code, or if the hint's purpose is simply not applicable, for example, a hint that specifies "yellow text" when the rendering platform is only capable of monochrome rendering.
- Preferred embodiments of the present invention as described provide a method for the automated configuration of complex hint combinations, in such a way that these hint configurations express a design brief that needs to be expressed only once, may be expressed in a more human friendly format, yet achieves the desired design parameters on all platforms, services and media at once provided the terminating platforms, services and media have the means to interpret the hints.
- Means to interpret the hints are described in WO 2014/165933.
- the present invention defines relationships between hints by means of a graph, where connected child nodes (child hints) preferably express ever more escalating levels of specificity and/or direction set out by the parent node (parent hint).
- Figure 2 is a depiction of an example sub-section of a graph that shows nodes that govern various aspects of "text box styling", including node interdependencies. A single arrow denotes a parent to child relationship, whereas a double arrow denotes mutual exclusivity.
- a parent node "text color” could have one or more "specific" child nodes such as "blue” and "red”.
- FIG. 5a is a representation of how hints are associated with different styling instructions, in this case using the Cascading Style Sheets (CSS) web technology.
- Figure 5b is a representation of how hints are associated with different styling instructions, in this case using Apple iOS UlView instructions.
- the terminating platform's hint interpreter does not require awareness of the graph or the full hint's data structures, however it does require awareness of which styling directions are more specific, as the more specific instructions need to be executed after the less specific instructions due to the possibility of overriding behaviour of the more specific hints.
- a hint specifying the use of feminine font "Lora” may be interpreted by one, visually oriented, renderer as a direction to use this more curly typeface by specifically checking for "typography>feminine>lora”.
- a text-to-speech renderer would use the same "typography>feminine>lora” direction to use a female voice (checking for the less specific parent-child relationship "typography>feminine", as it has no need for the specificity of further children such as "lora”).
- Yet another platform might completely ignore the hint if it is not able to synthesise a meaningful change in response to that hint (for example due to missing functionality or capability).
- Each hint optionally encodes a collection of other hints that should be turned on (e.g. added/set) or off (e.g. removed/unset) upon turning this hint on.
- This allows conflicting hints to be turned off in order to, for example, establish mutual exclusivity.
- hints may be turned on or off by other hints which may reside in very different areas of the graph. In this respect, they do not necessarily have an ancestor-descendant relationship.
- a hint that governs logo placement may instruct a certain hint combination that governs background color to be neutralised in order for the logo to blend in correctly, which effectively is encoding awareness of clashing design elements.
- the hint data structure in Figure 6b specifies that hint with unique identifier "#button: moderately show rounded corners" is to be turned on and therefore its design code executed as a direct result of turning on "#text box: moderately rounded corners”.
- buttons shall also adopt rounded corners, so as to keep the design consistent.
- "#button: moderately show rounded corners” itself would have hints associated with it that need to be turned on or off, then as a result of turning this hint on, those hints too will be processed, and so on and so forth.
- care must be taken not to encode infinite loops this way (for example caused by hints mutually turning each other on ad infinitum), or that infinite loops are detected and stopped by some other means in a solver (for example by checking if a particular node/hint has been processed before and not process it if that is indeed the case).
- care must also be taken not to create "orphan” hints (unless they are root nodes).
- a single "macro" hint for example the "design archetype” node in Figure 2
- Figure 1 is a flow chart describing recursive resolving of one or more hints into its full member hints representation.
- One or more optional hint qualifiers are preferably associated with each hint, which encode a "general concept” that this hint pertains to, such as for example "text color”, “border thickness”, “navigation position”, etc.
- classes encode a "general concept” that this hint pertains to, such as for example "text color”, “border thickness”, “navigation position”, etc.
- abstract notions can end up being large collections of hints under one or more "design archetype” hints as depicted in Figures 2, 9b and 9c.
- the found hints can now, for example, be added to the currently selected collection of hints (e.g. the "design" as the user experienced it before issuing the imperative), upon which they are solved by a solver and the new collection of hints is returned. Re-evaluation of the styling instructions associated with the updated hints collection by all platforms, will now ensure that the text is indeed rendered red as requested on platforms that are able to do so.
- Figure 8b is an example of how more conceptually abstract user input is mapped to hint classes and then hints. Using the classes associated with the hints, it is possible to adequately respond to otherwise ambiguous natural language imperatives like "make the font more feminine". Referring to Figure 8b, the latter is accomplished as follows. A number of design "archetypes" are encoded, e.g. aforementioned "macro" hints that trigger a lot of different child hints that cause sweeping design changes. Such archetype hints may, for example, constitute a large collection of design changes/elements that express "femininity" in a design. Such an archetype/macro hint has a "class” encoded along with it, for example, "feminine".
- the word “feminine” (or “female” or “ woman”, etc.) is mapped by natural language processing to the "feminine” qualifier of the macro hint.
- the word “text” (or “font”, etc.) is also mapped by natural language processing to, say, a "typeface” class, which has been previously encoded along with all hints that cover typography.
- An optional unique, human interpretable description may be provided along with each hint.
- This may be, for example in the form of a thumbnail/image, a natural language text string, or indices thereto.
- these natural language text strings and/or example images explain in human-relatable terms what design aspect the hint governs or pertains to.
- this allows for identifying user-desired (or undesired) hint candidates by means of natural language and/or visual examples.
- a graph solver there is provision for articulating a solution path, effectively communicating a thought process behind design decisions by means of rendering the human interpretable description for each intermediary step and in addition to an indication of what happened to the hint (turned on or off).
- Figure 4 is a flow chart describing an exemplary graph solving algorithm that iteratively finds a path from a first (source) set of hints to a second (target) set of hints. Articulating the thought process is then accomplished by conveying the textual or visual description for each new (or removed) hint, as the solver, as shown by the example of Figure 4, iterates on the way from the source collection of hints to the target collection of hints.
- the preceding described embodiments make it possible to articulate the design decisions and rationale in detail, including rationalising the resolution of clashing design elements.
- a "vector” may be associated with a hint which indicates how "extreme” or “conservative” a hint is in relation to its parent and children hints of the same class.
- this allows natural language processing algorithms to map natural language quantifiers such as "less”, “more”, “bigger”, “smaller”, “higher”, “lower”, etc. to a graph traversal direction.
- Figure 7a is an example of how hint class and vector mapping is used to modify an aspect of a design in a less extreme direction
- Figure 7b is an example of how hint class and vector mapping is used to modify an aspect of a design in a more extreme direction.
- a natural language processing algorithm can map the words “borders” and “rounded' to all hints with the appropriate classes, while it can map "less” to mean a vector reduction.
- a search is performed for the most extreme (or "specific") hint currently set (e.g. currently visible in the design) that matches the "borders" and "rounded” mapping.
- a measure for "specificity” can be defined by, for example longest distance to a root node, longest distance to the last ancestor that still has the same classes set, or simply testing whether a node is a leaf node in the context of the current collection of hints.
- this currently “most extreme/specific” hint After this currently “most extreme/specific” hint has been found, it may then find the descendant or ancestor that also matches the "borders" and “rounded' mapping, however with a smaller (as specified by the "less” natural language mapping) vector value. Then, by looking for the hint with the smallest difference in vector value compared to the currently "most extreme/specific” hint set, it can be ensured that the change/difference in visual appearance is the smallest possible (reflecting the word "less", as requested). Once this hint has been found, the appropriate changes can then be made to the current collection of hints. That is, making sure that the found hint is turned on and solved, while making sure that all its children are turned off.
- Figure 7b shows a similar flow of events for the imperative "can you make the border more rounded", as opposed to less rounded.
- the flow of events is very similar, with the exception that the implementation searches for a vector value that is bigger, rather than smaller.
- this mechanism could be driven by picking any vector value, in response to an imperative, that sits on a continuum between least extreme vector value and most extreme vector value and finding the hint that matches most closely to this vector value. By doing so, it is possible to respond to imperatives such as “can you make the font medium sized", assuming "medium sized” maps to a vector value that sits roughly in between the most extreme vector value and least extreme vector value for hints that govern font size.
- imperatives such as “can you make the font medium sized”
- this allows for scaling, either scaling up or scaling done in response to effectively an infinite variety of imperatives.
- a node distance calculation can be used in the user interface of a computer program that is interacting with the user for finding the anti-thesis of a design concept (such as "modern") as specified by a collection of hints.
- a design concept such as "modern”
- hints such as "modern”
- computing the solution(s) that maximises the distance to, for example, "modern” the anti-thesis of "modern” (e.g. "classic” or "conservative”) may be located.
- a solver could be implemented as follows.
- the first step to solve the path from one set of hints to another is to thoroughly resolve all hints of the source and, separately, target collection into their constituent on and off hints, for example, as depicted by Figure 1 .
- the algorithm of figure 4 repeatedly compares the source, which gets updated every iteration by means of the algorithm of figure 1 , to the target and evaluates the difference in hints.
- Figure 9b is an example of a "feminine" archetype using hints from the full knowledge graph of figure 9a, where the coloured-in nodes represent hints that are set.
- Figure 9c is an example of a "masculine” archetype using hints from the full knowledge graph of figure 9a, where the coloured-in nodes represent hints that are set.
- Figure 9d is an example of a valid half-way solution between the "feminine" archetype of figure 9b and the "masculine” archetype of figure 9b, where the coloured-in nodes represent hints that are set.
- Figure 9e is a second example of a valid half-way solution between the "feminine" archetype of figure 9b and the "masculine” archetype of figure 9b, where the coloured-in nodes represent hints that are set.
- the optional "visual impact" score (effectively a weighting factor) on a predetermined scale could be associated with each hint to further enhance path solver solution comparisons, and help to better articulate design decisions and guidance advice to an end user.
- a weighting factor recognises that not all design decisions are equal.
- One hint for example a hint that changes the background colour to red, could be deemed to have more of an impact than another, for example a hint that changes border thickness from 9 to 10 pixels.
- aforementioned design changes would both be counted as one "step” (e.g. a single solution application iteration from the solver) and therefore one unit of distance "away” or "closer” to another design.
- visual impact can be properly weighted in terms of "closeness" to other designs.
- Figure 3 is an n-matrix output of a Self Organizing Map (Kohonen network) Artificial Neural Net that has been trained with archetypal hint collections and valid in-between solutions. Overlaid is a closeness-of-fit gray scale for every solution in the matrix, yielding an image analogous to a functional magnetic resonance imaging (fMRI) scan, mapping brain activity of a biological brain.
- fMRI magnetic resonance imaging
- This assignment of values to grid result is somewhat similar to the output of a Self Organising Map (Kohonen Network) Artificial Neural Net and can further be used in a similar manner to pick designs based on their topology in relation the pure archetype locations on such a map.
- this can be achieved by choosing a grid location in between archetypes and consulting the hint collection that was used to generate the RGB or brightness value for that grid location.
- a true Self Organising Map Artificial Neural Net may be trained using randomised (but valid) designs, which would also be accomplishing something analogous to a brain activity map that can be used in the aforementioned manner. It would be appreciated by the reader that it is possible to have multiple brain maps in this way that show different types of archetypes that control different aspects of a design. For example, one could have design archetypes, layout archetypes, colour archetypes, etc.
- any means-plus-function clauses are intended to cover structures as performing the defined function and not only structural equivalents, but also equivalent structures.
- a nail and a screw may not be structural equivalents in that a nail employs a cylindrical surface to secure wooden parts together, whereas a screw employs a helical surface to secure wooden parts together, in the environment of fastening wooden parts, a nail and a screw are equivalent structures.
- process means any process, algorithm, method or the like, unless expressly specified otherwise.
- Each process (whether called a method, algorithm or otherwise) inherently includes one or more steps, and therefore all references to a "step” or “steps" of a process have an inherent antecedent basis in the mere recitation of the term 'process' or a like term. Accordingly, any reference in a claim to a 'step' or 'steps' of a process has sufficient antecedent basis.
- invention and the like mean "the one or more inventions disclosed in this specification", unless expressly specified otherwise.
- the phrase "at least one of, when such phrase modifies a plurality of things means any combination of one or more of those things, unless expressly specified otherwise.
- the phrase "at least one of a widget, a car and a wheel” means either (i) a widget, (ii) a car, (iii) a wheel, (iv) a widget and a car, (v) a widget and a wheel, (vi) a car and a wheel, or (vii) a widget, a car and a wheel.
- the phrase "at least one of, when such phrase modifies a plurality of things does not mean "one of each of the plurality of things.
- Numerical terms such as “one”, “two”, etc. when used as cardinal numbers to indicate quantity of something mean the quantity indicated by that numerical term, but do not mean at least the quantity indicated by that numerical term.
- the phrase “one widget” does not mean “at least one widget”, and therefore the phrase “one widget” does not cover, e.g., two widgets.
- any given numerical range shall include whole and fractions of numbers within the range.
- the range "1 to 10" shall be interpreted to specifically include whole numbers between 1 and 10 (e.g., 2, 3, 4, . . . 9) and non-whole numbers (e.g., 1.1 ,
- determining and grammatical variants thereof (e.g., to determine a price, determining a value, determine an object which meets a certain criterion) is used in an extremely broad sense.
- the term “determining” encompasses a wide variety of actions and therefore “determining” can include calculating, computing, processing, deriving, investigating, looking up (e.g., looking up in a table, a database or another data structure), ascertaining and the like.
- determining can include receiving (e.g., receiving information), accessing (e.g., accessing data in a memory) and the like.
- determining can include resolving, selecting, choosing, establishing, and the like.
- the term “determining” does not imply certainty or absolute precision, and therefore “determining” can include estimating, extrapolating, predicting, guessing and the like.
- determining does not imply that any particular device must be used. For example, a computer need not necessarily perform the determining.
- indication is used in an extremely broad sense.
- the term “indication” may, among other things, encompass a sign, symptom, or token of something else.
- indication may be used to refer to any indicia and/or other information indicative of or associated with a subject, item, entity, and/or other object and/or idea.
- phrases "information indicative of and "indicia” may be used to refer to any information that represents, describes, and/or is otherwise associated with a related entity, subject, or object.
- Indicia of information may include, for example, a symbol, a code, a reference, a link, a signal, an identifier, and/or any combination thereof and/or any other informative representation associated with the information.
- indicia of information may be or include the information itself and/or any portion or component of the information.
- an indication may include a request, a solicitation, a broadcast, and/or any other form of information gathering and/or dissemination.
- ordinal number such as “first”, “second”, “third” and so on
- that ordinal number is used (unless expressly specified otherwise) merely to indicate a particular feature, such as to distinguish that particular feature from another feature that is described by the same term or by a similar term.
- a "first widget” may be so named merely to distinguish it from, e.g., a "second widget”.
- the mere usage of the ordinal numbers “first” and “second” before the term “widget” does not indicate any other relationship between the two widgets, and likewise does not indicate any other characteristics of either or both widgets.
- the mere usage of the ordinal numbers “first” and “second” before the term “widget” (1 ) does not indicate that either widget comes before or after any other in order or location; (2) does not indicate that either widget occurs or acts before or after any other in time; and (3) does not indicate that either widget ranks above or below any other, as in importance or quality.
- the mere usage of ordinal numbers does not define a numerical limit to the features identified with the ordinal numbers.
- the mere usage of the ordinal numbers "first” and “second” before the term “widget” does not indicate that there must be no more than two widgets.
- a single device/article may alternatively be used in place of the more than one device or article that is described.
- a plurality of computer- based devices may be substituted with a single computer-based device.
- the various functionality that is described as being possessed by more than one device or article may alternatively be possessed by a single device/article.
- the functionality and/or the features of a single device that is described may be alternatively embodied by one or more other devices which are described but are not explicitly described as having such functionality/features.
- other embodiments need not include the described device itself, but rather can include the one or more other devices which would, in those other embodiments, have such functionality/features.
- Devices that are described as in communication with each other need not be in continuous communication with each other, unless expressly specified otherwise. On the contrary, such devices need only transmit to each other as necessary or desirable, and may actually refrain from exchanging data most of the time. For example, a machine in communication with another machine via the Internet may not transmit data to the other machine for long period of time (e.g. weeks at a time). In addition, devices that are in communication with each other may communicate directly or indirectly through one or more intermediaries.
- process may be described singly or without reference to other products or methods, in an embodiment the process may interact with other products or methods.
- interaction may include linking one business model to another business model.
- Such interaction may be provided to enhance the flexibility or desirability of the process.
- An enumerated list of items does not imply that any or all of the items are mutually exclusive, unless expressly specified otherwise.
- an enumerated list of items does not imply that any or all of the items are comprehensive of any category, unless expressly specified otherwise.
- the enumerated list "a computer, a laptop, a PDA" does not imply that any or all of the three items of that list are mutually exclusive and does not imply that any or all of the three items of that list are comprehensive of any category.
- a processor e.g., one or more microprocessors, one or more micro-controllers, one or more digital signal processors
- a processor will receive instructions (e.g., from a memory or like device), and execute those instructions, thereby performing one or more processes defined by those instructions.
- a "processor” means one or more microprocessors, central processing units (CPUs), computing devices, micro-controllers, digital signal processors, or like devices or any combination thereof.
- a description of a process is likewise a description of an apparatus for performing the process.
- the apparatus that performs the process can include, e.g., a processor and those input devices and output devices that are appropriate to perform the process.
- programs that implement such methods may be stored and transmitted using a variety of media (e.g., computer readable media) in a number of manners.
- media e.g., computer readable media
- hard-wired circuitry or custom hardware may be used in place of, or in combination with, some or all of the software instructions that can implement the processes of various embodiments.
- various combinations of hardware and software may be used instead of software only.
- Non-volatile media include, for example, optical or magnetic disks and other persistent memory.
- Volatile media include dynamic random access memory (DRAM), which typically constitutes the main memory.
- Transmission media include coaxial cables, copper wire and fibre optics, including the wires that comprise a system bus coupled to the processor.
- Transmission media may include or convey acoustic waves, light waves and electromagnetic emissions, such as those generated during radio frequency (RF) and infra-red (IR) data communications.
- RF radio frequency
- IR infra-red
- Common forms of computer-readable media include, for example, a floppy disk, a flexible disk, hard disk, magnetic tape, any other magnetic medium, a CD-ROM, DVD, any other optical medium, punch cards, paper tape, any other physical medium with patterns of holes, a RAM, a PROM, an EPROM, a FLASH-EEPROM, any other memory chip or cartridge, a carrier wave as described hereinafter, or any other medium from which a computer can read.
- data may be (i) delivered from RAM to a processor; (ii) carried over a wireless transmission medium; (iii) formatted and/or transmitted according to numerous formats, standards or protocols, such as Ethernet (or IEEE 802.3), SAP, ATP, BluetoothTM, and TCP/IP, TDMA, CDMA, and 3G; and/or (iv) encrypted to ensure privacy or prevent fraud in any of a variety of ways well known in the art.
- a description of a process is likewise a description of a computer- readable medium storing a program for performing the process.
- the computer-readable medium can store (in any appropriate format) those program elements which are appropriate to perform the method.
- an apparatus includes a computer/computing device operable to perform some (but not necessarily all) of the described process.
- a computer-readable medium storing a program or data structure include a computer-readable medium storing a program that, when executed, can cause a processor to perform some (but not necessarily all) of the described process.
- databases are described, it will be understood by one of ordinary skill in the art that (i) alternative database structures to those described may be readily employed, and (ii) other memory structures besides databases may be readily employed. Any illustrations or descriptions of any sample databases presented herein are illustrative arrangements for stored representations of information. Any number of other arrangements may be employed besides those suggested by, e.g., tables illustrated in drawings or elsewhere. Similarly, any illustrated entries of the databases represent exemplary information only; one of ordinary skill in the art will understand that the number and content of the entries can be different from those described herein. Further, despite any depiction of the databases as tables, other formats (including relational databases, object-based models and/or distributed databases) could be used to store and manipulate the data types described herein. Likewise, object methods or behaviours of a database can be used to implement various processes, such as the described herein. In addition, the databases may, in a known manner, be stored locally or remotely from a device which accesses data in such a database.
- Various embodiments can be configured to work in a network environment including a computer that is in communication (e.g., via a communications network) with one or more devices.
- the computer may communicate with the devices directly or indirectly, via any wired or wireless medium (e.g. the Internet, LAN, WAN or Ethernet, Token Ring, a telephone line, a cable line, a radio channel, an optical communications line, commercial on-line service providers, bulletin board systems, a satellite communications link, a combination of any of the above).
- Each of the devices may themselves comprise computers or other computing devices that are adapted to communicate with the computer. Any number and type of devices may be in communication with the computer.
- a server computer or centralised authority may not be necessary or desirable.
- the present invention may, in an embodiment, be practised on one or more devices without a central authority.
- any functions described herein as performed by the server computer or data described as stored on the server computer may instead be performed by or stored on one or more such devices.
- the process may operate without any user intervention.
- the process includes some human intervention (e.g., a step is performed by or with the assistance of a human).
- a communication device is described that may be used in a communication system, unless the context otherwise requires, and should not be construed to limit the present invention to any particular communication device type.
- a communication device may include, without limitation, a bridge, router, bridge- router (router), switch, node, or other communication device, which may or may not be secure.
- logic blocks e.g., programs, modules, functions, or subroutines
- logic elements may be added, modified, omitted, performed in a different order, or implemented using different logic constructs (e.g., logic gates, looping primitives, conditional logic, and other logic constructs) without changing the overall results or otherwise departing from the true scope of the invention.
- Various embodiments of the invention may be embodied in many different forms, including computer program logic for use with a processor (e.g., a microprocessor, microcontroller, digital signal processor, or general purpose computer and for that matter, any commercial processor may be used to implement the embodiments of the invention either as a single processor, serial or parallel set of processors in the system and, as such, examples of commercial processors include, but are not limited to MercedTM, PentiumTM, Pentium IITM, XeonTM, CeleronTM, Pentium ProTM, EfficeonTM, AthlonTM, AMDTM and the like), programmable logic for use with a programmable logic device (e.g., a Field Programmable Gate Array (FPGA) or other PLD), discrete components, integrated circuitry (e.g., an Application Specific Integrated Circuit (ASIC)), or any other means including any combination thereof.
- a processor e.g., a microprocessor, microcontroller, digital signal processor, or general purpose
- predominantly all of the communication between users and the server is implemented as a set of computer program instructions that is converted into a computer executable form, stored as such in a computer readable medium, and executed by a microprocessor under the control of an operating system.
- Computer program logic implementing all or part of the functionality where described herein may be embodied in various forms, including a source code form, a computer executable form, and various intermediate forms (e.g., forms generated by an assembler, compiler, linker, or locator).
- Source code may include a series of computer program instructions implemented in any of various programming languages (e.g., an object code, an assembly language, or a high-level language such as Fortran, C, C++, JAVA, or HTML.
- the source code may define and use various data structures and communication messages.
- the source code may be in a computer executable form (e.g., via an interpreter), or the source code may be converted (e.g., via a translator, assembler, or compiler) into a computer executable form.
- the computer program may be fixed in any form (e.g., source code form, computer executable form, or an intermediate form) either permanently or transitorily in a tangible storage medium, such as a semiconductor memory device (e.g, a RAM, ROM, PROM, EEPROM, or Flash-Programmable RAM), a magnetic memory device (e.g., a diskette or fixed disk), an optical memory device (e.g., a CD-ROM or DVD-ROM), a PC card (e.g., PCMCIA card), or other memory device.
- a semiconductor memory device e.g, a RAM, ROM, PROM, EEPROM, or Flash-Programmable RAM
- a magnetic memory device e.g., a diskette or fixed disk
- an optical memory device e.g., a CD-ROM or DVD-ROM
- PC card e.g., PCMCIA card
- the computer program may be fixed in any form in a signal that is transmittable to a computer using any of various communication technologies, including, but in no way limited to, analog technologies, digital technologies, optical technologies, wireless technologies (e.g., Bluetooth), networking technologies, and inter-networking technologies.
- the computer program may be distributed in any form as a removable storage medium with accompanying printed or electronic documentation (e.g., shrink wrapped software), preloaded with a computer system (e.g., on system ROM or fixed disk), or distributed from a server or electronic bulletin board over the communication system (e.g., the Internet or World Wide Web).
- Hardware logic including programmable logic for use with a programmable logic device
- implementing all or part of the functionality where described herein may be designed using traditional manual methods, or may be designed, captured, simulated, or documented electronically using various tools, such as Computer Aided Design (CAD), a hardware description language (e.g., VHDL or AHDL), or a PLD programming language (e.g., PALASM, ABEL, or CUPL).
- Hardware logic may also be incorporated into display screens for implementing embodiments of the invention and which may be segmented display screens, analogue display screens, digital display screens, CRTs, LED screens, Plasma screens, liquid crystal diode screen, and the like.
- Programmable logic may be fixed either permanently or transitorily in a tangible storage medium, such as a semiconductor memory device (e.g., a RAM, ROM, PROM, EEPROM, or Flash-Programmable RAM), a magnetic memory device (e.g., a diskette or fixed disk), an optical memory device (e.g., a CD-ROM or DVD-ROM), or other memory device.
- a semiconductor memory device e.g., a RAM, ROM, PROM, EEPROM, or Flash-Programmable RAM
- a magnetic memory device e.g., a diskette or fixed disk
- an optical memory device e.g., a CD-ROM or DVD-ROM
- the programmable logic may be fixed in a signal that is transmittable to a computer using any of various communication technologies, including, but in no way limited to, analog technologies, digital technologies, optical technologies, wireless technologies (e.g., Bluetooth), networking technologies, and internetworking technologies.
- the programmable logic may be distributed as a removable storage medium with accompanying printed or electronic documentation (e.g., shrink wrapped software), preloaded with a computer system (e.g., on system ROM or fixed disk), or distributed from a server or electronic bulletin board over the communication system (e.g., the Internet or World Wide Web).
- a computer system e.g., on system ROM or fixed disk
- a server or electronic bulletin board over the communication system (e.g., the Internet or World Wide Web).
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Computational Linguistics (AREA)
- General Health & Medical Sciences (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Databases & Information Systems (AREA)
- Data Mining & Analysis (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
Description
Claims
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2017249997A AU2017249997A1 (en) | 2016-04-11 | 2017-04-11 | Method and system for machine-assisted cross-platform design synchronisation |
EP17781624.6A EP3443468A4 (en) | 2016-04-11 | 2017-04-11 | Method and system for machine-assisted cross-platform design synchronisation |
US16/092,295 US20200285678A1 (en) | 2016-04-11 | 2017-04-11 | Method and system for machine-assisted cross-platform design synchronisation |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2016901336 | 2016-04-11 | ||
AU2016901336A AU2016901336A0 (en) | 2016-04-11 | Method and System for machine-assisted cross-platform design synchronisation |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2017177257A1 true WO2017177257A1 (en) | 2017-10-19 |
Family
ID=60041268
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/AU2017/000084 WO2017177257A1 (en) | 2016-04-11 | 2017-04-11 | Method and system for machine-assisted cross-platform design synchronisation |
Country Status (4)
Country | Link |
---|---|
US (1) | US20200285678A1 (en) |
EP (1) | EP3443468A4 (en) |
AU (1) | AU2017249997A1 (en) |
WO (1) | WO2017177257A1 (en) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5748974A (en) * | 1994-12-13 | 1998-05-05 | International Business Machines Corporation | Multimodal natural language interface for cross-application tasks |
US6980949B2 (en) * | 2003-03-14 | 2005-12-27 | Sonum Technologies, Inc. | Natural language processor |
US20130006637A1 (en) * | 2005-08-31 | 2013-01-03 | Nuance Communications, Inc. | Hierarchical methods and apparatus for extracting user intent from spoken utterances |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH04137073A (en) * | 1990-09-28 | 1992-05-12 | Toshiba Corp | Design drawing device |
-
2017
- 2017-04-11 EP EP17781624.6A patent/EP3443468A4/en not_active Withdrawn
- 2017-04-11 WO PCT/AU2017/000084 patent/WO2017177257A1/en active Application Filing
- 2017-04-11 AU AU2017249997A patent/AU2017249997A1/en not_active Abandoned
- 2017-04-11 US US16/092,295 patent/US20200285678A1/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5748974A (en) * | 1994-12-13 | 1998-05-05 | International Business Machines Corporation | Multimodal natural language interface for cross-application tasks |
US6980949B2 (en) * | 2003-03-14 | 2005-12-27 | Sonum Technologies, Inc. | Natural language processor |
US20130006637A1 (en) * | 2005-08-31 | 2013-01-03 | Nuance Communications, Inc. | Hierarchical methods and apparatus for extracting user intent from spoken utterances |
Non-Patent Citations (1)
Title |
---|
See also references of EP3443468A4 * |
Also Published As
Publication number | Publication date |
---|---|
EP3443468A4 (en) | 2019-12-04 |
EP3443468A1 (en) | 2019-02-20 |
US20200285678A1 (en) | 2020-09-10 |
AU2017249997A1 (en) | 2018-11-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP3814890B1 (en) | Refinement of machine learning engines for automatically generating component-based user interfaces | |
JP2022168031A (en) | Method and system for generating questionnaire | |
JP2023078363A (en) | Website building system and method for website building system | |
US11210111B2 (en) | Automatic user interface architecture | |
AU2020284731B2 (en) | System and method for integrating user feedback into website building system services | |
US11138022B2 (en) | Dynamic user interface for predicted procedures | |
Yuan et al. | Infocolorizer: Interactive recommendation of color palettes for infographics | |
US10949174B2 (en) | Automatic classification of user interface elements | |
US20200134310A1 (en) | Duplicate User Interface Design Identification | |
JP7373563B2 (en) | Systems and methods for creating and processing configurable applications for website building systems | |
Salah et al. | Combining cultural analytics and networks analysis: Studying a social network site with user-generated content | |
Schetinger et al. | Doom or deliciousness: Challenges and opportunities for visualization in the age of generative models | |
Dekker et al. | Networked Co-Curation: An exploration of the socio-technical specificities of Online Curation | |
WO2020264053A1 (en) | System and method for employing constraint based authoring | |
US9639924B2 (en) | Adding objects to digital photographs | |
Ye et al. | Generative ai for visualization: State of the art and future directions | |
CA3195648A1 (en) | System and method for automatically configuring custom product options based on user actions | |
Offenwanger et al. | Timesplines: Sketch-based authoring of flexible and idiosyncratic timelines | |
US20200285678A1 (en) | Method and system for machine-assisted cross-platform design synchronisation | |
US8234563B1 (en) | Editing of customised documents | |
KR102322786B1 (en) | Method and System for creating and managing the relation based document | |
Cachero et al. | Conference review system: a case of study | |
Banian | Content-Aware AI-Driven Design Assistance Frameworks for Graphic Design Layouts | |
Fischer | End-User Programming of Virtual Assistant Skills and Graphical User Interfaces | |
Nouraei et al. | Thinking Outside the Box: Non-Designer Perspectives and Recommendations for Template-Based Graphic Design Tools |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2017781624 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2017781624 Country of ref document: EP Effective date: 20181112 |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 17781624 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2017249997 Country of ref document: AU Date of ref document: 20170411 Kind code of ref document: A |