WO2017193105A1 - Programme d'application à base de langage naturel pour saisir, stocker, récupérer, valider et traiter des données de chaînes structurées - Google Patents

Programme d'application à base de langage naturel pour saisir, stocker, récupérer, valider et traiter des données de chaînes structurées Download PDF

Info

Publication number
WO2017193105A1
WO2017193105A1 PCT/US2017/031455 US2017031455W WO2017193105A1 WO 2017193105 A1 WO2017193105 A1 WO 2017193105A1 US 2017031455 W US2017031455 W US 2017031455W WO 2017193105 A1 WO2017193105 A1 WO 2017193105A1
Authority
WO
WIPO (PCT)
Prior art keywords
user
display
program
bookmark
page
Prior art date
Application number
PCT/US2017/031455
Other languages
English (en)
Other versions
WO2017193105A9 (fr
Inventor
Günter MARKSTEINER
Original Assignee
Marksteiner Günter
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Marksteiner Günter filed Critical Marksteiner Günter
Priority to EP17793529.3A priority Critical patent/EP3452926A4/fr
Publication of WO2017193105A1 publication Critical patent/WO2017193105A1/fr
Publication of WO2017193105A9 publication Critical patent/WO2017193105A9/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90—Details of database functions independent of the retrieved data types
    • G06F16/95—Retrieval from the web
    • G06F16/955—Retrieval from the web using information identifiers, e.g. uniform resource locators [URL]
    • G06F16/9562—Bookmark management
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0483—Interaction with page-structured environments, e.g. book metaphor
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/0485—Scrolling or panning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04808—Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen

Definitions

  • the present invention relates generally to the field of programs that process string data, the present program permitting the entry of such a string, recognition of the content of a string, what action its content suggests needs to be taken in relation to the string, execution of said action, bookmarking and titling of the string, displaying of bookmark titles in a field on a touch-sensitive display and the selection, retrieval and opening of bookmarked strings.
  • the present invention relates to a natural language application program for entering, storing, retrieving, validating and processing structured strings of string data such as uniform resource locators for objects on the World Wide Web, for displaying user-defined placeholder attributes for strings on a touch-sensitive display for efficient access to and common grouping of string and rich data rendered from user-entered and hyper-link resources.
  • the present program is a general purpose tool which may be used to process user-entered serial data based on internal or external pattern recognition algorithms, some of which may lead to navigation to one or more objects on the World Wide Web.
  • the present program preferably provides a graphics user interface (GUI) on the touch-sensitive display including sequential data entry means in the form of a lower-leaf mounted keyboard, permitting entry of alpha-numeric string data which may take the form of a uniform resource locator (URL), one function of which is to navigate the World Wide Web and to select and bookmark websites with user created bookmark titles, and to display a field of said titles in a convenient arrangement on one or more pages for ready access to a certain bookmarked string using a touchscreen gesture.
  • GUI graphics user interface
  • URL uniform resource locator
  • This program may be named RAZERCUTTM.
  • What is needed is a program with global capabilities which can recognize a cluster of data such as a string of string data or data field entered into a defined data space, determine from its pattern what needs to be done with it and undertake and successfully complete the needed function.
  • clusters of data include arithmetic expressions, unsolved scientific equations, incomplete sequential data expressions such as a partial Uniform Resource Locators, and a plurality of linked data processing instructions written in formal source code language.
  • iMDS stream data such as PSIP, video closed captioning, matrix metadata
  • mechanical device settings such as a mute switch position, audio level, ambient lighting
  • the present invention accomplishes the above-stated objectives, as well as others, as may be determined by a fair reading and interpretation of the entire specification.
  • the present application program creates a graphics user interface (GUI) suitable for alpha-numeric data entry and storage.
  • GUI graphics user interface
  • data takes the form of a uniform resource locator (URL)
  • URL uniform resource locator
  • the program is compatible with smart tablets and wireless telephonic devices having touch-sensitive displays which respond to mechanical gestures.
  • the present GUI presents: a lower-leaf mounted keyboard for data entry with a defined window for displaying sequentially-entered data; a field for user-specified titles (bookmarks) where each title represents a stored string; a plurality of touch sensitive stored variable areas which enable strings to be stored, retrieved, deleted or modified by the user; and a execute key to initiate navigation to a URL string displayed in the keyboard window, or otherwise to execute or process a non-URL string.
  • the present program displays either the instant website or a data entry GUI in response to a defined mechanical gesture, preferably the 2-finger vertical swipe gesture.
  • the present program otherwise responds to actions and gestures defined by the instant website, except for the reserved mechanical gesture, preferably a sequential double-tap, which enables the user to backup through multiple URL levels, exit a website and return control to the instant program GUI.
  • the present program displays a matrix of thumbnail images comprised of the home page of each website which is currently bookmarked on any given page of its GUI.
  • a defined mechanical gesture such as the 2-finger vertical swipe gesture
  • the present program alternately displays stored bookmarks as a field of user-specified titles.
  • Bookmarks from other pages of the present program can be shifted onto the display using a defined mechanical gesture, preferably the horizontal swipe gesture.
  • the present program may omit the lower-leaf mounted keyboard in certain display orientations on certain devices to enhance readability and improve physical access to the bookmarked titles.
  • Direct navigation to a bookmarked website is launched by a defined gesture, preferably the double-tap gesture, onto either the thumbnail image of the website or onto its bookmarked title. Repeating this gesture returns the user to the program GUI.
  • Bookmarks may be stored on, or moved across, a multiplicity of program pages to organize information.
  • the present program supports internet touch navigation based on graphics or alphanumeric titles.
  • a URL address can also be manually entered into the present keyboard window and navigation executed by touching the execute button on the keyboard.
  • the present program is compatible with interactive multiple data streaming (iMDS) websites. Upon detection of iMDS video at a URL, the present program assigns any stored iMDS bookmark to one or more dedicated screens or pages. The present program displays a
  • a reserved mechanical gesture preferably the double-tap gesture, enables the user to alternately launch and terminate any iMDS video channel. Upon termination, the user is returned to the thumbnail matrix home screen or page of the instant iMDS URL. Where the number of available thumbnails exceeds the display space on one page, the thumbnail matrix may overflow to adjacent pages.
  • a reserved mechanical gesture preferably the horizontal swipe gesture, selects between adjacent pages.
  • Selection between adjacent video channels within a iMDS matrix can be executed using a reserved 2-dimensional gesture, preferably the biaxial swipe gesture.
  • Certain iMDS websites offer special features such as transparent pulldown overlays, navigable pulldown tools, interactive touch-sensitive displays, customizable thumbnail matrices, secure geolocation services, device orientation and motion detection, audio-video data encryption, adaptive video quality, secure data delivery, closed-captioning, etc.
  • the present program supports all iMDS features which are currently offered.
  • Certain technical websites may require entry of strings having special characters, blank spaces, super and subscripted characters, mathematical symbols or equations.
  • the present program's lower-leaf mounted keyboard for data entry can be switched between alphanumeric, symbol and mathematical (Greek) symbols, each providing numerical entry with baseline offset.
  • the reserved 2-finger vertical swipe gesture is the preferred embodiment to pull up or lower the lower-leaf mounted keyboard and drop down and raise the data entry display GUI. Touching the touch-sensitive area 15 on the keyboard marked ⁇ SYMB / MATH / ALPHA > successively changes the active keyboard between keys with symbols, mathematical or alphanumeric characters. Upper and lower case alphanumeric and mathematical characters can be selected by touching the ⁇ SHIFT > key. Touching the top or bottom portion of the ⁇ SHIFT > key generates numerical entries which are super or subscripted relative to the baseline, respectively.
  • the ⁇ (unmarked) > key inserts one or more blank spaces into a string, depending on the number of times it is touched.
  • the non-destructive ⁇ backup CURSOR > key simplifies error correction within a string.
  • the cursor can be manually positioned within any string by directly tapping it over to a new position in the data entry window.
  • the data entry window can be cleared with one stroke using the ⁇ circle X > button.
  • pressing a defined icon symbol on the keyboard representing the execute key preferably named the RAZERCUTTM key, launches navigation to said URL address.
  • touching the execute key causes the program to complete an abbreviated address on the World Wide Web.
  • FIG 1 is a view of a touch-sensitive display 2 in the form of a screen of an electronic device showing the present application program, which may be called RAZERCUTTM, shown installed on the dock of a device 1 exemplified by the Apple iPad mini and is launched by touching its screen icon.
  • RAZERCUTTM the present application program
  • FIG la is a secondary figure corresponding to primary FIG 1, which is the first of a series of secondary figures each having a figure number matching that of its corresponding primary figure but having the suffix "a”, showing same screen image as the primary figure but showing the electronic device surrounding the given screen image in broken lines, and showing any changeable portions of the screen image which can change from one use to the next or from one moment to the next in faded colors relative to the full intensity colors of unchanging areas of the screen image.
  • FIG 2 is a view of a touch-sensitive display 2 showing an illustrative paginated list of user-specified titles bookmarked above a single line data entry window 4 and affixed to a retractable upper-leaf 3 which alternately opens and closes in opposition to a complementary lower-leaf mounted keyboard 5 in response to any 2-finger vertical gesture effected over a keyboard affixed to lower-leaf 5 and where software-defined apportioned areas on each leaf can detect a plurality of finger gestures applied to the touch-sensitive display 2.
  • FIG 2a is a secondary figure corresponding to primary FIG 2.
  • FIG 3 is a view of a device touch-sensitive display 2 in a portrait orientation shown reorganizing the illustrative paginated list of user-specified titles affixed to the retractable upper-leaf 3 to optimally use space on the touch-sensitive display 2 to present bookmarked titles as a single column and, when needed, to display multiline data and script in the data entry window 4.
  • FIG 3a is a secondary figure corresponding to primary FIG 3.
  • FIG 4 is a view of a display 2 in portrait orientation showing a presentation of the illustrative paginated list of bookmarked titles on a compact device 6 exemplified by the Apple iPhone 5S where the physical screen size precludes inclusion of a retractable lower-leaf and keyboard 5 or a data entry window.
  • FIG 4a is a secondary figure corresponding to primary FIG 4.
  • FIG 5 is a view as in FIGURE 4 of the upper-leaf 3 shown fully-retracted in response to a 2-finger vertical swipe gesture to reveal an alternate presentation of the RAZERCUTTM portrait-mode GUI as seen on a compact device 6 where each user-specified title is presented below one element of a matrix of thumbnail images each of a website homepage which is bookmarked by a stored URL string.
  • FIG 5a is a secondary figure corresponding to primary FIG 5.
  • FIG 6 is a view of a device touch-sensitive display 2 showing an illustrative single line of structured string data or data line 7 being sequentially assembled using the manual lower leaf mounted keyboard 5 to form a website URL, with letter "m” completing the ".com” domain suffix followed by execution of the command key 8 to analyze and process the string.
  • FIG 6a is a secondary figure corresponding to primary FIG 6.
  • FIG 7 is a view of a device display 2 showing the completed illustrative website domain name, shown entered on the display line 7 of the data entry window 4, where pressing the command key 8 causes the program to recognize and process the string data as an internet navigation request.
  • FIG 7a is a secondary figure corresponding to primary FIG 7.
  • FIG 8 is a view of a device touch-sensitive display 2 or screen showing gesture control transferred to the illustrative website where page navigation is effected using intuitive gestures applied to the display 2 such as the illustrative 1 -finger vertical swipe-up gesture shown to translate down the page.
  • FIG 8a is a secondary figure corresponding to primary FIG 8.
  • FIG 9 is a view of a display 2 showing the illustrative newspaper page sliding upward in response to the illustrative vertical swipe-up gesture applied to the touch-sensitive display 2 to reveal additional stories and images located further down the page.
  • FIG 9a is a secondary figure corresponding to primary FIG 9.
  • FIG 10 is a view of a display 2 showing momentary finger contact on an illustrative headline revealing it to be an active area 9 on this illustrative webpage, changing color to confirm its selection just prior to automatically renavigating the user to the webpage shown in Figure 11 and linked to the illustrative headline circumscribed by the illustrative active area 9.
  • FIG 10a is a secondary figure corresponding to primary FIG 10.
  • FIG 11 is a view of a display 2 showing the user landing on the illustrative targeted webpage associated with the active area 9 and linked to the chosen illustrative headline depicted in FIG 10.
  • FIG 1 la is a secondary figure corresponding to primary FIG 11.
  • FIG 12 is a view of a display 2 showing the reserved double-tap gesture 10 which, when executed on any inactive area of the touch-sensitive display 2, reverses the instant navigation path and backs up one level to the previous illustrative source URL as shown in Figure 13.
  • FIG 12a is a secondary figure corresponding to primary FIG 12.
  • FIG 13 is a view of a display 2 showing the reserved double-tap gesture 10, which when executed on any inactive area of the touch-sensitive display 2 further backs-up from the homepage of the illustrative website and returns to the RAZERCUTTM graphic GUI shown in Figure 14.
  • FIG 13a is a secondary figure corresponding to primary FIG 13.
  • FIG 14 is a view of a display 2 showing the RAZERCUTTM GUI, which alternates between a linear presentation of bookmarked user-titles shown in Figure 2 and the instant matrix presentation of stored titles, each presented below a thumbnail image of the homepage of its associated bookmarked website or other iconic image in the case of non-URL stored variables, where leaf 3 and leaf 5 are shown here fully retracted to reveal the RAZERCUT graphic GUI.
  • FIG 14a is a secondary figure corresponding to primary FIG 14.
  • FIG 15 is a view of a display 2 showing the reserved 2-finger vertical swipe gesture executed on the touch-sensitive display 2, which alternates the RAZERCUTTM GUI between a linear and a graphic presentation of its paginated stored variables.
  • FIG 15a is a secondary figure corresponding to primary FIG 15.
  • FIG 16 is a view of a display 2 showing the RAZERCUTTM linear GUI following the opposed closure and covering of the touch-sensitive display 2 by the upper-leaf 3 and the lower-leaf mounted keyboard 5 to display an illustrative list of sorted user-titles for variables stored on the instant page above the window 4, where said data entry window is shown empty of string data while exited from a website.
  • FIG 16a is a secondary figure corresponding to primary FIG 16.
  • FIG 17 is a view of a display 2 showing the reserved double-tap gesture 10 when executed on the touch-sensitive area 11 circumscribing the illustrative user-specified title for a stored illustrative extended website URL which retrieves said stored string data to the window 4 and launches navigation to the illustrative website shown in Figure 18.
  • FIG 17a is a secondary figure corresponding to primary FIG 17.
  • FIG 18 is a view of a display 2 showing the user landing on the targeted webpage following a simple double-tap gesture 10 on the user-title of the stored URL string data of the illustrative website.
  • FIG 18a is a secondary figure corresponding to primary FIG 18.
  • FIG 19 is a view of a display 2 showing the reserved double-tap gesture 10 when executed on any non-active area of the illustrative webpage backs-up one level to exit the website and return control to the RAZERCUTTM graphic GUI shown in Figure 20.
  • FIG 19a is a secondary figure corresponding to primary FIG 19.
  • FIG 20 is a view of a display 2 showing the user exiting the illustrative website shown in Figure 19, which is returned to the RAZERCUTTM graphic GUI.
  • FIG 20a is a secondary figure corresponding to primary FIG 20.
  • FIG 21 is a view of a display 2 showing matrices stored on adjacent pages of the
  • FIG 21a is a secondary figure corresponding to primary FIG 21.
  • FIG 22 is a view of a display 2 showing an illustrative adjacent page to the right of the page shown in Figure 21 which is dynamically swept onto the touch-sensitive display 2 in response to a horizontal swipe gesture, partially displacing the previously displayed thumbnail matrix.
  • FIG 22a is a secondary figure corresponding to primary FIG 22.
  • FIG 23 is a view of a display 2 showing the illustrative adjacent page of bookmarked websites which locks in place centered on the touch-sensitive display 2 following the horizontal swipe gesture shown in Figure 22.
  • FIG 23a is a secondary figure corresponding to primary FIG 23.
  • FIG 24 is a view of a display 2 showing the reserved double-tap gesture 10 when executed on the thumbnail image of a stored website launches navigation directly to that website as shown in Figure 25.
  • FIG 24a is a secondary figure corresponding to primary FIG 24.
  • FIG 25 is a view of a display 2 showing the user landing at the targeted website homepage selected in Figure 24 with data entry and gesture control, other than the reserved double-tap gesture 10 which exits the website, transferred to the instant website.
  • FIG 25a is a secondary figure corresponding to primary FIG 25.
  • FIG 26 is a view of a display 2 showing the RAZERCUTTM linear GUI displayed after the opposed closure of leaf 3 and leaf 5 over the touch-sensitive display 2 in response to any 2-finger vertical swipe gesture over the touch-sensitive display 2, and where the data entry window 4 will show the URL of any non-iMDS website still in control of its gestures.
  • FIG 26a is a secondary figure corresponding to primary FIG 26.
  • FIG 27 is a view of a display 2 showing titles and data which are stored on adjacent pages of the RAZERCUTTM GUI, which may be accessed by executing any horizontal swipe gesture across the upper-leaf 3 in opposition to the position of the targeted next page.
  • FIG 27a is a secondary figure corresponding to primary FIG 27.
  • FIG 28 is a view of a display 2 showing the adjacent page of illustrative stored variable titles locked in place and centered on the touch-sensitive display 2 following a horizontal swipe gesture.
  • FIG 28a is a secondary figure corresponding to primary FIG 28.
  • FIG 29 is a view of a display 2 showing touching the active area 12 circumscribing the title of an illustrative extended website URL which retrieves the underlying stored string data to the window 4.
  • FIG 29a is a secondary figure corresponding to primary FIG 29.
  • FIG 30 is a view of a display 2 showing touching of the ⁇ circle - > delete icon 13 which removes the illustrative stored title of the instant string data from the illustrative list of titles displayed above the window 4.
  • FIG 30a is a secondary figure corresponding to primary FIG 30.
  • FIG 31 is a view of a display 2 showing the list of stored titles displayed on leaf 3 re-sorted and net of the title previously associated with the string data displayed in the window 4, as indicated by the vacant list position in the touch sensitive area 12.
  • FIG 31 a is a secondary figure corresponding to primary FIG 31.
  • FIG 32 is a view of a display 2 illustrating the option to resave or retitle the string data displayed in the window 4 which can be effected by touching the ⁇ circle + > add icon in a reserved sensitive area 13 of display 2, however, in this example the reserved 2-finger vertical swipe gesture will be executed to first view an alternate presentation of the reduced list of stored titles by opening the vertically-opposed leafs covering the touch-sensitive display 2 to reveal the RAZERCUTTM graphic GUI.
  • FIG 32a is a secondary figure corresponding to primary FIG 32.
  • FIG 33 is a view of a display 2 upon completion of the reserved 2-finger swipe gesture of Figure 32, the upper and lower leafs 3 and 5, respectively, retract to reveal a matrix of illustrative thumbnail images, net of the illustrative URL deleted in Figure 31.
  • FIG 33a is a secondary figure corresponding to primary FIG 33.
  • FIG 34 is a view of a display 2 showing the 2-finger vertical swipe-up gesture which closes the opposing leaves 3 and 5 and returns display of the string data titles stored on the page using the RAZERCUTTM linear GUI.
  • FIG 34a is a secondary figure corresponding to primary FIG 34.
  • FIG 35 is a view of a display 2 showing the string data deleted in Figure 31 manually re-entered in the window 4, with the ⁇ circle + > add icon in the reserved sensitive area 13 of display 2 appearing in the window 4 upon the first-entered keystroke.
  • FIG 35a is a secondary figure corresponding to primary FIG 35.
  • FIG 36 is a view of a display 2 illustrating that touching the ⁇ circle + > add icon in the reserved touch sensitive areal3 enables the string data shown in the window 4 to be restored under a user-specified title and then added to the instant list of titles displayed on the upper-leaf 3 or otherwise added to another page.
  • FIG 36a is a secondary figure corresponding to primary FIG 36.
  • FIG 37 is a view of a display 2 showing an illustrative creative title for the illustrative string data displayed in Figure 36 being composed in the window 4 with upper-case letters with spaces being the default for readability.
  • FIG 37a is a secondary figure corresponding to primary FIG 37.
  • FIG 38 is a view of a display 2 showing touching of the ⁇ circle + > add icon in reserved touch sensitive area 13 of display 2 which stores the illustrative string data shown in Figure 36 under the illustrative title shown in Figure 37, said title shown circumscribed by its active area 12 and seen to expand the list of sorted bookmarked titles on the instant page.
  • FIG 38a is a secondary figure corresponding to primary FIG 38.
  • FIG 39 is a view of a display 2 showing a stored title(s) on adjacent page of the RAZERCUTTM linear GUI which can be accessed by executing any horizontal swipe gesture across the upper-leaf 3 in opposition to the position of the targeted next page.
  • FIG 39a is a secondary figure corresponding to primary FIG 39.
  • FIG 40 is a view of a display 2 showing an illustrative left-adjacent page displaying the singular stored title of an illustrative iMDS website locked in place and centered on the touch-sensitive display 2 following completion of the horizontal swipe gesture initiated in Figure 39.
  • FIG 40a is a secondary figure corresponding to primary FIG 40.
  • FIG 41 is a view of a display 2 executing the reserved 2-finger vertical swipe gesture on the lower-leaf mounted keyboard 5 switches the RAZERCUTTM GUI from a linear to a graphic presentation of the paginated thumbnail images associated with the illustrative iMDS website first above listed on the upper-leaf 3.
  • FIG 41a is a secondary figure corresponding to primary FIG 41.
  • FIG 42 is a view of a display 2 with RAZERCUTTM leafs 3 and 5 fully retracted following execution of the reserved 2-finger vertical swipe gesture shown in Figure 41, a matrix of titled thumbnail images is revealed, each a live image which tracks the video content of its respective iMDS video channel, and where the displayed matrix elements represent a user-specified subset of all iMDS channels offered by the illustrative iMDS website.
  • FIG 42a is a secondary figure corresponding to primary FIG 42.
  • FIG 43 is a view of a display 2 showing the reserved double-tap gesture 10 when executed on the thumbnail image of a chosen illustrative iMDS channel in the matrix initiates full-screen play of audio, video and ancillary data content of the selected channel as shown in Figure 44.
  • FIG 43a is a secondary figure corresponding to primary FIG 43.
  • FIG 44 is a view of a display 2 showing video and ancillary data fitted to the full-screen resolution and aspect ratio limits of the display 2 in both landscape and portrait orientation of the device 1, with audio play out level complying with its mechanical settings and user-preferences.
  • FIG 44a is a secondary figure corresponding to primary FIG 44.
  • FIG 45 is a view of a display 2 showing the reserved double-tap gesture 10 when executed on the touch-sensitive display 2 while the illustrative iMDS channel is playing full-screen terminates play of audio, video and ancillary data and returns the user to the iMDS homepage matrix shown in Figure 46.
  • FIG 45a is a secondary figure corresponding to primary FIG 45.
  • FIG 46 is a view of a display 2 showing an illustrative matrix of live thumbnail images created across one or more pages by the illustrative iMDS website first above titled.
  • FIG 46a is a secondary figure corresponding to primary FIG 46.
  • FIG 47 is a view of a display 2 showing the application program executing the 2-finger vertical swipe-down gesture over the touch-sensitive display 2 pulls-down the illustrative interactive screen overlay shown in Figure 48 over the instant RAZERCUTTM graphic GUI.
  • FIG 47a is a secondary figure corresponding to primary FIG 47.
  • FIG 48 is a view of a display 2 showing an illustrative interactive screen overlay having a scrollable column of available iMDS channels along one axis and a scrollable program grid for each channel indexed along the remaining axis of the touch-sensitive display 2 the title 14 in the illustrative column comprises one of a plurality of titled matrix elements highlighted by the user for display on the instant page of thumbnail images shown in Figure 46.
  • FIG 48a is a secondary figure corresponding to primary FIG 48.
  • FIG 49 is a view of a display 2 showing the reserved double-tap gesture 10 when executed on an illustrative title in the scrollable column of available iMDS channels which alternatively selects or deselects that channel for subsequent inclusion in the matrix of displayed channels by highlighting or dimming its title within said column.
  • FIG 49a is a secondary figure corresponding to primary FIG 49.
  • FIG 50 is a view of a display 2 showing the application program executing the 2-finger vertical swipe-up gesture over the touch-sensitive display 2 following deselection of the illustrative iMDS in column title 14 which pulls-up the illustrative interactive screen overlay to reveal the modified matrix of thumbnail images shown in Figures 51 and 52.
  • FIG 50a is a secondary figure corresponding to primary FIG 50.
  • FIG 51 is a view of a display 2 following execution of the 2-finger vertical swipe-up gesture over the touch-sensitive display 2, whereupon the overlay shown in Figure 50 retracts to reveal the instant revised matrix of user selected iMDS video channels.
  • FIG 51a is a secondary figure corresponding to primary FIG 51.
  • FIG 52 is a view of a display screen showing illustrative titled and resorted thumbnail images for the instant iMDS website following deletion of the illustrative channel, as delineated on the figure by a representation of the vacant matrix element position shown circumscribed.
  • FIG 52a is a secondary figure corresponding to primary FIG 52.
  • FIG 53 is a view of a display 2 showing iMDS website images stored on a left-adjacent page of the RAZERCUTTM graphic GUI which can be accessed by executing any horizontal swipe gesture across the touch-sensitive display 2 in opposition to the position of the targeted next page.
  • FIG 53a is a secondary figure corresponding to primary FIG 53.
  • FIG 54 is a view of a display 2 showing an adjacent illustrative iMDS website matrix inertially swept onto the touch-sensitive display 2 to displace the iMDS matrix shown in Figure 53, locking centered on the touch-sensitive display 2 following execution of the horizontal swipe gesture initiated in Figure 53.
  • FIG 54a is a secondary figure corresponding to primary FIG 54.
  • FIG 55 is a view of a display 2 showing the reserved double-tap gesture 10 when executed on the thumbnail image of any channel of an iMDS matrix initiating full-screen play of audio, video and ancillary data as shown in Figure 56.
  • FIG 55a is a secondary figure corresponding to primary FIG 55.
  • FIG 56 is a view of a display 2 showing video and ancillary data display of the iMDS channel selected in Figure 55 fitted to the display 2 in both landscape and portrait orientation, said illustrative channel in this instance being the live signal of a local television broadcast station including its embedded program grids, ratings, closed-captioning, emergency messages and audio loudness mitigation metadata.
  • FIG 56a is a secondary figure corresponding to primary FIG 56.
  • FIG 57 is a view of a display 2 showing changing of the illustrative iMDS channel to an adjacent channel in the matrix of thumbnail images, whereupon is effected using a 1 -finger biaxial swipe gesture along the axis and opposed to the position in the matrix of the next-selected channel, the effect of which is shown successively in Figure 58 and Figure 59.
  • FIG 57a is a secondary figure corresponding to primary FIG 57.
  • FIG 58 is a view of a display 2 showing the application program following execution of the 1 -finger left-swipe gesture shown in Figure 57, the illustrative title of the adjacent channel to the right is inertially swept onto touch-sensitive display 2 momentarily landing center-screen before launching the full-screen display of the selected channel as shown in Figure 59.
  • FIG 58a is a secondary figure corresponding to primary FIG 58.
  • FIG 59 is a view of a display 2 showing live audio, video and ancillary data signals from the illustrative local television broadcast station selected in Figure 58 play full-screen a moment after the station's over-the-air channel, FCC call sign and network affiliation are displayed, live audio in this illustrative example being muted and replaced by closed-captioning in response to the audio level setting or to the position of the audio mute switch on the device 1.
  • FIG 59a is a secondary figure corresponding to primary FIG 59.
  • FIG 60 is a view of a display 2 showing changing of the illustrative iMDS channel to the next right-adjacent channel in the matrix of thumbnail images being effected using a 1 -finger biaxial swipe gesture along the axis and opposed to the position in the matrix of the next-selected channel, the effect of which is shown successively in Figure 61 and Figure 62.
  • FIG 60a is a secondary figure corresponding to primary FIG 60.
  • FIG 61 is a view of a display 2 following execution of the 1 -finger left-swipe gesture shown in Figure 60, whereupon the illustrative title of the adjacent channel to the right is inertially swept onto the touch-sensitive display 2, momentarily landing center-screen before launching the full-screen display of the selected channel as shown in Figure 62.
  • FIG 61a is a secondary figure corresponding to primary FIG 61.
  • FIG 62 is a view of a display 2 showing live audio, video and ancillary data signals from the illustrative local television broadcast station selected in Figure 61 playing full-screen a moment after the station's over-the-air channel, FCC call sign and network affiliation are displayed.
  • FIG 62a is a secondary figure corresponding to primary FIG 62.
  • FIG 63 is a view of a display 2 showing the execution of the reserved double-tap gesture 10 on the full-screen playing image of an iMDS channel, terminating play of audio, video and ancillary data content and returning control to the RAZERCUTTM graphic GUI as shown in Figure 64.
  • FIG 63a is a secondary figure corresponding to primary FIG 63.
  • FIG 64 is a view of a display 2 showing the RAZERCUTTM graphic GUI presenting live content from the illustrative iMDS website which in this instance has geolocated the device 1 to be physically within the illustrative Designated Market Area (DMA) first above listed on the touch-sensitive display 2 and including only local television broadcast signals in the matrix which are assigned to the illustrative instant DMA.
  • DMA Designated Market Area
  • FIG 64a is a secondary figure corresponding to primary FIG 64.
  • FIG 65 is a view of a display 2 showing the execution of the 2-finger vertical swipe-down gesture on the illustrative iMDS matrix of thumbnail images pulling-down the illustrative interactive screen overlay shown in Figure 66 over the instant RAZERCUTTM graphic GUI.
  • FIG 65a is a secondary figure corresponding to primary FIG 65.
  • FIG 66 is a view of a display 2 showing an illustrative interactive screen overlay with a scrollable column of available iMDS channels along one axis and a scrollable program grid for each channel indexed along the remaining axis of the touch-sensitive display 2 where the illustrative titles 14 included in the column are determined by the physical geographic location of the device 1 and cannot be modified by the user.
  • FIG 66a is a secondary figure corresponding to primary FIG 66.
  • FIG 67 is a view of a display 2 showing the execution of the reserved double-tap gesture 10 on a selected row within the program grid launching full-screen play of the corresponding iMDS channel as shown in Figure 68.
  • FIG 67a is a secondary figure corresponding to primary FIG 67.
  • FIG 68 is a view of a display 2 showing video and ancillary data display of the iMDS channel selected in Figure 67 fitted to the display 2 in both landscape and portrait orientation, said illustrative channel being the live signal of a local television broadcast station including its embedded program grids, ratings, closed-captioning, emergency messages and audio loudness mitigation metadata.
  • FIG 68a is a secondary figure corresponding to primary FIG 68.
  • FIG 69 is a view of a display 2 showing execution of the 2-finger vertical swipe-down gesture on the touch-sensitive display 2 while it is playing an iMDS channel full-screen, pulling-down the semi-transparent informational overlay shown in Figure 70.
  • FIG 69a is a secondary figure corresponding to primary FIG 69.
  • FIG 70 is a view of a display 2 following execution of the 2-finger vertical swipe-down gesture shown in Figure 69 over a playing iMDS channel, a semi-transparent overlay covers the active video area of the touch-sensitive display 2 with illustrative ancillary information related to the instant iMDS program and content provider, program title, scheduled program runtime, the geolocation of the device 1, and other information included within the provider's PSIP digital program stream.
  • FIG 70a is a secondary figure corresponding to primary FIG 70.
  • FIG 71 is a view of a display 2 showing execution of the 2-finger vertical swipe-up gesture on the touch-sensitive display 2 while it is playing an iMDS channel, retracting the
  • FIG 71a is a secondary figure corresponding to primary FIG 71.
  • FIG 72 is a view of a display 2 showing the execution of the reserved double-tap gesture 10 on an iMDS channel while it is playing fullscreen, and terminates play and returns control to the RAZERCUTTM graphic GUI shown in Figure 73.
  • FIG 72a is a secondary figure corresponding to primary FIG 72.
  • FIG 73 is a view of a display 2 showing execution of the 2-finger vertical swipe-up gesture on the RAZERCUTTM graphic GUI closing the vertically-opposed leafs 3 and 5 and displaying the illustrative iMDS website title in linear fashion as shown in Figure 74.
  • FIG 73a is a secondary figure corresponding to primary FIG 73.
  • FIG 74 is a view of a display 2 following execution of the 2-finger vertical swipe-up gesture shown in Figure 73, the RAZERCUTTM linear GUI is enabled and displays the illustrative iMDS title centered on upper-leaf 3, with the lower leaf mounted keyboard 5 shown ready to generate symbolic characters upon finger-contact with the touch-sensitive area 15 marked
  • FIG 74a is a secondary figure corresponding to primary FIG 74.
  • FIG 75 is a view of a display 2 showing one or more side-swipe gestures across the upper-leaf 3, providing access to user variables, bookmarks and executable programs stored across a plurality of RAZERCUTTM pages, the illustrative executable script program shown retrieved and displayed in a window 4 whose height expands or contracts in response to the 2-finger vertical swipe gesture applied to the window 4 which is an example of a multiline script which can be edited by holding the cursor key 16 and pressing the upper area 19 and lower area 17 of the shift key 18 to control y-axis cursor position with the lower leaf mounted keyboard 5 to be ready to generate mathematical (Greek) characters upon finger-contact with the touch-sensitive area 15 marked [MATH] as shown in Figure 76.
  • mathematical (Greek) characters upon finger-contact with the touch-sensitive area 15 marked [MATH] as shown in Figure 76.
  • FIG 75a is a secondary figure corresponding to primary FIG 75.
  • FIG 76 is a view of a display 2 following one or more executions of the side-swipe gesture, the upper-leaf 3 displaying an illustrative page of variable titles which represent rows and columns of a rectangular mathematical matrix, while the window 4 displays an illustrative example of a single line structured string comprised of known physical constants entered by the lower leaf mounted keyboard 5 using the space key 20 to insert blank spaces, the upper area 19 of the shift key 18 to generate superscripted numbers and the lower area 17 of the shift key 18 to generate subscripted numbers.
  • FIG 76a is a secondary figure corresponding to primary FIG 76.
  • FIG 77 is a view of a display 2 upon pressing the RAZERCUTTM command key 8, whereupon the illustrative structured string data shown in Figure 76 is recognized as a linear algebraic expression which can be evaluated to Planck's constant.
  • FIG 77a is a secondary figure corresponding to primary FIG 77.
  • FIG 78 is a flow chart showing the steps executed by the present program and performed by an electronic device which are essential elements of the program for processing an iMDS URL request.
  • a natural language application program which provides a graphics user interface (GUI) on a touch-sensitive display 2 including sequential data entry means in the form of a lower-leaf mounted keyboard 5, permitting entry of alpha-numeric strings 7 which may take the form of a uniform resource locator (URL) to navigate the World Wide Web or which performs or requires other operations, and to select and bookmark such strings 7 with user created bookmark titles, and to display a field of the bookmark titles in a convenient arrangement on a page for ready access of a bookmarked string with a touchscreen gesture.
  • This program may be named RAZERCUTTM.
  • Touch sensitive display 2 use is a key feature of the present invention touch-sensitive display 2.
  • the data entry page preferably includes the keyboard 5 at its lower end, and above the keyboard 5 a data entry window 4 displaying a string 7 entered with the keyboard 5, and above the data entry window 4 the field of stored bookmarks.
  • the keyboard 5 may be omitted from the page so that the field can be large enough to be clearly seen.
  • the touchscreen gestures and the lower-leaf mounted keyboard 5 can be used to add and delete bookmarks from the field.
  • the data entry page can be transformed into a bookmark thumbnail image page by pulling the keyboard 5 off the display 2 with a touchscreen gesture.
  • the data entry window 4 vanishes, the bookmarks field expands to fill the display 2 and each bookmark transforms into a thumbnail image of the home page of the corresponding bookmarked website, so that a field of identically arranged thumbnail images appears, with a user assigned title of each website below each thumbnail image.
  • the overflow from the first bookmark page is placed on a further page or pages as the user may categorize or prioritize them, and the first bookmark page can be pulled off the display 2 with a touchscreen gesture so that the next bookmark page follows the first onto the display 2.
  • a series of bookmark pages may be created and accessed in this way.
  • a bookmarked website can be opened by touching the display 2 over its thumbnail image using a specific touchscreen gesture, and the website can be closed by repeating the touchscreen gesture, so that the field of thumbnail images on the given page once again appears.
  • the page preferably has a pull down overlay for displaying data over images on the given page.
  • the present program is capable of, among many other things, functioning as a subservient browser, meaning that when it functions as a browser it defers to the operational rules of the website accessed. Where the string 7 is not a website, it nevertheless also can be stored in the bookmark field, but it does not open or launch. Bookmarked non-URL strings 7 will not cause the program to navigate if executed with the RAZERCUT key.
  • the present program is capable of accessing and navigating multiple data stream websites, two examples of which are as follows:
  • the bookmarks optionally include one for a broadcast channel website containing the full bundle of local broadcast television channels in the user designated market area or "DMA", which are displayed in a field of thumbnail images much like the website thumbnail images. Since all local broadcast channels are provided, this website complies with the All-Channel Receiver Act of 1962, commonly known as the All Channels Act. This is what is termed herein an "iMDS" website, or interactive multiple data stream website, and preferably is given its own entire bookmark page, and it may be named iTUNATM. It is specifically noted that the iTUNA website is not part of the present invention, and is referenced solely as an example of an iMDS website that the present program can access and navigate.
  • these television station thumbnail images are continually changing in a closely timed sequence so that they track, in a series of fixed images, each television station video stream in substantially real time.
  • the electronic device 1 is effectively transformed into a fully-functional broadcast television receiver as that term is defined by the FCC.
  • the iTUNA iMDS website uses the geolocation resources of the present program to determine the physical location of the user so as to display only broadcast television stations which are licensed to said DMA.
  • a thumbnail displaying the live content of each local station is displayed above the station's OTA channel nr, FCC call sign and network affiliation.
  • Another bookmark is for a non-broadcast channel website, which operates in essentially the same way that the broadcast channel website does.
  • This non-broadcast channel website is also an iMDS website and once again preferably has its own entire bookmark page, and includes cable channels and other private channels.
  • This website may be named TUNA VISIONTM.
  • the TUNAVISIONTM website is in fact a part of the present invention, as well as an example of an iMDS that can be accessed and navigated by the present program.
  • the display 2 displays a field of channels as thumbnail images with a user assigned title below each. It never displays television station or broadcast channels.
  • non-broadcast channels may be pay channels while others may be free.
  • These non-broadcast channels once again each appear as a series of thumbnail images from the channel video streams, each of which changes sequentially at fixed intervals to track the given video stream in substantially real time. Any of these thumbnail images can be accessed by touching the display 2 over the image with a particular touchscreen gesture to open and display the video stream of the given channel over the entire display 2, and also to close the channel so that the field of thumbnail images returns.
  • a key difference this website has from the broadcast channel website is that the non-broadcast channels can be added and deleted from those displayed, which is an important benefit of the present invention.
  • the user is not limited to an arbitrary bundle of channels a cable company may choose to provide.
  • the cost of channel access using this website is greatly reduced because the cable company middleman is eliminated, and the provider of the present invention can purchase a great many channels in bulk for economical distribution to viewers.
  • the present program is not limited by the bandwidth constraints of cable or satellite providers, the number of available channels is virtually unlimited, and a channel does not have to have any particular level of popularity to remain accessible.
  • each thumbnail is a channel title, such as GUN TVTM, HISTORY CHANNELTM, NAT GEOTM or FOX NEWSTM.
  • the non-broadcast channel website detects the time zone in which the user is located and determines what language is spoken there and initially gives the user content which is relevant to his area. Then the user is free to add and delete channels as desired so that only the favorite channels of the given user are displayed.
  • a pull down overlay can display a program schedule for the non-broadcast channel website as a grid, including channels along a left column and program times across the top, and within the grid programs on those channels and at those times.
  • a preferably opaque channel selection overlay is pulled down over the thumbnail image page, and displays a column of channel names available through the website along its left side.
  • the channel name is tapped once to highlight it, and to unselect a channel, its channel name is tapped once to un-highlight it. Only highlighted channels are displayed on the thumbnail image screen.
  • the channel selection page is pushed back up and out of the screen.
  • Interactive touch gestures used to operate the present program preferably include mechanical double touch gestures to prevent unintended command entry with a single touch.
  • One preferred gesture is a simultaneous two digit touching of the touch-sensitive display 2 and dragging with two digits up or down on the display 2. This simultaneous two digit gesture preferably is used to pull down and then pull back up a thumbnail image in a matrix or a transparent overlay displaying image data, and also to pull up and then pull back down the otherwise hidden keyboard 5 for sequential data entry.
  • the other preferred double touch gesture is a rapid, sequential double touch, or double tap of the touch-sensitive display 2 directly over a bookmark or its corresponding thumbnail image to open or launch a website or video stream corresponding to the bookmark or thumbnail, which then fills the display 2.
  • the user double taps an inactive area of the display 2.
  • a single touch gesture preferably is used to drag a displayed page horizontally off the display 2 in the direction of digit movement.
  • the user places a single finger at one lateral end of the display 2 and drags the digit, sweeping the finger generally horizontally across the display 2.
  • This gesture not only drags the displayed page off the display 2, but at the same time drags behind it and onto the display 2 another page.
  • the initial page and the one subsequently pulled onto the display 2 may be a field of bookmark titles, a field of thumbnail images, a launched website or a launched channel next to the website or channel in the matrix.
  • the present program supports biaxial gesture navigation between active adjacent video streams within a matrix, rapid start/stop of high definition video streams, closed-captioning, multi-channel audio, ancillary and interactive data services, high-level encryption, multi-level geolocation, adaptive stream control, and quality-of-service (QoS) detection.
  • QoS quality-of-service
  • the lower-leaf mounted keyboard 5 includes rows of keys generally arranged in the order presented on a standard apparatus keyboard.
  • a super- and sub-script function is further provided.
  • the user touches any Greek letter key, for example, and then he or she touches the bottom part of the shift key 18 on right of keyboard 5 once and selects and touches a number key, such as 4.
  • the 4 becomes a subscript.
  • the user hits the space and then another Greek letter key, and touches the top of the shift key 18 and then a number creates a superscript.
  • This is useful for entering mathematical data into a website such as for scientific purposes. These features are helpful on specialized websites.
  • the keyboard 5 has number keys at its lower area such that user fingers can easily reach them, and the data entry window 4 above of keyboard 5.
  • Prior browsers put data entries at the top of the display 2 in very small font size. These prior number displays are difficult to reach without making mistakes.
  • a key feature of the present screen or page is the ability to enter data, and to add it and to take it away with the ⁇ circle + > and ⁇ circle - > emblems in a reserve touch sensitive area 13 of the display 2.
  • bookmarks To launch a bookmarked website, the user selects a website from the bookmark titles displayed in the field, such as FACEBOOKTM, GOOGLETM, EBAYTM or YOUTUBETM, or from the corresponding thumbnail images, and double taps its bookmark title or thumbnail title.
  • the user double taps the display 2 and the grid of bookmark thumbnail images reappears.
  • the bookmarks continue to appear as thumbnails until the user pulls up the lower-leaf mounted keyboard 5, and then the bookmarks transform into a field of bookmark titles assigned by the user.
  • a balance is struck of presenting the maximum number while keeping them large enough to be clearly seen. Taking this approach, the optimum number of bookmarks per page appears to be twelve, arranged in a three line matrix.
  • a user may organize the bookmarks in any convenient way, such as by choosing to have business related bookmarks on one page and personal bookmarks on another page.
  • the user pulls up the lower-leaf mounted keyboard 5, and taps the bookmark to be deleted once so that the bookmark URL appears in the data entry window 4. Then the user taps on the ⁇ circle -> emblem at the left end of the data entry window 4. The URL disappears and the ⁇ circle - > emblem immediately changes to a ⁇ circle + > emblem. Then if the keyboard 5 is pulled down and out of the display 2, the bookmark thumbnail page appears, and the deleted bookmark thumbnail will be missing. If the keyboard 5 is pulled back up into the display 2 again, the deleted bookmark title will be missing from the field of bookmark titles as well. If the ⁇ circle - > key is touched unintentionally, the bookmark can be added back by tapping the ⁇ circle + > key which replaces the ⁇ circle - > key to restore the bookmark. This must be done before pulling the keyboard 5 out of the display 2.
  • bookmarks To add a bookmark the user pulls up the lower-leaf mounted keyboard 5, types in the site address to be bookmarked, and gives it a name such as "google.com” for Google, and then taps the ⁇ circle + > key. More specifically, the user pulls up the lower-leaf mounted keyboard 5 with the two finger vertical swipe gesture. A list of bookmarks stored on the instant page is displayed. The user choses a page where the desired bookmark is to be placed by single finger swiping across the list to move the initial page off the display 2 and pull the adjacent page onto the display 2. The user pulls down the keyboard 5 momentarily to view thumbnail images of the websites currently bookmarked on that page. New bookmarks can be added to any bookmark page not already storing an iMDS bookmark. Empty bookmark pages are automatically created as needed.
  • the user types the new URL string 7 into the keyboard window 4.
  • a ⁇ circle + > icon appears on the line which, when touched, titles and stores the string 7.
  • the user is first prompted to enter a short title for the new bookmark.
  • the new bookmark title appears in the list on the field. Touching any bookmark causes its alphanumeric string to be displayed in the data entry window 4. Pressing the RAZERCUTTM execute key icon navigates the present program to that URL. Non-URL strings 7 cannot launch the program.
  • To delete a bookmark the user touches the bookmark title to display its associated string 7 in the data entry window 4.
  • a ⁇ circle - > icon appears on the line in the data entry window 4.
  • the bookmark deletes from the list if the ⁇ circle - > icon is touched.
  • the user presses the RAZERCUTTM icon key while the URL is still displayed.
  • the present program navigates to that URL.
  • the user brings up the lower-leaf mounted keyboard 5 and presses ⁇ circle + > icon to recreate a new bookmark for the URL.
  • Bookmarks can be easily moved between bookmark pages.
  • the user copies the string data to be moved into the data entry window 4 by touching its bookmark title.
  • the user swipes the list above the keyboard 5 until the desired page is displayed.
  • the user touches the ⁇ circle + > icon and proceeds to create a new bookmark for the string 7 on that page.
  • the user returns to the original page and deletes the old bookmark.
  • the touch-sensitive display 2 includes touch sensitive areas which enable strings 7 to be stored, retrieved, deleted or modified by the user, and the keyboard 5 includes a launch key to initiate navigation to the URL string 7 displayed in the window 4 or to execute or process a non-URL string 7, presenting the lower-leaf mounted keyboard 5 for data entry.
  • the field of bookmarks preferably takes the form of a matrix or grid of bookmark names or thumbnail images in horizontal rows and columns displayed on a page, or on a series of pages if the number is too great for display on a single page.
  • a pull down overlay which can be pulled over the screen or page, over the field of bookmarks or thumbnails, preferably displays additional data about each bookmark or thumbnail directly, over or adjacent to each bookmark, and then the overlay can be moved off the screen or page shown on the display 2.
  • Key inventive features of the present invention include, but are not limited to, the ability to create a string 7 and store the string 7 under a user-generated title, to create a user-generated title, and to retrieve and display the string 7 by touching its user-generated title, the ability to execute a retrieved string 7 by pressing a touch-sensitive execute key, the ability to execute a stored string 7 using the double-tap gesture 10 over the user generated title of said stored string 7, and the ability to recognize a URL string 7 and navigate to its associated URL internet address upon execution.
  • Further key inventive features include the ability to back-up one or more levels from an internet website using reserved screen gesture, the ability to display string 7 titles on one or more pages of the GUI, the ability to display a multiplicity of thumbnail images associated with strings 7 on one or more pages of the GUI, and the ability to select between GUI pages with the horizontal swipe gesture. Additionally, the present program provides the ability to alternate between a display of paginated user-generated string 7 titles with a display of paginated thumbnail images, where each thumbnail image is associated with a string 7, using the two-finger vertical swipe gesture, the ability to recognize an iMDS website and execute its defined screen gestures, and the ability to recognize an iMDS website and decode and display a video stream from a matrix of available streams.
  • the present program further provides the ability to paginate an iMDS URL website address on one or more GUI pages in response to the number of thumbnails in its string matrix.
  • the present program provides the ability of the GUI to detect and report device 1 orientation and geographic location, to detect, extract and display iMDS stream data such as PSIP, video closed captioning and matrix metadata, to detect and respond to mechanical device 1 settings, such as mute switch, audio level set; and the ability of the GUI to detect and prioritize higher-order services, and return to last-used state upon termination of a service interruption.
  • FIGURES 1-2 illustrate the lower-leaf mounted keyboard 5 being moved onto the display 2 upon execution of a touch gesture.
  • FIGURES 2 and 6-8 illustrate the entry and execution of exemplary string data, where the string represents a website showing a newspaper page, and the resulting display of the website.
  • FIGURES 8 and 9 illustrate a newspaper page on a selected website being slid upward to reveal additional stories further down the page.
  • FIGURES 9 and 10 show a website active area 9 in the form of a headline on a newspaper page being selected and changing color upon being touched, and the headline story opened as a result of the selection and touch.
  • FIGURES 13 and 14 illustrate the effect of a double tap gesture 10 on a newspaper page of a selected website, returning the display 2 to the matrix of thumbnail images representing a variety of websites available for selection and access.
  • FIGURES 15 and 16 illustrate the effect of a 2-finger vertical swipe gesture performed on a matrix page of thumbnail images of websites between a bringing up and onto the display 2 the lower leaf mounted keyboard 5 and bringing down and onto the display 2 the upper leaf 3 of bookmark titles.
  • FIGURES 16 and 17 illustrate the effect of a double tap gesture on a stored variable area 11 of the upper leaf 3 on a selected bookmark title to retrieve the stored string to the data entry window 4 and the resulting launch of navigation to the corresponding website and the effect of a double tap gesture 10 on any non-active area of the illustrated webpage, causing a back-up one level to exit the website and return to the matrix of thumbnail images of websites.
  • FIGURES 21-23 illustrate the effect of a horizontal swipe gesture in opposition to the position of a targeted next page of thumbnail images to be displayed and the display of the targeted next page.
  • FIGURES 24-25 illustrate the effect of a double-tap gesture 10 executed on a thumbnail image of a stored website and the resulting launch of navigation to that website.
  • FIGURES 28-31 illustrate the steps to delete a bookmark title from the field of bookmark titles above the keyboard 5 using the ⁇ circle - > icon.
  • FIGURES 32 and 35-38 illustrate the steps to restore the bookmark title deleted in FIGURES 28-31.
  • FIGURES 39 and 40 illustrate the effect of a horizontal swipe gesture on the upper leaf 3 field of bookmark titles to reveal another upper leaf 3 page, in this instance containing the single bookmark title of an iMDS website.
  • FIGURES 40-41 illustrate the effect of pulling down of the lower leaf mounted keyboard 5 using a 2-finger swipe gesture on the keyboard 5 to switch to the matrix of titled thumbnail images corresponding to the matrix of bookmark titles on the initial page.
  • FIGURES 43-46 illustrate the effect of a double-tap gesture 10 on a selected thumbnail image on a page displaying a matrix of thumbnail images, initiating a full-screen play of audio, video and ancillary data content of the selected channel, and the effect of a double-tap gesture 10 on the full-screen display of the channel, returning the display to the iMDS homepage matrix of thumbnail images.
  • FIGURES 47 - 48 illustrate the effect of a 2-finger vertical swipe gesture over a touch-sensitive display of a matrix of thumbnail images of channels to pull down the interactive screen overlay over the matrix of thumbnail images, the overlay having a scrollable column of available iMDS channels.
  • FIGURES 48-52 illustrate the steps of de-selecting a channel by touching the channel name on the column of available iMDS channels shown in FIGURE 48 and the effect of a vertical swipe-up gesture over the touch sensitive display 2 to reveal the modified matrix of thumbnail images.
  • FIGURES 53-54 illustrate the accessing of a display page showing iMDS website images stored on a left adjacent page as a result of executing any horizontal swipe gesture across the display 2.
  • FIGURES 55-56 illustrate the effect of a double-tap gesture 10 executed on a thumbnail image of any channel of an iMDS matrix, initiating a full-screen play of audio, video and auxiliary data.
  • FIGURES 57-59 illustrate changing of an illustrative iMDS channel to an adjacent channel.
  • FIGURES 60-62 illustrate the changing of an illustrated iMDS channel to the next right-adjacent channel in a matrix of thumbnail images effected using a 1 -finger biaxial swipe gesture.
  • FIGURES 63-64 illustrate the execution of the double-tap gesture 10 on a full-screen playing image of an iMDS channel to terminate play, to return to the page containing the matrix of thumbnail images of iMDS channels.
  • FIGURES 65-66 illustrate the execution of the 2-finger vertical swipe-down gesture on a display 2 showing an iMDS matrix of thumbnail images to pull down the interactive screen overlay over the matrix.
  • FIGURES 67-68 illustrate the effect of the double-tap gesture 10 on a selected row of the program grid of the interactive screen overlay to launch full-screen play of the corresponding iMDS channel.
  • FIGURES 69-71 illustrate the pulling down of semi-transparent overlay over a playing iMDS channel as a result of a 2-finger swipe-down gesture on the display to reveal related information and the subsequent retraction of the overlay as a result of a 2-finger vertical swipe-up gesture on the display.
  • FIGURES 72-74 illustrate the closing of the
  • FIGURES 75-76 illustrate the effect of one or more side-swipe gestures across the upper leaf 3 to provide access to user variables, bookmarks and executable programs stored across a plurality of pages
  • FIGURE 77 illustrates the effect of pressing the RazercutTM command key 8, causing recognition of the structured string data shown in FIGURE 76 as a linear algebraic expression which can be evaluated to Planck's constant.
  • the following method may be used. These are among the steps executed by the present program and performed by an electronic device, and are the essential elements of the program for processing an iMDS URL request. They are illustrated in the flow chart of Figure 78. These steps include: receiving the iMDS URL request; determining whether a unique device identifier has been provided; if the unique device identifier has not been provided, execution of the method is terminated; if the unique device identifier has been provided, processing the device location; requesting program details; if the program details are provided, returning program details; if the program details are not provided, requesting the program grid; if the program grid is provided, returning the program grid for the device / location; if the program grid is not provided, determining whether the overlay touch has been submitted; if the overlay touch has been submitted, processing and adjusting current device streams; and returning the stream list for device / location; and if the overlay touch has not been submitted, returning the stream list for device / location.
  • New iMDS URLs are found by visiting web pages which include a unique Javascript function for automatic redirection when the page is visited, or a link on a web page can return a unique Javascript function to redirect to the iMDS when clicked on.
  • a Javascript function embedded in the web page returns the iMDS query URL when called by Razercut.
  • Fetching from the iMDS URL is then done with a unique device identifier, screen dimensions and device location as parameters to the URL.
  • the query returns a listing of all the active streams and their title, stream URL, thumbnail URL, overlay image URL, and flags for visibility and geolocation requirements plus the title of the iMDS website and the ideal refresh rate for the thumbnail matrix. Queries for a new list should be made when either the location has changed, new list of thumbnails is required, or when playing a stream URL in case of redirection or location change.
  • the player When playing a stream, the player should still fetch from the iMDS URL in case the stream URL changes and to report changes in location.
  • the player When an overlay image URL is displayed, any touches detected in that overlay image should be sent back with a new fetch from the iMDS URL.
  • An iMDS player may also query an iMDS URL about the program guide for the iMDS hosted streams, as well as program details about a specific stream hosted on an iMDS. Program grid guide and program details are returned in a text based format.
  • the present program can provide special services to iMDS website operators. These services include geolocation, display motion and orientation, text data and message encryption, interactive touch-sensitive display services, biometric data, point-to-point data security challenges, location-specific services and streaming statistics.
  • the present program operates as a secondary service to higher priority functions such as incoming telephone calls, pre-programmed alerts and text messages. Some of these events may interrupt a video stream. Unless suspended for more than 15 minutes, this program resumes the last-viewed stream automatically. Auto-suspending an unwatched stream conserves internet resources and prevents a time-billed service from accumulating excessive charges in the event a user fails to manually terminate a feed.
  • the present program attempts to resume at the last URL level in use at the time of the priority interrupt.
  • the present program offers access to high data rate websites while relying on wireless data providers for internet access.
  • the performance of cellular LTE and similar radio services can vary significantly.
  • the present program attempts to switch between W-Fi and cellular providers, and may need to degrade incoming streams from time-to-time to preserve program continuity. Rotation of the display 2 to portrait-mode is one means to lower bandwidth requirements.
  • the present program places a high priority on maintaining the audio continuity of a video stream during poor service and may drop the video component at times when a service provider cannot sustain reliable service.

Abstract

L'invention concerne un programme d'application à base de langage naturel fournissant une interface utilisateur graphique sur l'affichage tactile comprenant un moyen de saisie de données séquentielles sous la forme d'un clavier, permettant la saisie de chaînes alphanumériques qui peuvent prendre la forme d'un localisateur uniforme de ressources, dont une fonction est de naviguer sur le Web et de sélectionner, d'attribuer un titre et de sauvegarder comme favoris des sites Web avec des titres créés par l'utilisateur, et d'afficher un champ des titres ou d'images vignettes équivalentes de la page d'accueil de chaque site Web sauvegardé sur une pluralité de pages où chaque chaîne peut être rappelée avec un geste d'écran tactile.
PCT/US2017/031455 2016-05-06 2017-05-05 Programme d'application à base de langage naturel pour saisir, stocker, récupérer, valider et traiter des données de chaînes structurées WO2017193105A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP17793529.3A EP3452926A4 (fr) 2016-05-06 2017-05-05 Programme d'application à base de langage naturel pour saisir, stocker, récupérer, valider et traiter des données de chaînes structurées

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201615148379A 2016-05-06 2016-05-06
US15/148,379 2016-05-06

Publications (2)

Publication Number Publication Date
WO2017193105A1 true WO2017193105A1 (fr) 2017-11-09
WO2017193105A9 WO2017193105A9 (fr) 2018-02-01

Family

ID=60203454

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2017/031455 WO2017193105A1 (fr) 2016-05-06 2017-05-05 Programme d'application à base de langage naturel pour saisir, stocker, récupérer, valider et traiter des données de chaînes structurées

Country Status (2)

Country Link
EP (1) EP3452926A4 (fr)
WO (1) WO2017193105A1 (fr)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040114258A1 (en) * 2002-12-17 2004-06-17 Harris Richard Alexander Device and method for combining dynamic mathematical expressions and other multimedia objects within a document
US20070139382A1 (en) * 2005-12-15 2007-06-21 Microsoft Corporation Smart soft keyboard
US20110302534A1 (en) * 2010-06-08 2011-12-08 Sony Corporation Information processing apparatus, information processing method, and program
US20130080937A1 (en) * 2011-09-27 2013-03-28 Imerj, Llc Browser full screen view
US20140164352A1 (en) * 2012-11-20 2014-06-12 Karl L. Denninghoff Search and navigation to specific document content
US20140208356A1 (en) * 2007-09-26 2014-07-24 At&T Intellectual Property I, L.P. Favorites mosaic
US20140215340A1 (en) * 2013-01-28 2014-07-31 Barnesandnoble.Com Llc Context based gesture delineation for user interaction in eyes-free mode
US20140327629A1 (en) * 2006-09-06 2014-11-06 Apple Inc. Touch Screen Device, Method, and Graphical User Interface for Customizing Display of Content Category Icons
US20150121285A1 (en) * 2013-10-24 2015-04-30 Fleksy, Inc. User interface for text input and virtual keyboard manipulation
US20150177933A1 (en) * 2013-12-19 2015-06-25 Barnesandnoble.Com Llc Visual thumbnail scrubber for digital content

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20040114258A1 (en) * 2002-12-17 2004-06-17 Harris Richard Alexander Device and method for combining dynamic mathematical expressions and other multimedia objects within a document
US20070139382A1 (en) * 2005-12-15 2007-06-21 Microsoft Corporation Smart soft keyboard
US20140327629A1 (en) * 2006-09-06 2014-11-06 Apple Inc. Touch Screen Device, Method, and Graphical User Interface for Customizing Display of Content Category Icons
US20140208356A1 (en) * 2007-09-26 2014-07-24 At&T Intellectual Property I, L.P. Favorites mosaic
US20110302534A1 (en) * 2010-06-08 2011-12-08 Sony Corporation Information processing apparatus, information processing method, and program
US20130080937A1 (en) * 2011-09-27 2013-03-28 Imerj, Llc Browser full screen view
US20140164352A1 (en) * 2012-11-20 2014-06-12 Karl L. Denninghoff Search and navigation to specific document content
US20140215340A1 (en) * 2013-01-28 2014-07-31 Barnesandnoble.Com Llc Context based gesture delineation for user interaction in eyes-free mode
US20150121285A1 (en) * 2013-10-24 2015-04-30 Fleksy, Inc. User interface for text input and virtual keyboard manipulation
US20150177933A1 (en) * 2013-12-19 2015-06-25 Barnesandnoble.Com Llc Visual thumbnail scrubber for digital content

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3452926A4 *

Also Published As

Publication number Publication date
EP3452926A4 (fr) 2020-04-08
WO2017193105A9 (fr) 2018-02-01
EP3452926A1 (fr) 2019-03-13

Similar Documents

Publication Publication Date Title
US11526252B2 (en) Method and apparatus for navigating a hierarchical menu based user interface
JP5703292B2 (ja) 英数字ナビゲーションおよび入力のためのシステムおよび方法
US11157555B2 (en) Methods, systems, and media for searching for video content
TWI516962B (zh) 巡覽一瀏覽器中之複數個內容項目的方法、電腦系統及電腦程式產品
EP1557744B1 (fr) Saisie de données commandée par touches haptiques
US8412278B2 (en) List search method and mobile terminal supporting the same
JP5553987B2 (ja) ユーザインターフェースにおけるスクロールおよびポインティングの方法およびシステム
JP4640822B2 (ja) 入力装置
JP6153868B2 (ja) アイテムをディスプレーする方法及び装置
US9280278B2 (en) Electronic apparatus and method to organize and manipulate information on a graphical user interface via multi-touch gestures
EP1702460B1 (fr) Système et procédé de sélection d'un élément dans une list d'éléments et produit associé
US20030043207A1 (en) Method of scrolling a display window
WO2006096570A2 (fr) Telephone mobile presentant une interface d'utilisateur de type telecommande de television
US10180991B2 (en) Information processing apparatus and information processing method for displaying transition state of web pages
KR101741698B1 (ko) 검색 서비스 제공방법 및 이를 적용한 디스플레이 장치
CN107239528B (zh) 搜索结果显示方法及装置
WO2016107462A1 (fr) Procédé et dispositif d'entrée d'informations, et terminal intelligent
WO2015161354A1 (fr) Saisie de texte à l'aide d'une ligne de caractères à rebond
CN106020614A (zh) 一种应用程序的切换方法及终端
EP3310064B1 (fr) Procédé et dispositif pour éditer des canaux de télévision intelligente et télévision intelligente
CN104219586A (zh) 一种应用于智能电视的输入方法和装置
US20060174295A1 (en) Method of selecting an element from a list by moving a graphics distinction and device implementing the method
JP2012209829A (ja) 番組表示制御装置
WO2017193105A1 (fr) Programme d'application à base de langage naturel pour saisir, stocker, récupérer, valider et traiter des données de chaînes structurées
CN103248957A (zh) 显示方法和电子设备

Legal Events

Date Code Title Description
NENP Non-entry into the national phase

Ref country code: DE

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17793529

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2017793529

Country of ref document: EP

Effective date: 20181206