TITLE
A video and video management system for navigation through a user interactive system.
The present invention relates to a video and video management system that enables a user to view a video within which are located a number of indices and to select various indices, the video being of such a structure so as to present a generally continuous video when jumping through various parts of the video sequence.
BACKGROUND OF THE INVENTION
A video having a number of frames is known where the video may be played with different frames played at different times and in a different order. However, the view seen by the user is disjointed in that there is no continuity between different frames in a video. As such, use of these types of videos is at best primitive and for they do not lend themselves to the viewing quality expected nowadays.
It is an object of the present invention to provide for a video and a video management system that to the user provides a generally continuous video even when the user may be jumping between separate frames in the video.
Such a video system is particularly appropriate when used in a user interface such as an interactive ordering system found in restaurants and/or hotels. However, the present invention may equally well be applied to other type of user interactive sessions including casino, general service provision over the Internet and so on. The present invention is one of a five co-pending applications describing an interactive ordering system and the development and management thereof, the system having application in environments such as a restaurants, hotels, casinos and so on. For a full description of the system, the reader is referred to these five co-pending applications by the same applicant that relate to different aspects of the system, namely: "A video and video management system for navigation through a user interface system". This aspect of the system enables the user to navigate through a hierarchical menu structure used in providing the user with selectable indicia.
"A user interactive system and method comprising profiles". This aspect of the system provides users with a choice of indicia that may be in a form of graphical images relating to their language and/or customs, whilst remaining transparent to the rest of the operating system.
"An interactive ordering and management system and method". This aspect of the system enables management of user orders and requests and provides information to the system operator.
"A user interface development system and method". This aspect of the system relates to the development of the user interface by subsequent use by users seeking to submit orders and requests. In particular, this aspect provides the ability for relatively low skilled operators to develop and/or modify the visual aspect of a user interface.
"A user interface management system and method". This aspect of the system relates to the management of the user interface development system thus providing relatively highly skilled administrators with the ability to provide low skilled operators with the facilities to develop and/or modify the visual aspect of a user interface.
Thus the present invention relates specifically to "A video and video management system for navigation through a user interface system". The contents of the other four co-pending applications are intended to be incorporated within the present specification by reference thereto.
SUMMARY OF THE INVENTION
Therefore in one form of the invention there is proposed a navigational video having a plurality of sequences, each said sequence having a plurality of frames including beginning, middle and end frames, wherein the frames within the beginning frames are for the same image.
In preference each said sequence has a plurality of frames including beginning, middle and end frames, wherein the frames within the end frames beginning frames are for the same image.
Preferably the beginning frames of one sequence are for the same image as the end frames for another sequence.
Preferably the end frames of one sequence have the same static image as the beginning frames for another sequence.
Preferably each sequence is at least 2 seconds long. However some of the sequence may be longer, such as the sequence played when a person is first shown the interactive system. Preferably each second of video comprises twenty-five frames. This number may also vary.
Preferably three frames define the beginning frames, said three frames being for the same static image. There could however be yet further frames.
Preferably three frames define the end frames, the end frames being for the same static image.
Preferably there is at least one sequence where none of the frames represent the same image. Preferably embedded within the video are selection indicia, said selection indicia allowing a user to navigate from one sequence of the video to another.
In a further form of the invention there is proposed a navigational video for use in a user ordering system wherein said navigational video includes a plurality of selectable indicia represented in video sequences played on a user interface and wherein selection of one of the indicia in a first video sequence by the user plays a pre-determined second sequence of said navigational video such that at least some of the end frames of the first sequence and the beginning frames of the second sequence are for the same image.
One can therefore appreciate that even though one may be "jumping" between sections of a video, due to the use of beginning and end frames the view seen by the user appears continuous rather than disjointed and becomes therefore usable in an interactive type of environment.
In a yet further form of the invention there is proposed a navigational video for use in a user ordering system wherein said navigational video includes a plurality of selectable indicia represented in video sequences played on a user interface and wherein selection of one of the indicia in a first video sequence by the user plays a pre-determined second sequence of said navigational video such that a third sequence is played between said first and second sequence, the images in the third sequence providing a visual continuity between the first and second sequences.
Preferably said second sequence is not a video sequence but a graphical image. Preferably said second sequence is not played until all of the frames of the first sequence have been played.
Preferably selection of a first indicia plays a sequence having a second set of indicia.
Preferably selection of an indicia from the second set displays a graphical image having a third set of indicia.
Preferably selection of an indicia from the third set represents a request from a user to an operator.
The present invention may be used in a number of venues such as hotels, restaurants, casinos and so on. However, in the following description an embodiment is described with reference to a restaurant. Regardless of the application, the operating system (XOS) uses a multi-tier or hierarchical menu structure, there currently being three tiers, to allow customers to navigate through the system. The first two layers are clickable or navigational video and are used purely for navigation to lower menu levels, while the third layer is a cold fusion page, displaying the products that a customer may select. This layer structure is flexible, and may expand or contract at any time without code changes.
The main function of the XOS is to allow customers to order food and beverage products from their table. This is achieved within the 'eat' or 'drink' menus. After ordering food and beverage items from a menu, customers navigate to the submit screen where they are given a chance to remove any products that they no longer desire before sending their order to the waiter who can then review and validate the order before sending it to the kitchen and/or bar area.
Apart from the food and beverage menus, there are additional menus, in this example three, devoted to multimedia content ('Fun', 'XertsTV and 'Shopping'). It is up to the system administrator whether access to these will be charged. Generally, most of this content will be free of charge, however the system does cater for chargeable items, such as music videos. In the case of multimedia products incurring a cost, the price will be automatically added to the customer's bill, and the customer will be unable to leave the screen, which is playing the content until it has finished.
Other objects and advantages will become apparent when taken into consideration with the following drawings and specifications.
BRIEF DESCRIPTION OF THE DRAWINGS
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate several implementations of the invention and, together with the description, serve to explain the advantages and principles of the invention. In the drawings, Figure 1 schematically illustrates the internal frame structure of a vide according to the present invention;
Figure 2 depicts a typical screen shown on the screen at the beginning of the session for an interactive table;
Figure 3 depicts a typical screen snap shot of a fuzz image used in the navigation video when the programme is playing different parts of the video; Figure 4 illustrates the Home page or the first tier menu that the customer uses to navigate through the system;
Figure 5 illustrates the view seen half way through when a customer has selected the Drink menu;
Figure 6 illustrates the second layer or tier, in this case the Drinks menu; Figure 7 is an outline of the screens used in the XOS, indicating the different active areas of the screen;
Figure 8 illustrates the Kids' drinks menu within the Drinks menu, illustrating a milkshake chosen with a choice of four different flavours or condiments; Figure 9 illustrates the second tier or layer for the Eat menu;
Figure 10 is a typical screen displayed to the user if the food and/or drinks order has been transmitted;
Figure 11 is the Shopping screen, being a second level screen, and showing a further six options; Figure 12 is the XertsTV screen, being a second level screen and showing three further options;
Figure 13 is the Fun screen, being a second level screen and showing six further options;
Figure 14 illustrates the profile tab of the Content Management Utility screen; Figure 15 illustrates the screen editor of the profile maintenance section of the
Content Management Utility; and
Figure 16 illustrates the screen editor in relation to a transmit screen.
DESCRIPTION OF THE PREFERRED EMBODIMENT
The following detailed description of the invention refers to the accompanying drawings. Although the description includes exemplary embodiments, other embodiments are possible, and changes may be made to the embodiments described without departing from the spirit and
scope of the invention. Wherever possible, the same reference numbers will be used throughout the drawings and the following description to refer to the same and like parts.
In co-pending application title "A user interactive system and method comprising profiles" there is described a way of allocating to individual user or customer individual profiles, that is, the visual interface that is seen by the user. Generally, these may be static files that are displayed on the screen. However, the present invention provides for a way that the user uses a navigational video to navigate through the various menus or indicia presented to them. Furthermore, the navigation video is so structured so that jumping between pre-determined parts of the video does not appear disjointed but is viewed as generally a continuous video. Thus when the operator has selected a profile this defines the navigation video that will be played by the system to the users at the table and that may present any appropriate graphics for the user to see. Thus the profile enables one to present even a foreign language.
As illustrated in Figure 1 the navigation or clickable video 10 includes of a number of sequences such as sequence 12, each sequence including a number of frames. In the preferred embodiment each sequence has 50 frames, 25 frames representing one second of video.
So as to use the video 10 as navigational video, it is desirable that different sequences by played in a different order. For example, one may wish to play sequence 12 followed by sequence 14. However, if the sequence represents completely different video images, then the user will observe a sudden change or jump in the video that is being played. The whole experience therefore is disjointed.
According to a preferred embodiment of the present invention, a number of initial frames in one sequence are the same as a number of end frames in another sequence and vice versa. That is, a number of end frames in one sequence are the same to a number of beginning frames in another sequence. Not all sequences share common frames, only those that may be accessed form one sequence to another.
As illustrated in Figure 1, sequence 12 has a number of initial frames 16 and end frames 18 whilst sequence 14 has a number of initial frames 18 and end frames 16. So if a user selects sequence 12 to be played followed by sequence 14, because sequence 12 has end frames 18 that are common to beginning frames 18 in sequence 14, the two sequences can be played whilst presenting continuity to a user.
Those skilled in the art will appreciate that a navigation video may be so constructed that those segments of the video that are accessible from other segments have a common end/beginning frames. It is also to be understood that although one may for example play
sequence 14 after sequence 12 the reverse is not necessarily true and it may be that after sequence 14 is played another completely different sequence is played.
Typically three of the twenty-five frames per second at the beginning and end of a sequence are common. This number may be varied. It is also to be understood that a sequence in itself may be used as a bridge between sequences rather than the initial and the end frames.
Such a navigation video has application in a number of venues, such as an interactive restaurant. Thus, when guests in a restaurant have been allocated a table, the host runs the software that the guests will use. Then the guests are welcomed at the table with an initial screen, being part of the navigation video, where they are prompted to start the interactive session. A typical screen 20 is shown in Figure 2. Here one can see a static border 22, a central area 24 that plays the navigation video, a banner 26 that can play an independent video or display a textual image (can be used for advertising etc.), the video controlled by the use of selectable indicia or buttons including Home 28, Help 30, Back 32, Options 34. Once a customer has selected a menu item that is displayed in a Transmit 36 portion of the screen. The frames that enable one to navigate through the video by using common beginning/end frames may include a zoom window or a common screen image 38 such as that shown in Figure 3. The image 38 may be used to provide a visual indication to the users that one is changing from one part of the programme to another. There the frames enabling navigation through the video represent old type screen noise. Typically, the navigation video will play an introductory set of sequences and will finish upon a main menus or screen such as that illustrated in Figure 4. Herein, the user will be presented with a choice of buttons or indicia that they can select. These indicia are within the navigation video and are in addition to the additional buttons such as Home 28 described above.
In a typical restaurant venue there may therefore be a Drink indicia 40, Eat indicia 42. Shop indicia 44, Xerts TV indicia 46 and Fun indicia 48. Selection of any one of these indicia will then lead the user to a second tier or hierarchical menu. To present continuity through the video, the video will zoom into the individual manu represented by the indicia defined above. A partial zoom is illustrated in Figure 5. Thus those skilled in the art will appreciate that the menu as displayed in Figure 4 has at least three end frames that are static, that is, the image does not change. At the same time, if selecting the Drinks menu 40, the initial three frames are also static before the menu zooms in. In this way the user is shown a view that appears continuous. This skilled in the art will also appreciate that if it is only the last three frames of the Main menu men that are static that all the other frames may vary. Thus the background of
the main menu may have interesting features such as the individual little space ships 49 flying therethrough. Of course, this means that if the drinks menu is selected, the second indicia are not displayed until the sequence of the main menu is completely played.
Once the Drinks selection has been made, the user is zoomed to the video shown in Figure 6. Here the user can select from different categories of drinks including Mocktails 60, Cocktails 62, Coffees & Teas 64, Kids' Drinks 66, Shooters 68, Soft Drinks 70, Spirits 72, White wine 74, Red Wine 76 and Beers & Alcoholic Sodas 78. The screen has a volume selection 80 on the right hand side to assist the users in regulating the volume on all sound effects.
Thus the main screen is typically a HTML page with a video embedded in it. Hence the video is played in the frame of the HTML and is a start up video or a navigation video. Thus we have the main navigation video where the user may select from a number of menus. After the programme has been started it usually goes through several entertainment screens until it reaches the main menu from which the guests may choose what they wish to do. The main screen, shown in Figure 2 allows the user to select a number of actions. The screen is in fact divided into a number of discrete parts, seen more clearly in Figure 7 and that was defined earlier, the external buttons represented in the active region 82.
When a user selects indicia from the second tier menu, they are then represented with a page showing yet a further selection. When the user has selected say the Kids drinks indicia 66 they are provided with a typical screen as shown in Figure 8. This is now a static video where there is displayed on the periphery of the screen a number of choices including Milkshake 84,
Chocolate Milk 86, Milk 88, Pineapple juice 90, Apple juice 92, Cranberry juice 94, Orange juice 96 and Smoothie 98. Once a choice is selected, such as Milk Shake in this example, the choice changes in colour or other marking and more information is provided in the center of the menu. That information may be in the form of another graphics, such as the large picture 100 in the centre of Figure 8 or alternatively may even be in the form of a video clip that sponsors the product. With some drinks, such as the Milk shake 84, the user may select the type by the use of condiment buttons for a Caramel flavour 102, Strawberry 104, Chocolate 106 and Vanilla 108. If a user selects the Eat indicia 42 they are zoomed into the screen illustrated in Figure 9 where the user can select meals from categories including Entrees 110, Salads 112 and Main and Grills 114.
Those skilled in the art will appreciate that every choice on the selection video is in fact simply a choice of the co-ordinates of the screen, which the software knows relates to a certain product. Since all the information is therefore graphical rather than textual, different
graphics maybe used that will be exactly the same choice of product. This is the so-called profile discussed in the co-pending applications mentioned above. It means that someone may for example provide a Japanese menu and an English menu, both of which would order the same products but be in completely different languages. Furthermore completely different videos may be used, such as a sports video, or a theme video, whereby the venue may choose different themes and which does not change the products and options available.
The above description relates to the use of the video to order food and or drinks. It is to be understood that the navigation video may equally well be applied to other uses, such as in a hotel environment, gambling environment and any other interactive session where the customer wants to be presented information that appears to have some continuity. It is also important to note that the navigation video may also display a static file after a particular sequence. In such an embodiment, there will typically be a general sequence that is then played to provide for the "continuity" seen by the user.
Typically, the first two layers are clickable video and are used purely for navigation to lower menu levels, while the third layer is a cold fusion page, displaying the products that a customer may select. This layer structure is flexible, and may expand or contract at any time without code changes. In a restaurant, after ordering food and beverage items from a menu, users navigate to the submit screen where they are given a chance to remove any products that they no longer desire before sending their order to the kitchen. For each screen, there are up to three sets of video times (dependant on the menu level) that must be stored. These are described in the table below:
Once a selection has been made by the user, selection of the transmit button 36 sends the order to the operator and plays a sequence 116 to the user advising that the order has been placed, this illustrated in Figure 10. The use of the navigation video thus enables distinct people to use the system. For example the navigation video may include an image 118 and a textual image 120. Since the textual image may be any image including an image representing the same meaning but in a different language those skilled in the art will appreciate the advantage of such a navigational video.
Illustrated in Figure 11 is another typical screen played from the navigation video and that is played when the use has selected the Shop indicia 44. Herein, the user is presented with a further set of selections including Souvenirs 122, Home ware 124, Clothing 126, Gifts 128, Games 130 and Toys 132. Selection of the XertsTV button 46 presents the view as illustrated in Figure 12 wherein the user can select News 134, Events 136 and Facts 138. Selection of the Fun indicia 48 plays a video sequence as illustrated in Figure 13 where the user has a further set of indicia to select form including Games 140, Music 142, Xplorer 144, Toons 146, XoneX 148 and Movies 150.
A screen in the video is usually around ten seconds long, and is broken into two-second intervals, each of which is played separately (except for the introduction and exit sections for each screen, as these must be two seconds long). This means that the system will react to a selection within two seconds. In order to achieve this, the following VBScript global variables are required:
• Next Start - this contains the start time of the section of video to be played once the current section stops. This will be the old 'Next Startl' value.
• Next End - this contains the end time of the section of video be played once the current section stops. This will be the old 'Next Endl' value.
• Next Startl - this contains the start time of the section of video to be played after the segment stored in 'Next Start' and 'Next End' has finished playing. This is calculated to prevent delays.
• Next End - this contains the end time segment of the section of video to be played after the section stored in 'Next Start' and 'Next End' has finished playing. This is calculated to prevent delays.
These variables are updated whenever a button is selected, and whenever the end of a section/segment of video is reached.
A 'playStateChange' event is used in VBScript to determine what to do a section of video reaches the end time. If the video is within a looping screen, a timer interval is set (a timer is used rather than a function as MediaPlayer cannot handle function calls within the 'playStateChange' event). Once a 'ieTimerl_timer' event occurs, the 'Next Start', 'Next End' 'Next Startl' and 'Next Endl' values are recalculated and the next section of the video will start playing.
When a button is clicked, the 'navigate next' function is called. This function gets the video times from the relevant JavaScript object and passes them to a VBScript function called 'gotoTimes', which is used to control the media player. This function takes the following five variables and puts them into the variables in brackets: • StartJjitro - The start time of the section of the video that plays as the customer enters the screen (next Start)
• Endlntro - The end time of the section of video that plays as the customer enters the screen (next End)
• StartMenu - The start time of the screen (next Startl) • EndMenu - The end time of the screen
• PlayCount - This will be zero or one. Zero means that once the video that shows the screen should loop continuously. One means that there is no video content for the screen (i.e. the customer is going to a ColdFusion page), and that once the introduction to the screen has been played the navigation video should stop. Thus in an interactive system each screen is stored separately in the database. A screen may be a separate html page or it may be a segment of video in the navigation video. Each screen contains buttons or indicia. These buttons may be used for navigation purposes in the navigation video or to order products on a menu
The playing of the video may be controlled by the sure of a Content Management Utility screen 152 illustrated in Figure 14. This can be divided up into three"areas as can be seen by three tabs 154, 156 and 158. The first tab 154 relates to profile maintenance and allows one to edit any details required with respect to each individual profile, Figure 22 illustrating the functions available under the profile tab. -
The audiovisual maintenance tab 156 allows one to edit the images and the sounds used by the operating system. The system maintenance tab 158 allows one to edit any system details. For further details of these other functions the reader is referred to the applicant co-pending applications identified above.
Layout of the Profile tab
The Profile tab in the Content management Utility provides a number of options for the operator. It enables the operator to edit all the details for each profile in the XOS or the current operating system. Referring now to Figure 14 a list of all the current profiles is listed
in the Description grid 160 at the left hand side of the window, whilst the details for that profile window are shown to the right.
The operator is presented with three selectable buttons. Edit screens 162 allows one to edit any screens used in the profile, that is, all the screens that make up a XOS. Edit category images 164 allows one to edit the category images for a profile, that is, the images that are shown for each category in the XOS. For example, the bottom left hand side of the XOS in the shopping cart and also the selection screen. The last button Validate Profile 166 allows one to validate a profile.
Editing Screens In the layout of the edit screens window one may edit the screens for a profile including adding, deleting, or changing a screen. The Screen editor is brought up by selecting the edit screens button 162 that brings up the display 168 as shown in Figure 15. On the left hand side there is the grid 170 that lists of all screens available for this profile in the XOS. On the right hand side we see all the details of this particular screen. One is provided with a description 172, a notes field 174 telling one when a profile was created, and whether it was created using a template. One can also enter any other appropriate notes. There is also the type of screen 176, and a home screen field 178. It is important to note that this home screen field will only be available when the screen type is set to home and that only one screen profile may be selected as the home screen. Down below there are items for a video. If the screen has an introduction in the navigation video one needs to enter the introduction times 180. If the screen itself is in the navigation video one needs to enter the times 182 in the video that the screen that it is shown. Finally if the screen has any exit video one needs to enter the times 184 of those as well.
One also has an option to enter the help 186 that will be displayed at the bottom of the XOS for this particular screen and also an incidental screen 188. An Incidental screen appears when the type of screen is menu and is a video that will play after the user clicks the screen a random number of times whilst in the current screen, generally between 5 and 15.
Different main types of screens include the menu, the navigation screen including home, here one can see and also the use of the background image, which is the navigation video. Another common type of screen is the transmit screen, the screen editor shown in Figure 16. Here the background images are made up of all images required to be shown on the selection screen. On can flick through this images using the button 190 at the bottom of the Xerts image display catalogue.
Therefore depending on the type of screen one is working with, one may need to enter introduction, menu or exit times for a particular screen. These times refer to particular segments of the navigation video that one may wish to play. For example, when working with an introduction one may want to enter times of the navigation video that are to be displayed when entering that screen. This is usually two seconds long. If the screen itself is part of the navigation video such as the Home, Eat, Fun, XertsTV and Shopping screen, the times that the video will play when showing that screen will need to be entered. For example, in the Eat screen the particular screen runs from 50 to 70 seconds of the navigation video.
Other changes may be made to the present invention whilst still falling within its scope. Therefore, whereas the above description related to visible profiles the system could equally well be used on audio profiles or shape profiles.
Although the invention has been shown and described in what is conceived to be the most practical and preferred embodiment, it is recognized that departures may be made therefrom within the scope and spirit of the invention, which is not to be limited to the details disclosed herein but is to be accorded the full scope of the claims so as to embrace any and all equivalent devices and apparatus.
Dated this 27th day of August 2001
Xerts International Limited By their Patent Attorneys Lesicar Perrin