KR20150003828A - A method and system of producing an interactive version of a plan or the like - Google Patents

Abstract

The present invention relates to a method of creating an interactive layout of such locations from a layout of optical images of a specific location including a plurality of features of different types, such as cabins and corridors. The method includes the steps of applying a geometric and optical hybrid character recognition (COGCR) process to an optical image to determine a plurality of functional data representative of a plurality of features of different types; Converting a plurality of functional data into a plurality of visual object models; And combining the visual object models to construct an interactive layout for display to an end user.

Description

Field of the Invention [0001] The present invention relates to a method and system for generating an interactive layout.

The present invention relates to a method and system for generating a layout of an active form. The method and system may be used in conjunction with a reservation system or a method related to reservation.

There are layouts in many other situations, but many travel-related environments, such as a cruise reservation application, are provided with a layout. Here, the cruise reservation process will be described as an example, but the scope of the present invention is not limited thereto.

In the age of the Internet, passengers typically search for cruise tours by viewing a specific travel agency or cruise ship's website. Passengers can open another window to access the multimedia website where they can view the deck plan at the time of selection and view the deck layout and cabin photos (sometimes associated cabin layout) .

The end user is not allowed to view available cabin on the image at the same time. Also, the end user can not select a particular cabin, and the user interface does not have interactivity related to views and options.

The above is the most common way of selling a website cruise travel solution. The end user has access to an image that displays several decks of the ship. While this information may be provided in the appropriate section of the shipping website, it can not be accessed during the booking process. Alternatively, the end user may access the scheduling information in a different window or tab. End users have additional access to photos and videos that show the boat, such as viewing a deck layout.

On websites related to "Cruise Products", end users have access to photos of cabins, videos of cabins, tables of cabins. The end user can not access deck layout or reservation related information.

The "croisierenet" and "abcroisiere" websites use a similar approach. End users generally can not see the location of the cabin concerned with the ship.

In the case of a "cruise-direct" web site, the end-user may access the same information previously shown in other prior art examples. However, the end user can display the reservation information in another tab. As with all other prior art examples, the layout of the ship is provided as a non-interactive picture.

The above mentioned websites use roughly the same method. None of these approaches provide interactive functionality and are not connected to the reservation process. As a result, the user can select a cabin layout report, but if the cabin has already been reserved, the cabin will not be available for later use. As a result, the end user becomes embarrassed and may not want to make a reservation, which leads to a loss of revenue for the cruise ship.

In the "cruise.com" solution, designed by TravTech, the end user can view the deck layout and open additional information, such as a photo or room rating, by hovering over the cabin. Deck layout is a still image, and it can not be easily managed even if it changes.

The website "cdfcroisieresdefrance.com" shows images of the boat, not the deck plan. The end user may place the mouse over a specific area of the fold image to display specific information.

US 2002/0099576 (MacDonald et al.) Discloses a method and system for managing a cabin reservation of a cruise ship using an interactive layout on the Internet. The system provides graphical and textual information related to the room. When the end user moves the pointer over the room in the interactive image, a "clickable" image portion appears in the context of the application. Cabin availability is updated regularly. The end user can click on the cabin in the interactive image to book the cabin. The system uses SmartDecks ™ technology to update the display of available and unavailable cabins for interactive images. The application only has a limited range of interactive features and does not provide much information to the customer when considering which cabin the customer will be booking. This application also depends on the manual operation of the manager in detecting the position of the cabin. This application can only handle the cabin by using the deck's bitmap. All other symbols and graphics can not be processed.

As a result, the reservation system only has information on cabin availability, and there is no information on other matters, such as disturbance facilities, connecting cabins, and distance to elevator. From the end-user's point of view, usability is poor as an indication of a static image rather than an interactive display. In addition, search functions other than the availability search are not provided. Also, from a processing perspective, the need to manually enter data is a limitation.

In general, the prior art relates to displaying information about a part or all of a ship. There is a particular prior art document that suggests that additional information may be accessed using a mouse or other pointer to view the details of a particular location. It is not possible for an end user to connect to a conventional system to check availability and then complete the reservation. The prior art only provides one or more layers of information so that the end user can view some of the particular cabin or other portion of the ship.

The present invention has the object of providing a method of creating an interactive layout of this location from a layout of optical images of a specific location including a plurality of features of different types, such as cabins and corridors.

 In addition, the present invention provides a graphical interface that is easy to manipulate for an end user, and a tool for automatically generating such a graphical interface is provided to an administrator of a reservation system. Unlike the conventional static image, all elements constitute an interactive image It also has the purpose of making it possible.

The present invention provides methods and systems as set forth in the appended claims.

According to one aspect of the present invention, a method is provided for creating an interactive layout of a location from an optical image layout of a specific location including a plurality of features of different types, such as cabins and corridors. In this method,

Applying a geometric and optical hybrid character recognition (COGCR) process to an optical image to determine a plurality of functional data representing a plurality of features of different types;

Converting a plurality of functional data into a plurality of object models;

- combining the object models to form an interactive layout for display to the end user.

Optionally, the method includes responding to an end user who interacts with the object model in a layout diagram to display an interactive layout and perform a specific function.

Optionally, the method includes generating different types of functional data for different types of features by applying different COGCR processes to different types of features.

Optionally, the method includes converting each type of functional data into a particular type of object model.

Optionally, the functional data comprises data relating to preferences on the optical image of the layout,

Applying a mask representative of a particular symbol to the surface of the optical image;

Identifying the position of one or more symbols corresponding to the mask on the optical image;

Storing the location of the identified symbols or symbols in the database as part of the functional data.

Optionally, the method includes completing steps for each of the symbols of interest expected to be found on the optical image.

Optionally, the method includes restoring the identified symbol location from the database and creating an associated object model to apply to the interactive layout.

Optionally, the functional data is associated with an entity such as a cabin and a corridor,

- identifying an entity and defining the entity by one or more topology rules;

Finding the location of one or more entities matching the at least one topology rule;

- storing the location of each entity matching the one or more topology rules.

Optionally, the method comprises constructing an object model corresponding to the entity by means of a matched topology rule.

Optionally, the object model includes a detailed shape of the entity, and the method further comprises tokenizing the image into a specific shape element or color element to determine the shape of the entity.

Optionally, the tokenizing step comprises:

- searching for pixels of the same type that are related to the characteristics of the optical image while moving from pixel to pixel;

Analyzing each pixel to determine whether each or some of its surrounding pixels are combined with the pixel to form a particular shape element or hue element;

- constructing a database of shape elements and / or color elements and their locations for future use in an interactive layout.

Optionally, the method includes classifying and identifying a particular object, such as a cabin, for use in an interactive layout.

Optionally, the optical image includes character and numerical indicia,

- applying an optical character recognition process to an image to identify characters and numbers;

- comparing letters and numbers with a list of words and / or numbers on the image to determine whether to match;

- constructing an object model of the matching one for use in an interactive layout.

Optionally, the method includes vectorizing the lines and edges identified in the processing of the image to construct a set of vectors representing the direction and magnitude of the movement from one pixel to another in the identified line or edge do.

Optionally, the method includes applying rules at a particular point in time to control processing of the optical image to construct an interactive layout.

Optionally, the method includes adding an object model from a particular process to lay out the layout of the interactive layout and to configure the optical image representation in an interactive layout display format.

Optionally, the method includes detecting an interactive layout representation and an end user conversation to perform an action based on the interaction.

Optionally, the method may associate the interactive layout with the booking procedure so that the end user can interact with the interactive layout to allow the user to select an entity, e.g., a cabin for the reservation, and if the entity is available, .

Optionally, the method includes using an interactive layout to obtain a direction to the requested location.

According to another aspect of the present invention, a system is provided for creating an interactive layout of a location from an optical image layout of a specific location including a plurality of features of different types, such as cabins and corridors. This system

A geometry and optical character recognition process, applied to an optical image to recognize a number of features of different types, to produce a functional data representation of a plurality of features (hereinafter referred to as functional data);

A processor for converting a plurality of functional data into a plurality of object models;

- a display device for combining the object models to construct an interactive layout displayed to the end user.

Optionally, the interactive layout diagram responds to an end user who interacts with the object model in a layout to perform a particular function.

Optionally, different COGCR processes are applied to different types of features to generate different types of functional data for different types of features.

Optionally, each type of functional data is transformed into a specific type of object model.

Optionally, the functional data includes data relating to symbols on the optical image of the layout, which symbols are recognized by a mask representative of a particular symbol passing over the surface of the optical image, such that one The locations of the above symbols are identified and stored in the database with the relevant locations.

Optionally, each interest symbol is located in an optical image.

Optionally, the identified symbol location generates an associated object model that is applied to the interactive layout.

Optionally, the functional data relates to entities such as cabins and corridors, entities are identified and defined by one or more topology rules, one or more entities matching one or more topology rules are associated with one or more topology rules, ≪ / RTI >

Optionally, an object model corresponding to the entity is constructed.

Optionally, the object model includes a detailed shape of the entity, the shape of which is determined by tokenizing the image into a specific shape element or color element.

Optionally, a particular object is classified and identified as a cabin or the like for use in an interactive layout.

Optionally, the optical image includes alphanumeric display, and the system includes an optical character recognition process that identifies letters and numbers and configures the object model for use in an interactive layout.

Optionally, the lines and edges identified in the processing of the image constitute a set of vectors representing the direction and magnitude of the movement from one pixel to another in the identified line or edge.

Optionally, rules are applied at a particular point in time to control the processing of the optical image to construct an interactive layout.

Optionally, a layout of the interactive layout is drawn, and an object model from the specific process is added to the layout to configure the optical image representation in an interactive layout display format.

Optionally, an interactive layout representation and interaction with the end user is detected, which is used to perform actions based on the conversation.

Optionally, the interactive layout is associated with the booking procedure so that the end user can interact with the interactive layout to allow the entity to select the cabin, e.g., a cabin for reservations, and to complete the reservation if this entity is available.

Optionally, the system includes a mobile device that includes an application that allows an end user to use an interactive layout with an application that obtains directions to a requested location.

The present invention has many advantages. The present invention enables the identification of all kinds of functional objects (cabin, elevator, etc.) that can be seen in the interactive layout. Search results are displayed in a more user-friendly graphic. An opportunity to use new search criteria such as proximity to points of interest, cabin size, and the like. The present invention also provides a ship navigator, cabin finder, and / or 3D layout that can be downloaded to a personal digital assistant (PDA) to obtain directions to a requested location for navigation around the ship. The present invention provides automatic data acquisition from any form of layout and is not limited to marine and cruiser environments.

Other advantages will become apparent from the following detailed description.

The present invention has practical advantages in all cruise applications that use layouts for reservations. The present invention provides a graphical interface that is easy to manipulate for an end user, and provides a tool for automatically creating such a graphical interface to a manager of a reservation system. In addition, the present invention enables new ways of performing cabin search, identification, and booking procedures.

An advantage of this approach is that, unlike conventional static images, which require a significant amount of processing to provide a certain type of dynamic functionality, all elements can constitute an interactive image.

Hereinafter, examples of the present invention will be described with reference to the accompanying drawings.
1 is a block diagram of a data acquisition method according to an embodiment of the present invention.
2 is a schematic diagram showing pixel positions according to an embodiment of the present invention.
3 is a schematic diagram illustrating various steps for creating an interactive deck layout to illustrate a more detailed data acquisition method in accordance with an embodiment of the present invention.
4 is a block diagram of an image composing method and system according to an embodiment of the present invention.
Figures 5 and 6 are illustrations of an interactive deck layout according to an embodiment of the present invention.
Figure 7 illustrates another interactive layout for a hotel village, in accordance with an embodiment of the present invention.

The present invention relates to a method and system for automatically generating an interactive deck plan, in order to improve the user's experience in the booking process. The system uses the reservation system to create an interactive deck layout. The method creates functional data for constructing an interactive deck layout in an available object model. Further, the present invention includes a process of acquiring data for constructing the interactive deck layout and a process of displaying the acquired data.

In this description, the 'plan' is not only related to the display of buildings, ships, aircraft, etc., but also the indication of the geographical position.

The end user can choose to reserve a particular cabin by selecting an image of a particular cabin in the interactive deck layout. The end user can then complete the booking process through the reservation system with reference to the room number of the selected cabin. The room number serves as a link linking the cabin image selected in the interactive deck layout chart to the corresponding room reference (reference) in the reservation system.

By displaying the cabin on the interactive deck layout according to the invention, additional descriptive features or criteria relating to the cabin are additionally provided. This additional descriptive criterion takes into account the cabin environment (eg, cabin exterior environment) on decks. In existing reservation systems, due to the required throughput, there is no room for technically processing these criteria in the reservation procedure. In the present invention, after the end user has more available information about the cabin, he can select the cabin that best matches the desired one. Once you find all the information about the cabin you are interested in, you can book your cabin immediately and directly using the booking system. If there is no available cabin, the graphical interface will prevent the user from selecting that cabin.

Although the present invention relates to a reservation and booking procedure, it may be applied to all other applications that may use the resource allocation diagram in the reservation process or system. The purpose of the Cruise Reservation System is to sell all cabins of a particular cruise. Currently, a travel agency or end-user using a cruise reservation application can not access any interactively manipulable time information related to the ship.

The interactive layout (ship) layout of the present invention is a part executed in the cabin selection step during the reservation procedure. The information is stored as functional data (e.g., in XML format) and can be associated with information from the reservation process to enable bi-directional interaction between the application and the interactive deck layout. By directly adding an interactive layout to the booking procedure, cabin selection is greatly improved.

The present invention allows an administrator to model cruise lines or other objects that can be modeled in a layout diagram as a layout diagram within the framework of the reservation process. The framework can be extended to the modeling of reservable resources including the layout. Other feasible aspects of the process procedure may be provided, for example, the ability to initiate a reservation process upon cabin selection.

The present invention includes two parts.

The first part is a way to automatically calculate the functional data used to construct the interactive layout. In one embodiment of the present invention, this is done by performing geometry and optical geometry and optical character recognition (CGOCR) on existing deck layouts.

The second part is about how to automatically display the data derived from the first part as an enhanced interactive interface.

These two parts can be applied to cruise and other travel application projects, while CGOCR is an interactive representation to be supplied to virtually any application where any kind of reservation system content, or interactive layout, can be usefully used And can be applied to output data.

The first part of the present invention will now be described in detail.

The present invention takes a static layout diagram image and automatically converts it into functional data representing an existing static layout diagram. These functional data may be provided to the end user in the form of an interactive interface. Thus, the present invention uses a data source to construct an interactive deck layout image. The original image data is converted into a usable object model representing all elements and features of the optical deck layout. There are a large number of element or feature categories to be processed in various ways. These will be described below.

Referring first to Figure 1, geometric and optical hybrid character recognition (CGOCR) 100 is shown. The following description will briefly describe various components of the CGOCR and will be described in more detail later. The CGOCR, generally designated 100, includes an image source 102, such as an original optical deck layout or double layout. CGOCR also includes a processing block 104 that includes a tokenizer 106, a noise reduction filter 108, an adaptive flood fill module 110, and a topology A topological analyzer 112 is included. The noise reduction filter is applied to the image to reduce noise in the optical image of the deck layout.

The noise size of the image is derived from the scanning process of the static layout image. The scanning process may include scanning a print of the static deck layout. In this scanning process, at least two noise sources from the input image are added. One noise source comes from the optical system, such as a lens in the original image pickup device, defects in the window glass of the scanner, scratches, unevenness, and unevenness of light.

Other noise sources are due to "lossy" compression of the format used. For example, a JPEG image can be generated as an approximate image by scanning a source bitmap that has already been exposed to the optical noise as described above.

The CGOCR also includes a classifier 114 that performs geometry matching in a shape matching module 116 and includes a primitive builder 118 and a vectorizer 120, . The shape matching module 116 receives a symbol from the database 122 and receives a topology rule from the database 124. At the output of the classifier, a number of digital scenes 126 are created. The digital scenes are stored in the model database 128 used by the application 130. This is described in more detail below.

A typical deck layout would include a layout of decks, each containing a location of various facilities. For example, a deck layout can show cabins, elevators, storage spaces, details and names of these facilities, social places such as restaurants, bars, theaters, and other appropriate environments or facilities.

According to the invention, the purpose is to convert the scanned versions of these decks into usable functional data. To achieve this, it is necessary to define the basic elements or simple elements in the appropriate language (object model) used for the ship. In this manner, symbols and patterns can be applied to deck images to generate functional data that can be used to reconstruct the interactive image. In doing so, the object model is used to transform the image into functional data used to create the graphical interface. As a result, a subsequent operation of the pointer (e.g., clicking on the pointing device) can be handled. The richness of the object model is also used to correct the results of low-level scanners that may be used to identify minimal identifiable primitives or simple elements.

As noted above, the present invention determines a set of functional data for storing, generating, displaying, and manipulating images that may be applied to a cruise reservation procedure. This is accomplished by the use of a model view controller (MVC) pattern that is applied to the deck layout. The data is processed by a display engine to display a layout diagram interactively to a viewer. This will be described in more detail below.

The method of the present invention requires significantly less overhead than using multiple images in the prior art and is easy to maintain in functional data (e.g., in XML format). This is especially so when there is a change in the ship layout. The fact that the ship's deck layout is stored as a group of functional data means that the use of functional data can be made more flexible by being manipulated by a computer program. Further, due to the characteristics of the functional data, more information related to the deck layout can be displayed at the time of changing the magnification, that is, enlarging for detailed display.

The advantage of this approach is that in contrast to the static images of the past, which require a significant amount of processing to provide all forms of dynamic functionality, all elements can form an interactive layout.

In the present invention, JavaScript is used for a logic part, HTML including a Canvas object is used for display, and XML is used for storing functional data. However, it will be appreciated that any other suitable standard or format may be used.

The procedure for identifying functional data may be performed in parallel with a plurality of concurrently executed processes. Or may be performed in series in any particular order.

The first part to identify functional data is to determine the symbols, patterns, features, or elements that are displayed in the base element, for example, the deck layout. This is necessary to generate an available data representation representing some or all of the elements of the deck layout, and is thus required to create an interactive layout.

In the case of a deck layout, many specific processes can be used to create an available set of functional data for constructing an interactive deck layout. These processes will identify the entity that activates the static layout image to be modeled. When constructing functional data, at least the following factors will be analyzed and considered.

The image processing function will identify the lines, points, curves, edges, etc. as the basic elements needed to draw the interactive deck layout. Certain topology rules will be applied when identifying data. The topology rules may be as follows:

The cabin will always be closed.

The cabin will normally be surrounded by superstructures (ie, there can be no "floating cabin" outside the boundaries of the ship).

A cabin will usually include cabin labels that follow a regular order.

The base elements of the low-level icon-type tend to follow a specific distribution (for example, the elevator can always be at the end of the aisle, the emergency stairway can always be in a similar position, In the same position of the deck, etc.). The fact that certain elements follow the basic distribution rules can be used to recognize simple elements within a complex part of the deck layout.

The first feature set to analyze is the symbol on the deck layout. Deck layouts include a number of specific symbols that are typically standardized throughout the cruise industry. However, as will be seen below, several cruise ships may have been modified from the standard. Symbols can be located at various points on the deck layout. A symbol is a specific shape or graphic character, and a definition is required for each specific symbol so that the processor can identify and detect the symbol. The two tables below show a list of specific symbols for two different cruise companies, each of which is intended to illustrate the attributes and related content of each symbol. It will be appreciated that other symbols and related content may be used than are shown below.

Example 1:

가용한 제3 또는 제4 침대

Available third or fourth bed

Available third bed

Disabled Facilities

Connecting stateroom

Room with sofa bed

woman's restroom

Men's room

Available room with sofa bed and 3rd Pullman bed

Example 2:

가용한 제3 또는 제4 침대

Available third or fourth bed

Available third bed

Upper fold-out bed 2 extra beds

Disabled Facilities

Sofa bed

Connecting stateroom

Double Sofa Bed

Family Room (6 persons or less)

woman's restroom

Men's room

Upper fold-out bed

Double bed

Each basic symbol can be called a pictogram or a pictogram. To identify and detect symbols on the original deck layout, the image of the deck layout is processed as follows. There is a mask for each of the known symbols for a particular cruise ship. For each symbol, apply a mask to the plot and raster scan over the surface of the plot to identify each occurrence of the desired symbol. Identify and store each occurrence coordinate of a particular symbol. This process is repeated for each symbol until the position of all relevant symbols appears in detail, and their coordinates are stored.

There may be relevant rules that prevent certain symbols from being associated with a particular zone of the deck layout. These rules are provided in the corresponding database. For example, if the symbol of a sofa bed is in the corridor area, the system will know that this is not possible. As a result, for sofa beds, the symbol of the sofa combination bed will be linked to the cabin recognized as being closest, according to the rule that the symbol must be located in the cabin. The rules increase the use of masks and raster scans in the identification of symbols, thus ensuring that the functional data associated with a particular symbol is not misinterpreted in an unacceptable area according to the rule. The result of the scan includes the coordinates of each symbol stored in the appropriate database along with the relevant description. The stored final result symbol became functional data that can be accessed when creating an interactive deck layout. The symbol used may come from any suitable location or source. Many other types of symbols can be thought of. The symbols for a particular ship are generally identified before the functional data is constructed.

The symbol is a relatively simple detection and identification entity. Deck layouts include significantly more complex entities, and several processes are required to identify these more complex entities.

To identify more complex entities, a process that uses patterns and topology rules is used. The pattern consists of a set of topology rules. For example, cabins are defined by three main topology rules. That is, the cabin is a closed space, the cabin is surrounded by the superstructure of the ship, the cabin label must follow a regular order, and so on. If the number of entities is identified as having the same pattern, it also allows the identification of entities of similar or the same class. An example of a similar entity class is a cabin.

In the deck layout, there may be several entities matching the basic pattern of the cabin. Thus, in order to be able to separate the cabin from other similar structures, a specific object structure corresponding to the cabin is created as follows.

This object structure represents the cabin designated at 1534 and contains the details of the shape, size, or other information in a format that is immediately accessible for introduction into the interactive deck layout. There will be a similar object structure for every other cabin on each deck, again, it will be possible to introduce it into the interactive deck layout.

The attributes of the cabin shape and size are determined by the tokenizer. A torqueizer looks for information related to shapes, lines, edges, and other major shapes (these are called shape elements). Cabins are generally expected to be straight, but there are cabins that take other shapes. However, in the following part of the description of the present invention, it is assumed that the cabin is straight. The image of the deck layout is analyzed by a tokenizer. The torque niner moves from pixel to pixel and finds the same kind of pixels that appear in relation to the features in the deck layout. Each pixel is analyzed to determine whether each or a portion of its neighboring pixels are combined with the pixel to form part of a line or other shape. In this way, for example, each pixel representing a part of a cabin is inspected to identify a shape from one pixel to the next pixel of the same or similar color. Tests for color analysis show similarity, not identity. Even if there is a slight difference in color, it is allowed as long as it is within a certain threshold value.

This will now be described in more detail with reference to FIG. Figure 2 shows a number of identified pixels. The first one identified is the pixel 200. By scanning all the neighboring pixels of the pixel 200, two neighboring pixels are identified. These are the pixel 202 on the right side of the original pixel 200 and the pixel 204 below the original pixel 200. All other pixels surrounding the pixel 200 do not appear to form part of a structure related to a straight line or shape, and no further analysis is performed at this point. Next, by analyzing the closest pixels 202 and 204 to their nearest neighbors, a picture is gradually made into a shape in which two walls forming a cabin appear. At the pixel 206, a T-junction is formed between the upward line of the pixel 208 and the horizontal line of the pixel 210. [ The pixel 200 becomes an edge pixel. Continuing to analyze the nearest neighbors, a detailed structure of the linear elements of the deck layout is constructed. Generally, a structure including four corners connected by lines is regarded as representing a cabin. After a more defined shape, i.e., a square or a rectangle, is determined, a space is defined between the boundary lines of these shapes. The defined space may be "in-filled" using the adaptive flood fill module 110 of FIG. Analyze the overall layout of the deck as described above to identify spaces and areas of linear features, cabins, and possibly the specific shape and size to fill, if possible.

Referring to FIG. 3, the overall creation process will be described in more detail. As mentioned above, the original image 300 of the original deck layout is acquired and filtered. In addition, the cruise ship owner provides the cabin list 302 and symbol type 304 (as described above) they use. The static layout diagram 300 when processed by the tokenizer 360 as described above is shown in detail at 306. The tokenizer object recognizes the color, basic shape, and properties of the features displayed in the original image.

The optical character recognition process is applied to the original image along with the cabin list and symbol type to create a data object 308 containing the symbols and recognizing the cabin numbers of the cabin.

Data object 302 (e.g., cabin list) and OCR object 308 (e.g., label) are processed by a classifier (114 in FIG. 1). The classifier attempts to match the 'OCR object' from the tokenizer to the '302' cabin list to remove false false positive results (ie, fake labels that can be generated as errors). This ensures that only a valid cabin label is used.

The classifier uses a shape matching module (116 in FIG. 1) with a symbol database and a topology rule database. The classifier processes the tokenizer image to identify characteristics related to corridors and other spaces that are not easily classified by the tokenizer into the cabin. This may take into account the specific topology rules stored in the database 124 of FIG. The data objects generated as in 310 of FIG. 3 represent corridors and other spaces that are not readily classifiable.

Through processing by the classifier of the optical character recognition object 308, a detailed representation of sign and cabin number is generated. The result of the optical character recognition data display generated by the classifier is shown at 312 in FIG. In addition, access to cabin lists and symbol types supports the process of creating data objects 312. The results of the OCR recognition process can be cross checked with the rules (i.e., the cabin numbers should generally be sorted in order, the cabin numbers must follow certain regular indications, and / .

At the end of the data acquisition step, a functional representation of the intermediate state of all deckplotter images processed by the tokenizer, the optical character recognition process, and the classifier is made.

The results of tokenizing and classifying the images performed by the tokenizer and classifier are related to the location of each identified pixel. In the subsequent steps performed by the vectorizer 314, the pixels and lines identified in the data representations 306 and 310 are transformed into a vector of points and from one point to another. This image is shown as 314. In other words, the shape features are displayed as coordinates. The image in the vectorizer appears as a number of points, one of which is shown at 316. It is not clear here whether or not the lines in which the dots are present are consecutive. This is due to deviations in the process. However, since the lines appear to be continuous, the points are ignored and the lines are considered continuous. The vectorizer represents the boundary pixel of the shape. As a result of the approximate representation of 310, by adding more vector segments to the shape descriptor, the original curve can be used instead.

If the classification fails, the vectorizer can continue to output valid boundary pixels, and the vectorizer can be used to close the open vector shape. This step is called topology closure.

The vectorized representation 314 and the classified optical character recognition representation 312 are combined to produce the functional data 318 to produce the final functional data of the deck layout. A more detailed representation of the functional data 318 will be described later with reference to Figures 5 and 6 in this detailed description. The digital scene 318 represents the cabin and its number from the optical character recognition display and not all cabin-free information except for specific information of interest to the prospective passenger (e.g., elevator location, etc.).

The following example shows some information about the format and type of functional data (in this case, the XML file structure) related to ship information.

The legend is displayed as follows.

The legend is used in the cabin while searching for information about the amenities represented by symbols on the layout. Here they are identified in the listed amenities, which may include extra beds, toilets, disabled facilities, and connected rooms. The connecting rooms are indicated by double arrows, and the double arrows are the attributes of the two cabins. Based on the number and / or location of two cabins, they may appear to be connected, but this is not always the case. However, when using the present invention, there is no possibility of confusion, as the two cabin properties will clearly identify the cabin by double arrows, even if the two cabin numbers do not have consecutive numbers or appear to be remote.

The category (category) is defined as follows.

The category information is retrieved by the display engine while the cabin is drawn. Graphically, each cabin category has a specific color, but also has other attributes, such as a private veranda, special amenities, and so on.

The deck is displayed as follows.

The layout is used as the background image of the deck layout. The layout of the deck layout can be considered as a line and thus can be stored as data in the form of functional datasets when necessary.

In an example with two types of cabins, a rectangular cabin and a polygonal cabin, the two cabins would be marked differently as follows:

A rectangular cabin has five properties - the name, shape (rectangle), length and width (in pixels), and the location of the top left corner (from the top left corner of the deck layout) in pixels. Special amenities provided in the cabin are listed in the cabin 's child attributes.

A polygonal cabin has fewer attributes, as follows: the coordinates (in pixels) of the shape (polygon), the counterclockwise direction (from the upper left corner of the layout), and its category.

It will be apparent that the foregoing is illustrative and that there are many other functional indicia in various situations and environments. In other applications, there will be various types of features to be considered and as a result there will be further functional indications. The various functional data will depend upon the particular application in which the present invention is used.

As indicated above, the functional data of the present invention is represented in XML. XML is a JavaScript program that translates a logical object model into a visual object for display to the end user, such as a cabin or other image.

Functional data can be represented as a canvas element as follows:

The canvas element is an HTML5 element that allows the programmer to create an individual image. Canvas elements can be used to display and modify images using JavaScript (JavaScript). For example, the w3c website (http://dev.w3.org/html5/canvas-api/canvas-2d-api.html) or the Mozilla Developer Network training (https://developer.mozilla.org/en/canvastutorial ). The HTML5 canvas is one possible implementation of the present invention. Alternatively, other vector viewers (e.g., Flash, etc.) may be used.

The system also includes a display engine, which is also a JavaScript file that uploads XML and parses it into a date object model (DOM) object. The display engine 400 loads data from the cruise operator to identify which cabin is available (402 in FIG. 4). Thereafter, the display engine draws the layout of the deck, in which all cabins of a particular deck are drawn and all available cabins are highlighted. The amenities are then plotted as symbols and a picture of the cabin of a particular category and its layout can be displayed in the frame.

The display engine 400 of FIG. 4 will now be described in more detail. The display engine includes a symbol maker 404 that has access to a layout 406 and display rules 408. [ The display engine also includes a scene composer 410. The display engine receives functional data in the functional data module 412, which is derived through CGOCR processing. The symbol maker and the scene composer are functionally connected, and an object model corresponding to the symbol is created. The display engine also communicates information related to availability 416 and potentially with a cruise reservation procedure 414 that provides information related to additional promotional offers 418. [ The display engine combines the essential elements, such as those described above, and outputs it to the end user via the viewer 420.

The result is an interactive image that represents the deck and emphasizes the available cabin in a particular way. The interactive image representing the deck can be used by the end user to determine information about the deck, including availability of the cabin. When the end user's mouse or pointer points to the canvas element of the interactive image, the algorithm compares the location of the cabin with the position of the cabin on the interactive deck layout image. When the mouse points to the cabin, the cabin is highlighted. Information about the cabin (e.g., category, etc.) is displayed and the availability of the cabin is displayed in a predetermined manner (e.g., the cabin can be decorated with a particular color to indicate that it is reserved). The end user can then click on the mouse to select the cabin. As a result, this cabin is reserved to the end user. Subsequent functions, such as input of passenger detail information, payment, etc., can then be performed.

Figures 5 and 6 illustrate a representative example of an interactive image of a portion of the deck layout generated by the present invention. In Fig. 5, the pointer points to the available cabin and more information will be available or made available by the subsequent operation of the pointer (i.e., mouse click near the cabin). In FIG. 6, the mouse (indicated by hand 600) points to an unavailable cabin. The end user then moves to select another available cabin. Since the end user can immediately see that the cabin is not available, he does not waste time identifying the characteristics of the cabin originally selected.

Based on the above-described system and the above method, an interactive deck layout can be generated in detail, and the entire ship can be processed within one hour.

Conventionally, the reservation procedure is performed by first selecting the region, date, and one or more cruise ship owners. You can then choose a ship with fare and cabin rating. Here, a selectable limited number of cabin lists are generated. Using the present invention, the end user can navigate the deck layout after once selecting a ship, and before entering the additional information, the available cabin can be selected based on various criteria. The various criteria used to select a cabin include the location in the ship, cabin rating, cabin layout, cabin size, fares, availability of amenities and facilities such as disabled facilities, folding beds, connecting rooms, Proximity, group reservation conditions, and the like. That is, the end user may go straight to the interactive deck layout and select the cabin, and then proceed with additional actions for booking (e.g., user identification, billing, etc.). Also, because the cabin is an object, the end user can request a search of the deck layout by confining it to a cabin with certain amenities (e.g., disabled facilities, etc.).

As mentioned earlier, interactive layout images can also be created in other applications such as restaurants, hotels, trains, and even airplanes.

Figure 7 shows an example arrangement of a hotel village with a number of villages located at different locations in a particular area. There is illustrated an original layout 700 of a hotel in a national park and elements 702 and 704 associated with the interactive image created by the method according to the invention next thereto. In a manner analogous to that described above, the end user may select a room in the interactive image or view other parts of the hotel.

The interactive deck layout gives a great advantage to both cruise ship owners and passengers when booking onboard vacation.

Once the interactive deck layout is created, an application can be developed based on it. Further, when the deck layout is changed, a new interactive deck layout can be configured easily and quickly.

Interactive deck layouts are available on many resources, such as computer screens, smart phones, or other personal electronic interfaces. In the field of mobile devices such as smart phones and tablets, an application may be included that allows the end user to interact with the interactive deck layout on the go. Also, the end user may use an interactive layout and application in combination to know the direction to the location he requested. Thus, the end user can find a specific place in the ship during the voyage. For example, an end user may request a route from a particular location to a restaurant. The fact that the interactive layout is composed of functional data rather than a simple static image means that the various types of applications that can be used are endless. For example, the end user can identify the golf distance and use an interactive layout to make a reservation for a golf game or lesson.

Those skilled in the art will understand that functional entities and some or all of their processes may be implemented in software, or in one or more software operating modules and / or devices, or combinations thereof. The software may operate on any suitable computer or other machine, and the module may constitute an integral part of the computer or machine. The operation of the present invention provides various processes for transforming many transform operations, for example, changing portions of a still image into interactive objects and then combining them to create a fully interactive layout equivalent to the features for the original layout. The ability for an end user to interact with an interactive layout also results in additional conversion operations in various ways.

The present invention can be extended to all kinds of appropriate situations as described above. The generation of conventional non-interactive images and other interactive images can have a wider range of applications outside the travel sector. According to the present invention, the ability to transform a layout into a series of objects can be used in many different applications, for example hotels, hotels, stadiums, theaters, restaurants, This can be used in all important situations. It will be understood that the invention can be modified in various ways and still fall within the intended scope of the invention.

Claims (16)

A method for generating an interactive layout of a location from a flat and static optical image layout at a specific location including a plurality of different types of features, such as cabins and corridors,
Applying a geometric and optical character recognition process to an optical image to recognize a plurality of features of different types and generating functional data representation of a plurality of features (hereinafter referred to as functional data);
Storing functional data for each recognized feature in a functional data module;
Converting the functional data into a plurality of visual object models;
- combining the visual object models to construct an interactive layout for display to an end user. The method according to claim 1,
Wherein the functional data is stored in an XML format. 3. The method according to claim 1 or 2,
Further comprising the step of displaying an interactive layout and responding to an end user communicating with the visual object model in a layout to perform a specific function. 4. The method according to any one of claims 1 to 3,
Further comprising the step of applying different geometry and optical character recognition processes to different types of features to generate different types of functional data for different types of features. 5. The method of claim 4,
Further comprising converting each type of functional data into a specific type of visual object model. 6. The method according to any one of claims 1 to 5,
Wherein the functional data comprises data relating to a preference on the optical image of the layout,
Applying a mask representative of a particular symbol to the surface of the optical image;
Identifying the position of one or more symbols corresponding to the mask on the optical image;
Storing the location of the identified symbols or symbols in a database as part of the functional data. The method according to claim 6,
Further comprising restoring the identified symbol location from the database and generating an associated visual object model to be applied to the interactive layout diagram. 8. The method according to any one of claims 1 to 7,
The functional data relate to features of cabins and corridors,
Identifying features and defining features by one or more topology rules;
- finding the location of one or more features that match the at least one topology rule;
Storing the location of each feature that matches the one or more topology rules as part of the functional data. 9. The method of claim 8,
And constructing a visual object model corresponding to the feature according to a matching topology rule. 10. The method of claim 9,
Wherein the visual object model includes details of a feature, the method further comprising: tokenizing the image into a specific shape element or color element to determine a shape of the feature. 11. The method of claim 10, wherein determining the shape of the feature by tokenizing comprises:
- searching for pixels of the same type that are related to the characteristics of the optical image while moving from pixel to pixel;
Analyzing each pixel to determine whether each or some of its surrounding pixels are combined with the pixel to form a particular shape element or hue element;
- constructing a database of shape elements and / or color elements and their locations for future use in an interactive layout. 12. The method according to any one of claims 1 to 11,
Wherein the optical image comprises a feature including a letter and a number indication,
- applying an optical character recognition process to the image to identify characters and numbers;
Comparing letters and numbers with words and / or number lists on the image to determine whether they are matched;
- constructing a visual object model of the matched, for use in an interactive layout diagram. 13. The method according to any one of claims 1 to 12,
Further comprising the step of adding a visual object model from a specific process to lay out the layout of the interactive layout and to configure the optical image representation into an interactive layout display form. 14. The method according to any one of claims 1 to 13,
Associating the interactive layout with the booking procedure so that in the interactive layout the end user is able to talk and select a reservable entity such as a cabin for reservations and complete the reservation if this entity is available, How to create an interactive layout chart. 17. A computer program comprising instructions for executing the steps of the method according to any one of claims 1 to 14, executed in a computer system. A system for creating an interactive layout of a location from a flat, static, optical image layout at a specific location that includes a plurality of features of different types, such as cabins and corridors,
A geometry and optical character recognition process, applied to an optical image to recognize a number of features of different types, to produce a functional data representation of a plurality of features (hereinafter referred to as functional data);
A processor that combines visual object models to transform functional data into a plurality of visual object models and construct an interactive layout;
- a display device for displaying an interactive layout diagram to an end user.

Images