EP0506842A4

EP0506842A4 - Method and apparatus for storing, transmitting and retrieving graphical and tabular data

Info

Publication number: EP0506842A4
Application number: EP19910902355
Authority: EP
Inventors: A. Martin Rozmanith; Anthony I. Rozmanith; Gabor F. Fulop; Neil Berenson; Egon Stephen Fabian; Ted R. Trilling
Original assignee: Araco Co Ltd
Current assignee: Araco Co Ltd
Priority date: 1989-12-13
Filing date: 1990-12-13
Publication date: 1993-09-01
Also published as: EP0506842A1; AU7157791A; CA2071814A1; WO1991009368A1

Abstract

A method and apparatus for rapid search and co-display of graphics and tabular data for both local (10) and distributed computer systems (20). The method rapidly selects and displays (12) related graphical and text information via a Graphical User Interface (16) (GUI) from both a Graphical Relational Database (GRDB) and large tabular database. An operator enters a query where previously encoded and stored graphics elements are selected, via a control program, from a local mass storage device (22) and displayed (12) with related text information on a local display (12). This method provides intelligent selection and display (12) of graphics data based on an analysis by the system (10) as to what graphics elements or images are required to satisfy the operator query, and how these elements are to be displayed (12) in conjunction with related tabular (text) data.

Description

- 1 -

METHOD AND APPARATUS FOR STORING, TRANSMITTING AND RETRIEVING GRAPHICAL AND TABULAR DATA Related Applications and Claim of Priority This application is a continuation-in-part of U.S. 5 Serial No. 494,115 filed March 14, 1990 which is itself a continuation-in-part of U.S. Serial No. 450,606, filed December 13, 1989, and U.S Serial No. 521,714, filed May 9, 1990, and U.S. Serial No. 544,826 entitled Method and Apparatus for Multi- Optional Processing, Storing, Transmitting and Retrieving 10 Graphical And Tabular Data In A Mobile Transportation Distributable and/or Networ able Communications and/or Data Processing System filed June 27, 1990. This application is further related to a co-pending application entitled VCR Based Presentation Selection System filed December 13, 1990, (no 15 serial number) which is incorporated herein by reference as if set forth herein in full.

Field of the Invention

The present invention is related in general to

20 interactive local and distributed database graphics display and textual information systems. In particular, the present invention is directed to improved methods and apparatus for providing rapid retrieval and display of such information on any given node, within local area networks, and within wide area

25 networks and/or on a linked database engine driven display device. Background of the Invention Existing single user or network systems which utilize a central host or server computer connected via conventional telephone link-up cannot be practically upgraded to provide efficient distributed large volume graphics. The implementation of a practical GRDB (graphical relational database) and a GUI (graphical user interface) on a conventional network, relying on a communication link over existing conventional telephone lines, is presently impractical due to the volume of data and limited data transmission rates. The highest transmission rate currently practical over conventional telephone lines is less than 150,000 bits per second. Under the present most widely distributed modem technology (which transmits at rates of 1200 to 9600 baud over standard telecommunication lines) , approximately two minutes or more is required to transmit a standard 300 dpi (dots per inch) scan of a photograph via standard communication lines. Also, the frequent screen updates required by a GUI based graphical database would strain this type of data transmission. A potential bottleneck is thus created because the graphics data is not stored on-site, but rather must be transmitted via conventional telephone transmission lines from a remote location.

The personal computer market has long had a need for a system incorporating graphical data within a distributed and "on demand" database. A graphically oriented user interface for multi-distributed, interactive local use combined with coordination and distribution provided by an interactive host and/or network system would be a major advancement, and would greatly improve the efficiency of end users by providing them with a considerable advantage over users who do not implement such a system.

The system of the present invention makes feasible both single user and network implementation incorporating a GUI and GRDB in spite of the natural limitations posed by conventional telephone transmission lines. The bulk of the required data (typically twenty megabytes to over one gigabyte of graphics data) , especially, if benefitting from data compression, including pictorial representations (both stationary and animated) and tabular data is stored locally. - 3 -

The present invention provides an improved method and apparatus for the rapid search and co-display of graphics and tabular data for both local and distributed computer systems. The apparatus and method of the present invention rapidly 5 selects and displays related graphical and textual information t: ) via a Graphical User Interface (GUI) from both a Graphical Relational Database (GRDB) and tabular database.

An operator enters a query or option request in which previously encoded and stored graphics elements are selected, 10 via a control program, from a local mass storage device and displayed with related textual information on a local display. The remote host, subsequently or simultaneously, processes the locally generated query. Incremental, additional or updated data at the remote host may then be rapidly accessed and 15 transmitted back from the host to the local user.

The present invention thus effectively creates two linked databases, both of which are necessary, updatable and/or expandable. The database (or the majority of the database) is stored on-site so as to provide instantaneous graphics 20 responsive to the character based tabular data and/or commands which are easy to quickly transmit via conventional communication lines. Additional data or updated data is stored at the remote host and can be rapidly transmitted. The present invention has numerous applications including the dissemination 25 or real estate information, medical image processing and data management, and the dissemination of architectural and business plans.

The present invention is particularly suited to be utilized in a system which incorporates a RVAD (i.e. a raster 30 vector attribute database) based display system in which one of the parameters of the search request is, for example, geographic data. The present invention may further incorporate state of the art optical character recognition (OCR) technology for database entry and system updatability. 35 It is therefore an object of the present invention to provide a system which incorporates a GUI for selecting updatable database options processed simultaneously or sequentially by a local computer and remote host computer.

It is a further object of the present invention to provide a system which incorporates transmitted tabular data in conjunction with a locally stored graphics database.

It is still a further object of the present invention to provide a system which can selectively transmit a database query to a remote host or which can process a command locally to locate data within a locally stored tabular and graphics database.

It is still yet a further object of the present invention to provide a system in which a remote host computer processes a query from a local computer system, transmits a selection command to the local computer, which then selects both tabular and graphical data from its local database responsive to the address command.

It is yet a further object of the present invention to provide a distributed database system which can be utilized in local, wide and regional area networks. It is a further object of the present invention to provide interlinkability and expandability of a local, wide and regional network.

It is a further object of the present invention to provide a distributed database which utilizes an RVAD based database selection format. It is a further object of the present invention to provide a system which utilized symmetric and/or asymmetric loosely coupled multi-processors.

Summary of the Invention The present invention is directed to an improved combination of components for a presentation and selection system used in applications such as real estate documentation, information and selection service, medical image retrieval and manipulation and the selection of medical records. The invention combines computer hardware and software with an additional graphic oriented user interface, and combines - 5 - multiple large tabular and graphic databases and computer hosts and/or servers with a rapid, combined system search and display capability for selected and related data from at least two databases (i.e. one local and one located at the host or 5 server) . Output generated by a query search and display request is displayed on a linked end-user computer such as a personal computer via a graphical user interface.

In accordance with the present invention, apparatus for displaying graphical and tabular data is disclosed. The

10 invention comprises local computer means having CRT (or flat panel) display means and containing at least one application program. The local computer means further contains a control program for facilitating the processing of a database query formulated at the local computer station. The local computer

15 includes a graphical user interface to formulate a database query for processing both at the local end user station and at a remote area center. Communication means including a modem transmit the query to the host computer means for simultaneous or subsequent processing. The host computer means contains a

20 control program which simultaneously processes the query and selects responsive graphical and tabular data. The data transmitted by the host computer may supplement the data identified in the local database.

The host computer means transmits the selected data by 25 the transmission means to the local computer means wherein the data may be displayed on the CRT display means by said graphical

_!«. user interface. A graphical relational database means situated at both the local station and host stores graphical data and transmits graphical data responsive to the query directly to 30 the CRT display means in response to a command from said graphical user interface program..

The present invention further provides a method for controlling the transmission and/or retrieval of tabular and/or graphical data as recited in the following steps: formulating

35 a query relating to a database selection on a local computer; locally processing and/or transmitting said selected query to a remote host computer; selecting graphical and tabular data using local computer and/or host responsive to said query; selecting a graphical presentation from a locally stored graphics database responsive to said query; and displaying said selected graphical and tabular presentation on a display associated with the local computer.

Description of the Drawings Figure 1 is a block diagram representation of the database selection and retrieval apparatus of the present invention.

Figures 2-3 are time sequence charts which illustrate the flow of the control programs of the local user station and area center. Figure 4 is a block diagram illustrating the steps for a database search using an RVAD database.

Figure 5 is a block diagram of the control program for the RVAD of the present invention.

Figure 6 is an illustration of a raster/vector space as actually shown on a CRT display.

Figure 7A illustrates the display of RVAD attributes on a CRT display.

Figure 7B illustrates a map of the state of Georgia from which the RVAD overlay map of Fulton County of Figure 6 was derived.

Figure 7C is an enhanced view of a multitasked RVAD based display system which illustrates interactive maps and tabular windows for the tri-state (Del., N.J. and PA) Philadelphia metropolitan area. Figure 8 is a block diagram of a wide area network in accordance with the present invention linking several counties or an entire region.

Figure 9 is a block diagram of a national network in accordance with the present invention for linking up to four major regions via a public value added communications network. Figure 10 is a block diagram of the national network of Figure 9 incorporating a dedicated private communications network.

Figure 11 illustrates a multiprocessing based system utilized in the present invention.

Figure 12 illustrates the use of the present invention in a global network which can be remotely accessed.

Figure 13A and 13B illustrate typical system-wide data traffic flow and in footnotes discuss related details and/or characteristics.

Figure 14A and 14B illustrate typical system-wide data storage allocation for a single application and in footnotes discuss related characteristics and/or details particularly suited to an updating and transaction oriented environment, such as the described real estate information service.

Detailed Description of the Invention The present invention is described with reference to the enclosed Figures wherein the same numbers are utilized where applicable. Figure 1 illustrates the basic embodiment of the present invention as utilized in both a single user and LAN/WAN (local area network/wide area network) configuration. The system comprises a local station 10 and area service center 20 (with in respective hashed lined) linked by a conventional telephone link 15. The local station 10 and area center 20 comprise elements of a linked database for one or more applications such as the selection of real estate information, medical image processing and the dissemination of architectural and structural designs. For purposes of explaining the operation of the present invention, it will be assumed that the local user station 10 is located within a real estate brokerage company and the area center is located at a remote location. In this example, the local station 10 is utilized to process database queries pertinent to real estate information such as housing prices, number of bedrooms, square footage and to display tabular, graphical and pictorial representations of the selected information.

Referring to Figure 1, the local user 10 station comprises a computerized system including a display device 12 having a graphic monochrome or high resolution color CRT or flat panel display 12. Display device 12 displays information and selected tabular and graphics data pertinent to selected information to the operator. The system 10 also includes a keyboard 14 and most preferably a mouse 14 which the operator may use to enter information, including both commands and data into the system via a graphical user interface (GUI) 16.

Microsoft Windows 3.X is the preferred GUI 16 for the present invention because it is the most widely accepted graphical user interface for the IBM PC compatible family of computers. However, other comparable GUI programs may be used in the present invention. Examples of other currently available GUIIs are OS/2 PM (Presentation Manager), PM/X, CXI, Motif, DEC- Windows, and Open Loop.

The GUI 16 and system 10 are utilized in association with one or more application programs 23 (real estate in this example) which can be written in "C" or an object oriented programming language such as Actor. The individual application program defines the search criteria. As will be discussed below, the application program interfaces with the graphical user interface 16. The local user system 10 is thus used to collect the information to be used for specifying the search criteria or modifying the database. When the information is collected, the user interface originates a function call to the control program to originate the query. An external printer 18 provides hard copy output of real estate (or other application) data output selected by the operator. The system may can also include an internal fax board which can be utilized to send facsimile transmissions and/or multi-media features 21.

The local user system 10 is utilized in association with a mass storage database residing on a storage medium such as a WORM (Write Once Read Many) drive 22 which stores encoded Graphics Relational Database GRDB and tabular records pertaining to individual real estate information within the database. For the purposes of this disclosure, the term graphics refers exclusively to pictorial representations such as a raster image. WORM 22 is preferably a large transparent mass storage device which supports random access to data stored on the device. In addition, the present invention can utilize any magnetic, optical, CD, or magneto-optical mass storage system and/or plasma etched storage systems as the database storage means 22. The mass storage device 22 may further comprise an optical tape storage system such as that manufactured by Creo products. One square millimeter of etched optical tape can hold store 100,000 bits of information.

The interface from the computer to the WORM 22 is preferably an SCSI (Small Computer Serial Interface) interface (not shown) , which is controlled by an intelligent interface attached to the computer bus. The SCSI interface supports a high data transfer rate of at least twice that of the "standard" ST506 interface used in typical fixed disk and other computer peripherals. Creation of the WORM for distribution to end users and for updates of the GRDB, allows optimized placement of data on the WORM so as to further speed and access to the data.

The microprocessor in the local user station with associated hardware and operating system includes a microprocessor 24 such as an Intel 80286, 80386, 80486, 80X86 or Motorola 68030, 68040 microprocessor or more powerful, that will typically operate under the DOS, UNIX or XENIX operating systems. A RISC based CPU (e.g. as produced by Sun Micro Systems) may also be used. The latter two operating systems are multi-user and multi-tasking systems.

The system also includes communications software 25 and encryption system. Modem 26 transmits commands via standard voice grade communications lines 15, to interconnect the area center 20, which stores the master tabular database and a host control program.

The local user system is utilized in association with a database engine 28 such as Wintrieve or DBVista III by Raima Corporation. The database engine performs the database searching and saving functions based upon commands of the applications program and control program. The area center 20 contains a host processor 31 which will typically contain an Intel 80486 or more powerful microprocessor operating under the Unix or Xenix multi-user, multitasking operating system. The host computer of the Area Center 20 will service a number of applications (e.g. Real Estate, Medical Image Processing) and will be linked to one or more local user centers 10. The area center 20 will contain a central control program 11 which serves to route query requests to one or more service package programs 33 residing within the area center computer. Each service package application services a particular application, e.g. real estate, medical image processing, etc. Like the local user system, the area center 20 contains a WORM 32 which stores a tabular and graphic database which is accessed by a area center database engine. One or more local user stations can be connected to an Area Center via direct dial telephone link-up.

The system of the present invention includes control programs which reside at both the local user station 10 and area center 20. The control program (CP) performs two major functions: table driven dispatching; and as a library of function calls which accommodate the operating system, database engine, communications system and applications program.

In operation, the user initiates transactions through the GUI. These transactions are dispatched through to an appropriate handler, i.e., the local database engine, graphical database, or a remote database via communications program 25. For purposes of the disclosure, the term handler refers to a function or set of functions which perform a requested operation. Responses are returned to the GUI 16 for presentation to the user. All CP 11 actions originate with a transaction from the GUI 16 in the form of a function call to the CP 11. The CP using application program 23 unique transaction tables, converts the transaction data to a format required by the DBE, and makes a function call to the DBE 28. The DBE 28 performs the requested action(s) , and returns a response to the CP, which may be just a completion code or one or more messages. If the transaction requires further action, the control program initiates the additional transactions. Upon completion the CP converts the response to the format required by the GUI 16, and returns it to the GUI. The processing of a transaction includes the following major steps: o converting application data formats to DBE formats o invoke handler o converting a handler response to application data format o return to application

A transaction-control table will contain references to determine the identity of the handler, the format of the parameters passed by the GUI to the CP, the format of the parameters required by the handler, as well as the format of handler responses and their disposition, as described below.

Each transaction passed to the control program shall include a transaction code. The control program locates the code in a transaction-control database table. If not found, the control program will return to the application GUI with an error indication. If found, the control program will identify the handler to be used. It will then test whether or not the handler is currently available. If the handler is unavailable because it was not loaded, the control program will request the operating system to load it. If unavailability is due to a concurrent task not having been initiated (e.g., the WinTrieve ISAM engine in the MS-Windows environment) , the control program will request the operating system to start it. If the handler is still unavailable, the CP will report the error condition to the GUI.

A transaction-control table specifies the table describing the structure of the information passed by the GUI to the control program, the table describing the information required by the transaction handler, and the table specifying the correspondence between them. The control program will build the data structures required by the handler according to these tables.

A transaction-control table will similarly specify the tables required to convert handler responses to the GUI format, permitting the CP to perform the reverse conversions as needed. The transaction control table is unique for each application. It is sorted by transaction codes. The table contains information describing the format of the parameters passed by the caller.

When the application is loaded, it will specify the name of the first-level table which enumerates the application data tables it utilizes. The contents of that database table will be loaded by the control program into its internal table- list. Another first-level table, column-format, will be coded as part of the database engine interface (i.e., a unique version may be needed for each database engine to be used with the CP) . It will enumerate the format of the columns to be read into column-description. These two tables together (one application- unique and one database engine-dependent) specify what information is to be read from the database into the second- level table column-description and how it is formatted.

The second level table column-description will be shared by all applications available in the machine. It will describe the name and characteristics of each column of each table used by any of the applications. Another category of control tables are used for interfacing to remote databases. All the information for each remote database access request will be assembled by the control program, under the control of these tables, to be passed to the communication program as a single message. These tables will control whether or not information will be translated from its local format to another format before transmission, and if so. - 13 - how. The tables will similarly control what, if any, translation is required before remote database responses are delivered to the application. The tables will similarly control what, if any, translation is required before remote database 5 responses are delivered to the application. The tables will also control how the response is to be broken into smaller units when required.

It is to be noted that the local user system 10 of the present invention may also be utilized as a stand-alone 10 prototype which operates under DOS running under Microsoft I Windows version 3.0. As with the interactive system, a preferred database engine on the stand-alone system is Wintrieve, and the application program will be written in object oriented Actor "C". In using the stand alone version database 15 records are initially generated. Once the list of records is generated, queries can be generated. The query searches all the records and presents the records which fit the field specifications of the query. The records previously saved to disk are then called up. 20 The implementation of the present invention using the

GUI will preferably incorporate a raster/vector/attribute graphic database (RVAD) used to obtain specific selection sets based upon data criteria such as geography. RVAD is a method of overlaying a raster image, such as a map, visible to a person 25 viewing a computer screen, over a vector space (part of which is the screen viewed by the local user) . The vectors may be •; displayed or may also be transparent. The vector space is virtual, and the raster image is a "window" looking at a portion of the vector space which is composed of four elements; points, 30 lines, faces, and attributes. Each point, line, or face in the vector space can have multiple associated attributes.

The local user would select either vector points, lines or faces from the raster overlay on the vector space, such as a map on the screen. That is, the user selects a portion of

35 the raster image with transparent vector components becoming part of the selection set. The vector space is preferably bit or overlay mapped in order to provide background images as shown in Figure 7C. The selection may be an area, individual object, or a point on the screen. The area may be selected by clicking on a point, or "boxing" an area on the screen with a pointing device (mouse or digitizer) or the keyboard (arrow keys) . The selected area of the RVAD map can then be enlarged and/or manipulated.

The selected area would then define the user database query, with the control program using the locations within the selected for the host database selection criteria. The RVAD can be implemented utilizing a vector and MVP card. An MVP card is a processor device which is capable of masterizing images on a filing recorder at 2000 or 4000 lines of resolution. It is to be noted that the implementation of an RVAD based system can utilize "off-the-shelf" software such as CAD overlay ESP (Edit, Save, Plot) and DRAFIX CAD Overlay, a program which allows a raster image to serve as a template on the screen so that vector data can be traced over it. Terminal Emulators such as the EM320, 4010, and 4105 manufactured by Diversified Computer Systems are particularly suited for RVAD applications.

The operation and advantages of an RVAD based system in the context of the present invention is explained by the following example and with reference to Figures 1-6C. Referring to Figure 5, the RVAD vector space may cover several counties in, for example, the state of Georgia (Figure 7B) . Each of the counties contain a plurality of real estate information, each of which is identified by a point. In total, there may be up to 10,000 points within the total vector space of the county (not completely shown) . A window 51 may cover a portion of one of the counties (Fulton County 48) of Georgia which contains, for example, 20 points. The potential home buyer or realtor would then select type in other desired options, criteria or attributes such as price (e.g. less than $200,000), size (e.g. four bedrooms) , etc. Referring to Figures 4 and 5, the query and twenty points defined within the window of Figure 6 are processed via the real estate applications software situated at the local station. Pursuant to the applications program residing in Act the local control program transmits the X-Y coordinates of the window to the database engine. The application program may initially determines how many of the 20 homes defined by each point possess one or more of the desired attributes or criteria defined by the query. The application program them calls up the data. The data will typically comprise information such as the address of the information, the asking price, and the age of the information.

Figures 2 and 3 illustrate the anatomy of a sample transaction utilizing both the local user station and the area center on RVAD input means and local and area control programs.

This sample transaction assumes that the user is interested in reviewing real estate related records at, for example, a real estate brokerage. Initially, the user selects the geographic area of interest via the RVAD interface. The application program builds and sends to the control program a geographic area retrieval request. Next, via the application program, the user selects his price range. Concurrently, the control program passes the geographic area of retrieval request to the communications programs. The control program then activates the database engine. Concurrently with this step, the communication software passes the geographic area retrieval request to the area center. Next, the control program passes geographic area retrieval request to the database engine.

At this point, the database engine starts up and initializes. It then retrieves and delivers to the control program the first matching record. The area center verifies user authorization. It then builds a buffer of geographically matching records which are not in the local database. Next, the user selects a bedroom count via the graphical user interface. The control program builds a buffer for local matches, buffers the first record and requests the next record. The database engine at this point, retrieves the next geographic match. This process is repeated until all record matches which satisfy the geographic areas defined by the RVAD are located.

The user then activates the search via the application program. The control program buffers the next record and delivers the first record to the application program. The application program checks if the first record is a complete match (all criteria) and then displays the first match. The database engine continues to retrieve the next geographic match. This process is repeated until all matches satisfying the requested criteria are identified and displayed. Referring to the lower portion of Figure 2, the application program will then make a determination as to whether a sufficient number of local matches were found. The application program will then request area center matches. Initially, a request is passed from the application program to the communication system. The control program builds a buffer area for records which are passed via the communications system to the area center. The communication system then passes area center records to the local control program which buffers. The control program then delivers the first area center record to the applications program. The application program then checks to see that the first area center record is complete and then displays the first match via the GUI. The control program then delivers the next area center record to the application program and the process is repeated. Figure 3 illustrates a sample transaction from the standpoint of the area center. In this figure, the communication program passes the user access request to the control program residing in the area center. The geographic area retrieval request is similarly forwarded to the area center control program. The control program residing at the area center verifies the user authorization and passes a geographical area retrieval request and user ID to the specific service package. The service package builds a buffer for matches and passes geographic area retrieval request to the database engine. The database engine then retrieves and delivers to the service package the first matching record. The service package checks if the record is known to the local user. It then buffers the next area center-only record and requests the next record. The database engine then retrieves and delivers to the service package the next matching record and the process is repeated. 5 The lower portion of Figure 3 illustrates the transmittal of records from the area center to the local user. Initially, the communication program passes a local user delivery request to the control program. The control program

"* _ then passes the delivery request to the service package. The 10 specific service package for real estate would then build a message of all area center-only records and passes them to the control program. The control program passes the service package message to the communications program and the communications program delivers all records to the local user.

15 It is to be stressed that because the configuration of the local computer has been identified to the application software, the address pointer of the GRDB will be selected to conform to the limitations and operating system of the local system. For example, if the local system utilizes a monochrome

20 printer and the information corresponding to choice number 4 has three graphical configurations (monochrome, color, and animation) , the host will select the monochrome address. Utilizing specialized programs such as Hydra, the user could perform "walk-throughs" or fly-by's of the selected records.

25 A further aspect of the system of the present invention and one which is particularly applicable to an RVAD based system, is the facilitation of the entry of new data entries (e.g. graphic and/or tabular) to the system. In the real estate example, discussed above, the hypothetical end user

30 (e.g., a real estate office) would enter a new entry such as a real estate information containing the query criteria of location, asking price, size etc., and transmit to the area center via the communications system.

In a preferred RVAD based system, the computer at the

35 area center 20 would place the new information on the vector space with respect-to previously entered entry points and then transmit back to the local user. Other end users could periodically receive the new information, either through periodic updates (e.g. nightly, weekly) or updates could be periodically piggybacked during each query. Two or more area centers may be linked in interactive operation thereby increasing the area and/or number of local stations serviced. In applications such as computer aided design (CAD) , two clients may be interlinked via this system, further via at least one area server and preferably at least one other communications means such as fax, voice, etc. A key feature of the invention is that there is no direct linkage between local user stations. Any local user station (i.e. peer) to local user station (peer) communication must go through an area center 20. Moreover, while the area center 20 is principally accessed via network of local area centers 20, as shown in Figure 12, a local area center (e.g. US3) may be accessed via, for example, toll free number by local user stations situated anywhere in the world, (e.g. T=Tokyo, Japan and V=Vienna, Austria-being-also super- regional (Continental) Centers, and B, L, M, P, R being major European capital cities as recited in U. S. Serial No. 544,826.

The system of the present invention can utilize optical character recognition (OCR) technology for data entry and. system updatability. OCR is a process for converting printed text into computer readable files, e.g., ASCII, WordPerfect, Graphical, etc. The present invention can utilize portable hand held OCR image scanners such as the AS-8000P and Image 72 and Image 256 painting scanners manufactured by A4SCAN. State of the art portable scanners such as the AS-8000P provide graphics resolutions up to 400 dpi. The present invention can further utilize Desktop Scanner technology such as the Apple Scanner, Bell & Howell "Jetscan", and Xerox "Datacopy" line of scanners.

Through the use of OCR technology, system upgrades could be rapidly and efficiently entered at the local end-user station. In the example of a real estate graphic information service, a local realtor on the system could photograph a new - 19 - information. The photograph could be scanned using local (on- site) OCR technology and entered into the GRDB. The newly entered GRDB entry could then be transmitted to the host during periodic system updates. From the host, the new entry could be 5 distributed to other subscribers of the system.

While the present invention has been described in the context of a real estate list in service, there are alternative applications for the present invention. In the area architectural and structural design, for example, there are

10 often many portions of an image which do not undergo modification. For example, in the design of a multi-story structure, the details and location of external walls, support structures, etc. are often identical from one level to the next.

If the graphical data related to such common elements is stored

15 in a distributed database as described in this invention, then two idesigners in remote locations can make changes by merely sending commands to each other's computers in order to change or update details in the local graphical displays. As before, the entire contents of the graphical image need not be transmitted,

20 thus effecting a great savings in time and convenience.

One of the great inconveniences in industrial design is the constant need for referring to and updating of blueprints by persons at remote locations from each other. In a typical application, specifications and drawings are sent to a machine 25 shop which contracts to perform certain machining tasks. If the machine shop is especially well equipped, the design may be sent on a computer readable magnetic tape or diskette.

In the case of any necessary changes, two people must communicate the exact location and type of change. In most 30 complex designs this requires a personal meeting. By use of the methods of the present invention such changes can be made easily by command updates of the local databases and both designers can view the changed images at the same time. Upon agreement, the new design data can be stored. In addition, the altered data 35 segments can also be stored as a running record of the engineering changes which have been made, together with the date and the persons involved. Such a continuous - and automatically logged - record of engineering changes (EC) is valuable for design integrity and security. The changes can also be communicated, in a similar fashion, to manufacturing personnel so that the production line works with the most up to date design data.

Modern medical practice requires a number of digital images. These include radioscopic X-ray, CAT (Computed Axial Tomography) Scan, NMR (Nuclear Magnetic Resonance) , and PET (Positron Emission Tomography) images. In addition, numerous analog images are often acquired for diagnostic purposes. These include ordinary x-ray film, ultrasound displays and endoscopic images (which are often recorded on video tape) . Conversion of analog images to digital form is increasingly used. For example, DuPont has a method of scanning x-ray film and converting it to a high-resolution digital image. Conventional digital signal processing techniques can then be used on such images to enhance certain features by varying the contrast, removing background noise, etc. The apparatus for the acquisition of high-resolution medical images is extremely expensive and only available at large medical centers. Thus, the images are not readily available to physicians in remote locations. The diagnosis is often made at the medical center and a "single-slice" hard copy sent to the local physician. The local physician currently has no opportunity to view cross-sections at will.

However, with the use of the methods of the present invention, the physician's local database could be updated with an express delivery of the data (for example on magnetic and/or optical tape media) . He could then view the image in any way desired merely by sending commands to an area center located at a medical center (or at another location having a host and compatible software) for recalculation of the image ("reconstruction") . This would enable him to have the "look and feel" of working with the actual imaging system. The availability of patient records to a number of medical practitioners is often necessary. This may be the case for a patient seeing various specialists. Alternatively, a patient who has moved sometimes needs portions of his medical record from a distant family physician. The present invention is applicable to these cases, especially as it relates to graphical information. For example, a radiologist may follow the development of a tumor by having a graphics data base stored locally and updating over the phone any changes as new x-rays are taken. Another example involves the monitoring by CAT scan and NMR of certain chemical deposits which have been correlated with Alzheimer's disease.

Doctor's notes may also be transferred in both graphical form (especially if they include sketches) as well as ASCII characters. In this case graphical images have the disadvantage that they cannot be readily text edited.

The system of the present invention can further be configured to utilize an image storage and retrieval system such as that manufactured by Recognition Equipment Corp. In addition, the present invention could further utilize a sophisticated image processing system. Such a system could utilize the Image Plus High Performance Transaction system which requires an IBM 3090 mainframe computer. The IBM system captures 2400 documents per minute. The use of image processing technology could be particularly applicable for medical database applications.

A key feature of the embodiments of Figures 1 and 8-10 is of multiprocessing (SLCMP) by the local and regional hosts. Symmetric Loosely Coupled Multiprocessors (SLCMPs) are best described as a group of cooperating computers. The term multi¬ processing describes the ability of a computer system to utilize more than one Central Processing Unit (CPU) concurrently. Unequally distributed co-processors associated with co-operating computers create assymetric multiprocessing. Microprocessing is available on hardware configurations such as the Sequent and Convex "minicomputers", and the Compaq SystemPro. Operating systems which utilize multiple processors optimize input/output from the system, and permit the simultaneous use of more than one application on the system. In a multiprocessor based system, each computer will typically have its own peripherals (disks, LANs, terminals, etc.) along with a dedicated interprocessor communications channel (IPC) .

The major advantage of SLCMP as applied in the present invention is that processing capacity can be added easily and system performance can scale proportionally to the capacity of the discrete components (i.e. the local and stations, local hosts 63 and regional host 64) . In a possible configuration, a Compaq SystemPro could be used to control the processing for multiple databases simultaneously accessed by different hosts. Thus, the SystemPro could simultaneously process for example, Real Estate and Medical applications emanating from different networks. As those skilled in the art will recognize, there is a synergism when multiple processing is utilized. Figure 11 illustrates the use of multiprocessing in the present invention. As shown, two or more workstations connect to a local regional host. The existence of several CPUs on the host coupled with multiprocessing software permits the host/server to simultaneous process a plurality of queries.

Figures 8-10 illustrate further examples how the system of the present invention could be incorporated as part of a local, regional, national or continental network. Figure 8 illustrates a host/server which would typically service a region such as Bucks County, PA. The host will service a plurality of system subscribers located within a single county for applications ranging from graphic real estate information to medical image processing. Users outside of the system can access the system via phone or modem. Figure 9 illustrates a regional network (e.g. the Philadelphia Metropolitan Area) which links the hosts of several counties. The hosts may be linked by a fiber optic network capable of transmitting data at rates of up to 40,000 baud. The fiber optic link would permit the local computers in the region to access all other computers which are part of the network through the use of "store and forward" of data or by passing control program packets through intermediate host connections. Data may be further transmitted via conventional phone lines. Figure 10 illustrates a national network interlinked and supported by a nationwide value-added fiber-optic network such as Sprint or CompuServe.

Communication between the local station(s) and host/server(s) will be performed via modems such as the PEP modem by Telebit Corporation. This modem splits the bandwidth of voice grade telephone communications into 524 virtual circuits. Intelligence within the modem dynamically contracts or expands the number of circuits used to communications between PEP modems based on the quality of the circuit. The local computer or terminal attached to the modem maintains a constant interface speed with the modem and the connected modems arbitrate the line speed. PEP technology also supports 32 bit error correction and compression of data and supports special protocols such as UUCP (for UNIX based computers) , Kermit and YMODEM file transfer protocols that take advantage of the modem based flow control for the transfer of binary data between computer systems.

It will be appreciated by those skilled in the art that a typical 9.6 Kbaud data circuit can support multiplexing of the circuit to support multiple connections across the same circuit. Use of a multiplexer such as those produced by MultiTeck allows sharing of a single 9600 bps to 19,200 bps data line among several systems, thus increasing the output and economy of the system.

Sprint and other current communications vendors support various means for the sharing of public networks, and provide transmission speeds up to 40,000 baud. Sprint has an X.25 network with connections to most cities within the United States and most major international cities. Data is collected in packets at high speeds (up to 9600 baud) and routed through the network to the remote address specified by the connection. Multiple computers attached to this network can exchange data based on unique addresses within the system. This type of network is also supportable by CompuServe and other Value Added Network providers.

Figure 10 discloses a private national network that can consist of dial-up connections via high speed modems (e.g. Telebit T2500 or equivalent) . This network can also utilize a combination of dial-up modems and dedicated data lines. The addition of multiplexers in this configuration allows dedicated data lines to be split into multiple data lines to support multiple hosts or concurrent queries from a single host. This maximizes the greater bandwidth of the dedicated data connection and improves utilization of the data line.

A further benefit of the present invention manifests itself in it unexpected efficiency for linking national and/or continental networks containing in their regions a variety of circuit switching and/or packet switching technologies into an efficient international and/or inter-continental (i.e. global) network. As a result of system-wide data traffic flow and data storage allocation profile characteristics, bulk WAN data expansion and/or update information can be provided by transported (non-electronically transmitted) system compatible and recombinable data storage means (M) for most local and regional purposes. All presently available switching and packeting technologies can co-exist in the networks of the present invention. Using transparent and/or translatable data storage means, the greatly reduced long distance traffic flow particularly in combination with RVAD and/or PQA features of the present invention provides for practical and/or repeated re- switching and/or repacketing applicability. This may also include cell-relay and/or frame relay packet switching combined with circuit switching.

A further aspect of the invention is the use of encoded VCR tape means such as that disclosed in co-pending VCR Based Presentation Selection Means for data storage. The present invention has been described in the context of systems in which the end user will pose a query which will be processed yielding tabular and graphical data at a local workstation. The present invention thus serves as a means to optimize system-wide data traffic flow and storage allocation. Figures 13A, 13B and 14A, 14B illustrate said system-wide data traffic and storage allocation profiles for an intercontinentally linkable system with respect to said data profile parameter with some notable characteristics (e.g. there is no communication between local user (peer to peer stations) ) . Greater than sixty-seven percent of the data traffic (D) will flow between the local station and the area center. Less then 5% of the data traffic flows between the regional area centers and even less data traffic flows nationally. Media means (M) transportation can range widely from local user and drops rapidly to local user from local area servers to distant servers in a large national network. Details are discussed in Figures 13Bι and 14B.

A final aspect of the present invention is the provision of a mechanism which facilitates the practical pre- storage of preselected presentation format (component(s) ) which may be shown on displays associated with local presentation means but which cannot themselves generate such output in real time operation. For example, three dimensional animated graphical presentation outputs incorporating "walk throughs" and "fly-bys" generated using, for example, a 386 or 486 host, cannot be generated within a practical (egoleodline 48 hours) environment by a local station operating with a 286 AT processor. Such output presentations can be usually generated at a particularly slow rate using a 386/486 Host. However, a pre-defined, preprocessed, appropriately re-formatted (e.g. for the 16 bit 286 AT processor) and stored in local GRDB in toto to be merely displayed (presented) at a local (e.g. AT) station can provide a practical real time "preprocessed query answer" (PQA) component with real time and/or zoom features (for a local workstation customer presentation. An example of useful combination would be to use AutoCAD (from Autodesk) at a host server to create CAD (possibly with RVAD application) output under UNIX which can be predistributed to local databases, retrieved and manipulated under a simpler version of a compatible software program such as Autosketch (from Autodesk) . A query structure system (QSS) probably would subsequently select, from locally stored substantially pre-processed, predistributed query answer(s) (PQA) component(s) at least one animated and/or zoomed segment of a query answer upon an appropriate workstation query.

Pregenerated PQA's can be stored as interactive recombinable components, preferably for an 8086, 8088, 80286 or higher power local workstation and/or at least a dual window graphic multiprocessed output which can be stored in toto for searchable redisplay upon command in a database of relatively lower (end-user) power (end-user) local workstation, such as an IBM, PC, XT, AT, a low-end 386 based compatible and/or a comparable Motovola 6800 microprocessor chip (LPV) based unit with adequate local database storage capacity and retrieval gate speed. In general, the storing and/or retrieval of single and/or at least dual-window PQA's, particularly involving animation (e.g. including zoom) and/or color is a particularly important efficiency improving feature of this invention (e.g. using an IBM XT. AT. 0S2 or compatible^ .

In designing PQA's, limited (e.g. Menu) choices are preferably presented for query selection to end-users increasing the use-probability of said PQA's and thereby the PQA utilization efficiencies of the system. Using a relational database engine such as Ingres with SCO Open Desktop, a user interface is constructed from pre-defined forms such as SQLWindows produced by Gupta Technologies. This form would be used to Query the database (Query by Example) , and for display of the extracted information.

Pre-Designing the form is typical of RDBE applications, and a typical application would be designed with indexes on specific fields of the database tables to assure sub second (or 1-5 second) response times for the application. This would be possible in part to the fact that we are extracting in most cases, when using conventional dialable phone line query limitation data only, not working in a transaction based environment (such as an airline) where data would be entered as well as extracted. The use of PQA's will facilitate the indexing of output formats such that outputs can be standardized regardless of the written and/or spoken language (or its local versions) of the user, (e.g. Chinese, Japanese, Spanish, English, French, German or a Slavic) . This has also applicability in higher transmission rate capability host/server connection applications within the invention (such as financial transactional , travel service) . A preferred system would provide intelligent PQA capability (as a preferred upgrade option) for any portable unit from related LAN's upon hook-up in any other regional (e.g. diversified continent based WAN in English further in at least one more regionally dominant language and/or a local language. Such service, can be provided from regional "super" hosts and would be available as a location limited upgrade option to selected minimum 386 power W/S's.

Designing the workstation/PC application to take advantage of background processing using Windows or UNIX based software will improve the functionality of the application by supporting concurrent display of data to the end user while processing the transfer of graphic images into a disk or memory buffer. This enhanced capability would require that the PC be configured with two to sixteen or higher megabytes of RAM to take advantage of background processing capabilities of Windows and other multitasking or background processing software. An alternative for enhanced local service would incorporate network

PC's through local UNIX hosts using a Network File System (NFS) and would allow the PC's to transparently use a unified integratable database. The NFS allows many PC's to share a large, common database located on a more powerful host system, thus speeding access and local capacity for data. The invention thus provides improved and expanded graphical and combined presentation capabilities within a time constraint (i.e. on line, overnight, 48 hour service) environment. The PQA system according to the invention by using the combination of a W/S query, a high capacity PQA host associated with a relative large (and preferably pre-processable) database for at least the most desired or probably anticipated query answer components and menus of getting the PQA's from the host to the W/S within the practically set operational (technical) standards. An example of such a sequence of PQA's can be separate short, walk through segments of PQA's for several house models not yet built and stored in combination with changing other descriptive, financial and related community traffic pattern information for a large new development. The updatable marketing information segment is advantageous by recombinable with the WORM graphics.

While the present invention has been described in the context of a multi-entry real estate information and transaction monitoring presentation application, it is to be appreciated that numerous applications fall within the spirit and scope of the present invention and that the present invention may be utilized in any application requiring interactive communications between a local query initiation and a host computer and/or the presentation of tabular search data with graphics. In transit use, transportability of local database segments or locally generated information data and reintegratability of any other PC end user server providing global system capability and unlimited database means storage capacity is also an essential feature of the present invention. It is to be further appreciated that other embodiments fall within the spirit and scope of the present invention and that the true nature and scope of the present invention is to be determined with reference to the claims appended hereto.

Claims

What is claimed is:

1. A method for displaying and manipulating tabular and graphical data as recited in the following steps: selecting an end-user application from a local computer station; formulating a database search query based upon said end-user application; processing said query at said local computer; transmitting said query to a remote host for processing; selecting a graphical and tabular data base entry using said local and host computer responsive to said query; selecting a graphical presentation from a locally stored database responsive to said processed graphical and tabular database query processed at said local and host computers; and displaying said selected graphical presentation on a display associated with said local computer station.

2. The method of claim 1 further comprising local optical character recognition means for updating said locally stored database means.

3. The method of claim 1 wherein said locally stored database is stored on a CD-WORM.

4. The method of claim 1 wherein said locally stored database is stored on a hard disk drive.

5. The method of claim 1 wherein said locally stored database is stored on an optical tape.

6. The method of claim 1 wherein said locally stored database is stored on a magnetic-optical tape. 7. The method of claim 1 further comprising the step of transmitting tabular and geographical data responsive to said database query from said host computer.

8. The method of claim 1 wherein said host processor contains at least an 8 bit microprocessor.

9. Apparatus for controlling the storing and retrieval of graphical and tabular data comprising: local computer means having display means, said local computer means having access to a plurality of application programs, said local computer means further containing graphical user interface means for displaying graphical data responsive to a query processed by an application program for display on said display means; transmission means for transmitting said query to first host computer means, said first host computer means containing a control program for selecting graphical relational database and tabular database data which satisfy said query, said first host computer means transmitting said data to said local computer means wherein said data are displayed on said graphical user interface; and graphical relationship database means for storing graphical data and for transmitting graphical data responsive to said query directly to said display means in response to a command from said graphical user interface (GUI) .

10. Apparatus of claim 9 further comprising second host computer means in communication with said first host computer means, said second host computer being in a remote location from said local station and said first host computer means, said second host computer means having a control program which selects a graphical relational database and tabular database data which matches a query transmitted from said first host computer means, said second host computer means transmitting said graphical relational and tabular data to said first host computer means.

11. The apparatus of claim 10 wherein said first and second host computers are linked by a fiber optic transmission system.

12. Apparatus for controlling the storing and retrieval of graphical and tabular data comprising: local computer means having display means, said local computer means having access to at least one application program, said local computer means further containing graphical user interface means for processing graphical data for display on said display means in response to a database query formulated by said application program; communication means for transmitting said query to first host computer means, said first host computer means containing a control program for selecting graphical relational database and tabular database data which match said database query, said host process means transmitting said data may be by said transmission means to said local station means wherein said data may be displayed via said graphical user interface;

13. The apparatus of claim 12 wherein said local computer further contains a control program which selects graphical relational database and tabular database data based upon a database query. 14. Apparatus of claim 13 further comprising second host computer means in communication with said first host computer means, said second host computer means being more powerful than said first host computer means, said second host computer means having a control program which selects a graphical relational database and tabular database data which satisfies a query transmitted from either said local station or first host computer means, said second host computer means transmitting graphical relational and tabular database data responsive to said query to said first host computer means or said local station means.

15. Appartus of claim 13 wherein said local user, first and second computer means are components of a network communication system.

16. Apparatus of claim 13 further comprising multi¬ media storage and display means associated with said local user computer means.