JP2013509665A - System and method using 3D and 2D digital images - Google Patents

Abstract

The present invention realizes a real-scale, coordinate-matched, real-time linked 3D / 2D image dual display / viewer. The display shows simultaneously the 3D digital image and the associated 2D digital image of the selected drawing. The display of the present invention allows the user to visualize the actual scale structural details for the asset location, the surrounding environment, and dangerous goods, as well as internal or external structural scenes. Using this display and associated tools, users can see real-time information about the environment, actual scale measurement results, plan view entry / exit routes, the shortest path between points, and the number of doorways in the structure. You can get and track objects in the displayed environment. A single user can use and manipulate further intelligence information obtained using tools and 3D / 2D displays, or distribute that information to other users.

Description

  The present invention relates generally to digital images, and more particularly to a method for displaying digital images.

  Methods for scanning paper documents into digital images are well known. Some advantages of digital or electronic documents over paper documents are small storage space, quick and easy copy operations, fast read speed, and easy through electronic transfer (eg email) Shareability, digital form is persistent and non-volatile, and protects natural resources such as trees. Although a fully digital office has not been realized in most companies, it is rare to find a company that does not rely heavily on digital documents in the normal course of business.

  For example, real estate owners, land developers, architects, and document management professionals are working and historical documents related to real estate, such as building blueprints, floor plans, and riser diagrams. Scanning saves space and makes document copying and distribution more efficient. However, after the drawing is scanned, the scale information on the drawing is no longer computer recognizable when the digitized drawing of the paper is displayed on a monitor or display device. In particular, the digital image of the drawing is typically captured as a digital image having specific pixel-by-pixel dimensions and is a direct or easy means of establishing a relationship with the scale information contained on the original drawing. There is no. Therefore, when displaying an image using a monitor or display, the scale of a paper drawing, for example, that 1 inch corresponds to 3 feet is not valid for a rendered image on the monitor or display. It is virtually impossible for the user to obtain correct measurement information from the rendered image.

US patent application Ser. No. 10 / 434,390 US patent application Ser. No. 10 / 038,572 US patent application Ser. No. 10 / 177,577

  Traditionally, when a plan view of paper is scanned, digitized and stored in an electronic storage device, the original physical size of the image of a particular document, and thus the corresponding usefulness of the image scale, is no longer specific It is no longer an attribute. For example, if the paper infrastructure diagram is 30 inches high and 40 inches wide, the computer user of the scanned electronic image may be used when using a different monitor depending on the size of the display device and the pixel resolution of the device. Appears to be a document of a different physical size. Therefore, the scale displayed on the document (eg, 1/8 inch corresponds to 1 foot) is inaccurate when displaying an electronic diagram of the document on a computer monitor. This is because the original physical size of the paper image has no direct correlation with the computer monitor pixel dimensions. As a result, a 20 inch wide monitor can only display an image as 20 inches wide when displaying the entire image, and a 25 inch wide monitor can display an image as 25 inches wide when displaying the entire image. Can only be displayed. Also, neither monitor can display the entire image as it was originally displayed, that is, as a 40-inch wide image. Although the user has no way of knowing what the original physical size of the paper drawing was, the scale ratio of the images listed in the floor plan is still directly related to the physical size of the original paper document. Are tied together. Therefore, when a computer user who is viewing a scanned infrastructure diagram on a 25-inch monitor attempts to physically measure the image on the computer monitor using the data along with the image scale and manually calculate the actual scale measurement result, As a result, an incorrect measurement value is obtained. In addition, if the image is zoomed so that only a portion of the original image is displayed on the computer monitor, the physical size of the image will be distorted when combined with the scale to calculate the actual scale measurement. The physical measurement of the image or pixel becomes useless. In essence, after a paper drawing is scanned, the scale information on that drawing is no longer valid or accurate when displaying the digitized drawing of the paper drawing on a monitor or display device.

  Thus, some of the utility inherent in paper documents is lost when the document is digitized. This loss of practicality is particularly a problem when it is desirable to determine room measurements, wall lengths, or floor area, which is often the main reason for looking at drawings. It becomes. In addition, when annotating a digital drawing, it is often desirable to annotate where the graphical annotation retains the actual scale ratio for the rendered object represented on the digital image.

  Therefore, there is a need in the industry for the ability to display and distribute digital drawings along with being able to determine the correct and accurate dimensional information that accurately describes the rendered object. Not satisfied.

  It is also known that event information about a building can be displayed together with a digital drawing of the building. For example, it is known that buildings can be equipped with various alarm systems. A method of displaying event information from a building system in an emergency when an event occurs in the building system is disclosed (for example, see Patent Document 1). Information about the building is displayed on the display portion. The displayed information can be selected and changed by the user. Alarm graphics related to emergency in the building can also be displayed. The user can choose to show a floor plan that discloses the status of the fire system alarm generating device. However, although this graphic can be displayed, the user does not recognize the exact, full-scale, spatial relationship that exists between the people in the building, the emergency situation, and the structural characteristics of the building.

  A responder asset management system (RAMS) is disclosed in the literature (see, for example, Patent Document 2). The disclosed system uses information available to responders, including emergency responders, including local weather, national weather, and links to other information. The system also provides a virtual walk-through function for a building or facility. However, even if this virtual walk-through is prepared, the user cannot zoom in / out and zoom in order to determine an accurate spatial relationship.

  Finally, systems and methods for detecting, monitoring, and evaluating dangerous situations in structures are disclosed in the literature (see, for example, Patent Document 3). Sensors with two-way communication capability are strategically placed in the structure or in a matrix of structures. These units are high level multifunction detectors that communicate with the base computer. However, as with the other systems described above, no spatial relationship is provided for the user so that an accurate relationship with the dangerous situation in the structure can be determined.

  In the prior art, the spatial relationship cannot be further determined by the type of display, viewer, or graphic viewport used to display the floor plan or drawing represented graphically. The two traditional types of displays used in the prior art are either 2D displays or 3D displays. Each display provides individual benefits to the user, but these benefits are limited. For example, a 2D display can be used by a user to plot a space with respect to an entire building or structure, but the 2D display describes the complete geometry and appearance of the interior of a structure room or passage. I can't do it. In such cases, when the user is plotting the entrance or exit route in the structure using the 2D representation of the floor, details regarding the architecture and geometry of the particular route can be found at the actual scale of the space. Since it may be a 3D animation or a 3D virtual representation in actual scale, it cannot be determined comprehensively. Also, using only 2D displays, it is not possible to make route adjustments for architectural and dangerous elements that are visually identified in the building that occurs along the route being navigated. For example, a 2D floor plan may indicate that a particular passage is sufficiently wide for a particular equipment, but representing the actual height and architectural geometry of the passage in all dimensions in a two-dimensional representation Can not. As a result, emergency response teams or other building system workers receive incomplete data that can directly cause bad or dangerous decisions when using only 2D floor plans as decision support tools.

  The advantage of the method of displaying the floor plan when using only the 3D display is also that the user simply sees the interior of the structure and quickly sees the wall structure and embedded electrical, natural gas and piping details. It is damaged because it cannot be identified. In addition, when using the 3D display, the user can identify only spatial relationships to objects in the room that are directly within the user's view cone, including but not limited to blocked passages. It does not recognize potentially dangerous / important adjacent room / area characteristics, including hazardous material locations, alarm status, and other important items.

  The prior art separates and visualizes graphics in 2D or 3D, but requires a display that improves display capabilities that utilize the novel image data relationships constructed by the present invention. Such a display combines the advantages of both 3D and 2D displays. Therefore, there is a need for a display that constitutes a synchronized, real-scale visual relationship between two related and related but independent data perspectives in a manner not found in previous techniques. A display capable of symbiotic data visualization between real scale 3D and 2D displays is required, which is displayed independently even when such displays are displayed continuously. Sometimes not realized. Such a display allows 3D and 2D routes to be displayed simultaneously while simultaneously accessing critical, measurable, spatial, and related data via an actual scale coordinate link display. It would also be desirable for such a display to display the exact actual scale measurement results of the route.

  In the present invention, a real-scale, coordinate-matched, real-time linked 3D / 2D image dual display (viewer) is realized. Use the combined simultaneous and real-time image display of the present invention to assess risk, define safe and kill zones, critical assets for internal and / or external structural scenes, alarms and sensors, dangerous goods, and real scale structures It is possible to effectively visualize the details of the building / building. By combining 3D and 2D displays with synchronized, coordinate-linked, real-scale image displays, contextual placement and spatial data are no longer mutually exclusive. Rather, the combined 3D / 2D display uses the scale information embedded in the header in the image to allow the user to obtain real-time information that can be manipulated in 3D and 2D simultaneously and is displayed. Establish a unique state of environmental situational awareness and intelligence information. Simultaneous display of 3D and 2D views is independent of fixed or floating 3D and 2D window placement or size.

  The present invention also implements a metrology tool for use with applications suitable for displaying digitized drawings. The measurement tool calculates the length and area (both regular and irregular shaped areas) from the actual scaled digital drawing. This is a digitized architectural drawing or scanned from paper to digital form when it is important to measure and annotate the drawing at actual scale, and it is not easy to maintain for a long time. This is particularly advantageous for other drawings that are not easy to re-import.

  In one embodiment, the invention is associated with digitizing a paper document, capturing scale data and physical parameters of the paper to be digitized (scanned), and a digitized image file. Embedding scale and physical parameter data within the header, and then storing the digitized image. The present invention further processes the header data when displaying the digitized image through the viewer application so that the header data can be used in calculating the actual scale line length and area. For example, if the digitized paper displayed is a floor plan, the header data can be used to measure the distance and area on the floor plan at actual scale. After the line is drawn, the header scale data can be used to calculate an actual scale measurement, which can then be converted to the desired unit of measurement and then presented to the user.

  Capturing the scale and physical parameters of the paper to be digitized includes capturing the original scale information of the paper, the DPI of the scan, and the original size of the paper. When paper is imaged as a TIFF file, the captured data is stored in a private tag in the TIFF header using the TIFF header tag. As is well known to those skilled in the art, a TIFF header has both a private TIFF header tag and a public TIFF header tag, the public tag is intended for a specific or specific data type, and the private tag is for a specific purpose. Must be registered to hold data in order to. For example, a public TIFF header tag for file size cannot be used to store other data such as descriptive data or scale data. Private tags are open fields and do not have data intended to enter those fields unless they are registered tags. Private tags can be used by software developers, or can be registered with a private company so that a particular tag can be used for one designated, unambiguous purpose.

  When displaying a TIFF image, the user can use a drawing tool that is part of the viewer to draw a line or shape. The arrangement of pixels defining the line or shape is captured by the viewer for use with the header data to calculate the measured length of the actual scale of the line. As described above, the present invention measures length (for both lines and polylines) and area (for both regular and irregular shapes such as rectangles, polygons, and inverted polygons). Other tools used in TIFF images include two user-selected or moving parts that are marked on a 2D map or in 3D rendering using scale information embedded in the TIFF header. A Find Shortest Path tool that computes the shortest fastest path between points that are automatically updated, and the Find Shortest Path tool is a multiple route between two user-selected or dynamically updated points , For example, primary (shortest) route, secondary (next shortest) route, and tertiary (optional) route can also be calculated and displayed at the same time, so that advanced contingency planning, individualized Mark the passage and entrance / exit points manually or automatically to attack the stairwell or May correspond to the barrier tool that allows marking of flame, recalculation of these dynamic details the shortest path can be trigger. The 3D Record Path tool records the route navigated on the 3D window and at the same time maps the route on the 2D display pane. When replayed, the Door Detection Tool will be in an environment along the route assigned to be a critical aid to emergency response personnel working under adverse conditions such as a dark environment full of smoke. Automatically create a list of doorways and passages that are oriented together. The generated route can be stored and embedded in a digital file, which facilitates planning, preparation, simulated evacuation training, and training enhancement.

  During these changing times, it is imperative that disaster response and similar emergency management and building personnel in crisis situations have access to the building floor plan to properly protect residents, infrastructure, and assets. What is needed is a system and method that provides emergency response personnel with interactive building scale 3D and 2D visualization environments that provide building floor plans that are proportional to their original size, which are useful for emergency response personnel and remote locations. Allows the system user at to retrieve multiple in-context contextual recognition data points. This function has historically been reserved only for people in the physical structure itself. The system and method can be implemented in the form of a software package.

  The scale plan is useful for emergency response personnel when planning entry and exit routes for buildings or structures, including stadiums, arenas, bridges, tunnels, wharves, and the like. In addition, point-to-point routing is easily determined either manually or programmatically.

  The scale plan is useful for the general public and emergency response personnel when planning entry and exit routes both before and during emergencies. To prepare for possible emergencies, the building tenant or manager has pre-arranged to enter and exit the building using the disclosed system while simultaneously displaying such details in 3D and 2D A route can be determined. In the event of an emergency, emergency response personnel can use the dynamic search and delivery function of the present invention to determine the route to the emergency exit in real time. With this system, emergency response personnel can determine multiple routes presented in a hierarchical shortest to longest format to and from a particular building location or area, Time response personnel can access or block certain parts of the building in both 3D and 2D. With this system, multiple routes of buildings are considered, considering all infrastructure carrying people, for example, stairwells of buildings, even the route from the outside of the structure to an accessible location on the floor of the structure Routes can be determined across floors.

  The present invention facilitates the point-to-point route designation within a structure and allows personnel to identify an accurate measured route to reach a specific location. Emergency responders know how to get from point A to point B and the exact distance that they must travel along the route. For example, when a building is wrapped in smoke, the fire officer cannot determine where to go and must rely on other means to determine where to go. With this system, firefighters know exactly how far to go in a given direction to reach the place. Similarly, at stadiums and arenas, the security side can use the disclosed system to pinpoint problem areas and address possible security situations. Both emergency response personnel and tenants or other people in the building can determine the location of the emergency exit and the route to the exit. By using the dynamic search function, various routes to the emergency exit can be determined in real time.

  In the present invention, scale plan information can be delivered in at least three ways. First, in one embodiment, the present invention displays information on a computer monitor screen or display device and is selected by a user using a pointing device, such as a mouse, stylus, or other user indication selection device. Selected point or area. Second, the present invention can display information on handheld devices that can be carried by personnel. Third, the system can use a heads-up display that displays relevant information within the user's line of sight. Thus, using the present invention will help firefighters who often work in situations with reduced visibility. By using the present invention, a firefighter walking in the dark can check the necessary information including the current location and the route to the desired destination location with a head-up display that details.

  Finally, 3D and 2D scaled displays can be used simultaneously so that a planning committee or planner can determine containment strategies or other strategies along with access routes. Use the disclosed system to develop pre-arranged routes by building tenants or building management and determine entry and exit routes that can effectively enhance fire safety measures for fire fighting training Can do. In addition, for stadiums, arenas, and the like, security can use the disclosed system to pinpoint problem areas and determine solutions for various security situations that may arise. .

  Users can implement the present invention in at least three ways: (1) kiosks, (2) telecommunications systems, and (3) integrated systems.

  The present invention will be described in general terms and with reference to the accompanying drawings, which are not necessarily to scale.

1 is a schematic block diagram illustrating a system according to one embodiment using the present invention. 3 is a flowchart of an embodiment of the present invention. FIG. 4 is an exemplary user interface for entering scale data associated with a scanned document according to one embodiment of the invention. FIG. 4 is an exemplary user interface for entering data associated with a scanned document according to one embodiment of the invention. FIG. 6 is an exemplary user interface for displaying a scanned document where a user draws a line and the actual scale measurement result of the line is displayed to the user, according to one embodiment of the invention. FIG. 4 is an exemplary user interface for displaying a scanned document in which a user draws a polygon and the actual scale measurement result of the polygon is displayed to the user according to an embodiment of the present invention. 6 is a schematic diagram illustrating the calculation of line length according to one embodiment of the invention. 6 is a schematic diagram illustrating the calculation of a rectangular area according to an embodiment of the invention. 6 is a schematic diagram illustrating the calculation of the area of an ellipse according to one embodiment of the invention. 6 is a schematic diagram illustrating the calculation of the length of a polyline according to one embodiment of the invention. 6 is a schematic diagram illustrating the calculation of the area of a polygon according to an embodiment of the present invention. FIG. 6 is a diagram of data display according to an embodiment of the present invention. 6 is a flowchart of another embodiment of the present invention. FIG. 4 illustrates an exemplary user interface displaying a 3D / 2D display / viewer. FIG. 14 illustrates an exemplary user interface that displays only a 3D window of the display / viewer as described in FIG. FIG. 14 illustrates an exemplary user interface that displays only a 2D window of the display / viewer as described in FIG. FIG. 14 illustrates an exemplary user interface displaying a 3D / 2D display / viewer application shell as described in FIG. FIG. 5 is a diagram illustrating a Find Path Tool used for a single floor shown on a 3D / 2D display / viewer. It is a figure which shows the path | route calculated using Find Path Tool of FIG. 18A. FIG. 3 is a diagram showing a Find Path Tool used for a high-rise building shown on a 3D / 2D display / viewer. FIG. 6 is a diagram showing a Barrier Path Tool used with a 3D / 2D display / viewer. It is a figure which shows the Door Detection Tool used with 3D / 2D display / viewer. FIG. 3 is a diagram illustrating a 3D Record Path Tool used with a 3D / 2D display / viewer.

  The present invention will now be described in more detail below with reference to the accompanying drawings, in which some but not all embodiments of the invention are shown. Indeed, these inventions may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are disclosed in this disclosure. To meet applicable legal requirements. Like numbers refer to like elements throughout.

  In the following, it should be understood that the system and method of the present invention will be described with reference to block diagrams and flowcharts. It will be understood that blocks in the block diagrams and flowcharts, and combinations of blocks in the block diagrams and flowcharts, can each be implemented by computer program instructions. These computer program instructions are loaded into a general purpose computer, special purpose computer, or other programmable data processing device to generate a mechanism, thereby executing instructions on the computer or other programmable data processing device Can generate means for performing the functions specified in one or more flow diagram blocks.

  These computer program instructions that can cause a computer or other programmable data processing device to function in a particular manner can also be stored in computer readable memory, whereby instructions stored in computer readable memory are A manufactured product containing instruction means for executing the functions specified in this specification can be produced. These computer program instructions are further loaded onto a computer or other programmable data processing device, whereby a series of operational steps are performed on the computer or other programmable device, such as a computer or other programmable device. A computer-implemented process can be formed such that the instructions executed above implement steps for implementing the functions specified herein. Thus, the block diagram and flow diagram blocks comprise a combination of means for performing a specified function, a combination of steps for performing a specified function, and a program instruction means for performing a specified function. to support. Each block in the block diagram and flowchart, and combinations of blocks in the block diagram and flowchart, are implemented by a dedicated hardware-based computer system or a combination of dedicated hardware and computer instructions that performs a specified function or step. It will also be understood.

  The present invention provides a metrology tool for use with a viewer application for displaying digitized drawings. By using a measurement tool, horizontal and vertical lengths, distances, and areas (both regular and irregularly shaped areas) at actual scales can be measured. The present invention can be used with a digital representation of a paper document having a scaled drawing such as an architectural drawing, a mechanical drawing, or a map, but is described below in the context of an architectural drawing for illustrative purposes. . The disclosed embodiments should not be construed as limiting the scope of the invention.

  In this system, an operator at a first location can provide information to a user at a second location. For example, using the firefighter example above again, the firefighter can include a head-up display, for example, in the visor of the firefighter's protective clothing, and show an image of the building floor plan on the head-up display. Meanwhile, supervisors who are in the street or in a centralized location may give firefighters precise navigational instructions for the structure via a head-up display or with verbal instructions or in a similar manner. it can.

  In another embodiment, all of the building floor plans are integrated into one system. As such, structures, electrical systems, waterworks, fire alarms, motion detection, and other critical systems are all easily accessible by emergency response personnel. Emergency responders use an integrated view of disparate data to effectively identify and identify dangerous situations, potential victims, criminals, or terrorist elements.

  The system can also use standard RF communications, optical links, Bluetooth, IR links, or the like. In addition, the 3D model can be integrated with other building systems such as intrusion alarms, fire alarms, smoke alarms, electronic building management or electronic building information management systems to determine entry or exit routes, or other building centers The various obstacles that may be present when making the decision are taken into account: fire alarms, temperature caution monitors, hazardous material locations, special building geometries and obstacles.

  In addition, emergency planning for other structures such as bridges and tunnels can also be performed using the disclosed system. In addition, a GPS locator can be used to track an individual's location. In another embodiment, RF triangulation is used to locate an individual's exact location. RF triangulation is performed using antennas installed in the building, or in the case of old buildings or buildings without such antennas, portable triangulation units are used.

  In another embodiment, the triangulation instrument is in an emergency response vehicle. RF triangulation can be used with a GPS locator so that the triangulation points are known using GPS technology and the exact position is determined by interpolation using triangulation.

  The system uses existing electronic CAD drawings or paper top views. The floor plan is processed, entered into the system, and stored on one or more servers. The system uses raster-vector transformation to prepare for the use of a paper plan or legacy plan. The prepared plan view is drawn in proportion to the original size. After entering the system, the plan view is immediately accessible to all users, including users at remote locations. In one embodiment, the plan view is password protected.

  The system can also be used for planning, decoration and design. After the floor plan is entered and scaled, other objects such as furniture, carpets, and paintings can be added to the floor plan. The system includes walk-through and plan view features so that the final layout can be viewed at multiple angles. Detailed measurements can be made using the disclosed system because the drawings are proportional to the original size.

  In one embodiment of the system, kiosks are available in and around the structure, which allows the user to select a start point and an end point. The system then generates a three-dimensional representation of the route and a two-dimensional map display that are completely proportional to the original size. The generated image is proportional to the original size so that the user can easily determine the distance. In addition, with kiosks, the location of the kiosk is known and can be pre-mapped or plotted using the system, so end users can view details about the building structure and view the rest of the structure. It is possible to obtain contextual real-scale intelligence information regarding the current position of the relative user. Alternatively, by using system drawings and annotation tools, kiosk users can base their building building data sets, for example, the placement of building fire protection equipment such as exits and / or fire extinguishers, all in full scale. Can be displayed in the context of a real scale digital building floor plan.

  Referring to FIG. 1, it can be seen that one embodiment of the present invention comprises a scanner station 12, a database 14, a workstation 16, a printer 18, a file input device 10, a transmitter 26, and a security system central office 8. The scanner station 12 includes the scanner and associated software necessary to capture digital images of paper documents such as building blueprints, floor plans, riser diagrams, or other architectural or design drawings. In one preferred embodiment, the scanner station 12 comprises a high speed large format scanner connected to a desktop computer having sufficient speed and sufficient capacity RAM to process large digital images. In one embodiment, the scanner uses either an ISIS or TWAIN interface and the compression / decompression algorithm used is TIFF CCITT Group 4, which is a lossless compression algorithm. It is important that the algorithm is a lossless compression algorithm in order to preserve the pixel-to-pixel bitmap data captured by the scanner. The database server 14 includes a suitable database for storing image files created by the scanner and its associated software. In another embodiment, the image file is entered into the database as a digital file, eg, a CAD file and similar files. The database stores the entire facility floor plan and the entire structural details, allowing immediate access to the data. As a result, emergency response personnel can take care of the entire building layout and any areas where problems may arise prior to entering the structure.

  The workstation 16 can be any suitable computing device with user interface means such as a monitor, keyboard, mouse, stylus. The workstation can be a desktop computer or portable computing device such as a laptop 28a, PDA 28b, or mobile phone 28c that can display two-dimensional and three-dimensional images. The workstation includes a viewer 240. In the illustrated embodiment, the viewer 240 is a TIFF viewer that can read (ie, restore) and display a TIFF image to a user. The viewer 240 is, for example, LEAD Technologies, Inc. Can be configured using viewer components and tools provided by the company. In particular, LEAD Technologies, Inc. The company provides restoration tools, rubber band tools, display tools, overlay display tools, overlay storage tools, and tag reading tools that can be incorporated into the TIFF viewer. An important aspect of the viewer 240 is that it includes a measurement calculator 22 in accordance with the present invention to calculate the actual scale measurements of line and shape drawing in the viewer 240.

  Printer 18 is a suitable printer capable of printing from workstation 16 and network 24 interconnects the aforementioned devices. Network 24 may include public or private telecommunications and / or data networks, such as local area networks, wide area networks, intranets, the Internet, and / or any combination thereof, and wired and / or It may be wireless. Depending on the connectivity of the network, various methods as described herein can be implemented assuming a distributed computing environment.

  In one embodiment of the invention, workstation 16 is accompanied by one or more docking stations. These docking stations are used to download floor plans and structural details to devices such as tablet PCs 28a, PDAs 28b, mobile phones 28c, and the like. Thus, in addition to being able to print out data, electronic copies can also be used. In another embodiment, the data is transmitted to a PDA, cell phone, or the like using transmitter 26. In one embodiment, the data is transmitted to the heads-up display using Bluetooth technology or similar technology.

  In fact, sending data files to a mobile phone, PDA, or the like is done using existing mobile phone, Wi-Fi, and pager infrastructure. In yet another embodiment, the data can be transmitted on a standard FM signal or on a wired or wireless network that can transmit data packets.

  Referring to FIG. 2, the method according to the present invention is illustrated. As an initial step, the paper document is digitized, as indicated by block 58. This step includes scanning a paper document using the scanner station 12 to create a bitmapped raster image or loading a digital file using an input device. In the illustrated embodiment, the paper document is a drawing. Scale data and physical parameters of the drawing of the paper to be scanned are captured and associated with the bitmapped image. In particular, the original scale information of the paper drawing, the scan DPI, and the original size of the paper are recorded and embedded in the digital image. In another embodiment, the input is input from the file input device 10 that inputs a digital file.

  An exemplary user interface for recording this information is shown in FIG. 3, which shows a Master File Info window 32 for entering the scale and physical parameter data of the drawing of the paper being scanned. . Of particular interest is that the X-DPI field 34 and the Y-DPI field 36 are locations where the direct optical reading characteristics of the scanner used for scanning are recorded. These values must be calibrated to ensure accuracy. The SCN Width field 38 and the SCN Height field 40 are the actual pixel dimensions of the scanned image. The Scale field 42 is where the actual scale of the drawing is recorded as an integer. The entered value can be calculated using the Scale Finder 44, which is given by selecting the Scale Finder button 46. The user simply inputs the scale from the drawing in the correct units, and Scale Finder writes the correct scale value in the Scale field 42. For example, if the scale is “1 inch (2.54 cm) corresponds to 3 feet (91.44 cm)”, Scale Finder writes 36 in the Scale field 42. Similarly, if the scale is “1 centimeter corresponds to 1 meter”, Scale Finder writes 100 in the Scale field 42.

  Note that the information recorded and associated with the digital image file does not necessarily have to be recorded when the image is scanned or otherwise acquired. Also, additional names identifying paper documents such as building name, building owner, drawing date, exact geospatial location, ie latitude and longitude, as shown in the user interface 50 of FIG. Information can also be recorded.

  In the illustrated embodiment, the paper drawing is optically scanned and saved as a TIFF file, and the captured data is stored in the TIFF header using a TIFF header tag. The TIFF tag 50271 is a suitable location for storing scale and physical parameter data. A data structure suitable for such information is as follows.

  Tag 50271 = DBSWWWHHHHAABBSSSSSSSDB

  DBS = digital building floor plan tag (letter "DBP")

  W = width (original image scan width expressed in pixels)

  H = height (original image scan height expressed in pixels)

  A = HDPI (scan horizontal DPI)

  B = VDPI (scan vertical DPI)

  S = scale (scale of document from inch to inch, ie 1 (2.54 cm) “= 36 (91.44 cm)”)

  DB = digital building identifier tag ("DB")

  The Adobe tag 50271 is stored as an ASCII data type having a variable length of 24 characters beginning with any “DBS” and ending with the digital building identification tag “DB”. The width W is the scan width of the image in pixel units. The height H is the height of the image in pixels. A and B are the horizontal and vertical direct optical DPIs of the scanner, respectively. This is the direct optical resolution of the scanner. The scale S is a scale taken from a paper drawing. Alphanumeric ASCII characters with ASCII values in the range from # 48 to # 90 can be used in the data field to avoid data and compression conflicts. In the illustrated embodiment, these values are converted to radix 34 numbers.

  Referring again to FIG. 2, after the digital image file has been created, it can be stored with accompanying entries of the database server 14, preferably in a RAID server or SAN, as indicated by block 60. . However, the digital image file can be stored in the memory of virtually any computing device, including scan station 12, workstation 16, or mobile phone 28c, PDA 28b, or the like. In a preferred embodiment, multiple digital image files are stored together in a central data repository.

  The user can then view the digital image, preferably at workstation 16, as indicated by block 62. The digital image file is transmitted to the workstation via the network 24. The digital image display / viewer 240 can be used to open and display digital images. A digital viewer application should, at a minimum, have some drawing tools and be able to draw at least lines and interconnect those lines to form a shape.

  The user can then use the display / viewer to draw lines or shapes (eg, regular or irregular shapes such as polygons or inverted polygons), or map in and out routes or block The distance as shown at 64 is calculated. The actual scale measurement of the line or the length of the route distance is calculated and posted to the user as indicated by block 66. For example, as shown in FIG. 5, the user has drawn line 70, such as by clicking and dragging the mouse, or dragging the stylus. The actual scale measurement of the line is calculated as indicated by block 66 and presented to the user in the toolbar field 72. Another example is presented in FIG. 6 where the user draws a polygon 74 and the actual scale area of the polygon is presented to the user in the toolbar field 76. Thus, according to the present invention, the digital image viewer 240 has been modified to access scale and physical parameter information embedded in the digital image, and calculates the actual scale measurement of the area of the line or shape. .

  In the illustrated embodiment, the digital image viewer 240 reads the TIFF header tag 50271 and retrieves the scale and physical parameter data. The digital image viewer 240 then sends pixel data defining the user's drawing (eg, line or shape) and scale information read from the digital image header tag to the measurement calculator 22. The measurement calculator 22 then calculates the actual scale measurement using that information and the pixel placement data for the line or shape. The calculated measurements can be presented to the user on the screen in a suitable format or arrangement, but in the illustrated embodiment, the measurements are presented in a toolbar at the bottom of the window.

  For purposes of illustration, several calculations are presented for the length and area of annotations drawn by a user using the drawing tools of the digital image viewer 240 and particularly using a mouse input device.

The length of line 80 is calculated with reference to FIG. 7 as a whole. The user first triggers a calculation with a mouse down event (a line annotation is selected from the drawing toolbar). This event gives the first reference point (X ₁ , Y ₁ ) in pixel units, as illustrated in FIG. When the user releases the mouse button, a mouse up event is triggered. This event gives the second (and last) reference point (X ₂ , Y ₂ ) in pixels. At these two points ((X ₁ , Y ₁ ) and (X ₂ , Y ₂ )), the measurement calculator 22 can calculate the length (in pixels) between them using the Pythagorean theorem. Yes, this is the formula (1)
Length (pixel unit) = ((x ₂ −x ₁ ) ² + (y ₂ −y ₁ ) ² ) ^(1/2) (1)
Given by.

This length is then divided by the resolution of the image to produce a representative plan view, or a representative length (in inches) on the drawing, which is represented by equation (2)
Length (in inches) = (length (in pixels)) / (image resolution (dpi)) (2)
Given by.

This length (in inches) is then multiplied by the blueprint scale (embedded in the header of the TIFF image) to produce the actual length of the line (in inches), which is the expression ( 3)
Actual length = plan view length (in inches) x plan view scale (3)
Given by.

  The measurement computer 22 then sends this actual scale measurement to the viewer 240 for display to the user. If necessary, further measurement conversions can be performed to calculate the required units of measurement. For example, the unit of measure can be converted from inches to feet or meters by simply multiplying by a unit conversion factor.

Next, the area of the rectangle 82 is calculated with reference to FIG. Initially, the user triggers a calculation with a mouse down event (rectangular annotation is selected from the drawing toolbar). This event gives the first reference point (X ₁ , Y ₁ ) in pixels. When the user releases the mouse button, a mouse up event is triggered. This event gives the second (and last) reference point (X ₂ , Y ₂ ) in pixels. At these two points ((X ₁ , Y ₁ ) and (X ₂ , Y ₂ )), the measurement calculator 22 can calculate the area (in pixels) between them using the Pythagorean theorem. This is the formula (4)
Area (pixel unit) = (x ₂ −x ₁ ) ² + (y ₂ −y ₁ ) ² (4)
Given by.

This area is then divided by the square of the resolution of the image to produce the original plan view, or a representative area (in inches) on the drawing, which is represented by equation (5)
Area (inch unit) = (Area (pixel unit)) / (Image resolution (dpi)) ² (5)
Given by.

This area (in inches) is then squared and multiplied by the square root of the blueprint scale (embedded in the header of the TIFF image) to produce the actual area (in inches) of the selected rectangle, This is the formula (6)
Actual area = (plan view area (in inches)) ² (plan view scale) ^(1/2) (6)
Given by.

  The measurement computer 22 then sends this actual scale measurement to the viewer 240 for display to the user. If necessary, further measurement conversions can be performed to calculate the required units of measurement. For example, the unit of measure can be converted from inches to feet or meters by simply multiplying by a unit conversion factor.

The area of the ellipse 84 is illustrated with reference now to FIG. 9 as a whole. The user first triggers a calculation with a mouse down event (an ellipse annotation is selected from the drawing toolbar). This event gives the first reference point (X ₁ , Y ₁ ) in pixels. The mouse up event is then triggered when the user releases the mouse button. This event gives the second (and last) reference point (X ₂ , Y ₂ ) in pixels. At these two points ((X ₁ , Y ₁ ) and (X ₂ , Y ₂ )), the measurement calculator 22 can calculate the area (in pixels) between them using the Pythagorean theorem. This is the formula (7)
Area (pixel unit) = Π [((x ₂ −x ₁ ) / 2) + ((y ₂ −y ₁ ) / 2)] (7)
Given by.

This area is then divided by the square of the resolution of the image to produce the original plan view, or a representative area (in inches) on the drawing, which is represented by equation (8)
Area (inch unit) = (Area (pixel unit)) / (Image resolution (dpi)) ² (8)
Given by.

This area (in inches) is then squared and multiplied by the square root of the blueprint scale (embedded in the header of the TIFF image) to produce the actual area (in inches) of the selected ellipse, This is the formula (9)
Actual area = (plan view area (in inches)) ² (plan view scale) ^(1/2) (9)
Given by.

  The measurement computer 22 then sends this actual scale measurement to the viewer 240 for display to the user. If necessary, further measurement conversions can be performed to calculate the required units of measurement. For example, the unit of measure can be converted from inches to feet or meters by simply multiplying by a unit conversion factor.

The length of the polyline 86 is then calculated with reference to FIG. 10 as a whole. The user first triggers this calculation with a mouse down event (a polyline annotation is selected from the drawing toolbar). This event gives the first reference point (X ₁ , Y ₁ ) in pixels. The user then moves the mouse and clicks (left button) to add additional nodes [(X ₂ , Y ₂ ), (X ₃ , Y ₃ ),. . . , (X _{n + 1} , Y _{n + 1} )]. After the user completes the polyline, double-click the left mouse button or single-click the right mouse button to determine the polyline end point and trigger the length calculation. This gives (n + 1) nodes and (n) line segments for use in length calculation, where “n” is an arbitrary absolute number. This set of points allows the measurement computer 22 to cycle through each node and calculate the sum of the lengths of each line segment using the Pythagorean theorem (each on each line segment). This is the formula (10)

Given by.

This length is then divided by the resolution of the image to produce a representative plan view, or a representative length (in inches) on the drawing, which is represented by equation (11)
Length (in inches) = (length (in pixels)) / (image resolution (dpi)) (11)
Given by.

This length (in inches) is then multiplied by the blueprint scale (embedded in the header of the TIFF image) to produce the actual length of the polyline (in inches), which is calculated using the formula ( 12)
Actual length = plan view length (in inches) x plan view scale (12)
Given by.

  The measurement computer 22 then sends this actual scale measurement to the viewer 240 for display to the user. If necessary, further measurement conversions can be performed to calculate the required units of measurement. For example, the unit of measure can be converted from inches to feet or meters by simply multiplying by a unit conversion factor.

The area of the polygon 88 is illustrated next with reference to FIG. The user first triggers these calculations with a mouse down event (polygon annotations are selected from the drawing toolbar). This event gives the first reference point (X ₁ , Y ₁ ) in pixels. The end user then moves the mouse and clicks (eg, the left button) to add additional nodes [(X ₂ , Y ₂ ), (X ₃ , Y ₃ ),. . . , (X _{n + 1} , Y _{n + 1} )]. After the user completes the polygon, double click the left mouse button or single click the right mouse button to determine the end point of the polygon and trigger the length calculation. It comprises (n + 1) nodes and (n) line segments for use in calculating lengths, where “n” is an arbitrary absolute number. With this set of points, it is possible to follow those line segments in an iterative manner and find the total to date for the area. This area first identifies the baseline below the polygon, then the edges are (1) a single line segment on the polygon, (2) from the rightmost point in the polygon line to the baseline By identifying a trapezoid consisting of a straight line to a vertical baseline, (3) a line segment of the baseline, and (4) a straight line from the baseline to the leftmost point in the line segment (drawn perpendicular to the baseline) Calculated. The area of the trapezoid is given by equation (13)

Calculated by

This area is then divided by the square of the resolution of the image to produce the original plan view, or a representative area (in inches) on the drawing, which is represented by equation (14)
Area (inch unit) = (Area (pixel unit)) / (Image resolution (dpi)) ² (14)
Given by.

This area (in inches) is then squared and multiplied by the square root of the blueprint scale (embedded in the header of the TIFF image) to produce the actual area (in inches) of the selected rectangle, This is the formula (15)
Actual area = (plan view area (in inches)) ² (plan view scale) ^(1/2) (15)
Given by.

  The measurement computer 22 then sends this actual scale measurement to the viewer 240 for display to the user. If necessary, further measurement conversions can be performed to calculate the required units of measurement. For example, the unit of measure can be converted from inches to feet or meters by simply multiplying by a unit conversion factor.

  The present invention allows a user to display a file during an emergency situation. For example, if a firefighter is dispatched to a burning structure, the firefighter downloads a digital file to a PDA or the like so that the entire structural layout of the building can be viewed. In one embodiment, a first user at a workstation sends routing or other information to a second user within the structure. The second user receives this information on a PDA, mobile phone, tablet computer, head-up display, or the like.

  In one embodiment, the user views the drawing on a viewer 240 such as a computer, laptop 28a, PDA 28b, or the like. From the blueprint presented on the PDA, the user (emergency response personnel) can obtain an accurate measurement of the floor area and distance between the entrance, exit, and target location. In addition, the system has full scaling capabilities. By using this enlargement / reduction function, the user can zoom in and out on a specific area and adjust necessary details. In one embodiment, when zooming, the user selects an area to zoom using a zoom tool. Alternatively, the system zooms in around a particular area by a preset increment, i.e., 10%, 20%, 30%, by simply tapping within the desired zoom area with a stylus. Note that scale accuracy is maintained no matter how much the user enlarges the display.

  The system displays details about stairwells, elevators, entrances, exits, shafts, building management systems, cooling units, reserve power, emergency command centers, evacuation areas, and the like along with measurement results Can be visualized and calculated. In addition, the location of sprinklers, fire extinguishers, hose hookups, risers, HVAC systems, and electrical inspection panels can also be shown in the layout. In yet another embodiment, dangerous substances can also be displayed.

  In one embodiment of the invention, the building security system is networked. The security system can provide data such as active alarms such as fire alarms, smoke alarms, carbon monoxide alarms, smoke alarms, and the like. In this way, an emergency response worker can determine the problem area and the potential rescue situation. In addition, building motion sensors can be connected to a network to track people in the building and thereby enhance rescue efforts. For example, a GPS locator can be used to track people and equipment. Alternatively, if a hostage situation exists, the police may use this data to plan a terror mitigation or asset recovery mission.

  FIG. 12 is a diagram of data display according to an embodiment of the present invention. As shown, the display can be zoomed in so that the user can recognize the desired level of detail. In a preferred embodiment, a cursor is used to select a start point and an end point 110 such as the entrance passage 116. The system is programmed to calculate a route from 116 to 110. Two routes are shown in FIG. The first route 102 is shown from the entrance passage 116 to a point 110 in the back office. The second route 104 is shown from the entry point 116 to the utility closet that houses the PBX and hub. In one embodiment, elements such as outlet 114, switch 118, and telephone outlet are shown. Other elements such as electrical conduits, HVAC systems, and plumbing systems are also shown. The display shows data from motion sensor 100, heat and smoke alarms, and door and window sensors, and these alarms and sensors are tied to the display.

  In one embodiment, a kiosk 120 is present. Building visitors use the kiosk 120 as a guide. In one embodiment, the customer uses the kiosk as a directory. The customer selects the desired location on the graphic, for example, by selecting the desired office 110 or from a directory listing. In any case, the route and, if necessary, the route adjacent to the area of interest such as the placement or danger of the building are displayed.

  The user can use the zoom tool 108 to zoom in and out of a particular area and adjust the necessary details. In one embodiment, when zooming, the zoom tool 108 selects a specific area to enlarge. Alternatively, the system expands by a preset increment, ie 5%, 10%, 15%, etc., using the selected area as the center of the area to be expanded. In another embodiment, the preset increment is selectable by the user. Note that the exact scaling of the image and the exact scaling of all measurement results are maintained at each magnification point.

  As mentioned above, the system and method according to the present invention can receive a paper-based original drawing and construct a scaled digitized image that allows accurate point-to-point measurements and routing. it can. The above embodiments are given, for example, for the purpose of teaching the method and system of the present invention. The invention is not limited to these embodiments, and those skilled in the art can make various changes and modifications within the spirit of the invention as defined in the appended claims.

  Also, as noted above, the present invention includes, but is not limited to, firefighters, emergency response, command and control personnel, police officers, workers such as EMT, electric gas and water, military and building operations, It can be used by administrative tenants and those who own and even include equipment engineers. In one embodiment, the present invention may be implemented for urban emergency response facilities that have access to local, federal, and state fire, police, and emergency service users.

  Another method according to the present invention is illustrated in FIG. At block 200, the document is scanned or otherwise digitized to capture the image scale information of the original document, the DPI of the scan, and the original paper size and embed them in the digital file header of the two-dimensional digital raster image. . A scanned document may include a floor plan from a collection of buildings, as a single building or more likely.

  Actual scale 3D virtual digital model rendering (also referred to as 3D digital image or 3D digital rendering) is created based on a 2D digital raster image. In particular, a scene graph that is subsequently used to annotate a 2D digital raster image using a viewer and associated toolset manually or through program steps, thereby generating an associated 3D digital image. The 2D annotation characteristics and position are converted programmatically to create See block 205. A scene graph lists objects, characteristics, and transformations that describe a 3D digital image. The scene graph is organized by loose groups of similar object types rather than a specific order of objects.

  After creating 2D digital raster image files and 3D virtual model files, each file is organized and individually associated using the file system in the database server 14, the memory of the computing device, or a central data repository. Can be stored as a file. See block 210. Individual documents are stored on the file server and associated with database records. Documents are preferably organized in a database by building and floor, or by some world-wide criteria.

  The user can search the database for digital image files to display on the workstation 16 using a computer or laptop 28a or the like. See block 220. Users of the database can identify and display individual digital floor plans or groups of digital floor plans. The database can be located on a closed network, a web-accessible network, or a local computing device that does not have network connectivity.

  The user can query the database to identify specific digital images or groups of digital images, such as entire 3D buildings, digitized floor plan documents, or individual floor 3D scenes (block 230). . The selected digital image file is then distributed to the workstation via the network 24 and displayed on the dual 3D / 2D digital image display / viewer 240 in proportion to the original size. The digital viewer 240 includes, but is not limited to, a synchronized graphic rendering device, a synchronized user interactive graphic display, a linked graphic representation, a real-time event link display mechanism, a synchronized horizontal display surface, a synchronized holographic display, a synchronized graphic. Screens, dual monitor head-up displays, autostereoscopic displays, and immersive graphic environments can be included. In one embodiment, the digital image file is pre-loaded onto the mobile computer system with 3D-compatible video graphics hardware and software.

  The digital image display / viewer 240 can open and render the digital image file and retrieve the original image / document scale information embedded in the 2D digital image header. The digital image display / viewer 240 has a multi-document interface with display means, windows, or viewports that are linked and adjusted and can be viewed simultaneously.

  FIG. 14 shows an exemplary user interface of the display / viewer 240, which includes an application shell 243, two document viewports (a 3D window 342 with 3D graphics enabled, and a 2D graphic). An enabled 2D window 244), a basic drawing toolset, and a menu interface to activate functions and interact with 3D and 2D displays. Both the 3D window 242 and the 2D window 244 can be resized and positioned according to user preferences. In one example, the 3D window 242 occupies 40% of the left side (LVP) of the display / viewer 240, and the 2D window 244 occupies 40% of the right side of the screen (RVP).

  The image displayed in the 3D display 242 is an actual scale three-dimensional digital rendering first seen as a ground plan view, and the user perspective is parallel to a flat portion of the document surface. The viewing angle can be changed manually and can be rotated on the X, Y, or Z axis to allow the user to obtain a view perspective with the desired angle or height. See FIG. The image displayed on the 2D window 244 is displayed perpendicular to the surface of the document. For example, a 2D scaled digital floor plan or architectural drawing view is displayed in a floor plan that is maintained when the document is zoomed, rotated, or manipulated in some other way. The A 2D digital raster image is a master file, actual data, and is the starting point for the data when scale data is embedded and read from a digital image rendered at this location for both 3D and 2D windows.

  The simultaneous viewer 240 serves as a tool that provides the user with increased awareness of the situation or environment and overall intelligence information of the structure shown in the drawing. The user can manipulate the digital image using the simultaneous viewer 240 using the tools used with the viewer 240. For example, the user identifies the start and end points on the image displayed in the selection window (block 250) and uses the shortest path tool to constrain or limit the end point and start point in the context of the building image. Find the fastest route between two graphic-marked / user-selected points without (block 260), select a stairwell, and then structure that stairwell down from the building floor An attack that can only be used as a evacuation stairwell that can only be used for a calculated route through an object and / or for a calculated route that passes through the structure from the building layout. Set as a stairwell and force the Shortest Path tool to use that stairwell as the first node in the route calculation (Block 265), calculate the shortest path between points using the shortest path algorithm and embedded scale information, display the total distance (Block 270), 3D window 242 (Block 280) and The shortest path schematically shown in the 2D window 244 (block 285) can be displayed graphically, and the actual scale measurement result of the shortest calculated path can also be displayed (block 290). In addition, the calculated path data, ie graphic display data and actual scale path measurement data, can be selected in the 3D window with a mouse command to the calculated path for later retrieval and use. An application dialog is displayed that allows it to be named and saved (block 295).

  Creating a 2D digital raster floor plan image

  Referring again to block 220, it can be seen that the scanned document produces an actual scale 2D digital image that is displayed in the 2D window 244. The captured scale data is embedded in the TIFF header of the 2D digital image. Each object represented in the 2D digital image of the 2D window 244 is represented by a 2D primitive, usually a line for a wall, or a rectangle for a door, window, or other object. The shape represented by the digital image in the 2D window 244 may be either 2D-only data (data that does not have a 3D-related representation) or data that includes a 3D-related representation, also referred to as a 3D-related object. it can. A 3D relationship object has additional information related to the type that cannot be realistically displayed in the 2D window, orientation, position away from the ground, and the height of the object.

  Creating a real scale 3D virtual digital model image

  As noted above, the scale information embedded in the original raster 2D floor plan is also used to construct the actual scale 3D digital model image, and in particular the scale information is associated via the scene graph. To a 3D virtual model. The 3D relationship object data graphically superimposed on the original 2D digital image displayed in the 2D window 244 is used to create a 3D digital image / 3D digital rendering displayed in the 3D window 242. Each object in the 2D dataset is evaluated to extract information contained in the 3D related object and a predefined model associated with that object is added to the scene graph. (The 2D data annotation object representing the wall is independent and does not have an associated model. The 2D wall annotation is extruded directly into the actual scale 3D geometric element.) Then, using the position coordinate information The 3D objects are arranged to create a 3D object data structure, and a pointer to the 3D structure is added to the associated 2D object data set.

  Using a 3D digital image, the user manually navigates the 3D virtual model of the building using a computer mouse and virtually walks through the model rooms and corridors displayed on the 3D window 242. Can do. Using a 3D window camera with a 3D window 242 assists in displaying the path taken in the 3D virtual model. The 3D window camera can define a view of the structure presented in the 3D window 242 and set it to a location to render the scene from the camera perspective. The path taken in the 3D virtual model can be seen as if the virtual moving camera is located on the person's head.

  Display / viewer 240, 3D window 242, and 2D window 224 are designed to work in concert. For example, 3D window 242 and 2D window 224 may be child applications of application shell (parent application) 243, or two separate applications may be tied to a third application, or all three. Tie together applications. As a result, using the display / viewer 240, the user can only simultaneously view the 2D digital image of the floor plan in the 2D window 244 and the associated 3D digital model image of the structure and objects of the floor plan 242. Alternatively, actions performed in one window can be synchronized in real time and displayed in the other window. Further, by using tools used with the display / viewer 240, the user can manipulate or derive information from the digital image. As an option, utilizing the present invention, the user can open one window 242 (see FIG. 15) or 244 (see FIG. 16) and manipulate the digital image using only the open window. Can do. All changes or other inputs made in the open window are for example the parent application if the parent application is used to manage all changes made in the 3D window 242 and 2D window 242 243 (see FIG. 17) and relayed when reopened in a closed window.

  The 3D window 242 and 2D window 244 of the display / viewer 240 are true to scale, match in terms of coordinates, and are linked in real time, resulting in interaction between the images in the respective 3D and 2D windows 242, 244. The mechanism for maintaining the exact synchronization of the object is achieved by associating the scale, selection event, and coordinates from one window 242, 244 with the other window 244, 242 respectively.

  Synchronize using scales

  As described above, the original image / document scale information is embedded in the digital image header. This data is retrieved and used by the digital image viewer 240. Since the 3D digital image is associated with and based on the 2D digital image, the actual scale values are the same in the two windows 242, 244. In some embodiments, the scale between the windows 242, 244 may be different. In such a case, an algorithm for converting the scale from one window to the other may be used.

  Synchronize using selection events

  Selection event synchronization takes advantage of the fact that movement or repositioning (user input) of each object generates a software selection / conversion event. From these selection events, an identified and updated location for the object is obtained. Depending on which window the user uses, selection events or actions triggered by the user in one window are repeated simultaneously in the other window (causing redrawing). In general, when an object is moved, the selected object is flagged and the 2D selection event list catalogs each flagged / selected object (the selection event to be logged). And affect the update using the 2D selection event list in the corresponding window. There are variations in this process depending on which window is used to generate the selection event.

  Changes made to objects in 2D windows

  If the user makes a change to one or more objects in the 2D window 244, the selected object is flagged and the flagged object is placed in the 2D selection event list. The Idle State Processing Program is part of the parent application and is then used to update the 3D digital image. For example, when deleting an object from a 2D window, the Idle State Processing Program looks in the 2D selection event list in order, checks the flagged object, and supports the flagged 2D object in the scene graph. Delete the 3D representation. The 3D data is deleted when converted from the actual 2D data when the 3D digital model image is updated.

  The 2D selection event list containing the updated information is then repeatedly referenced to generate a new 3D object and place it in the scene graph. Therefore, in order for changes to the 3D representation of the object to take effect, it must be placed in the scene graph, its data updated, and the scene graph re-rendered. If the scene graph is organized as a loose group of similar object types, object replacement is straightforward and efficient. The scene graph can be manipulated not to re-render the entire scene, only the affected objects that will be recorded even if they are updated.

  To prevent thrashing (excessive re-rendering on every object move), the Idle State Processing Program is only used when the system detects an idle state in the application, such as when there is no selection event, change, or input from the user. It is activated. Here, when the Idle State Processing Program is opened, changes are made to the scene graph to update the 3D digital image. Unnecessary changes are further controlled by tracking which objects are selected. Both 3D and 2D datasets contain a list of currently selected objects, only the objects in the smaller list are changed. Therefore, after the 3D digital image is updated, a flag is set to prevent a 3D side change selection event from triggering a 2D side change.

  Changes made to objects in the 3D window

  As the user moves or rotates an object in the 3D window 242, a selection event is triggered and flagged by the 3D selected object in the scene graph to create a 3D selection event list. Selection events that occur within the 3D window 242 have object identification and transform information for the action to be performed. The transformation is new X, Y, and Z position and rotation angle information applied to the 3D object. The transformation is applied only to the selected 2D object (s) in the 3D selection event list. Here, unlike the change initiated in the 2D window 244, the selected 2D object data is not deleted, but rather is modified directly since the 2D data is processed as real or source data.

  The selected 2D data is updated using known magnification and position and orientation information necessary to correctly show the 2D digital image or representation in the 2D window 244. Additional information such as z-axis rotation or vertical position information cannot be shown in the 2D window and is stored in the object's dataset.

  Again, a change is made in the 2D digital image background to perform an update after the Idle State Processing Program detects that there is no activity, and the new location of the already updated 2D digital image component is further 3D. Set a flag to prevent the selection event from being triggered.

  Synchronize using coordinates

  The matching function for the coordinates of the dual 3D / 2D image display / viewer 240 is based on a mathematically accurate grid system that is not rendered. Each of the 3D and 2D digital images has an unrendered grid located on top of it, which reflects the exact pixel dimensions of the document. The coordinate system of each window in the display / viewer 240 is linked as a 0,0 point to a common reference point or cross-reference point, usually the upper left corner of the floor plan.

  Thus, a 2000 W x 1500 H pixel document has a corresponding 2000 x 1500 spatial grid on it. This grid is a calculated virtual entity that is not drawn or seen and can extend indefinitely on any axis. When the entire document is displayed at 0% zoom, the upper left corner of the document is 0Y (vertical axis), 0X (horizontal axis), and 0Z (three-dimensional axis) if applicable.

  The link of the coordinate positions of the data objects displayed in the respective 2D window 244 and 3D window 242 of the display / viewer 240 depends on the grid that is not rendered. Coordinate system links form a bidirectional relationship. Thus, if an object is moved or annotated in the 3D window 242 manually or programmatically, the corresponding 2D graphic representation in the 2D window 244 approaches at the same time, and vice versa.

  In a coordinate system specific to the display / viewer 240, selected shapes, lines, or points can be marked with links by graphically coloring individual sets of pixels. In fact, the point marker may be as small as 1 pixel W × 1 pixel H. Since pixels have a critical size that cannot be divided, the graphic representation of lines and shapes is always an estimate.

  A coordinate system can define relative positions and correspond to other relative or arbitrary positions. The coordinate system of the present invention may even correspond to a position in the real world defined by coordinates of a geodetic system including latitude and longitude, for example, an external system such as a GIS system. The display / viewer 240 can receive coordinate input from a third or external coordinate system as long as the external coordinate grid and scale can be transformed by the coordinate system shared by the windows 242, 244. Such a transformation is done by transforming scales of essentially different coordinate systems and defining at least one common reference point. Preferably, a plurality of common reference points are set.

  By using an external coordinate system, a user utilizing the present invention receives coordinate data that describes the position of an asset or object based on a geodetic system and displays those coordinates on a 3D window 242 and a 2D window 244 representing a structure. Can be converted to the exact position.

  In fact, the points defined graphically in the 2D window 244 appear to have specific coordinate positions because the actual scale measurement size relative to the grid is obtained from the scale data embedded in the digital image header. Can be calculated.

  In the present invention, the contextually and structurally linked image information is combined to allow the user to have a high situational awareness of the structure and to navigate within the structure based on intelligence information. For example, the user can see the actual scale space environment in the 3D window 242 (with what the room looks like) as well as the exact actual scale as shown in the 2D image displayed on the 2D window 244. The orientation (with respect to the end point / target) and the current position within the building can be confirmed simultaneously.

  Duality and simultaneity linked to the coordinates of the 3D / 2D display / viewer 240 when combined with the tools of the viewer 240 allows the user to interact with the digital images in the respective windows 242, 244, thereby making the environment more It can be accurately grasped. The user draws a route, experiences the route (virtual walkthrough), describes the environment of the route in the virtual walkthrough, checks the real-time location indicator for asset placement in the 2D viewport, The actual scale measurement result of the navigation path between or displayed and saved can be obtained. Also, once a 3D image navigation of the structure can be recorded, this can be made distributable using standard video file output.

  tool

  Tools used in conjunction with the display / viewer 240 include, but are not limited to, a basic scale measurement calculator 22, a basic drawing tool set that allows accurate colored annotations to be included in a digital image, Find Shortest Path Tool 300, Path. Barrier Tool 360, Door Detection Tool 330, and Evacuation Simulation Tool. These tools are managed by the parent application 243 and can be used in either window 242, 244.

  Drawing tools

  As described above, the drawing tool 410 allows the user to configure lines, shapes, and points with vector or raster graphic drawing. These drawings are then presented on the original drawing, the layer above the digital document. Using the display / viewer 240 of the present invention, a user can draw a path on the 2D window 244 using a basic drawing tool and have the same path rendered programmatically in the 3D window 242. Can do. The path shown in the 3D window is contextually correct, true to scale, and reflects the exact measurement results of the structure. The route that is virtually walked in the 3D window 242 can be recorded, saved, and played back as an image generated as a user-generated animation as described below.

  Find Shortest Path Tool

  Referring to FIG. 18A, Find Shortest Path Tool 300 uses an algorithm to automatically calculate the shortest path between selected points in either a 3D window or a 2D window, and use that path as an image. Allows plotting. This Find Shortest Path Tool operates in the form of transforming the map matrix and distance / area data present in the floor plan image of the digital document, and automatically calculates its shortest path. The actual scale measurement of the calculated shortest path and the associated path is known and can be calculated as a result of the scale embedded in the header of the TIFF image.

  In fact, the user selects the Find Shortest Path tool 300 and then graphically marks the start and end points on one digital image in the selected window. For example, emergency response personnel may mark the start point 302 as being a doorway in a building, the end point 304 as being a computer lecture room that is said to be a victim or hostage, and the Find Shortest Path tool. 300 can be used to calculate the shortest path 306 between the two points. See Figures 18A and 18B. The tool 300 can be used on a single floor, as shown in FIGS. 18A and 18B, or across multiple floors, for which the Find Shortest Path tool is shown in FIG. 18C. See 301. When the tool 301 is used across multiple floors, it identifies and traverses a collection of building specific emergency stairwells, entrances and exits when calculating routes. See FIG. 18C showing the start point 312, end point 314, and route 316.

  Tools 300, 301 may assist emergency response personnel or other personnel to navigate from the doorway to the stairwell, even when the building floor is visually or physically blocked. it can. This Find Shortest Path tool can be used to determine the fastest route to an evacuation site inside a building even when emergency response personnel are not on site or without prior knowledge of the building's internal structure. Save valuable time.

  In a preferred embodiment, the shortest path is represented in the 2D window 244 by a colored line 306 that follows the exact calculated path through the structural drawing and in the 3D window 242 by a red 3D floating polyline shape 308. The See Figure 18B. An image display of the actual scale measurement path is also shown. After the path is calculated and plotted as an image in both 3D window 244 and 2D window 242, the user positions the 3D window camera at the preferred structure entry point and easily visualizes and identifies the starting position of the shortest path. be able to. The shortest path marker and route instructions may be communicated to the fire brigade or acquired by the fire brigade itself on site. In addition, the calculated route is automatically played as a walk-through animation, which allows emergency responders to see the entire route and all building structural elements, objects of interest, and dangerous goods on the road can do.

  Path Barrier Tool

  FIG. 19 shows a Path Barrier Tool 360 used to graphically mark passage obstacles and hazards that prevent passage through a particular area, or as a general hazard marker. The user selects the Barrier tool and then graphically marks the affected area in any window and programmatically scales the visual “Do Not Enter” marker into the window dataset. Trigger placement. This action changes the visual geometry of the 3D scene 364 and 2D scene 362, respectively, and mathematically modifies the map matrix configuration used by the Find Path Tool.

  After the obstructed area is marked in at least one of the images or renderings, the present invention recalculates the shortest path option automatically or manually, fully considering the reduced route option, Can be rendered visually. This tool 360 utilizes real-time events and the user interaction of the present invention to instantly and accurately update tactical response plans and instructions, and to convert map and measurement data into field-specific real-time contextual intelligence information. Can be used by emergency response personnel.

  Door Detection Tool

  The Door Detection Tool 330 can be used with, for example, the 3D window 242, and can be used to automatically and programmatically count the doors in the selected route, or be virtual by the user of the present invention. Handed over. See FIG. The count to date can be displayed in a 3D window and shown to the user of the tool. For example, a dialog box may appear, showing each of the left door count 332 and the right door count 334. The total account account can be communicated to the fire brigade or acquired on site by the fire brigade itself. The fire brigade can also use the Door Detection Tool to count the number of doors or determine the placement of the doors in the selected route and confirm that they are on the right route. Thus, the Door Detection Tool also helps to mitigate navigation through low visibility environments.

  3D Record Path Tool

  The display / viewer 240 can also use a 3D Record Path Tool 350. See FIG. The tool 350 is best used in the 3D window 242, but with some modifications, the tool 350 can be used in the 2D window 244.

  Using the 3D Record Path Tool 350, the application user can record all virtual movements and scenes displayed in the 3D window 242 in an image. When the 3D Record Path tool is turned on, the actual scale start point 352 of the 3D camera in the 3D digital image, the exact path taken 354, and the current position 356 are shown in the 2D window 244. At the same time, it is displayed graphically in real time. The 3D window 242 shows a 3D view of the path 354 shown in the 2D window. Reference numeral 358 shows a 3D view taken at the current position 356 of the path 354 shown in the 2D window 244. Thus, as the user walks virtually through the 3D floor plan model, the user's virtual position is directly related to the exact coordinates on the original 2D floor plan. In addition, an accurate actual scale measurement of the path length can be shown in the measurement box 400.

  The visual marker used in the 2D window 244 may be a red line drawn in the visual layer above the 2D image. The red line essentially follows the path that the user walks in the 3D view, plotting marker points or root nodes along the way. By using the measurement dialog with the present invention, it is possible to display the exact measured length of the path recorded in real time using the embedded scale data.

  After the 3D Record Path tool is stopped, the user not only sees the exact path taken with the start and end points, but also plays a virtual 3D path walked within the 3D window 242, or the entire 3D image sequence, , Standard video. It can be stored and distributed in avi, mp4, or various other standard video formats.

  The 3D Record Path function can be used in a variety of situations and contexts. For example, a user can create a virtual model that is accurate and proportional to the original floor plan of a museum by scanning a paper drawing of a section of the museum. When creating 3D digital images, furniture, sculpture, and wall-mounted artwork can be accurately modeled and represented in a 3D museum floor plan. The application user can then walk through the virtual 3D museum and launch the 3D Record Path tool to display an accurate image representation (or video) of the route taken. This will guide museum visitors to museum exhibitions, or an accurate museum layout and artwork from another country, even if they are not physically present at the museum where the remote museum curator is displayed Can be used to be able to see the layout. This tool can be used not only to market materials and virtual art exhibitions, but also to host the entire art exhibition from a remote location without the cost of a local visit.

  In another example, emergency response personnel can use the 3D Record Path Tool to gain extremely valuable insights into the building's internal layout during emergencies. Using 3D Record Path Tool, tactical information gathered in the field can be used in conjunction with a 3D floor plan model to give users detailed, full-scale image guidance of the evacuation site Can be. Using this tool, the user can also plot the entrance or exit route in the structure, automatically display the full length of the route in real scale 3D animation, and can only be visualized using the present invention, Navigation paths can be adjusted according to intelligence information based on architectural and risk factors that can be incorporated into the digital image. Visualization of these recorded 3D floor plans can be used to make further tactical decisions based on the information being rendered and the novel way of presentation under command and control, or local emergency response It can be sent to the site as advance planning guidance for personnel. All of these uses retain accurate scale and measurement data throughout because the scale is embedded in the TIFF header. It should also be noted that raster images created using the tools of the present invention are transmitted from one source to another while maintaining the actual scale throughout the entire process and end user activity.

  Evacuation Simulation Tool

  By using the Evolution Simulation Tool, the user of the 3D / 2D synchronous viewer 240 can extend the data calculated by the shortest path tool 300 to a larger simulation. In essence, after the shortest path is calculated by the Shortest Path Tool 300 and the path is graphically displayed in the 3D and 2D viewports, the end user selects a path in the 3D or 2D window and through the right-click menu New functions can be activated.

  The Evacuation Simulation tool uses population density data encoded in the 3D / 2D data set of the building to describe the number of people near the shortest path starting point. The Evacuation Simulation tool then calculates the dimensions of the surrounding area and the area with the estimated population using the actual scale size information embedded in the tiff header. The Evacuation Simulation tool can then be used in conjunction with a virtual crowd simulation, point particle method, or swarm algorithm in the population density data along the calculated actual scale shortest path through all structural obstacles to the final path position. Calculate the time required to move the estimated total number of people encoded. The user simulates / selects either the time of day or event description that will change the estimated population density data in the 3D and 2D datasets of the building. The simulator then considers the prepared density information for the various parts of the building that the path traverses. A time estimate is returned and displayed for the last use and for the function of performing video playback showing the situation where a virtual group of people moves along the evacuation route.

  Each of the above tools can be used alone or in combination. For example, the user can use the Find Shortest Path Tool 300, 301 and 3D Record Path Tool 360 together to not only follow the shortest path in one window that is simultaneously plotted in the corresponding window, but also from 3D digital rendering. It is also possible to display a moving image in which the selected route taken is recorded.

  Using the present invention, the user can manually record the presence of additional hazards, obstacles, or other data pointed out in the field on a digital image or be recorded from the 3D Record Path Tool. It is also possible to record while viewing the playback of the 3D virtual path. This additional information can then be distributed / relayed to other emergency response personnel located inside or inside the real-world building location or otherwise in a location where the building can be quickly entered and exited. This capability allows emergency rescue team leaders and command and control personnel to continuously update their response plans as new information is obtained using the present invention. Some information is not available to end users without using the present invention.

  Track real-world emergency response personnel

  Use real-scale, coordinate-matched, real-time linked 3D / 2D image dual display / viewer 240 to track real-world objects (assets) while simultaneously locating their locations in 2D On the floor plan, it can be graphically marked as a corresponding object in the 3D window 242. With such a combination of contextually relevant visualization environments, two independent streams of data can be converted into a single piece of coherent information.

  In fact, emergency response personnel can be equipped with transmitter / receiver devices. These devices use positioning methods to identify where the asset is relative to some scaled coordinate-based system. For example, as described above, asset coordinates can be obtained with respect to a GPS geodetic system, or with respect to a local placement grid that creates grid entities and links asset positions to coordinates within the local grid.

  For example, emergency response personnel may receive or receive location or identification signals for receiver locations that are external to the building or receivers that are already in a structure that can be equipped with disaster signal repeat and amplification units. It can be equipped with a GPS device that can transmit. These signal repetition and amplification units are designed to pick up low intensity / low power personal GPS device signals and retransmit them to an external receiver to calculate location data.

  In another example, emergency response personnel can be equipped with a wireless transmitter and receiver, which can be referred to as an asset tag. In a system known in the art, a local mobile transceiver set connected to a computer transmits radio signals and receives signals returned from asset tags. In the present invention, triangulation or polygonal survey methods known in the art can be used in detecting the coordinates of assets or emergency response personnel. Depending on the type of system implemented, the asset tag location can be determined for the local grid in various ways depending on the type, strength, and broadcast reach of the asset tag and receiver station.

  After the position of the object (such as the position of emergency response personnel) is calculated using the method described above, the coordinate grid and scale can be transformed to align with the coordinate system of the present invention. A reference point common to all coordinate systems is set so that the position can be plotted with respect to this point.

  Asset coordinate data for emergency response personnel can be rendered graphically simultaneously using the 3D / 2D image dual display / viewer 240 of the present invention. When the asset location coordinate data is updated, the location of the object or emergency response personnel is also updated in the 3D and 2D digital images.

  Using the display / viewer 240 and the tools of the present invention, the user can view contextual 3D / by allowing the user to see the position of the rendered object (or asset) in a way not possible with the prior art. A 2D visualization environment can be grasped. The present invention is also useful as an analysis tool. For example, when navigating through a structure in a situation where the asset is faulty, dangerous, or visually impaired, the direct danger, the rate of route completion, and local conditions have changed Alternative routes to can be evaluated and addressed by the information transformed by the present invention.

  The invention is illustrated using the following non-limiting examples.

  There is a report of a fire on the third floor of a four-story structure. Emergency responders use the laptop 28a to access floor plan data for a building that has fired on site or on its way to the building. After the floor is identified, the emergency response personnel can use the display / viewer 240 to open the desired digital image and manipulate the data in several different ways that can all be performed simultaneously.

  The user uses the 2D window 244 of the digital image display / viewer 240 to identify all entry and exit points of the structure and selects the Find Shortest Path Tool to provide the shortest fastest from the floor to the exit point. A route can be determined. After the path is calculated and plotted as an image in both the 3D window 242 and the 2D window 244, the user places the 3D window camera at the preferred structure entry point or its current position in the building and displays the calculated path Can be made. The 3D Record Path tool can be used at this point to record the path taken in the 3D digital image of the building (3D virtual model). This video can be played or distributed to other emergency personnel in a wired or wireless manner. Although specific to the standard video format that is created, the end user of the user-generated content converted by this type of system need not be the system user himself to share the intelligence information from the image.

  If the real-time local date received by the emergency response personnel indicates that the route indicated by the Find Shortest Path tool is obstructed or cannot be taken, the user can use the Find Shortest Path tool The route can be changed by calculating another route to the exit point. Using the paired Barrier Tool 360, the user can mark hazards / obstacles identified by local emergency response personnel in a 3D or 2D window and simultaneously insert an image representation of the obstacle in proportion to the original size Can be triggered. This image representation can be an actual obstacle or textured geometry that is mapped using world standard emergency symbols. The user modifies the data parameters of the mapped environment and eventually marks multiple, scaled barriers that affect the measured route options calculated from intelligence information and the underlying document image data be able to. Finally, to assist emergency response personnel in the process of finding smoke-filled floors, the Door Detection Tool can be used to count the number of doorways or entrance passages until the desired end point is reached. . This data is essential for visually impaired environments where tactical validation is required for navigation. This data can be found in almost any typical architectural floor plan, but manually along the desired route so that the data is meaningful or provides useful intelligence information. Must be a table. By using the present invention, such a significant drawback of the prior art can be overcome.

  Emergency responders equipped with receivers / amplifiers inside the building and involved in internal attacks or as part of a rescue company in a fire hot zone are equipped with GPS devices or radio transmitters. External personnel visually track the exact coordinates of emergency response personnel within the third floor of the building and verbally command new emergencies or changes in the emergency or system The additional information based on the image display may be used to assist emergency response personnel in dealing with conditions that are discovered inside the building and reported to external personnel.

  Many modifications and other embodiments of the invention described herein will occur to those skilled in the art to which the invention pertains utilizing the teachings presented in the foregoing description and the associated drawings. Is. Accordingly, it is to be understood that the invention is not limited to the specific embodiments disclosed, and that modifications and other embodiments are intended to be included within the scope of the appended claims. Will. Although specific terms are used herein, these terms are used in a general and descriptive sense only and are not intended to be limiting.

Claims (22)

An improved method for providing digital raster image information comprising:
Digitizing a paper document to create a digital raster image;
Recording scale information associated with the paper document and the digitizing device;
Embedding the scale information in a header of the digital raster image;
Storing the digital raster image as a first file, wherein the embedded scale information is embedded in the header of the first file;
Rendering the digital raster image with a digital image viewer, the improvement comprising:
Creating a three-dimensional rendering of the digital raster image, the three-dimensional rendering having a three-dimensional coordinate system;
Storing the three-dimensional rendering as a second file;
The digital raster image has a two-dimensional coordinate system;
The 3D coordinate system and the 2D coordinate system are matched and linked in real time;
An improved method characterized in that the digital raster image of the paper document and the three-dimensional rendering of the digital raster image can be displayed simultaneously.   The improved method of claim 1, wherein a three-dimensional coordinate system matches the two-dimensional coordinate system with respect to coordinates.   The improved method of claim 2, wherein each of the three-dimensional coordinate systems corresponding to the two-dimensional coordinate system is linked to form a common coordinate system.   The improved method of claim 1, wherein a three-dimensional coordinate system matches the two-dimensional coordinate system with respect to selection events. An improved system for presenting information of digital raster images,
A digitizing device that digitizes a paper document to create a two-dimensional digital raster image, wherein scale information associated with the paper document is recorded and embedded in a header of the two-dimensional digital raster image. A digitizing device;
A digital image viewer capable of receiving input from a user, including a start point and an end point, which receives the two-dimensional digital raster image and renders the two-dimensional digital raster image in a two-dimensional display means in proportion to the original size;
A processor for calculating a route from the start point to the end point, and the improvement comprises:
The digital image viewer generates a three-dimensional rendering based on the two-dimensional digital raster image, and the three-dimensional rendering is proportional to the original size in the three-dimensional display means, and the three-dimensional display means is a part of the digital image viewer. Including
The 3D rendering uses the scale information recorded and embedded in the header of the 2D digital raster image;
An improved system wherein the 3D rendering is matched and linked with the 2D digital raster image in real time.   6. The improved system of claim 5, wherein the three-dimensional rendering comprises a three-dimensional coordinate system that matches in coordinates with a two-dimensional coordinate system of the two-dimensional digital raster image.   The improved system of claim 6, wherein a three-dimensional coordinate system matches the two-dimensional coordinate system with respect to events.   A Find Path Tool, the Find Path Tool can identify a first shortest path between two points marked graphically on the digital viewer, and the first shortest path is between the two points. 6. The improved system of claim 5, wherein the system is the fastest path and the actual scale measurement of the first shortest path can be displayed on the digital viewer.   The Find Path Tool can specify a second shortest path between the two points when the first shortest path is not available, and the second shortest path is a second path between the two points. 9. The improved system of claim 8, wherein the fastest path and an actual scale measurement of the second shortest path can be displayed on the digital image viewer.   6. The improved of claim 5, further comprising a Door Detection Tool, wherein the Door Detection Tool is capable of determining the number of entrance passages between two points graphically marked on the digital image viewer. System.   The apparatus further comprises a three-dimensional record path tool used in the three-dimensional display means, and the three-dimensional record path tool can record all details of a virtual path taken in the three-dimensional display means as an image. The improved system of claim 5. An improved digital image viewer for presenting information based on a digital raster image of a paper drawing,
A route between a first position and a second position specified on the digital raster image is calculated using a route calculator;
An actual scale measurement of the route is calculated using a measurement computer, and the actual scale measurement defines scale information embedded in a header of the digital raster image, and the first position and the second position. Based at least in part on the coordinates of the pixel to
The presenting means is means for displaying the route and actual scale measurement in the two-dimensional display means, and the improvement is as follows:
3D display means for displaying the route and actual scale measurement in 3D rendering, wherein the 3D display is a part of the presentation means, and the presentation means displays the digital raster image. And the presenting means can display the three-dimensional rendering, wherein the three-dimensional rendering comprises real-time linked and matched three-dimensional display means linked to the digital raster image. Image viewer.   The improvement of claim 12, wherein the 3D rendering has a 3D coordinate system, and the 3D coordinate system is matched and linked in real time to the 2D coordinate system of the digital raster image. Viewer.   The improved viewer of claim 12, wherein a three-dimensional coordinate system matches the two-dimensional coordinate system in terms of coordinates.   The improved viewer of claim 12, wherein a 3D coordinate system matches the 2D coordinate system for events. A method for tracking assets in a structure using a digital viewer, the digital viewer comprising two-dimensional display means for displaying a two-dimensional digital image of a scanned paper document of the structure, the paper The scale information of the document is embedded in the header of the two-dimensional digital image,
Displaying a three-dimensional rendering of the two-dimensional digital image in a three-dimensional display means, wherein the three-dimensional rendering has a three-dimensional coordinate system, the two-dimensional digital image has a two-dimensional coordinate system, and A two-dimensional coordinate system matches the three-dimensional coordinate system to form a common coordinate system;
Presenting a receiver location for the structure;
Providing the asset with a receiving / transmitting device,
The position of the asset in the structure can be detected on the common coordinate system;
The method, wherein the two-dimensional digital image is linked with the three-dimensional rendering in real time and matches with respect to coordinates.   The method of claim 16, wherein the coordinates of the position are determined using triangulation on the digital viewer.   The method of claim 16, wherein the coordinates of the position are determined using a polygon survey method on the digital viewer.   The method of claim 16, wherein the receiving / transmitting devices are a wireless transmitter and a receiver device.   The method of claim 16, wherein the receiving / transmitting device is a GPS device.   21. The method of claim 20, wherein the GPS device has a GPS coordinate system and a GPS scale, and the GPS coordinate system and the GPS scale are converted to align with the common coordinate system.   6. The improved system of claim 5, further comprising a Door Detection Tool, wherein the Door Detection Tool can determine the number of entrance passages virtually traversed by a three-dimensional virtual walkthrough.

Images