WO2024035976A2

WO2024035976A2 - Dynamic areas of interest that travel and interact with maps and void spaces

Info

Publication number: WO2024035976A2
Application number: PCT/US2023/066763
Authority: WO
Inventors: Matthew A. Molenda
Original assignee: Mofaip, Llc
Priority date: 2022-05-09
Filing date: 2023-05-09
Publication date: 2024-02-15
Also published as: WO2024035976A3

Abstract

The present invention are defined areas of interest including pins, points, segments, and regions on maps, avatars, or images, wherein the areas of interest themselves exist as dynamic data islands and the data islands themselves exist in multiple dimensions as determined by map data, void space data (unmapped areas), and data-driven relationships. The areas of interest interact and relate to one another using data from their own internal dynamic data islands and data from maps, void spaces, and databases. The area of interest may have components within its coordinate system, and the components may interact with each other and are translatable to any coded, linguistic, or symbolic language.

Description

UTILITY PATENT APPLICATION

CONFIDENTIAL INFORMATION

Applicant: MoFalP, LLC

Address: 7050 Spring Meadows West, Holland, OH 43528, USA

Title: Dynamic areas of interest that travel and interact with maps and void spaces.

First Named Inventor: Matthew A. Molenda

Attorney: McCarthy, Lebit, Crystal & Liffman, Co. L.P. A.

Customer No. : 113863

Attorney Docket No.: AML.P032.PCT

RELATED APPLICATIONS

[0001] This application claims priority from each of U.S. Provisional Patent Application Serial No. 63/364,393 and its filing date May 9, 2022, and U.S. Provisional Patent Application Serial No. 63/364,764 and its filing date May 16, 2022. Each of these applications is hereby incorporated by reference in their entireties for all purposes.

FIELD OF THE INVENTION

[0002] This invention relates to pins, points, segments, and regions (areas of interest) on anatomic maps, avatars, or images, wherein the areas of interest themselves exist as dynamic data islands and the data islands themselves exist in multiple dimensions as determined by map data, void space data (unmapped areas), and data-driven relationships. SUMMARY OF THE INVENTION

[0003] Currently, areas of interest on an anatomic map, avatar, image, or video, such as pins, points, segments, and regions, may be highlighted but such highlighting reflects manually entered and static data. Additionally, the areas of interest in current technology exist as static (nondynamic) points in two-dimensional or three-dimensional space with no ability to precisely and reproducibly describe, isolate, group, relate, order, target, translate, transform, merge, categorize, convert, or modify the area of interest as it changes through space and time. The present invention places dynamic, isolated, transformable, translatable, and targetable areas of interest onto anatomic maps, avatars, images, and videos and onto unmapped void spaces.

[0004] Each area of interest exists as its own dynamic “data island” represented by a visualization, description, optional position on multidimensional maps and void spaces, associated features and properties. A visualization associated with an area of interest may include a pin, pin type, pin order, pin description, coordinates relative to a map, coordinates relative to a map segment, coordinates relative to other areas of interest, relational information, void space information, attached data, cross-linked data, diagnostic information, morphological information, symptoms, historical health information, and other data as one skilled in the art would know. Each area of interest in the present invention is describable, isolatable, groupable, relatable, orderable, targetable, translatable, transformable, mergeable, categorizable, convertible, and modifiable.

[0005] The present invention is illustrated by means of an example describing two areas of interest represented as “pins” on a diagram on a map element. The areas of interest as pins and text can be shown or hidden on the map (i.e., made invisible or visible); related to one another; isolated from one another; grouped to each other; associated with diagnoses, morphologies, symptoms, tags, detections, attachments, multimedia, procedures, encodings, and other health data; the same or different colors; individually targeted (e.g. for modification, association, categorization, or isolated visualization or finding its location on a map); group targeted; reordered; reproduced in a new session; automatically encoded with anatomy, diagnostic, procedural, and other encodings; automatically translated into any coded, symbolic, or linguistic language; described with optional enhancements such as those describing the direction of the pin relative to the anatomic sites above and below the pin; and moved, translated or transformed dependently or independently in relation to coordinates, axes, data-based positions, organ systems, functional systems, cross-mappings, synonyms, diagnosis, category, data memberships, and other data as one skilled in the art would know. This is a substantial improvement on current systems that use static areas of interest, which have issues with reordering, re-categorizing, and segregating different data components. For example, in current electronic health records (EHRs), if a procedure anatomic location, order, or type is changed (such as a biopsy order or type), the associated photos, documentation, notes, and other content must be deleted and re-documented. For example, with existing EHRs, if four biopsies are recommended with areas of interest being: A - shave biopsy; B - shave removal; C - punch biopsy; and D - punch excision, but the patient refuses to have the procedure on locations A and C, the system would require the documentation to start over - causing frustration and potential for errors and data loss in the documentation process. In the present invention, the areas of interest could be re-categorized and B would become A, and D would become B. Further continuing this example, if the procedure type for original D (now B) was initially entered incorrectly, and is actually a shave removal, the system of the present invention could change the targeted data point in the area of interest file without risking data loss or time-consuming manual tasks of reassociation of data. Existing solutions also do not have dynamic areas of interest that can be associated with changing or evolving optional anatomy data, changing procedural and diagnostic data, photos, images, videos, morphologies, visualizations, symptoms, and other data at different time points.

[0006] In one embodiment, the area of interest (AOI) represented by a pin is a separate scalable vector graphic (SVG) that has its own coordinate system and structure that is transposed on a map that itself contains mapped and unmapped regions. The AOI contains its own coordinate systems and structures; thereby allowing the AOI to exist by itself and also co-exist in relation to unlimited coordinate systems under, above, around, and related to it and in relation to data-driven relationships and connections. The AOI size, scale, rotation, angle, and topology can also be variables to relationships, surface areas, intensities, and other data. It is contemplated that an AOI can also belong to multiple neighboring anatomic sites defined by paths simultaneously and is represented by a drawn polygon, curve, path or shape. It is also contemplated that an AOI can have several non-obvious invisible connections to other AOIs or other health data, such as through data-driven relationships or invisible anatomic map layers to other organ systems or functional systems.

[0007] In another embodiment, the AOI is a hidden and invisible SVG file that is nested into a multidimensional map with coordinates associated with at least one dimension of the map. In this embodiment, the AOI can be thought of as an “invisible pin” that can travel through map elements and void space; and in order to allow for precise and visual travel, this “invisible pin” can temporarily be made visible during the travel process.

[0008] AOIs have their own coordinate system and exist independently from a map, allowing the AOIs to travel through two-dimensional, three-dimensional, and multi-dimensional space and time on a map and to travel through void, unmapped space. AOIs can also exist in unmapped void space to visualize dynamic health information which does not have associated map or anatomy data. AOIs also have their own data sets associated with them related to patient demographic information, images, multimedia, reports, diagnoses, procedures, codes, descriptions, translations, and other information as demonstrated in the figures. AOIs are also movable, mergeable, modifiable, reproducible, searchable, and relatable based on the patient information, diagnosis information, procedure information, health information, positional information, data- based information with or without a map-based coordinate and/or anatomic visualization.

Additionally, AOI-coordinate systems can interact with map-based coordinate systems that are above, below, neighboring, or nearby the AOI coordinate system, and the AOI-coordinate systems can be independently targeted and modified.

[0009] Targeted, dynamically changeable AOIs that have order and can be grouped, segmented, and tracked as separate islands (e.g., files or databases) of information that can interact with map and void space information have applications beyond anatomic mapping. In a geographic context for a military application, for example, it is contemplated that the land could be mapped in greater detail than the sea, and the sea is correlated with the void space as previously described. It is contemplated that the AOIs could correlate with military troops that contain their own properties and personnel files and skillsets, and these can be ordered, re-ordered, and tracked dynamically through space and time. Continuing this example, the AOI could be an asset like a land/sea vehicle or aircraft carrier; an AOI could be stealthily assigned to a region with an invisible AOI that has separate permissions and classification statuses; time-sensitive decisions can reorder assets in real time; and this vehicle or aircraft carrier acts as its own independent filesystem and database that has its own coordinate system to navigates the interiors and compartments within the vehicle or carrier; personnel inside the vehicle or carrier interact with the vehicle or carrier’s coordinate system to determine their position within the vehicle or carrier; and personnel inside the vehicle or carrier have anatomic maps with their own anatomic coordinate systems associated with their personal health file. The AOI is its own file, database, or “data island” but it interacts with available mapping and tracking data.

[0010] In yet another embodiment in a sports context, it is contemplated that the AOIs could be sports players on a map of a sports field. A group of AOIs would make up a team. The statistics on the AOI change dynamically over time as the AOI is tracked on a field map. It is contemplated that wearable or portable technology such as watches, glasses, mobile phones, or other devices can serve as a dynamic AOI or segment of a dynamic AOI, and interact with map data and void spaces, whether those maps be anatomic, geographic, or situation specific. Another example would be asset tracking where each AOI is an asset with its own bucket of information that interacts with an office map, schedule, and other data. As another example, if an AOI is a particular medical laser asset that has usage logs, patient treatment logs, scheduled patients for use, scheduled physicians who are using the asset, physician training logs and certificates for those qualified to operate the asset, payment logs, before and after photos, operator manuals, warranty information, service representative contact information, patient instruction sets, special electrical plug-in requirements, special warnings (e.g., no use in room with windows), setting recommendations for different parts of the body and different skin types and skin tones, safety notices like particular eye safety goggles needed with different wavelength and optical density settings, and other information relevant to the asset. Having all of the asset AOI information in the contemplated example interact with an office map dynamically joins relevant information to one place and interacts with specific rooms on the office map that can support the AOI, such as those with special electrical requirements.

[0011] Dynamic AOIs can also be thought of as buckets or files that contain segments of information. Segments and files can belong to multiple buckets or dynamic AOIs simultaneously. They can be structured or unstructured, and serve as their own database, file system, and coordinate system. It is contemplated that each AOI can be its own database that interacts with two-dimensional maps, three-dimensional maps, multidimensional maps, map elements, and void spaces. It is further contemplated that dynamic AOIs may also be translated in whole or in part into any coded, linguistic, symbolic, or multimedia based language. For example, a visualization SVG file for the AOI for a biopsy contains information that interacts with a map based on its position on the map and may also contain procedure information, coded information, and order information directly in the AOI file. The AOI may be translated to Chinese, in part or in whole, as one example, while the map data and data-based relationships remain in English. Procedure codes such as the Current Procedural Terminology (CPT) codes may be calculated based on combining AOI data and map data, as another example. AOI position on a map combined with AOI diagnosis code data may modify the diagnosis code and anatomy coded result. The description of position of the AOI over the map can be translated to Chinese, remain in English, or shown and interacted with in any coded, linguistic, symbolic, or multimedia (such as images) based language.

BRIEF DESCRIPTION OF DRAWINGS

[0012] FIG. 1 illustrates exemplar areas of interest represented by a visible pins on an anatomic map.

[0013] FIG. 2 illustrates an exemplar invisible area of interest on an anatomic map.

[0014] FIG. 3 illustrates the areas of interest from FIG. 1 reproduced at a different point in time.

[0015] FIG. 4 shows a screenshot of source code demonstrating the components of the pin, pin description, color, coordinates, and other properties in its own file.

[0016] FIG. 5 shows a screenshot of a pin description editor.

[0017] FIG. 6 illustrates an exemplar area of interest in a void unmapped space.

[0018] FIG. 7 illustrates the relocation of the unmapped area of interest in FIG. 6 to a mapped location.

[0019] FIG. 8 illustrates reordering of the areas of interest from FIG. 1 .

[0020] FIG. 9 illustrates the areas of interest from FIG. 8 isolated and shown in mirror view.

[0021] FIG. 10 illustrates the areas of interest from FIG. 8 translated into Chinese.

[0022] FIG. 11 illustrates the areas of interest from FIG. 8 translated into Spanish.

DETAILED DESCRIPTION OF DRAWINGS

[0023] Referring now to FIG. 1 , the representative dynamic AOIs are biopsies. The AOIs are represented as “pins” on an anatomic map diagram 10. The general anatomic location of the pins can be described, in English, as the “left central cheek.” The first pin 12 is described and appears with a text label 13 as “A-Shave biopsy-r/o BCC” and the second pin 14 is described and appears with a text label 13 as “B-Punch biopsy-r/o MM.” The pins and text labels can be shown or hidden on the map (e.g., made invisible or visible) through use of the visibility toggle 16; related to one another through automatically assigned relationships 15; isolated from one another shown as isolated visual previews 17 in the present embodiment; grouped to each other; associated with diagnoses, morphologies, symptoms, tags, detections, attachments 19, multimedia, procedures, encodings, and other health data; the same or different colors; individually targeted (e.g., for modification, association, categorization, or isolated visualization or finding its location on a map); group targeted; reordered (e.g., A becomes B and B becomes A); reproduced in a new session; automatically encoded with anatomy, diagnostic, and other encodings; automatically translated into any coded, symbolic, or linguistic language; described with optional enhancements such as those describing the direction of the pin relative to the anatomic sites above and below the pin; and moved, translated or transformed dependently or independently in relation to coordinates, axes, data-based positions, organ systems, functional systems, cross-mappings, synonyms, diagnosis, category, data memberships, and other data as one skilled in the art would know.

[0024] In this embodiment, the first pin 12 is its own dynamic image file (e.g., an SVG file) and includes targetable data elements 18. These example targetable data elements 18 in the present embodiment include but are not limited to: a point in 2D, 3D, or multidimensional space (e.g., the center of first pin 12); an associated procedure (e.g., “shave biopsy” for the first pin 12); color, pin type, order type, order, and grouping; associated diagnosis; associated data buckets for images/multimedia, links, forms, health data, patient info; pin and point properties, crossmappings, and metadata; pin descriptions; automatic relationships; targeting and unique IDs; isolated pin visualization combined with anatomy visualization; and visibility with the pin being visible. The data elements 18 are all dynamically linked to a separate AOI file, in this case the SVG file, that has its own coordinate system and an anchoring point that interacts with mapped and unmapped (void space) regions on an anatomic map in the present embodiment. Shading applies an additive color or pattern sequence to show the different anatomy map elements 20, which have different dimensions, to show which sites the first pin 12 and second pin 14 belong to simultaneously. Here the first pin 12 and the second pin 14 exist simultaneously on the left central cheek, left cheek, face, head, and head and neck in this embodiment The AOIs also exist simultaneously in deep anatomy that is not visible in the present embodiment, such as the fat pads and muscles underlying the first pin 12 and the second pin 14. Automatic relationships 15 are also shown, specifically here “A (this pin) is Medial and Superior from B” and “B (this pin) is Lateral and Inferior from A.” The individual AOIs are associated with data that is optionally dependent and relatable to the map.

[0025] FIG. 2 shows an anatomic map 10 on the left that a user would see with the same pins from FIG. 1. This anatomic map has an additional AOI associated with the same general anatomic location but the point associated with the AOI is invisible to the user on the map showing pins 10 while the color shading in the present embodiment has been dynamically targeted to visually represent an anatomic site, the left central cheek, in the present embodiment 10. The invisible AOI 25 may be made visible as shown in the second anatomic map 26 shown on the right for reference and graphically depicted as an anchor. Making the invisible AOI 25 temporarily made visible enables move workflows to relocate the anchor to different coordinates. The invisible AOI 25 can also keep the same coordinates and move through different map dimensions with a hierarchical selector 27; in which case it would sync map coloration to the visualizations on the map and isolated visual preview with a new selection point of anatomy. The invisible AOI 25 is also its own dynamic image file and includes targetable data elements 15. As with visible AOIs, data elements are all dynamically linked to a separate AOI file that has its own coordinate system and an anchoring point that interacts with mapped and unmapped (void space) regions on an anatomic map. The invisible AOI 25 also exists simultaneously on the left central cheek, left cheek, face, head, and head and neck, but is shown with only the left central cheek shading in this embodiment.

[0026] FIG. 3 shows an anatomic map 10 with AOIs from FIG. 1 reproduced at a different point in time with dynamic changes to pin properties, descriptions, diagnosis, color, categorization, and other properties. The first pin 12 received a pathological diagnosis of Basal Cell Carcinoma, so the AOI was kept in a constant map position and the properties were dynamically updated at a different time point. The second pin 14 received a pathological diagnosis of Melanoma, so the AOI was kept in a constant map position and the properties were dynamically updated at a different time point. Each AOI can be changed dynamically therefore these two AOIs can be grouped into a “skin cancer” group as one example. Additionally, if first pin 12 was accidentally stamped on the wrong anatomic site, such as the wrong side and it should have been stamped on the “right central cheek”, the entire AOI can be moved or refined without data loss or corruption, and only dynamically affecting the position of the AOI and the anatomic description of its position. In other words, all documentation can follow the AOI, and is dynamically changeable with or without map interaction.

[0027] FIG. 4 illustrates that the AOI is its own file or data island with its own coordinate system and properties that dynamically interact with underlying, overlying, and nearby coordinate systems, file systems, and map elements. In this embodiment, the AOI has a nested file containing its own coordinate system and properties. The different files can have associated orders, properties, and segmented structured data. The coordinate systems are relatable to map elements, void spaces, and to other AOIs. It is contemplated that each AOI can have nested AOIs that relate to and interact with self, other AOIs, map elements on maps and avatars, and void spaces. It is further contemplated that each AOI can act as its own database or file system, which can interact with itself, other AOIs, map elements on maps and avatars, and void spaces.

[0028] FIG. 5 shows a screenshot of a pin description editor. Components of the separate file and AOI can be modified. It is contemplated that other properties are also modifiable, such as color, pin type, pin size, surface area, and position of file. The AOI interacts with itself, with nearby AOIs, with its group, and with underlying map elements and void spaces.

[0029] FIG. 6 shows an anatomic map 10 with a void space AOI 30 that is in a void unmapped space, represented here by an encapsulated sequence (1) pin type and not located on an anatomic site. In this example, the diagnosis of “Essential hypertension” is not associated with a specific anatomic site or on a mapped area. The AOI still has its own file structure including buckets to store health information 32, such as photos, attachments, links, cross-links, forms, diagnosis, order, pin type, color, groupings, and other properties.

[0030] AOIs located in void spaces can be moved or assigned to mapped locations. FIG. 7 shows the void space AOI 30 from FIG. 6 moved to a mapped location. The mapped AOI 34 in FIG. 7 has been assigned to a specific location and all data associated 32 with the AOI 34 has been moved from the void space to a mapped area. The AOI 34 interacts with the anatomic map 10 to generate a description of the anatomic location, here indicating the anatomic location at which the blood pressure measurement was obtained in the present embodiment: the left upper arm. [0031] AOIs can be reordered while maintaining the data associated with the respective AOI. FIG. 8 shows the areas of interest from FIG. 1 reordered. The procedure type, diagnosis, descriptions, and associated map positions remained constant. Only the order was dynamically targeted and changed. The first pin 12 is now “B” and the second pin 14 is now “A” but the text labels remain the same as depicted in FIG. 1. The automatic relationships 15 were also automatically described and updated. While in FIG. 1 , the relationships were described as “A (this pin) is Medial and Superior from B” and “B (this pin) is Lateral and Inferior from A.”, in this Figure, the relationships are described as “A (this pin) is Lateral and Inferior from B” and “B (this pin) is Medial and Superior from A.”

[0032] FIG. 9 illustrates the areas of interest from FIG. 8 isolated and shown in mirror view. Only the pins 40 and pin orders 42 are shown. Both pins 40 are still on the “left central cheek” but are shown in a reflected view, such as when a patient is looking at their anatomy in the mirror or on a “selfie” camera. The AOIs maintain their correct positioning even when the anatomic maps and visualizations are reflected such that even the descriptions describing the relationships between pins remain accurate. Here, “A (this pin) is Lateral and Inferior from B” and “B (this pin) is Medial and Superior from A.” [0033] AOIs may also be presented in translated versions as well. FIGs. 10 and 11 show this in Chinese and Spanish. In each, the pin order 42 and rule out “r/o” text 44 remain in Roman characters (i.e., A, B, C), but the remaining text has been dynamically targeted and updated, while maintaining the pin 40 position on the anatomic map 10. It is noted that the Spanish translation derived from the AOI interaction with the map, which has also been translated to Spanish, is optionally and automatically presented in a natural linguistic sequence, also describable as a natural semantic sequence enabled by natural language processing in the present invention, where the laterality is shown at the end of the anatomic site description in this embodiment.

[0034] The foregoing descriptions of specific embodiments of the present invention are presented for purposes of illustration and description. They are not intended to be exhaustive nor are they intended to limit the invention to precise forms disclosed and, obviously, many modifications and variations are possible in light of the above teaching. The embodiments are chosen and described in order to best explain principles of the invention and its practical application, to thereby enable others skilled in the art to best utilize the invention and its various embodiments with various modifications as are suited to the particular use contemplated. It is intended that a scope of the invention be defined broadly by the drawings and specification appended hereto and to their equivalents. Therefore, the scope of the invention is in no way to be limited only by any adverse inference under the rulings of Warner-Jenkinson Company, v. Hilton Davis Chemical, 520 US 17 (1997) or Festo Corp. v. Shoketsu Kinzoku Kogyo Kabushiki Co., 535 U.S. 722 (2002), or other similar caselaw or subsequent precedent should not be made if any future claims are added or amended subsequent to this patent application.

Claims

CLAIMS What is claimed is:

1 . A computer implemented system for defining an area of interest compromising: a processor for hosting a defined map or image of containing at least one area of interest wherein the defined map or image has a coordinate system; an area of interest wherein the area of interest has a coordinate system, an associated data set, dynamic properties, and at least one tracking point; wherein the coordinate system of the area of interest is independent from the coordinate system of the defined map or image; and a non-transitory computer readable medium, storing machine executable instructions executable by the processor, the machine executable instructions configured to receive input wherein the input identifies a location or region on the map or image to associate with the area of interest.

2. The system of claim 1 wherein the area of interest can be nested into file systems and databases, interact with file systems and databases, and contain their own file systems and databases.

3. The system of claim 1 wherein the area of interest is movable, mergeable, modifiable, reproducible, searchable, and relatable based on the associated coordinate system and data set.

4. The system of claim 1 wherein the area of interest exists simultaneously in multiple dimensions of the map or image.

5. The system of claim 1 wherein the tracking points are related to diagnosis, diagnosis category, procedure, procedure counts, measurements, and calculatable and analyzable metadata.

6. The system of claim 1 wherein the area of interest is located within an unmapped void space while maintaining its own coordinate system, data, and dynamic properties..

7. The system of claim 1 wherein the data sets relate to patient demographic information, images, multimedia, reports, diagnoses, procedures, codes, descriptions, translations, and other medical information.

8. The system of claim 1 wherein the dynamic properties are modifiable.

9. The system of claim 1 wherein the area of interest coordinate system can be independently targeted and modified.

10. The system of claim 1 wherein the coordinate systems can interact with each other.

11 . The system of claim 1 comprising at least two areas of interest wherein one area of interest is not visible and wherein said invisible area of interest can select, relate, and modify visible map areas, define intensity and define overlap on the map.