AU2007100074A4 - Site Inspection - Google Patents

Description

SITE INSPECTION FIELD OF THE INVENTION The invention is related to video assisted inspection systems, and more particularly to a system and method for providing an interactive video inspection.

BACKGROUND OF THE INVENTION Various forms of business utilize video demonstrations as part of their efforts to generate revenue. For example, real estate agents often display looping movies that play selected 0 footage of one or more selected properties continually throughout the day for prospective investors to view. This is usually at a display suite. While such systems provide a good indication of what the building resembles, they do not provide sufficient information, such as details about areas of interest.

It is often the case that a person interested in a real estate property would prefer to be able to review relevant information without necessarily physically attending the site of interest.

Consequently, there is a need to provide a simple, low cost and effective method of providing easily navigable and information-rich content which is suitable for such viewing.

The reference to any prior art in this specification is not, and should not be taken as, an acknowledgement or any form of suggestion that the prior art forms part of the common general !0 knowledge.

SUMMARY OF THE INVENTION According to a first aspect of the invention, there is provided a tool for remotely inspecting a site comprising data associated with an inspection site and navigation means to enable selection of aspects of the site for inspection wherein the data comprises at least one segment of video data in respect of at least one aspect of such site.

The remote inspection tool of the current invention may take any suitable form.

According to one embodiment it is an application supplied on a removable memory means (such as a DVD). However, other suitable forms are also applicable. Thus, in some embodiments, the tool is in the form of a file which is downloadable from a computer or server which may for example be networked, for example on the internet. In some embodiments, the tool may comprise video, graphical and other elements to enable navigation and viewing of various aspects of the site to be inspected. A memory means according to the present invention may be of any suitable type. Thus, for example, it may be a computer hard disk, multimedia centre, computer file, or personal device. In some embodiments it is a removable memory means, for example a DVD disk.

The remote inspection tool of the present invention is suitable for providing remote inspections of many different types of site. Characteristics important to applicability of the invention include the ability to capture and store video data in relation to a site and the term 'site' (and its grammatical forms) is only limited by this definition. Thus, in some aspects, a 'site' may comprise a real estate property or other geographical or physical location. However, the invention might for example equally apply to anatomical sites (for example for remote inspection by a physician), an aspect of a manufacturing process, the microfeatures of a particular product or thing, etc. A navigation means according to the present invention may take any suitable form.

0 According to one embodiment, it comprises an interface comprising at least one indicator element to indicate options for selection by the viewer. The tool may also comprise one or more graphical or other elements to enable navigation and viewing of various aspects of the site to be inspected. Preferably at least one of the options relates to an aspect of the inspection site which is available for viewing. According to an embodiment, the navigation means comprises a map (such as a plan-view map) of the site from which various portions and or aspects may be selected for inspection.

Aspects of sites which may be inspected according to the present invention may be of any suitable type. Typically, they will comprise parts of interest to the viewer inspecting them.

Thus, for example, in one embodiment relating to remote inspection of real estate properties, !0 one or more saleable features of a property would correspond to an aspect of the inspection site. The video data according to the present invention may comprise any suitable form.

According to one embodiment, it comprises MPEG2 format, H.264 or any other related compression scheme According to one embodiment, the viewer has discontinuous control over the aspects of the site to be inspected. Thus, the video data to be displayed is displayed in short segments which are unconnected visually. According to another embodiment, the video data is in segments which correspond to aspects of the site to be inspected and which may be individually selected from a map. It may be desired in this embodiment to select an option to play all video in a continuous stream, however, control over the aspects to be inspected may still be discontinuous in the sense that the video displayed may for example fade out and fade in between each segment.

According to a second aspect of the invention, there is provided a method of producing a remote inspection tool comprising the steps of identifying an inspection site to be the subject of the inspection, capturing video data in relation to one or more predefined aspects of the inspection site, storing the video data on a memory means, and associating the video data with at least one navigational indicator which is available for selection by a viewer.

According to a third aspect of the invention, there is provided, in a computer system having a user interface comprising a display and user interface selection device, a process for

O

displaying a remote inspection of a site, comprising process actions for: inputting data associated with the inspection, said inputting comprising, inputting video data associated with at least one aspect of the inspection site, inputting at least one navigational indicator associated with the video data, displaying a viewing and navigation window on the display, wherein the window comprises at least one aspect for viewing and controlling the inspection, implementing commands entered by a user directly via said selection device and via the user selecting at least one displayed item within the viewing and navigation window using said selection device, so as to give the user control over the aspects of the site to be inspected. According to one embodiment of this aspect of the invention, the control over the aspects of the site to be inspected is discontinuous.

Throughout this specification (including any claims which follow), unless the context requires otherwise, the word 'comprise', and variations such as 'comprises' and 'comprising', will be understood to imply the inclusion of a stated integer or step or group of integers or steps but not the exclusion of any other integer or step or group of integers or steps.

BRIEF DESCRIPTION OF DRAWINGS Various embodiments of the present invention will be described with reference to the ?0 accompanying schematic drawings, wherein like reference characters denote like features, and wherein: Figures 1.1 to 1.23 comprise plan-view diagrams demonstrating a video production process according to one embodiment of the invention.

Figures 2.1-2.8 comprise a flow diagram depicting the sequence flow and components for the pre-production process.

Figures 3.1 to 3.6 depict a flow diagram showing the navigation process for a typical video inspection tour according to one embodiment of the invention.

Figures 4.1 to 4.4 depict example screens of the initial video inspection tour according to one embodiment of the invention.

DETAILED DESCRIPTION It is convenient to describe the invention herein in relation to embodiments relating to inspections associated with real estate properties. However, the invention is applicable to a wide range of types of inspections and sites and it is to be appreciated that other constructions and arrangements are also considered as falling within the scope of the invention. Various modifications, alterations, variations and or additions to the construction and arrangements S described herein are also considered as falling within the ambit and scope of the present 0 invention.

Figures 1.1 to 1.23 comprise plan-view diagrams demonstrating a video production process according to one embodiment of the invention. The process according to this example embodiment follows a particular sequence, taking into account the various features likely to be of interest to viewers in order to maximize the viewing experience. The camera position is indicated throughout these drawings by a circle with lines extending from it to indicate the width of the camera shot to be included, either in a single shot, or as a pan.

Figure 1.1 depicts the opening introduction to the virtual inspection tour which is a 3-6 second still shot of the front of the property, taken from across the road at position 111. In N Figure 1.2 the camera is panned from the left side of the front of the property across to the far right of the property with a duration of for example 4-6 seconds. In Figure 1.3, the camera is pointed to the top of the street and then panned across from the right to the left of the street with a 180 degree shot. This provides a feel for the local environment of the property and places it in perspective. Such a shot may last for example for 13-16 seconds. In Figure 1.4 the camera is pointed to the bottom of the street and then panned across from the left to the right of the street looking up to the top of the street, again passing through 180 degrees as in Figure 1.3.

In Figure 1.5 there is a close up shot of the fagade of the property with a camera pan !0 from left to right giving the viewer greater property detail the duration of such a shot may be 8-10 seconds. In Figure 1.6 there is an upward shot of the fagade of the property with the camera panning from right to left. In Figure 1.7 the camera positioned at the doorway and facing away from the house, pans from left to right revealing height and perspective between surrounding properties in the street as well as other street areas in the suburb. In Figure 1.8 the camera, positioned in the back corner of the backyard pans from left to right revealing the rear of the property including courtyard or garden areas or specific areas of interest. In Figure 1.9 the camera, located at the back door of the property pans from left to right revealing the rear of the property including the courtyard or garden areas. In Figure 1.10, the camera, located near the front door of the property zooms towards the entry area of the property which gives the viewer a sense of approaching or entering the property.

In Figure 1.11 the camera, located at one side of the entry area in the garage is zoomed towards the entry area giving the feeling of entering the property. In Figure 1.2 the camera, located in the same position as in 1.11, pans from left to right from the inside of the entry area.

In Figure 1.13, the camera, located at the base of the stairs, pans from the base of the stairs to the top. In Figure 1.14a the camera, located in one corner of a bedroom area pans from the entry of the room and from floor to ceiling thus providing the viewer with a sense of the proportions of the room. In Figure 1.14b the camera pans from right of inside of the bedroom area then moves towards the entry. In Figure 1.4c, the camera focuses on specific areas of interest, such as a robe.

In Figure 1.15a the camera pans from left to right across an entry point to a lounge room.

In Figure 1.15b the camera pans from left to right inside the lounge area. In Figure 1.15c the t camera pans from left to right from inside the lounge area. The same sequence is repeated in Figures 1.16a-c for the dining area, Figures 1.17a-c for the kitchen, Figures 1.18a-c for the family room, Figures 1.19a-c for the laundry, Figures 1.20a-c for the hallway, Figures 1.21a-c for the bathroom, Figures 1.22a-c for the theatre room, and Figures 1.23a-c for the garden shed.

Figures 2.1-2.8 comprise a flow diagram depicting the sequence flow and components for the pre-production process. Figure 2.1 depicts how a video camera 211 is used to film on location and so that video and audio is stored on media such on a tape 212 or hard disk 213.

Figure 2.2 depicts transfer of video and audio data from tape 212 and or hard disk 213 onto an electronic device for storage, such as computer 221, also depicted as 231 in Figure 2.3. Figure 2.4 depicts at 241 that video and audio data may then be edited on the computer or electronic device into a complete video sequence, optionally with fades ready for compression.

Figure 2.5 depicts graphical maps and overlay files 251, composed for navigation in a graphical editing program ready for compression. Figure 2.6 depicts that specilaised computer software is used to compress the video, audio, graphical and overlay maps shown generally at !0 261 into compliant files ready for authoring. Figure 2.7 depicts that specialised computer software is used to combine all of the different authored assets 271 together which can be used on different communication devices, eg. DVD, HD DVD, Blue Ray, (272) mobile devices 273, and hand held multimedia devices 274. Finally, Figure 2.8 depicts that final authored assets 281, may be transferred onto various media such as optical based media or interactive multimedia devices, which are then ready to be viewed on a compatible consumer electronic device such as DVD/HD DVD/Blue ray players 282 (operable with remote control 285), handheld multimedia devices 283, mobile phones 284. Authored assets 281 may also be stored on a physical storage medium, such as a DVD, 286.

Figures 3.1 to 3.6 depict a flow diagram showing the navigation process for a typical video inspection tour according to one embodiment of the invention, as depicted in Figure 3.1.

An inspection tool according to the present invention may be housed on any suitable device, such as a computer hard disk 311, DVD 312, mobile phone 313, or other personal multimedia device 314. The initial step is to display a welcome page 315 with for example the corporate identity and an introduction. Figure 3.2 depicts the steps of selecting an interface screen with 3 options: auctions, private sales and rentals, and selection of 'Auctions'. Figure 3.3 explains that Auctions, Private Sales and Rentals are separate options and illustrates the 'Auctions' option and selection of an appropriate property to view. Figure 3.4 depicts a site plan with selectable parts according to the present invention and selection of the kitchen area (shaded) as indicated

O

Oby arrow 341. Figure 3.5 illustrates that by highlighting and selecting certain areas, certain areas of the property can be inspected. Figure 3.6 provides examples of potential further features, such as a chattels list.

M Figures 4.1 to 4.4 are example screens of the initial video inspection tour according to one embodiment of the invention. In Figure 4.2, the initial item on the list is shaded indicating that it has been selected 421 or 431 in Figure 4.3. In Figure 4.4, the screen includes a combination of descriptive and graphical elements including a plan-view diagram of the layout of a house the subject of a DVD according to the present invention. In the top left corner of the S diagram, the kitchen is highlighted as indicated by 441, indicating that this room is the current area of interest for which a video has or is about to be displayed.

One embodiment of the present invention enables provision of video inspection tours in the real-estate market. More specifically, it provides an interactive process with specific focus on filmed video data which has been post edited together into a short form sequence which shows focal points for specific locations. Furthermore, an intuitive interface menu design creates a customised pre-defined set of graphical based frames that the user becomes familiar.

The present invention enables the production of cost-effective and detailed inspections of specific virtual and real world locations, using compatible consumer electronic devices or !0 computers as the delivery platform.

Once the video data is stored inside the computer, specialised video editing software may be used to streamline and refine the video data into a finished data file. Any suitable software may be used for this process, in one embodiment, the software may be FinalCut Pro tm.

The video data is then compressed using specialized software that creates a compatible video data file for use with the DVD format to replay the inspection tour in an interactive manner.

The resulting experience is referred to as a virtual inspection tour. The experience is interactive in that the user can highlight and select specific text elements and icons on the menu, and branch-off to different navigational components and view specific areas of interest. Such navigational components may take the form of graphical maps which, in one embodiment, also require an interface design 'style guide'. This process involves using specialised graphical design programs to create an overall theme based on the corporate identity of the real estate company. Any suitable software may be used for this process, in one embodiment, the software is Adobe Photoshop.

According to one embodiment, the production process involves gathering the raw data, (such as video, voice over audio, audio and graphical map elements), and using specialised software to finalise and refine the specific data elements into a fully completed data set ready for the authoring stage. An authoring tool is then used to generate a specialised file representing

O

video, audio, and scene data which is then processed. Any suitable software may be used for this process, in one embodiment, the software is DVD Studio Pro and Soundtrack Pro. Such processing may for example involve transfer onto an optical 'media' device such that a viewer is able to view the virtual inspection tour on a display device. The user is then able to interact with the navigational system via an input system such as a remote control device. The user experience may be additionally enhanced with sound, voice over audio, video, computer animation, web links, navigational maps, and the ability to view a site or location with one's family in the privacy of their own home using a compatible consumer electronic device or computer. The combination of interaction, full resolution video, voice over audio, web interaction and audio provides viewers with an unprecedented sense of presence and essential viewing 0 information that is necessary for the prospective vendor or purchaser.

A Video Inspection Tour system according to the present invention may use any compatible consumer electronic device or computer as the delivery system. Once the digital versatile disc (DVD) or any other mobile or hand held device is inserted or activated into any consumer electronic device or computer, a sequence of post edited video frames will present the corporate identity of the particular Real Estate company. The system then allows the viewer to select from real estate based options such as, 'auctions', 'private sales' and 'rentals'. Once an .0 option is selected, the viewer may then highlight a specific location which provides information about the particular selected suburb. The viewer can then, at any time, navigate the menu to have interactive control. Such control is accomplished via a graphical user interface that includes a viewing and navigational window which gives the user many options to view and control the video inspection tour. User commands are entered via a selection device remote control, keyboard, keypad and finger driven interaction) and via the displayed items within the viewing and navigational window. Entered commands may include among other things, a simple selection of buttons on a remote control. The user can use any suitable method for entering commands, for example, the left/rightlup/downlenter/title and menu buttons via the graphical user interface for viewing and controlling the Virtual Tour. As a result the user is given control over which viewing selection of post edited video data he/she will view next within the Virtual Tour. In addition, any part of the Virtual Tour can be accessed by the viewer and may be 'paused' to view information and the viewer may 'return' to the previous graphical map or return to the beginning of the virtual tour by selecting the appropriate button on the remote control during the virtual inspection process.

The video data used in accordance with the invention may be captured in raw form in separate sequenced files using a digital capture device and then stored digitally on the computer. The raw video data is then edited together with specialized software. Any suitable software may be used for this process, in one embodiment, the software is Final Cut Pro.

O Throughout the video editing process, video transitions (such as fading in and out) are Sused to splice segments of video data together to give the viewer a smooth sense of motion.

S Video titling can also be included to indicate areas of interest for the viewer.

Once the process is complete then all specific video data elements are combined into one selfcontained video sequence. Furthermore, the final video sequence file must be decompressed during viewing by the user as described above. The video data is then compressed using a specialised compression method based on the digital versatile disc (DVD), Blue Ray, H.264 or any other similar compression scheme specification which gives the viewer decompression of any still or sequential video frame data. Any suitable software may be used for this process, in one embodiment, the software is Compressor and Quicktime Movie Player tm. This c compression scheme allows the virtual inspection tour to be compatible with consumer electronic devices or computers.

The video data also corresponds to specific pre-defined video sequences. Each video sequence corresponds to a specific link that is assigned to a particular text or icon on the graphical user interface, which enables the viewer to access designated pre-defined video sequences.

In addition, the user may also select from a graphical map of the Video inspection tour.

Such a graphical map may include for example, a plan view which identifies each specific area ?0 of the site for the user to view and it may highlight specific areas when indicated by the user (for example with a cursor, mouse, finger interaction or pointer). By highlighting in a semi transparent colour the specific region, it identifies the point at which the viewer wishes to activate the selected region in order to view. The Graphical map provides the viewer with the flexibility to select individual components by using an interface such as the enter/left/right/up/down arrow buttons on the remote control or any other form of interaction. The selected highlighted region also allows the user to move to other sections of the video data without having to view the entire video path from start to finish.

The navigational window may also include an information section that displays icons or text information that represents areas of interest to the viewer. For example: The navigational or graphical map can list sub headings such as "Contract of Sale" or "Chattels list" which give the user a full detailed interactive approach to specific items that relate to the particular property.

When the user selects one of these icons or text elements, additional information is displayed in the separate navigational window.

A virtual inspection system according to this embodiment may also support sound in order to enhance the viewing process. Each audio track can be aligned with the viewing sequences during the entire virtual tour process. Such an audio track may be of any suitable S type. For example, it may comprise a certain type of background music, or it may comprise a

O

voice-over by a real estate agent/presenter which describes elements of the property such as the elements currently on display in associated video footage.

A virtual tour system according to the present invention may be used with any suitable computing system environment or configuration. By way of example only, it may be used with personal computers, hand held or laptop devices, set top boxes, consumer electronics, or similar other personal computing environments, and the like.

According to one embodiment, the delivery system provides the viewer with the ability to view an interactive tour of a particular site with the ability to interact and select specific sections of pre-defined and post edited video data that responds to the commands of the viewer.

N According to some embodiments of the invention, the video component may have certain attributes that are required for viewing and navigation. In general the video provides the user with as much information as possible, based on the relevant subject detail.

All video data is filmed on the specified site and then captured into a computer using a specialized digital input device. Any suitable software may be used for this process, in one embodiment, the software may for example may be FinalCut Pro.

The data is then organized and named to correspond to what is contained on the video data. The video data is then edited using editing software and using transition points at key !0 sections in order to provide optimum viewing detail for the viewer. Once the video data is edited together the process for compiling the video data into one complete video is processed ready for integrating into the video inspection tour system. For example, (a property view or outside location) as seen by a person moving through and viewing the specific location. These specific viewing angles are pre- defined shots that will represent special interactive links.

Furthermore, a video element according to the present invention utilizes a compression technology, that gives the viewing system the ability to decode the video file with minimal delay and be able to fast forward, go backwards and access navigational elements in a responsive and timely manner. The compression technology may be any suitable compression technology.

By way of example only, it may be a compression scheme such as MPEG2, H.264 or any other related compression scheme.

As described previously, the video inspection tour is mostly represented in the video file.

The tour may contain a number of pre defined points from which it may "enter" and "exit" at specific points during the viewing of video as specified by the user or can be viewed as one predefined edited sequence using the" Play All" function once displayed for the viewer to select on the graphical map. According to one embodiment, the specific areas of selection and interaction by the viewer are controlled through graphical maps. These graphical maps can be either a sequence of looping images or static graphical images. These graphical elements may contain text or icon based information. Options such as these allow the viewer to select and navigate, from multi-levels, giving the viewer access to specific sections of information when needed. For example a user may select from a plan view of a property and select specific rooms or areas of interest as depicted in Figures 1-4. The resulting video is displayed to the viewer. When a particular segment of video is completed, the navigational map may again be displayed for the viewer to select another specific sub area for viewing. The user may also elect to view the entire video file on the navigational map via a "Play All" activation button. At any time the user is able 0 to return to the existing navigational map and select another specified option.

In order for the viewer to navigate effectively within the computing environment, a graphical user interface (GUI) is implemented as shown in figure 1-4. This format provides a full interactive map of the entire layout of the virtual tour site. The navigational graphical map can be indicated with an emphasized portion, for example it may be represented by either a specific highlighted colour or symbolic icon that enables the viewer to select and view on screen specific sections of pre-defined video data or navigate to other specific graphical maps within the entire navigational system. The video data may also contain specific link information. This is used to enable the viewer to individually select specific areas of interest. For example, if the viewer has a graphical map showing a plan view of a site, the viewer may then select by highlighting the ?0 selected kitchen area (for example) and view that particular 'link' relating to that section of video data. Once the video has finished, the end section of the video then links back to the kitchen section on the graphical map. Links are also an important aspect in allowing the viewer to individually select specific data. This is based on careful interface design and implementation of key text, graphical and video frame data.

In addition video and graphical data may comprise single, multiple or specific voice over audio tracks. The audio data may represent a single track of filmed, composed music or scripted voice over data that details key areas and chattel detail, to create an ambiance that helps achieve a more complete experience.

The Navigational system for certain embodiments of the invention is an important component of how the user experiences the relevant information. The interface enables the user to select and command specific areas of interest using a simple input device, for example, remote control unit and keyboard or mouse. For example, a remote control allows the user to navigate the Graphical user interface (GUI) from a specific selection of buttons. The user may select Left/Right/Up/Down or any other form of navigation to move around the interface. If the user wishes to view a specific video sequence or navigate to another graphical map, the user may select" Enter" to create an action. The "Enter" button may also be used to enable the viewer to select specific areas that display "static" images for use in specified navigational menus. The Remote control can be used to select a specific region of the Virtual inspection map which allows the viewer to be taken to a new position as mentioned earlier.

Although the present invention has been described in connection with the embodiments disclosed herein, it will be appreciated by those skilled in the art that additions, deletions, modifications, and substitutions not specifically described may be made without department from the spirit and scope of the invention as defined in the appended claims.

Claims (16)

1. A tool for remotely inspecting a site comprising data associated with an inspection site Sand navigation means to enable selection of aspects of the site for inspection wherein the data comprises at least one segment of video data in respect of at least one aspect of O such site.

2. A tool according to claim 1 comprising one or more graphical or other elements to enable Snavigation and viewing of various aspects of the site to be inspected.

3. A tool according to either claim 1 or claim 2 adapted for inspection of a real estate site.

4. A tool according to any one of the preceding claims comprising an interface with at least Sone indicator element to indicate options for selection by the viewer.

A tool according to claim 4 wherein the navigation means comprises a map of the site from which various portions and or aspects may be selected for inspection.

6. A tool according to any one of the preceding claims wherein the format of the data comprises one or more of MPEG2 format or H.264 format.

7. A tool according to any one of the preceding claims wherein the user of the tool has discontinuous control over the aspects of the site to be inspected.

8. A tool according to any one of the preceding claims wherein the data comprises segments which correspond to aspects of the site to be inspected and which may be individually !0 selected from a map.

9. A tool according to any one of the preceding claims provided on a memory means which is optionally removable.

A tool according to claim 9 wherein the memory means comprises optionally one or more of a DVD, computer hard disk, multimedia centre, computer file, or personal device.

11. A method of producing a tool for remotely inspecting a site comprising the steps of identifying an inspection site to be inspected, capturing video data in relation to one or more predefined aspects of the inspection site, storing the video data on a memory means, and associating the video data with at least one navigational indicator which is available for selection by a viewer.

12. A system for producing a remote inspection of a site comprising: a memory means; a user interface; and C- 5 Cc a means of implementing process actions comprising: inputting data associated with the inspection; inputting at least one navigational indicator associated with the data; creating a viewing and navigation interface.

13. A system according to claim 12 wherein the data comprises video data associated with at least one aspect of the site.

14. A tool substantially as described herein by reference to the drawings.

A method substantially as described herein by reference to the drawings.

16. A system substantially as described herein by reference to the drawings.