AU2017219142A1

AU2017219142A1 - Location Based Augmented Reality Property Listing Method, Software and System

Info

Publication number: AU2017219142A1
Application number: AU2017219142A
Authority: AU
Inventors: Donald John Smart; Jan Petrus VAN DER BERGH
Original assignee: Smart Donald John Mr
Current assignee: Smart Donald John Mr
Priority date: 2016-08-31
Filing date: 2017-08-29
Publication date: 2018-03-15
Also published as: WO2018055459A3; ZA201608802B; WO2018055459A2

Abstract

LOCATION BASED AUGMENTED REALITY PROPERTY LISTING SOFTWARE, METHOD AND SYSTEM This invention is a location based augmented reality property listing method (1) to facilitate the advertising and viewing of properties (13). The method comprises providing a property database (13) with details of the properties, and photographs and/or videos of a particular property, the photographs/videos having been taken by a 360 degree camera to capture substantially every area in and around the property; allowing a user to provide criteria of properties of interest; (18) and to select an augmented reality mode (20), in which the method further includes determining the position of the user's mobile device; determining properties that match the user's criteria; and identifying the geospatial data and location of a property (13) and the position of the mobile device (14); and allowing the user to select a virtual reality mode to enable the user to view and manipulate the photographs/videos of the property in order to emulate a virtual reality experience; and allowing the user to navigate to the property using the mobile device (14) geospatial data and location of a property (13) and the position of the mobile device and the GPS and mapping data. Fig I F G12~t 20 POR ADATABEL 1210 INTERFACE z POWER SUPPLY 18 D N ANALYTICS 4NODETEUEALE ODL p.... 122 C UOTMFMCAUION Oi~ REIS RAODOUMOUL m FIG 12 t= a PROPERTY DATABASES -z cc USER DATABASE i I. 1221NPUT MEANS Z NOTIFICATION 1 ::~E~MDL 14 AGMETEREALITY MODULE 4(15 co 24 0 COMMUNICATIONS MODULE o REGISTRATION MODULE

Description

LOCATION BASED AUGMENTED REALITY PROPERTY LISTING SOFTWARE,

METHOD AND SYSTEM

REFERENCE TO RELATED APPLICATIONS

[0001] THIS application claims the benefit of patent ZA 2016/08802 filed on 12 December 2016 and application ZA 2016/06025 filed on 31 August 2016 and application PCT/IB/2017/054260 filed on 14 July 2017 and the relevant aspects and claims of patent ZA 2016/08802 and application ZA 2016/06025 and PCT/IB/2017/054260, are incorporated herein.

FIELD OF THE INVENTION

[0002] THIS application relates to a location based augmented reality property listing method, system and software. In particular, this invention relates to facilitating customisations required by Real Estate agents and related analytics, and improved images for viewing by a user.

[0003] THIS application relates to mobile application software commonly known as Apps, and integrated software and systems for the processing and transmission of visual imagery of buildings or property in 360 degree or virtual reality, and related data as well as location coordinates and mapping data and systems.

[0004] THIS application relates further to the use of location scanning software and systems and mapping data, integrated with Global Positioning Systems and voice responsive navigation software and systems for the real estate industry and the public.

SUMMARY OF THE INVENTION

[0005] In broad terms, there is provided a location based augmented reality property listing and location method to facilitate the marketing and viewing of properties, either for sale or renting.

[0006] The method comprises setting up a property database with details of properties, either for sale or renting, the details including area, address, price, property profiles and .

[0007] The method includes allowing an authorised person, such as the property owner or the Real Estate agent to set up an entry in the property database and to populate the entry with the property detail and profiles.

[0008] The method includes the step of hiding or showing any of the property details, when the entry in the property database is viewed by a third party, such as a potential buyer or tenant, or another Real Estate agent. Typically, for example, the address of the property may be hidden from view, thus requiring the third party to call the associated Real Estate agent.

[0009] The property database may include photographs and/or videos of a particular property. In an embodiment, the photographs may be taken by a 360 degree or virtual reality camera to capture substantially every area in and around the property.

[0010] In an embodiment, the method includes the step of allowing a user to register as a user of the system or application, using an augmented reality property listing software application running on a mobile device associated with the user.

[0011] The method includes allowing the user to specify an area of interest and a minimum and/or a maximum price range and/or a distance from the user of interest to the user. In an embodiment, the method includes sending a notification to the user’s mobile device when a new listing matches the user’s criteria.

[0012] In an augmented reality mode, the method includes: (1) determining the position of the user’s mobile device; (2) determining the position of listed properties in relation to the position of the user’s mobile device; (3) determining properties that match the user’s criteria; (4) displaying the location of the properties that match the user’s criteria; and (5) allowing the user to select properties shown on the positioning screen of the mobile device.

[0013] In an embodiment, the method includes activating a camera on the user’s mobile device and displaying a marker or markers, in real time, corresponding to the properties that match the user’s criteria, depending on the spatial orientation of the user’s mobile device.

[0014] In an embodiment, the marker takes the form of a bubble, which may be selected by the user, which in turn causes the details of the selected property to be retrieved and displayed to the user.

[0015] In an embodiment, the user’s activities, including location and markers selected, are recorded, which may be reported to the relevant Real Estate agent and/or to an administrator of the software application.

[0016] According to a first aspect of the invention there is provided a location based augmented reality property listing method to facilitate the advertising and viewing of properties, either for sale or renting, the method comprising: (1) providing a property database with details of the properties, and photographs and/or videos of a particular property, the photographs/videos having been taken by a 360 degree camera to capture substantially every area inside and around the property; (2) allowing a user to provide criteria of properties of interest; (3) allowing a user to select an augmented reality mode, in which the method further includes: (a) determining the position of the user’s mobile device; (b) determining properties that match the user’s criteria; and (c) displaying the location of the properties that match the user’s criteria; and (d) allowing the user to select a virtual reality mode to enable the user to view and manipulate the photographs/videos of the property in order to emulate a virtual reality experience.

[0017] In an embodiment, the method includes activating a digital camera or video recorder on the user’s mobile device and displaying the geographical position of properties in the area and a marker or markers, in real time, corresponding to the properties that match the user’s criteria, depending on the spatial orientation of the user’s mobile device.

[0018] In an embodiment, the method includes activating a digital camera or video recorder on the user’s mobile device or smartphone that by means of an algorithm by pointing the digital camera or recording device in a direction, identifies properties in a geographical area by calculation of co-ordinates relative to direction and mapping data retrieving and displaying data to the user indicating distance and direction of the property by a marker.

[0019] In an embodiment, the marker takes the form of a bubble, which may be selected by the user, which in turn causes the details of the selected property to be retrieved and displayed to the user, including an option to allow the user to select the virtual reality mode.

[0020] In an embodiment, the user’s activities, including location and markers selected, are recorded and communicated to a relevant Real Estate agent and/or to an administrator of the method.

[0021] In an embodiment, the details of the properties on the property database include area, address, price, property size and number of bedrooms, bathrooms and garages.

[0022] In an embodiment, if there is a property owner or Real Estate agent associated with a particular property, details of the Real Estate agent are included in the property database.

[0023] In an embodiment, the method includes allowing an authorised person, such as the property owner or the Real Estate agent, to set up an entry in the property database and to populate the entry with the property details.

[0024] In an embodiment, the method includes the step of hiding or showing any of the property details, when the entry in the property database is viewed by a third party, such as a potential buyer or tenant, or another Real Estate agent. Typically, for example, the address and geographical position of the property may be hidden from view.

[0025] In an embodiment, the method includes the step of allowing a user to register, using a software application running on a mobile device or desktop computer associated with the user.

[0026] In an embodiment the method includes selecting specific properties that are stored as selected favourites by means of which the imagery can later be viewed on a computer screen or television screen using a method of image transmission such though a system commonly known as blue tooth, a USB computer cable, or connectivity or screen mirror transmission by internet or smartphone technology.

[0027] In an embodiment, the method allows the user to define the criteria of properties of interest, including location, an area of interest, and a minimum and/or a maximum price range.

[0028] In an embodiment, in the case of the user using a mobile device, the method includes allowing the user to specify the radial distance from the current location of user, to enable a real time set of results to be delivered to the user, who may then interact with the results in the augmented reality mode and/or the virtual reality mode.

[0029] In an embodiment, in the virtual reality mode and in the case of the user using a mobile device or smartphone, the method includes allowing the mobile device to be inserted into a virtual reality viewer, with the step of manipulating the photographs/videos of the property in order to emulate a virtual reality experience including allowing the user to rotate around the room and to look up and down, by either rotating the mobile device or by swiping on the image in the required direction. 0030] In an embodiment, the method includes allowing the user to move the mobile device or smartphone in a direction to capture the geospatial data of a property and also the position of the mobile device or smartphone by using a global positioning system (GPS) and an algorithm determine the position of the user and the position of the property and record the data for location of the property against the stored property data.

[0031] In an embodiment, the method includes using the geospatial data of a property and also the position of the mobile device or smartphone that has been captured and using a global positioning system (GPS) navigate the user to the identified property.

[0032] In an embodiment, the method includes sending a notification to the user’s mobile device when a new listing matches the user’s criteria.

[0033] According to a second aspect of the invention there is provided a location based augmented reality property listing system to facilitate the marketing and viewing of properties, either for sale or renting, the system comprising: (1) a property database with details of the properties, and photographs and/or videos of a particular property, the photographs/videos having been taken by a 360 degree camera to capture substantially every area in and around the property; (2) input means to allow a user to provide criteria of properties of interest; (3) an augmented reality module to determine the position of the user’s mobile device, determine properties that match the user’s criteria, and display the location of the properties that match the user’s criteria; and (4) a virtual reality module to enable the user to view and manipulate the photographs/videos of the property in order to emulate a virtual reality experience.

[0036] In an embodiment, the augmented reality module is arranged to activate a camera on the user’s mobile device and display a marker or markers, in real time, corresponding to the properties that match the user’s criteria, depending on the spatial orientation of the user’s mobile device and geospatial data of a property.

[0037] In an embodiment, the marker takes the form of a bubble, which may be selected by the user, which in turn causes the details of the selected property to be retrieved and displayed to the user, including an option to allow the user to select the virtual reality mode.

[0038] In an embodiment, the system includes a user database of registered participating users interested or potentially interested in any of the properties in the property database, and the system further including an analytics module to record the user’s property selection criteria, activities, and geographical preferences, including location and markers selected to identify potential properties for viewing.

[0039] In an embodiment, the system allows a property entry/update module to enable an authorised person, such as the property owner or the Real Estate agent, to set up an entry in the property database and to populate the entry with the property details.

[0040] In an embodiment, the property entry/update module enables property details to be either hidden or displayed when the entry in the property database is viewed by a third party, such as a potential buyer or tenant, or another Real Estate agent.

[0041] In an embodiment, the system includes a registration module to enable a user to register, using a software application running on a mobile device or desktop computer associated with the user.

[0042] In an embodiment, the registration module allows the user to define the criteria of properties of interest, including an area of interest, property criteria, geographical area or location, and a minimum and/or a maximum price range.

[0043] In an embodiment, wherein, in the case of the user using a mobile device or smartphone, the input means allows the user to specify the radial distance from the current location of user, to enable a real time set of results to be delivered to the user, who may then interact with the results using the augmented reality module and/or the virtual reality module.

[0044] In an embodiment, wherein in the case of the user using a mobile device or smartphone, the mobile device can be inserted into a virtual reality viewer, with the virtual reality module allowing the user to rotate around the room and to look up and down, by either rotating the mobile device, headgear or by swiping on the image in the required direction.

[0045] In an embodiment, the system includes a notification module to send a notification to the user’s mobile device when a new listing matches the user’s criteria.

BRIEF DESCRIPTION OF THE DRAWINGS

[0046] The invention will now be described, by way of example, with reference to the accompanying diagrammatic drawings. In the drawings:-

Figures 1 to 10 show screenshots corresponding to a location based augmented reality property listing method according to the invention;

Figure 11 shows an example embodiment of the computer hardware of a computing device associated with a user of the method and/or system of the present invention;

Figure 12 shows an example embodiment of the computer hardware of a remote server at an administrator running the method and/or system of the present invention;

Figure 13 shows a highly schematic block diagram of a location based augmented reality property listing system according to the invention, including the key components of the remote server shown in Figure 12 and the key components of the computer hardware shown in Figure 11;

Figure 14 shows a highly schematic flow block diagram of a location based augmented reality property listing method according to the invention;

Figure 15 shows a screenshot having a virtual reality feature of the location based augmented reality property listing method according to the invention;

Figure 16 shows one of a plurality of rooms which may be viewed by a user using virtual reality;

Figures 17 and 18 show a room from two perspectives, using the virtual reality feature;

Figure 19 shows a screen to allow the user to experience the virtual reality feature using a virtual reality viewer;

Figure 20 shows a mobile device being inserted into the virtual reality viewer; and

Figure 21 shows the virtual reality view experienced by the user, once the virtual reality viewer is fitted to the user’s head.

DETAILED DESCRIPTION OF THE INVENTION

[0047] In broad terms, with particular reference to Figure 13, there is provided a location based augmented reality property listing system 8, for use by a user 10, to facilitate the viewing of properties 12, typically proximate the user 10 (but necessarily so), either for sale or renting.

[0048] In broad terms, with reference to Figure 12 as well, a property database 1205 may be provided or set up at a remote site or server 13, including details of properties, either for sale or renting. The details in the property database 1205 may include area, address, price, property size and number of bedrooms, bathrooms, garages etc. If there is an Real Estate agent associated with a particular property 12, details of the Real Estate agent may be included in the property database 1205 as well. The remote site or server 13 may further include a user database 1220 of registered users 10 interested or potentially interested in any of the properties 12 in the property database 1205. The remote site or server 13 may further include a notification module 1221 to send a notification to the user’s mobile device 14 when a new listing matches the user’s criteria (which will be described in more detail further below).

[0049] The property database 1205 may include photographs and/or videos of a particular property 12. In an embodiment, the photographs may be taken by a 360 degree camera to capture substantially every area in and around the property 12.

[0050] In one version, a 360 degree camera is set up in each room of a particular property to capture a 360 degree view of the room. The 360 degree camera may be set up at one or more locations within the room, depending on the size and arrangement of the room. The captured 360 degree image is typically saved onto the property database 1205, with the processor 1200 running software to facilitate the viewing for the 360 degree image. Alternatively, or in addition the capture 360 degree image may uploaded onto a dedicated web site, or a general, public web site. This will enable a virtual reality experience of each room, as will be explained in more detail below with reference to Figures 15 to 21.

[0051] In another version, a 360 degree video may be captured to ultimately enable a user to ‘walk’ through the property, in virtual reality. There are various ways of capturing 360 degree video, but this will typically be done using a specialized omnidirectional cameras and rigs, with the resulting footage then being stitched together to form a single video.

[0052] The invention allows an authorised person 15, such as the property owner or the Real Estate agent to set up an entry in the property database 1205 and to populate the entry with the property details. The property database 1205 may be customised depending upon the owner or Real Estate agent’s requirements. For example, the Real Estate agent or the property owner may hide or show any of the property details, when the entry in the property database 1205 is viewed by a third party, such as a potential buyer or tenant, or another Real Estate agent. Typically, for example, the address of the property may be hidden from view, thus forcing the third party to call the associated Real Estate agent to obtain further details.

[0053] In an embodiment, the invention requires the user 10 to register, using an augmented reality property listing software application running on a mobile device 14 associated with the user 10. In particular, the application may include a registration module 16 to facilitate the registration process.

[0054] The application may further include input means 18 to allow the user 10 to provide criteria of properties of interest; an augmented reality module 20 to determine the position of the user’s mobile device 14, determine properties that match the user’s criteria, and display the location of the properties that match the user’s criteria; a virtual reality module 22 to enable the user 10 to view and manipulate the photographs/videos of the property 12 in order to emulate a virtual reality experience; and a communications module 24 to communicate the user’s recorded activities to the remote site/server 13 and/or to the authorised person 15, such as the property owner or the Real Estate agent and/or to an administrator of the system 8.

[0055] Although the device 14 is shown as a mobile device, certain features of the present invention, such as the user registration functionality, may be performed on a desktop computer associated with the user 10.

[0056] Turning now to Figure 13, the invention extends to a location based augmented reality property listing method 150 to facilitate the advertising and viewing of properties, either for sale or renting. The method 150 comprises providing a property database (such as database 1205 in Figures 12 and 13), as indicated in block 152. As indicated above, the database includes details of the properties, and photographs and/or videos of a particular property, the photographs/videos having been taken by a 360 degree camera to capture substantially every area in and around the property.

[0057] The method 150 then allows a user (such as user 10 in Figure 13) to provide criteria of properties of interest, as indicated in block 154, and to select an augmented reality mode, as indicated in block 156, which activates the augmented reality module 20 in Figure 13. In this mode, the method 150 includes determining the position of the user’s mobile device 14, as indicated in block 158, determining properties that match the user’s criteria, and as indicated in block 160, and displaying the location of the properties that match the user’s criteria, as indicated in block 162. At a high level, the method 150 concludes by allowing the user 10 to select a virtual reality mode, by activating virtual reality module 22 in Figure 13, to enable the user 10 to view and manipulate the photographs/videos of the property in order to emulate a virtual reality experience, as indicated in block 164.

[0058] In use, in one version, the method 150 includes activating a camera on the user’s mobile device 14 and displaying a marker or markers, in real time, corresponding to the properties that match the user’s criteria, depending on the spatial orientation of the user's mobile device. This will be described in more detail further below. The marker may take the form of a bubble, which may be selected by the user 10, which in turn causes the details of the selected property to be retrieved and displayed to the user 10, including an option to allow the user to select the virtual reality mode.

[0059] As indicated above, the method 150 includes recording the user’s activities, including location and markers selected, and communicating this information to a relevant Real Estate agent and/or to an administrator of the method.

[0060] The method 150 includes allowing an authorised person, such as the property owner or the Real Estate agent, to set up an entry in the property database and to populate the entry with the property details. In particular, the method includes the step of hiding or showing any of the property details, when the entry in the property database is viewed by a third party, such as a potential buyer or tenant, or another Real Estate agent. Typically, for example, the address of the property may be hidden from view, thus forcing the third party to call the associated Real Estate agent to obtain further details.

[0061] The method 150 may include an initial step of allowing the user 10 to register, using a software application running on a mobile device or desktop computer associated with the user 10. This may include the step of allowing the user 10 to define the criteria of properties of interest, including an area of interest and a minimum and/or a maximum price range.

[0062] In one particular version, in the case of the user 10 using a mobile device 14, the method 50 includes allowing the user 10 to specify the radial distance from the current location of user 10, to enable a real time set of results to be delivered to the user 10, who may then interact with the results in the augmented reality mode and/or the virtual reality mode.

[0063] The operation of the software application on the mobile device 14, in conjunction with the remote site/server 13 will now be described with reference to the screenshots in Figures 1 to 10.

[0064] The landing page 20 shown in Figure 1 allows the user 10 to specify whether he or she is interested in buying a property (button 22) or renting a property (button 24). The favourite button 26 allows the user 10 to save properties of potential interest, to facilitate easier retrieval/access down the line.

[0065] For the buying option, turning now to Figure 2, the user 10 may choose between residential properties, commercial properties, land for sale, residential auctions and commercial auctions, as set out in the drop down menu 30.

[0066] For the renting option, turning now to Figure 3, the user 12 may choose between residential properties, commercial properties and short term/holiday rentals, as set out in the drop down menu 40.

[0067] Once a selection has been made, the user 10 may choose between a Location mode (button 50) or an Augmented Reality mode (button 52), as shown in Figure 4.

[0068] If the Location mode (button 50) is selected, the screen 60 shown in Figure 5 is retrieved and displayed. This screen 60 enables the user 10 to specify an area of interest to the user, as indicated by drop down menu 62, and a minimum and/or a maximum price range of interest to the user, as provided by selection sliders 64.

[0069] Once the criteria have been selected, a list of properties of potential interest to the user 10 is retrieved and displayed, as shown in screen 70 in Figure 6. Any of these options may in turn be selected, which will activate a map module to show the location of the selected property, as shown in map display 80 in Figure 7.

[0070] If the Augmented Reality mode (button 52) is selected, the screen 90 shown in Figure 8 is retrieved and displayed. In this mode, the user 10 may specify a minimum and/or a maximum price range, as provided by selection sliders 92, as well as a distance around the user’s current location, as provided by selection slider 94. In this mode, the invention determines the position of the user’s mobile device 14, determines properties that match the user’s criteria (price range and distance), and displays the location of the properties that match the user’s criteria.

[0071] As best shown in Figure 9, the camera on the user’s mobile device 14 is activated, with a marker 100 being displayed, in real time, corresponding to the properties (in this case a single property) that match the user’s criteria, depending on the spatial orientation of the user’s mobile device 14. As shown in Figure 9, the marker 100 takes the form of a bubble, which may be selected by the user 10. This in turn causes the details of the selected property to be retrieved and displayed to the user 10, as shown in Figure 10, typically in an information box 110 next to the bubble 100.

[0072] In an embodiment, the user’s activities, including location and markers selected, are recorded, which may be reported to the relevant Real Estate agent and/or to an administrator of the software application.

[0073] Turning now to Figure 12, a location based augmented reality property listing system to facilitate the advertising and viewing of properties, as implemented on a remote server, will briefly be described. The system includes a property database 1205 of the type described above, with details of properties, either for sale or renting, the details including area, address, price, property size and number of bedrooms, bathrooms, garages etc.; [0074] The system further includes a user database 1220 of registered users interested or potentially interested in any of the properties in the property database.

[0075] A Real Estate agent panel module 1222 for use by an authorised person (such as person 15 shown in Figure 13, corresponding to the property owner or the Real Estate agent) to set up an entry in the property database 1205 and to populate the entry with the property details is provided, typically using a property entry/update module. This module 1222 enables the Real Estate agent to hide and/or show any of the property details, when the entry in the property database 1205 is viewed by a third party, as described above.

[0076] The system further includes an analytics module 1224 to record the user’s activities, including the properties of potential interest to the user 10. This information may be reported to the relevant Real Estate agent and/or to an administrator of the system. The administrator interacts with the system via an admin panel 1226.

[0077] The remote server of the system shown in Figure 12 includes a processor 1200, a memory 1205, a bus 1210, a network interface 1215, and a power supply 1225.

[0078] While some embodiments can be implemented in fully functioning computers and computer systems, various embodiments are capable of being distributed as a computing product in a variety of forms and are capable of being applied regardless of the particular type of machine or computer readable media used to actually effect the distribution.

[0079] Figure 11 illustrates an example embodiment of the computer hardware associated with a user mobile computing device 14 of the type envisaged above (with the desktop computer version, as described above, having many of the same components). The user mobile computing device 14 includes a processing unit (CPU) 1022 in communication with a mass memory 1030 via a bus 1024. User mobile computing device 14 also includes a power supply 1026, one or more network interfaces 1050, an audio interface 1052, a display 1054, an optional keypad 1056, a Bluetooth transceiver 1058, one or more input/output interfaces 1060, and a global positioning systems (GPS) receiver 1064 to determine the location of the user’s mobile device 14, as described above.

[0080] Power supply 1026 provides power to the user mobile computing device. A rechargeable or non-rechargeable battery may be used to provide power. The power may also be provided by an external power source, such as an AC adapter or a powered docking cradle that supplements and/or recharges a battery.

[0081] User mobile computing device may optionally communicate with a base station (not shown), or directly with another computing device. Network interface 1050 includes circuitry for coupling the user’s mobile computing device to one or more networks, and is constructed for use with one or more communication protocols and technologies including, but not limited to, global system for mobile communication (GSM), code division multiple access (CDMA), time division multiple access (TDMA), user datagram protocol (UDP), transmission control protocol/lnternet protocol (TCP/IP), SMS, general packet radio service (GPRS), WAP, ultra wide band (UWB), IEEE 802.16 Worldwide Interoperability for Microwave Access (WiMax), SIP/RTP, Bluetooth™, infrared, Wi-Fi, Zigbee, or any of a variety of other wireless communication protocols. Network interface 1050 is sometimes known as a transceiver, transceiving device, or network interface card (NIC).

[0082] Audio interface 1052 is arranged to produce and receive audio signals such as the sound of a human voice. For example, audio interface 1052 may be coupled to a speaker and microphone (not shown) to enable telecommunication with others and/or generate an audio acknowledgement for some action. Display 1054 may be a liquid crystal display (LCD), gas plasma, light emitting diode (LED), or any other type of display used with a computing device. Display 1054 may also include a touch sensitive screen arranged to receive input from an object such as a stylus or a digit from a human hand.

[0083] The user’s mobile computing device 14 may also comprise input/output interface 1060 for communicating with external devices, such as a headset, or other input or output devices. Input/output interface 1060 can utilize one or more communication technologies, such as USB, infrared, Bluetooth™, WiFi, Zigbee, or the like.

[0084] The (Global Positioning Satellite system - GPS) GPS transceiver 1064 can determine the physical coordinates of the user’s mobile computing device 14, which typically outputs a location as latitude and longitude values.

[0085] The GPS transceiver 1064 can also employ other geo-positioning mechanisms, including, but not limited to, triangulation, assisted OPS (AGPS), E-OTD, Cl, SAI, ETA, BSS or the like, to further determine the physical location of the user’s mobile computing device. It is also noted that other GPS systems may be employed. It is understood that under different conditions, GPS transceiver 1064 can determine a physical location within millimeters for the user’s mobile computing device; and in other cases, the determined physical location may be less precise, such as within a metre. In one embodiment, however, a client device may through other components, provide other information that may be employed to determine a physical location of the device, including for example, a MAC address, IP address, or the like.

[0086] In one embodiment, GPS transceiver 1064 may operate with one or more other components of the user’s mobile computing device 14 to connect to a network, to provide location information to another computing device.

[0087] It should be noted, that where the user's configuration includes a GPS or other location detection device that is separate from the user’s mobile computing device 14, then that device may also include, in one embodiment, an ability to connect to a network to provide location information to another computing device.

[0088] Mass memory 1030 includes a RAM 1032, a ROM 1034, and other storage means. Mass memory 1030 illustrates another example of computer storage media for storage of information such as computer readable instructions, data structures, program modules or other data. Mass memory 1030 stores a basic input/output system ("BIOS") or other firmware 1040 for controlling low-level operation of the user’s mobile computing device 14.

[0089] The mass memory also stores an operating system 1041 for controlling the operation of the user’s mobile computing device 14. It will be appreciated that this component may include a general purpose operating system such as a version of UNIX, or LINUX™, or a specialized client communication operating system such as iOS™, Android™, Windows Mobile™, or the Symbian® operating system. The operating system may include, or interface with a Java virtual machine module that enables control of hardware components and/or operating system operations via Java application programs.

[0090] Memory 1030 further includes one or more data storage 1044, which can be utilized by the user’s mobile computing device 14 to store, among other things, applications 1042 (of the type envisaged in the present invention) and/or other data. For example, data storage 1044 may also be employed to store information that describes various capabilities of the user’s mobile computing device 14. The information may then be provided to another device based on any of a variety of events, including being sent as part of a header during a communication, sent upon request, or the like. Moreover, data storage 1044 may also be employed to store personal information including but not limited to address lists, contact lists, personal preferences, or the like. In one embodiment, data storage 1044 may be configured to store information, including, but not limited to user account information, properties of interest, social network information, or the like. In one embodiment, a portion of the information may also be located remote to the user’s mobile computing device 14.

[0091] Applications or "apps" 1042 may include computer executable instructions which, when executed by the user’s mobile computing device 14, transmit, receive, and/or otherwise process messages (e.g., SMS, MMS, IM, email, and/or other messages), multimedia information, and enable telecommunication with another user of another client device. Other examples of application programs include calendars, browsers, email clients, IM applications, SMS applications, VOIP applications, contact managers, task managers, transcoders, database programs, word processing programs, security applications, spreadsheet programs, games, search programs, and so forth.

[0092] Browser 1045 and a mobile application 1047 (of the type envisaged above) may be configured to receive and to send web pages, forms, web-based messages, and the like. Browser 1045 may, for example, receive and display (and/or play) graphics, text, multimedia, audio data, and the like, employing virtually any web based language, including, but not limited to Standard Generalized Markup Language (SMGL), such as HyperText Markup Language (HTML), a wireless application protocol (WAP), a Handheld Device Markup Language (HDML), such as Wireless Markup Language (WML), WMLScript, JavaScript, and the like.

[0093] Embodiments of the disclosure can be implemented via the microprocessor(s) and/or the memory. For example, the functionalities described above can be partially implemented via hardware logic in the microprocessor(s) and partially using the instructions stored in the memory. Some embodiments are implemented using the microprocessor(s) without additional instructions stored in the memory. Some embodiments are implemented using the instructions stored in the memory for execution by one or more general purpose microprocessor(s). Thus, the disclosure is not limited to a specific configuration of hardware and/or software.

[0094] At least some aspects disclosed can be embodied, at least in part, in software. That is, the techniques may be carried out in a computer system or other data processing system in response to its processor, such as a microprocessor, executing sequences of instructions contained in a memory, such as ROM, volatile RAM, non-volatile memory, cache or a remote storage device.

[0095] A computer readable storage medium can be used to store software and data which when executed by a data processing system causes the system to perform various methods. The executable software and data may be stored in various places including for example ROM, volatile RAM, nonvolatile memory and/or cache. Portions of this software and/or data may be stored in any one of these storage devices. As used herein, the phrases "computer readable material" and "computer readable storage medium" refers to all computerreadable media, except for a transitory propagating signal per se.

[0096] Turning now to Figures 15 to 21, a virtual reality feature of the present invention will now be described. In Figure 15, once a particular property 200 has been identified by the user, a virtual reality option 202 may be selected by the user. Once selected, Figure 16 is retrieved and displayed, which shows one of a plurality of rooms 204 which may be viewed by the user using virtual reality. In this case, there are four rooms, as indicated by indicator 206, in respect of which a 360 degree view of each room is available for viewing by the user. Should the user wish to view one of the other rooms, s/he simply has to swipe left or right using scroll bar 208. Once the desired room has been identified, the user may select the virtual reality icon 210, which will then present the room as a 360 degree view, of the type shown in Figures 17 and 18. In this mode, the user may rotate around the room, and look up and down to a certain extent, by either rotating the mobile device or by swiping on the image in the required direction.

[0097] To enhance the virtual reality experience, the virtual reality viewer icon 212 in Figures 17 and 18 may be selected. This will bring up an instruction screen 214 of the type shown in Figure 19, in which the user is directed to insert his/her mobile device 216 into a virtual reality viewer 218, as shown in Figure 20. Figure 21 shows the virtual reality view experienced by the user, once the virtual reality viewer 218 is fitted to the user’s head.

[0098] In another version, a 360 degree video may be captured to ultimately enable the user to ‘walk’ through the property, in virtual reality. There are various ways of capturing 360 degree video, but this will typically be done using a specialized omnidirectional cameras and rigs, with the resulting footage then being stitched together to form a single video. In an embodiment, the processor 1200 will run software to stitch the footage together, for use by the present invention. The captured 360 degree video is typically saved onto the property database 1205, but may also, due to its size, be uploaded onto a dedicated web site, or a general, public web site.

Claims

LOCATION BASED AUGMENTED REALITY PROPERTY LISTING SOFTWARE, METHOD AND SYSTEM CLAIMS

1. A location based augmented reality property listing method to facilitate the advertising and viewing of properties, either for sale or renting, the method comprising: (i) providing a property database with details of the properties, and photographs and/or videos of a particular property, the photographs/videos having been taken by a 360 degree camera to capture substantially every area in and around the property; (ii) allowing a user to provide criteria of properties of interest; (iii) allowing a user to select an augmented reality mode, in which the method further includes: (a) determining the position of the user’s mobile device; (b) determining properties that match the user’s criteria; and (c) displaying the location of the properties that match the user’s criteria; and (d) identifying the geospatial data and location of a property and the position of the mobile device; and (e) allowing the user to select a virtual reality mode to enable the user to view and manipulate the photographs/videos of the property in order to emulate a virtual reality experience; and (f) allowing the user to navigate to the property using the mobile device geospatial data and location of a property and the position of the mobile device and the GPS and mapping data.
2. The method of claim 1, wherein the method includes activating a camera on the user’s mobile device and displaying a marker or markers, in real time, corresponding to the properties that match the user’s criteria, depending on the spatial orientation of the user’s mobile device.
3. The method of claim 2, wherein the marker takes the form of a bubble, which may be selected by the user, which in turn causes the details of the selected property to be retrieved and displayed to the user, including an option to allow the user to select the virtual reality mode.
4. The method of any preceding claim, wherein the user’s activities, including location and markers selected, are recorded and communicated to a relevant Real Estate agent and/or to an administrator of the method.
5. The method of any preceding claim, wherein the details of the properties on the property database include area, address, price, property size and number of bedrooms, bathrooms and garages.
6. The method of claim 5, wherein if there is an Real Estate agent associated with a particular property, details of the Real Estate agent are included in the property database as well.
7. The method of claim 6, wherein the method includes allowing an authorised person, such as the property owner or the Real Estate agent, to set up an entry in the property database and to populate the entry with the property details.
8. The method of claim 7, wherein the method includes the step of hiding or showing any of the property details, when the entry in the property database is viewed by a third party, such as a potential buyer or tenant, or another Real Estate agent.
9. The method of any preceding claim, wherein the method includes the step of allowing a user to register, using a software application running on a mobile device or desktop computer associated with the user.
10. The method of claim 9, wherein the method allows the user to define the criteria of properties of interest, including an area of interest and a minimum and/or a maximum price range.
11. The method of claim 10, wherein, in the case of the user using a mobile device, the method includes allowing the user to specify the radial distance from the current location of user, to enable a real time set of results to be delivered to the user, who may then interact with the results in the augmented reality mode and/or the virtual reality mode.
12. The method of claim 11, wherein in the virtual reality mode and in the case of the user using a mobile device, the method includes allowing the mobile device to be inserted into a virtual reality viewer, with the step of manipulating the photographs/videos of the property in order to emulate a virtual reality experience including allowing the user to rotate around the room and to look up and down, by either rotating the mobile device or by swiping on the image in the required direction.
13. The method of any one of claims 10 to 12, wherein the method includes sending a notification to the user’s mobile device when a new listing matches the user’s criteria.
14. A location based augmented reality property listing system to facilitate the advertising and viewing of properties, either for sale or renting, the system comprising: (i) a property database with details of the properties, and photographs and/or videos of a particular property, the photographs/videos having been taken by a 360 degree camera to capture substantially every area in and around the property; (ii) input means to allow a user to provide criteria of properties of interest; (iii) an augmented reality module to determine the position of the user’s mobile device, determine properties that match the user’s criteria, and display the location of the properties that match the user’s criteria; and (iv) a virtual reality module to enable the user to view and manipulate the photographs/videos of the property in order to emulate a virtual reality experience.
15. The system of claim 14, wherein the augmented reality module is arranged to activate a camera on the user’s mobile device and display a marker or markers, in real time, corresponding to the properties that match the user’s criteria, depending on the spatial orientation of the user’s mobile device.
16. The system of claim 15, wherein the marker takes the form of a bubble, which may be selected by the user, which in turn causes the details of the selected property to be retrieved and displayed to the user, including an option to allow the user to select the virtual reality mode.
17. The system of any preceding claim 14 to 16, which includes a user database of registered users interested or potentially interested in any of the properties in the property database, the system further including an analytics module to record the user’s activities, including location and markers selected, with the system further including a communications module to communicate the user’s recorded activities to a relevant Real Estate agent and/or to an administrator of the system.
18. The system of any preceding claim 14 to 17, wherein the details of the properties on the property database include area, address, price, property size and number of bedrooms, bathrooms and garages.
19. The system of claim 18, wherein if there is an Real Estate agent associated with a particular property, details of the Real Estate agent are included in the property database as well.
20. The system of claim 19, wherein the system allows a property entry/update module to enable an authorised person, such as the property owner or the Real Estate agent, to set up an entry in the property database and to populate the entry with the property details.
21. The system of claim 20, wherein the property entry/update module enables property details to be either hidden or displayed when the entry in the property database is viewed by a third party, such as a potential buyer or tenant, or another Real Estate agent.
22. The system of any preceding claim 14 to 21, which includes a registration module to enable a user to register, using a software application running on a mobile device or desktop computer associated with the user.
23. The system of claim 22, wherein the registration module allows the user to define the criteria of properties of interest, including an area of interest and a minimum and/or a maximum price range.
24. The system of claim 23, wherein, in the case of the user using a mobile device, the input means allows the user to specify the radial distance from the current location of user, to enable a real time set of results to be delivered to the user, who may then interact with the results using the augmented reality module and/or the virtual reality module, and using the known positions to integrate with GPS navigation software and mapping data for the user to navigate to the property.
25. The system of claim 24, wherein in the case of the user using a mobile device, the mobile device can be inserted into a virtual reality viewer, with the virtual reality module allowing the user to rotate around the room and to look up and down, by either rotating the mobile device or by swiping on the image in the required direction.
26. The system of any one of claims 23 to 25, wherein the system includes a notification module to send a notification to the user’s mobile device when a new listing matches the user’s criteria.