NZ734671B2

NZ734671B2 - A method for roadside asset tracking and maintenance monitoring

Info

Publication number: NZ734671B2
Application number: NZ734671A
Authority: NZ
Inventors: Norman Boyle
Original assignee: Norman Boyle
Priority date: 2015-01-16
Filing date: 2016-01-15
Publication date: 2022-06-28

Abstract

There is provided a method for roadside asset tracking and maintenance monitoring. The method comprises periodically deploying a mobile unit alongside a roadside section. The mobile unit comprising a data capture device comprising: an asset data capture device operably coupled to at least one digital camera configured for capturing roadside asset image data; a global positioning system (GPS) receiver; and a data interface for communicating with an asset management server, the server comprising an asset tracking register database. The method comprises receiving the roadside asset image data representing images taken of a plurality of roadside assets and receiving location data from the GPS receiver representing the respective locations the roadside assets. The method then comprises utilising an asset type image recognition technique for automating the identification of the roadside assets and comparing roadside asset data of the asset tracking register database to record newly identified roadside assets and their respective locations in the asset tracking register database; and identify missing roadside assets. l camera configured for capturing roadside asset image data; a global positioning system (GPS) receiver; and a data interface for communicating with an asset management server, the server comprising an asset tracking register database. The method comprises receiving the roadside asset image data representing images taken of a plurality of roadside assets and receiving location data from the GPS receiver representing the respective locations the roadside assets. The method then comprises utilising an asset type image recognition technique for automating the identification of the roadside assets and comparing roadside asset data of the asset tracking register database to record newly identified roadside assets and their respective locations in the asset tracking register database; and identify missing roadside assets.

Description

There is provided a method for roadside asset tracking and maintenance monitoring. The method comprises periodically deploying a mobile unit alongside a roadside section. The mobile unit comprising a data capture device comprising: an asset data capture device operably coupled to at least one digital camera configured for capturing roadside asset image data; a global positioning system (GPS) receiver; and a data interface for communicating with an asset management server, the server comprising an asset ng register database. The method comprises receiving the roadside asset image data enting images taken of a ity of roadside assets and receiving location data from the GPS er representing the respective locations the roadside assets.

The method then ses utilising an asset type image recognition technique for automating the identification of the roadside assets and comparing roadside asset data of the asset tracking register database to record newly identified roadside assets and their respective locations in the asset tracking register database; and identify g roadside assets.

NZ 734671 A method for roadside asset tracking and maintenance monitoring Field of the ion The present invention relates in particular, but not necessarily entirely, to a system, server and data capture device for roadside asset tracking and maintenance monitoring.

Background Roadside assets, such as public infrastructure assets, such as speed management posts, reflector posts, roadside barriers and the like are installed and subsequently repaired and maintained over long periods of time.

Now, D1 (US 20080086391 A1 - MAYNARD), being exemplary of the current state of the art, discloses a system for impromptu asset tracking for maintenance scheduling. ically, D1 refers to the tracking of e asset types such as graders, levelers, dozers, saws, debris transportation vehicles, s, pavers, concrete trucks, supply trucks, cranes, tools, service trucks, compressors and so on and describes es of the system used in the construction industry (specifically building a shopping mall) for monitoring asset maintenance and unauthorised use of such .

For example, D1, in paragraphs 481-482 refers to a reporting device that is mounted to a moveable asset so as to record characteristics of the moveable asset such as by, for example, recording the position of the moveable asset, and having a diagnostic evaluator such as a mileage indicator, a speedometer, a eter, an oil pressure indicator, a wheel pressure indicator, a hydraulic indicator, an engine time r, and the like to monitor and se the asset so as to be able to schedule nance and detect unauthorised use of the moveable asset.

As such, D1 is not suited for fixed roadside asset. In this regard, for de assets, councils often times have poor documentation of such roadside asset installations and may therefore not have information relating to the specific location, type, condition and value of each roadside asset.

As such, it would be advantageous to have the ability to identify roadside asset installations.

In this regard, the best D1 offers in terms of identifying (moveable) assets is by ng a barcode, or inputting a chassis VIN number or the like (see paragraph 488 of D1).

However, D1 is not suited for identifying roadside assets because roadside assets do not mly comprise such barcodes, VIN numbers and the like.

As such, it would be advantageous to have the ability to automate the identification of roadside assets in a manner that does not rely on barcodes and the like.

Furthermore, councils may not be aware of roadside assets that have been d and require replacement or that have been damaged and require maintenance.

As such, it would be advantageous to have the ability to automate the detection of missing roadside assets.

Furthermore, if an asset is to be replaced, such as a speed limit management post, the specific speed limit management post may require installation at a particular location adjacent the road and specify a particular speed. In this manner, the l may not know the previously utilised specific location or the specific speed limit displayed by the speed limit management post. As such, were the speed limit management post replaced, it may be installed in the incorrect location, or with the incorrect speed limit.

As such, it would be advantageous to have a historical record of installed roadside assets, including their teristics, such as, for example for speed management signs, their locations, their respective speed limits and the like.

Furthermore, councils have no quality control mechanisms for roadside maintenance, such as verge grass cutting other than manual inspections. For example, at least five times a year, the council may deploy grass s to cut grass adjacent roads which may involve multiple cutters at differing times. r, councils are unable to control the quality of the grass cutting, such as whether the grass has been cut, whether the grass has been cut to the correct height, whether the grass has been cut sufficiently proximate roadside assets and the like. Indeed, the only mechanism for councils to ensure quality is by way of manual inspection which is not feasible.

As such, it would be advantageous to have means for ring the quality of roadside maintenance.

Furthermore, many councils across lia are experiencing a g of infrastructure renewal and there have been recommendations for the funding of asset management programs for councils. In this regard, councils need to allocate funding for roadside asset maintenance so as to t funding from the federal government, allocate rates and the like. However, councils often times do not know the extent of their asset ory, or the value of the assets of their inventory. In this manner, councils cannot accurately calculate depreciation costs, replacement costs and the like.

D2 (US 86391 A1 - MAYNARD) discloses a system that receives fixed asset data and then predicts a maintenance plan based on various statistical factors, such as weather, asset type failure rates and the like.

As such, D2 fails to offer the above described advantages of the y to identify roadside asset installations, the ability to te the identification of roadside assets in a manner that does not rely on barcodes and the like, the ability to automate the detection of missing roadside assets, the y to have a historical record of installed roadside assets, ing their characteristics, such as, for e for speed management signs, their locations, their respective speed limits and the like.

It is to be understood that, if any prior art information is referred to herein, such reference does not constitute an admission that the information forms part of the common general knowledge in the art, in Australia or any other country. y of the Disclosure The present invention seeks to provide a , system, server and data capture device for roadside asset tracking and maintenance monitoring, which will overcome or substantially ameliorate at least some of the deficiencies of the above prior art, or to at least provide an alternative. Specifically, in embodiments as will be described in r detail below, there is described an asset and maintenance ng system which may be deployed on roadside maintenance vehicles, such as grass cutters, to record roadside assets, such as traffic management post, reflector posts and the like, subsequently monitor the previously ed assets, and to monitor the maintenance conducted by the roadside maintenance e.

Specifically, in accordance with particular ments and the exemplary application of roadside grass cutting, the system may be run in "Set-up" mode such that each roadside management post that is slashed is recorded, coded and labelled on a map. A image of the asset is taken at the time of grass cutting that is stored for reference should it need to be ically identified.

Furthermore, the system may perform asset identification and ion wherein once data is entered, the system will provide a data analysis option where each asset image is analysed for type, ion and valuation at the time of entry. Any asset needing attention will be flagged and given a liability risk rating.

The system may also allow for real-time tracking of nance machinery enabling realtime feedback of the progress of the roadside maintenance. A GPS tracking system allows councils and supervisors to see the location of the grass cutting maintenance machinery on a map and provide more information such as the operator of the machinery.

The system may be further adapted to provide a photographic summary of each nance job wherein front and rear mounted cameras will be capable of time incremented photographs showing each maintenance run’s works as executed (WAE) and work in progress (WIP). A time-lapse video of these photos will give supervisors an overview of each job, data for quality control and efficiency s as well as ct compliance data.

The system may further allow for accumulative data wherein the system will create a log for each maintenance run that will provide useful information that can be used for future statistical analysis and budgeting forecasts.

The system may further allow for real-time nt ing wherein any incidents encountered in the maintenance run will be recorded and flagged for council or a supervisor’s ion immediately reducing the risk of escalation of any nts.

The system may further allow for collaborative data n data from le councils can be ted and compared. This will encourage an increase in efficiency, best practice, budget comparison and provide comparative statistics.

With the foregoing in mind, according to one aspect, there is provided method for roadside asset tracking and maintenance monitoring, the method sing: periodically deploying a mobile unit alongside a roadside section, the mobile unit comprising a data capture device comprising: an asset data capture device operably coupled to at least one digital camera configured for capturing roadside asset image data; a global positioning system (GPS) receiver; and a data interface for communicating with an asset management server, the server comprising an asset tracking register database; receiving the roadside asset image data representing images taken of a plurality of roadside assets; receiving location data from the GPS er representing the respective locations the roadside assets; utilising an asset type image recognition que for automating the identification of the roadside assets; comparing roadside asset data of the asset tracking register database to: record newly identified roadside assets and their respective locations in the asset tracking register database; and identify missing roadside assets.

The asset type image recognition technique may comprise an image recognition stage comprising edge shape detection.

The edge shape detection may comprise rotation invariance processing to allow for edge shape detection of skew roadsign assets.

Edge shape ion may comprise comparison to reference shapes in a shape reference database.

The image recognition may comprise an image recognition stage comprising colour detection.

The colour detection may comprise colour juxtapose detection.

Colour ion may se comparison to nce colours in a colour reference database.

The image recognition may comprise an image recognition stage comprising symbol Symbol detection may comprise comparison to reference symbols in a symbol reference database.

Symbol detection may comprise alphanumeric symbol detection.

Symbol detection may comprise text recognition.

The mobile unit may further comprise an asset proximity detector for detecting the proximity of roadside assets and the asset data capture device may be red by the asset proximity or.

The mobile unit may comprise a grass cutter unit and the proximity or may be configured for detecting when the roadside asset may be engaged by the grass cutter unit.

The mobile unit may comprise a grass cutter unit and the grass cutter unit may be controllable to be moveable with respect to the mobile unit and the at least one digital camera may be configured to follow the movement of the grass cutter unit.

The method may further comprise image comparison for detecting roadside asset damage or degradation to identify assets requiring maintenance.

The image comparison may comprise colour comparison.

The image ison may comprise shape comparison.

The image comparison may comprise colour detection.

The image comparison may comprise symbol comparison.

The method may further comprise generating a map representation representing the roadside section and the locations of the fied roadside assets along the roadside n.

The mobile unit may comprise at least one camera for capturing image data from the perspective of the mobile unit and the map representation may be configured for selectively displaying image data from the at least one camera at a plurality of locations along the roadside section.

The mobile unit may comprise forward and rearward facing s for respectively capturing forward and rearward facing image data from the perspective of the mobile unit and the map representation may be configured for ying before and after maintenance ison imagery utilising the image data received from the forward and rearward facing cameras.

The method may further comprise calculating a valuation for the roadside assets, the valuation calculated in accordance with the asset type identified using the asset type image ition technique.

The valuation may be further calculated in accordance with entry dates associated with each of the asset types.

The method may further comprise using an asset condition estimate image recognition technique to estimate a condition of each of the roadside assets and the valuation may be further calculated in accordance with the estimated condition.

The method may further comprise calculating maintenance statistics including at least one of last maintenance date, distance of the roadside section and e time to maintain the de section.

The method may further comprise the mobile unit receiving, via the data interface, maintenance instruction data sing instructions for the maintenance of the roadside section.

The mobile unit may be configured for sending the asset image data to the server and the service performs the asset type image recognition.

In accordance with other aspects, there is provided a server for roadside asset tracking, the server may se a processor for processing l data; a memory device for storing digital data including computer program code, the memory device being operably coupled to the processor; a network ace adapted for sending and receiving data across a data network, the network interface being operably coupled to the processor; and a database adapted for storing asset data representing a plurality of assets, the asset data may comprise at least unique asset identifier data and asset location data, the database being operably coupled to the processor, wherein, in use, the processor may be controlled by the computer program code to e, via the network interface, from a remote data capture device, asset data relating to an asset, the asset data may comprise at least location data representing the location of the asset; and insert, into the database, the asset data in association with a unique asset identifier and the location data.

The asset data further may comprise the asset type and wherein the processor may be further controlled by the computer program code to store, in the se, the asset type in association with the unique asset identifier.

The asset data further may comprise additional asset information and wherein the processor may be further controlled by the computer program code to store, in the se, the additional asset information in association with the unique asset identifier.

The sor may be further controlled by the computer program code to select an additional asset information category in accordance with the asset type.

The asset data further may se image data and wherein the processor may be further controlled by the computer program code to store, in the database, the image data in association with the unique asset identifier The processor may be further controlled by the er program code to store, in the database, valuation data enting a valuation of the asset in association with the unique asset identifier.

The sor may be further controlled by the computer program code to calculate the The sor may be further controlled by the computer program code to calculate the valuation in accordance with an asset type.

The processor may be further controlled by the computer program code to calculate the ion in accordance with an asset lifespan allocated for the asset type.

The processor may be further controlled by the computer program code to calculate the valuation in accordance with a depreciation schedule for the asset type.

The processor may be further controlled by the computer program code to select, from the database, previously recorded asset data representing a plurality of previously recorded assets; e the asset data against the previously recorded asset data; and identify at least one missing asset in accordance with the usly recorded asset data and the asset data.

The processor may be further controlled by the er program code to , from the database, previously recorded asset data representing the asset; compare the asset data against the previously recorded asset data; and identify the asset as ing maintenance in accordance with the asset data and the previously recorded asset data.

The previously recorded asset data may comprise previously recorded image data representing a previous image of the asset and the asset data may comprise present image data representing a previous image of the asset and wherein, in identifying the asset as requiring maintenance, the processor may be r controlled by the er program code to compare the previously recorded image data and the present image data.

The processor may be further controlled by the computer program code to generate map representation data, the map representation data may comprise a representation of the asset represented at an riate location of the asset.

The database may be further d to store maintenance task data representing various maintenance tasks allocated to various maintenance machinery for various maintenance routes and n, in use, the processor may be further controlled by the computer program code to receive, via a network ace, from the remote data capture device, maintenance data relating to a maintenance task being performed by maintenance machinery may comprise the remote data capture device; and store, in the database, the maintenance data in relation to maintenance machine ry identification data fying the maintenance ery and read identification data representing the maintenance route.

The maintenance data may comprise the location of a maintenance machinery.

The maintenance data may comprise maintenance image data.

The maintenance image data may comprise maintenance image data representing a rearward image from the maintenance vehicle.

The nance image data may comprise maintenance image data representing a forward image from the maintenance vehicle.

In use, the processor may be further controlled by the computer m code to calculate at least one maintenance tic in accordance with at least one of the maintenance data and the asset data.

The at least one maintenance statistic may comprise at least one of route number uniquely representing, total number of assets for the route, total value of assets for the route, the last maintenance date of the route, the distance of the route, the average time to maintain the route and the maintenance cost per kilometre for the route.

In use, the processor may be further controlled by the computer program code to send, via the network interface, to the remote data capture device, maintenance instruction data.

According to yet another aspect, there is provided a data capture device for roadside asset tracking, the data capture device may se a processor for processing l data; a memory device for storing digital data including computer program code, the memory device being operably coupled to the processor; a location sensor adapted to sense a location of the data capture , the location sensor being operably coupled to the processor; an asset data receiver adapted to receive asset data; and a wireless network interface adapted for sending and receiving data across a wireless data network, the network interface being operably coupled to the processor, n, in use, the processor may be controlled by the computer program code to e, from the asset data er, asset data relating to an asset; receive, from the location sensor location data representing the location of the data capture device; and send, via the network interface, to an asset tracking server, the asset data, the asset data may comprise the location data.

The asset data receiver may comprise an image capture device and n, in use, the asset data may comprise image data representing an image of the asset.

The image capture device may be a forward facing image capture device.

The image capture device may be a rearward facing image e device.

The image capture device may comprise both a forward facing image capture device and a rearward image capture device and n, in use, the processor may be controlled by the computer program code to capture forward view image data enting a forward view of the asset; and subsequently capture rearward view image data representing a rd view of the asset.

The processor may be further controlled by the computer program code to identify the asset in accordance with the image data.

The processor may be further controlled by the computer program code to fy the asset in ance with an image recognition technique.

The image recognition technique may comprise an image comparison technique with a plurality of asset type images.

The processor may be further controlled by the computer program code to capture the image data upon receipt of a trigger signal.

The asset data input may comprise an asset detector adapted to generate the trigger .

The asset detector may be a physical asset detector.

The asset detector may be a noncontact asset detector.

The noncontact asset detector may comprise light beam interrupt detector.

The tact asset detector may comprise an ultrasonic proximity detector.

The asset data input device may comprise a scanning device adapted to scan the asset data from a data bearing computer readable medium.

The data bearing computer readable medium may comprise a barcode.

The e may comprise at least one of a 2-D and 3-D barcode.

The data bearing computer readable medium may comprise a near field radio frequency tag.

The asset data input device may comprise a human interface device adapted to receive at least a subset of the asset data.

It should be noted that while the embodiments described herein are described with reference to tracking roadside assets and maintaining des, the embodiments described herein need not necessarily be limited to these particular applications and the embodiments may be applicable to other applications also, including non-roadside located assets and maintenance, such as for, for example, the ng and nance of trees within an orchard and the like.

Other aspects of the invention are also disclosed.

Brief ption of the Drawings Notwithstanding any other forms which may fall within the scope of the t invention, a preferred embodiments of the disclosure will now be bed, by way of example only, with reference to the accompanying drawings in which: Figure 1 shows a system for roadside asset tracking in ance with an embodiment of the present disclosure; Figure 2 shows a computing device for application in the system of Figure 1 in accordance with an embodiment of the t disclosure; Figure 3 shows maintenance machinery comprising a data capture device in accordance with an embodiment of the present disclosure; Figure 4 shows a grass cutting device of the maintenance machinery of figure 3 in accordance with an embodiment of the present disclosure; and Figures 5 and 6 show exemplary graphical user interfaces yed by the data capture device of the system of Figure 1 in accordance with an embodiment of the present disclosure; and Figure 7 shows an exemplary cal user interface displayed by the strative client computing device of the system of Figure 1 in accordance with an embodiment of the present disclosure.

Description of Embodiments For the purposes of promoting an understanding of the principles in accordance with the disclosure, reference will now be made to the embodiments illustrated in the drawings and specific language will be used to describe the same. It will nevertheless be understood that no limitation of the scope of the disclosure is thereby intended. Any alterations and further modifications of the inventive features illustrated herein, and any additional applications of the principles of the disclosure as illustrated herein, which would normally occur to one skilled in the relevant art and having possession of this disclosure, are to be considered within the scope of the disclosure.

Before the structures, systems and ated methods relating to the system, server and data capture device for roadside asset tracking and maintenance monitoring are disclosed and described, it is to be understood that this disclosure is not d to the particular configurations, process steps, and the like disclosed herein as such may vary at. It is also to be understood that the terminology employed herein is used for the purpose of describing particular embodiments only and is not intended to be limiting since the scope of the disclosure will be limited only by the claims and equivalents thereof.

In bing and ng the subject matter of the disclosure, the following terminology will be used in accordance with the definitions set out below.

It must be noted that, as used in this specification and the appended claims, the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise.

As used herein, the terms "comprising," ding," "containing," "characterised by," and grammatical equivalents thereof are inclusive or nded terms that do not exclude additional, unrecited elements or method steps.

It should be noted in the following description that like or the same reference ls in different embodiments denote the same or similar es.

A system for asset tracking Turning now to figure 1, there is shown a system 100 for roadside asset tracking.

The system 100 ses at least one data capture device 105 operably coupled to a server computing device 140 across a data network 130. In this manner, the data capture device 105 is adapted to record information relating to various roadside assets and convey the asset data to the server 140 for recordal. Operably coupled to the server 140 is a database 135 adapted for storing asset and maintenance data.

The asset data may comprises asset type and location data enting a ity of assets and their respective locations. Over and above this, the database 135 may store onal asset data as will be bed in further detail below, such as asset image data, asset valuation data and the like.

The maintenance data may comprise maintenance data relating to particular maintenance routes, the maintenance route distances, maintenance machinery and operators ted to maintenance jobs and image data being a record of maintenance performed for maintenance quality control purposes as will be described in further detail below.

The data capture device 105 comprises a wireless network interface 125 for sending and ing data across the network 130. The wireless network interface 125 is ideally suited for use by roadside maintenance machinery, such as grass cutting devices as will be described in further detail below, and should ore be able to send and receive data across several tres. In this manner, in one embodiment, the k interface 125 is a GSM interface adapted to send and receive data across a GSM data network, such as a 3G, 4G data network or the like.

It should be noted that in certain embodiments, as opposed to the data capture device comprising a wireless network interface 125 for sending the asset data to the server 140, in other embodiments, the data capture device 105 comprises a local database adapted for storing the asset data. In this manner, upon completion of an asset tracking run or maintenance job, the data from the local database may be retrieved such as by way of USB memory stick or the like for uploading to the server 140 or other computing device.

Operably coupled to the ss network interface 125 is a computing device 200 as will be described in further detail below, especially with reference to figure 2.

The computing device 200 is adapted to receive asset data and send the asset data to the server 140 across the network 130.

As such, operably coupled to the computing device 200 is an asset data input device 115 adapted to receive asset data relating to a plurality of assets. As can be iated, there are a number of s in which asset data relating to a plurality of assets may be input into the data capture device. These different manners will be described in further detail below, but for brief introductory purposes, in embodiments, the asset data input device 115 may comprise an g device, such as a camera or the like adapted to e images of various assets. These images of the assets maybe then manually classified by operators, or alternatively utilised for automated image recognition purposes for fying assets.

Furthermore, the asset data input device 150 may comprise a scanning device adapted to scan a computer readable media ed to the asset, such as a barcode, near field communication tag and the like.

Yet further, the asset data input device 150 may comprise an asset proximity detector adapted for use in the below ned embodiment where the data e device 105 is used in ction with a grass cutting device comprising an asset engagement. In this manner, the asset engagement may comprise an asset detector, such as a deflecting lever, light beam interrupt or the like adapted to sense the presence of the asset engaged by the asset engagement.

Yet further, the asset data input 150 may comprise a human input , such as a keyboard and the like allowing a human operator to manually input asset data relating to an asset.

The data capture device 155 may further comprise a display device (not shown) adapted for displaying digital data, especially the exemplary graphical user interfaces provided below with reference to figures 5 and 6.

Furthermore, the system 100 may comprise a client computing device 200 operably coupled to the server 140 and/or the data capture device 105 to m various administrative functionality, including by way of exemplary graphical user interface provided below with reference to figures 7.

A computing device 200 Turning now to figure 2, there is shown a computing device 200 adapted for being implemented as any of the computing devices as substantially provided in figure 1. Specifically, the computing device 200 may be adapted to perform the onality performed by the server 140, data capture device 105 or administrative client computing device 200.

In ular the computer implemented functionality for asset tracking and maintenance monitoring, as described , may be implemented as computer program code instructions executable by the computing device 200. The computer program code instructions may be divided into one or more computer m code instruction libraries, such as dynamic link libraries (DLL), wherein each of the libraries performs a one or more steps of the method. Additionally, a subset of the one or more of the libraries may perform graphical user interface tasks relating to the steps of the The device 200 comprises semiconductor memory 210 comprising volatile memory such as random access memory (RAM) or read only memory (ROM). The memory 210 may comprise either RAM or ROM or a ation of RAM and ROM.

The device 200 comprises a computer program code storage medium reader 260 for reading the computer program code instructions from computer m code storage media to 65. The storage media to 65 may be optical media such as CD-ROM disks, magnetic media such as floppy disks and tape cassettes or flash media such as USB memory sticks.

The device further comprises I/O interface 235 for communicating with one or more peripheral devices. The I/O ace 235 may offer both serial and parallel interface connectivity. For example, the I/O interface 235 may comprise a Small Computer System Interface (SCSI), Universal Serial Bus (USB) or similar I/O interface for interfacing with the storage medium reader 260. The I/O interface 235 may also communicate with one or more human input s (HID) 255 such as keyboards, pointing devices, joysticks and the like. The I/O interface 235 may also comprise a er to er interface, such as a Recommended Standard 232 2) interface, for interfacing the device 200 with one or more personal computer (PC) s 250. The I/O interface 235 may also comprise an audio interface for communicate audio signals to one or more audio devices 245, such as a speaker or a buzzer.

The device 200 also comprises a network interface 240 for communicating with one or more computer networks 270. The k 270 may be a wired network, such as a wired EthernetTM network or a wireless network, such as a BluetoothTM network, IEEE 802.11, cellular data k network or the like. The network 280 may be a local area network (LAN), such as a home or office computer network, or a wide area k (WAN), such as the Internet or private WAN.

The device 200 comprises an arithmetic logic unit or processor 220 for performing the computer program code instructions. The processor 220 may be a d instruction set computer (RISC) or complex instruction set computer (CISC) processor or the like. The device 200 further comprises a storage device 230, such as a magnetic disk hard drive or a solid state disk drive.

Computer program code instructions may be loaded into the storage device 230 from the storage media 265 using the storage medium reader 260 or from the network 270 using network interface 240. During the bootstrap phase, an operating system and one or more software applications are loaded from the storage device 230 into the memory 210. During the fetch-decode-execute cycle, the processor 220 fetches computer program code instructions from memory 210, decodes the instructions into machine code, executes the instructions and stores one or more intermediate results in memory 210.

In this manner, the instructions stored in the memory 210, when retrieved and executed by the processor 220, may configure the computing device 200 as a special-purpose machine that may perform the functions bed herein.

The device 200 also comprises a video interface 215 for conveying video signals to a display device 205, such as a liquid crystal y (LCD), cathode-ray tube (CRT) or r display device.

The device 200 also comprises a communication bus tem 225 for interconnecting the various devices described above. The bus tem 225 may offer parallel connectivity such as Industry rd Architecture (ISA), conventional Peripheral Component Interconnect (PCI) and the like or serial connectivity such as PCI s (PCIe), Serial Advanced Technology Attachment (Serial ATA) and the like.

Maintenance machinery As alluded to above, in a preferred embodiment, the data capture device 105 is adapted for ation of conjunction with maintenance machinery.

Specifically, referring to figure 3, there is shown one version of maintenance machinery 300 comprising a maintenance vehicle 305 and a grass slasher 310.

The maintenance machinery 300 may comprise maintenance machinery as is disclosed in respect of patent application in the name of the present Applicant, the entire contents of which are incorporated herein by reference.

The maintenance vehicle 305, being a bobcat, tractor or other similar vehicle is adapted to move the grass slasher 310 along roadsides for grass cutting purposes. While performing the maintenance, by ing the maintenance machinery 300 with the data e device 105, the de assets may be advantageously simultaneously recorded and maintained and the maintenance performed by the maintenance machinery 300 may be recorded for subsequent quality control verification purposes.

Further specifically, referring to figure 4, there is shown a perspective view of the grass slasher 310 in further detail. In this particular embodiment, the grass slasher 310 comprises an asset engagement 310 or dock d to engage a roadside asset, such as a traffic control e post or the like so as to be able to cut about the signage post.

In this manner, the asset ment 310 may comprise the above-mentioned asset detector adapted to detect the proximity of the post so as to be able to record asset data.

Exemplary embodiments Having described the above system ecture, there will now be described various exemplary embodiments for rative purposes, including describing the functions performed by the server 140 and data capture device 105. It should be noted that these embodiments are exemplary only and that no limitation should necessarily be d to the embodiments bed herein other than those specifically enumerated in the claims.

In these exemplary embodiments, there will be described the utilisation of the maintenance machinery 300 as substantially provided in figure 3 and 4 for tracking roadside assets during the grass cutting process. However, again, this ation is ary only and the system 100 may be equally applicable for provision in other applications, including applications not necessarily comprising maintenance machinery and not necessarily for assets located along roadsides.

Server functionality Now with this exemplary application in mind, there will now be bed the functionality performed by the server 140. Specifically, in this embodiment, the server 140 comprises a processor 220 for sing digital data, a memory device 210 for storing digital data including computer program code, the memory device 210 been operably coupled to the processor 220. Furthermore, the server 120 comprises a network interface adapted for sending and receiving data across the data network 130, the network interface been operably coupled to the processor 220. Furthermore, the server 140 comprises a database interface for interfacing with the database 135. In this regard, the database is adapted for storing asset data representing a plurality of assets wherein the asset data comprises at least a unique asset identifier data and asset location data. The database interface is similarly ly coupled to the processor 220.

Server functionality – data recorded Now, in use, the server 140 is adapted to receive, from the data capture device 105 asset data ng to a roadside asset, the asset data comprising at least the location of the roadside asset. In this manner, the server 140 is adapted to store, in the database 135, asset type and location data representing the asset and the location thereof.

For example, during the grass cutting s, should the maintenance vehicle 300 come across and 80 km an hour speed signage post, the data capture device 105 would send asset data relating to the speed signage post and the location thereof, as ascertained from the location sensor 110, to the server 140.

In this manner, the server 140 may record the location of the speed signage post. If the speed signage post has not yet been recorded in the database 135, the server 140 may create an entry for the speed signage post.

Now, further information may be provided by the data e device 105 to the server 140.

In one embodiment, the server 140 may r be adapted to receive, from the data capture device 105, the asset type. For example, for the mentioned speed signage post, the speed signage post asset type may be allocated. Other asset types may e, for e, informational street signage, warning street signage, and other asset types not specifically related to signage, such as roadside barriers, speed bumps, cattle grids, water fountains, side roads and the like.

A r embodiment, the server 140 may be adapted to store onal information in relation to the asset type. For example, for the speed signage asset type, the speed may be recorded, such as 80 km per hour. In this manner, should the ular street sign require replacement, the appropriate speed signage of the ement speed sign may be ascertained from the se 135.

Other additional information may include the condition of the roadside asset, such as a rating of 1 to 10.

In this embodiment, the system 100 may be configured for differing additional information according to differing asset types. In this , the system 100 may record or prompt for input the appropriate additional information as ed for the ular asset type.

In one preferred embodiment, the server 140 is adapted to receive, from the data capture device 105 image data relating to a particular asset for storage within the database 135.

Specifically, the asset data input 115, as will be described in further detail below, in one embodiment may comprise an imaging device such as a camera or the like. In this manner, upon recordal of an asset by the data capture device 105, an image of the asset may be captured using the camera. In this , image data may be stored for each asset recorded within the database 135, for subsequent visual inspection and other es.

In embodiments, as will be bed in further detail below, the system 100 may be adapted for the automated identification of assets using image recognition technique performed on the image data.

In yet further embodiments, the system 100 may be adapted to allocate a monetary valuation for each asset. In this manner, during the asset recording process, a monetary valuation of the asset inventory may be ascertained from the server 140 which may serve various purposes, including for funding for maintenance and the like.

In this embodiment, the server 140 may be adapted to apply a depreciation schedule against assets so as to account for depreciation over time. Furthermore, the server 140 may be further configured with a service life for each type of asset for asset replacement purposes.

In this embodiment, the server 140 may be adapted to select the appropriate depreciation schedule and/or service life in accordance with the riate asset type. For example, speed control signage may depreciate faster and have a shorter service life as opposed to a roadside barrier, for example.

Server onality – identifying missing assets In one particular preferred embodiment, the server 140 is adapted to identify missing assets, such as, for example, in the event of a particular roadside speed control signage having been removed or ated from vehicle impact.

For such missing asset identification, the functionality performed by the server 140 usually ses a first pass wherein particular assets are recorded for the first time. For example, for a particular section of road, the nance vehicle 300 may be sent to e the above-mentioned assets data relating to the roadside assets for the roadside section for the first time.

As such, upon subsequent passes, the server 140 is adapted to identify whether any of the usly recorded assets failed to be recorded.

For example, for a second pass, the data capture device 105 may report, to the server 140, a previously recorded 80 km/h speed control sign but fail to report a previously recorded 110 km/h speed control sign. In this manner, the server 140 would be adapted to identify the omitted 110 km/h speed control sign and take appropriate action. Such appropriate action may include notifying the operator of the maintenance ery 300 accordingly such that the operator may acknowledge that the speed control sign is indeed missing or alternatively rectify an omission.

Furthermore, the server 140 may compile a database of missing roadside assets such that maintenance crews may be scheduled and deployed accordingly.

In ments as will be described in further detail below, the exemplary graphical user interfaces as may be displayed by the data capture device 105 as will be described with nce to figures 5 and 6 may display upcoming assets on a map representation of the like representing previously recorded roadside assets. In this manner, the roadside operator would know in advance of approaching roadside , or where previously recorded roadside assets should be.

In embodiments, as opposed to the system 100 identifying g assets, the operator, or the data capture device 105 in an automated manner, may identify assets requiring replacement. For the or initiated flagging of assets requiring nance, should the operator notice a particular asset is damaged, such as having been blackened from bushfire or the like, the operator may flag the particular asset, such as by using the human interface device of the asset data input 115 to flag that the particular assets requires maintenance. In other embodiments, the data capture device 105, ally by utilising image recognition technique may fy assets requiring maintenance, such as wherein image data recorded from an asset deviates from a standard asset image, such as wherein a street sign is blackened, bent, obliquely orientated or the like.

Server functionality – generating map data In an embodiment, the server 140 is adapted to generate map data for management purposes. In particular, the map data may be displayed by the y device of the client computing device 200, especially with reference to the ary cal user interface as will be described in further detail below with reference to figure 7.

In this manner, administrators, such as councils and the like may view map representations having superimpose thereon the location of various assets, such as by way of appropriate icon or the like. In embodiments, the icon type may represent the asset type and furthermore, each icon may be user able to display further information in relation to the asset, such as by displaying the image data for the asset, the onal information recorded for the asset and the like.

Server functionality – maintenance tracking In embodiments, the server 140 is further adapted for maintenance tracking, additionally, or ative to asset tracking.

For example, grass cutting maintenance may be tracked and managed by the server 140.

For example, road verges may require cutting 5 times a year, including at differing heights depending on whether the grass is seeding or not.

In this , various nance may be scheduled by the server 140. Thereafter, once the maintenance is in progress by the maintenance machinery 300, the current status of the maintenance may be recorded by the server 140, especially in ascertaining the percentage work completed in accordance with the on of the maintenance machinery 300 as it is received from the data capture device 105.

In this manner, the server 140 may record, for display by the client computing device 200, various tics relating to various maintenance being med, or requiring performance. Such statistics may include work to do, work in progress and work performed.

Similarly, by using map representations, the client ing device 200 may be adapted to display map representations showing the ons of various maintenance machinery 300, their respective work routes, work completed and the like.

In embodiments, and referring to figure 3, the maintenance machinery 300 may comprise a forward facing camera 320 and a rearward facing camera 315. In this manner, at periodic intervals, the server 140 may be adapted to receive, from the data capture device 105 image data from these cameras such that an administrator, ing the client computing device 200 may be adapted to view the forward view and the rearward view of the maintenance machinery 300 so as to be able to ascertain the quality of the work performed, for example. It should be noted that in embodiment, the maintenance machinery 300 may se either the forward facing camera 320 or the rearward facing camera 315 in lieu of having both.

In these embodiments, the server 140 may be adapted to send maintenance instructions to the data capture device 200. Such maintenance instructions may include, for example, the riate height at which to cut the grass. In this example, the operator, viewing the display device of the data capture device 105 may view the required grass height and set the grass cutter 310 height accordingly.

Data capture device onality Having described the exemplary functionality is performed by the server 140, there will now be described exemplary functionality performed by the data capture device 105 in accordance with the exemplary embodiment of using maintenance machinery 300 for grass cutting purposes in conjunction with the data e device 105 for recording asset data relating to various roadside assets and monitoring the maintenance performed during the grass cutting s.

As alluded to above, the data capture device 105 similarly comprises a processor 220 for processing digital data, a memory device 210 for storing digital data including computer program code, the memory device 210 being ly d to the processor 220.

Furthermore, the data capture device 105 ses a location sensor 110 for sensing a location of the data capture device, the location sensor being operably coupled to the processor 220.

In embodiments, the location sensor 110 may comprise a GPS receiver.

Furthermore, the data capture device 105 comprises an asset data receiver 105 adapted for receiving asset data ng to various assets including in the manners described in further detail below.

Furthermore, the data capture device 105 comprises a ss network interface adapted for sending and receiving data across a wireless data network 130 to the server 140. As alluded to above, given the remote operational locations of the machinery 300, the wireless network interface 125 may comprise a GSM data interface adapted for sending data across a GSM network.

In a preferred ment, the data capture device 105 is a small form factor ruggedised computing device, such as a tablet computing device have an inbuilt on g and display functionality, including, in embodiments, image capture functionality. In this embodiment, the data capture device 105 computing device may be utilised in isolation, or alternatively coupled to various other electronic ing devices located about the machinery 300, such as the forward and rearward facing camera is 320, 315, tactile sensors and the like.

In a preferred embodiment, the data capture device 105 is adapted to automate the asset data recording process requiring minimal ention from the operator of the machinery 300.

Data capture device functionality – data sent As such, in use, as the machinery 300 cuts grass, as the machinery 300 encounters various roadside assets, the data capture device 105 is adapted to receive from the asset data input, asset data relating to the asset and send, via the wireless network interface 125 and the k 130, the asset data to the server 140 for recordal within the database 135. onally, and as alluded to above, in embodiments, the data capture device 105 may be adapted to receive information from the server 140 also, including information relating to previously recorded assets, maintenance instructions and the like.

Data capture device functionality – imaging Now, there will be described a first aspect of the asset data input 115 wherein the asset data input 115 utilises imaging for the purposes of recording asset data.

In this embodiment, and as alluded to above, the machinery 300 may comprise cameras, especially the forward facing camera 320 to record information relating to an asset.

Specifically, the forward facing camera 320 would be appropriately located for an ideal vantage for recording image data relating to various roadside assets. For example, the forward facing camera 320 may be mounted at the forward upper edge of the canopy of the vehicle 305 or alternatively located on the cutting device 310 for example.

In embodiments, the rearward facing camera 315 may be d to capture a rearward image of the asset also such that the administrator may be able to view both sides of the asset or view the maintenance that has been performed. In this , during operation, the data capture device 105 may be adapted to record a forward facing image of the asset, and uently, at the appropriate time, record a rd image of the asset.

The timing for the taking of the second rearward facing image may be timed in accordance with a predetermined time interval, such as 10 seconds, the speed of the maintenance vehicle 310 or wherein the data capture device 105 captures the second rd facing image in accordance with the speed of the maintenance vehicle 305, or the location of the maintenance vehicle 310 wherein the data capture device 105 es the second rearward facing image in accordance with the location of the vehicle, such as wherein the maintenance e 305 is 5 m past the asset.

Now, in one embodiment, the system 100 is adapted for the automated identification of assets in accordance with the image data. In one particular embodiment, the system 100 may employ image recognition for recognising various assets and asset types. It should be noted that the image ition may be performed by the data capture device 105, or where the data e device is a low-power computing , by the more powerful server 140.

In this manner, at intervals, the data capture device 105 may be adapted to capture images from the cameras wherein the images are sed using an image sing technique. For example, should the data e device 105 capturing image comprising an 80 km an hour street sign, the system 100 may identify the images sing the Street sign type and of the 80 km an hour additional information for the street sign.

In embodiments, the database 135 may comprise exemplary representative imagery of various roadside assets for comparison purposes during the image recognition technique.

In other embodiments, the capturing of images may be triggered. For example, and especially ing to the embodiment provided in figure 4 shown the cutting device 310 in further detail, as can be seen, in this embodiment, the cutting device 310 comprises an asset engagement 410. The asset engagement 410 is adapted to receive the asset therein so as to cut the grass about the asset.

During the engagement of the assets by the asset engagement 410, the asset may be detected by the asset detector 405 which may be a tactile asset detector, such as a deflected lever, a light beam interrupted or the like.

As such, upon ing tion of the detection of an asset by the asset detector, the data capture device 105 may be adapted to capture an image.

It should be noted that other asset detectors may be employed such as by way of ultrasonic proximity detection device adapted to detect assets within proximity of the machinery 300.

Data capture device functionality – scanning In other embodiments, the asset data input device 115 may be adapted to read computer readable ation from a computer readable data bearing media attached to an asset.

Such computer readable data bearing media may comprise a barcode, such as a 2-D or 3-D barcode, or near field radio ncy communication device and the like.

For example, all roadside assets may be ed with low-cost NFC tags for detection by imate data capture s 105 during the grass cutting run.

Data capture device functionality – asset detector In an embodiment, the acetate input 150 may comprise the above-mentioned asset detector adapted to detect an asset. As alluded to above, in one manner, the asset detector may be located about the asset engagement 410 to detect when an asset has been engaged within the asset detector.

However, in embodiments, the asset detector need not necessarily be used in conjunction with an asset engagement and may, for example comprise al object proximity detectors located about the vehicle 310. For example, the asset detector may comprise ultrasonic proximity detectors adapted to detect s within proximity of the vehicle 310.

Data capture device functionality – human interface device In one ment, alternatively or additionally, asset data may be recorded by way of a human input device. In one embodiment, the human input device comprises a touch sensitive overlay over the display device of the data capture device comprising inputs allowing the user to input various information.

In ments, all of the asset data may be input using the human input device such as wherein the operator of the machinery 300 manually records each asset.

In other ments, the asset data may be complimented using the human input device such as wherein, for example, the data capture device 105 s a speed control road sign wherein the human operator inputs the speed limit of the detected speed control road sign.

Exemplary graphical user interfaces As alluded to above, there will now be described exemplary graphical user interfaces as may be displayed by the display device of the data capture device 105 and the client computing device 200. ary graphical user aces – data capture device Figures 5 and 6 show exemplary graphical user interfaces displayed by the display device of the data capture device 105.

Specifically, referring to figure 5, there is shown an exemplary graphical user interface 500 n the data capture device 105 is in roadside maintenance mode.

Specifically, the left hand side of the interface 500 comprises a map representation comprising a bottom portion located map overview and a top located current location overview showing the location of the data capture device 105 overlaid a map representation. In the embodiment shown, the data capture device 105 is shown as the crosshair icon adjacent the de.

The map representation further comprises a plurality of icons representing the roadside assets. Any particular map representation shown, the data capture device 105 is ented as currently being adjacent and asset, one asset been ented as being in front of the data capture device 105 and two assets as been recorded as being behind the data capture device.

The right hand side of the interface 500 comprises asset specific information.

Specifically, the upper located n comprises information relating to the current asset, as can be seen, the current asset has been allocated unique asset identify A4262 and there is shown image data relating to the asset. In this manner, the operator of the machinery 300 may visually compare the asset with the image data as recorded by the system 100 for comparison es.

Adjacent the image data of the asset may be the further onal information relating to the asset, such as the type of asset, the condition, when the grass was last cut and the like.

Furthermore, the lower located portion of the ace 500 may comprise ation relating to the next asset, given as asset A4263 and an appropriate image.

In this manner, by showing the proximate pre-recorded assets, the operator may easily identify if an asset is missing or has been damaged since the last recordal.

Furthermore, for the above-mentioned maintenance tracking purposes, the lower located portion of the interface 500 may r comprise a rearward view image of the rear of the maintenance vehicle as is captured by rearward facing camera 315 to record the grass as having been cut by the maintenance vehicle 300.

Turning now to figure 6, there is shown an exemplary graphical user interface 600 n the data capture device 105 is in setup mode. ically, during the setup mode, various assets may be recorded, such as during the above-mentioned first pass.

Specifically, the left hand side of the interface 600 is substantially the same as for interface 500. However, for the right hand side, the interface 600 comprises a portion allowing for the capturing of asset data.

As can be seen, the upper right-hand portion of the ace 600 allows the operator to record and asset for the first time. Specifically, this portion comprises an image of the asset for recordal. As mentioned above, the image of the asset may be taken manually by the operator, or in an automated manner such as wherein the data capture device 105 utilises image recognition technique, proximity detection or the like.

Once the image of the asset has been taken by the operator, or the asset identified by the data capture device 105, the interface 600 may allow the operator to m the asset including in inputting additional ation ng to the asset.

Exemplary graphical user interfaces – administrative client computing device Turning now to figure 7, there is shown an exemplary graphical user interface 700 as displayed by the administrative client computing device 200. Typically, and as alluded to above, the client computing device 200 would be operated by various administrators, such as council workers and the like.

As can be seen, the lower left hand portion of the interface 700 comprises a map representation showing the location of the data capture device 105 and various recorded . In a preferred embodiment, the location of the data capture device 105 may be shown in real time.

Furthermore, a ular asset may be selected for the purposes of displaying further information. In the interface 700, asset a 4262 has been selected wherein, as can be seen, the top right-hand portion of the interface 700 comprises further information in on to the asset including comprising an image of the asset, and additional information ng to the asset.

As can be seen, the additional information ng to the asset comprises additional information that the asset is in excellent ion, that it is a reflector post A3 was last maintained on 13 October 2013, the coordinates of the asset, the asset value of $300 and the asset having an estimated life span of two years.

Furthermore, for the above mentioned nance tracking, the top left hand side of the interface 700 may comprise a rear image of the maintenance vehicle 300. In this manner, should the administrator ly identify from the image that the grass as not been cut correctly, the administrator may take appropriate , such as by contacting the operator to take appropriate remedial action.

It should be noted that the substantial real time imagery from the maintenance vehicle 300 may be displayed within the interface 700. In other embodiments, a timelapse of the maintenance imagery may be shown wherein, for example, the operator drags the icon of the maintenance vehicle 300 to various locations along the map representation so as to be able to view the maintenance imagery at differing locations of the map.

Furthermore, the bottom right hand side of the interface 700 comprises various information relating to the particular maintenance task. As can be seen, this particular grass cutting maintenance task has been allocated to route number 12, that route number 12 has 543 assets totalling a value of $76,000, that the route was last maintained on 13 October 2013, that route 1260 km in length, takes an average of 16 hours and 32 minutes to maintain and cost $130 per kilometre to maintain.

This portion of the interface 700 further comprises a menu allowing the administrator to view and manage various contract statistics, job statistics, council averages national averages and routes.

Exemplary embodiment There will now be described an exemplary embodiment method for roadside asset tracking and maintenance monitoring. Specifically, in this exemplary ment, the method ses utilising a mobile unit, such as the maintenance machinery 300 as substantially shown in figure 3 for grass g, the mobile unit comprising a data capture device 100 (such as a small form factor tablet computing device) having an asset data capture device 115 (such as a camera for capturing roadside assert image data); an inbuilt or external global positioning system (GPS) er 110 and a data interface 125 for communicating with an asset management server 140, the asset ment server 140 comprising an asset ng register database 135.

The method comprises deploying a mobile unit 305 (such as the above-described maintenance machinery or the like) ide a de section, primarily while performing roadside maintenance, but not necessarily so.

Now, the method comprises utilising an asset type image recognition technique for automating the identification of the roadside assets. For example, the de asset types may be divided into any number of roadside asset type categories such as posts, barriers, roadsigns and the like. Other categories, such as subcategories may also be ed such as, for example, n roadsigns are d into warning, informational and traffic management signs. For traffic management signs, such as speed management signs, further categories may be employed relating to the speed limit, for example.

Now, during any de pass or run, the method ses inserting, into the asset tracking register database 135, newly fied assets and their respective locations. For example, should a new road post be installed on a road corner, the method may comprise identifying the new road post installed at the particular location of the updating of the database 135 to record the new post of a particular type and the new location.

Now, in a preferred embodiment, for subsequent passes, the method further comprises identifying missing roadside assets by comparing the previously identified asset types at the respective locations. For example, should a roadside signpost which had been previously identified be subsequently removed, during a subsequent pass of the mobile unit 305, the method may identify that the roadside asset is missing such that appropriate remedial action may be taken. For example, in embodiments, the system 100 may be configured such that, should the mobile unit 305 pass 10 m beyond from where a roadside asset was usly recorded, the system 100 may identify the asset as being missing.

When identifying a missing asset, the se 135 may be updated to flag the relevant missing roadside asset.

In embodiments, the operator of the mobile unit 305 may be prompted to confirm the missing asset including in the system 100 ying an image of the asset as was previously recorded. The operator may then confirm that the roadside asset is indeed missing.

In this manner, the system 100 may generate a register of remedial action tasks specify in roadside assets that require replacing.

Now, as alluded to above, the asset data capture device 115 ses a camera (or is ly couples to a camera) for capturing roadside asset image data. In this manner, the method comprises utilising image recognition for identifying the roadside asset types.

For example, along the roadside section the camera may capture periodic images, such as in front of the mobile unit 300, or that which is engaged by the grass cutting device 310 and wherein the method comprises employing the asset type image recognition to identify assets from those images.

For example, the method may comprise identifying de posts, de signage and the like from the image is captured by the camera.

In a red embodiment, especially given the computationally intensive nature of image identification, the data capture device 105 may transmit the image data and the on data from the location sensor 110 to the server 140 for processing by the server 140.

Now, so as to suit the image recognition for roadside asset identification, the image ition may comprise a number of image recognition stages bed below.

As such, in embodiments, the image recognition may comprise an image recognition stage comprising edge shape detection to detect shapes of roadside assets. Edge detection may be performed in accordance with intensity (such as from ale images) or colour ions between the roadside asset and the ound.

For example, roadside posts may have a distinctive rectangular shape having particular dimension ranges ng the method to identify such roadside posts accordingly.

Now, particular for roadside signage, differing types of roadside signs may comprise differing shapes which may be utilised when identifying the roadside assets. For example, warning signs may have a triangular shape whereas traffic management signs may have a circular shape. In this manner, by identifying a particular shape, the method may identify the sign type when identifying a roadside asset.

In ments, the method may comprise utilising shape rotation invariance filtering to account for roadside signs which are not exactly upright, such as those that have been installed or knocked skew. In this manner, should a triangular sign be skew, the image identification may yet recognise the ular shape.

Image recognition may further comprise colour detection so as to r enhance the image identification. For example, the above-described roadside posts may have a distinctive white colouring which may assist the identification thereof. Furthermore, and especially for roadside signs, the abovedescribed different types of roadside signs may have differing colour types also.

In embodiments, and especially for roadside signs, the colour detection may comprise colour juxtaposed detection so as to, for example, identify a red border against a white background of a restrictional roadside sign.

In a further ment, the image recognition may comprise symbol ion. For example, roadside signage may comprise differing symbols, such as, a koala bear symbol shape warning of wildlife ahead. The s may further represent alphanumeric symbols such as numbering utilised on speed management signs. In further embodiment, the image recognition may utilise text recognition so as to identify, text utilised within roadside signage.

In embodiments, the image recognition may utilise a combination of the above described image recognition ques. For e, in one embodiment, the image recognition may utilise a combination of both shape detection and symbol detection. For further accuracy, colour detection may additionally be employed.

In embodiments, the image recognition may utilise reference databases for the purposes of enhancing accuracy. For example, in one embodiment, the method may comprise utilising correlation to correlate the captured roadside asset image data with known roadside assets stored within a roadside assets image database. It should be noted that such image correlation may be performed in accordance with the entire image. However, in embodiments, correlation may be performed utilising the separate shape, colour, symbol and text reference databases.

For example, in identify a triangular shape and a koala bear symbol, the system 100 may identify the particular type of roadside signage accordingly.

Now, in one embodiment, the mobile unit asset data capture device 115 comprises a or in the form of an asset ity or to detect the proximity of the roadside asset. The or may trigger the asset data capture device 115 to capture an image of the roadside asset.

For example, in the embodiment where the mobile unit comprises a grass cutter 310 as is substantially ed in figures 3 and 4, the detector may take the form of a physical t, laser trip or the like 405 within the grass cutter asset engagement 410. In this manner, when the grass cutter 310 engages an asset within the asset engagement 410 to cut around the asset, the correspondingly located camera, having a view of the grass cutter 310 captures an image of the asset.

It should be noted that in embodiments, the grass cutter 305 may comprise a plurality of grass cutter devices such as the frontward located grass cutter device 310 as substantially shown in figure 4 and a side arm gantry-type movable grass cutter device (not shown). For example, the side arm e grass cutter device may be utilised for performing delicate grass g, such as around posts of a roadside barrier or the like. In this manner, the mobile unit 305 may comprise a side facing camera so as to be able to capture image data of assets engaged by the side arm cutting device also.

In ments, where the side arm is movable the side facing camera may be gimbal mounted or the like so as to follow the location of the end of the side arm.

In embodiment, the side movable grass cutting device may be marked with a laser so as to allow the side camera to follow the grass cutting device.

The method may further comprise image comparison for detecting roadside asset damage or degradation to fy roadside assets requiring maintenance. For example, the method may compare asset image data against previously ed asset image data and detect changes in colour, shape, the symbols or text represented on roadside asset (so as to identify missing letters and the like).

For those assets that show a change in colour or shape ing a threshold may trigger the system to update the database 135 with a flag indicating that a particular asset requires maintenance.

For example, should a roadside be damaged in a re and therefore be blackened, the image comparison may detect the colour degradation and flag the asset for maintenance.

Furthermore, should a roadside post be hit by a passing vehicle all of the like and ore be skew or otherwise bent out of shape, the system may identify the change of shape or orientation and flag the asset for maintenance.

Furthermore, should a letter be missing from a roadside signpost, the system may identify the missing letter or the change to the text and flag the roadside signpost for nance.

The method may further comprise generating a map entation showing the roadside sections and the locations of the roadside assets along the roadside section. Specifically, figure 5 and 6 show the map presentation which may be displayed by the data capture device 100 on the mobile unit on figure 7 may display the representation displayed at a headquarters.

As can be seen, the representations comprise a map entation representing the roadside section and the locations of the identified roadside assets along the roadside section. The map representation at headquarters may y the t location of the mobile unit.

Clicking on each of the icons of each respective roadside asset may display further information in relation to each roadside asset, including an image of the roadside asset, such as a front and rear image of the roadside asset with such as available.

The map representation is displayed by the mobile unit may display image data relating to the closest asset, such as the next roadside asset including an image of the next de asset. In this manner, the operator may view the previously recorded image of the asset and report any changes to the asset that the operator notices. For any newly identified asset, the mobile unit operator interface allows the or to confirm that new asset and input other information such as any further characteristics or notes.

In embodiments, the operator interface may allow the operator to report incidents, such as wildlife casualties or roadside s, such as flooding, fire and the like.

Now, in embodiments, and referring to figure 3, as can be seen, the mobile unit 305 may comprise a forward camera 320 and a rearward camera 315 for respectively capturing forward and rearward image data from the perspective of the mobile unit.

As such, at headquarters, perspective views may be displayed by the interface 700 either in real time from the t location of the mobile unit, or at any particular locations, such as a road bend or the like.

In embodiments, the image data recorded from the cameras 315 and 320 may be utilised at arters for quality control purposes by comparing before and after maintenance imagery. For e, should the mobile unit have cut the grass to the incorrect height, such may be noticed from the imagery and rectified maintenance instructions sent to the mobile unit.

Now, especially ing to the interface 700 as substantially shown in figure 7, the method may further comprise calculating a valuation of the roadside assets along the roadside n. In this regard, the valuation may be calculated in accordance with the assets type which has been identified using the above-described asset type image recognition technique. For example, the database 135 may comprise a register of asset type values which may be taken into account in determining the value of the roadside assets.

In embodiments, the method may take into account depreciation wherein the date at which the asset was first installed are identified by the method may be taken into account wherein, for example, road posts may be depreciated over 2 years. In this , the method may further comprise identifying those roadside assets requiring replacement on account of their having reached the end of their service life.

Calculating the valuation of the assets may further take into account the condition of the asset. In embodiment, the method may utilise an asset condition estimate image ition technique for ting a condition of each of the de assets. For example, referring to the exemplary interface 700 as can be seen, asset A4262, the condition of the asset has been deemed to be excellent. The asset condition estimate image recognition technique to take into account various factors in determining the condition, such as colour, shape and the like.

As can be seen, the interface 700 further displays various maintenance tics including at least one of last maintenance date, distance of the roadside section and average time to in the roadside section.

It should be noted that in embodiments, as opposed to the data capture device 105 being located on a movable unit, such as the maintenance machinery 105 and the like, the data capture device 105 may be a portable unit ured for rian ation. In this manner, for example, a user may walk along a trail, route or the like capturing information relating to various route or trail assets. In embodiment, the data capture device 105 may take the form of a tablet computing device have an inbuilt camera, GPS and data connectivity functionality configured with appropriate software such that no ntial hardware modification need be required.

Interpretation Wireless: The invention may be embodied using devices ming to other network standards and for other applications, ing, for example other WLAN standards and other wireless standards.

Applications that can be accommodated include IEEE 802.11 ss LANs and links, and wireless Ethernet.

In the t of this nt, the term "wireless" and its tives may be used to describe circuits, devices, s, methods, techniques, communications channels, etc., that may communicate data through the use of modulated electromagnetic radiation through a non-solid medium. The term does not imply that the associated devices do not contain any wires, gh in some embodiments they might not. In the t of this document, the term "wired" and its derivatives may be used to describe circuits, devices, systems, methods, techniques, communications channels, etc., that may communicate data through the use of modulated electromagnetic radiation through a solid medium. The term does not imply that the associated devices are coupled by electrically conductive wires.

Processes: Unless specifically stated otherwise, as apparent from the following discussions, it is appreciated that throughout the specification discussions ing terms such as "processing", "computing", "calculating", "determining", "analysing" or the like, refer to the action and/or processes of a computer or ing system, or similar electronic computing device, that manipulate and/or transform data represented as physical, such as electronic, quantities into other data similarly represented as physical quantities.

Processor: In a similar manner, the term "processor" may refer to any device or portion of a device that processes electronic data, e.g., from registers and/or memory to transform that electronic data into other electronic data that, e.g., may be stored in registers and/or memory. A "computer" or a ting device" or a "computing machine" or a "computing rm" may include one or more processors.

The methodologies described herein are, in one embodiment, performable by one or more processors that accept computer-readable (also called machine-readable) code containing a set of instructions that when executed by one or more of the processors carry out at least one of the methods described herein. Any processor capable of executing a set of instructions (sequential or ise) that y actions to be taken are included. Thus, one example is a typical processing system that includes one or more processors. The processing system further may include a memory tem including main RAM and/or a static RAM, and/or ROM.

Computer-Readable Medium: rmore, a computer-readable carrier medium may form, or be ed in a computer program product. A computer program product can be stored on a er usable carrier medium, the computer program product comprising a computer readable program means for causing a processor to perform a method as described herein.

Networked or Multiple Processors: In ative embodiments, the one or more processors operate as a standalone device or may be connected, e.g., networked to other processor(s), in a networked deployment, the one or more sors may operate in the capacity of a server or a client machine in server-client network nment, or as a peer machine in a peer-to-peer or distributed network environment. The one or more processors may form a web appliance, a network router, switch or bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify s to be taken by that machine.

Note that while some diagram(s) only show(s) a single processor and a single memory that carries the computer-readable code, those in the art will understand that many of the components described above are included, but not explicitly shown or described in order not to e the inventive aspect. For example, while only a single machine is illustrated, the term "machine" shall also be taken to e any collection of machines that individually or y execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein.

Additional Embodiments: Thus, one embodiment of each of the methods described herein is in the form of a computerreadable carrier medium carrying a set of instructions, e.g., a computer program that are for ion on one or more processors. Thus, as will be appreciated by those skilled in the art, embodiments of the present invention may be embodied as a method, an apparatus such as a special purpose apparatus, an apparatus such as a data processing system, or a computer-readable carrier medium.

The computer-readable carrier medium carries computer readable code including a set of ctions that when executed on one or more processors cause a processor or processors to implement a method. Accordingly, aspects of the present invention may take the form of a method, an entirely hardware embodiment, an entirely software embodiment or an embodiment combining re and hardware aspects. Furthermore, the present invention may take the form of carrier medium (e.g., a computer program product on a computer-readable storage medium) carrying computer-readable program code embodied in the medium.

Carrier Medium: The software may further be itted or received over a network via a network interface device. While the carrier medium is shown in an example embodiment to be a single medium, the term "carrier medium" should be taken to e a single medium or multiple media (e.g., a centralized or buted database, and/or associated caches and servers) that store the one or more sets of instructions. The term "carrier medium" shall also be taken to include any medium that is capable of storing, encoding or ng a set of instructions for execution by one or more of the processors and that cause the one or more processors to perform any one or more of the ologies of the present invention. A carrier medium may take many forms, including but not d to, non-volatile media, volatile media, and transmission media.

Implementation: It will be understood that the steps of methods discussed are performed in one embodiment by an appropriate processor (or processors) of a processing (i.e., computer) system executing ctions (computer-readable code) stored in storage. It will also be tood that the invention is not limited to any particular implementation or programming que and that the invention may be implemented using any appropriate techniques for implementing the functionality described herein. The invention is not limited to any particular programming language or operating system.

Means For Carrying out a Method or Function Furthermore, some of the embodiments are described herein as a method or combination of elements of a method that can be implemented by a processor of a processor device, computer system, or by other means of carrying out the function. Thus, a sor with the necessary instructions for carrying out such a method or element of a method forms a means for carrying out the method or element of a method. Furthermore, an element described herein of an apparatus ment is an example of a means for carrying out the on performed by the element for the purpose of carrying out the invention.

Connected Similarly, it is to be noticed that the term connected, when used in the claims, should not be reted as being limitative to direct connections only. Thus, the scope of the expression a device A connected to a device B should not be limited to devices or systems n an output of device A is directly connected to an input of device B. It means that there exists a path between an output of A and an input of B which may be a path including other devices or means. "Connected" may mean that two or more elements are either in direct physical or electrical contact, or that two or more elements are not in direct contact with each other but yet still co-operate or interact with each other.

Embodiments: Reference throughout this specification to "one embodiment" or "an ment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, appearances of the phrases "in one ment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment, but may. Furthermore, the particular features, structures or characteristics may be combined in any suitable manner, as would be apparent to one of ordinary skill in the art from this disclosure, in one or more embodiments.

Similarly it should be appreciated that in the above description of example embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the s inventive aspects. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the Detailed Description of ic Embodiments are hereby expressly incorporated into this Detailed Description of Specific Embodiments, with each claim standing on its own as a separate ment of this ion.

Furthermore, while some embodiments bed herein include some but not other es included in other embodiments, combinations of features of different embodiments are meant to be within the scope of the ion, and form different ments, as would be understood by those in the art. For example, in the following claims, any of the claimed embodiments can be used in any combination.

Different Instances of Objects As used , unless otherwise specified the use of the ordinal adjectives "first", "second", "third", etc., to be a common object, merely indicate that different instances of like objects are being referred to, and are not intended to imply that the objects so described must be in a given sequence, either temporally, lly, in ranking, or in any other manner.

Specific Details In the description provided herein, numerous specific details are set forth. r, it is understood that embodiments of the invention may be ced without these specific details. In other ces, well-known methods, structures and techniques have not been shown in detail in order not to obscure an tanding of this description.

Terminology In describing the preferred embodiment of the invention rated in the drawings, specific terminology will be resorted to for the sake of clarity. r, the invention is not intended to be limited to the specific terms so selected, and it is to be understood that each specific term includes all technical equivalents which operate in a similar manner to accomplish a similar technical purpose.

Terms such as "forward", "rearward", "radially", "peripherally", "upwardly", "downwardly", and the like are used as words of convenience to provide reference points and are not to be construed as ng terms. sing and Including In the claims which follow and in the preceding description of the invention, except where the context requires otherwise due to express language or ary implication, the word "comprise" or ions such as "comprises" or "comprising" are used in an inclusive sense, i.e. to specify the presence of the stated features but not to preclude the presence or addition of further features in various embodiments of the invention.

Any one of the terms: including or which includes or that includes as used herein is also an open term that also means ing at least the elements/features that follow the term, but not excluding others. Thus, including is synonymous with and means comprising.

Scope of Invention Thus, while there has been described what are believed to be the preferred embodiments of the invention, those skilled in the art will recognize that other and further modifications may be made thereto without departing from the spirit of the invention, and it is intended to claim all such changes and modifications as fall within the scope of the invention. For example, any as given above are merely representative of procedures that may be used. Functionality may be added or deleted from the block diagrams and operations may be interchanged among functional blocks. Steps may be added or deleted to methods described within the scope of the present invention.

Although the invention has been described with reference to specific examples, it will be iated by those skilled in the art that the invention may be embodied in many other forms.

Claims

1. A method for roadside asset tracking and maintenance monitoring, the method comprising: ically deploying a mobile unit alongside a roadside section, the mobile unit comprising a data capture device comprising: an asset data capture device operably coupled to at least one digital camera configured for capturing roadside asset image data; a global positioning system (GPS) receiver; and a data interface for communicating with an asset management server, the server comprising an asset ng register database; receiving the roadside asset image data representing images taken of a plurality of roadside assets; receiving location data from the GPS er representing the respective locations the roadside assets; utilising an asset type image recognition technique for automating the identification of the de assets; comparing roadside asset data of the asset tracking register database to: record newly identified roadside assets and their respective locations in the asset tracking register database; and identify missing roadside , wherein the mobile unit comprises forward and rd facing cameras for respectively capturing forward and rearward facing image data from the ctive of the mobile unit and wherein the asset data capture device is adapted to record a d facing image of the asset and subsequently record a rearward image of the asset timed according to at least one of speed and location of the unit, and wherein the map representation is configured for displaying before and after maintenance comparison imagery utilising the image data received from the d and rearward facing cameras.

2. A method as d in claim 1, n the asset type image recognition technique comprises an image recognition stage comprising edge shape detection.

3. A method as claimed in claim 2, wherein the edge shape detection comprises rotation invariance processing to allow for edge shape detection of skew roadsign assets.

4. A method as claimed in claim 3, wherein edge shape detection comprises comparison to reference shapes in a shape reference database.

5. A method as d in any one of claims 1 - 4, wherein the image recognition comprises an image recognition stage comprising colour detection.

6. A method as claimed in claim 5, wherein the colour detection comprises colour juxtapose ion.

7. A method as d in claim 6, wherein colour detection comprises comparison to reference s in a colour reference database.

8. A method as claimed in any one of claims 1 - 7, wherein the image recognition comprises an image recognition stage comprising symbol detection.

9. A method as d in claim 8, n symbol detection comprises comparison to reference symbols in a symbol reference database.

10. A method as claimed in claim 8, wherein symbol detection comprises umeric symbol detection.

11. A method as claimed in claim 8, wherein symbol detection comprises text recognition.

12. A method as claimed in claim 1, wherein the mobile unit r comprises an asset proximity detector for detecting the proximity of roadside assets and wherein the asset data capture device is triggered by the asset proximity detector.

13. A method as claimed in claim 12, wherein the mobile unit comprises a grass cutter unit and wherein the proximity detector is configured for detecting when the roadside asset is engaged by the grass cutter unit.

14. A method as claimed in claim 1, wherein the mobile unit comprises a grass cutter unit and wherein the grass cutter unit is llable to be le with respect to the mobile unit and wherein the at least one digital camera is configured to follow the movement of the grass cutter unit.

15. A method as claimed in claim 1, wherein the method further comprises image comparison for detecting roadside asset damage or degradation to identify assets requiring maintenance.

16. A method as claimed in claim 15, wherein the image comparison comprises colour comparison.

17. A method as claimed in any one of claims 15 - 16, wherein the image comparison comprises shape ison.

18. A method as claimed in any one of claims 15 - 17, wherein the image comparison comprises colour detection.

19. A method as claimed in any one of claims 15 - 18, wherein the image comparison comprises symbol comparison.

20. A method as claimed in claim 1, wherein the method further comprises generating a map representation enting the roadside section and the locations of the identified de assets along the roadside n.

21. A method as claimed in claim 20, wherein the mobile unit comprises at least one camera for capturing image data from the perspective of the mobile unit and wherein the map representation is configured for selectively displaying image data from the at least one camera at a plurality of locations along the roadside section.

22. A method as claimed in claim 1, n the method further comprises calculating a valuation for the de assets, the valuation calculated in accordance with the asset type identified using the asset type image recognition technique.

23. A method as claimed in claim 22, wherein the valuation is further calculated in accordance with entry dates ated with each of the asset types.

24. A method as claimed in any one of claims 22 - 23, wherein the method further comprises using an asset condition estimate image recognition technique to estimate a condition of each of the roadside assets and wherein the valuation is further calculated in accordance with the estimated condition.

25. A method as d in claim 1, wherein the method further comprises calculating maintenance statistics including at least one of last maintenance date, distance of the roadside section and average time to maintain the roadside section.

26. A method as claimed in claim 1, wherein the method r ses the mobile unit receiving, via the data interface, maintenance instruction data comprising instructions for the maintenance of the roadside section.

27. A method as claimed in claim 1, wherein the mobile unit is configured for sending the asset image data to the server and wherein the service ms the asset type image recognition.