WO2017208371A1 - Image search program, image search method, and image search device - Google Patents

Image search program, image search method, and image search device Download PDF

Info

Publication number
WO2017208371A1
WO2017208371A1 PCT/JP2016/066073 JP2016066073W WO2017208371A1 WO 2017208371 A1 WO2017208371 A1 WO 2017208371A1 JP 2016066073 W JP2016066073 W JP 2016066073W WO 2017208371 A1 WO2017208371 A1 WO 2017208371A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
range
road
information
search
Prior art date
Application number
PCT/JP2016/066073
Other languages
French (fr)
Japanese (ja)
Inventor
仁志 影山
孝司 島田
耕世 高野
Original Assignee
富士通株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 富士通株式会社 filed Critical 富士通株式会社
Priority to PCT/JP2016/066073 priority Critical patent/WO2017208371A1/en
Publication of WO2017208371A1 publication Critical patent/WO2017208371A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor

Abstract

A receiving unit 43 receives a designation of range conditions that include a time period and location region. A search unit 44 searches a storage unit 22 which stores images with which location information and time information are associated, and when the number of image data 30 which satisfy the range conditions received by the receiving unit 43 from among the image data 30 stored in the storage unit 22 is equal to or less than a prescribed number, searches again by expanding the time period range or location range of the range conditions.

Description

Image search program, an image retrieval method and the image retrieval device

The present invention relates to an image search program, an image retrieval method and an image retrieval apparatus.

Conventionally, for example, in the field of logistics, business vehicles such as trucks and buses, fitted with a vehicle-mounted device such as a digital tachograph for monitoring the operating conditions such as position and velocity, based on information collected from the vehicle-mounted device, operation control It is carried out. The vehicle-mounted device have a function of capturing an image of a road at every predetermined time, and transmits the captured image.

JP 2015-103089 JP

Meanwhile, service Teiyo road conditions by using an image captured by the vehicle-mounted device can be considered. For example, an image transmitted from the vehicle-mounted device, and stores the image capturing time, the storage unit of the system together with the image pickup position. Then, for example, the system accepts the designation of a range of hours or roads to extract an image, and displays the searched imaging time, an image corresponding to the range of hours or roads imaging position is specified from the storage unit .

However, the imaging position of the image collected from onboard vehicle device to the system each business vehicles, not necessarily to be evenly distributed. Therefore, road conditions also display the retrieved image it may be difficult to grasp. For example, in the way infrequently road work vehicles, less image to be retrieved, road conditions it may be difficult to grasp.

In one aspect, an object of the invention to provide an image search program can provide an image easy to understand the road conditions, the image retrieval method and an image retrieval apparatus.

In the first scheme, the image search program causes the computer to execute the process of receiving a designation of range condition including the area of ​​the time zone and location. Image retrieval program, the computer searches the storage unit for storing the position information and time information image is correlated with, among images stored in the storage unit, the range satisfying image received predetermined If the number below to execute processing to search performed by extending one of the range of the time zone or location of range condition.

According to one embodiment of the present invention, an effect that it provides an easy image to grasp the road conditions.

Figure 1 is an explanatory view for explaining an example of a logistical support system. Figure 2 is a diagram illustrating an example of a functional configuration of a road status providing platform. Figure 3 is a diagram schematically showing a functional configuration of an image retrieval apparatus. Figure 4 is a diagram illustrating an example of the data configuration of the imaging information. Figure 5 is a diagram illustrating an example of the data structure of the road information. Figure 6 is a diagram illustrating an example of the data structure of the travel section information. Figure 7 is a diagram showing an example of matching and aggregation. Figure 8 is a time period ranging conditions, extension of the range of positions, is a diagram for explaining the reduction. Figure 9 is a diagram showing an example of a flow to search for the road conditions. Figure 10 is a diagram showing another example of a flow to search for the road conditions. Figure 11 is a flowchart showing an example of an image retrieval procedure. Figure 12 is a diagram showing an example of a computer, configured to execute the image search program.

Hereinafter, an image search program according to the present invention will be described in detail with reference to examples of image retrieval method and an image retrieval apparatus in the drawings. Incidentally, the present embodiment does not disclose technology is limited. Further, embodiments described below may be appropriately combined within a range not causing contradiction.

[System configuration]
First, an example of a distribution support system according to the first embodiment. Figure 1 is an explanatory view for explaining an example of a logistical support system. Logistical support system 10 is a system to support the operation of the vehicle in the logistics industry. Logistical support system 10 is, for example, a cloud system. The logistical support system 10, the operation management platform 11, a probe analysis platform 12, and road conditions provides the platform 13 is constructed. Logistical support system 10 may be realized by a computer, such as one server device, it may be implemented as a computer system according to a plurality of computers. For example, logistical support system 10 may be implemented in a plurality of computers for each service and functions provided.

For example, business vehicles 16 such as trucks and buses, vehicle-mounted device 15, such as a digital tachograph is provided. OBE 15 is communicatively connected to the logistical support system 10 via the network N. In addition, the logistical support system 10, operating through the network N operators terminal device 17 and the road administrator terminal apparatus 18 is communicably connected. As an embodiment of such a network N, regardless of wired or wireless, cellular telephone mobile communication network, such as any type of communication such as the Internet (Internet), LAN (Local Area Network) and VPN (Virtual Private Network) It can be adopted net. In the example of FIG. 1, a case has been exemplified where the work vehicle 16 equipped with the vehicle-mounted device 15 and one is not limited to this, the operational vehicle 16 equipped with the vehicle-mounted device 15, any number can. Further, in the example of FIG. 1, but the operation business terminal device 17 and road administrator terminal apparatus 18 is exemplified a case of the one, respectively, without being limited thereto, travel operators terminal device 17 and the road administrator terminal 18 can also be any number.

OBE 15, a predetermined time (e.g., 1 second) at intervals, to detect the current position and time of the business vehicle 16, various information such as the speed of the work vehicle 16 during operation. OBE 15 transmits the detected various information to logistical support system 10 as the probe information. Further, the vehicle-mounted device 15 has a function of capturing an image of the road at regular intervals, and transmits the captured image. For example, the business vehicle 16, and the camera is provided in front of the vehicle to the imaging position capable camera is connected to the vehicle-mounted device 15. OBE 15 captures an image of the vehicle ahead of the road at regular intervals by the camera. The predetermined time is, for example, does not is a 5-minute limited thereto. For example, the vehicle-mounted device 15 takes an image ahead of the vehicle at intervals of a predetermined time, and transmits the image data of an image captured, the logistical support system 10 together with the time information indicating the position information and a picked-up time indicating the position captured.

Logistical support system 10, based on various information such as probe information and the image data transmitted from the vehicle-mounted device 15, to provide various services.

For example, logistical support system 10 uses the operation management platform 11 provides a service management service for operation management of the business vehicle 16. For example, operation management platform 11, based on the probe information transmitted from the vehicle-mounted device 15, operating hours and breaks of business vehicles 16, to manage the speed. Further, operation management platform 11, in response to a request from the service company which runs the business vehicle 16, the service operator to provide an image transmitted from the vehicle-mounted device 15 of the work vehicle 16 to manage the operation. That is, operation management platform 11, to the service operators, the service operator to provide an image captured by the business vehicle 16 that runs. As a result, the service operators, can grasp the operating state of the work vehicle 16 to manage the operation.

Further, for example, logistics support system 10 uses the probe analysis platform 12 analyzes the probe information. For example, the probe analysis platform 12, based on the probe information transmitted from the vehicle-mounted device 15 analyzes the congestion of the traveling road or road work vehicle 16. For example, the probe analysis platform 12 based on the position information included in the probe information, and road running, travels to that section of the road, to identify the direction of travel. The probe analyzing platform 12, operational vehicle 16 analyzes the congestion situation of a road from the time the vehicle travels the road.

Further, for example, logistics support system 10 uses the road status providing platform 13 provides a road status providing service for providing road condition. For example, logistical support system 10 provides an image transmitted from the vehicle-mounted device 15 of the work vehicle 16 in each operating company as a road condition, the service operators and, to a third party, such as a road manager for managing the road to.

Service operators terminal device 17 disposed in the operating company which runs the business vehicle 16 is a terminal device such as a personal computer. Service operators to navigate the business vehicle 16 performs operation management of the business vehicle 16 by utilizing the operation control service access to the logistical support system 10 provides logistical support system 10 by using the service operator terminal 17 .

Road administrator terminal apparatus 18 is, for example, highway company, located in road management company that manages the road, a terminal device such as a personal computer. Road administrators managing road with road administrator terminal apparatus 18 accesses the logistical support system 10, grasp the road conditions by using the road status providing service provided logistical support system 10. For example, a road administrator responsible for highway, by referring to the image logistical support system 10 is stored as the public, can grasp the various conditions concerning the road, such as congestion and degradation conditions of the road.

Next, a description is given of a functional configuration of a road status providing platform 13. Figure 2 is a diagram illustrating an example of a functional configuration of a road status providing platform. Road status providing platform 13, the service management platform 11, the image data and the image captured by the vehicle-mounted device 15, the imaging information including an imaging position at the time of capturing an image is provided. Further, the road status providing platform 13, the probe analysis platform 12, and road information about a road, travel route information about the travel route with the business vehicle 16 equipped with the vehicle-mounted device 15 has been running is provided. Road status providing platform 13, by a specific function (FIG. 2 (a)), the image based on the position information when captured, specifying the type of the imaged road image. Road status providing platform 13, the image provided by the output function (FIG. 2 (b)), as road conditions, provides a third party, such as a road manager for managing the service operators and the road. Operation management platform 11, the probe analysis platform 12 and the road status providing platform 13 may be implemented on the same computer or may be implemented on another computer. In this embodiment, logistical support system 10, operation management platform 11, the probe analysis platform 12, will be described as an example a case where the road status providing platform 13 is mounted on another computer.

[Configuration of the image retrieval apparatus]
Next, the configuration of an image retrieval apparatus 20. Figure 3 is a diagram schematically showing a functional configuration of an image retrieval apparatus. Image retrieval apparatus 20 is a computer such as a server computer. Image retrieval device 20, road conditions provides platform 13 described above are mounted, providing road status providing services. In the present embodiment, it will be described a case where the image retrieval apparatus 20 and one computer as an example, may be implemented as a computer system according to a plurality of computers.

As shown in FIG. 3, the image retrieval device 20 includes a communication unit 21, a storage unit 22, and a control unit 23.

The communication unit 21 is a communication interface for performing wireless communication with another device or wired communication. For example, the communication unit 21 from the operation control platform 11, and the image data of the image captured by the vehicle-mounted device 15 receives imaging information including an imaging position at the time of capturing the image. Further, the communication unit 21, the probe analysis platform 12 receives and road information about a road, a running section information concerning the traveling route with the vehicle-mounted device 15 is traveling business vehicle 16 mounted.

Storage unit 22, a hard disk, SSD (Solid State Drive), a storage device such as an optical disk. The storage unit 22, RAM (Random Access Memory), a flash memory, NVSRAM (Non Volatile Static Random Access Memory) data may be a semiconductor memory capable of rewriting the like. Storage unit 22, and OS (Operating System) executed by the control unit 23 stores various programs. Further, the storage unit 22 stores various types of information. For example, the storage unit 22 stores the image data 30, the imaging information 31, the road information 32, the travel section information 33, the matching information 34, and summary information 35. The storage unit 22 may store other various information.

Image data 30, received from the operation management platform 11, which is image data of an image captured by the vehicle-mounted device 15.

Imaging information 31 is data including an imaging position at the time of capturing the image of the image data 30. Figure 4 is a diagram illustrating an example of the data configuration of the imaging information. As shown in FIG. 4, the imaging information 31 includes image ID, image capturing position, the vehicle ID, and each item of the image capturing time. The imaging information 31 may store a variety of information other than the above.

Item image ID is an area for storing identification information for identifying the image data of an image captured by the vehicle-mounted device 15. The image data of an image captured by the vehicle-mounted device 15, as identification information, e.g., unique image ID, such imaged order number (identification) is given. In the item of image ID, image ID assigned to the image data of an image captured by the vehicle-mounted device 15 is stored. Item of the imaging position is an area for storing position information indicating the image pickup position at the time of capturing the image. In this embodiment, the position information, and the latitude, and the information to showing in position longitude by a predetermined datum, such as Japanese geodetic system and the world geodetic system. In the item of the imaging position, latitude showing an imaging position (x), the position information such as longitude (y) is stored. The position information may be other information as long specifying the position. Item vehicle ID is an area for storing the identification information of the business vehicle 16 equipped with the vehicle-mounted device 15 that has transmitted the image data. To the vehicle-mounted device 15, as identification information of the business vehicle 16 mounted, unique vehicle ID is set. OBE 15 transmits the image data and the probe information obtained by adding a vehicle ID is set to the logistical support system 10. In the item of the vehicle ID, vehicle ID of the business vehicle 16 equipped with the vehicle-mounted device 15 that has transmitted the image data of the image ID is stored. Item of the imaging time, an area for storing the image capturing time the image was captured by the vehicle-mounted device 15.

In the example of FIG. 4, the image of the image data of the image ID "image 1", the imaging position is latitude x, longitude y, the vehicle ID of the business vehicle 16 equipped with the vehicle-mounted device 15 that has transmitted the image data is "Aaa a "indicates that the imaging time is 20 minutes and 20 seconds at 10.

Returning to Figure 3, the road information 32 is data that stores various information about the road. For example, the road information 32, for each section separated road, information such as the type of the road is stored. Figure 5 is a diagram illustrating an example of the data structure of the road information. As shown in FIG. 5, the road information 32 includes section number, type, direction, facilities, each item of the section range. Incidentally, the road information 32 may store a variety of information other than the above.

Item interval number is an area for storing identification information for identifying a section of the road. Each road, respectively, for example, along a predetermined reference, divided into one or more sections, as identification information to each section, for example, a unique segment number is assigned. Predetermined criterion, for example, may be defined by a distance such as every 100 m, the intersection of the other roads such as intersections may be a unit of the separator section. The predetermined criterion may be, for example, bridges, tunnels, service area, parking area, junction etc., of the boundary and facilities boundary structures relating road section may be separated, of a section public institutions have determined it may be used conditions. The predetermined criterion may be a combination of a plurality of conditions. In the item of interval number, granted section number road sections are stored. Item type is an area for storing a type of road in the section number section. The section of road, motorway, motorways, etc. general road defines a type indicating whether the interval is what kind of road. The type of the item, type defined in the road of the section number section is stored. Direction of entry is an area for storing the traveling direction of the road sections. The direction of the items, the road section, for example upstream, when the traveling direction, such as down is defined, the travel direction is stored, when the traveling direction is not determined, that the traveling direction is not defined "-" it is stored show. Item facilities is a region for storing property road segment. The item of the facility, the road of the section is, if the service area, a facility such as a parking area, a facility name is stored, if it is not in the facility, indicating that it is not a facility "-" is stored. Item section range is an area that stores information about the range of the section. For example, when defining a section as a rectangular region, the item interval range, position information indicating the positions of two vertexes facing the area to be a section is stored. Incidentally, the interval range may be shown using any information. For example, the interval range may be indicated by the position of all vertices in the region of the section.

In the example of FIG. 5, the section of the section number is 0002, type is highway direction is at up, rather than the property, the interval range (x, y) - indicates that the (x, y) .

Returning to Figure 3, the travel section information 33 is data that stores various information concerning the traveling route with business vehicle 16 equipped with the vehicle-mounted device 15 has traveled. Figure 6 is a diagram illustrating an example of the data structure of the travel section information. As shown in FIG. 6, the travel section information 33 includes time of day, segment number, direction, average speed, each item of the vehicle ID. Incidentally, the travel section information 33 may store a variety of information other than the above.

Item time zone is an area in which the business vehicle 16 equipped with the vehicle-mounted device 15 stores the travel time period on the segment. Time zone, for example, a 5-minute increments, are shown at the start time of the time zone. Item interval number is an area for storing a segment number identifying a section of the road. Direction of entry is an area for storing a running direction of the section of the road where work vehicle 16 equipped with the vehicle-mounted device 15 has traveled. The direction of the item, when the traveling direction on the road sections are defined, the direction of travel is stored, when the traveling direction is not determined, indicating that the traveling direction is not defined "-" is stored that. Item average speed is an area for storing the average rate at which work vehicle 16 equipped with the vehicle-mounted device 15 has traveled the section. Item vehicle ID is an area for storing the vehicle ID of the business vehicle 16 has traveled the section.

In the example of FIG. 6, section of the section number 0002 is up, indicating that the time zone of 10:20, the average speed is work vehicle 16 of the vehicle ID "Aaa" is running at 34.5km .

Returning to Figure 3, the matching information 34, based on the imaging information 31 and the travel distance information 33 is data obtained the section or the like corresponding to the imaging position of the image of the image data 30. Details matching information 34 will be described later.

Summary information 35, using the image data 30 is data obtained to use the number of pseudo-facilities. Details of the summary information 35 will be described later.

Control unit 23 is a device that controls the entire image search apparatus 20. The controller 23, CPU (Central Processing Unit), and an electronic circuit such as a MPU (Micro Processing Unit), ASIC (Application Specific Integrated Circuit), can be adopted an integrated circuit such as FPGA (Field Programmable Gate Array). The control unit 23 includes an internal memory for storing programs and control data defining various processing routines and uses them to execute various processes. Control unit 23 functions as various processing units by various programs operate. For example, a control unit 23, a storage unit 40, an identifying unit 41, a counting unit 42, a receiving unit 43, a search unit 44, and an output unit 45.

Storage unit 40 stores various data received in the storage unit 22. For example, storage unit 40, received from the operation management platform 11, and stores the image data of an image captured by the vehicle-mounted device 15 as image data 30 in the storage unit 22. The storage unit 40 has received from the operation management platform 11, and stores the imaging information 31 imaging information including an imaging position at the time of capturing the image in the storage unit 22. The storage unit 40 stores in the storage unit 22 the road information received from the probe analyzing platform 12 as road information 32. The storage unit 40 stores in the storage unit 22 the travel section information received from the probe analyzing platform 12 as the travel section information 33.

Specification unit 41 performs various specific. For example, the specification unit 41 includes an image data 30 of an image captured by the vehicle-mounted device 15, when receiving the imaging information 31 including the location information at the time of capturing the image, the position information when the image was captured based on, specifying the type of the imaged road image. For example, the specification unit 41, based on the road information 32, the imaging position of each image data 30 stored in the imaging information 31 to identify whether corresponding to which section of the road. Thus, for example, image data of the image ID in FIG. 4, "image 1" is identified as corresponding to a section of the section number "0001". Image data of the image ID "image 2" is identified as corresponding to a section of the section number "0002". Image data of the image ID "image 3" is identified as corresponding to a section of the section number "0003". Image data of the image ID "image 4" is identified as corresponding to a section of the section number "0004". Identifying unit 41 identifies the type of the road corresponding to the period corresponding to the imaging position. For example, an image ID "image 1" through "image 4", the type of road corresponding to the period corresponding to the imaging position is identified as "motorways". As shown in FIG. 3, the traveling section information 33, the vehicle number of the business vehicle 16, the traveling the section number, when the running time period on is associated, the specifying unit 41, the travel section information 33 using an imaging time of the image data 30, the vehicle number of the business vehicle 16 may specify whether the imaging position corresponds to which section of the road.

Further, certain portions 41, based on the specified interval, to generate the matching information 34 by performing matching of the image information 31 and the travel section information 33. Figure 7 is a diagram showing an example of matching and aggregation. For example, the specification unit 41, for each image of each image ID of the image information 31, specifies the record corresponding to the period corresponding to the time zone and the imaging position including the image capturing time from the travel section information 33. Then, the specification unit 41, time zone, interval number, direction, average speed, and generates a vehicle ID, the matching information 34 that stores information of each item of the image ID.

Counting unit 42 counts the number of images of the image data capturing position is included in the predetermined region. For example, the aggregation unit 42, when the imaging position is included service area, parking area, time of day, service area, by the parking area, counts the number of images captured. The counting unit 42 stores the counting result in the summary information 35. 7 shows an example of the summary information 35 is shown. In the summary information 35, time zone, facility, is provided with each item of the use number. The summary information 35, time of day, facility separately, the number of images captured is stored as a usage count. Here, if the vehicle-mounted device 15 captures an image at regular time intervals, in a section that is congested, a number of images are captured. The counting unit 42 according to the present embodiment, as the usage count of the number of images captured, and stored in the summary information 35. By using the available number, pseudo-service area, it is possible to represent the congestion status of the facility, such as a parking area.

Receiving unit 43 accepts various operations. For example, the receiving unit 43 accepts the access from the service operator terminal 17 or road administrator terminal apparatus 18 transmits the information of various operation screens to access source to display an operation screen to the access source, the operation screen It receives various operations from. For example, the receiving unit 43 provides a Web site of the road status providing services. Receiving unit 43, from the service business user terminal device 17 or the road administrator terminal device 18, when receiving the access to the Web site of the road status providing services, operation information of the login screen of the access source business user terminal device 17 and the road to display the login screen to send to the administrator terminal device 18, accepts a log-in operation by entering the login ID and password. Receiving unit 43 performs when receiving the log-in operation, compared to authentication and login ID and password that has been pre-registered a login ID and password has been entered. Receiving unit 43, when the authenticity and authentication is obtained by sending the information of the condition specifying screen to the access source and displays the condition designation screen. Then, the receiving unit 43 receives a search condition of the road conditions from the conditions specified screen. For example, the receiving unit 43, a search condition of the road conditions, the time zone, the region of position, receives designation of range condition, including the traveling direction. For example, the receiving unit 43 receives the time of day, and the road section, the road of the uplink, the designation of the downlink.

Searching unit 44, the image data 30 stored in the storage unit 22, searches for satisfying the search condition image data received by the receiving unit 43. For example, the search unit 44 uses the matching information 34, specifies an image ID of the image corresponding to the specified time zone and road sections as a search condition. Then, the search unit 44, the image data 30 of the specified image ID to search or stored in the storage unit 22. The search unit 44, interval service area is specified as a search condition road, when a parking area, the summary information 35, reads the usage number corresponding to the facility designated section.

Meanwhile, the imaging position of the collected images from the vehicle-mounted device 15 mounted in the logistical support system 10 to the respective business vehicle 16 is not always evenly distributed. Thus, image display and road conditions even when the image data searched by the search unit 44 it may be difficult to grasp. For example, in the way infrequently road work vehicle 16, less image to be retrieved, road conditions it may be difficult to grasp. Further, for example, in high traffic frequency operational vehicle 16 the road, increases an image to be searched, when viewing all retrieved image, if trouble of referring to the image hardly grasped road conditions become complicated there is.

Therefore, the search unit 44 of the image data 30 stored in the storage unit 22, when the range satisfies the image data 30 that has been received is equal to or less than a predetermined number, one of the range of the time zone or location of the range condition extended the re-search is carried out. The search unit 44 of the storage unit 22 image data 30 stored in the case the range satisfying the condition image data 30 that has received the predetermined or maximum number larger than the predetermined number, the time zone of range condition or reducing one of the range of positions of the search performed. Predetermined number, for example, although a 10, but is not limited thereto. The upper limit number is, for example, a 15, but not also limited. Predetermined number and maximum number, the administrator of the user and distribution support system 10 may be changed.

Figure 8 is a time period ranging conditions, extension of the range of positions, is a diagram for explaining the reduction. 8 includes a period T1 of the specified time period, interval range T2 of road sections is shown. For example, the search unit 44, first, there is an imaging time period T1 of the specified time period, searches the image data 30 is image pickup position in the interval range T2 of road sections. Searching unit 44, a predetermined number of image data 30 are retrieved (e.g., 10) in the following cases, performing the search extend either period T1 or interval range T2. For example, the search unit 44, priority to the extension of time, until the image data 30 retrieved is larger than a predetermined number, repeats the expansion of the range of extension and position of the time alternately. For example, the search unit 44 performs a search to extend the period T1, even search result by extending the period T1, when the image data 30 retrieved is less than a predetermined number, to extend the interval range T2 the re-search is carried out. Searching unit 44, for the period T1 performs extension for past. The search unit 44 performs an expansion on both sides around the specified interval for interval range T2. Unit to extend the period T1, the predetermined time period (e.g., 2 minutes) may as a unit may be a unit time period. Further, extension of the period T1 may increase the extended width of about the period T1 times to extend increases. For example, the search unit 44, in the extension of the first period T1, and expanded 2 minutes, the extension of the second period T1, may be extended for 3 minutes. Unit to extend the interval range T2 is a predetermined distance (e.g., 100 m) may be a unit, or as a unit of segment. Also, expansion of the section range T2 may increase the extended width of about interval range T2 times to extend increases. For example, the search unit 44, in the extension of the first section ranges T2, and 100m extension, the extension of the second section ranges T2, and the 200m extend. The retrieval unit 44, if the image data 30 retrieved is less than a predetermined number, may be extended both periods T1 and interval range T2. The search unit 44, only one may be repeated to extend the period T1 or interval range T2. The search unit 44, when the image data 30 retrieved is less than a predetermined number, may be extended both periods T1 and interval range T2. The search unit 44, for the period T1, may be carried out extensions to the past and future around the period T1. The search unit 44, the interval range T2, may extend the period range T2 only to one of before or after for a given direction of travel. For example, the search unit 44, when the extension of the section range T2 is the interval range T2 which is extended in front of the traveling direction of the specified road or as a new range condition. Accordingly, the CPU recognizes the condition of the vehicle passing through a section of the specified position from now, in the position specified interval, for example, can provide more predictable changes in road conditions, such as traffic conditions.

The search unit 44 searches image data 30 is a predetermined upper limit number (e.g., 15) cases described above, the search performed by reducing either the period T1 or interval range T2. For example, the search unit 44, priority to the reduction of the interval range T2, to the image data 30 retrieved is less than the upper limit number, repeating the reduction of the reduction and time range of positions alternately. For example, the search unit 44 performs the search by reducing the interval range T2, even search result by reducing the interval range T2, the image data 30 retrieved often higher than the upper limit number, to reduce the period T1 the re-search Te do. Searching unit 44, for period T1 performs reduction only past side. The search unit 44 performs a reduction of both sides around a specified interval for interval range T2. Unit to reduce the period T1, the predetermined time period (e.g., 2 minutes) the unit. Further, reduction of the period T1 may reduce the reduction width enough period T1 times to reduce increases. For example, the search unit 44, the reduction of the first period T1, reduced 2 minutes, and the reduction of the second period T1, may be reduced 1 minute. Units to reduce the section range T2 is a predetermined distance (e.g., 50 m) units. Also, reduction in the interval range T2 may reduce the reduction width of about interval range T2 is the number of times to reduce increases. For example, the search unit 44, the reduction of the first segment ranges T2, and 50m expansion, the reduction of the second interval range T2, and the 25m reduced. The retrieval unit 44, if the image data 30 that has been searched for more than the maximum number, may be reduced both the period T1 and period range T2. The search unit 44 may repeat contraction only one time interval T1 or interval range T2. Search unit 44, when the image data 30 that has been searched for more than the maximum number, may be reduced both the period T1 and period range T2. The search unit 44, for the period T1, may be performed reduced relative to the center of the period T1. The search unit 44, the interval range T2, may be reduced section ranges T2 only to one of before or after for a given direction of travel. For example, the search unit 44, when the time direction expansion, the period T1 that than the specified time period was extended past time zone may be as a new range condition. Thus, the time zone from the past, the CPU recognizes the condition of the vehicle passing through the section of the specified position of toward the specified time period, for example, Ya grasp the change in the road conditions, such as traffic conditions camphor can be provided.

The output unit 45 outputs the search result to the access source. For example, the output unit 45 transmits the information of the road status screen showing the retrieved image data and use the number to the access source and displays the road status screen.

Figure 9 is a diagram showing an example of a flow to search for the road conditions. Image search apparatus 20, provides a road status providing services, accepts a search condition of the road conditions from the condition specification screen 100. Condition specifying screen 100 includes a map area 101 where the road map is displayed, the time zone selection area 102 for selecting a time zone in which the search condition, the traveling direction selection area 103 for selecting the traveling direction of the road to be searched , a search button 104 for instructing the search start is provided. Map region 101 is in a state of section of road corresponding to the designated position is selected by the road is selected. In the example of FIG. 9, there is a state where the section 105 shown by oblique lines is selected. Time zone selection area 102 is a combo box, by selecting, for example, there is a possible specification of time zone 5 minutes. In the example of FIG. 9, the time zone of 10:00 20 minutes to 10 hours 25 minutes it is specified. Traveling direction selection area 103 is a combo box, by selecting, for example, upstream, and is possible to specify the travel direction of the road in the downlink. Incidentally, in the map region 101, when the road traveling direction has been determined is designated, the traveling direction selected area 103 may be the traveling direction of the selected road is selected automatically. Image retrieval apparatus 20 is selected road sections in the map area 101 of the condition setting screen 100, the selected time zone in the time zone selection area 102, a search button 104 traveling direction is selected by the traveling direction selection area 103 Once selected, the selected road section, time of day, the search for the traveling direction as a search condition performed. Then, the image search apparatus 20 displays the road status screen 120 shows the search results. If the image data is retrieved, the road status screen 120 in association with the imaging position of the retrieved image data of the image, the image of the image data is displayed. Further, the interval of the specified road when a service area, parking area, the road status screen 120, service area, the use count in association with the parking area are displayed. In the example of FIG. 9, since it is specified service area, other than the parking area section, the road status screen 120 in association with the imaging position of the retrieved image data of the image, the image of the image data is displayed ing.

Note that the road to be searched may be multiple allowed simultaneously. Figure 10 is a diagram showing another example of a flow to search for the road conditions. Map region 101 of the condition setting screen 100 is configured to be in the range of specified by such drag. In the example of FIG. 10, the range 110 is specified. Image retrieval apparatus 20 is range designated on map region 101 of the condition setting screen 100, the selected time zone in the time zone selection area 102, a search button 104 traveling direction is selected by the traveling direction selected region 103 is selected If that road section included in the specified range of the map region 101, the time zone, the searching the traveling direction as a search condition performed. Then, the image search apparatus 20 displays the road status screen 120 shows the search results. In the example of FIG. 10, because it contains a range 110 as "○○ expressway," "New ○○ highway", for each road, in association with the imaging position of the retrieved image data of the image, the image data the image is displayed. Image search apparatus 20, when each image is selected, to enlarge an image.

As a result, the road management company and to manage the road, service operators to navigate a business vehicle 16, can grasp the road conditions.

Process Flow
Next, the flow of image search image search apparatus 20 according to this embodiment is executed. Figure 11 is a flowchart showing an example of an image retrieval procedure. The image search a predetermined timing, for example, a search button 104 search criteria condition specification screen 100 is specified is performed on the selected timing.

As shown in FIG. 11, the search unit 44, the image data 30 stored in the storage unit 22, searches for the specified search condition is satisfied image data (S10). Searching unit 44 determines whether the number of retrieved image data 30 is equal to or less than a predetermined number (S11). If the number of the retrieved image data 30 is equal to or less than a predetermined number (S11: Yes), the search unit 44 performs search again extend one of the range of the time zone or location of range condition (S12), to step S11 Transition.

On the other hand, if the number of retrieved image data 30 is not equal to or less than the predetermined number (S11: No), the search unit 44 determines whether the number of retrieved image data 30 is equal to or more than the upper limit number (S13). If the number of the retrieved image data 30 is equal to or greater than the upper limit number (S13: Yes), the search unit 44 performs the search by reducing one of the range of the time zone or location of range condition (S14), the S13 Transition.

On the other hand, if the number of retrieved image data 30 is not equal to or larger than the upper limit number (S13: No), the output unit 45 transmits the information of the road status screen showing an image of the retrieved image data to the access source (S15 ), the process is terminated.

[effect]
As described above, the image search apparatus 20 according to this embodiment receives a specification of range condition including the area of ​​the time zone and location. Image search apparatus 20 searches the storage unit 22 for storing an image in which the position information and time information associated, among images stored in the storage unit 22, a predetermined number range satisfying image received is if: the search performed by extending one of the range of the time zone or location of range condition. Thus, the image search device 20 has a low traffic frequency operational vehicle 16, even image is small roads to be searched, it is possible to provide an easy image to grasp the road conditions.

The image search apparatus 20 according to this embodiment, of the image stored in the storage unit 22, when a range satisfying image received is given over the upper limit number greater than the predetermined number, the time range condition the search carried out by reducing one of the range of the band or position. Thus, the image search apparatus 20 is often traffic frequently work vehicle 16, even image often roads to be searched, it is possible to provide an easy image to grasp the road conditions.

The image search apparatus 20 according to this embodiment receives a specification of range condition, including the traveling direction of the road to be searched. Image search apparatus 20, when the expansion of the position information, the position information is extended in front of the traveling direction of the specified road as a new range condition. Thus, the image search apparatus 20, the area of ​​the designated location, for example, can provide more predictable changes in road conditions, such as traffic conditions. The image search apparatus 20, when the time direction expansion, the past time zone information obtained by extending the time period as a new range condition. Thus, the image search apparatus 20, the toward the specified time period, for example, can be provided grasp reagent changes in road conditions, such as traffic conditions.

The image search apparatus 20 according to this embodiment, priority is given to extension of time, the range satisfying the condition image including an extended time period if more than a predetermined number, to extend the range of positions. Thus, the image search apparatus 20, even if traffic frequency operational vehicle 16 in the region of the designated position is low, it is possible to provide an easy image to grasp the road conditions of a specified position.

Now, have been described embodiments relates to a device disclosed this, the disclosed technology is also other than the embodiment described above may be implemented in various different forms. In the following, a description will be given of another embodiment included in the present invention.

For example, the above embodiment exemplifies a case where an image of the road by the vehicle-mounted device 15. However, the invention is not limited thereto. For example, a smart phone, a camera-equipped information processing apparatus such as a mobile phone may be an image of the road is fixed to the vehicle. That is, an imaging apparatus for imaging is not limited to the vehicle-mounted device 15 may be an information processing apparatus with a camera.

The components of each device illustrated in the drawings are functionally conceptual and are not necessarily physically configured as depicted. In other words, the specific state of dispersion and integration of each apparatus is not limited to those illustrated in the drawings, depending on various loads or use conditions, dispersed or functionally or physically in arbitrary units It may be configured by integration. For example, storage unit 40, the identifying unit 41, totaling unit 42, receiving unit 43, the processing unit of the search unit 44 and the output unit 45 may be integrated as appropriate. The processing of each processing unit may be separated into processing appropriate plurality of processing units. The process functions performed by the processing unit, of which all or any part, be realized by a program analyzed and executed by the CPU and the CPU, or implemented as hardware by wired logic .

[Image Search Programs
Also, various processes described in the above embodiments may also be realized by executing a prepared program in a computer system such as a personal computer or a workstation. In the following, an example of a computer system that executes the image search program to assist navigation. Figure 12 is a diagram showing an example of a computer, configured to execute the image search program.

As shown in FIG. 12, the computer 400 has a CPU (Central Processing Unit) 410, HDD (Hard Disk Drive) 420, RAM (Random Access Memory) 440. These units 400 to 440 are connected via a bus 500.

HDD420 above storage unit 40, the identifying unit 41, totaling unit 42, receiving unit 43, an image search program 420A having the same function as the search unit 44 and the output unit 45 are stored in advance. Note that the image retrieval program 420A may be separated as appropriate.

Further, HDD 420 stores various types of information. For example, HDD 420, similar to the storage unit 22 stores various data used to support OS and service.

Then, CPU 410 may reads and executes the image search program 420A from HDD 420, to perform the same operation as the processing unit of the embodiment. In other words, the image retrieval program 420A is storing section 40, the identifying unit 41, totaling unit 42, receiving unit 43 performs the same operation as the retrieval unit 44 and an output unit 45.

Note that the image retrieval program 420A as described above, does not necessarily need to be stored from the beginning in the HDD 420. Further, for example, an image search program 420A is a flexible disk 400 (FD), CD-ROM, DVD disk, a magneto-optical disk, may be stored in "portable physical media" such as an IC card . Then, the computer 400 may read and execute the program from these.

Furthermore, public line, Internet, LAN, allowed to store the program and "another computer (or server)" connected to the computer 400 via a WAN. Then, the computer 400 may read and execute the program from these.

10 logistical support system 11 operation management platform 12 probe analysis platform 13 road status providing platform 15 mounted device 16 work vehicle 20 image search apparatus 21 communication unit 22 storage unit 23 the control unit 30 the image data 31 captured information 32 road information 33 travel route information 34 matching information 40 storing section 41 specifying unit 42 counting unit 43 reception unit 44 search unit 45 output unit

Claims (6)

  1. Accepting designation of range conditions including the region of the time period and location,
    Searching a storage unit for storing the position information and time information image is correlated with, among images stored in the storage unit, when the range satisfies image received is equal to or less than a predetermined number, the image retrieval program, characterized in that to execute expanded and re-searching process performed by one of the range of the time zone or location of the range condition to the computer.
  2. Wherein the performing processing search, among the images stored in the storage unit, when the range satisfies image received is given over the upper limit number greater than the predetermined number, the time zone of the range condition or image retrieval program according to claim 1, characterized in that the search reduce any range of positions.
  3. Process of receiving the designation accepts designation of range conditions including the traveling direction of the road to be searched,
    Expansion of the range, when the expansion of the position information, the position information is extended in front of the traveling direction of the specified the road as a new range condition, if the time direction expansion, the past time zone image retrieval program according to claim 1, characterized in that the new range condition an extended time zone information.
  4. Expansion of the range, with priority to extend the time, when the range satisfies image including an extended time period is equal to or less than a predetermined number, image according to claim 1, characterized in that to extend the range of the position Search program.
  5. Accepting designation of range conditions including the region of the time period and location,
    Searching a storage unit for storing the position information and time information image is correlated with, among images stored in the storage unit, when the range satisfies image received is equal to or less than a predetermined number, the image retrieval method characterized by processing either to extend the range to re-search time period or position of range condition the computer executes.
  6. A receiving unit that receives a designation of range condition including the area of ​​the time zone and location,
    Searching a storage unit for storing the position information and time information image is correlated with, among the stored images in the storage unit, the range satisfying image received by the receiving unit is equal to or less than a predetermined number when, a search unit for performing search extend one of the range of the time zone or location of the range condition,
    Image retrieval apparatus characterized by having a.
PCT/JP2016/066073 2016-05-31 2016-05-31 Image search program, image search method, and image search device WO2017208371A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2016/066073 WO2017208371A1 (en) 2016-05-31 2016-05-31 Image search program, image search method, and image search device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2016066073A JPWO2017208371A1 (en) 2016-05-31 2016-05-31 Image search program, an image retrieval method and the image retrieval device
PCT/JP2016/066073 WO2017208371A1 (en) 2016-05-31 2016-05-31 Image search program, image search method, and image search device

Publications (1)

Publication Number Publication Date
WO2017208371A1 true WO2017208371A1 (en) 2017-12-07

Family

ID=60479216

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/066073 WO2017208371A1 (en) 2016-05-31 2016-05-31 Image search program, image search method, and image search device

Country Status (2)

Country Link
JP (1) JPWO2017208371A1 (en)
WO (1) WO2017208371A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07295875A (en) * 1994-04-22 1995-11-10 Sharp Corp Information retrieval device
JP2004220420A (en) * 2003-01-16 2004-08-05 Fuji Photo Film Co Ltd Image retrieval method and device and program
JP2012133526A (en) * 2010-12-21 2012-07-12 Panasonic Corp Location history authentication system, server and program
JP2013045319A (en) * 2011-08-25 2013-03-04 Sony Corp Information processing apparatus, information processing method, and program
WO2013099002A1 (en) * 2011-12-28 2013-07-04 楽天株式会社 Search device, searching method, search program and recording medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH07295875A (en) * 1994-04-22 1995-11-10 Sharp Corp Information retrieval device
JP2004220420A (en) * 2003-01-16 2004-08-05 Fuji Photo Film Co Ltd Image retrieval method and device and program
JP2012133526A (en) * 2010-12-21 2012-07-12 Panasonic Corp Location history authentication system, server and program
JP2013045319A (en) * 2011-08-25 2013-03-04 Sony Corp Information processing apparatus, information processing method, and program
WO2013099002A1 (en) * 2011-12-28 2013-07-04 楽天株式会社 Search device, searching method, search program and recording medium

Also Published As

Publication number Publication date
JPWO2017208371A1 (en) 2019-01-31

Similar Documents

Publication Publication Date Title
KR101847466B1 (en) Method and system for displaying points of interest
US8972175B2 (en) Navigation using crowdsourcing data
US8639654B2 (en) Method for updating digital maps
Shekhar et al. Spatial big-data challenges intersecting mobility and cloud computing
US8930123B2 (en) Systems and methods for determining traffic intensity using information obtained through crowdsourcing
JP4305361B2 (en) Road management system
CA2823827C (en) Crowd sourced traffic reporting
US20150292894A1 (en) Travel route
US9691281B2 (en) Navigation system with image assisted navigation mechanism and method of operation thereof
US8108141B2 (en) Intelligent travel routing system and method
US9200910B2 (en) Ranking of path segments based on incident probability
JPWO2008117787A1 (en) Map matching system, the map-matching method, and program
US20110112760A1 (en) Method of creating map data comprising transit times for intersections
EP3047664B1 (en) System and method for automated correction of geofences
EP2911410A2 (en) Method and apparatus for providing selection and prioritization of sensor data
US9959761B2 (en) System and method for locating available parking spaces
US7908075B2 (en) Traffic information query system and traffic information query method
US9355063B2 (en) Parking lot detection using probe data
Antoniou et al. A synthesis of emerging data collection technologies and their impact on traffic management applications
CN103557870B (en) Dynamic trajectory navigation method and cloud platform
KR101994496B1 (en) Providing routes through information collection and retrieval
US10354333B1 (en) Providing insurance discounts based upon usage of telematics data-based risk mitigation and prevention functionality
US9476964B2 (en) Automatic image capture
US20160298977A1 (en) Systems and methods for simultaneous electronic display of various modes of transportation for viewing and comparing
JP2014527617A5 (en)

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 2018520263

Country of ref document: JP

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16903997

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16903997

Country of ref document: EP

Kind code of ref document: A1