JP2020095353A - Information processing device - Google Patents

Abstract

To provide an information processing device capable of easily collecting information of interest to a user.SOLUTION: An information processing device 10 is provided, comprising: a communication unit 12 configured to acquire an in-vehicle camera image, shot location information of the in-vehicle camera image, and shot time information of the in-vehicle camera image; and a control unit 11 configured to extract an evaluation target image from the in-vehicle camera image according to predetermined conditions, evaluate the evaluation target image, and output an evaluation result of the evaluation target image in association with the shot location information and the shot time information.SELECTED DRAWING: Figure 1

Description

The present disclosure relates to an information processing device.

Conventionally, a navigation device that displays a landscape spot is known. For example, Patent Document 1 discloses a navigation device that displays information on landscape spots that are registered in advance, based on the traveling route of the vehicle.

JP, 2017-150972, A

As information provided to the user of the device, it is required to collect information that the user is interested in.

An object of the present disclosure made in view of such circumstances is to easily collect information in which a user is interested.

An information processing device according to an embodiment of the present disclosure,
A vehicle-mounted camera image, a communication unit that acquires shooting position information of the vehicle-mounted camera image, and shooting time information of the vehicle-mounted camera image,
An evaluation target image is extracted from the vehicle-mounted camera image based on a predetermined condition, the evaluation target image is evaluated, and an evaluation result of the evaluation target image, the shooting position information, and the shooting time information are output in association with each other. And a control unit for controlling.

According to the information processing device according to the embodiment of the present disclosure, information in which the user is interested can be easily collected.

It is a block diagram showing an example of composition of an information processing system concerning one embodiment. It is a flowchart which shows an example of the procedure of an information processing method.

(Example of configuration of information processing system according to one embodiment)
As shown in FIG. 1, an information processing system 100 according to an embodiment includes an information processing device 10 and a photographing vehicle 1. The photographing vehicle 1 is, for example, an automobile, but is not limited to this and may be any vehicle. The information processing system 100 may include a plurality of photographing vehicles 1. The photographing vehicle 1 can communicate with the information processing device 10. The photographing vehicle 1 may communicate with the information processing device 10 via the network 60.

The information processing device 10 includes a control unit 11, a communication unit 12, and a storage unit 13. The information processing device 10 may include a server. The control unit 11 may include one or more processors. In the present embodiment, the “processor” is a general-purpose processor, a dedicated processor specialized for specific processing, or the like, but is not limited to these. The communication unit 12 includes a communication module and communicates with the communication device 30 of the photographing vehicle 1. The storage unit 13 may include one or more memories. In the present embodiment, the “memory” is, for example, a semiconductor memory, a magnetic memory, an optical memory, or the like, but is not limited to these. Each memory included in the storage unit 13 may function as, for example, a main storage device, an auxiliary storage device, or a cache memory. The storage unit 13 may include an electromagnetic storage medium such as a magnetic disk. The storage unit 13 stores arbitrary information used for the operation of the information processing device 10. For example, the storage unit 13 may store a system program, an application program, or the like.

The photographing vehicle 1 is equipped with an in-vehicle camera 20, a position information acquisition device 25, and a communication device 30. The vehicle-mounted camera 20, the position information acquisition device 25, and the communication device 30 are communicably connected to each other via a vehicle-mounted network such as a CAN (Controller Area Network) or a dedicated line.

The communication device 30 communicates with the communication unit 12 of the information processing device 10. The communication device 30 may communicate with the communication unit 12 of the information processing device 10 via the network 60. The communication device 30 may be an in-vehicle communication device such as a DCM (Data Communication Module). The communication device 30 may include a communication module connected to the network 60. The communication module may include, but is not limited to, a communication module compatible with mobile communication standards such as 4G (4th Generation) and 5G (5th Generation).

The vehicle-mounted camera 20 photographs an object located around the photographing vehicle 1 or in the passenger compartment. The image captured by the vehicle-mounted camera 20 is also referred to as a vehicle-mounted camera image. The vehicle-mounted camera image is associated with information about the shooting position or information about the shooting time. The vehicle-mounted camera image may include a still image or a moving image. The vehicle-mounted camera 20 outputs the vehicle-mounted camera image to the information processing device 10.

The vehicle-mounted camera 20 may include at least one of a front camera, a side camera, a rear camera, and an in-vehicle camera. The front camera shoots an object located in front of the shooting vehicle 1. The image captured by the front camera is also referred to as a front image. The side camera photographs an object located on the side of the photographing vehicle 1. The image captured by the side camera is also referred to as a side image. The rear camera photographs an object located behind the photographing vehicle 1. The image captured by the rear camera is also referred to as the rear image. The in-vehicle camera images an object located inside the vehicle interior of the imaging vehicle 1 and an object located behind the imaging vehicle 1. The image captured by the in-vehicle camera is also referred to as an in-vehicle image.

The position information acquisition device 25 acquires the position information of the own vehicle. The position information acquisition device 25 may include a receiver compatible with the satellite positioning system. The receiver compatible with the satellite positioning system may include, for example, a GPS (Global Positioning System) receiver. The photographing vehicle 1 may associate the vehicle-mounted camera image with the position information of the own vehicle acquired by the position information acquisition device 25 as the information regarding the position where the vehicle-mounted camera image is captured.

The information processing system 100 may further include a terminal 70. The terminal 70 communicates with the information processing device 10. The terminal 70 may communicate with the information processing device 10 via the network 60. The terminal 70 may include a mobile terminal such as a smartphone.

(Operation of information processing system)
The information processing system 100 collects information in which the user is interested based on the vehicle-mounted camera image captured by the capturing vehicle 1.

The communication unit 12 of the information processing device 10 acquires the vehicle-mounted camera image, information that identifies the position at which the vehicle-mounted camera image was captured, and information that identifies the time at which the vehicle-mounted camera image was captured. The information that specifies the position where the vehicle-mounted camera image is captured is also referred to as shooting position information. The information that specifies the time when the vehicle-mounted camera image was captured is also referred to as capturing time information.

The control unit 11 of the information processing device 10 extracts, from the vehicle-mounted camera image, an image that is a target for evaluating how much interest the user shows. An image that is a target for evaluating how much interest a user shows is also referred to as an evaluation target image. It is assumed that the shooting position information and the shooting time information of the evaluation target image are the same as the shooting position information and the shooting time information of the vehicle-mounted camera image from which the evaluation target image is extracted.

The control unit 11 evaluates the degree of interest of the user with respect to the evaluation target image. The control unit 11 may calculate an evaluation value for the evaluation target image. The higher the user's interest in the evaluation target image, the higher the evaluation value may be calculated.

The control unit 11 associates the evaluation result of the evaluation target image with the shooting position information and the shooting time information of the evaluation target image. The information in which the evaluation result of the evaluation target image is associated with the shooting position information and the shooting time information of the evaluation target image is also referred to as spot evaluation information. The control unit 11 may output the spot evaluation information to the storage unit 13. The storage unit 13 stores spot evaluation information. The storage unit 13 may have a database that stores spot evaluation information. A database that stores spot evaluation information is abbreviated as a spot evaluation DB.

By operating as described above, the information processing system 100 can easily collect information on spots of high interest to the user.

The information processing system 100 may output the information stored in the spot evaluation DB to the photographing vehicle 1 so that the driver or fellow passenger of the photographing vehicle 1 can browse the information. The information processing system 100 may allow a driver or a passenger of a vehicle other than the photographing vehicle 1 to browse the information stored in the spot evaluation DB. By doing so, information of high interest to the user can be provided.

The control unit 11 extracts an evaluation target image from the vehicle-mounted camera image based on a predetermined condition. The predetermined condition for extracting the evaluation target image is also referred to as an extraction condition. The extraction condition may include that topography such as a mountain, a hill, a river, a lake, or the sea is shown. The extraction conditions may include the presence of vegetation such as forests, forests, meadows, flower fields, blooming cherry trees, or red-colored trees. The extraction condition may include that an event such as a fireworks display or a festival is shown. The extraction condition may include that a night view such as lighting or illumination of a building is captured. The extraction condition may include that the landscape of the sky such as the sunrise sky, the sunset sky, the blue sky, the sky in which the clouds are floating, or the night sky in which the moon or the star appears appears. The control unit 11 may extract the evaluation target image based on various extraction conditions without being limited to the exemplified extraction conditions. The control unit 11 may extract the evaluation target image based on an extraction condition that is a combination of a plurality of conditions. The extraction condition may include a condition generated by machine learning such as deep learning.

The control unit 11 evaluates the degree of interest of the user with respect to the evaluation target image. The control unit 11 may analyze the elements included in the evaluation target image. The control unit 11 may analyze at least one of the topography, vegetation, event, night view, and sky landscape as an element included in the evaluation target image. The control unit 11 may acquire the number of elements included in the evaluation target image as the analysis result. The control unit 11 may acquire a combination of types of elements included in the evaluation target image as an analysis result. The control unit 11 may acquire the ratio of the area occupied by the entire image for each element included in the evaluation target image as the analysis result. The control unit 11 may acquire the saturation, the brightness, or the contrast of each element included in the evaluation target image as the analysis result. The control unit 11 may acquire the saturation, brightness, or contrast of the entire evaluation target image as an analysis result. The control unit 11 may evaluate the degree of user's interest in the evaluation target image based on the analysis result. The control unit 11 may calculate an evaluation value indicating the degree of interest of the user with respect to the evaluation target image based on the analysis result.

For example, the control unit 11 may determine that a high interest is shown in the evaluation target image in which the fireworks display and the illumination of the tower or the skyscraper are shown, and the evaluation value may be calculated high. For example, the control unit 11 may determine that the evaluation target image in which a mountain range that looks small in the distance and a cherry tree in full bloom that looks large in the vicinity are shown is highly interested, and the evaluation value may be calculated high. For example, the control unit 11 may determine that the evaluation target image showing the sea of clouds formed in the valley is highly interested, and may calculate the evaluation value to be high. The control unit 11 may calculate the evaluation value of the evaluation target image based on various algorithms. The algorithm for calculating the evaluation value may include an algorithm generated by machine learning such as deep learning.

The control unit 11 may further acquire weather information at the position and time when the evaluation target image was captured. The control unit 11 may acquire weather information at the position and time at which the evaluation target image was captured by analyzing the sky state captured in the evaluation target image. The control unit 11 may acquire the weather information in the shooting position information and the shooting time information of the evaluation target image from a database regarding weather information provided by the Meteorological Agency, a private weather service business, or the like. The weather information may include a classification such as sunny, cloudy, or rain. The weather information may include cloud cover. The weather information may include temperature or humidity. The control unit 11 may calculate the evaluation value further based on the weather information. The control unit 11 may associate the weather information with the evaluation result.

By providing not only the evaluation value but also the shooting position information and the shooting time information as the spot evaluation information, the user can easily go to a spot having a high evaluation value. By further providing the weather information at the time of shooting as the spot evaluation information, the probability that the user can see the expected scenery can be increased. In addition, since the weather information at the time of shooting is reflected in the evaluation result, the accuracy of the evaluation value can be increased. As a result, user satisfaction can be increased.

The shooting position information may include direction information indicating in which direction the evaluation target image is taken from the shooting vehicle 1. When a high mountain such as Mt. Fuji that can be seen from a distance or a tall building such as a tower is reflected in the evaluation target image, the control unit 11 may specify the reflected target based on the direction information. The control unit 11 may associate the evaluation result of the evaluation target image with the specified target.

The information processing device 10 may execute an information processing method including the procedure of the flowchart illustrated in FIG. The information processing method may be realized as an information processing program executed by a processor.

The communication unit 12 acquires an in-vehicle camera image, shooting position information, and shooting time information from the shooting vehicle 1 (step S1).

The control unit 11 determines whether the vehicle-mounted camera image is an image obtained by photographing the vicinity of a tourist spot based on the photographing position information (step S2). The control unit 11 may determine that the vehicle-mounted camera image is an image of the vicinity of the tourist spot when the photographing vehicle 1 is located within a predetermined range from the tourist spot, based on the position information of the tourist spot. The location information of the tourist spot may be stored in the storage unit 13 in advance. That is, the tourist spot may be registered in advance. The control unit 11 may acquire the position information of the tourist spot based on the map data.

When the vehicle-mounted camera image is an image of the vicinity of the tourist spot (step S2: YES), the control unit 11 associates the vehicle-mounted camera image with the tourist spot (step S3). As a result, it is specified that the vehicle-mounted camera image is an image captured near the tourist spot.

When the vehicle-mounted camera image is not an image of the vicinity of a tourist spot (step S2: NO), the control unit 11 proceeds to the procedure of step S4.

The control unit 11 extracts the evaluation target image from the vehicle-mounted camera image (step S4).

The control unit 11 acquires weather information at the time of shooting the evaluation target image (step S5).

The control unit 11 calculates the evaluation value of the evaluation target image (step S6). After executing the procedure of step S6, the control unit 11 ends the execution of the procedure shown in the flowchart of FIG. After executing the procedure of step S6, the control unit 11 may output the evaluation value, the shooting position information, and the shooting time information in association with each other. The controller 11 may further output the weather information in association with each other.

The control unit 11 may omit the procedure of steps S2 and S3 shown in the flowchart of FIG.

The control unit 11 may repeat the procedure of steps S4 and S6 when the evaluation target image is extracted as a moving image that continues for a predetermined period or is extracted as a still image continuously shot for a predetermined period. .. By doing so, the control unit 11 may continue to calculate the evaluation value of the evaluation target image for a predetermined period. The control unit 11 may average the evaluation values calculated over a predetermined period.

When the evaluation target image is not an image of the vicinity of a tourist spot, the control unit 11 may register the position where the evaluation target image is captured as a new tourist spot and associate it with the evaluation target image. When the evaluation value equal to or greater than the predetermined value is calculated, the control unit 11 may register the position where the evaluation target image is captured as a new tourist spot.

The control unit 11 may determine the ranking of the tourist spots based on the evaluation value of the evaluation target image associated with each tourist spot.

The information processing system 100 and the information processing apparatus 10 according to the present embodiment can collect spot evaluation information based on an in-vehicle camera image. The vehicle-mounted camera 20 can photograph various directions from various positions. The vehicle-mounted camera 20 can continue shooting while the ignition of the shooting vehicle 1 is on, running, or idling. Thereby, the information processing system 100 and the information processing apparatus 10 can acquire various types of vehicle-mounted camera images. As a result, the information processing system 100 and the information processing device 10 can easily collect the spot evaluation information by evaluating the in-vehicle camera image.

If spot evaluation information is collected based on an image taken by a fixed-point camera, the shooting range is limited. By collecting the spot evaluation information based on the in-vehicle camera image, the image capturing range can be expanded, and the image captured from an unexpected viewpoint can also be collected.

If the spot evaluation information is collected based on an image taken by a camera mounted on the mobile terminal, a compact camera, a single-lens reflex camera, or the like, the timing of shooting is limited. By collecting the spot evaluation information based on the vehicle-mounted camera image, it is possible to collect an image taken at an unexpected timing. In addition, an image taken by a personally owned camera has a limited shooting position depending on the action range of the photographer, and the shooting position is limited within the range assumed by the photographer. By collecting the spot evaluation information based on the in-vehicle camera image, the image capturing range can be expanded, and the image captured from an unexpected viewpoint can also be collected.

That is, according to the information processing system 100 and the information processing apparatus 10 according to the present embodiment, unexpected spot evaluation information can be collected. This allows the user to know a new spot. As a result, user convenience is improved.

(Other embodiments)
The control unit 11 may output the spot evaluation information to the photographing vehicle 1, the terminal 70, or the like. The photographing vehicle 1 notifies the driver or the passenger of the spot evaluation information. The terminal 70 notifies the user of the terminal 70 of the spot evaluation information.

The photographing vehicle 1 or the terminal 70 may include a notification unit that notifies the spot evaluation information. The notification unit may include a display device. The display device may display a character, a figure, an image, or the like that represents information to be notified to the terminal holder. The display device may include a light emitting device such as an LED (Light Emission Diode). The display device may be, for example, a liquid crystal display (LCD). The display device may be an organic EL (Electro-Luminescence) display or an inorganic EL display. The display device may be a plasma display (PDP). The display device is not limited to these displays, and may be displays of various other types. The notification unit may include a speaker. The speaker may output a voice that represents information to be notified to the terminal holder. The notification unit may include a vibrating device. The vibrating device may output a vibration pattern representing information to be notified to the terminal holder. The notification unit is not limited to these examples, and may include various other devices.

In the case of notifying the driver of the photographing vehicle 1 of information, the notification unit mounted on the photographing vehicle 1 summarizes the information to be notified when the amount of information to notify is large from the viewpoint of driver distraction. It may be short culture or symbolized.

The spot evaluation information may be provided to the navigation device. The spot evaluation information may be posted as an article of SNS (Social Networking Service). The spot evaluation information may be posted on the home page of the area including the target spot or a nearby area. The spot evaluation information may be introduced on various media such as television, newspapers or magazines, or web media. The spot rating information may be provided to the travel agent. The spot evaluation information is not limited to these examples and may be used in various modes.

The information processing device 10 extracts, as an image to be evaluated, a mobile sales vehicle that sells stone-roasted potatoes, warabimochi, or the like, or a vehicle that functions as a mobile store such as a stall vehicle that provides ramen or oden, and shoots the image. It may be output in association with the position information and the shooting time information. When the information processing device 10 notifies the user of the information regarding these vehicles, the user's willingness to purchase can be stimulated and the user's action options can be expanded. As a result, user convenience is improved. In addition, the regional economy can be activated.

Although the embodiments according to the present disclosure have been described based on the drawings and the examples, it should be noted that those skilled in the art can easily make various variations and modifications based on the present disclosure. Therefore, it should be noted that these variations and modifications are included in the scope of the present disclosure. For example, the functions and the like included in each means or each step can be rearranged so as not to logically contradict, and a plurality of means or steps or the like can be combined into one or divided. ..

1 Photography Vehicle 10 Information Processing Device 11 Control Unit 12 Communication Unit 13 Storage Unit 20 Vehicle-Mounted Camera 25 Position Information Acquisition Device 30 Communication Device 60 Network 70 Terminal 100 Information Processing System

Claims (1)

A vehicle-mounted camera image, a communication unit that acquires shooting position information of the vehicle-mounted camera image, and shooting time information of the vehicle-mounted camera image,
An evaluation target image is extracted from the vehicle-mounted camera image based on a predetermined condition, the evaluation target image is evaluated, and an evaluation result of the evaluation target image, the shooting position information, and the shooting time information are output in association with each other. Information processing apparatus including a control unit for controlling the information processing apparatus.

Images