JP2019218095A - Information processing device, fuel supply device, information processing method and program - Google Patents

Abstract

To provide an information processing device capable of carrying out appropriate processing according to a status of a user supplying fuel to a movable body.SOLUTION: An information processing device 10 comprises: an acquisition information receiving part 101 for receiving acquisition information, such as an image photographed by a camera 201 etc., acquired by a sensor provided in a fuel supply device 20 for supplying fuel to the movable body; an analysis part 102 for analyzing the acquisition information such as the image received by the acquisition information receiving part 101; and a processing part 104 for carrying out processing according to an analysis result of the analysis part 102.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an apparatus for processing information at the time of fuel supply and the like.

  As a conventional technology, an oil supply pipe communicating with an underground oil storage tank is set up in a fuel supply case, and an oil supply pump connected to an oil supply motor and a flow meter connected to a flow rate pulse transmitter are sequentially placed in the oil supply pipe. There has been known an oil supply device in which an oil supply pipe is disposed, an end of an oil supply pipe is led out of a case of an oil supply machine, and an oil supply hose having an oil supply nozzle at a tip is connected to the end thereof (for example, see Patent Document 1).

Japanese Patent Publication No. 7-84233 (Page 1, Figure 1, etc.)

  However, the conventional technique has a problem in that appropriate processing cannot be performed according to the situation of a user who supplies fuel to a moving body. The status of the user is, for example, the operation status of the user at the time of supply or the status of the user.

  For example, appropriate fuel supply control could not be performed in accordance with the user's operation during fuel supply. For example, even when a user attempts to refuel a car without touching the antistatic sheet, the gasoline refueling cannot be forcibly stopped. Also, for example, even if a user who has fire such as cigarettes attempts to refuel, it has not been possible to forcibly stop gasoline refueling.

  For this reason, conventionally, a monitoring person or the like at a gas station or the like monitors a user who refuels using a monitoring camera or the like provided at the gas station or the like and tries to refuel without touching the antistatic sheet. A user who has fired or a user who has fire has tried to refuel, and was given verbal attention to the user. However, in this case, it is necessary to arrange a guard at a gas station or the like, which is inefficient and labor intensive, and may result in inaccurate monitoring and human error such as omission of checks. There was a problem.

  Further, for example, it has not been possible to provide appropriate information according to a user who supplies fuel. For example, even if a user who supplies fuel is a user who is registered as a member at a specific society operated by a refueling station or the like that performs refueling, recognizing that the user is a member, Failed to notify user.

  The present invention has been made in order to solve the above-described problems, and has an information processing device and a fuel supply device that can perform appropriate processing according to the situation of a user who supplies fuel to a moving object. The purpose is to provide.

  The information processing device of the present invention is an image receiving unit that receives information obtained by a sensor included in a fuel supply device that supplies fuel to a moving object, an analyzing unit that analyzes an image received by the image receiving unit, The information processing apparatus includes a processing unit that performs a process according to an analysis result of the analysis unit.

  With this configuration, appropriate processing can be performed according to the situation of a user who supplies fuel to the moving body.

  Further, in the information processing apparatus of the present invention, in the information processing apparatus, the analysis unit analyzes the image to determine whether a predetermined condition is satisfied, and the processing unit includes the analysis unit Is an information processing apparatus that performs a security ensuring process for ensuring safety as a process according to the analysis result when it is determined that the predetermined condition is satisfied.

  With this configuration, safety can be ensured according to the situation of the user who supplies fuel to the moving body.

  Further, in the information processing apparatus according to the present invention, in the information processing apparatus, the security ensuring process includes an output of a warning.

  With this configuration, a warning can be output according to the situation of the user who supplies fuel to the moving body, and safety can be ensured.

  Further, in the information processing apparatus according to the present invention, in the information processing apparatus, the safety ensuring process includes a control process for prohibiting fuel supply.

  With this configuration, it is possible to prohibit the fuel supply according to the situation of the user who supplies the fuel to the moving body and to ensure the safety.

  Further, in the information processing device of the present invention, in the information processing device, the analysis unit analyzes an image, detects holding of a predetermined article by a user in the image, and detects the holding. , An information processing apparatus that determines that a predetermined condition is satisfied.

  With such a configuration, safety can be ensured when the user holds a predetermined article at the time of fuel supply.

  Further, in the information processing device of the present invention, in the information processing device, the analysis unit analyzes the image to determine whether or not there are a plurality of persons in the image, and determines that there are a plurality of persons. In this case, the information processing apparatus determines that the predetermined condition is satisfied.

  With this configuration, safety can be ensured when a plurality of persons are present at the time of fuel supply.

  Further, in the information processing device of the present invention, in the information processing device, the analysis unit analyzes the image and detects that a user in the image has touched the electrostatic removal sheet, and the touch has not been detected. In this case, the information processing apparatus determines that the predetermined condition is satisfied.

  With such a configuration, safety can be ensured when the user does not touch the static elimination sheet.

  Further, the information processing apparatus of the present invention, in the information processing apparatus, an acquisition unit that acquires supply-related information related to fuel supply performed by the fuel supply device; an analysis result acquired by the analysis unit; And an analysis storage unit that stores the supply-related information acquired in association with the storage unit.

  With this configuration, the analysis result and the supply-related information can be stored in association with each other, and, for example, information related to fuel supply can be effectively used.

  Further, in the information processing device of the present invention, in the information processing device, the analysis unit analyzes the image to determine whether a user in the image is a registered user, and determines whether the registered user is a registered user. In some cases, the information processing apparatus acquires a user identifier associated with the user as an analysis result.

  According to this configuration, the user identifier of the user who intends to supply fuel can be automatically acquired without the user performing any operation or the like.

  Further, in the information processing device of the present invention, in the information processing device, a user information storage unit in which a user identifier of a user and user information on the user are stored in association with each other, and the analysis unit acquires the analysis result. An information processing apparatus further comprising: a user information output unit configured to obtain and output user information associated with the user identifier from the user information storage unit using the user identifier.

  With this configuration, it is possible to output information of a user who intends to supply fuel.

  Further, in the information processing device of the present invention, in the information processing device, the analysis unit analyzes the image, acquires an attribute value related to a user in the image as an analysis result, and sets the attribute value acquired by the analysis unit to The information processing apparatus further includes an attribute corresponding output unit that acquires and outputs corresponding attribute corresponding information.

  With this configuration, it is possible to output information corresponding to the attribute of the user.

  Further, the information processing device of the present invention is the information processing device, wherein the attribute correspondence information is an advertisement.

  With such a configuration, an advertisement corresponding to the attribute of the user can be output.

  Further, in the information processing device according to the present invention, in the information processing device, the sensor is a camera, and the information acquired by the sensor is an image captured by the camera.

  With this configuration, appropriate processing can be performed according to the situation of a user who supplies fuel to the moving body.

  Further, in the information processing device according to the present invention, in the information processing device, the sensor is an infrared sensor, and the information obtained by the sensor is an image captured by the infrared sensor. .

  With this configuration, appropriate processing can be performed according to the situation of a user who supplies fuel to the moving body.

  Further, in the information processing apparatus of the present invention, in the information processing apparatus, the sensor is an infrared distance sensor that obtains a distance image using infrared light, and the information obtained by the sensor is the infrared distance sensor. This is an information processing device that is an acquired infrared distance image.

  With this configuration, appropriate processing can be performed according to the situation of a user who supplies fuel to the moving body.

  A fuel supply device according to the present invention is a fuel supply device that supplies fuel to a moving body, the fuel supply device comprising: a sensor; and an image output unit that outputs information acquired by the sensor to the information processing device. It is a supply device.

  With this configuration, it is possible to provide an image of the user who supplies the fuel to the information processing apparatus, and perform a process according to the situation of the user.

  A fuel supply device of the present invention is a fuel supply device that supplies fuel to a moving body, and performs a sensor, an analysis unit that analyzes information acquired by the sensor, and a process according to an analysis result of the analysis unit. And a processing unit.

  With this configuration, appropriate processing can be performed according to the situation of a user who supplies fuel to the moving body.

  According to the present invention, appropriate processing can be performed according to the situation of a user who supplies fuel to a moving body.

1 is a block diagram of a fuel supply system according to an embodiment of the present invention. Conceptual diagram of the fuel supply system Flow chart showing the operation of the information processing device of the fuel supply system 4 is a flowchart showing the operation of the fuel supply device of the fuel supply system. The figure which shows the user recognition information management table of the information processing apparatus of the same fuel supply system FIGS. 6A to 6D show examples of images for explaining the operation of the information processing apparatus of the fuel supply system. The figure which shows the user information management table of the information processing apparatus of the same fuel supply system FIGS. 8A and 8B show display examples of a fuel supply device of the fuel supply system. FIGS. The figure which shows the attribute correspondence information management table of the information processing apparatus of the same fuel supply system. FIG. 10 is a diagram showing a display example of the fuel supply device of the fuel supply system (FIGS. 10A to 10C). The figure which shows the supply related information management table of the information processing apparatus of the same fuel supply system FIG. 2 is a diagram illustrating an example of an appearance of a computer system according to the embodiment. The figure which shows an example of the structure of the same computer system

  Hereinafter, embodiments of an information processing apparatus and the like will be described with reference to the drawings. Note that components denoted by the same reference numerals in the embodiments perform the same operation, and thus the description thereof may not be repeated.

(Embodiment)
FIG. 1 is a block diagram of a fuel supply system according to the present embodiment.

  FIG. 2 is a schematic diagram of the fuel supply system according to the present embodiment.

  The fuel supply system 1 includes an information processing device 10 and a fuel supply device 20. Here, the case where the number of the fuel supply devices 20 is one will be described, but the fuel supply system 1 may include two or more fuel supply devices 20. The information processing device 10 and one or more fuel supply devices 20 are connected to be able to communicate with each other via a wireless or wired network.

  The information processing apparatus 10 includes an acquisition information receiving unit 101, an analysis unit 102, a user recognition information storage unit 103, a processing unit 104, a user information storage unit 105, a user information output unit 106, an acquisition unit 107, a supply related information storage unit 108, An analysis storage unit 109, an attribute correspondence information storage unit 110, and an attribute correspondence output unit 111 are provided.

  The fuel supply device 20 includes a camera 201, an acquisition information output unit 202, a reception unit 203, a supply unit 204, a control unit 205, an output unit 206, an operation reception unit 207, and a supply-related output unit 208. A dome-shaped static elimination sheet 210 is attached to the front of the fuel supply device 20. A monitor 2061 and a touch panel 2071 provided on the screen of the monitor 2061 are attached to the front of the fuel supply device 20. In addition, a nozzle 212 that supplies fuel via one or more hoses 211 is attached to the fuel supply device 20. The fuel supply device 20 may be considered as a fuel meter.

  The fuel supply device 20 is a device that supplies fuel to a moving body. The moving body is, for example, an automobile, a motorcycle, a motor-equipped bicycle, an electric motor-equipped bicycle, or the like. The fuel is a fuel used by the moving body, such as gasoline, light oil, liquid fuel such as alcohol, gaseous fuel such as LP gas and hydrogen gas, and electricity. Hereinafter, a case will be described in the present embodiment where the fuel is liquid fuel and the moving body is a moving body such as an automobile or a motorcycle using the liquid fuel. However, the fuel supplied by the fuel supply device 20 is not limited to the liquid fuel, and the moving body is not limited to the moving body using the liquid fuel.

  The acquired information receiving unit 101 receives acquired information that is information acquired by a sensor included in the fuel supply device 20 that supplies fuel to the moving body. Hereinafter, in the present embodiment, an example will be described in which the sensor of the fuel supply device 20 is the camera 201, and the information acquired by the sensor is an image captured by the camera 201. That is, an example in which the acquisition information receiving unit 101 receives an image captured by the camera 201 will be described. The acquisition information receiving unit 101 receives, for example, an image captured by the camera 201 from the acquisition information output unit 202 of the fuel supply device 20. The image photographed by the camera 201 is, for example, an image photographed by the user when the camera 201 supplies fuel. The image captured by the camera 201 is, for example, an image captured by the camera 201 of a user standing in front of the camera 201 of the fuel supply device 20 when supplying fuel. Here, the case where the image captured by the camera 201 is a moving image will be described. However, the image captured by the camera 201 may be one or more still images. For example, the image captured by the camera 201 may be a group of a plurality of still images captured at predetermined time intervals. The image captured by the camera 201 may be a color image or a monochrome image. Further, the format of the image captured by the camera 201 is not limited. Note that the reception of an image by the acquisition information receiving unit 101 is not limited to the reception of an image, but may be, for example, the reception of an image output from the camera 201 or the like via a signal line or the like.

  The analysis unit 102 analyzes the acquired information received by the acquired information receiving unit 101. Here, an example in which the analysis unit 102 analyzes an image received by the acquisition information reception unit 101 will be described. The analysis unit 102 determines whether the image satisfies a predetermined condition by analyzing the image, for example. The analysis unit 102 analyzes, for example, the situation of the user in the image. The analysis of the situation of the user is an analysis of an article held by the user, an analysis of the number of users, and an analysis of the operation of the user. Hereinafter, an example of the analysis and determination processing performed by the analysis unit 102 will be described. However, the analysis performed by the analysis unit 102 is not limited to the following analysis.

(1) Analysis of Items to be Held The analysis unit 102 analyzes, for example, an image received by the acquisition information receiving unit 101, detects holding of a predetermined item by the user in the image, and detects the holding. In this case, it is determined that a predetermined condition is satisfied. The predetermined article is, for example, an article that is considered to be dangerous to hold when supplying fuel. The predetermined article is, for example, fire. The fire is, for example, a lit cigarette. The holding here may be considered to include, for example, holding a cigarette in the mouth. The predetermined article may be a lighter or the like. The predetermined article may be a mobile terminal such as a mobile phone or a so-called smartphone. The analysis unit 102 detects, for example, holding of a predetermined article such as fire in order to prevent ignition of fuel or the like. The analysis unit 102 performs, for example, image recognition and detects a predetermined article from the image. For example, the analysis unit 102 separates and extracts features from the image, performs pattern matching, conversion, and the like, and identifies and recognizes predetermined features of the article. The image recognition is performed using, for example, information on feature points acquired for a predetermined article, an image of a predetermined article, and the like. For example, the analysis unit 102 detects an image having a feature point that matches a predetermined feature point of the article by performing pattern matching or the like from the image received by the acquisition information receiving unit 101. The information on the feature points may be stored in a storage unit (not shown) of the information processing apparatus 10, for example, and may be appropriately read at the time of analysis. Note that the image recognition processing used by the analysis unit 102 is not limited to the above-described image recognition processing. Since the image recognition processing for detecting a specific article is a known technique, a detailed description is omitted here. The image recognition performed by the analysis unit 102 thereafter may be the same as the image recognition described here. In this case, the predetermined article may be appropriately replaced with an object to be detected by image recognition.

(2) Analysis on Number of People The analysis unit 102 analyzes, for example, an image received by the acquisition information receiving unit 101, determines whether or not there are a plurality of people in the image, and determines that there are a plurality of people. When it is determined, it is determined that a predetermined condition is satisfied. For example, the analysis unit 102 performs image recognition in the same manner as described above to detect a person from the image, and determines whether the number of detected persons is two or more. If there are two or more, it is determined that a predetermined condition is satisfied. If it is alone, it is determined that the predetermined condition is not satisfied. When fuel is supplied by a plurality of persons, static electricity or the like may be generated and the fuel may ignite. The analysis unit 102 detects that a plurality of persons supply fuel in order to prevent such fuel ignition. When detecting a human, an image may be analyzed to detect a human face in the image. If the number of detected faces is two or more, it may be determined that the condition is satisfied. If the number of detected faces is one, it may be determined that the condition is not satisfied. Since human detection and human face recognition are known, detailed description is omitted here.

(3) Analysis on Operation The analysis unit 102 analyzes, for example, an image received by the acquisition information receiving unit 101, and determines whether or not a user operation in the image satisfies a predetermined condition. The analysis unit 102 analyzes, for example, the image received by the acquisition information reception unit 101, detects whether the user in the image has performed a predetermined operation, and performs the predetermined operation. If not, it is determined that the predetermined condition is satisfied. If it is detected that the predetermined operation has been performed, it is determined that the predetermined condition is not satisfied. The predetermined operation here is, for example, an operation that is indispensable before fuel supply for safety. The predetermined operation is, for example, an operation of touching the static elimination sheet 210 attached to the fuel supply device 20. For example, the analysis unit 102 analyzes the image, detects that the user in the image has touched the electrostatic removal sheet 210, and when it is detected that the user has touched the electrostatic removal sheet 210, a predetermined condition is not satisfied. If it is determined that the touch has not been detected, it is determined that a predetermined condition is satisfied. The analysis unit 102 may continue to determine that a predetermined condition is satisfied, for example, until it is detected that the electrostatic removal sheet 210 has been touched. In addition, when a predetermined operation such as touching a nozzle or the like called a gun nozzle for supplying fuel or the like is detected before it is detected that the electrostatic removal sheet 210 is touched, a predetermined operation is performed. It may be determined that the condition is satisfied. In addition, when the detection target of the analysis unit 102 is an operation that only needs to be performed once, such as a touch on the electrostatic removal sheet 210, the analysis unit 102 may detect the operation after detecting the operation once. Is stored in a storage unit or the like (not shown). In the subsequent process of detecting the same operation, if the information of this flag can be detected, the operation is performed based on the image received by the acquired information receiving unit 101. Even if the detection of is not performed, a determination result that the user's operation in the image satisfies a predetermined condition is obtained.

  The analysis unit 102 analyzes, for example, the image received by the acquisition information reception unit 101, determines whether the user in the image has performed a predetermined operation, and has performed the predetermined operation. If it is detected, it may be determined that the predetermined condition is satisfied, and if it is not detected that the predetermined operation has been performed, it may be determined that the predetermined condition is not satisfied. For example, the analyzing unit 102 determines whether the user has performed an operation for supplying fuel (for example, refueling) to a part other than the moving body, and has performed the operation for supplying fuel to a part other than the moving body. May be determined to satisfy the predetermined condition, and if not detected, it may be determined that the predetermined condition is not satisfied. The operation for supplying fuel to a part other than the moving body is, for example, an operation for supplying fuel such as gasoline to the plastic tank. For example, whether the destination of the fuel nozzle is a position overlapping the moving body is determined. By detecting from the image, it is possible to detect whether or not the fuel supply to the moving body. Alternatively, the analysis unit 102 may detect a plastic tank in the image, and if it can detect the plastic tank, may determine that the fuel supply is to a non-mobile body.

  The analysis unit 102 determines whether the combination of the image analysis result and information detected by another sensor or the like (not shown) provided in the fuel supply device 20 satisfies a predetermined condition. May be determined. For example, the analysis unit 102 detects, from the image, a predetermined operation in which the user supplies fuel to the moving body (for example, an operation of inserting a nozzle or the like of a fuel supply device into a fuel supply port of the moving body). When the detection is performed after the pressure sensor (not shown) provided on the static electricity removing sheet 210 detects the pressure by the user's touch, it is determined that the predetermined condition is not satisfied, and the safety assurance process is performed. If the above operation is detected in a state where the pressure sensor (not shown) provided on the static elimination sheet 210 does not detect the pressure by the user's touch, a predetermined condition is set. It may be determined that the condition is satisfied and the security guarantee processing may be performed.

  The analysis unit 102 may, for example, analyze the image received by the acquisition information receiving unit 101 and determine whether the user in the image is a registered user. The registered user is, for example, a user registered as a member of a specific organization. A member of a specific organization is, for example, a member of a specific society. The specific meeting is, for example, a meeting for customers operated by a service provider such as a gas station. For example, the analysis unit 102 acquires information on the feature points of the user's face from the image received by the acquisition information receiving unit 101, and stores one or more registered feature points of the user's face stored in advance. From the information, a user whose feature point matches the acquired information of the feature point is detected. The information on the feature points of the user to be acquired is, for example, information on predetermined feature points. Here, in the case where it is determined whether or not the user is a registered user, using information on feature points of one or more registered faces of the user stored in advance in the user recognition information storage unit 103 described later Will be described. For example, the analysis unit 102 acquires information on feature points of the user's face from the image received by the acquisition information reception unit 101, and stores one or more registered users stored in the user recognition information storage unit 103. From the information on the feature points of the face, information on the feature points that match the acquired information on the feature points is detected. If the information is detected, it is determined that the user is a registered user. When the user is a registered user, the analysis unit 102 acquires, for example, a user identifier associated with the user as an analysis result. For example, when the information on the feature point that matches the information on the feature point acquired from the image is detected from the information on the feature point stored in the user recognition information storage unit 103, the analysis unit 102 The user identifier stored in the user recognition information storage unit 103 in association with the user identification information may be acquired. The user identifier may be, for example, a member number of the user, a unique character string assigned to the user, or a mail address of the user. Here, the match of the information of the feature points may be a perfect match or a partial match (for example, a match equal to or more than a threshold). Note that the process of recognizing a registered user is a well-known technique in face authentication processing and the like, and a detailed description thereof will be omitted here. However, the processing of determining whether or not a registered user is performed by the analysis unit 102 is not limited to the above processing.

  In addition, the analysis unit 102 may analyze an image, for example, and acquire, as an analysis result, an attribute value regarding the user in the image received by the acquisition information receiving unit 101. The attribute value relating to the user is, for example, a value indicating the gender of the user, the age or age group of the user, and the like. For example, the analysis unit 102 obtains information on the user's characteristic points regarding the user's face, body shape, and the like from the image received by the obtained information reception unit 101, and obtains an attribute value related to the user using the obtained information. For example, the analysis unit 102 acquires an attribute value related to the user using information on feature points acquired from an image using a technique such as SVM, SVR, deep learning, decision tree, or machine learning such as random forest. . For example, the analysis unit 102 uses the learning data obtained by learning in advance the feature point information of a plurality of users acquired from the image and the attribute values relating to each of the plurality of users, and uses the learning data of the feature points acquired from the image. Get the attribute value of the user from the information. The learning data may be stored in advance in, for example, a storage unit (not shown). Note that the processing of acquiring the user's gender, age, and the like from the information on the user's feature points by machine learning or the like is a known technique, and thus a detailed description is omitted here. Note that the process in which the analysis unit 102 acquires the attribute value related to the user is not limited to the above process.

  The user recognition information storage unit 103 stores information on feature points of one or more user's faces. The one or more users are, for example, users registered in advance as members or the like. Here, as an example, the user recognition information storage unit 103 stores one or more pieces of user recognition information having feature point information of a user's face registered in advance as a member or the like and a user identifier of the user. Will be described. For example, the analysis unit 102 described above detects user recognition information having a feature point that matches a feature point acquired from an image from the user recognition information stored in the user recognition information storage unit 103, and detects the detected user recognition information. Get the user identifier that has. The analysis unit 102 is registered in the user recognition information storage unit 103 in such a manner that an image of the user's face or the like is stored instead of information on one or more feature points of the user's face. When detecting a user or the like, information on feature points of the user's face may be obtained from the stored face image.

  The user recognition information storage unit 103 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium. The same applies to other storage units.

  The processing unit 104 performs a process according to the analysis result of the analysis unit 102. For example, when the analyzing unit 102 determines that the predetermined condition is satisfied, the processing unit 104 performs a security securing process for securing safety as a process according to the analysis result. For example, when the analyzing unit 102 determines that the predetermined condition is satisfied as a result of performing the above-described determinations (1) to (3), the processing unit 104 responds to the analysis result. As a process, a security securing process for securing security may be performed. The security ensuring process is, for example, a process for ensuring safety when fuel is supplied using the fuel supply device 20. The security securing process is, for example, outputting a warning for securing security. The warning here may be considered as information for outputting a warning. The warning is, for example, information notifying that the fuel supply cannot be performed, information notifying the prohibition of the fuel supply, and notification of what points need to be improved in order to perform the fuel supply. It may be information. The warning here may be a warning sound, a warning sound output, or a warning text or image output. For example, the warning may be different depending on the determination results of the above (1) to (3). The output of the warning here may be output by the information processing device 10 or may be output by the fuel supply device 20. For example, the processing unit 104 may output an instruction or the like to output a desired warning to the fuel supply device 20. The output here may be a transmission via a network or the like.

  Further, the security ensuring process may be a control process for prohibiting fuel supply. The control process for inhibiting fuel supply is, for example, a process for controlling the fuel supply device 20 to inhibit fuel supply. The control process of prohibiting fuel supply may be a control process of not accepting an operation for supplying fuel, or a control process of not supplying fuel even if an operation of supplying fuel is received. You may. For example, the processing unit 104 may output a control instruction to prohibit fuel supply to the fuel supply device 20. The output here may be a transmission via a network or the like.

  Note that, after performing the security securing process, when the analysis unit 102 detects that the predetermined condition is not satisfied, the processing unit 104 may end or cancel the security securing process. Good. For example, control for terminating the output of a warning or terminating prohibition of fuel supply may be performed. For example, the processing unit 104 may transmit to the fuel supply device 20 an instruction to end the output of the warning or a control instruction to end the prohibition of the fuel supply.

  Note that the output here is a concept including display on a monitor, sound output, transmission to an external device, delivery of a processing result to another processing device, another program, or the like. The user information output unit 106 may or may not include an output device such as a monitor or a speaker. The output unit can be realized by driver software for an output device, or driver software for an output device and an output device.

  The user information storage unit 105 stores user information. The user information is information on the registered user as described above. For example, the user information is information on a user who is a member belonging to a specific organization. The user information may be, for example, information on benefits such as points and coupons possessed by the user, and the user information may be information on the user's name, age, gender, address, etc. Information indicating a class, a class, or the like in a specific organization may be used. The user information may include these two or more pieces of information. The user information is stored in the user information storage unit 105, for example, in association with the user identifier of the corresponding user.

  The user information output unit 106 uses the user identifier acquired as an analysis result by the analysis unit 102 to acquire and output the user information associated with the user identifier from the user information storage unit 105. The output here is a concept including display on a monitor, sound output, transmission to an external device, delivery of a processing result to another processing device, another program, or the like. For example, the user information output unit 106 detects a user identifier that matches the obtained user identifier from among the user identifiers stored in the user information storage unit 105, and detects the user information associated with the detected user identifier. Read and output. For example, the user information output unit 106 transmits the obtained user information to the fuel supply device 20.

  The user information output unit 106 may or may not include an output device such as a monitor or a speaker. The output unit can be realized by driver software for an output device, or driver software for an output device and an output device.

  The acquisition unit 107 acquires supply-related information related to fuel supply performed by the fuel supply device 20. The supply-related information is, for example, the date and time when the fuel supply was performed, information indicating the amount of supplied fuel, information on the charge of the supplied fuel, information indicating the type of fuel, and the like. For example, the acquisition unit 107 acquires the supply-related information output by the fuel supply device 20. For example, the acquisition unit 107 receives supply-related information transmitted by the fuel supply device 20. The obtaining unit 107 may include, for example, a receiving unit that receives information.

  The supply-related information storage unit 108 stores the supply-related information in association with the analysis result of the image acquired by the analysis unit 102.

  The analysis accumulation unit 109 accumulates the analysis result acquired by the analysis unit 102 and the supply-related information acquired by the acquisition unit 107 in association with each other. The analysis result here may be, for example, the user identifier acquired by the analysis unit 102 or an attribute value related to the user, or both.

  The attribute correspondence information storage unit 110 stores one or more pieces of attribute correspondence information. The attribute correspondence information is stored in the attribute correspondence information storage unit 110 in association with the attribute value of the user. The attribute correspondence information stored in the attribute correspondence information storage unit 110 in association with one attribute value is information associated with this attribute value. The attribute correspondence information associated with one attribute value is information that is preferably or is required to be provided to a user having this attribute value. The attribute correspondence information is, for example, an advertisement. For example, the attribute correspondence information associated with one attribute value is an advertisement desired to be provided to a user having this attribute value. The advertisement here may be an advertisement of text data, an advertisement of a still image or a moving image, or an advertisement of a sound, and the type of the data is not limited. Further, the attribute correspondence information associated with one attribute value may be privilege information such as a coupon, a prize or a service voucher which is desired to be provided to a user having this attribute value. The coupon may be, for example, a coupon code or the like.

  The attribute correspondence output unit 111 acquires and outputs attribute correspondence information according to the attribute value of the user acquired by the analysis unit 102. For example, the attribute correspondence output unit 111 outputs, from the attribute correspondence information storage unit 110, the attribute correspondence information stored in association with the attribute value of the user acquired by the analysis unit 102 and the attribute value having a predetermined relationship. Get and output. The predetermined relationship may be, for example, a relationship of matching. For example, the attribute correspondence output unit 111 acquires and outputs, from the attribute correspondence information storage unit 110, the attribute correspondence information accumulated in association with the attribute value that matches the user attribute value acquired by the analysis unit 102. The match here may be a perfect match or a partial match. Further, the predetermined relation may be a relation that is in an inclusion relation. The output here is a concept including display on a monitor, sound output, transmission to an external device, delivery of a processing result to another processing device, another program, or the like. For example, the attribute correspondence output unit 111 transmits the acquired attribute correspondence information to the fuel supply device 20.

  The attribute corresponding output unit 111 may or may not include an output device such as a monitor or a speaker. The output unit can be realized by driver software for an output device, or driver software for an output device and an output device.

  The camera 201 is a sensor included in the fuel supply device 20. The camera 201 captures an image. For example, the camera 201 is a camera having an image pickup device such as a CCD (Charge Coupled Device) or a CMOS (Complementary MOS) and an optical system such as a lens. The camera 201 is, for example, a camera having sensitivity to visible light. However, a camera having sensitivity to infrared rays may be used. The camera 201 is provided, for example, at a position where a user who supplies fuel can capture an image of the user. The camera 201 is usually provided in front of the fuel supply device 20, and photographs a user located in front. The front surface of the fuel supply device 20 is a surface provided with, for example, an interface (not shown) for receiving an order of supplied fuel and the like. The image captured by the camera 201 is usually a moving image, but may be a still image continuously captured at fixed or undefined timing.

  The direction of the optical axis of the camera 201, the mounting position, the angle of view, the number of pixels, the image to be captured may be color or monochrome, and so on. The camera 201 is preferably mounted at a position where, for example, a user standing in front of the fuel supply device 20 can be photographed in order to supply fuel. Further, the camera 201 preferably has an angle of view, an optical axis direction, the number of pixels, and the like at which an image usable for analysis performed by the analysis unit 102 can be captured. For example, when the analysis unit 102 specifies a user by analysis from the user's face, the camera 201 is attached to the fuel supply device 20 so as to have an optical axis direction and an angle of view such that the user's face can be photographed. Is preferred. The camera 201 is preferably a camera provided with, for example, a wide-angle lens or a fisheye lens. When the analysis unit 102 analyzes whether or not the user has touched the static elimination sheet 210, the camera 201 sets the fuel axis direction and the angle of view so that the static elimination sheet 210 can be photographed. Preferably, it is attached to the supply device 20. The timing at which the camera 201 starts capturing an image does not matter. For example, the camera 201 may always shoot an image, or may start shooting when a user operates a touch panel 2071 or the like described later. The fuel supply device 20 generally has one camera 201, but may have a plurality of cameras. In addition, the camera 201 may transfer an image in which the angle of view or the like of the captured image is adjusted to an acquisition information output unit 202 described later. Note that the camera 201 may be a camera that captures a distance image using a distance image sensor (not shown).

  The acquired information output unit 202 outputs the acquired information acquired by the sensor of the fuel supply device 20 to the information processing device 20. Here, an example in which the acquired information output unit 202 outputs an image captured by the camera 201 as a sensor to the information processing apparatus 10 will be described. The output here may be a transmission. For example, the acquisition information output unit 202 transmits an image captured by the camera 201 to the information processing device 10. It is preferable that the acquisition information output unit 202 outputs an image captured by the camera 201 so that a time lag does not occur as much as possible. For example, the acquisition information output unit 202 is realized by a wireless or wired communication unit.

  The receiving unit 203 receives information output from the information processing device 10. The receiving unit 203 receives, for example, a warning output from the information processing apparatus 10, a control instruction for prohibiting fuel supply, user information, and attribute correspondence information. The reception here may be reception. The receiving unit 203 receives, for example, a warning transmitted by the processing unit 104. In addition, the reception unit 203 receives, for example, a control instruction transmitted from the processing unit 104 for prohibiting fuel supply. In addition, the receiving unit 203 receives, for example, the user information transmitted by the user information output unit 106. The receiving unit 203 receives, for example, the attribute correspondence information transmitted by the attribute correspondence output unit 111. For example, the reception unit 203 is realized by a wireless or wired communication unit.

  The supply device 204 performs a process of supplying fuel and the like. The supply device 204 includes, for example, a fuel tank (not shown), a supply pipe serving as a fuel path communicating with the fuel tank, a pump provided in the middle of the supply pipe for supplying fuel, a fuel pulse generator, and the like. , Etc. are provided. A nozzle 212 is attached to the end of the supply pipe (the end opposite to the fuel tank) via a hose 211. The supply device 204 may have the same configuration as a fuel supply device for liquid fuel such as ordinary gasoline, for example. Since the configuration of the feeder 204 is known, a detailed description is omitted. The configuration of the feeder 204 is not limited to this configuration as long as fuel can be supplied.

  The fuel supply device 20 may include a payment processing unit (not shown) that performs a payment process or the like for the user. The settlement process may be considered to include, for example, a billing process. Since the settlement processing unit is known in a normal fuel supply device or the like, a detailed description thereof is omitted here.

  The control unit 205 controls the supply of fuel by the supply device 204. For example, the control unit 205 controls start and stop of fuel supply from the supply device 204. The control unit 205 controls start and stop of fuel supply from the supply device 204 in accordance with, for example, an operation received by an operation reception unit 207 described below. The control unit 205 does not supply the fuel according to the control instruction for prohibiting the fuel supply received by the receiving unit 203. For example, the control unit 205 may control the operation receiving unit 207 or the like so as not to receive an operation of supplying fuel in response to a control instruction for prohibiting fuel supply. May be controlled so that the feeder 204 does not supply fuel. For example, when the supply device 204 supplies the liquid fuel from the nozzle 212, the control for not accepting the operation of supplying the fuel is performed by a lever for supplying the fuel of the nozzle 212 connected to the supply device 204. May be locked so as not to be pulled, or even if the lever is pulled, an instruction to supply fuel is not transmitted to a pump (not shown) of the feeder 204 that feeds fuel. The control for prohibiting the fuel supply is not limited to such control.

  The control unit 205 acquires the supply-related information as described above from the supply device 204 or the like. Further, the control unit 205 may control processing of another processing unit such as the camera 201 and the obtained information output unit 202. Further, the control unit 205 may control the processing of the settlement processing unit (not shown) as described above. Note that, when the receiving unit 203 receives a control instruction to end the prohibition of the fuel supply, the control unit 205 may end the prohibition of the fuel supply according to the control instruction. Ending the prohibition of fuel supply means, for example, controlling the supply device 204 to a state in which fuel can be supplied.

  The output unit 206 outputs, for example, a warning received by the reception unit 203. For example, the output unit 206 outputs the user information received by the receiving unit 203. The output unit 206 outputs, for example, attribute correspondence information such as an advertisement received by the reception unit 203. The output here may be a display, an audio output, or a combination thereof. The output unit 206 may display, for example, an operation menu screen or the like for receiving an operation on the fuel supply device 20, an operation for bill settlement, and the like. The output unit 206 performs the display using, for example, a monitor 2061 provided on the front of the fuel supply device 20. However, the display device used by the output unit 206 is not limited to the monitor 2061. When the receiving unit 203 receives an instruction to end the output of the warning by the output unit 203, the display of the warning may be ended according to the instruction.

  The operation receiving unit 207 receives an operation on the fuel supply device 20. For example, the operation receiving unit 207 may receive an operation for supplying fuel, an operation for bill payment, and the like. The operation receiving unit 207 receives an operation via an operation menu screen displayed by the output unit 206, for example. Here, a case where the operation receiving unit 207 receives an operation via the touch panel 2071 will be described as an example. However, an input device or the like for which the operation receiving unit 207 receives an operation is not limited to the touch panel 2071. For example, the operation receiving unit 207 may receive an operation via a button (not shown) or the like.

  The supply-related output unit 208 outputs the supply-related information acquired by the control unit 205 to the information processing device 10. The output here is, for example, transmission. For example, the acquisition information output unit 202 is realized by a wireless or wired communication unit.

  Next, an example of the operation of the information processing apparatus 10 will be described with reference to the flowchart in FIG.

  (Step S101) The acquisition information receiving unit 101 determines whether or not to start receiving (for example, receiving) an image captured by the camera 201. For example, the acquisition information accepting unit 101 starts accepting an image when a new image is accepted while no image is accepted. If the acquisition information accepting unit 101 determines to start accepting an image, it starts accepting images sequentially captured by the camera 201, and proceeds to step S102. If image reception is not started, the process returns to step S101.

  (Step S102) The analysis unit 102 analyzes the image received by the acquisition information reception unit 101, and determines whether the user is a registered user. If the user is a registered user, the user identifier of this user is obtained, and the process proceeds to step S103. If the user is not a registered user, the process proceeds to step S104.

  (Step S103) The user information output unit 106 acquires the user information corresponding to the user identifier acquired in Step S102 from the user information storage unit 105 and outputs it. The output here is, for example, transmission to the fuel supply device 20. Then, the process proceeds to step S105.

  (Step S104) The user information output unit 106 outputs information indicating that the user is not a registered user. The output here is, for example, transmission to the fuel supply device 20. Then, the process proceeds to step S105.

  (Step S105) The analysis unit 102 analyzes the image received by the acquisition information receiving unit 101, and obtains the attribute value of the user.

  (Step S106) The attribute correspondence output unit 111 acquires and outputs the attribute correspondence information acquired in step S105 from the attribute correspondence information storage unit 110. The output here is, for example, transmission to the fuel supply device 20.

  (Step S107) The analysis unit 102 analyzes the image received by the acquisition information reception unit 101, detects whether or not the user holds a predetermined article, and determines whether the detected result is a predetermined condition. It is determined whether or not is satisfied. For example, if it is detected that an article that is prohibited from being held at the time of fuel supply is held, it is determined that a predetermined condition is satisfied. I do. If the predetermined condition is satisfied, the process proceeds to step S108; otherwise, the process proceeds to step S111.

  (Step S108) The processing unit 104 performs a security guarantee process. For example, the processing unit 104 transmits, to the fuel supply device 20, a control instruction to prohibit fuel supply and a warning related to holding of the articles as the security ensuring process.

  (Step S109) The analysis unit 102 analyzes the image received by the acquisition information reception unit 101, detects whether or not the user holds a predetermined article, and determines whether the detection result is a predetermined condition. It is determined whether or not is satisfied. If the condition is satisfied, the process returns to step S109. If the condition is not satisfied, the process proceeds to step S110.

  (Step S110) The processing unit 104 ends the security guarantee processing. For example, the processing unit 104 transmits to the fuel supply device 20 a control instruction to end the prohibition of the fuel supply and an instruction to end the output of the warning regarding the holding of the article.

  (Step S111) The analysis unit 102 analyzes the image received by the acquisition information reception unit 101, detects the number of users, and detects whether the number of users is plural. Then, it is determined whether or not the detected result satisfies a predetermined condition. For example, if the number is plural, it is determined that the predetermined condition is satisfied. If the number is not plural, it is determined that the condition is not satisfied. If the predetermined condition is satisfied, the process proceeds to step S112; otherwise, the process proceeds to step S115.

  (Step S112) The processing unit 104 performs a security guarantee process. For example, the processing unit 104 transmits to the fuel supply device 20 a control instruction to prohibit fuel supply and a warning that a plurality of people are near the fuel supply device 20.

  (Step S113) The image received by the acquisition information receiving unit 101 is analyzed, the number of users is detected, and whether or not the number of users is plural is detected. Then, it is determined whether or not the detected result satisfies a predetermined condition. If the condition is satisfied, the process returns to step S113. If the condition is not satisfied, the process proceeds to step S114.

  (Step S114) The processing unit 104 ends the security guarantee processing. For example, the processing unit 104 transmits to the fuel supply device 20 a control instruction to end the prohibition of fuel supply and an instruction to end the output of a warning that a plurality of people are near the fuel supply device 20.

  (Step S115) The analysis unit 102 analyzes the image received by the acquisition information reception unit 101, detects whether the user has performed a predetermined operation, and the detected result satisfies a predetermined condition. It is determined whether or not. For example, when an indispensable predetermined operation is not performed at the time of fuel supply such as touching the electrostatic removal sheet 210, it is determined that a predetermined condition is satisfied, and when the operation is performed, the condition is satisfied. Judge that there is no. If the predetermined condition is satisfied, the process proceeds to step S116; otherwise, the process proceeds to step S119. When the predetermined operation is an operation that only needs to be performed once at the time of refueling, such as touching the electrostatic removal sheet 210, the analysis unit 102 may perform, for example, this step or step S117 described later. In the case where it is detected once that the user has performed a predetermined operation, information such as a flag is stored in a storage unit or the like (not shown), and in the subsequent process of step S115, the analysis unit If it is detected that the information such as the flag is stored, the 102 does not analyze the image and determines that the operation detection result does not satisfy the predetermined condition.

  (Step S116) The processing unit 104 performs a security guarantee process. For example, the processing unit 104 transmits to the fuel supply device 20 a control instruction to prohibit fuel supply and a warning that a predetermined operation has not been performed.

  (Step S117) The analysis unit 102 analyzes the image received by the acquisition information reception unit 101, detects whether the user has performed a predetermined operation, and the detected result satisfies a predetermined condition. It is determined whether or not. When the condition is satisfied, the process returns to step S117, and when the condition is not satisfied, the process proceeds to step S118.

  (Step S118) The processing unit 104 ends the security guarantee processing. For example, the processing unit 104 transmits to the fuel supply device 20 a control instruction to end the prohibition of the fuel supply and an instruction to end the output of the warning regarding that the predetermined operation is not performed.

  (Step S119) The acquisition information receiving unit 101 determines whether the reception of the image has been completed. For example, it is determined whether or not the transmission of the image from the fuel supply device 20 has been completed. If completed, the process proceeds to step S120, and if not completed, the process returns to step S107.

  (Step S120) The acquisition unit 107 determines whether supply-related information has been acquired. For example, it is determined whether or not supply related information has been received from the fuel supply device 20. If the supply-related information has been acquired (for example, if it has been received), the process proceeds to step S121, and if not, the process returns to step S120.

  (Step S121) The analysis accumulation unit 109 associates the supply-related information acquired in step S120 with one or more of the analysis results acquired in advance by the analysis unit 102 in the supply-related information storage unit 108. accumulate. The analysis result obtained above may be, for example, a user identifier or a user attribute value. Note that the analysis unit 102 may perform analysis other than the above, and the analysis result acquired by the analysis may be accumulated in the analysis accumulation unit 109 in association with the supply-related information. Then, the process returns to step S101.

  In the flowchart of FIG. 3, the order in which the analysis unit 102 performs a plurality of analyzes is not limited to the above order. For example, the processing from step S115 to step S118 may be performed before step S107.

  In the flowchart of FIG. 3, the processing is terminated by powering off or interruption for terminating the processing.

  Next, an example of the operation of the fuel supply device 20 will be described with reference to the flowchart in FIG. Here, a settlement process performed by the fuel supply device 20, a process of receiving an order related to fuel to be supplied, and the like are omitted.

  (Step S201) The camera 201 determines whether it is time to start shooting. For example, when the operation receiving unit 207 receives an operation for ordering fuel supply (for example, selecting a menu item for starting fuel supply, pressing a button, or the like), the camera 201 determines that it is time to start shooting. You may decide. In addition, when a sensor such as an infrared sensor (not shown) detects that the user is in front of the fuel supply device 20, the camera 201 may determine that it is time to start shooting. If it is time to start shooting, the process proceeds to step S202. If it is not the time to start shooting, the process returns to step S201.

  (Step S202) The camera 201 starts shooting and acquires an image. The camera 201 acquires a moving image by, for example, continuously photographing.

  (Step S203) The acquisition information output unit 202 outputs the image captured by the camera 201 to the information processing device 10. The output here is, for example, transmission.

  (Step S204) The receiving unit 203 determines whether the user information has been received from the information processing apparatus 10 (for example, whether or not it has been received). If the request has been received, the process proceeds to step S205, and if not, the process proceeds to step S206.

  (Step S205) The output unit 206 outputs the user information received in step S204. For example, the output unit 206 may display the user information on the monitor 2061, and may output the user information from a speaker (not shown) or the like. Then, the process proceeds to step S207.

  (Step S206) The receiving unit 206 determines whether or not information indicating that the user is not a registered user has been received from the information processing apparatus 10 (for example, whether or not it has been received). If accepted, the process proceeds to step S207; otherwise, the process returns to step S206.

  (Step S207) The receiving unit 203 determines whether or not the attribute correspondence information has been received (received) from the information processing apparatus 10. If accepted, the process proceeds to step S208; otherwise, the process returns to step S207.

  (Step S208) The output unit 206 outputs the attribute correspondence information received in Step S207. For example, the output unit 206 outputs the image or sound of the advertisement, which is the received attribute correspondence information, from the monitor 2061, a speaker (not shown), or the like.

  (Step S209) The receiving unit 203 determines whether a control instruction to prohibit fuel supply and a warning have been received. For example, it is determined whether a control instruction to prohibit fuel supply and a warning have been received from the information processing device 10. If it has been received (for example, if it has been received), the process proceeds to step S210; otherwise, the process proceeds to step S214.

  (Step S210) The control unit 205 controls prohibition of fuel supply in accordance with the control instruction received in step S209. For example, control may be performed so that the operation receiving unit 207 or the like does not receive an operation of supplying fuel, and even if the operation of supplying fuel is received, the supply device 204 or the like is controlled so that the supply device 204 does not supply fuel. May be. The control instruction and the warning to prohibit the fuel supply accepted here may be output in any of steps S108, S112, and S116 described in FIG.

  (Step S211) The output unit 206 outputs the warning received in step S209.

  (Step S212) The receiving unit 203 determines whether a control instruction to end the prohibition of the fuel supply and an instruction to end the output of the warning have been received (for example, whether or not the instruction has been received from the information processing apparatus 10). . If not received, the process returns to step S212, and if received, the process proceeds to step S213.

  (Step S213) In response to the control instruction received in step S212, the control unit 205 ends the control of prohibiting the fuel supply performed in step S210, and makes the fuel supply possible. For example, when the fuel supply is interrupted by the control for inhibiting the fuel supply during the supply of the fuel, the fuel supply can be restarted. Further, the output unit 206 ends the output of the warning performed in step S210 according to the instruction received in step S212. Then, the process returns to step S209.

  (Step S214) The operation receiving unit 207 determines whether or not an operation for supplying fuel has been received from the user. The operation of supplying fuel is, for example, an operation of gripping a lever (not shown) for supplying fuel provided in the nozzle 212. If received, the process proceeds to step S214; otherwise, the process returns to step S209. Here, also in the case where the operation of supplying fuel has already been received from the user, or the case where the operation of supplying fuel has already been received and the supply of fuel has been performed, the operation of supplying fuel has been received here. You may judge that.

  (Step S215) The supply device 204 supplies the fuel.

  (Step S216) The supply device 204 determines whether or not to end the fuel supply. For example, when a predetermined amount of fuel is supplied, the fuel supply ends. If the processing is to be ended, the process proceeds to step S216.

  (Step S217) The camera 201 ends the shooting. Further, the acquisition information output unit 202 ends the output of the image.

  (Step S218) The supply-related output unit 208 acquires the supply-related information from the control unit 205, and outputs (for example, transmits) the information to the information processing apparatus 10. Then, the process returns to step S201.

  In the flowchart of FIG. 4, the processing is terminated by powering off or interruption for terminating the processing.

(Concrete example)
Hereinafter, a specific operation of the fuel supply system 1 according to the present embodiment will be described using an example. Here, an example will be described in which the fuel supply device 20 is capable of supplying regular gasoline, high-octane gasoline called so-called high-octane gasoline, and light oil.

  It is assumed that a user parks a vehicle, which is a moving body, in front of the fuel supply device 20, gets off the vehicle, and stands in front of the fuel supply device 20 to supply gasoline. Then, it is assumed that a menu button for ordering refueling displayed on monitor 2061 is pressed via touch panel 2071 in order to perform refueling. When the operation receiving unit 207 receives this operation, the camera 201 determines that it is time to perform shooting, and starts shooting the user in front of the fuel supply device 20. The acquisition information output unit 202 sequentially transmits the moving images acquired by the camera 201 to the information processing device 10. Here, it is assumed that the camera 201 has a wide-angle lens (not shown).

  When an image is transmitted from the fuel supply device 20, the acquired information receiving unit 101 of the information processing device 10 starts receiving the image.

  FIG. 5 is a user recognition information management table for managing the user recognition information stored in the user recognition information storage unit 103. The user recognition information management table has attributes of “user ID” and “feature point”. The “user ID” is a user identifier, and is, for example, a member number of the user here. The “feature point” is information of a feature point of the user's face, and here, indicates a file name of a file in which information of a plurality of feature points is stored. It is assumed that each record (row) of the user recognition information management table is user recognition information corresponding to each user. This user recognition information management table includes a user identifier of a user registered in advance as a member of a membership system operated by a company that provides refueling using the fuel supply device 20, and information on feature points of the face of the user. It is assumed that user recognition information is managed.

  FIGS. 6A to 6D are diagrams illustrating one frame of an image received by the acquisition information receiving unit 101, for describing the analysis performed by the analyzing unit 102. It is assumed that a dome-shaped electrostatic removal sheet 210 is shown in each image.

  FIG. 7 is a diagram showing a user information management table for managing user information stored in the user information storage unit 105. The user information management table has attributes of “user ID” and “user information”. “User information” further has attributes of “number of points” and “name”. The “user ID” is the same as the “user ID” in FIG. “User information” is user information. The “point number” is the number of points that the user has. The number of points is, for example, a value of points that can be used for discounting the payment of a fee generated for refueling, or a value of points that can be exchanged for goods. “Name” is the name of the user. Here, the user information is composed of a point number and a name.

  FIG. 8A is a diagram illustrating a display example of the user information by the output unit 206, and FIG. 8B is a diagram illustrating a display example of the attribute correspondence information by the output unit 206.

  The analysis unit 102 analyzes the image received by the acquisition information receiving unit 101 and determines whether the user photographed in the image is a registered user. For example, assuming that the image received by the acquisition information receiving unit 101 is an image as shown in FIG. 6A, the analyzing unit 102 first recognizes the user's face 61, and starts from the recognized user's face 61. Acquires information on a plurality of feature points. Then, among the records of the user recognition information management table shown in FIG. 5, the plurality of feature points of the file indicated by the attribute value of “feature point” match the plurality of feature points acquired from the user's face 61. To find the record to do. Here, when the ratio of a plurality of feature points equal to or greater than a preset threshold value matches (for example, the feature points match 90% or more), the plurality of feature points acquired from the face and the “ It is determined that a plurality of feature points of the file indicated by the attribute value of “feature point” match. Then, when a matching record is detected, the analysis unit 102 acquires the attribute value of the “user ID” of the detected record. Here, it is assumed that a record in which the information of the “feature points” matches is detected, and that the analysis unit 102 acquires “M1003” that is the “user ID” of the record.

  The user information output unit 106 determines from the record (row) of the user information management table shown in FIG. 7 that the attribute value of “user ID” is “M1003” which is the “user ID” acquired by the analysis unit 102 as described above. Is detected, and "750" which is an attribute value of "point number" of the detected record and "Kimura Csuke" which is an attribute value of "name" are obtained. Then, the user information output unit 106 transmits the acquired user information of the point number “750” and the name “Kimura C assistant” to the fuel supply device 20.

  The reception unit 203 of the fuel supply device 20 receives the point number “750” and the name “Kimura C assistant” from the information processing device 10 as the user information. The output unit 206 displays the received number of points and the name on the monitor 2061 as shown in FIG. The received information is displayed, for example, in a template or the like prepared in advance. In this manner, the user's face can be automatically recognized, and the user information can be displayed on the monitor 2061 of the fuel supply device 20.

  In the case where a record in which the information of the "feature point" matches in the user recognition information management table cannot be detected and it cannot be determined that the user is a registered user, the processing for acquiring the user information or the like as described above is not performed .

  Next, the analysis unit 102 acquires the attribute value of the user from the feature points of the user's face acquired from the image as described above, using learning data stored in advance in a storage unit (not shown) or the like. Here, information indicating gender and age group is acquired as attribute values. The learning data used here is, for example, learning data of the feature points of each user's face acquired from a plurality of users, the gender of each user, and the age of each user. It is assumed that the analysis unit 102 has acquired information of gender "male" and age group "40s" as attribute values.

  FIG. 9 is a diagram showing an attribute correspondence information management table for managing the attribute correspondence information stored in the attribute correspondence information storage unit 110. The attribute correspondence information management table has attributes of “sex”, “age group”, and “attribute correspondence information”. “Sex” is the gender of the user, “age” is the age of the user, and “attribute corresponding information” is the information of the advertisement. Here, the file name of the moving image of the advertisement is shown. The advertisement information indicated by the “attribute correspondence information” is assumed to be advertisement information targeted at users of the gender and the age group indicated by the “gender” and “age group” of the same record.

  FIGS. 10A to 10C are display examples of warnings output by the output unit 206.

  The attribute correspondence output unit 111 detects a record in which the attribute value of “sex” is “male” and the attribute value of “age” is “forties” in the attribute correspondence information management table shown in FIG. , "M40.mp4" which is the attribute value of the "attribute correspondence information" of the detected record. Then, a file of the moving image of the advertisement whose file name is “m40.mp4”, which is the attribute correspondence information, is acquired, and the acquired file is transmitted to the fuel supply device 20.

  When the receiving unit 203 of the fuel supply device 20 receives the moving image file whose file name is “m40.mp4”, which is the attribute correspondence information, the output unit 206 outputs the moving image file as shown in FIG. Is displayed on the monitor 2061 of the fuel supply device 20. As a result, a moving image of an advertisement suitable for the user's gender and age group is displayed on the monitor 2061.

  Here, for example, the operation reception unit 207 of the fuel supply device 20 receives the operation for ordering refueling as described above and then ends the output of the advertisement as the attribute correspondence information. It is assumed that an operation for designating the type of refueling, the amount of refueling, an operation for paying a fee, etc. has been received. Then, it is assumed that, in response to the reception of this operation, the fuel supply device 20 is in a state where refueling can be performed in response to the operation of the lever (not shown) of the nozzle 212 by the user. The reception of the operation for designating the type of refueling and the amount of refueling here may be performed by, for example, a menu screen or the like for receiving the type of refueling, the amount of refueling, and the payment method displayed on the monitor 2061 by the output unit 206. What should I do?

  The analysis unit 102 of the information processing device 10 analyzes the image received by the acquisition information reception unit 101 and performs a process of detecting that the user is holding a predetermined article. Here, it is assumed that the predetermined article is cigarette. That is, the analysis unit 102 performs a process of detecting that the user is holding a cigarette. Here, for example, assuming that the image received by the acquisition information receiving unit 101 is the image shown in FIG. 6A as described above, the analysis unit 102 performs image recognition in this image, Perform processing to detect tobacco. When no cigarette is detected, the analysis unit 102 determines that the predetermined condition is not satisfied with respect to the fact that the user holds the predetermined article. For example, in FIG. 6A, since no tobacco is detected, the analysis unit 102 determines that the predetermined condition is not satisfied. For this reason, the processing unit 104 does not perform the security guarantee processing. Then, the analysis unit 102 analyzes the number of people as described later.

  Here, if the image received by the acquisition information receiving unit 101 is an image as shown in FIG. 6B, and if the cigarette 62 is detected from the image by image recognition, the analyzing unit 102 It is determined that a predetermined condition is satisfied with respect to holding a predetermined article. For this reason, the processing unit 104 transmits, to the fuel supply device 20, a control instruction to prohibit refueling and a warning about holding cigarettes as the security ensuring process. The warning about holding cigarettes is, for example, information on the text of a warning that the user cannot refuel because of holding cigarettes and that the user is required to discard the cigarettes. This warning is assumed to be stored in advance in a storage unit (not shown).

  When the receiving unit 203 of the fuel supply device 20 receives the control instruction to prohibit refueling and the warning transmitted by the processing unit 104 of the information processing device 10, the control unit 205 of the fuel supply device 20 transmits the received control instruction. Is controlled so that the feeder 204 does not supply fuel. Specifically, even if the lever (not shown) for refueling provided in the nozzle 212 of the fuel supply device 20 is grasped, the supply device 204 is controlled so that fuel cannot be supplied from the nozzle 212. For example, even if a lever (not shown) for refueling is gripped, control is performed so that a pump (not shown) for supplying fuel from the feeder 204 does not operate.

  Further, the output unit 206 displays the warning received by the reception unit 203 on the monitor 2061 as shown in FIG.

  When the analysis unit 102 of the information processing apparatus 10 once detects that a cigarette which is a predetermined article is held, the analysis unit 102 analyzes the image received by the acquisition information receiving unit 101 again, and The process of detecting holding is repeatedly performed until it is no longer detected that a predetermined article is held. As a result, while the user holds the predetermined item of cigarette, the security ensuring process is continued. When the analysis unit 102 no longer detects that the user is holding a cigarette, the analysis unit 102 determines that the predetermined condition is not satisfied. In response to this determination, processing unit 104 transmits to fuel supply device 20 a control instruction to end refueling prohibition and an instruction to end warning output. Then, the analysis unit 102 performs an analysis on the number of people.

  When the receiving unit 203 of the fuel supply device 20 receives a control instruction to end prohibition of refueling and an instruction to end output of a warning transmitted by the processing unit 104 of the information processing device 10, the control unit of the fuel supply device 20 The control unit 205 terminates the prohibition of refueling by the supply unit 204 in response to the received control instruction, and controls the refueling state. The output unit 206 ends the output of the warning.

  As described above, when it is determined that the predetermined condition is not satisfied for the article (tobacco in this case) held by the user, the analysis unit 102 detects whether or not a plurality of persons exist in the image. Perform processing. For example, the analysis unit 102 performs face recognition on the image received by the acquisition information receiving unit 101 to detect a face, and counts the number of detected faces. Here, for example, assuming that the image received by the acquired information receiving unit 101 is the image as shown in FIG. 6A as described above, the analyzing unit 102 performs face recognition in this image to perform face recognition. Is detected, and the number of faces is counted. Then, when only one face is detected, the analysis unit 102 determines that only a plurality of persons are detected, and determines that the predetermined condition regarding the number of persons is not satisfied. For example, in FIG. 6A, since only one face is detected, it is determined that the analysis unit 102 does not satisfy the predetermined condition. For this reason, the processing unit 104 does not perform the security guarantee processing. Then, the analysis unit 102 analyzes the operation of the user as described later.

  Here, suppose that the image received by the acquisition information receiving unit 101 is an image as shown in FIG. 6C, and that the face 61 and the face 63 are detected from the image by image recognition. By counting the number, the analysis unit 102 determines that a plurality of persons have been detected. For this reason, the analysis unit 102 determines that the predetermined condition is satisfied for the number of people. For this reason, the processing unit 104 transmits, to the fuel supply device 20, a control instruction to prohibit refueling and a warning about the presence of a plurality of persons as the security ensuring process. It is assumed that the warning about the existence of a plurality of persons is, for example, information of text indicating that refueling cannot be performed due to the presence of a plurality of persons, and a text requesting the user to refuel alone. This warning is assumed to be stored in advance in a storage unit (not shown).

  When the receiving unit 203 of the fuel supply device 20 receives the control instruction to prohibit refueling and the warning transmitted by the processing unit 104 of the information processing device 10, the control unit 205 of the fuel supply device 20 transmits the received control instruction. Is controlled so that the feeder 204 does not supply fuel. Further, the output unit 206 displays the warning received by the reception unit 203 on the monitor 2061 as shown in FIG.

  When the analysis unit 102 of the information processing apparatus 10 once detects that a plurality of people are present, the analysis unit 102 analyzes the image received by the acquisition information reception unit 101 and allows the user to detect the presence of the plurality of people. Is repeated until the presence of a plurality of persons is no longer detected. As a result, while a plurality of persons are present, the security guarantee processing is continued. Then, when the analyzing unit 102 does not detect the presence of a plurality of persons, the analyzing unit 102 determines that the predetermined condition is not satisfied. In response to this determination, processing unit 104 transmits to fuel supply device 20 a control instruction to end refueling prohibition and an instruction to end warning output. Then, the analysis unit 102 analyzes the operation of the user.

  When the receiving unit 203 of the fuel supply device 20 receives a control instruction to end prohibition of refueling and an instruction to end output of a warning transmitted by the processing unit 104 of the information processing device 10, the control unit of the fuel supply device 20 The control unit 205 terminates the prohibition of refueling by the supply unit 204 in response to the received control instruction, and controls the refueling state. The output unit 206 ends the output of the warning.

  If the presence of a plurality of persons in the image is not detected, the analysis unit 102 performs a process of detecting a user's predetermined operation. The predetermined operation here is an operation of touching the static elimination sheet 210. For example, the analysis unit 102 performs a process of detecting whether or not a user's hand has entered an area 210a in the image received by the acquisition information reception unit 101 where the electrostatic removal sheet 210 is located. For example, the intrusion of an object into the area 210a where the static electricity removing sheet 210 is located is detected, and when it is detected, whether or not the detected object is the hand of the user is determined by performing image recognition. Then, when the user's hand is touched, it is detected that the electrostatic removal sheet 210 has been touched. In other cases (for example, when the intrusion of the object into the region 210a cannot be detected, or when the intruding object is not the user's hand), the touch is not detected. For example, if the image received by the acquisition information receiving unit 101 is an image as shown in FIG. 6D, the analyzing unit 102 detects an intrusion of an object into the area 210a where the static elimination sheet 210 is located. Then, by detecting that this object is a hand, it is detected that the user has touched the electrostatic removal sheet 210. As a result, the analysis unit 102 determines that the user has touched the electrostatic removal sheet 210, and determines that the operation of the user does not satisfy the predetermined condition. For this reason, the processing unit 104 does not perform the security guarantee processing. Then, as described later, a determination process is performed to determine whether or not the image receiving unit 210 has received an image. Note that once the touch on the static elimination sheet 210 is once detected, the analysis unit 102 does not detect whether the user has touched the static elimination sheet 210 and the operation of the user is determined in advance. It is determined that the condition is not satisfied.

  Here, for example, if the image received by the acquisition information receiving unit 101 is an image as shown in FIG. 6A, no object has entered the area 210 a where the static elimination sheet 210 is located. The analysis unit 102 determines that the user has not touched the static elimination sheet 210, and determines that the predetermined condition for the user's operation is satisfied. For this reason, the processing unit 104 performs a security guarantee process. The processing unit 104 transmits, to the fuel supply device 20, a control instruction to prohibit refueling and a warning that the electrostatic removal sheet 210 has not been touched, as the safety ensuring process. The warning about not touching the static elimination sheet 210 is, for example, information indicating that lubrication cannot be performed because the user has not touched the static elimination sheet 210, and text information requesting the user to touch the static elimination sheet 210. And This warning is assumed to be stored in advance in a storage unit (not shown).

  When the receiving unit 203 of the fuel supply device 20 receives the control instruction to prohibit refueling and the warning transmitted by the processing unit 104 of the information processing device 10, the control unit 205 of the fuel supply device 20 transmits the received control instruction. Is controlled so that the feeder 204 does not supply fuel. Further, the output unit 206 displays the warning received by the receiving unit 203 on the monitor 2061 as shown in FIG.

  When the analysis unit 102 of the information processing apparatus 10 once detects that the electrostatic removal sheet 210 has not been touched, the analysis unit 102 analyzes the image received by the acquired information reception unit 101 and The process of detecting that the user has not touched is repeatedly performed until it is detected that the user has touched the electrostatic removal sheet 210. Thus, the security ensuring process is continued until the electrostatic elimination sheet 210 is touched. Then, when the analyzing unit 102 detects that the electrostatic elimination sheet 210 has been touched, the analyzing unit 102 determines that the predetermined condition is not satisfied. In response to this determination, processing unit 104 transmits to fuel supply device 20 a control instruction to end refueling prohibition and an instruction to end warning output. Note that once the touch on the static elimination sheet 210 is once detected, the analysis unit 102 does not detect whether the user has touched the static elimination sheet 210 and the operation of the user is determined in advance. It is determined that the condition is not satisfied.

  When the receiving unit 203 of the fuel supply device 20 receives a control instruction to end prohibition of refueling and an instruction to end output of a warning transmitted by the processing unit 104 of the information processing device 10, the control unit of the fuel supply device 20 The control unit 205 terminates the prohibition of refueling by the supply unit 204 in response to the received control instruction, and controls the refueling state. The output unit 206 ends the output of the warning.

  As described above, when it is determined that the operation of the user does not satisfy the predetermined condition, the image receiving unit 210 determines whether or not the reception of the image (here, the reception of the image) has been completed. Do. The analysis unit 102 repeats the analysis of the article held by the user, the analysis of the number of people, and the analysis of the operation until the image receiving unit 210 determines that the reception of the image is completed.

  The operation receiving unit 207 of the fuel supply device 20 determines whether or not an operation of performing refueling has been received from the user in a state in which control to prohibit refueling has not been received from the control unit 205. Then, when the operation receiving unit 207 receives an operation for refueling, such as an operation of gripping the lever, via a lever for refueling the nozzle 212, the supply device 204 supplies oil from the nozzle 212.

  The reception unit 203 determines whether a control instruction and a warning to prohibit refueling have been received before or during refueling. This determination is performed until the shooting by the camera 201 ends. For example, if the receiving unit 203 receives a control instruction to prohibit refueling during refueling, the control unit 205 performs control to prohibit refueling to the feeder 204 in response to this control instruction, so that refueling is stopped. Interrupted. The output unit 206 displays the received warning. In the same manner as described above, the suspension of the refueling and the output of the warning are canceled by the reception unit 203 receiving the control instruction for ending the prohibition of the refueling and the instruction for ending the output of the warning, the refueling is resumed, and the warning The display disappears.

  The supply device 204 determines whether or not the refueling of the amount specified by the user or the like has been performed, and when determining that the specified amount has been refueled, the supply device 204 ends the refueling.

  When the supply device 204 ends the refueling, the camera 201 ends the shooting, and the image output unit 302 ends the output of the image.

  The supply-related output unit 208 obtains information such as the type of refueling such as regular and high-octane, the amount of refueling, the amount of money, the refueling start date and time, and the like from the control unit 205 as supply-related information on refueling performed by the supply device 204, The acquired supply-related information is transmitted to the information processing device 10. It is assumed that the acquired supply-related information is “high oct” indicating the type of refueling, “40.0” L indicating the refueling amount, and refueling start time “14:20”.

  When the transmission of the image from the fuel supply device 20 ends, the image receiving unit 210 of the information processing device 10 determines that the reception of the image has ended. When the image receiving unit 210 determines that the reception of the image has been completed, the acquiring unit 107 repeats the process of determining whether or not the supply-related information has been received from the fuel supply device 20. When the acquisition unit 107 receives the supply-related information, the analysis accumulation unit 109 analyzes the supply-related information received by the acquisition unit 107 and one or more predetermined analysis results of the analysis results acquired by the analysis unit 102. The results are stored in the supply-related information storage unit 108 in association with each other. Here, the user identifier “M1003” is stored in association with the analysis result. Then, the processing performed by the information processing device 10 for one refueling is completed.

  FIG. 11 is a diagram illustrating a supply-related information management table for managing the supply-related information stored in the supply-related information storage unit 108 in association with the analysis result. The supply related information management table has attributes of “supply related information” indicating supply related information and “user ID” which is a user identifier. “User ID” is one of the analysis results obtained by the analysis unit 102. The “supply-related information” further has attributes of “type”, “refueling amount”, and “time”. “Type” is the name of the type of fuel to be supplied. “Refueling amount” is the amount of refueling. “Time” is the refueling start time. Here, it is assumed that the record on the first line in FIG. 11 is the newly added supply-related information and the analysis result.

  As described above, according to the present embodiment, by performing processing in accordance with the analysis result of the image captured by the camera provided in fuel supply device 20, appropriate processing can be performed in accordance with the situation of the user who supplies fuel to the moving body. Can do it.

  For example, when the analysis result satisfies a predetermined condition, a security guarantee process is performed, and when the user is not in a safe situation, the fuel supply can be prohibited.

  In the above embodiment, the case where the information processing device 10 and the fuel supply device 20 are separate devices connected via a network has been described. However, the configuration of the information processing device 10 may be changed as appropriate. The information processing device 10 and the fuel supply device 20 may be realized by one fuel supply device. In this case, transmission and reception of information in the above embodiment may be appropriately replaced with output and input of information via a signal line, a wiring, or the like. In this case, a configuration that can be omitted, such as a configuration provided for transmitting and receiving information between the information processing device 10 and the fuel supply device 20, may be appropriately omitted. The configuration provided for transmitting and receiving information between the information processing device 10 and the fuel supply device 20 may be used as a configuration for inputting and outputting information. For example, such a fuel supply device includes a camera 201, an analysis unit 102 that analyzes an image captured by the camera 201, and a processing unit 104 that performs a process according to the analysis result of the analysis unit 102. It is.

  In the above embodiment, the case where the camera 201 having sensitivity to visible light is used as the sensor of the fuel supply device 20 has been described. However, the sensor of the fuel supply device 20 is limited to the camera 201. is not. For example, the sensor may be any sensor as long as it can obtain information that enables the analysis unit to perform one or more of the analysis described above. This sensor is preferably a sensor that acquires information about a plurality of positions of the sensing target (for example, color, luminance, distance information, and the like for the plurality of positions). Further, in the above-described embodiment, a case has been described where the analysis unit 102 analyzes an image captured by the camera 201 serving as a sensor. However, the analysis unit 102 uses the acquired information, which is information acquired by the sensor, to perform the above-described processing. What is necessary is just to perform one or more of such analysis. In this case, the portions described for the images captured by the camera 201 in the above embodiment may be appropriately replaced with the acquired information acquired by the sensor. For example, the acquired information receiving unit 102 that receives the image captured by the camera 201 may be replaced with the obtained information receiving unit 102 that receives the acquired information obtained by the sensor. Further, the analysis unit 102 that analyzes the image received by the acquisition information receiving unit 102 may be replaced with the analysis unit 102 that analyzes the acquisition information received by the acquisition information receiving unit 102.

  For example, the sensor of the fuel supply device 20 may be an infrared sensor having sensitivity to infrared rays, and the information acquired by the sensor may be an infrared image acquired by the infrared sensor. In this case, for example, an image captured by the camera 201 in the description of the above embodiment may be appropriately replaced with an infrared image. The infrared sensor here is preferably a sensor in which a plurality of photoelectric conversion elements are arranged in a plane. For example, the infrared sensor may be a so-called infrared thermography. Note that the process in which the analysis unit 102 performs the above-described analysis from the infrared image is a known technique, and thus a detailed description is omitted here. In the infrared image, since the intensity distribution of infrared rays can be known, detection of fire becomes easy. Similarly, by detecting the human body temperature and specifying the position where the human is, it becomes easy to detect the number of humans.

  Further, for example, the sensor included in the fuel supply device 20 may be a so-called infrared distance sensor that acquires a distance image using infrared rays, and the acquired information acquired by the sensor may be a distance image. In this case, for example, the image taken by the camera 201 in the description of the above embodiment may be appropriately read as a distance image. The distance image is, for example, an image in which each pixel of the image is represented by a value indicating a distance to a subject, instead of being represented by a color value. Since the distance image is a known technique, a detailed description thereof is omitted here. In addition, the process in which the analysis unit 102 performs the above-described analysis of the user's operation and the like from the distance image is a known technique, and thus a detailed description thereof is omitted here.

  Note that the sensor provided in the fuel supply device 20 may be a combination of two or more of the above sensors.

  Further, in the above embodiment, each process (each function) may be realized by centralized processing by a single device (system), or may be realized by distributed processing by a plurality of devices. May be.

  In the above-described embodiment, it goes without saying that two or more communication units (such as an image output unit and a supply-related output unit) existing in one device may be physically realized by one medium.

  Further, in each of the above embodiments, each component may be configured by dedicated hardware, or a component that can be realized by software may be realized by executing a program. For example, each component can be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. At the time of execution, the program execution unit may execute the program while accessing a storage unit (for example, a recording medium such as a hard disk or a memory).

  The software that implements the information processing device 10 in each of the above embodiments is a program as described below. That is, the program includes a computer, an acquisition information receiving unit that receives information acquired by a sensor included in the fuel supply device that supplies fuel to the moving body, and an analysis unit that analyzes the acquisition information received by the acquisition information receiving unit. And a program for functioning as a processing unit that performs a process according to the analysis result of the analysis unit.

  Note that, in the above-described program, functions realized by the program do not include functions that can be realized only by hardware. For example, functions that can be realized only by hardware such as a modem and an interface card in an obtaining unit that obtains information and an output unit that outputs information are not included in the functions realized by the above-described programs.

  The computer that executes this program may be a single computer or a plurality of computers. That is, centralized processing or distributed processing may be performed.

  FIG. 12 is a schematic diagram illustrating an example of the external appearance of a computer that executes the program and realizes the information processing apparatus and the like according to the embodiment. The above embodiment can be realized by computer hardware and a computer program executed on the computer hardware.

  12, a computer system 900 includes a computer 901 including a CD-ROM (Compact Disk Read Only Memory) drive 905, a keyboard 902, a mouse 903, and a monitor 904.

  FIG. 13 is a diagram showing the internal configuration of the computer system 900. 13, a computer 901 is connected to an MPU (Micro Processing Unit) 911, a ROM 912 for storing a program such as a boot-up program, and a MPU 911 in addition to the CD-ROM drive 905, and is connected to the MPU 911. A RAM (Random Access Memory) 913 that temporarily stores and provides a temporary storage space, a hard disk 914 that stores application programs, system programs, and data, and a bus 915 that interconnects the MPU 911, the ROM 912, and the like. Prepare. Note that the computer 901 may include a network card (not shown) that provides a connection to a LAN.

  A program that causes the computer system 900 to execute the functions of the information processing apparatus and the like according to the above-described embodiment may be stored in the CD-ROM 921, inserted into the CD-ROM drive 905, and transferred to the hard disk 914. Alternatively, the program may be transmitted to the computer 901 via a network (not shown) and stored in the hard disk 914. The program is loaded into the RAM 913 at the time of execution. Note that the program may be loaded directly from the CD-ROM 921 or a network.

  The program does not necessarily include an operating system (OS) or a third-party program that causes the computer 901 to execute the functions of the information processing apparatus and the like according to the above-described embodiment. The program may include only a part of an instruction that calls an appropriate function (module) in a controlled manner and obtains a desired result. It is well known how the computer system 900 operates, and a detailed description thereof will be omitted.

  The present invention is not limited to the embodiments described above, and various modifications are possible, and it goes without saying that they are also included in the scope of the present invention.

  As described above, the information processing apparatus and the like according to the present invention are suitable as an apparatus and the like for processing information at the time of fuel supply, and particularly as an apparatus and the like for performing processing according to the situation of a user who uses the fuel supply apparatus Useful.

DESCRIPTION OF SYMBOLS 1 Fuel supply system 10 Information processing device 20 Fuel supply device 101 Acquisition information reception part 102 Analysis part 103 User recognition information storage part 104 Processing part 105 User information storage part 106 User information output part 107 Acquisition part 108 Supply related information storage part 109 Analysis Storage unit 110 Attribute correspondence information storage unit 111 Attribute correspondence output unit 201 Camera 202 Acquisition information output unit 203 Reception unit 204 Supply unit 205 Control unit 206 Output unit 207 Operation reception unit 208 Supply-related output unit 210 Static electricity removal sheet

Claims (19)

An acquisition information receiving unit that receives acquisition information acquired by a sensor included in a fuel supply device that supplies fuel to a moving object,
An analyzing unit that analyzes the acquired information received by the acquired information receiving unit;
An information processing apparatus comprising: a processing unit that performs a process according to an analysis result of the analysis unit. The analysis unit analyzes the obtained information to determine whether or not a predetermined condition is satisfied,
The information processing apparatus according to claim 1, wherein the processing unit performs a security securing process for securing safety as a process according to the analysis result when the analyzing unit determines that the predetermined condition is satisfied. . The information processing apparatus according to claim 2, wherein the security guarantee processing includes outputting a warning. The information processing apparatus according to claim 2, wherein the security ensuring process includes a control process for prohibiting fuel supply. The said analysis part analyzes the acquired information, detects holding | maintenance of the predetermined article by the user in the obtained information, and determines that the predetermined conditions are satisfy | filled when holding is detected. 5. The information processing device according to any one of items 4 to 4. The analysis unit analyzes the obtained information, determines whether or not there are a plurality of persons in the obtained information, and determines that a predetermined condition is satisfied when it is determined that there are a plurality of persons. The information processing device according to claim 2. The analysis unit analyzes the obtained information, detects that a user in the obtained information touches the electrostatic removal sheet, and determines that a predetermined condition is satisfied when no touch is detected. Item 7. The information processing device according to any one of Items 2 to 6. An acquisition unit that acquires supply-related information related to fuel supply performed by the fuel supply device,
The information processing apparatus according to claim 1, further comprising an analysis storage unit configured to store the analysis result acquired by the analysis unit in association with the supply-related information acquired by the acquisition unit. . The analysis unit analyzes the obtained information to determine whether a user in the obtained information is a registered user or not, and when the registered user is a registered user, determines a user identifier associated with the user. The information processing apparatus according to claim 8, wherein the information processing apparatus acquires the result as an analysis result. A user information storage unit in which a user identifier of the user and user information on the user are stored in association with each other;
The user information output part which acquires and outputs the user information matched with the said user identifier from the said user information storage part using the user identifier acquired as the analysis result by the said analysis part was further provided. Information processing device. The analysis unit analyzes the acquired information, acquires an attribute value regarding the user in the acquired information as an analysis result,
The information processing apparatus according to claim 1, further comprising an attribute correspondence output unit configured to acquire and output attribute correspondence information corresponding to the attribute value acquired by the analysis unit. The information processing apparatus according to claim 11, wherein the attribute correspondence information is an advertisement. The sensor is a camera,
The information processing apparatus according to claim 1, wherein the information obtained by the sensor is an image captured by the camera. The sensor is an infrared sensor,
The information processing apparatus according to claim 1, wherein the information acquired by the sensor is an image captured by the infrared sensor. The sensor is an infrared distance sensor that acquires a distance image using infrared light,
The information processing apparatus according to any one of claims 1 to 12, wherein the information acquired by the sensor is an infrared distance image acquired by the infrared distance sensor. A fuel supply device for supplying fuel to a moving body,
Sensors and
A fuel supply device comprising: an acquisition information output unit configured to output acquisition information acquired by the sensor to the information processing device according to any one of claims 1 to 15. A fuel supply device for supplying fuel to a moving body,
Sensors and
An analysis unit for analyzing the information acquired by the sensor,
A fuel supply device comprising: a processing unit that performs a process according to an analysis result of the analysis unit. An information processing method performed using an acquisition information receiving unit, an analyzing unit, and a processing unit,
The acquisition information receiving unit receives the acquisition information obtained by a sensor included in a fuel supply device that supplies fuel to the moving object,
An analysis step in which the analysis unit analyzes the acquisition information received in the acquisition information reception step,
An information processing method comprising: a processing step in which the processing unit performs processing according to an analysis result of the analysis step. Computer
An acquisition information receiving unit that receives acquisition information acquired by a sensor included in a fuel supply device that supplies fuel to a moving object,
An analyzing unit that analyzes the acquired information received by the acquired information receiving unit;
A program for functioning as a processing unit that performs a process according to the analysis result of the analysis unit.

Images