WO2022091165A1 - 情報処理装置、情報処理方法、情報処理システム、及びコンピュータ読み取り可能な記憶媒体 - Google Patents

情報処理装置、情報処理方法、情報処理システム、及びコンピュータ読み取り可能な記憶媒体 Download PDF

Info

Publication number
WO2022091165A1
WO2022091165A1 PCT/JP2020/040030 JP2020040030W WO2022091165A1 WO 2022091165 A1 WO2022091165 A1 WO 2022091165A1 JP 2020040030 W JP2020040030 W JP 2020040030W WO 2022091165 A1 WO2022091165 A1 WO 2022091165A1
Authority
WO
WIPO (PCT)
Prior art keywords
radio wave
information
information processing
detected
wave sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2020/040030
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
純平 奥野
政弘 兼松
優介 只野
崇 栗原
啓行 秋葉
俊樹 竹内
太一 大辻
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
NEC Corp
Original Assignee
NEC Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by NEC Corp filed Critical NEC Corp
Priority to JP2022558599A priority Critical patent/JP7533610B2/ja
Priority to PCT/JP2020/040030 priority patent/WO2022091165A1/ja
Publication of WO2022091165A1 publication Critical patent/WO2022091165A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
    • G01R29/00—Arrangements for measuring or indicating electric quantities not covered by groups G01R19/00 - G01R27/00
    • G01R29/08—Measuring electromagnetic field characteristics

Definitions

  • This disclosure relates to the technology for acquiring information on radio waves.
  • Patent Document 1 a radio wave transmitted from a car equipped with a radio is detected, and if the radio wave is an illegal radio wave, the car is photographed with a camera to identify the car that transmitted the illegal radio wave.
  • the technology to be used will be disclosed.
  • Patent Document 1 it is premised that there is one automobile in the range where radio waves can be detected and the range where radio waves can be photographed. Therefore, for example, when there are a plurality of automobiles in a range in which radio waves can be detected or in a range in which radio waves can be photographed, it may be difficult to appropriately associate the detected radio waves with the automobiles.
  • the present disclosure has been made in view of the above problems, and provides an information processing device and the like capable of appropriately associating information on radio waves with a mobile body even when a plurality of mobile bodies exist.
  • One of the purposes is to do.
  • the position of a predetermined moving object among the plurality of moving objects is set as a detection range of the radio wave sensor.
  • a control means for controlling the radio wave sensor to detect a radio wave and an acquisition means for acquiring information on the radio wave detected by the radio wave sensor are provided.
  • the position of a predetermined moving object among the plurality of moving objects is set as a detection range of a radio wave sensor. Then, the radio wave sensor is controlled to detect the radio wave, and the information about the radio wave detected by the radio wave sensor is acquired.
  • the computer-readable storage medium of one aspect of the present disclosure detects the position of a predetermined moving body among the plurality of moving bodies when a plurality of moving bodies are reflected in the captured image taken by the photographing device by a radio wave sensor. It stores a program that is set as a range and causes a computer to execute a process of controlling the radio wave sensor to detect a radio wave and a process of acquiring information about the radio wave detected by the radio wave sensor.
  • FIG. 1 is a diagram schematically showing an example of the configuration of the information processing system 1000 of the first embodiment.
  • the information processing system 1000 includes an information processing device 100, a photographing device 200, and a radio wave sensor 300.
  • the information processing device 100 is connected to the photographing device 200 and the radio wave sensor 300 so as to be able to communicate with each other by wire or wirelessly.
  • the photographing device 200 and the radio wave sensor 300 may be an integrated device.
  • the information processing device 100 may be a device integrated with either or both of the photographing device 200 and the radio wave sensor 300.
  • the information processing device 100 is also connected to the storage device 400 so as to be able to communicate by wire or wirelessly.
  • the storage device 400 may be mounted on the information processing device 100.
  • the photographing device 200 is photographing a moving object.
  • the radio wave sensor 300 detects radio waves in a range including at least one mobile body.
  • the photographing device 200 and the radio wave sensor 300 may be installed at a plurality of places.
  • the moving body is, for example, a person, but the example of the moving body is not limited to this.
  • the moving body may be a vehicle or an aircraft such as a multicopter (also referred to as a multirotor helicopter or a multirotor).
  • a multicopter that a person does not board may be called a UAV (Unmanned Aerial Vehicle), a small unmanned aerial vehicle, or a drone.
  • the moving body may be a robot that operates autonomously (autonomous robot) or a robot that is remotely controlled (remotely controlled robot).
  • the photographing device 200 photographs a predetermined range and generates photographing data.
  • the range in the real space taken by the photographing apparatus 200 is also referred to as an imaging range
  • the image captured by the photographing apparatus 200 is also referred to as a captured image.
  • the captured image may be each of a plurality of frames constituting the moving image, or may be each of the still images captured at regular time intervals. If there is a moving object in the shooting range, the moving object appears in the captured image.
  • the shooting data indicates information constituting the shot image.
  • the photographing device 200 transmits the photographing data to, for example, the information processing apparatus 100.
  • the information processing apparatus 100 acquires a photographed image based on the photographed data.
  • the radio wave sensor 300 detects radio waves output from communication devices existing in a predetermined range and generates detection data.
  • the range in real space where the radio wave sensor 300 detects radio waves is also referred to as a detection range.
  • the radio wave sensor 300 can detect radio waves in a range including, for example, a shooting range.
  • the radio wave sensor 300 detects radio waves output from, for example, a communication device possessed by a person, a communication device possessed by a person in a vehicle, or a communication device mounted on a vehicle, an aircraft, or the like.
  • the detection data is information related to the radio wave detected by the radio wave sensor 300.
  • the radio wave sensor 300 transmits the detected data to the information processing device 100.
  • the information processing apparatus 100 includes a control unit 110 and an acquisition unit 120.
  • the control unit 110 sets the position of a predetermined moving object among the plurality of moving objects as the detection range of the radio wave sensor 300, and the radio wave sensor 300. Controls to detect radio waves.
  • the control unit 110 is an example of control means.
  • the control unit 110 acquires in advance the feature amount to be extracted based on the image data of another image in which a predetermined moving object is reflected, and the feature amount and the feature extracted from a plurality of moving objects appearing in the captured image. Compare with quantity.
  • the control unit 110 detects a specific moving object having a feature amount similar to the feature amount extracted based on the image data of another image among the compared feature amounts.
  • the control unit 110 acquires a position (position information) in the real space from the position on the captured image of the detected moving object, and sets the acquired position in the real space as the detection range of the radio wave sensor 300. Set.
  • the position on the captured image and the position on the real space are associated in advance.
  • the control unit 110 may calculate the position in the real space from the position of the moving body on the captured image and the size of the moving object reflected in the captured image. It should be noted that at least one of the other image in which the predetermined moving body is reflected and the feature amount extracted based on the image data of the other image may be stored in the storage device 400 in advance.
  • control unit 110 when the control unit 110 detects that a plurality of moving objects are reflected in the captured image, the control unit 110 may acquire the position of each of the moving objects in the real space. Then, the control unit 110 may set the position of each moving object in the real space in order as the detection range of the radio wave sensor 300, and control the radio wave sensor 300 to detect the radio wave in each detection range.
  • the acquisition unit 120 acquires information on the radio wave detected by the radio wave sensor 300.
  • the acquisition unit 120 may acquire the detection data as information related to radio waves from the radio wave sensor 300 controlled by the control unit 110, or may acquire the processed data of the detection data as information related to radio waves. good.
  • the acquisition unit 120 is an example of acquisition means.
  • each step of the sequence diagram and the flowchart is expressed by using the number assigned to each step as in "S101".
  • the information processing apparatus 100 has acquired a captured image.
  • FIG. 3 is a flowchart illustrating an example of the operation of the information processing apparatus 100.
  • the control unit 110 sets a predetermined position of the moving object as a detection range of the radio wave sensor, and causes the radio wave sensor to detect the radio wave (S101).
  • the acquisition unit 120 acquires information regarding the radio wave detected by the radio wave sensor (S102).
  • the information processing apparatus 100 of the first embodiment when a plurality of moving objects are reflected in the captured image captured by the photographing device, the position of a predetermined moving body among the plurality of moving objects is determined by the radio wave sensor. Set it as the detection range and let the radio wave sensor detect the radio wave. Then, the information processing apparatus 100 acquires information about the radio wave detected by the radio wave sensor. As a result, the information processing apparatus 100 can set the detection range of the radio wave sensor according to the position of the moving body, so that information on the radio wave output by the communication device of the predetermined moving body among the plurality of moving bodies can be obtained. Can be obtained. That is, the information processing apparatus 100 of the first embodiment has an effect that even when a plurality of mobile bodies exist, the information about the radio wave and the mobile body can be associated with each other.
  • FIG. 4 is a block diagram showing an example of the configuration of the information processing system 1001 according to the second embodiment.
  • the information processing system 1001 includes an information processing device 101 instead of the information processing device 100 in the first embodiment, and other than that, the information processing system 1000 described in the first embodiment. The same is true. That is, the information processing system 1001 includes an information processing device 101, a photographing device 200, and a radio wave sensor 300.
  • the description of the contents in which the configuration and operation of the information processing system 1001 shown in FIG. 4 overlaps with the description of the first embodiment will be omitted.
  • the photographing device 200 photographs an imaging range and generates imaging data.
  • the shooting data may be data in which the shot image is encoded.
  • the information processing apparatus 101 acquires a captured image by decoding the captured data received from the imaging device 200.
  • the shooting data may include information on the shooting time, information indicating the shooting location, and information for identifying the shooting device 200.
  • the photographing device 200 may be controlled by the information processing device 101.
  • the photographing apparatus 200 may change the detection range according to the instruction from the information processing apparatus 101.
  • the radio wave sensor 300 detects radio waves output from communication devices existing in the detection range and generates detection data.
  • the detection data includes information indicating the signal waveform of the detected radio wave. Further, the detection data may include information indicating the radio wave intensity of the detected radio wave.
  • the communication device that outputs radio waves is, for example, a mobile phone, a smartphone, a tablet terminal, or the like, but is not limited to this example.
  • the communication device may be a device that outputs radio waves of any communication method.
  • the radio wave detected by the radio wave sensor 300 may be, for example, a radio wave such as LTE (Long Term Evolution), wireless LAN (Local Area Network), or short-range radio wave.
  • LTE Long Term Evolution
  • wireless LAN Local Area Network
  • short-range radio wave When the communication device is a smartphone or the like, the timing at which the radio wave is transmitted is, for example, a voice call, communication by operating an application, polling communication between the communication device and the base station, and the like.
  • the radio wave sensor 300 transmits the detected data to the information processing device 101.
  • the detection data may include information indicating the time when the radio wave was detected, information indicating the location where the radio wave sensor 300 is installed, and information for identifying the radio wave sensor 300.
  • the radio wave sensor 300 may be controlled by the information processing device 101.
  • the radio wave sensor 300 may change the detection range according to an instruction from the information processing device 101.
  • the radio wave sensor 300 can detect radio waves in a range including a shooting range.
  • the range in which the radio wave sensor 300 can detect radio waves and the shooting range are associated in advance.
  • the detection range may be set in advance to include the shooting range.
  • the storage device 400 includes a mobile database 410 and a radio wave feature database 420.
  • the mobile body database 410 data in which information for identifying a mobile body and information about the mobile body are associated with each other are registered.
  • the information about the moving body is information indicating the characteristics of the moving body, such as an image showing the moving body and a feature amount extracted from the image showing the moving body.
  • information about a mobile body is also referred to as "mobile body information”.
  • FIG. 5 is a diagram showing an example of a mobile database.
  • the mobile information of "data X" is associated with the mobile of the identification information "001".
  • the mobile information is not limited to the above example.
  • the mobile information may further include personal information such as, for example, when the mobile is a person, the gender, age and address of the mobile. Further, for example, when the moving body is a vehicle, the information on the vehicle type and the license plate may be further included in the moving body information. Further, when the moving body is an aircraft or other robot, the serial number may be further included in the moving body information.
  • the mobile body registered in the mobile body database 410 is also referred to as a registered mobile body.
  • Radio wave feature database 420 Data associated with mobile information and radio wave feature information is registered in the radio wave feature database 420. Details of the radio wave feature database 420 and radio wave feature information will be described later.
  • the information processing apparatus 101 includes a control unit 111, an acquisition unit 121, and a registration unit 130.
  • the control unit 111 has a mobile body detection unit 141 and a sensor control unit 142.
  • the moving object detection unit 141 detects a moving object reflected in the captured image.
  • a method of detecting the moving object based on the difference between a plurality of captured images that is, a background subtraction method can be considered, but the present invention is not limited to this example.
  • the method for detecting the moving body may be various known methods such as a method for detecting the shape of the moving body.
  • the moving body detection unit 141 detects the position information indicating the spatial position in the photographing range with respect to the detected moving body.
  • the moving body detection unit 141 notifies the sensor control unit 142 of the position information corresponding to the predetermined moving body among the detected moving bodies. For example, when the registered mobile body registered in the mobile body database 410 is detected from the captured image, the mobile body detection unit 141 detects the position information of the detected registered mobile body. At this time, the moving object detection unit 141 acquires a feature amount related to the registered moving object from the moving object information registered in the moving object database, and collates the feature amount with the information extracted based on the captured image. By doing so, the registered moving object is detected from the captured image. Further, the mobile body detection unit 141 may detect the position information corresponding to the moving body having the characteristics when the moving body having the preset characteristics is detected.
  • the mobile body detection unit 141 may detect the position information of each of the moving bodies (persons) whose gender is male, or detect the position information of each moving body whose age is a predetermined value or more. May be good.
  • the moving object detection unit 141 may detect the position information corresponding to all the moving objects detected from the captured image without performing the collation as described above. Further, the moving body detection unit 141 may calculate the number of detected moving bodies. In this way, the moving body detection unit 141 detects a predetermined moving body from the captured image.
  • the mobile body detection unit 141 is an example of the mobile body detection means.
  • the sensor control unit 142 controls the radio wave sensor 300 based on the detection result of the mobile body detection unit 141. Specifically, the sensor control unit 142 sets the detection range to include the position indicated by the position information based on the position information detected by the mobile body detection unit 141. For example, when the detection range is set to include the photographing range, the sensor control unit 142 narrows the detection range and sets the detection range to be the position indicated by the position information and the range in the vicinity thereof. Then, the sensor control unit 142 controls the radio wave sensor 300 to detect the radio wave within the set detection range. If the moving object detection unit 141 detects only one moving object and the detection range is set to include the photographing range, the sensor control unit 142 does not have to set the detection range again. good. In this way, when a predetermined moving body is detected, the sensor control unit 142 sets the position of the predetermined moving body as a detection range and controls the radio wave sensor to detect the radio wave.
  • the sensor control unit 142 is an example of the sensor control means.
  • the acquisition unit 121 acquires the imaging data from the imaging device 200 and acquires the detection data from the radio wave sensor 300. Further, the acquisition unit 121 acquires the radio wave feature information extracted from the detection data.
  • the radio wave characteristic information is information showing the characteristics of the signal waveform of the radio wave, which differs depending on the device that outputs the radio wave.
  • the radio wave feature information is, for example, a feature amount based on a modulation error by modulation analysis, a feature amount based on a time waveform of a radio wave, or the like.
  • the radio wave characteristic information includes the transient (rising and falling) of the received signal, the power spectral density of the preamble portion, the error vector amplitude (EVM), the IQ (In-phase Quadrature-phase) phase error, and the like. It may be a feature quantity indicating one or more of the IQ imbalance amount, the frequency offset, and the symbol clock error, but is not limited thereto.
  • the radio wave feature information depends on the hardware of the communication device, it is difficult to rewrite it manually. Therefore, the radio wave feature information is information that is unlikely to be intentionally disguised. Further, the radio wave feature information is information that can identify an individual communication device regardless of the type of information transmitted by the radio wave, for example, a mobile phone operator.
  • the process of extracting radio wave feature information from the detected data is performed by, for example, the acquisition unit 121 according to a predetermined rule.
  • the information processing apparatus 101 can use machine learning when extracting radio wave feature information from information indicating a radio wave signal waveform.
  • the information processing apparatus 101 can extract radio wave feature information from the information indicating the signal waveform of the radio wave by using the extraction model generated based on the learning data.
  • the learning data includes information indicating radio wave signal waveforms output from various communication devices and radio wave feature information corresponding to each of the information indicating radio wave signal waveforms.
  • the training data and the extraction model may be stored in the storage device 400 in advance. Further, the acquisition unit 121 may generate the learning model.
  • the registration unit 130 associates the acquired radio wave feature information with the information about a predetermined mobile object and registers it in the radio wave feature database 420.
  • the information about the predetermined moving body may be, for example, a photographed image in which the predetermined moving body is reflected, or an image obtained by cutting out a region in which the predetermined moving body is reflected from the photographed image. Further, the information about the predetermined moving body may be information indicating the appearance of the predetermined moving body extracted from the captured image in which the predetermined moving body is reflected. Further, when the registered mobile body is detected as a predetermined mobile body by the mobile body detection unit 141, the registration unit 130 associates the mobile body information registered in the mobile body database 410 with the acquired radio wave feature information. It may be registered in the radio wave feature database.
  • the registration unit 130 registers in the radio wave feature database 420 data in which the acquired radio wave feature information is associated with information about a predetermined mobile object.
  • FIG. 6 is a diagram showing an example of the radio wave feature database 420.
  • the mobile body information shown in FIG. 6 indicates information regarding a predetermined mobile body.
  • “data 1" which is radio wave characteristic information and "data A" which is mobile information are associated with each other.
  • the registration unit 130 may further associate the time and place information with the data in which the radio wave feature information and the mobile body information are associated with each other.
  • the time information may be, for example, either the time taken by the photographing device 200 or the time when the radio wave sensor 300 detects the radio wave.
  • the location information may be, for example, information on the installation location of the photographing device 200 or the radio wave sensor 300.
  • the registration unit 130 registers the acquired information on the radio wave and the information on the predetermined mobile object in the database in association with each other.
  • the registration unit 130 is an example of registration means.
  • the detection data may include multiple radio wave feature information.
  • the detection data may include a plurality of radio wave feature information.
  • the detection data may include a plurality of radio wave feature information.
  • the acquisition unit 121 acquires a plurality of radio wave feature information.
  • the registration unit 130 registers the data in which the mobile body information and the plurality of radio wave feature information are associated with each other in the radio wave feature database 420.
  • the radio wave sensor 300 may also detect radio waves of a communication device that the predetermined mobile body does not have.
  • the information processing apparatus 101 can more accurately associate the mobile body with the radio wave information by registering the data in which the mobile body information and the plurality of radio wave feature information are associated with each other in the radio wave feature database 420. It becomes.
  • FIG. 7 is a flowchart illustrating an example of the operation of the information processing apparatus 101.
  • the information processing apparatus 101 controls the radio wave sensor when the registered mobile body is detected from the captured image.
  • the detection range is set to include the shooting range.
  • the acquisition unit 121 acquires shooting data from the shooting device 200 (S201). At this time, for example, the acquisition unit 121 acquires the captured image by decoding the captured data.
  • the moving object detection unit 141 of the control unit 111 detects a moving object from the captured image (S202). When the moving body detection unit 141 detects a plurality of moving bodies from the captured image (“Yes” in S203) and further detects a registered moving body (“Yes” in S204), it detects the position information of the registered moving body. (S205). Then, the sensor control unit 142 sets the detection range of the radio wave sensor 300 based on the detected position information (S206). For example, the sensor control unit 142 narrows the detection range and sets a position indicating the detected position information as the detection range.
  • the sensor control unit 142 causes the radio wave sensor 300 to detect the radio wave (S208).
  • the acquisition unit 121 acquires the detection data from the radio wave sensor 300, and acquires the radio wave feature information from the detection data (S209).
  • the acquisition unit 121 acquires the radio wave feature information by extracting the radio wave feature information from the detection data using, for example, a learning model stored in the storage device 400 in advance.
  • the registration unit 130 registers the data in which the acquired radio wave feature information and the mobile body information are associated with each other in the radio wave feature database 420 (S210). At this time, the registration unit 130 registers, for example, the mobile body information of the registered mobile body registered in the mobile body database 410 in association with the acquired radio wave feature information.
  • the moving object detection unit 141 registers the moving object to be displayed in the captured image. Determine if it is a mobile body.
  • the mobile body detection unit 141 detects the target mobile body (“Yes” in S207)
  • the information processing apparatus 101 proceeds to the process of S208.
  • the mobile object detection unit 141 does not detect the target mobile object (“No” in S207)
  • the information processing apparatus 101 returns to the process of S201.
  • the registered mobile body is not detected in the process of S204 (“No” in S204)
  • the information processing apparatus 101 returns to the process of S201.
  • the position of the predetermined moving object among the plurality of moving objects is determined by the radio wave sensor. It is set as a detection range, controls the radio wave sensor to detect radio waves, and acquires information on radio waves detected by the radio wave sensor. Further, the information processing apparatus 101 associates the acquired information on the radio wave with the information on the predetermined mobile body and registers the information in the database.
  • the information processing apparatus 101 of the second embodiment has the same effect as the information processing apparatus 100 of the first embodiment. That is, the information processing apparatus 101 has an effect that the information about the radio wave and the mobile body can be associated with each other even when a plurality of mobile bodies exist.
  • the radio wave sensor 300 may perform the process of extracting the radio wave feature information from the detection data. For example, when the radio wave sensor 300 detects a radio wave in the detection range, the radio wave sensor 300 extracts radio wave feature information from the signal waveform of the detected radio wave. The radio wave sensor 300 transmits the extracted radio wave feature information as detection data to the information processing apparatus 101. The acquisition unit 121 of the information processing apparatus 101 acquires radio wave feature information as detection data. At this time, the extraction model may be stored in advance in a storage device (not shown) included in the radio wave sensor 300.
  • FIG. 8 is a block diagram showing an example of the configuration of the information processing system 1002 according to the third embodiment.
  • the information processing system 1002 includes an information processing device 102 instead of the information processing device 101 in the second embodiment, and other than that, the information processing system 1001 described in the second embodiment is used. The same is true. That is, the information processing system 1002 includes an information processing device 102, a photographing device 200, and a radio wave sensor 300.
  • the description of the contents in which the configuration and operation of the information processing system 1002 shown in FIG. 8 overlaps with the description of the first and second embodiments will be omitted.
  • the information processing apparatus 102 includes a control unit 112, an acquisition unit 121, a registration unit 131, a collation unit 150, and a display control unit 160.
  • the control unit 112 includes a mobile body detection unit 143 and a sensor control unit 142.
  • the registration unit 131 and the mobile body detection unit 143 perform the operations described below in addition to the operations of the registration unit 130 and the mobile body detection unit 141 described in the second embodiment, respectively.
  • the collation unit 150 collates the information regarding the radio wave acquired by the acquisition unit 121 with the information regarding the radio wave registered in the database. For example, when the radio wave feature information is acquired by the acquisition unit 121, the collation unit 150 collates the acquired radio wave feature information with the radio wave feature information registered in the radio wave feature database 420.
  • the collation unit 150 can use machine learning when collating the radio wave feature information. Specifically, the collation unit 150 uses a collation model generated based on the training data to determine whether or not the collation matches.
  • the collation model is, for example, a model for collating the acquired radio wave feature information with the registered radio wave feature information and determining whether or not they match. By inputting the acquired radio wave feature information into the collation model, the degree of similarity with the registered radio wave feature information is calculated.
  • the collation unit 150 identifies the mobile body information associated with the radio wave feature information having a similarity of a predetermined value or more in the radio wave feature database 420. If the collation does not match, the collation unit 150 outputs information indicating that the collation did not match.
  • the collation unit 150 collates the acquired information on the radio wave with the information on the radio wave registered in the database.
  • the collating unit 150 is an example of collating means.
  • the display control unit 160 causes the display device (not shown) to display the captured image captured by the photographing device 200.
  • the display device is a device that is connected to the information processing device 102 so as to be able to communicate by wire or wirelessly.
  • the display device may be, for example, a display included in a device communicably connected to the information processing device 102.
  • the device communicably connected to the information processing device 102 may be, for example, a personal computer, a smartphone, a tablet terminal, or the like.
  • the display control unit 160 causes the display device to display the captured image when the collation by the collation unit 150 matches. For example, the display control unit 160 causes the display device to display a captured image in which at least a part of the detection range is displayed.
  • the detection range at this time is the range in which the radio wave including the radio wave feature information used for the collation is detected.
  • the display control unit 160 may display the processed image of the captured image on the display device.
  • the display control unit 160 causes the display device to display the captured image in which the range including the detection range is captured when the collation matches.
  • the display control unit 160 is an example of the display control means.
  • the mobile body detection unit 143 determines whether or not there is a mobile body having the mobile body information in the captured image based on the mobile body information specified by the collating unit 150. For example, when the collation matches, the mobile body detection unit 143 acquires a captured image in which a range in which the radio wave including the radio wave feature information used for the collation is detected is captured. Then, the moving body detection unit 143 detects a moving body having the moving body information specified by the collating unit 150 from the captured image. When a moving body having the specified moving body information is detected by the collating unit 150, the moving body detecting unit 143 further detects the position information on the captured image of the detected moving body.
  • the display control unit 160 adds information indicating the detected position of the moving body on the captured image to the captured image and displays it on the display device based on the position information. For example, the display control unit 160 causes the display device to display a captured image in which a rectangle is superimposed on the area where the detected moving object is reflected.
  • the registration unit 131 registers the data associated with the radio wave feature information acquired by the acquisition unit 121 with the time and place information in the radio wave feature database 420. At this time, the registration unit 131 may associate the information of the time when the radio wave sensor 300 detects the radio wave and the information of the installation location of the radio wave sensor 300 with the acquired radio wave feature information. The registration unit 131 may further associate the acquired radio wave feature information with a captured image showing a range in which the radio wave including the acquired radio wave feature information is detected. Further, the registration unit 131 may further associate the specified mobile object information with the acquired radio wave feature information.
  • the information processing apparatus 102 may perform the following processing.
  • the sensor control unit 142 may control the radio wave sensor 300 to detect the radio wave around the range in which the radio wave including the radio wave feature information used for the collation is detected.
  • the acquisition unit 121 acquires the radio wave feature information extracted from the detected radio wave.
  • the registration unit 131 is the radio wave feature information acquired at this time and the information registered in the radio wave feature database 420, and the matching radio wave feature information or the moving body information associated with the matching radio wave feature information. And may be associated.
  • the registration unit 131 may perform the following processing. For example, the registration unit 131 may associate the acquired plurality of radio wave feature information with the mobile body information associated with the matched radio wave feature information in the radio wave feature database 420. Further, the registration unit 131 may associate the acquired plurality of radio wave feature information with the radio wave feature information of the radio wave feature database 420 that matches the matching.
  • the following effects can be achieved by associating the registered mobile body with the radio wave feature information different from the radio wave feature information of the registered mobile body.
  • the radio wave feature information of the moving object registered in the radio wave feature database 420 is detected at a plurality of places.
  • the registered mobile has or is registered with a plurality of communication devices. It can be estimated that there are many cases where a specific mobile body exists in the vicinity of the mobile body.
  • FIG. 9 is a flowchart illustrating an example of the operation of the information processing apparatus 102. In this operation example, it is assumed that at least one or more records are registered in the radio wave feature database 420 by the operation shown in FIG. 7.
  • the acquisition unit 121 acquires radio wave feature information from the detection data (S301).
  • the collation unit 150 collates the acquired radio wave feature information with the radio wave feature information registered in the radio wave feature database 420 (S302).
  • the matching unit 150 identifies the mobile body information associated with the matching radio wave feature information (radio wave feature information registered in the radio wave feature database 420) (S304). ..
  • the registration unit 131 registers the data in which the acquired radio wave feature information is associated with the time and place information in the radio wave feature database 420 (S305). If the collation does not match (No in S303), the process returns to the process of S301.
  • the display control unit 160 indicates the position of the detected moving object on the captured image.
  • the captured image is displayed on the display device (S307).
  • the moving body detection unit 143 does not detect the moving body having the specified moving body information from the captured image (No of S306), the captured image obtained by capturing the detection range of the radio wave sensor 300 is displayed.
  • the detection range of the radio wave sensor 300 at this time is a range including the range in which the radio wave including the acquired radio wave feature information is detected.
  • the information processing apparatus 102 of the third embodiment collates the acquired information on the radio wave with the information on the radio wave registered in the database. As a result, the information processing apparatus 102 can detect a specific moving object by using the information about the radio wave.
  • the information processing apparatus 102 of the third embodiment causes the display device to display the captured image in which the range including the detection range is captured when the collation matches. Thereby, when the information processing apparatus 102 detects a specific mobile body by using the information about the radio wave, for example, the information processing apparatus 102 can inform the user where the detected mobile body exists.
  • the photographing apparatus 200 may be controlled according to the collation result of the collation unit 150.
  • the information processing apparatus 102 sets the photographing range so as to include the range in which the radio wave including the radio wave feature information used for the matching is detected when the matching by the collating unit 150 is matched, and causes the photographing apparatus 200 to take an image. You may.
  • the information processing apparatus 102 may set the photographing range so as to include the entire detection range of the radio wave sensor 300, or may include a radio wave feature information which is a part of the detection range and used for collation.
  • the shooting range may be set so as to include the range where the radio wave is detected.
  • the information processing apparatus 102 uses the radio wave intensity information including the radio wave feature information used for the collation to detect the radio wave in the detection range. You may narrow down the range in which the transmitted communication device exists.
  • the sensor control unit 142 may perform such a process of controlling the photographing apparatus 200, for example.
  • FIG. 10 is a block diagram showing an example of the configuration of the information processing system 1003 according to the fourth embodiment.
  • the information processing system 1003 includes an information processing device 103 instead of the information processing device 102 in the third embodiment, and other than that, the information processing system 1002 described in the third embodiment is used. The same is true. That is, the information processing system 1003 includes an information processing device 103, a photographing device 200, and a radio wave sensor 300.
  • the description of the contents in which the configuration and operation of the information processing system 1003 shown in FIG. 10 overlaps with the description of the first, second, and third embodiments will be omitted.
  • the information processing apparatus 103 includes a control unit 112, an acquisition unit 121, a registration unit 131, a collation unit 150, and an alarm generation unit 170.
  • the alarm generation unit 170 generates an alarm when the collation by the collation unit 150 matches.
  • the alarm is, for example, a sound generated from a speaker included in a device communicably connected to the information processing device 102, but is not limited to this example.
  • the alarm generation unit 170 may display information indicating that the collation has been matched on the display device included in the device communicably connected to the information processing device 102.
  • the alarm generation unit 170 may display information on the time and place where the radio wave including the radio wave feature information that matches the matching is detected, in addition to the information indicating that the matching is matched. In this way, the alarm generation unit 170 generates an alarm when the collation matches.
  • the alarm generation unit 170 is an example of an alarm generation means.
  • the alarm generation unit 170 performs, for example, a process of generating an alarm after the process of S305 in the flowchart of FIG.
  • the information processing device 103 may include a display control unit 160. That is, the information processing apparatus 103 may perform the processing after S306 in FIG. 9 after the processing for generating the alarm is performed.
  • the information processing apparatus 103 of the fourth embodiment generates an alarm when the collation matches. As a result, the information processing apparatus 103 can more quickly notify the user that the collation has been matched.
  • FIG. 11 is a block diagram showing an example of a hardware configuration of a computer device that realizes the information processing device in each embodiment.
  • Each block shown in FIG. 11 can be realized by a combination of software and a computer device 10 that realizes an information processing device and an information processing method in each embodiment.
  • the computer device 10 includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, a storage device 14, an input / output interface 15, a bus 16, and a drive device 17.
  • the information processing device may be realized by a plurality of electric circuits.
  • the storage device 14 stores a program (computer program) 18.
  • the processor 11 executes the program 18 of the information processing apparatus using the RAM 12.
  • the program 18 includes a program that causes a computer to execute the processes shown in FIGS. 3, 7, and 9.
  • each component of the information processing apparatus control units 110, 111, 112, acquisition units 120, 121, registration units 130, 131, collation unit 150, described above).
  • the functions of the display control unit 160, the alarm generation unit 170, etc.) are realized.
  • the program 18 may be stored in the ROM 13. Further, the program 18 may be recorded on the storage medium 20 and read out using the drive device 17, or may be transmitted from an external device (not shown) to the computer device 10 via a network (not shown).
  • the input / output interface 15 exchanges data with peripheral devices (keyboard, mouse, display device, etc.) 19.
  • the input / output interface 15 functions as a means for acquiring or outputting data.
  • the bus 16 connects each component.
  • the information processing device can be realized as a dedicated device. Further, the information processing device can be realized based on a combination of a plurality of devices.
  • a processing method in which a program for realizing each component in the function of each embodiment is recorded in a storage medium, the program recorded in the storage medium is read out as a code, and the program is executed in a computer is also included in the category of each embodiment. .. That is, a computer-readable storage medium is also included in the scope of each embodiment. Further, the storage medium in which the above-mentioned program is recorded and the program itself are also included in each embodiment.
  • the storage medium is, for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magneto-optical disk, a CD (Compact Disc) -ROM, a magnetic tape, a non-volatile memory card, or a ROM, but the storage medium is not limited to this example.
  • the program recorded on the storage medium is not limited to a program that executes processing by itself, but operates on an OS (Operating System) in cooperation with other software and expansion board functions to execute processing. Programs to be implemented are also included in the category of each embodiment.
  • Appendix 2 A registration means for associating the acquired information on the radio wave with the information on the predetermined mobile object and registering the information in the database is provided.
  • the information processing apparatus according to Appendix 1.
  • the acquisition means acquires information about the radio wave corresponding to each of the plurality of radio waves, and obtains information about the radio wave.
  • the registration means associates the acquired information on the radio waves with the information on the predetermined mobile body and registers the information in the database.
  • Appendix 4 A collation means for collating the acquired information on the radio wave with the information on the radio wave registered in the database is provided.
  • the information processing apparatus according to Appendix 2 or 3.
  • Appendix 6 An alarm generating means for generating an alarm when the collation is matched is provided.
  • the information processing apparatus according to Appendix 4 or 5.
  • the control means is A moving body detection means for detecting the predetermined moving body from the captured image, When the predetermined moving body is detected, the position of the predetermined moving body is set as the detection range, and the sensor control means for controlling the radio wave sensor to detect the radio wave is provided.
  • the information processing apparatus according to any one of Supplementary note 1 to 6.
  • the information regarding the radio wave is radio wave characteristic information indicating the characteristics of the signal waveform of the radio wave.
  • the information processing apparatus according to any one of Supplementary Provisions 1 to 7.
  • the mobile is at least one of a person, a vehicle, an aircraft, an autonomous robot, and a remote-controlled robot.
  • the information processing apparatus according to any one of Supplementary Provisions 1 to 8.
  • Appendix 12 The acquired information on the radio wave and the information on the predetermined mobile object are associated and registered in the database. The information processing method according to Appendix 11.
  • Appendix 14 The acquired information on the radio wave and the information on the radio wave registered in the database are collated. The information processing method according to Appendix 12 or 13.
  • the information regarding the radio wave is radio wave characteristic information indicating the characteristics of the signal waveform of the radio wave.
  • the information processing method according to any one of Supplementary note 11 to 17.
  • the mobile is at least one of a person, a vehicle, an aircraft, an autonomous robot, and a remote-controlled robot.
  • the information processing method according to any one of Supplementary note 11 to 18.
  • Appendix 21 Stores a program that causes a computer to further execute a process of associating the acquired information on the radio wave with the information on the predetermined mobile object and registering the information in the database.
  • the computer-readable storage medium according to Appendix 20 stores a program that causes a computer to further execute a process of associating the acquired information on the radio wave with the information on the predetermined mobile object and registering the information in the database.
  • Appendix 22 When a plurality of the radio waves are detected by the radio wave sensor, In the acquisition process, information about the radio wave corresponding to each of the plurality of radio waves is acquired. In the registration process, the acquired information on the radio waves and the information on the predetermined mobile body are associated and registered in the database.
  • Appendix 23 A program for further executing a process of collating the acquired information on the radio wave with the information on the radio wave registered in the database is stored.
  • Appendix 24 When the collation matches, a program for causing the computer to further execute a process of displaying the captured image captured in the range including the detection range on the display device is stored.
  • Appendix 25 Stores a program that causes the computer to further execute the process of generating an alarm when the matching is matched.
  • the information regarding the radio wave is radio wave characteristic information indicating the characteristics of the signal waveform of the radio wave.
  • the computer-readable storage medium according to any one of Supplementary Provisions 20 to 26.
  • the mobile is at least one of a person, a vehicle, an aircraft, an autonomous robot, and a remote-controlled robot.
  • the computer-readable storage medium according to any one of Supplementary Provisions 20 to 27.
  • Information processing device 110 100, 101, 102, 103 Information processing device 110, 111, 112 Control unit 120, 121 Acquisition unit 130, 131 Registration unit 141 Mobile detection unit 142 Sensor control unit 150 Matching unit 160 Display control unit 170 Alarm generation unit 200 Imaging device 300 radio wave sensor 400 storage device

Landscapes

  • Physics & Mathematics (AREA)
  • Electromagnetism (AREA)
  • General Physics & Mathematics (AREA)
  • Traffic Control Systems (AREA)
  • Geophysics And Detection Of Objects (AREA)
PCT/JP2020/040030 2020-10-26 2020-10-26 情報処理装置、情報処理方法、情報処理システム、及びコンピュータ読み取り可能な記憶媒体 Ceased WO2022091165A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
JP2022558599A JP7533610B2 (ja) 2020-10-26 2020-10-26 情報処理装置、情報処理方法、及びプログラム
PCT/JP2020/040030 WO2022091165A1 (ja) 2020-10-26 2020-10-26 情報処理装置、情報処理方法、情報処理システム、及びコンピュータ読み取り可能な記憶媒体

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2020/040030 WO2022091165A1 (ja) 2020-10-26 2020-10-26 情報処理装置、情報処理方法、情報処理システム、及びコンピュータ読み取り可能な記憶媒体

Publications (1)

Publication Number Publication Date
WO2022091165A1 true WO2022091165A1 (ja) 2022-05-05

Family

ID=81383687

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2020/040030 Ceased WO2022091165A1 (ja) 2020-10-26 2020-10-26 情報処理装置、情報処理方法、情報処理システム、及びコンピュータ読み取り可能な記憶媒体

Country Status (2)

Country Link
JP (1) JP7533610B2 (https=)
WO (1) WO2022091165A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025158780A1 (ja) * 2024-01-22 2025-07-31 株式会社日立製作所 通信制御装置および通信制御システム、誘導システム

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08511093A (ja) * 1993-05-28 1996-11-19 サーブ − スカニア コンビテック アクティエボラーグ 車輌の移動を登録する方法及び装置
JP2006098158A (ja) * 2004-09-29 2006-04-13 Hitachi Ltd 電界分布測定方法及び電界分布測定装置
US20090231161A1 (en) * 2008-03-11 2009-09-17 Alastair Malarky Real-time vehicle position determination using communications with variable latency
JP2010145195A (ja) * 2008-12-18 2010-07-01 Canon Inc 電界計測アレイセンサ及び電界分布計測装置
JP2011164064A (ja) * 2010-02-15 2011-08-25 Panasonic Corp 電磁波検知装置、携帯機器、電気自動車及びハイブリッド車の判定方法並びにプログラム
JP2013009413A (ja) * 2012-08-28 2013-01-10 Sumitomo Electric Ind Ltd 違法電波の判定方法、判定装置及びコンピュータプログラム
JP2013513336A (ja) * 2009-12-08 2013-04-18 トゥルーポジション・インコーポレーテッド マルチセンサの定位および特定
JP2017514189A (ja) * 2014-01-21 2017-06-01 キネテイツク・リミテツド 車両の識別

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08511093A (ja) * 1993-05-28 1996-11-19 サーブ − スカニア コンビテック アクティエボラーグ 車輌の移動を登録する方法及び装置
JP2006098158A (ja) * 2004-09-29 2006-04-13 Hitachi Ltd 電界分布測定方法及び電界分布測定装置
US20090231161A1 (en) * 2008-03-11 2009-09-17 Alastair Malarky Real-time vehicle position determination using communications with variable latency
JP2010145195A (ja) * 2008-12-18 2010-07-01 Canon Inc 電界計測アレイセンサ及び電界分布計測装置
JP2013513336A (ja) * 2009-12-08 2013-04-18 トゥルーポジション・インコーポレーテッド マルチセンサの定位および特定
JP2011164064A (ja) * 2010-02-15 2011-08-25 Panasonic Corp 電磁波検知装置、携帯機器、電気自動車及びハイブリッド車の判定方法並びにプログラム
JP2013009413A (ja) * 2012-08-28 2013-01-10 Sumitomo Electric Ind Ltd 違法電波の判定方法、判定装置及びコンピュータプログラム
JP2017514189A (ja) * 2014-01-21 2017-06-01 キネテイツク・リミテツド 車両の識別

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2025158780A1 (ja) * 2024-01-22 2025-07-31 株式会社日立製作所 通信制御装置および通信制御システム、誘導システム

Also Published As

Publication number Publication date
JPWO2022091165A1 (https=) 2022-05-05
JP7533610B2 (ja) 2024-08-14

Similar Documents

Publication Publication Date Title
US12282708B2 (en) Portable terminal device and information processing system
US11605179B2 (en) System for determining anatomical feature orientation
CN108875451B (zh) 一种定位图像的方法、装置、存储介质和程序产品
CN105956518A (zh) 一种人脸识别方法、装置和系统
CN111382637B (zh) 行人检测跟踪方法、装置、终端设备及介质
JP6588413B2 (ja) 監視装置および監視方法
WO2021136975A1 (en) Image processing methods and apparatuses, electronic devices, and storage media
US9854148B2 (en) Micro-location of devices within a wireless network using room boundary images
JP6862596B1 (ja) 映像解析装置、広域監視システム及びカメラの選定方法
WO2018146938A1 (ja) 人物検出システム
US20210201478A1 (en) Image processing methods, electronic devices, and storage media
EP3594879A1 (en) System and method for authenticating transactions from a mobile device
CN108877787A (zh) 语音识别方法、装置、服务器及存储介质
WO2022091165A1 (ja) 情報処理装置、情報処理方法、情報処理システム、及びコンピュータ読み取り可能な記憶媒体
US9785829B2 (en) Information processing apparatus, information processing method, and non-transitory computer readable medium
US10719543B2 (en) Information processing apparatus, information processing method, and program
JP2010146522A (ja) 顔画像追跡装置及び顔画像追跡方法並びにプログラム
JP6740784B2 (ja) 認証システム、認証方法、および認証プログラム
US12439371B2 (en) Information processing system, information processing method, and non-transitory computer readable medium
JP2018173767A (ja) 個体識別装置、情報処理システム、個体識別装置の制御方法及びプログラム
US20190035105A1 (en) Output control device, information output system, output control method, and program
JP2016024720A (ja) 映像分割装置、方法及びプログラム
US12327428B2 (en) Authentication device, registration device, authentication method, registration method, and storage medium
JP7601111B2 (ja) 情報処理装置、情報処理方法、及びプログラム
CN113470081B (zh) 一种车辆跟踪方法、装置、计算机设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20959683

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2022558599

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20959683

Country of ref document: EP

Kind code of ref document: A1