WO2024042683A1 - 情報処理装置、移動端末、情報処理方法、およびプログラム - Google Patents

情報処理装置、移動端末、情報処理方法、およびプログラム Download PDF

Info

Publication number
WO2024042683A1
WO2024042683A1 PCT/JP2022/032068 JP2022032068W WO2024042683A1 WO 2024042683 A1 WO2024042683 A1 WO 2024042683A1 JP 2022032068 W JP2022032068 W JP 2022032068W WO 2024042683 A1 WO2024042683 A1 WO 2024042683A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
information
unit
videos
acquisition unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2022/032068
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
健二 鳴島
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Micware Co Ltd
Original Assignee
Micware Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Micware Co Ltd filed Critical Micware Co Ltd
Priority to JP2024542533A priority Critical patent/JP7606651B2/ja
Priority to PCT/JP2022/032068 priority patent/WO2024042683A1/ja
Priority to EP22956510.6A priority patent/EP4525456A4/en
Publication of WO2024042683A1 publication Critical patent/WO2024042683A1/ja
Priority to JP2024205043A priority patent/JP7614440B1/ja
Priority to JP2024206794A priority patent/JP7717434B2/ja
Priority to US18/969,255 priority patent/US12361522B2/en
Priority to US19/023,338 priority patent/US12475540B2/en
Priority to US19/023,349 priority patent/US20250157006A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00—Image enhancement or restoration
    • G06T5/50—Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H04N21/21805—Source of audio or video content, e.g. local disk arrays enabling multiple viewpoints, e.g. using a plurality of cameras
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
    • G01C21/00—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00
    • G01C21/26—Navigation; Navigational instruments not provided for in groups G01C1/00 - G01C19/00 specially adapted for navigation in a road network
    • G01C21/34—Route searching; Route guidance
    • G01C21/36—Input/output arrangements for on-board computers
    • G01C21/3626—Details of the output of route guidance instructions
    • G01C21/3647—Guidance involving output of stored or live camera images or video streams
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2541—Rights Management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808—Management of client data
    • H04N21/25816—Management of client data involving client authentication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H04N21/25808—Management of client data
    • H04N21/25841—Management of client data involving the geographical location of the client
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/266—Channel or content management, e.g. generation and management of keys and entitlement messages in a conditional access system, merging a VOD unicast channel into a multicast channel
    • H04N21/2665—Gathering content from different sources, e.g. Internet and satellite
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/27—Server based end-user applications
    • H04N21/274—Storing end-user multimedia data in response to end-user request, e.g. network recorder
    • H04N21/2743—Video hosting of uploaded data from client
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/20—Special algorithmic details
    • G06T2207/20212—Image combination
    • G06T2207/20221—Image fusion; Image merging

Definitions

  • the present invention relates to an information processing device, etc. that performs processing regarding moving images captured by two or more mobile terminals.
  • the information processing device of the first invention is a moving image shot by each of two or more mobile terminals, and an attribute value including one or more environmental information including position information for specifying the shooting position or time information for specifying the time of shooting.
  • a video acquisition unit that acquires videos that are associated with a set and transmitted from two or more mobile terminals, and two or more videos that have different information when associated with each of the two or more videos acquired by the video acquisition unit.
  • a video configuration that configures one video by temporally combining two or more videos obtained by a video acquisition unit, or spatially merging parts of two or more videos that have different positional information associated with each of the two or more videos acquired by the video acquisition unit.
  • the information processing apparatus includes a moving image transmitting section that transmits one moving image configured by the moving image composing section.
  • the video acquisition unit sequentially acquires two or more videos whose location information corresponding to each of the two or more videos satisfies the first location condition.
  • the video composition unit is an information processing device that combines two or more videos acquired by the video acquisition unit in the order of time corresponding to the videos, and configures one video.
  • the information processing device of the third invention is different from the second invention in that it further includes an inquiry receiving section that receives an inquiry including location information from a user terminal, and the video acquisition section is configured to include an inquiry receiving section.
  • the information processing apparatus acquires two or more moving images corresponding to position information that satisfies a first position condition using position information received by the user.
  • the information processing device of the fourth invention further includes an inquiry receiving unit that sequentially receives two or more pieces of location information transmitted from the target terminal, and the information processing device obtains a video.
  • the unit is an information processing device that sequentially uses the two or more pieces of position information received by the inquiry receiving unit to sequentially acquire two or more videos corresponding to the position information that satisfies the first position condition.
  • the information processing device of the fifth invention is different from the second invention by further comprising an inquiry receiving unit that receives an inquiry including location information for specifying a destination set in the navigation terminal, and
  • the acquisition unit is an information processing device that sequentially acquires two or more videos corresponding to position information that satisfies the first position condition using the position information received by the inquiry reception unit.
  • the information processing device of the sixth invention further includes an inquiry receiving unit that receives an inquiry including route information including two or more pieces of location information
  • the video acquisition unit includes: The information processing apparatus acquires two or more moving images corresponding to positional information that satisfies two or more first positional conditions using two or more pieces of positional information included in route information.
  • the route information has time information corresponding to two or more pieces of position information
  • the video acquisition unit is configured to provide two or more pieces of time information that the route information has.
  • the information processing apparatus acquires two or more moving images corresponding to position information that satisfies a first position condition using each of the above position information and time information.
  • the video acquisition unit is configured such that the position information associated with each of the two or more videos satisfies the second position condition, and Acquires two or more videos whose associated time information satisfies the time condition, and the video composition unit configures one frame using part or all of the frames constituting each of the two or more videos acquired by the video acquisition unit. It is an information processing device that temporally connects frames to form a single moving image.
  • the video is a video taken of a parking lot
  • the video composition unit is provided with two or more video components installed in each of the two or more moving objects.
  • This is an information processing device that spatially connects frames directly above the frames of moving images shot by each mobile terminal to form one frame, and forms one moving image having one frame.
  • the video is associated with a rights holder identifier for identifying a rights holder of the video
  • the video configuration unit configures the information processing device.
  • the information processing apparatus further includes a right holder processing unit that performs right holder processing, which is processing related to a right holder identified by a right holder identifier associated with one video.
  • the right holder identifier associated with one video is the right holder identifier associated with each of two or more videos that are the source of the one video.
  • the right holder processing unit performs remuneration processing, which is a process of giving a reward, to each right holder identified by the right holder identifier that corresponds to two or more videos that are the source of one video. This is an information processing device equipped with remuneration means for performing.
  • the reward means is a video attribute value corresponding to each of two or more videos that are the basis of the video transmitted by the video transmitter.
  • This is an information processing device that performs remuneration processing, which is a process of obtaining a video attribute value, determining remuneration for each of two or more rights holders using video attribute values, and providing remuneration.
  • the right holder processing unit converts one video composed by the video composition unit into two or more sources that are the source of the one video.
  • the information processing apparatus includes a first maintenance means that performs a first maintenance process of accumulating data in association with attribute value sets associated with each video.
  • the right holder processing unit converts one video composed by the video composition unit into two or more sources that are the source of the one video.
  • the information processing apparatus includes a second preservation means that performs a second preservation process of accumulating data in association with a right holder identifier corresponding to each video.
  • the right holder of one video composed of two or more images can be made the appropriate right holder.
  • the information processing device of the fifteenth invention is different from the tenth invention, further comprising an inquiry receiving unit that receives an inquiry from the user terminal regarding environmental information regarding the environment in which the mobile terminal shot the video,
  • the video acquisition unit acquires two or more videos corresponding to the inquiry received by the inquiry reception unit, and the right holder processing unit converts one video configured by the video composition unit into a right holder that identifies the user of the user terminal.
  • the information processing apparatus includes a third security means that stores information in association with an identifier.
  • the right holder of one video composed of two or more images can become the right holder who needs the video.
  • the right holder processing unit stores maintenance information including access information for accessing the video.
  • the information processing device includes a fourth security means that performs a fourth security process of accumulating information on a blockchain.
  • the information processing device it is possible to compose and provide one useful video using videos shot by two or more mobile terminals.
  • Embodiment 1 In this embodiment, two or more moving images acquired by photographing devices in two or more moving objects are used to configure one temporally combined moving image or to create one spatially fused moving image.
  • the information processing device to be configured will be explained. Inquiries to select two or more videos include, for example, inquiries using location information specified on the user terminal, inquiries using two or more location information received from the target terminal for monitoring, and inquiries using the location information specified on the navigation terminal. These are inquiries using a set destination and route information.
  • an information processing apparatus that performs rights holder processing, which is processing related to the rights holder of one video to be output, will be described.
  • the right holder process is, for example, a reward process to be described later and various maintenance processes to be described later.
  • an information processing device that automatically receives videos that meet maintenance conditions from a mobile terminal and stores them will be described.
  • an information processing apparatus that handles videos to which one or more tags obtained through video analysis or the like are added will be described. Note that although the process of adding tags is performed, for example, by an information processing device or a mobile terminal, it may be performed by another device.
  • an information processing apparatus that performs processing for a user of a mobile terminal or a user who requires a video when a video desired by the user exists but cannot be transmitted.
  • a case where the moving image cannot be transmitted is, for example, a case where the power of the mobile terminal is OFF.
  • an information processing apparatus that receives movement information regarding the start of movement from a mobile terminal and utilizes it will be described.
  • a mobile terminal will be described that transmits the latest set of attribute values for a captured video to an information processing device at the end of movement.
  • a mobile terminal that acquires one or more tags by analyzing a video or the like and associates the tag with the video will be described.
  • information X is associated with information Y means that information Y can be acquired from information X, or information X can be acquired from information Y, and the method of association is not limited. .
  • Information X and information Y may be linked, exist in the same buffer, information X may be included in information Y, or information Y may be included in information X. etc. is also fine.
  • FIG. 1 is a conceptual diagram of information system A in this embodiment.
  • the information system A includes an information processing device 1 , one or more mobile terminals 2 , one or more user terminals 3 , one or more target terminals 4 , and one or more navigation terminals 5 .
  • the information processing device 1 is a server that provides one video to the user terminal 3 using videos transmitted by two or more mobile terminals 2.
  • the information processing device 1 is, for example, a so-called server, such as a cloud server, an ASP server, etc., but the type thereof does not matter.
  • the information processing device 1 may be a device that constitutes a blockchain.
  • the video here is an image captured by the mobile terminal 2.
  • a moving image is usually a collection of two or more still images, but it may also be considered to be a single still image.
  • the interval between the shooting times of two or more still images included in the video does not matter.
  • the video is, for example, a 60 frame/second video or a 30 frame/second video, but it may also be a collection of two or more still images taken at a time interval of more than a predetermined time (for example, 1 minute). It may also be a collection of two or more still images taken when the conditions are met.
  • the mobile terminal 2 is a terminal installed in a moving body, and is a terminal that shoots a video.
  • the mobile terminal 2 is, for example, a drive recorder, a smartphone, a tablet terminal, or a camera with a communication function. Further, installation usually means being fixed, but it may also be considered to include being in contact with or holding. Further, the mobile terminal 2 may have a driving means such as an engine, and a moving means such as wheels.
  • a moving body is an object that moves.
  • the mobile object is, for example, a land mobile device, a sea mobile device, an underwater mobile device, an air mobile device, a space mobile device, or a living creature.
  • Ground transportation equipment includes, for example, human-powered vehicles such as automobiles, bicycles, rickshaws, and playground equipment, railway vehicles such as trains and steam locomotives, vehicles at amusement parks, and commercial vehicles at factories and other facilities. It is. Terrestrial mobile devices may include devices that are not vehicles for people to ride, such as various robots for business use or play equipment, and play equipment such as so-called radio-controlled devices.
  • the motor vehicle is, for example, a passenger car, a truck, a bus, a taxi, or a motorcycle.
  • Examples of maritime mobile devices include various ships, personal watercraft, surfboards, row boats, floating rings, and rafts.
  • underwater mobile devices examples include submarines, diving robots, and diving equipment such as Aqualungs.
  • aviation mobile devices include various aircraft, helicopters, gliders, parachutes, balloons, kites, etc.
  • space mobile devices examples include rockets, space probes, and artificial satellites.
  • the living thing is, for example, a human being or a moving object other than a human being.
  • moving objects other than humans include birds, mammals, reptiles, amphibians, fish, insects, and other various living things.
  • the user terminal 3 is a terminal used by a user. Users are those who watch videos and those who need videos.
  • the user terminal 3 may have the functions of the mobile terminal 2.
  • the user terminal 3 may be a terminal of a user who provides videos.
  • the user terminal 3 may be a navigation terminal 5, which will be described later.
  • the target terminal 4 is a terminal that transmits location information.
  • the target terminal 4 is, for example, a terminal provided as a monitoring target.
  • the monitoring target is, for example, a living thing or an object.
  • the living thing is, for example, a human being.
  • the person is, for example, a child or an elderly person.
  • the object to be monitored is, for example, something that should not be stolen, such as a car.
  • the mobile terminal 2, user terminal 3, and target terminal 4 are, for example, smartphones, tablet terminals, so-called personal computers, navigation terminals, etc., and their types do not matter.
  • the navigation terminal 5 is a so-called navigation terminal.
  • the navigation terminal 5 is a terminal installed in a ground mobile device or held by a person.
  • the information processing device 1 and one or more mobile terminals 2 can normally communicate via a network such as the Internet. Further, the information processing device 1 and each of the one or more user terminals 3 can normally communicate via a network such as the Internet. Further, the information processing device 1 and each of the one or more target terminals 4 can normally communicate via a network such as the Internet. Furthermore, the information processing device 1 and each of the one or more navigation terminals 5 can normally communicate via a network such as the Internet.
  • FIG. 2 is a block diagram of information system A in this embodiment.
  • FIG. 3 is a block diagram of the information processing device 1. As shown in FIG.
  • the information processing device 1 includes a storage section 11, a reception section 12, a processing section 13, and a transmission section 14.
  • the storage section 11 includes a collection storage section 111 .
  • the receiving section 12 includes a movement information receiving section 121, an inquiry receiving section 122, and a collective receiving section 123.
  • the processing unit 13 includes a movement information storage unit 131, a set storage unit 132, a video acquisition unit 133, a video composition unit 134, and a right holder processing unit 135.
  • the right holder processing unit 135 includes a first security device 1351, a second security device 1352, a third security device 1353, a fourth security device 1354, and a reward device 1355.
  • the transmitter 14 includes a video transmitter 141, a status transmitter 142, and a needs transmitter 143.
  • the mobile terminal 2 includes a movement storage section 21, a movement reception section 22, a movement processing section 23, and a movement transmission section 24.
  • the movement processing section 23 includes a photographing section 231, a tag acquisition section 232, and a movement information acquisition section 233.
  • the movement transmission section 24 includes a movement information transmission section 241 , a movement video transmission section 242 , and a set transmission section 243 .
  • the user terminal 3 includes a user storage section 31, a user reception section 32, a user processing section 33, a user transmission section 34, a user reception section 35, and a user output section 36.
  • the various types of information are stored in the storage unit 11 that constitutes the information processing device 1.
  • the various types of information include, for example, terminal information, which will be described later, an attribute value set, which will be described later, movement information, moving images, and management information, which will be described later.
  • Management information is information used to monitor the person being watched over.
  • the management information includes a user identifier for transmitting a video to the user terminal 3 of the person watching the target person, and a target person identifier for identifying the target terminal 4 of the target person.
  • the set storage unit 111 stores one or more pieces of terminal information.
  • Terminal information is information regarding the mobile terminal 2.
  • the terminal information includes information on the video currently held by the mobile terminal 2.
  • the terminal information includes a terminal identifier and a set of attribute values.
  • the terminal information may be associated with the video. Further, the terminal identifier may be included in the attribute value set.
  • the terminal identifier is information that identifies the mobile terminal 2.
  • the terminal identifier may be a right holder identifier that identifies the right holder who is the user of the mobile terminal 2.
  • the terminal identifier is, for example, the ID of the mobile terminal 2, the name of the mobile terminal 2, and the MAC address of the mobile terminal 2.
  • a right holder is a person who has some rights regarding a video.
  • the right holder is, for example, the owner of the video, the copyright holder of the video, or the owner of the mobile terminal 2 that captured the video.
  • the rights holder is the initial rights holder of the video.
  • the right holder is usually the holder of the mobile terminal 2, but may be any person who has the rights to the video captured by the mobile terminal 2.
  • the right holder identifier is the identifier of the video right holder.
  • the right holder identifier may be a terminal identifier.
  • the right holder identifier is, for example, the right holder ID, the right holder's name, the right holder's e-mail address, and the right holder's telephone number.
  • An attribute value set is a set of one or more video attribute values.
  • a video attribute value is an attribute value of a video.
  • the video attribute value is, for example, environmental information.
  • the video attribute value is, for example, a tag.
  • the moving image attribute value may be, for example, a moving object attribute value, which will be described later.
  • Environmental information is information about the environment in which the video was shot.
  • the environmental information is, for example, location information, time information, weather information, temperature information, and seasonal information.
  • Position information is information that specifies the shooting position.
  • the photographing position is the position of the camera for photographing.
  • the location information is, for example, (latitude, longitude), (latitude, longitude, altitude).
  • the position information may be an area identifier that specifies an area on a map, an address, a road identifier that specifies a road, a lane identifier that specifies a lane on a road, or the like.
  • Time information is information that specifies the time when a video was shot. The time when the video was shot may be around the time when the video was shot, and accuracy is not required.
  • the time information is, for example, time, year, month, date and time, year, month, day, hour, minute, year, month, date, hour, minute, second, year, month, day, month and day. In other words, the granularity of the time indicated by the time information does not matter.
  • Weather information is information that specifies the weather at the location where the video was shot at the time the video was shot.
  • the weather information is, for example, "sunny,” “rain,” “snow,” and “cloudy.”
  • Temperature information is information that specifies the outside temperature at the location where the video was taken at the time the video was taken.
  • the temperature information is, for example, "25 degrees” or “30 degrees or more.”
  • Seasonal information is information that identifies the season of the location where the video was shot at the time the video was shot.
  • the seasonal information is, for example, "spring”, “summer”, “early summer”, and "winter”.
  • a tag is information that specifies the characteristics of a video.
  • the tag is, for example, information as a result of analyzing a video.
  • a tag is, for example, information as a result of analyzing one or more moving object attribute values.
  • the tag is, for example, information as a result of analyzing two or more moving object attribute values in time series.
  • a moving object attribute value is an attribute value related to a moving object.
  • the moving object attribute value is, for example, information regarding movement that can be obtained while the moving object is moving.
  • the moving object attribute value is, for example, CAN (Controller Area Network) data or information indicating the use of an airbag.
  • the CAN data includes, for example, speed, engine rotational speed, and brake status. Examples of tags include "accident,” “traffic jam,” “dangerous driving,” “excessive speed,” and names of objects shown in the video (for example, "people,” “bears,” and names of celebrities).
  • the receiving unit 12 receives various information and instructions from the mobile terminal 2, user terminal 3, target terminal 4, or navigation terminal 5.
  • Various types of information and instructions include, for example, movement information, location information, inquiries, attribute value sets, and videos.
  • the video received by the receiving unit 12 is associated with a rights holder identifier that identifies the rights holder of the video.
  • a rights holder identifier that identifies the rights holder of the video.
  • one or more video attribute values are associated with a video received by the receiving unit 12.
  • the video received by the receiving unit 12 is, for example, a video shot of a parking lot. However, it does not matter where the video received by the receiving unit 12 is acquired.
  • the movement information receiving unit 121 receives movement information from the mobile terminal 2 when the mobile terminal 2 starts moving.
  • the start time is preferably immediately after the start, but may also be after a predetermined time (for example, 1 minute) has elapsed from the start of the movement.
  • the movement information is information that specifies that the mobile terminal 2 moves.
  • the information specifying that the user is moving may be information specifying that the user has started moving.
  • the movement here may be about moving from now on or may be about being moved.
  • the movement information is, for example, a movement start flag and a terminal identifier.
  • the movement start flag is information indicating to start movement.
  • the terminal identifier is the identifier of the mobile terminal 2 that starts moving. Note that the terminal identifier may be the same as the right holder identifier.
  • the inquiry receiving unit 122 receives an inquiry regarding environmental information from the user terminal 3.
  • a query regarding environmental information is a query that includes environmental information as a condition.
  • the inquiry is a request for a video shot by the mobile terminal 2.
  • the query is, for example, SQL, but its format, data structure, etc. are not critical.
  • the inquiry receiving unit 122 receives an inquiry including location information from the user terminal 3, for example.
  • the inquiry receiving unit 122 sequentially receives two or more pieces of location information transmitted from the target terminal 4.
  • the inquiry receiving unit 122 may receive the two or more pieces of location information from the target terminal 4, or may receive it from the user terminal 3 or the like that has received the position information from the target terminal 4.
  • the inquiry receiving unit 122 receives, for example, an inquiry including location information that specifies a destination set on the navigation terminal 5.
  • the inquiry receiving unit 122 may receive the position information from the navigation terminal 5, may receive it from the user terminal 3 that received it from the navigation terminal 5, or may receive the position information from the navigation terminal 3 to set the destination.
  • the information may also be received from the user terminal 3 or the like that transmitted the information to the user terminal 5.
  • the inquiry receiving unit 122 receives, for example, an inquiry that includes route information that includes two or more pieces of location information.
  • the inquiry receiving unit 122 receives an inquiry including route information from the user terminal 3 or the navigation terminal 5, for example.
  • the inquiry receiving unit 122 receives an inquiry from the user terminal 3 regarding environmental information regarding the environment in which the mobile terminal 2 took a video.
  • the route information included in the inquiry is, for example, information specifying the route traveled by the user viewing the video, or route information set in the navigation terminal 5 or the user terminal 3 having a navigation function.
  • the route information has time information corresponding to two or more pieces of position information.
  • the time information is, for example, information that specifies when the user was at the location specified by the location information. Note that the distance interval between two or more pieces of position information included in the route information does not matter.
  • the set receiving unit 123 receives the attribute value set from the mobile terminal 2. It is preferable that the set receiving unit 123 receives the attribute value set from the mobile terminal 2 at the end of the movement of the mobile terminal 2.
  • the attribute value set here is information that specifies the video stored in the mobile terminal 2.
  • the processing unit 13 performs various processes.
  • the various processes are, for example, processes performed by the movement information storage unit 131, the set storage unit 132, the video acquisition unit 133, the video composition unit 134, and the right holder processing unit 135.
  • the movement information storage unit 131 stores the movement information received by the movement information reception unit 121 in association with the mobile terminal 2.
  • Associating with the mobile terminal 2 means, for example, associating with a right holder identifier or a terminal identifier.
  • the set storage unit 132 stores the attribute value set received by the set reception unit 123 in the set storage unit 111.
  • the set storage unit 132 normally stores the attribute value set in association with the mobile terminal 2 that has transmitted the attribute value set.
  • Associating with the mobile terminal 2 means, for example, associating with a right holder identifier or a terminal identifier.
  • the video acquisition unit 133 acquires videos shot by each of the two or more mobile terminals 2. Such a video is associated with an attribute value set.
  • the attribute value set includes one or more pieces of environmental information. It is preferable that the one or more pieces of environmental information include position information for specifying the photographing position or time information for specifying the time of photographing. Further, it is preferable that the video is associated with a right holder identifier.
  • the video acquisition unit 133 sequentially acquires two or more videos whose location information corresponding to each of the two or more videos satisfies the first location condition.
  • the video acquisition unit 133 acquires, for example, two or more videos corresponding to the inquiry received by the inquiry reception unit 122.
  • the video acquisition unit 133 acquires two or more videos corresponding to position information that satisfies the first position condition using the position information received by the inquiry reception unit 122.
  • the video acquisition unit 133 sequentially uses the two or more pieces of positional information received by the inquiry receiving unit 122 to sequentially acquire two or more videos corresponding to the positional information that satisfies the first positional condition. .
  • the video acquisition unit 133 sequentially acquires two or more videos corresponding to location information that satisfies the first location condition using the location information received by the inquiry reception unit 122.
  • the video acquisition unit 133 acquires two or more videos corresponding to position information that satisfies two or more first position conditions using two or more pieces of position information included in the route information.
  • the video acquisition unit 133 acquires two or more videos corresponding to location information that satisfies the first location condition using two or more pieces of location information and time information included in the route information.
  • the video acquisition unit 133 acquires two or more videos in which the position information associated with each of the two or more videos satisfies the second position condition, and the time information associated with each of the two or more videos satisfies the time condition.
  • the first location condition is a condition related to location information.
  • the first location condition is that the target location information is location information that has an approximate relationship with the specified location. An approximate relationship is being close, for example, the distance is within a threshold, the distance is less than a threshold, the travel time is within a threshold, or the travel time is less than a threshold.
  • the target location information is, for example, location information included in an inquiry or received location information.
  • the first location condition may include conditions other than location information.
  • the first location condition may be a condition related to location information and time information.
  • the first location condition is, for example, that a target location information and time information set is associated with location information and time information that satisfy an approximation condition.
  • Location information and time information that satisfy the approximation conditions for a pair of target location information and time information include, for example, the distance to the location specified by the target location information is within a threshold, the distance is less than a threshold,
  • the location information indicates a position where the travel time is within the threshold value or the travel time is less than the threshold value, and the time information is time information where the time difference is within the threshold value or less than the threshold value from the time specified by the target time information. It is.
  • the first position condition may be a condition regarding position information and the moving direction of the moving object.
  • the first position condition may be a condition regarding position information and the orientation (direction) of the camera.
  • the second position condition is position information that has an approximate relationship with the reference position or reference area to be compared.
  • the approximate relationship here is that the distance to the reference position is within the threshold, the distance to the reference position is less than the threshold, or the position is within the reference area.
  • the video acquisition unit 133 acquires a video transmitted from the mobile terminal 2, which is, for example, a video shot by each of two or more mobile terminals 2, and which is associated with an attribute value set and a right holder identifier. It is preferable that the video acquisition unit 133 acquires videos that satisfy the storage conditions.
  • the storage conditions are conditions for storing videos.
  • the storage condition is, for example, that a condition specified by the inquiry is met.
  • the storage condition is, for example, that the storage condition, which will be described later, is met.
  • the device storing the video to be acquired may be the mobile terminal 2, the information processing device 1, or another device not shown.
  • the other device is, for example, a device that configures a blockchain.
  • the video acquisition unit 133 acquires one or more videos corresponding to the inquiry from the mobile terminal 2.
  • the video acquisition unit 133 acquires from the mobile terminal 2, for example, one or more videos that are paired with an attribute value set that satisfies the conditions related to the environmental information included in the inquiry.
  • the video acquisition unit 133 transmits an inquiry to one or more mobile terminals 2, and receives one or more videos corresponding to the inquiry from the one or more mobile terminals 2.
  • Such processing is called unregistered video search processing.
  • the unregistered video search process is a process of acquiring videos that match the conditions from unregistered videos stored in the mobile terminal 2.
  • the unregistered video search process is, for example, a process of acquiring a video that matches an inquiry from unregistered videos stored in the mobile terminal 2.
  • the video acquisition unit 133 acquires, for example, a video corresponding to the inquiry among videos shot by one or more mobile terminals 2 corresponding to the movement information.
  • the video acquisition unit 133 transmits an inquiry to one or more mobile terminals 2 corresponding to the movement information, and receives a video matching the inquiry from the mobile terminal 2.
  • the mobile terminal 2 corresponding to the movement information is a mobile terminal 2 that is moving and is a mobile terminal 2 that can transmit moving images.
  • the video acquisition unit 133 determines one or more attribute value sets that match the inquiry, and stores the video corresponding to each of the one or more attribute value sets. Obtained from section 11.
  • the video acquisition unit 133 refers to the set storage unit 111 , determines one or more videos corresponding to the inquiry, and acquires the one or more videos from the mobile terminal 2 .
  • the process of referring to the set storage unit 111 and determining the video corresponding to the inquiry is to determine the attribute value set that matches the inquiry among the one or more attribute value sets that the set storage unit 111 has.
  • This process is called registered video search process.
  • the registered video search process is a process of searching registered videos for videos that match conditions.
  • the registered video search process is, for example, a process of searching registered videos for a video that matches an inquiry. Note that the registered video is a video that has been subjected to first maintenance processing or second maintenance processing, which will be described later.
  • the video acquisition unit 133 refers to the set storage unit 111, determines a video corresponding to the inquiry, determines whether the video is in a state that can be transmitted from the mobile terminal 2, and determines whether the video is in a state where it can be transmitted. , acquires a video from the mobile terminal 2.
  • the video acquisition unit 133 attempts communication with the mobile terminal 2 and can receive information from the mobile terminal 2, it determines that the video can be transmitted from the mobile terminal 2. For example, the video acquisition unit 133 determines whether or not movement information corresponding to the mobile terminal 2 is stored in the storage unit 11, and if it is stored, determines that the video is ready to be transmitted from the mobile terminal 2. do.
  • the state in which a moving image can be transmitted is, for example, a state in which the mobile terminal 2 or a mobile body corresponding to the mobile terminal 2 is powered on (for example, a state in which the engine of a car that is a mobile body is turned on).
  • the method by which the video acquisition unit 133 determines whether or not a video can be transmitted is not limited.
  • the video acquisition unit 133 acquires a video associated with an attribute value set that satisfies the maintenance condition from the mobile terminal 2. Through this process, videos can be automatically acquired.
  • Preservation conditions are conditions for storing videos.
  • a maintenance condition is a condition regarding an attribute value set.
  • the maintenance condition is a condition regarding one or more tags.
  • the preservation conditions include, for example, that the attribute value set includes a tag indicating "accident,” that the attribute value set includes a tag indicating "traffic jam,” and that the attribute value set includes a tag indicating a specific location.
  • a tag indicating a specific place is, for example, the name of a specific parking lot, the name of a specific place, the name of a specific scenic spot, or the name of a specific landscape.
  • the maintenance condition corresponds to an attribute value set that satisfies a predetermined condition for an attribute value set corresponding to one or more videos stored in a predetermined device or area (for example, the storage unit 11). It must be a video.
  • the predetermined condition is, for example, that the attribute value included in the attribute value set does not exist in the attribute value set corresponding to one or more moving images stored in a predetermined device or area.
  • the video acquisition unit 133 may acquire a processed image obtained by processing a video captured by the mobile terminal 2.
  • a processed image is, for example, a around-view image.
  • the around view image is an image displayed on the around view monitor.
  • the around-view image is an image that appears to be taken from directly above an area including a moving object.
  • the video composition unit 134 composes one video using two or more videos acquired by the video acquisition unit 133. Composing one moving image may be accomplished by sequentially passing parts of the moving image that appear to be one moving image from the user to the moving image transmitting unit 141.
  • the video composition unit 134 temporally combines two or more videos that have different time information associated with the two or more videos acquired by the video acquisition unit 133, and configures one video.
  • Two or more moving images may be temporally combined to form one moving image by sequentially passing the two or more moving images to the moving image transmitting unit 141.
  • composing one moving image by temporally combining two or more moving images only requires that the user view them as one moving image.
  • the video composition unit 134 combines two or more videos acquired by the video acquisition unit 133 in the order of time corresponding to the videos, and configures one video.
  • the video composition unit 134 acquires parts of two or more videos acquired by the video acquisition unit 133, and sequentially combines the parts of each video to form one video.
  • Temporally combining two or more moving images usually means sequentially combining parts of the moving images shot by two or more mobile terminals 2. Sequentially combining parts of the videos may also be done by sequentially passing the parts of the videos to the video transmitter 141.
  • Combining videos in the time order corresponding to the videos means combining videos in the time order indicated by time information corresponding to the videos, or combining videos in the order in which the videos are received.
  • the video composition unit 134 configures one video by spatially fusing parts of two or more videos that have different position information associated with the two or more videos acquired by the video acquisition unit 133.
  • the video composition unit 134 configures one frame using part or all of the frames constituting each of the two or more videos acquired by the video acquisition unit 133, and temporally connects the frames to create one video. Configure.
  • the video composition unit 134 processes two or more videos acquired by the video acquisition unit 133 to compose one video.
  • the video composition unit 134 spatially connects frames directly above the frames that are included in videos shot by two or more mobile terminals 2 installed in two or more mobile objects, and configures one frame. , constitute one moving image having one frame.
  • the video composition unit 134 composes two or more around-view images to construct a wide-area around-view image.
  • the right holder processing unit 135 performs right holder processing.
  • the right holder process is a process related to a right holder identified by a right holder identifier associated with one video configured by the video composition unit 134.
  • the right holder processing unit 135 performs right holder processing, which is processing in response to the video transmission unit 141 transmitting a video, and is processing related to the right holder identified by the right holder identifier associated with the video, for example.
  • the right holder processing is, for example, a first maintenance processing described later, a second maintenance processing described later, a third maintenance processing described later, a fourth maintenance processing described later, and a reward processing described later.
  • the video transmitted by the video transmitting section 141 is an image composed by the video composition section 134.
  • the right holder identifier associated with one video is, for example, the right holder identifier associated with each of two or more videos that are the source of one composed video, or the identifier of the user who requested the one video. be.
  • the right holder processing unit 135 stores the video acquired by the video acquisition unit 133 in association with the right holder identifier. It is preferable that the right holder processing unit 135 stores only the video that the video acquisition unit 133 has acquired, assuming that the storage condition is satisfied. Further, it is preferable that the right holder processing unit 135 does not store videos that do not satisfy the storage conditions.
  • the right holder processing unit 135 acquires status information regarding the state. do.
  • Status information is information regarding the state in which a video cannot be transmitted.
  • the status information is, for example, information indicating the status of the mobile terminal 2 that holds the video. Status information includes, for example, ⁇ The video exists, but it is not currently in a state where it can be sent to you.'' ⁇ The video exists on Mr. ___'s mobile terminal, but it is not currently in a state where it can be sent to you. ”.
  • the status information is, for example, information indicating that the power of the mobile terminal 2 is OFF, or information indicating that the power of the mobile terminal 2 is ON.
  • the right holder processing unit 135 acquires needs information when the video acquisition unit 133 determines that the mobile terminal 2 holding the video corresponding to the inquiry is unable to transmit the video.
  • Needs information is information indicating that there is a need for videos.
  • the needs information is, for example, "Your XXX video is requested by another user.” "Another user is requesting your XXX video for XX yen.”
  • the first preservation means 1351 performs a first preservation process of accumulating one moving image composed by the moving image composition unit 134 in association with attribute value sets associated with two or more moving pictures that are the basis of the one moving picture. conduct.
  • the first maintenance unit 1351 may perform a first maintenance process in which a video received from the mobile terminal 2 is stored in association with an attribute value set associated with the video.
  • the second preservation means 1352 performs a second preservation process of storing one moving image composed by the moving image composition unit 134 in association with the right holder identifier corresponding to each of the two or more videos that are the source of the one moving image. conduct.
  • the first preservation means 1351 or the second preservation means 1352 stores a single video constructed by the video composition unit 134, an attribute value set associated with each of two or more videos that are the source of the one video, and the corresponding The information may be stored in association with right holder identifiers corresponding to two or more videos that are the source of one video.
  • the third storage unit 1353 stores one video composed by the video composition unit 134 in association with the right holder identifier that identifies the user of the user terminal 3.
  • the user of the user terminal 3 here is a person who watches one video.
  • the user terminal 3 here is, for example, the terminal that transmitted the inquiry.
  • the destination for storing one video is, for example, the storage unit 11, but it may be other devices, other devices configuring the blockchain, or the like.
  • the fourth preservation means 1354 performs a fourth preservation process of accumulating preservation information including access information for accessing one stored moving image.
  • the order of storing a video and performing the fourth maintenance process on the maintenance information corresponding to the video does not matter.
  • the fourth security means 1354 is configured by the video composition unit 134 and performs a fourth security process of storing security information including access information for accessing one stored video in the blockchain.
  • the fourth security means 1354 it is preferable for the fourth security means 1354 to store security information in a blockchain. In other words, it is preferable for the fourth security means 1354 to store security information in a blockchain distributed ledger. It is preferable that the fourth security means 1354 register security information as an NFT (non-fungible token). It is preferable that the fourth security means 1354 register the security information in a distributed file system in an IPFS (Inter Planetary File System) network.
  • NFT non-fungible token
  • the maintenance information is the heading information of the video.
  • the maintenance information is, for example, access information and one or more video attribute values.
  • the security information includes, for example, one or more right holder identifiers.
  • the preservation information has two or more right holder identifiers
  • the right holder of the video may be shared, or the two or more right holder identifiers may be right holder history information.
  • the right holder history information is a set of right holder identifiers, and is information indicating the history of the right holder.
  • the fourth preservation process ensures the originality of the preservation information of the registered video.
  • the access information is information for accessing a video.
  • the access information is information that specifies the storage destination of the video.
  • the access information is, for example, a URL or a URI.
  • the maintenance information includes information (which may also be called a flag) indicating whether or not the video can be provided to a third party.
  • the flag is, for example, information indicating that a third party can view the item, information indicating that the item can be sold, or information indicating that neither viewing nor sale is permitted.
  • the remuneration unit 1355 performs remuneration processing for each right holder identified by the right holder identifier associated with each of the two or more videos that are the basis of one video composed by the video composition unit 134.
  • Reward processing is the process of giving a reward.
  • the reward process is, for example, a process of increasing points managed in pairs with one or more right holder identifiers associated with a video.
  • the remuneration process is, for example, a process of depositing money to a rights holder identified by one or more rights holder identifiers associated with a video.
  • the reward process is, for example, a process of transmitting a video or other content to the user terminal 3 of the right holder identified by one or more right holder identifiers associated with the video.
  • the content of the reward process does not matter as long as it provides a benefit to the right holder identified by one or more right holder identifiers associated with the video.
  • the reward may be, for example, money, points, goods, content, etc., and the content thereof does not matter.
  • the reward means 1355 acquires one or more video attribute values corresponding to each of the two or more videos that are the source of the one video transmitted by the video transmitter 141, and uses the one or more video attribute values to , it is preferable to perform a remuneration process, which is a process of determining remuneration for each of two or more right holders and giving the remuneration.
  • the one or more video attribute values here include, for example, the data amount of the video, the time of the video, the number of frames of the video, and the resolution of the video.
  • the remuneration means 1355 performs remuneration processing, which is a process of obtaining a remuneration amount corresponding to a service identifier that identifies a service performed on the target video, and giving a remuneration corresponding to the remuneration amount.
  • remuneration processing which is a process of obtaining a remuneration amount corresponding to a service identifier that identifies a service performed on the target video, and giving a remuneration corresponding to the remuneration amount.
  • the service identifiers are, for example, "browse" and "purchase.”
  • the storage unit 11 stores the amount of remuneration corresponding to the service identifier or information for determining the amount of remuneration corresponding to the service identifier.
  • the remuneration unit 1355 obtains a remuneration amount using, for example, one or more information of one or more video attribute values and a service identifier, and provides remuneration that corresponds to the remuneration amount. Perform processing.
  • the storage unit 11 stores arithmetic expressions or correspondence tables corresponding to two or more service identifiers.
  • the calculation formula is a formula for calculating the amount of reward using one or more video attribute values as parameters.
  • the correspondence table is a table having two or more pieces of correspondence information that manage reward amounts corresponding to one or more video attribute values.
  • the remuneration means 1355 normally performs a process of making the user who has enjoyed the service related to the target video bear the remuneration.
  • the process of paying the reward is, for example, the process of paying the amount of the acquired reward.
  • the process of making the reward payable is, for example, a process of making the operator of the information processing device 1 pay the amount of the acquired reward and the profit earned by the operator of the information processing device 1.
  • the process of charging the reward includes, for example, a process of deducting points corresponding to a user who has enjoyed a service, a payment process using the user's credit card number, and the like.
  • the transmitter 14 transmits various information or instructions to the mobile terminal 2, user terminal 3, or navigation terminal 5.
  • Various types of information or instructions include, for example, videos, inquiries, status information, and needs information.
  • the video transmission unit 141 transmits one video composed by the video composition unit 134.
  • the video transmitter 141 transmits the one video to the user terminal 3. It is preferable that the video transmitter 141 transmits a video in response to receiving an inquiry.
  • the video transmitter 141 transmits a video to the user terminal 3 or the navigation terminal 5, for example. Transmitting one moving image may also mean that the moving image transmitting unit 141 sequentially transmits a portion of the one moving image that has been passed to it.
  • the video transmission unit 141 transmits the video acquired by the video acquisition unit 133 to the user terminal 3, for example.
  • the status transmitting unit 142 transmits status information regarding the status to the user terminal 3 when the video cannot be transmitted. For example, the status transmitting unit 142 transmits the status information acquired by the right holder processing unit 135 to the user terminal 3.
  • the video acquisition unit 133 determines whether or not the video cannot be transmitted.
  • the needs transmitting unit 143 transmits needs information indicating that there is a need for the video to the user corresponding to the video.
  • the needs transmitting unit 143 transmits, for example, the needs information acquired by the right holder processing unit 135 to the user corresponding to the video.
  • Sending the needs information to the user corresponding to the video means, for example, sending the needs information by e-mail to the destination of the e-mail address that is paired with the right holder identifier corresponding to the video.
  • Sending the needs information to the user corresponding to the video means, for example, sending the needs information as a short message to the destination of the telephone number that is paired with the right holder identifier corresponding to the video.
  • Transmitting to the user corresponding to the video means, for example, transmitting the needs information to the mobile terminal 2 paired with the right holder identifier corresponding to the video.
  • the user corresponding to the video is usually the right holder of the video.
  • a variety of information is stored in the mobile storage unit 21 that constitutes the mobile terminal 2.
  • Various types of information include, for example, a video, a set of attribute values, a right holder identifier, movement information indicating the start of movement, a combination of an attribute value tag condition and a tag, a combination of a video tag condition and a tag, one or more A maintenance condition, one or more pieces of acquisition information.
  • the movement storage unit 21 normally stores one or more pairs of attribute value tag conditions and tags.
  • the movement storage unit 21 normally stores one or more pairs of video tag conditions and tags.
  • one or more still images (which may also be referred to as fields or frames) that make up a moving image are associated with one or more moving image attribute values that make up an attribute value set.
  • One or more moving image attribute values may be associated with all still images, some still images, or two or more still images.
  • the attribute value tag condition is a condition for acquiring a tag based on one or more mobile object attribute values.
  • the attribute value tag condition is a condition regarding one or more mobile object attribute values.
  • Attribute value tag conditions include, for example, ⁇ a sudden brake was pressed'', ⁇ the degree of speed deceleration (acceleration) within a unit time is below a threshold (a sudden brake was pressed)'', ⁇ an airbag was pressed.'' ⁇ The speed has been lower than the first speed for a second period of time or more (congestion)''' ⁇ The location information corresponds to a specific name.
  • Tags paired with attribute value tag conditions are, for example, "abnormal driving,” “accident,” "traffic jam,” and "specific point name.”
  • Video tag conditions are conditions related to videos.
  • the video tag condition is a condition based on the video analysis result.
  • Video tag conditions include, for example, ⁇ having a still image of two or more cars in contact (an accident)'' and ⁇ there being a frame where the distance between two or more cars is 0 (cars are in contact)'' )" "The period during which there are vehicles equal to or greater than the first threshold within a predetermined distance is equal to or greater than the second threshold (congestion)" "Amount of change in distance between the center of gravity of the vehicle in front and the lane” The cumulative amount per unit time is greater than or equal to the threshold value (the car in front is driving in a meandering manner).
  • Tags paired with the video tag condition are, for example, “accident,” “traffic jam,” and “abnormal driving.”
  • Preservation conditions are conditions for preserving videos.
  • a maintenance condition is a condition regarding an attribute value set. Such preservation conditions include, for example, ⁇ the airbag has been activated (an accident has occurred)'', ⁇ a specific tag has been attached to the video (specific tags are, for example, ⁇ accident'' and ⁇ dangerous driving''). It is.
  • the maintenance conditions are associated with acquired information.
  • the acquisition information is information that specifies the video to be acquired.
  • the acquisition information is information that specifies the video to be acquired when the maintenance conditions are met.
  • Such maintenance conditions are, for example, ⁇ (1) The number of cars in the screen is above the first threshold & (2) The running speed of the cars is below the second threshold & The duration of (1) and (2) is above the third threshold (continuing traffic jams).”
  • the mobile receiving unit 22 receives various types of information.
  • Various types of information include, for example, inquiries, needs information, and videos captured by other mobile terminals 2.
  • the movement processing unit 23 performs various processes. Various types of processing are, for example, processing performed by the photographing section 231, the tag acquisition section 232, and the movement information acquisition section 233.
  • the movement processing unit 23 converts the information received by the movement reception unit 22 into a data structure to be output.
  • the movement processing unit 23 detects the start of movement, for example. Detection of the start of movement is, for example, detection of turning on the power of the mobile terminal 2 or detection of turning on the engine of the mobile object.
  • the movement processing unit 23 detects, for example, the end of movement. Detection of the end of movement is, for example, detection of power OFF of the mobile terminal 2 or detection of OFF of the engine of the mobile object.
  • the movement processing unit 23 determines an attribute value set that matches the inquiry received by the movement reception unit 22, and acquires a video that is paired with the attribute value set from the movement storage unit 21.
  • the movement processing unit 23 obtains, for example, a moving image from the start of movement to the end of movement.
  • the movement processing unit 23 obtains, for example, a moving image from the start of movement to the end of movement in association with the attribute value set obtained during movement.
  • the movement processing unit 23 acquires a set of attribute values during shooting, for example.
  • the movement processing unit 23 stores the acquired attribute value set in the movement storage unit 21.
  • the movement processing unit 23 associates the acquired attribute value set with a video, for example.
  • Associating with a video usually means associating with frames that make up the video. It is preferable that the attribute value set and the frame are temporally synchronized.
  • the attribute value set is, for example, one or more pieces of environmental information.
  • the environmental information is, for example, location information, time information, weather information, temperature information, and seasonal information.
  • the movement processing unit 23 acquires position information, for example, during shooting.
  • the movement processing unit 23 acquires position information, for example, at all times, every predetermined period, or when acquisition conditions are met.
  • Acquisition conditions are conditions for acquiring information.
  • the acquisition conditions include, for example, when it is detected that an accident has occurred, when a traffic jam is detected, or when there is a change in weather information.
  • the movement processing unit 23 acquires time information from a clock (not shown) during shooting.
  • the movement processing unit 23 acquires time information, for example, at all times, every predetermined period, or when acquisition conditions are met.
  • the movement processing unit 23 acquires time information from a clock (not shown) and acquires seasonal information corresponding to the time information.
  • the movement processing unit 23 acquires weather information, for example, during shooting.
  • the movement processing unit 23 obtains weather information corresponding to position information from a server (not shown), for example.
  • the movement processing unit 23 acquires weather information, for example, at all times, every predetermined period, or when acquisition conditions are met.
  • the movement processing unit 23 acquires temperature information, for example, during shooting.
  • the movement processing unit 23 obtains, for example, temperature information corresponding to position information from a server (not shown).
  • the movement processing unit 23 acquires temperature information from a temperature sensor installed on the moving body, for example.
  • the movement processing unit 23 acquires temperature information, for example, at all times, every predetermined period, or when acquisition conditions are met.
  • the movement processing unit 23 determines, for example, whether the acquired attribute value set matches the maintenance condition.
  • the movement processing unit 23 determines, for example, whether or not the acquired time-series attribute value set matches a maintenance condition. For example, when the maintenance condition is met, the movement processing unit 23 acquires the video corresponding to the attribute value set. For example, when the maintenance condition is met, the movement processing unit 23 acquires a video corresponding to the maintenance condition. For example, when the maintenance condition is met, the movement processing unit 23 acquires the acquisition information paired with the maintenance condition, and acquires the video according to the acquisition information.
  • the movement processing unit 23 is equipped with a microphone, for example, acquires sound information, and stores the sound information in association with the moving image acquired by the photographing unit 231.
  • a function is, for example, a function of a drive recorder.
  • the photographing unit 231 photographs a moving image. For example, the photographing unit 231 starts photographing after detecting the start of movement. Further, it is preferable that the photographing unit 231 continues photographing, for example, until the end of movement is detected.
  • the photographing section 231 accumulates the photographed moving images in the movable storage section 21.
  • the photographing unit 231 When storing moving images in the mobile storage unit 21 having a limited storage capacity, it is preferable for the photographing unit 231 to overwrite an area where an old moving image is stored with a new moving image.
  • the structure of the mobile storage unit 21 is a ring buffer structure.
  • the tag acquisition unit 232 acquires one or more tags for the video captured by the photography unit 231 and associates them with the video.
  • the tag acquisition unit 232 analyzes a video shot by the imaging unit 231 and acquires one or more tags for the video.
  • the tag acquisition unit 232 acquires one or more tags using, for example, one or more moving object attribute values acquired during photography by the photography unit 231.
  • the mobile object attribute value is, for example, CAN data.
  • the tag acquisition unit 232 determines one or more still images that match the video tag condition, and acquires the tag that pairs with the video tag condition. Furthermore, the tag acquisition unit 232 may associate the tag with the one or more still images. Note that a still image is a frame that constitutes a moving image.
  • the tag The acquisition unit 232 analyzes frames included in the video, recognizes two or more cars, and acquires the distance between each of the two or more cars. Furthermore, the tag acquisition unit 232 acquires the number of cars whose intervals are within a threshold value. Furthermore, the tag acquisition unit 232 acquires the moving distance and frame rate of one vehicle in two or more frames, and acquires the speed of the vehicle.
  • the tag acquisition unit 232 uses the number of cars within which the distance between cars is within a threshold value and the speed of the cars to determine whether the video tag condition is met. If the video tag condition is met, the tag acquisition unit 232 acquires the tag "traffic jam" that pairs with the video tag condition. Further, the tag acquisition unit 232 may associate the tag "traffic jam" with the analyzed frame of the analyzed video.
  • the tag acquisition unit 232 determines one or more mobile object attribute values that match the attribute value tag condition, and acquires a tag that pairs with the attribute value tag condition. Furthermore, the tag acquisition unit 232 may associate the tag with the video that is paired with the one or more moving object attribute values.
  • the tag paired with the attribute value tag condition is “driving time at a speed of less than 30 km for 10 minutes or more & the ratio of speed less than 30% during the said traveling time is 80% or more”
  • the tag paired with the attribute value tag condition is In the case of "traffic jam”
  • the tag acquisition unit 232 detects CAN data that matches the attribute value tag condition using the speed history of the CAN data associated with each field of the video, and The tag "traffic jam" paired with the attribute value tag condition is acquired, and the tag is associated with the field associated with the CAN data.
  • the CAN data associated with each field included in the video is CAN data acquired at the same timing as the field was photographed.
  • the movement information acquisition unit 233 detects movement of the mobile terminal 2, and acquires movement information, for example, at the start of the movement.
  • the movement information acquisition unit 233 acquires movement information that is the right holder identifier of the movement storage unit 21, for example.
  • the movement information acquisition unit 233 acquires movement information from the movement storage unit 21, for example. Note that the movement information is, for example, a right holder identifier and information indicating that the movement has started.
  • the mobile transmitter 24 transmits various types of information to the information processing device 1.
  • Various types of information include, for example, movement information, moving images, and attribute value sets.
  • the movement information transmitting unit 241 normally transmits movement information specifying that the mobile terminal 2 is moving to the information processing device 1 at the start of movement.
  • the movement information transmitting unit 241 transmits the movement information acquired by the movement information acquisition unit 233 to the information processing device 1.
  • the moving video transmitting unit 242 transmits the video captured by the imaging unit 231 to the information processing device 1.
  • the timing at which the moving video transmitter 242 transmits the video does not matter.
  • the moving video transmitting unit 242 transmits the video to the information processing device 1 after the moving processing unit 23 acquires a video that is paired with the attribute value set that matches the received inquiry.
  • the moving video transmitter 242 detects the end of the move, it transmits the videos accumulated since the start of the move was detected to the information processing device 1 .
  • the moving video transmitting unit 242 transmits a video corresponding to the determination to the information processing device 1.
  • the movement transmitting unit 24 transmits the moving image photographed by the photographing unit 231 to the information processing device 1, it is preferable that the movement transmitting unit 24 does not transmit the sound information acquired by the movement processing unit 23.
  • the sound information may be, for example, the voice information of the driver or passenger in the moving body, and it is the driver's or passenger's responsibility to transmit such sound information to the information processing device 1 and provide it to the user terminal 3 etc. This is because it may threaten the privacy of passengers and is not appropriate.
  • the set transmitting unit 243 transmits the attribute value set in the movement storage unit 21 to the information processing device 1.
  • the set transmitting unit 243 transmits the attribute value set in the movement storage unit 21 to the information processing device 1, for example, when the movement of the mobile terminal 2 ends. Note that, once the set transmitting unit 243 acquires the attribute value set, it may immediately transmit the attribute value set to the information processing device 1. In other words, the timing at which the set transmitter 243 transmits the attribute value set does not matter.
  • a variety of information is stored in the user storage unit 31 that constitutes the user terminal 3.
  • Various types of information include, for example, a user identifier and a video.
  • the user reception unit 32 receives various instructions and information.
  • Various instructions and information include, for example, inquiries and purchase instructions.
  • the purchase instruction is an instruction to purchase a video.
  • the purchase instruction is associated with a user identifier.
  • Purchase instructions typically include information that identifies the video.
  • the purchase instruction includes, for example, a video identifier.
  • the purchase instruction includes, for example, an inquiry.
  • the purchase instruction includes, for example, purchase conditions.
  • the purchase condition is, for example, the purchase amount.
  • the purchase conditions include, for example, information specifying the rights period.
  • Any means for inputting various instructions and information may be used, such as a touch panel, keyboard, mouse, or menu screen.
  • the user processing unit 33 performs various processes.
  • the various processes are, for example, processes for converting various instructions and information received by the user reception unit 32 into a data structure to be transmitted.
  • Various types of processing are, for example, processing for creating a structure for transmitting information received by the user receiving unit 35.
  • the user transmitter 34 transmits various instructions and information to the information processing device 1.
  • Various instructions and information include, for example, inquiries, purchase instructions, location information received from the target terminal 4, and route information received from the navigation terminal 5.
  • the user receiving unit 35 receives various information and instructions.
  • Various types of information and instructions include, for example, inquiries, videos, and status information.
  • the user output unit 36 outputs various information.
  • Various types of information include, for example, moving images and status information.
  • output means displaying on a display, projecting using a projector, printing on a printer, outputting sound, sending to an external device, storing on a recording medium, sending to other processing devices or other programs, etc.
  • This is a concept that includes the delivery of processing results.
  • the target terminal 4 acquires and transmits location information that specifies the location of the target terminal 4.
  • the target terminal 4 transmits position information to the information processing device 1 or the user terminal 3, for example. It is preferable that the target terminal 4 transmits the location information in pairs with the target person identifier.
  • a subject identifier is information that identifies a monitoring target.
  • the target person identifier is, for example, an ID, a name, a telephone number, an email address, and a MAC address of the target terminal 4.
  • the target terminal 4 acquires location information using, for example, a GPS receiver, but any method of acquiring location information may be used.
  • the navigation terminal 5 has the functions of a known navigation terminal.
  • the navigation terminal 5 receives input of a destination, acquires the current position, and acquires route information from the current position to the destination. For example, the navigation terminal 5 transmits the received destination. For example, the navigation terminal 5 transmits the acquired route information.
  • the destination or route information is transmitted to, for example, the information processing device 1 or the user terminal 3.
  • the navigation terminal 5 may receive the destination from the user terminal 3 and obtain route information from the current location to the destination.
  • the storage unit 11, collective storage unit 111, mobile storage unit 21, and user storage unit 31 are preferably non-volatile recording media, but can also be implemented using volatile recording media.
  • information may be stored in the storage unit 11 or the like via a recording medium, or information transmitted via a communication line or the like may be stored in the storage unit 11 or the like.
  • information input via an input device may be stored in the storage unit 11 or the like.
  • the receiving unit 12, mobile information receiving unit 121, inquiry receiving unit 122, collective receiving unit 123, mobile receiving unit 22, and user receiving unit 35 are usually realized by wireless or wired communication means, but are not used for receiving broadcasts. It may be realized by means of.
  • the four maintenance means 1354, the reward means 1355, the movement processing section 23, the tag acquisition section 232, the movement information acquisition section 233, and the user processing section 33 can usually be realized by a processor, memory, or the like.
  • the processing procedures of the processing unit 13 and the like are usually realized by software, and the software is recorded on a recording medium such as a ROM. However, it may be realized by hardware (dedicated circuit). Note that the processor may be a CPU, MPU, GPU, etc., and its type does not matter.
  • video acquisition unit 133 and the right holder processing unit 135 may be realized by wireless or wired communication means.
  • the transmitting section 14, the moving image transmitting section 141, the status transmitting section 142, the needs transmitting section 143, the movement transmitting section 24, the moving information transmitting section 241, the moving moving image transmitting section 242, the collective transmitting section 243, and the user transmitting section 34 usually Although it is realized by wireless or wired communication means, it may also be realized by broadcasting means.
  • the photographing unit 231 is realized by a camera.
  • the camera may be, for example, a CCD camera, a CMOS camera, a 3D camera, a LiDAR, or an omnidirectional camera, but the type thereof does not matter.
  • the user reception unit 32 may be realized by a device driver for input means such as a touch panel or a keyboard, control software for a menu screen, or the like.
  • the user output unit 36 may or may not include output devices such as a display and a speaker.
  • the user output unit 36 may be realized by output device driver software, output device driver software and the output device, or the like.
  • Step S401 The movement information receiving unit 121 determines whether or not movement information associated with the right holder identifier has been received from the mobile terminal 2. If the movement information is received, the process goes to step S402, and if the movement information is not received, the process goes to step S403.
  • Step S402 The movement information receiving unit 121 stores the movement information received in step S401 in the storage unit 11 in association with the right holder identifier. Return to step S401. Note that when the movement information is a right holder identifier, the movement information receiving unit 121 stores the right holder identifier.
  • Step S403 The set reception unit 123 determines whether or not the set of attribute values associated with the right holder identifier has been received from the mobile terminal 2. If the attribute value set is received, the process goes to step S404; if not, the process goes to step S406.
  • Step S404 The set storage unit 132 stores the attribute value set received in step S403 in the set storage unit 111 in association with the right holder identifier.
  • Step S405 The processing unit 13 deletes the movement information associated with the right holder identifier from the storage unit 11. Return to step S401. Note that deleting the movement information has the same meaning as "rewriting the movement information with information indicating that the user is not in a state where a video can be transmitted.”
  • Step S406 The receiving unit 12 determines whether or not a video etc. associated with the right holder identifier has been received from the mobile terminal 2. If a moving image or the like has been received, the process proceeds to step S407; if not, the process proceeds to step S410.
  • Step S407 The processing unit 13 performs a process of acquiring an attribute value set corresponding to the video received in step S406.
  • An example of such attribute value set acquisition processing will be described using the flowchart of FIG. 5. Further, the attribute value set acquisition process here may be a process of acquiring an attribute value set associated with the received video.
  • the first preservation means 1351 stores the video received in step S406 in association with the attribute value set obtained in step S407. Note that the first preservation means 1351 stores the video in the storage unit 11, for example, but it may also store the video in another device such as a device configuring a blockchain. Further, the process in which the first preservation means 1351 stores moving images is a first preservation process.
  • Step S409 The fourth maintenance means 1354 performs a fourth maintenance process. Return to step S401. Note that an example of the fourth maintenance process will be explained using the flowchart of FIG. 8.
  • Step S410 The inquiry receiving unit 122 determines whether or not an inquiry has been received. If an inquiry is received, the process goes to step S411; if not, the process goes to step S414. Note that the inquiry receiving unit 122 normally receives an inquiry from the user terminal 3 or the navigation terminal 5. Note that the navigation terminal 5 that transmits the inquiry may be the user terminal 3.
  • Step S411 The video acquisition unit 133 determines whether the received inquiry is a real-time video search. If it is a real-time video search, the process goes to step S412, and if it is not a real-time video search, the process goes to step S415. Note that such a determination can be made by inspecting the received inquiry.
  • the real-time video search is a process in which the mobile terminal 2 searches for videos currently held or videos being shot.
  • Step S412 The video acquisition unit 133 determines whether the received inquiry requires spatial fusion of two or more videos. If spatial fusion is necessary, the process proceeds to step S413, and if spatial fusion is not necessary, the process proceeds to step S414. Note that such a determination can be made by inspecting the received inquiry.
  • Step S413 The video acquisition unit 133, video composition unit 134, etc. perform video fusion processing. Go to step S418.
  • the video fusion process is a process of spatially merging two or more videos to obtain and transmit an image having one or more frames. An example of video fusion processing will be explained using the flowchart of FIG. 9.
  • Step S414 The video acquisition unit 133, video composition unit 134, etc. perform video combination processing. Go to step S418.
  • the video combining process is a process of transmitting a single video in which two or more videos are combined. An example of video combining processing will be described using the flowchart of FIG. 11.
  • Step S415) The video acquisition unit 133 and the like perform registered video search processing.
  • An example of registered video search processing will be described using the flowchart of FIG. 12. Note that here, the video acquisition unit 133 may not be able to acquire the video.
  • Step S416 The video acquisition unit 133 determines whether the video was successfully acquired in step S415. If the video could be acquired, the process goes to step S417; if the video could not be acquired, the process goes to step S418.
  • Step S417) The video acquisition unit 133 performs an unregistered video search process.
  • An example of the unregistered video search process will be described using the flowcharts of FIGS. 13 and 14. Note that here, the video acquisition unit 133 may not be able to acquire the video.
  • Step S4128 The right holder processing unit 135 performs maintenance processing. Return to step S401. An example of the maintenance process will be explained using the flowchart of FIG. 15.
  • Step S419) The receiving unit 12 determines whether a purchase instruction has been received from the user terminal 3. If a purchase instruction has been received, the process proceeds to step S420; if not, the process returns to step S401.
  • the video acquisition unit 133 acquires a video corresponding to the purchase instruction.
  • the video acquisition unit 133 receives, for example, a video corresponding to the purchase instruction from the mobile terminal 2. Further, the video acquisition unit 133 acquires, for example, a video corresponding to the purchase instruction from registered videos. The video acquisition unit 133 may, for example, acquire the video corresponding to the purchase instruction from unregistered videos.
  • Step S421 The fourth security means 1354 acquires the user identifier corresponding to the user terminal 3 that sent the purchase instruction. Note that this user identifier becomes a rights holder identifier for the purchased video.
  • Step S422 The fourth maintenance means 1354 performs the fourth maintenance process using the user identifier acquired in step S416.
  • An example of the fourth maintenance process will be explained using the flowchart of FIG. 8.
  • Step S423 The remuneration means 1355 performs remuneration processing to the original rights holder of the video to be purchased. Return to step S401. An example of reward processing will be explained using the flowchart of FIG. 16.
  • the receiving unit 12 receives location information from each of the two or more mobile terminals 2 that identifies the current location of the mobile terminal 2 by pairing it with the identifier of the mobile terminal 2 (for example, a right holder identifier). It is preferable to receive and temporarily store the information.
  • the frequency and time interval at which the receiving unit 12 receives and temporarily stores position information are not limited.
  • the receiving unit 12 may receive position information continuously from the user terminal 3, the target terminal 4, or the navigation terminal 5, for example.
  • the information processing device 1 may receive the video acquired by the mobile terminal 2 using the received position information, and transmit it to the user terminal 3 or the navigation terminal 5, for example. Note that the frequency and time interval at which position information is continuously received does not matter.
  • the movement processing unit 23 or the set accumulation unit 132 acquires one or more pieces of environmental information associated with the target video.
  • the target video is a video for which video attribute values are to be acquired, and is, for example, a received video, a video that has been shot, or a video that is currently being shot.
  • the environmental information etc. may be only environmental information, or may be environmental information and one or more moving object attribute values.
  • Step S502 The movement processing unit 23 and the like acquire the right holder identifier associated with the received video.
  • Step S503 The movement processing unit 23 and the like determine whether or not to perform annotation processing on the video. If annotation processing is to be performed, the process proceeds to step S504; otherwise, the process proceeds to step S511. Note that it is assumed that whether or not to perform annotation processing is determined in advance. Further, it is preferable to annotate the video using either the information processing device 1 or the mobile terminal 2.
  • Step S504 The movement processing unit 23 etc. assigns 1 to the counter i.
  • Step S505 The movement processing unit 23 and the like determine whether the i-th annotation unit exists in the video. If the i-th annotation unit exists, the process goes to step S506; if it does not exist, the process goes to step S511.
  • a unit of annotation is a target for acquiring an annotation, and is, for example, one frame, a group of frames of a certain number, or a moving image of a certain period of time (for example, 5 seconds or 10 seconds).
  • Step S506 The movement processing unit 23 and the like determine whether or not to use the moving object attribute value during annotation. If the mobile object attribute value is to be used, the process goes to step S507, and if it is not to be used, the process goes to step S508. Note that it is assumed that whether or not to use the moving object attribute value during annotation is determined in advance.
  • Step S507 The movement processing unit 23 and the like performs a moving object attribute value tag acquisition process.
  • An example of the mobile object attribute value tag acquisition process will be described using the flowchart of FIG. 6.
  • Step S508 The movement processing unit 23 and the like determine whether to use a moving image during annotation. If a moving image is to be used, the process goes to step S509; if not, the process goes to step S510. Note that it is assumed that whether or not to use a video for annotation is determined in advance.
  • Step S509 The movement processing unit 23 and the like perform video tag acquisition processing. An example of video tag acquisition processing will be described using the flowchart of FIG. 7.
  • Step S510 The movement processing unit 23 etc. increments the counter i by 1. Return to step S505.
  • Step S511 The movement processing unit 23 and the like configures an attribute value set including one or more environment information, one or more tags, and a right holder identifier. Return to upper level processing.
  • the video may be divided into two or more inspection units, and the processes from step S501 to step S511 may be performed for each inspection unit.
  • step S507 an example of the mobile object attribute value tag acquisition process in step S507 will be described using the flowchart of FIG. 6.
  • Step S601 The movement processing unit 23 etc. assigns 1 to the counter i.
  • Step S602 The movement processing unit 23 and the like determine whether the i-th attribute value tag condition exists. If the i-th attribute value tag condition exists, the process advances to step S603; if it does not exist, the process returns to the upper level process.
  • Step S603 The movement processing unit 23 etc. obtains the i-th attribute value tag condition.
  • Step S604 The movement processing unit 23 or the like acquires one or more moving body attribute values used for determining the i-th attribute value tag condition.
  • Step S605 The movement processing unit 23 and the like determine whether the one or more moving body attribute values acquired in step S604 satisfy the i-th attribute value tag condition. If the attribute value tag condition is satisfied, the process goes to step S606; if not, the process goes to step S607.
  • Step S606 The movement processing unit 23 or the like acquires the tag that pairs with the i-th attribute value tag condition, and associates the tag with the corresponding video.
  • Associating tags with videos typically involves associating tags with fields that make up the video.
  • Step S607 The movement processing unit 23 etc. increments the counter i by 1. Return to step S602.
  • Step S701 The movement processing unit 23 etc. assigns 1 to the counter i.
  • Step S702 The movement processing unit 23 and the like determine whether the i-th video tag condition exists. If the i-th video tag condition exists, the process goes to step S703, and if it does not exist, the process returns to the upper level process.
  • Step S703 The movement processing unit 23 and the like acquire the i-th video tag condition.
  • Step S704 The movement processing unit 23 and the like acquire one or more video attribute values used for determining the i-th video tag condition.
  • Step S705 The movement processing unit 23 or the like determines whether the one or more moving body attribute values acquired in step S704 satisfy the i-th attribute value tag condition. If the attribute value tag condition is satisfied, the process goes to step S706; if not, the process goes to step S707.
  • Step S706 The movement processing unit 23 or the like acquires the tag that pairs with the i-th attribute value tag condition, and associates the tag with the corresponding video. Associating tags with videos typically involves
  • Step S707 The movement processing unit 23 etc. increments the counter i by 1. Return to step S702.
  • the fourth maintenance means 1354 acquires access information that specifies the storage destination of the video.
  • a moving image is, for example, a fused moving image or a combined moving image.
  • the fourth preservation means 1354 acquires the attribute value set corresponding to the accumulated video. If the stored video is a video composed of two or more source videos, the attribute value set corresponding to the video is the attribute value set of each of the two or more source videos.
  • the fourth preservation means 1354 configures preservation information including the access information obtained in step S801, the attribute value set obtained in step S802, and the right holder identifier of the video. Note that if a new right holder identifier has been acquired, the fourth preservation means 1354 configures preservation information including, for example, the new right holder identifier and the original right holder identifier. (Step S804) The fourth maintenance means 1354 accumulates the maintenance information configured in step S803. Return to upper level processing.
  • step S804 if maintenance information of the video corresponding to the maintenance information to be accumulated is accumulated, the maintenance information is overwritten with the maintenance information configured in step S803. By doing so, for example, the transition of video rights holders can be managed. Further, the fourth security means 1354 stores security information in a blockchain, for example.
  • step S413 an example of the video fusion process in step S413 will be described using the flowchart in FIG. 9.
  • the video acquisition unit 133 acquires reference position information.
  • the reference location information is, for example, location information included in a received inquiry.
  • the reference location information is, for example, the location information of the user terminal 3 or the target terminal 4.
  • the reference location information is, for example, one location information among the route information included in the inquiry.
  • the first location information is the first location information in the route information.
  • the position information is, for example, (latitude, longitude), but may also be a point name (for example, the name of a parking lot), a place name, etc.
  • Step S902 The video acquisition unit 133 assigns 1 to the counter i.
  • Step S903 The video acquisition unit 133 determines whether there is an i-th mobile terminal 2 that can transmit the video. If the i-th mobile terminal 2 exists, the process goes to step S904; if the i-th mobile terminal 2 does not exist, the process goes to step S908. Note that the mobile terminal 2 that can transmit videos is usually the mobile terminal 2 that is moving.
  • the mobile terminal 2 that is moving is the mobile terminal 2 that corresponds to the movement information stored in the storage unit 11. That is, the video acquisition unit 133, for example, refers to the storage unit 11 and determines whether or not the i-th movement information exists.
  • Step S904 The video acquisition unit 133 acquires the latest position information transmitted by the i-th mobile terminal 2.
  • Step S905 The video acquisition unit 133 determines whether the position information acquired in step S904 satisfies the second position condition with respect to the reference position information. If the second position condition is satisfied, the process goes to step S906, and if the second position condition is not satisfied, the process goes to step S907.
  • Step S906 The video acquisition unit 133 acquires an image from the i-th mobile terminal 2, pairs the image with the right holder identifier and position information of the i-th mobile terminal 2, and temporarily stores the image in a buffer (not shown). do.
  • the video acquisition unit 133 sends an inquiry to the i-th mobile terminal 2 that includes a type identifier (for example, "video”, “still image”, “around-view image”) that specifies the type of image requested. and receives an image corresponding to the inquiry from the i-th mobile terminal 2.
  • a type identifier for example, "video”, "still image”, “around-view image”
  • Step S907 The video acquisition unit 133 increments the counter i by 1. Return to step S903.
  • Step S908 The video composition unit 134 calculates the difference (distance) between each image temporarily stored in a buffer (not shown) and the reference position information.
  • the moving image composition unit 134 sorts the images in ascending order using the difference as a key.
  • the moving image composition unit 134 acquires a reference image.
  • the reference image is an image corresponding to reference position information.
  • the reference image is, for example, an image transmitted from the user terminal 3 located at the position of the reference position information. Note that this image is of a type identified by a type identifier that specifies the type of image requested.
  • Step S910 The video composition unit 134 assigns 1 to the counter j.
  • Step S911 The moving image composition unit 134 determines whether there is a j-th other image. If the j-th other image exists, the process goes to step S912, and if it does not exist, the process goes to step S914. Note that the other images are the images sorted in step S908.
  • Step S912 The moving image composition unit 134 performs image fusion processing.
  • An example of image fusion processing will be described using the flowchart of FIG. 10.
  • Step S913 The video composition unit 134 increments the counter j by 1. Return to step S911.
  • Step S914 The video composition unit 134 composes an image that clearly shows the position indicated by the reference position information in the fused image finally constructed in step S912, and temporarily stores it in a buffer (not shown). Note that this image is a fused image.
  • Step S915 The video transmitter 141 transmits the fused image configured in step S914. Note that the video transmitting unit 141 may transmit the fused image finally configured in step S912.
  • the destination of the fused image is usually the user terminal 3 that sent the inquiry.
  • Step S916 The video transmission unit 141 determines whether to end the transmission of the fused image. If the transmission of the fused image is to be completed, the process advances to step S917; otherwise, the process returns to step S901.
  • the video transmitter 141 determines to end the transmission of the fused image.
  • Step S917 The moving image composition unit 134 temporally combines the transmitted one or more fused images to form a fused moving image, and temporarily stores it in a buffer (not shown). Return to upper level processing.
  • step S912 an example of the image fusion process in step S912 will be described using the flowchart in FIG. 10.
  • Step S1001 The video composition unit 134 acquires a base image.
  • the first base image is the reference image acquired in step S909. Further, the base image is the base image updated in step S1005 in the previous loop from step S911 to step S913.
  • Step S1002 The video composition unit 134 acquires area information that specifies the area covered by the base image acquired in step S1001.
  • the region information is, for example, a set of positional information of vertices forming a polygon, or a set of positional information of two diagonal corners forming a rectangle.
  • Step S1003 The video composition unit 134 acquires the j-th other image in step S911.
  • Step S1004 The video composition unit 134 acquires area information that specifies the area covered by the other image acquired in step S1003.
  • Step S1005 The video composition unit 134 uses the area information of the base image and the area information of other images to determine an area in which another image is placed with respect to the base image, and Place the image and get the updated base image. Return to upper level processing.
  • step S414 an example of the video combining process in step S414 will be described using the flowchart in FIG. 11.
  • the video acquisition unit 133 acquires target position information.
  • the target location information is usually location information included in the inquiry.
  • the target location information is, for example, information that specifies a location close to the location indicated by the location information corresponding to the video to be acquired.
  • Step S1102 The video acquisition unit 133 assigns 1 to the counter i.
  • Step S1103 The video acquisition unit 133 determines whether there is an i-th mobile terminal 2 that can transmit the video. If the i-th mobile terminal 2 exists, the process goes to step S1104; if the i-th mobile terminal 2 does not exist, the process goes to step S1114. Note that the mobile terminal 2 that can transmit videos is usually the mobile terminal 2 that is moving. The mobile terminal 2 that is moving is the mobile terminal 2 that corresponds to the movement information stored in the storage unit 11.
  • the mobile terminal 2 that is moving is the mobile terminal 2 that corresponds to the movement information stored in the storage unit 11. That is, the video acquisition unit 133, for example, refers to the storage unit 11 and determines whether or not the i-th movement information exists.
  • Step S1104 The video acquisition unit 133 acquires the latest position information transmitted by the i-th mobile terminal 2.
  • Step S1105 The video acquisition unit 133 determines whether the location information of the i-th mobile terminal 2 satisfies the first location condition with respect to the target location information. If the first position condition is satisfied, the process goes to step S1106, and if the first position condition is not satisfied, the process goes to step S1110.
  • Step S1106 The video acquisition unit 133 acquires the video from the i-th mobile terminal 2, pairs the video with the right holder identifier and location information of the i-th mobile terminal 2, and temporarily stores the video in a buffer (not shown). do.
  • the video acquisition unit 133 transmits, for example, to the i-th mobile terminal 2 an inquiry including a type identifier (for example, "video" or "still image") that specifies the type of image requested, and The image corresponding to the i-th mobile terminal 2 may be received from the i-th mobile terminal 2.
  • a type identifier for example, "video” or "still image”
  • Step S1107) The video transmitter 141 transmits the video acquired in step S1106.
  • the video transmitter 141 normally transmits a video to the user terminal 3 that has transmitted the inquiry.
  • Step S1108 The video acquisition unit 133 acquires the position information of the target. Note that, for example, if the target terminal 4 transmitting the location information is moving, the target location information acquired here is different from the location information acquired in step S1101. However, if the target terminal 4 does not move or if an inquiry with fixed location information is received, the target location information acquired here is the same as the location information acquired in step S1101. be.
  • Step S1109 The video acquisition unit 133 acquires the updated position information of the i-th mobile terminal 2. Return to step S1105.
  • Step S1110 The video composition unit 134 determines whether there is a video that has been acquired by the i-th mobile terminal 2 and that has been transmitted. If the transmitted video exists, the process goes to step S1111, and if the transmitted video does not exist, the process goes to step S1113.
  • the video configuration unit 134 configures a combined video that includes the transmitted video that is the video acquired by the i-th mobile terminal 2, and uses the combined video as the right holder identifier of the i-th mobile terminal 2. In contrast, it is temporarily stored in a buffer (not shown).
  • the combined video is the video acquired by the i-th mobile terminal 2, and is the transmitted video.
  • the combined video in the process of step S1111 from the second time onwards in the loop process is the video acquired by the i-th mobile terminal 2 temporally next to the combined video acquired in the previous process, and is the video that was acquired by the i-th mobile terminal 2. This is a video that combines videos.
  • Step S1112 The video acquisition unit 133 assigns 1 to the counter i. Return to step S1103.
  • Step S1113 The video acquisition unit 133 increments the counter i by 1. Return to step S1103.
  • Step S1114 The video acquisition unit 133 determines whether to end the video combination process. If the process is to be completed, the process proceeds to step S1115, and if not, the process is to proceed to step S1116.
  • the video acquisition unit 133 determines to end the video combining process.
  • Step S1115 The video acquisition unit 133 then acquires the position information of the target.
  • the video acquisition unit 133 acquires, for example, the position information of the next target included in the route information included in the inquiry. Return to step S1103.
  • Step S1116 The video composition unit 134 concatenates the one or more combined videos configured in step S1111 in the order in which they were acquired, and configures a combined video to be stored.
  • the video composition unit 134 temporarily stores the combined video in a buffer (not shown) in pairs with two or more right holder identifiers and position information of the video that is the source of the combined video. Return to upper level processing.
  • Step S1201 The video acquisition unit 133 assigns 1 to the counter i.
  • Step S1202 The video acquisition unit 133 determines whether the i-th target position information is present in the received inquiry. If the i-th position information exists, the process goes to step S1203; if it does not exist, the process goes to step S1217.
  • Target location information is location information used to search for videos.
  • the target location information is, for example, one piece of location information in a received inquiry, or two or more pieces of location information included in route information in a received inquiry.
  • Step S1203 The video acquisition unit 133 acquires the i-th target position information in the received inquiry.
  • the video acquisition unit 133 acquires all maintenance information.
  • the video acquisition unit 133 acquires, for example, security information present on the blockchain.
  • Step S1205 The video acquisition unit 133 assigns 1 to the counter j.
  • Step S1206 The video acquisition unit 133 determines whether j-th maintenance information exists among the maintenance information acquired in step S1204. If the j-th maintenance information exists, the process goes to step S1207, and if it does not exist, the process goes to step S1216.
  • Step S1207 The video acquisition unit 133 inspects the j-th security information and determines whether the video corresponding to the j-th security information can be provided to a third party. If it can be provided, the process goes to step S1208; if it is not, the process goes to step S1215.
  • "providable” means, for example, that it can be viewed, that it can be sold, or that it can be viewed and sold.
  • Step S1208 The video acquisition unit 133 assigns 1 to the counter k.
  • Step S1209 The video acquisition unit 133 determines whether the k-th search unit exists in the j-th security information or the video corresponding to the j-th security information. If the k-th search unit exists, the process goes to step S1210, and if it does not exist, the process goes to step S1215.
  • the search unit is the amount of videos used to determine whether or not the query is satisfied.
  • the search unit videos include, for example, videos from the start of shooting to the end of shooting, videos for a certain period of time, videos until a predetermined event occurs (for example, videos whose speed is a moving object attribute value from 0 to the next Videos of speed up to 0, videos of leaving a permanent location (e.g. home parking lot) and returning to a permanent location), videos with predetermined tags (e.g. ⁇ accident'', ⁇ traffic jam''). This is a video of a predetermined period before and after the video was released.
  • the search unit does not matter.
  • Step S1210 The video acquisition unit 133 acquires a set of video attribute values for the k-th search unit from the j-th maintenance information.
  • Step S1211 The video acquisition unit 133 determines whether the set of video attribute values of the k-th search unit satisfies the first position condition for the i-th target position information. If the first position condition is satisfied, the process goes to step S1212, and if it is not satisfied, the process goes to step S1214.
  • Step S1212 The video acquisition unit 133 acquires the video etc. corresponding to the j-th maintenance information, and temporarily stores it in a buffer (not shown).
  • a moving image or the like is, for example, a set of a moving image and a moving image attribute value, or a moving image.
  • Step S1213 The video acquisition unit 133 increments the counter i by 1. Return to step S1202.
  • Step S1214 The video acquisition unit 133 increments the counter k by 1. Return to step S1209.
  • Step S1215) The video acquisition unit 133 increments the counter j by 1. Return to step S1206.
  • Step S1216 The video acquisition unit 133 increments the counter i by 1. Return to step S1202.
  • Step S1217) The video composition unit 134 determines whether two or more videos, etc. have been acquired in step S1212. If two or more moving pictures, etc. are acquired, the process goes to step S1218, and if only one moving picture, etc. is acquired, the process goes to step S1219.
  • the video composition unit 134 combines two or more videos stored in a buffer (not shown) in the order in which they were stored, forms a combined video, and stores the combined video in a buffer (not shown). Note that it is preferable that the video composition unit 134 also store the right holder identifier and video attribute value of the video that is the source of the combined video in a buffer (not shown) in association with the combined video.
  • Step S1219) The video transmitter 141 transmits the combined video or the acquired video. Return to upper level processing. Return to upper level processing.
  • step S1212 each time a video is acquired in step S1212, the video transmitter 141 may transmit the video. In such a case, the process of step S1219 is unnecessary.
  • the video transmitting unit 141 normally transmits the combined video or video to the user terminal 3 that sent the inquiry.
  • a first example of the unregistered video search process is a case where an attribute value set in the set storage section 111 is used.
  • Step S1301 The video acquisition unit 133 assigns 1 to the counter i.
  • Step S1302 The video acquisition unit 133 determines whether or not the i-th target position information exists in the received inquiry. If the i-th position information exists, the process goes to step S1303, and if it does not exist, the process goes to step S1320.
  • Step S1303 The video acquisition unit 133 acquires the i-th target position information in the received inquiry.
  • Step S1304 The video acquisition unit 133 assigns 1 to the counter j.
  • Step S1305 The video acquisition unit 133 determines whether the j-th attribute value set exists in the set storage unit 111. If the j-th attribute value set exists, the process goes to step S1303; if it does not exist, the process goes to step S1319.
  • Step S1306 The video acquisition unit 133 assigns 1 to the counter k.
  • Step S1307 The video acquisition unit 133 determines whether the kth search unit corresponding to the jth attribute value set exists. If the k-th search unit exists, the process goes to step S1308, and if it does not exist, the process goes to step S1313.
  • Step S1308 The video acquisition unit 133 acquires the set of video attribute values of the k-th search unit in the j-th attribute value set from the set storage unit 111.
  • Step S1309) The video acquisition unit 133 determines whether the set of video attribute values acquired in step S1308 satisfies the inquiry. If the inquiry is satisfied, the process goes to step S1310; otherwise, the process goes to step S1314.
  • Step S1310 The video acquisition unit 133 acquires the right holder identifier corresponding to the video.
  • Step S1311 The video acquisition unit 133 determines whether movement information corresponding to the right holder identifier acquired in step S1310 exists. If the movement information exists (for example, when the mobile terminal 2 is powered on), the process goes to step S1312, and if it does not exist (for example, when the mobile terminal 2 is powered off), the process goes to step S1315.
  • Step S1312 The video acquisition unit 133 acquires the video corresponding to the k-th search unit from the mobile terminal 2 corresponding to the right holder identifier acquired in step S1310, and temporarily stores it in a buffer (not shown). Note that, for example, the video acquisition unit 133 transmits a request for a video corresponding to the k-th search unit to the mobile terminal 2, and receives the video corresponding to the request from the mobile terminal 2.
  • Step S1313 The video acquisition unit 133 increments the counter j by 1. Return to step S1305.
  • Step S1314 The video acquisition unit 133 increments the counter k by 1. Return to step S1307.
  • the video acquisition unit 133 acquires status information and the like.
  • the status information and the like include, for example, status information indicating that the mobile terminal 2 is powered off.
  • Step S1316 The status transmitting unit 142 transmits the status information etc. acquired in step S1315 to the user who sent the inquiry.
  • Step S1317) The video acquisition unit 133 acquires needs information.
  • Step S13178 The needs transmitting unit 143 transmits the needs information acquired in step S1317 to the right holder of the video. Return to step S1313.
  • Step S1319) The video acquisition unit 133 increments the counter i by 1. Return to step S1302.
  • Step S1320 The video composition unit 134 determines whether or not two or more videos could be acquired in step S1312. If two or more videos can be acquired, the process goes to step S1321, and if only one video can be acquired, the process goes to step S1322.
  • Step S1321 the video composition unit 134 combines two or more videos accumulated in a buffer (not shown) in the order in which they were accumulated, forms one combined video, and stores the combined video in a buffer (not shown).
  • Step S1322 The video transmission unit 141 transmits the combined video or video. Return to upper level processing. Note that the video transmitter 141 normally transmits the combined video or the video to the user terminal 3 that has transmitted the inquiry.
  • a second example of the unregistered video search process in step S417 will be described using the flowchart of FIG. 14.
  • a second example of the unregistered video search process is when an inquiry is made to the mobile terminal 2.
  • Step S1401 The video acquisition unit 133 assigns 1 to the counter i.
  • Step S1402 The video acquisition unit 133 determines whether the i-th target position information is present in the received inquiry. If the i-th position information exists, the process goes to step S1403; if it does not exist, the process goes to step S1412.
  • Step S1403 The video acquisition unit 133 acquires the i-th target position information in the received inquiry.
  • Step S1404 The video acquisition unit 133 assigns 1 to the counter j.
  • Step S1405 The video acquisition unit 133 determines whether the j-th movement information exists in the storage unit 11. If the j-th movement information exists, the process advances to step S1403; if the j-th movement information does not exist, the process returns to the upper level process.
  • Step S1406 The video acquisition unit 133 transmits an inquiry to the mobile terminal 2 corresponding to the j-th movement information.
  • Step S1407 The video acquisition unit 133 determines whether information has been received from the mobile terminal 2 corresponding to the j-th movement information. If the information has been received, the process advances to step S1408; if the information has not been received, the process returns to step S1407.
  • Step S1408 The video acquisition unit 133 determines whether a video is included in the information received in step S1407. If a moving image is included, the process goes to step S1409, and if it is not included, the process goes to step S1410.
  • Step S1410 The video acquisition unit 133 temporarily accumulates the video etc. received in step S1407 in a buffer (not shown).
  • Step S1411 The video acquisition unit 133 increments the counter j by 1. Return to step S1405.
  • Step S1412 The video composition unit 134 determines whether two or more videos were able to be accumulated in step S1409. If two or more moving images can be stored, the process goes to step S1413, and if only one moving image can be acquired, the process goes to step S1414.
  • step S1409 the video composition unit 134 combines two or more videos accumulated in a buffer (not shown) in the order in which they were accumulated, forms one combined video, and stores the combined video in a buffer (not shown).
  • Step S1414 The video transmission unit 141 transmits the combined video or video. Return to upper level processing. Note that the video transmitter 141 normally transmits the combined video or the video to the user terminal 3 that has transmitted the inquiry.
  • Step S1501 The right holder processing unit 135 stores the transmitted video in association with the attribute value set associated with each of the one or more videos that are the source of the transmitted video.
  • the right holder processing unit 135 stores the video in pairs with a right holder identifier that identifies one or more rights holders of the video.
  • the right holder identifier here is, for example, one or more right holder identifiers of the video that is the source of the stored video.
  • the right holder identifier here is, for example, one right holder identifier that identifies the user who made the inquiry.
  • the right holder processing unit 135 stores the moving image in, for example, the storage unit 11 or a device other than the information processing device 1.
  • Devices other than the information processing device 1 may be devices that constitute a blockchain.
  • Step S1502 The fourth maintenance means 1354 performs a fourth maintenance process.
  • An example of the fourth maintenance process has been described using the flowchart of FIG. 8.
  • Step S1503 The right holder processing unit 135 assigns 1 to the counter i.
  • Step S1504 The right holder processing unit 135 determines whether or not the i-th video that is the source of the stored video exists. If the i-th video exists, the process advances to step S1505; if the i-th video does not exist, the process returns to the upper level process.
  • Step S1505 The reward means 1355 performs reward processing.
  • An example of reward processing will be explained using the flowchart of FIG. 16.
  • the reward process here is a reward process for the right holder of the i-th video that is the source of the stored video.
  • Step S1506 The right holder processing unit 135 determines whether to change the right holder of the i-th video that is the source of the stored video. If the right holder is to be changed, the process proceeds to step S1507; if the right holder is not to be changed, the process is to proceed to step S1508.
  • whether or not to change the rights holder may be based on the flag associated with the i-th video, or it may be determined in advance, or the inquiry may include "information indicating a request to change the rights holder". The rights holder may be changed if the
  • Step S1507 The right holder processing unit 135 acquires the user identifier of the user terminal 3. Note that this user identifier becomes a new right holder identifier.
  • Step S1508 The right holder processing unit 135 determines whether the i-th video that is the source of the stored video has been registered. If it has been registered, the process advances to step S1511; if it has not been registered, the process advances to step S1509.
  • the first preservation means 1351 stores the i-th video that is the source of the stored video.
  • Step S1510 The fourth preservation means 1354 performs fourth preservation processing regarding the i-th video that is the source of the accumulated video.
  • An example of the fourth maintenance process has been described using the flowchart of FIG. 8.
  • Step S1511 The right holder processing unit 135 increments the counter i by 1. Return to step S1504.
  • step S1509 the process of accumulating two or more videos that are the basis of the combined video
  • step S1510 the fourth maintenance process
  • the reward means 1355 acquires one or more right holder identifiers of the target video.
  • the reward means 1355 may acquire the right holder identifier of the previous right holder of the target video.
  • Step S1602 The reward unit 1355 obtains a set of attribute values of the target video.
  • the reward means 1355 acquires a service identifier that identifies the service performed on the target video.
  • the service identifier is, for example, "browse” or "purchase.”
  • Step S1604 The remuneration unit 1355 obtains the amount of remuneration using one or more of the attribute value set obtained in step S1602 and the service identifier obtained in step S1603.
  • the remuneration means 1355 acquires the amount of remuneration for each right holder identifier. If the history information of a right holder including two or more right holder identifiers has been acquired, the remuneration means 1355 may acquire the amount of remuneration for each right holder identifier.
  • the reward means 1355 obtains video attribute values corresponding to two or more videos that are the source of the video transmitted by the video transmitter 141, and uses the video attribute values to acquire each of the two or more rights. It is preferable to determine the amount of remuneration for each person. For example, it is preferable that the reward unit 1355 determines a larger reward amount as the amount of data, time, or number of frames of the original video adopted in the video transmitted by the video transmitter 141 is larger. . For example, it is preferable that the reward unit 1355 determines a larger reward amount as the resolution of the original video adopted in the video transmitted by the video transmitter 141 is higher.
  • Step S1605 The remuneration unit 1355 performs a process of giving a reward equal to the amount of remuneration acquired in step S1604 to the right holder identified by the right holder identifier acquired in step S1601.
  • Step S1606 The remuneration unit 1355 performs a process of making the user who has enjoyed the service regarding the target video bear the remuneration. Return to upper level processing. Note that the target video is usually a video transmitted to the user terminal 3.
  • the profits earned by the operator of the information processing device 1 may be acquired and accumulated.
  • Step S1701 The movement processing unit 23 determines whether or not the start of movement has been detected. If the start of movement is detected, the process proceeds to step S1702; if not detected, the process proceeds to step S1717. Note that the movement is started by, for example, turning on the engine of the mobile body in which the mobile terminal 2 is installed and turning on the power of the mobile terminal 2.
  • Step S1702 The movement information acquisition unit 233 acquires movement information.
  • the movement information transmitting unit 241 transmits the movement information to the information processing device 1. Note that the movement information is stored in the movement storage section 21, for example.
  • Step S1703 The photographing unit 231 starts photographing.
  • Step S1704 The photographing unit 231 acquires a moving image.
  • Step S1705 The movement processing unit 23 acquires one or more video attribute values, and associates the one or more video attribute values with the video acquired in step S1704.
  • the movement processing unit 23 acquires, for example, location information, time information, weather information, temperature information, and seasonal information. Furthermore, the movement processing unit 23 obtains, for example, one or more moving object attribute values (for example, CAN data).
  • moving object attribute values for example, CAN data
  • Step S1706 The tag acquisition unit 232 determines whether to acquire the mobile object attribute value tag. If the mobile object attribute value tag is to be acquired, the process goes to step S1707; if not, the process goes to step S1709. Note that whether or not to acquire the mobile object attribute value tag is determined in advance.
  • Step S1707 The tag acquisition unit 232 performs mobile object attribute value tag acquisition processing.
  • An example of the mobile object attribute value tag acquisition process has been described using the flowchart of FIG. 6 . Note that there may be cases where the tag cannot be acquired.
  • Step S1708 When one or more tags are acquired in step S1707, the tag acquisition unit 232 associates the one or more tags with the video acquired in step S1704.
  • the tag acquisition unit 232 associates one or more tags with the video and stores them in the movement storage unit 21. Thereby, the user of the mobile terminal 2 can search for videos using the tag as a key, for example.
  • Step S1709 The tag acquisition unit 232 determines whether to acquire a video tag. If the video tag is to be acquired, the process goes to step S1710; if not, the process goes to step S1712. Note that whether or not to acquire a video tag is determined in advance.
  • Step S1710 The tag acquisition unit 232 performs video tag acquisition processing.
  • An example of video tag acquisition processing has been described using the flowchart in FIG. Note that there may be cases where the tag cannot be acquired.
  • Step S1711 When one or more tags are acquired in step S1710, the tag acquisition unit 232 associates the one or more tags with the video acquired in step S1704.
  • the tag acquisition unit 232 associates one or more tags with the video and stores them in the movement storage unit 21. Thereby, the user of the mobile terminal 2 can search for videos using the tag as a key, for example.
  • Step S1712 The movement processing unit 23 determines whether or not the end of movement has been detected. If the end of movement is detected, the process advances to step S1713; if not detected, the process returns to step S1704.
  • the movement processing unit 23 detects the end of movement by detecting turning off the engine, turning off the power of the mobile terminal 2, etc., and detecting arrival at the destination.
  • Step S1713 The movement processing unit 23 acquires the right holder identifier from the movement storage unit 21.
  • Step S1714 The movement processing unit 23 generates an attribute value set including one or more moving body attribute values obtained in step S1705, one or more tags obtained in step S1707, and one or more tags obtained in step S1710. Configure.
  • Step S1715 The set transmitting unit 243 transmits the attribute value set configured in step S1714 to the information processing device 1 in association with the right holder identifier.
  • Step S1716 The moving video transmission unit 242 and the like perform video transmission processing. Return to step S1701. Note that an example of the video transmission process will be explained using the flowchart of FIG. 18.
  • the video transmission process is a process of automatically transmitting a video that meets the preservation conditions.
  • Step S1717 The mobile receiving unit 22 determines whether or not it has received an inquiry from the information processing device 1. If an inquiry is received, the process advances to step S1718; if not, the process returns to step S1701.
  • Step S1718 The movement processing unit 23 performs terminal image acquisition processing corresponding to the inquiry received in step S1717.
  • An example of the terminal image acquisition process will be described using the flowchart of FIG. 19.
  • the terminal image acquisition process is a process of acquiring a video that matches the inquiry from among the videos stored in the movement storage unit 21.
  • Step S1719 The movement processing unit 23 determines whether or not the image has been acquired in step S1718. If an image has been acquired, the process proceeds to step S1720; if not, the process proceeds to step S1721.
  • Step S1720 The moving video transmitter 242 transmits images and the like to the information processing device 1.
  • images and the like include, for example, images, attribute value sets, and rights holder identifiers.
  • the image is, for example, a moving image, a still image, or an around view.
  • Step S1721 The moving video transmitter 242 transmits error information.
  • the error information is information indicating that the video could not be acquired.
  • a set of video attribute values that are all or part of the one or more video attributes acquired in step S1705, the tag acquired in step S1707, and the tag acquired in step S1710 is It is preferable to transmit the information to the information processing device 1 each time the tag "accident” or "traffic jam” is acquired, every predetermined period, or when a predetermined condition (for example, the tag "accident” or "traffic jam” is acquired).
  • the video transmission process (processing in S1416) is performed after the end of movement is detected, but the video transmission process may be performed at all times.
  • Always performing video transmission processing means, for example, performing video transmission processing (S1416) immediately after step S1711. As a result, even if the storage area for moving pictures in the storage unit 11 is small, moving pictures that meet the preservation conditions can be preserved.
  • the process is terminated by turning off the power or by an interrupt to terminate the process.
  • step S1716 an example of the video transmission process in step S1716 will be described using the flowchart in FIG. 18.
  • Step S1801 The movement processing unit 23 acquires the attribute value set of the movement storage unit 21.
  • Step S1802 The movement processing unit 23 assigns 1 to the counter i.
  • Step S1803 The movement processing unit 23 determines whether the i-th search unit exists. If the i-th search unit exists, the process advances to step S1804; if it does not exist, the process returns to the upper level process.
  • Step S1804 The movement processing unit 23 acquires a set of video attribute values for the i-th search unit.
  • Step S1805) The movement processing unit 23 assigns 1 to the counter j.
  • Step S1806 The movement processing unit 23 determines whether the j-th maintenance condition exists. If the j-th maintenance condition exists, the process goes to step S1807, and if it does not exist, the process goes to step S1810.
  • Step S1807 The movement processing unit 23 determines whether the set of video attribute values acquired in step S1804 satisfies the j-th maintenance condition. If the j-th maintenance condition is satisfied, the process goes to step S1808, and if it is not satisfied, the process goes to step S1811.
  • Step S1808 The movement processing unit 23 acquires the i-th search unit video, etc.
  • the i-th search unit video or the like is, for example, the i-th search unit video and the attribute value set corresponding to the video.
  • Step S1809 The moving video transmitter 242 transmits the video etc. acquired in step S1808 to the information processing device 1.
  • Step S1810 The movement processing unit 23 increments the counter i by 1. Return to step S1803.
  • Step S1811 The movement processing unit 23 increments the counter j by 1. Return to step S1806.
  • step S1718 an example of the terminal image acquisition process in step S1718 will be described using the flowchart of FIG. 19.
  • Step S1901 The movement processing unit 23 uses the received inquiry to determine whether or not to acquire a video. If a moving image is to be acquired, the process goes to step S1902, and if a still image or the like is to be acquired, the process goes to step S1908.
  • the movement processing unit 23 examines the type identifier (for example, "video”, “still image”, “around view image”) included in the received inquiry, and determines whether or not to acquire a video.
  • type identifier for example, "video”, “still image”, “around view image”
  • Step S1902 The movement processing unit 23 assigns 1 to the counter i.
  • Step S1903 The movement processing unit 23 determines whether the i-th search unit exists. If the i-th search unit exists, the process goes to step S1904; if it does not exist, the process returns to the upper level process.
  • Step S1904 The movement processing unit 23 acquires a set of video attribute values for the i-th search unit.
  • Step S1905 The movement processing unit 23 determines whether the set of video attribute values of the i-th search unit matches the query. If it matches the inquiry, the process goes to step S1906; if it does not match, the process goes to step S1907.
  • Step S1906 The movement processing unit 23 acquires the i-th search unit video, etc.
  • a video or the like is, for example, a collection of a video and video attribute values.
  • Step S1907 The movement processing unit 23 increments the counter i by 1. Return to step S1903.
  • Step S1908 The movement processing unit 23 acquires the latest composite image or the latest still image. Return to upper level processing.
  • the composite image is an image that is composited using still images taken by two or more cameras installed on the moving body.
  • the composite image is, for example, a around-view image.
  • a still image is an image taken by one camera installed on a moving object. Further, since the technology for configuring the around-view image is a known technology, detailed explanation will be omitted.
  • Step S2001 The user reception unit 32 determines whether or not the inquiry has been received. If the inquiry is accepted, the process goes to step S2002; if not, the process goes to step S2007.
  • accepting an inquiry includes, for example, accepting a user's input, receiving position information from the target terminal 4, and receiving destination or route information from the navigation terminal 5.
  • Step S2002 The user processing unit 33 composes an inquiry to be sent.
  • the user transmitter 34 transmits the inquiry to the information processing device 1 in association with the user identifier.
  • Step S2003 The user receiving unit 35 determines whether or not information has been received from the information processing device 1. If the information has been received, the process advances to step S2004; if the information has not been received, the process returns to step S2003.
  • Step S2004 The user processing unit 33 determines whether the information received in step S2003 includes a moving image. If a moving image is included, the process goes to step S2005, and if a moving image is not included, the process goes to step S2006.
  • Step S2005 The user output unit 36 outputs the received moving image. Return to step S2001.
  • Step S2006 The user output unit 36 outputs the other received information. Return to step S2001.
  • Step S2007 The user processing unit 33 determines whether it is time for an inquiry. If it is an inquiry timing, the process goes to step S2008, and if it is not an inquiry timing, the process goes to step S2009.
  • the timing of the inquiry is, for example, when a destination is set on the user terminal 3, which is a navigation terminal, or when the user terminal 3 installed in a car detects a traffic jam.
  • Step S2008 The user processing unit 33 performs query generation processing. Go to step S2002. An example of the query generation process will be described using the flowchart of FIG. 18.
  • Step S2009 The user reception unit 32 determines whether a purchase instruction has been received from the user. If the purchase instruction is accepted, the process goes to step S2010; if not, the process returns to step S2001.
  • the purchase instruction includes, for example, an inquiry.
  • Step S2010 The user processing unit 33 composes a purchase instruction to be transmitted.
  • the user transmitter 34 transmits the purchase instruction to the information processing device 1 in association with the user identifier.
  • Step S2011 The user receiving unit 35 determines whether information has been received from the information processing device 1. If the information has been received, the process goes to step S2012; if the information has not been received, the process returns to step S2011.
  • the information is, for example, a video, information indicating that the transfer of the right holder has been completed, and a set of attribute values of the video.
  • Step S2012 The user processing unit 33 uses the received information to configure information to be output.
  • the user output unit 36 outputs the information. Return to step S2001.
  • step S2008 an example of the query generation process in step S2008 will be explained using the flowchart of FIG. 21.
  • Step S2101 The user processing unit 33 acquires a destination.
  • Step S2102 The user processing unit 33 acquires the current location.
  • Step S2103 The user processing unit 33 uses the destination and current location to search for a route and obtain route information.
  • Step S2104 The user processing unit 33 acquires information on one or more points that are points on the route specified by the route information acquired in step S2103 and satisfy the extraction conditions.
  • Step S2105 The user processing unit 33 composes an inquiry using the one or more point information acquired in step S2104. Return to upper level processing. Note that the user processing unit 33 may, for example, receive an inquiry, ⁇ This is a video within one hour from now, a video has been tagged with either ⁇ traffic jam'' or ⁇ accident,'' and any one of one or more point information. ⁇ Search for a video that is paired with a set of attribute values that include''.
  • the user processing unit 33 may obtain the current location and compose an inquiry that includes the current location.
  • an inquiry is a request to transmit a video corresponding to a predetermined tag (for example, "accident” or "traffic jam") in an area surrounding the current location (for example, the distance is within a threshold value).
  • the target terminal 4 acquires location information.
  • the target terminal 4 transmits the position information to the information processing device 1 or the user terminal 3 registered in the target terminal 4.
  • the target terminal 4 acquires and transmits position information upon receiving an instruction from the holder of the target terminal 4 (for example, a child to be watched over).
  • the target terminal 4 has, for example, a GPS receiver and acquires position information using the GPS receiver, but the method of acquiring the position information is not limited.
  • the user terminal 3 registered as the target terminal 4 is, for example, the guardian of the holder of the target terminal 4.
  • the navigation terminal 5 receives a destination from the user. Next, the navigation terminal 5 performs the inquiry generation process described in FIG. 21. Next, the navigation terminal 5 performs the processes from S2002 to S2005 and S2006 in FIG.
  • a terminal management table having the structure shown in FIG. 22 is currently stored in the set storage unit 111 of the information processing device 1.
  • the terminal management table is a table that manages one or more terminal information.
  • the terminal management table is a table for managing mobile terminals 2 that transmit videos. Note that the mobile terminal 2 that is not managed by the terminal management table may transmit the video to the information processing device 1.
  • the terminal management table manages one or more records having "ID”, “terminal identifier”, “video information”, “movement information”, “registration flag”, and “provision flag”.
  • Video information is information regarding a captured video, and here includes a “frame identifier,” “environmental information,” and “tag.”
  • Environmental information here includes “location information,” “time information,” “weather information,” and “temperature information.”
  • “Environmental information” is information about the environment around the mobile terminal 2 when the video was acquired.
  • the “tags” include “accident,” “traffic jam,” and “dangerous driving.” That is, here, one or more tags among “accident,” “traffic jam,” and “dangerous driving” may be added to the video, for example.
  • ID is information that identifies a record.
  • the "terminal identifier” is an identifier of the mobile terminal 2, and here, it is the same as the right holder identifier that identifies the right holder of the video at the time of transmitting the video.
  • “Frame identifier” is an ID of a frame that constitutes a moving image. A frame can also be called a field or a still image.
  • “Position information” here is (latitude, longitude).
  • the “time information” here is year, month, date, hour, minute, and second.
  • the "weather information” is, for example, “sunny,” “rain,” “cloudy,” and “snow.”
  • “Temperature information” is the temperature (°C) outside the moving body.
  • the value “1” for “accident” indicates that a tag indicating that an accident has occurred is attached to the corresponding frame.
  • a value of “1” for “traffic jam” indicates that a tag indicating that a traffic jam is occurring is attached to the corresponding frame.
  • a value of “1” for “dangerous driving” indicates that a tag indicating that a car or the like driving in front is driving dangerously is attached to the corresponding frame.
  • a registered video management table having the structure shown in FIG. 23 is stored on the blockchain.
  • the registered video management table is a table for managing registered videos.
  • the registered video management table is a table for managing maintenance information.
  • the registered video is, for example, a video provided to the user in response to an inquiry from the user, or a video that satisfies the maintenance conditions.
  • the registered video management table includes "ID”, "video identifier”, “access information”, "right holder identifier”, "right registration date”, "video information”, and “provision flag”. Note that the registered video is stored in the information processing device 1, another device, or a blockchain. It is also assumed that each record in the registered video management table is maintenance information here.
  • Specific examples 1 to 4 involve the use of real-time video.
  • Specific example 5 is the use of videos shot in the past.
  • a user related to the target person can watch a combined video that is a combination of videos taken by mobile terminals 2 installed on two or more mobile objects. This is a case where the information is transmitted to the user terminal 3 of a person (for example, a guardian).
  • a combined video obtained by combining videos shot by a plurality of mobile terminals 2 is output to the user terminal 3 based on an inquiry using route information corresponding to a destination set in the user terminal 3 or the navigation terminal 5. This is the case.
  • a third specific example is a case where the user terminal 3 or navigation terminal 5 that detects a traffic jam acquires a video that allows understanding of the reason for the traffic jam and outputs it to the user terminal 3 or navigation terminal 5.
  • Specific example 4 is a case where an image is output that allows the user to understand the situation of the parking lot in order to help the user find an empty space in the parking lot.
  • Specific example 5 is a case where a combined video that is a combination of registered videos is output to the user terminal 3 using route information that specifies a route traveled by the user in the past (for example, a traveled route).
  • the storage unit 11 of the information processing device 1 contains a user identifier (for example, the IP address of the user terminal 3) for transmitting a video to the user terminal 3 of one guardian P, and one child A of the guardian P. It is assumed that management information having a target user identifier "T001" that identifies the target terminal 4 of is stored.
  • a user identifier for example, the IP address of the user terminal 3
  • T001 target user identifier
  • T001 target person identifier
  • communication destination information eg, IP address
  • the receiving unit 12 of the information processing device 1 periodically receives location information that specifies the location of the mobile terminal 2 by pairing it with a terminal identifier from each of the two or more mobile terminals 2, and pairs it with the terminal identifier. It is assumed that the information is stored in the terminal management table (FIG. 22).
  • the information (x t1 , y t1 ) and the subject identifier "T001" are temporarily stored. It is assumed that the position information is received periodically, and the latest position information is stored in a buffer (not shown).
  • the video acquisition unit 133 performs the operation described in the flowchart of FIG. (Here, it is assumed that the drive recorder installed in the car) has been determined.
  • the video acquisition unit 133 receives the video from the first mobile terminal 2.
  • Child A is shown in this video. This is because the position information of the target terminal 4 of child A and the position information of the mobile terminal 2 are information indicating positions that are close enough to satisfy the first position condition.
  • the moving image is usually associated with location information and the first right holder identifier of the first mobile terminal 2. Further, it is preferable that the received moving image is a moving image that is immediately transmitted after being photographed by the mobile terminal 2.
  • the video transmission unit 141 transmits the video received by the video acquisition unit 133 to the user terminal 3 of the guardian P identified by the user identifier paired with the target person identifier "T001".
  • the video acquisition unit 133 pairs the video received from the first mobile terminal 2 with the first right holder identifier and location information of the first mobile terminal 2, and temporarily stores them in a buffer (not shown).
  • the video acquisition unit 133 at least receives the information received from the first mobile terminal 2. After receiving the video, the video transmitter 141 transmits the video to the user terminal 3 of the guardian P.
  • the video acquisition unit 133 determines that the location information of the target terminal 4 of child A and the location information of the first mobile terminal 2 no longer satisfy the first location condition. This is because the first mobile terminal 2 has moved and is no longer in a position to photograph the child A who is walking home.
  • the video acquisition unit 133 again compares the latest location information of the target terminal 4 with the location information of the second mobile terminal 2 whose latest location information satisfies the first location condition, with reference to FIG. and decide. Note that in FIG. 22, the latest position information transmitted from each mobile terminal 2 is stored in pairs with each terminal identifier. The video acquisition unit 133 then acquires the video from the second mobile terminal 2. Next, the video acquisition unit 133 pairs the video with the second right holder identifier and position information of the second mobile terminal 2 and temporarily stores the video in a buffer (not shown).
  • the video transmitting unit 141 transmits the video received by the video acquiring unit 133 from the second mobile terminal 2 to the user terminal 3 of the guardian P.
  • the video acquisition unit 133 determines that the position information of the target terminal 4 of child A and the position information of the second mobile terminal 2 no longer satisfy the first position condition. Let's say you've made a decision.
  • the video acquisition unit 133 again compares the latest location information of the target terminal 4 with the location information of the third mobile terminal 2 whose latest location information satisfies the first location condition, with reference to FIG. , but it is assumed that there is no location information of the third mobile terminal 2 that satisfies the first location condition.
  • the video transmitting unit 141 may transmit information to the user terminal 3 of the parent P to the effect that the video containing the child A cannot be transmitted, or may stop transmitting the video and information to the user terminal 3. You may do so.
  • the user terminal 3 sequentially receives and outputs the video acquired by the first mobile terminal 2 and the video acquired by the second mobile terminal 2. This allows the guardian P to see how the child A returns home.
  • a third mobile terminal 2 approaches the child A, and the video acquisition unit 133 determines that the latest location information is the first location condition with respect to the latest location information of the target terminal 4. It is assumed that the position information of the third mobile terminal 2 that satisfies the above conditions has been determined with reference to FIG. Next, the video acquisition unit 133 acquires a video from the third mobile terminal 2. Next, the video acquisition unit 133 pairs the video with the third right holder identifier and position information of the third mobile terminal 2 and temporarily stores the video in a buffer (not shown).
  • the video transmission unit 141 transmits the video received by the video acquisition unit 133 from the third mobile terminal 2 to the user terminal 3 of the guardian P identified by the user identifier paired with the target person identifier “T001”. Send to.
  • the user terminal 3 receives and outputs the video acquired by the third mobile terminal 2.
  • the guardian P was unable to see how the child A returned home for a short period of time, but by outputting the video, the guardian P is now able to see the child A's return home again.
  • the remuneration means 1355 rewards the rights holders identified by the rights holder identifiers of the first mobile terminal 2, the second mobile terminal 2, and the third mobile terminal 2 that provided the video to the guardian B as described above. Perform reward processing.
  • the video composition unit 134 combines the videos transmitted from two or more mobile terminals 2 in the order in which they were sent, and configures a combined video.
  • the right holder processing unit 135 stores the combined video as a pair with the right holder identifier, which is the guardian P's identifier.
  • the right holder processing unit 135 stores the combined video in association with the attribute value set associated with each of the one or more videos that are the basis of the combined video.
  • the fourth preservation means 1354 obtains access information that specifies the storage destination of the combined video. Further, the fourth preservation means 1354 obtains an attribute value set corresponding to the accumulated combined video. Next, the fourth preservation means 1354 configures preservation information including the obtained access information, the obtained attribute value set, and the right holder identifier of the video. Next, the fourth maintenance means 1354 stores the configured maintenance information.
  • the target person holding the target terminal 4 can be watched over using the combined video. Furthermore, it is possible to reward the rights holder who provided the video that is the basis of the combined video for monitoring. Additionally, combined videos can be managed appropriately.
  • the user inputs a destination into the user terminal 3 having a navigation function.
  • the user reception unit 32 of the user terminal 3 receives the destination.
  • the user processing unit 33 also acquires the current position.
  • the user processing unit 33 acquires route information from the current location to the destination. Note that it is assumed here that the route information includes two or more pieces of position information.
  • the user sending unit 34 of the user terminal 3 automatically sends an inquiry including the route information to the information processing device 1 in response to the acquisition of the route information by the user processing unit 33.
  • the inquiry receiving unit 122 of the information processing device 1 receives the inquiry.
  • the video acquisition unit 133 and the video composition unit 134 perform a video combination process as follows.
  • the video acquisition unit 133 acquires the position information (first position information) of the first intersection in the route specified by the route information, among the two or more pieces of position information included in the route information. That is, it is preferable that the video acquisition unit 133 acquires the video using only part of the position information included in the received route information. It is preferable that the video acquisition unit 133 acquires the video using only some of the position information included in the received route information that satisfies a specific condition.
  • the specific conditions are, for example, that the location information is information indicating the location of an intersection, and that the distance from the previously used location information is greater than or equal to a threshold value.
  • the video acquisition unit 133 determines the position information of the first mobile terminal 2 that satisfies the first position condition based on the acquired position information. Then, the video acquisition unit 133 acquires the video from the determined first mobile terminal 2, pairs the video with the first right holder identifier and the first location information of the first mobile terminal 2, It is temporarily stored in a buffer (not shown). Next, the video transmitter 141 transmits the acquired video to the user terminal 3.
  • the video acquisition unit 133 acquires second position information of the next intersection, which is closer to the destination than the position indicated by the previously acquired first position information of the intersection.
  • the video acquisition unit 133 determines the position information of the second mobile terminal 2 that satisfies the first position condition with respect to the second position information. Then, the video acquisition unit 133 acquires the video from the determined second mobile terminal 2, pairs the video with the second right holder identifier and second position information of the second mobile terminal 2, It is temporarily stored in a buffer (not shown). Next, the video transmitter 141 transmits the acquired video to the user terminal 3.
  • the video acquisition unit 133 acquires third position information of the next intersection that is closer to the destination than the position indicated by the second position information.
  • the video acquisition unit 133 determines the position information of the third mobile terminal 2 that satisfies the first position condition with respect to the third position information. Then, the video acquisition unit 133 acquires the video from the determined third mobile terminal 2, pairs the video with the third right holder identifier and third location information of the third mobile terminal 2, It is temporarily stored in a buffer (not shown). Next, the video transmitter 141 transmits the acquired video to the user terminal 3.
  • the information processing device 1 repeats the above process until it transmits the video corresponding to the n-th location information that specifies the destination.
  • the user receiving unit 35 of the user terminal 3 sequentially receives the first video, the second video, the third video, . . . the n-th video.
  • the user output unit 36 sequentially outputs the first video, the second video, the third video, . . . the n-th video.
  • the remuneration means 1355 of the information processing device 1 rewards the first right holder, the second right holder, . Perform reward processing to give rewards.
  • the video composition unit 134 combines the videos transmitted from two or more mobile terminals 2 in the order in which they were sent, and configures a combined video.
  • the right holder processing unit 135 stores the combined video in pairs with the right holder identifier, which is the identifier of the user of the user terminal 3. That is, here, the right holder of the combined video is the user.
  • the right holder processing unit 135 stores the combined video in association with the attribute value set associated with each of the one or more videos that are the basis of the combined video.
  • the fourth preservation means 1354 obtains access information that specifies the storage destination of the combined video. Further, the fourth preservation means 1354 obtains an attribute value set corresponding to the accumulated combined video. Next, the fourth preservation means 1354 configures preservation information including the obtained access information, the obtained attribute value set, and the right holder identifier of the video. Next, the fourth maintenance means 1354 stores the configured maintenance information.
  • the state of the route to the destination is displayed near the current location.
  • a moving object such as a car.
  • combined videos can be stored and managed appropriately.
  • the navigation terminal 5 detects a traffic jam on the route to the destination.
  • the function of detecting traffic congestion is possible using known technology.
  • the navigation terminal 5 acquires route information having one or more pieces of positional information that specify the congested road, and sends the inquiry including the route information and the user identifier stored in the navigation terminal 5.
  • the information has been transmitted to the information processing device 1.
  • the user identifier is the identifier of the user terminal 3 that receives the video transmitted from the mobile terminal 2 located on the road where there is traffic congestion, and is, for example, an IP address.
  • the route information is information that specifies one or more roads with traffic jams.
  • the user terminal 3 is, for example, a terminal of a fellow passenger in the front passenger seat.
  • the inquiry receiving unit 122 of the information processing device 1 receives the inquiry including the route information and the user identifier.
  • the video acquisition unit 133 and the video composition unit 134 perform a video combination process as follows.
  • the video acquisition unit 133 acquires the location information closest to the current location from among the location information included in the route information. Next, the video acquisition unit 133 acquires the last position information of the position information that continues from the position information and whose position is within the threshold value with respect to the adjacent position information. The video acquisition unit 133 uses this location information as the location information of the target to be used for video acquisition.
  • the video acquisition unit 133 determines, with respect to the target location information, the first mobile terminal 2 whose location information satisfies the first location condition. Next, the video acquisition unit 133 acquires the video from the mobile terminal 2, pairs the video with the first right holder identifier and location information of the first mobile terminal 2, and temporarily stores the video in a buffer (not shown). accumulate.
  • the video acquisition unit 133 receives the video from the first mobile terminal 2 and temporarily stores it in a buffer (not shown) until the latest location information of the first mobile terminal 2 no longer satisfies the first location condition. .
  • the video transmitting unit 141 sequentially transmits the acquired videos to the user terminal 3.
  • the mobile terminal 2 passes through the traffic jam and the video acquisition unit 133 determines that the latest position information of the first mobile terminal 2 no longer satisfies the first position condition.
  • the video acquisition unit 133 determines, with respect to the target location information, the second mobile terminal 2 whose location information satisfies the first location condition. Next, the video acquisition unit 133 acquires the video from the second mobile terminal 2 and pairs the video with the second right holder identifier and location information of the second mobile terminal 2 (not shown). Temporarily accumulate in the buffer.
  • the video acquisition unit 133 receives the video from the second mobile terminal 2 and temporarily stores it in a buffer (not shown) until the latest location information of the second mobile terminal 2 no longer satisfies the first location condition. .
  • the video transmitting unit 141 sequentially transmits the acquired videos to the user terminal 3.
  • the user terminal 3 receives the video from the information processing device 1 and outputs it.
  • the user of the user terminal 3 can continuously know the traffic jam situation.
  • the information processing device 1 performs similar processing using the route information that identifies the second and subsequent locations.
  • the user terminal 3 can also receive and output videos for understanding the traffic congestion situation at the second and subsequent locations. Note that, if there are two or more traffic jam locations, it is preferable that the user terminal 3 automatically or in accordance with a user's instruction switch the location, receive and output the moving image.
  • the situation of traffic congestion on the route to the destination can be grasped using videos transmitted from two or more mobile terminals 2.
  • the inquiry receiving unit 122 of the information processing device 1 receives the inquiry.
  • the video acquisition unit 133 determines from the received inquiry that spatial fusion of two or more videos is necessary.
  • the video acquisition unit 133 and the video composition unit 134 perform video fusion processing as described below.
  • the video acquisition unit 133 acquires the reference position information included in the received inquiry. Next, the video acquisition unit 133 determines one or more mobile terminals 2 corresponding to the position information that satisfies the second position condition with respect to the reference position information. Next, the video acquisition unit 133 transmits an instruction to transmit the current around-view image to one or more mobile terminals 2.
  • the second location condition here is that the location indicated by the location information exists in the area of the parking lot that includes the reference location information. Note that it is assumed that one or more mobile terminals 2 are continuously acquiring around-view images.
  • the video acquisition unit 133 receives, from each of the one or more mobile terminals 2, around-view images associated with the position information of the mobile terminals 2.
  • the video composition unit 134 calculates the difference (distance) between the position information paired with each received around-view image and the reference position information. Next, the video composition unit 134 sorts the around-view images in ascending order using the difference as a key.
  • the video composition unit 134 acquires a reference image.
  • the reference image is an around-view image included in the inquiry.
  • the video composition unit 134 performs the process described using the flowchart of FIG.
  • the fusion image is constructed by placing the images at appropriate positions. Further, the video composition unit 134 composes an image that clearly indicates the position indicated by the reference position information (the position of the user terminal 3 that transmitted the inquiry) in the finally composed fused image. Note that this image is also a merged image.
  • the video transmission unit 141 transmits the constructed fused image to the user terminal 3.
  • the user terminal 3 receives and outputs the fused image.
  • the information processing device 1 fuses around-view images.
  • the information processing device 1 fuses two or more normal camera images and two or more images acquired by an omnidirectional camera using position information corresponding to each image to form a merged image, The fused image may be transmitted to the user terminal 3.
  • this inquiry is a video of a drive course traveled by the user, and is a query for acquiring a video of a sunny day.
  • the inquiry receiving unit 122 of the information processing device 1 receives the inquiry.
  • the video acquisition unit 133 determines that the received inquiry is not a real-time video search.
  • the video acquisition unit 133 and the like perform registered video search processing as follows.
  • the video acquisition unit 133 acquires the first position information included in the route information in the received inquiry.
  • the video acquisition unit 133 acquires all maintenance information from the registered video management table (FIG. 23). That is, the video acquisition unit 133 acquires, for example, security information that exists on the blockchain.
  • the video acquisition unit 133 acquires the access information "address 01" that is paired with the determined maintenance information.
  • the video acquisition unit 133 uses the access information "address 01" to acquire the video.
  • the video acquisition unit 133 generates a video up to the point where the second and subsequent location information included in the route information included in the received inquiry satisfies (is the same as or is close to) the location information in the maintenance information and the first location condition. , cut out from the video corresponding to the access information "address 01".
  • the video acquisition unit 133 extracts and acquires the video up to when the user deviates from the drive course on which the user has traveled, from the video corresponding to the access information "address 01.”
  • the video acquisition unit 133 acquires second location information included in the route information included in the received inquiry, which is location information when the video corresponding to the access information "address 01" deviates from the drive course. .
  • the video acquisition unit 133 includes location information that includes "1" in the provision flag, satisfies the first location condition for the acquired second location information, and "weather” in the acquired maintenance information.
  • Determine maintenance information including "Information Clear”.
  • the video acquisition unit 133 acquires access information (for example, “address , the second video has been acquired.
  • the video acquisition unit 133 determines whether the location information prior to the second location information included in the route information included in the received inquiry is the location information of the maintenance information. The video that satisfies the requirements is cut out from the second video that corresponds to the access information "address The video corresponding to "X" is cut out and acquired.
  • the video acquisition unit 133 performs the above processing until it uses the last location information included in the route information in the received inquiry.
  • the video composition unit 134 combines the two or more videos acquired by the video acquisition unit 133 in the order in which they were acquired (in the order of the route) to configure a combined video.
  • the video transmitter 141 transmits the combined video to user B's user terminal 3.
  • the user terminal 3 receives and outputs the combined video.
  • the remuneration means 1355 of the information processing device 1 obtains the right holder identifiers (for example, "U001", etc.) of each of the two or more original videos used in the combined video, and identifies the two or more original videos with the respective right holder identifiers. Performs remuneration processing to reward rights holders.
  • the right holder identifiers for example, "U001", etc.
  • the right holder processing unit 135 performs the various preservation processes described above on the configured combined video.
  • one useful temporally combined video is constructed and provided using two or more videos corresponding to two or more pieces of location information transmitted from the target terminal 4. can. In this way, for example, a target person holding a moving target terminal 4 can be watched over.
  • appropriate processing regarding the right holder of the video can be performed. For example, a reward can be given to the right holder of the video captured by the mobile terminal 2.
  • the right holder of one video composed of two or more images can be made the appropriate rights holder.
  • the right holder of a video composed of two or more images can be the person who needs the video.
  • the mobile terminal 2 acquires and accumulates video and sound information, but transmits the video but does not transmit the sound information, thereby contributing to the provision of video and being mobile.
  • the privacy of those with rights to the body can be protected.
  • the processing in this embodiment may be realized by software. Then, this software may be distributed by software download or the like. Furthermore, this software may be recorded on a recording medium such as a CD-ROM and distributed. Note that this also applies to other embodiments in this specification.
  • the software that implements the information processing device 1 in this embodiment is the following program. In other words, this program converts a computer into an attribute value set that is a video shot by two or more mobile terminals and includes one or more environmental information including location information that specifies the shooting location or time information that specifies the shooting time.
  • a video acquisition unit that acquires videos that are associated with each other and that are transmitted from each of the two or more mobile terminals, and two or more different videos that have different information when being associated with each of the two or more videos that the video acquisition unit has acquired. Constructing one video by temporally combining videos or spatially merging parts of two or more videos obtained by the video acquisition unit and having different positional information associated with each of the two or more videos.
  • This is a program for causing a moving image composing section to function as a moving image composing section and a moving image transmitting section for transmitting the one moving image configured by the moving image structuring section.
  • FIG. 24 shows the external appearance of a computer that executes the programs described in this specification and realizes the information processing apparatus 1 and the like of the various embodiments described above.
  • the embodiments described above may be implemented in computer hardware and computer programs executed thereon.
  • FIG. 24 is an overview diagram of this computer system 300
  • FIG. 25 is a block diagram of the system 300.
  • the mobile terminal 2 usually includes a camera.
  • the mobile terminal 2 may be equipped with a microphone.
  • a computer system 300 includes a computer 301 including a CD-ROM drive, a keyboard 302, a mouse 303, and a monitor 304.
  • the computer 301 includes, in addition to a CD-ROM drive 3012, an MPU 3013, a bus 3014 connected to the CD-ROM drive 3012, a ROM 3015 for storing programs such as a boot-up program, and an MPU 3013. It is connected and includes a RAM 3016 for temporarily storing application program instructions and providing temporary storage space, and a hard disk 3017 for storing application programs, system programs, and data.
  • the computer 301 may further include a network card that provides connection to a LAN.
  • a program that causes the computer system 300 to execute the functions of the information processing device 1 of the above-described embodiment may be stored in the CD-ROM 3101, inserted into the CD-ROM drive 3012, and further transferred to the hard disk 3017. .
  • the program may be transmitted to the computer 301 via a network (not shown) and stored on the hard disk 3017.
  • the program is loaded into RAM 3016 during execution.
  • the program may be loaded directly from CD-ROM 3101 or the network.
  • the program does not necessarily include an operating system (OS) or a third party program that causes the computer 301 to execute the functions of the information processing apparatus of the above-described embodiment.
  • the program need only contain those parts of the instructions that call the appropriate functions (modules) in a controlled manner to achieve the desired results. How computer system 300 operates is well known and will not be described in detail.
  • processing is performed by hardware. processing) is not included.
  • the number of computers that execute the above program may be a single computer or a plurality of computers. That is, centralized processing or distributed processing may be performed.
  • two or more communication means existing in one device may be physically realized by one medium.
  • each process may be realized by being centrally processed by a single device, or may be realized by being distributed by a plurality of devices.
  • the information processing device 1 has the advantage of being able to compose and provide one useful video by using videos shot by two or more mobile terminals 2, and can be used as a server etc. Useful.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Security & Cryptography (AREA)
  • Automation & Control Theory (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Astronomy & Astrophysics (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Navigation (AREA)
  • Mobile Radio Communication Systems (AREA)
PCT/JP2022/032068 2022-08-25 2022-08-25 情報処理装置、移動端末、情報処理方法、およびプログラム Ceased WO2024042683A1 (ja)

Priority Applications (8)

Application Number Priority Date Filing Date Title
JP2024542533A JP7606651B2 (ja) 2022-08-25 2022-08-25 情報処理装置、移動端末、情報処理方法、およびプログラム
PCT/JP2022/032068 WO2024042683A1 (ja) 2022-08-25 2022-08-25 情報処理装置、移動端末、情報処理方法、およびプログラム
EP22956510.6A EP4525456A4 (en) 2022-08-25 2022-08-25 INFORMATION PROCESSING DEVICE, MOBILE TERMINAL, INFORMATION PROCESSING METHOD, AND PROGRAM
JP2024205043A JP7614440B1 (ja) 2022-08-25 2024-11-25 情報処理装置、移動端末、情報処理方法、およびプログラム
JP2024206794A JP7717434B2 (ja) 2022-08-25 2024-11-27 情報処理装置、移動端末、情報処理方法、およびプログラム
US18/969,255 US12361522B2 (en) 2022-08-25 2024-12-05 Information processing device and information processing method
US19/023,338 US12475540B2 (en) 2022-08-25 2025-01-16 Information processing device and information processing method
US19/023,349 US20250157006A1 (en) 2022-08-25 2025-01-16 Information processing device and information processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/032068 WO2024042683A1 (ja) 2022-08-25 2022-08-25 情報処理装置、移動端末、情報処理方法、およびプログラム

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/969,255 Continuation US12361522B2 (en) 2022-08-25 2024-12-05 Information processing device and information processing method

Publications (1)

Publication Number Publication Date
WO2024042683A1 true WO2024042683A1 (ja) 2024-02-29

Family

ID=90012799

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/032068 Ceased WO2024042683A1 (ja) 2022-08-25 2022-08-25 情報処理装置、移動端末、情報処理方法、およびプログラム

Country Status (4)

Country Link
US (3) US12361522B2 (https=)
EP (1) EP4525456A4 (https=)
JP (3) JP7606651B2 (https=)
WO (1) WO2024042683A1 (https=)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7847258B1 (ja) * 2025-05-08 2026-04-16 株式会社ブロードリーフ 情報処理装置、情報処理方法、及び情報処理プログラム

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008154192A (ja) 2006-11-22 2008-07-03 Sony Corp 画像表示システム、表示装置、表示方法
JP2016134859A (ja) * 2015-01-21 2016-07-25 株式会社ナイルワークス 動画配信システム
US20180330610A1 (en) * 2016-05-10 2018-11-15 Tencent Technology (Shenzhen) Company Limited Traffic accident warning method and traffic accident warning apparatus
KR102115098B1 (ko) * 2018-11-30 2020-05-25 서울과학기술대학교 산학협력단 실내 공간용 파노라마 영상 생성 시스템 및 방법
JP2021048597A (ja) * 2020-11-18 2021-03-25 Ｌｉｎｅ株式会社 コンピュータプログラム、情報処理方法および端末
JP2021064886A (ja) * 2019-10-15 2021-04-22 本田技研工業株式会社 被写体撮影システム、被写体撮影方法、および被写体撮影プログラム
JP2021083034A (ja) * 2019-11-22 2021-05-27 トヨタ自動車株式会社 画像データ配信システム及び画像データ表示端末

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3918518B2 (ja) * 2001-11-09 2007-05-23 ソニー株式会社 情報処理システムおよび情報処理方法、プログラムおよび記録媒体、移動体、並びに情報処理装置
US20110102637A1 (en) * 2009-11-03 2011-05-05 Sony Ericsson Mobile Communications Ab Travel videos
JP2012129961A (ja) * 2010-12-17 2012-07-05 Tokyo Metropolitan Univ 映像データベース構築システム
US9570113B2 (en) * 2014-07-03 2017-02-14 Gopro, Inc. Automatic generation of video and directional audio from spherical content
JP6301779B2 (ja) * 2014-08-07 2018-03-28 エヌ・ティ・ティ・コミュニケーションズ株式会社 センサ制御装置、センサ制御方法およびセンサ制御プログラム
JP7081468B2 (ja) * 2018-12-10 2022-06-07 株式会社Ｊｖｃケンウッド ナビゲーション制御装置、ナビゲーション方法およびプログラム
JP7323355B2 (ja) * 2019-06-28 2023-08-08 株式会社Ｎｔｔドコモ 情報処理装置
US11109107B2 (en) * 2019-12-10 2021-08-31 Tetsuro KIYOOKA Video streaming playback system and method

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008154192A (ja) 2006-11-22 2008-07-03 Sony Corp 画像表示システム、表示装置、表示方法
JP2016134859A (ja) * 2015-01-21 2016-07-25 株式会社ナイルワークス 動画配信システム
US20180330610A1 (en) * 2016-05-10 2018-11-15 Tencent Technology (Shenzhen) Company Limited Traffic accident warning method and traffic accident warning apparatus
KR102115098B1 (ko) * 2018-11-30 2020-05-25 서울과학기술대학교 산학협력단 실내 공간용 파노라마 영상 생성 시스템 및 방법
JP2021064886A (ja) * 2019-10-15 2021-04-22 本田技研工業株式会社 被写体撮影システム、被写体撮影方法、および被写体撮影プログラム
JP2021083034A (ja) * 2019-11-22 2021-05-27 トヨタ自動車株式会社 画像データ配信システム及び画像データ表示端末
JP2021048597A (ja) * 2020-11-18 2021-03-25 Ｌｉｎｅ株式会社 コンピュータプログラム、情報処理方法および端末

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4525456A4

Also Published As

Publication number Publication date
JP7717434B2 (ja) 2025-08-04
JP2025022961A (ja) 2025-02-14
JP7606651B2 (ja) 2024-12-25
US20250095111A1 (en) 2025-03-20
US20250157006A1 (en) 2025-05-15
EP4525456A4 (en) 2026-01-14
US12361522B2 (en) 2025-07-15
US12475540B2 (en) 2025-11-18
EP4525456A1 (en) 2025-03-19
JP7614440B1 (ja) 2025-01-15
JP2025023054A (ja) 2025-02-14
JPWO2024042683A1 (https=) 2024-02-29
US20250157004A1 (en) 2025-05-15

Similar Documents

Publication Publication Date Title
JP6773579B2 (ja) マルチメディアキャプチャ用のシステム及び方法
AU2016208929B2 (en) Systems and methods for providing information for an on-demand service
JP7407246B2 (ja) サービス提供装置、サービス提供方法およびサービス提供プログラム
JP7614440B1 (ja) 情報処理装置、移動端末、情報処理方法、およびプログラム
US11487286B2 (en) Mobile object system that provides a commodity or service
JP7803736B2 (ja) 配信サーバー、プログラム及び配信システム
JP7670937B2 (ja) 情報処理装置、および情報処理方法
JP7733427B2 (ja) 情報システム
JP7667921B2 (ja) 情報処理装置、および情報処理方法
JP6917426B2 (ja) 画像表示装置、画像表示方法、および、画像表示システム
WO2024180655A1 (ja) 情報処理装置、および情報処理方法
JP2008107927A (ja) 車両用情報授受システム
KR102118441B1 (ko) 자연공원 관광서비스 관리서버
JP7667380B2 (ja) 情報処理装置、移動端末、ユーザ端末、および情報処理方法
US12432320B1 (en) Anonymous remote device content capture, scheduling and secure delivery
US20260012441A1 (en) Anonymous Remote Device Scheduling, Content Capture and Secure Delivery
WO2024201927A1 (ja) 情報処理装置、ユーザ端末、および情報処理方法
WO2024116366A1 (ja) 移動端末、情報処理装置、および情報処理方法
JP2025024688A (ja) プログラム、方法、情報処理装置
JP2024119425A (ja) 情報処理装置、及び、方法
Hussain et al. Glimpse: Real Time Transport Tracking System

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22956510

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2024542533

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 2022956510

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2022956510

Country of ref document: EP

Effective date: 20241210

WWE Wipo information: entry into national phase

Ref document number: 2501001026

Country of ref document: TH

NENP Non-entry into the national phase

Ref country code: DE