WO2024134862A1 - 情報処理装置、移動端末、ユーザ端末、および情報処理方法 - Google Patents

情報処理装置、移動端末、ユーザ端末、および情報処理方法 Download PDF

Info

Publication number
WO2024134862A1
WO2024134862A1 PCT/JP2022/047551 JP2022047551W WO2024134862A1 WO 2024134862 A1 WO2024134862 A1 WO 2024134862A1 JP 2022047551 W JP2022047551 W JP 2022047551W WO 2024134862 A1 WO2024134862 A1 WO 2024134862A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
unit
information
route
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2022/047551
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
健二 鳴島
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Micware Co Ltd
Original Assignee
Micware Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Micware Co Ltd filed Critical Micware Co Ltd
Priority to DE112022008115.5T priority Critical patent/DE112022008115T5/de
Priority to PCT/JP2022/047551 priority patent/WO2024134862A1/ja
Priority to JP2024565531A priority patent/JP7667380B2/ja
Publication of WO2024134862A1 publication Critical patent/WO2024134862A1/ja
Priority to JP2025063103A priority patent/JP7725183B2/ja
Priority to US19/188,000 priority patent/US12518545B2/en
Anticipated expiration legal-status Critical
Priority to US19/403,263 priority patent/US20260087823A1/en
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/50—Context or environment of the image
    • G06V20/56—Context or environment of the image exterior to a vehicle by using sensors mounted on the vehicle
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/20—Analysis of motion
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/27—Server based end-user applications
    • H04N21/274—Storing end-user multimedia data in response to end-user request, e.g. network recorder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/431—Generation of visual interfaces for content selection or interaction; Content or additional data rendering
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30241—Trajectory

Definitions

  • the present invention relates to an information processing device that can serve as a platform for providing video along a route.
  • Patent Document 1 Conventionally, there has been technology that provides users with image data taken with an in-vehicle camera in a location and environment of the user's choice (see, for example, Patent Document 1).
  • the information processing device of the first invention is an information processing device that includes an inquiry receiving unit that receives an inquiry including route identification information that identifies a route from a user terminal, a video acquisition unit that acquires a first video corresponding to location information that identifies a first partial route corresponding to location information that identifies at least a portion of the route identified by the route identification information, and acquires a second video corresponding to location information that identifies a second partial route beyond the first partial route of the route identified by the route identification information, and a video transmission unit that transmits the first video and the second video to the user terminal.
  • This configuration creates a platform for multiple mobile devices to appropriately provide videos taken at points along the route.
  • the information processing device of the second invention compared to the first invention, further comprises a terminal management unit in which terminal information including location information identifying the location of each mobile terminal is stored in association with each of one or more mobile terminals, a location receiving unit that receives location information from each of one or more mobile terminals, and a terminal determination unit that uses the location information received by the location receiving unit to determine one or more mobile terminals that were present on at least a portion of the route identified by the route identification information, and the video acquisition unit is an information processing device that acquires videos taken by each of the one or more mobile terminals determined by the terminal determination unit.
  • This configuration makes it possible to provide a platform that places a low load on mobile devices that provide video of points along the route.
  • the information processing device of the third invention is the information processing device of the first invention, further comprising an inquiry sending unit that sends an inquiry to each of the plurality of mobile terminals, and the video acquiring unit is an information processing device that receives video from one or more mobile terminals that are determined to satisfy a route condition, which is a condition that the route identification information corresponds to location information that identifies at least a part of a route, among the plurality of mobile terminals, in response to the sending of the inquiry.
  • a route condition which is a condition that the route identification information corresponds to location information that identifies at least a part of a route, among the plurality of mobile terminals, in response to the sending of the inquiry.
  • This configuration reduces the load on the platform to properly provide videos captured by mobile devices at points along the route.
  • the information processing device of the fourth invention is an information processing device according to any one of the first to fourth inventions, further comprising a rights holder processing unit that corresponds the video acquired by the video acquisition unit to a rights holder identifier that identifies the rights holder of the video, and performs rights holder processing, which is processing related to the rights holder identified by the rights holder identifier associated with the video.
  • This configuration allows for appropriate processing regarding video rights holders.
  • the information processing device of the fifth invention is an information processing device in which the rights holder processing unit is equipped with a third security means for storing the video in association with a rights holder identifier that identifies the user of the user terminal, in comparison with the fourth invention.
  • This configuration allows the rights holder of a video to become the rights holder who needs that video.
  • the mobile terminal of the sixth invention is a mobile terminal that includes a location acquisition unit that acquires location information that identifies the location of the mobile terminal, a capture unit that captures video, a mobile receiving unit that receives an inquiry that includes route identification information, a mobile determination unit that determines whether the location information acquired by the location acquisition unit satisfies a route condition that corresponds to location information that identifies at least a portion of the route identified by the route identification information, and a mobile video transmission unit that transmits the video when the mobile determination unit determines that the route condition is met.
  • This configuration makes it possible to realize a mobile terminal that can appropriately provide videos of points along a route.
  • the user terminal of the seventh invention includes a user output unit that outputs a map showing a route, a user transmission unit that transmits an inquiry including route identification information that identifies the route, a user reception unit that receives a video in response to the transmitted inquiry, a user reception unit that receives a point instruction that is an instruction for a point on the route on the map, and a user processing unit that obtains a video corresponding to location information indicating the point for the point instruction, and the user output unit is a user terminal that outputs the video obtained by the user processing unit.
  • This configuration makes it possible to realize a user terminal that can properly acquire videos of points along a route.
  • the information processing device of the present invention can properly obtain video of each point along the route.
  • Block diagram of information system A Block diagram of the information processing device 1 A flowchart illustrating an example of the operation of the information processing device 1. A flowchart illustrating an example of the terminal determination process A flowchart illustrating an example of the past video acquisition process. A flowchart illustrating an example of the maintenance process. A flowchart illustrating an example of the fourth maintenance process. A flowchart illustrating an example of the compensation process.
  • Block diagram of the computer system A flowchart for explaining an example of the operation of the mobile terminal 2 A flowchart for explaining an example of the operation of the user terminal 3 A diagram showing the terminal management table A diagram showing an example of the output A diagram showing an example of the output A diagram showing an example of the output Block diagram of information system B in embodiment 2
  • Block diagram of the information processing device 4 A flowchart for explaining an example of the operation of the information processing device 4
  • a flowchart for explaining an example of the operation of the mobile terminal 5 Overview of the computer system according to the above embodiment.
  • an information processing device that performs rights holder processing, which is processing related to the rights holder of the output video, is described.
  • the rights holder processing is, for example, a compensation process described below, and various types of preservation processing described below.
  • a mobile terminal that transmits acquired location information to an information processing device and transmits a captured video to the information processing device in response to a transmission instruction received from the information processing device.
  • a user terminal that accepts an instruction for a specific point on a route and outputs a video of that point will be described.
  • information X being associated with information Y means that information Y can be obtained from information X, or information X can be obtained from information Y, and the method of association is not important.
  • Information X and information Y may be linked, may exist in the same buffer, information X may be included in information Y, or information Y may be included in information X, etc.
  • FIG. 1 is a conceptual diagram of an information system A in this embodiment.
  • Information system A includes an information processing device 1, one or more mobile terminals 2, and one or more user terminals 3.
  • the information processing device 1 is a server that provides videos transmitted by one or more mobile terminals 2 to a user terminal 3.
  • the information processing device 1 is, for example, a cloud server, an ASP server, etc., but the type is not important.
  • the information processing device 1 may also be a device that constitutes a blockchain.
  • a video is, for example, a video of 60 frames per second or 30 frames per second, but it may also be a collection of multiple still images captured with an interval of a specified time (for example, one minute) or more, or a collection of multiple still images captured when specified conditions are met.
  • the still images may also be referred to as fields or frames.
  • the mobile terminal 2 is a terminal that can move.
  • the mobile terminal 2 is a terminal that is installed on a moving object and that takes video.
  • the mobile terminal 2 is, for example, a smartphone, a tablet terminal, a camera with a communication function, glasses with a camera, or a smartwatch with a camera.
  • installation usually means that it is fixed, but it may also be considered to include being in contact with or held.
  • a mobile object is an object that moves, for example, equipment that moves underground, or a living thing.
  • a living thing is usually a person, but it may also be a dog or cat, etc.
  • the user terminal 3 is a terminal used by a user.
  • a user is someone who watches videos or needs videos.
  • the user terminal 3 may have the functions of a mobile terminal 2.
  • the user terminal 3 may be a terminal of a user who provides videos.
  • the user terminal 3 may be, for example, a navigation terminal, a smartphone, a tablet terminal, a so-called personal computer, a navigation terminal, etc., and the type is not important.
  • the information processing device 1 and one or more mobile terminals 2, and the information processing device 1 and one or more user terminals 3, can typically communicate with each other via a network such as the Internet.
  • FIG. 2 is a block diagram of information system A in this embodiment.
  • FIG. 3 is a block diagram of information processing device 1.
  • the information processing device 1 comprises a storage unit 11, a receiving unit 12, a processing unit 13, and a transmitting unit 14.
  • the storage unit 11 comprises a terminal management unit 111.
  • the receiving unit 12 comprises a location receiving unit 121, and an inquiry receiving unit 122.
  • the processing unit 13 comprises a location accumulation unit 131, a terminal determination unit 132, a video acquisition unit 133, a video composition unit 134, and a rights holder processing unit 135.
  • the rights holder processing unit 135 comprises a first maintenance means 1351, a second maintenance means 1352, a third maintenance means 1353, a fourth maintenance means 1354, and a remuneration means 1355.
  • the transmitting unit 14 comprises a video transmission unit 141.
  • the mobile terminal 2 comprises a mobile storage unit 21, a mobile receiving unit 22, a mobile processing unit 23, a mobile transmission unit 24, and a mobile output unit 25.
  • the mobile processing unit 23 comprises a position acquisition unit 231, a photographing unit 232, an attribute value acquisition unit 233, and a configuration unit 234.
  • the mobile transmission unit 24 comprises a position transmission unit 241, and a mobile video transmission unit 242.
  • the mobile output unit 25 comprises a video output unit 251.
  • the user terminal 3 includes a user storage unit 31 , a user reception unit 32 , a user processing unit 33 , a user transmission unit 34 , a user reception unit 35 , and a user output unit 36 .
  • the various types of information are, for example, terminal information described below, a video, and one or more video attribute values associated with the video.
  • Video attribute values are the attribute values of a video.
  • Video attribute values are, for example, environmental information.
  • Environmental information is information about the environment in which a video was shot.
  • Environmental information is, for example, location information, time information, weather information, temperature information, and seasonal information, which will be described later.
  • Time information is information that specifies the time when a video was shot. The time when a video was shot may be around the time when the video was shot, and accuracy is not required.
  • Time information is, for example, the time, year/month/date/time, year/month/date/time/minute, year/month/date/time/minute/second, year/month/date, and month/day. In other words, the granularity of the time indicated by the time information does not matter.
  • Weather information is information that specifies the weather at the location (or region) where the video was shot. Weather information is, for example, “sunny,” “rain,” “snow,” or “cloudy.” Temperature information is information that specifies the temperature at the location where the video was shot. Temperature information is, for example, “25 degrees” or “above 30 degrees.” Seasonal information is information that specifies the season at the location where the video was shot. Examples of seasonal information are “spring,” “summer,” “early summer,” and "winter.”
  • the terminal management unit 111 stores one or more pieces of terminal information.
  • the terminal information is information related to the mobile terminal 2.
  • the terminal information here typically includes a terminal identifier, which is an identifier of the mobile terminal 2, location information, and terminal communication information.
  • the mobile terminal 2 here is typically a terminal capable of transmitting video.
  • the terminal information is associated with the mobile terminal 2.
  • the terminal identifier is information that identifies the mobile terminal 2.
  • the terminal identifier may be a rights holder identifier that identifies the rights holder who is the user of the mobile terminal 2.
  • the terminal identifier is, for example, the ID of the mobile terminal 2, the user identifier of the user of the mobile terminal 2, the name of the mobile terminal 2, the IP address of the mobile terminal 2, or the MAC address of the mobile terminal 2.
  • a rights holder is someone who has some rights regarding the video captured by the mobile terminal 2.
  • a rights holder is, for example, the owner of the video, the copyright holder of the video, the owner of the mobile terminal 2 that captured the video, or the person with the right to dispose of the video.
  • a rights holder is, for example, the initial rights holder of the video.
  • the rights holder is usually the owner of the mobile terminal 2, but it can be anyone who has rights to the video captured by the mobile terminal 2.
  • the rights holder identifier may be a terminal identifier.
  • the rights holder identifier is, for example, the rights holder's ID, the rights holder's name, the rights holder's email address, or the rights holder's phone number.
  • the rights holder's ID is, for example, a user identifier.
  • Location information is information that identifies a location. Location information is, for example, (latitude, longitude) or (movement, longitude, altitude).
  • the terminal communication information is information for communicating with the mobile terminal 2.
  • the terminal communication information is, for example, the IP address of the mobile terminal 2, the MAC address of the mobile terminal 2, and the ID of the communication app installed on the mobile terminal 2.
  • the receiving unit 12 receives various information and instructions from the mobile terminal 2 or the user terminal 3.
  • the various information and instructions are, for example, location information, inquiries, videos, and additional videos described below.
  • the receiving unit 12 may receive video from one or more mobile terminals 2 in pairs with the location information. In such a case, it is preferable for the receiving unit 12 to receive the video continuously. Continuous reception means, for example, receiving periodically or receiving constantly. The interval at which the video is received periodically may vary slightly.
  • the location receiving unit 121 receives location information from one or more mobile terminals 2. It is preferable that the location receiving unit 121 continuously receives the latest location information from one or more mobile terminals 2. The location receiving unit 121 may receive from the mobile terminal 2 one or more sets of location information corresponding to videos stored in the mobile terminal 2. The location receiving unit 121 normally receives location information in association with a terminal identifier.
  • the inquiry receiving unit 122 receives an inquiry from the user terminal 3.
  • a query can be said to be a request for video of one or more points on a route.
  • the query includes route identification information.
  • the query includes, for example, a timing flag.
  • Route identification information is information that identifies a route.
  • Route identification information may be route information that includes multiple location information, may be information on a departure point and a destination, or may be a collection of three or more location names. Route identification information may be any information that can identify a route, and its structure and content are not important.
  • the timing flag is information that specifies the type of video to be acquired.
  • the timing flag can be "real time,” which instructs the transmission of real-time video being shot, or "past,” which instructs the transmission of video that was shot in the past and stored.
  • the processing unit 13 performs various types of processing. For example, the various types of processing are performed by the location accumulation unit 131, the terminal determination unit 132, the video acquisition unit 133, the video composition unit 134, and the rights holder processing unit 135.
  • the processing unit 13 may store the videos continuously received by the receiving unit 12 in association with the location information and the terminal identifier.
  • the processing unit 13 determines whether the latest location information of the mobile terminal 2 transmitting the video, which is the location information received by the receiving unit 12, has deviated from the route indicated by the route identification information.
  • the location accumulation unit 131 accumulates the location information received by the location receiving unit 121 from the mobile terminal 2 in the terminal management unit 111 in association with the mobile terminal 2.
  • the location accumulation unit 131 accumulates the location information in the terminal management unit 111, for example, in pairs with a terminal identifier. It is preferable that the location accumulation unit 131 add the location information to the terminal management unit 111 in association with the mobile terminal 2.
  • the terminal determination unit 132 determines one or more mobile terminals 2 that satisfy the route conditions in response to the received query.
  • a route condition is a condition that corresponds to location information that identifies at least a part of the route identified by the route identification information.
  • a route condition is that the mobile terminal 2 is capturing video at any point on the route identified by the route identification information, that the mobile terminal 2 is present at any point on the route identified by the route identification information, or that the mobile terminal 2 is holding video captured at one or more points on the route identified by the route identification information.
  • the terminal determination unit 132 determines, for example, one or more mobile terminals 2 that correspond to the location information that identifies at least a portion of the route identified by the route identification information contained in the received inquiry.
  • the terminal determination unit 132 may select only one or more mobile terminals 2 that satisfy the selection conditions.
  • the selection condition is, for example, that the mobile terminal 2 corresponds to a plurality of pieces of location information for which the ratio of support for the route specified by the route specification information is equal to or greater than a threshold value.
  • the selection condition is, for example, that the ratio of support for the route specified by the route specification information is the largest.
  • the terminal determination unit 132 may sort the multiple mobile terminals 2 using sort information as a key.
  • the sort information is, for example, the proportion of the route identified by the multiple location information associated with the mobile terminal 2 that supports the route identified by the route identification information.
  • the video acquisition unit 133 acquires videos taken by one or more mobile terminals 2 that satisfy the route conditions.
  • the video acquisition unit 133 acquires, for example, a first video corresponding to position information that identifies a first partial route of the route identified by the route identification information, and acquires a second video corresponding to position information that identifies a second partial route other than the first partial route of the route identified by the route identification information.
  • the first partial route and the second partial route are parts of the route identified by the route identification information. It is preferable that the first partial route and the second partial route are continuous routes. It is preferable that the first partial route and the second partial route are routes that do not overlap. In the route identified by the route identification information, for example, the second partial route is a route beyond the first partial route.
  • the video acquisition unit 133 acquires, for example, videos taken by one or more mobile terminals 2 determined by the terminal determination unit 132.
  • the video acquisition unit 133 transmits a transmission instruction to one or more mobile terminals 2 determined by the terminal determination unit 132. Then, the video acquisition unit 133 receives video from each of the one or more mobile terminals 2, for example. Such video is usually video that is transmitted immediately after being captured by the mobile terminal 2. Such video is appropriately referred to as real-time video.
  • the video acquisition unit 133 transmits, for example, a transmission instruction including the route identification information to one or more mobile terminals 2 determined by the terminal determination unit 132. Then, the video acquisition unit 133 receives from each mobile terminal 2, for example, videos that have been captured by the one or more mobile terminals 2 along the route specified by the route identification information and that have been stored in each mobile terminal 2. Such videos are videos that have been captured and stored by the mobile terminal 2, and are appropriately referred to as past videos.
  • the video acquisition unit 133 acquires, for example, video stored by the rights holder processing unit 135 described below, which is video shot at one or more points on the route specified by the route identification information. Such videos are also referred to as past videos, as appropriate.
  • the video acquisition unit 133 for example, checks location information paired with the past videos stored by the rights holder processing unit 135, and acquires videos corresponding to the location information of one or more points on the route specified by the route identification information.
  • the video acquisition unit 133 acquires videos, for example, using access information described below.
  • the video composition unit 134 for example, combines the multiple videos acquired by the video acquisition unit 133 in time to compose one video. It is preferable that each of the multiple videos is a video taken at a different point on the route specified by the route identification information. Note that one video combined in time is one video that connects multiple original videos. When the multiple videos that are the source of one video combined in time are taken, it is preferable that they are continuous in time, but they may be separated in time. For example, the time when one video that is the source of one video was taken may be, for example, 8:20, and the day when another video that is the source of the one video was taken may be, for example, 8:25. It is preferable that the video composition unit 134 combines the multiple videos in the order of the points on the route specified by the route identification information to compose one video. One combined video is appropriately called a combined video.
  • the video composition unit 134 also composes a single video by, for example, spatially fusing each of the multiple videos acquired by the video acquisition unit 133.
  • a single spatially fused video is a video that is constructed by constructing a frame using some or all of the frames that compose each of the multiple original videos for each of the multiple frames that compose each of the multiple original videos, and then connecting the constructed frames in time. At least one of the frames that compose the single video is a frame that contains some or all of the frames of each of the multiple original videos.
  • a single spatially fused video is appropriately referred to as a fused video.
  • the video composing unit 134 may perform processing up to passing a video acquired by the video acquiring unit 133 to the video transmitting unit 141. Such processing may also be considered as processing for composing a video.
  • the processing up to passing to the video transmitting unit 141 is usually processing for sequentially placing the videos in a buffer for transmitting the videos.
  • the video composition unit 134 for example, combines the multiple videos acquired by the video acquisition unit 133 in the order of the time information corresponding to the videos to compose a single video.
  • the video composition unit 134 acquires parts of the multiple videos acquired by the video acquisition unit 133, and combines the parts of the videos in order to compose a single video.
  • Combining multiple videos in time usually means combining parts of the videos taken by multiple mobile terminals 2 in the order of the time they were taken.
  • Combining parts of videos in order may also mean passing parts of the videos in order to the video transmission unit 141.
  • Combining in time order corresponding to the videos means combining the videos in the time order indicated by the time information corresponding to the videos, or combining the videos in the order in which they were received.
  • Combining multiple videos in time to compose a single video should result in a single video that the user can see.
  • the video composition unit 134 for example, spatially fuses parts of multiple videos acquired by the video acquisition unit 133, each of which has different position information associated with it, to compose a single video.
  • the video composition unit 134 for example, composes a single frame using some or all of the frames that compose each of the multiple videos acquired by the video acquisition unit 133, and connects the frames in time to compose a single video.
  • the process of spatially fusing frames included in each of a plurality of moving images is, for example, the following processes (a) and (b).
  • the video composition unit 134 performs, for example, a process of matching the direction and scale of each of the multiple frames that are the subject of the spatial connection process. Next, the video composition unit 134 detects, for example, identical areas in each of the multiple frames. Next, the video composition unit 134 performs, for example, a process of overlapping multiple frames that have the same area to compose one wide-area frame. Note that it is possible to detect the same area in each of the multiple frames using publicly known technology. (b) Machine learning-based methods
  • the video composition unit 134 for example, provides multiple frames and a learning model to a module that performs machine learning prediction processing, executes the module, and obtains a single frame over a wide area.
  • the learning model is obtained by providing multiple training data sets, each of which has multiple frames as explanatory variables and a single wide-area frame composed of the multiple frames as a target variable, to a module that performs machine learning learning processing, and then executing the module.
  • the learning model may also be called a learner, a classifier, a classification model, etc.
  • the machine learning algorithm deep learning is preferable, but any algorithm such as random forest is also acceptable.
  • various machine learning functions such as the TensorFlow library and the random forest module of the R language, as well as various existing libraries, can be used.
  • Rights holder processing unit 135 performs rights holder processing.
  • Rights holder processing is processing related to a rights holder identified by a rights holder identifier associated with a video.
  • Rights holder processing unit 135 performs rights holder processing, which is processing in response to the video sending unit 141 sending a video, and is processing related to a rights holder identified by a rights holder identifier associated with the video.
  • Rights holder processing is, for example, a first security processing described below, a second security processing described below, a third security processing described below, a fourth security processing described below, and a compensation processing described below.
  • the rights holder identifier corresponding to a video is, for example, a rights holder identifier corresponding to one or more videos that are the basis of the constructed video, or an identifier of a user who requested the video.
  • the user who requested the video is the user of the user terminal 3 that sent the inquiry.
  • the first maintenance means 1351 performs a first maintenance process of storing a video constructed by the video construction unit 134 in association with a set of attribute values corresponding to one or more videos that are the basis of the video.
  • the first maintenance means 1351 may also perform a first maintenance process of storing a video received from the mobile terminal 2 in association with a set of attribute values corresponding to the video.
  • the set of attribute values is one or more video attribute values.
  • the second preservation means 1352 performs a second preservation process in which a video composed by the video composition unit 134 is stored in association with a rights holder identifier corresponding to one or more videos that are the basis of the video.
  • the first preservation means 1351 or the second preservation means 1352 may store a video composed by the video composition unit 134 in association with a set of attribute values corresponding to one or more videos that were the basis of the video, and with a rights holder identifier corresponding to one or more videos that were the basis of the video.
  • the third security means 1353 stores a video composed by the video composition unit 134 in association with a rights holder identifier that identifies the user of the user terminal 3.
  • the user of the user terminal 3 here is the person who watches the video.
  • the user terminal 3 here is, for example, the terminal that sent the inquiry.
  • the destination where a video is stored is, for example, the storage unit 11, but it may also be another device, such as another device that constitutes the blockchain.
  • the fourth preservation means 1354 performs a fourth preservation process that accumulates preservation information.
  • the preservation information includes access information for accessing one of the accumulated videos.
  • the order of accumulation of a video and the fourth preservation process for the preservation information corresponding to that video does not matter.
  • the fourth preservation means 1354 performs a fourth preservation process, for example, of storing preservation information including access information for accessing a video that has been composed and stored by the video composition unit 134 in the blockchain.
  • the fourth security means 1354 stores the security information in the blockchain. That is, it is preferable that the fourth security means 1354 stores the security information in the distributed ledger of the blockchain. It is preferable that the fourth security means 1354 registers the security information as an NFT (non-fungible token). It is preferable that the fourth security means 1354 registers the security information in a distributed file system in an IPFS (Inter Planetary File System) network.
  • NFT non-fungible token
  • IPFS Inter Planetary File System
  • the preservation information is information for ensuring the originality of a video. It can be said that the preservation information is heading information for a video.
  • the preservation information is, for example, access information and a set of attribute values. It is preferable that the preservation information has, for example, one or more rights holder identifiers.
  • the preservation information has multiple rights holder identifiers, the rights holder of the video may be shared, and the multiple rights holder identifiers may be rights holder history information.
  • the rights holder history information is a set of rights holder identifiers and is information that indicates the history of the rights holder.
  • the fourth preservation process can guarantee the originality of the preservation information of a registered video.
  • the access information is information for accessing a video.
  • the access information is information that identifies the storage destination of the video.
  • the access information is, for example, a URL or a URI.
  • the preservation information includes information (which may be called a flag) indicating whether the video can be provided to a third party.
  • the flag may be, for example, information indicating that the video can be viewed by a third party, information indicating that the video can be sold, or information indicating that neither viewing nor selling is permitted.
  • the compensation means 1355 performs compensation processing for each rights holder identified by a rights holder identifier corresponding to one or more videos that are the basis of a video composed by the video composition unit 134.
  • the reward process is a process of giving a reward.
  • the reward process is, for example, a process of increasing points managed in pair with one or more rights holder identifiers associated with a video.
  • the reward process is, for example, a process of making a payment to a rights holder identified by one or more rights holder identifiers associated with a video.
  • the reward process is, for example, a process of transmitting a video or other content to a user terminal 3 of a rights holder identified by one or more rights holder identifiers associated with a video.
  • the reward process need only give a benefit to a rights holder identified by one or more rights holder identifiers associated with a video, and the content of the benefit is not important.
  • the reward may be, for example, money, points, goods, content, etc., and the content is not important.
  • the compensation means 1355 performs compensation processing, which is a process of acquiring one or more video attribute values corresponding to one or more videos that are the basis of a video transmitted by the video transmission unit 141, determining compensation for each of multiple rights holders using the one or more video attribute values, and awarding the compensation.
  • the one or more video attribute values here are, for example, the amount of video data, the duration of the video, the number of frames in the video, and the resolution of the video.
  • the reward means 1355 preferably performs reward processing, which is a process of acquiring a reward amount corresponding to a service identifier that identifies a service provided to the target video, and giving a reward corresponding to the reward amount.
  • the service identifier is, for example, "view” or "purchase.”
  • the storage unit 11 stores the reward amount corresponding to the service identifier, or information for determining the reward amount corresponding to the service identifier.
  • the reward means 1355 performs reward processing, which is, for example, a process of acquiring a reward amount using one or more pieces of information from one or more video attribute values and one or more service identifiers, and granting a reward corresponding to the reward amount.
  • reward processing is, for example, a process of acquiring a reward amount using one or more pieces of information from one or more video attribute values and one or more service identifiers, and granting a reward corresponding to the reward amount.
  • an arithmetic formula or a correspondence table corresponding to each of the multiple service identifiers is stored in the storage unit 11.
  • the arithmetic formula is a formula that calculates the reward amount using one or more video attribute values as parameters.
  • the correspondence table is a table having multiple pieces of correspondence information that manage the reward amounts corresponding to one or more video attribute values.
  • the reward means 1355 normally performs a process of charging a user who has enjoyed a service related to the target video with a reward.
  • the process of charging a user with a reward is, for example, a process of charging the user with the amount of reward acquired.
  • the process of charging a user with a reward is, for example, a process of charging the user with the amount of reward acquired and the amount of profit obtained by the operator of the information processing device 1.
  • the process of charging a user with a reward is, for example, a process of deducting points corresponding to the user who has enjoyed the service, a payment process using the user's credit card number, etc.
  • the transmission unit 14 transmits various types of information or instructions to the mobile terminal 2 or the user terminal 3.
  • the various types of information or instructions are, for example, video, a transmission instruction, and a stop instruction.
  • a stop instruction is an instruction to stop the transmission of video.
  • the transmission unit 14 determines that the latest location information of the mobile terminal 2 transmitting the video has deviated from the route indicated by the route identification information, it transmits a stop instruction to the mobile terminal 2.
  • the video sending unit 141 sends the video constructed by the video construction unit 134 to the user terminal 3.
  • the video constructed by the video construction unit 134 may be the video acquired by the video acquisition unit 133 itself.
  • the video sending unit 141 sends, for example, the first video and the second video acquired by the video acquiring unit 133 to the user terminal 3. It is preferable that the video sending unit 141 sends the videos in the order of positions on the route specified by the route specifying information. ⁇ Details of components of mobile terminal 2>
  • the mobile storage unit 21 stores various types of information.
  • the various types of information are, for example, video, attribute value sets, rights holder identifiers, and camera attribute values.
  • the camera attribute values are the attribute values of the camera.
  • the camera attribute values are, for example, the angle of view, directional information, and resolution.
  • one or more still images that make up a video are associated with one or more video attribute values that make up an attribute value set.
  • the one or more video attribute values may correspond to all still images, may correspond to some of the still images, or may correspond to multiple still images.
  • the mobile receiving unit 22 receives various types of information.
  • the various types of information are, for example, a transmission instruction and a stop instruction.
  • the mobile instruction receiving unit 221 receives a transmission instruction from the information processing device 1.
  • the movement processing unit 23 performs various types of processing.
  • the various types of processing are, for example, processing performed by a position acquisition unit 231, a photographing unit 232, an attribute value acquisition unit 233, and a configuration unit 234.
  • the location acquisition unit 231 acquires location information.
  • the location acquisition unit 231 typically acquires location information that identifies the location of the mobile terminal 2.
  • the location acquisition unit 231 acquires location information, for example, by a GPS receiver. However, the means or algorithm by which the location acquisition unit 231 acquires the location information is not important.
  • the image capturing unit 232 captures video.
  • the image capturing unit 232 captures video while the mobile terminal 2 is moving. It is preferable that the captured video be associated with location information acquired by the location acquisition unit 231. It is preferable that the captured video be associated with one or more video attribute values acquired by the attribute value acquisition unit 233, which will be described later.
  • the image capture unit 231 stores the captured video in the mobile storage unit 21.
  • the image capture unit 231 stores video in the mobile storage unit 21, which has a limited storage capacity, it is preferable that the image capture unit 231 overwrites the area in which the old video is stored with the new video.
  • the structure of the mobile storage unit 21 is a ring buffer structure.
  • the attribute value acquisition unit 233 acquires one or more camera attribute values including directional information indicating the direction in which the image capture unit 232 captures images. It is preferable that the attribute value acquisition unit 233 acquires one or more video attribute values including the camera attribute value.
  • the attribute value acquisition unit 233 acquires, for example, one or more video attribute values.
  • One or more video attribute values may be referred to as an attribute value set.
  • the attribute value acquisition unit 233 acquires, for example, time information from a clock (not shown) during shooting.
  • the attribute value acquisition unit 233 acquires time information, for example, constantly, at predetermined intervals, or when acquisition conditions are met.
  • the attribute value acquisition unit 233 acquires time information from a clock (not shown) during shooting, and acquires seasonal information corresponding to the time information.
  • the attribute value acquisition unit 233 acquires weather information, for example, during shooting. Note that even if the shooting location is indoors, the weather information may be information about the weather in the same area as the indoor location.
  • the movement processing unit 23 acquires weather information corresponding to the position information, for example, from a server (not shown).
  • the movement processing unit 23 acquires weather information, for example, constantly, at predetermined intervals, or when acquisition conditions are met.
  • the attribute value acquisition unit 23 acquires temperature information, for example, during shooting.
  • the movement processing unit 23 acquires, for example, temperature information corresponding to the location information from a server (not shown).
  • the movement processing unit 23 acquires, for example, temperature information from a temperature sensor installed on a moving object.
  • the movement processing unit 23 acquires temperature information, for example, constantly, at predetermined intervals, or when an acquisition condition is satisfied.
  • the acquisition condition is, for example, when the analysis result of the video satisfies a predetermined condition.
  • the attribute value acquisition unit 233 acquires one or more tags for the video captured by the image capture unit 231 and associates them with the video. Note that the tags can also be considered as video attribute values.
  • the attribute value acquisition unit 233 analyzes the video captured by the imaging unit 231 and acquires one or more tags for the video.
  • the attribute value acquisition unit 233 acquires one or more tags, for example, using one or more moving object attribute values acquired during shooting by the shooting unit 231.
  • the moving object attribute values are, for example, CAN data.
  • the attribute value acquisition unit 233 determines one or more still images that match the video tag condition, and acquires a tag that pairs with the video tag condition.
  • the attribute value acquisition unit 233 may also associate the tag with the one or more still images. Note that the still images are frames that make up the video.
  • the attribute value acquisition unit 233 analyzes frames of the video, recognizes multiple cars, and acquires the spacing between each of the multiple cars.
  • the attribute value acquisition unit 233 also acquires the number of cars whose spacing is within a threshold.
  • the attribute value acquisition unit 233 also acquires the moving distance and frame rate of one car in multiple frames, and acquires the speed of the car.
  • the attribute value acquisition unit 233 uses the number of cars whose spacing is within a threshold and the speed of the car to determine whether or not the video tag condition is met. If the video tag condition is met, the attribute value acquisition unit 233 acquires the tag "traffic jam" that is paired with the video tag condition. The attribute value acquisition unit 233 may also associate the tag "traffic jam" with the analyzed frame of the analyzed video.
  • the attribute value acquisition unit 233 determines one or more moving object attribute values that match an attribute value tag condition, and acquires a tag that pairs with the attribute value tag condition.
  • the attribute value acquisition unit 233 may also associate the tag with a video that pairs with the one or more moving object attribute values.
  • the attribute value acquisition unit 233 uses the speed history of the CAN data associated with each field of the video to detect CAN data that matches the attribute value tag condition, acquires the tag "traffic jam” that matches the attribute value tag condition, and associates the tag with the field associated with the CAN data.
  • the CAN data associated with each field of the video is CAN data acquired at the same time that the field was photographed.
  • the configuration unit 234 associates the acquired location information with the video and acquires an additional video. For example, the configuration unit 234 acquires an additional video in which one or more camera attribute values acquired by the attribute value acquisition unit 233 are also associated with the video. For example, the configuration unit 234 acquires an additional video in which one or more video attribute values acquired by the attribute value acquisition unit 233 are also associated with the video.
  • An additional video is a video to which one or more video attribute values have been added. Such one or more video attribute values typically include location information.
  • the mobile transmission unit 24 transmits various types of information to the information processing device 1.
  • the various types of information are, for example, location information, video, and additional video.
  • the mobile transmission unit 24 may continuously transmit video captured by the image capture unit 232 to the information processing device 1. In such cases, the video is usually associated with location information.
  • the mobile transmission unit 24 stops transmitting the video when a stop instruction is received.
  • the location transmission unit 241 transmits the location information acquired by the location acquisition unit 231 to the information processing device 1.
  • the location transmission unit 241 continuously transmits the location information to the information processing device 1. Continuously may include always or periodically. Periodically means that the transmission interval may vary slightly. There is no restriction on the frequency or interval at which the location transmission unit 241 transmits the location information.
  • the moving video transmission unit 242 transmits the video captured by the image capture unit 232 in response to, for example, the movement instruction receiving unit 221 receiving a transmission instruction. It is preferable for the moving video transmission unit 242 to transmit additional videos.
  • the movement processing unit 23 acquires from the movement storage unit 21 past videos paired with one or more pieces of location information corresponding to the route specified by the route specification information contained in the transmission instruction, and the movement video sending unit 242 sends the past videos. It is preferable that the movement video sending unit 242 also sends additional videos.
  • the movement output unit 25 outputs various types of information.
  • the various types of information are, for example, videos, additional videos, and sets of attribute values.
  • Output is a concept that includes displaying on a monitor, projecting using a projector, printing on a printer, outputting sound, sending to an external device, storing on a recording medium, and passing on the results of processing to other processing devices or other programs.
  • the video output unit 251 outputs a video. It is preferable that the video output unit 251 outputs an additional video.
  • the output here may be storage in the moving storage unit 21.
  • the user storage unit 31 stores various types of information. Examples of the various types of information include user identifiers, videos, inquiries, and map information.
  • the user reception unit 32 receives various instructions and information.
  • the various instructions and information are, for example, inquiries, location instructions, purchase instructions, and route specification information. Note that an inquiry may include a purchase instruction. Also, the route specification information may be a destination.
  • reception includes the reception of information entered from input devices such as a keyboard, mouse, or touch panel, the reception of information transmitted via a wired or wireless communication line, and the reception of information read from recording media such as optical disks, magnetic disks, and semiconductor memory.
  • a location instruction is an instruction for a location on the route shown on the output map.
  • the location instruction here is an instruction to output a video of that location.
  • a purchase instruction is an instruction to purchase a video.
  • the purchase instruction is associated with a user identifier.
  • the purchase instruction typically includes information that identifies the video.
  • the purchase instruction has, for example, a video identifier.
  • the purchase instruction includes, for example, an inquiry.
  • the purchase instruction includes, for example, the conditions of the purchase.
  • the conditions of the purchase are, for example, the purchase amount.
  • the conditions of the purchase include, for example, information that identifies the rights period.
  • the means for inputting various instructions and information can be anything, such as a touch panel, keyboard, mouse, or menu screen.
  • the user processing unit 33 performs various types of processing.
  • the various types of processing are processing for creating a data structure for transmitting the various instructions and information received by the user receiving unit 32.
  • the various types of processing are processing for creating a structure for transmitting the information received by the user receiving unit 35.
  • the user processing unit 33 acquires a video corresponding to the location information indicating the location corresponding to the location instruction received by the user reception unit 32. Such a video is a part or all of the videos received by the user reception unit 35.
  • the user processing unit 33 obtains route specification information using the current location and the destination. Note that this processing is a well-known processing in a navigation terminal.
  • the user transmission unit 34 transmits various instructions and information to the information processing device 1.
  • Various instructions and information are, for example, inquiries and purchase instructions.
  • the user transmission unit 34 transmits a query including route identification information that identifies a route.
  • the timing or trigger for the user transmission unit 34 to transmit the query is not important. For example, when a route is set, the user transmission unit 34 transmits a query including route identification information that identifies the route.
  • the user receiving unit 35 receives the video in response to the transmission of the inquiry.
  • the user receiving unit 35 normally receives the video from the information processing device 1.
  • the user receiving unit 35 receives position information of a mobile terminal 2 that is located at a point on the route specified by the route identification information.
  • the user receiving unit 35 receives thumbnail images constituting the video captured by a mobile terminal 2 that is located at a point on the route specified by the route identification information.
  • the user output unit 36 outputs a map using the map information in the user storage unit 31.
  • the user output unit 36 outputs a map that clearly shows the route indicated by the route specification information acquired by the user processing unit 33.
  • the user output unit 36 outputs a map indicating points along the route where videos can be obtained.
  • the points where videos can be obtained are points indicated by the location information of one or more mobile terminals 2 received by the user receiving unit 35.
  • the user output unit 36 outputs, for example, a thumbnail image received by the user receiving unit 35. It is preferable that the user output unit 36 outputs the thumbnail image in association with the point indicated by the location information associated with the thumbnail image.
  • the user output unit 36 outputs the video received by the user receiving unit 35.
  • the storage unit 11, the terminal management unit 111, the mobile storage unit 21, and the user storage unit 31 are preferably non-volatile recording media, but can also be realized using volatile recording media.
  • information may be stored in the storage unit 11, etc. via a recording medium, information transmitted via a communication line, etc. may be stored in the storage unit 11, etc., or information inputted via an input device may be stored in the storage unit 11, etc.
  • the receiving unit 12, the location receiving unit 121, the inquiry receiving unit 122, the mobile receiving unit 22, and the user receiving unit 35 are typically implemented using wireless or wired communication means, but may also be implemented using means for receiving broadcasts.
  • the processing unit 13, position accumulation unit 131, terminal determination unit 132, video acquisition unit 133, video composition unit 134, rights holder processing unit 135, first security means 1351, second security means 1352, third security means 1353, fourth security means 1354, reward means 1355, movement processing unit 23, attribute value acquisition unit 233, composition unit 234, and user processing unit 33 can usually be realized by a processor, memory, etc.
  • the processing procedures of the processing unit 13, etc. are usually realized by software, and the software is recorded on a recording medium such as a ROM. However, they may also be realized by hardware (dedicated circuitry).
  • the processor may be a CPU, MPU, GPU, etc., and the type does not matter.
  • Transmitting unit 14 video transmitting unit 141, mobile transmitting unit 24, location transmitting unit 241, mobile video transmitting unit 242, and user transmitting unit 34 are typically realized by wireless or wired communication means, but may also be realized by broadcasting means.
  • the location acquisition unit 231 is realized, for example, by a GPS receiver.
  • the image capture unit 232 includes a camera capable of capturing video. Note that any type of camera can be used.
  • the movement output unit 25, video output unit 251, and user output unit 36 may or may not include output devices such as a display or speaker.
  • the movement output unit 25 may be realized by driver software for an output device, or by driver software for an output device and an output device, etc.
  • the user reception unit 32 can be realized by a device driver for an input means such as a touch panel or a keyboard, or control software for a menu screen. ⁇ Operation>
  • the location receiving unit 121 determines whether or not location information has been received from the mobile terminal 2. If location information has been received, the process proceeds to S402, and if location information has not been received, the process proceeds to S403.
  • the received location information is associated with a terminal identifier.
  • the receiving unit 12 may also receive videos paired with one or more pieces of location information from the mobile terminal 2.
  • the receiving unit 12 may also receive location information and one or more video attribute values.
  • the location accumulation unit 131 associates the location information received in S401 with the terminal identifier and adds it to the terminal management unit 111. Return to S401. Note that the processing unit 13 may accumulate videos paired with one or more pieces of location information.
  • the inquiry receiving unit 122 determines whether or not an inquiry has been received from the user terminal 3. If an inquiry has been received, the process proceeds to S404, and if an inquiry has not been received, the process returns to S401. Note that an inquiry is usually associated with the user identifier of the user who sent the inquiry.
  • the terminal determination unit 132 acquires the route information contained in the inquiry received in S403. Alternatively, the terminal determination unit 132 acquires the route information using the route specification information contained in the inquiry. Note that the route information is a collection of multiple pieces of location information.
  • the terminal determination unit 132 determines whether the inquiry received in S403 is an inquiry indicating the acquisition of real-time video (appropriately referred to as "real-time") or an inquiry indicating the acquisition of video that may include video stored in the past (appropriately referred to as "past"). If it is an inquiry indicating real-time acquisition, the process proceeds to S406, and if it is an inquiry indicating past acquisition, the process proceeds to S413.
  • the terminal determination unit 132 determines whether the query is "real-time” or "past” based on the value of the timing flag included in the query, for example.
  • the terminal determination unit 132 determines one or more mobile terminals 2 capable of transmitting real-time video.
  • An example of such a terminal determination process will be described using the flowchart in FIG. 5.
  • a mobile terminal 2 capable of transmitting real-time video is a mobile terminal 2 that is capturing video at any point on the route specified by the route information.
  • the video acquisition unit 133 assigns 1 to counter i.
  • the video acquisition unit 133 determines whether the i-th mobile terminal 2 exists among the mobile terminals 2 determined in S406. If the i-th mobile terminal 2 exists, the process proceeds to S409; if not, the process returns to S401.
  • the video acquisition unit 133 acquires the terminal communication information of the i-th mobile terminal 2 from the terminal management unit 111.
  • the video acquisition unit 133 uses the terminal communication information to send a video to the i-th mobile terminal 2.
  • the receiving unit 12 judges whether or not a video has been received from the i-th mobile terminal 2. If a video has been received, the process proceeds to S411, and if a video has not been received, the process returns to S410. Note that it is preferable to wait until a video is received from the mobile terminal 2 that sent the transmission instruction.
  • the receiving unit 12 may receive only location information from the i-th mobile terminal 2 instead of a video, or may receive location information and a thumbnail image.
  • the processing unit 13 composes information including the location information of the i-th mobile terminal 2, to be transmitted to the user terminal 3.
  • the transmission unit 14 transmits the information to the user terminal 3.
  • Such information is, for example, the location information of the i-th mobile terminal 2 and a still image (for example, a thumbnail image) included in the video from the mobile terminal 2.
  • Such information is, for example, the location information of the i-th mobile terminal 2 and the video.
  • the video acquisition unit 133 performs a process to acquire past videos.
  • An example of such a past video acquisition process will be described with reference to the flowchart in FIG. 6.
  • past videos are videos stored by the information processing device 1, or videos stored by the mobile terminal 2 in the mobile storage unit 21 of the mobile terminal 2.
  • the video transmission unit 141 transmits the video acquired in S413 to the user terminal 3. Return to S401.
  • the receiving unit 12 determines whether or not a video or the like has been received from the mobile terminal 2. If a video or the like has been received, the process proceeds to S416. If a video or the like has not been received, the process proceeds to S421. Note that a video or the like is, for example, a video, a terminal identifier, or a set of attribute values.
  • the processing unit 13 temporarily stores the video etc. received in S415 in a buffer (not shown).
  • the destination for storing the video etc. may be, for example, the storage unit 11.
  • the processing unit 13 determines whether the video received from the mobile terminal 2 identified by the terminal identifier included in the video etc. received in S415 is currently being transmitted to the user terminal 3. If it is currently being transmitted, the process proceeds to S418, and if it is not currently being transmitted, the process returns to S401.
  • the route condition here is that the latest location information paired with the terminal identifier contained in the video or the like received in S415 is location information of a point on the route indicated by the route information corresponding to the inquiry.
  • the transmission unit 14 transmits a stop instruction to the mobile terminal 2.
  • the video transmission unit 141 transmits the video received in S415 to the user terminal 3.
  • the rights holder processing unit 135 performs preservation processing.
  • An example of preservation processing is explained using the flowchart in FIG. 7.
  • the receiving unit 12 determines whether or not a location instruction has been received from the user terminal 3. If a location instruction has been received, the process proceeds to S422; if a location instruction has not been received, the process proceeds to S425.
  • the video acquisition unit 133 acquires location information corresponding to the location instruction.
  • the video acquisition unit 133 acquires a video of the location indicated by the location information.
  • the video acquisition unit 133 acquires a terminal identifier corresponding to the acquired location information, and acquires the video paired with the terminal identifier from a buffer (not shown).
  • the video acquisition unit 133 acquires a terminal identifier corresponding to the acquired location information, and transmits a transmission instruction to the mobile terminal 2 identified by the terminal identifier.
  • the video acquisition unit 133 then receives the video from the mobile terminal 2.
  • the video transmission unit 141 transmits the video acquired in S422 to the user terminal 3 that transmitted the location instruction.
  • the processing unit 13 judges whether or not to end the transmission of the video to the user terminal 3. If the transmission is to be ended, the process proceeds to S420, and if not, the process returns to S422. Note that the transmission is to be ended, for example, when an instruction to end the transmission is received from the user terminal 3.
  • the video acquisition unit 133 acquires a video corresponding to the purchase instruction. Note that the video acquisition unit 133 acquires the video corresponding to the purchase instruction from among the videos stored by the rights holder processing unit 135, for example.
  • the fourth security means 1354 acquires a user identifier corresponding to the user terminal 3 that sent the purchase instruction. This user identifier becomes the rights holder identifier for the purchased video.
  • the fourth security means 1354 performs the fourth security process using the user identifier acquired in S427.
  • An example of the fourth security process is described using the flowchart in FIG. 8.
  • the compensation means 1355 performs compensation processing for the original rights holder of the purchased video. Return to S401. An example of compensation processing will be explained using the flowchart in FIG. 9.
  • processing ends when the power is turned off or an interrupt occurs to end processing.
  • the terminal determination unit 132 assigns 1 to counter i.
  • the terminal determination unit 132 determines whether the i-th location information is present in the route information acquired in S404. If the i-th location information is present, the process proceeds to S503; if not, the process returns to the upper level process.
  • the terminal determination unit 132 determines whether the jth terminal information exists in the terminal management unit 111. If the jth terminal information exists, the process proceeds to S505; if not, the process proceeds to S509.
  • the terminal determination unit 132 obtains the latest location information contained in the j-th terminal information.
  • the terminal determination unit 132 judges whether the i-th location information in the route information and the latest location information of the mobile terminal 2 satisfy the approximation condition. If the approximation condition is satisfied, the process proceeds to S507, and if the approximation condition is not satisfied, the process proceeds to S508.
  • the approximation condition is that the two pieces of location information are close to each other.
  • the approximation condition is that the distance between the two points indicated by the two pieces of location information is within a threshold or is smaller than a threshold.
  • the terminal determination unit 132 calculates the distance between the two points using the two pieces of location information.
  • the terminal determination unit 132 temporarily stores the distance in a pair with the terminal identifier of the mobile terminal 2.
  • the terminal determination unit 132 determines whether or not a mobile terminal 2 that satisfies the approximation conditions is present. If a mobile terminal 2 is present, the process proceeds to S508; if not, the process proceeds to S511.
  • the terminal determination unit 132 obtains the terminal identifier of the mobile terminal 2 with the shortest distance.
  • the terminal determination unit 132 adds ⁇ to the counter i. Note that ⁇ is a natural number equal to or greater than 1. Return to S502.
  • ⁇ is preferably a multiple large numerical value, and if the terminal identifier of mobile terminal 2 cannot be acquired, ⁇ is preferably a numerical value smaller than that in the case where the terminal identifier of mobile terminal 2 can be acquired, such as 1.
  • the video acquisition unit 133 determines whether the i-th location information is present in the route information acquired in S404. If the i-th location information is present, the process proceeds to S603; if not, the process returns to the upper level process.
  • the video acquisition unit 133 refers to the terminal management unit 111 and determines whether or not there is a jth mobile terminal 2 (jth terminal information) to which a video can potentially be transmitted. If there is a jth mobile terminal 2, the process proceeds to S605; if there is not, the process proceeds to S610.
  • the video acquisition unit 133 acquires a group of location information that is paired with the terminal identifier of the j-th mobile terminal 2 from the terminal management unit 111.
  • the group of location information is one or more pieces of location information. Also, it is assumed that the video corresponding to the group of location information has been shot by the mobile terminal 2 and stored in the video storage unit 21.
  • the video acquisition unit 133 determines whether the i-th location information satisfies the route condition for the group of location information acquired in S605. If the route condition is satisfied, the process proceeds to S607, and if the route condition is not satisfied, the process proceeds to S609. Note that the route condition here is that the i-th location information is information indicating a point on a route specified by the group of location information.
  • the video acquisition unit 133 acquires a group of location information, which is one or more pieces of location information from the group of location information acquired in S605, which is a group of location information from the route information acquired in S404, and which is a collection of one or more pieces of location information from the i-th position information onward in the route information.
  • This group of location information is information that identifies the route on which the j-th mobile terminal 2 has video.
  • the video acquisition unit 133 calculates the distance of the route identified by the group of location information acquired in S607.
  • the video acquisition unit 133 assigns 1 to counter k.
  • the video acquisition unit 133 determines whether the kth past video exists among the past videos saved in S420. If the kth past video exists,
  • the video acquisition unit 133 acquires a group of location information corresponding to past videos.
  • the video acquisition unit 133 determines whether the i-th location information satisfies the route condition for the group of location information acquired in S125. If the route condition is satisfied, the process proceeds to S614, and if the route condition is not satisfied, the process proceeds to S616. Note that the route condition here is that the i-th location information is information indicating a point on the route specified by the group of location information acquired in S612.
  • the video acquisition unit 133 acquires a group of position information that is one or more pieces of position information from the group of position information acquired in S612, is a group of position information from the route information acquired in S404, and is a collection of one or more pieces of position information from the i-th position information onward in the route information.
  • This group of position information is a collection of position information that identifies routes that overlap with the route indicated by the route information, among routes corresponding to past videos.
  • the video acquisition unit 133 calculates the distance of the route identified by the group of location information acquired in S614.
  • the video acquisition unit 133 determines whether the route condition has been satisfied at least once in either S606 or S614. If the route condition has been satisfied, the process proceeds to S618; if the route condition has not been satisfied, the process proceeds to S619.
  • the video acquisition unit 133 acquires the terminal identifier of the mobile terminal 2 with the longest distance calculated in S608 or S615, or an identifier of a past video. If the video acquisition unit 133 acquires a terminal identifier, it transmits an instruction to send a video including a group of position information corresponding to the distance to the mobile terminal 2 identified by the terminal identifier, and receives a video from the mobile terminal 2 along the route indicated by the group of position information. Furthermore, if the video acquisition unit 133 acquires an identifier of a past video, it acquires the video etc. identified by the identifier from the storage area indicated by the access information of the video.
  • the video acquisition unit 133 preferably increments the value of counter i by 1. If the path condition is satisfied, the video acquisition unit 133 preferably increments the value of counter i by 2 or more.
  • the rights holder processing unit 135 stores the transmitted video in association with a set of attribute values corresponding to one or more videos that were the basis for the transmitted video.
  • the rights holder processing unit 135 stores the video in a pair with a rights holder identifier that identifies one or more respective rights holders.
  • the rights holder identifier here is, for example, one or more rights holder identifiers of the videos that are the basis of the stored video.
  • the rights holder identifier here is, for example, a single rights holder identifier that identifies the user who made the inquiry.
  • the rights holder processing unit 135 also stores the video in, for example, the storage unit 11 or a device other than the information processing device 1.
  • the device other than the information processing device 1 may be a device that constitutes a blockchain.
  • the fourth maintenance means 1354 performs the fourth maintenance process.
  • An example of the fourth maintenance process was explained using the flowchart in FIG. 9.
  • the rights holder processing unit 135 determines whether the i-th video that was the basis for the stored video exists. If the i-th video exists, the process proceeds to S705; if not, the process returns to the upper level process.
  • the compensation means 1355 performs compensation processing.
  • An example of the compensation processing will be described with reference to the flowchart in FIG. 9.
  • the compensation processing here is a process of paying compensation to the rights holder of the i-th video that was the basis for the accumulated video.
  • the rights holder processing unit 135 determines whether or not to change the rights holder of the i-th video that was the basis of the stored video. If the rights holder is to be changed, the process proceeds to S707; if the rights holder is not to be changed, the process proceeds to S708.
  • the decision as to whether or not to change the rights holder may be based on a flag associated with the i-th video, may be predetermined, or the rights holder may be changed if the inquiry includes "information indicating a request to change the rights holder.”
  • the rights holder processing unit 135 acquires the user identifier of the user terminal 3. This user identifier becomes the new rights holder identifier.
  • the first preservation means 1351 stores the i-th video that was the source of the stored video.
  • the fourth preservation means 1354 performs a fourth preservation process on the i-th video that was the source of the stored videos. An example of the fourth preservation process was explained using the flowchart in FIG. 9.
  • the fourth security means 1354 acquires access information that identifies the storage destination of the video.
  • a video may be, for example, a fused video or a combined video.
  • the fourth preservation means 1354 acquires a set of attribute values corresponding to the stored video. If the stored video is a video composed of multiple original videos, the set of attribute values corresponding to the video is the set of attribute values for each of the multiple original videos.
  • the fourth security means 1354 constructs security information having the access information acquired in S801, the attribute value set acquired in S802, and the rights holder identifier of the video. Note that if a new rights holder identifier has been acquired, the fourth security means 1354 constructs security information including, for example, the new rights holder identifier and the original rights holder identifier. (S804) The fourth maintenance unit 1354 accumulates the maintenance information constructed in S803, and then returns to the upper level process.
  • the preservation information configured in S803 is overwritten with that preservation information. This makes it possible to manage, for example, the transition of rights holders of the video.
  • the fourth preservation means 1354 stores the preservation information in a blockchain, for example.
  • the compensation means 1355 acquires one or more rights holder identifiers for the target video.
  • the compensation means 1355 may also acquire the rights holder identifiers of the previous rights holders for the target video.
  • the reward means 1355 acquires a set of attribute values for the target video.
  • the reward means 1355 acquires a service identifier that identifies the service provided for the target video.
  • the service identifier is, for example, "view” or "purchase.”
  • the reward means 1355 obtains the reward amount using one or more pieces of information from the attribute value set obtained in S902 and the service identifier obtained in S903.
  • the compensation means 1355 acquires a compensation amount for each rights holder identifier. If rights holder history information including multiple rights holder identifiers has been acquired, the compensation means 1355 may acquire a compensation amount for each rights holder identifier.
  • the compensation means 1355 acquires video attribute values corresponding to each of the multiple videos that were the basis for the video transmitted by the video transmission unit 141, and uses the video attribute values to determine the amount of compensation for each of the multiple rights holders. It is preferable that the compensation means 1355, for example, determines a larger amount of compensation the greater the amount of data, video duration, or number of frames of the original video used in the video transmitted by the video transmission unit 141. It is preferable that the compensation means 1355, for example, determines a larger amount of compensation the greater the resolution of the original video used in the video transmitted by the video transmission unit 141.
  • the reward means 1355 performs processing to give a reward to the rights holder identified by the rights holder identifier obtained in S901, in the amount of reward obtained in S904.
  • the remuneration means 1355 performs processing to charge a remuneration to the user who has enjoyed the service related to the target video.
  • the processing returns to the upper level processing.
  • the target video is usually a video transmitted to the user terminal 3.
  • the profits earned by the operator of the information processing device 1 may be acquired and accumulated.
  • the mobile terminal 2 determines whether or not a start instruction has been received. If a start instruction has been received, the process proceeds to S1002, and if not, the process proceeds to S1011.
  • the start instruction may be, for example, an instruction to launch a video transmission app or to power on the mobile terminal 2.
  • the location acquisition unit 231 acquires location information.
  • the attribute value acquisition unit 233 acquires one or more video attribute values excluding location information.
  • the configuration unit 234 obtains the terminal identifier from the movement storage unit 21.
  • the configuration unit 234 configures the information to be transmitted, which is information having location information, one or more video attribute values, and a terminal identifier.
  • the location transmission unit 241 transmits the information configured in S1005 to the information processing device 1.
  • the image capture unit 232 captures and acquires video.
  • the composition unit 234 composes an additional video having a video, location information, one or more video attribute values, and a terminal identifier.
  • the composition unit 234 stores the additional video in the moving storage unit 21.
  • the moving video transmission unit 242 determines whether or not to transmit the video to the information processing device 1. If a video is to be transmitted, the process proceeds to S1009. If not, the process proceeds to S1010. Note that, when a video is to be transmitted, for example, the transmission flag may be "ON”. Also, the initial value of the transmission flag is "OFF".
  • the moving video transmission unit 242 transmits the additional images accumulated in S1007 to the information processing device 1. Note that there is no limit to the amount of video transmitted at one time.
  • the movement processing unit 23 judges whether or not to end the transmission of the position information, etc. If the transmission is to be ended, the process returns to S1001, and if the transmission is not to be ended, the process returns to S1002. Note that the transmission of the position information, etc. is ended, for example, when an end instruction is received from the user.
  • the movement instruction receiving unit 221 determines whether or not a video transmission instruction has been received from the information processing device 1. If a transmission instruction has been received, the process proceeds to S1002; if not, the process returns to S1001.
  • the movement processing unit 23 determines whether the transmission instruction received in S1011 is an instruction to transmit real-time video or an instruction to transmit past video. If it is an instruction to transmit real-time video, the process proceeds to S1013, and if it is an instruction to transmit past video, the process proceeds to S1014.
  • the movement processing unit 23 may determine whether the transmission instruction is an instruction to transmit real-time video or an instruction to transmit past video based on the timing flag contained in the transmission instruction. If the transmission instruction does not have a set of location information, the movement processing unit 23 may determine that the transmission instruction is an instruction to transmit real-time video, and if the transmission instruction has a set of location information, the movement processing unit 23 may determine that the transmission instruction is an instruction to transmit past video.
  • the movement processing unit 23 acquires the location information group contained in the transmission instruction.
  • the movement processing unit 23 acquires from the movement storage unit 21 videos, etc., that correspond to the multiple pieces of location information that correspond to the group of location information acquired in S1014.
  • the videos, etc. are preferably so-called additional videos, but may be videos alone.
  • the moving video transmission unit 242 transmits the additional video acquired in S1015 to the information processing device 1.
  • the mobile receiving unit 22 determines whether or not a stop instruction has been received from the information processing device 1. If a stop instruction has been received, the process proceeds to S1018; if not, the process returns to S1001.
  • processing ends when the power is turned off or an interrupt occurs to end processing.
  • the user reception unit 32 determines whether or not route identification information has been received. If route identification information has been received, the process proceeds to S1102; if not, the process proceeds to S1117.
  • the user processing unit 33 acquires route identification information.
  • the route identification information accepted in S1101 is the destination, and the acquired route identification information may be a collection of multiple location information results of a route search using the current location and the destination.
  • the route identification information accepted in S1101 and the route identification information acquired here do not have to be the same information.
  • the user processing unit 33 acquires map information from the user storage unit 31. Next, the user processing unit 33 creates map information on the map information that indicates the route specified by the route specification information. The user output unit 36 uses the map information to output a map on which the route is specified.
  • the user processing unit 33 constructs a query having the route identification information acquired in S1102.
  • the user transmission unit 34 transmits the query to the information processing device 1.
  • the user processing unit 33 may perform the processes from S1104 to S1116 only if the inquiry flag in the user storage unit 31 is "ON". In other words, if the inquiry flag is "OFF", the video is not output to the user terminal 3.
  • the inquiry flag is also changeable.
  • the user receiving unit 35 determines whether or not information has been received from the information processing device 1. If information has been received, the process proceeds to S1106; if information has not been received, the process proceeds to S1113.
  • the user processing unit 33 determines whether or not the information received in S1105 includes a video. If a video is included, the process proceeds to S1107; if a video is not included, the process proceeds to S1109.
  • the user output unit 36 outputs one or more videos from the information received in S1105. It is preferable that the user output unit 36 clearly displays on a map the location indicated by the location information corresponding to the video.
  • the user processing unit 33 determines whether or not to end the output of information. If the output is to be ended, the process returns to S1101. If not, the process returns to S1105.
  • the user processing unit 33 acquires the location information group from the information received in S1105.
  • the user processing unit 33 creates a map that clearly shows the points indicated by each piece of location information in the group of location information acquired in S1109.
  • the user output unit 36 outputs the map.
  • the user processing unit 33 determines whether or not a thumbnail image is present in the information received in S1105. If a thumbnail image is present, the process proceeds to S1112; if not, the process returns to S1105. Note that a thumbnail image is one image in a video.
  • the user output unit 36 outputs one or more thumbnail images from the information received in S1105. It is preferable that the user output unit 36 outputs the thumbnail image in a manner that clearly indicates the location indicated by the location information paired with the image.
  • the user processing unit 33 determines whether or not a timeout has occurred. If a timeout has occurred, the process returns to S1101. If not, the process proceeds to S1114. A timeout occurs when a time equal to or greater than a threshold has elapsed since the query was sent.
  • the user reception unit 32 determines whether or not a location instruction has been received. If a location instruction has been received, the process proceeds to S1115; if not, the process returns to S1105.
  • the user processing unit 33 etc. acquires a video that is paired with the location information corresponding to the location instruction.
  • the user transmitting unit 34 transmits a transmission instruction to the mobile terminal 2 that corresponds to the location information corresponding to the location instruction.
  • the user receiving unit 35 receives the video from the mobile terminal 2.
  • the user processing unit 33 then acquires the video.
  • the user output unit 36 outputs the video acquired in S1115.
  • the user reception unit 32 determines whether or not a purchase instruction has been received from the user. If a purchase instruction has been received, the process proceeds to S1118; if not, the process returns to S1101.
  • the purchase instruction may include, for example, an inquiry.
  • the user processing unit 33 composes a purchase instruction to be sent.
  • the user sending unit 34 associates the purchase instruction with the user identifier and sends it to the information processing device 1.
  • the user receiving unit 35 determines whether or not information has been received from the information processing device 1. If information has been received, the process proceeds to S1120, and if information has not been received, the process returns to S1119.
  • the information may be, for example, a video, information indicating that the transfer of rights holders has been completed, and a set of attribute values for the video.
  • the user processing unit 33 uses the received information to construct information to be output.
  • the user output unit 36 outputs the information. Return to S1101.
  • processing ends when the power is turned off or an interrupt occurs to end processing.
  • Specific example 1 is a case where real-time video based on route identification information is output by the user terminal 3.
  • Specific example 2 is a case where past video based on route identification information is output by the user terminal 3.
  • the terminal management table is a table that manages one or more pieces of terminal information.
  • the terminal management table manages one or more records having an "ID”, “terminal identifier”, “terminal communication information”, and an "attribute value set".
  • the "attribute value set” has "time” and "location information”.
  • the position acquisition unit 231 acquires position information (x, y).
  • the attribute value acquisition unit 233 acquires one or more video attribute values such as time.
  • the configuration unit 234 configures information to be transmitted, which is information having the position information, one or more video attribute values, and a terminal identifier.
  • the position transmission unit 241 transmits the configured information to the information processing device 1.
  • the shooting unit 232 shoots and acquires the video.
  • the configuration unit 234 configures an additional video having a video, position information, one or more video attribute values, and a terminal identifier.
  • the configuration unit 234 accumulates the additional video in the mobile storage unit 21.
  • the mobile terminal 2 repeats the above process.
  • many other mobile terminals 2 also perform the same process as the above mobile terminal 2.
  • the other many mobile terminals 2 may be drive recorders mounted on automobiles, camera-equipped glasses-type terminals worn by people, or smartphones mounted on bicycles, etc.
  • the location receiving unit 121 of the information processing device 1 receives location information, etc. from each mobile terminal 2.
  • the location storage unit 131 then associates the received location information, etc. with the terminal identifier and adds it to the terminal management table.
  • the terminal management table shown in FIG. 12 is constructed.
  • user A inputs the destination into user terminal 3, which is a navigation terminal installed in the car.
  • the user reception unit 32 of the user terminal 3 receives route specification information, which is the destination.
  • the user processing unit 33 acquires the current position using the GPS receiver.
  • the user processing unit 33 performs a route search using the current position and the destination, and acquires route information that specifies the route from the current position to the destination and has multiple position information. Then, as shown in FIG. 13, a map with the route drawn on it is output to the user terminal 3.
  • the user processing unit 33 of the user terminal 3 acquires the inquiry flag stored in the user storage unit 31.
  • the user transmission unit 34 transmits the inquiry to the information processing device 1.
  • the inquiry receiving unit 122 of the information processing device 1 receives the inquiry from the user terminal 3.
  • the terminal determination unit 132 acquires the route information contained in the received inquiry.
  • the terminal determination unit 132 determines that the received inquiry includes the timing flag "real-time.”
  • the terminal determination unit 132 then refers to the terminal management table (FIG. 12) and determines one or more mobile terminals 2 that can transmit real-time video along the route indicated by the route information included in the query.
  • the terminal determination unit 132 uses the process described using the flowchart in FIG. 5 to determine, from the location information paired with the latest time of each mobile terminal 2 in the terminal management table, one or more pieces of location information that satisfy an approximation condition for any of the location information indicating a position on the route indicated by the group of location information contained in the received query, and obtains the terminal identifier and terminal communication information paired with each piece of location information from the terminal management table (FIG. 12).
  • the video acquisition unit 133 uses one or more pieces of terminal communication information to send a video to one or more mobile terminals 2.
  • the video acquisition unit 133 sends a send instruction that includes the timing flag "real time.”
  • the movement instruction receiving unit 221 of each of the one or more mobile terminals 2 receives the transmission instruction.
  • the movement processing unit 23 of each mobile terminal 2 determines that the received transmission instruction is an instruction to transmit real-time video based on the timing flag "real-time" included in the transmission instruction.
  • the position acquisition unit 231 of each mobile terminal 2 acquires position information.
  • the attribute value acquisition unit 233 of each mobile terminal 2 acquires one or more video attribute values.
  • the composition unit 234 acquires a terminal identifier from the mobile storage unit 21.
  • the composition unit 234 composes information having the position information, one or more video attribute values, and a terminal identifier.
  • the shooting unit 232 shoots and acquires the video.
  • the composition unit 234 composes an additional video having a video, position information, one or more video attribute values, and a terminal identifier.
  • the composition unit 234 accumulates the additional video in the mobile storage unit 21.
  • the mobile video transmission unit 242 transmits information having the position information, one or more video attribute values, and a terminal identifier, and a thumbnail image, which is a still image in the video, to the information processing device 1.
  • the mobile video transmission unit 242 of each mobile terminal 2 may also transmit the additional image to the information processing device 1.
  • the location transmission unit 241 of each mobile terminal 2 may repeatedly transmit information having location information, one or more video attribute values, and a terminal identifier to the information processing device 1.
  • the receiving unit 12 of the information processing device 1 receives information including location information, one or more video attribute values, a terminal identifier, and a thumbnail image from each mobile terminal 2.
  • the processing unit 13 composes information including the location information and thumbnail image of each mobile terminal 2, to be transmitted to the user terminal 3.
  • the transmitting unit 14 transmits the information to the user terminal 3.
  • the user receiving unit 35 of the user terminal 3 receives information including the position information and thumbnail images of each mobile terminal 2 from the information processing device 1.
  • the user processing unit 33 constructs a map that clearly shows the points indicated by each piece of position information.
  • the user output unit 36 outputs the map.
  • the user output unit 36 also outputs one or more thumbnail images in association with the positions indicated by the position information. An example of such an output is shown in FIG. 14.
  • the user designates a location (here, a car icon) 1401 or a thumbnail image 1402 on the output screen of FIG. 14.
  • the user reception unit 32 of the user terminal 3 then accepts the location designation.
  • the user transmission unit 34 transmits a transmission instruction with a timing flag of "real time" to the mobile terminal 2 identified by the terminal identifier corresponding to the location designation.
  • the mobile receiving unit 22 of the mobile terminal 2 receives the transmission instruction.
  • the mobile processing unit 23 checks whether the timing flag is "real time”. Then, the shooting unit 232 acquires the video currently being shot.
  • the mobile video sending unit 242 transmits the video to the information processing device 1.
  • the receiving unit 12 of the information processing device 1 receives the video.
  • the video sending unit 141 sends the video to the user terminal 3.
  • the user receiving unit 35 of the user terminal 3 receives the video.
  • the user output unit 36 outputs the video.
  • An example of such an output is shown in FIG. 15.
  • the output video is 1501.
  • the rights holder processing unit 135 of the information processing device 1 performs the preservation processing described using the flowchart in Figure 7 on the video transmitted to the user terminal 3.
  • real-time video of the route can be provided to the user based on the route identification information.
  • route information that specifies the route walked by user B is stored in the user storage unit 31 of user terminal 3.
  • the route information is a collection of multiple pieces of location information.
  • the user reception unit 32 of the user terminal 3 receives the inquiry.
  • the user processing unit 33 obtains the user identifier from the user storage unit 31, and composes an inquiry that includes the user identifier, route information, and a timing flag "past.”
  • the user transmission unit 34 transmits the inquiry to the information processing device 1.
  • the inquiry receiving unit 122 of the information processing device 1 receives the inquiry.
  • the terminal determination unit 132 acquires the route information contained in the received inquiry.
  • the video acquisition unit 133 performs a process of acquiring past videos based on the timing flag "past" by the process described using the flowchart in FIG. 6. That is, the video acquisition unit 133 acquires one or more videos that satisfy the route condition from the videos stored in the mobile terminal 2 managed in the terminal management table (FIG. 12) or the videos accumulated by the preservation process, in the order of the location information contained in the route information. Furthermore, if multiple videos are acquired, the video composition unit 134 combines the multiple acquired videos in the order of the location information contained in the route information, and acquires a combined video that is a video in which the multiple videos are combined in terms of time. Next, the video transmission unit 141 transmits the combined video to the user terminal 3. Furthermore, the rights holder processing unit 135 performs preservation processing on the video.
  • the user receiving unit 35 of the user terminal 3 receives the combined video.
  • the user output unit 36 outputs the video.
  • past videos of the route can be provided to the user based on the route identification information.
  • the information processing device 1 becomes a platform for appropriately providing videos of each point along the route.
  • the information processing device 1 becomes a platform for appropriately providing videos of multiple points along a route.
  • this embodiment can provide a platform that places a low load on mobile terminals that provide video at each point along the route.
  • this embodiment reduces the load on the platform required to provide appropriate video for each point along the route.
  • this embodiment allows for appropriate processing regarding the rights holder of the video.
  • this embodiment allows videos to be preserved.
  • this embodiment ensures that the rights holder of the video is the appropriate rights holder.
  • the processing in this embodiment may be realized by software.
  • This software may be distributed by software download or the like.
  • This software may also be recorded on a recording medium such as a CD-ROM and distributed. This also applies to the other embodiments in this specification.
  • the information processing device 1 determines the mobile terminal 2 to which a video matching the user's inquiry can be transmitted. In the present embodiment, the mobile terminal determines whether or not to transmit a video in response to the user's inquiry.
  • FIG. 16 is a block diagram of information system B in this embodiment.
  • FIG. 17 is a block diagram of information processing device 4.
  • Information system B includes an information processing device 4, one or more mobile terminals 5, and one or more user terminals 3.
  • the information processing device 4 is a server that provides the video transmitted by one or more mobile terminals 5 to the user terminal 3.
  • the information processing device 4 is, for example, a so-called server, such as a cloud server or an ASP server, but the type is not important.
  • the information processing device 4 may also be a device that constitutes a blockchain.
  • the mobile terminal 5 is a terminal installed on a moving object and is a terminal that shoots video.
  • the mobile terminal 5 is, for example, a smartphone, a tablet terminal, a camera with a communication function, glasses with a camera, or a smart watch with a camera.
  • the information processing device 4 and one or more mobile terminals 5, and the information processing device 4 and one or more user terminals 3 are typically capable of communicating via a network such as the Internet.
  • the information processing device 4 includes a storage unit 41, a receiving unit 42, a processing unit 43, and a transmitting unit 44.
  • the storage unit 41 includes a terminal management unit 411.
  • the receiving unit 42 includes an inquiry receiving unit 122.
  • the processing unit 43 includes a video acquisition unit 433, a video composition unit 134, and a right-sender processing unit 135.
  • the transmitting unit 44 includes an inquiry sending unit 441, and a video transmission sending unit 141.
  • the mobile terminal 5 includes a moving storage unit 21, a moving receiving unit 52, a moving processing unit 53, a moving transmitting unit 54, and a moving output unit 25.
  • the moving processing unit 53 includes a position acquiring unit 231, a shooting unit 232, an attribute value acquiring unit 233, a configuration unit 234, and a moving determination unit 531.
  • the moving transmitting unit 54 includes a moving video transmitting unit 542.
  • the various types of information include, for example, terminal information (described later), videos, and video attribute values associated with the videos.
  • the terminal management unit 411 stores one or more pieces of terminal information.
  • the terminal information corresponds to the mobile terminal 5.
  • the terminal information is information related to the mobile terminal 5.
  • the terminal information here typically includes a terminal identifier, which is an identifier of the mobile terminal 5, and terminal communication information.
  • the receiving unit 42 receives various information and instructions from the mobile terminal 5 or the user terminal 3.
  • the various information and instructions are, for example, inquiries, videos, and additional videos.
  • the processing unit 43 performs various types of processing. For example, the various types of processing are performed by the video acquisition unit 433, the video composition unit 134, and the rights holder processing unit 135.
  • the video acquisition unit 433 acquires videos taken by one or more mobile terminals 5 that satisfy the route conditions.
  • the video acquisition unit 433 normally receives video from the mobile terminal 5 in response to a transmitted inquiry.
  • the video acquisition unit 433 receives, for example, video captured by each of a plurality of mobile terminals 5.
  • the mobile terminal 5 that transmits the video is the mobile terminal 5 that corresponds to the location information that matches the inquiry.
  • the video acquisition unit 433, for example, acquires a first video corresponding to position information that identifies a first partial route of the route identified by the route identification information, and acquires a second video corresponding to position information that identifies a second partial route other than the first partial route of the route identified by the route identification information.
  • the transmission unit 44 transmits various types of information or instructions to the mobile terminal 5 or the user terminal 3.
  • the various types of information or instructions are, for example, inquiries, videos, and stop instructions.
  • the inquiry sending unit 441 sends the inquiry received by the inquiry receiving unit 122 to one or more mobile terminals 5.
  • the mobile terminals 5 are terminals managed by the terminal management unit 411. ⁇ Details of components of mobile terminal 5>
  • the mobile receiver 52 receives an inquiry that includes route identification information.
  • the movement processing unit 53 performs various types of processing.
  • the various types of processing are, for example, processing performed by the position acquisition unit 231, the photography unit 232, the attribute value acquisition unit 233, the configuration unit 234, and the movement determination unit 531.
  • the movement determination unit 531 determines whether the location information acquired by the location acquisition unit 231 satisfies a route condition, which is a condition that the location information corresponds to location information that identifies at least a portion of the route identified by the route identification information.
  • the movement determination unit 531 determines whether or not the latest location information acquired by the location acquisition unit 231 satisfies the route condition that the latest location information is information indicating the location of a point on the route identified by the route identification information.
  • the movement determination unit 531 determines whether or not at least a portion of the route identified by one or more pieces of location information stored in the movement storage unit 21 satisfies the route condition that the route is part of the route identified by the route identification information.
  • the mobile transmission unit 54 transmits various types of information to the information processing device 4.
  • the various types of information are, for example, attribute value sets, videos, and additional videos.
  • the movement video transmission unit 542 transmits a video when the movement determination unit 531 determines that the video matches the query. Note that the video in this case may be an additional video. Matching the query means satisfying the route conditions.
  • the moving video transmission unit 542 transmits the video being shot to the information processing device 4.
  • the movement video sending unit 542 sends to the information processing device 4 a video paired with one or more pieces of location information that specify part or all of the route specified by the received route specification information. Note that such a video is a video stored in the movement storage unit 21.
  • the storage unit 41 and the terminal management unit 411 are preferably non-volatile recording media, but can also be realized using volatile recording media.
  • the process by which information is stored in the storage unit 41, etc. is not important.
  • information may be stored in the storage unit 41, etc. via a recording medium, information transmitted via a communication line, etc. may be stored in the storage unit 41, etc., or information inputted via an input device may be stored in the storage unit 41, etc.
  • the receiving unit 42 and the mobile receiving unit 52 are typically implemented using wireless or wired communication means, but may also be implemented using means for receiving broadcasts.
  • the processing unit 43, movement processing unit 53, and movement determination unit 531 can usually be realized by a processor, memory, etc.
  • the processing procedures of the processing unit 43, etc. are usually realized by software, and the software is recorded in a recording medium such as a ROM. However, they may also be realized by hardware (dedicated circuitry).
  • the processor may be a CPU, MPU, GPU, etc., and the type is not important.
  • the video acquisition unit 433 is usually implemented using a wireless or wired communication means, but may also be implemented using a means for receiving broadcasts.
  • the transmitting unit 44, the inquiry transmitting unit 441, the mobile transmitting unit 54, and the mobile video transmitting unit 542 are usually realized by wireless or wired communication means, but may be realized by broadcasting means. ⁇ Operation>
  • the processing unit 43 determines whether or not the i-th mobile terminal 5 exists among the mobile terminals 5 managed by the terminal management unit 411. If the i-th mobile terminal 5 exists, the process proceeds to S1803; if it does not exist, the process proceeds to S1805.
  • the processing unit 43 acquires the terminal communication information of the i-th mobile terminal 5 from the terminal management unit 411.
  • the inquiry sending unit 441 sends the received inquiry to the i-th mobile terminal 5 corresponding to the acquired terminal communication information.
  • the receiving unit 42 determines whether or not location information, etc. has been received from one or more mobile terminals 5. If location information, etc. has been received, the process proceeds to S1806; if not, the process returns to S1805.
  • the receiving unit 42 waits, for example, until a predetermined period of time has elapsed since sending the inquiry.
  • the location information, etc. is, for example, location information and a thumbnail image, or location information and a video.
  • the location information, etc. may have one or more video attribute values.
  • the transmission unit 44 transmits the location information, etc. of each of the one or more mobile terminals 5 received in S1805 to the user terminal 3 that sent the inquiry. Return to S403.
  • processing ends when the power is turned off or an interrupt occurs to end processing.
  • the mobile receiving unit 52 determines whether or not an inquiry has been received from the information processing device 4. If an inquiry has been received, the process proceeds to S1902; if not, the process proceeds to S1905.
  • the movement determination unit 531 acquires the route specification information contained in the query.
  • the movement determination unit 531 acquires the latest location information.
  • the movement determination unit 531 determines whether the latest location information satisfies the route conditions for the route specified by the route specification information. If the route conditions are satisfied, the process proceeds to S1903, and if not, the process proceeds to S1002.
  • the route condition here is that the latest location information is information indicating a point on the route specified by the route specification information.
  • the movement processing unit 53 configures the information to be transmitted.
  • the information to be transmitted is, for example, the latest location information, one or more video attribute values, a thumbnail image, and a terminal identifier.
  • the information to be transmitted is, for example, the latest location information, one or more video attribute values, a video, and a terminal identifier.
  • the mobile transmission unit 54 transmits the information constructed in S1903 to the information processing device 4. Go to S1010.
  • the mobile receiving unit 52 determines whether or not a transmission instruction has been received from the information processing device 4. If a transmission instruction has been received, the process proceeds to S1906; if not, the process proceeds to S1908.
  • the movement processing unit 53 acquires a video.
  • the movement processing unit 53 normally acquires a video stored in the movement storage unit 21.
  • the moving video transmission unit 542 transmits the video acquired in S1906 to the information processing device 4.
  • the movement processing unit 53 determines whether or not to end the process. If the process is to be ended, the process returns to S1901. If the process is not to be ended, the process returns to S1902. Note that the process is ended, for example, when an instruction to end a process such as video storage is received.
  • processing ends when the power is turned off or an interrupt occurs to end processing.
  • the information processing device 4 becomes a platform for appropriately providing videos of each point along the route.
  • the information processing device 4 becomes a platform for appropriately providing videos of multiple points along the route.
  • this embodiment can provide a platform that places a low load on the user when providing video from each point along the route.
  • this embodiment reduces the load on the platform required to provide appropriate video for each point along the route.
  • this embodiment allows for appropriate processing regarding video rights holders.
  • this embodiment allows videos to be preserved.
  • this embodiment ensures that the rights holder of the video is the appropriate rights holder.
  • FIG. 20 also shows the appearance of a computer that executes the programs described in this specification to realize each device, such as the information processing device 1, of the various embodiments described above.
  • the above-mentioned embodiments can be realized by computer hardware and a computer program executed thereon.
  • FIG. 20 is an overview of this computer system 300
  • FIG. 21 is a block diagram of system 300.
  • computer system 300 includes computer 301, which includes a CD-ROM drive, keyboard 302, mouse 303, and monitor 304.
  • computer 301 in addition to a CD-ROM drive 3012, computer 301 includes an MPU 3013, a bus 3014 connected to the CD-ROM drive 3012 etc., a ROM 3015 for storing programs such as a boot-up program, a RAM 3016 connected to the MPU 3013 for temporarily storing instructions for application programs and providing temporary storage space, and a hard disk 3017 for storing application programs, system programs, and data.
  • computer 301 may further include a network card that provides connection to a LAN.
  • the program that causes the computer system 300 to execute the functions of the information processing device 1 of the above-mentioned embodiment may be stored on the CD-ROM 3101, inserted into the CD-ROM drive 3012, and then transferred to the hard disk 3017.
  • the program may be sent to the computer 301 via a network (not shown) and stored on the hard disk 3017.
  • the program is loaded into the RAM 3016 when executed.
  • the program may be loaded directly from the CD-ROM 3101 or the network.
  • the program does not necessarily have to include an operating system (OS) that causes the computer 301 to execute the functions of the information processing device 1 of the above-mentioned embodiment, or a third-party program, etc.
  • OS operating system
  • the program only needs to include an instruction portion that calls appropriate functions (modules) in a controlled manner to obtain the desired results. How the computer system 300 operates is well known, and a detailed description will be omitted.
  • the steps of transmitting information and receiving information do not include processing performed by hardware, such as processing performed by a modem or interface card in the transmission step (processing that can only be performed by hardware).
  • the computer that executes the above program may be a single computer or multiple computers. In other words, it may perform centralized processing or distributed processing.
  • multiple communication means present in one device may be realized physically by one medium.
  • each process may be realized by centralized processing in a single device, or may be realized by distributed processing in multiple devices.
  • the information processing device 1 has the effect of being able to appropriately acquire video of each point along a route, and is useful as a server for transmitting video, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computer Graphics (AREA)
  • Telephonic Communication Services (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
PCT/JP2022/047551 2022-12-23 2022-12-23 情報処理装置、移動端末、ユーザ端末、および情報処理方法 Ceased WO2024134862A1 (ja)

Priority Applications (6)

Application Number Priority Date Filing Date Title
DE112022008115.5T DE112022008115T5 (de) 2022-12-23 2022-12-23 Informationsverarbeitungsvorrichtung, mobiles endgerät, nutzerendgerät und informationsverarbeitungsverfahren
PCT/JP2022/047551 WO2024134862A1 (ja) 2022-12-23 2022-12-23 情報処理装置、移動端末、ユーザ端末、および情報処理方法
JP2024565531A JP7667380B2 (ja) 2022-12-23 2022-12-23 情報処理装置、移動端末、ユーザ端末、および情報処理方法
JP2025063103A JP7725183B2 (ja) 2022-12-23 2025-04-07 情報処理装置、移動端末、ユーザ端末、および情報処理方法
US19/188,000 US12518545B2 (en) 2022-12-23 2025-04-24 Information processing device, mobile terminal, user terminal and information processing method
US19/403,263 US20260087823A1 (en) 2022-12-23 2025-11-28 Information processing device, mobile terminal, user terminal and information processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2022/047551 WO2024134862A1 (ja) 2022-12-23 2022-12-23 情報処理装置、移動端末、ユーザ端末、および情報処理方法

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US19/188,000 Continuation US12518545B2 (en) 2022-12-23 2025-04-24 Information processing device, mobile terminal, user terminal and information processing method

Publications (1)

Publication Number Publication Date
WO2024134862A1 true WO2024134862A1 (ja) 2024-06-27

Family

ID=91587890

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/047551 Ceased WO2024134862A1 (ja) 2022-12-23 2022-12-23 情報処理装置、移動端末、ユーザ端末、および情報処理方法

Country Status (4)

Country Link
US (2) US12518545B2 (https=)
JP (2) JP7667380B2 (https=)
DE (1) DE112022008115T5 (https=)
WO (1) WO2024134862A1 (https=)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018074412A (ja) * 2016-10-31 2018-05-10 富士通株式会社 コンテンツ配信システム、情報処理装置、コンテンツ配信制御プログラムおよびコンテンツ配信制御方法
JP2020094958A (ja) * 2018-12-14 2020-06-18 トヨタ自動車株式会社 情報処理システム、プログラム、及び情報処理方法
WO2021225085A1 (ja) * 2020-05-08 2021-11-11 株式会社ミックウェア 情報処理システム、情報処理方法、情報処理プログラム、およびサーバ

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7383123B2 (en) * 2003-06-03 2008-06-03 Samsung Electronics Co., Ltd. System and method of displaying position information including an image in a navigation system
JP4926400B2 (ja) * 2004-12-27 2012-05-09 京セラ株式会社 移動カメラシステム
DE102016205436A1 (de) * 2015-11-25 2017-06-01 Volkswagen Aktiengesellschaft Verfahren und System zum Erstellen einer digitalen Karte
JP2018037886A (ja) 2016-08-31 2018-03-08 株式会社東芝 画像配信装置、画像配信システム、および画像配信方法
JP7272244B2 (ja) * 2019-11-22 2023-05-12 トヨタ自動車株式会社 画像データ配信システム

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2018074412A (ja) * 2016-10-31 2018-05-10 富士通株式会社 コンテンツ配信システム、情報処理装置、コンテンツ配信制御プログラムおよびコンテンツ配信制御方法
JP2020094958A (ja) * 2018-12-14 2020-06-18 トヨタ自動車株式会社 情報処理システム、プログラム、及び情報処理方法
WO2021225085A1 (ja) * 2020-05-08 2021-11-11 株式会社ミックウェア 情報処理システム、情報処理方法、情報処理プログラム、およびサーバ

Also Published As

Publication number Publication date
US12518545B2 (en) 2026-01-06
JP2025114560A (ja) 2025-08-05
US20260087823A1 (en) 2026-03-26
JP7725183B2 (ja) 2025-08-19
JPWO2024134862A1 (https=) 2024-06-27
DE112022008115T5 (de) 2025-10-23
US20250252753A1 (en) 2025-08-07
JP7667380B2 (ja) 2025-04-22

Similar Documents

Publication Publication Date Title
EP1349363B1 (en) Digital camera connected to a navigation device and to an external storage information system
JP2017228115A (ja) 情報を提供するための方法、当該方法をコンピュータに実行させるためのプログラム、および情報を提供するための装置
KR102197392B1 (ko) 관심지점 리스트에 대한 구독과 리뷰 정보에 기초하여 보상을 제공하는 방법 및 시스템
KR102235740B1 (ko) 관심지점 리스트에 대한 구독과 리뷰 정보에 기초하여 보상을 제공하는 방법 및 시스템
JP7667380B2 (ja) 情報処理装置、移動端末、ユーザ端末、および情報処理方法
KR101850501B1 (ko) 역사 컨텐츠 제공 시스템
JP7746610B2 (ja) 情報処理装置、ユーザ端末、および情報処理方法
KR102118462B1 (ko) 관심지점을 이용하여 이미지를 필터링하기 위한 방법 및 시스템
KR102105231B1 (ko) 정보 공유 시스템 및 방법
JP7738782B2 (ja) 情報処理装置、ユーザ端末、および情報処理方法
JP7688473B2 (ja) 移動端末、情報処理装置、および情報処理方法
JP7733427B2 (ja) 情報システム
KR102427830B1 (ko) 관심지점을 이용하여 이미지를 필터링하기 위한 방법 및 시스템
WO2024224502A1 (ja) 情報処理装置、および情報処理方法
JP7667921B2 (ja) 情報処理装置、および情報処理方法
KR20210109759A (ko) 차량용 컨텐츠 기반 경로 정보 제공 방법 및 그를 수행하기 위한 장치
WO2024161605A1 (ja) 情報処理装置、ユーザ端末、および情報処理方法
JP7681812B2 (ja) 情報処理装置、ユーザ端末、および情報処理方法
WO2024232011A1 (ja) 移動端末、情報処理装置、および情報処理方法
JP2025077092A (ja) 情報処理装置、ユーザ端末、および情報処理方法
WO2024224576A1 (ja) 移動端末、情報処理装置、および情報処理方法
WO2024201927A1 (ja) 情報処理装置、ユーザ端末、および情報処理方法
JP2021077115A (ja) 出力システムおよびその制御方法、並びにプログラム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22969245

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2024565531

Country of ref document: JP

WWE Wipo information: entry into national phase

Ref document number: 2501003351

Country of ref document: TH

WWE Wipo information: entry into national phase

Ref document number: 112022008115

Country of ref document: DE

WWP Wipo information: published in national office

Ref document number: 112022008115

Country of ref document: DE

122 Ep: pct application non-entry in european phase

Ref document number: 22969245

Country of ref document: EP

Kind code of ref document: A1