WO2022163715A1 - プログラム、情報処理方法、及び端末装置 - Google Patents

プログラム、情報処理方法、及び端末装置 Download PDF

Info

Publication number
WO2022163715A1
WO2022163715A1 PCT/JP2022/002922 JP2022002922W WO2022163715A1 WO 2022163715 A1 WO2022163715 A1 WO 2022163715A1 JP 2022002922 W JP2022002922 W JP 2022002922W WO 2022163715 A1 WO2022163715 A1 WO 2022163715A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
sensor
sensor device
timing
terminal device
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2022/002922
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
善朗 深井
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Concept Proto Co Ltd
Original Assignee
Concept Proto Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Concept Proto Co Ltd filed Critical Concept Proto Co Ltd
Priority to US18/263,258 priority Critical patent/US20250327945A1/en
Priority to EP22745934.4A priority patent/EP4290317A4/en
Publication of WO2022163715A1 publication Critical patent/WO2022163715A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G04—HOROLOGY
    • G04G—ELECTRONIC TIME-PIECES
    • G04G21/00—Input or output devices integrated in time-pieces
    • G04G21/02—Detectors of external physical values, e.g. temperature
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01V—GEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
    • G01V8/00—Prospecting or detecting by optical means
    • G01V8/10—Detecting, e.g. by using light barriers
    • G01V8/12—Detecting, e.g. by using light barriers using one transmitter and one receiver
    • G—PHYSICS
    • G04—HOROLOGY
    • G04G—ELECTRONIC TIME-PIECES
    • G04G21/00—Input or output devices integrated in time-pieces
    • G04G21/04—Input or output devices integrated in time-pieces using radio waves
    • G—PHYSICS
    • G04—HOROLOGY
    • G04G—ELECTRONIC TIME-PIECES
    • G04G9/00—Visual time or date indication means
    • G04G9/0064—Visual time or date indication means in which functions not related to time can be displayed
    • G—PHYSICS
    • G04—HOROLOGY
    • G04G—ELECTRONIC TIME-PIECES
    • G04G9/00—Visual time or date indication means
    • G04G9/0064—Visual time or date indication means in which functions not related to time can be displayed
    • G04G9/007—Visual time or date indication means in which functions not related to time can be displayed combined with a calculator or computing means
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C1/00—Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people
    • G07C1/22—Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people in connection with sports or games
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/2228—Video assist systems used in motion picture production, e.g. video cameras connected to viewfinders of motion picture cameras or related video signal processing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628—Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04Q—SELECTING
    • H04Q9/00—Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom
    • G—PHYSICS
    • G07—CHECKING-DEVICES
    • G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
    • G07C1/00—Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people
    • G07C1/22—Registering, indicating or recording the time of events or elapsed time, e.g. time-recorders for work people in connection with sports or games
    • G07C1/24—Race time-recorders

Definitions

  • the present invention relates to a program, an information processing method, and a terminal device.
  • Patent Literature 1 discloses a time measurement system including a plurality of time measurement devices equipped with sensor units. In the time measurement system, first, each of the synchronized time measurement devices is arranged at a measurement start position and a measurement end position. These time measuring devices are connected by wireless communication or wired communication, and transit time or moving time of the moving body is measured based on the detection signal of each sensor unit.
  • One of the purposes of the present invention is to provide technology that can be universally applied to sensor systems used in various fields.
  • a program causes a computer to generate, from each of a plurality of sensor devices, sensor identification information for identifying the sensor device, sensor information based on detection by the sensor device, and information on the detection by the sensor device.
  • a receiving unit that receives first information including timing information indicating timing; and a processing unit that generates second information based on the first information received from the plurality of sensor devices.
  • An information processing method includes sensor identification information for identifying the sensor device from each of a plurality of sensor devices, sensor information based on detection by the sensor device, and timing of the detection by the sensor device. and generating second information based on the first information received from the plurality of sensor devices.
  • a terminal device receives, from each of a plurality of sensor devices, sensor identification information for identifying the sensor device, sensor information based on detection by the sensor device, and timing of the detection by the sensor device. and a processing unit that generates second information based on the first information received from the plurality of sensor devices.
  • FIG. 1 is a conceptual diagram illustrating the hardware configuration of a terminal device in one embodiment
  • FIG. 1 is a conceptual diagram illustrating the hardware configuration of a sensor device according to one embodiment
  • FIG. 1 is a conceptual diagram for explaining an example of usage of a sensor system in one embodiment
  • FIG. 4 is a diagram for exemplifying the processing flow of the sensor system in one embodiment
  • 1 is a conceptual diagram for explaining an example of usage of a sensor system in one embodiment
  • FIG. 1 is a conceptual diagram for explaining an example of usage of a sensor system in one embodiment
  • FIG. 1 is a conceptual diagram for explaining an example of usage of a sensor system in one embodiment
  • FIG. 1 is a conceptual diagram for explaining an example of usage of a sensor system in one embodiment
  • the sensor system 1 includes a terminal device 10 and sensor devices 20a, 20b, 20c, and 20d.
  • the sensor system 1 includes four sensor devices, but the number of sensor devices may be set arbitrarily and may be three or less or five or more.
  • the sensor devices 20a, 20b, 20c, and 20d may each have the same configuration, or may have different configurations.
  • the sensor devices 20a, 20b, 20c, and 20d are collectively referred to as the sensor device 20 when referred to without distinguishing one from another.
  • the terminal device 10 receives from each of the plurality of sensor devices 20 sensor identification information for identifying the sensor device 20, sensor information based on detection by the sensor device 20, and timing of the detection by the sensor device 20.
  • information (hereinafter also referred to as “notification information”) including timing information indicating the timing information.
  • the terminal device 10 performs processing based on the notification information received from each of the plurality of sensor devices 20, and generates other information (hereinafter also referred to as "generated information").
  • the generated information is information based on the notification information received from each of the plurality of sensor devices 20, and is generated by performing arithmetic processing using the plurality of notification information or combining processing using the plurality of notification information. Information. Details of the processing in the sensor system 1 will be described later.
  • the terminal device 10 receives notification information including sensor identification information, sensor information, and timing information from each of the plurality of sensor devices 20, and Generates generated information based on the information received.
  • notification information including sensor identification information, sensor information, and timing information from each of the plurality of sensor devices 20, and Generates generated information based on the information received.
  • the sensor system 1 is configured to allow communication between the terminal device 10 and the sensor device 20 .
  • Communication between the terminal device 10 and the sensor device 20 is, for example, unidirectional communication from the sensor device 20 to the terminal device 10 .
  • the present invention is not limited to this, and the terminal device 10 and the sensor device 20 may be configured to be bidirectionally communicable.
  • the terminal device 10 is configured by, for example, a smartphone, tablet terminal, PDA (Personal Digital Assistant), personal computer, or other general-purpose or dedicated information processing device.
  • a smartphone for example, a smartphone, tablet terminal, PDA (Personal Digital Assistant), personal computer, or other general-purpose or dedicated information processing device.
  • PDA Personal Digital Assistant
  • personal computer or other general-purpose or dedicated information processing device.
  • the sensor device 20 is a device that detects some event, such as the state, presence or change of an object, or the state or change of the environment.
  • the terminal device 10 includes a processing unit 11, a communication unit 12, an input unit 13, an output unit 14, a storage unit 15, and a positioning unit 16 as main components.
  • the terminal device 10 may have other configurations that terminal devices generally have, in addition to the configuration shown in FIG. Moreover, the terminal device 10 does not have to include part of the configuration shown in FIG.
  • the processing unit 11 controls various processes in the terminal device 10 by executing programs stored in the storage unit 15 .
  • the processing unit 11 implements various processes and functions in the terminal device 10 in cooperation with the configuration (hardware) provided in the terminal device 10 and the program (software).
  • the processing unit 11 is configured by, for example, a CPU (Central Processing Unit).
  • the communication unit 12 communicates with an external device of the terminal device 10 by wire or wirelessly. configured to receive information; Note that the communication unit 12 may be configured to perform two-way communication or long-distance communication with the sensor device 20 . Also, the communication unit 12 is configured to be able to communicate with devices other than the sensor device 20 via a network such as the Internet (via a communication device such as a base station or router).
  • the input unit 13 receives input to the terminal device 10, and includes, for example, an operation unit, a voice input unit, and an image input unit.
  • the operating unit includes, for example, a touch panel and button keys.
  • the audio input unit includes, for example, a microphone.
  • the image input unit includes, for example, a camera.
  • the input unit 13 also includes an interface connector for inputting (and outputting) data from the outside.
  • the output unit 14 performs various outputs from the terminal device 10, and includes, for example, an image output unit and an audio output unit.
  • the image output unit includes, for example, a display device.
  • the audio output unit includes, for example, a speaker.
  • the storage unit 15 is a storage device or memory that stores various information necessary for processing and operation in the terminal device 10 and information on processing results.
  • the positioning unit 16 identifies the position of the terminal device 10, and includes, for example, a GNSS (Global Navigation Satellite System) module (GNSS receiver).
  • the positioning unit 16 receives GNSS signals from a plurality of GNSS satellites and performs positioning processing of the terminal device 10 based on the signals.
  • the GNSS signal includes time information when the GNSS satellite transmitted the GNSS signal.
  • the sensor device 20 includes a processing unit 21, a communication unit 22, a sensor 23, a storage unit 24, and a synchronization unit 25 as main components. Also, the configuration including the processing unit 21, the communication unit 22, and the storage unit 24 functions as a measurement clock (time generation unit).
  • the sensor device 20 may have a configuration other than the configuration shown in FIG. Moreover, the sensor device 20 does not have to include a part of the configuration shown in FIG.
  • the processing unit 21 controls various processes in the sensor device 20 by executing programs stored in the storage unit 24 .
  • the processing unit 21 implements various processes and functions in the sensor device 20 through cooperation between the configuration (hardware) included in the sensor device 20 and the programs (software) stored in the storage unit 24 .
  • the processing unit 21 has a transmission circuit that transmits a system clock.
  • the system clock (clock signal) may be used to measure time or generate time information.
  • the processing unit 21 may generate time information so as to synchronize with the time information included in the GNSS signal received by the positioning unit 16 .
  • the processing unit 21 is configured by, for example, a CPU.
  • the communication unit 22 communicates with an external device of the sensor device 20, and is configured to transmit (broadcast) notification information to the terminal device 10 by short-distance one-way communication such as BLE, for example.
  • the communication unit 22 may be configured to perform two-way communication or long-distance communication with the terminal device 10 .
  • the notification information includes, for example, sensor identification information that identifies the sensor device 20, sensor information based on detection by the sensor device 20, and timing information that indicates the timing of the detection by the sensor device 20.
  • the timing information includes, for example, some information indicating timing, such as time information at the time of the above detection.
  • the sensor information includes information based on the detection of some event, such as the state, presence or change of an object, or the state or change of the environment, by the sensor device 20.
  • the sensor information may include information indicating that the sensor device 20 has detected (or sensed) an object.
  • Information indicating that an object has been detected includes, for example, information indicating that the sensor 23 has detected that an object has passed through a predetermined position or is present at a predetermined position.
  • the sensor information may also include information indicating the physical quantity detected by the sensor 23 .
  • the information indicating the physical quantity includes physical quantity related to the object, such as movement or shape change of the object.
  • information indicating physical quantities includes information indicating environmental conditions such as temperature, air pressure, or water pressure.
  • the sensor 23 detects some event, such as the state, presence or change of an object, or the state or change of the environment, and is composed of one or more sensors.
  • the sensor 23 includes, for example, a photoelectric sensor, a magnetic sensor, an acceleration sensor, an angular velocity sensor, a temperature sensor, or a pressure sensor (eg, an air pressure sensor or water pressure sensor).
  • the storage unit 24 is a memory that stores various information necessary for processing and operation in the sensor device 20 and information on processing results.
  • the synchronization unit 25 controls so that the time measured by the sensor device 20 is synchronized with the time measured by the other sensor device 20 .
  • Synchronization part 25 is provided with a GNSS receiver, for example, and is constituted.
  • the synchronization unit 25 receives the GNSS signal from the GNSS satellite, and based on the time information included in the GNSS signal, the time information generated by the sensor device 20 and the time information generated by the GNSS satellite The time information generated in the sensor device 20 is controlled so that synchronization can be obtained between and.
  • the sensor device 20 (for example, the sensor device 20a) can synchronize generated time information with other sensor devices 20 (for example, the sensor device 20b, the sensor device 20c, and the sensor device 20d).
  • the synchronization unit 25 can generate timing information to be included in notification information based on time information synchronized between the plurality of sensor devices 20 . That is, each piece of timing information included in the notification information received by the terminal device 10 from the plurality of sensor devices 20 is based on temporally synchronized information. Further, when the terminal device 10 generates timing information based on the time information included in the GNSS signal received by the positioning unit 16, the sensor device 20 also exchanges the generated timing information with the terminal device 10. can be synchronized.
  • the synchronization unit 25 provided in each of the plurality of sensor devices 20 receives a signal including time information from an external device such as a terminal device (for example, a smartphone), a router, or a base station.
  • the timing information generated by the plurality of sensor devices 20 may be controlled so as to be synchronized with the time information included in the signal.
  • timing information can be synchronized between the plurality of sensor devices 20 .
  • the modified example can be adopted for the process of synchronizing the timing information to be described later.
  • FIGS. 1 to 3 An embodiment of the sensor system 1 will be described below. In the following description, each configuration shown in FIGS. 1 to 3 will be referred to.
  • Example 1 An example of processing executed by the sensor system 1 according to the first embodiment will be described.
  • the sensor system 1 functions as a time measurement system.
  • the terminal device 10 calculates the travel time of the object in the predetermined section based on the notification information received from the plurality of sensor devices 20 under the control of the processing unit 11 .
  • FIG. 4 conceptually shows an example in which the sensor system 1 is used to measure the running time of a runner in sprinting (or middle-distance running or long-distance running) in track and field events.
  • FIG. 4 shows the start line and finish line of a sprint.
  • a runner holds a terminal device 10 .
  • a sensor device 20b is arranged on the goal line as a goal sensor that detects (detects) the goal of the runner.
  • a sensor device 20a is arranged as an intermediate sensor at an intermediate point between the start line and the goal line.
  • the timing information generated by the terminal device 10, the sensor device 20a, and the sensor device 20b are synchronized based on the signals received from the GNSS satellites.
  • the terminal device 10 In order to measure the running time of a runner who starts running from the starting line, the terminal device 10 first outputs a running start signal. For example, as a signal output, the output unit 14 (audio output unit) of the terminal device 10 held by the runner on the start line may output audio such as "On your marks, set, 'Bang'". In addition, the terminal device 10 outputs and stores timing information (for example, time information) at which the signal to start running is output within the terminal device 10 .
  • a running start signal For example, as a signal output, the output unit 14 (audio output unit) of the terminal device 10 held by the runner on the start line may output audio such as "On your marks, set, 'Bang'".
  • the terminal device 10 outputs and stores timing information (for example, time information) at which the signal to start running is output within the terminal device 10 .
  • the sensor device 20a After the signal to start running is output, the runner starts running, and when the runner passes the waypoint, the sensor device 20a detects that the runner has passed the waypoint. When it is detected that the runner has passed the waypoint, the sensor device 20a outputs sensor identification information for identifying the sensor device 20a and sensor information (for example, flag information) indicating that the runner has passed the waypoint. ) and timing information indicating the time of detection of passage of the runner's waypoint. It should be noted that the sensor information may indicate the time of detection of passage through the waypoint as well as the timing information.
  • the terminal device 10 receives notification information transmitted from the sensor device 20a.
  • the sensor device 20a detects that the runner has crossed the goal line.
  • the sensor device 20b outputs sensor identification information for identifying the sensor device 20b and sensor information (for example, flag information) indicating that the runner has passed the goal line. ) and timing information indicating the time at which the runner's passage of the finish line is detected.
  • the terminal device 10 receives the notification information transmitted from the sensor device 20b.
  • the terminal device 10 detects the difference between the timing information outputting the signal to start running and the timing information (time information) included in the notification information received from the sensor device 20a. It is possible to calculate (measure) the time required to travel. In addition, the terminal device 10 detects the difference between the timing information (time information) included in the notification information received from the sensor device 20a and the timing information (time information) included in the notification information received from the sensor device 20b. It is possible to calculate the time required for the runner to run the section from the halfway point to the finish line. Furthermore, the terminal device 10 detects the difference between the timing information at which the signal to start running and the timing information included in the notification information received from the sensor device 20b allows the runner to run the section from the start line to the finish line. It is possible to calculate the time required to
  • the terminal device 10 may transmit the calculated (measured) running time of the runner as generated information to the data server, and the data server may store the received running time in the storage unit. Moreover, the sensor system 1 may calculate the running times of a plurality of runners by a method similar to that described above. In this case, the data server aggregates the running time rankings of the plurality of runners stored in the storage unit, and makes it possible to transmit the ranking information to the terminal device 10 in response to a request from the terminal device 10. good too.
  • the data server has a configuration that a general information processing apparatus has, and includes, for example, a processing unit (processor) and a storage unit. The data server in other embodiments also has a similar configuration.
  • a processing flow of the sensor system 1 according to the first embodiment will be described with reference to FIG.
  • Each processing step described below is implemented by, for example, the processing units of the terminal device 10 and the sensor device 20 reading and executing a computer program stored in the storage unit.
  • step S50 the terminal device 10 outputs a running start signal at a predetermined timing.
  • the output unit 14 (audio output unit) of the terminal device 10 may output audio such as "On your marks, set, "Bang” as a signal output.
  • the timing information at which the signal for starting running is output is output from the processing section 11 as timing information for starting running, and is stored in the storage section 15 . That is, the processing unit 11 functions as a timing information output unit.
  • step S51 when the sensor device 20a detects that the runner has passed the waypoint, sensor identification information that identifies the sensor device 20a, and sensor information that indicates that the runner has passed the waypoint. (for example, flag information) and timing information indicating the time of detection of the runner's passage of the waypoint is transmitted. It should be noted that the sensor information may indicate the time of detection of passage through the waypoint as well as the timing information.
  • the terminal device 10 receives notification information transmitted from the sensor device 20a.
  • the sensor device 20a detects that the runner has passed the waypoint. To detect.
  • step S52 when the sensor device 20b detects that the runner has passed the goal line, the sensor device 20b detects sensor identification information that identifies the sensor device 20b and that the runner has passed the halfway point. and timing information indicating the time when the runner's passage of the finish line is detected. It should be noted that the sensor information may indicate the time of detection of passage of the goal line as well as the timing information.
  • the terminal device 10 receives the notification information transmitted from the sensor device 20b.
  • the terminal device 10 receives notification information transmitted from the sensor device 20b.
  • the terminal device 10 calculates the running time of the runner in the predetermined section. Details are as follows, for example.
  • the sensor identification information of the sensor device 20a indicates the waypoint as information indicating that the sensor device 20a is installed at the waypoint in the terminal device 10. Stored in association with information. Further, in the terminal device 10, as information indicating that the sensor device 20b is installed on the goal line, sensor identification information of the sensor device 20b is stored in association with information indicating the goal line.
  • the terminal device 10 calculates the difference between the time (start time) indicated by the timing information stored in the storage unit 15 in step S50 and the time (middle time) indicated by the timing information included in the notification information received in step S51. Then, the time required for the runner to run the section from the start line to the halfway point (running time) is calculated. In addition, the terminal device 10 sets the time between the time indicated by the timing information included in the notification information received in step S51 (middle time) and the time indicated by the timing information included in the notification information received in step S52 (goal time). The time required for the runner to run the section from the halfway point to the finish line (running time) is calculated from the difference between .
  • the terminal device 10 sets the time between the time (start time) indicated by the timing information stored in the storage unit 15 in step S50 and the time (goal time) indicated by the timing information included in the notification information received in step S52.
  • the time required for the runner to run the section from the start line to the finish line (running time) is calculated from the difference between the .
  • the terminal device 10 stores the calculated running time in the storage unit 15 as generated information, and transmits the generated information to the data server described above.
  • the terminal device 10 receives notification information including sensor identification information, sensor information, and timing information from each of the plurality of sensor devices 20, and generates based on information included in the received notification information. Generate information.
  • notification information including sensor identification information, sensor information, and timing information from each of the plurality of sensor devices 20, and generates based on information included in the received notification information.
  • Generate information As a result, as shown in the time measurement system of Example 1 and Examples described later, it is possible to realize a technology that is universally applicable to sensor systems used in various fields.
  • the terminal device 10 can accurately calculate the travel time (generate generated information) based on the notification information received from the plurality of sensor devices 20 .
  • the sensor device 20 When the communication between the sensor device 20 and the terminal device 10 adopts a configuration in which unidirectional communication from the sensor device 20 to the terminal device 10 is adopted, the sensor device 20 has, for example, a configuration necessary for communication via the Internet (for example, Information can be transmitted to the terminal device 10 without having a SIM card (Subscriber Identity Module Card). As a result, the sensor system 1 can calculate the travel time (generate generated information) with high accuracy with a simple configuration and less restrictions on the communication environment.
  • a configuration necessary for communication via the Internet for example, Information can be transmitted to the terminal device 10 without having a SIM card (Subscriber Identity Module Card).
  • SIM card Subscriber Identity Module Card
  • the processing unit 11 of the terminal device 10 identifies (outputs) the timing information at which the signal to start running is output as the timing information to start running, and stores the timing information in the storage unit 15 .
  • the identification and storage of the travel start timing information are not limited to the above, and may be implemented by other methods. For example, it may be implemented as follows. First, the sensor device 20c is arranged as a start sensor on the start line, and the sensor device 20c detects the start of running of the runner.
  • the sensor device 20c When the sensor device 20c detects the start of running of the runner, the sensor device 20c indicates sensor identification information for identifying the sensor device 20c, sensor information indicating that the start of running of the runner is detected, and the time when the start of running of the runner is detected. and timing information.
  • the terminal device 10 receives the notification information transmitted from the sensor device 20 c and stores it in the storage unit 15 .
  • the sensor device 20a detects the start of running of the runner. good.
  • the terminal device 10 receives the time indicated by the timing information included in the notification information received from the sensor device 20c (start time) and the time indicated by the timing information included in the notification information received in steps S51 and S52 (intermediate time and goal time). ) to calculate the running time from the start line to the intermediate point, the running time from the intermediate point to the finish line, and the running time from the start line to the finish line in the same manner as above. good too.
  • Example 2 An example of processing executed by the sensor system 1 according to the second embodiment will be described.
  • the sensor system 1 functions as a video system.
  • a camera device having the same configuration and functions as the terminal device 10 edits the video shot by the camera based on the notification information received from the plurality of sensor devices 20 under the control of the processing unit. generate information used for
  • FIG. 6 conceptually shows an example in which the sensor system 1 is used as a video system for shooting a video with a camera or editing a video of some kind of competition such as a track and field competition or a ski competition.
  • FIG. 6 shows a sensor device 20a and a camera device 30 installed at a predetermined position such as a starting line. Furthermore, a terminal device 10 held by a player is shown.
  • the camera device 30 has the same configuration as the terminal device 10 (that is, the camera device 30 can function in the same manner as the terminal device 10).
  • the camera device 30 is installed at a predetermined position facing the player so that the player can be photographed.
  • the timing information generated by the terminal device 10, the sensor device 20a, and the camera device 30 are synchronized based on the signals received from the GNSS satellites.
  • the camera device 30 has started shooting before the start of the competition.
  • Timing information for example, time information
  • the sensor device 20a detects that the competitor has passed the start line
  • the sensor device 20a receives the sensor identification information of the sensor device 20a and the sensor information indicating that the competitor has passed the start line (for example, flag information) and timing information indicating the time of detection of the competitor's passage of the start line.
  • the sensor information may indicate the time of detection of the passage of the start line as well as the timing information.
  • the camera device 30 receives notification information transmitted from the sensor device 20a.
  • the sensor device 20b may be installed on the goal line.
  • the sensor device 20b when the sensor device 20b detects that the player has passed the goal line, the sensor device 20b includes sensor identification information of the sensor device 20b and sensor information indicating that the player has passed the goal line (for example, , flag information) and timing information indicating the time of detection of the crossing of the goal line by the player may be transmitted.
  • the camera device 30 receives notification information transmitted from the sensor device 20b.
  • the camera device 30 may receive the notification information via a relay device configured by any communication device instead of directly receiving the notification information from the sensor device 20 .
  • the camera device 30 detects the time (competition start time) indicated by the timing information included in the notification information received from the sensor device 20a and the time (competition end time) indicated by the timing information included in the notification information received from the sensor device 20b. Cut out (trim) the video data at the position determined based on That is, based on the notification information received from the plurality of sensor devices 20 , the camera device 30 generates cut position information used for editing moving image data captured by the camera device 30 as generation information.
  • a position corresponding to a predetermined time (for example, 2 seconds before) before the game start time in the video data obtained by shooting is set as the start position of the clipping, and a predetermined time after the game end time (for example, 2 seconds)
  • the clipping may be performed with the corresponding position as the clipping end position.
  • the camera device 30 stores the video data obtained by the clipping process in the storage unit of the camera device 30 and transmits the data to the data server. Transmission of video data from the camera device 30 to the data server may be performed via the terminal device 10 .
  • the data server stores the received video data in the storage unit of the data server. Competitors (users) can receive moving image data from the camera device 30 or the data server via the terminal device 10, and can reproduce and view the data.
  • the clipped video data for each of a plurality of competitors may be obtained by the same method as described above and stored in the camera device 30 or data server.
  • the plurality of moving image data stored in the camera device 30 or the data server start from the same predetermined position (for example, two seconds before the start time of the competition), so the user can reproduce the plurality of moving image data simultaneously. Therefore, it is possible to easily compare subjects shown in moving image data (comparison of competitions by a plurality of athletes).
  • the user downloads the plurality of moving image data from a data server or the like, or superimposes the plurality of moving image data on the terminal device 10 or another device by streaming, and places them at a predetermined position (for example, at the start time of the competition). By playing back from 2 seconds ago), it is possible to analyze the competition by multiple athletes. Such analysis may include, for example, in athletics, identifying where differences exist between athletes, such as comparing reaction times to the start sound among athletes.
  • the sensor system 1 functioning as a video system in the second embodiment can be used not only for track and field competitions or ski competitions described above, but also for performance competitions (for example, gymnastics such as vaulting, one-make, or aerial), railroad crossings, etc. It can be used for filming or editing and analyzing filmed videos of sports (eg, long jump, triple jump, high jump, or pole vault) or golf.
  • the camera device 30 receives notification information transmitted from the sensor device 20 and generates generated information, but the present invention is not limited to this.
  • the terminal device 10 may receive the notification information from the sensor device 20 and generate the generated information based on the received notification information.
  • the terminal device 10 receives from the camera device 30 the sensor identification information of the camera device 30, the sensor information including the video data obtained by shooting with the camera device 30, and the shooting time associated with the video data.
  • the terminal device 10 determines the clipping position (creation information) of the moving image data by the same method as described above.
  • Moving image data (generation information) may be generated.
  • Example 3 the sensor system 1 functions as an athlete's form analysis system.
  • the terminal device 10 under the control of the processing unit 11, based on the sensor identification information and the timing information included in each of the plurality of notification information received from the plurality of sensor devices 20, Synthesize sensor information. Further, under the control of the processing unit 11, the terminal device 10 estimates the movement form of the athlete by analyzing the generated information obtained by synthesizing the sensor information, and converts the movement form data of the estimation result into ( For example, it can be output as moving image data).
  • FIG. 7 conceptually shows an example of using the sensor system 1 as a form analysis system for analyzing the form of a running athlete.
  • FIG. 7 shows a terminal device 10 held by a subject who is a competitor (runner).
  • sensor devices 20a, 20b, 20c, 20d attached to the limbs (left wrist, right wrist, left ankle, right ankle) of the person to be measured are shown.
  • the sensor device 20 may be attached to some of the limbs instead of all of them.
  • the sensor device 20 may be attached to a part of the body of the person to be measured other than the extremities (for example, the head or waist).
  • information indicating the position where the sensor device 20 is attached is stored in the terminal device 10 .
  • sensor identification information identifying the sensor devices 20a, 20b, 20c, and 20d is stored in association with information indicating left wrist, right wrist, left ankle, or right ankle.
  • Example 3 the timing information generated by the terminal device 10 and the sensor devices 20a, 20b, 20c, and 20d are synchronized based on the signals received from the GNSS satellites.
  • Notification information is transmitted from each of the sensor devices 20a, 20b, 20c, and 20d while the subject is running, and the terminal device 10 receives the notification information.
  • the notification information includes sensor identification information that identifies the sensor device 20 , sensor information based on detection by the sensor device 20 , and timing information that indicates the time of the detection by the sensor device 20 .
  • the sensor information includes, for example, information on detection results (measurement results) by the acceleration sensor and the angular velocity sensor included in the sensor 23 of the sensor device 20 .
  • the terminal device 10 Based on the sensor identification information and the timing information included in each of the plurality of notification information received from the sensor devices 20a, 20b, 20c, and 20d, the terminal device 10 synthesizes the sensor information included in the plurality of notification information. . Specifically, the terminal device 10 uses the sensor information associated with the sensor identification information of the sensor device 20a as the measurement result of the left wrist, and uses the sensor information associated with the sensor identification information of the sensor device 20b as the measurement result of the right wrist. As a result, the sensor information associated with the sensor identification information of the sensor device 20c is used as the measurement result of the left ankle, and the sensor information associated with the sensor identification information of the sensor device 20d is used as the measurement result of the right ankle. Synthesis of sensor information is performed so that the time indicated by the timing information associated with the information corresponds.
  • the terminal device 10 estimates the motion form of the subject by analyzing the information (generated information) obtained by synthesizing the sensor information, and outputs data of the motion form of the estimation results (for example, as video data). Output by the unit 14 .
  • the terminal device 10 is pre-associated data (basic data) is stored in the storage unit 15 .
  • the terminal device 10 may estimate the motion form of the person to be measured based on the basic data and the generated information, and output motion form data as a result of the estimation.
  • by associating physical information (including height, weight, etc.) with the basic data based on the basic data, the generated information, and the physical information of the person being measured, the behavior of the estimation results with higher accuracy. It is possible to output form data.
  • the motion form data obtained as a result of the estimation can be played back on the terminal device 10 as video data indicating the motion form (for example, video data indicating the shape of a person's body and motion of parts of the body such as limbs). be.
  • the data of the motion form of the estimation result may be transmitted to the data server and stored in the storage unit of the data server together with the data of other subjects.
  • the terminal device 10 can download the data of the operation form from the data server and reproduce it.
  • the terminal device 10 is capable of comparing data of motion forms of a plurality of subjects (including data of motion forms that serve as samples, for example) (for example, reproducing a plurality of moving image data side by side or overlapping each other). ) and may be reproducible.
  • a program for implementing the sensor system 1 (or the terminal device 10, the sensor device 20, or the camera device 30) in this embodiment is recorded in various recording media such as an optical disk, a magnetic disk, and a semiconductor memory. be able to. Also, the above program can be installed or loaded on a computer by downloading it through a recording medium or via a communication network or the like.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Life Sciences & Earth Sciences (AREA)
  • Geophysics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Mathematical Physics (AREA)
  • Theoretical Computer Science (AREA)
  • Arrangements For Transmission Of Measured Signals (AREA)
  • Studio Devices (AREA)
  • Measurement Of Unknown Time Intervals (AREA)
PCT/JP2022/002922 2021-01-29 2022-01-26 プログラム、情報処理方法、及び端末装置 Ceased WO2022163715A1 (ja)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US18/263,258 US20250327945A1 (en) 2021-01-29 2022-01-26 Program, Information Processing Method, and Terminal Device
EP22745934.4A EP4290317A4 (en) 2021-01-29 2022-01-26 PROGRAM, INFORMATION PROCESSING METHOD AND TERMINAL DEVICE

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021013111A JP2022116767A (ja) 2021-01-29 2021-01-29 プログラム、情報処理方法、及び端末装置
JP2021-013111 2021-01-29

Publications (1)

Publication Number Publication Date
WO2022163715A1 true WO2022163715A1 (ja) 2022-08-04

Family

ID=82654552

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/002922 Ceased WO2022163715A1 (ja) 2021-01-29 2022-01-26 プログラム、情報処理方法、及び端末装置

Country Status (4)

Country Link
US (1) US20250327945A1 (https=)
EP (1) EP4290317A4 (https=)
JP (2) JP2022116767A (https=)
WO (1) WO2022163715A1 (https=)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2022116767A (ja) * 2021-01-29 2022-08-10 株式会社コンセプトプロト プログラム、情報処理方法、及び端末装置

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05142364A (ja) * 1991-11-25 1993-06-08 Fujitsu Ltd 時間計測システム
JPH06318278A (ja) * 1993-05-06 1994-11-15 Nippon Telegr & Teleph Corp <Ntt> 移動体管理システム及び移動機
JP2003284061A (ja) * 2002-03-26 2003-10-03 Fujitsu Ltd 映像記録装置
KR20070100569A (ko) * 2006-04-07 2007-10-11 박종천 마라톤 및 인라인 경주용 ｉｄ 장치
JP2016158699A (ja) * 2015-02-27 2016-09-05 セイコーエプソン株式会社 着地位置評価方法、及び着地位置評価装置
JP6550612B1 (ja) 2017-11-27 2019-07-31 株式会社Ｔｒａｃ 時間計測システム
WO2019167955A1 (ja) * 2018-03-02 2019-09-06 土樋パルス株式会社 競技用計測システム

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012100237A2 (en) * 2011-01-20 2012-07-26 Innovative Timing Systems, Llc Rfid timing system and method with integrated event participant location tracking
WO2014145361A1 (en) * 2013-03-15 2014-09-18 Innovative Timing Systems Llc System and method of integrating participant biometrics within an event timing system
CA3030958C (en) * 2015-07-16 2019-11-05 Blast Motion Inc. Integrated sensor and video motion analysis method
JP6834740B2 (ja) * 2017-04-19 2021-02-24 富士通株式会社 送信プログラム、送信方法および情報処理装置
JP6785724B2 (ja) * 2017-06-16 2020-11-18 株式会社日立ビルシステム 情報処理装置、問合せ処理システムおよび問合せ処理方法
US10516982B2 (en) * 2017-10-27 2019-12-24 Hewlett Packard Enterprise Development Lp Match Bluetooth low energy (BLE) moving patterns
EP3621082B1 (en) * 2018-09-10 2026-03-18 Polar Electro Oy Synchronizing physiological measurement data streams
JP2022116767A (ja) * 2021-01-29 2022-08-10 株式会社コンセプトプロト プログラム、情報処理方法、及び端末装置

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05142364A (ja) * 1991-11-25 1993-06-08 Fujitsu Ltd 時間計測システム
JPH06318278A (ja) * 1993-05-06 1994-11-15 Nippon Telegr & Teleph Corp <Ntt> 移動体管理システム及び移動機
JP2003284061A (ja) * 2002-03-26 2003-10-03 Fujitsu Ltd 映像記録装置
KR20070100569A (ko) * 2006-04-07 2007-10-11 박종천 마라톤 및 인라인 경주용 ｉｄ 장치
JP2016158699A (ja) * 2015-02-27 2016-09-05 セイコーエプソン株式会社 着地位置評価方法、及び着地位置評価装置
JP6550612B1 (ja) 2017-11-27 2019-07-31 株式会社Ｔｒａｃ 時間計測システム
WO2019167955A1 (ja) * 2018-03-02 2019-09-06 土樋パルス株式会社 競技用計測システム

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4290317A4

Also Published As

Publication number Publication date
JP2022116767A (ja) 2022-08-10
JP7614663B2 (ja) 2025-01-16
US20250327945A1 (en) 2025-10-23
JP2024019209A (ja) 2024-02-08
EP4290317A1 (en) 2023-12-13
EP4290317A4 (en) 2025-02-12

Similar Documents

Publication Publication Date Title
US11250247B2 (en) Information processing device, information processing system, and program
US10782929B2 (en) Cadence and media content phase alignment
US12505862B2 (en) Repetitive-motion activity enhancement based upon media content selection
US10901683B2 (en) Cadence determination and media content selection
KR101392059B1 (ko) 워크아웃에서 사용되는 미디어에 대한 퍼포먼스 메타데이터
US20200237264A1 (en) Information processor, information processing method, and program
US20150375106A1 (en) Implementing user motion games
US20160065984A1 (en) Systems and methods for providing digital video with data identifying motion
JP7614663B2 (ja) プログラム、情報処理方法、及び端末装置
CN108337641B (zh) 一种通过多个无线节点计算运动状态的方法和装置
WO2024261451A1 (en) System and method for tracking checkpoint transition times for races
CN117357880B (zh) 一种基于智能设备的运动状态识别方法及系统
JP6516551B2 (ja) 測定システム
CN120523311A (zh) 信息处理方法、装置、设备、存储介质及计算机程序产品
JP2019121816A (ja) 信号同期方法

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22745934

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2022745934

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2022745934

Country of ref document: EP

Effective date: 20230829

WWP Wipo information: published in national office

Ref document number: 18263258

Country of ref document: US