CN107007997B - Image processing apparatus, measurement device, image processing system, image processing method and recording medium - Google Patents
Image processing apparatus, measurement device, image processing system, image processing method and recording medium Download PDFInfo
- Publication number
- CN107007997B CN107007997B CN201610951654.1A CN201610951654A CN107007997B CN 107007997 B CN107007997 B CN 107007997B CN 201610951654 A CN201610951654 A CN 201610951654A CN 107007997 B CN107007997 B CN 107007997B
- Authority
- CN
- China
- Prior art keywords
- visible light
- information
- measurement
- light signal
- dynamic image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B71/00—Games or sports accessories not covered in groups A63B1/00 - A63B69/00
- A63B71/06—Indicating or scoring devices for games or players, or for other sports activities
- A63B71/0619—Displays, user interfaces and indicating devices, specially adapted for sport equipment, e.g. display mounted on treadmills
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/80—Special sensors, transducers or devices therefor
- A63B2220/806—Video cameras
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/80—Special sensors, transducers or devices therefor
- A63B2220/807—Photo cameras
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/80—Special sensors, transducers or devices therefor
- A63B2220/83—Special sensors, transducers or devices therefor characterised by the position of the sensor
- A63B2220/836—Sensors arranged on the body of the user
Landscapes
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Physical Education & Sports Medicine (AREA)
- Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Arrangements For Transmission Of Measured Signals (AREA)
- Image Analysis (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
Abstract
The present invention provides image processing apparatus, measurement device, image processing system and image processing method.Without wireless transmitter implement receiving or sending for data.Image processing apparatus has acquisition unit and communication unit.Acquisition unit obtains the dynamic image information of the image comprising visible light signal and measure object, which has the measurement information of the measure object measured by the measurement device for being mounted on measure object, and is transmitted messages by measurement device.Communication unit visible light signal contained in the dynamic image information obtained as acquisition unit obtains measurement information.
Description
The application based on and advocate the (December 28 2015 applying date of first Japanese patent application the 2015-256148th
Day) and first Japanese patent application 2016-136253 (July 8 2016 applying date), merge with reference to by their content
In this.
Technical field
The present invention relates to image processing apparatus, measurement device, image processing system, image processing method and records to be situated between
Matter.
Background technique
It in order to parse the movement such as sports, dancing, and is instructed, the dynamic of measure object is shot with filming apparatus
Image.Using dynamic image, have can easily be grasped special knowledge deficiency movement, be easy to know measure object
The advantages of situation of surrounding.On the other hand, there is also be only capable of grasping the movement of the outline that can see of eyes, be difficult to carry out it is quantitative
The shortcomings that evaluation.
In addition, it is same as filming apparatus, also use wearable sensors.Being had using wearable sensors can be easy to carry out
The advantages of quantitative evaluation of acquirement, the movement of the information that eyes can't see.On the other hand, there is also need in the analysis of data
It wants special knowledge, be difficult to grasp the shortcomings that situation around measure object.
In this way, filming apparatus and wearable sensors can supply mutual weakness, can be realized by being applied in combination effectively
The parsing and guidance of the movement of fruit.Following device is described in special open 2009-106323 bulletin: adding subject's equipment
Velocity sensor, and show with digital camera shooting the dynamic image for the appearance of subject waved, by dynamic image and
It display together and is showing in the image of the peak-peak trace mark of the time waveform for the acceleration that acceleration transducer detects
Device.
In the device of special open 2009-106323 bulletin, filming apparatus and wearable sensors combination are subjected to figure
As handling and being shown.In the device of special open 2009-106323 bulletin, there are image processing apparatus must use wirelessly
Transmitter receives project as data acquired by wearable sensors.
Summary of the invention
The present invention is proposed in view of relevant project, it is therefore intended that, data can be implemented without wireless transmitter by providing
Image processing apparatus, measurement device, image processing system image processing method and the recording medium received or sent.
1 mode of image processing apparatus according to the present invention has: acquisition unit, obtain comprising visible light signal and
The dynamic image information of the image of measure object, wherein visible light signal has the measurement device by being mounted on the measure object
The measurement information of the measure object of measurement, and transmitted messages by the measurement device；And acquisition unit, it is obtained from by the acquisition unit
The visible light signal contained in the dynamic image information obtained obtains the measurement information.
In addition, 1 mode of measurement device according to the present invention has: determination part is mounted on measure object to survey
The measurement information of the fixed measure object；And illumination region, the measurement information determined with the determination part of transmitting messages
Visible light signal, the determination part measure earth magnetism to obtain the angle displacement of the measure object, and the illumination region is at the angle
The visible light signal of transmitting messages in the case that displacement is less than threshold value is spent, in the case where the angle displacement is more than the threshold value
It does not transmit messages the visible light signal.
In addition, 1 mode of image processing system according to the present invention has: measurement device is mounted on measurement pair
As the visible light signal with the measurement information determined of come the measurement information that measures the measure object, transmitting messages；And figure
As processing unit, there is obtaining for the dynamic image information for obtaining the image comprising the visible light signal and the measure object
Portion and the visible light signal contained in the dynamic image information obtained as the acquisition unit is taken to obtain the measurement
The acquisition unit of information.
In addition, 1 mode of image processing method according to the present invention comprises the following steps: obtaining and believe comprising visible light
Number and measure object image dynamic image information, the visible light signal has by the measurement that is mounted on the measure object
The measurement information for the measure object that device determines, and transmitted messages by the measurement device；From the dynamic image obtained
The visible light signal contained in information obtains the measurement information.
In addition, 1 mode of recording medium according to the present invention, is that record has for realizing computer at image
The computer-readable recording medium of the program of the image procossing executed in reason device makes the calculating execute following processing:
Acquisition processing obtains the dynamic image information of the image comprising visible light signal and measure object, described visible
Optical signal has the measurement information of the measure object measured by the measurement device for being mounted on measure object, and by the measurement
Device is transmitted messages；With
Acquirement processing, the visible light signal contained in the dynamic image information obtained obtain the survey
Determine information.
According to the present invention, receiving or sending for data can be implemented without using wireless transmitter.
Other objects and advantages of the invention will be illustrated in explanation appended below, and a portion will be from froming the perspective of
It is apparently obtained in bright, or practice acquisition through the invention.Objects and advantages of the present invention can be by hereafter special
The means pointed out and combination understand and obtain.
Detailed description of the invention
It is incorporated herein and describe embodiments of the present invention as part thereof of attached drawing, and it is given above generally
Bright and detailed description given below together, for illustrating the principle of the present invention.
Fig. 1 is the skeleton diagram for indicating the composition of image processing system involved in embodiment 1.
Fig. 2 is the block diagram for indicating the composition of image processing system involved in embodiment 1.
Fig. 3 A is the figure being illustrated to the method for the search signal of acquisition unit involved in embodiment 1.
Fig. 3 B is the figure that the method for determining signal to acquisition unit involved in embodiment 1 is illustrated.
Fig. 4 is the figure for indicating the composition of visible light signal involved in embodiment 1.
Fig. 5 is the figure for the time synchronization for illustrating that acquisition unit involved in embodiment 1 carries out.
Fig. 6 is the flow chart for indicating synchronization process involved in embodiment 1.
Fig. 7 is the figure for indicating picture shown by display unit involved in embodiment 1.
Fig. 8 A is to indicate to select the exemplary of measure object in picture shown by the display unit involved in embodiment 1
Figure.
Fig. 8 B is to indicate to show the exemplary of evaluation of estimate in picture shown by the display unit involved in embodiment 1
Figure.
Fig. 9 A is to indicate to select the exemplary of measure object in picture shown by the display unit involved in embodiment 1
Figure.
Fig. 9 B is the exemplary figure for indicating to show data in picture shown by the display unit involved in embodiment 1.
Figure 10 A is to illustrate to measure exemplary figure when starting in the image processing system involved in embodiment 2.
Figure 10 B is to illustrate that angle displacement is more than the exemplary of threshold value in the image processing system involved in embodiment 2
Figure.
Figure 11 is the skeleton diagram for indicating the composition of image processing system of variation.
Specific embodiment
(embodiment 1)
Illustrate image processing system 1 involved in embodiments of the present invention 1 below with reference to attached drawing.In addition, in figure
Same or equivalent part marks identical label.
Fig. 1 is the skeleton diagram for indicating the composition of image processing system 1 involved in embodiments of the present invention 1, and Fig. 2 is table
Show the block diagram of the composition of image processing system 1.As shown in Figure 1 and Figure 2 like that, image processing system 1 has measurement device
100, filming apparatus 200 and image processing apparatus 300.
Measurement device 100 is mounted in the wearable sensors of measure object.Measurement device 100 has control unit 101, passes
Sensor portion 102, analysis unit 103, coding unit 104, storage unit 105, illumination region 106 and communication unit 107.
Control unit 101 is to control the processing unit of measurement device 100 by executing program.Control unit 101 can include CPU
(Central Processing Unit, central processing unit).
Sensor portion 102 is the ring around motion information or Biont information or measure object to measure object
Border information is measured and obtains the sensor of data (measurement information).Sensor portion 102 can include velocity sensor, acceleration
Sensor, angular-rate sensor, heart rate sensor, blood pressure sensor, baroceptor.Sensor portion 102 is sent out as determination part
Wave function.
Analysis unit 103 parses data acquired by sensor portion 102, calculate to the motion information of measure object or
Evaluation of estimate (evaluation of estimate of motion information, biology that environmental information around Biont information or measure object is evaluated
Evaluation of estimate, the evaluation of estimate of environmental information of body information).Analysis unit 103 can include CPU.In the motion information that analysis unit 103 calculates
Evaluation of estimate can include: according to the speed of measure object, the weight of measure object and speed calculate activity (energy)；Root
The consumption calorie calculated according to activity；Characterize the small stability of speed or acceleration.
Coding unit 104 generates signal to information coding.Coding unit 104 can include CPU.Coding unit is encoded and is generated
Visible light signal 400 include commenting of being calculated of time for being determined of measurement device 100, sensor portion 102, analysis unit 103
Value, is described in detail later.
Storage unit 105 be data acquired by storage sensor portion 102, analysis unit 103 calculated evaluation of estimate, Yi Jibian
The storage device of the signal generated of code portion 104.In addition, storage unit 105 also executes memory block when handling as control unit 101
It functions.Storage unit 105 can comprising RAM (Random Access Memory, random access memory), flash memory,
Disk.
Illumination region 106 is the visible light light emitting device of the transmitter as visible light communication.106 use of illumination region is for example heavy
It is multiple with the flashing pattern lighted, extinguished that visible light carries out come the encoded visible light signal 400 of coding unit 104 of transmitting messages.It shines
Portion 106 can include LED (Light Emitting Diode, light emitting diode).In addition, illumination region 106 also can be used with not
The luminous multiple LED of same wavelength are come the visible light signal 400 for the coding of coding unit 104 of transmitting messages.By using at different wavelengths
Luminous multiple LED, can increase the information content of transmission.
Communication unit 107 is the communication device carried out with the wireless communication of image processing apparatus 300.Communication unit 107 carries out letter
Number transmission, which includes the data that determine of sensor portion 102, and capacity is big and is difficult to via the visible of illumination region 106
It is sent in optic communication.Communication unit 107 can include Bluetooth (registered trademark) module, Wireless LAN (Local Area
Network, local area network) module and the control circuit for controlling them.
Filming apparatus 200 is the filming apparatus for shooting measure object and storing dynamic image information.Dynamic image packet
Image containing visible light signal 400 and measure object, wherein visible light signal 400 has the survey determined by measurement device 100
Determine the measurement information of object and measured device 100 is transmitted messages.Filming apparatus 200 has control unit 201, shoot part 202, storage unit
203 and communication unit 204.Filming apparatus 200 can include digital camera, band video camera portable phone.
Control unit 201 controls filming apparatus 200 by executing program.Control unit 201 can include CPU.
Shoot part 202 shoots measure object and obtains dynamic image information.Shoot part 202 can include camera lens, CMOS
(Complementary Metal Oxide Semiconductor, complementary metal oxide semiconductor) imaging sensor, CCD
(Charge-Coupled Device, charge-coupled device) imaging sensor, A/D (Analog/Digital, analog/digital)
Converter.In the present specification, as an example, by every 1 second frame number of dynamic image information captured by shoot part 202
(fps) it is set as being 30fps to be illustrated.Shoot part 202 is functioned as acquisition unit.
Storage unit 203 be storage dynamic image information acquired by the shoot part 202 including data storage device.
In addition, the memory block that storage unit 203 also executes when handling as control unit 201 functions.Storage unit 203 can include RAM, sudden strain of a muscle
Fast memory, disk.
Communication unit 204 is the communication device carried out with the wireless communication of image processing apparatus 300.Communication unit 204 is counted
According to transmission, which includes to be obtained by shoot part 202 and the dynamic image information that is stored by storage unit 203.Communication unit 204
It can include Bluetooth (registered trademark) module, wireless LAN module and the control circuit for controlling them.
Image processing apparatus 300 is to keep the dynamic image information for shooting measure object and the data time being measured to synchronous
And the device shown.Image processing apparatus 300 have control unit 301, communication unit 302, acquisition unit 303, storage unit 304,
Display unit 305 and receiving portion 306.Image processing apparatus 300 can include server, personal computer, smart phone.
Control unit 301 is to control the processing unit of image processing apparatus 300 by executing program.Control unit 301 can wrap
Containing CPU.
Communication unit 302 is the communication device for carrying out the wireless communication with measurement device 100 and filming apparatus 200.Communication
Portion 302 receives signal transmitted by the communication unit 107 of measurement device 100 or the communication unit 204 of filming apparatus 200.Communication unit 302
It can include Bluetooth (registered trademark) module, wireless LAN module and the control circuit for controlling them.Communication unit 302
It is functioned as acquisition unit or receiving unit.
Acquisition unit 303 is decoded (decode) to the signal for the visible light communication being recorded in dynamic image information, takes
Obtain information.In addition, acquisition unit 303 carries out time synchronization.Acquisition unit 303 can include CPU.Acquisition unit 303 is from filming apparatus 200
Shoot and be sent to image processing apparatus 300 dynamic image information determine measurement device 100 illumination region 106 light emitting-type
Formula is decoded the pattern that shines and obtains data.In turn, acquisition unit 303 carries out time synchronization with aftermentioned method.
Acquisition unit 303 is illustrated from the method that dynamic pictorial information determines signal that illumination region 106 is transmitted messages.Fig. 3 A
And Fig. 3 B is to illustrate that acquisition unit 303 determines the figure of the method for signal.As shown in Figure 3A like that, acquisition unit 303 is from dynamic image
The image of certain 1 frame of information integrally searches for the luminous color that (scanning) is equivalent to illumination region 106.The luminous wave of illumination region 106
The long, white balance of filming apparatus 200 and sensitivity are it is known that being equivalent to the luminous color of illumination region 106 from these information
In uniquely determine.
If as shown in fig. 3b, acquisition unit 303 is determined as finding it was found that being equivalent to the luminous color of illumination region 106
The position of the color is the position of measurement device 100, is tracked to the position of determining whole measurement devices 100.Later, right
Every 1 frame of dynamic image information obtains the presence or absence of shining for the position of each measurement device 100, and the luminous pattern of acquirement is true
It is set to the signal that the illumination region 106 of measurement device 100 is transmitted messages.
As described above, in order to which every 1 frame to dynamic image information obtains the presence or absence of shining for illumination region 106, ideal shape
Under state, 1 frame of dynamic image information is corresponding with the 1bit of signal.Therefore, image processing system 1 carries out the communication of visible light communication
Speed (bps) is ideally every 1 second frame number (fps) one with dynamic image information captured by filming apparatus 200
It causes.In the example of this specification, since dynamic image information is 30fps, the communication speed of visible light communication is
30bps。
Storage unit 304 is that the dynamic image information that storage communication unit 302 receives and data and acquisition unit 303 are solved
The storage device of the data of code.In addition, the memory block that storage unit 304 also executes when handling as control unit 301 functions.It deposits
Storage portion 304 can include RAM, flash memory.
Display unit 305 is the display device that dynamic image information and data are shown to user.The display communication of display unit 305
What portion 302 received has recorded the dynamic image information of the movement of measure object.In addition, display unit 305 shows that communication unit 302 connects
It receives or the decoded data of acquisition unit 303.In turn, display unit 305 can carry out specific measurement device 100 on picture and is located at
Part be highlighted.Display unit 305 can include liquid crystal display, Blang's tube display.It is carried out about display unit 305
Picture shows aftermentioned.
Receiving portion 306 is functioned as user interface, is the receiving device for receiving the instruction of user.User is via receiving
Portion 306 inputs the instruction for selecting specific measurement device 100 on picture.Receiving portion 306 can include mouse, touch tablet, touch-control
Panel.
The visible light signal 400 for being encoded by coding unit 104 and being transmitted messages by illumination region 106 is described with reference to the attached figures.
Fig. 4 is the figure for indicating the composition of visible light signal 400.As shown in Figure 4, it is seen that optical signal 400 includes file leader
Label 401, minute 402, sensor ID 403, parsing data 404 and warning label 405.
File leader's label 401 is the signal for indicating the 32bit of beginning of visible light signal 400.File leader's label 401 is included in can
The file leader of light-exposed signal 400, acquisition unit 303 exist according to file leader's label 401 and recognize visible light signal 400 and start.
Minute 402 is to indicate that the measurement device 100 for sending visible light signal 400 starts to have measured by the time
The signal (measurement signal) of 32bit.More specifically, minute 402 indicates that measurement device 100 starts measurement and plays file leader's label
401 it is initial shine until pass through the time.
Fig. 5 is the figure for the synchronization for illustrating that acquisition unit 303 is carried out.Acquisition unit 303 is according to having recorded luminous dynamic image
Time represented by the frame and minute 402 of information is to carry out the data determined by measurement device 100 and by filming apparatus
The time synchronization of the dynamic image information of 200 shootings.
Acquisition unit 303 obtains minute 402.It in the example of hgure 5, is T by the time represented by minute 402
Second.Determine the initial luminous dynamic from the file leader's label 401 for having recorded the visible light signal 400 comprising minute 402
The shooting time (T1) of the frame of pictorial information, which rises, have been recalled represented by minute 402 by (T2) at the time of time T seconds.It should
At the time of moment is that measurement device 100 starts measurement, time synchronization is carried out by the determining frame shot at the moment.
Fig. 4 is returned to, sensor ID 403 is intrinsic 16bit in the measurement device 100 for sending visible light signal 400
Signal is the determination signal of determining measurement device 100.It is equipped in the case where measure object respectively in multiple measurement devices 100,
Acquisition unit 303 also determines the measurement device 100 for sending visible light signal 400 according to sensor ID 403.
Parsing data 404 are to indicate evaluation of estimate obtained from the analysis unit 103 of measurement device 100 parses data
The signal (evaluation signal) of 16bit.Data 404 are parsed in visible light signal 400 comprising multiple, include in the example of fig. 4
Parse data 404A, 404B, 404C this 3.
Warning label 405 is to indicate that evaluation of estimate obtained from the analysis unit 103 of measurement device 100 is parsed is more than threshold value
In the case where the signal (caution signal) of the 32bit of label that exports.Also comprising indicating multiple evaluations of estimate in warning label 405
When which of be more than threshold value information.
Visible light signal 400 is the signal of 160bit as a whole, in the communication speed of the 30bps of present embodiment,
Communication is completed in 5.3 seconds.
Fig. 6 is the flow chart for indicating the synchronization process as image procossing.Illustrate image procossing with reference to the flow chart of Fig. 6
Synchronization process performed by system 1.
The movement of measurement device 100 is illustrated.After by the instruction measurement of control unit 101, sensor portion 102 starts
The measurement (step S101) of measure object.The data of measurement are stored in storage unit 105.
After the measurement for starting data, analysis unit 103 parses data to calculate evaluation of estimate (step S102).It calculates
Evaluation of estimate is stored in storage unit 105.
After calculating evaluation of estimate, coding unit 104 is encoded and is started the generation (step of visible light signal 400 to information
S103).The visible light signal 400 of generation is stored in storage unit 105.
After generating visible light signal 400, illumination region 106 is transmitted messages 400 (step of visible light signal by being flashed
S104)。
It transmits messages after visible light signal 400, then the data that sensor portion 102 is measured to are sent at image by communication unit 107
It manages device 300 (step S105).In addition, execute step S105 position be it is any, can both be carried out before step S101,
It parallel with step S101 to step S104 can carry out.
After the completion of step S101 to step S105,100 tenth skill of measurement device.
The movement of filming apparatus 200 is illustrated.After by the instruction shooting of control unit 201, the shooting of shoot part 202 is surveyed
Determine object and obtains dynamic image information (step 8201).Also shoot that the illumination region 106 of measurement device 100 transmitted messages simultaneously can
Light-exposed signal 400.The dynamic image information preservation of acquirement is in storage unit 203.In addition, step S201 is not needed in illumination region 106
Transmit messages visible light signal 400 step S104 after carry out, can also be in midway (the i.e. step of the shooting of dynamic image information
In the execution of S201) start visible light signal 400 and transmits messages (step S104).
After obtaining dynamic image information, the dynamic image information that shoot part 202 obtains is sent at image by communication unit 204
It manages device 300 (step S202).
After the completion of step S201 to step S202,200 tenth skill of filming apparatus.
The movement of image processing apparatus 300 is illustrated.After step S105 has sent data, communication unit 302 is received
The data (step S301) of transmission.The data received are stored in storage unit 304.
After step S202 has sent dynamic image, communication unit 302 receives the dynamic image information (step S302) sent.
The dynamic image received is stored in storage unit 304.
After receiving dynamic image, acquisition unit 303 determines the visible light signal 400 for being recorded in dynamic image, is decoded
(step S303).The information preservation as obtained from being decoded is in storage unit 304.In addition, step S302 and step S303
Both it can carry out, parallel with step S301 can also carry out prior to step S301.
Receive data and dynamic image information, after being decoded to visible light signal 400 and obtain information, acquisition unit
303 carry out the time synchronization (step S304) of dynamic image information and date or evaluation of estimate.Time synchronization is according to minute 402
The frame of the dynamic image information of the signal of the minute 402 is indicated with record to carry out.Synchronous dynamic image information sum number
According to or evaluation of estimate establish correspondence be stored in storage unit 304.
After the completion of step S301 to step S304,300 tenth skill of image processing apparatus.
After 300 tenth skill of measurement device 100, filming apparatus 200 and image processing apparatus, 1 knot of image processing system
Beam synchronization process.
The picture carried out to display unit 305, which is shown, to be described in detail.
Fig. 7, Fig. 8 A, Fig. 8 B, Fig. 9 A and Fig. 9 B are the figures for indicating picture shown by display unit 305.As shown in Figure 7 that
Sample, in the case where in the visible light signal 400 that measurement device 100 is sent comprising warning label 405, display unit 305 is in picture
On carry out being highlighted for part that the measurement device 100 is located at.It is highlighted by surrounding the measurement device 100 with ellipse
The part being located at carries out.It the use of elliptical be highlighted is an example, it can be with being depicted with arrows, change the various methodologies such as lightness
It carries out.
If given threshold, so that in the case where the motion information of measure object is more than suitable range, measure object
Environmental information in the case that Biont information is more than suitable range or around measure object is more than suitable range
In the case of, evaluation of estimate is more than threshold value, then in the case where the motion information of measure object is inappropriate situation, the organism of measure object
Information is that the environmental information in inappropriate situation or around measure object is to be highlighted survey in inappropriate situation
Determine the measurement device 100 that object is equipped.In this way, the measurement pair to have in mind from multiple measure objects can be expressed to user
As can be carried out efficient guidance.
As shown in Figure 8A and 8B like that, display unit 305 is overlapped in picture or abreast shows simultaneously measurement device
The dynamic image information that evaluation of estimate contained in the 100 parsing data 404 sent and filming apparatus 200 are sent.As shown in Figure 8 A
Like that, if user selects measurement device 100 on picture via receiving portion 306 or equips the measurement pair of the measurement device 100
As the minute 402 that acquisition unit 303 is sent from the measurement device 100 obtains elapsed time information, and analytically data 404 take
Obtain evaluation of estimate.Control unit 301 controls display unit 305 on the basis of synchronizing processing, comes as shown in Figure 8 B like that in picture
Upper overlapping shows evaluation of estimate and dynamic image information simultaneously side by side.
For example, the evaluation of estimate of motion information is the finger for being easier to the effect for making user understand movement compared to data itself
Mark can carry out efficient guidance to user by calculating evaluation of estimate.In addition, parsing data 404 are due to can be from the survey on picture
Determine the acquirement of device 100, therefore the foundation of measurement device 100 and evaluation of estimate is corresponding easy.In addition, the display of evaluation of estimate can only pass through
Visible light communication carries out, and due to not needing the wireless communication via communication unit 107 and communication unit 302, data management becomes
It is easy.
As shown in Figure 9A and 9B like that, display unit 305 is overlapped in picture or abreast shows simultaneously measurement device 100
The dynamic image that the data and filming apparatus 200 sent via communication unit 107 are sent via communication unit 204.As shown in Figure 9 A that
Sample, if user has selected measurement device 100 on picture via receiving portion 306 or has equipped the measure object of the measurement device 100,
The minute 402 that then acquisition unit 303 is sent from the measurement device 100 obtains elapsed time information, obtains from sensor ID 403
Determine the information of the measurement device 100.Control unit 301 obtains the measurement device 100 from storage unit 304 and sends out via communication unit 107
The data sent, on the basis of having carried out synchronization process control display unit 305, as shown in Figure 9 B like that on picture overlapping or simultaneously
Row ground shows data and dynamic image information simultaneously.At the time of at the time of in the dynamic image information of display in corresponding data
Expressed with line L.
By carrying out the wireless communication via communication unit 107 and communication unit 302, it can be carried out and be utilized under visible light communication
The more detailed evaluation of movement that receive or send the data of difficult large capacity, measure object.
As described above, related image processing system 1, image processing apparatus 300 can pass through according to the present embodiment
Dynamic image information captured by filming apparatus 200 is received to obtain the measurement letter of the data determined based on measurement device 100
It ceases (motion information, Biont information or environmental information).Since measurement information can be obtained by receiving dynamic image information, because
This, which does not have to wireless transmitter, can implement to implement receiving or sending for data.
According to image processing system 1, the data and filming apparatus that measurement device 100 can be determined as unit of 1 frame
Dynamic image information captured by 200 carries out time synchronization.By carrying out time synchronization as unit of 1 frame, user can be made correct
Grasp the movement of measure object and being associated with for data (measurement information) in ground.As showing for the module that can be carried out correct time synchronization
Example have GPS (Global Positioning System, global positioning system), but this not only have device enlargement and at
The project of this increase, there are also GPS cannot obtain current time indoors, the project that not can be carried out time synchronization.According to image
Processing system 1 also can be carried out correct time synchronization indoors.
It, can be by dynamic image and data or evaluation of estimate on the basis of having carried out time synchronization according to image processing system 1
Overlapping is abreast simultaneously displayed on picture.It is overlapped by dynamic image information and data or evaluation of estimate or is shown side by side simultaneously
Show, the survey that user can be made while seeing the movement of the body of the measure object based on dynamic image information and being obtained from measure object
Fixed number evidence can easily allow user to be measured the evaluation and guidance of the movement of object.
It, can be by visible light signal 400 using multiple measurement device 100 according to image processing system 1
Contained sensor ID 403 determines each measurement device 100.Even if equipping measurement device 100 respectively in for example more people as a result,
In the case where being moved, it also can readily determine that data are obtained from which measure object, can be easy to carry out more people's
The guidance of movement.
(embodiment 2)
Illustrate image processing system 1 involved in embodiments of the present invention 2 below with reference to attached drawing.In addition, in figure
Same or equivalent part marks identical label.
The sensor portion 102 of measurement device 100 includes geomagnetic sensor.Sensor portion 102 measures earth magnetism, the data of measurement
It is stored in storage unit 105.
Figure 10 A and Figure 10 B are the figures for illustrating the movement of image processing system 1 involved in embodiment 2.Such as Figure 10 A
Shown such, after sensor portion 102 starts measurement, earth magnetism when analysis unit 103 starts the earth magnetism and measurement that determine is carried out
Parsing, calculates the angle displacement of measure object.Control unit 101 judges whether the angle displacement calculated is more than threshold value.In this implementation
In mode, the threshold value of angle displacement is ± 60 degree.
In the case where being judged as that the angle displacement of measure object is less than threshold value, what continuation illumination region 106 was carried out can
The transmission of light-exposed signal 400.In the case where being judged as the measure object X such as Figure 10 B more than threshold value, control unit 101 is controlled
Illumination region 106 processed stops the transmission of visible light signal 400.In addition, after the case where being judged as is more than threshold value, once again sentencing
In the case where breaking to be less than threshold value, control unit 101 controls illumination region 106 to make the transmission weight of the visible light signal 400 stopped
It opens.
If the angle displacement of measurement device 100 becomes larger, the luminous of illumination region 106 can be become difficult to by filming apparatus 200
It takes.In this case, the luminous of illumination region 106 becomes meaningless, leads to the waste of energy and the shortening in service life.Separately
Outside, if the visible light signal 400 transmitted messages from measurement device 100 is not taken, device 200 is taken, and data can lose.
Image processing system 1 involved in present embodiment is more than threshold value by the angle displacement in measurement device 100
In the case of stop transmitting messages, can prevent it is meaningless shine, the waste of energy and the shortening in service life can be prevented.In addition, can prevent visible
The device 200 that is not taken of optical signal 400 takes and leads to loss of data.
(variation)
Several embodiments of the invention is explained above, but embodiment 1 and embodiment 2 are an examples, the present invention
The scope of application be not limited to this.That is, embodiments of the present invention can have various applications, all embodiments are included in this
In the range of invention.
Image processing system 1 has measurement device 100, filming apparatus 200 and image processing apparatus 300, but is not limited to
This.Figure 11 is the skeleton diagram for indicating the composition of image processing system of variation.Can also be as shown in Figure 11, image procossing
System 1 does not have filming apparatus 200, and image processing apparatus 300 has shoot part 202, and image processing apparatus 300 has shooting dress
Set 200 function.Do not have image processing apparatus 300 alternatively, it is also possible to image processing system 1, filming apparatus 200 has image
The function of processing unit 300.
Illumination region 106 is set as being visible light light emitting device, and but it is not limited to this.As long as the electromagnetism wave energy generated is taken
The composition that device 200 takes, such as can be infrared generator.Similarly, explanation is visible in this specification
Optic communication or visible light signal, but be not limited to using visible light.
Communication unit 107 is set as being the communication device carried out wireless communication, and but it is not limited to this.For example, it can be have
USB (Universal Serial Bus, universal serial bus) module, the communication device for carrying out wire communication.Alternatively, it is also possible to
The storage device that can be removed is saved the data in, reads in other equipment to exchange data.About communication unit 204, communication unit 302
Similarly.In this case, dynamic image information is obtained from the storage device that can be removed.
In addition, measurement device 100 may not possess communication unit 107.Even if not having communication unit 107, can also pass through through
Measurement information is sent by illumination region 106, the shoot part 202 of filming apparatus 200 shoots it, to show dynamic image information
With measurement information.
In visible light communication, 1 frame of dynamic image information is corresponding with the 1bit of signal, and but it is not limited to this.For example,
Scintillation time can be set, 2 frames of dynamic image information is made to become the 1bit of signal.It is set if so, although then communicating
Speed halves, but flashing can be prevented to be not recorded in the frame of dynamic image information and lose.
Visible light signal 400 includes file leader's label 401, minute 402, sensor ID 403, parsing data 404 and police
Label 405 is accused, but it is not limited to this.Such as visible light signal 400 can also only include file leader's label 401 and minute
402.Alternatively, it is also possible to be free of minute 402, in sensor ID 403, parsing data 404, warning label 405
At least any one.As long as at least 1 time in the visible light signal 400 repeatedly sent including minute 402, at image
Reason system 1 just can be carried out the time synchronization of dynamic image information and determination data.
Evaluation of estimate obtained from the analysis unit 103 of the parsing expression measurement device 100 of data 404 parses data, but
It is not limited to this.For example, parsing data 404 also may include the data sheet that the sensor portion 102 of measurement device 100 determines
Body, as measurement information.
Visible light signal 400 can also include to terminate label at the end of signal.Terminating label is to indicate visible light signal
The signal of the 32bit of 400 end.Acquisition unit 303 is terminated by terminating label in the presence of to recognize visible light signal 400.
Image processing system 1 carries out the synchronization process as image procossing, and but it is not limited to this.For example, it can be can
Light-exposed signal 400 is free of minute 402, executes the image procossing without time synchronization.As long as in visible light signal 400
Comprising parsing data 404, dynamic image information can be received to be measured information and move by shooting visible light signal 400
The display of state pictorial information.
Feelings in the image processing system 1 involved in embodiment 2, in visible light signal 400 comprising terminating to mark
Under condition, illumination region 106 reopens the transmission of the visible light signal 400 stopped from file leader's label 401.By from 401 weight of file leader's label
Exploitation is sent, and acquisition unit 303 can be made certainly to recognize visible light signal 400.Even if acquisition unit 303 does not receive end label,
It is judged as that transmission is interrupted in the case where not receiving visible light signal 400 more than given time (such as 1 second), prepares visible light
Signal 400 is sent again.
In addition, can be mentioned as the image processing system having in advance for realizing the composition of function according to the present invention
For needless to say, moreover it is possible to so that existing information processing unit etc. is used as image procossing according to the present invention by the utilization of program
System functions.That is, can be by with for realizing the image processing system 1 illustrated in embodiment 1 and embodiment 2
Each function constitute program so that controlling CPU of existing information processing unit etc. etc. can execute, as involved by the present invention
And image processing system function.In addition, image processing method according to the present invention can use image processing system real
It applies.
In addition, the application method of such program is arbitrary.Program can be stored in such as floppy disk, CD (Compact
Disc, CD) computers such as-ROM, DVD (Digital Versatile Disc, digital versatile disc)-ROM, storage card can
It is used in the storage media of reading.In turn, moreover it is possible to program be added to carrier wave, equal communication mediums use via internet.Such as
Bulletin board (BBS:Bulletin Board System) on a communication network announces release process.Also, it is also configured to
By starting the program, held in the same manner as other applications under the control of OS (Operating System, operating system)
Row, thus, it is possible to execute above-mentioned processing.
The preferred embodiments of the present invention is explained above, but the present invention is not limited to relevant specific embodiment party
Formula, in the present invention comprising invention and its equivalent range documented by claims.
Claims (17)
1. a kind of image processing apparatus, has:
Acquisition unit obtains the dynamic image information of the image comprising visible light signal and measure object, the visible light signal
The measurement information of the measure object with the measurement device measurement by being mounted on the measure object, and filled by the measurement
It sets and transmits messages；With
Acquisition unit, the visible light signal contained in the dynamic image information obtained as the acquisition unit obtain institute
Measurement information is stated,
The acquisition unit obtains the institute of the minute of the measurement comprising also carrying out the measurement information with the measurement device
The dynamic image information of visible light signal is stated,
Acquisition unit visible light signal contained in the dynamic image information obtained as the acquisition unit obtains
The minute, based on the minute of acquirement come by the measurement information and the dynamic image information in time
It is synchronous.
2. image processing apparatus according to claim 1, wherein
The acquisition unit is the shoot part for shooting the dynamic image information.
3. image processing apparatus according to claim 1, wherein
The acquisition unit is that the reception of the dynamic image information is received from the filming apparatus for having taken the dynamic image information
Portion.
4. image processing apparatus according to claim 1, wherein
Described image processing unit is also equipped with:
Display unit shows institute acquired by the acquisition unit dynamic image information obtained and the acquisition unit simultaneously
State measurement information.
5. image processing apparatus according to claim 1, wherein
The acquisition unit is obtained comprising also having the described of the visible light signal for the identification information for identifying the measurement device
Dynamic image information,
Acquisition unit visible light signal contained in the dynamic image information obtained as the acquisition unit obtains
The identification information.
6. image processing apparatus according to claim 1, wherein
The acquisition unit obtains the described of the evaluation of estimate calculated comprising also parsing the measurement information with the measurement device
The dynamic image information of visible light signal.
7. image processing apparatus according to claim 4, wherein
The acquisition unit is obtained comprising also having the evaluation of estimate for indicating that the measurement device parses the measurement information and calculates super
The dynamic image information of the visible light signal of the warning label of threshold value is crossed,
Acquisition unit visible light signal contained in the dynamic image information obtained as the acquisition unit obtains
The warning label,
The display unit is highlighted the dynamic image information in the case where the acquisition unit achieves the warning label
On the part comprising the measurement device.
8. image processing apparatus according to claim 4, wherein
Described image processing unit is also equipped with:
Receiving portion receives the instruction for selecting the specific measurement device in multiple measurement devices,
The display unit shows the measurement information for being mounted with the measure object of the selected measurement device simultaneously
With the dynamic image information.
9. image processing apparatus according to claim 1, wherein
The measurement information includes the motion information that the measurement device is obtained from the measure object moved.
10. image processing apparatus according to claim 1, wherein
The measurement information includes the Biont information that the measurement device is obtained from the measure object.
11. image processing apparatus according to claim 1, wherein
The measurement information includes the environmental information that the measurement device is obtained from the environment around the measure object.
12. image processing apparatus according to claim 1, wherein
The visible light signal includes the flashing pattern of visible light.
13. image processing apparatus according to claim 1, wherein
The visible light signal includes the different multiple visible lights of wavelength.
14. a kind of measurement device, has:
Determination part is mounted on measure object and measures the measurement information of the measure object；With
Illumination region, the visible light signal for the measurement information determined with the determination part of transmitting messages,
Determination part measurement earth magnetism obtains the angle displacement of the measure object,
The illumination region is transmitted messages the visible light signal in the case where the angle displacement is less than threshold value, in the angle position
It moves more than the visible light signal of not transmitting messages in the case where the threshold value.
15. a kind of image processing system, has:
Measurement device is mounted on measure object to measure the measurement information of the measure object, transmits messages with the institute determined
State the visible light signal of measurement information；With
Image processing apparatus has the dynamic image letter for obtaining the image comprising the visible light signal and the measure object
The acquisition unit of breath and the visible light signal contained in the dynamic image information obtained as the acquisition unit obtain institute
The acquisition unit of measurement information is stated,
The acquisition unit obtains the institute of the minute of the measurement comprising also carrying out the measurement information with the measurement device
The dynamic image information of visible light signal is stated,
Acquisition unit visible light signal contained in the dynamic image information obtained as the acquisition unit obtains
The minute, based on the minute of acquirement come by the measurement information and the dynamic image information in time
It is synchronous.
16. a kind of image processing method, comprises the following steps:
The dynamic image information of the image comprising visible light signal and measure object is obtained, the visible light signal has by installing
In the measurement information for the measure object that the measurement device of the measure object measures, and transmitted messages by the measurement device；
The visible light signal contained in the dynamic image information obtained obtains the measurement information,
Obtain the visible light letter of the minute of the measurement comprising also carrying out the measurement information with the measurement device
Number the dynamic image information,
The visible light signal contained in the dynamic image information obtained obtains the minute, based on acquirement
The minute is synchronous in time by the measurement information and the dynamic image information.
17. a kind of recording medium is that record has the image procossing executed in image processing apparatus for realizing computer
The computer-readable recording medium of program makes the calculating execute following processing:
Acquisition processing obtains the dynamic image information of the image comprising visible light signal and measure object, the visible light letter
Number there is the measurement information of the measure object measured by the measurement device for being mounted on measure object, and by the measurement device
It transmits messages；With
Acquirement processing, the visible light signal contained in the dynamic image information obtained obtain the measurement and believe
Breath,
The minute for obtaining measurement of the processing acquisition comprising also carrying out the measurement information with the measurement device
The dynamic image information of the visible light signal,
The acquirement processing handles the visible light signal contained in the dynamic image information obtained from as the acquisition
Obtain the minute, based on the minute of acquirement come by the measurement information and the dynamic image information when
Between upper synchronize.
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2015256148 | 2015-12-28 | ||
| JP2015-256148 | 2015-12-28 | ||
| JP2016-136253 | 2016-07-08 | ||
| JP2016136253A JP6888250B2 (en) | 2015-12-28 | 2016-07-08 | Image processing equipment, measuring equipment, image processing system, image processing method and program |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107007997A CN107007997A (en) | 2017-08-04 |
| CN107007997B true CN107007997B (en) | 2019-10-11 |
Family
ID=59272495
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610951654.1A Active CN107007997B (en) | 2015-12-28 | 2016-11-02 | Image processing apparatus, measurement device, image processing system, image processing method and recording medium |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP6888250B2 (en) |
| CN (1) | CN107007997B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6690622B2 (en) * | 2017-09-26 | 2020-04-28 | カシオ計算機株式会社 | Information processing apparatus, information processing system, information processing method, and program |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103099602A (en) * | 2011-11-10 | 2013-05-15 | 深圳泰山在线科技有限公司 | Constitution detecting method and constitution detecting system based on optical identification |
| CN204582502U (en) * | 2015-03-02 | 2015-08-26 | 欧文特斯（天津）科技发展有限公司 | A kind of precisely standing long jump tester |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3374175B2 (en) * | 2000-01-27 | 2003-02-04 | 名古屋大学長 | Data transmission device with data transmission function for position display |
| CA2671429A1 (en) * | 2005-11-29 | 2007-06-07 | Pure Motion Inc. | Position determining apparatus and related method |
| JP2007265032A (en) * | 2006-03-28 | 2007-10-11 | Fujifilm Corp | Information display device, information display system and information display method |
| JP2009106323A (en) * | 2007-10-26 | 2009-05-21 | Yamaha Corp | Motion form evaluation device and motion form evaluation program |
| JP2009050721A (en) * | 2008-11-25 | 2009-03-12 | Hitachi Metals Ltd | Swing movement assessment method, swing movement assessment apparatus, swing movement assessment system, and swing movement assessment program |
| US20100273130A1 (en) * | 2009-04-22 | 2010-10-28 | Integrated Digital Technologies, Inc. | Shooting training systems using an embedded photo sensing panel |
| JP5504818B2 (en) * | 2009-10-23 | 2014-05-28 | ソニー株式会社 | Motion-related computing device, motion-related computing method, program, motion-related playback system |
| KR101850225B1 (en) * | 2013-10-14 | 2018-04-18 | 나이키 이노베이트 씨.브이. | Fitness training system for merging energy expenditure calculations from multiple devices |
-
2016
- 2016-07-08 JP JP2016136253A patent/JP6888250B2/en active Active
- 2016-11-02 CN CN201610951654.1A patent/CN107007997B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103099602A (en) * | 2011-11-10 | 2013-05-15 | 深圳泰山在线科技有限公司 | Constitution detecting method and constitution detecting system based on optical identification |
| CN204582502U (en) * | 2015-03-02 | 2015-08-26 | 欧文特斯（天津）科技发展有限公司 | A kind of precisely standing long jump tester |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2017120615A (en) | 2017-07-06 |
| CN107007997A (en) | 2017-08-04 |
| JP6888250B2 (en) | 2021-06-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9936084B2 (en) | Wrist computer wireless communication and event detection | |
| US9927877B2 (en) | Data manipulation on electronic device and remote terminal | |
| US7782358B2 (en) | Measuring human movements—method and apparatus | |
| US20160196667A1 (en) | System and Method for Tracking | |
| TWI590804B (en) | Information processing apparatus, information processing method, program, and measuring system | |
| US20130194421A1 (en) | Information processing apparatus, information processing method, and recording medium, for displaying information of object | |
| US20180063421A1 (en) | Wearable camera, wearable camera system, and recording control method | |
| US9195885B2 (en) | Positional locating system and method | |
| WO2015123771A1 (en) | Gesture tracking and control in augmented and virtual reality | |
| JP2015119833A (en) | Exercise support system, exercise support method, and exercise support program | |
| CN104338311A (en) | Sensor unit and motion detection device | |
| US11460912B2 (en) | System and method related to data fusing | |
| CN103099602A (en) | Constitution detecting method and constitution detecting system based on optical identification | |
| JP2015116288A (en) | Exercise information display system, exercise information display method, and exercise information display program | |
| JP2007229197A (en) | Mobile communication terminal, movement assessment system, method, program, recording media | |
| CN110370273A (en) | A kind of Obstacle Avoidance, device and system | |
| CN107007997B (en) | Image processing apparatus, measurement device, image processing system, image processing method and recording medium | |
| JP6094476B2 (en) | Imaging system, control method therefor, and control program therefor | |
| EP4040268A1 (en) | Object sharing method and apparatus | |
| US10389444B2 (en) | Image processing apparatus, image processing system, image processing method, and recording medium | |
| JP2016213548A (en) | Imaging system, imaging method, detector and imaging device | |
| FR3072579B1 (en) | METHOD FOR QUANTIFYING SPORTS ACTIVITY | |
| EP4016252A1 (en) | System and method related to motion tracking | |
| EP4016253A1 (en) | System and method related to data fusing | |
| EP3832435A1 (en) | Motion tracking system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |