US20150111657A1 - Movement analysis method, movement analysis apparatus, and movement analysis program - Google Patents

Movement analysis method, movement analysis apparatus, and movement analysis program Download PDF

Info

Publication number
US20150111657A1
US20150111657A1 US14/510,685 US201414510685A US2015111657A1 US 20150111657 A1 US20150111657 A1 US 20150111657A1 US 201414510685 A US201414510685 A US 201414510685A US 2015111657 A1 US2015111657 A1 US 2015111657A1
Authority
US
United States
Prior art keywords
sporting equipment
checkpoint
posture
movement
movement analysis
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/510,685
Other languages
English (en)
Inventor
Kazuhiro Shibuya
Kazuo Nomura
Kenya Kodaira
Masafumi Sato
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Seiko Epson Corp
Original Assignee
Seiko Epson Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Seiko Epson Corp filed Critical Seiko Epson Corp
Assigned to SEIKO EPSON CORPORATION reassignment SEIKO EPSON CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KODAIRA, KENYA, NOMURA, KAZUO, SATO, MASAFUMI, SHIBUYA, KAZUHIRO
Assigned to SEIKO EPSON CORPORATION reassignment SEIKO EPSON CORPORATION CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S ADDRESS PREVIOUSLY RECORDED AT REEL: 033923 FRAME: 0955. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Assignors: KODAIRA, KENYA, NOMURA, KAZUO, SATO, MASAFUMI, SHIBUYA, KAZUHIRO
Publication of US20150111657A1 publication Critical patent/US20150111657A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B24/00Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
    • A63B24/0003Analysing the course of a movement or motion sequences during an exercise or trainings sequence, e.g. swing for golf or tennis
    • A63B24/0006Computerised comparison for qualitative assessment of motion sequences or the course of a movement
    • GPHYSICS
    • G09EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09BEDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00Teaching not covered by other main groups of this subclass
    • G09B19/003Repetitive work cycles; Sequence of movements
    • G09B19/0038Sports
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B69/00Training appliances or apparatus for special sports
    • A63B69/36Training appliances or apparatus for special sports for golf
    • A63B69/3623Training appliances or apparatus for special sports for golf for driving
    • A63B69/3632Clubs or attachments on clubs, e.g. for measuring, aligning
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/20Movements or behaviour, e.g. gesture recognition
    • G06V40/23Recognition of whole body movements, e.g. for sport training
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00Measuring of physical parameters relating to sporting activity
    • A63B2220/80Special sensors, transducers or devices therefor
    • A63B2220/803Motion sensors
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63BAPPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
    • A63B2220/00Measuring of physical parameters relating to sporting activity
    • A63B2220/80Special sensors, transducers or devices therefor
    • A63B2220/83Special sensors, transducers or devices therefor characterised by the position of the sensor
    • A63B2220/833Sensors arranged on the exercise apparatus or sports implement

Definitions

  • the present invention relates to a movement analysis method, a movement analysis apparatus, and a movement analysis program.
  • a movement analysis apparatus is used for analysis of a movement called a swing motion.
  • An inertial sensor is mounted on sporting equipment or an examinee who operates the sporting equipment.
  • the swing motion is visually reproduced based on output of the inertial sensor.
  • a golf swing analysis apparatus which is disclosed in JP-A-2008-73210 may be shown.
  • the direction of a struck ball is greatly affected by the direction of a face of a club head at an impact moment.
  • the alignment is delayed and the face is not properly aligned at the impact due to twisting of the wrist, thereby negatively affecting the result of the swing.
  • minute tracing it is necessary to use a plurality of high-precision cameras, thereby resulting in a large-scale measurement apparatus.
  • measurement can be performed only indoor in optical motion capture, in which a camera or the like is used, and thus it is difficult to use the measurement apparatus in a general outdoor driving range.
  • An advantage of some aspects of the invention is to provide a movement analysis method, a movement analysis apparatus, and a movement analysis program capable of easily displaying a state of a golf club or an arm at a checkpoint visually.
  • An aspect of the invention provides a movement analysis method including: acquiring and calculating information about movement path of sporting equipment which is being swung and information about a posture of an interest part of the sporting equipment; and outputting and displaying a state of the posture of the interest part of the sporting equipment at a designated checkpoint on the movement path of the sporting equipment.
  • the checkpoint of the sporting equipment on which a swing motion is performed is designated.
  • the movement path and the posture of the interest part of the sporting equipment are calculated using data which is output from an inertial sensor when the sporting equipment is being swung. Therefore, a position of the checkpoint on the acquired movement path of the sporting equipment may be understood.
  • the posture of the interest part of the sporting equipment at the checkpoint, which is designated on the movement path of the sporting equipment, is displayed. When the posture is used for swing evaluation, it is possible to support the improvement of the movement of an examinee.
  • the checkpoint may be designated using at least one of positional information and time information of the sporting equipment which is being swung.
  • the checkpoint is designated on the movement path of the sporting equipment, it is possible to designate the checkpoint using the positional information (for example, the same height as the eyes of the examinee or the like) or the time information (for example, time that elapses from the start of backswing or downswing or the like) of the sporting equipment.
  • the inertial sensor sampling is performed per unit time and acceleration, angular velocity, and the like are detected.
  • Detected data is managed per unit time (for example, per time or per a sampling counter number).
  • the movement analysis method may further include: acquiring information about a rotation angle which varies around a long axis of a shaft section of the sporting equipment which is being swung; and associating interest part of the sporting equipment in the movement path with information about the rotation angle.
  • the rotation angle, which is generated around the axis of the shaft section of the sporting equipment at the checkpoint is acquired by performing integration on the angular velocity, which is acquired using the inertial sensor, within a range from an initial rotation angle position to the checkpoint.
  • the rotation angle, which is generated around the axis of the shaft section of the sporting equipment is an important factor which is associated with the behavior of the wrist and which indicates the direction of a hitting surface (a direction of a face surface in a case of a golf club and a direction of a string surface in a case of a tennis racket) in a case of a hitting equipment.
  • the interest part of the sporting equipment may be the hitting surface.
  • the hitting equipment such as the golf club
  • the change during the swing in the direction of the hitting surface, such as the face surface of the club head is the matter of concern.
  • the swing is too rapid to recognize.
  • the posture of the hitting surface at the checkpoint is displayed, it is possible to effectively check the swing.
  • the movement analysis method according to the aspect of the invention may further include displaying an object image which shows the interest part in association with the movement path of the sporting equipment.
  • the movement analysis method may further include displaying a mark which changes direction according to a change in the state of the posture of the interest part of the sporting equipment.
  • the mark When the mark is displayed, it is possible to display, for example, a wrist twisting state or the change in the angle of the hitting surface as the posture of the interest part of the sporting equipment such that the examinee easily understands the posture.
  • the movement analysis method may further include displaying the state of the posture of the interest part in a direction in which an examinee gazes at the interest part of the sporting equipment.
  • the direction in which the examinee faces the checkpoint from the view point is set to the gaze direction, it is possible to display the posture of the interest part which is viewed from the eyes of the examinee.
  • the movement path may be calculated based on output of an inertial sensor which is mounted on at least one of the sporting equipment and an examinee.
  • the rotation angle may be calculated based on output of an inertial sensor which is mounted on the sporting equipment.
  • Another aspect of the invention provides a movement analysis apparatus including: a designation unit that designates a checkpoint of sporting equipment on which a swing motion is being performed; a first calculation unit that calculates a movement path of the sporting equipment using an output of an inertial sensor; a second calculation unit that calculates a state of a posture of an interest part of the sporting equipment at the checkpoint in the movement path of the sporting equipment; and a display unit that outputs and displays the posture of the interest part of the sporting equipment at the checkpoint.
  • Still another aspect of the invention provides a movement analysis program causing a computer to perform: acquiring information about movement path of sporting equipment, which is being swung, and information about calculation of a posture of an interest part of the sporting equipment using an output of an inertial sensor; designating a checkpoint in the movement path of the sporting equipment; and outputting and displaying a state of the posture of the interest part of the sporting equipment at the designated checkpoint.
  • the program may be stored in the movement analysis apparatus from the beginning, may be stored in a storage medium and then installed in the movement analysis apparatus, and may be downloaded in a communication terminal of the movement analysis apparatus from a server through a network.
  • FIG. 1 is a schematic diagram schematically illustrating the configuration of a golf swing analysis apparatus according to an embodiment of the invention.
  • FIG. 2 is a schematic diagram schematically illustrating the relationship between a movement analysis model, and a golfer and a golf club.
  • FIG. 3 is a block diagram schematically illustrating the configuration of an arithmetic processing circuit according to the embodiment.
  • FIG. 4 is a diagram illustrating an example of a checkpoint.
  • FIG. 5 is a diagram illustrating an output of an inertial sensor which is managed for each unit time.
  • FIG. 6 is a diagram illustrating a front image on which a normal view coordinate conversion is performed.
  • FIG. 7 is a diagram illustrating a side image on which the normal view coordinate conversion is performed.
  • FIG. 8 is a diagram illustrating an example of display for an image which visually expresses the movement path of a golf club and the posture of the golf club at the checkpoint.
  • FIG. 9 is a diagram illustrating another example of display in which view coordinates are different from those in FIG. 8 .
  • FIG. 10 is a diagram illustrating further another example of display in which view coordinates are different from those in FIGS. 8 and 9 .
  • FIG. 1 schematically illustrates the configuration of a golf swing analysis apparatus (movement analysis apparatus) 11 according to an embodiment of the invention.
  • the golf swing analysis apparatus 11 includes, for example, an inertial sensor 12 .
  • the inertial sensor 12 is provided with, for example, an acceleration sensor and a gyro sensor.
  • the acceleration sensor is capable of detecting respective accelerations in triaxial directions which are perpendicular to each other.
  • the gyro sensor is capable of individually detecting respective angular velocities around the respective axes of the three axes which are perpendicular to each other.
  • the inertial sensor 12 outputs a detection signal. In the detection signal, an acceleration and an angular velocity are specified for each axis.
  • the acceleration sensor and the gyro sensor relatively accurately detect information about the acceleration and the angular velocity.
  • the inertial sensor 12 is attached to a golf club (sporting equipment) 13 .
  • the golf club 13 includes a shaft 13 a and a grip 13 b .
  • the grip 13 b is gripped by the hands.
  • the grip 13 b is formed on the same axis as the shaft 13 a .
  • the tip end of the shaft 13 a is coupled with a club head 13 c .
  • the inertial sensor 12 is attached to the shaft 13 a or the grip 13 b of the golf club 13 .
  • the shaft 13 a indicates a bar-shaped portion which includes the grip 13 b and reaches the club head 13 c .
  • the inertial sensor 12 may be relatively unmovably fixed to the golf club 13 .
  • one detection axis of the inertial sensor 12 is aligned on the axis of the shaft 13 a .
  • One more detection axis of the inertial sensor 12 is aligned in a direction of the face (hitting surface) of the club head 13 c.
  • the golf swing analysis apparatus 11 includes an arithmetic processing circuit 14 .
  • the inertial sensor 12 is connected to the arithmetic processing circuit 14 .
  • a predetermined interface circuit 15 is connected to the arithmetic processing circuit 14 .
  • the interface circuit 15 may be connected to the inertial sensor 12 in a wired or wireless manner.
  • a detection signal is supplied to the arithmetic processing circuit 14 from the inertial sensor 12 .
  • a storage device 16 is connected to the arithmetic processing circuit 14 .
  • a golf swing analysis software program (movement analysis program) 17 and the relative data thereof can be stored in the storage device 16 .
  • the arithmetic processing circuit 14 executes the golf swing analysis software program 17 and implements a golf swing analysis method.
  • a Dynamic Random Access Memory (DRAM), a high-capacity storage device unit, a nonvolatile memory, or the like can be included in the storage device 16 .
  • the golf swing analysis software program 17 is temporally held in the DRAM when the golf swing analysis method is performed.
  • the golf swing analysis software program 17 and data are held in the high capacity storage device unit such as a Hard Disk Drive (HDD).
  • a relatively small capacity program, such as a Basic Input/Output System (BIOS), or data is stored in the nonvolatile memory.
  • BIOS Basic Input/Output System
  • An image processing circuit 18 is connected to the arithmetic processing circuit 14 .
  • the arithmetic processing circuit 14 transmits predetermined image data to the image processing circuit 18 .
  • a display device (display unit) 19 is connected to the image processing circuit 18 .
  • the image processing circuit 18 is provided with a view coordinate conversion unit 18 A. As will be described in detail, the view coordinate conversion unit 18 A performs conversion on the viewpoint and gaze direction of an image which is displayed on the display device 19 .
  • a predetermined interface circuit (not shown in the drawing) is connected to the image processing circuit 18 .
  • the image processing circuit 18 transmits an image signal to the display device 19 in accordance with input image data. An image which is specified based on the image signal is displayed on the screen of the display device 19 .
  • a liquid crystal display or another flat panel display is used for the display device 19 .
  • a designation unit 20 is connected to the arithmetic processing circuit 14 .
  • the designation unit 20 designates the checkpoint of the golf club 13 , on which the swing motion is performed, for the arithmetic processing circuit 14 .
  • the arithmetic processing circuit 14 calculates the movement path of the interest part of the golf club 13 , and calculates a rotation angle which is generated around the axis of the shaft 13 a at the checkpoint based on the output of the inertial sensor 12 up to the checkpoint on the movement path.
  • the arithmetic processing circuit 14 , the storage device 16 , the image processing circuit 18 , and the designation unit 20 are provided as, for example, a computer apparatus.
  • An input device 21 is connected to the arithmetic processing circuit 14 and the designation unit 20 .
  • the input device 21 includes at least alphabet keys and numeric keys. Character information or numerical value information is input to the arithmetic processing circuit 14 from the input device 21 .
  • the input device 21 may include, for example, a keyboard.
  • the combination of the computer apparatus and the keyboard may be replaced by, for example, a smart phone, a mobile phone terminal, a tablet Personal Computer (PC), or the like.
  • a checkpoint which is designated by the designation unit 20 may be set based on external input data (for example, data of the height of the examinee) which is input by the input device 21 .
  • the view coordinate conversion unit 18 A may be connected to the designation unit 20 . If so, the view point can be set based on the data of the height of the examinee and a direction which faces the checkpoint from the viewpoint can be set to the gaze direction.
  • the arithmetic processing circuit 14 defines a virtual space.
  • the virtual space is formed in a 3-dimensional space.
  • the 3-dimensional space specifies an actual space.
  • the 3-dimensional space includes an absolute reference coordinate system (world coordinate system) ⁇ xyz.
  • a 3-dimensional movement analysis model 26 is constructed along the absolute reference coordinate system ⁇ xyz.
  • a bar 27 of the 3-dimensional movement analysis model 26 is point restrained by a fulcrum 28 (coordinate x).
  • the bar 27 3-dimensionally operates as a pendulum around the fulcrum 28 . It is possible to move the position of the fulcrum 28 .
  • the position of the tip end of the club head 13 c is specified by a coordinate xh along the absolute reference coordinate system ⁇ xyz.
  • the 3-dimensional movement analysis model 26 corresponds to a model of the golf club 13 when a swing is performed.
  • the shaft 13 a of the golf club 13 is projected as the bar 27 of the pendulum.
  • the grip 13 b is projected as the fulcrum 28 of the bar 27 .
  • the inertial sensor 12 is fixed to the shaft 13 a .
  • the inertial sensor 12 outputs an acceleration signal and an angular velocity signal. In the acceleration signal, an acceleration signal which includes a gravity acceleration g is output.
  • the arithmetic processing circuit 14 fixes a local coordinate system (sensor coordinate system) ⁇ s to the inertial sensor 12 .
  • the origin of the local coordinate system ⁇ s is set to the origin of the detection axis of the inertial sensor 12 .
  • the Y axis of the local coordinate system ⁇ s coincides with the long axis of the shaft 13 a as shown in FIG. 1 .
  • the x axis of the local coordinate system ⁇ s coincides with a struck ball direction which is specified as a direction of a face as shown in FIG. 1 . Therefore, based on the local coordinate system ⁇ s, a fulcrum position l sj is specified as (0, l sjy , 0) as shown in FIG. 2 .
  • the position l sh of the club head 13 c is specified as (0, l shy , 0).
  • FIG. 3 schematically illustrates the configuration of the arithmetic processing circuit 14 according to the embodiment.
  • the arithmetic processing circuit 14 includes a swing trace calculation unit 31 as a first calculation unit and a rotation angle calculation unit 32 as a second calculation unit.
  • the swing trace calculation unit 31 is connected to the inertial sensor 12 .
  • An output signal is supplied to the swing trace calculation unit 31 from the inertial sensor 12 .
  • the output of the inertial sensor 12 includes accelerations which are respectively detected along the perpendicular three axes, and angular velocities which are respectively detected around the perpendicular three axes.
  • the swing trace calculation unit 31 detects the position and the posture of the golf club 13 based on the output of the inertial sensor 12 .
  • the swing trace calculation unit 31 detects, for example, the positions of the grip 13 b and the club head 13 c which are moving. In the detection, the swing trace calculation unit 31 calculates the acceleration of the grip 13 b according to, for example, subsequent Expression (1). In the calculation of the acceleration, the swing trace calculation unit 31 specifies the position l sj of the grip 13 b according to the unique local coordinate system ⁇ s of the inertial sensor 12 . In the specification, the swing trace calculation unit 31 acquires positional information from the storage device 16 . The position l sj of the grip 13 b is stored in the storage device in advance. The position l sj of the grip 13 b may be designated through, for example, the input device 21 . In Expression (1), ⁇ sj indicates the acceleration of the grip, as indicates the acceleration which is measured by the inertial sensor 12 , and ⁇ s indicates the angular velocity which is measured by the inertial sensor 12 .
  • ⁇ sj ⁇ s + ⁇ dot over ( ⁇ ) ⁇ s ⁇ l sj + ⁇ s ⁇ ( ⁇ s ⁇ l sj )+ g (1)
  • the swing trace calculation unit 31 calculates the moving velocity of the grip 13 b based on the calculated acceleration.
  • an integration process is performed on the acceleration with a prescribed sampling interval dt according to subsequent Expression (2).
  • N indicates the number of samples (hereinafter, the same).
  • the swing trace calculation unit 31 calculates the position of the grip 13 b based on the calculated velocity.
  • the integration process is performed on the velocity with the prescribed sampling interval dt according to subsequent Expression (3).
  • the swing trace calculation unit 31 specifies the position of the local coordinate system ⁇ s (or the position of the grip 13 b ) in a virtual 3-dimensional space in advance.
  • the position of the golf club 13 is specified.
  • the swing trace calculation unit 31 detects the position of the club head 13 c according to subsequent Expressions (4) to (6). In the detection of the position, the swing trace calculation unit 31 specifies the position l sh of the club head 13 c according to the unique local coordinate system ⁇ s of the inertial sensor 12 . In the specification, the swing trace calculation unit 31 acquires the positional information from the storage device 16 . The position l sh of the club head 13 c is stored in the storage device 16 in advance. The position l sh of the club head 13 c may be designated through, for example, the input device 21 .
  • the swing trace calculation unit 31 specifies the position l sh of the club head 13 c according to the unique local coordinate system ⁇ s of the inertial sensor 12 as described above, and then converts the position l sh of the club head 13 c into the coordinate system in the virtual 3-dimensional space. That is, the position P sh (t) of the club head 13 c is shown by coordinates (x, y, z) in the virtual 3-dimensional space shown in FIG. 1 .
  • the rotation angle calculation unit 32 is connected to the inertial sensor 12 and the designation unit 20 . An output from the inertial sensor 12 is supplied to the rotation angle calculation unit 32 .
  • the angular velocity ⁇ n is sequentially input to the rotation angle calculation unit 32 from the inertial sensor (gyro sensor) 12 . Therefore, a checkpoint is designated to the rotation angle calculation unit 32 . If the end of the integration period is acquired, the rotation angle calculation unit 32 can calculate the rotation angle ⁇ m of the grip 13 b at the checkpoint.
  • the checkpoint can be designated as positional information or time information in the movement path of the golf club 13 , a case in which designation is performed using the positional information will be described below.
  • FIG. 4 is a diagram illustrating an example of the checkpoint.
  • the golf club 13 In the golf driving range, there is a case in which the golf club 13 is stopped during downswing facing the impact from the top, and the direction of the face of the club head 13 c at that time is recognized as a checkpoint.
  • the club head 13 c is stopped at, for example, the height of the eyes of a golfer.
  • the checkpoint is a height H1 up to the club head 13 c .
  • the checkpoint (height) H1 can be designated in such a way that the golf swing analysis apparatus 11 acquires a height H2 of the golfer.
  • height data H2 of an examinee is input by the input device 21 .
  • FIG. 5 illustrates an example of data which is detected by the inertial sensor 12 .
  • the data may be stored in the storage device 16 or a storage unit inside the arithmetic processing circuit 14 .
  • the sampling counter number t coincides with a symbol t in Expression (7) which is used when the swing trace calculation unit 31 calculates the position P sh (t) of the club head 13 c . That is, the position P sh (t) of the club head 13 c , which is calculated by the swing trace calculation unit 31 based on Expression (7), is calculated per the sampling counter number t.
  • the position P sh (t) of the club head 13 c which is calculated per the sampling counter number t, is input to the designation unit 20 from the swing trace calculation unit 31 .
  • the arithmetic processing circuit 14 includes an image data generation unit 34 .
  • the image data generation unit 34 is connected to the swing trace calculation unit 31 and the rotation angle calculation unit 32 .
  • An output signal is supplied to the image data generation unit 34 from the swing trace calculation unit 31 and the rotation angle calculation unit 32 .
  • the image data generation unit 34 includes a movement trace image generation unit 35 , a surface rotation image generation unit 36 , and a cube image generation unit 37 .
  • the movement trace image generation unit 35 generates images (R1 and R2 shown in FIGS. 8 to 10 which will be described later) to visually display the movement path of the golf club 13 based on the position and the posture of the golf club 13 .
  • the surface rotation image generation unit 36 generates an object image (image 41 shown in FIGS.
  • the cube image generation unit 37 generates an image of a cube (a mark 42 shown in FIGS. 8 and 9 ) which has a ridgeline parallel to the axis of the grip 13 b .
  • a cube a mark 42 shown in FIGS. 8 and 9
  • one plane which extends parallel to the axis of the grip 13 b and has a geometric-shaped outline (here, a quadrate outline), is prescribed.
  • the object image 41 of the face surface and the plane 43 of the cube 42 change directions around the axis of the grip 13 b according to the rotation angle ⁇ m of the grip 13 b when the club head 13 c is at the checkpoint.
  • Images, acquired when the club head 13 c is at the checkpoint, are associated with each other, and output from the image data generation unit 34 as a single piece of image data.
  • the mark can have a three-dimensional shape, such as a curved surface or a sphere other than a cube, in addition to the plane or cube.
  • the arithmetic processing circuit 14 includes a drawing unit 38 .
  • the drawing unit 38 is connected to the image data generation unit 34 .
  • Image data is supplied to the drawing unit 38 from the image data generation unit 34 .
  • the drawing unit 38 draws an image which visually displays the movement path of the golf club 13 based on the output signal of the movement trace image generation unit 35 , and displays the image on the display device 19 .
  • the drawing unit 38 overlaps the face image (object) 41 and the cube image (mark) 42 on the image of the movement path of the golf club 13 for each position.
  • an image which is acquired by associating the movement path of the golf club 13 with the rotation angle of the face and the rotation angle of the cube at the checkpoint and which is visually displayed is generated.
  • a golf swing of a golfer is measured.
  • necessary information is input to the arithmetic processing circuit 14 from the input device 21 .
  • the position l sj of the fulcrum 28 according to the local coordinate system ⁇ s and the rotation matrix R0 of an initial posture of the inertial sensor 12 are prompted to be input.
  • data of the height of the golfer is input to the designation unit 20 from the input device 21 .
  • the input information is managed, for example, under a specific identifier. The identifier may identify a specific golfer.
  • the inertial sensor 12 Prior to the measurement, the inertial sensor 12 is attached to the shaft 13 a of the golf club 13 .
  • the inertial sensor 12 is fixed to the golf club 13 such that relative displacement is not possible.
  • one detection axis of the inertial sensor 12 is aligned on the axis of the shaft 13 a .
  • One detection axis of the inertial sensor 12 is aligned in a struck ball direction which is specified as the direction of the face (hitting surface).
  • the inertial sensor 12 Prior to the execution of golf swing, measurement performed by the inertial sensor 12 starts.
  • the inertial sensor 12 is set to a predetermined position and posture. The position and the posture are specified in a rotation matrix R0 of the initial posture.
  • the inertial sensor 12 continuously measures the acceleration and the angular velocity at a specific sampling interval. The sampling interval prescribes a measurement resolution.
  • the detection signal of the inertial sensor 12 is transmitted to the arithmetic processing circuit 14 in real time.
  • the arithmetic processing circuit 14 receives a signal which specifies the output of the inertial sensor 12 .
  • the golf swing starts from address and reaches the follow-through and the finish through take back, half way back, top to downswing, and impact. If the golf club 13 is swung, the posture of the golf club 13 changes according to a time axis.
  • the inertial sensor 12 outputs the detection signal according to the posture of the golf club 13 .
  • the swing trace calculation unit 31 detects the position of the golf club 13 , in particular, the club head 13 c based on the output of the inertial sensor 12 .
  • the designation unit 20 to which the position of the club head 13 c is input from the swing trace calculation unit 31 , compares the position and the checkpoint.
  • the rotation angle calculation unit 32 calculates the angular position of the grip 13 b around the axis of the grip 13 b at the checkpoint according to Expression (7) based on the output of the inertial sensor 12 up to the checkpoint H1 on the movement path of the club head 13 c .
  • the image data generation unit 34 generates 3-dimensional image data (for example, polygon data) which specifies an image of the face and an image of the cube at the checkpoint in association with the movement path of the golf club 13 .
  • the drawing unit 38 draws the image of the face 41 and the image of the cube 42 in association with the movement path T of the golf club 13 based on the 3-dimensional image data.
  • the drawing data is transmitted to the image processing circuit 18 , and an image is displayed on the screen of the display device 19 according to the drawing data.
  • the image processing circuit 18 includes a view coordinate conversion unit 18 A.
  • the view coordinate conversion unit 18 A has a well-known function to perform view coordinate conversion such that an image, viewed from the view point toward the gaze direction, is displayed on the display device 19 .
  • the view point is set on the z axis by the absolute reference coordinate system (x, y, z) shown in FIG. 1
  • a front image which is acquired by performing normal view coordinate conversion such that the gaze direction from the view point is set to the z direction, is shown in FIG. 6 .
  • FIG. 7 a side image, which is acquired by performing the normal view coordinate conversion such that the gaze direction from the viewpoint is set to the x direction, is shown in FIG. 7 .
  • a backswing movement path is R1
  • a downswing movement path is R2.
  • FIG. 8 illustrates the posture of the face of the club head 13 c at the checkpoint, which is displayed in, for example, the front image which is the same as in FIG. 6 .
  • view coordinate conversion in which the vicinity of the eyes of a golfer is set to a view point 1 and which includes a gaze direction 1 toward the checkpoint from the view point 1 in FIG. 7 , can be illustrated in FIG. 9 .
  • the gaze direction 1 is the same as the gaze direction S from the view point P shown in FIG. 4 . That is, in FIG.
  • FIG. 9 the posture of the face of the club head 13 c at the checkpoint viewed from the eyes of the golfer is displayed by the movement analysis apparatus 11 , similarly to FIG. 4 when the golf club 13 is swung at the checkpoint without stopping.
  • the display example in FIG. 9 it is excellent in that the checkpoint acquired when exercise, which is used as in FIG. 4 , is performed (when the golf club is stopped) can be compared with the checkpoint when the golf club is swung without stopping.
  • view coordinate conversion in which a view point 2 is set obliquely above and behind the golfer and which includes a gaze direction 2 toward the golfer from the view point 2 in FIG. 7 , can be illustrated in FIG. 10 .
  • FIGS. 8 to 10 illustrate the backswing movement path R1 and the downswing movement path R2.
  • FIGS. 8 to 10 illustrate an object 41 which indicates the face of the club head 13 c which rotates around the axis of the shaft 13 a .
  • FIGS. 8 and 9 illustrate a cube 42 which is a mark. Since the shaft 13 a of the sporting equipment 13 has a bar shape, it is difficult for the examinee to grasp the amount of rotation even though the rotation around the axis of the shaft 13 a is displayed as the object 41 . Therefore, when the mark 42 ( FIGS.
  • the plane 43 of the cube 42 in the image changes the direction according to the rotation of the grip 13 b and the shaft 13 a .
  • the rotation of the grip 13 b that is, the rotation of the wrist is expressed through the rotation of the plane 43 .
  • the examinee can clearly grasp the rotation of the wrist at the checkpoint based on the image.
  • the examinee can improve a swing posture according to such a grasp.
  • the cube 42 reflects the perpendicular three axes of the grip 13 b . As a result, the examinee can ideally recognize the behavior of the wrist at the checkpoint clearly.
  • the face 41 at the checkpoint is specified in the image.
  • the rotation of the wrist at the checkpoint with the golf club 13 itself is represented.
  • the examinee can visually recognize the behavior of the golf club 13 .
  • the examinee can improve the swing posture through the recognition.
  • the first image and the second image may be displayed in parallel or overlapping on the display device 19 . In this manner, it is possible to compare different swings of the same golfer. Further, it is possible to compare the swing of a person with the swing of an advanced learner.
  • the individual functional block of the arithmetic processing circuit 14 is realized by executing the golf swing analysis software program 17 .
  • the individual functional block may be realized by hardware without resorting to software processing.
  • the golf swing analysis apparatus 11 may be applied for analysis of swing of sporting equipment (for example, a tennis racket, a table tennis racket, or a baseball bat) which is gripped and swung by hand.
  • the swing trace calculation unit 31 and the rotation angle calculation unit 32 in FIG. 3 are separately described, the swing trace calculation unit 31 and the rotation angle calculation unit 32 may collectively function as a single calculation unit.
  • the arithmetic processing circuit 14 , the image processing circuit 18 , the swing trace calculation unit 31 , and the rotation angle calculation unit 32 may be embodied by a single processing unit, such as a central processing unit (CPU), more than one processing unit, or may be embodied by one or more special purpose circuits.
  • the processing units are not limited to CPUs, and may be provided by any other type of processing unit.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Educational Administration (AREA)
  • Educational Technology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Psychiatry (AREA)
  • Social Psychology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Physical Education & Sports Medicine (AREA)
  • Golf Clubs (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
US14/510,685 2013-10-18 2014-10-09 Movement analysis method, movement analysis apparatus, and movement analysis program Abandoned US20150111657A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2013217642A JP2015077351A (ja) 2013-10-18 2013-10-18 運動解析方法、運動解析装置および運動解析プログラム
JP2013-217642 2013-10-18

Publications (1)

Publication Number Publication Date
US20150111657A1 true US20150111657A1 (en) 2015-04-23

Family

ID=52826635

Family Applications (1)

Application Number Title Priority Date Filing Date
US14/510,685 Abandoned US20150111657A1 (en) 2013-10-18 2014-10-09 Movement analysis method, movement analysis apparatus, and movement analysis program

Country Status (3)

Country Link
US (1) US20150111657A1 (enExample)
JP (1) JP2015077351A (enExample)
CN (1) CN104548555A (enExample)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150362331A1 (en) * 2014-04-24 2015-12-17 Sanwood Llc Systems, devices, and methods for recording and transmitting data
US20160175647A1 (en) * 2014-12-22 2016-06-23 Seiko Epson Corporation Exercise analysis device, exercise analysis system, exercise analysis method, display device, and recording medium
US20160184686A1 (en) * 2014-12-24 2016-06-30 Sony Corporation System and method for processing sensor data
US20160296795A1 (en) * 2015-04-09 2016-10-13 Electronics And Telecommunications Research Institute Apparatus and method for analyzing golf motion
US20160325138A1 (en) * 2015-05-07 2016-11-10 Seiko Epson Corporation Swing analyzing device, swing analyzing method, storage medium, and swing analyzing system
US20170026564A1 (en) * 2015-07-24 2017-01-26 Samsung Electronics Co., Ltd. Photographing apparatus and method of controlling the same
US20170028282A1 (en) * 2015-07-28 2017-02-02 Seiko Epson Corporation Swing diagnosis method, recording medium, swing diagnosis apparatus, and swing diagnosis system
US20170124388A1 (en) * 2014-08-04 2017-05-04 Panasonic Corporation Moving body tracking method and moving body tracking device
US20190223839A1 (en) * 2018-01-03 2019-07-25 Cardiac Pacemakers, Inc. Imaging of a body part using sounds
US20200139214A1 (en) * 2017-07-13 2020-05-07 Prgr Co., Ltd. Swing Measurement Device, Swing Measurement Method, and Swing Measurement Program
US20220008276A1 (en) * 2020-07-08 2022-01-13 Gabriel Curiel Pressure Differential-, Ultrasound-, and Magnetic-Based Methods for Treating Viral Infections and other Pathogenic Diseases, Sterilizing Medical Equipment, and Enhancing Fatty Tissue Reduction
US20220331657A1 (en) * 2021-04-19 2022-10-20 Swing Logic Ventures, Inc. Swing analysis device
CN118248019A (zh) * 2024-05-20 2024-06-25 慧医谷中医药科技(天津)股份有限公司 一种基于ai视觉的中医刮痧走罐沉浸式实训方法及系统

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018027688A1 (zh) * 2016-08-10 2018-02-15 张阳 运动距离在网球运动中的应用方法及系统
JP6895304B2 (ja) * 2017-04-24 2021-06-30 株式会社 Mtg 運動器具制御装置および運動器具制御プログラム
JP2021100716A (ja) 2021-04-08 2021-07-08 雄三 安形 9軸センサ内蔵型ゴルフクラブ及びそれを用いたスイング軌道計測システム
CN113797518B (zh) * 2021-09-30 2022-08-05 天津工业大学 一种运动员选拔方法及系统
CA3218296A1 (en) 2023-01-06 2025-03-17 Amplus Co Ltd DISPLAY CONTROL DEVICE, DISPLAY CONTROL METHOD, AND DISPLAY CONTROL PROGRAM
JP7281857B1 (ja) 2023-01-06 2023-05-26 有限会社Amplus 表示制御装置およびプログラム

Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4137566A (en) * 1977-09-12 1979-01-30 Acushnet Company Apparatus and method for analyzing a golf swing and displaying results
US5111410A (en) * 1989-06-23 1992-05-05 Kabushiki Kaisha Oh-Yoh Keisoku Kenkyusho Motion analyzing/advising system
US5233544A (en) * 1989-10-11 1993-08-03 Maruman Golf Kabushiki Kaisha Swing analyzing device
US5638300A (en) * 1994-12-05 1997-06-10 Johnson; Lee E. Golf swing analysis system
US5772522A (en) * 1994-11-23 1998-06-30 United States Of Golf Association Method of and system for analyzing a golf club swing
US5826578A (en) * 1994-05-26 1998-10-27 Curchod; Donald B. Motion measurement apparatus
US20040096085A1 (en) * 2002-09-26 2004-05-20 Nobuyuki Matsumoto Image analysis method, apparatus and program
US7101287B1 (en) * 1999-04-21 2006-09-05 Herrmann Wagner Sports training apparatus and sports training system
US7264554B2 (en) * 2005-01-26 2007-09-04 Bentley Kinetics, Inc. Method and system for athletic motion analysis and instruction
US20080085778A1 (en) * 2006-10-07 2008-04-10 Dugan Brian M Systems and methods for measuring and/or analyzing swing information
US7376245B2 (en) * 2003-04-16 2008-05-20 Sri Sports Limited Automatic tracking method for golf swing
US7857708B2 (en) * 2004-03-26 2010-12-28 Sri Sports Limited Golf swing-diagnosing system
US20120316005A1 (en) * 2011-06-09 2012-12-13 Seiko Epson Corporation Swing analyzing device, swing analyzing program, and recording medium

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS59193466U (ja) * 1983-06-09 1984-12-22 井上 静子 ゴルフスイング学習用具
JP2004081683A (ja) * 2002-08-28 2004-03-18 Yokohama Rubber Co Ltd:The ゴルフスイング分析システム
DE102005027388A1 (de) * 2005-06-14 2006-12-28 Darran Bird Verfahren zur Bestimmung der Schaftlänge eines individuell angepassten Golfschlägers
WO2009060011A2 (en) * 2007-11-05 2009-05-14 Brian Francis Mooney Apparatus and method for analysing a golf swing
JP5434540B2 (ja) * 2008-12-04 2014-03-05 横浜ゴム株式会社 ゴルフクラブの選択方法
JP5773122B2 (ja) * 2010-12-20 2015-09-02 セイコーエプソン株式会社 スイング分析装置及びスイング分析プログラム
JP5768266B2 (ja) * 2011-02-10 2015-08-26 株式会社ユピテル ゴルフ支援システム、ゴルフ支援装置及びプログラム
JP2013009789A (ja) * 2011-06-29 2013-01-17 Bridgestone Corp カメラシステム、撮影システム及び撮影方法
US9101812B2 (en) * 2011-10-25 2015-08-11 Aquimo, Llc Method and system to analyze sports motions using motion sensors of a mobile device
JP2013188293A (ja) * 2012-03-13 2013-09-26 Casio Computer Co Ltd 運動情報表示システム、運動情報表示プログラムおよび運動情報表示方法
CN103083886B (zh) * 2013-01-31 2015-01-28 深圳市宇恒互动科技开发有限公司 虚拟高尔夫球运动实现方法、系统及其球杆和球座

Patent Citations (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4137566A (en) * 1977-09-12 1979-01-30 Acushnet Company Apparatus and method for analyzing a golf swing and displaying results
US5111410A (en) * 1989-06-23 1992-05-05 Kabushiki Kaisha Oh-Yoh Keisoku Kenkyusho Motion analyzing/advising system
US5233544A (en) * 1989-10-11 1993-08-03 Maruman Golf Kabushiki Kaisha Swing analyzing device
US5826578A (en) * 1994-05-26 1998-10-27 Curchod; Donald B. Motion measurement apparatus
US5772522A (en) * 1994-11-23 1998-06-30 United States Of Golf Association Method of and system for analyzing a golf club swing
US5638300A (en) * 1994-12-05 1997-06-10 Johnson; Lee E. Golf swing analysis system
US7101287B1 (en) * 1999-04-21 2006-09-05 Herrmann Wagner Sports training apparatus and sports training system
US20040096085A1 (en) * 2002-09-26 2004-05-20 Nobuyuki Matsumoto Image analysis method, apparatus and program
US7376245B2 (en) * 2003-04-16 2008-05-20 Sri Sports Limited Automatic tracking method for golf swing
US7857708B2 (en) * 2004-03-26 2010-12-28 Sri Sports Limited Golf swing-diagnosing system
US7264554B2 (en) * 2005-01-26 2007-09-04 Bentley Kinetics, Inc. Method and system for athletic motion analysis and instruction
US20080085778A1 (en) * 2006-10-07 2008-04-10 Dugan Brian M Systems and methods for measuring and/or analyzing swing information
US20120316005A1 (en) * 2011-06-09 2012-12-13 Seiko Epson Corporation Swing analyzing device, swing analyzing program, and recording medium

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150362331A1 (en) * 2014-04-24 2015-12-17 Sanwood Llc Systems, devices, and methods for recording and transmitting data
US10520557B2 (en) * 2014-04-24 2019-12-31 Arthrokinetic Institute, Llc Systems, devices, and methods for recording and transmitting data
US10002289B2 (en) * 2014-08-04 2018-06-19 Panasonic Corporation Moving body tracking method and moving body tracking device
US20170124388A1 (en) * 2014-08-04 2017-05-04 Panasonic Corporation Moving body tracking method and moving body tracking device
US20160175647A1 (en) * 2014-12-22 2016-06-23 Seiko Epson Corporation Exercise analysis device, exercise analysis system, exercise analysis method, display device, and recording medium
US20160184686A1 (en) * 2014-12-24 2016-06-30 Sony Corporation System and method for processing sensor data
US10706740B2 (en) * 2014-12-24 2020-07-07 Sony Corporation System and method for processing sensor data
US20160296795A1 (en) * 2015-04-09 2016-10-13 Electronics And Telecommunications Research Institute Apparatus and method for analyzing golf motion
US10186041B2 (en) * 2015-04-09 2019-01-22 Electronics And Telecommunications Research Institute Apparatus and method for analyzing golf motion
US20160325138A1 (en) * 2015-05-07 2016-11-10 Seiko Epson Corporation Swing analyzing device, swing analyzing method, storage medium, and swing analyzing system
US9979872B2 (en) * 2015-07-24 2018-05-22 Samsung Electronics Co., Ltd. Photographing apparatus and method of controlling the same
KR20170011873A (ko) * 2015-07-24 2017-02-02 삼성전자주식회사 촬영 디바이스 및 그 제어 방법
KR102352680B1 (ko) * 2015-07-24 2022-01-18 삼성전자주식회사 촬영 디바이스 및 그 제어 방법
US20170026564A1 (en) * 2015-07-24 2017-01-26 Samsung Electronics Co., Ltd. Photographing apparatus and method of controlling the same
US10517512B2 (en) * 2015-07-28 2019-12-31 Seiko Epson Corporation Swing diagnosis method, recording medium, swing diagnosis apparatus, and swing diagnosis system
US20170028282A1 (en) * 2015-07-28 2017-02-02 Seiko Epson Corporation Swing diagnosis method, recording medium, swing diagnosis apparatus, and swing diagnosis system
US11224787B2 (en) * 2017-07-13 2022-01-18 Prgr Co., Ltd. Swing measurement device, swing measurement method, and swing measurement program
US20200139214A1 (en) * 2017-07-13 2020-05-07 Prgr Co., Ltd. Swing Measurement Device, Swing Measurement Method, and Swing Measurement Program
US20190223839A1 (en) * 2018-01-03 2019-07-25 Cardiac Pacemakers, Inc. Imaging of a body part using sounds
US12245891B2 (en) * 2018-01-03 2025-03-11 Cardiac Pacemakers, Inc. Imaging of a body part using sounds
US20220008276A1 (en) * 2020-07-08 2022-01-13 Gabriel Curiel Pressure Differential-, Ultrasound-, and Magnetic-Based Methods for Treating Viral Infections and other Pathogenic Diseases, Sterilizing Medical Equipment, and Enhancing Fatty Tissue Reduction
US20220331657A1 (en) * 2021-04-19 2022-10-20 Swing Logic Ventures, Inc. Swing analysis device
US11771956B2 (en) * 2021-04-19 2023-10-03 Swing Logic Ventures, Inc. Swing analysis device
CN118248019A (zh) * 2024-05-20 2024-06-25 慧医谷中医药科技(天津)股份有限公司 一种基于ai视觉的中医刮痧走罐沉浸式实训方法及系统

Also Published As

Publication number Publication date
CN104548555A (zh) 2015-04-29
JP2015077351A (ja) 2015-04-23

Similar Documents

Publication Publication Date Title
US20150111657A1 (en) Movement analysis method, movement analysis apparatus, and movement analysis program
US10459002B2 (en) Motion analysis method and motion analysis device
US10478707B2 (en) Motion analysis method and motion analysis device
CN104225890B (zh) 运动分析装置
US20150012240A1 (en) Motion analysis device
US9717969B2 (en) Motion analyzing apparatus and motion analyzing program
US9962591B2 (en) Motion analysis method, program, and motion analysis device
US20140378239A1 (en) Motion analysis method and motion analysis device
US20150142374A1 (en) Motion analyzing method and motion analyzing apparatus
US20170239520A1 (en) Motion analysis apparatus, motion analysis system, motion analysis method, recording medium, and display method
US10252136B2 (en) Swing diagnosis apparatus, swing diagnosis system, swing diagnosis method, and recording medium
US20170024610A1 (en) Motion analysis apparatus, motion analysis system, motion analysis method, and display method and program of motion analysis information
JP2016116615A (ja) 運動解析装置、運動解析システム、運動解析方法、及びプログラム
US20170011652A1 (en) Motion analysis method, motion analysis apparatus, motion analysis system, and program
CN104587662A (zh) 运动分析装置、运动分析方法
JP2015073821A (ja) 運動解析方法、運動解析装置、および運動解析プログラム
JP2015002911A (ja) 運動解析装置および運動解析プログラム
JP6428815B2 (ja) 運動解析装置、運動解析システムおよび運動解析方法
JP6255738B2 (ja) 運動解析装置および運動解析プログラム並びに表示方法
JP2016209229A (ja) スイング解析装置、スイング解析方法、プログラム、およびスイング解析システム

Legal Events

Date Code Title Description
AS Assignment

Owner name: SEIKO EPSON CORPORATION, JAPAN

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:SHIBUYA, KAZUHIRO;NOMURA, KAZUO;KODAIRA, KENYA;AND OTHERS;SIGNING DATES FROM 20140929 TO 20140930;REEL/FRAME:033923/0955

AS Assignment

Owner name: SEIKO EPSON CORPORATION, JAPAN

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S ADDRESS PREVIOUSLY RECORDED AT REEL: 033923 FRAME: 0955. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNORS:SHIBUYA, KAZUHIRO;NOMURA, KAZUO;KODAIRA, KENYA;AND OTHERS;SIGNING DATES FROM 20140929 TO 20140930;REEL/FRAME:034037/0702

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION