WO2022085650A1 - Insole data generating system, and insole data generating method - Google Patents

Insole data generating system, and insole data generating method Download PDF

Info

Publication number
WO2022085650A1
WO2022085650A1 PCT/JP2021/038498 JP2021038498W WO2022085650A1 WO 2022085650 A1 WO2022085650 A1 WO 2022085650A1 JP 2021038498 W JP2021038498 W JP 2021038498W WO 2022085650 A1 WO2022085650 A1 WO 2022085650A1
Authority
WO
WIPO (PCT)
Prior art keywords
walking
user
insole
data
video
Prior art date
Application number
PCT/JP2021/038498
Other languages
French (fr)
Japanese (ja)
Inventor
和 庄野
Original Assignee
和 庄野
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 和 庄野 filed Critical 和 庄野
Publication of WO2022085650A1 publication Critical patent/WO2022085650A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A43FOOTWEAR
    • A43BCHARACTERISTIC FEATURES OF FOOTWEAR; PARTS OF FOOTWEAR
    • A43B17/00Insoles for insertion, e.g. footbeds or inlays, for attachment to the shoe after the upper has been joined
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B29WORKING OF PLASTICS; WORKING OF SUBSTANCES IN A PLASTIC STATE IN GENERAL
    • B29DPRODUCING PARTICULAR ARTICLES FROM PLASTICS OR FROM SUBSTANCES IN A PLASTIC STATE
    • B29D35/00Producing footwear

Definitions

  • the present invention relates to an insole data generation system and an insole data generation method, and particularly based on a user's walking habits extracted from a user's walking video taken by a user terminal, structural data of an insole for correction suitable for the user.
  • the present invention relates to an insole data generation system and an insole data generation method.
  • Walking is one of the most basic movements for humans, but many people tend to have a habit of walking as a result of walking without being particularly conscious of their walking posture for many years.
  • the habit of walking usually appears as a tilt of the body, and in a continuous walking motion, it is observed as a swing during walking in which the body leans to one side or left and right.
  • Such walking habits may occur not only when the walking habits are accumulated for many years, but also when it is difficult to take a correct walking posture due to the influence of illness or injury.
  • the habit of walking is mild, the effect on the body is small, but if the degree is severe, a biased load is applied to the knees and hips, and the effects of joint inflammation and pain are likely to occur. Therefore, it is important for people with strong walking habits to correct their walking habits before they affect the body.
  • an insole which is an insole to be put in shoes, into a shape that gives a corrective effect.
  • An insole shaped to have a corrective effect is also called a sole plate, and it is necessary to individually manufacture it according to the walking habit of the user who uses it, and for that purpose, first the user's walking habit You need to figure it out.
  • the habit of walking can be grasped to some extent by the decrease in the soles of the shoes that are usually worn, but it is not possible to grasp exactly where and how to correct it.
  • Patent Document 1 an insole in which a pressure-sensitive sensor and transmission / reception means are arranged at a plurality of predetermined locations is attached to the inside of a shoe desired as a test insole, and the pressure applied to the sole of the foot during walking is measured by the pressure-sensitive sensor.
  • a method and a system for producing a new insole in which a pressure-sensitive sensor and a transmission / reception means are arranged are disclosed.
  • Patent Document 1 since it is possible to accurately evaluate where and what kind of pressure is applied while the user is walking, it is expected to manufacture an insole that matches the walking habit of the user.
  • the user in order to carry out Patent Document 1, the user must first obtain a test insole and walk for pressure measurement, and a new insole created based on the pressure measurement result also has a pressure sensor and a pressure sensitive insole. Since the transmission / reception means are arranged, the production cost is high, the production place is limited, and the user has to wait for the finished product to be sent. Furthermore, there is a problem that repeat orders are subject to the same restrictions. Therefore, an insole data generation system and an insole data generation method that can easily grasp the user's walking habits and easily produce repeats without preparing a special tool such as a pressure sensor. Expected to be provided.
  • the present invention has been made in view of the problems in the above-mentioned conventional insole data generation system and insole data generation method, and an object of the present invention is a user extracted from a user's walking video taken by a user terminal. It is an object of the present invention to provide an insole data generation system and an insole data generation method for generating and providing structural data of an insole for correction suitable for a user based on the habit of walking.
  • the insole data generation system made to achieve the above object is based on the user's walking habits extracted from the user's walking video taken by the user terminal, and the insole structural data suitable for the user.
  • An insole data generation system including an information providing server that generates and provides information, the information providing server includes a walking data management unit that stores and manages a user's walking habits extracted from the walking video.
  • a user including a pad structure data generation unit that calculates a correction amount for correcting the walking habit based on the walking habit and generates pad structure data for correction, and a user's shoe size input in advance.
  • insole structure data generation unit that generates structural data of an insole for correction by incorporating the pad structure data into a standard insole that matches the size of the shoe based on the basic information of the above. It is characterized in that it is extracted from the walking video by an application implemented in the user terminal and transmitted from the user terminal, or is extracted from the walking video transmitted from the user terminal by the walking data management unit. do.
  • the walking video is a video shot from the front or back of the user and includes walking movements by at least the left and right feet, and the walking habit is a predetermined portion of the body observed from the front or back of the walking user. It is preferably a change in the inclination of the central axis or the reference line. It is preferable that the information providing server further has a 3D printer data generation unit that configures and outputs the structural data of the insole as input data of the 3D printer.
  • the method for generating insole data according to the present invention is based on the user's walking habits extracted from the user's walking video taken by the user terminal, and has an insole structure suitable for the user. It is a method of generating insole data by an insole data generation system including an information providing server that generates and provides data, and is a step of shooting a user's walking video by a user terminal and the walking by the user terminal or the information providing server. Based on the stage of extracting the user's walking habit from the video and the information providing server, the correction amount for correcting the walking habit is calculated based on the walking habit, and the pad structure data for correction is generated.
  • the corrective insole that incorporates the pad structure data into a standard insole that fits the shoe size based on the user's basic information including the user's shoe size pre-entered by the information providing server. It is characterized by having a stage of generating structural data.
  • the user can extract the user's walking habits only by shooting a moving image of his / her walking with a user terminal such as his / her smartphone. Since the acquisition of the information is completed, the user does not need to prepare a special tool such as a pressure sensor or a shape sensor to apply for the production of the insole, and the insole data generation system can be used very easily.
  • the generated structural data of the insole is configured and output as input data of the 3D printer. Therefore, when the user owns the 3D printer, Based on the structural data of the insole received by the user terminal, it is possible to produce as many orthodontic insoles as necessary when necessary using a 3D printer. Even if the user does not own a 3D printer, the insole structure data received by the user terminal can be provided to a shop where the nearest 3D printer can be used to create an insole. Even a user in a remote place, for example, a foreign country can easily create an insole by using the insole data generation system.
  • FIG. 1 It is a block diagram which shows schematic structure of the insole data generation system by embodiment of this invention. It is a figure for demonstrating the method of extracting the habit at the time of walking of a user from the walking motion
  • FIG. 1 is a block diagram schematically showing a configuration of an insole data generation system according to an embodiment of the present invention.
  • the insole data generation system 1 according to the embodiment of the present invention includes an information providing server 10 and a user terminal 20 connected via a network 50. Although only one user terminal 20 is shown in FIG. 1, the number of user terminals 20 is arbitrary and basically a plurality.
  • the insole data generation system 1 generates and provides structural data of an insole suitable for the user based on the walking habit of the user extracted from the walking video of the user taken by the user terminal 20. It is a system to do. If one is not aware of maintaining the correct posture when walking, one may develop a habit of walking with one shoulder down or the knee bent inward or outward. When the degree of walking habits becomes severe, local pain and other effects are likely to occur on the body, so insoles that are put in shoes to correct walking habits have been used. Until now, insole production has required time-consuming preparations such as detailed measurement of the foot size of the user who desires the insole and pressure measurement of the sole of the foot.
  • the insole data generation system 1 reduces the time and effort required for such advance preparation, and makes it easy for the user to manufacture an insole even from a remote location without going to an orthopedic clinic or the like to have the user manufacture an insole for correction. It provides an environment where you can apply for.
  • a user who needs to use the insole can simply shoot a moving image of his / her walking by the user terminal 20 and implement an application program (hereinafter referred to as an application) on the user terminal 20. Since the user's walking habits are extracted from the moving image taken by (referred to as) and transmitted to the information providing server 10, the user can easily acquire the basic data for manufacturing the insole.
  • an application an application program
  • the information providing server 10 that has received the user's walking habit from the user terminal 20 calculates the correction amount for correcting the walking habit based on the received walking habit, and obtains the pad structure data for correction. Generate and generate structural data for the orthodontic insole that incorporates pad structure data into a standard insole that fits the shoe size, based on the user's basic information, including the user's shoe size pre-populated. Since the generated insole structure data is configured as input data of the 3D printers (30, 31) and output to the user terminal 20, when the user owns the 3D printer 30, the insole structure data received as it is is used. You can make an insole on the spot. Even if you do not own the 3D printer 30, you can provide the structural data of the insole received to a store such as a shoe store where the nearest 3D printer 31 is installed and have it manufactured.
  • the insole data generation system 1 is a system that can acquire data very easily without using a special tool, and even a user in a remote place can easily manufacture an insole.
  • the information providing server 10 includes a control unit 11, an input / output unit 12, a storage unit 13, a display unit 14, a user registration unit 15, a walking data management unit 16, a pad structure data generation unit 17, and an insole structure data.
  • a generation unit 18 and a 3D printer data generation unit 19 are provided.
  • the user registration unit 15 receives the user's basic information such as the user's name and e-mail address transmitted from the user terminal 20, and as a new user member, each user A user ID, which is a unique identifier, is issued and stored in the storage unit 13 together with the basic information of the user for management.
  • the basic information of the user is provided to the user registration unit 15 by presenting an input format so as to input necessary items in the website provided by the information providing server 10 and inputting and transmitting the user. Will be done.
  • the basic information of the user includes information necessary for manufacturing the insole such as the size of the user's shoes.
  • the information necessary for manufacturing the insole includes image data of the front and side surfaces of the foot under the load state of the foot.
  • the image data of the front surface and the side surface of the foot under the load state of the foot is used to acquire the data of the foot width of the user and the vertical arch shape of the foot.
  • the image data of the front surface and the side surface of the foot may be presented to the user by an application implemented in the user terminal 20 to encourage the user to take a picture. It is preferable that the image data of the front surface and the side surface of the foot are taken with each of the left and right feet, and the image of the side surface is taken so as to include the left side surface and the right side surface.
  • the image data of the front and side surfaces of the foot received from the user terminal 20 may be stored and managed by the user registration unit 15 as it is in the storage unit 13 as a part of the basic information of the user, or may be managed by the information providing server 10.
  • An image analysis unit (not shown in FIG. 1) is further provided, and the user's foot width and the vertical arch shape data of the foot are extracted from the image data of the front and side surfaces of the foot, and the extracted user's foot width and foot are extracted.
  • the data of the vertical arch shape of the unit may be stored and managed in the storage unit 13 as a part of the basic information of the user.
  • the image data of the front surface and the side surface of the foot in the unloaded state of the foot are further included, and the difference between the data of the foot width and the vertical arch shape of the foot in the loaded state and the unloaded state is extracted.
  • It is stored and managed in the storage unit 13 as a part of the basic information of the user so as to be the reference data at the time of creating the insole.
  • the basic information of the user may include information such as the height of the user so as to be referred to when calculating the correction amount for correcting the habit of walking.
  • the walking data management unit 16 receives the walking habit of the user extracted by the application implemented in the user terminal 20 from the walking video of the user taken by the user terminal 20, and associates it with the user ID in the storage unit 13. Save and manage in.
  • the walking video of the user is a video shot from the front or the back of the user and includes walking movements by at least the left and right feet, and is preferably a video including walking of at least two or three steps on each of the left and right feet. ..
  • the habit of walking is a change in the inclination of the central axis or the reference line of a predetermined position of the body observed from the front or the back of the walking user.
  • the central axis or reference line at a predetermined location includes, for example, the axis of the trunk, which is the central axis of the torso, the reference line of the shoulder, the reference line of the pelvis, the reference line of the knee, the reference line of the foot, and the like.
  • the walking habit is extracted by the application implemented in the user terminal 20, but in other embodiments, the walking video of the user taken by the user terminal 20 is stored in the user terminal 20. After that, it is transmitted to the information providing server 10 as it is without extracting the habit of walking. Therefore, the walking data management unit 16 is provided with a means for extracting the walking habit from the walking video, extracts the walking habit from the walking video of the user received from the user terminal 20, and associates it with the user ID of the user to store the habit. Save and manage in 13.
  • the extraction of walking habits is performed by determining the inclination of the central axis or the reference line of a predetermined part of the body from the timing of landing of the foot to the timing of kicking the foot and leaving the ground. It should be acquired according to how to attach to or at a predetermined time interval.
  • the walking data management unit 16 superimposes a central axis or a reference line of a predetermined portion of the user's body used when extracting a walking habit on the walking video of the user, and the user walks. It provides a visualization of how the central axis and reference line are tilted inside.
  • the walking video needs to be recorded so that the whole body of the user is included in the walking video in order to correctly identify the central axis and the reference line of a predetermined part of the body, but if the height of the user is known, the walking video needs to be recorded.
  • the user's walking distance, walking speed, and stride can be calculated from the walking time from the start to the end of walking and the angle and number of steps of the user's whole body, it is used as the user's walking data in My Page of the above website. Walking speed, stride length, etc. may be provided.
  • the walking data management unit 16 may encourage the user to shoot a moving image in which the walking speed is changed, obtain a difference in walking habits due to the difference in walking speed, and reflect the result in the production of the insole.
  • the pad structure data generation unit 17 acquires the user's walking habit from the walking data management unit 16, calculates the correction amount for correcting the walking habit based on the walking habit, and calculates the correction amount of the pad structure data for correction. To generate. For example, if the user has a habit of leaning to the right when walking, correct the pad to be inserted on the outside of the right foot. At that time, the height of the pad is obtained by referring to the value of the inclination of the central axis or the reference line at a predetermined position of the user's body during walking so that the inclination disappears. In addition, if the data on walking habits is acquired in correspondence with the landing state of the foot or the passage of time, it is possible to calculate how much correction is required at which position in the front-back direction of the foot. Finer fitting is possible.
  • the pad structure data generated by the pad structure data generation unit 17 is set higher as the position where the pad is installed is farther from the center line of the shoe in order to correct the inclination during walking. Therefore, in the embodiment, the pad structure data generation unit 17 calculates the required pad height according to the standard shoe size. In another embodiment, the user's shoe size and foot front and side image data entered during user registration, or the user's foot width and vertical arch shape of the foot extracted from these image data. It is configured to refer to the data and calculate the pad height according to the size of the user's shoes.
  • the pad structure data is based on the amount of correction that corrects habits during walking, and it is desirable to use an insole that includes the generated pad structure data in the end, but depending on the user, an ideal insole may be used suddenly. It may cause discomfort when used. Therefore, in one embodiment, in addition to the pad structure data of the ideal height, the pad structure data in which the height is changed to the plus side and the minus side is generated, and the data of the insole incorporating these data can be selected by the user. To provide to. This also enables the user to gradually improve the walking posture.
  • the insole structure data generation unit 18 incorporates the pad structure data acquired from the pad structure data generation unit 17 into a standard insole that matches the shoe size based on the user's shoe size information, and obtains structural data of the insole for correction. Generate. If the pad structure data is generated in a form that matches the standard shoe size, the insole structure data generator 18 selects a standard insole that matches the user's shoe size, and then the standard shoe. The pad structure data is corrected based on the ratio of the size of the insole to the size of the user's shoes so that the pad structure data is placed on the selected insole, and the structure data of the insole for correction incorporating the pad structure data is generated.
  • the insole structure data generation unit 18 may generate the pad structure data.
  • the pad structure data is directly incorporated into the standard insole that matches the size of the user's shoe, and the structure data of the insole is generated.
  • the 3D printer data generation unit 19 configures and outputs the structural data of the insole as input data of the 3D printers (30, 31).
  • 3D printers There are various models of 3D printers (30, 31) on the market, from desktop type for personal use to large equipment for business use, but if the data is configured in the format called STL (Standard Triangled Language) format, it is basic. Any model can read data and perform 3D processing. Therefore, the 3D printer data generation unit 19 configures the insole structure data generated by the insole structure data generation unit 18 as STL format data, and outputs the data to the user terminal 20 that has applied for the generation of the insole data.
  • STL Standard Triangled Language
  • the user can perform 3D processing at the nearest store equipped with the 3D printer 30 or 3D printer 31 owned by the user and immediately obtain the insole.
  • the nearest store equipped with the 3D printer 30 or 3D printer 31 owned by the user can perform 3D processing at the nearest store equipped with the 3D printer 30 or 3D printer 31 owned by the user and immediately obtain the insole.
  • you are a remote user and neither you nor the stores in the vicinity own a 3D printer (30, 31) make an insole with the 3D printer owned by the administrator of the information providing server 10 and use the completed insole. It may be delivered to the user.
  • the input / output unit 12 is a communication means for receiving the user's basic information, the user's walking video or walking habit from the user terminal 20, and transmitting the generated insole structure data for a 3D printer, and the communication means.
  • the information providing server 10 includes a keyboard for inputting character data and a mouse for data selection operations.
  • the storage unit 13 stores various data such as basic user information, generated pad structure data, insole structure data, and input data of 3D printers (30, 31), as well as a control program for controlling the information providing server 10 itself. save.
  • the storage unit 13 is realized by a storage medium such as a hard disk, and may be configured as an external memory device when there is a large amount of information to be stored.
  • the display unit 14 displays various data, control programs, and the like stored in the storage unit 13.
  • the display unit 14 is realized by a liquid crystal display device or the like.
  • the control unit 11 controls each component of the information providing server 10 so as to perform the function described above according to the control program stored in the storage unit 13.
  • the user terminal 20 includes a control unit 21, an input / output unit 22, a storage unit 23, a display unit 24, a moving image acquisition unit 25, and a 3D printer data management unit 26.
  • the moving image acquisition unit 25 is a means for acquiring a walking motion of the user.
  • the walking video of the user is a photograph of the walking state of the user from the front or the back, and is a state in which the left and right feet walk a few steps, respectively.
  • the lens provided in the video acquisition unit 25 is horizontally and correctly oriented in the walking direction of the user in order to observe the inclination of the central axis and the reference line at a predetermined position of the user's body as accurately as possible. Must be fixed. Therefore, an application for using the insole data generation system 1 mounted on the user terminal 20 detects the orientation of the lens of the moving image acquisition unit 25 or the housing of the user terminal 20 and determines whether or not the user terminal is correctly fixed. It may be displayed on the display unit 24 of 20.
  • the moving image acquisition unit 25 stores the acquired walking moving image in the storage unit 23.
  • the moving image acquisition unit 25 is not limited to the moving image acquisition unit, and may also serve as an image acquisition unit for acquiring a still image.
  • the user's basic information transmitted when the user uses the insole data generation system 1 for the first time includes image data of the front and side surfaces of the foot, but the front of the foot and the like.
  • the side image may be acquired by the moving image acquisition unit 25 under the control of the application.
  • the images of the front surface and the side surface of the foot are stored in the storage unit 23 separately from the above-mentioned walking motion, and are transmitted to the information providing server 10.
  • the 3D printer data management unit 26 receives data configured for input data of the 3D printers (30, 31) from the information providing server 10 and stores the structural data of the insole in the storage unit 23.
  • the 3D printer data management unit 26 calls the input data of the 3D printer (30, 31) from the storage unit 23 and outputs the input data to the 3D printer 30 owned by the user or the 3D printer 31 provided in the nearest store. ..
  • the insole incorporating the pad structure data having different heights on the plus side and the minus side is provided.
  • it is output it is possible to select which insole data to use and display it on the display screen of the user terminal 20, and the data selected by the user is output to the 3D printer 30 or 31.
  • the user terminal 20 further includes a walking data management unit 27 when extracting a walking habit from the acquired walking video.
  • the walking data management unit 27 extracts the inclination of the central axis of a predetermined portion of the user's body or the change of the reference line as a habit during walking from the acquired walking moving image according to the application implemented in the user terminal 20.
  • the extraction of the habit during walking is performed on the central axis of a predetermined position of the body between the timing of landing the foot and the timing of kicking the foot and leaving the ground.
  • the inclination of the reference line should be acquired according to how the foot touches the ground or a predetermined time interval.
  • the extracted walking habit is transmitted from the user terminal 20 to the information providing server 10. Also in this case, when playing back the walking video saved in the user terminal 20, the central axis and the reference line used for extracting the walking habit of the user are superimposed, and the user can express his / her own walking habit. It may be displayed so that it can be easily recognized.
  • the input / output unit 22 is a communication means for transmitting basic information of the user, a walking video of the user, or a habit of walking, and receiving data for a 3D printer of insole structure data from the information providing server 10, or a user.
  • a character input means for inputting characters to the terminal 20 and a display screen operation means for selecting data displayed on the display unit 24 and moving the display screen are provided. Character input means and display screen operation means can be realized by a touch panel.
  • the storage unit 23 includes data such as walking videos and walking habits extracted from walking videos, as well as programs such as a control program for controlling the basic operation of the user terminal 20 and an application for using the insole data generation system 1. To save.
  • the display unit 24 displays various data such as walking moving images and walking habits, as well as various programs stored in the storage unit 23 as needed.
  • the control unit 21 controls each component of the user terminal 20 to perform the above function according to the control program stored in the storage unit 23.
  • the user terminal 20 can be realized by a smartphone or a tablet terminal provided with a camera.
  • the network 50 connecting the information providing server 10 and the user terminal 20 is preferably a wide-area communication network that can be accessed from overseas, and is the Internet in the embodiment.
  • FIG. 2 is a diagram for explaining a method of extracting a user's walking habit from a user's walking moving image according to the embodiment of the present invention.
  • FIG. 2A is a diagram showing one screen of a walking video acquired by the user terminal 20
  • FIG. 2B is a diagram showing axes and reference lines at predetermined positions for extracting habits during walking from the walking video. It is a superposed figure.
  • the walking data management unit 16 or 27 that extracts the habit during walking recognizes the user by image recognition in the image data of the walking moving image, and the center of the user's torso from the outer shape of the user.
  • the axis 200 of the trunk which is the line, the reference line 210 of the shoulder connecting both shoulders, the reference line 220 of the pelvis connecting the heights of the left and right pelvis, the intersection of the central axis 230 of the thigh and the central axis 231 of the lower leg.
  • the reference line of the knee shown by (1), the reference line 240 of the foot which is the center line in the width direction of the foot, and the like are obtained, and the deviation angle between these axes and the vertical line or the horizontal line is extracted as a habit during walking.
  • the shoulder reference line 210 and the pelvis reference line 220 are shown as deviation angles from the horizon. The deviation angle may be obtained.
  • FIG. 3 is a diagram for schematically explaining the improvement of the user's walking habit by wearing the insole according to the embodiment of the present invention.
  • FIG. 3A is a diagram in which a typical central axis and a reference line are superimposed on one screen of a walking video before the insole is attached
  • FIG. 3B is a representative screen of the walking video after the insole is attached. It is a diagram in which a typical insole and a reference line are superimposed, and each is a diagram in which one screen of an actual walking motion is traced and modeled.
  • the trunk axis 200 and the shoulder reference line 210 are overlapped as typical central axes and reference lines, but the left shoulder tends to be lowered and the upper body tends to be tilted to the left.
  • a shoulder reference line 210 is used in one screen of a walking video in which an insole 300 incorporating a pad 310 is attached so as to eliminate the walking habit of FIG. 3 (a). Is horizontal, and it is recognized that the axis 200 of the trunk is also corrected so as to face the vertical direction correctly.
  • the insole 300 tends to tilt to the left from the time of landing of the left foot due to the inclination of each axis during walking of the user over time, and the insole 300 has a long pad 310 especially on the left side of the left foot. Generated in a built-in form.
  • FIG. 4 is a flowchart for explaining the procedure of the insole data generation method according to the embodiment of the present invention.
  • the walking motion of the user is captured by the user terminal 20 in step S410.
  • the walking video of the user is a video in which the whole body of the user is shot from the front or the back, and the walking motion by at least the left and right feet is included.
  • the user may be instructed to shoot the walking moving image a plurality of times by an application implemented on the user terminal 20. Further, in another embodiment, the user may be instructed to walk a predetermined distance several times, and a plurality of moving images may be collectively shot in one shooting.
  • step S420 the walking data management unit 16 of the user terminal 20 or the walking data management unit 27 of the information providing server 10 that has received the walking video from the user terminal 20 extracts the walking habit of the user.
  • the outer shape of a pedestrian is recognized by image recognition, and the central axis or reference line of a predetermined part of the body such as the trunk axis 200 or the shoulder reference line 210 is obtained, and these central axes or reference lines are obtained. It can be extracted by finding the slope of the reference line with the vertical line or the horizontal line.
  • more accurate walking habits can be extracted by obtaining the average inclination of each central axis and reference line.
  • the outward route and the inbound route are each extracted as one walking video, and the average walking habit is extracted as described above.
  • the extracted walking habit is sent to the pad structure data generation unit 17 of the information providing server 10, and the pad structure data generation unit 17 corrects the walking habit based on the walking habit in step S430.
  • the amount is calculated to generate pad structure data for correction.
  • Pad structure data is calculated as the height of the pad relative to standard size shoes.
  • the insole structure data generation unit 18 of the information providing server 10 has the user's shoe size and foot front and side image data input in advance in step S440, or the user's foot width extracted from these image data. Based on the data of the vertical arch shape of the foot, the structural data of the insole for correction is generated by incorporating the pad structure data into the standard insole suitable for the shoe size. When incorporating the pad structure data, the insole structure data generation unit 18 corrects the height of the pad in the pad structure data due to the difference between the standard size shoe and the user's shoe size.
  • step S450 the 3D printer data generation unit 19 of the information providing server 10 configures the structural data of the insole as input data of the 3D printers (30, 31) and outputs it to the user terminal 20.
  • the user When the user who receives the structural data of the insole actually manufactures the insole, the user transmits the input data of the 3D printer (30, 31) which is the structural data of the received insole to the 3D printer 30 owned by the user. (Step S460) Processing is performed (step S470). If the user does not own the 3D printer 30, the user can go to the nearest store equipped with the 3D printer 31 or send the data to the nearest store to have the insole manufactured.
  • Insole data generation system 10 Information provision server 11, 21 Control unit 12, 22 Input / output unit 13, 23 Storage unit 14, 24 Display unit 15 User registration unit 16 Walking data management unit 17 Pad structure data generation unit 18 Insole structure data generation Part 19 3D printer data generation part 20 User terminal 25 Video acquisition part 26 3D printer data management part 30, 31 3D printer 50 Network 200 Trunk axis 210 Shoulder reference line 220 Pelvic reference line 230 Thigh center axis (Knee reference line) 231 Central axis of lower leg (knee reference line) 240 foot reference line 300 insoles 310 pad

Abstract

Provided is an insole data generating system which generates and provides structural data of a correction insole suitable for a user, on the basis of the user's habits during walking. An insole data generating system according to the present invention is characterized by being provided with an information providing server which generates and provides structural data of an insole suitable for a user, on the basis of the user's habits during walking, wherein: the information providing server includes a walking data management unit which stores and manages the user's habits during walking, a pad structural data generating unit which calculates a correction amount for correcting the habits during walking, and generates pad structural data for correction, and an insole structural data generating unit which generates structural data for a correction insole, obtained by incorporating the pad structural data into a standard insole matching the user's shoe size; and the habits during walking are extracted from a walking video by a user terminal and are transmitted from the user terminal, or are extracted by the walking data management unit from a walking video transmitted by the user terminal.

Description

インソールデータ生成システム及びインソールデータ生成方法Insole data generation system and insole data generation method
 本発明は、インソールデータ生成システム及びインソールデータ生成方法に関し、特にユーザ端末により撮影されたユーザの歩行動画から抽出されるユーザの歩行時の癖に基づき、ユーザに適した矯正用のインソールの構造データを生成して提供するインソールデータ生成システム及びインソールデータ生成方法に関する。 The present invention relates to an insole data generation system and an insole data generation method, and particularly based on a user's walking habits extracted from a user's walking video taken by a user terminal, structural data of an insole for correction suitable for the user. The present invention relates to an insole data generation system and an insole data generation method.
 歩行は人間にとって最も基本的な動作の1つであるが、多くの人が長年自身の歩行姿勢を特に意識しないで歩行する結果、歩き方に癖がついてしまう傾向がある。歩き方の癖は通常は体の傾きとして現れ、連続歩行動作では体が一方又は左右に傾く歩行中の揺動として観察される。
 このような歩行時の癖は長年の歩行習慣の積み重ねにより定着化される場合の他、病気やけがなどの影響で正しい歩行姿勢を取りにくいような場合にも起こり得る。
Walking is one of the most basic movements for humans, but many people tend to have a habit of walking as a result of walking without being particularly conscious of their walking posture for many years. The habit of walking usually appears as a tilt of the body, and in a continuous walking motion, it is observed as a swing during walking in which the body leans to one side or left and right.
Such walking habits may occur not only when the walking habits are accumulated for many years, but also when it is difficult to take a correct walking posture due to the influence of illness or injury.
 歩行時の癖は軽度の場合は身体への影響は少ないが、程度がひどくなると膝や腰などに偏った負荷がかかり、関節の炎症や痛みなどの影響が出やすくなる。そこで歩行時の癖の強い人は身体への影響が出る前に、歩行時の癖を矯正することが重要である。
 歩行時の癖を矯正するには、靴の中に入れる中敷きであるインソールを、矯正効果を持たせるような形状に形成して使用するのが一般的である。矯正効果を持たせるような形状のインソールは、足底板とも呼ばれ、これを使用するユーザの歩行時の癖に合わせて個別に製作する必要があり、そのためにはまずユーザの歩行時の癖を把握する必要がある。
 歩行時の癖は、普段履いている靴の靴底の減り具合で、ある程度の傾向をつかむことはできるが、具体的にどこをどのように矯正すればよいかまでは把握できない。
If the habit of walking is mild, the effect on the body is small, but if the degree is severe, a biased load is applied to the knees and hips, and the effects of joint inflammation and pain are likely to occur. Therefore, it is important for people with strong walking habits to correct their walking habits before they affect the body.
In order to correct walking habits, it is common to form an insole, which is an insole to be put in shoes, into a shape that gives a corrective effect. An insole shaped to have a corrective effect is also called a sole plate, and it is necessary to individually manufacture it according to the walking habit of the user who uses it, and for that purpose, first the user's walking habit You need to figure it out.
The habit of walking can be grasped to some extent by the decrease in the soles of the shoes that are usually worn, but it is not possible to grasp exactly where and how to correct it.
 特許文献1には、感圧センサーおよび送受信手段が所定の複数箇所に配置されている中敷きを、テスト用中敷きとして所望する靴の内部に装着して、歩行時足裏に掛かる圧力を感圧センサーにより検出し、検出した圧力に基づき新たな中敷きの作製条件を求め、感圧センサーおよび送受信手段を配置した新たな中敷きを作製する中敷きの作成方法及びシステムが開示されている。 In Patent Document 1, an insole in which a pressure-sensitive sensor and transmission / reception means are arranged at a plurality of predetermined locations is attached to the inside of a shoe desired as a test insole, and the pressure applied to the sole of the foot during walking is measured by the pressure-sensitive sensor. A method and a system for producing a new insole in which a pressure-sensitive sensor and a transmission / reception means are arranged are disclosed.
 特許文献1によれば、ユーザの歩行中に、どこにどのような圧力が加わるかを的確に評価することができるので、ユーザの歩行時の癖に見合ったインソールを製作することが見込める。しかしながら特許文献1を実施するためには、ユーザは先ずテスト用中敷きを入手して圧力測定のための歩行を行う必要があり、また圧力測定結果に基づき作成する新たな中敷きにも感圧センサーおよび送受信手段が配置されるため、製作費も高くなり、また、製作する場所が限られ、ユーザは完成品が送られてくるのを待たなければならない。さらにリピートのオーダーも同様の制約を受けるという課題がある。
 そこで、感圧センサーなどの特別なツールを用意することなく、簡便にユーザの歩行時の癖が把握でき、またリピートの製作も容易に行うことが可能なインソールデータ生成システム及びインソールデータ生成方法の提供が期待される。
According to Patent Document 1, since it is possible to accurately evaluate where and what kind of pressure is applied while the user is walking, it is expected to manufacture an insole that matches the walking habit of the user. However, in order to carry out Patent Document 1, the user must first obtain a test insole and walk for pressure measurement, and a new insole created based on the pressure measurement result also has a pressure sensor and a pressure sensitive insole. Since the transmission / reception means are arranged, the production cost is high, the production place is limited, and the user has to wait for the finished product to be sent. Furthermore, there is a problem that repeat orders are subject to the same restrictions.
Therefore, an insole data generation system and an insole data generation method that can easily grasp the user's walking habits and easily produce repeats without preparing a special tool such as a pressure sensor. Expected to be provided.
特開2020-058464号公報Japanese Unexamined Patent Publication No. 2020-058464
 本発明は、上記従来のインソールデータ生成システム及びインソールデータ生成方法における問題点に鑑みてなされたものであって、本発明の目的は、ユーザ端末により撮影されたユーザの歩行動画から抽出されるユーザの歩行時の癖に基づき、ユーザに適した矯正用のインソールの構造データを生成して提供するインソールデータ生成システム及びインソールデータ生成方法を提供することにある。 The present invention has been made in view of the problems in the above-mentioned conventional insole data generation system and insole data generation method, and an object of the present invention is a user extracted from a user's walking video taken by a user terminal. It is an object of the present invention to provide an insole data generation system and an insole data generation method for generating and providing structural data of an insole for correction suitable for a user based on the habit of walking.
 上記目的を達成するためになされた本発明によるインソールデータ生成システムは、ユーザ端末により撮影されたユーザの歩行動画から抽出されるユーザの歩行時の癖に基づき、前記ユーザに適したインソールの構造データを生成して提供する情報提供サーバを備えるインソールデータ生成システムであって、前記情報提供サーバは、前記歩行動画から抽出されるユーザの歩行時の癖を保存して管理する歩行データ管理部と、前記歩行時の癖に基づき、前記歩行時の癖を矯正する矯正量を算出して矯正用のパッド構造データを生成するパッド構造データ生成部と、予め入力されたユーザの靴のサイズを含むユーザの基本情報に基づき前記靴のサイズに適合する標準のインソールに前記パッド構造データを組み込んだ矯正用のインソールの構造データを生成するインソール構造データ生成部とを有し、前記歩行時の癖は前記ユーザ端末に実装されたアプリケーションにより前記歩行動画から抽出されてユーザ端末から送信されるか、又はユーザ端末より送信される前記歩行動画から前記歩行データ管理部により抽出されるものであることを特徴とする。 The insole data generation system according to the present invention made to achieve the above object is based on the user's walking habits extracted from the user's walking video taken by the user terminal, and the insole structural data suitable for the user. An insole data generation system including an information providing server that generates and provides information, the information providing server includes a walking data management unit that stores and manages a user's walking habits extracted from the walking video. A user including a pad structure data generation unit that calculates a correction amount for correcting the walking habit based on the walking habit and generates pad structure data for correction, and a user's shoe size input in advance. It has an insole structure data generation unit that generates structural data of an insole for correction by incorporating the pad structure data into a standard insole that matches the size of the shoe based on the basic information of the above. It is characterized in that it is extracted from the walking video by an application implemented in the user terminal and transmitted from the user terminal, or is extracted from the walking video transmitted from the user terminal by the walking data management unit. do.
 前記歩行動画はユーザの正面又は背面から撮影し、少なくとも左右それぞれの足による歩行動作を含む動画であり、前記歩行時の癖は、歩行するユーザの正面又は背面から観測される体の所定箇所の中心軸又は基準線の傾きの変化であることが好ましい。
 前記情報提供サーバは、前記インソールの構造データを3Dプリンタの入力データとして構成して出力する3Dプリンタデータ生成部をさらに有することが好ましい。
The walking video is a video shot from the front or back of the user and includes walking movements by at least the left and right feet, and the walking habit is a predetermined portion of the body observed from the front or back of the walking user. It is preferably a change in the inclination of the central axis or the reference line.
It is preferable that the information providing server further has a 3D printer data generation unit that configures and outputs the structural data of the insole as input data of the 3D printer.
 上記目的を達成するためになされた本発明によるインソールデータの生成方法は、ユーザ端末により撮影されたユーザの歩行動画から抽出されるユーザの歩行時の癖に基づき、前記ユーザに適したインソールの構造データを生成して提供する情報提供サーバを備えるインソールデータ生成システムによるインソールデータの生成方法であって、ユーザ端末によりユーザの歩行動画を撮影する段階と、前記ユーザ端末又は情報提供サーバにより、前記歩行動画よりユーザの歩行時の癖を抽出する段階と、前記情報提供サーバにより、前記歩行時の癖に基づき、前記歩行時の癖を矯正する矯正量を算出して矯正用のパッド構造データを生成する段階と、前記情報提供サーバにより、予め入力されたユーザの靴のサイズを含むユーザの基本情報に基づき前記靴のサイズに適合する標準のインソールに前記パッド構造データを組み込んだ矯正用のインソールの構造データを生成する段階と、を有することを特徴とする。 The method for generating insole data according to the present invention, which has been made to achieve the above object, is based on the user's walking habits extracted from the user's walking video taken by the user terminal, and has an insole structure suitable for the user. It is a method of generating insole data by an insole data generation system including an information providing server that generates and provides data, and is a step of shooting a user's walking video by a user terminal and the walking by the user terminal or the information providing server. Based on the stage of extracting the user's walking habit from the video and the information providing server, the correction amount for correcting the walking habit is calculated based on the walking habit, and the pad structure data for correction is generated. And the corrective insole that incorporates the pad structure data into a standard insole that fits the shoe size based on the user's basic information including the user's shoe size pre-entered by the information providing server. It is characterized by having a stage of generating structural data.
 本発明に係るインソールデータ生成システム及びインソールデータ生成方法によれば、ユーザは自身のスマートフォンなどのユーザ端末により、自身の歩行するときの動画を撮影するだけでユーザの歩行時の癖を抽出するための情報の取得が完了するため、ユーザはインソールの製作の申し込みに圧力センサや形状センサなどの特別のツールを準備する必要がなく、非常に簡便にインソールデータ生成システムを利用することができる。 According to the insole data generation system and the insole data generation method according to the present invention, the user can extract the user's walking habits only by shooting a moving image of his / her walking with a user terminal such as his / her smartphone. Since the acquisition of the information is completed, the user does not need to prepare a special tool such as a pressure sensor or a shape sensor to apply for the production of the insole, and the insole data generation system can be used very easily.
 また、本発明に係るインソールデータ生成システム及びインソールデータ生成方法によれば、生成されたインソールの構造データは3Dプリンタの入力データとして構成されて出力されるので、ユーザは3Dプリンタを所有する場合、ユーザ端末に受信したインソールの構造データにより、3Dプリンタを使用して必要な時に必要な数だけ矯正用のインソールを作製することができる。ユーザ自身が3Dプリンタを所有していなくても、ユーザ端末に受信したインソールの構造データを、最寄りの3Dプリンタが利用できるショップに提供してインソールを作製することができるので、インソールデータ生成システムの遠隔地、例えば外国にいるユーザでもインソールデータ生成システムを利用して容易にインソールを作製することができる。 Further, according to the insole data generation system and the insole data generation method according to the present invention, the generated structural data of the insole is configured and output as input data of the 3D printer. Therefore, when the user owns the 3D printer, Based on the structural data of the insole received by the user terminal, it is possible to produce as many orthodontic insoles as necessary when necessary using a 3D printer. Even if the user does not own a 3D printer, the insole structure data received by the user terminal can be provided to a shop where the nearest 3D printer can be used to create an insole. Even a user in a remote place, for example, a foreign country can easily create an insole by using the insole data generation system.
本発明の実施形態によるインソールデータ生成システムの構成を概略的に示すブロック図である。It is a block diagram which shows schematic structure of the insole data generation system by embodiment of this invention. 本発明の実施形態によるユーザの歩行動画からユーザの歩行時の癖を抽出する方法を説明するための図である。It is a figure for demonstrating the method of extracting the habit at the time of walking of a user from the walking motion | moving image of the user by embodiment of this invention. 本発明の実施形態によるインソール装着によるユーザの歩行時の癖の改善を概略的に説明するための図である。It is a figure for demonstrating the improvement of the user's walking habit by wearing an insole according to the embodiment of this invention. 本発明の実施形態によるインソールデータ生成方法の手順を説明するためのフローチャートである。It is a flowchart for demonstrating the procedure of the insole data generation method by embodiment of this invention.
 次に、本発明に係るインソールデータ生成システム及びインソールデータ生成方法を実施するための形態の具体例を、図面を参照しながら詳細に説明する。
 図1は、本発明の実施形態によるインソールデータ生成システムの構成を概略的に示すブロック図である。
 図1を参照すると、本発明の実施形態によるインソールデータ生成システム1は、ネットワーク50を介して接続される情報提供サーバ10とユーザ端末20とを備える。図1ではユーザ端末20は1つだけを示すが、ユーザ端末20の数は任意であり、基本的に複数である。
Next, a specific example of the embodiment for implementing the insole data generation system and the insole data generation method according to the present invention will be described in detail with reference to the drawings.
FIG. 1 is a block diagram schematically showing a configuration of an insole data generation system according to an embodiment of the present invention.
Referring to FIG. 1, the insole data generation system 1 according to the embodiment of the present invention includes an information providing server 10 and a user terminal 20 connected via a network 50. Although only one user terminal 20 is shown in FIG. 1, the number of user terminals 20 is arbitrary and basically a plurality.
 本発明の実施形態によるインソールデータ生成システム1は、ユーザ端末20により撮影されたユーザの歩行動画から抽出されるユーザの歩行時の癖に基づき、ユーザに適したインソールの構造データを生成して提供するシステムである。
 人は歩く時に正しい姿勢を保つことを意識していないと、一方の肩が下がったり、膝が内側か外側に曲がっていたりするような癖のある歩き方が身に付いてしまうことがある。このような歩く時の癖の程度がひどくなると、身体に局所的な痛みなど影響が出やすくなることから、靴の中に入れて歩行時の癖を矯正するインソールが利用されてきた。これまでインソールの製作には、インソールを所望するユーザの足の詳細なサイズの測定や、足裏の圧力測定などの手間のかかる事前準備が必要であった。
The insole data generation system 1 according to the embodiment of the present invention generates and provides structural data of an insole suitable for the user based on the walking habit of the user extracted from the walking video of the user taken by the user terminal 20. It is a system to do.
If one is not aware of maintaining the correct posture when walking, one may develop a habit of walking with one shoulder down or the knee bent inward or outward. When the degree of walking habits becomes severe, local pain and other effects are likely to occur on the body, so insoles that are put in shoes to correct walking habits have been used. Until now, insole production has required time-consuming preparations such as detailed measurement of the foot size of the user who desires the insole and pressure measurement of the sole of the foot.
 本発明によるインソールデータ生成システム1は、こうした事前準備の手間を軽減し、またユーザが矯正用のインソールを製作してもらうために整形外科医院等へ出向くことなく遠隔地からでも気軽にインソールの製作を申し込める環境を提供するものである。 The insole data generation system 1 according to the present invention reduces the time and effort required for such advance preparation, and makes it easy for the user to manufacture an insole even from a remote location without going to an orthopedic clinic or the like to have the user manufacture an insole for correction. It provides an environment where you can apply for.
 本発明によるインソールデータ生成システム1によれば、インソールの使用が必要となったユーザは、ユーザ端末20により自身の歩行する動画を撮影するだけで、ユーザ端末20に実装したアプリケーションプログラム(以下アプリケーションと称す)により撮影した動画からユーザの歩行時の癖が抽出されて情報提供サーバ10に送信されるので、ユーザは容易にインソール製作のための基礎データの取得を行うことができる。 According to the insole data generation system 1 according to the present invention, a user who needs to use the insole can simply shoot a moving image of his / her walking by the user terminal 20 and implement an application program (hereinafter referred to as an application) on the user terminal 20. Since the user's walking habits are extracted from the moving image taken by (referred to as) and transmitted to the information providing server 10, the user can easily acquire the basic data for manufacturing the insole.
 ユーザ端末20からユーザの歩行時の癖を受信した情報提供サーバ10では、受信した歩行時の癖に基づき、歩行時の癖を矯正するための矯正量を算出して矯正用のパッド構造データを生成し、予め入力されたユーザの靴のサイズを含むユーザの基本情報に基づいて、靴のサイズに適合する標準のインソールにパッド構造データを組み込んだ矯正用のインソールの構造データを生成する。生成したインソールの構造データは3Dプリンタ(30、31)の入力データとして構成してユーザ端末20に出力されるので、ユーザが3Dプリンタ30を所有する場合は、そのまま受信したインソールの構造データを使ってその場でインソールを製作することができる。また、3Dプリンタ30を所有していない場合でも最寄りの3Dプリンタ31を設置した靴店などの店舗に受信したインソールの構造データを提供して製作してもらうことができる。 The information providing server 10 that has received the user's walking habit from the user terminal 20 calculates the correction amount for correcting the walking habit based on the received walking habit, and obtains the pad structure data for correction. Generate and generate structural data for the orthodontic insole that incorporates pad structure data into a standard insole that fits the shoe size, based on the user's basic information, including the user's shoe size pre-populated. Since the generated insole structure data is configured as input data of the 3D printers (30, 31) and output to the user terminal 20, when the user owns the 3D printer 30, the insole structure data received as it is is used. You can make an insole on the spot. Even if you do not own the 3D printer 30, you can provide the structural data of the insole received to a store such as a shoe store where the nearest 3D printer 31 is installed and have it manufactured.
 このようにインソールデータ生成システム1は、特別なツールを使用することなく非常に簡便にデータが取得でき、又遠隔地のユーザでも気軽にインソールを製作することが可能となるシステムである。 In this way, the insole data generation system 1 is a system that can acquire data very easily without using a special tool, and even a user in a remote place can easily manufacture an insole.
 図1を参照すると、情報提供サーバ10は、制御部11、入出力部12、記憶部13、表示部14、ユーザ登録部15、歩行データ管理部16、パッド構造データ生成部17、インソール構造データ生成部18、及び3Dプリンタデータ生成部19を備える。 Referring to FIG. 1, the information providing server 10 includes a control unit 11, an input / output unit 12, a storage unit 13, a display unit 14, a user registration unit 15, a walking data management unit 16, a pad structure data generation unit 17, and an insole structure data. A generation unit 18 and a 3D printer data generation unit 19 are provided.
 ユーザ登録部15は、ユーザが初めてインソールデータ生成システム1を利用する際に、ユーザ端末20から送信されるユーザの氏名、メールアドレスなどのユーザの基本情報を受け取り、新たなユーザ会員としてユーザ毎の固有の識別子であるユーザIDを発行してユーザの基本情報とともに記憶部13に保存して管理する。実施形態ではユーザの基本情報は、情報提供サーバ10が提供するWebサイトの中で必要な事項を入力するように入力フォーマットを提示し、ユーザが入力して送信することでユーザ登録部15に提供される。ユーザの基本情報にはユーザの靴のサイズなどインソールの製作に必要な情報も含む。 When the user uses the insole data generation system 1 for the first time, the user registration unit 15 receives the user's basic information such as the user's name and e-mail address transmitted from the user terminal 20, and as a new user member, each user A user ID, which is a unique identifier, is issued and stored in the storage unit 13 together with the basic information of the user for management. In the embodiment, the basic information of the user is provided to the user registration unit 15 by presenting an input format so as to input necessary items in the website provided by the information providing server 10 and inputting and transmitting the user. Will be done. The basic information of the user includes information necessary for manufacturing the insole such as the size of the user's shoes.
 一実施形態では、インソールの形状をよりユーザの足に適切な形に合わせるため、インソールの製作に必要な情報には、足部の荷重状態での足部正面と側面の画像データを含む。足部の荷重状態での足部正面と側面の画像データはユーザの足幅と足部の縦のアーチ形状のデータを取得するのに利用される。足部正面と側面の画像データはユーザ端末20に実装したアプリケーションによりユーザ端末20での撮影を促すようにユーザに提示してもよい。足部正面と側面の画像データは、左右それぞれの足で撮影し、また側面の画像は、左側面と右側面を含むように撮影するのが好ましい。
 ユーザ端末20から受信した足部正面と側面の画像データは、そのままユーザ登録部15がユーザの基本情報の一部として記憶部13に保存して管理してもよいし、情報提供サーバ10に、図1には示さない画像解析部などをさらに備えて、足部正面と側面の画像データからユーザの足幅と足部の縦のアーチ形状のデータを抽出し、抽出したユーザの足幅と足部の縦のアーチ形状のデータをユーザの基本情報の一部として記憶部13に保存して管理してもよい。他の実施形態では更に足部の非荷重状態での足部正面と側面の画像データを含み、荷重状態と非荷重状態での足幅と足部の縦のアーチ形状のデータの差分を抽出し、インソール作成時の参照データとするようユーザの基本情報の一部として記憶部13に保存して管理する。
 さらに、ユーザの基本情報には、歩行時の癖を矯正する矯正量を算出する際に参照するようユーザの身長などの情報を含めてもよい。
In one embodiment, in order to fit the shape of the insole to a shape more suitable for the user's foot, the information necessary for manufacturing the insole includes image data of the front and side surfaces of the foot under the load state of the foot. The image data of the front surface and the side surface of the foot under the load state of the foot is used to acquire the data of the foot width of the user and the vertical arch shape of the foot. The image data of the front surface and the side surface of the foot may be presented to the user by an application implemented in the user terminal 20 to encourage the user to take a picture. It is preferable that the image data of the front surface and the side surface of the foot are taken with each of the left and right feet, and the image of the side surface is taken so as to include the left side surface and the right side surface.
The image data of the front and side surfaces of the foot received from the user terminal 20 may be stored and managed by the user registration unit 15 as it is in the storage unit 13 as a part of the basic information of the user, or may be managed by the information providing server 10. An image analysis unit (not shown in FIG. 1) is further provided, and the user's foot width and the vertical arch shape data of the foot are extracted from the image data of the front and side surfaces of the foot, and the extracted user's foot width and foot are extracted. The data of the vertical arch shape of the unit may be stored and managed in the storage unit 13 as a part of the basic information of the user. In another embodiment, the image data of the front surface and the side surface of the foot in the unloaded state of the foot are further included, and the difference between the data of the foot width and the vertical arch shape of the foot in the loaded state and the unloaded state is extracted. , It is stored and managed in the storage unit 13 as a part of the basic information of the user so as to be the reference data at the time of creating the insole.
Further, the basic information of the user may include information such as the height of the user so as to be referred to when calculating the correction amount for correcting the habit of walking.
 歩行データ管理部16は、ユーザ端末20により撮影されたユーザの歩行動画から、ユーザ端末20に実装されたアプリケーションにより抽出されたユーザの歩行時の癖を受信し、ユーザIDと関連付けて記憶部13に保存して管理する。
 ここでユーザの歩行動画は、ユーザの正面又は背面から撮影し、少なくとも左右それぞれの足による歩行動作を含む動画であり、少なくとも左右それぞれで2、3歩の歩行が含まれる動画であることが好ましい。また、歩行時の癖は、歩行するユーザの正面又は背面から観測される体の所定箇所の中心軸又は基準線の傾きの変化である。所定箇所の中心軸又は基準線は、例えば胴体の中心軸である体幹の軸や肩の基準線、骨盤の基準線、膝の基準線、足の基準線などを含む。
The walking data management unit 16 receives the walking habit of the user extracted by the application implemented in the user terminal 20 from the walking video of the user taken by the user terminal 20, and associates it with the user ID in the storage unit 13. Save and manage in.
Here, the walking video of the user is a video shot from the front or the back of the user and includes walking movements by at least the left and right feet, and is preferably a video including walking of at least two or three steps on each of the left and right feet. .. Further, the habit of walking is a change in the inclination of the central axis or the reference line of a predetermined position of the body observed from the front or the back of the walking user. The central axis or reference line at a predetermined location includes, for example, the axis of the trunk, which is the central axis of the torso, the reference line of the shoulder, the reference line of the pelvis, the reference line of the knee, the reference line of the foot, and the like.
 上記の実施形態では、歩行時の癖はユーザ端末20に実装されたアプリケーションにより抽出されるとしたが、他の実施形態では、ユーザ端末20により撮影されたユーザの歩行動画はユーザ端末20に保存された後、歩行時の癖を抽出することなくそのまま情報提供サーバ10に送信される。そこで歩行データ管理部16は歩行動画から歩行時の癖を抽出する手段を備え、ユーザ端末20から受信したユーザの歩行動画から歩行時の癖を抽出し、当該ユーザのユーザIDと関連付けて記憶部13に保存して管理する。 In the above embodiment, the walking habit is extracted by the application implemented in the user terminal 20, but in other embodiments, the walking video of the user taken by the user terminal 20 is stored in the user terminal 20. After that, it is transmitted to the information providing server 10 as it is without extracting the habit of walking. Therefore, the walking data management unit 16 is provided with a means for extracting the walking habit from the walking video, extracts the walking habit from the walking video of the user received from the user terminal 20, and associates it with the user ID of the user to store the habit. Save and manage in 13.
 一実施形態では、歩行時の癖の抽出は、足の着地のタイミングから足を蹴り出して地面を離れるタイミングまでの間に、体の所定箇所の中心軸又は基準線の傾きを、足の地面への付き方又は所定の時間間隔に対応して取得するようにする。
 また、一実施形態では、歩行データ管理部16は、ユーザの歩行動画に歩行時の癖を抽出する際に使用するユーザの体の所定箇所の中心軸又は基準線を重ね合わせて、ユーザが歩行中にどのように中心軸や基準線が傾いているかを可視化可能に提供する。これは例えば情報提供サーバ10が提供するWebサイトの中で、ユーザ毎に独自の情報ページをユーザのマイページとして提供し、マイページの中で閲覧可能に提供することで実現可能である。さらに、インソールデータ生成システム1を利用して製作したインソールを使用して歩行した場合の歩行動画からも同様に歩行時の癖を抽出し、インソール使用前後の軸や基準線の傾きの改善具合を可視化可能に提供するようにしてもよい。このようにすることで、ユーザは自身の歩行時の癖を視覚的に把握し、自身の歩行姿勢の改善に意識を向けやすくなる。
In one embodiment, the extraction of walking habits is performed by determining the inclination of the central axis or the reference line of a predetermined part of the body from the timing of landing of the foot to the timing of kicking the foot and leaving the ground. It should be acquired according to how to attach to or at a predetermined time interval.
Further, in one embodiment, the walking data management unit 16 superimposes a central axis or a reference line of a predetermined portion of the user's body used when extracting a walking habit on the walking video of the user, and the user walks. It provides a visualization of how the central axis and reference line are tilted inside. This can be realized, for example, by providing a unique information page for each user as a user's My Page in the Web site provided by the Information Providing Server 10, and providing the information page so that it can be viewed in the My Page. Furthermore, the habit of walking is similarly extracted from the walking video when walking using the insole manufactured using the insole data generation system 1, and the degree of improvement in the inclination of the axis and the reference line before and after using the insole is improved. It may be provided so that it can be visualized. By doing so, the user can easily grasp his / her walking habits and focus on improving his / her walking posture.
 尚、歩行動画は体の所定箇所の中心軸や基準線を正しく識別するために、歩行動画中ユーザの全身が含まれるように撮影される必要があるが、ユーザの身長が既知であれば、歩行開始から終了までの歩行時間とユーザの全身の画角と歩数から、ユーザの歩行距離、歩行速度、歩幅が算出可能であることから、上記Webサイトのマイページの中でユーザの歩行データとして歩行速度、歩幅などを提供するようにしてもよい。さらに、歩行データ管理部16は、ユーザに歩行速度を変えた動画の撮影を促し、歩行速度の違いによる歩行時の癖の違いを求め、その結果をインソールの製作に反映してもよい。 In addition, the walking video needs to be recorded so that the whole body of the user is included in the walking video in order to correctly identify the central axis and the reference line of a predetermined part of the body, but if the height of the user is known, the walking video needs to be recorded. Since the user's walking distance, walking speed, and stride can be calculated from the walking time from the start to the end of walking and the angle and number of steps of the user's whole body, it is used as the user's walking data in My Page of the above website. Walking speed, stride length, etc. may be provided. Further, the walking data management unit 16 may encourage the user to shoot a moving image in which the walking speed is changed, obtain a difference in walking habits due to the difference in walking speed, and reflect the result in the production of the insole.
 パッド構造データ生成部17は、歩行データ管理部16からユーザの歩行時の癖を取得し、歩行時の癖に基づき、歩行時の癖を矯正する矯正量を算出して矯正用のパッド構造データを生成する。例えばユーザが歩行時に右に傾く癖を有する場合、右足の外側にパッドを挿入するように矯正する。その際パッドの高さは歩行時のユーザの体の所定箇所の中心軸や基準線の傾きの値を参照して傾きがなくなるようにして求める。また歩行時の癖のデータが足の着地の状態又は時間経過と対応して取得されている場合は、足の前後方向のどの位置でどれだけの矯正が必要かを算出することができるので、より細かいフィッティングが可能となる。 The pad structure data generation unit 17 acquires the user's walking habit from the walking data management unit 16, calculates the correction amount for correcting the walking habit based on the walking habit, and calculates the correction amount of the pad structure data for correction. To generate. For example, if the user has a habit of leaning to the right when walking, correct the pad to be inserted on the outside of the right foot. At that time, the height of the pad is obtained by referring to the value of the inclination of the central axis or the reference line at a predetermined position of the user's body during walking so that the inclination disappears. In addition, if the data on walking habits is acquired in correspondence with the landing state of the foot or the passage of time, it is possible to calculate how much correction is required at which position in the front-back direction of the foot. Finer fitting is possible.
 パッド構造データ生成部17が生成するパッド構造データは、歩行時の傾きを矯正するため、パッドを設置する位置が靴の中心線から離れるほど高く設定することになる。そこで実施形態では、パッド構造データ生成部17は標準的な靴のサイズに合わせた形で必要なパッドの高さを算出する。他の実施形態では、ユーザ登録の際に入力されたユーザの靴のサイズ及び足部正面と側面の画像データ、又はこれら画像データから抽出されたユーザの足幅と足部の縦のアーチ形状のデータを参照し、ユーザの靴のサイズに合わせたパッドの高さを算出するように構成する。 The pad structure data generated by the pad structure data generation unit 17 is set higher as the position where the pad is installed is farther from the center line of the shoe in order to correct the inclination during walking. Therefore, in the embodiment, the pad structure data generation unit 17 calculates the required pad height according to the standard shoe size. In another embodiment, the user's shoe size and foot front and side image data entered during user registration, or the user's foot width and vertical arch shape of the foot extracted from these image data. It is configured to refer to the data and calculate the pad height according to the size of the user's shoes.
 パッド構造データは、歩行時の癖を矯正する矯正量に基づくものであり、最終的には生成したパッド構造データを盛り込んだインソールを使用するのが望ましいが、ユーザによってはいきなり理想的なインソールを使用すると違和感を生ずることも起こり得る。そこで一実施形態では理想的な高さのパッド構造データに加えて、プラス側とマイナス側に高さを変えたパッド構造データを生成し、これらのデータを盛り込んだインソールのデータをユーザに選択可能に提供する。これによりユーザは段階的に歩行姿勢を改善することも可能となる。 The pad structure data is based on the amount of correction that corrects habits during walking, and it is desirable to use an insole that includes the generated pad structure data in the end, but depending on the user, an ideal insole may be used suddenly. It may cause discomfort when used. Therefore, in one embodiment, in addition to the pad structure data of the ideal height, the pad structure data in which the height is changed to the plus side and the minus side is generated, and the data of the insole incorporating these data can be selected by the user. To provide to. This also enables the user to gradually improve the walking posture.
 インソール構造データ生成部18は、ユーザの靴のサイズの情報に基づき靴のサイズに適合する標準のインソールにパッド構造データ生成部17から取得するパッド構造データを組み込んだ矯正用のインソールの構造データを生成する。
 パッド構造データが標準的な靴のサイズに合わせた形で生成されている場合は、インソール構造データ生成部18は、ユーザの靴のサイズに適合する標準のインソールを選択した後、標準的な靴のサイズとユーザの靴のサイズの比率に基づきパッド構造データを補正して、選択したインソール上に配置するようにし、パッド構造データを組み込んだ矯正用のインソールの構造データを生成する。パッド構造データがユーザの靴のサイズ及び足部正面と側面の画像データから得られる足幅や縦のアーチ形状に合わせたパッドのデータとして生成されている場合は、インソール構造データ生成部18は、ユーザの靴のサイズに適合する標準のインソールにそのままパッド構造データを組み込み、インソールの構造データを生成する。
The insole structure data generation unit 18 incorporates the pad structure data acquired from the pad structure data generation unit 17 into a standard insole that matches the shoe size based on the user's shoe size information, and obtains structural data of the insole for correction. Generate.
If the pad structure data is generated in a form that matches the standard shoe size, the insole structure data generator 18 selects a standard insole that matches the user's shoe size, and then the standard shoe. The pad structure data is corrected based on the ratio of the size of the insole to the size of the user's shoes so that the pad structure data is placed on the selected insole, and the structure data of the insole for correction incorporating the pad structure data is generated. When the pad structure data is generated as pad data according to the foot width and the vertical arch shape obtained from the image data of the user's shoe size and the front and side of the foot, the insole structure data generation unit 18 may generate the pad structure data. The pad structure data is directly incorporated into the standard insole that matches the size of the user's shoe, and the structure data of the insole is generated.
 3Dプリンダデータ生成部19は、インソールの構造データを3Dプリンタ(30、31)の入力データとして構成して出力する。3Dプリンタ(30、31)は個人向けの卓上型から、業務用の大型の装置など様々な機種が市販されているが、STL(Standard Triangulated Language)形式と呼ばれる形式でデータを構成すれば、基本的にはどの機種でもデータを読み込んで3次元加工を行うことができる。そこで3Dプリンダデータ生成部19は、インソール構造データ生成部18で生成したインソールの構造データをSTL形式のデータとして構成し、インソールデータの生成を申し込んだユーザ端末20に出力する。 The 3D printer data generation unit 19 configures and outputs the structural data of the insole as input data of the 3D printers (30, 31). There are various models of 3D printers (30, 31) on the market, from desktop type for personal use to large equipment for business use, but if the data is configured in the format called STL (Standard Triangled Language) format, it is basic. Any model can read data and perform 3D processing. Therefore, the 3D printer data generation unit 19 configures the insole structure data generated by the insole structure data generation unit 18 as STL format data, and outputs the data to the user terminal 20 that has applied for the generation of the insole data.
 これによりユーザは所有する3Dプリンタ30又は3Dプリンタ31が備えられる最寄りの店舗で3次元加工して、すぐにインソールを入手することができる。勿論、遠隔地のユーザで自身も周辺の店舗も3Dプリンタ(30、31)を所有していない場合は、情報提供サーバ10の管理者が所有する3Dプリンタでインソールを製作し、完成したインソールをユーザに送り届けるようにしてもよい。 As a result, the user can perform 3D processing at the nearest store equipped with the 3D printer 30 or 3D printer 31 owned by the user and immediately obtain the insole. Of course, if you are a remote user and neither you nor the stores in the vicinity own a 3D printer (30, 31), make an insole with the 3D printer owned by the administrator of the information providing server 10 and use the completed insole. It may be delivered to the user.
 入出力部12は、ユーザ端末20からユーザの基本情報やユーザの歩行動画又は歩行時の癖を受信したり、生成したインソール構造データの3Dプリンタ用データを送信したりするための通信手段や、情報提供サーバ10に文字データを入力するためのキーボードやデータ選択操作などのためのマウスを含む。
 記憶部13は、ユーザの基本情報や生成したパッド構造データ、インソールの構造データ、3Dプリンタ(30、31)の入力データなどの各種データの他、情報提供サーバ10自身を制御する制御プログラムなどを保存する。記憶部13は、ハードディスクなどの記憶媒体により実現化され、記憶する情報が多い場合は外付けのメモリ装置として構成してもよい。
The input / output unit 12 is a communication means for receiving the user's basic information, the user's walking video or walking habit from the user terminal 20, and transmitting the generated insole structure data for a 3D printer, and the communication means. The information providing server 10 includes a keyboard for inputting character data and a mouse for data selection operations.
The storage unit 13 stores various data such as basic user information, generated pad structure data, insole structure data, and input data of 3D printers (30, 31), as well as a control program for controlling the information providing server 10 itself. save. The storage unit 13 is realized by a storage medium such as a hard disk, and may be configured as an external memory device when there is a large amount of information to be stored.
 表示部14は、記憶部13に保存した各種データや制御プログラムなどを表示する。表示部14は、液晶表示装置などで実現化される。
 制御部11は、記憶部13に保存した制御プログラムに従い、情報提供サーバ10の各構成要素が上記で説明した機能を果たすように制御する。
The display unit 14 displays various data, control programs, and the like stored in the storage unit 13. The display unit 14 is realized by a liquid crystal display device or the like.
The control unit 11 controls each component of the information providing server 10 so as to perform the function described above according to the control program stored in the storage unit 13.
 ユーザ端末20は、制御部21、入出力部22、記憶部23、表示部24、動画取得部25、及び3Dプリンタデータ管理部26を備える。
 動画取得部25は、ユーザの歩行動画を取得するための手段である。ユーザの歩行動画は正面又は背面からユーザの歩行の状態を撮影したものであり、左右の足がそれぞれ2、3歩歩く程度の状態を撮影したものである。この間ユーザの体の所定箇所の中心軸や基準線の傾きを観察するため、歩行動画中ではユーザの全身が写り込んでいる必要がある。またユーザの歩行動画を撮影する際、ユーザの体の所定箇所の中心軸や基準線の傾きをできるだけ正しく観察するために、動画取得部25の備えるレンズは、水平で正しくユーザの歩行方向に向いて固定されている必要がある。そこでユーザ端末20に実装するインソールデータ生成システム1を利用するためのアプリケーションで、動画取得部25のレンズ又はユーザ端末20の筐体の向きを検知して、正しく固定されているか否かをユーザ端末20の表示部24に表示するようにしてもよい。動画取得部25は、取得した歩行動画を記憶部23に保存する。
 動画取得部25は、動画取得に限らず静止画を取得する画像取得部を兼ねてもよい。即ち前述のように実施形態では、ユーザが初めてインソールデータ生成システム1を利用する際に送信するユーザの基本情報には、足部正面と側面の画像データを含むが、このような足部正面と側面の画像はアプリケーションの制御のもとで動画取得部25により取得するようにしてもよい。この場合足部正面と側面の画像は上述の歩行動画とは区別して記憶部23に保存されるとともに、情報提供サーバ10に送信される。
The user terminal 20 includes a control unit 21, an input / output unit 22, a storage unit 23, a display unit 24, a moving image acquisition unit 25, and a 3D printer data management unit 26.
The moving image acquisition unit 25 is a means for acquiring a walking motion of the user. The walking video of the user is a photograph of the walking state of the user from the front or the back, and is a state in which the left and right feet walk a few steps, respectively. During this time, in order to observe the inclination of the central axis and the reference line at a predetermined position of the user's body, it is necessary that the whole body of the user is reflected in the walking video. Further, when shooting a walking video of the user, the lens provided in the video acquisition unit 25 is horizontally and correctly oriented in the walking direction of the user in order to observe the inclination of the central axis and the reference line at a predetermined position of the user's body as accurately as possible. Must be fixed. Therefore, an application for using the insole data generation system 1 mounted on the user terminal 20 detects the orientation of the lens of the moving image acquisition unit 25 or the housing of the user terminal 20 and determines whether or not the user terminal is correctly fixed. It may be displayed on the display unit 24 of 20. The moving image acquisition unit 25 stores the acquired walking moving image in the storage unit 23.
The moving image acquisition unit 25 is not limited to the moving image acquisition unit, and may also serve as an image acquisition unit for acquiring a still image. That is, as described above, in the embodiment, the user's basic information transmitted when the user uses the insole data generation system 1 for the first time includes image data of the front and side surfaces of the foot, but the front of the foot and the like. The side image may be acquired by the moving image acquisition unit 25 under the control of the application. In this case, the images of the front surface and the side surface of the foot are stored in the storage unit 23 separately from the above-mentioned walking motion, and are transmitted to the information providing server 10.
 3Dプリンタデータ管理部26は、情報提供サーバ10からインソールの構造データを3Dプリンタ(30、31)の入力データ用に構成したデータを受信して、記憶部23に保存する。インソールを製作する場合、3Dプリンタデータ管理部26は、記憶部23から3Dプリンタ(30、31)の入力データを呼び出し、ユーザが所有する3Dプリンタ30又は最寄りの店舗が備える3Dプリンタ31に出力する。前述のように一実施形態で、情報提供サーバ10から理想的な高さのパッド構造データを組み込んだインソールの他に、プラス側とマイナス側に高さを変えたパッド構造データを組み込んだインソールを出力した場合は、どのインソールデータを使用するかを選択可能にユーザ端末20の表示画面に表示し、ユーザの選択したデータを3Dプリンタ30または31に出力する。 The 3D printer data management unit 26 receives data configured for input data of the 3D printers (30, 31) from the information providing server 10 and stores the structural data of the insole in the storage unit 23. When manufacturing an insole, the 3D printer data management unit 26 calls the input data of the 3D printer (30, 31) from the storage unit 23 and outputs the input data to the 3D printer 30 owned by the user or the 3D printer 31 provided in the nearest store. .. As described above, in one embodiment, in addition to the insole incorporating the pad structure data of the ideal height from the information providing server 10, the insole incorporating the pad structure data having different heights on the plus side and the minus side is provided. When it is output, it is possible to select which insole data to use and display it on the display screen of the user terminal 20, and the data selected by the user is output to the 3D printer 30 or 31.
 またユーザ端末20は、取得した歩行動画から歩行時の癖を抽出する場合、歩行データ管理部27をさらに備える。歩行データ管理部27は、ユーザ端末20に実装するアプリケーションに従い、取得した歩行動画からユーザの体の所定箇所の中心軸の傾き又は基準線の変化を歩行時の癖として抽出する。歩行データ管理部16に関して前述したように、実施形態では、歩行時の癖の抽出は、足の着地のタイミングから足を蹴り出して地面を離れるタイミングまでの間に、体の所定箇所の中心軸や基準線の傾きを足の地面への付き方又は所定の時間間隔に対応して取得するようにする。 Further, the user terminal 20 further includes a walking data management unit 27 when extracting a walking habit from the acquired walking video. The walking data management unit 27 extracts the inclination of the central axis of a predetermined portion of the user's body or the change of the reference line as a habit during walking from the acquired walking moving image according to the application implemented in the user terminal 20. As described above with respect to the walking data management unit 16, in the embodiment, the extraction of the habit during walking is performed on the central axis of a predetermined position of the body between the timing of landing the foot and the timing of kicking the foot and leaving the ground. And the inclination of the reference line should be acquired according to how the foot touches the ground or a predetermined time interval.
 抽出した歩行時の癖はユーザ端末20から情報提供サーバ10に送信される。
 この場合も、ユーザ端末20に保存した歩行動画を再生する際に、ユーザの歩行時の癖を抽出する際に使用する中心軸線や基準線を重ね合わせて、ユーザが自身の歩行時の癖を認識しやすいように表示するようにしてもよい。
The extracted walking habit is transmitted from the user terminal 20 to the information providing server 10.
Also in this case, when playing back the walking video saved in the user terminal 20, the central axis and the reference line used for extracting the walking habit of the user are superimposed, and the user can express his / her own walking habit. It may be displayed so that it can be easily recognized.
 入出力部22は、ユーザの基本情報やユーザの歩行動画又は歩行時の癖を送信したり、情報提供サーバ10からインソール構造データの3Dプリンタ用データを受信したりするための通信手段や、ユーザ端末20に文字を入力する文字入力手段や、表示部24に表示されたデータを選択したり表示画面を移動したりする表示画面操作手段を備える。文字入力手段や表示画面操作手段はタッチパネルにより実現可能である。 The input / output unit 22 is a communication means for transmitting basic information of the user, a walking video of the user, or a habit of walking, and receiving data for a 3D printer of insole structure data from the information providing server 10, or a user. A character input means for inputting characters to the terminal 20 and a display screen operation means for selecting data displayed on the display unit 24 and moving the display screen are provided. Character input means and display screen operation means can be realized by a touch panel.
 記憶部23は、歩行動画や歩行動画から抽出される歩行時の癖などのデータの他、ユーザ端末20の基本動作を制御する制御プログラムやインソールデータ生成システム1を利用するためのアプリケーションなどのプログラムを保存する。
 表示部24は歩行動画や歩行時の癖などの各種データの他、必要により記憶部23に保存した各種プログラムを表示する。
The storage unit 23 includes data such as walking videos and walking habits extracted from walking videos, as well as programs such as a control program for controlling the basic operation of the user terminal 20 and an application for using the insole data generation system 1. To save.
The display unit 24 displays various data such as walking moving images and walking habits, as well as various programs stored in the storage unit 23 as needed.
 制御部21は、記憶部23に保存した制御プログラムに従い、ユーザ端末20の各構成要素が上記機能を果たすように制御する。
 ユーザ端末20はカメラを備えるスマートフォンやタブレット端末などにより実現可能である。
 情報提供サーバ10とユーザ端末20とを接続するネットワーク50は、海外からもアクセス可能な広域な通信網であることが好ましく、実施形態ではインターネットである。
The control unit 21 controls each component of the user terminal 20 to perform the above function according to the control program stored in the storage unit 23.
The user terminal 20 can be realized by a smartphone or a tablet terminal provided with a camera.
The network 50 connecting the information providing server 10 and the user terminal 20 is preferably a wide-area communication network that can be accessed from overseas, and is the Internet in the embodiment.
 図2は、本発明の実施形態によるユーザの歩行動画からユーザの歩行時の癖を抽出する方法を説明するための図である。図2(a)はユーザ端末20により取得された歩行動画の1画面を示す図であり、図2(b)は歩行動画から歩行時の癖を抽出するための所定箇所の軸及び基準線を重ね合わせた図である。 FIG. 2 is a diagram for explaining a method of extracting a user's walking habit from a user's walking moving image according to the embodiment of the present invention. FIG. 2A is a diagram showing one screen of a walking video acquired by the user terminal 20, and FIG. 2B is a diagram showing axes and reference lines at predetermined positions for extracting habits during walking from the walking video. It is a superposed figure.
 図2(b)を参照すると、歩行時の癖を抽出する歩行データ管理部16または27は、歩行動画の画像データの中で画像認識によりユーザを認識し、ユーザの外形からユーザの胴の中心線となる体幹の軸200、両肩を結ぶ肩の基準線210、左右の骨盤の高さを結ぶ骨盤の基準線220、大腿部の中心軸230と下腿部の中心軸231の交点で示される膝の基準線、及び足の幅方向の中心線となる足の基準線240などを求め、これらの軸と鉛直線又は水平線とのずれ角度を歩行時の癖として抽出する。肩の基準線210、骨盤の基準線220は水平線とのずれ角度として示すが、肩幅の中心、骨盤幅の中心でそれぞれの垂線を引いて中心軸を求め、これらの中心軸と鉛直線とのずれ角度を求めてもよい。
 このように所定箇所の中心軸や基準線の傾きを求めることにより矢印A、B、Cで示すように体全体の相対的な傾きの状況を明確にすることができる。
Referring to FIG. 2B, the walking data management unit 16 or 27 that extracts the habit during walking recognizes the user by image recognition in the image data of the walking moving image, and the center of the user's torso from the outer shape of the user. The axis 200 of the trunk, which is the line, the reference line 210 of the shoulder connecting both shoulders, the reference line 220 of the pelvis connecting the heights of the left and right pelvis, the intersection of the central axis 230 of the thigh and the central axis 231 of the lower leg. The reference line of the knee shown by (1), the reference line 240 of the foot which is the center line in the width direction of the foot, and the like are obtained, and the deviation angle between these axes and the vertical line or the horizontal line is extracted as a habit during walking. The shoulder reference line 210 and the pelvis reference line 220 are shown as deviation angles from the horizon. The deviation angle may be obtained.
By obtaining the inclination of the central axis and the reference line at a predetermined position in this way, it is possible to clarify the relative inclination of the whole body as shown by arrows A, B, and C.
 図3は、本発明の実施形態によるインソール装着によるユーザの歩行時の癖の改善を概略的に説明するための図である。
 図3(a)は、インソール装着前の歩行動画の一画面に代表的な中心軸及び基準線を重ね合わせた図であり、図3(b)はインソール装着後の歩行動画の一画面に代表的な中心軸及び基準線を重ね合わせた図であり、いずれも実際の歩行動画の一画面をトレースして模式化した図である。
FIG. 3 is a diagram for schematically explaining the improvement of the user's walking habit by wearing the insole according to the embodiment of the present invention.
FIG. 3A is a diagram in which a typical central axis and a reference line are superimposed on one screen of a walking video before the insole is attached, and FIG. 3B is a representative screen of the walking video after the insole is attached. It is a diagram in which a typical insole and a reference line are superimposed, and each is a diagram in which one screen of an actual walking motion is traced and modeled.
 図3(a)を参照すると、代表的な中心軸及び基準線として体幹の軸200と肩の基準線210を重ね合わせているが、左肩が下がり、上半身が左に傾く傾向が認められる。
 図3(b)を参照すると、図3(a)の歩行時の癖を解消するようにパッド310が組み込まれたインソール300を装着して歩行した歩行動画の一画面では、肩の基準線210が水平になり、体幹の軸200も正しく鉛直方向に向くように矯正されたことが認められる。
Referring to FIG. 3A, the trunk axis 200 and the shoulder reference line 210 are overlapped as typical central axes and reference lines, but the left shoulder tends to be lowered and the upper body tends to be tilted to the left.
Referring to FIG. 3 (b), in one screen of a walking video in which an insole 300 incorporating a pad 310 is attached so as to eliminate the walking habit of FIG. 3 (a), a shoulder reference line 210 is used. Is horizontal, and it is recognized that the axis 200 of the trunk is also corrected so as to face the vertical direction correctly.
 図3のユーザの例では、時間を追ったユーザの歩行時の各軸の傾きの状況から、左足の着地の時点から左に傾く傾向があり、インソール300は特に左足の左側に長くパッド310を組み込む形で生成される。 In the example of the user in FIG. 3, the insole 300 tends to tilt to the left from the time of landing of the left foot due to the inclination of each axis during walking of the user over time, and the insole 300 has a long pad 310 especially on the left side of the left foot. Generated in a built-in form.
 図4は、本発明の実施形態によるインソールデータ生成方法の手順を説明するためのフローチャートである。
 図4を参照すると、段階S410にてユーザ端末20によりユーザの歩行動画を撮影する。ユーザの歩行動画はユーザの全身を正面又は背面から撮影し、少なくとも左右それぞれの足による歩行動作を含む動画である。歩行時の癖をできる限り正確に把握するため、ユーザ端末20に実装するアプリケーションにより、歩行動画は複数回撮影するようにユーザに指示するようにしてもよい。また別の実施形態で所定の距離を何往復か歩行するようにユーザに指示を出し、1回の撮影で複数回の動画をまとめて撮影するようにしてもよい。
FIG. 4 is a flowchart for explaining the procedure of the insole data generation method according to the embodiment of the present invention.
Referring to FIG. 4, the walking motion of the user is captured by the user terminal 20 in step S410. The walking video of the user is a video in which the whole body of the user is shot from the front or the back, and the walking motion by at least the left and right feet is included. In order to grasp the walking habit as accurately as possible, the user may be instructed to shoot the walking moving image a plurality of times by an application implemented on the user terminal 20. Further, in another embodiment, the user may be instructed to walk a predetermined distance several times, and a plurality of moving images may be collectively shot in one shooting.
 次に段階S420にて、ユーザ端末20の歩行データ管理部16、又はユーザ端末20から歩行動画を受信した情報提供サーバ10の歩行データ管理部27によりユーザの歩行時の癖を抽出する。歩行時の癖の抽出は、画像認識により歩行者の外形を認識し、体幹の軸200や肩の基準線210などの体の所定箇所の中心軸又は基準線を求め、これらの中心軸や基準線の鉛直線又は水平線との傾きを求めることで抽出することができる。上記の様に複数の歩行動画を撮影した場合は、それぞれの中心軸や基準線の平均的な傾きを求めることでより正確な歩行時の癖を抽出することができる。また、往復の歩行動画を撮影した場合は、往路、復路をそれぞれ1回の歩行動画として抽出し、上記の様に平均的な歩行時の癖を抽出する。 Next, in step S420, the walking data management unit 16 of the user terminal 20 or the walking data management unit 27 of the information providing server 10 that has received the walking video from the user terminal 20 extracts the walking habit of the user. To extract habits during walking, the outer shape of a pedestrian is recognized by image recognition, and the central axis or reference line of a predetermined part of the body such as the trunk axis 200 or the shoulder reference line 210 is obtained, and these central axes or reference lines are obtained. It can be extracted by finding the slope of the reference line with the vertical line or the horizontal line. When a plurality of walking videos are taken as described above, more accurate walking habits can be extracted by obtaining the average inclination of each central axis and reference line. In addition, when a round-trip walking video is taken, the outward route and the inbound route are each extracted as one walking video, and the average walking habit is extracted as described above.
 抽出された歩行時の癖は、情報提供サーバ10のパッド構造データ生成部17に送られ、パッド構造データ生成部17は段階S430にて歩行時の癖に基づき、歩行時の癖を矯正する矯正量を算出して矯正用のパッド構造データを生成する。パッド構造データは標準的なサイズの靴に対するパッドの高さとして算出する。尚、矯正量を算出する際、ユーザ登録時に入力したユーザの身長を参照してユーザの肩幅や骨盤の幅を求め、肩や骨盤の左右の高さの差を算出して矯正量の算出に利用するようにしてもよい。 The extracted walking habit is sent to the pad structure data generation unit 17 of the information providing server 10, and the pad structure data generation unit 17 corrects the walking habit based on the walking habit in step S430. The amount is calculated to generate pad structure data for correction. Pad structure data is calculated as the height of the pad relative to standard size shoes. When calculating the correction amount, the user's shoulder width and pelvis width are obtained with reference to the user's height entered at the time of user registration, and the difference between the left and right heights of the shoulder and pelvis is calculated to calculate the correction amount. You may use it.
 情報提供サーバ10のインソール構造データ生成部18は、段階S440にて、予め入力されたユーザの靴のサイズ及び足部正面と側面の画像データ、又はこれら画像データから抽出されたユーザの足幅と足部の縦のアーチ形状のデータに基づき、靴のサイズに適合する標準のインソールにパッド構造データを組み込んだ矯正用のインソールの構造データを生成する。インソール構造データ生成部18は、パッド構造データを組み込む際、標準的なサイズの靴とユーザの靴のサイズとの違いによりパッド構造データにおけるパッドの高さを補正するようにする。 The insole structure data generation unit 18 of the information providing server 10 has the user's shoe size and foot front and side image data input in advance in step S440, or the user's foot width extracted from these image data. Based on the data of the vertical arch shape of the foot, the structural data of the insole for correction is generated by incorporating the pad structure data into the standard insole suitable for the shoe size. When incorporating the pad structure data, the insole structure data generation unit 18 corrects the height of the pad in the pad structure data due to the difference between the standard size shoe and the user's shoe size.
 最後に段階S450にて情報提供サーバ10の3Dプリンダデータ生成部19は、インソールの構造データを3Dプリンタ(30、31)の入力データとして構成してユーザ端末20に出力する。 Finally, in step S450, the 3D printer data generation unit 19 of the information providing server 10 configures the structural data of the insole as input data of the 3D printers (30, 31) and outputs it to the user terminal 20.
 インソールの構造データを受信したユーザが実際にインソールを製作する場合、ユーザは受信したインソールの構造データである3Dプリンタ(30、31)の入力データを、ユーザが所有する3Dプリンタ30に送信して(段階S460)加工を行う(段階S470)。
 ユーザが3Dプリンタ30を所有していない場合、ユーザは3Dプリンタ31を備える最寄りの店舗に赴くか、最寄りの店舗にデータを送信してインソールを製作してもらうこともできる。
When the user who receives the structural data of the insole actually manufactures the insole, the user transmits the input data of the 3D printer (30, 31) which is the structural data of the received insole to the 3D printer 30 owned by the user. (Step S460) Processing is performed (step S470).
If the user does not own the 3D printer 30, the user can go to the nearest store equipped with the 3D printer 31 or send the data to the nearest store to have the insole manufactured.
 以上、本発明の実施形態について図面を参照しながら詳細に説明したが、本発明は、上述の実施形態に限定されるものではなく、本発明の技術的範囲から逸脱しない範囲内で多様に変更することが可能である。 Although the embodiments of the present invention have been described in detail with reference to the drawings, the present invention is not limited to the above-described embodiments and is variously modified within a range that does not deviate from the technical scope of the present invention. It is possible to do.
 1  インソールデータ生成システム
 10  情報提供サーバ
 11、21  制御部
 12、22  入出力部
 13、23  記憶部
 14、24  表示部
 15  ユーザ登録部
 16  歩行データ管理部
 17  パッド構造データ生成部
 18  インソール構造データ生成部
 19  3Dプリンダデータ生成部
 20  ユーザ端末
 25  動画取得部
 26  3Dプリンタデータ管理部
 30、31  3Dプリンタ
 50  ネットワーク
 200  体幹の軸
 210  肩の基準線
 220  骨盤の基準線
 230  大腿部の中心軸(膝の基準線)
 231  下腿部の中心軸(膝の基準線)
 240  足の基準線
 300  インソール
 310  パッド
              
1 Insole data generation system 10 Information provision server 11, 21 Control unit 12, 22 Input / output unit 13, 23 Storage unit 14, 24 Display unit 15 User registration unit 16 Walking data management unit 17 Pad structure data generation unit 18 Insole structure data generation Part 19 3D printer data generation part 20 User terminal 25 Video acquisition part 26 3D printer data management part 30, 31 3D printer 50 Network 200 Trunk axis 210 Shoulder reference line 220 Pelvic reference line 230 Thigh center axis (Knee reference line)
231 Central axis of lower leg (knee reference line)
240 foot reference line 300 insoles 310 pad

Claims (4)

  1.  ユーザ端末により撮影されたユーザの歩行動画から抽出されるユーザの歩行時の癖に基づき、前記ユーザに適したインソールの構造データを生成して提供する情報提供サーバを備えるインソールデータ生成システムであって、
     前記情報提供サーバは、前記歩行動画から抽出されるユーザの歩行時の癖を保存して管理する歩行データ管理部と、前記歩行時の癖に基づき、前記歩行時の癖を矯正する矯正量を算出して矯正用のパッド構造データを生成するパッド構造データ生成部と、予め入力されたユーザの靴のサイズを含むユーザの基本情報に基づき前記靴のサイズに適合する標準のインソールに前記パッド構造データを組み込んだ矯正用のインソールの構造データを生成するインソール構造データ生成部とを有し、
     前記歩行時の癖は前記ユーザ端末に実装されたアプリケーションにより前記歩行動画から抽出されてユーザ端末から送信されるか、又はユーザ端末より送信される前記歩行動画から前記歩行データ管理部により抽出されるものであることを特徴とするインソールデータ生成システム。
    An insole data generation system including an information providing server that generates and provides structural data of an insole suitable for the user based on the walking habit of the user extracted from the walking video of the user taken by the user terminal. ,
    The information providing server has a walking data management unit that stores and manages the user's walking habits extracted from the walking video, and a correction amount that corrects the walking habits based on the walking habits. The pad structure is attached to a pad structure data generator that calculates and generates pad structure data for correction, and a standard insole that matches the shoe size based on the user's basic information including the user's shoe size that has been input in advance. It has an insole structure data generation unit that generates structural data of the insole for correction that incorporates the data.
    The walking habit is extracted from the walking video by an application implemented in the user terminal and transmitted from the user terminal, or is extracted from the walking video transmitted from the user terminal by the walking data management unit. An insole data generation system characterized by being a thing.
  2.  前記歩行動画はユーザの正面又は背面から撮影し、少なくとも左右それぞれの足による歩行動作を含む動画であり、
     前記歩行時の癖は、歩行するユーザの正面又は背面から観測される体の所定箇所の中心軸又は基準線の傾きの変化であることを特徴とする請求項1に記載のインソールデータ生成システム。
    The walking video is a video shot from the front or the back of the user and includes walking motion by at least the left and right feet.
    The insole data generation system according to claim 1, wherein the walking habit is a change in the inclination of a central axis or a reference line of a predetermined portion of the body observed from the front or the back of a walking user.
  3.  前記情報提供サーバは、前記インソールの構造データを3Dプリンタの入力データとして構成して出力する3Dプリンタデータ生成部をさらに有することを特徴とする請求項1又は2に記載のインソールデータ生成システム。 The insole data generation system according to claim 1 or 2, wherein the information providing server further includes a 3D printer data generation unit that configures and outputs the structural data of the insole as input data of the 3D printer.
  4.  ユーザ端末により撮影されたユーザの歩行動画から抽出されるユーザの歩行時の癖に基づき、前記ユーザに適したインソールの構造データを生成して提供する情報提供サーバを備えるインソールデータ生成システムによるインソールデータの生成方法であって、
     ユーザ端末によりユーザの歩行動画を撮影する段階と、
     前記ユーザ端末又は情報提供サーバにより、前記歩行動画よりユーザの歩行時の癖を抽出する段階と、
     前記情報提供サーバにより、前記歩行時の癖に基づき、前記歩行時の癖を矯正する矯正量を算出して矯正用のパッド構造データを生成する段階と、
     前記情報提供サーバにより、予め入力されたユーザの靴のサイズを含むユーザの基本情報に基づき前記靴のサイズに適合する標準のインソールに前記パッド構造データを組み込んだ矯正用のインソールの構造データを生成する段階と、を有することを特徴とするインソールデータの生成方法。

     
    Insole data by an insole data generation system equipped with an information providing server that generates and provides structural data of an insole suitable for the user based on the user's walking habits extracted from the user's walking video taken by the user terminal. It is a method of generating
    At the stage of shooting the user's walking video with the user terminal,
    The stage of extracting the user's walking habits from the walking video by the user terminal or the information providing server, and
    Based on the walking habit, the information providing server calculates the correction amount for correcting the walking habit and generates pad structure data for correction.
    The information providing server generates structural data of an insole for correction in which the pad structure data is incorporated into a standard insole that matches the shoe size based on the user's basic information including the user's shoe size input in advance. A method of generating insole data, characterized in that it has a stage of insole data.

PCT/JP2021/038498 2020-10-20 2021-10-18 Insole data generating system, and insole data generating method WO2022085650A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020176360A JP7138683B2 (en) 2020-10-20 2020-10-20 Insole data generation system and insole data generation method
JP2020-176360 2020-10-20

Publications (1)

Publication Number Publication Date
WO2022085650A1 true WO2022085650A1 (en) 2022-04-28

Family

ID=81290853

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/038498 WO2022085650A1 (en) 2020-10-20 2021-10-18 Insole data generating system, and insole data generating method

Country Status (2)

Country Link
JP (1) JP7138683B2 (en)
WO (1) WO2022085650A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013017822A (en) * 2008-03-25 2013-01-31 Comfort Lab Inc Diagnostic device for foot and shoe or insole fitting navigation system using the same
US20190022945A1 (en) * 2017-07-18 2019-01-24 Ivan Ordaz Custom Insole
JP2020163154A (en) * 2014-05-09 2020-10-08 アールエスプリント エヌ.ヴィ. Methods and apparatuses for designing footwear

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013208291A (en) 2012-03-30 2013-10-10 Equos Research Co Ltd Walking assistance device and walking assistance program

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2013017822A (en) * 2008-03-25 2013-01-31 Comfort Lab Inc Diagnostic device for foot and shoe or insole fitting navigation system using the same
JP2020163154A (en) * 2014-05-09 2020-10-08 アールエスプリント エヌ.ヴィ. Methods and apparatuses for designing footwear
US20190022945A1 (en) * 2017-07-18 2019-01-24 Ivan Ordaz Custom Insole

Also Published As

Publication number Publication date
JP2022067577A (en) 2022-05-06
JP7138683B2 (en) 2022-09-16

Similar Documents

Publication Publication Date Title
CN111263953B (en) Action state evaluation system, device, server, method and storage medium thereof
US10564628B2 (en) Generating of 3D-printed custom wearables
US20080292179A1 (en) System and method for evaluating the needs of a person and manufacturing a custom orthotic device
US20160093085A1 (en) Devices, frameworks and methodologies for enabling user-driven determination of body size and shape information and utilisation of such information across a networked environment
WO2003103433A1 (en) Shoe pattern design method, shoe pattern design device, foot measurer, and foot positioning device of foot measurer
JP6242768B2 (en) Virtual try-on device, virtual try-on method, and program
JP6338966B2 (en) Virtual try-on device, virtual try-on system, virtual try-on method, and program
JP6320237B2 (en) Virtual try-on device, virtual try-on method, and program
JP2016038811A (en) Virtual try-on apparatus, virtual try-on method and program
CN104994762B (en) Footwear select aid system
JP6649323B2 (en) Gait analysis system and method
JP6348623B2 (en) 3D model creation method, 3D model creation device, 3D model creation system, and 3D model creation program
JP2021501955A (en) Tilting controller for measuring physical information
JP2018106736A (en) Virtual try-on apparatus, virtual try-on method and program
KR102506352B1 (en) Digital twin avatar provision system based on 3D anthropometric data for e-commerce
KR100969038B1 (en) Method for making fitting type insole using biomechanical diagnosis data and system for executing the method
WO2020180688A1 (en) Multiple physical conditions embodied in body part images to generate an orthotic
WO2022085650A1 (en) Insole data generating system, and insole data generating method
WO2020059716A1 (en) Size measurement system
JP6837694B1 (en) Foot shape specific data generation method, shoe making method, ready-made shoe search method, custom-made shoe manufacturing support system, ready-made shoe search system
TWI796624B (en) Information providing device, information providing method, and control program
TWI789674B (en) Information acquisition device, information acquisition method, and control program
JPWO2019003429A1 (en) Human body model display system, human body model display method, communication terminal device, and computer program
JP2018113060A (en) Virtual try-on apparatus, virtual try-on system, virtual try-on method and program
JP7398646B2 (en) Fatigue estimation system, fatigue estimation method, and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21882791

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21882791

Country of ref document: EP

Kind code of ref document: A1