WO2022232968A1 - A massage coaching method, device and application thereof - Google Patents
A massage coaching method, device and application thereof Download PDFInfo
- Publication number
- WO2022232968A1 WO2022232968A1 PCT/CN2021/091815 CN2021091815W WO2022232968A1 WO 2022232968 A1 WO2022232968 A1 WO 2022232968A1 CN 2021091815 W CN2021091815 W CN 2021091815W WO 2022232968 A1 WO2022232968 A1 WO 2022232968A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- massage
- person
- image
- guiding
- indication
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 55
- 210000000481 breast Anatomy 0.000 claims description 43
- 230000002040 relaxant effect Effects 0.000 claims description 6
- 235000013336 milk Nutrition 0.000 claims description 3
- 239000008267 milk Substances 0.000 claims description 3
- 210000004080 milk Anatomy 0.000 claims description 3
- 230000035935 pregnancy Effects 0.000 claims description 3
- 230000001737 promoting effect Effects 0.000 claims description 3
- 230000009467 reduction Effects 0.000 claims description 3
- 238000007493 shaping process Methods 0.000 claims description 3
- 230000036544 posture Effects 0.000 description 13
- 230000006870 function Effects 0.000 description 9
- 238000004891 communication Methods 0.000 description 5
- 210000002445 nipple Anatomy 0.000 description 5
- 230000008569 process Effects 0.000 description 5
- 210000000707 wrist Anatomy 0.000 description 5
- 230000036541 health Effects 0.000 description 4
- 210000001624 hip Anatomy 0.000 description 4
- 206010006187 Breast cancer Diseases 0.000 description 3
- 208000026310 Breast neoplasm Diseases 0.000 description 3
- 230000032696 parturition Effects 0.000 description 3
- 238000007639 printing Methods 0.000 description 3
- 238000013473 artificial intelligence Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000002708 enhancing effect Effects 0.000 description 2
- 238000001914 filtration Methods 0.000 description 2
- 210000000245 forearm Anatomy 0.000 description 2
- 230000007166 healthy aging Effects 0.000 description 2
- 210000003205 muscle Anatomy 0.000 description 2
- 238000000554 physical therapy Methods 0.000 description 2
- 230000001225 therapeutic effect Effects 0.000 description 2
- 208000011092 Hand injury Diseases 0.000 description 1
- 239000003221 ear drop Substances 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 210000004247 hand Anatomy 0.000 description 1
- 210000001981 hip bone Anatomy 0.000 description 1
- 210000004251 human milk Anatomy 0.000 description 1
- 235000020256 human milk Nutrition 0.000 description 1
- 238000010191 image analysis Methods 0.000 description 1
- 230000036039 immunity Effects 0.000 description 1
- 238000012905 input function Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000008521 reorganization Effects 0.000 description 1
- 238000012549 training Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
- G09B19/003—Repetitive work cycles; Sequence of movements
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
- G09B5/065—Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/12—Driving means
- A61H2201/1253—Driving means driven by a human being, e.g. hand driven
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
- A61H2201/5007—Control means thereof computer controlled
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
- A61H2201/5023—Interfaces to the user
- A61H2201/5043—Displays
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
- A61H2201/5058—Sensors or detectors
- A61H2201/5064—Position sensors
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2201/00—Characteristics of apparatus not provided for in the preceding codes
- A61H2201/50—Control means thereof
- A61H2201/5058—Sensors or detectors
- A61H2201/5092—Optical sensor
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61H—PHYSICAL THERAPY APPARATUS, e.g. DEVICES FOR LOCATING OR STIMULATING REFLEX POINTS IN THE BODY; ARTIFICIAL RESPIRATION; MASSAGE; BATHING DEVICES FOR SPECIAL THERAPEUTIC OR HYGIENIC PURPOSES OR SPECIFIC PARTS OF THE BODY
- A61H2205/00—Devices for specific parts of the body
- A61H2205/08—Trunk
- A61H2205/082—Breasts
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30196—Human being; Person
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/30—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
Definitions
- the present invention relates to a massage coaching method, device and application thereof.
- the massage may be a self-breast-massage or any other types of massage.
- the present invention helps a user to learn correct massage methods at home thereby improving their health, e.g., self-breast-massage to improve and/or breastfeeding experience.
- the present invention relates to a massage coaching method, device and application thereof.
- breast massage is given as an example, however, other types of massage is covered by the present invention as well, e.g., massage for on a hand, face, leg, foot, etc.
- the breast massage may be a self-massage, e.g., a self-breast-massage.
- a method for massage coaching comprises capturing at least one image; displaying the at least one image; identifying a person in the at least one image; identifying at least one target massage position of the person in the at least one image; displaying at least one massage indication at the at least one target massage position.
- an electronic device comprises a camera, a display, and a processer to perform the method of the present invention.
- a storage medium and a program/software are configured to store instructions executed by at least one processor to perform the method of the present invention.
- Fig. 1 shows a method for massage coaching according to the present invention.
- Fig. 2A shows a user interface according to the present invention.
- Fig. 2B shows a user interface according to the present invention.
- Fig. 3 shows a device for massage coaching according to the present invention.
- a or B, ” “at least one of A or/and B, ” or “one or more of A or/and B” as used herein include all possible combinations of items enumerated with them.
- “A or B, ” “at least one of A and B, ” or “at least one of A or B” means (1) including at least one A, (2) including at least one B, or (3) including both at least one A and at least one B.
- first and second may modify various elements regardless of an order and/or importance of the corresponding elements, and do not limit the corresponding elements. These terms may be used for the purpose of distinguishing one element from another element.
- a first printing form and a second printing form may indicate different printing forms regardless of the order or importance.
- a first element may be referred to as a second element without departing from the scope the present invention, and similarly, a second element may be referred to as a first element.
- the expression “configured to (or set to) ” as used herein may be used interchangeably with “suitable for, ” “having the capacity to, ” “designed to, ” “adapted to, ” “made to, ” or “capable of” according to a context.
- the term “configured to (set to) ” does not necessarily mean “specifically designed to” in a hardware level. Instead, the expression “apparatus configured to... ” may mean that the apparatus is “capable of... ” along with other devices or parts in a certain context.
- the massage may be a self-massage, in which the person who performs the massage is the person who receives the massage.
- the person may massage her breast by her own hands according to the present invention, or perform other type of massages, e.g., on a hand, face, leg, foot, etc.
- the massage in the present invention may also be performed by another person (e.g., according to the coaching method) .
- a masseuse, a husband or a nurse may perform the massage to a patient according to the present invention.
- a nurse may follow the coaching method in fig. 1 and may massage the breast of a female who is pregnant or lactating.
- the present invention may be applied to men as well.
- a man may follow the coaching method according to the present invention, e.g., a breast massage to prevent breast cancer, recover from breast cancer, or for any other health and non-health related purposes, a leg massage to relax after physical excises, or a physiotherapeutic hand massage after a hand injury.
- Additional examples of massages and related physical therapies specifically including, but not limited to grip-strength and acupressure may include muscle development and mobility enhancing (e.g., healthy aging) .
- Fig. 1 shows a method for massage coaching. Some steps shown in fig. 1 may be omitted and the order of the steps may be in a different sequence. In the below explanation a breast massage is used as an example, however, other types of massage are included in the scope of the present invention as well.
- step 101 at least one image (used interchangeably with “the image” , “the captured image” , “the captured images” and “the images” in this document) is captured.
- This may be via a separate camera, or an integrated camera in an electronic device, e.g., a mobile phone, a tablet, a laptop, a desktop, a TV, etc.
- the image may be captured continuously or one image in each predetermined period (e.g., one image in each second) .
- a user may start the massage coaching application installed (and/or stored) in the electronic device (for example, a breast massage app on a smart phone) .
- the device may identify (e.g., performed by at least one processor) whether there is a usable camera. If no usable camera is identified, the method stops, or displays at least one (breast) massage guiding video/guiding photo/images, which may have been pre-filmed and each may show a correct massage manner.
- Each of the (breast) massage guiding videos (or photos/images) may be according to a different massage type.
- the guiding videos may include both moving images and audio information, which may be pre-recorded. Guiding photos or images may be used to replace the guiding videos, e.g., drawings, cartoon image, or a pre-taken photo.
- the at least one guiding videos is used interchangeable with the guiding video, the guiding videos, the video and the videos in this application. The same interchangeable using applies to the guiding photos/images.
- the massage type may be input by the user via an I/O unit of the device, or determined according to other information, e.g., at least one predetermined condition.
- the predetermined condition may be at least one of one or a plurality of pregnancy stages and/or one or a plurality after birth stages, such as an early pregnant stage (0 to 14 weeks) , a mid-term pregnant stage (14 Weeks to28 weeks) , a late pregnant stage (28 Week to before giving birth) , feeding stage (0 to 4 days after giving birth) , and etc.
- a massage type may include a massage manner on a target massage positon and/or the massage function.
- the massage manner may include how to apply a massage, e.g., a massaging direction, strength, etc.
- the target massage position may be a body part where the massage is applied.
- the massage function may be the effect of the massage, e.g., relaxing, therapeutic, etc.
- the massage type may further include types of at least one of a circling massage, a side pushing massage, a direct pushing massage, a relaxing massage, a lactating promoting massage, a residual milk reduction massage, and a breast shaping massage.
- a circling massage may be to massage a breast or around the breast in a circling manner.
- a side pushing massage may be to press and slide forward on one or two sides of the breast.
- a direct pushing massage may be to press and slide forward in all directions of the breast.
- Other massage types are obvious from their names (i.e., providing the indicated function) and would be understood by a skilled person.
- a foot massage type may further include relaxing finger massage, therapeutic palm massage, etc.
- a usable camera If a usable camera is detected, the user may be asked to agree on using the camera. For example, after the user inputs to agree on using the camera, later steps are performed. Otherwise, the same steps as no camera identified are performed.
- the user Before and/or during steps 101 and/or step 102, the user may be notified with some general guidance, e.g., “please keep a certain distance to the camera/device (e.g., 0.5 to 3 meters, or 1 meter) ” ; “the method will count down five seconds before capturing images” , “please relax and sit/lying comfortably” , etc.
- some general guidance e.g., “please keep a certain distance to the camera/device (e.g., 0.5 to 3 meters, or 1 meter) ” ; “the method will count down five seconds before capturing images” , “please relax and sit/lying comfortably” , etc.
- the image is displayed on a screen/display of the device, for example on a separate display/monitor/screen, or an integrated display unit, e.g., on a mobile phone, a tablet, a laptop and so on.
- a single captured image or a video formed by the captured images may be displayed, e.g., a live stream captured by the camera.
- the image may be displayed as mirrored which helps the user to find the massage position (e.g., on/around the breast) easily according to the indication discussed later in this document.
- the at least one (e.g., breast) massage guiding video (referred also as the guiding video (s) and the video (s) ) may be displayed in a predetermined area of a screen/display, which overlaps or is separate from a predetermined displaying area for the at least one captured/displayed image.
- the guiding video may be displayed in an upper area of the screen 202 and the at least one image is displayed in a lower area 203.
- the video and the image may be resized to fit to the predetermined areas.
- the videos may start playing in this step or ready to be started.
- the video may start playing after receiving an input of the user, and/or, in step 103 after a person is identified in the image (and/or is identified in ready to massage position) . If the guiding videos is playing after a person is identified (e.g., during the massaging process) , if the person left (e.g., cannot determined anymore) during the video, the guiding videos may be paused. The guiding videos may be resumed when the person is identified again.
- guiding photos or images may be used to replace the guiding videos, e.g., drawings, cartoon image, or a pre-taken photo, wherever guiding videos are discussed in this application.
- a use may also input directly and/or adjust the display areas of the video and the image, and may also zoom in and/or zoom out the video and the image within the predetermined areas in any step of the present invention.
- the guiding videos/photos/images may have been pre-filmed and each may show a correct massage manner.
- Each of the guiding videos may be according to a different massage type as discussed for step 101.
- the at least one guiding video/photo/film may be displayed in any or all steps of the present invention.
- Step 103 may identify whether a person (e.g., the one who receives the massage) appearing in the image and/or whether the person being in a proper posture for massage.
- the step of identifying of whether a person appears in the image may be omitted, and the step of identifying of whether the person is in a general massage posture may be omitted as well. If no person appears in the image (e.g., no body part of a person is identified for longer than a predefined time period) , the device may notify the user to adjust the camera or the position of the user in order to be in the image, e.g., via at least one of an audio, image, a movie or any other notification method, and/or the device may start playing the guiding videos/photos/images.
- a person e.g., the one who receives the massage
- the guiding videos may be paused if a person is identified in a later period and the normal steps are performed (e.g., steps 103, 104, 105 and their alternatives) . If the guiding videos is playing after a person is identified (e.g,. during the massaging process) , if the person left (e.g., cannot determined anymore) during the video, the guiding videos may be paused. The guiding videos may be resumed when the person is identified again.
- the device may further identify whether the person is in a general massage posture. For example, a guiding outline as shown in fig 2A may be displayed to guide the user to pose correctly, which may prevent the person being too far from, too close to or not in the middle of the image.
- the identifying of the general massage posture being met may include identifying that at least one or more basic rules (or referred as the rule, the rules, filtering rules, or basis filtering rules) is met by the posture of the user.
- a guiding video may start playing after receiving an input of the user, and/or, after a person is identified in the image (and/or is identified in ready to massage position) . If the guiding videos is playing after a person is identified (e.g., during the massaging process) , if the person left (e.g., cannot determined anymore) during the video, the guiding videos may be paused. The guiding videos may be resumed when the person is identified again.
- a rule may be considered to be met, if the related posture is according to the rule for longer than or equal to a predefined period, or longer than or equal to a threshold period in a predefined period. For example, a rule may be considered to be met if the posture is according to it for 5 seconds, or the rule may be considered to be met if the posture is according to the rule for longer than or equal to 3 seconds in a total period of 5 seconds.
- the basic rules may include:
- the person is within certain area of the image, e.g., shoulders are in the lower half of the image, the upper body of the person appears in the lower half of the image, and/or the upper body of the person is within the guiding outline area.
- the person is not too close to and facing the camera.
- the upper body of the person is within the guiding outline area and cover more than at least certain percentage of the area.
- she is not facing the camera directly. This may be determined according to the shoulder width of the person and distance of the ears, and/or the length of arms in the image. For example, if the shoulder width in the image is shorter than 1.2 times of the distance of the person, the device determines that the person is too close to the camera. The mom may be notified to turn to the camera and keep a longer distance.
- the camera is not positioned too low or too high.
- the device may determine according to the shoulder width and the hip width of the mom in the image. For instance, the camera is too high if the shoulder width is more than 1.2 times of the hip width, and/or the camera is too low if the hip width is more than 1.5 times of the shoulder width.
- the mom may be notified to higher or lower the camera accordingly.
- a key point may be a position on a central point of the concerned body part, or on a side point of the concerned body part, or a random position within the concerned body part area.
- key points may include at least one of a right hand, right wrist, right elbow, right shoulder, nose, left palm, left wrist, left elbow, left shoulder, left breast, right breast, left nipple, right nipple, etc.
- the recognizing/identifying of the key points of a body may be via artificial intelligence and/or image reorganization technologies.
- a key area may be an area of a concerned body part, e.g., a back area, a head area, a right hand area, right wrist area, right elbow area, right shoulder area, nose area, left palm area, left wrist area, left elbow area, left shoulder area, left breast area, right breast area, left nipple area, right nipple area, etc.
- the key point of a hand may be the center point of the back of the hand; the key point of a wrist may be the middle point of a line between the hand and forearm; the key point of an elbow may be the joining point of the forearm and upper arm; the key point of a shoulder may be the joining point of the upper arm and the shoulder; the key point of a head may be the nose (e.g., for the mom) or the ear drop (e.g., for the baby) ; the key point of a breast may be the nipple position, and/or may be estimated according to the width of the shoulder and upper body length of the mom; the key point of hips may be the middle point or one of the two edge points of the hip bones; the key point of a neck may be the joining point of the upper body and head.
- This step may include a step of identifying the posture of the person via key points/key area on the user in the image.
- the guiding outline may be displayed during and throughout step 103 and/or step 104.
- the identified key points/areas may also be displayed or not displayed.
- the key points When displaying the key points/areas, the key points may be connected in a structure of a human being and/or the key area may be displayed with a colored area or a box/circle/outline of the key area.
- the displayed guiding outline and/or key points/areas can help the user to understand the relative positions of the body parts, correct her posture and/or find the massage position easier.
- the outline and/or key points/areas may be displayed (e.g., mirrored) at the beginning period of step 103, the whole step, or until the end of the method.
- At least one (e.g., breast) massage guiding video/photo/image may be displayed as in other steps.
- a guiding video may start playing after receiving an input of the user, and/or, after a person is identified in the image (and/or is identified in ready to massage position) . If the guiding videos is playing after a person is identified (e.g., during the massaging process) , if the person left (e.g., cannot determined anymore) during the video, the guiding videos may be paused. The guiding videos may be resumed when the person is identified again.
- the basic rules may include key point/area information on a correct massage posture of the user.
- the plurality of rules may include different sets of rules based for key point/area information in different massage types. For example, if it is a breast massage, a side pushing massage and a direct pushing massage may have different or the same rules.
- the correct massage posture may be obtained via artificial intelligence after training with a large numbers of images with correct massage postures, for example, by subtracting all the key points/areas and obtaining relative position information (and/or in acceptable ranges) of the key points/areas.
- At least one target massage position may be identified in the at least one image, which may be the position to be massaged (e.g., according to the coaching/guiding videos/photos/images and/or a massaging type) .
- the target massage position may be associated with a body part of the person receiving the massage, e.g., a hand position, a finger position, a breast positon of the person, both breast positions of the person, a position around a breast of the person, or any other positions that may need to be massaged.
- the target massage position may be according to the massage type and/or guiding videos.
- the target massage position may be a specific position around the breast areas according to a specific massage type.
- the target massage position may change from a first positon to a second position during one massage period, and the position change may be according to the coaching/guiding videos and/or a massaging type. For example, from massaging left breast to the right breast, or from massaging the top of a breast to the area around the breast.
- the target massage position may be identified according to image analysis, e.g., a direct recognition of a body part (s) that needs to be massaged. For example, a breast may be recognized for massaging.
- the target massage positon may be identified according to relations with other body parts, e.g., in the at least one image.
- a breast position may be determined/identified according to at least one key points of the shoulders and/or chin of the person. For example, if an identified shoulder key point is the central part of the corresponding shoulder, e.g., the middle point between the closer edge of the neck and the outer edge of the shoulder.
- the target massage position for the breast may be identified as a certain distance vertically below the key point of the shoulder, for example, certain pixels (e.g., 200 pixels or 500 pixels) , or certain absolute distance on or percentage of the length of the screen (e.g., 1.5 cm, 2 cm or 2.5 cm, or 10%to 30%of the length of the screen) .
- the length of the screen may be the length of the screen parallel to the line between the shoulder key point and the target massage position.
- the length of the screen is the length of the longer edge of the screen; if the screen is set up in a landscape direction (e.g., the shorter edge is vertical) , the length of the screen is the length of the shorter edge of the screen.
- At least one massage indication may be displayed on the at least one target massage position that has been identified.
- the indication may be an image, text, an animation, or in any other forms that can indicate a massage manner.
- the indication may indicate at least one of a massage direction, a massage position, a massage strength and a massage timing.
- a massage direction by an arrow, a hand or a moving animation
- indicating a massage strength by different colours e.g., red is strong, green is light
- text e.g., text
- indicating the massage timing with text or a clock shaped figure/animation The massage timing may be the massage time left or past.
- An example of the direction indication (with two arrows) is shown in 203a of fig. 2B, and an example of the timing indication is shown in 204 of fig. 2B.
- the at least one guiding video/photo/image may be displayed (e.g., start playing) simultaneously in step 105, and at least one further massage indication may be simultaneously displayed on the video according to a correct massaging manner, e.g., at least one of the direction, strength, position and timing.
- the further indication (s) may be incorporated in the videos when filing the videos, or may be added afterwards on top of the videos when displaying the videos.
- a user may start the massage according to the indication and the guiding video/photo/image, e.g., as shown in fig. 2B.
- a guiding video may start playing after the indication is display and/or the further indication is displayed.
- the guiding videos may be playing after a person is identified (e.g., during the massaging process) , if the person left (e.g., cannot determined anymore) during the video, the guiding videos may be paused. The guiding videos may be resumed when the person is identified again.
- the indication and the further indication may be in the same form but in different positions on the screen.
- the indication may be at the target massage position of the captured image of the person, but the further indication may be at the correct massage position on the guiding video/photo/image.
- the indication and the further indication may be in different forms as well, e.g., in different colors to distinguish from each other.
- the steps in 101 to 105 may be performed iteratively until the method ends according to at least one condition.
- the iteration may be once in a predefined time period, e.g., once in every second.
- the method may end when a predefined time period is identified, e.g., the predefined massage time period or the total time period of the guiding video, expires.
- the method may end by a user input, e.g., closing the application, turn off the screen, power off the device, etc.
- the method may end if no person can be identified in the image anymore for longer than a predetermined time period.
- the method may end if all the massage videos have been played, e.g., all massages have been performed.
- a series of massages may be performed before it taking effect.
- notifications may be output to remind the user to perform a massage.
- the present invention may use the calendar on a smart phone to remind the user, or a timer in the application may be used to trigger the notification.
- the user may also set the notification system via the user interface by herself.
- Fig. 3 shows a device 300, e.g., a mobile phone, tablet, laptop, desktop, smart watch, a TV, etc., to perform the present invention.
- a device 300 e.g., a mobile phone, tablet, laptop, desktop, smart watch, a TV, etc.
- the device 300 may comprise a processor 301, a display 302, a communication unit 303, a memory 305, a camera 306 and other input/output units 307.
- the processor 301 is configured to perform the program/instructions stored in the memory 305, e.g., via controlling other components such as the display 302, the communication unit 303, the memory 305, the camera 306 and other input/output units 307.
- the displayed 302 may be controlled by the processor 301 to perform the all the displaying function (and input function if it is a touch screen) in the present invention such as in steps 102 and 105.
- the communication unit 303 may be controlled by the processor 301 to perform all communication function in the present invention. For example, if an external device 310 (e.g., an sever) is used to perform some of or all the identifying functions in the present invention, e.g., steps 103 and 104, messages are communicated via the communication unit 303, such as transmitting the images and/or receiving the identifying results.
- the image may be not stored in the external device 310 for privacy reasons, e.g., after each identifying step, the image is immediately deleted in the external device 310.
- the memory 305 is configured to store the massage coaching application software and/or data.
- the application may provide at least one entry for the user to check/overviewing these data.
- the camera 306 is configured to capture images in the present invention, e.g., in steps 101.
- the other input/output units 307 are configured to perform other input/output functions of the present invention, for example, to output audio notifications when playing the guiding videos, or receive user input for the massage type and/or any other user settings.
- At least a part of the device e.g., fig. 3 or method (e.g., fig. 1) or user interface (e.g., fig. 2) may be implemented as instructions stored in a non-transitory computer-readable storage medium, e.g., in the form of a program module, a piece of software, a mobile app, and/or other forms.
- the instructions when executed by a processor (e.g., the processor 301) , may enable the processor to carry out a corresponding function according to the present invention.
- the non-transitory computer-readable storage medium may be the memory 305.
- a method for massage coaching comprises: capturing at least one image; displaying the at least one image; identifying a person in the at least one image; identifying at least one target massage position of the person in the at least one image; displaying at least one massage indication at the at least one target massage position.
- the at least one image may be mirrored when displayed, and/or the at least one target massage position may be associate with a position of a body part.
- the method may be performed iteratively once in a predefined time period.
- the method may further comprise: receiving an input to select a massage type, and/or determining a massage type according to at least one predetermined condition, herein the at least one massage indication and/or the at least one target massage position is according to the massage type.
- the massage type may be according to at least one of one or a plurality of pregnancy stages and/or one or a plurality of after birth stages.
- the massage type may include at least one of a circling massage, a side pushing massage, a direct pushing massage, a relaxing massage, a lactating promoting massage, a residual milk reduction massage, and a breast shaping massage.
- the displaying of the at least one image may comprise displaying a guiding outline for guiding a pose of the person.
- the identifying of the person may include identifying whether the person poses according to the guiding outline.
- the at least one target massage position may be identified according to at least one shoulder position of the person.
- the method further may comprise displaying a massage guiding video simultaneously.
- At least one further massage indication may be displayed in the guiding video.
- the least one massage indication and/or the at least one further massage indication may indicate at least one of a massage direction, a massage position, a massage strength and a massage timing.
- the method may further comprise ending the massage when a predefined time period expired and/or receiving an input to end the massage.
- an electronic device comprising a camera, a display, and a processer to perform the method according to the method of the present invention.
- a storage medium configured to store instructions executed by at least one processor to perform the method of the present invention.
Landscapes
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Entrepreneurship & Innovation (AREA)
- Multimedia (AREA)
- Image Processing (AREA)
- Peptides Or Proteins (AREA)
- Electrically Operated Instructional Devices (AREA)
- Massaging Devices (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
Description
Claims (15)
- A method for massage coaching comprising:capturing at least one image;displaying the at least one image;identifying a person in the at least one image;identifying at least one target massage position of the person in the at least one image;displaying at least one massage indication at the at least one target massage position.
- The method in claim 1, wherein the at least one image is mirrored when displayed, and/or wherein the at least one target massage position is associate with a position of a body part.
- The method in claim 1, wherein the method is performed iteratively once in a predefined time period.
- The method in claim 1, further comprising:receiving an input to select a massage type, and/ordetermining a massage type according to at least one predetermined condition,wherein the at least one massage indication and/or the at least one target massage position is according to the massage type.
- The method in claim 4, wherein the massage type is according to at least one of one or a plurality of pregnancy stages and/or one or a plurality of after birth stages.
- The method in claim 5, wherein the massage type includes at least one of a circling massage, a side pushing massage, a direct pushing massage, a relaxing massage, a lactating promoting massage, a residual milk reduction massage, and a breast shaping massage.
- The method in claim 1, wherein the displaying of the at least one image comprises displaying a guiding outline for guiding a pose of the person.
- The method in claim 7, wherein the identifying of the person includes identifying whether the person poses according to the guiding outline.
- The method in claim 1, wherein the at least one target massage position is identified according to at least one shoulder position of the person.
- The method in any of claims 1 to 9, further comprising displaying a massage guiding video simultaneously.
- The method in claim 10, wherein at least one further massage indication is displayed in the guiding video.
- The method in any of claims 1 to 11, wherein the least one massage indication and/or the at least one further massage indication indicate at least one of a massage direction, a massage position, a massage strength and a massage timing.
- The method in claim 1, further comprising ending the massage when a predefined time period expired and/or receiving an input to end the massage.
- An electronic device comprising a camera, a display, and a processer to perform the method according to any of claims 1 to 13.
- A storage medium configured to store instructions executed by at least one processor to perform the method according to any of claims 1 to 13.
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
AU2021444499A AU2021444499A1 (en) | 2021-05-04 | 2021-05-04 | A massage coaching method, device and application thereof |
PCT/CN2021/091815 WO2022232968A1 (en) | 2021-05-04 | 2021-05-04 | A massage coaching method, device and application thereof |
JP2023558723A JP2024517061A (en) | 2021-05-04 | 2021-05-04 | Massage instruction method, device and application thereof |
EP21939616.5A EP4288016A4 (en) | 2021-05-04 | 2021-05-04 | A massage coaching method, device and application thereof |
CN202180096587.9A CN117241771A (en) | 2021-05-04 | 2021-05-04 | Massage guidance method, device and application thereof |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2021/091815 WO2022232968A1 (en) | 2021-05-04 | 2021-05-04 | A massage coaching method, device and application thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022232968A1 true WO2022232968A1 (en) | 2022-11-10 |
Family
ID=83932589
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/091815 WO2022232968A1 (en) | 2021-05-04 | 2021-05-04 | A massage coaching method, device and application thereof |
Country Status (5)
Country | Link |
---|---|
EP (1) | EP4288016A4 (en) |
JP (1) | JP2024517061A (en) |
CN (1) | CN117241771A (en) |
AU (1) | AU2021444499A1 (en) |
WO (1) | WO2022232968A1 (en) |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104873381A (en) * | 2015-06-02 | 2015-09-02 | 京东方科技集团股份有限公司 | Massage indicator and massage indicating method |
CN105662806A (en) * | 2016-04-05 | 2016-06-15 | 重庆易控科技有限责任公司 | Monitoring type massager and massage indication system thereof |
WO2018168353A1 (en) * | 2017-03-13 | 2018-09-20 | ファミリーイナダ株式会社 | Massage machine |
CN109498384A (en) * | 2018-09-17 | 2019-03-22 | 鲁班嫡系机器人(深圳)有限公司 | A kind of identification of massage part, positioning, massage method and device, equipment |
CN110297720A (en) * | 2018-03-22 | 2019-10-01 | 卡西欧计算机株式会社 | Notify device, notification method and the medium for storing advising process |
US20200035237A1 (en) * | 2019-07-09 | 2020-01-30 | Lg Electronics Inc. | Communication robot and method for operating the same |
CN111736934A (en) * | 2020-05-25 | 2020-10-02 | 北京百度网讯科技有限公司 | Massage prompting method and device |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2014042121A1 (en) * | 2012-09-12 | 2014-03-20 | 独立行政法人産業技術総合研究所 | Movement evaluation device and program therefor |
RU2750596C2 (en) * | 2016-12-06 | 2021-06-29 | Конинклейке Филипс Н.В. | Displaying guide pointer to the user |
JP7135472B2 (en) * | 2018-06-11 | 2022-09-13 | カシオ計算機株式会社 | Display control device, display control method and display control program |
-
2021
- 2021-05-04 WO PCT/CN2021/091815 patent/WO2022232968A1/en active Application Filing
- 2021-05-04 AU AU2021444499A patent/AU2021444499A1/en active Pending
- 2021-05-04 CN CN202180096587.9A patent/CN117241771A/en active Pending
- 2021-05-04 EP EP21939616.5A patent/EP4288016A4/en active Pending
- 2021-05-04 JP JP2023558723A patent/JP2024517061A/en active Pending
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104873381A (en) * | 2015-06-02 | 2015-09-02 | 京东方科技集团股份有限公司 | Massage indicator and massage indicating method |
CN105662806A (en) * | 2016-04-05 | 2016-06-15 | 重庆易控科技有限责任公司 | Monitoring type massager and massage indication system thereof |
WO2018168353A1 (en) * | 2017-03-13 | 2018-09-20 | ファミリーイナダ株式会社 | Massage machine |
CN110297720A (en) * | 2018-03-22 | 2019-10-01 | 卡西欧计算机株式会社 | Notify device, notification method and the medium for storing advising process |
CN109498384A (en) * | 2018-09-17 | 2019-03-22 | 鲁班嫡系机器人(深圳)有限公司 | A kind of identification of massage part, positioning, massage method and device, equipment |
US20200035237A1 (en) * | 2019-07-09 | 2020-01-30 | Lg Electronics Inc. | Communication robot and method for operating the same |
CN111736934A (en) * | 2020-05-25 | 2020-10-02 | 北京百度网讯科技有限公司 | Massage prompting method and device |
Non-Patent Citations (1)
Title |
---|
See also references of EP4288016A4 * |
Also Published As
Publication number | Publication date |
---|---|
JP2024517061A (en) | 2024-04-19 |
EP4288016A1 (en) | 2023-12-13 |
CN117241771A (en) | 2023-12-15 |
EP4288016A4 (en) | 2024-04-03 |
AU2021444499A1 (en) | 2023-10-05 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11445985B2 (en) | Augmented reality placement of goniometer or other sensors | |
US20220193491A1 (en) | Systems and methods of using artificial intelligence and machine learning for generating alignment plans to align a user with an imaging sensor during a treatment session | |
US11317975B2 (en) | Method and system for treating patients via telemedicine using sensor data from rehabilitation or exercise equipment | |
US20220339501A1 (en) | Systems and methods of using artificial intelligence and machine learning for generating an alignment plan capable of enabling the aligning of a user's body during a treatment session | |
US20220415471A1 (en) | Method and system for using sensor data to identify secondary conditions of a user based on a detected joint misalignment of the user who is using a treatment device to perform a treatment plan | |
US20240122486A1 (en) | Physiological monitoring soundbar | |
WO2019053719A1 (en) | Apparatus and methods for monitoring a subject | |
CN112382369A (en) | Rehabilitation exercise monitoring method and equipment | |
US20210265055A1 (en) | Smart Meditation and Physiological System for the Cloud | |
JP2018149096A (en) | Massage machine | |
WO2019036038A1 (en) | Guiding user motion for physiotherapy in virtual or augmented reality | |
WO2022232968A1 (en) | A massage coaching method, device and application thereof | |
CN109411051A (en) | A kind of patients with cerebral apoplexy continuity medical system accessing VR technology | |
CN204636299U (en) | A kind of portable infrared angiograph | |
CN112220651A (en) | Wearable equipment system for rehabilitation training and wearable equipment | |
CN112541382A (en) | Method and system for assisting movement and identification terminal equipment | |
Ribeiro Batista Geraldini | Becoming a person? Learning from observing premature babies and their mothers | |
US20240161646A1 (en) | A breast feeding coaching method, device and application thereof | |
JP7353605B2 (en) | Inhalation motion estimation device, computer program, and inhalation motion estimation method | |
WO2016206120A1 (en) | Information processing method, apparatus and terminal | |
Dawson et al. | Opportunities to Support Mechanical Ventilation Weaning | |
JP7500882B2 (en) | Method and system for the use of telemedicine enabled rehabilitation equipment for the prediction of secondary diseases - Patents.com | |
AU2021104997A4 (en) | Smart Yoga Assistant Mirror using IOT & Computer Vision for Healthy Life | |
CN117396976A (en) | Patient positioning adaptive guidance system | |
CN206391520U (en) | A kind of Yoga posture suggestion device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21939616 Country of ref document: EP Kind code of ref document: A1 |
|
DPE1 | Request for preliminary examination filed after expiration of 19th month from priority date (pct application filed from 20040101) | ||
WWE | Wipo information: entry into national phase |
Ref document number: 803432 Country of ref document: NZ Ref document number: 2021939616 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2021444499 Country of ref document: AU Ref document number: AU2021444499 Country of ref document: AU |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2023558723 Country of ref document: JP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202180096587.9 Country of ref document: CN |
|
ENP | Entry into the national phase |
Ref document number: 2021444499 Country of ref document: AU Date of ref document: 20210504 Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2021939616 Country of ref document: EP Effective date: 20230907 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 18557302 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |