TWI784774B - Smart feedback device and systematic method for physiological image and signal - Google Patents

Smart feedback device and systematic method for physiological image and signal Download PDF

Info

Publication number
TWI784774B
TWI784774B TW110140077A TW110140077A TWI784774B TW I784774 B TWI784774 B TW I784774B TW 110140077 A TW110140077 A TW 110140077A TW 110140077 A TW110140077 A TW 110140077A TW I784774 B TWI784774 B TW I784774B
Authority
TW
Taiwan
Prior art keywords
information
unit
image
user
feedback
Prior art date
Application number
TW110140077A
Other languages
Chinese (zh)
Other versions
TW202317035A (en
Inventor
林秀真
張家銘
Original Assignee
中國醫藥大學
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 中國醫藥大學 filed Critical 中國醫藥大學
Priority to TW110140077A priority Critical patent/TWI784774B/en
Application granted granted Critical
Publication of TWI784774B publication Critical patent/TWI784774B/en
Publication of TW202317035A publication Critical patent/TW202317035A/en

Links

Images

Landscapes

  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Measuring Pulse, Heart Rate, Blood Pressure Or Blood Flow (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)
  • Measurement And Recording Of Electrical Phenomena And Electrical Characteristics Of The Living Body (AREA)

Abstract

Disclose is a smart feedback device and systematic method for physiological image and signal. The smart feedback device for physiological image and signal includes a physiological sensing unit, an image unit, a data fetching unit, a data transmitting unit, a cloud database, a cloud processing unit, and a feedback unit. The systematic method employs the smart feedback device in collocation with a sporting device to integrate a plurality of physiological signals and image data, and is further provided with personal recognition and cloud storage and computation to generate a warning feedback in accordance with risky movement or motion so as to help the user to intrinsically understand the current status of exercise and instantly correct any unsuitable movement or pose, thereby greatly improving safety of exercise, effectively increasing the whole efficiency, and avoiding any potential harm.

Description

智慧型生理暨影像訊號回饋裝置及系統方法Intelligent Physiological and Image Signal Feedback Device and System Method

本發明係有關於一種智慧型生理暨影像訊號回饋裝置及系統方法,尤其是整合多個生理訊號及影像訊號,並搭配個人辨識以及雲端儲存、運算的技術,同時還提供危險動作的警示回饋,進而幫助使用者直觀了解目前自身運動的表現,且即時修正不當動作或姿勢,可大幅提高運動安全性,並有效改善運動訓練的整體效率,避免任何運動傷害。The present invention relates to an intelligent physiological and image signal feedback device and system method, especially integrating multiple physiological signals and image signals, and matching personal identification, cloud storage, and computing technologies, and also provides warning feedback of dangerous actions. In turn, it helps users to intuitively understand the current performance of their own sports, and immediately corrects improper movements or postures, which can greatly improve sports safety, effectively improve the overall efficiency of sports training, and avoid any sports injuries.

近年來,民眾對於運動訓練的品質要求日益提高,而且受傷過後需要接受復健治療的患者也需要多進行一些在家訓練以提升治療效益,所以很需要優質的運動裝置。In recent years, people's requirements for the quality of sports training have been increasing, and patients who need rehabilitation after injuries also need to do more home training to improve the therapeutic effect, so high-quality sports equipment is in great demand.

另外,隨著政府大力推廣健康促進政策及全民運動風氣的提升,公私立的運動中心及健身房開始大量的成立,使得民眾能夠很便利的到運動場域進行訓練,但對於初學者或是先前較無運動習慣的民眾來說,場域中各式各樣的運動器材並無法完全掌握及熟悉其操作,因此,常會因為訓練重量過大、訓練次數過多或是因為在訓練過程中動作不正確而發生運動傷害。In addition, with the government's vigorous promotion of health promotion policies and the improvement of the national sports atmosphere, a large number of public and private sports centers and gymnasiums have begun to be established, making it easy for the public to go to the sports field for training. For people who are accustomed to exercise, the various sports equipment in the field cannot fully grasp and be familiar with its operation. Therefore, exercise often occurs due to excessive training weight, too many training times, or incorrect movements during training. harm.

目前,雖然現在許多運動場域都有配合的專業人員可以提供諮詢及指導,但受限於人力安排以及有限的資源,無法隨時都有專業人員進行動作指導,因此,如何隨時提醒使用者正確的使用運動器材及調整自己運動的動作以符合訓練需求或是避免受傷便成為在開發運動裝置上的一大挑戰課題。At present, although there are professionals in many sports fields who can provide consultation and guidance, but limited by manpower arrangements and limited resources, it is impossible to have professionals to guide actions at any time. Therefore, how to remind users to use it correctly at any time? Sports equipment and adjusting one's own movement to meet training needs or avoid injuries has become a major challenge in the development of sports equipment.

再者,對於有復健訓練需求的族群來說,持續進行適當強度及頻率的運動是十分重要的。在復健計畫與運動訓練中常要求其進行肌力與神經肌肉控制鍛練,藉此以改善不適的症狀或是進行生物力學上的調整。Furthermore, for groups with rehabilitation training needs, it is very important to continue to exercise with appropriate intensity and frequency. Muscle strength and neuromuscular control exercises are often required in rehabilitation programs and sports training to improve symptoms of discomfort or adjust biomechanics.

進一步對於受傷後的運動員來說,神經肌肉控制恢復更是其重回運動場的一大決定關鍵,而在訓練過程中經常需要治療師或是經過訓練的專業人員對患者或是運動員進行運動姿勢的矯正、生理狀況的評估或是確認肌肉出力。然而,在介入或訓練過程中,為了能促進復健進程及達到最佳的訓練效果,通常會希望患者或運動員能在住家附近或是鄰近區域進行自主運動訓練。但目前並無完整的系統或方法可以讓使用者在自行運動的過程中進行上述生理表現上的回饋。因此,為了確保使用者安全,會盡量避免使用高強度高風險的訓練菜單,但此一限制卻容易導致恢復或是訓練進程延緩,對於整體健康促進或是病後恢復上並非是好事。Furthermore, for athletes after injury, the recovery of neuromuscular control is a key decision for them to return to the sports field, and during the training process, therapists or trained professionals often need to perform exercise postures on patients or athletes. Correction, assessment of physiological condition, or confirmation of muscle output. However, in the intervention or training process, in order to promote the rehabilitation process and achieve the best training effect, it is usually hoped that patients or athletes can perform autonomous movement training near their homes or nearby areas. However, there is currently no complete system or method that allows the user to provide feedback on the above physiological performance during voluntary exercise. Therefore, in order to ensure the safety of users, high-intensity and high-risk training menus will be avoided as much as possible. However, this restriction will easily lead to a delay in recovery or training progress, which is not a good thing for overall health promotion or recovery after illness.

眾所周知,膝關節退化性關節炎(knee osteoarthritis,knee OA)是造成老年族群功能障礙的常見疾病,而過去的許多研究已證實,對膝關節退化患者給予適當的運動訓練能夠有效改善關節疼痛與功能障礙。在運動訓練中,最常使用的是固定式腳踏車運動(stationary cycling),因為固定式腳踏車的取得容易且操作簡單,不需特別學習,然而,目前並沒有適當的回饋系統及方法可以針對訓練方式與踩踏策略進行搭配,以致於實務上的應用與訓練效益相當受限。As we all know, knee osteoarthritis (knee OA) is a common disease that causes dysfunction in the elderly population, and many past studies have confirmed that appropriate exercise training for patients with knee joint degeneration can effectively improve joint pain and function obstacle. In sports training, stationary cycling is the most commonly used, because stationary cycling is easy to obtain and operate, and no special learning is required. However, there is currently no appropriate feedback system and method for training methods It is matched with the stepping strategy, so that the practical application and training benefits are quite limited.

另一方面,雖然運動裝置在業者不斷的創新下已能滿足一般需要,但是仍缺乏有效的使用者回饋機制而仍侷限於單一生理或影像訊號為主,所以實際應用上的功效不大,對於運動訓練、復健的幫助相當有限。On the other hand, although sports devices have been able to meet the general needs due to the continuous innovation of the industry, they still lack an effective user feedback mechanism and are still limited to a single physiological or image signal, so the practical application is not very effective. The help of sports training and rehabilitation is quite limited.

因此,很需要一種創新的智慧型生理暨影像訊號回饋裝置及系統方法,係整合多個生理訊號及影像訊號,並搭配個人辨識以及雲端儲存、運算的技術,同時還提供危險動作的警示回饋,進而幫助使用者直觀了解目前自身運動的表現,且即時修正不當動作或姿勢,可大幅提高運動安全性,並有效改善運動訓練的整體效率,避免任何運動傷害,藉以解決上述習知技術的問題。Therefore, there is a great need for an innovative intelligent physiological and image signal feedback device and system method, which integrates multiple physiological signals and image signals, and is equipped with personal identification, cloud storage, and computing technologies, and also provides warning feedback of dangerous actions. Furthermore, it helps users to intuitively understand the current performance of their own sports, and correct improper movements or postures in real time, which can greatly improve the safety of sports, effectively improve the overall efficiency of sports training, and avoid any sports injuries, so as to solve the problems of the above-mentioned conventional technologies.

本發明之主要目的在於提供一種智慧型生理暨影像訊號回饋裝置,包含生理感測單元、影像單元、資料擷取單元、資料傳輸單元、雲端資料庫、雲端運算單元以及回饋單元,用以搭配由使用者所使用而進行運動或訓練的運動裝置,比如固定式腳踏車、跑步機、踏步機、滑步機、滑輪機或橢圓機,進而提供生理回饋功能。The main purpose of the present invention is to provide an intelligent physiological and image signal feedback device, which includes a physiological sensing unit, an image unit, a data acquisition unit, a data transmission unit, a cloud database, a cloud computing unit and a feedback unit, for matching with Sports equipment used by users for exercise or training, such as stationary bicycles, treadmills, steppers, slide machines, pulley machines or elliptical machines, thereby providing physiological feedback functions.

具體而言,生理感測單元是用以感測使用者而產生並傳送感測資訊,比如可包含肌電感測器、心電感測器以及慣性感測器,而影像單元是用以拍攝使用者而產生及傳送使用者影像資訊,比如可包含攝影機,且由連接至生理感測單元以及影像單元的資料擷取單元接收並轉傳感測資訊以及使用者影像資訊。Specifically, the physiological sensing unit is used to sense the user to generate and transmit sensing information, such as a myoelectric sensor, an electrocardiographic sensor, and an inertial sensor, and the image unit is used to photograph the user. The generation and transmission of user image information may include, for example, a camera, and the data acquisition unit connected to the physiological sensing unit and the image unit receives and forwards the sensing information and user image information.

另外,資料傳輸單元連接至資料擷取單元以接收感測資訊以及使用者影像資訊,並接收來自資料輸入單元的個人資訊,且個人資訊是對應於使用者,進而結合感測資訊、使用者影像資訊以及個人資訊而產生及傳送使用者資訊至雲端網路,同時,還接收及轉傳來自運動裝置的目前運動狀態資訊至雲端網路。In addition, the data transmission unit is connected to the data acquisition unit to receive sensing information and user image information, and receives personal information from the data input unit, and the personal information corresponds to the user, and then combines the sensing information and user image Generate and transmit user information to the cloud network based on personal information and personal information. At the same time, it also receives and forwards the current exercise status information from the sports device to the cloud network.

再者,雲端資料庫包含對應於使用者的運動歷史資訊,並且是經由雲端網路而連接至資料傳輸單元,用以接收並儲存使用者資訊以及目前運動狀態資訊,進而更新所儲存的運動歷史資訊以供讀取。Furthermore, the cloud database includes exercise history information corresponding to the user, and is connected to the data transmission unit through the cloud network, to receive and store user information and current exercise status information, and then update the stored exercise history information for reading.

上述的雲端運算單元係電氣連接至雲端資料庫或是經由雲端網路而連接至雲端資料庫,用以讀取運動歷史資訊,且依據運動歷史資訊中的感測資訊、使用者影像資訊及目前運動狀態資訊以進行動作判斷處理,進而產生並傳送動作建議資訊以及動作警示資訊。The above-mentioned cloud computing unit is electrically connected to the cloud database or connected to the cloud database through the cloud network to read the motion history information, and based on the sensing information in the motion history information, the user image information and the current The motion status information is used for motion judgment processing, and then generates and transmits motion suggestion information and motion warning information.

尤其,回饋單元係包含影像輸出裝置以及音訊輸出裝置,並且是電氣連接至雲端運算單元或經由雲端網路而連接至雲端運算單元,用以接收動作建議資訊以及動作警示資訊,進而依據動作建議資訊以及動作警示資訊而進行回饋操作,其中回饋操作包含驅動影像輸出裝置以及音訊輸出裝置而分別播放回饋影像以及回饋聲音,用以供使用者參考而即時調整使用運動裝置的動作及姿勢。In particular, the feedback unit includes an image output device and an audio output device, and is electrically connected to the cloud computing unit or connected to the cloud computing unit through a cloud network to receive action suggestion information and action warning information, and then according to the action suggestion information And action warning information to perform feedback operation, wherein the feedback operation includes driving the image output device and the audio output device to respectively play the feedback image and the feedback sound, which are used for the user's reference and real-time adjustment of the movement and posture of using the sports device.

此外,本發明之另一目的在於提供一種智慧型生理暨影像訊號回饋系統方法,包含以下依序進行的步驟。首先設置智慧型生理暨影像訊號回饋裝置,且智慧型生理暨影像訊號回饋裝置包含生理感測單元、影像單元、資料擷取單元、資料傳輸單元、雲端資料庫、雲端運算單元以及回饋單元。In addition, another object of the present invention is to provide an intelligent physiological and image signal feedback system method, which includes the following steps performed in sequence. Firstly, the intelligent physiological and image signal feedback device is set up, and the intelligent physiological and image signal feedback device includes a physiological sensing unit, an image unit, a data acquisition unit, a data transmission unit, a cloud database, a cloud computing unit and a feedback unit.

接著,設置運動裝置,並利用資料傳輸單元以輸入對應於使用者的個人資訊,且由使用者藉運動裝置而進行運動,之後,由智慧型生理暨影像訊號回饋裝置搭配運動裝置,藉以實現生理回饋操作。Then, the exercise device is set up, and the data transmission unit is used to input the personal information corresponding to the user, and the user uses the exercise device to exercise, and then, the intelligent physiological and image signal feedback device is matched with the exercise device to achieve physiological Feedback operation.

具體而言,上述的生理回饋操作包含:由生理感測單元感測使用者而產生並傳送感測資訊;由影像單元拍攝使用者而產生及傳送使用者影像資訊;由資料擷取單元連接至生理感測單元以及影像單元,用以接收並轉傳感測資訊以及使用者影像資訊;由資料傳輸單元連接至資料擷取單元,用以接收感測資訊以及使用者影像資訊,並接收來自資料輸入單元的個人資訊,且結合感測資訊、使用者影像資訊以及個人資訊而產生及傳送使用者資訊至雲端網路,同時接收及轉傳目前運動狀態資訊至雲端網路;由雲端資料庫包含對應於使用者的運動歷史資訊,並且是經由雲端網路而連接至資料傳輸單元,用以接收並儲存使用者資訊以及目前運動狀態資訊而更新運動歷史資訊以供讀取;由雲端運算單元電氣連接至雲端資料庫或經由雲端網路而連接至雲端資料庫,用以讀取運動歷史資訊,且依據運動歷史資訊中的感測資訊及使用者影像資訊而產生並傳送動作表現資訊,同時針對目前運動狀態資訊、感測資訊及使用者影像資訊進行動作表現判斷處理而產生並傳送動作建議資訊以及動作警示資訊,雲端運算單元亦可依據使用者影像資訊產生並傳送使用者之個人識別資訊;以及由電氣連接至雲端運算單元或經由雲端網路而連接至雲端運算單元的回饋單元接收動作建議資訊以及動作警示資訊,進而依據動作建議資訊以及動作警示資訊而進行回饋操作。Specifically, the above-mentioned physiological feedback operation includes: the physiological sensing unit senses the user to generate and transmit sensing information; the imaging unit shoots the user to generate and transmit user image information; the data acquisition unit is connected to The physiological sensing unit and the image unit are used to receive and transmit the sensing information and user image information; the data transmission unit is connected to the data acquisition unit to receive the sensing information and user image information, and receive data from the Input the personal information of the unit, and combine the sensing information, user image information and personal information to generate and transmit user information to the cloud network, and at the same time receive and forward the current exercise status information to the cloud network; the cloud database includes Corresponds to the user's exercise history information, and is connected to the data transmission unit through the cloud network to receive and store user information and current exercise status information to update the exercise history information for reading; the cloud computing unit is electrically Connect to the cloud database or connect to the cloud database through the cloud network to read the sports history information, and generate and transmit the motion performance information according to the sensing information and user image information in the sports history information, and at the same time for The current motion status information, sensing information and user image information are judged and processed to generate and transmit action suggestion information and action warning information. The cloud computing unit can also generate and transmit the user's personal identification information based on the user image information; And the feedback unit electrically connected to the cloud computing unit or connected to the cloud computing unit through the cloud network receives the action suggestion information and the action warning information, and then performs the feedback operation according to the action suggestion information and the action warning information.

更具體而言,上述的回饋單元包含影像輸出裝置以及音訊輸出裝置,而回饋操作是包含驅動影像輸出裝置以及音訊輸出裝置而分別播放回饋影像以及回饋聲音,用以供使用者參考而即時調整使用運動裝置的動作及姿勢。More specifically, the above-mentioned feedback unit includes an image output device and an audio output device, and the feedback operation includes driving the image output device and the audio output device to respectively play the feedback image and the feedback sound for the user's reference and real-time adjustment. Movement and posture of the movement device.

因此,本發明實質上是整合多個生理訊號及影像訊號,並搭配個人辨識以及雲端儲存、運算的技術,同時還提供危險動作的警示回饋,進而幫助使用者直觀了解目前自身運動的表現,且即時修正不當動作或姿勢,可大幅提高運動安全性,並有效改善運動訓練的整體效率,避免任何運動傷害。Therefore, the present invention essentially integrates multiple physiological signals and video signals, and uses personal identification, cloud storage, and calculation technologies, and also provides warning feedback of dangerous actions, thereby helping users to intuitively understand the current performance of their own sports, and Immediately correcting improper movements or postures can greatly improve sports safety, effectively improve the overall efficiency of sports training, and avoid any sports injuries.

以下配合圖示及元件符號對本發明之實施方式做更詳細的說明,俾使熟習該項技藝者在研讀本說明書後能據以實施。The implementation of the present invention will be described in more detail below in conjunction with the diagrams and component symbols, so that those skilled in the art can implement it after studying this specification.

請參考第一圖,依據本發明第一實施例智慧型生理暨影像訊號回饋裝置的示意圖。如第一圖所示,本發明第一實施例的智慧型生理暨影像訊號回饋裝置包含生理感測單元10、影像單元20、資料擷取單元30、資料傳輸單元40、雲端資料庫50、雲端運算單元60以及回饋單元70,係用以搭配由使用者P所使用而進行運動或訓練的運動裝置80,而提供生理回饋功能,幫助使用者P能以直觀的方式輕鬆而又準確的了解到目前自身運動或訓練的表現,可有效改善運動訓練的整體效率,並即時修正不當動作或姿勢以避免任何運動傷害,大幅提高運動安全性。Please refer to the first figure, which is a schematic diagram of an intelligent physiological and video signal feedback device according to a first embodiment of the present invention. As shown in the first figure, the intelligent physiological and image signal feedback device of the first embodiment of the present invention includes a physiological sensing unit 10, an image unit 20, a data acquisition unit 30, a data transmission unit 40, a cloud database 50, a cloud The computing unit 60 and the feedback unit 70 are used to cooperate with the exercise device 80 used by the user P for exercise or training, and provide physiological feedback functions to help the user P understand easily and accurately in an intuitive way The current performance of your own sports or training can effectively improve the overall efficiency of sports training, and immediately correct improper movements or postures to avoid any sports injuries and greatly improve sports safety.

舉例而言,運動裝置80可包含固定式腳踏車、跑步機、踏步機、滑步機、滑輪機或橢圓機。For example, exercise device 80 may include a stationary bike, treadmill, stepper, slide machine, pulley machine, or elliptical machine.

整體而言,生理感測單元10是用以感測使用者P而產生並傳送感測資訊A,比如生理感測單元10可包含肌電感測器、心電感測器以及慣性感測器,是分別貼附或配戴於使用者P而藉感測以產生肌電感測訊號、心電感測訊號以及慣性感測訊號,而感測資訊包含肌電資訊、心電資訊以及慣性資訊,且肌電感測訊號、心電感測訊號以及慣性感測訊號是分別包含於肌電資訊、心電資訊以及慣性資訊。本質上,肌電資訊可包含肌電圖(Electromyogram,EMG)。Overall, the physiological sensing unit 10 is used to sense the user P to generate and transmit sensing information A. For example, the physiological sensing unit 10 may include an electromyographic sensor, an electrocardiographic sensor, and an inertial sensor. Respectively attached or worn on the user P to generate electromyographic sensing signals, electrocardiographic sensing signals and inertial sensing signals by sensing, and the sensing information includes electromyographic information, electrocardiographic information and inertial information, and electromyographic sensing signals The measuring signal, the electrocardiographic sensing signal and the inertial sensing signal are respectively included in the electromyographic information, the electrocardiographic information and the inertial information. Essentially, EMG information may include Electromyogram (EMG).

利用肌電波記錄器記錄肌肉電氣活動而產生的肌電圖在臨床上是相當有用的參考資料,尤其是關於運動及感覺神經纖維的傳導,而對於檢查末梢神經損傷更其特殊價值。整體而言,肌電圖的臨床價值在於:分析異常波出現模式,區別各種肌病變,鑑別神經原性或肌原性萎縮,肌力減退;研究神經肌肉結合處的病理或肌肉本身之病變;研究因代謝疾病造成的神經及肌肉功能障礙;潛伏性肌病變或運動神經障礙之探測;了解運動神經損傷後之恢復過程及神經再生情形;利用多元表面電極同時記錄肌群之肌電圖,了解正常運動或不隨意運動時之肌肉動態;利用電氣刺激器誘發肌電位及刺激神經做末稍神經傳導速度之測量,有助於了解人體工學及運動生理學。The electromyogram produced by recording muscle electrical activity with a myoelectric recorder is a very useful reference in clinical practice, especially regarding the conduction of motor and sensory nerve fibers, and it is of special value for examining peripheral nerve injuries. On the whole, the clinical value of electromyography lies in: analyzing the pattern of abnormal waves, differentiating various muscle diseases, identifying neurogenic or myogenic atrophy, and muscle weakness; studying the pathology of the neuromuscular junction or the lesions of the muscle itself; Research on nerve and muscle dysfunction caused by metabolic diseases; detection of latent myopathy or motor nerve disorder; understanding the recovery process and nerve regeneration after motor nerve injury; using multiple surface electrodes to simultaneously record the electromyogram of muscle groups to understand Muscle dynamics during normal exercise or involuntary exercise; the use of electrical stimulators to induce myoelectric potentials and stimulate nerves to measure peripheral nerve conduction velocity is helpful for understanding ergonomics and exercise physiology.

不過要注意的是,上述的肌電感測器、心電感測器以及慣性感測器只是用以方便請楚說明本發明特點的示範性實例而已,並非用以限制本發明範圍。換言之,生理感測單元10所包含的感測器種類以及數目可視實際需要而調整,藉以達到最佳功效,比如可使用血氧感測器,或使用多個肌電感測器貼附於使用者四肢、軀體、頭部的適當部位。However, it should be noted that the above-mentioned myoelectric sensor, electrocardiographic sensor and inertial sensor are just exemplary examples for explaining the characteristics of the present invention, and are not intended to limit the scope of the present invention. In other words, the type and number of sensors included in the physiological sensing unit 10 can be adjusted according to actual needs, so as to achieve the best effect. For example, a blood oxygen sensor can be used, or multiple myoelectric sensors can be attached to the user. Appropriate parts of limbs, body, head.

此外,影像單元20是用以拍攝使用者P而產生及傳送使用者影像資訊B,比如攝影機,換言之,影像單元20是拍攝使用者P在利用運動裝置80進行運動或訓練時的即時影像,主要是包含姿勢、動作、施力程度及速度。再者,資料擷取單元30連接至生理感測單元10以及影像單元20,用以接收並轉傳感測資訊A以及使用者影像資訊B。進一步,生理感測單元10以及影像單元20是以有線方式或無線方式連接資料擷取單元30,其中有線方式可包含電氣連接,而無線方式可包含藍芽(Blue Tooth)或WiFi。In addition, the image unit 20 is used to capture the user P to generate and transmit the user image information B, such as a video camera. It includes posture, movement, degree of exertion and speed. Furthermore, the data acquisition unit 30 is connected to the physiological sensing unit 10 and the image unit 20 for receiving and forwarding the sensing information A and the user image information B. Further, the physiological sensing unit 10 and the imaging unit 20 are connected to the data acquisition unit 30 in a wired or wireless way, wherein the wired way may include electrical connection, and the wireless way may include Bluetooth or WiFi.

上述的資料傳輸單元40連接至資料擷取單元30,用以接收感測資訊A以及使用者影像資訊B,並接收來自資料輸入單元U的個人資訊C,且個人資訊C是對應於使用者P,比如個人資訊C可包含姓名、性別、年齡,或是運動喜好、運動頻率,甚至是疾病,進而結合感測資訊A、使用者影像資訊B以及個人資訊C而產生及傳送使用者資訊D至雲端網路N,同時接收及轉傳來自運動裝置80的目前運動狀態資訊E至該雲端網路N。以固定式腳踏車當作運動裝置80為例,目前運動狀態資訊E可包含腳踏板阻力、車輪轉速、操作時間,藉以表示運動的強度。再以跑步機當作運動裝置80為例,目前運動狀態資訊E可包含跑步滑動板的移動速度、累計跑步時間。The above-mentioned data transmission unit 40 is connected to the data acquisition unit 30 for receiving sensing information A and user image information B, and receiving personal information C from the data input unit U, and the personal information C corresponds to the user P , such as personal information C can include name, gender, age, or sports preferences, exercise frequency, or even disease, and then combined with sensing information A, user image information B and personal information C to generate and transmit user information D to The cloud network N receives and forwards the current exercise state information E from the exercise device 80 to the cloud network N at the same time. Taking a stationary bicycle as the exercise device 80 as an example, the current exercise state information E may include pedal resistance, wheel speed, and operation time, so as to represent the intensity of the exercise. Taking the treadmill as the exercise device 80 again as an example, the current exercise state information E may include the moving speed of the running slide board and the accumulated running time.

進一步,雲端資料庫50包含對應於使用者P的運動歷史資訊F,並且是經由雲端網路N而連接至資料傳輸單元40,用以接收並儲存使用者資訊D以及目前運動狀態資訊E而更新所儲存的運動歷史資訊F以供讀取。Further, the cloud database 50 includes exercise history information F corresponding to the user P, and is connected to the data transmission unit 40 via the cloud network N, for receiving and storing user information D and current exercise state information E for updating The stored exercise history information F is available for reading.

更具體而言,雲端運算單元60電氣連接至雲端資料庫50或經由雲端網路N而連接至雲端資料庫50,用以讀取運動歷史資訊F,且依據運動歷史資訊F中的感測資訊A、使用者影像資訊B及目前運動狀態資訊E而進行動作判斷處理,進而產生並傳送動作建議資訊G以及動作警示資訊H。More specifically, the cloud computing unit 60 is electrically connected to the cloud database 50 or is connected to the cloud database 50 via the cloud network N, for reading the motion history information F, and according to the sensing information in the motion history information F A. The user's image information B and the current exercise state information E are used for action judgment processing, and then action suggestion information G and action warning information H are generated and transmitted.

上述的回饋單元70是電氣連接至雲端運算單元60或經由雲端網路N而連接至雲端運算單元60,用以接收動作建議資訊G以及動作警示資訊H,進而依據動作建議資訊G以及動作警示資訊H而進行回饋操作。舉例而言,回饋單元70可包含影像輸出裝置71以及音訊輸出裝置72,並且回饋操作是包含驅動影像輸出裝置71以及音訊輸出裝置72而分別播放回饋影像以及回饋聲音,用以供使用者P參考而即時調整使用運動裝置80時的動作及姿勢。The above-mentioned feedback unit 70 is electrically connected to the cloud computing unit 60 or connected to the cloud computing unit 60 through the cloud network N to receive the action suggestion information G and the action warning information H, and then according to the action suggestion information G and the action warning information H for feedback operation. For example, the feedback unit 70 may include an image output device 71 and an audio output device 72, and the feedback operation includes driving the image output device 71 and the audio output device 72 to respectively play a feedback image and a feedback sound for reference by the user P And adjust the action and posture when using the exercise device 80 in real time.

換言之,影像輸出裝置71以及音訊輸出裝置72可分別利用傳統的顯示器以及揚聲器而實現,或者利用平板電腦、智慧型手機當作回饋單元70,所以不需額外配置特殊設計的裝置,整體的建置非常簡便且容易實施。In other words, the image output device 71 and the audio output device 72 can be realized by using traditional displays and speakers respectively, or using a tablet computer or a smart phone as the feedback unit 70, so there is no need to configure additional specially designed devices, and the overall construction Very simple and easy to implement.

進一步,上述的回饋影像可包含視覺上易懂的圖表、圖示、標示、數據、顏色、燈號以及光影的至少其中之一,所以使用者能以直觀的方式而清楚了解動作狀態而是否需要即時修正錯誤或不良的動作、姿勢、施力大小,並隨時掌握生理狀態,比如肌電圖、心跳、血壓、血氧量,尤其還能觀察到運動裝置80的操作狀態及操作參數,比如固定式腳踏車的轉輪轉速、跑步機的滑動板速度,進而提供即時且有效的回饋以幫助使用者調整最佳的運動、訓練或復健。Further, the above-mentioned feedback image may include at least one of visually understandable charts, diagrams, signs, data, colors, lights, and light and shadows, so users can clearly understand the action status in an intuitive manner and whether they need to Immediately correct wrong or bad actions, postures, and applied force, and keep abreast of physiological states, such as electromyography, heartbeat, blood pressure, and blood oxygen levels. In particular, the operating state and operating parameters of the exercise device 80 can be observed, such as fixed The rotation speed of the wheel of the bicycle and the speed of the sliding plate of the treadmill provide immediate and effective feedback to help the user adjust the best exercise, training or rehabilitation.

再者,上述的回饋聲音可包含動作修正語音、危險警告語音以及警示音的至少其中之一,用以在發生動作錯誤不適當時,提醒使用者注意而修正動作,並避免造成運動傷害,改善使用上的安全性。Furthermore, the above-mentioned feedback sound may include at least one of motion correction voice, danger warning voice, and warning sound, which are used to remind the user to pay attention to correct the motion when an incorrect motion occurs, avoid sports injuries, and improve the user experience. on security.

例如,使用者在使用固定式腳踏車而發生上半身向左偏移時,可能因踩踏施力不當或右腿肌肉較弱而產生代償作用所造成,本發明可藉回饋單元70顯示使用者偏左的圖示或標示以提醒使用者注意,同時還由回饋單元70發出動作修正語音,比如需要向右校正姿勢,或是發出危險警告語音,比如姿勢過度偏左而有導致傷害風險。因此,使用者可立即調整姿勢,避免運動傷害。For example, when the user uses a stationary bicycle and the upper body deviates to the left, it may be caused by improper pedaling force or weak right leg muscles. The present invention can use the feedback unit 70 to display the left deviation Icons or signs are used to remind the user to pay attention, and at the same time, the feedback unit 70 sends out action correction voices, such as correcting the posture to the right, or a danger warning voice, such as the posture is too far to the left and there is a risk of injury. Therefore, the user can immediately adjust the posture and avoid sports injuries.

此外,雲端資料庫50進一步包含對應於使用者P的個人辨識影像,比如大頭照或全身照,其中個人辨識影像是經由影像單元20拍攝後產生而藉資料擷取單元30以及資料傳輸單元40傳送至雲端網路N,進而由雲端資料庫50接收而儲存以供讀取。再者,雲端運算單元60藉讀取雲端資料庫50所儲存的個人辨識影像以進行個人辨識,並在個人辨識成功後才進行動作判斷處理,而如果個人辨識不成功,則不進行該動作判斷處理。因此,個人辨識的功能可防止個人隱私或個資外洩。In addition, the cloud database 50 further includes a personal identification image corresponding to the user P, such as a headshot or a full-body photo, wherein the personal identification image is generated after being shot by the image unit 20 and transmitted by the data acquisition unit 30 and the data transmission unit 40 to the cloud network N, and then received by the cloud database 50 and stored for reading. Furthermore, the cloud computing unit 60 performs personal identification by reading the personal identification images stored in the cloud database 50, and performs motion judgment processing only after the personal recognition is successful, and does not perform the motion judgment if the personal recognition is unsuccessful. deal with. Therefore, the function of personal identification can prevent leakage of personal privacy or personal information.

整體而言,本發明第一實施例的智慧型生理暨影像訊號回饋裝置係整合多個生理訊號及影像訊號,並搭配個人辨識以及雲端儲存、運算的技術,同時還提供危險動作的警示回饋,進而幫助使用者直觀了解目前自身運動的表現,且即時修正不當動作或姿勢,可大幅提高運動安全性,並有效改善運動訓練的整體效率,避免任何運動傷害。Overall, the intelligent physiological and image signal feedback device of the first embodiment of the present invention integrates multiple physiological signals and image signals, and is equipped with personal identification, cloud storage, and computing technologies, and also provides warning feedback of dangerous actions. In turn, it helps users to intuitively understand the current performance of their own sports, and immediately corrects improper movements or postures, which can greatly improve sports safety, effectively improve the overall efficiency of sports training, and avoid any sports injuries.

進一步參考第二圖,依據本發明第二實施例智慧型生理暨影像訊號回饋系統方法的操作流程示意圖。如第二圖所示,第二實施例智慧型生理暨影像訊號回饋系統方法包含依序進行的步驟S10、S20、S30、S40以及S50,用以提供智慧型回饋功能而大幅改善整體功效。Further referring to FIG. 2 , it is a schematic diagram of the operation flow of the intelligent physiological and image signal feedback system method according to the second embodiment of the present invention. As shown in the second figure, the intelligent physiological and image signal feedback system method of the second embodiment includes steps S10, S20, S30, S40, and S50 performed in sequence to provide intelligent feedback functions and greatly improve the overall efficacy.

具體而言,本發明第二實施例的智慧型生理暨影像訊號回饋系統方法是從步驟S10開始,係設置智慧型生理暨影像訊號回饋裝置,而設置智慧型生理暨影像訊號回饋裝置包含生理感測單元、影像單元、資料擷取單元、資料傳輸單元、雲端資料庫、雲端運算單元以及回饋單元。由於設置智慧型生理暨影像訊號回饋裝置的主要技術已在第一實施例中詳細解釋,因而下文不再贅述。Specifically, the intelligent physiological and image signal feedback system method of the second embodiment of the present invention starts from step S10, which is to set the intelligent physiological and image signal feedback device, and the setting of the intelligent physiological and image signal feedback device includes physiological sense Measurement unit, image unit, data acquisition unit, data transmission unit, cloud database, cloud computing unit and feedback unit. Since the main technology of setting up the intelligent physiological and video signal feedback device has been explained in detail in the first embodiment, it will not be repeated below.

接著進入步驟S20,係設置運動裝置,其中運動裝置可包含固定式腳踏車、跑步機、踏步機、滑步機、滑輪機或橢圓機,如同第一實施例所述。Then enter step S20, which is to set the exercise device, wherein the exercise device may include a stationary bicycle, a treadmill, a stepper, a slide machine, a pulley machine or an elliptical machine, as described in the first embodiment.

然後在步驟S30中,由使用者利用資料傳輸單元以輸入對應於使用者的個人資訊,接著進入步驟S40,由使用者藉運動裝置而進行運動。Then in step S30, the user uses the data transmission unit to input the personal information corresponding to the user, and then enters step S40, where the user uses the exercise device to exercise.

最後執行步驟S50,由智慧型生理暨影像訊號回饋裝置搭配運動裝置以實現生理回饋操作,而生理回饋操作是如第三圖所示,包含步驟S51、S52、S53、S54、S55、S56以及S57。Finally, step S50 is executed, and the intelligent physiological and video signal feedback device is combined with the exercise device to realize the physiological feedback operation, and the physiological feedback operation is shown in the third figure, including steps S51, S52, S53, S54, S55, S56 and S57 .

在步驟S51中,由生理感測單元感測使用者而產生並傳送感測資訊,而在步驟S52中,是由影像單元拍攝使用者而產生及傳送使用者影像資訊,且在步驟S53中,由資料擷取單元連接至生理感測單元以及影像單元,用以接收並轉傳感測資訊以及使用者影像資訊,其中,步驟S51和步驟S52可以同時進行或者以任意順序先後進行。In step S51, the physiological sensing unit senses the user to generate and transmit sensing information, and in step S52, the image unit shoots the user to generate and transmit user image information, and in step S53, The data acquisition unit is connected to the physiological sensing unit and the imaging unit to receive and transmit sensing information and user image information, wherein step S51 and step S52 can be performed simultaneously or sequentially in any order.

接著在步驟S54中,由資料傳輸單元連接至資料擷取單元,用以接收感測資訊以及使用者影像資訊,並接收來自資料輸入單元的個人資訊,且結合感測資訊、使用者影像資訊以及個人資訊而產生及傳送使用者資訊至雲端網路,同時,還接收及轉傳目前運動狀態資訊至雲端網路。Then in step S54, the data transmission unit is connected to the data acquisition unit to receive sensing information and user image information, and receive personal information from the data input unit, and combine the sensing information, user image information and Personal information is generated and transmitted to the cloud network, and at the same time, the current exercise status information is also received and forwarded to the cloud network.

之後在步驟S55中,由雲端資料庫包含對應於該使用者的運動歷史資訊,並且是經由雲端網路而連接至資料傳輸單元,用以接收並儲存使用者資訊以及目前運動狀態資訊而更新運動歷史資訊以供讀取。接著在步驟S56中,由雲端運算單元電氣連接至雲端資料庫或經由雲端網路而連接至雲端資料庫,用以讀取運動歷史資訊,且依據運動歷史資訊中的該感測資訊及使用者影像資訊而產生並傳送動作表現資訊,同時,還針對目前運動狀態資訊、感測資訊及使用者影像資訊進行動作判斷處理而產生並傳送動作建議資訊以及動作警示資訊。此外,雲端運算單元亦可依據使用者影像資訊產生並傳送使用者之個人識別資訊。Then in step S55, the cloud database contains the exercise history information corresponding to the user, and is connected to the data transmission unit via the cloud network to receive and store user information and current exercise status information to update the exercise Historical information for reading. Then in step S56, the cloud computing unit is electrically connected to the cloud database or connected to the cloud database through the cloud network to read the exercise history information, and according to the sensing information and the user in the exercise history information The image information is used to generate and transmit motion performance information. At the same time, it also performs motion judgment processing on the current motion status information, sensing information, and user image information to generate and transmit motion suggestion information and motion warning information. In addition, the cloud computing unit can also generate and transmit the user's personal identification information based on the user's image information.

最後在步驟S57中,由電氣連接至雲端運算單元或經由該雲端網路而連接至雲端運算單元的回饋單元接收動作建議資訊以及動作警示資訊,進而依據動作建議資訊以及動作警示資訊而進行回饋操作,且回饋單元包含影像輸出裝置以及音訊輸出裝置,其中回饋操作是包含驅動影像輸出裝置以及音訊輸出裝置而分別播放回饋影像以及回饋聲音,用以供使用者參考而即時調整使用運動裝置的動作及姿勢。Finally, in step S57, the feedback unit electrically connected to the cloud computing unit or connected to the cloud computing unit via the cloud network receives the action suggestion information and the action warning information, and then performs the feedback operation according to the action suggestion information and the action warning information , and the feedback unit includes an image output device and an audio output device, wherein the feedback operation includes driving the image output device and the audio output device to play the feedback image and the feedback sound respectively, so as to provide the user with reference to real-time adjustment of the action of using the sports device and posture.

為進一步簡化整體結構及系統配置,可將影像單元以及回饋單元相互結合成一體的整合單元,且設置於運動裝置上以方便拍攝使用者、並供使用者觀看回饋影像以及收聽回饋聲音。以固定式腳踏車當作運動裝置為例,整合單元可配置在固定式腳踏車的把手中間,所以使用者在踩踏固定式腳踏車時,便可很自然的往前看到整合單元所播放的回饋影像,同聽取回饋聲音,保持一般腳踏車的騎車姿勢,符合人體工學,而且影像單元可拍攝使用者的上半身的正面影像,供雲端運算單元判斷運動姿勢是否偏左或偏右,或是太過前傾或後傾。或者,也可只將影像輸出裝置結合影像單元而配置在固定式腳踏車的把手中間,而音訊輸出裝置是以耳機的形式供使用者配戴,藉以減少對鄰近其他使用者的聲音干擾。In order to further simplify the overall structure and system configuration, the image unit and the feedback unit can be combined into an integrated unit, and installed on the sports device to facilitate the shooting of the user, and for the user to watch the feedback image and listen to the feedback sound. Taking a stationary bicycle as an exercise device as an example, the integrated unit can be placed in the middle of the handlebar of the stationary bicycle, so when the user steps on the stationary bicycle, he can naturally look forward to see the feedback video played by the integrated unit, While listening to the feedback sound, maintain the general bicycle riding posture, which is ergonomic, and the image unit can capture the frontal image of the user's upper body for the cloud computing unit to judge whether the exercise posture is left or right, or too forward Lean or lean back. Alternatively, only the image output device can be combined with the image unit and arranged in the middle of the handlebar of the stationary bicycle, and the audio output device is worn by the user in the form of earphones, so as to reduce the sound interference to other nearby users.

另外,生理感測單元也可利用具生理感測功能以及無線通信功能的智慧型手表或健康手環而實現,並以無線方式連結資料擷取單元而傳送感測資訊,不過資料擷取單元也必須配置無線通信功能,可省去電氣連接線路的佈局,使用上更加方便。In addition, the physiological sensing unit can also be realized by using a smart watch or a health bracelet with physiological sensing function and wireless communication function, and wirelessly connects with the data acquisition unit to transmit sensing information, but the data acquisition unit also The wireless communication function must be configured, which can save the layout of electrical connection lines and make it more convenient to use.

由於膝關節退化性關節炎是造成老年族群功能的主要障礙之一,所以便以膝關節退化性關節炎的病患為例說明本發明的具體功效。Since knee osteoarthritis is one of the main barriers to the function of the elderly, patients with knee osteoarthritis are taken as an example to illustrate the specific effects of the present invention.

過去已有許多的研究證實需要對膝關節退化患者給予適當的運動訓練,才能有效改善關節疼痛與功能障礙,然而,針對患者方便取得的固定式腳踏車運動的訓練效益卻沒有適當的回饋系統及方法以維持最佳的訓練方式與踩踏策略,以致於實務上的應用受限。換言之,傳統固定式腳踏車的運動裝置缺乏有效的生物回饋。Many studies in the past have confirmed that appropriate exercise training is needed for patients with knee joint degeneration to effectively improve joint pain and dysfunction. However, there is no proper feedback system and method for the training benefits of stationary bicycle exercise that is conveniently obtained by patients In order to maintain the best training method and pedaling strategy, the practical application is limited. In other words, the exercise device of the traditional stationary bicycle lacks effective biofeedback.

在應用實例上,本發明提供多達14位的膝關節退化患者進行適當運動訓練,並分為兩組,其中一組為控制組,是只使用不具回饋機制的傳統固定式腳踏車當作運動裝置,而另一組為回饋組,是特別使用股內側肌(vastus medialis,VM)肌電圖回饋機制當作本發明回饋單元的其中一示範例,搭配固定式腳踏車的運動裝置,如第四圖所示。In the application example, the present invention provides as many as 14 patients with knee joint degeneration to carry out appropriate exercise training, and divide them into two groups, one of which is the control group, which only uses traditional stationary bicycles without feedback mechanism as exercise devices , and the other group is the feedback group, which uses the vastus medialis (VM) EMG feedback mechanism as one of the examples of the feedback unit of the present invention, and is matched with a stationary bicycle exercise device, as shown in the fourth figure shown.

上述控制組以及回饋組的整體訓練為期六周,每周兩節,單節30分鐘的固定式腳踏車運動訓練,並且比較在訓練前後患者的膝關節功能問卷、疼痛量表、肌力、肌耐力及腳踏車運動中每五分鐘肌肉活化程度之差異。The overall training of the control group and the feedback group lasted for six weeks, two sessions per week, a single session of 30 minutes of stationary bicycle exercise training, and compared the knee joint function questionnaire, pain scale, muscle strength, and muscle endurance of the patients before and after the training and the difference in muscle activation every five minutes during cycling.

結果顯示,功能性表現、患側疼痛、肌力與肌耐力並無法藉由六周的腳踏車訓練而有顯著的進步,且無組間差異,然而固定式腳踏車運動過程中,肌電圖回饋能使患者在運動過程中對肌肉的徵招(較高的最大及最小肌肉活化程度),但該現象並未呈現於目標肌肉(股內側肌)而是發生於鄰近的股直肌。因此,本發明的回饋單元所產生的效益相當明顯而具產業利用性。The results showed that functional performance, pain on the affected side, muscle strength and muscle endurance could not be significantly improved by six weeks of cycling training, and there was no difference between groups. However, during stationary cycling, EMG feedback could make The patient's recruitment of muscles during exercise (higher maximal and minimal muscle activation) was not present in the target muscle (vastus medialis) but in the adjacent rectus femoris. Therefore, the benefits generated by the feedback unit of the present invention are quite obvious and have industrial applicability.

綜上所述,本發明的特點在於整合多個生理訊號及影像訊號,並搭配個人辨識以及雲端儲存、運算的技術,同時還提供危險動作的警示回饋,進而幫助使用者直觀了解目前自身運動的表現,且即時修正不當動作或姿勢,可大幅提高運動安全性,並有效改善運動訓練的整體效率,避免任何運動傷害。To sum up, the feature of the present invention is to integrate multiple physiological signals and image signals, and to use personal identification, cloud storage, and calculation technologies, and also provide warning feedback of dangerous actions, thereby helping users to intuitively understand the current state of their own movement Improper movement or posture can be corrected immediately, which can greatly improve sports safety, effectively improve the overall efficiency of sports training, and avoid any sports injuries.

以上所述者僅為用以解釋本發明之較佳實施例,並非企圖據以對本發明做任何形式上之限制,是以,凡有在相同之發明精神下所作有關本發明之任何修飾或變更,皆仍應包括在本發明意圖保護之範疇。The above are only preferred embodiments for explaining the present invention, and are not intended to limit the present invention in any form. Therefore, any modification or change of the present invention made under the same spirit of the invention , should still be included in the scope of protection intended by the present invention.

10:生理感測單元 20:影像單元 30:資料擷取單元 40:資料傳輸單元 50:雲端資料庫 60:雲端運算單元 70:回饋單元 71:影像輸出裝置 72:音訊輸出裝置 80:運動裝置 A:感測資訊 B:使用者影像資訊 C:個人資訊 D:使用者資訊 E:目前運動狀態資訊 F:運動歷史資訊 G:動作建議資訊 H:動作警示資訊 N:雲端網路 P:使用者 U:資料輸入單元 S10, S20, S30, S40, S50:步驟 S51, S52, S53, S54, S55, S56, S57:步驟 10: Physiological sensing unit 20: Image unit 30: Data acquisition unit 40: Data transmission unit 50:Cloud database 60: Cloud Computing Unit 70:Feedback unit 71: Image output device 72: Audio output device 80:Motion device A: Sensing information B: User image information C: Personal Information D: User information E: Current exercise status information F: Sports history information G: Action suggestion information H: Action warning information N: cloud network P: user U: data input unit S10, S20, S30, S40, S50: steps S51, S52, S53, S54, S55, S56, S57: steps

第一圖顯示依據本發明第一實施例智慧型生理暨影像訊號回饋裝置的示意圖。 第二圖顯示依據本發明第二實施例智慧型生理暨影像訊號回饋系統方法的操作流程示意圖。 第三圖顯示依據本發明第二實施例智慧型生理暨影像訊號回饋系統方法中生理回饋操作的操作流程示意圖。 第四圖顯示依據本發明的應用實例示意圖。 The first figure shows a schematic diagram of an intelligent physiological and video signal feedback device according to a first embodiment of the present invention. The second figure shows a schematic diagram of the operation flow of the intelligent physiological and image signal feedback system method according to the second embodiment of the present invention. The third figure shows a schematic diagram of the operation flow of the physiological feedback operation in the intelligent physiological and image signal feedback system method according to the second embodiment of the present invention. Figure 4 shows a schematic diagram of an application example according to the present invention.

10:生理感測單元 10: Physiological sensing unit

20:影像單元 20: Image unit

30:資料擷取單元 30: Data acquisition unit

40:資料傳輸單元 40: Data transmission unit

50:雲端資料庫 50:Cloud database

60:雲端運算單元 60: Cloud Computing Unit

70:回饋單元 70:Feedback unit

71:影像輸出裝置 71: Image output device

72:音訊輸出裝置 72: Audio output device

80:運動裝置 80:Motion device

A:感測資訊 A: Sensing information

B:使用者影像資訊 B: User image information

C:個人資訊 C: Personal information

D:使用者資訊 D: User information

E:目前運動狀態資訊 E: Current exercise status information

F:運動歷史資訊 F: Sports history information

G:動作建議資訊 G: Action suggestion information

H:動作警示資訊 H: Action warning information

N:雲端網路 N: cloud network

P:使用者 P: user

U:資料輸入單元 U: data input unit

Claims (10)

一種智慧型生理暨影像訊號回饋裝置,係用以搭配一運動裝置而提供生理回饋功能給使用該運動裝置的一使用者,包括:一生理感測單元,係用以感測該使用者而產生並傳送一感測資訊;一影像單元,係用以拍攝該使用者而產生及傳送一使用者影像資訊;一資料擷取單元,係連接至該生理感測單元以及該影像單元,用以接收並轉傳該感測資訊以及該使用者影像資訊;一資料傳輸單元,係連接至該資料擷取單元,用以接收該感測資訊以及該使用者影像資訊,並接收來自一資料輸入單元的一個人資訊,且該個人資訊是對應於該使用者,進而結合該感測資訊、該使用者影像資訊以及該個人資訊而產生及傳送一使用者資訊至一雲端網路,同時接收及轉傳來自該運動裝置的一目前運動狀態資訊至該雲端網路;一雲端資料庫,係包含對應於該使用者的一運動歷史資訊,並且是經由該雲端網路而連接至該資料傳輸單元,用以接收並儲存該使用者資訊以及該目前運動狀態資訊而更新該運動歷史資訊以供讀取;一雲端運算單元,係電氣連接至該雲端資料庫或經由該雲端網路而連接至該雲端資料庫,用以讀取該運動歷史資訊,且依據該運動歷史資訊中的該感測資訊及該使用者影像資訊而產生並傳送一動作表現資訊,同時針對該使用者影像資訊及該目前運動狀態資訊以進行一動作判斷處理而產生並傳送一動作建議資訊以及一動作警示資訊;以及一回饋單元,係具一影音播放功能,並電氣連接至該雲端運算單元或經由該雲端網路而連接至該雲端運算單元,用以接收該動作建議資訊以及該動作警示資訊,進而依據該動作建議資訊以及該動作警示資訊而進行一回饋操作而播放該動作建議資訊以及該動作警示資訊,且該回饋單元包含一影像輸出裝置以及一音訊輸出裝置,而該回饋操作包含驅動該影像輸出裝置以及該音訊輸出裝置而 分別播放一回饋影像以及一回饋聲音,用以供該使用者參考而即時調整使用該運動裝置的動作及姿勢。 An intelligent physiological and image signal feedback device is used to provide physiological feedback function to a user using the exercise device in conjunction with an exercise device, including: a physiological sensing unit, which is used to sense the user and generate and transmit a sensing information; an image unit is used to photograph the user to generate and transmit a user image information; a data acquisition unit is connected to the physiological sensing unit and the image unit for receiving and forward the sensing information and the user image information; a data transmission unit is connected to the data acquisition unit to receive the sensing information and the user image information, and receive input from a data input unit A personal information, and the personal information corresponds to the user, and then combines the sensing information, the user image information and the personal information to generate and transmit a user information to a cloud network, and receive and forward from A current exercise status information of the exercise device is sent to the cloud network; a cloud database includes a exercise history information corresponding to the user, and is connected to the data transmission unit through the cloud network for use in Receive and store the user information and the current exercise status information and update the exercise history information for reading; a cloud computing unit is electrically connected to the cloud database or connected to the cloud database through the cloud network , used to read the exercise history information, and generate and transmit an action performance information based on the sensing information and the user image information in the exercise history information, and at the same time target the user image information and the current exercise state information Generate and transmit an action suggestion information and an action warning information by performing an action judgment process; and a feedback unit having an audio-visual playback function and being electrically connected to the cloud computing unit or connected to the The cloud computing unit is used to receive the action suggestion information and the action warning information, and then perform a feedback operation based on the action suggestion information and the action warning information to play the action suggestion information and the action warning information, and the feedback unit includes An image output device and an audio output device, and the feedback operation includes driving the image output device and the audio output device to A feedback image and a feedback sound are respectively played for the user's reference to adjust the action and posture of using the exercise device in real time. 如請求項1所述之智慧型生理暨影像訊號回饋裝置,其中該運動裝置包含一固定式腳踏車、一跑步機、一踏步機、一滑步機、一滑輪機或一橢圓機。 The intelligent physiological and image signal feedback device as described in Claim 1, wherein the exercise device includes a stationary bicycle, a treadmill, a stepper, a slide machine, a pulley machine or an elliptical machine. 如請求項1所述之智慧型生理暨影像訊號回饋裝置,其中該生理感測單元包含一肌電感測器、一心電感測器以及一慣性感測器,是分別貼附或配戴於該使用者而藉感測以產生一肌電感測訊號、一心電感測訊號以及一慣性感測訊號,而該感測資訊包含一肌電資訊、一心電資訊以及一慣性資訊,且該肌電感測訊號、該心電感測訊號以及該慣性感測訊號是分別包含於該肌電資訊、該心電資訊以及該慣性資訊。 The intelligent physiological and image signal feedback device as described in claim item 1, wherein the physiological sensing unit includes a myoelectric sensor, an electrocardiographic sensor and an inertial sensor, which are respectively attached or worn on the Or by sensing to generate a myoelectric sensing signal, an electrocardiographic sensing signal, and an inertial sensing signal, and the sensing information includes an electromyographic information, an electrocardiographic information, and an inertial information, and the electromyographic sensing signal, The electrocardiographic sensing signal and the inertial sensing signal are respectively contained in the electromyographic information, the electrocardiographic information and the inertial information. 如請求項1所述之智慧型生理暨影像訊號回饋裝置,其中該生理感測單元以及該資料擷取單元是以一有線方式或一無線方式而連接,且該有線方式包含電氣連接,而該無線方式包含藍芽(Blue Tooth)或WiFi,該回饋影像包含一圖表、一數據、一顏色以及一光影的至少其中之一,而該回饋聲音包含一動作修正語音、一危險警告語音以及一警示音的至少其中之一。 The intelligent physiological and image signal feedback device as described in claim 1, wherein the physiological sensing unit and the data acquisition unit are connected in a wired way or a wireless way, and the wired way includes electrical connection, and the The wireless method includes Bluetooth (Blue Tooth) or WiFi, the feedback image includes at least one of a chart, a data, a color, and a light and shadow, and the feedback sound includes a motion correction voice, a danger warning voice, and a warning at least one of the sounds. 如請求項1所述之智慧型生理暨影像訊號回饋裝置,其中該雲端資料庫進一步包含對應於該使用者的一個人辨識影像,該個人辨識影像是經由該影像單元拍攝後產生而藉該資料擷取單元以及該資料傳輸單元傳送至該雲端網路,進而由該雲端資料庫接收而儲存以供讀取,該雲端運算單元讀取該讀取雲端資料庫所儲存的該個人辨識影像以進行一個人辨識,並在該個人辨識成 功後才進行該動作判斷處理,而如果該個人辨識不成功,則不進行該動作判斷處理。 The intelligent physiological and image signal feedback device as described in Claim 1, wherein the cloud database further includes a personal identification image corresponding to the user, and the personal identification image is generated after being shot by the imaging unit and captured by the data The fetching unit and the data transmission unit are sent to the cloud network, and then received by the cloud database and stored for reading, and the cloud computing unit reads the personal identification image stored in the read cloud database to perform a personal identification identified, and when the individual is identified as The action judgment process is performed only after the identification is successful, and if the person identification is unsuccessful, the action judgment process is not performed. 一種智慧型生理暨影像訊號回饋系統方法,包含:設置一智慧型生理暨影像訊號回饋裝置,且包含一生理感測單元、一影像單元、一資料擷取單元、一資料傳輸單元、一雲端資料庫、一雲端運算單元以及一回饋單元;設置一運動裝置;利用該資料傳輸單元以輸入對應於該使用者的一個人資訊;由一使用者藉該運動裝置而進行運動;以及由該智慧型生理暨影像訊號回饋裝置搭配該運動裝置,藉以實現一生理回饋操作,其中該生理回饋操作包含:由該生理感測單元感測該使用者而產生並傳送一感測資訊;由該影像單元拍攝該使用者而產生及傳送一使用者影像資訊;由該資料擷取單元連接至該生理感測單元以及該影像單元,用以接收並轉傳該感測資訊以及該使用者影像資訊;由該資料傳輸單元連接至該資料擷取單元,用以接收該感測資訊以及該使用者影像資訊,並接收來自一資料輸入單元的個人資訊,且結合該感測資訊、該使用者影像資訊以及該個人資訊而產生及傳送一使用者資訊至一雲端網路,同時接收及轉傳一目前運動狀態資訊至該雲端網路;由該雲端資料庫包含對應於該使用者的一運動歷史資訊,並且是經由該雲端網路而連接至該資料傳輸單元,用以接收並儲存該使用者資訊以及該目前運動狀態資訊而更新該運動歷史資訊以供讀取; 由該雲端運算單元電氣連接至該雲端資料庫或經由該雲端網路而連接至該雲端資料庫,用以讀取該運動歷史資訊,且依據該運動歷史資訊中的該感測資訊及該使用者影像資訊而產生並傳送一動作表現資訊,同時針對該目前運動狀態資訊、該感測資訊及該使用者影像資訊進行一動作判斷處理而產生並傳送一動作建議資訊以及一動作警示資訊;以及由電氣連接至該雲端運算單元或經由該雲端網路而連接至該雲端運算單元的該回饋單元接收該動作建議資訊以及該動作警示資訊,進而依據該動作建議資訊以及該動作警示資訊而進行一回饋操作,且該回饋單元包含一影像輸出裝置以及一音訊輸出裝置,而該回饋操作包含驅動該影像輸出裝置以及該音訊輸出裝置而分別播放一回饋影像以及一回饋聲音,用以供該使用者參考而即時調整使用該運動裝置的動作及姿勢。 A method for an intelligent physiological and image signal feedback system, including: installing an intelligent physiological and image signal feedback device, and including a physiological sensing unit, an image unit, a data acquisition unit, a data transmission unit, and a cloud data Library, a cloud computing unit and a feedback unit; set up an exercise device; use the data transmission unit to input a personal information corresponding to the user; exercise by a user through the exercise device; and by the intelligent physiological And the image signal feedback device is matched with the exercise device to realize a physiological feedback operation, wherein the physiological feedback operation includes: the physiological sensing unit senses the user to generate and transmit a sensing information; the imaging unit captures the The user generates and transmits a user image information; the data acquisition unit is connected to the physiological sensing unit and the image unit for receiving and retransmitting the sensing information and the user image information; from the data The transmission unit is connected to the data acquisition unit for receiving the sensing information and the user image information, and receiving personal information from a data input unit, and combining the sensing information, the user image information and the personal information Generate and send a user information to a cloud network based on the information, and receive and forward a current exercise status information to the cloud network at the same time; the cloud database contains a movement history information corresponding to the user, and is Connect to the data transmission unit via the cloud network, to receive and store the user information and the current exercise status information, and update the exercise history information for reading; The cloud computing unit is electrically connected to the cloud database or connected to the cloud database through the cloud network to read the motion history information, and according to the sensing information and the usage in the motion history information generate and transmit a motion performance information based on the user image information, and simultaneously perform a motion judgment process on the current motion state information, the sensing information and the user image information to generate and transmit a motion suggestion information and a motion warning information; and The feedback unit electrically connected to the cloud computing unit or connected to the cloud computing unit via the cloud network receives the action suggestion information and the action warning information, and then performs an action based on the action suggestion information and the action warning information. Feedback operation, and the feedback unit includes an image output device and an audio output device, and the feedback operation includes driving the image output device and the audio output device to respectively play a feedback image and a feedback sound for the user Refer to and adjust the action and posture of using the exercise device in real time. 如請求項6所述之智慧型生理暨影像訊號回饋系統方法,其中該運動裝置包含一固定式腳踏車、一跑步機、一踏步機、一滑步機、一滑輪機或一橢圓機。 The intelligent physiological and image signal feedback system method as described in Claim 6, wherein the exercise device includes a stationary bicycle, a treadmill, a stepper, a slide machine, a pulley machine or an elliptical machine. 如請求項6所述之智慧型生理暨影像訊號回饋系統方法,其中該生理感測單元包含一肌電感測器、一心電感測器以及一慣性感測器,是分別貼附或配戴於該使用者而藉感測以產生一肌電感測訊號、一心電感測訊號以及一慣性感測訊號,而該感測資訊包含一肌電資訊、一心電資訊以及一慣性資訊,且該肌電感測訊號、該心電感測訊號以及該慣性感測訊號是分別包含於該肌電資訊、該心電資訊以及該慣性資訊。 The intelligent physiological and image signal feedback system method as described in claim item 6, wherein the physiological sensing unit includes a myoelectric sensor, an electrocardiographic sensor and an inertial sensor, which are respectively attached or worn on the The user generates a myoelectric sensing signal, an electrocardiographic sensing signal, and an inertial sensing signal by sensing, and the sensing information includes an electromyographic information, an electrocardiographic information, and an inertial information, and the electromyographic sensing signal , the electrocardiographic sensing signal and the inertial sensing signal are respectively included in the electromyographic information, the electrocardiographic information and the inertial information. 如請求項6所述之智慧型生理暨影像訊號回饋系統方法,其中該生理感測單元以及該資料擷取單元是以一有線方式或一無線方式而連接,且該有線方式包含電氣連接,而該無線方式包含藍芽(Blue Tooth)或WiFi,該回饋 影像包含一圖表、一數據、一顏色以及一光影的至少其中之一,而該回饋聲音包含一動作修正語音、一危險警告語音以及一警示音的至少其中之一。 The intelligent physiological and image signal feedback system method as described in claim 6, wherein the physiological sensing unit and the data acquisition unit are connected in a wired way or a wireless way, and the wired way includes electrical connection, and The wireless method includes Bluetooth (Blue Tooth) or WiFi, the feedback The image includes at least one of a chart, a data, a color, and a light and shadow, and the feedback sound includes at least one of an action correction voice, a danger warning voice, and a warning sound. 如請求項6所述之智慧型生理暨影像訊號回饋系統方法,其中該雲端資料庫進一步包含對應於該使用者的一個人辨識影像,該個人辨識影像是經由該影像單元拍攝後產生而藉該資料擷取單元以及該資料傳輸單元傳送至該雲端網路,進而由該雲端資料庫接收而儲存以供讀取,該雲端運算單元讀取該讀取雲端資料庫所儲存的該個人辨識影像以進行一個人辨識,並在該個人辨識成功後才進行該動作判斷處理,而如果該個人辨識不成功,則不進行該動作判斷處理。 The intelligent physiological and image signal feedback system method as described in Claim 6, wherein the cloud database further includes a personal identification image corresponding to the user, and the personal identification image is generated by the image unit after shooting and using the data The capture unit and the data transmission unit are sent to the cloud network, and then received and stored by the cloud database for reading, and the cloud computing unit reads the personal identification image stored in the read cloud database to perform A person is identified, and the action judgment process is performed only after the individual identification is successful, and if the individual identification is unsuccessful, the action determination process is not performed.
TW110140077A 2021-10-28 2021-10-28 Smart feedback device and systematic method for physiological image and signal TWI784774B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW110140077A TWI784774B (en) 2021-10-28 2021-10-28 Smart feedback device and systematic method for physiological image and signal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW110140077A TWI784774B (en) 2021-10-28 2021-10-28 Smart feedback device and systematic method for physiological image and signal

Publications (2)

Publication Number Publication Date
TWI784774B true TWI784774B (en) 2022-11-21
TW202317035A TW202317035A (en) 2023-05-01

Family

ID=85794639

Family Applications (1)

Application Number Title Priority Date Filing Date
TW110140077A TWI784774B (en) 2021-10-28 2021-10-28 Smart feedback device and systematic method for physiological image and signal

Country Status (1)

Country Link
TW (1) TWI784774B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200608938A (en) * 2004-09-10 2006-03-16 Jang-Min Yang Cloth system for automatic inspection and analysis feedback of body health condition to provide healthcare guidance and applying method thereof
CN107106053A (en) * 2015-01-10 2017-08-29 黛博拉·杜连 For diagnosing and verifying the method and apparatus that the automatic function of patient's treatment and result is measured
TW201914520A (en) * 2017-10-06 2019-04-16 金上達科技股份有限公司 Easy detection method and system for sarcopenia characterized in that when the testee's walking speed and gripping force value are respectively lower than the predetermined walking speed and the predetermined gripping force value, it can be determined that the testee is a suspected sarcopenia patient
US20210233656A1 (en) * 2019-12-15 2021-07-29 Bao Tran Health management

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TW200608938A (en) * 2004-09-10 2006-03-16 Jang-Min Yang Cloth system for automatic inspection and analysis feedback of body health condition to provide healthcare guidance and applying method thereof
CN107106053A (en) * 2015-01-10 2017-08-29 黛博拉·杜连 For diagnosing and verifying the method and apparatus that the automatic function of patient's treatment and result is measured
TW201914520A (en) * 2017-10-06 2019-04-16 金上達科技股份有限公司 Easy detection method and system for sarcopenia characterized in that when the testee's walking speed and gripping force value are respectively lower than the predetermined walking speed and the predetermined gripping force value, it can be determined that the testee is a suspected sarcopenia patient
US20210233656A1 (en) * 2019-12-15 2021-07-29 Bao Tran Health management

Also Published As

Publication number Publication date
TW202317035A (en) 2023-05-01

Similar Documents

Publication Publication Date Title
CA2818867C (en) Fatigue indices and uses thereof
US9292935B2 (en) Sensor-based evaluation and feedback of exercise performance
US9364714B2 (en) Fuzzy logic-based evaluation and feedback of exercise performance
US9223936B2 (en) Fatigue indices and uses thereof
US8287434B2 (en) Method and apparatus for facilitating strength training
US10102345B2 (en) Personal wellness management platform
CA2934744C (en) Motion capture and analysis system for assessing mammalian kinetics
CN101784230A (en) System and method for displaying anonymously annotated physical exercise data
WO2012071551A1 (en) Fatigue indices and uses thereof
TWI618933B (en) Body motion analysis system, portable device and body motion analysis method
KR102299217B1 (en) Method for providing cloud based cancer survivorship care plan service
US20220019284A1 (en) Feedback from neuromuscular activation within various types of virtual and/or augmented reality environments
WO2022145563A1 (en) User-customized exercise training method and system
TW201317038A (en) Virtual Reality Leg-Cycling apparatus and control method thereof
TWI784774B (en) Smart feedback device and systematic method for physiological image and signal
KR102301575B1 (en) Music modulation auditory feedback system using wireless earphones and smart phones
US20240057926A1 (en) Neurofeedback rehabilitation system
Valencia-Jimenez et al. The effect of smart mirror environment on proprioception factors of children with Down syndrome
TW202318441A (en) Smart risk evaluation system and method of sports injury and chronic disease based on the physiological and image signals
US20240268702A1 (en) Portable device allowing accurately and concisely characterising the fitness condition of individuals in activity as well as accurately calculating and detecting their ventilatory thresholds in real-time
Κουκουβές Live data streaming and alert service for advanced athletes
Eska et al. [Don't] Let The Bodies HIIT The Floor: Fostering Body Awareness in Fast-Paced Physical Activity Using Body-Worn Sensors
WO2002013684A1 (en) Method and apparatus for improving mental focus, visceral perception & bilateral psychomotor skills
JP2004221815A (en) Network terminal