US20070190506A1 - Online interactive multimedia system and the transmission method thereof - Google Patents
Online interactive multimedia system and the transmission method thereof Download PDFInfo
- Publication number
- US20070190506A1 US20070190506A1 US11/580,302 US58030206A US2007190506A1 US 20070190506 A1 US20070190506 A1 US 20070190506A1 US 58030206 A US58030206 A US 58030206A US 2007190506 A1 US2007190506 A1 US 2007190506A1
- Authority
- US
- United States
- Prior art keywords
- audio
- signal
- gesture
- processing
- micro
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/40—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment
- A63F13/42—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
- A63F13/428—Processing input control signals of video game devices, e.g. signals generated by the player or derived from the environment by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle involving motion or position input signals, e.g. signals representing the rotation of an input controller or a player's arm motions sensed by accelerometers or gyroscopes
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
- A63B24/0087—Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load
-
- A63F13/10—
-
- A63F13/12—
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/211—Input arrangements for video game devices characterised by their sensors, purposes or types using inertial sensors, e.g. accelerometers or gyroscopes
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/21—Input arrangements for video game devices characterised by their sensors, purposes or types
- A63F13/212—Input arrangements for video game devices characterised by their sensors, purposes or types using sensors worn by the player, e.g. for measuring heart beat or leg activity
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/20—Input arrangements for video game devices
- A63F13/23—Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console
- A63F13/235—Input arrangements for video game devices for interfacing with the game device, e.g. specific interfaces between game controller and console using a wireless connection, e.g. infrared or piconet
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/45—Controlling the progress of the video game
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B24/00—Electric or electronic controls for exercising apparatus of preceding groups; Controlling or monitoring of exercises, sportive games, training or athletic performances
- A63B24/0087—Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load
- A63B2024/0096—Electric or electronic controls for exercising apparatus of groups A63B21/00 - A63B23/00, e.g. controlling load using performance related parameters for controlling electronic or video games or avatars
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2102/00—Application of clubs, bats, rackets or the like to the sporting activity ; particular sports involving the use of balls and clubs, bats, rackets, or the like
- A63B2102/02—Tennis
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2102/00—Application of clubs, bats, rackets or the like to the sporting activity ; particular sports involving the use of balls and clubs, bats, rackets, or the like
- A63B2102/16—Table tennis
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2102/00—Application of clubs, bats, rackets or the like to the sporting activity ; particular sports involving the use of balls and clubs, bats, rackets, or the like
- A63B2102/32—Golf
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2220/00—Measuring of physical parameters relating to sporting activity
- A63B2220/40—Acceleration
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63B—APPARATUS FOR PHYSICAL TRAINING, GYMNASTICS, SWIMMING, CLIMBING, OR FENCING; BALL GAMES; TRAINING EQUIPMENT
- A63B2225/00—Miscellaneous features of sport apparatus, devices or equipment
- A63B2225/50—Wireless data transmission, e.g. by radio transmitters or telemetry
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F13/33—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections
- A63F13/335—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers using wide area network [WAN] connections using Internet
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1012—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals involving biosensors worn by the player, e.g. for measuring heart beat, limb activity
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/10—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
- A63F2300/1087—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals comprising photodetecting means, e.g. a camera
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/60—Methods for processing data by generating or executing the game program
- A63F2300/6045—Methods for processing data by generating or executing the game program for mapping control signals received from the input arrangement into game commands
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Human Computer Interaction (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Physical Education & Sports Medicine (AREA)
- Computer Networks & Wireless Communication (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biophysics (AREA)
- Cardiology (AREA)
- Heart & Thoracic Surgery (AREA)
- User Interface Of Digital Computer (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The present invention relates to an online interactive multimedia system and the transmission method, that the interactive system is adapted to be applied by users of a plurality of remote ends for enabling users at his/her remote end to interact with each other in an online fashion, and each remote end comprises: a at least a micro inertial sensing module, a micro processing device, an audio/video device, a network device, and a displaying device; wherein each micro inertial sensing module is capable of detecting and measuring motions of a user operating the remote end so as to generate gesture signals accordingly; the micro processing device is used for receiving/transmitting and processing audio/video as well as the gesture signals from/to other remote ends in an online fashion, while using the processed signals to control a software arranged in the online interactive multimedia system for enabling the displaying device to display images accordingly; the audio/video device is used for providing real-time audio/video service between the remote end and another remote end connected thereto through a network; and the network device, for connecting the remote end to a network system for enabling the remote end to transmit/receive audio/video and the gesture signals to/from another. remote ends.
Description
- The present invention relates to an online interactive multirmedia system and the transmission method thereof, and more particularly, to an online video conferencing means capable of enabling remote users to interact with each other, not only by video and audio, but also by motions and gestures; that is, a user of the interactive system not only can perform video conference with other remote users in an online fashion, but also can further-have gesture interaction with them, so that the interactive system can be employed as a platform for interactive sport game, an online fitness training program, or a remote rehabilitation program.
- As the lifestyle and diet of modern people tends to change in the footsteps of time, more and more high-calorie foods are consumed while just activities of daily living are performed. This has resulted in an increasing number of persons who are obese. This is a problem even amongst children. It is known that a good exercise can help you burn off calories and increase your metabolic rate. Therefore, there are all kinds of fitness center and aerobic exercise clubs available for obese people. However, most of the exercise programs provided by such facilities either are performed at a specific location where trainees can receive instructions in group from a few trainers or instructors, or are capable of providing exercise videos to be purchased by trainees for enabling each trainee to perform the exercise by oneself at home while following the instructions of the videos. Although the exercise video is capable of enabling a person to perform exercise at any time and place, it can not motivate the trainee to develop an exercise routine that can become part of one's everyday life since it is usually boring and robotic, and can not enable the trainee to obtain instructions from trainer instantly for enabling the same to perform the exercise correctly.
- One of such system is the electronic health monitoring system disclosed in U.S. Pat. No. 6,144,837, entitled “Method and apparatus for interactively monitoring a physiological condition and for interactively providing health-related information”, as shown in
FIG. 1 . In the operating of thehealth monitoring system 10, a multimedia device 15 is used to play anoptic disc 17 containing programs of relating training/testing while interacting with a user therewith, and the same time that the physiological conditions of the user can be detected and converted into relating physiological signals by theelectrodes monitor 16 by theinterface device 14, and consequently, the physiological condition of the user is revealed. Although the aforesaid system can assist a user to exercise a training or testing by oneself at home, it is still short of interaction as it can not enable any two users, each at one's home, to interact with each other, and as the programs contained in theoptic disc 17 for providing training/test that can be used in thesystem 10 are all designed to be practice following a specific schedule and can not be changed. Therefore, it is not practical. In addition, it is not economical since once the programs contained in the optic disc are done by the user, additional spending will be necessary to purchase disc containing new exercise programs. - Other examples of such systems are the two interactive teaching systems disclosed in TW Pat. No. 92119274 and the TW Pat. No. 91111827, which are online systems capable of utilizing multimedia devices and Internet to enable interaction between teachers and students, and vice versa. The operation modes of the aforesaid teaching systems are similar to that of the popular MSN messenger. Although the interaction of the aforesaid teaching system is enhanced, the interaction is restricted to audio and video only, and the users of the systems still can not interact with each other by gesture movements.
- In view of the disadvantages of prior art, the primary object of the present invention is to provide an online interactive multimedia system and the transmission method thereof, capable of enabling remote users to interact with each other, not only by video and audio, but also by motions and gestures; that is, a user of the interactive system not only can perform video conference with other remote users in an online fashion, but also can further have gesture interaction with them, so that the interactive system can be employed as a platform for interactive sport game, an online fitness training program, or a remote rehabilitation program.
- To achieve the above object, the present invention provides an online interactive multimedia system, adapted to be applied by users of a plurality of remote ends for enabling users at his/her remote end to interact with each other, each remote end comprising:
-
- at least a micro inertial sensing module, each capable of detecting and measuring motions of a user operating a remote end so as to generate a first gesture signals accordingly;
- a micro processing device, for receiving/transmitting the first gesture signal from/to other remote ends for forming a second gesture signal thereon, while processing the first and the second gesture signals thereof to generate a processing signal accordingly; and
- a displaying device, connected to the micro processing device for enabling the same to receive the processing signal.
- Preferably, the micro inertial sensing module is primarily comprised of at least a micro inertial sensor, a wireless transceiver, and peripheral circuits.
- Preferably, the micro inertial sensor can be a device selected from the group consisting of an accelerometer and a gyroscope.
- Preferably, the micro inertial sensing module can be fitted to any part of a user's body.
- Preferably, the micro inertial sensing module can be arranged inside a package.
- Preferably, the package can be formed into a bat, a table tennis racket, and a golf club.
- Preferably, the first and the second gesture signals are transmitted by a means of network transmission, whereas the means of network transmission is a means selected from the group consisting of an ADSL network, a cable local area network, a Bluetooth communication network, a 3G mobile network and a GPRS mobile network.
- To achieve the above object, the present invention further provides an online interactive multimedia system, adapted to be applied by users of a plurality of remote ends for enabling users at his/her remote end to interact with each other, each remote end comprising:
-
- at least a micro inertial sensing module, each capable of detecting and measuring motions of a user operating a remote end so as to generate a first gesture signals accordingly;
- an audio/video device, for fetching a first audio/video data from the remote end;
- a micro processing device, for receiving/transmitting the first gesture signal and the first audio/video data from/to other remote ends for forming a second gesture signal and a second audio/video data thereon, while the processing the first and the second gesture signals as well as the first and the second audio/video data to generate a processing signal accordingly; and
- a displaying device, connected to the micro processing device for enabling the same to receive the processing signal.
- Preferably, the audio/video device includes camcorders, microphones, speakers, and so on.
- Preferably, the audio signal received by the micro processing device is outputted from the audio/video device.
- Moreover, to achieve, the above object, the present invention provides a transmission method of an online interactive multimedia, adapted to be applied by users, of a plurality of remote ends of an online interactive multimedia system for enabling users at his/her remote end to interact with each other, the method comprising steps of:
-
- detecting a gesture of a user operating a remote end for generating a first gesture signal accordingly;
- receiving/transmitting the first gesture signal from/to other remote ends for forming a second gesture signal thereon;
- processing the first and the second gesture signals to generate a processing signal accordingly; and
- receiving the processing signal while displaying corresponding images and motions with respect to the received processing signal.
- In a preferred aspect, the transmission method further comprises steps of:
-
- fetching a first audio/video data form a remote end;
- receiving/transmitting the first audio/video data from/to other remote ends for forming a second gesture signal thereon;
- processing the first and the second audio/video data to generate an audio/video processing signal accordingly; and
- receiving the, audio/video processing signal while displaying corresponding audios and videos with respect to the received audio/video processing signal.
- Preferably, as the processing signal is comprised of a first signal, acquired from the processing of the first gesture signal, and a second signal, acquired from the processing of the second gesture signal, the displaying of the corresponding images and motions with respect to the received processing signal further comprise steps of:
-
- displaying images and motions corresponding to the remote end with respect to the first signal; and
- displaying images and motions corresponding to the other remote ends with respect to the second signal.
- Other aspects and advantages of the present invention will become apparent from the following detailed description, taken in conjunction with the accompanying drawings, illustrating by way of example the principles of the present invention.
-
FIG. 1 shows an electronic health monitoring system disclosed in U.S. Pat. No. 6,144,837. -
FIG. 2 is a flow chart illustrating a preferred embodiment of the invention. -
FIG. 3 shows an online interactive multimedia system according to a preferred embodiment of the invention. - For your esteemed members of reviewing committee to further understand and recognize the fulfilled functions and structural characteristics of the invention, several preferable embodiments cooperating with detailed description are presented as the follows.
- Please refer to
FIG. 2 , which is a flow chart illustrating a preferred embodiment, of the invention. InFIG. 2 , the transmission method of an online interactive multimedia, adapted to be applied by users of a plurality of remote ends of an online interactive multimedia system for enabling users at his/her remote end to interact with each other, starts atstep 30. Atstep 30, information required for the transmission method is acquired before the flow proceeds to,step 31, which include twosub-steps sub-step 301, motions of a user operating a remote end is detected and measured so as to generate a first gesture signals accordingly; and atsub-step 302, a first audio/video data of the aforesaid remote end is fetched. - At
step 31, an operation is performed at the remote end for receiving the first gesture signal and the first audio/video data and transmitting the same to another remote end for causing a second gesture signal and a second audio/video data to be formed on the another remote end; and then the flow proceeds to step 32. Atstep 32, the first gesture signal, the first audio/video data, the second gesture signal and the second audio/video data are processed, whereas the process ofstep 32 further comprises steps of: processing the first and the second gesture signal to form a motion processing signal; and processing the first and the second audio/video data to form an audio/video processing signal; and then the flow proceeds to step 33. Moreover, in a preferred aspect, the signal transmission of the aforesaid flow chart is enabled by a means of network transmission, whereas the means of network transmission is a means selected from the group consisting of an ADSL network, a cable local area network, a Bluetooth communication network, a 3G mobile network and a GPRS mobile network. - At
step 33, the motion processing signal and the audio/video processing signal are received and used for generating corresponding images, sounds and motions with respect to the above processing, which further comprises steps of: displaying images and motions corresponding to the remote end with respect to a first signal, acquired from the processing of the first gesture signal and the first audio/video data; and displaying images and motions corresponding to the other remote ends with respect to a second signal, acquired from the processing of the second gesture signal and the second audio/video data. Thus, as users at the plural remote ends of the invention are enabled to communicate with each other through a means of network transmission, the display at a remote end not only is enabled to display images corresponding to the motions of the user operating the same, but also it is enabled to display images corresponding to the motions of the other users operating other remote end. For instance, a plurality of sub-frames can be presented on a display for enabling the same to display images relating to users at other remote ends. - Please refer to
FIG. 3 , which shows an online interactive multimedia system according to a preferred embodiment of the invention. In theFIG. 3 , the two users A, B respectively operating two remote ends 20, 30 of the online interactive multimedia system are connected through anetwork system 40 for enabling signals to be transmitted to and from between the two remote ends 20, 30. In this preferred embodiment, more than one microinertial sensing modules 21 are fitted to the user A operating theremote end 20 while more than one microinertial sensing modules 31 are fitted to the, user B operating theremote end 30, whereas each of the microinertial sensing modules inertial sensing modules inertial sensing modules inertial sensing modules inertial sensing modules micro processing devices micro processing devices devices FIG. 3 , each displayingdevices inertial sensing modules video devices - From the above description, it is concluded that a transmission method of an online interactive multimedia, adapted to be applied by users of a plurality of remote ends of the online interactive multimedia system is provided, which comprises steps of:
-
- (a) detecting gestures of users A, B, respectively operating remote ends 20, 30 for generating-gesture signals accordingly by the use of micro
inertial sensing modules - (b) receiving/transmitting and processing audio/video signals as well as the gesture signal from/to other remote end in an online fashion, while using the processed signals to control a software for respectively enabling displaying
devices micro processing devices - (c) providing a real-time audio/video service between the two remote ends 20, 30 according to the online fashion by the use of audio/
video devices - (d) connecting the two remote ends 20, 30 to a
network system 40 for enabling the two remote ends 20, 30 to transmit/receive audio/video and the gesture signals to/from each other; and - (e) displaying the audio/video signals and the gesture signal received from the
network system 40 on the displayingdevices
- (a) detecting gestures of users A, B, respectively operating remote ends 20, 30 for generating-gesture signals accordingly by the use of micro
- Furthermore, instead of arranging each of the micro
inertial sensing modules inertial sensing modules remote end 20 is holding a gold-club-shaped package containing a microinertial sensing module 21, the swing of the user A can be detected by the microinertial sensing module 21 and then the result of the detection is transmitted to themicro processing device 23 while the audio/video device 22 is also transmitting the sounds and images of the swing to themicro processing device 23; and then themicro processing device 23 is enabled to transmit all the signals received thereby to anotherremote end 30 through thenetwork system 40 where themicro processing device 33 will process all those signals to be displayed on thedisplay device 34. Similarly, the above description is suitable to the user B operating theremote end 30 for display the motions of the user B on the displayingdevice 24 of theremote end 20 operated by the user A. Assuming that user A operating theremote end 20 is a student and user B operating theremote end 30 is a coach, the coach is able to see the swing of the student on his/her displayingdevice 34 in real time so that he/she can specifically correct the gesture, strength and trajectory of the awing instantly. Assuming that user A operating theremote end 20 is a patient and user B operating theremote end 30 is a doctor, the doctor is able to see the rehabilitation exercise performed by the patient on his/her displayingdevice 34 in real time so that he/she can specifically direct the exercise instantly. In addition, online game can be enabled by the user of the network server of thenetwork system 40, that is, the two users A, B, are able to select an on line ball game on the network system so as to play the game against each other. It is noted that the amount of user is not limited by the two users A, B, as described in the preferred embodiment shown inFIG. 3 , that it can be as many as specified by the online software containing in the online interactive multimedia system. - To sum up, the present invention provides an online interactive multimedia system and the transmission method thereof, and more particularly, to an online video conferencing means capable of enabling remote users to interact with each other, not only by video and audio, but also by motions and gestures; that is, a user of the interactive system not only can perform video conference with other remote users in an online fashion, but also can further have gesture interaction with them.
- While the preferred embodiment of the invention has been set forth for the purpose of disclosure, modifications of the disclosed embodiment of the invention as well as other embodiments thereof may occur to those-skilled in the art. Accordingly, the appended claims are intended to cover all embodiments which do not depart from the spirit and scope of the invention.
Claims (24)
1. An online interactive multimedia system, adapted to be applied by users of a plurality of remote ends for enabling users at his/her remote end to interact with each other, each remote end comprising:
at least a micro inertial sensing module, each capable of detecting and measuring motions of a user operating a remote end so as to generate a first gesture signals accordingly;
a micro processing device, for receiving/transmitting the first gesture signal from/to other remote ends for forming a second gesture signal thereon, while processing the first and the second gesture signals thereof to generate a processing signal accordingly; and
a displaying device, connected to the micro processing device for enabling the same to receive the processing signal.
2. The system of claim 1 , wherein the micro inertial sensing module is primarily comprised of at least a micro inertial sensor, a wireless transceiver, and peripheral circuits.
3. The system of claim 1 , wherein the micro inertial sensing module is comprised of at least an accelerometer.
4. The system of claim 1 , wherein the micro inertial sensing module is comprised of at least a gyroscope.
5. The system of claim 1 , wherein the micro inertial sensing module is enabled to be fitted to any part of a user's body.
6. The system of claim 1 , wherein the micro inertial sensing module can be arranged inside a package.
7. The system of claim 6 , wherein the package is formed into a shape of a batting means selected from the group consisting of a bat, a table tennis racket, a golf club, and the like.
8. The system of claim 1 , wherein the micro processing device is able to control the software according to the online fashion.
9. The system of claim 1 , wherein the first and the second gesture signals are transmitted by a means of network transmission, whereas the means of network transmission is a means selected from the group consisting of an ADSL network, a cable local area network, a Bluetooth communication network, a 3G mobile network and a GPRS mobile network.
10. An online interactive multimedia system, adapted to be applied by users of a plurality of remote ends for enabling users at his/her remote end to interact with each other, each remote end comprising:
at least a micro inertial sensing module, each capable of detecting and measuring motions of a user operating a remote end so as to generate a first gesture signals accordingly;
an audio/video device, for fetching a first audio/video data from the remote end;
a micro processing device, for receiving/transmitting the first gesture signal and the first audio/video data from/to other remote ends for forming a second gesture signal and a second audio/video data thereon, while the processing the first and the second gesture signals as well as the first and the second audio/video data to generate a processing signal accordingly; and
a displaying device, connected to the micro processing device for enabling the same to receive the processing signal.
11. The system of claim 10 , wherein the micro inertial sensing module is primarily comprised of at least a micro inertial sensor, a wireless transceiver, and peripheral circuits.
12. The system of claim 10 , wherein the micro inertial sensing module is comprised of at least an accelerometer.
13. The system of claim 10 , wherein the micro inertial sensing module is comprised of at least a gyroscope.
14. The system of claim 10 , wherein the micro inertial sensing module is enabled to be fitted to any part of a user's body.
15. The system of claim 10 , wherein the micro inertial sensing module can be arranged inside a package.
16. The system of claim 15 , wherein the package is formed into a shape of a batting means selected from the group consisting of a bat, a table tennis racket, a golf club, and the like.
17. The system of claim 10 , wherein the audio/video device includes audio/video receivers selected form the group consisting of camcorders, microphones, speakers, and the like.
18. The system of claim 10 , wherein the first and the second audio/video data received by the micro processing device are outputted from the audio/video device.
19. The system of claim 10 , wherein the micro processing device is able to control the software according to the online fashion.
20. The system of claim 10 , wherein the first and the second gesture signals are transmitted by a means of network transmission, whereas the means of network transmission is a means selected from the group consisting of an ADSL network, a cable local area network, a Bluetooth communication network, a 3G mobile network and a GPRS mobile network.
21. A transmission method of an online interactive multimedia, adapted to be applied by users of a plurality of remote ends of the online interactive multimedia system for enabling users at his/her remote end to interact with each other, comprising steps of:
detecting a gesture of a user operating a remote end for generating a first gesture signal accordingly;
receiving/transmitting the first gesture signal from/to other remote ends for forming a second gesture signal thereon;
processing the first and the second gesture signals to generate a processing signal accordingly; and
receiving the processing signal while displaying corresponding images and motions with respect to the received processing signal.
22. The method of claim 21 , further comprising steps of:
fetching a first audio/video data form a remote end;
receiving/transmitting the first audio/video data from/to other remote ends for forming a second gesture signal thereon;
processing the first and the second audio/video data to generate an audio/video processing signal accordingly; and
receiving the audio/video processing signal while displaying corresponding audios and videos with respect to the received audio/video processing signal.
23. The method of claim 21 , wherein the processing signal is comprised of a first signal, acquired from the processing of the first gesture signal, and a second signal, acquired from the processing of the second gesture signal.
24. The method of claim 23 , wherein the displaying of the corresponding images and motions with respect to the received processing signal further comprise steps of:
displaying images and motions corresponding to the remote end with respect to the first signal; and
displaying images and motions corresponding to the other remote ends with respect to the second signal.
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
TW094146489 | 2005-12-26 | ||
TW94146489 | 2005-12-26 | ||
TW095129463 | 2006-08-11 | ||
TW095129463A TWI341692B (en) | 2005-12-26 | 2006-08-11 | Online interactive multimedia system and the trasnsmission method thereof |
Publications (1)
Publication Number | Publication Date |
---|---|
US20070190506A1 true US20070190506A1 (en) | 2007-08-16 |
Family
ID=38369007
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/580,302 Abandoned US20070190506A1 (en) | 2005-12-26 | 2006-10-13 | Online interactive multimedia system and the transmission method thereof |
Country Status (2)
Country | Link |
---|---|
US (1) | US20070190506A1 (en) |
TW (1) | TWI341692B (en) |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20100015585A1 (en) * | 2006-10-26 | 2010-01-21 | Richard John Baker | Method and apparatus for providing personalised audio-visual instruction |
US20110285626A1 (en) * | 2009-01-30 | 2011-11-24 | Microsoft Corporation | Gesture recognizer system architecture |
CN103297411A (en) * | 2012-03-02 | 2013-09-11 | 瑞昱半导体股份有限公司 | Cross-platform multimedia interaction system, related method and device |
WO2013144697A1 (en) * | 2012-03-29 | 2013-10-03 | Playoke Gmbh | Entertainment system and method of providing entertainment |
US8578302B2 (en) | 2009-01-30 | 2013-11-05 | Microsoft Corporation | Predictive determination |
WO2013184998A3 (en) * | 2012-06-08 | 2014-01-30 | Unitedhealth Group Incorporated | Interactive sessions with participants and providers |
US8892495B2 (en) | 1991-12-23 | 2014-11-18 | Blanding Hovenweep, Llc | Adaptive pattern recognition based controller apparatus and method and human-interface therefore |
US9143724B2 (en) | 2011-07-06 | 2015-09-22 | Hewlett-Packard Development Company, L.P. | Telepresence portal system |
US9517383B2 (en) | 2012-04-20 | 2016-12-13 | Samsung Electronics Co., Ltd. | Method of displaying multimedia exercise content based on exercise amount and multimedia apparatus applying the same |
US9535563B2 (en) | 1999-02-01 | 2017-01-03 | Blanding Hovenweep, Llc | Internet appliance system and method |
CN112121369A (en) * | 2019-06-25 | 2020-12-25 | 恩恩商社股份公司 | Operating system utilizing small-sized equipment training program |
WO2024045086A1 (en) * | 2022-08-31 | 2024-03-07 | 华为技术有限公司 | Inertial measurement device, control system, and terminal |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
TWI402088B (en) * | 2010-11-15 | 2013-07-21 | Univ Nat Pingtung Sci & Tech | Visual rehabilitation clinic system |
US10444845B2 (en) | 2012-12-21 | 2019-10-15 | Qualcomm Incorporated | Display of separate computer vision based pose and inertial sensor based pose |
CN104331147A (en) * | 2013-07-23 | 2015-02-04 | 系统电子工业股份有限公司 | Diversified perception interactive experiencing system and method |
CN113476815B (en) * | 2021-05-17 | 2022-07-12 | 张昌昊 | Intelligent sports auxiliary training method and system based on E-ink |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5554980A (en) * | 1993-03-12 | 1996-09-10 | Mitsubishi Denki Kabushiki Kaisha | Remote control system |
US6144837A (en) * | 1994-11-04 | 2000-11-07 | Health Hero Network, Inc. | Method and apparatus for interactively monitoring a physiological condition and for interactively providing health-related information |
US20020018070A1 (en) * | 1996-09-18 | 2002-02-14 | Jaron Lanier | Video superposition system and method |
US20020080094A1 (en) * | 2000-12-22 | 2002-06-27 | Frank Biocca | Teleportal face-to-face system |
US20040095317A1 (en) * | 2002-11-20 | 2004-05-20 | Jingxi Zhang | Method and apparatus of universal remote pointing control for home entertainment system and computer |
US20040132526A1 (en) * | 2002-12-23 | 2004-07-08 | Yu-Chen Liu | Computer interactive and game playing system |
US20050032582A1 (en) * | 2002-12-19 | 2005-02-10 | Satayan Mahajan | Method and apparatus for determining orientation and position of a moveable object |
US20050091111A1 (en) * | 1999-10-21 | 2005-04-28 | Green Jason W. | Network methods for interactive advertising and direct marketing |
-
2006
- 2006-08-11 TW TW095129463A patent/TWI341692B/en not_active IP Right Cessation
- 2006-10-13 US US11/580,302 patent/US20070190506A1/en not_active Abandoned
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5554980A (en) * | 1993-03-12 | 1996-09-10 | Mitsubishi Denki Kabushiki Kaisha | Remote control system |
US6144837A (en) * | 1994-11-04 | 2000-11-07 | Health Hero Network, Inc. | Method and apparatus for interactively monitoring a physiological condition and for interactively providing health-related information |
US20020018070A1 (en) * | 1996-09-18 | 2002-02-14 | Jaron Lanier | Video superposition system and method |
US20050091111A1 (en) * | 1999-10-21 | 2005-04-28 | Green Jason W. | Network methods for interactive advertising and direct marketing |
US20020080094A1 (en) * | 2000-12-22 | 2002-06-27 | Frank Biocca | Teleportal face-to-face system |
US20040095317A1 (en) * | 2002-11-20 | 2004-05-20 | Jingxi Zhang | Method and apparatus of universal remote pointing control for home entertainment system and computer |
US20050032582A1 (en) * | 2002-12-19 | 2005-02-10 | Satayan Mahajan | Method and apparatus for determining orientation and position of a moveable object |
US20040132526A1 (en) * | 2002-12-23 | 2004-07-08 | Yu-Chen Liu | Computer interactive and game playing system |
Cited By (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8892495B2 (en) | 1991-12-23 | 2014-11-18 | Blanding Hovenweep, Llc | Adaptive pattern recognition based controller apparatus and method and human-interface therefore |
US9535563B2 (en) | 1999-02-01 | 2017-01-03 | Blanding Hovenweep, Llc | Internet appliance system and method |
US11210963B2 (en) * | 2006-10-26 | 2021-12-28 | Richard John Baker | Method and apparatus for providing personalised audio-visual instruction |
US20170206794A1 (en) * | 2006-10-26 | 2017-07-20 | Richard John Baker | Method and Apparatus for Providing Personalised Audio-Visual Instruction |
US20100015585A1 (en) * | 2006-10-26 | 2010-01-21 | Richard John Baker | Method and apparatus for providing personalised audio-visual instruction |
US8578302B2 (en) | 2009-01-30 | 2013-11-05 | Microsoft Corporation | Predictive determination |
US8782567B2 (en) | 2009-01-30 | 2014-07-15 | Microsoft Corporation | Gesture recognizer system architecture |
US8869072B2 (en) | 2009-01-30 | 2014-10-21 | Microsoft Corporation | Gesture recognizer system architecture |
US9280203B2 (en) * | 2009-01-30 | 2016-03-08 | Microsoft Technology Licensing, Llc | Gesture recognizer system architecture |
US20110285626A1 (en) * | 2009-01-30 | 2011-11-24 | Microsoft Corporation | Gesture recognizer system architecture |
US9143724B2 (en) | 2011-07-06 | 2015-09-22 | Hewlett-Packard Development Company, L.P. | Telepresence portal system |
CN103297411A (en) * | 2012-03-02 | 2013-09-11 | 瑞昱半导体股份有限公司 | Cross-platform multimedia interaction system, related method and device |
WO2013144697A1 (en) * | 2012-03-29 | 2013-10-03 | Playoke Gmbh | Entertainment system and method of providing entertainment |
US9517383B2 (en) | 2012-04-20 | 2016-12-13 | Samsung Electronics Co., Ltd. | Method of displaying multimedia exercise content based on exercise amount and multimedia apparatus applying the same |
WO2013184998A3 (en) * | 2012-06-08 | 2014-01-30 | Unitedhealth Group Incorporated | Interactive sessions with participants and providers |
US9306999B2 (en) | 2012-06-08 | 2016-04-05 | Unitedhealth Group Incorporated | Interactive sessions with participants and providers |
CN112121369A (en) * | 2019-06-25 | 2020-12-25 | 恩恩商社股份公司 | Operating system utilizing small-sized equipment training program |
WO2024045086A1 (en) * | 2022-08-31 | 2024-03-07 | 华为技术有限公司 | Inertial measurement device, control system, and terminal |
Also Published As
Publication number | Publication date |
---|---|
TW200726252A (en) | 2007-07-01 |
TWI341692B (en) | 2011-05-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20070190506A1 (en) | Online interactive multimedia system and the transmission method thereof | |
US11033776B2 (en) | Method and system for athletic motion analysis and instruction | |
US11000765B2 (en) | Method and system for athletic motion analysis and instruction | |
KR101687252B1 (en) | Management system and the method for customized personal training | |
US20210379447A1 (en) | Interactive exercise apparatus | |
US10755466B2 (en) | Method and apparatus for comparing two motions | |
US11210834B1 (en) | Article of clothing facilitating capture of motions | |
US20200105041A1 (en) | Method and system for providing real-time feedback in performing motions | |
US20120088222A1 (en) | System for Measuring Speed and Magnitude of Responses and Methods Thereof | |
US10806982B2 (en) | Frameworks, devices and methodologies configured to provide of interactive skills training content, including delivery of adaptive training programs based on analysis of performance sensor data | |
US20090312152A1 (en) | Exercise Monitoring System and Method | |
JP2006320424A (en) | Action teaching apparatus and method | |
CN102016956A (en) | Vision and cognition testing and/or training under stress conditions | |
JP2018512980A (en) | Frameworks, devices and methods configured to enable delivery of interactive skill training content, including content with multiple expert knowledge variations | |
CA3228550A1 (en) | Method and system for analysing activity performance of users through smart mirror | |
US9248361B1 (en) | Motion capture and analysis systems for use in training athletes | |
US20220101588A1 (en) | Techniques for establishing biomechanical model through motion capture | |
JP2007505675A (en) | Exercise management system and method | |
KR100926754B1 (en) | Golf teaching system | |
CN113457105A (en) | Intelligent mirror with body-building menu | |
TWI704942B (en) | Virtual reality underwater training device and method for executing the same | |
US20240135617A1 (en) | Online interactive platform with motion detection | |
Oagaz | Motor Skill Training in Virtual Reality and Skill Transfer via Effective Feedback Modalities | |
KR20230085278A (en) | Smart Stroke Device | |
TWM632566U (en) | Virtual reality training device for muscle strength assessment |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: INDUSTRIAL TECHNOLOGY RESEARCH INSTITUTE, TAIWAN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:JENG, SHENG-WEN;LIAN, ZHI-WEI;LIOU, SHUN-NAN;AND OTHERS;REEL/FRAME:018410/0959 Effective date: 20060620 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |