TWI549728B - Management method for detecting multi-users' motions and system thereof - Google Patents

Description

Method and system for detecting multi-human sense

The following description relates to a method and system for managing the sense of body, and in particular, a method and system for managing the sense of body when a plurality of people are connected.

The traditional game console needs to let the player hold or step on the controller to control the role played by the player in the game screen. Currently, the newer game console is an interface that can use the voice command or gesture to operate the system. The host can also be equipped with an infrared sensor to capture the player's movements up and down the whole body, and use the body to play the game, giving the player a "game-free game and entertainment experience."

However, such a game console is limited to one or more players controlling characters on a game console, and it is not possible for players of multiple game consoles to play games on one screen at the same time and control individual roles, or only Players of multiple game consoles use a limited number of action commands to control the character.

Furthermore, when an older user performs such a game console, since such a game host often requires the player to use the body to play the game, other caregivers must be on the side to prevent danger.

Therefore, how to improve the existing game console mode has become an urgent issue.

The embodiment of the present invention is directed to a management method and system for detecting multiple human senses, which enables different players to perform a somatosensory detection connection game through the different game hosts, so that the player has more gameplay during the game. Convenience and fun.

The aspect of the embodiment of the present invention is directed to a management method and system for detecting multiple human senses, which can improve the player's role in controlling the character in the game without being limited to the upper limit of the motion command when the multiplayer is connected.

The embodiment of the present invention is directed to a management method and system for detecting a multi-human sense, which enables a first player to learn the physiology of the first player from the game screen when the first player is playing the game. Information, with entertaining functions and instant care.

Based on the above, the present invention provides a method for detecting a multi-human sense, which is used for a first electronic device, a second electronic device, and a cloud server. The first electronic device includes a first motion detecting unit. a first display unit and a first processing unit, the second electronic device includes a second motion detecting unit, a second display unit, and a second processing unit. The management method includes the following steps: using the first motion detection The measuring unit detects the limb movement of the first user to generate the first image. A first spatial unit corresponding to the first image is generated by the first processing unit. The second motion detecting unit detects the limb motion of the second user to generate a second image. A second processing unit is used to generate a second spatial coordinate corresponding to the second image. The first space coordinate and the second space coordinate are transmitted to the cloud server. The cloud server generates a three-dimensional space shadow including the first spatial position and the second spatial position according to a standard conversion program. image. And displaying the three-dimensional image on the first display unit and the second display unit.

Preferably, the first electronic device further comprises a physiological signal measuring unit, the physiological signal measuring unit measures the physiological signal of the first user and transmits the physiological signal to the first processing unit, and the physiological signal is transmitted by the first processing unit. To the cloud server, the physiological signal is included in the three-dimensional image.

Preferably, the physiological signal measuring unit comprises a wearable wristband, a wearable wristband, a wearable headgear or a smart eyeglass.

Preferably, the physiological signal measuring unit transmits the physiological signal to the first processing unit via Bluetooth 4.0.

Preferably, the first electronic device or the second electronic device comprises a smart TV or a gaming machine.

Based on the above object, the present invention further provides a management system for detecting a multi-human sense, comprising a first electronic device, a second electronic device, and a cloud server. The first electronic device includes a first motion detecting unit, a first display unit, and a first processing unit. The first motion detecting unit is configured to detect a limb motion of the first user to generate a first image, and the first processing unit A first spatial coordinate corresponding to the first image is generated and transmitted. The second electronic device includes a second motion detecting unit, a second display unit, and a second processing unit, and the second motion detecting unit is configured to detect a second user's limb motion to generate a second image, and the second processing unit A second spatial coordinate corresponding to the second image is generated and transmitted. And a cloud server, configured to receive the first space coordinate and the second space coordinate, and generate a three-dimensional space image including the first spatial location and the second spatial location according to the first spatial coordinate and the second spatial coordinate, and then transmit the three-dimensional space The image is to the first electronic device and the second electronic device. The three-dimensional image can be displayed on the first display unit and the second display unit.

Preferably, the first electronic device further comprises a physiological signal measuring unit, and the physiological signal The measuring unit measures the physiological signal of the first user and transmits the physiological signal to the first processing unit, and the first processing unit transmits the physiological signal to the cloud server, so that the physiological signal is included in the three-dimensional space image.

Preferably, the physiological signal measuring unit comprises a wearable wristband, a wearable wristband, a wearable headgear or a smart eyeglass.

Preferably, the physiological signal measuring unit transmits the physiological signal to the first processing unit via Bluetooth 4.0.

Preferably, the first electronic device or the second electronic device comprises a smart TV or a gaming machine.

100‧‧‧Management system for detecting multiple human senses

10‧‧‧First electronic device

20‧‧‧Second electronic device

30‧‧‧Cloud Server

40‧‧‧ first user

50‧‧‧ second user

11‧‧‧First motion detection unit

12‧‧‧First display unit

13‧‧‧First Processing Unit

14‧‧‧ first image

15‧‧‧First space coordinates

16‧‧‧physiological signal measuring unit

17‧‧‧Physiological signal

21‧‧‧Second motion detection unit

22‧‧‧Second display unit

23‧‧‧Second processing unit

24‧‧‧second image

25‧‧‧Second space coordinates

31‧‧‧First space location

32‧‧‧Second space location

33‧‧‧3D space imagery

S1~S7‧‧‧Step process

The above and other features and advantages of the present invention will become more apparent from the detailed description of the embodiments illustrated in the appended claims.

2A is a first schematic diagram of a management system in accordance with an embodiment of the present invention.

2B is a second schematic diagram of a management system in accordance with an embodiment of the present invention.

2C is a third schematic diagram of a management system in accordance with an embodiment of the present invention.

Figure 3 is a flow chart showing the steps of the management method according to an embodiment of the present invention.

As used herein, the term "and/or" includes any and all combinations of one or more of the associated listed items. When the statement of "at least one of" is prefixed to a list of components, The entire list of components is not an individual component of the list.

Please refer to FIG. 1, which is a block diagram of a management system in accordance with an embodiment of the present invention. A management system 100 for detecting multiple human senses includes a first electronic device 10, a second electronic device 20, and a cloud server 30. The first electronic device 10 includes a first motion detecting unit 11, a first display unit 12, a first processing unit 13, and a physiological signal measuring unit 16, and the first motion detecting unit 11 is configured to detect the first user ( The limbs, not shown in the figures, act to produce a first image 14, and the first processing unit 13 generates and transmits a first spatial coordinate 15 corresponding to the first image 14. The second electronic device 20 includes a second motion detecting unit 21, a second display unit 22, and a second processing unit 23, and the second motion detecting unit 21 is configured to detect a limb of a second user (not shown in the figure). Actuated to generate a second image 24, the second processing unit 23 generates and transmits a second spatial coordinate 25 corresponding to the second image 24.

In practice, the first motion detecting unit 11 or the second motion detecting unit 21 may include an infrared sensor or a dual lens module that can generate depth information, and the first processing unit 13 or the second processing unit 23 may include A central processing unit or a microcontroller, the first display unit 12 or the second display unit 22 can include a screen.

In practice, the first image 14 and the second image 24 correspond to an instant image generated by the movement of the limbs of the first user and the second user.

The cloud server 30 can receive the first space coordinate 15 and the second space coordinate 25 through the network, and generate one of the first spatial location 31 and the second spatial location 32 according to the first spatial coordinate 15 and the second spatial coordinate 25. The three-dimensional image 33 is transmitted to the first electronic device 10 and the second electronic device 20 through the network. The three-dimensional image 33 can be simultaneously displayed on the first display unit 12 and the second display unit 22.

The physiological signal measuring unit 16 can include a wearable wristband, a wearable headgear or a smart eyewear. The physiological signal measuring unit 16 measures one of the physiological signals of the user. 17 and transmitting the physiological signal 17 to the first processing unit 13, and the first processing unit 13 simultaneously transmits the physiological signal 17 and the first space coordinate 15 to the cloud server 30, so that the physiological signal 17 can be included in the three-dimensional image 33. .

Please refer to FIG. 2A, FIG. 2B and FIG. 2C, which are a first schematic diagram, a second schematic diagram and a third schematic diagram of a management system according to an embodiment of the present invention. In FIG. 2A, the first user 40 and the second user 50 are respectively in front of the first electronic device 10 and the second electronic device 20. In this embodiment, a smart TV for playing games is used as the first The electronic device 10 and the second electronic device 20 are implemented by way of example, but not limited thereto, and can also be implemented by a game machine.

The first motion detecting unit 11 of the first electronic device 10 can be an infrared sensor or a dual lens module that can generate depth information to detect the first user 40 to generate a first image 14 and The first image 14 is transmitted to the first processing unit 13, and the first processing unit 13 generates an instant first space coordinate 15. In addition, the first user 40 can wear a physiological signal measuring unit 16, such as a wearable wristband, a wearable wristband, a wearable headgear or a smart eyeglass, for measuring the first user 40. The temperature, pulse or brain wave signal generates a physiological signal 17 and transmits the physiological signal 17 to the first processing unit 13 via Bluetooth 4.0. Finally, the first processing unit 13 sets the physiological signal 17 and the first space coordinate 15 And transmitted to the cloud server 30.

In practice, the first space coordinate 15 can be a skeleton point coordinate of the first user 40, and the coordinate conversion between the first space coordinate 15 and the first image 14 can be performed in the first processing unit 13, The method can effectively utilize the computing function of the first processing unit 13 and simplify the calculation amount of the cloud server 30, and if only transmitting the coordinate data to the cloud server 30, the time for transmitting the packet on the network can be reduced.

The second electronic device 20 can also generate a second empty corresponding to the second user 50. The inter-symbol 25 and another physiological signal (not shown in the figure) are generated in the manner that the first electronic device 10 is described for the first user 40, and therefore will not be described herein.

After receiving the first space coordinate 15 and the second space coordinate 25, the cloud server 30 converts the first space coordinate 15 and the second space coordinate 25 into a first one of the three-dimensional space images 33 according to a standard conversion program. The spatial position 31 and the second spatial position 32 are not overlapped with each other in the three-dimensional image 33 as shown in FIG. 2B, and the three-dimensional image 33 is transmitted back to the first electronic device 10 and the second electronic device 20. .

In detail, the cloud server 30 can process functions of receiving, computing, storing, storing, and feeding different user interaction information, and the interactive information includes the user's physical movements, physiological information, and the coordinate conversion program. The coordinate of the first user 40 in an image space is converted into a scene coordinate shared by the first user 40 and the second user 50. The three-dimensional image 33 can also contain reading data in the physiological signal 17, such as body temperature, pulse, and the like.

After the first processing unit 13 receives the three-dimensional image 33, as shown in FIG. 2C, the first processing unit 13 can establish the first image 14 according to the coordinates of the first spatial position 31, and the second image is The second display unit 22 can display the same three-dimensional image 33, and the physiological signal 17 The third user image 50 is also included in the three-dimensional image 33, so that the second user 50 can know the physiological signal 17 of the first user 40 through the three-dimensional image 33.

Therefore, through the system, the physiological signal 17 of the first user 40 can be known by the second user 50 at any time, so even if the first user 40 and the second user 50 are older elders, Through the system, you can instantly grasp the physical condition of the other person without the need for additional caregivers to look around.

Please refer to FIG. 3, which is a flow chart of the steps of the management method according to an embodiment of the present invention. The method for detecting the multi-human sense can be applied to the first electronic device 10, the second electronic device 20, and the cloud server 30 in FIGS. 2A, 2B, and 2C. The management method consists of the following steps.

Step S1 uses the first motion detecting unit to detect a limb motion of the first user to generate a first image 14.

Step S2 uses the first processing unit 13 to generate a first space coordinate 15 corresponding to the first image 14.

Step S3 uses the second motion detecting unit 21 to detect the motion of a second user 50 to generate a second image 24.

Step S4 uses the second processing unit 23 to generate a second space coordinate 25 corresponding to one of the second images 24.

Step S5 transmits the first space coordinate 15 and the second space coordinate 25 to the cloud server 30.

In step S6, the cloud server 30 generates a three-dimensional image 33 including a first spatial position 31 and a second spatial position 32 according to a standard conversion program.

Step S7 displays the three-dimensional image 33 on the first display unit 12 and the second display unit 22.

In summary, the present invention can enable a player in different regions to perform a somatosensory detection connection game, and the player can control the character in the game without being limited by the number of action instructions, so that the player is more convenient in the game. Sexuality and funness. Moreover, when a first player is playing a game, a second player at the far end can learn the physiological information of the first player from the game screen, and can have both immediate care while having an entertaining function. The function.

The present invention has been particularly shown and described with reference to the exemplary embodiments thereof, and it is understood by those of ordinary skill in the art Various changes in form and detail can be made in the context of the category.

S1~S7‧‧‧Step process

Claims (6)

A method for detecting a multi-human sense is used for a first electronic device, a second electronic device, and a cloud server. The first electronic device includes a first motion detecting unit, a first display unit, and a first a first processing unit, the second electronic device includes a second motion detecting unit, a second display unit, and a second processing unit, the managing method includes: detecting, by the first motion detecting unit, a first use Actuating the limb to generate a first image; using the first processing unit to generate a first space coordinate corresponding to the first image, the first space coordinate being the skeleton point coordinate of the first user; using the second The motion detecting unit detects a second user's limb motion to generate a second image; and the second processing unit generates a second space coordinate corresponding to the second image, the second space coordinate is the second use Skeleton point coordinate; transmitting the first space coordinate and the second space coordinate to the cloud server; generating, by the cloud server, a first spatial position according to a standard conversion program And displaying the three-dimensional image on the first display unit and the second display unit; wherein the first electronic device further comprises a physiological signal measuring unit, the physiological signal The measuring unit measures the physiological signal of the first user and transmits the physiological signal to the first processing unit, and the first processing unit transmits the physiological signal to the cloud server, so that the physiological signal is included in The physiological signal measuring unit comprises a wearable wristband, a wearable headgear or a smart eyeglass. The management method of claim 1, wherein the physiological signal measuring unit transmits the physiological signal to the first processing unit via Bluetooth 4.0. The management method of claim 1, wherein the first electronic device or the second electronic device comprises a smart TV or a gaming machine. A management system for detecting a multi-human sense, comprising: a first electronic device, comprising a first motion detecting unit, a first display unit and a first processing unit, wherein the first motion detecting unit is configured to detect Measuring a first user's limb motion to generate a first image, the first processing unit generating and transmitting a first space coordinate corresponding to the first image, the first space coordinate being the skeleton of the first user a second electronic device includes a second motion detecting unit, a second display unit, and a second processing unit, wherein the second motion detecting unit is configured to detect a second user's limb motion Generating a second image, the second processing unit generates and transmits a second space coordinate corresponding to one of the second images, the second space coordinate is a skeleton point coordinate of the second user; and a cloud server Receiving the first space coordinate and the second space coordinate, and generating a three-dimensional space image including a first spatial location and a second spatial location according to the first spatial coordinate and the second spatial coordinate And transmitting the three-dimensional image to the first electronic device and the second electronic device; wherein the three-dimensional image is displayed on the first display unit and the second display unit, and the first electronic device further includes a physiological signal measuring unit, the physiological signal measuring unit measures one of the first users Sending the physiological signal to the first processing unit, and transmitting the physiological signal to the cloud server by the first processing unit, so that the physiological signal is included in the three-dimensional image, the physiological signal measuring unit includes A wearable bracelet, a wearable headgear or a smart eyewear. The management system of claim 4, wherein the physiological signal measuring unit transmits the physiological signal to the first processing unit via Bluetooth 4.0. The management system of claim 4, wherein the first electronic device or the second electronic device comprises a smart television or a gaming machine.