TWI509464B - Method for processiing interactive programed object and method of communication among devices - Google Patents

Description

Interactive program object processing method and multi-machine communication method thereof

The present invention relates to a method for processing an interactive program object and an inter-device communication method for performing the same, and more particularly to a technique for performing an operation of an interactive program object and communicating with each other through an electronic device having communication capability.

Software programs commonly found in handheld devices (such as mobile phones and tablets), especially video games, are mostly operated by buttons or touch screens. The feature is that the software objects in the operation move with the user's judgment. .

Gradually, several advanced sensors are provided inside the more advanced handheld device as the user's use of the device, such as software programs related to the direction and device inclination determination. A common sensor, such as an accelerometer, is a gravity sensor (G-Sensor) that senses the instantaneous movement state of a user when operating a communication device, and can detect speed changes in various directions. In order to judge the change of horizontal or vertical movement in various directions (such as three-axis accelerometer). There is also a gyroscope that can detect angular velocity changes in all directions, so it can be used to determine the direction and angle of movement, which can be used to assist the accelerometer in determining the accuracy of the direction and moving distance.

Video games used in general communication devices can be connected to these sensors. The fun of the operation.

The present disclosure proposes an interactive program object processing method and a multi-machine communication method thereof. The sensor provided in a handheld device can interact with an object displayed by the device, and can even pass through a network between multiple handheld devices. The road is connected to achieve the effect of interactive operation.

According to the embodiment of the disclosure, in the stand-alone mode, the interactive program object processing method is applied to a handheld device having an acceleration sensor and an angular velocity sensor, such as a touch display The phone, the tablet computer, etc., start with a data processing unit to start a program object and display it on the display. According to an embodiment, the program object is a soft object having a rotating and moving feature, such as a gyro simulated by a software.

The user can then receive the continuously sliding touch signal of the surrounding program object through the touch panel. If the gyro is used as an example, the process of calculating a continuous scrolling signal for a period of time is calculated by the data processing unit. An initial rate of rotation of the program object.

Thereafter, the user holds the handheld device for operation, wherein the sensor senses an operational behavior, that is, receiving the speed signal and the direction signal generated by the acceleration sensor and the angular velocity sensor of the handheld device, and data processing. The unit then calculates the initial movement speed of the program object in a moving direction.

The data processing unit then calculates an initial state of the program object based on the initial rotational rate and the initial movement speed, including generating a picture showing the initial position of the program object on the display. The data processing unit calculates the initial rotation rate and the initial movement speed of the program object at least with a change of the time parameter, and displays the position of the program object on the display according to the changed position. If the gyro is taken as an example, the gyro will decelerate as time passes.

The data processing unit of the handheld device can calculate an initial tilt angle of the program object according to the initial rotation speed and the initial movement speed in addition to the initial movement speed and direction.

In the dual-machine or multi-machine interaction mode, the multi-machine communication method for processing the interactive program object includes at least two handheld devices respectively starting the corresponding software programs, and individually displaying the connection setting screen, including the connection information, and then according to the connection information. This connection information establishes a wireless connection between handheld devices. In one embodiment, the connection information includes a website of a handheld device on a local area network and authentication information.

Then, each handheld device initializes the program object. The steps are the initial steps in the stand-alone mode. After initializing the program object, at least two handheld devices exchange the respective program objects and the initial position of the program object through the wireless connection. The respective displays of the at least two handheld devices are displayed to correspond to at least two program objects generated by the respective handheld devices.

Thereafter, the data processing unit of one of the at least two handheld devices calculates the instantaneous position of the program object according to a physical model to calculate the rotation rate and the moving speed of each of the program objects at least with a change of the time parameter. The instant location of the program object is synchronized to different handheld devices via a wireless connection, and at least two program objects are instantly displayed by the display of the respective handheld device.

The step of initializing the program object in each of the handheld devices may include setting physical parameters of the program object that change the initial state, including at least the weight of the program object and the surface structure.

In order to further understand the technology, method and function of the present invention in order to achieve the intended purpose, reference should be made to the detailed description and drawings of the present invention. The detailed description is to be understood as illustrative and not restrictive.

10‧‧‧Handheld devices

201‧‧‧Setting screen

203‧‧‧ Game mode

205‧‧‧Program objects

207‧‧‧Drive objects

301‧‧‧ first hand-held device

302‧‧‧Second hand-held device

a, a’‧‧‧ first program object

b, b’‧‧‧ second stylized object

30‧‧‧Wireless network

401‧‧‧ first hand-held device

402‧‧‧Second hand-held device

403‧‧‧Connection information map

501‧‧‧ first hand-held device

502‧‧‧Second hand-held device

Steps S601~S613‧‧‧ Interactive program object processing method steps

Steps S701~S713‧‧‧Multi-machine communication method steps

Steps S801~S817‧‧‧ Interactive program object processing method steps

Step S901~S917‧‧‧Multi-machine communication method steps

1 is a schematic diagram showing an operation of a user's hand gripping device to perform a swing; FIG. 2(a) is a schematic view showing a setting screen on the handheld device; and FIG. 2(b) is a schematic diagram showing a screen for initializing a program object on the handheld device; 2(c) is a schematic diagram of an operation screen displayed on the handheld device; FIG. 3 is a schematic diagram showing wireless connection of two handheld devices; FIG. 4 is a schematic diagram showing the connection manner of two handheld devices in the present invention. FIG. 5 is a schematic diagram showing an interactive screen showing two program objects in a handheld device; FIG. 6 is a flow chart describing one embodiment of the interactive program object processing method of the present invention; and the flow shown in FIG. 7 describes the present invention. One of the embodiments of the computer communication method; the flow shown in FIG. 8 describes the second embodiment of the interactive program object processing method of the present invention; the flow shown in FIG. 9 describes the second embodiment of the multi-machine communication method of the present invention.

The invention provides an interactive program object processing method and a multi-machine communication method capable of interacting on a single handheld device or two or more handheld devices, and the handheld device is especially intelligent with a speed sensor and an angular velocity sensor. For mobile phones, tablets, etc., these devices should be equipped with a touch screen or an electronic device that can operate with gestures. Through the interactive program object processing method described in the disclosure, the user can manipulate the objects displayed on the user interface by waving, shaking, etc., and interact with the objects on other devices. The object can be a soft object implemented by a software program.

1 shows a schematic diagram of the operation of the user's hand gripping device to perform the swinging, that is, the user's operation behavior is sensed by the speed and angular velocity sensor (such as a multi-dimensional accelerometer, gyroscope, etc.) provided in the handheld device 10. These sensors will feel The action to be performed is converted into an operation signal, and the change of the time is controlled by the data processor in the device to control the movement of the program object and the change of energy.

For example, the method described in the disclosure can operate as an object that can interact with the surrounding environment, in addition to a specific object on a general user interface, as shown in FIG. 2(a), wherein the schematic display is handheld. Setting screen on the device.

A program object is generated by the software program, as shown in the gyro of the setting screen 201. The setting screen 201 includes various attribute settings of the program object, including the form of the object, such as the gyro, including the gyro of each country and all regions. There are different features (weight, size, shape, pattern); set the user's data, and the function of attaching to this object, such as the function of the gyro in the game. The setting screen 201 also includes a game mode 203 that provides the user with a choice of stand-alone or combat.

Next, as shown in FIG. 2(b), the step of initializing the program object is performed on the display screen of the handheld device. This figure only shows the initial step of one of the steps, that is, providing the user to operate a driving object 207 to the program object 205. Generate a starting condition. Taking the gyro as an example, the driving object 207 is wound around the gyro, and is touched by the user on the touch display by the user, and the surrounding program object 205 continuously slides to generate a continuously sliding touch signal, which can be converted into a program after calculation. The initial kinetic energy of the object 205, such as the initial energy (rotational energy) of the gyro object.

2(c) is a schematic diagram showing an operation screen displayed on the handheld device. The program object 205 in the figure is moved in a screen by operation, and the operation includes controlling the user to swing or control the program object 205 with horizontal angle control. Move in the picture. If the game is taken as an example, the screen can be designed with obstacles or other objects in the moving path of the program object 205. The user should perform a collision to make the object 205 slow down and reduce energy by operating the dodge. These possible level designs are not technical features disclosed in the present invention and therefore will not be described herein.

Applying the technology disclosed in the disclosure, the interactive program object processing method can be used in a stand-alone mode with a program object, and then the above-mentioned gyro game is taken as an example, and the user touches the gesture of the touch display of the handheld device during the game. Gestures include Menu selection, initial environment setting; one or multi-dimensional acceleration sensor, gyroscope and other motion sensors in the handheld device, when the user operates the device, controls the movement and speed of the program object.

A multi-machine communication method using this interactive program object processing method can be used to interact with a plurality of interconnected handheld devices. In the case of a gyro game, two or more handheld devices can be provided for interaction, such as Each generates a program object that can be used against. This part of the technology involves the generation and exchange of game objects, including the exchange of touch signals generated by the touch display, and the exchange of sensors such as accelerometers and gyroscopes.

Embodiments Referring to FIG. 3, a schematic diagram of wirelessly connecting two handheld devices in accordance with the teachings of the present invention is shown.

A first hand-held device 301 and a second hand-held device 302 connected via a wireless network 30 are shown. After the program objects are initialized, each of the program objects is started, such as the illustrated gyro, each having a different initial parameter value, such as the first handheld device 301 initializing the first program object through its own software program and function option initialization. a, the second hand-held device 302 is to start another second program object b.

After the two handheld devices 301, 302 are connected, the corresponding software programs respectively executed start a program object a, b, and after the network exchanges the setting parameters, a corresponding object can be started on the user interface of the other party. . The first program object a, such as initiated on the first hand-held device 301, will project a corresponding image first program object a' in the second hand-held device 302; initiated on the second hand-held device 302. The second program object b generates a second program object b' on the first hand-held device 301, and exchanges an instant state during the game, that is, one of the two devices 301, 302 is used as an arithmetic unit, and the calculation is received from two The various touch and sensor signals generated by the device are transmitted to the respective software programs to form a moving and changing image of the object.

It is worth mentioning that when the two handheld devices are initially connected, the two devices are all in a wireless local area network. To connect to each other's network address, including some means of authentication. The disclosure further proposes a method for establishing a connection, as shown in FIG. 4, which is a schematic diagram of establishing a connection mode of two handheld devices in the present invention.

In this example, the first handheld device 401 performs a battle or multi-machine interaction mode after the software program is operated, and can initiate a connection actively, and the related connection information is recorded in a barcode that can record various information, such as A two-dimensional bar code such as QR Code, the connection information shown in the figure corresponds to the map 403, wherein the connection information can be the address of the handheld device in a regional network and the authentication data. At this time, the second handheld device 402 captures the connection information corresponding map 403 by using a camera and such a barcode scanning program, and scans and decodes the information, thereby becoming the basis for connecting the two devices. The software program of the second handheld device 402 will identify the connected object based on the connection information, and a dedicated channel can be established between the two.

Figure 5 is a schematic diagram showing an interactive screen showing two program objects in a handheld device.

Therefore, the gyro is in the form of a program object, and the software program in each handheld device will provide various function menus corresponding to the characteristics of the object, and the initial parameters of the object are formed after the setting is completed. When the multi-machine interaction mode is executed, the first handheld device 501 displays the local start program object, including the energy axis associated with the object (such as the lifeline of the game), while displaying the start of another second handheld device 502. The programmatic object, the associated energy axis is displayed near the object, allowing the user to clearly understand their respective energy conditions.

The flow shown in FIG. 6 describes an embodiment of the interactive program object processing method of the present invention. The method is particularly applied to a handheld device having an acceleration sensor and an angular velocity sensor. The device further includes a display having a touch panel and performing an operation. The data processing unit, other basic components such as memory, speakers, image processor and so on will not be described.

According to this embodiment, starting the step S601, initializing the handheld device, the device includes executing a software program for performing the object interaction, and the step of initializing the program object in each handheld device includes setting a program object that changes the initial state. Parameters such as the weight, shape, size, and even surface structure of the program object. As described in step S603, a user object is generated by the user interface generated by the user through the software program of the handheld device, and the program object is generated by the software program providing a menu for the user to select or provide customization. The environment of a program object. It can be displayed on the display. The setting screen of the setting object may include a plurality of options regarding the physical characteristics of the program object. For example, according to the laws of mechanics, an object that rotates at an initial velocity (such as a gyro) should change its velocity according to the influence of gravity over time, such as getting slower and slower, and depending on the collision of the program object with the surrounding environment, the environment Factors such as friction change the speed and the path of travel, especially the speed that affects the movement of the object and the angle of inclination.

Then, before starting to operate the program object, the software program of the handheld device provides a user interface for the user to establish initial parameters through interaction. In step S605, the user is continuously slid on the touch display of the handheld device. After the data processing unit in the handheld device receives the continuously sliding touch signal, in step S607, the data processing unit accumulates the continuously sliding touch signal for a period of time, and an initial rotation rate of the program object can be calculated. Referring to the above-mentioned gyro-like program object, the gyro has the characteristics of rotational energy, so that the user can continuously circulate around the object along with the gyro, and it is regarded as the action of winding the wire when starting to play the gyro, and scrolling The process will accumulate the initial energy of this gyro, especially the rotational energy.

At this point, the software program has given the program object an initial condition through the operation, in particular an initial rotation rate, and then the user can gesture to start the start of the entire program object, such as step S609, the sense of acceleration and angular velocity through the handheld device. The detector senses the motion, generates a velocity and direction signal, and is received by the data processing unit of the handheld device.

Next, in step S611, the data processing unit calculates an initial moving speed in a moving direction according to the above-described parameters such as speed and direction sensed by the sensor. The data processing unit calculates the program object according to the initial rotation rate and the initial movement speed The initial state is converted to an image of the program object, that is, an initial picture showing the initial position of the program object on the display.

In addition to the physical parameters such as the initial rotation rate, the initial movement speed, and the moving direction, the data processing unit can further calculate an initial tilt angle of the program object.

When the program object moves on the display screen, the data processing unit calculates the initial rotation rate of the program object and the initial movement speed (which may also include the tilt angle) at least with a time parameter, taking the gyro as an example, according to the physical model, the software The program will calculate the change of the program object over time or the collision with other surrounding objects according to the weight of the object, the wind speed of the environment, the frictional force, the travel path, etc., and display it on the display according to the instantaneous position.

The flow shown in Figure 6 depicts a stand-alone operating procedure for a handheld device, and Figure 7 shows the flow of the multi-machine communication method of the present invention. This example involves an interactive program of two handheld devices and can be applied to two or more devices interaction.

Beginning with step S701, the two handheld devices start the corresponding program. Taking the game as an example, the two devices will execute the same or corresponding software programs respectively. The connection setting screen is displayed through the software program respectively. In step S703, the setting screen can provide a menu, the user selects the program object, and other function menus.

The software program will be based on the options of the setting screen (each option is linked to a function parameter, object characteristics). After the initialization of the program object is completed in step S705, in step S707, the two handheld devices are exchanged through the wireless connection of the two devices. The program object and the initial parameters cause the devices to display the two program objects according to the initial or in-process immediate parameters, as in step S709.

Then, in step S711, the software program has a built-in physical model, in particular, according to the mechanical principle, calculates the change of the rotation and the movement, and converts the change into an exchangeable signal. In step S713, the instant state is transmitted to another handheld device. on.

Taking the gyro as a program object as an example, FIG. 8 further shows the flow of the interactive program object processing method of the present invention applied to a game.

When the handheld device executes a game software, the user selects a menu through the software menu. The machine mode is executed and the game is executed (step S801), and a game object such as a top can be selected or customized from the game menu (step S803).

The software then provides a menu for setting initial conditions, such as weight, size, shape, and other characteristics simulated by the software, which affect the initial state of the game object during the game, as well as other objects. The degree of influence (step S805).

At the beginning of the game, the game start screen provides a screen for accumulating the energy of the game object. Taking the gyro as an example, the initial energy can be continuously accumulated by the function of providing the winding line through the screen (step S807). The processor within the device calculates the initial energy based on successive sliding signals over a cumulative period of time.

Thereafter, the game screen prompts the user to release the game object (step S809). For example, the hand-held device is generally swung by a gyro that pulls up the rope, and the sensor in the device senses the amplitude, direction, etc. of the wave. The operation determines the initial rotation speed, the moving direction, and the moving speed based on the initial energy, the initial speed, the direction, and the like (step S811), and starts counting (step S813).

If the gyro is taken as an example, the game object will change the moving direction, speed and rotation speed due to time and object collision (step S815), and then the game software simulates the environment of the game, and the user can follow the game rules until the game is finished. (Step S817).

If the gyro game is taken as an example, FIG. 9 further shows a flow embodiment of the multi-game mode, which is applied to two or more hand-held devices connected to each other.

When different users use different handheld devices to select the competition mode (step S901), the game state of both can be synchronized in real time during the game. In the competition mode, the game object (gyro) is still initialized by the two handheld devices respectively (step S903). At this time, one of the handheld devices can initiate a connection request, and the connection steps are not limited and can be exchanged. The connection information is provided to the game software setting; or, as in the above embodiment, one device initiates a connection information map such as QR Code, and the other device obtains connection information by scanning the corresponding map, and the game software is According to this The connection is set (step S905) to establish a connection between two or more devices, preferably in a wireless local area network.

In this connection state, the game software prompts that the related object parameters can be transmitted to each other (step S907). At this time, the main operation can be performed by one of the devices, including starting the screen so that the user can continuously slide through the touch panel. The action of simulating the gyro roping, the processor in the device receives the continuous sliding touch signal surrounding the game object, and obtains the continuous sliding touch signal for a cumulative period of time, and calculates the initial energy of the program object, which can be The initial rotation rate parameter is represented (step S909).

Taking the gyro object as an example, the user of the interconnected handheld device releases the object by means of the waving device (step S911), wherein the processor will obtain the speed signal generated by the acceleration sensor and the angular velocity sensor of the handheld device. With the direction signal, an initial condition such as an initial moving speed of the program object of the interactive game in a moving direction is calculated (step S913).

At this time, because of the relationship of the instant exchange state, each connected handheld device generates a picture showing the initial positions of the plurality of program objects (including the objects generated by other devices) on the display, the positions of the objects are transmitted according to the device to which the device belongs. It depends on the news. Then, the processor calculates, according to a physical model, a rotation rate, a direction, a moving speed of the at least two program objects, or an initial tilt angle with the respective program object, etc., at least with a change of a time parameter (step S915), during which, at least The results of the immediate calculation of the two program objects (e.g., the instant location) are synchronized to different devices via the wireless connection (step S917).

The interactive program object processing method contained in the present invention can refer to a physical model in the process, and the physical model simulates the weight, the speed, the shape, the collision angle with other objects, the initial velocity, and the friction with other objects. The force can calculate the rotation rate and the moving speed of the program object according to the basic physical laws, at least according to the change of the time parameter, including simulating the collision parameter according to the rotation rate and the moving speed of the program object, and calculating the instantaneous position and the immediate inclination angle. .

Therefore, the interactive program object processing method and the multi-machine communication method proposed by the present invention provide a novel user interface operation experience, which can be used for a specific user interface for a specific purpose operation, and can also be used for game operations.

The above are only the preferred embodiments of the present invention, and all changes and modifications made to the scope of the present invention should be within the scope of the present invention.

S601‧‧‧Initialized handheld device

S603‧‧‧Starting a program object

S605‧‧‧ Receive continuous sliding touch signals

S607‧‧‧ Calculation of the initial rotation rate of the program object

S609‧‧‧ Receiving speed and direction signals

S611‧‧‧ Calculate the initial movement speed in one direction

S613‧‧‧ produces an initial screen

Claims (8)

A multi-machine communication method for processing an interactive program object is applied to at least two handheld devices having an acceleration sensor and an angular velocity sensor, each handheld device comprising a display having a touch panel and a data The processing unit includes: the at least two handheld devices respectively start corresponding software programs; and the individual displays of the at least two handheld devices display a connection setting screen, including a connection information; according to the connection information Establishing a wireless connection between the at least two handheld devices; initializing a program object in each handheld device, comprising: (a) the data processing unit initiating the program object and displaying the same on the display; (b) receiving, by the touch panel, a continuously sliding touch signal surrounding the program object, and accumulating the continuously sliding touch signal for a period of time by the data processing unit to calculate an initial rotation rate of the program object; c) receiving a speed signal and a direction signal generated by the acceleration sensor of the handheld device and the angular velocity sensor, the data processing Calculating an initial moving speed of the program object in a moving direction; (d) calculating, by the data processing unit, an initial state of the program object according to the initial rotation speed and the initial moving speed, generating a display of the program object a screen of an initial position on the display; the at least two handheld devices exchange respective program objects via the wireless connection, and the initial position of the program object such that respective displays of the at least two handheld devices are displayed Corresponding to at least two program objects generated by each handheld device, wherein the information exchanged by the at least two handheld devices via the wireless connection includes a respective program object An initial tilt angle; and the data processing unit of one of the at least two handheld devices calculates the at least one of the rotational speed and the moving speed of the at least two program objects according to a physical model to calculate the at least Instant position of two program objects; the data processing unit of one of the at least two handheld devices calculates a rotation rate and a movement speed of the at least two program objects at least according to the change of the time parameter, and further according to the physical model Calculating an instantaneous tilt angle of the at least two program objects; wherein the instantaneous positions of the at least two program objects are synchronized to the at least two handheld devices through the wireless connection, and the display of the respective handheld devices instantly displays the at least Two stylized objects. The multi-machine communication method for processing an interactive program object according to claim 1, wherein the connection information is a website address and authentication data of the at least two handheld devices in a regional network. The multi-machine communication method for processing an interactive program object according to claim 2, wherein the connection information is recorded in a two-dimensional barcode displayed by one of the handheld devices, and the other handheld devices are obtained through a scanning program. The connection information. The multi-machine communication method for processing an interactive program object according to claim 1, wherein, according to the calculation of the data processing unit, the rotation rate and the moving speed of the at least two program objects simulate a collision parameter according to the physical model. With the change, the instantaneous position and the instantaneous tilt angle are calculated. The multi-machine communication method for processing an interactive program object according to claim 1, wherein the step of initializing the program object in each of the handheld devices includes setting a physical parameter of the program object that changes the initial state, At least the weight of the program object and the surface structure are included. An interactive program object processing method is applied to a handheld device having an acceleration sensor and an angular velocity sensor. The handheld device includes a display having a touch panel and a data processing unit, including: The data processing unit starts a program object and displays the same on the display; receives the continuously sliding touch signal surrounding the program object through the touch panel, and accumulates the continuous sliding touch in the data processing unit for a period of time a signal, an initial rotation rate of the program object is calculated; a speed signal and a direction signal generated by the acceleration sensor of the handheld device and the angular velocity sensor are received, and the data processing unit calculates that the program object is An initial moving speed of a moving direction; the data processing unit calculates an initial state of the program object according to the initial rotation rate and the initial moving speed, and generates a screen for displaying an initial position of the program object on the display; The data processing unit calculates the initial rotation rate of the program object and the initial movement speed to change at least with a time parameter, and displays the position of the program object on the display immediately according to the changed position of the program object. The interactive program object processing method of claim 6, wherein the display displays a setting screen initiated by the software program, and includes a plurality of options regarding physical characteristics of the program object. The interactive program object processing method of claim 6, wherein the data processing unit calculates an initial tilt angle of the program object based on the initial rotation rate and the initial movement speed.