TWI556131B - Input and output system job execution method and input and output system - Google Patents

Description

Job execution method and input/output system of input/output system

The present invention relates to a job execution method for an input/output system, and more particularly to a job execution method and an input/output system for an input/output system controlled by a signal of a mobile electronic device.

Currently, smart phones can execute a variety of applications, some of which perform preset tasks by reading built-in sensors, such as accelerometers. However, in some cases, the user will feel that the phone is convenient, but the screen is too small.

Devices that can be remotely controlled using mobile phones, such as Microsoft's game console 360 (Microsoft XBox 360) and Sony's smart TV (Sony Smart TV), use larger screens and can be used as input. The device remotely controls the mobile phone by moving up, down, left, and right, and outputs a screen output on its screen after execution. However, since the devices are not designed to be directly held or operated by the user, the devices themselves are not equipped with the sensors built in the mobile phone as described above, so the game or software in the game must be directed at how to capture the mobile phone. The remote control signal is designed. In other words, if you want these devices to be able to read the remote control signals from the mobile phone and execute the mobile phone application, you must develop a new version for the application that was originally executed on the mobile phone. , or redesigned to allow users to execute applications that were originally executed on the phone on those devices.

Accordingly, it is an object of the present invention to provide a job execution method for an input/output system.

Therefore, the method for executing the input/output system of the present invention includes a mobile electronic device and a host electronic device, the method comprising the steps of: installing a mobile terminal software in the mobile electronic device, the mobile electronic device comprising a mobile terminal controller, a sensing unit and a mobile terminal buffer, the sensing unit has a plurality of sensors, including a motion state of the mobile electronic device, a position state of the mobile electronic device, and an input of a sound information. Or an input sensor of the image information, and correspondingly generating an original signal for controlling an application, the mobile controller writes the original signal to the mobile buffer, and executes the mobile software to Extracting the original signal stored in the buffer of the mobile terminal and transmitting a data signal including the original signal, the content of each data signal further includes information representing each sensor, and the application is designed to receive The original signal from the sensing unit performs a preset reaction but is installed on the host electronic device.

An emulation program and the application are installed in the host electronic device, the host electronic device includes a host controller and a host buffer corresponding to each of the sensors, and after receiving the data signal, the host electronic device The host controller executes the simulation program to analyze the data signal and simulates an analog signal identical to the original signal, and the host electronic device writes the original signal in the analog signal according to the information of the sensor. The corresponding host side buffer.

The host controller of the host electronic device executes the application The analog signal from the host side buffer is received and a preset response is performed.

Preferably, the content of the original signal includes information about a motion state or a position of the mobile electronic device.

Preferably, the host electronic device transmits the output content executed by the application to a display device connected thereto.

Preferably, the simulation program is installed in an access control serial layer of the host electronic device, and an architectural layer of the host electronic device continues to receive the data signal and is transmitted to the access control serial layer. The simulator.

Preferably, the content of the original signal includes information input by the user through an input interface of the mobile electronic device for use by the application.

Preferably, the content of the original signal includes a label, a button state, a word, a string, a displacement value, an acceleration value, an angular velocity value, a positioning signal value, a sound information, and an image information. Or a combination thereof.

Preferably, the sensing unit is a set of various devices that can respectively generate the original signal, and is selected from the group consisting of: accepting various input interfaces input by the user to the mobile electronic device, various A dynamic sensor capable of sensing motion of the mobile electronic device, a positioning signal receiver capable of sensing a position state of the mobile electronic device, a video information receiver, and the like.

Preferably, the content of the data signal further includes information representing a type of the original signal, and the host electronic device is based on the type of information. The original signal in the analog signal is written into the corresponding host side buffer.

Another object of the present invention is to provide an input and output system.

Thus, the input/output system of the present invention comprises a mobile electronic device and a host electronic device.

The mobile electronic device includes a mobile terminal software installed therein, a mobile terminal controller, a sensing unit and a mobile terminal buffer. The sensing unit has a plurality of sensors, including sensing motion of the mobile electronic device. a state, a positional state of the mobile electronic device, an input of a sound message, or a sensor for inputting image information, and correspondingly generating an original signal for manipulating an application, the mobile controller The signal is written into the mobile terminal buffer, and the mobile terminal software is executed to extract the original signal stored in the mobile terminal buffer and send a data signal including the original signal, and the content of each data signal further includes Representing information about each of the sensors, the application is designed to receive the original signal from the sensing unit to perform a preset reaction, but is installed on the host electronic device.

The host electronic device includes an analog program installed therein and the application program, a host controller, and a host buffer corresponding to each of the sensors. After receiving the data signal, the host electronic device receives the data signal. The controller executes the simulation program to analyze the data signal and simulates an analog signal identical to the original signal. The host electronic device writes the original signal in the analog signal according to the information of the sensor. a host side buffer, the host side controller executing the application to receive the analog signal from the host side buffer and performing a preset reaction.

Preferably, wherein the host electronic device executes the application The output content is transmitted to a display device to which it is connected.

Preferably, the simulation program is installed in an access control serial layer of the host electronic device, and an architectural layer of the host electronic device continues to receive the data signal and is transmitted to the access control serial layer. The simulator.

Preferably, the sensing unit is a set of various devices that can respectively generate the original signal, and is selected from the group consisting of: accepting various input interfaces input by the user to the mobile electronic device, various A dynamic sensor capable of sensing motion of the mobile electronic device, a positioning signal receiver capable of sensing a position state of the mobile electronic device, a video information receiver, and the like.

Preferably, the content of the data signal further includes information representing a type of the original signal, and the host electronic device writes the original signal in the analog signal to the corresponding host-side buffer according to the type of information.

Preferably, the mobile electronic device and the host electronic device are built-in open operating systems for the user to install the software.

The effect of the present invention is that the data signal is sent to the host computer electronic device through the mobile terminal software, and the buffer corresponding to the sensing unit is filled in the simulation for an application in the host electronic device. Taken in the way the application was originally designed.

The foregoing and other technical aspects, features and advantages of the present invention will be apparent from the following description of the preferred embodiments.

Referring to FIG. 1 and FIG. 2, an embodiment of an operation execution method of the input/output system of the present invention is illustrated. The input/output system includes a mobile electronic device 1 and a host electronic device 2. The mobile electronic device 1 has an open operating system for the user to install the software, for example, a smart phone or a tablet computer for the user. In this embodiment, the user can install the software. For example, the smart phone includes a mobile controller 12, a mobile buffer 13 and a sensing unit 14. The sensing unit 14 is a set of sensors that can respectively generate an original signal, and includes a keyboard, a mouse, and a touch screen that accept input from the mobile electronic device 1 , wherein the touch screen can be Acting as a keyboard or a mouse; the sensing unit 14 also includes an accelerometer, a gyroscope or a positioning signal receiver that can sense the motion or position state of the mobile electronic device 1; even the sensing unit 14 can include a The recorder or a camera, the content of the original signal generated by the recorder includes a sound information or an image information or a combination thereof. It should be emphasized that, in this embodiment, the sensing unit 14 is an existing sensor of the existing mobile electronic device 1 (smartphone), and the present embodiment utilizes these existing feelings. The detector generates various original signals and then uses them. The host electronic device 2 also has an open operating system built in, and the user can install the software itself. In this embodiment, the host electronic device 2 is a machine that connects a display device 3 with a high-definition quality multimedia interface (HDMI) and transmits the audio-visual information to the display device 3, and combines the specific design of the present invention. . The display device 3 is, for example, a television or a computer screen. The host electronic device 2 includes a host controller 22 and a plurality of host buffers 23. The job execution method of the input/output system includes The following steps S11 to S13 are sequentially performed on the mobile electronic device 1, and steps S21 to S25 are sequentially performed on the host electronic device 2:

Step S11 - A mobile terminal software 11 is installed in the mobile electronic device 1 in advance. The mobile terminal software 11 is a software designed by the user for the mobile electronic device 1 to be installed by the user. When executed, the output of the sensing unit 14 can be retrieved at any time, and processed by the following method. The Wi-Fi wireless network is transmitted to the host electronic device 2.

Step S12 - The sensing unit 14 senses an input from the outside, such as the motion of the mobile electronic device 1 body, the location or the user's input, and correspondingly generates the original signal for controlling an application 24.

The application 24 is exemplified as an integrated game, and the content of the original signal is required to include the motion state or position of the mobile electronic device 1 such as a displacement value, an acceleration value, and the like. In other embodiments, the content of the original signal may also include information input by the user through an input interface of the mobile electronic device 1 for use by the application 24, such as a logo and a Button status, a single word or a string, or a combination of the above information.

Step S13 - the mobile controller 12 writes the original signal to the mobile buffer 13 and executes the mobile software 11 to retrieve the original signal from the mobile buffer 13 and send a signal accordingly. The data signal including the original signal. The content of the data signal further includes information indicating the type of the original signal (ie, which sensor of the sensing unit 14 is generated), and the content of the data signal is described later.

Step S21 - A simulation program 21 and the application program 24 are installed in the host electronic device 2 in advance. In the case where the application 24 is a somatosensory game, it is designed to receive the original signal from the sensing unit 14 and perform a preset reaction, such as a character action reaction in the game, which can only be installed on the mobile electronic device 1 Executed, but with the design of the present invention, the application 24 is installed on the host electronic device 2 without rewriting or developing a new version. The simulation program 21 is a program designed in advance for the host electronic device 2, and when executed, the presence of the sensing unit 14 can be simulated as follows to cause the application 24 to consider the host electronic device 2 to be set. There is the sensing unit 14.

Step S22 - The host electronic device 2 receives the data signal described in step S13.

Step S23 - the host controller 22 executes the simulation program 21 to analyze the data signal and simulates an analog signal identical to the original signal, and writes one of the types of information according to the content of the data signal. The host side buffer 23 of the type data signal.

In detail, the simulation program 21 is installed in an access control list (ACL) layer of the host electronic device 2, and a framwork layer of the host electronic device 2 is continuously waiting to receive the data signal, and The simulation program 21 is passed to the access control serial layer.

Step S24 - the host of the host controller 22 of electronic apparatus 2 executes the application received from the host 24 and the end of the analog signal buffer 23 and performs a predetermined response. In detail, the application 24 is installed at the application layer. In the application layer, the application 24 does not know that the analog signal is simulated by the simulation program, but is executed in a manner preset thereto.

Step S25 - The host electronic device 2 transmits the output content executed by the application 24 to the display device 3 to which it is connected.

The contents of the data signal are described below. In this embodiment, the content of the data signal includes a plurality of comma separated data, wherein the first data is a number from 0 to 4, representing the type of the sensor, and the meaning is as follows:

0: keyboard

1: mouse

2: Accelerometer

3: Gyro

4: Positioning signal receiver

The keyboard may be a physical keyboard or a keyboard displayed by the touch screen. When the mobile terminal 11 receives the original signal of the keyboard of the mobile electronic device 1, it will be separated by a comma, including a keyboard representing the sensor type. 0, the keyboard state such as bounce or press, and the data signal of the string or word content, for example, when the keyboard is pressed to the right button, its data signal is "0, press, right (single word)", wherein Pressing and turning to the right is actually a code representing the meaning; for example, after inputting a text in a dialog box, the data signal is "0 input string", wherein the button state has no content.

The mouse can also be a physical mouse, a controller for controlling the cursor, or a mouse controlled by the touch screen. The mobile terminal 11 receives the original signal of the mouse of the mobile electronic device 1 and is separated by a comma. Issues include a mouse indicating the sensor type as a mouse, such as a mouse up or down or double-click, and a cursor coordinate value such as "1, double-click, x-coordinate, y-coordinate".

As for accelerometers, gyroscopes, positioning signal receivers, mobile terminals Body 11 also sends the sensor type and signal separated by commas. Taking the accelerometer as an example, the data signal will be "2, x displacement, y displacement, z displacement", other types of sensors are no longer One by one, the principles of operation are similar.

For example, to perform the so-called somatosensory game mentioned above, some settings must be made before the game starts, for example, inputting the user name. At this time, the mobile terminal software 11 will send out the information input by the keyboard; after the game starts, some need to slide. The operation, such as the change of the viewing angle of the screen, at this time, the mobile terminal software 11 will send out the information input by the mouse; when the game is in progress, the movement and rotation operations are required to control the movement of the character, and the mobile terminal software 11 will send Information about accelerometers and gyroscopes; at the end of the game, game scores may be shared, if you use the consent to share the location, or use location-related features such as searching nearby players, then the action The software 11 sends out the information of the positioning signal receiver.

In the whole process, the mobile terminal software 11 sends a data signal including the foregoing information. After the host electronic device 2 receives the data signal, the host controller 22 executes the simulation program 21 to analyze the data signal and simulates a data signal. The same analog signal as the original signal is written into the host side buffer 23, so that the somatosensory game (application) is executed in exactly the same way as when it is installed on the mobile phone, that is, Game developers do not need to develop a new version or redesign the application 24.

The following application 24 is a video calling software, such as SKYPE. In this example, the mobile terminal software 11 transmits the video signal received by the recorder or the camera to the host electronic device 2, so that the user can see the call object on the larger display device 3, or for example, The A photo or a movie or the like is viewed on the display device 3.

In this embodiment, when selecting a call object or answering an incoming call, the mobile terminal software 11 sends a data signal including the content input by the keyboard; when the audio call is selected, the mobile terminal software 11 sends a data signal including the sound information; When the video call is selected, the mobile terminal 11 sends a data signal of the sound information and the image information, and the simulation program 21 of the host electronic device 2 analyzes the data signal correspondingly and simulates an analog signal identical to the original signal. In the same way, the developer does not need to develop a new version or redesign the application 24, which means that the user can use the custom call application 24, or even the application 24 executed on the mobile phone, but The output content of the application 24 is displayed on the display device 3 of a larger size to which the host electronic device 2 is connected.

In summary, the data signal is sent to the simulation program 21 of the host electronic device 2 through the mobile terminal software 11, and after being simulated, the buffer corresponding to the sensing unit 14 is filled in for the host electronic device 2. An application 24 is used in the manner originally designed by the application 24, and can execute a plurality of applications 24 that can be executed on the mobile electronic device 1 and display them on the display device 3. The purpose of the invention.

The above is only the preferred embodiment of the present invention, and the scope of the invention is not limited thereto, that is, the simple equivalent changes and modifications made by the scope of the invention and the description of the invention are All remain within the scope of the invention patent.

1‧‧‧Mobile electronic device

11‧‧‧Mobile software

12‧‧‧Action Controller

13‧‧‧Action side buffer

14‧‧‧Sensor unit

2‧‧‧Host electronic device

21‧‧‧ Simulator

22‧‧‧Host Controller

23‧‧‧Host side buffer

24‧‧‧Application

3‧‧‧Display device

S11 to S13‧‧‧ steps

S21 to S25‧‧‧ steps

Figure 1 is a system block diagram illustrating the operation of the input and output system of the present invention A preferred embodiment of the method of performing the same; and FIG. 2 is a flow chart illustrating the preferred embodiment.

S11 to S13‧‧‧ steps

S21 to S25‧‧‧ steps

Claims (14)

A job execution method for an input/output system, the input/output system comprising a mobile electronic device and a host electronic device, the method comprising the steps of: installing a mobile terminal software in the mobile electronic device, the mobile electronic device comprising an action end a sensor, a sensing unit and a mobile buffer, the sensing unit having a plurality of sensors, including sensing a motion state of the mobile electronic device, a position state of the mobile electronic device, an input of a sound information, or a sensor for inputting image information, and correspondingly generating an original signal for controlling an application, the mobile controller writes the original signal to the mobile buffer, and executes the mobile software Taking the original signal stored in the mobile terminal buffer and transmitting a data signal including the original signal, the content of each data signal further includes information representing each sensor, and the application is designed to receive from The original signal of the sensing unit performs a preset reaction, but is installed on the host electronic device; in the host electronic device An emulator and an application are installed. The host electronic device includes a host controller and a host buffer corresponding to each of the sensors. After the host electronic device receives the data signal, the host controller executes the The simulation program analyzes the data signal and simulates an analog signal identical to the original signal. The host electronic device writes the original signal in the analog signal to the corresponding host side buffer according to the information of the sensor. And the host controller of the host electronic device executes the application The analog signal from the host side buffer is received and a preset response is performed. The job execution method of the input/output system according to claim 1, wherein the content of the original signal includes information on a motion state or a position of the mobile electronic device. The job execution method of the input/output system according to Item 1, wherein the host electronic device transmits the output content executed by the application to a display device to which it is connected. The operation execution method of the input/output system according to the first aspect of the invention, wherein the simulation program is installed in an access control serial layer of the host electronic device, and an architectural layer of the host electronic device continues to receive the data signal. And passed to the simulator in the access control serial layer. The operation method of the input/output system according to the first aspect of the invention, wherein the content of the original signal includes information input by the user through an input interface of the mobile electronic device for use by the application. The job execution method of the input/output system according to claim 1, wherein the content of the original signal includes a label, a button state, a word, a string, a displacement value, an acceleration value, and an angular velocity value. , a positioning signal value, a sound information, an image information or a combination thereof. The job execution method of the input/output system according to claim 1, wherein the sensing unit is a set of various devices that can respectively generate the original signal, and is selected from the group consisting of: accepting a user Various input interfaces for inputting the mobile electronic device, various dynamic sensors capable of sensing motion of the mobile electronic device, a positioning signal receiver capable of sensing a position state of the mobile electronic device, a video information receiver, and this A combination of the same. An input/output system includes a mobile electronic device and a host electronic device; the mobile electronic device includes a mobile terminal software installed therein, a mobile terminal controller, a sensing unit and a mobile terminal buffer, the sensing The unit has a plurality of sensors, including a sensor for sensing the motion state of the mobile electronic device, the position state of the mobile electronic device, an input of a sound information, or an input of image information, and correspondingly generating a control An original signal of an application, the mobile controller writes the original signal to the mobile buffer, and executes the mobile software to retrieve the original signal stored in the mobile buffer and send a The data signal including the original signal, the content of each of the data signals further includes information representing each of the sensors, and the application is designed to receive the original signal from the sensing unit and perform a preset reaction, but is installed on the The host electronic device includes an emulation program installed therein and the application program, a host controller, After receiving the data signal, the host computer executes the simulation program to analyze the data signal and simulates an analog signal identical to the original signal. The host electronic device writes the original signal in the analog signal to the corresponding host-side buffer according to the information of the sensor, and the host-side controller executes the application to receive the buffer from the host end. The analog signal and perform a preset reaction. The input/output system according to claim 8, wherein the host electronic device transmits the output content executed by the application to the connected A display device. According to the input/output system of claim 8, wherein the simulation program is installed in an access control serial layer of the host electronic device, and an architectural layer of the host electronic device continues to receive the data signal and is transmitted to The access control is the simulator in the serial layer. The input/output system according to claim 8, wherein the sensing unit is a set of various devices that can respectively generate the original signal, and is selected from the group consisting of: accepting a user to the mobile electronic Various input interfaces for inputting by the device, various dynamic sensors capable of sensing the movement of the mobile electronic device, a positioning signal receiver capable of sensing the position state of the mobile electronic device, a video information receiver, and the like . According to the operation execution method of the input/output system of claim 8, wherein the mobile electronic device and the host electronic device are built-in open operating systems, and the user can install the software by themselves. According to the input/output system of claim 8, the application is an integrated game, and the sensing unit has a keyboard, a mouse, an accelerometer, a gyroscope and/or a positioning signal receiver. According to the input/output system of claim 8, the application is a video calling software, and the sensing unit has a keyboard, a sound recorder and/or a camera.