CN114167987A - Android device physical interaction simulation method and device, android device and medium - Google Patents

Android device physical interaction simulation method and device, android device and medium Download PDF

Info

Publication number
CN114167987A
CN114167987A CN202111485644.0A CN202111485644A CN114167987A CN 114167987 A CN114167987 A CN 114167987A CN 202111485644 A CN202111485644 A CN 202111485644A CN 114167987 A CN114167987 A CN 114167987A
Authority
CN
China
Prior art keywords
equipment
interactive
operation command
physical interaction
android
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202111485644.0A
Other languages
Chinese (zh)
Inventor
刘少华
李进汉
吴东海
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huizhou TCL Mobile Communication Co Ltd
Original Assignee
Huizhou TCL Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huizhou TCL Mobile Communication Co Ltd filed Critical Huizhou TCL Mobile Communication Co Ltd
Priority to CN202111485644.0A priority Critical patent/CN114167987A/en
Publication of CN114167987A publication Critical patent/CN114167987A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016Input arrangements with force or tactile feedback as computer generated output to the user
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/30003Arrangements for executing specific machine instructions
    • G06F9/30076Arrangements for executing specific machine instructions to perform miscellaneous control operations, e.g. NOP
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/30Arrangements for executing machine instructions, e.g. instruction decode
    • G06F9/3017Runtime instruction translation, e.g. macros

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Software Systems (AREA)
  • Human Computer Interaction (AREA)
  • Telephone Function (AREA)

Abstract

The invention discloses a method and a device for simulating physical interaction equipment by using android equipment, the android equipment and a medium, wherein the method comprises the following steps: acquiring a virtual interactive device starting command, and calling and displaying an interactive device type selection interface; acquiring an interactive equipment type selection command, calling a preset interactive equipment operation interface and a corresponding operation command mapping table, and displaying the interactive equipment operation interface; acquiring an operation command through the operation interface of the interaction equipment, and searching a physical interaction equipment output signal corresponding to the operation command in the operation command mapping table; and controlling to send the output signal of the physical interaction device to opposite-end equipment through a wireless function. The method aims to solve the problems that a user needs to purchase various interactive devices for using special applications, the cost is high, and the storage is difficult. The user can simulate various interactive devices through the android device and realize corresponding operation, and convenience is brought to the user.

Description

Android device physical interaction simulation method and device, android device and medium
Technical Field
The invention relates to the technical field of android devices, in particular to a method and a device for simulating physical interaction equipment by using the android device, the android device and a medium.
Background
With the development of technology and the improvement of living standard of people, the variety of human-computer interaction devices (HID devices) is increasing, including traditional keyboards, mice, game pads, and game steering wheels, VR pads, etc. accompanying games. Meanwhile, some applications or games can only be used through a specific interactive device, for example, when a user wants to use a VR application, the user must purchase a VR handle to perform in-game control.
However, as the number of interactive devices increases, on one hand, the various devices are not favorable for the user to save, and on the other hand, certain economic burden is caused to the user as the devices are updated.
Thus, there is a need for improvements and enhancements in the art.
Disclosure of Invention
The invention aims to solve the technical problem that in order to overcome the defects in the prior art, the invention provides a method and a device for simulating physical interaction equipment by using android equipment, the android equipment and a storage medium.
In order to solve the technical problems, the technical scheme adopted by the invention is as follows:
a method for simulating a physical interaction device by an android device, wherein the method comprises the following steps:
acquiring a virtual interactive device starting command, and calling and displaying an interactive device type selection interface;
acquiring an interactive equipment type selection command, calling a preset interactive equipment operation interface and a corresponding operation command mapping table, and displaying the interactive equipment operation interface;
acquiring an operation command through the operation interface of the interaction equipment, and searching a physical interaction equipment output signal corresponding to the operation command in the operation command mapping table;
and controlling to send the output signal of the physical interaction device to opposite-end equipment through a wireless function.
The method for simulating the physical interaction device by the android device comprises the following steps of obtaining a virtual interaction device starting command, and calling and displaying an interaction device type selection interface:
pre-creating a plurality of types of interactive equipment operation interfaces, wherein the types comprise a keyboard, a game handle, a game steering wheel and a VR handle;
and pre-creating an operation command mapping table corresponding to each interactive equipment operation interface, wherein the operation command mapping table comprises operation commands which can be received in the interactive equipment operation interfaces and output signals of actual physical interactive equipment which are in one-to-one correspondence.
The method for simulating the physical interaction device by the android device comprises the following steps of obtaining a virtual interaction device starting command, calling and displaying an interaction device type selection interface:
and starting a wireless function in advance and establishing wireless connection with opposite terminal equipment.
The method for simulating the physical interaction device by the android device comprises the following steps of obtaining an operation command through the operation interface of the interaction device, and searching the physical interaction device output signal corresponding to the operation command in the operation command mapping table, wherein the step comprises the following steps:
when the interactive equipment operation interface is a key input device of a keyboard or a game handle, acquiring an operation command for clicking each key through the interactive equipment operation interface;
and searching the actual physical interaction equipment output signal corresponding to each operation command in the corresponding operation command mapping table.
The method for simulating the physical interaction device by the android device, wherein the step of obtaining the operation command through the operation interface of the interaction device and searching the physical interaction device output signal corresponding to the operation command in the operation command mapping table further comprises the following steps:
when the interactive equipment operation interface is equipment with a motor, a gyroscope and an acceleration sensor, which is a game steering wheel or a VR handle, a clicked operation command is obtained through the interactive equipment operation interface;
acquiring an operation command of the hand gesture of the user through a gyroscope and an acceleration sensor;
and searching the output signal of the actual physical interaction device corresponding to each operation command in the corresponding operation command mapping table.
The method for simulating the physical interaction device by the android device, wherein the step of controlling the physical interaction device output signal to be sent to the opposite terminal device through the wireless function comprises the following steps:
and controlling to send the output signal of the physical interaction equipment to opposite-end equipment in real time through a wireless function.
The method for simulating the physical interaction device by the android device comprises the following steps of controlling the physical interaction device output signal to be sent to an opposite terminal device through a wireless function:
and acquiring a feedback signal returned by the opposite terminal equipment, and executing operation corresponding to the feedback signal, wherein the feedback signal comprises a vibration signal.
An android device simulated physical interaction device apparatus, wherein the apparatus comprises:
the virtual interactive equipment starting module is used for acquiring a virtual interactive equipment starting command, calling and displaying an interactive equipment type selection interface;
the interactive equipment type selection module is used for acquiring an interactive equipment type selection command, calling a preset interactive equipment operation interface and a corresponding operation command mapping table, and displaying the interactive equipment operation interface;
the operation command conversion module is used for acquiring an operation command through the interactive equipment operation interface and searching a physical interactive equipment output signal corresponding to the operation command in the operation command mapping table;
and the physical interaction equipment output signal sending module is used for controlling the physical interaction equipment output signal to be sent to opposite-end equipment through a wireless function.
An android device comprises a memory, a processor and an android device simulation physical interaction device program which is stored in the memory and can run on the processor, wherein when the processor executes the android device simulation physical interaction device program, the steps of any android device simulation physical interaction device method are realized.
A computer readable storage medium, wherein an android device simulated physical interaction device program is stored on the computer readable storage medium, and when executed by a processor, the method for implementing any one of the android device simulated physical interaction device method steps is implemented.
Has the advantages that: compared with the prior art, the invention provides a method for simulating physical interaction equipment by using android equipment, which comprises the following steps: acquiring a virtual interactive device starting command, and calling and displaying an interactive device type selection interface; acquiring an interactive equipment type selection command, calling a preset interactive equipment operation interface and a corresponding operation command mapping table, and displaying the interactive equipment operation interface; acquiring an operation command through the operation interface of the interaction equipment, and searching a physical interaction equipment output signal corresponding to the operation command in the operation command mapping table; and controlling to send the output signal of the physical interaction device to opposite-end equipment through a wireless function. According to the invention, the user operation command acquired by the android device sensor is mapped into the output signal of the actual physical interaction device by presetting the operation command mapping table, and the output signal is sent to the opposite terminal device such as a television or a computer through the wireless functions such as Bluetooth. The problems that a user needs to purchase various interactive devices due to software use, the cost is high, and storage is not facilitated are solved.
Drawings
Fig. 1 is a flowchart of a specific implementation of a method for simulating a physical interaction device by an android device according to an embodiment of the present invention.
Fig. 2 is a detailed flowchart of a real-time method in step S300 in fig. 1 according to an embodiment of the present invention.
Fig. 3 is a schematic flowchart of another embodiment of step S300 in fig. 1 according to an embodiment of the present invention.
Fig. 4 is a flowchart illustrating a specific process of step S400 in fig. 1 according to an embodiment of the present invention.
Fig. 5 is a flowchart of a specific implementation of a method for implementing an android device to simulate a physical interaction device in a plug-in form according to an embodiment of the present invention.
Fig. 6 is a schematic block diagram of an apparatus for simulating physical interaction of an android device according to an embodiment of the present invention.
Fig. 7 is a schematic diagram of an internal structure of a terminal device according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and effects of the present invention clearer and clearer, the present invention is further described in detail below with reference to the accompanying drawings and examples. It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.
It should be noted that, if directional indications (such as up, down, left, right, front, and back … …) are involved in the embodiment of the present invention, the directional indications are only used to explain the relative positional relationship between the components, the movement situation, and the like in a specific posture (as shown in the drawing), and if the specific posture is changed, the directional indications are changed accordingly.
In addition, if there is a description of "first", "second", etc. in an embodiment of the present invention, the description of "first", "second", etc. is for descriptive purposes only and is not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, technical solutions between various embodiments may be combined with each other, but must be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present invention.
With the development of science and technology and the improvement of living standard of people, people invent more and more interactive devices for obtaining better interactive experience, such as VR software popular in recent years and VR handles used in VR games, and mainly use a gyroscope and acceleration to sense hand actions of users so as to realize the immersive interactive experience; and for example, a game steering wheel controller specially used for playing racing games is used for inputting the operation of rotating the game steering wheel by a user into a television or a computer through a motor so as to control racing in the games.
However, with the wide variety of interactive devices, users must purchase the corresponding interactive devices to obtain better application and game experience, which is costly for the users. At the same time, the special device is only needed when running individual applications or games, and most of the time, the special interactive devices are in idle state. Therefore, with the increase of the types of the interactive devices, the user obtains better use experience, and meanwhile, the problems of high device cost, occupied space and low use rate are urgently needed to be solved.
In order to solve the above problems, embodiments of the present invention provide a method for an android device to simulate a physical interaction device, where a click, a hand action, and the like of a user can be obtained through the android device, an operation command input by the user through the android device is one-to-one corresponding to an output signal of an actual physical interaction device, and the output signal is sent to an opposite-end device through a wireless function, so that the user can run a corresponding application without purchasing a dedicated interaction device, thereby reducing user cost, solving the problems of low utilization rate of hardware devices and occupied space, and improving user convenience.
Exemplary method
First embodiment
As shown in fig. 1, an embodiment of the present invention provides a method for an android device to simulate a physical interaction device, where the method for the android device to simulate the physical interaction device can be used in an android device such as a mobile phone and a tablet computer. The method in the embodiment of the invention comprises the following steps:
s100, acquiring a virtual interactive device starting command, and calling and displaying an interactive device type selection interface;
in this embodiment, after the android device obtains a command that a user clicks to start the virtual interactive device, an interactive device type selection interface is called and displayed. The selectable device types on the interactive device type selection interface at least comprise a keyboard, a game handle, a VR handle and a game steering wheel.
S200, acquiring an interactive equipment type selection command, calling a preset interactive equipment operation interface and a corresponding operation command mapping table, and displaying the interactive equipment operation interface;
in this embodiment, when the android device obtains a selection command for a user to select a type of the interactive device, a preset interactive device operation interface is invoked. For example, when the user selects the interactive device of the keyboard, the keys which are the same as or similar to the keyboard layout and can be clicked appear on the operation interface; when the user selects the interactive device with the VR handle, the image of the actual VR handle is displayed on the operation interface, the image correspondingly contains a clickable button, and the use method of simulating the VR handle by using android equipment is popped up, wherein the use method comprises a holding method, a correcting method and the like. Furthermore, an operation command mapping table corresponding to the operation device needs to be called, where the operation command mapping table includes an operation command input by a user on an operation interface and an output signal sent by the corresponding physical interaction device when the operation command is actually executed. Through the steps, the corresponding controllable interactive equipment operation interface is called and displayed for the user to operate according to the interactive equipment selected by the user.
Step S300, obtaining an operation command through the operation interface of the interaction equipment, and searching a physical interaction equipment output signal corresponding to the operation command in the operation command mapping table;
in this embodiment, the android device obtains an operation command input by a user through an interactive device operation interface, and searches for a physical interactive device output signal corresponding to the operation command input by the user in the operation command mapping table based on the operation command. When the operation command is a clicked operation command, obtaining an output signal corresponding to the physical interaction equipment through simple search; and when the operation command is a hand action, acquiring data of a mobile phone gyroscope and an acceleration sensor, and mapping the data through a calculation formula to obtain an output signal of the physical interaction device. Therefore, through the steps, the operation command input by the user is obtained at the android device terminal, and the output signal sent by the physical interaction device when the user uses the actual physical interaction device is simulated according to the operation command. The effect of simulating physical interaction equipment through the android equipment is achieved.
And S400, the android device controls to send the physical interaction device output signal to an opposite terminal device through a wireless function.
In this embodiment, the android device sends the output signal of the physical interaction device obtained by searching or mapping to the peer device in real time through a wireless function. The wireless functions comprise wireless technologies such as Bluetooth, WIFI and 2.4GHz receivers, and more fluent use experience is provided for users through real-time transmission. Through the steps, any physical interaction device can be simulated through the android device, and the applications with different operation requirements can be controlled, so that a user does not need to purchase various interaction devices through high cost, and the problem of low actual utilization rate of the interaction devices can be avoided.
Therefore, the operation command is obtained from the android device terminal, the operation command capable of reflecting the operation intention of the user is mapped through the preset operation command mapping table to obtain the output signal which is actually sent by the corresponding physical interaction device, and finally the output signal is sent to the opposite terminal device through the wireless function of the android device. The user can simulate physical interaction equipment with various functions and purposes through one android device. The user does not need to purchase corresponding operating equipment at high cost for using certain application, and meanwhile, the portable android equipment improves the use convenience of the user.
Specifically, in this embodiment, a mobile phone commonly used by a user is used as an android device, and a virtual interaction device application is preset, and when the android device and the application are other devices or applications, the specific scheme in this embodiment may be referred to.
In an application scene, the mobile phone acquires a virtual interaction device starting command, and calls and displays an interaction device type selection interface;
the method comprises the following steps of obtaining a virtual interactive device starting command, calling and displaying an interactive device type selection interface:
and starting a wireless function in advance and establishing wireless connection with opposite terminal equipment.
For example, when a user searches for a tv show through a tv, the user cannot input a specific name as conveniently and accurately as a keyboard because of limited keys of a remote controller. At the moment, the user starts the Bluetooth function in advance, establishes Bluetooth connection with the television and further clicks the application of the virtual interaction equipment. The mobile phone detects an operation command input by a user for starting the virtual interaction equipment application, loads and starts the virtual interaction equipment application, and displays an interaction equipment type selection interface. The interactive equipment type selection interface comprises a keyboard, a mouse, a game handle, a game steering wheel, a VR handle and other various interactive equipment.
In an application scene, the mobile phone acquires an interactive device type selection command, calls a preset interactive device operation interface and a corresponding operation command mapping table, and displays the interactive device operation interface;
the method comprises the following steps of obtaining a virtual interactive device starting command, calling and displaying an interactive device type selection interface, wherein the steps comprise:
pre-creating a plurality of types of interactive equipment operation interfaces, wherein the types comprise a keyboard, a game handle, a game steering wheel and a VR handle;
and pre-creating an operation command mapping table corresponding to each interactive equipment operation interface, wherein the operation command mapping table comprises operation commands which can be received in the interactive equipment operation interfaces and output signals of actual physical interactive equipment which are in one-to-one correspondence.
For example, a plurality of types of interactive device operation interfaces, that is, the above-mentioned interactive device operation interfaces of the keyboard, the mouse, the gamepad, the steering wheel, the VR handle, and the like, are stored in the virtual interactive device application in advance. For example, the operation interface of the keyboard contains keys which have the same or similar key layout as the keyboard equipment and can be clicked; the operation interface of the mouse comprises a blank area for sliding by a user, and the actual mouse movement, left key clicking double clicking and right key operation are simulated by acquiring the sliding, clicking, double clicking and long pressing commands input by the user; for example, the operation interface of the game steering wheel contains the image of the game steering wheel, and the operation command of the user for rotating the mobile phone is mainly obtained through the mobile phone gyroscope and the acceleration sensor.
Furthermore, an operation command mapping table corresponding to each interactive device operation interface is created in advance, and the operation command mapping table comprises operation commands which can be received in the device operation interfaces and output signals of actual physical interactive devices which are in one-to-one correspondence. For example, when the operating interface of the keyboard is opened, if a user presses a key w of the keyboard, the operating command mapping table of the keyboard records an output signal sent when the actual keyboard presses w; for example, when the operation interface of the game steering wheel is opened, when the user turns the mobile phone 45 ° to the left, the operation command mapping table of the game steering wheel records the output signal sent during the process of playing the game steering wheel 45 ° to the left in the actual game steering wheel, or records a certain mapping formula, so that the operation command input by the user in the mobile phone is consistent with or matched with the output signal of the actual physical interaction device. The physical interaction equipment with any different functions can be simulated by the mobile phone through the operation command mapping table preset in the step.
When a user opens an interactive equipment operation interface of the keyboard in the mobile phone, calling and displaying a preset operation interface of the keyboard, and starting an operation command mapping table of the keyboard; when a user opens an interactive device operation interface of the game steering wheel in the mobile phone, calling and displaying a preset operation interface of the game steering wheel, and starting an operation command mapping table of the game steering wheel. Through the steps, the operation interface of any simulation physical interaction equipment is started according to the use requirement of the user, various interaction equipment capable of being simulated are provided for the user, and the use by the user is facilitated.
In an application scenario, the mobile phone obtains an operation command through the interactive device operation interface, and searches a physical interactive device output signal corresponding to the operation command in the operation command mapping table;
specifically, as shown in fig. 2 and 3, the step S300 includes:
a301, when the interactive equipment operation interface is a key input device of a keyboard or a game handle, acquiring an operation command for clicking each key through the interactive equipment operation interface;
and A302, searching the actual physical interaction equipment output signal corresponding to each operation command in the corresponding operation command mapping table.
B301, when the interactive equipment operation interface is equipment with a motor, a gyroscope and an acceleration sensor, of a game steering wheel or a VR handle, acquiring a clicked operation command through the interactive equipment operation interface;
b302, acquiring an operation command of the hand gesture of the user through a gyroscope and an acceleration sensor;
b303, searching the output signal of the actual physical interaction device corresponding to each operation command in the corresponding operation command mapping table.
For example, when a user wishes to use a keyboard to input a specific drama name in a television at this time, the user selects an operation interface of the keyboard, and inputs, for example, four english letters abcd through keys on the operation interface of the keyboard, the mobile phone receives an operation command of clicking the abcd by the user, and controls to search for a corresponding output signal in an operation command mapping table of the keyboard, that is, an output signal of an actual keyboard when the four keys abcd are pressed, and controls to acquire the four data assuming that the four data are first data, second data, third data, and fourth data, respectively.
And when a user runs a racing game on a television and needs to use a game steering wheel, selecting an operation interface of the game steering wheel, and inputting operation commands of clicking acceleration and turning left a mobile phone by 45 degrees respectively through the operation interface of the game steering wheel, after receiving the operation commands through a mobile phone gyroscope and an acceleration sensor, the mobile phone controls to search corresponding output signals in an operation command mapping table of the game steering wheel, namely output signals of the actual game steering wheel when the actual game steering wheel is pressed for acceleration and the actual steering wheel is turned left by 45 degrees, and if the actual game steering wheel is respectively fifth data and sixth data, the two data are controlled to be acquired.
Therefore, the operation instruction which is input by the user and reflects the intention of the user is converted into the output instruction of the actual physical interaction equipment through the step. The effect of conveniently simulating various interactive devices through the mobile phone and providing convenience for users is achieved.
In an application scenario, the mobile phone controls to send the physical interaction device output signal to an opposite terminal device through a wireless function.
Specifically, as shown in fig. 4, the step S400 includes:
and S401, controlling to send the output signal of the physical interaction device to the opposite terminal device in real time through a wireless function.
For example, after the mobile phone acquires the first data, the second data, the third data and the fourth data, the four data are sent to the television in real time through a pre-established bluetooth connection, and then the television displays four abcd characters after receiving the data; and after the mobile phone acquires the fifth data and the sixth data, the data are also transmitted to the television in real time through Bluetooth connection, and the racing car game controls the racing car to execute commands of acceleration and left turning. Through the steps, the operation instruction input by the user is realized on the opposite terminal equipment in real time, and the operation experience without delay is brought to the user.
Further, after the step of controlling to send the physical interaction device output signal to the peer device through the wireless function, the method includes:
and acquiring a feedback signal returned by the opposite terminal equipment, and executing operation corresponding to the feedback signal, wherein the feedback signal comprises a vibration signal.
For example, when a user uses an actual game steering wheel to operate a racing car, when the racing car collides, a vibration signal is fed back to the steering wheel by a racing car game according to the degree of collision, and the game experience of the user is improved. Similarly, when a user uses the operation interface of the game steering wheel to simulate the game steering wheel to play a racing game, the vibration signal fed back by the television can be received through the Bluetooth connection when a racing car collides, and the corresponding vibration sense is generated through the mobile phone vibration sensor, so that the use experience of the user is improved.
The invention is further illustrated in detail by the following specific application examples:
in this specific application embodiment, the android device takes a mobile phone and a keyboard as examples, as shown in fig. 5, in this specific application embodiment, a method for displaying an android device simulation physical interaction device in a plug-in mode includes the following steps:
step S10, start, proceed to step S11;
step S11, creating an Activity window in advance, compiling a Keycode and Keyboard Report data mapping table according to the USB HID, and entering step S12;
step S12, starting an input method to call out a virtual soft keyboard, and entering step S13;
step S13, clicking the virtual soft keyboard to send the android KeyEvent, and entering step S14;
step S14, Activity receives KeyEvent event, and the process goes to step S15;
step S15, searching a Keyboard Report data mapping table, and entering step S16;
step S16, outputting Keyboard Report data by wireless, entering step S20;
and step S20, end.
It can be seen from the above that, an Activity window (active window) is created in advance, and a mapping table of KeyCode and Keyboard Report data is compiled in advance according to a USB HID, where the USB HID is an interactive device with a USB wired interface, and is referred to herein as a Keyboard of a USB interface, the KeyCode refers to a key value input through a virtual soft Keyboard of a mobile phone, and the Keyboard Report data is data output by pressing any letter in the Keyboard, and is used to map a key pressed by a user on the mobile phone into data actually output by pressing the corresponding letter by the Keyboard.
Further, a mobile phone input method is started to call a commonly used virtual soft Keyboard, such as a dog searching input method or a Baidu input method, an android key event is clicked through the virtual soft Keyboard to send an android keyevent, the active window searches for the corresponding output Keyboard Report data in the mapping table after receiving the key event, and controls the searched Keyboard Report data to be wirelessly output, so that Keyboard simulation can be achieved through the commonly used input method of the user, and the use of the user is facilitated.
Exemplary device
As shown in fig. 6, an embodiment of the present invention provides an apparatus for simulating a physical interaction device by an android device, where the apparatus includes: the virtual interactive device comprises a virtual interactive device starting module 610, an interactive device type selecting module 620, an operation command converting module 630 and a physical interactive device output signal sending module 640. Specifically, the virtual interaction device starting module 610 is configured to obtain a virtual interaction device starting command, call and display an interaction device type selection interface; the interactive device type selection module 620 is configured to obtain an interactive device type selection command, call a preset interactive device operation interface and a corresponding operation command mapping table, and display the interactive device operation interface; the operation command conversion module 630 is configured to obtain an operation command through the interactive device operation interface, and search for a physical interactive device output signal corresponding to the operation command in the operation command mapping table; and the physical interaction device output signal sending module 640 is configured to control sending of the physical interaction device output signal to an opposite terminal device through a wireless function.
Based on the above embodiments, the present invention further provides a terminal device, and a schematic block diagram thereof may be as shown in fig. 7. The terminal equipment comprises a processor, a memory, a network interface and a display screen which are connected through a system bus. Wherein the processor of the terminal device is configured to provide computing and control capabilities. The memory of the terminal equipment comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the terminal device is used for connecting and communicating with an external terminal through a network. The computer program is executed by a processor to implement an android device to simulate a physical interaction device. The display screen of the terminal equipment can be a liquid crystal display screen or an electronic ink display screen.
It will be understood by those skilled in the art that the block diagram in fig. 7 is only a block diagram of a part of the structure related to the solution of the present invention, and does not constitute a limitation to the terminal device to which the solution of the present invention is applied, and a specific terminal device may include more or less components than those in the figure, or combine some components, or have different component arrangements.
In one embodiment, a terminal device is provided, where the terminal device includes a memory, a processor, and an android device emulation physical interaction device program stored on and executable on the processor, and the processing performs the following steps:
acquiring a virtual interactive device starting command, and calling and displaying an interactive device type selection interface;
acquiring an interactive equipment type selection command, calling a preset interactive equipment operation interface and a corresponding operation command mapping table, and displaying the interactive equipment operation interface;
acquiring an operation command through the operation interface of the interaction equipment, and searching a physical interaction equipment output signal corresponding to the operation command in the operation command mapping table;
and controlling to send the output signal of the physical interaction device to opposite-end equipment through a wireless function.
The steps of obtaining a virtual interactive device starting command, calling and displaying an interactive device type selection interface comprise:
pre-creating a plurality of types of interactive equipment operation interfaces, wherein the types comprise a keyboard, a game handle, a game steering wheel and a VR handle;
and pre-creating an operation command mapping table corresponding to each interactive equipment operation interface, wherein the operation command mapping table comprises operation commands which can be received in the interactive equipment operation interfaces and output signals of actual physical interactive equipment which are in one-to-one correspondence.
The step of obtaining a virtual interactive device start command, calling and displaying an interactive device type selection interface further comprises:
and starting a wireless function in advance and establishing wireless connection with opposite terminal equipment.
The step of obtaining an operation command through the interactive device operation interface and searching the physical interactive device output signal corresponding to the operation command in the operation command mapping table includes:
when the interactive equipment operation interface is a key input device of a keyboard or a game handle, acquiring an operation command for clicking each key through the interactive equipment operation interface;
and searching the actual physical interaction equipment output signal corresponding to each operation command in the corresponding operation command mapping table.
The step of obtaining an operation command through the interactive device operation interface and searching the physical interactive device output signal corresponding to the operation command in the operation command mapping table further includes:
when the interactive equipment operation interface is equipment with a motor, a gyroscope and an acceleration sensor, which is a game steering wheel or a VR handle, a clicked operation command is obtained through the interactive equipment operation interface;
acquiring an operation command of the hand gesture of the user through a gyroscope and an acceleration sensor;
and searching the output signal of the actual physical interaction device corresponding to each operation command in the corresponding operation command mapping table.
Wherein the step of controlling the physical interaction device output signal to be sent to the opposite terminal device through the wireless function comprises:
and controlling to send the output signal of the physical interaction equipment to opposite-end equipment in real time through a wireless function.
Wherein, after the step of controlling the physical interaction device output signal to be sent to the peer device through the wireless function, the method comprises:
and acquiring a feedback signal returned by the opposite terminal equipment, and executing operation corresponding to the feedback signal, wherein the feedback signal comprises a vibration signal.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by instructing the relevant hardware through a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, databases, or other media used in embodiments provided herein may include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
In summary, the present invention discloses a method, an apparatus, an android device and a medium for an android device to simulate a physical interaction device, where the method includes: acquiring a virtual interactive device starting command, and calling and displaying an interactive device type selection interface; acquiring an interactive equipment type selection command, calling a preset interactive equipment operation interface and a corresponding operation command mapping table, and displaying the interactive equipment operation interface; acquiring an operation command through the operation interface of the interaction equipment, and searching a physical interaction equipment output signal corresponding to the operation command in the operation command mapping table; and controlling to send the output signal of the physical interaction device to opposite-end equipment through a wireless function. The method aims to solve the problems that a user needs to purchase various interactive devices for using special applications, the cost is high, and the storage is difficult. The user can simulate various interactive devices through the android device and realize corresponding operation, and convenience is brought to the user.
Finally, it should be noted that: the above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (10)

1. A method for simulating a physical interaction device by an android device is characterized by comprising the following steps:
acquiring a virtual interactive device starting command, and calling and displaying an interactive device type selection interface;
acquiring an interactive equipment type selection command, calling a preset interactive equipment operation interface and a corresponding operation command mapping table, and displaying the interactive equipment operation interface;
acquiring an operation command through the operation interface of the interaction equipment, and searching a physical interaction equipment output signal corresponding to the operation command in the operation command mapping table;
and controlling to send the output signal of the physical interaction device to opposite-end equipment through a wireless function.
2. The android device physical interaction device simulation method of claim 1, wherein the step of obtaining a virtual interaction device start command, invoking and displaying an interaction device type selection interface comprises:
pre-creating a plurality of types of interactive equipment operation interfaces, wherein the types comprise a keyboard, a game handle, a game steering wheel and a VR handle;
and pre-creating an operation command mapping table corresponding to each interactive equipment operation interface, wherein the operation command mapping table comprises operation commands which can be received in the interactive equipment operation interfaces and output signals of actual physical interactive equipment which are in one-to-one correspondence.
3. The method for simulating physical interaction devices by using android devices as claimed in claim 1, wherein the step of obtaining the virtual interaction device start command, invoking and displaying the interaction device type selection interface further comprises:
and starting a wireless function in advance and establishing wireless connection with opposite terminal equipment.
4. The method for simulating physical interaction equipment by using android equipment as claimed in claim 2, wherein the step of obtaining an operation command through the operation interface of the interaction equipment, and the step of searching for the physical interaction equipment output signal corresponding to the operation command in the operation command mapping table comprises:
when the interactive equipment operation interface is a key input device of a keyboard or a game handle, acquiring an operation command for clicking each key through the interactive equipment operation interface;
and searching the actual physical interaction equipment output signal corresponding to each operation command in the corresponding operation command mapping table.
5. The method for simulating physical interaction equipment by using android equipment as claimed in claim 2, wherein the step of obtaining an operation command through the operation interface of the interaction equipment and searching for the physical interaction equipment output signal corresponding to the operation command in the operation command mapping table further comprises:
when the interactive equipment operation interface is equipment with a motor, a gyroscope and an acceleration sensor, which is a game steering wheel or a VR handle, a clicked operation command is obtained through the interactive equipment operation interface;
acquiring an operation command of the hand gesture of the user through a gyroscope and an acceleration sensor;
and searching the output signal of the actual physical interaction device corresponding to each operation command in the corresponding operation command mapping table.
6. The method for android device to simulate physical interaction devices as claimed in claim 1, wherein the step of controlling the sending of the physical interaction device output signal to peer devices via wireless functionality comprises:
and controlling to send the output signal of the physical interaction equipment to opposite-end equipment in real time through a wireless function.
7. The method for android device to emulate a physical interaction device of claim 1, wherein the step of controlling the sending of the physical interaction device output signal to the peer device via a wireless function is followed by:
and acquiring a feedback signal returned by the opposite terminal equipment, and executing operation corresponding to the feedback signal, wherein the feedback signal comprises a vibration signal.
8. An apparatus for simulating physical interaction equipment by an android device, the apparatus comprising:
the virtual interactive equipment starting module is used for acquiring a virtual interactive equipment starting command, calling and displaying an interactive equipment type selection interface;
the interactive equipment type selection module is used for acquiring an interactive equipment type selection command, calling a preset interactive equipment operation interface and a corresponding operation command mapping table, and displaying the interactive equipment operation interface;
the operation command conversion module is used for acquiring an operation command through the interactive equipment operation interface and searching a physical interactive equipment output signal corresponding to the operation command in the operation command mapping table;
and the physical interaction equipment output signal sending module is used for controlling the physical interaction equipment output signal to be sent to opposite-end equipment through a wireless function.
9. An android device, comprising a memory, a processor and an android device simulation physical interaction device program stored in the memory and executable on the processor, wherein the processor implements the steps of the android device simulation physical interaction device method according to any one of claims 1 to 7 when executing the android device simulation physical interaction device program.
10. A computer readable storage medium having stored thereon an android device simulated physical interaction device program which, when executed by a processor, performs the steps of the android device simulated physical interaction device method of any of claims 1-7.
CN202111485644.0A 2021-12-07 2021-12-07 Android device physical interaction simulation method and device, android device and medium Pending CN114167987A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202111485644.0A CN114167987A (en) 2021-12-07 2021-12-07 Android device physical interaction simulation method and device, android device and medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202111485644.0A CN114167987A (en) 2021-12-07 2021-12-07 Android device physical interaction simulation method and device, android device and medium

Publications (1)

Publication Number Publication Date
CN114167987A true CN114167987A (en) 2022-03-11

Family

ID=80483890

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202111485644.0A Pending CN114167987A (en) 2021-12-07 2021-12-07 Android device physical interaction simulation method and device, android device and medium

Country Status (1)

Country Link
CN (1) CN114167987A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102755744A (en) * 2012-06-25 2012-10-31 惠州Tcl移动通信有限公司 Method, system and mobile terminal for game control
CN103079019A (en) * 2012-12-21 2013-05-01 康佳集团股份有限公司 Control method and system for controlling intelligent terminal through mobile equipment
CN103480151A (en) * 2013-09-04 2014-01-01 张家港保税区润桐电子技术研发有限公司 Method and system of simulating car race game steering wheel by using smartphone
CN103607618A (en) * 2013-11-21 2014-02-26 乐视致新电子科技(天津)有限公司 Game control method and game control device in intelligent television
US20150182856A1 (en) * 2013-12-31 2015-07-02 Microsoft Corporation Touch screen game controller
CN105771236A (en) * 2016-02-17 2016-07-20 成都市极米科技有限公司 Information interaction method and device
CN111420390A (en) * 2020-03-11 2020-07-17 广州微算互联信息技术有限公司 Method, device and system for realizing control of PC game by mobile equipment
CN112827163A (en) * 2021-03-17 2021-05-25 四川酷赛科技有限公司 Game handle simulation method and mobile device

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102755744A (en) * 2012-06-25 2012-10-31 惠州Tcl移动通信有限公司 Method, system and mobile terminal for game control
CN103079019A (en) * 2012-12-21 2013-05-01 康佳集团股份有限公司 Control method and system for controlling intelligent terminal through mobile equipment
CN103480151A (en) * 2013-09-04 2014-01-01 张家港保税区润桐电子技术研发有限公司 Method and system of simulating car race game steering wheel by using smartphone
CN103607618A (en) * 2013-11-21 2014-02-26 乐视致新电子科技(天津)有限公司 Game control method and game control device in intelligent television
US20150182856A1 (en) * 2013-12-31 2015-07-02 Microsoft Corporation Touch screen game controller
CN105771236A (en) * 2016-02-17 2016-07-20 成都市极米科技有限公司 Information interaction method and device
CN111420390A (en) * 2020-03-11 2020-07-17 广州微算互联信息技术有限公司 Method, device and system for realizing control of PC game by mobile equipment
CN112827163A (en) * 2021-03-17 2021-05-25 四川酷赛科技有限公司 Game handle simulation method and mobile device

Similar Documents

Publication Publication Date Title
US6213880B1 (en) Game pad apparatus and method for navigation on a digital video disk (DVD) system
US20180104574A1 (en) Universal game controller
US20140011584A1 (en) Mobile terminal-based virtual game controller and remote control system using the same
US20140121022A1 (en) Method and system for video gaming using touchscreen input adaptation
US20120075529A1 (en) Techniques for displaying data on a secondary device while displaying content on a television
WO2022247540A1 (en) Device control method and apparatus, and computer device and storage medium
WO2022228465A1 (en) Interface display method and apparatus, electronic device, and storage medium
US11061560B2 (en) Non-volatile recording medium, information processing method, and electronic apparatus
WO2020063214A1 (en) Virtual input device-based method and system for remotely controlling pc
JPH04238529A (en) Device and method of controlling picture in computer-system
CN114281288A (en) Screen projection processing method and device and electronic equipment
US20150138085A1 (en) Electronic apparatus for simulating or interfacing a backward compatible human input device by means or control of a gesture recognition system
CN111531551A (en) Safety demonstrator using universal tablet computer and demonstration method
CN112827163B (en) Game paddle simulation method and mobile device
CN104639865A (en) Video conference motion control method, terminal and system
CN114167987A (en) Android device physical interaction simulation method and device, android device and medium
JPH03217895A (en) Methods of controlling cursor and scrolling display
CN109395377B (en) Non-inductive virtual control method and device
CN113797527B (en) Game processing method, device, equipment, medium and program product
CN108153427B (en) Keyboard layout method and system and vehicle machine
JP3228584B2 (en) Mouse input method on touch panel
US10761606B1 (en) Terminal device, program, method, and system
US20130002558A1 (en) Input method and input device
CN108897457B (en) Touch device assembly and touch system
CN113877197A (en) Game mapping control method, device, equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination