WO2021227525A1 - Handle button mapping method and electronic device - Google Patents

Abstract

The present application provides a handle button mapping method and an electronic device. Said method comprises: an electronic device displaying a first interface by means of a display screen, the first interface comprising a first interface element; the electronic device determining a first function and a first position corresponding to the first interface element, the first position being the position of the first interface element on the first interface; the electronic device associating a first handle button with the first position; and in response to the acquisition of first information sent by the handle, the electronic device executing, at the first position, a response operation for the first function, the first information being used to indicate that the handle detects that a user presses the first handle button. The embodiments of the present application help to reduce the operation complexity of a user, improve the degree of intelligence of an electronic device, and improve the user experience.

Description

Method for mapping handle buttons and electronic equipment

This application claims the priority of a Russian patent application filed with the Russian Federal Patent Office, the application number is RU2020115614, and the application name is "a method and electronic device for mapping handle buttons" on May 11, 2020, the entire content of which is incorporated by reference In this application.

Technical field

The present application relates to the field of terminals, and more specifically, to a method and electronic device for key mapping of a handle.

Background technique

Mobile games refer to game software running on mobile phones, referred to as "mobile games". With the continuous enhancement of mobile phone hardware capabilities and the rapid development of network communication technology, real-time playing of large-scale mobile games through the Internet has become a part of consumers' daily lives, and online game platforms have also become a brand-new social media.

While the content and operation methods of mobile games are getting closer to those of personal computer (PC) games, the virtual key operation experience of mobile games has a large gap with the experience of keyboard, mouse or handle operation. Holding a screen and using virtual keys for a long time in the game lacks comfort, which can no longer meet the needs of players. The handle is an auxiliary peripheral that effectively enhances the player's manipulation experience.

Currently, the user needs to manually complete the mapping between the handle buttons and the game buttons, which may cause problems such as complicated operations and lead to a bad user experience.

Summary of the invention

The present application provides a method and electronic device for mapping handle buttons, which helps to reduce the complexity of the user's operation, improve the degree of intelligence of the electronic device, and enhance the user experience.

In the first aspect, the present technical solution provides a method for mapping handle buttons. The method is applied to an electronic device with a display screen. The electronic device and the handle are connected in a wired or wireless manner. The handle includes one or more handle buttons. , The method includes: the electronic device displays a first interface through the display screen, the first interface includes a first interface element; the electronic device determines a first function and a first position corresponding to the first interface element, the first The position is the position of the first interface element on the first interface; the electronic device associates the first handle button with the first position, and the one or more handle buttons include the first handle button; in response to obtaining The first information sent by the handle, the electronic device performs a response operation to the first function at the first position, and the first information is used to indicate that the handle detects that the user presses the first handle button.

In the embodiments of the present application, the electronic device can accurately complete the mapping of the corresponding positions of the handle buttons and the game buttons by determining the functions and positions of the interface elements. This helps to avoid the user's cumbersome operations, enhance the intelligence of the electronic device, and thereby enhance the user's gaming experience.

With reference to the first aspect, in some implementations of the first aspect, the electronic device stores a first mapping relationship between the first function and the feature point set corresponding to the first function, and the first interface element corresponding to the first interface element is determined The first function includes: extracting the feature points of the first interface element; determining the first interface element when the matching degree between the feature points of the first interface element and the feature point set corresponding to the first function is greater than or equal to a preset value The interface elements correspond to the first function.

In the embodiment of the present application, the electronic device may pre-store the mapping relationship between the first function and the feature point set corresponding to the first function, and the electronic device may match the feature point of the interface element with the feature point set. When the matching degree is greater than or equal to the preset value, the electronic device may determine that the first interface element corresponds to the first function, and thereby associate the first handle button with the first position. Such a mapping relationship can ensure that the electronic device accurately recognizes the functions corresponding to the interface elements, thereby realizing the mapping between the handle buttons and the game buttons. This helps to avoid the user's cumbersome operations, enhance the intelligence of the electronic device, and thereby enhance the user's gaming experience.

In some possible implementations, the electronic device includes multiple interface elements, the electronic device can determine multiple functions corresponding to the multiple interface elements, and the electronic device can randomly associate multiple handle buttons with the multiple functions. Associated with the location.

With reference to the first aspect, in some implementations of the first aspect, the method further includes: in response to the user's operation of moving the first interface element from the first position to the second position on the first interface, automatically The first handle button is associated with the second position; in response to acquiring the first information, a response operation to the first function is performed at the second position.

In the embodiments of this application, when the electronic device detects that the position of the interface element has changed, the electronic device can automatically update the association relationship between the handle button and the position of the interface element, thereby ensuring that the mobile phone can automatically perform a response operation after the user clicks the handle button . It avoids the user from manually adjusting the association relationship between the handle button and the location of the game function, improves the intelligence of the electronic device, and helps to improve the user's game experience.

With reference to the first aspect, in some implementations of the first aspect, a second mapping relationship between the first handle button and the first function is stored in the electronic device; the first handle button is associated with the first position , Including: associating the first handle button with the first position according to the second mapping relationship.

In the embodiment of the present application, the mobile phone can save the mapping relationship between the handle buttons and the game buttons that the user is accustomed to in advance. For example, taking mainstream controllers such as Xbox and PS4 as an example, after a large number of users' actual experience, it can be concluded that the X button in the PS4 game controller is the most easily controlled button. For FPS games, the game function "shooting" is the most commonly used game button by users, so the phone can save the mapping relationship between the X button and the game function "shooting". In this way, the user can avoid the cumbersome operation of repeatedly adjusting the mapping relationship between the handle buttons and the game buttons, which improves the degree of intelligence of the electronic device, thereby helping to improve the user experience.

With reference to the first aspect, in some implementations of the first aspect, the method further includes: in response to the user's operation of associating the second handle button with the first position, automatically updating the second mapping relationship to the first position The mapping relationship between the two handle buttons and the first function, and the one or more handle buttons include the second handle button.

In the embodiment of this application, when the mobile phone detects that the user has updated the mapping relationship between the handle buttons and the game buttons saved last time, the mobile phone can save the handle buttons and the game buttons adjusted by the user, which is convenient for the user to experience the game next time At this time, the electronic device directly associates the handle buttons with the positions of the interface elements according to the adjusted mapping relationship. This helps to avoid the user's cumbersome operation of repeatedly adjusting the mapping relationship between the handle buttons and the game buttons, and improves the degree of intelligence of the electronic device, thereby helping to improve the user experience.

In a second aspect, the present technical solution provides a device for mapping handle buttons, which is included in an electronic device, and the device has the function of realizing the behavior of the electronic device in the foregoing first aspect and the possible implementation of the foregoing first aspect. The function can be realized by hardware, or the corresponding software can be executed by hardware. The hardware or software includes one or more modules or units corresponding to the above-mentioned functions.

In a third aspect, the technical solution provides an electronic device, including: a display screen; one or more processors; a memory; one or more application programs; and one or more computer programs. Among them, one or more computer programs are stored in the memory, and the one or more computer programs include instructions. When the instruction is executed by the electronic device, the electronic device is caused to execute the handle button mapping method in any possible implementation of the first aspect described above.

In a fourth aspect, the present technical solution provides a computer storage medium, including computer instructions, which when the computer instructions run on an electronic device, cause the electronic device to execute the handle button mapping method in any one of the possible implementations of the first aspect above .

In a fifth aspect, the present technical solution provides a computer program product that, when the computer program product runs on an electronic device, causes the electronic device to execute the method for mapping the handle buttons in any one of the possible implementations of the first aspect described above.

Description of the drawings

Fig. 1 is a schematic structural diagram of an electronic device provided by an embodiment of the present application.

Figure 2 is a set of GUIs provided by an embodiment of the present application.

Figure 3 is another set of GUIs provided by an embodiment of the present application.

Figure 4 is another set of GUIs provided by an embodiment of the present application.

Figure 5 is another set of GUIs provided by an embodiment of the present application.

Fig. 6 is another set of GUIs provided by an embodiment of the present application.

Fig. 7 is a schematic diagram of the acquisition and learning stage provided by an embodiment of the present application.

FIG. 8 is a schematic flowchart of a method for mapping keys on a handle provided in an embodiment of the present application.

Detailed ways

The terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to limit the application. As used in the specification and appended claims of this application, the singular expressions "a", "an", "said", "above", "the" and "this" are intended to also This includes expressions such as "one or more" unless the context clearly indicates to the contrary. It should also be understood that in the following embodiments of the present application, "at least one" and "one or more" refer to one, two, or more than two. The term "and/or" is used to describe the association relationship of associated objects, indicating that there can be three types of relationships; for example, A and/or B can mean: A alone exists, A and B exist at the same time, and B exists alone. Among them, A and B can be singular or plural. The character "/" generally indicates that the associated objects before and after are in an "or" relationship.

References described in this specification to "one embodiment" or "some embodiments", etc. mean that one or more embodiments of the present application include a specific feature, structure, or characteristic described in combination with the embodiment. Therefore, the sentences "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. appearing in different places in this specification are not necessarily All refer to the same embodiment, but mean "one or more but not all embodiments" unless it is specifically emphasized otherwise. The terms "including", "including", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized.

The following introduces the electronic device provided by the embodiments of the present application, the user interface for such electronic device, and the embodiment for using such electronic device. In some embodiments, the electronic device may also include other functions such as portable electronic devices, such as mobile phones, tablet computers, wearable electronic devices with wireless communication functions (such as smart watches), and so on. Exemplary embodiments of portable electronic devices include, but are not limited to, carrying

Or portable electronic devices with other operating systems. The aforementioned portable electronic device may also be other portable electronic devices, such as a laptop computer (Laptop) and the like. It should also be understood that, in some other embodiments, the above-mentioned electronic device may not be a portable electronic device, but a desktop computer.

Exemplarily, FIG. 1 shows a schematic structural diagram of an electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, and an antenna 2. , Mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, buttons 190, motor 191, indicator 192, camera 193, display screen 194, and Subscriber identification module (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light Sensor 180L, bone conduction sensor 180M, etc.

It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or arrange different components. The illustrated components can be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal processor. (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural-network processing unit (NPU) Wait. Among them, the different processing units may be independent devices or integrated in one or more processors.

The controller may be the nerve center and command center of the electronic device 100. The controller can generate operation control signals according to the instruction operation code and timing signals to complete the control of fetching instructions and executing instructions.

A memory may also be provided in the processor 110 to store instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory can store instructions or data that have just been used or recycled by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. Repeated accesses are avoided, the waiting time of the processor 110 is reduced, and the efficiency of the system is improved.

In some embodiments, the processor 110 may include one or more interfaces. The interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and a universal asynchronous transmitter/receiver (universal asynchronous) interface. receiver/transmitter, UART) interface, mobile industry processor interface (MIPI), general-purpose input/output (GPIO) interface, subscriber identity module (SIM) interface, and / Or Universal Serial Bus (USB) interface, etc.

The I2S interface can be used for audio communication. In some embodiments, the processor 110 may include multiple sets of I2S buses.

The PCM interface can also be used for audio communication to sample, quantize and encode analog signals. In some embodiments, the audio module 170 and the wireless communication module 160 may be coupled through a PCM bus interface.

The UART interface is a universal serial data bus used for asynchronous communication. The bus can be a two-way communication bus. It converts the data to be transmitted between serial communication and parallel communication.

The MIPI interface can be used to connect the processor 110 with the display screen 194, the camera 193 and other peripheral devices.

The GPIO interface can be configured through software. The GPIO interface can be configured as a control signal or as a data signal.

The USB interface 130 is an interface that complies with the USB standard specification, and specifically may be a Mini USB interface, a Micro USB interface, a USB Type C interface, and so on.

It can be understood that the interface connection relationship between the modules illustrated in the embodiment of the present application is merely a schematic description, and does not constitute a structural limitation of the electronic device 100. In other embodiments of the present application, the electronic device 100 may also adopt different interface connection modes in the foregoing embodiments, or a combination of multiple interface connection modes.

The charging management module 140 is used to receive charging input from the charger.

The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110.

The wireless communication function of the electronic device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.

The antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals.

The mobile communication module 150 can provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the electronic device 100.

The modem processor may include a modulator and a demodulator. Among them, the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal.

The wireless communication module 160 can provide applications on the electronic device 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), and global navigation satellites. System (global navigation satellite system, GNSS), frequency modulation (FM), near field communication (NFC), infrared technology (infrared, IR) and other wireless communication solutions.

In some embodiments, the antenna 1 of the electronic device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the electronic device 100 can communicate with the network and other devices through wireless communication technology.

The electronic device 100 implements a display function through a GPU, a display screen 194, an application processor, and the like. The GPU is an image processing microprocessor, which is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations and is used for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

The display screen 194 is used to display images, videos, and the like. The display screen 194 includes a display panel. The display panel can use liquid crystal display (LCD), organic light-emitting diode (OLED), active matrix organic light-emitting diode or active-matrix organic light-emitting diode (active-matrix organic light-emitting diode). AMOLED, flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include one or N display screens 194, and N is a positive integer greater than one.

The electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

The ISP is used to process the data fed back from the camera 193. The camera 193 is used to capture still images or videos. The digital signal processor is used to process digital signals. In addition to digital image signals, it can also process other digital signals. Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 can play or record videos in multiple encoding formats, such as: moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.

NPU is a neural-network (NN) computing processor. By drawing on the structure of biological neural networks, for example, the transfer mode between human brain neurons, it can quickly process input information, and it can also continuously self-learn. Through the NPU, applications such as intelligent cognition of the electronic device 100 can be realized, such as image recognition, face recognition, voice recognition, text understanding, and so on.

In the embodiment of the present application, the electronic device can use the NPU to identify the function corresponding to the interface element on the interface displayed on the display screen.

The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example, save music, video and other files in an external memory card.

The internal memory 121 may be used to store computer executable program code, where the executable program code includes instructions. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121. The internal memory 121 may include a storage program area and a storage data area. Among them, the storage program area can store an operating system, an application program (such as a sound playback function, an image playback function, etc.) required by at least one function, and the like. The data storage area can store data (such as audio data, phone book, etc.) created during the use of the electronic device 100. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, a universal flash storage (UFS), and the like.

The electronic device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. For example, music playback, recording, etc.

The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal.

The gyro sensor 180B may be used to determine the movement posture of the electronic device 100.

The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude based on the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

The magnetic sensor 180D includes a Hall sensor.

The acceleration sensor 180E can detect the magnitude of the acceleration of the electronic device 100 in various directions (generally three axes).

Distance sensor 180F, used to measure distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 may use the distance sensor 180F to measure the distance to achieve fast focusing.

The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector such as a photodiode.

The ambient light sensor 180L is used to sense the brightness of the ambient light.

The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photographs, fingerprint answering calls, and so on.

The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy.

Touch sensor 180K, also called "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch screen is composed of the touch sensor 180K and the display screen 194, which is also called a “touch screen”. The touch sensor 180K is used to detect touch operations applied on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. The visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100, which is different from the position of the display screen 194.

The bone conduction sensor 180M can acquire vibration signals.

The button 190 includes a power-on button, a volume button, and so on. The button 190 may be a mechanical button. It can also be a touch button. The electronic device 100 may receive key input, and generate key signal input related to user settings and function control of the electronic device 100.

The motor 191 can generate vibration prompts. The motor 191 can be used for incoming call vibration notification, and can also be used for touch vibration feedback.

The indicator 192 may be an indicator light, which may be used to indicate the charging status, power change, or to indicate messages, missed calls, notifications, and so on.

Fig. 2 is a set of graphical user interfaces (GUI) provided by an embodiment of the present application.

Refer to the GUI shown in (a) in Figure 2, which is a Bluetooth setting interface. The setting interface can display the device name "Huawei P40" and the paired device. The paired device can be a Bluetooth device that the phone has previously connected to. When the mobile phone detects the user's operation of turning on the Bluetooth function 201, the mobile phone can search for surrounding Bluetooth devices. The mobile phone can display the searched Bluetooth devices in the "Available Devices" list.

Refer to the GUI shown in (b) in Figure 2, which is a Bluetooth setting interface. The Bluetooth devices searched by the mobile phone can be displayed among the available devices in the setting interface, including "gamepad" 202. When the mobile phone detects that the user clicks the "game controller" 202, the mobile phone can establish a Bluetooth connection with the game controller.

It should be understood that the above is only to establish a connection between the mobile phone and the handle via Bluetooth, or the mobile phone and the handle establish a connection via Wi-Fi or other near field communication methods; or the mobile phone and the handle can also be connected via a wired method. establish connection.

The game controller as shown in the figure includes a plurality of handle buttons, and the plurality of handle buttons include direction keys 203, Y keys 204, X keys 205, A keys 206, B keys 207, LB keys 208, and RB keys 209. It should be understood that the game controller buttons in the embodiments of the present application are merely illustrative, and the controller buttons on the game controller may also include more or fewer buttons than those on the game controller shown in the figure, which is not limited in the embodiments of the present application.

Refer to the GUI shown in (c) in FIG. 2, which is a battle interface of the game application. When the mobile phone detects that the user launches the battle interface of a certain game application, the button setting reminder box 216 may automatically pop up on the battle interface. The button setting reminder box 216 includes icon information of the gamepad buttons. When the mobile phone detects that the user has clicked the automatic mapping key position, it can display the GUI as shown in (d) in FIG. 2.

Refer to the GUI shown in (d) in FIG. 2, which is another battle interface of the game application. When the mobile phone detects that the user clicks the operation of the automatic mapping key, the mobile phone can determine the game function corresponding to the interface element according to the interface element on the battle interface, so as to determine that a certain handle button corresponds to the game function corresponding to the interface element. The mobile phone can determine the location information of the interface element on the battle interface. Finally, the mobile phone can establish the mapping relationship between the handle buttons and the position information, thereby completing the mapping of the game buttons and the game buttons.

As shown in Figure 2 (d), the mobile phone can automatically move the icon of the LB button to the interface element 210 on the battle interface (the corresponding game function is "open aiming"); the mobile phone can automatically move the icon of the arrow keys Go to interface element 211 (the corresponding game function is "move up, down, left and right"); the mobile phone can automatically move the icon of the A key to the interface element 212 (the corresponding game function is "jump"); the mobile phone can automatically move the Y key The icon is moved to the interface element 213 (the corresponding game function is "change ammo"); the mobile phone can automatically move the icon of the X key to the interface element 214 (the corresponding game function is "shooting"). Thus, the mobile phone automatically completes the mapping between the handle buttons and the game buttons.

It should be understood that the interface elements described in the above embodiments may refer to the image information corresponding to the game functions of the game interface. When the mobile phone determines the mapping relationship between the handle buttons and the game functions, it may first analyze the feature points of each interface element, and then use the feature points. To determine the game function corresponding to the interface element.

It should also be understood that when the aforementioned mobile phone moves the icon of each handle button to the interface element on the battle interface, the corresponding relationship between each handle button and the game function can be preset in the mobile phone in advance. Exemplarily, Table 1 shows the corresponding relationship between the handle buttons and the game functions corresponding to the game buttons saved in the mobile phone.

Table 1

Handle button	Game features
LB key	Open aiming
RB key	Switch weapon
X key	shooting
Y key	Change ammunition
A key	jump
B key	Creeping
…	…

In an embodiment, the mobile phone may not preset the corresponding relationship between the handle buttons and the game functions shown in Table 1 above. For example, after the mobile phone determines the game function corresponding to each interface element on the battle interface, it can randomly correspond the handle buttons to the game function corresponding to each interface element. If the user uses the corresponding relationship between the handle buttons and the game functions randomly mapped by the mobile phone to experience the game, the mobile phone can generate the mapping relationship between the handle buttons and the game functions. The next time the mobile phone detects that the game is opened again, it can follow the previous mapping The relationship is mapped; or the mobile phone may not generate the mapping relationship between the handle buttons and the game functions. The next time the mobile phone detects that the game is opened again, it continues to randomly correspond the handle buttons to the game functions corresponding to each interface element. Further, for some special handle buttons (for example, the arrow keys 203), the mobile phone can save the correspondence between the arrow keys on the handle and the up, down, left, and right movement on the battle interface in advance; and for the X, Y, A, or B keys The keys, etc. may not save their corresponding relationships with specific game functions.

Exemplarily, Table 2 shows the location information of each interface element and each interface element on the battle interface.

Table 2

Interface elements	location information
Interface Elements 210	Position 1
Interface Elements 211	Position 2
Interface elements 212	Position 3
Interface elements 213	Position 4
Interface Elements 214	Position 5
…	…

In the embodiment of this application, when the mobile phone determines the game function corresponding to a certain handle button, it can first extract the feature points of each interface element on the battle interface, and then according to the extracted feature points of each interface element and each game function saved by the mobile phone The corresponding feature point set is matched.

Exemplarily, after the mobile phone extracts the interface element 214, it may first determine the feature points of the interface element 214. If the matching degree between the feature points of the interface element 214 and the image feature point set corresponding to the game function "shooting" saved by the mobile phone is greater than or equal to the preset value, the mobile phone can determine that the game function corresponding to the interface element 214 is "shooting". Thus, the mobile phone establishes a mapping relationship between the X key and the position 5 corresponding to the interface element 214.

In an embodiment, the position corresponding to the interface element may be the absolute coordinate position of the interface element on the display screen under the current mobile phone size.

When the mobile phone detects that the user clicks on the application and saves the operation, it can display the GUI as shown in (e) in FIG. 2.

Referring to the GUI shown in (e) in Figure 2, when the mobile phone detects that the user clicks on the application and saves the operation, the mapping of the handle buttons and the game buttons can be completed. After completing the mapping between the handle buttons and the game buttons, the icons of the corresponding handle buttons can be reduced without blocking the game buttons. This ensures that the user can view the corresponding game buttons during the game experience, and also see the handle buttons and Correspondence of game buttons.

When the game handle detects the user's operation of clicking a certain handle button, the game handle can send the corresponding operation information to the mobile phone. The mobile phone can generate a response at the position corresponding to the corresponding interface element according to the operation information. So as to realize the game experience using the game handle.

In the embodiment of the present application, the electronic device can accurately complete the mapping of the handle buttons and the game buttons through the mapping between the handle buttons and the specific game functions, and the mapping relationship between the game functions and the location information of the interface elements where the game functions are located. This helps to avoid the user's cumbersome operations, enhance the intelligence of the electronic device, and thereby enhance the user's gaming experience.

Figure 3 is another set of GUIs provided by an embodiment of the present application.

Refer to the GUI shown in (a) in FIG. 3, which is an adjustment interface of the game buttons. When the mobile phone detects that the user adjusts the position of the interface element corresponding to the game button, the mobile phone can adjust the interface element 212 to a new position (for example, position 6) according to the sliding direction of the user's finger.

Refer to the GUI shown in (b) in FIG. 3, which is a display interface after adjusting the game buttons. The interface element 212 is adjusted to position 6 by the user. At this time, after determining that the interface element is adjusted to position 6, the mobile phone can update the mapping relationship between the A key in the handle button and the updated position information of the interface element 212.

Exemplarily, the mobile phone may first update the interface elements shown in Table 2 and the location information corresponding to the interface elements. The updated interface elements and the corresponding location information of the interface elements are shown in Table 3.

table 3

Interface elements	location information
Interface Elements 210	Position 1
Interface Elements 211	Position 2
Interface elements 212	Position 6
Interface elements 213	Position 4
Interface Elements 214	Position 5
…	…

Therefore, the mobile phone can update the mapping relationship between the A key and the position 3 to the mapping relationship between the A key and the position 6.

In the embodiment of the present application, when the electronic device detects that the user updates the position of a certain game button, the electronic device can automatically update the mapping relationship between the handle button and the position information of the interface element corresponding to the game button, thereby avoiding manual adjustment by the user. The user's cumbersome operation is avoided, the intelligence of the electronic device is improved, and the user's gaming experience is improved.

Figure 4 is another set of GUIs provided by an embodiment of the present application.

Refer to the GUI shown in (a) in FIG. 4, which is a battle interface of a game application. When the user wants to adjust the mapping relationship between a certain handle button and the game button while playing the game, the user can call up the button setting reminder box. When the mobile phone detects that the user has clicked the clear key position, it can display the GUI shown in Figure 4 (b).

Refer to the GUI shown in (b) in Figure 4, which is an interface for manually setting key mapping. The user can move the icon of the handle button to the interface element corresponding to the game button according to their own wishes. As shown in Figure 4 (b), when the mobile phone detects that the user has moved the RB key to the interface element 210 and the user's movement operation is not detected within the preset time, the mobile phone can complete the position where the RB key and the interface element 210 are located. Mapping. Similarly, the user can manually complete the mapping of the location of the arrow keys, LB key, A key, and B key and the corresponding interface elements.

In one embodiment, when the mobile phone detects that the user has manually adjusted the mapping relationship between the handle buttons and the game buttons, the mobile phone may also update the mapping relationship between the handle buttons and the game functions shown in Table 1. Exemplarily, Table 4 shows the mapping relationship between the handle buttons and the game functions after the update.

Table 4

Handle button	Game features
LB key	jump
RB key	Open aiming
X key	Switch weapon
Y key	Creeping
A key	Change ammunition
B key	shooting
…	…

It should be understood that the mobile phone can update the mapping relationship between the controller buttons and the game functions saved by the user after detecting the mapping relationship between the user's updated handle buttons and the game buttons; or, the update may not be performed, then the next time the user plays the game During the experience, the mobile phone will still map the game buttons and the handle buttons according to the mapping relationship shown in Table 1.

In the embodiment of this application, when the user wants to adjust the mapping relationship between the handle buttons and the game buttons automatically set by the electronic device, the electronic device can display the button setting reminder box, and the user can manually adjust the mapping relationship between the handle buttons and the game buttons, which is helpful To improve the user’s gaming experience.

Figure 5 is another set of GUIs provided by an embodiment of the present application.

The GUI shown in (a) in FIG. 5 is a battle interface of another game application. When the mobile phone detects that the user has clicked the automatic mapping key position, it can display the GUI as shown in Figure 5 (b).

The interface elements corresponding to the game buttons on the battle interface shown in Figure 5 (a) are similar in shape to the interface elements corresponding to the game buttons on the battle interface shown in Figure 2 (c), so the phone is in the handle The mapping process of buttons and game buttons can refer to the processes shown in Figure 2 (c) to Figure 2 (d).

Refer to Figure 5 (b), the mobile phone can automatically move the icon of the LB button to the interface element 501 on the battle interface (the corresponding game function is "open aiming"); the mobile phone can automatically move the icon of the B button Go to interface element 502 (corresponding to the game function "switch weapon") on the battle interface; the mobile phone can automatically move the icon of the X key to interface element 503 (the corresponding game function is "shooting"); the mobile phone can automatically move The icon of the A key is moved to the interface element 504 (the corresponding game function is "jump"); the mobile phone can automatically move the icon of the Y key to the interface element 505 (the corresponding game function is "change ammo"); the mobile phone can automatically Move the icon of the arrow key to the interface element 506 (the corresponding game function is "move up, down, left, and right"); thus, the mobile phone automatically completes the mapping between the handle buttons and the game buttons.

As shown in (c) in Figure 5, when the mobile phone detects that the user clicks on the application and saves the operation, it can complete the mapping of the handle buttons and the game buttons. After completing the mapping between the handle buttons and the game buttons, the icons of the corresponding handle buttons can be reduced without blocking the game buttons. This ensures that the user can view the corresponding game buttons during the game experience, and also see the handle buttons and Correspondence of game buttons.

Several groups of GUIs have been introduced above through FIGS. 2 to 5. The GUIs shown in FIGS. 2 to 5 are mainly introduced by first-person shooting games (FPS). The interface elements corresponding to the game buttons in this type of game are basically similar. For example, the graphical shape of the game button "shoot" button shown in Figure 2 (c) and the game button "shoot" button shown in Figure 5 (a) Basically similar, except that the direction of the graphics is somewhat deviated. For another example, for example, the game button "jump" button shown in (c) of FIG. 2 has a similar graphic shape to the game button "jump" button shown in (a) of FIG. 5, except that the graphic direction is slightly different. For this type of game, only the feature point information of the interface element corresponding to each game function in some FPS games can be saved in the mobile phone, thereby forming a feature point set corresponding to the game function. Since the graphic shapes of the interface elements corresponding to the game buttons in the FPS game are basically similar, when the mobile phone starts a new FPS game, it can also accurately complete the mapping between the handle buttons and the game buttons.

For other types of games, due to the large difference in interface elements between games, it is also possible to save a specific set of feature points of game functions in a specific game in an electronic device for a specific game. For example, for multiplayer online battle arena games (MOBA), the game interface of each MOBA game is quite different, so for each MOBA game, the corresponding game function can also be saved in the mobile phone in advance Corresponding feature point collection.

Figure 6 shows another set of GUIs provided by the implementation of this application.

The GUI shown in (a) in FIG. 6 is a battle interface of another game application. The battle interface includes the interface element 601 corresponding to the game function "Skill 1", the interface element 602 corresponding to the game function "Skill 2", the interface element 603 corresponding to the game function "Skill 3", and the interface corresponding to the game function "Skill 4" Element 604, an interface element 605 corresponding to the game function "Skill 5", and an interface element 606 corresponding to the game function "Move up, down, left, and right". When the mobile phone detects that the user has clicked the operation of automatically mapping the key position, the mobile phone can display the GUI as shown in (b) in FIG. 6.

Refer to the GUI shown in (b) in Figure 6, the mobile phone can automatically move the icon of the LB key to the interface element 601 on the battle interface; the mobile phone can automatically move the icon of the RB key to the interface element 602 on the battle interface ; The mobile phone can automatically move the icon of the X key to the interface element 603; the mobile phone can automatically move the icon of the Y key to the interface element 604; the mobile phone can automatically move the icon of the A key to the interface element 605; the mobile phone can automatically move the icon of the A key to the interface element 605; The icon of the arrow key moves to the interface element 606. Thus, the mobile phone automatically completes the mapping between the handle buttons and the game buttons.

The difference from the mapping process shown in Figure 2 above is that during the mapping process from (c) to (d) in Figure 2, the mobile phone can save multiple games (for example, The feature points extracted from the image corresponding to the game function under Game 1 and Game 2). Exemplarily, Table 5 shows the corresponding relationship between the handle buttons, the game functions corresponding to the game buttons, and the feature point set saved in a mobile phone.

table 5

Alternatively, the mobile phone can also randomly map the handle buttons to the corresponding game function, so the mobile phone only needs to save the corresponding relationship between the game function and the feature point set corresponding to the game function. Exemplarily, Table 6 shows the mapping relationship between a game function stored in the mobile phone and the feature point set.

Table 6

For the mapping process shown in (a) to (b) in Figure 6, the mobile phone can only save the image extraction corresponding to the game function under a specific game (for example, game 3) for the feature point set corresponding to a game function Characteristic points. Exemplarily, Table 7 shows the corresponding relationship between the handle buttons, the game functions corresponding to the game buttons, and the feature point set saved in another mobile phone.

Table 7

In this way, for this type of specific game, after the mobile phone saves the corresponding relationship between the handle buttons and the game functions in advance, if the mobile phone detects that the game is started, it can automatically complete the matching of the handle buttons and the game buttons. By providing users with a functional experience of automatic mapping, it helps to reduce the complexity of the user's operation and enhance the user's gaming experience.

The above describes the process of the mobile phone automatically completing the mapping between the handle buttons and the game buttons in the embodiment of the present application in conjunction with FIGS. 2 to 6. The following describes the process of acquiring the mapping relationship between the handle buttons, game functions, and feature point sets. This process can also be referred to as the acquisition and learning stage. Figure 7 shows a schematic diagram of the acquisition and learning phase. As shown in Figure 7, the acquisition and learning stage may include the following processes:

S701: Obtain image information of the game button at the default position from the battle interface.

In an embodiment, the image information of the default location includes but is not limited to one or more of the following:

(1) The image information collected at the default location when the user did not click the game button;

(2) Image information collected at different time points during the game when the user did not click the game button at the default location;

(3) At different time points in the game process, the image information collected at the default position when the user clicks the game button.

It should be understood that for some games, since the image information (or interface elements) corresponding to the game buttons is translucent, the image information collected at different time points of the game will be different.

It should also be understood that for some games, the image information when the user clicks the game button and the image information when the user does not click the game button may also be different. For example, when the user clicks the game button, the game button will have a global cool down (CD) game effect, then the image information collected at this time and the image information when the user did not click the game button will exist difference.

S702: Customize the game buttons to other positions of the battle interface, and obtain image information of the game buttons at the adjusted positions.

In an embodiment, the image information at the adjusted position includes but is not limited to one or more of the following:

(1) The image information collected at the adjusted position when the user did not click the game button;

(2) Image information collected at different time points during the game when the user did not click the game button at the adjusted position;

(3) At different time points in the game process, the image information collected at the adjusted position when the user clicks the game button.

It should be understood that for some games, because the image information (or interface elements) corresponding to the game buttons is semi-transparent, the image information collected on different positions of the battle interface will be different.

It should be understood that the above S701-S702 may be implemented by the mobile phone based on its own processor. For example, the mobile phone can customize the game buttons to other positions of the battle interface, and then obtain the image information of the game buttons at the adjusted positions. Alternatively, S701-S702 can also be implemented by game developers on the PC or other devices. The process of custom adjustment in S702 can be done automatically by the device or manually by the game developer. After the game developer has collected enough image feature point sets corresponding to the game function, the mapping relationship between the above-mentioned game function and the image feature point set corresponding to the game function (or the image corresponding to the handle button, the game function and the game function The mapping relationship of the feature point set) is uploaded to the cloud server. After the mobile phone obtains the game from the cloud server, it can also obtain the mapping relationship between the game function and the image feature point set corresponding to the game function (or the mapping relationship between the handle buttons, the image feature point set corresponding to the game function and the game function).

S703: Repeat S701 to S702, and after collecting enough image data, complete the image data collection of the game button.

S704: Perform artificial intelligence (AI) training on the image data collected in S701 to S703, so as to obtain the mapping relationship shown in Table 4.

It should be understood that S703 and S704 may also be executed by a PC or a server.

In an embodiment, the process of performing AI training on image data may refer to the process of collecting feature points of the face in advance when performing face recognition in the prior art. The main purpose of collecting the feature points of the face is to accurately identify the user when performing face recognition. Similarly, the collection of the feature point set corresponding to the game buttons (or game functions) is mainly for the identification of interface elements on the battle interface At the same time, the game function corresponding to the interface element can be accurately identified.

In one embodiment, for a certain type of game (for example, FPS game), since the interface elements corresponding to the game buttons are basically similar, S701-S703 can be performed for different games, and the characteristics of a certain game button under different games The points are grouped together, as shown in Table 5. Then the electronic device can perform automatic mapping no matter when opening a game that has collected data or a game that has not collected data, which can reduce the user's cumbersome operations and improve the user's gaming experience.

In one embodiment, for a specific game (for example, a certain MOBA game), because the interface elements corresponding to the game buttons in different MOBA games are quite different, then S701-S703 can be performed for the specific game, and certain games under the specific game can be collected. The set of feature points corresponding to each game button is shown in Table 7. Then the electronic device can perform automatic mapping when starting this game, which can reduce the user's cumbersome operation and improve the user's game experience.

FIG. 8 shows a schematic flowchart of a method 800 for key mapping of a handle provided by an embodiment of the present application. As shown in FIG. 8, the method 800 is applied to an electronic device with a display screen. The electronic device and the handle are wired or For wireless connection, the method 800 includes:

S801: The electronic device displays a first interface through a display screen, and the first interface includes a first interface element.

Exemplarily, as shown in Figure 2(b), the mobile phone displays a battle interface through the display screen, and the battle interface includes interface elements 210 to 214.

Exemplarily, as shown in FIG. 6(a), the mobile phone displays another battle interface through the display screen, and the battle interface includes interface elements 601 to 605.

S802. The electronic device determines a first function and a first position corresponding to the first interface element, where the first position is the position of the first interface element on the first interface.

Optionally, the electronic device may store the first mapping relationship between the first function and the feature point set corresponding to the first function, and then the electronic device determines the first function corresponding to the first interface element, including:

The electronic device extracts the feature points of the first interface element;

The electronic device determines that the first interface element corresponds to the first function when the matching degree of the feature point set corresponding to the first interface element and the first function is greater than or equal to a preset value.

Exemplarily, the mapping relationship may be as shown in Table 6. For the interface element 210 shown in (c) in FIG. 2, the electronic device may extract the characteristic points of the interface element 210; the electronic device may be based on The mapping relationship matches the feature points of the interface element 210 with all feature point sets. For example, if the electronic device determines that the matching degree between the feature points of the interface element 210 and the feature point set corresponding to the game function "turn on aiming" is greater than or equal to the preset value, the electronic device can determine that the interface element 210 corresponds to the "turn on aiming" function .

It should be understood that the electronic device may determine that the first interface element corresponds to the first function through the saved mapping relationship between the game function and the feature point set; it may also determine that the first interface element corresponds to the first function in other ways. For example, an electronic device downloads a certain game App from a cloud server, and the game App may include the corresponding relationship between interface elements and game functions. After extracting a certain interface element, the electronic device can directly determine the game function corresponding to the interface element. For another example, the electronic device can also determine the corresponding game function by extracting the graphic shape on the interface element. For example, the graphic shape contained in the interface element 210 is "+", and the electronic device can use the mapping relationship between the game function and the graphic shape. It is determined that the interface element 210 corresponds to the "open aiming" function. In the embodiments of the present application, the manner in which the electronic device determines its corresponding first function through the first interface element is not specifically limited.

The electronic device may also determine the position of the first interface element. For example, the electronic device may associate the first interface element with the absolute position coordinate information of the first interface element on the display screen, as shown in Table 3 is obtained.

S803: The electronic device associates the first handle button with the first position, and the one or more handle buttons include the first handle button.

Exemplarily, as shown in Figure 2(d), when the mobile phone detects that the user has clicked the "automatic key mapping" operation, it can map the handle button to the location of the interface element, such as mapping the LB key to the interface The location of the element 210; the A key is mapped to the location of the interface element 212.

Optionally, the electronic device may randomly map other handle buttons except for the direction key 203 to the location where each interface element is located.

In the embodiment of the present application, the electronic device may not perform random mapping on the direction key 203. After determining that the interface element 211 corresponds to the game function "move up and down, left and right", the electronic device can map the handle button 203 to the location where the interface element 211 is located.

Optionally, the electronic device may save a second mapping relationship between the first game button and the first function, and the electronic device associating the first handle button with the first position includes:

The electronic device associates the first handle button with the position according to the second mapping relationship.

Exemplarily, the electronic device may save the second mapping relationship shown in Table 1.

After the electronic device determines the first function corresponding to the first interface element, it can associate the first handle button with the first position according to the mapping relationship shown in Table 1. For example, when the electronic device determines that the interface element 210 corresponds to the game function "enable aiming", and the game function "enable aiming" corresponds to position 1 on the battle interface, the electronic device can associate the LB key with position 1 according to the mapping relationship shown in Table 1. Associated.

In the embodiment of the present application, the mobile phone can save the mapping relationship between the handle buttons and the game buttons that the user is accustomed to in advance. For example, taking mainstream controllers such as Xbox and PS4 as an example, after a large number of users' actual experience, it can be concluded that the X button in the PS4 game controller is the most easily controlled button. For FPS games, the game function "shooting" is the most commonly used game button by users, so the phone can save the mapping relationship between the X button and the game function "shooting". In this way, the user can avoid the cumbersome operation of repeatedly adjusting the mapping relationship between the handle buttons and the game buttons, which improves the degree of intelligence of the electronic device, thereby helping to improve the user experience.

Optionally, the method 800 further includes:

In response to the user's operation of associating the second handle button with the first function, the electronic device automatically updates the second mapping relationship to the mapping relationship between the second handle button and the first function, and the one or more handle buttons include the The second handle button.

Exemplarily, as shown in FIG. 4(c), after the user has cleared the mapping relationship between the handle buttons and the game buttons, the user can adjust the mapping relationship between the handle buttons and the game buttons that he wants. For example, when the mobile phone detects that the user has moved the RB key to position 1 where the interface element 210 is located (the corresponding game function is “turn on aiming”), the RB key can be associated with the position 1 where the interface element 210 is located. Since the previous mobile phone saved the mapping relationship between the LB key and the game function "turn on aiming", the mobile phone can update the mapping relationship to the mapping relationship between the RB key and the game function "turn on aiming" at this time.

Exemplarily, as shown in (c) of FIG. 4, the mobile phone can update the mapping relationship shown in Table 1 to the mapping relationship shown in Table 4 after detecting that the user has clicked the "update and save" operation.

In the embodiment of this application, when the mobile phone detects that the user has updated the mapping relationship between the handle buttons and the game buttons saved last time, the mobile phone can save the handle buttons and the game buttons adjusted by the user, which is convenient for the user to experience the game next time At this time, the electronic device directly associates the handle buttons with the positions of the interface elements according to the adjusted mapping relationship. This helps to avoid the user's cumbersome operation of repeatedly adjusting the mapping relationship between the handle buttons and the game buttons, and improves the degree of intelligence of the electronic device, thereby helping to improve the user experience.

S804: In response to acquiring the first information sent by the handle, the electronic device performs a response operation to the first function at the first position, where the first information is used to indicate that the handle detects that the user presses the first handle button.

After the electronic device completes associating the first handle button with the first position, the electronic device receives the first information sent by the handle button, and the electronic device can perform a response operation to the first function at the first position. For example, the user clicks the LB button on the handle, and after the handle detects that the user has clicked the LB button, it can send the information i ₁ to the mobile phone. The first information indicates that the user has clicked the LB button. In response to receiving the information i ₁ , the mobile phone performs a response operation at position 1 to complete the "turn on aiming" function.

Optionally, the method 800 further includes:

The electronic device automatically associates the first handle button with the second position in response to the user's operation of moving the first interface element from the first position to the second position on the first interface;

In response to acquiring the first information, the electronic device performs a response operation to the first function at the second location.

Exemplarily, as shown in Figure 2(e), when the handle detects that the user has clicked the A button, the handle can send information i ₂ to the mobile phone, and this information i _{2 is} used to indicate that the handle detects that the user has clicked A key. Then, in response to receiving the information i ₂ , the mobile phone performs a response operation at position 1 to complete the "jumping" function.

As shown in Fig. 3(a), the mobile phone detects that the user has moved the interface element 212 from position 1 to position 6 on the display screen. The mobile phone may associate the A key with the position 6 in response to the operation for moving the interface element 212 from the position 1 to the position 6 on the display screen. When the handle detects that the user clicks the A button, the handle can send information i ₃ to the mobile phone, and the information i _{3 is} used to indicate that the handle detects that the user has clicked the A button. Then, in response to receiving the information i ₃ , the mobile phone performs a response operation at position 6 to complete the "jumping" function.

In the embodiments of this application, when the electronic device detects that the position of the interface element has changed, the electronic device can automatically update the association relationship between the handle button and the position of the interface element, thereby ensuring that the mobile phone can automatically perform a response operation after the user clicks the handle button . This helps to avoid the user from manually adjusting the association relationship between the handle button and the location of the game function, improves the degree of intelligence of the electronic device, and helps to improve the user's game experience.

In an embodiment, the electronic device may save the third mapping relationship of the first handle button, the first function, and the feature point set corresponding to the first function. The process of S802-S803 in the method 800 may be:

The electronic device extracts the feature points of the first interface element;

The electronic device determines that the first interface element corresponds to the first function when the matching degree between the feature point of the first interface element and the feature point set corresponding to the first function is greater than or equal to a preset value according to the third mapping relationship;

The first electronic device associates the first handle button with the first position according to the third mapping relationship.

It should be understood that the first mapping relationship and the second mapping relationship in the foregoing embodiment may constitute the third mapping relationship. The third mapping relationship may be as shown in Table 5 or Table 7. Exemplarily, as shown in FIG. 2(d), the mobile phone can extract the feature points of the interface element 210, and the mobile phone determines the matching degree between the feature points of the interface element 210 and the feature point set corresponding to “on aiming” in Table 5 After the value is greater than or equal to the preset value, it is determined that the interface element 210 corresponds to the game function "open aiming". The mobile phone can associate the LB key with the position 1 where the interface element 210 is located according to the mapping relationship shown in Table 5.

An embodiment of the present application also provides an electronic device, which may include a processor 110 and a memory as shown in FIG. 1, where one or more computer programs are stored in the memory, and the one or more computer programs include instructions, When the instructions are executed by the one or more processors, the electronic device is caused to execute the steps S801, S802, S803, and S804 in the method 800.

A person of ordinary skill in the art may realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.

Those skilled in the art can clearly understand that, for the convenience and conciseness of description, the specific working process of the system, device and unit described above can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, device, and method can be implemented in other ways. For example, the device embodiments described above are merely illustrative, for example, the division of the units is only a logical function division, and there may be other divisions in actual implementation, for example, multiple units or components may be combined or It can be integrated into another system, or some features can be ignored or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit.

If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the technical solution of the present application essentially or the part that contributes to the existing technology or the part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including Several instructions are used to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage media include: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk and other media that can store program code .

The above are only specific implementations of this application, but the protection scope of this application is not limited to this. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed in this application. Should be covered within the scope of protection of this application. Therefore, the protection scope of this application should be subject to the protection scope of the claims.

Claims (11)

1. A method for mapping handle buttons, the method is applied to an electronic device with a display screen, the electronic device and the handle are connected in a wired or wireless manner, the handle includes one or more handle buttons, and is characterized in that: The methods include:

   Displaying a first interface through the display screen, and the first interface includes a first interface element;

   Determine a first function and a first position corresponding to the first interface element, where the first position is the position of the first interface element on the first interface;

   Associating a first handle button with the first position, and the one or more handle buttons include the first handle button;

   In response to acquiring the first information sent by the handle, a response operation to the first function is performed at the first position, and the first information is used to indicate that the handle detects that the user presses the first handle button.
2. The method of claim 1, wherein the electronic device stores a first mapping relationship between the first function and the feature point set corresponding to the first function, and the first interface element is determined The corresponding first function includes:

   Extracting feature points of the first interface element;

   When the matching degree between the feature point of the first interface element and the feature point set corresponding to the first function is greater than or equal to a preset value, it is determined that the first interface element corresponds to the first function.
3. The method according to claim 1 or 2, wherein the method further comprises:

   In response to the user's operation of moving the first interface element from the first position to the second position on the first interface, automatically associating the first handle button with the second position;

   In response to acquiring the first information, a response operation to the first function is performed at the second location.
4. The method according to any one of claims 1 to 3, wherein a second mapping relationship between the first handle button and the first function is stored in the electronic device;

   The associating the first handle button with the first position includes:

   According to the second mapping relationship, the first handle button is associated with the first position.
5. The method of claim 4, wherein the method further comprises:

   In response to the user's operation of associating the second handle button with the first position, the second mapping relationship is automatically updated to the mapping relationship between the second handle button and the first function, and the one or more The two handle buttons include the second handle button.
6. An electronic device, wherein the electronic device and a handle are connected in a wired or wireless manner, the handle includes one or more handle buttons, and is characterized in that the electronic device includes:

   Display screen

   One or more processors;

   One or more memories;

   The one or more memories stores one or more computer programs, and the one or more computer programs include instructions, which when executed by the one or more processors, cause the electronic device to execute:

   Displaying a first interface through the display screen, and the first interface includes a first interface element;

   Determine a first function and a first position corresponding to the first interface element, where the first position is the position of the first interface element on the first interface;

   Associating a first handle button with the first position, and the one or more handle buttons include the first handle button;

   In response to acquiring the first information sent by the handle, a response operation to the first function is performed at the first position, and the first information is used to indicate that the handle detects that the user presses the first handle button.
7. The electronic device of claim 6, wherein the electronic device stores the mapping relationship between the first function and the feature point set corresponding to the first function, and when the instruction is controlled by the one or more When each processor executes, the electronic device is caused to execute:

   Extracting feature points of the first interface element;

   When the matching degree between the feature point of the first interface element and the feature point set corresponding to the first function is greater than or equal to a preset value, it is determined that the first interface element corresponds to the first function.
8. 8. The electronic device of claim 6 or 7, wherein when the instruction is executed by the one or more processors, the electronic device is caused to execute:

   In response to the user's operation of moving the first interface element from the first position to the second position on the first interface, automatically associating the first handle button with the second position;

   In response to acquiring the first information, a response operation to the first function is performed at the second location.
9. The electronic device according to any one of claims 6 to 8, wherein a second mapping relationship between the first handle button and the first function is stored in the electronic device, and when the instruction is When the one or more processors execute, the electronic device is caused to execute:

   According to the second mapping relationship, the first handle button is associated with the first position.
10. The electronic device of claim 9, wherein when the instruction is executed by the one or more processors, the electronic device is caused to execute:

    In response to the user's operation of associating the second handle button with the first position, the second mapping relationship is automatically updated to the mapping relationship between the second handle button and the first function, and the one or more The two handle buttons include the second handle button.
11. A computer-readable storage medium, characterized by comprising computer instructions, when the computer instructions run on an electronic device, cause the electronic device to execute the handle button mapping according to any one of claims 1 to 5 Methods.

Images