CN113031795B

CN113031795B - Control method, mouse and upper computer

Info

Publication number: CN113031795B
Application number: CN202110573274.XA
Authority: CN
Inventors: 李超; 邓恒波
Original assignee: Shenzhen Photool Vision Co ltd
Current assignee: Shenzhen Photool Vision Co ltd
Priority date: 2021-05-25
Filing date: 2021-05-25
Publication date: 2021-10-12
Anticipated expiration: 2041-05-25
Also published as: WO2022246937A1; CN113031795A

Abstract

The control method provided by the application is applied to a mouse and comprises the following steps: when control information corresponding to the designated mouse operation of the mouse is acquired, determining the control type of the control information corresponding to the designated mouse operation; if the control type is a target control type, determining a target channel from at least two preset channels according to the current control mode of the mouse, wherein information for controlling different elements in a display interface of the upper computer can be sent to the upper computer through different preset channels; and sending control information corresponding to the operation of the specified mouse to the upper computer through the target channel, wherein the connection between the upper computer and the mouse is established, and the control information is used for controlling the upper computer. By the method, the problems that the control mode of the existing mouse to the electronic equipment is fixed and simple, and the requirements of different application scenes are difficult to meet are solved.

Description

Control method, mouse and upper computer

Technical Field

The application belongs to the technical field of control, and particularly relates to a control method, a mouse, an upper computer and a computer readable storage medium.

Background

In daily use, a mouse is a tool capable of controlling a cursor in an electronic device such as a desktop computer or a notebook computer. However, the control mode of the existing mouse to the electronic device is fixed and simple, and the requirements of different application scenes are difficult to meet.

Disclosure of Invention

The embodiment of the application provides a control method, a mouse, an upper computer and a computer readable storage medium, and can solve the problems that the control mode of the existing mouse to electronic equipment is fixed and simple, and the requirements of different application scenes are difficult to meet.

In a first aspect, an embodiment of the present application provides a control method, which is applied to a mouse, and the control method includes:

when control information corresponding to the designated mouse operation of the mouse is acquired, determining the control type of the control information corresponding to the designated mouse operation;

if the control type is a target control type, determining a target channel from at least two preset channels according to the current control mode of the mouse, wherein information for controlling different elements in a display interface of the upper computer can be sent to the upper computer through different preset channels;

and sending control information corresponding to the operation of the specified mouse to the upper computer through the target channel, wherein the connection between the upper computer and the mouse is established, and the control information is used for controlling the upper computer.

In a second aspect, an embodiment of the present application provides a control method, which is applied to an upper computer, and the control method includes:

the method comprises the steps that control information corresponding to designated mouse operation of a mouse is obtained from the mouse through a target channel, the control type of the control information is a target control type, the upper computer is connected with the mouse, the target channel is determined from at least two preset channels based on the current control mode of the mouse, and the upper computer can obtain information for controlling different elements in a display interface of the upper computer through different preset channels;

and controlling the upper computer according to the control information.

In a third aspect, an embodiment of the present application provides a mouse, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the control method according to the first aspect when executing the computer program.

In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a computer program is stored, and the computer program, when executed by a processor, implements the control method according to the first aspect.

In a fifth aspect, the present application provides a computer program product, which when run on a terminal device, causes the terminal device to execute the control method described in the first aspect.

In a sixth aspect, an embodiment of the present application provides a host computer, which includes a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor implements the control method according to the second aspect when executing the computer program.

In a seventh aspect, an embodiment of the present application provides a computer-readable storage medium, where a computer program is stored, and the computer program, when executed by a processor, implements the control method according to the second aspect.

In an eighth aspect, the present application provides a computer program product, which when run on a terminal device, causes the terminal device to execute the control method described in the second aspect.

Compared with the prior art, the embodiment of the application has the advantages that: by the embodiment of the application, when the control information corresponding to the specified mouse operation of the mouse is acquired, the control type of the control information corresponding to the specified mouse operation can be determined, so that the specific control scene corresponding to the mouse is determined according to the control type. And if the control type is a target control type, determining a target channel from at least two preset channels according to the current control mode of the mouse, wherein information for controlling different elements in a display interface of the upper computer can be sent to the upper computer through different preset channels. It is visible, mouse can switch different preset passageways to through the different control of presetting the passageway different elements in the display interface of host computer compare in traditional mouse that can only control the cursor, the function of mouse in this embodiment is abundant greatly, makes mouse can switch different preset passageways according to the demand and controls different elements in the host computer. In practical application, the mouse can determine a specific control scene corresponding to the mouse according to the control type, further determine a target channel from at least two preset channels in a targeted manner, and send control information corresponding to the designated mouse operation to the upper computer through the target channel, at this time, the element to be controlled in the upper computer can be accurately determined from diversified elements which can be controlled by the mouse according to the target channel and the control information, and the element to be controlled in the upper computer can be controlled.

Drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or the prior art descriptions will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present application, and it is obvious for those skilled in the art to obtain other drawings without creative efforts.

Fig. 1 is a schematic flow chart of a control method according to an embodiment of the present application;

FIG. 2 is a schematic diagram of a connection between the host computer and the mouse according to an embodiment of the present application;

FIG. 3 is an exemplary diagram of a button in the mouse according to an embodiment of the present application;

fig. 4 is an exemplary schematic diagram of information transmission between the upper computer and the mouse according to an embodiment of the present application;

FIG. 5 is a schematic flow chart diagram of another control method provided by an embodiment of the present application;

FIG. 6 is a schematic structural diagram of a mouse according to an embodiment of the present application;

fig. 7 is a schematic structural diagram of an upper computer according to an embodiment of the present application.

Detailed Description

In the following description, for purposes of explanation and not limitation, specific details are set forth, such as particular system structures, techniques, etc. in order to provide a thorough understanding of the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments that depart from these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

It should be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

As used in this specification and the appended claims, the term "if" may be interpreted contextually as "when", "upon" or "in response to" determining "or" in response to detecting ". Similarly, the phrase "if it is determined" or "if a [ described condition or event ] is detected" may be interpreted contextually to mean "upon determining" or "in response to determining" or "upon detecting [ described condition or event ]" or "in response to detecting [ described condition or event ]".

Reference throughout this specification to "one embodiment" or "some embodiments," or the like, means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," or the like, in various places throughout this specification are not necessarily all referring to the same embodiment, but rather "one or more but not all embodiments" unless specifically stated otherwise. The terms "comprising," "including," "having," and variations thereof mean "including, but not limited to," unless expressly specified otherwise.

Specifically, fig. 1 shows a flowchart of a control method provided in an embodiment of the present application, where the control method may be applied to a mouse.

In the embodiment of the present application, the specific structure of the mouse may be various, and is not limited herein. Illustratively, the mouse may include a left mouse button, a right mouse button, and a mouse wheel. The mouse may also include one or more other buttons or other features that may be used for user interaction.

The mouse can be connected with an upper computer. The specific type of the upper computer is not limited herein. For example, the host computer may be a desktop computer, a mobile phone, a tablet computer, a wearable device, an in-vehicle device, an Augmented Reality (AR)/Virtual Reality (VR) device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a Personal Digital Assistant (PDA), or the like.

The specific connection mode of the mouse and the upper computer can be various. As shown in fig. 2 (a), the connection between the mouse and the upper computer is schematically illustrated. The mouse and the upper computer can be in wireless connection or in wired connection.

Exemplarily, as shown in fig. 2 (b), a specific schematic diagram of establishing a connection between the mouse and the upper computer is shown. The mouse is a wireless mouse, data transmission is carried out between a Micro Control Unit (MCU) in the mouse and another MCU connected to an upper computer through a wireless 2.4G network and the like, mouse key information, mouse position information and the like collected by the MCU in the mouse are sent to the other MCU connected to the upper computer through wireless networks such as the wireless 2.4G network and the like, and then the mouse is sent to the upper computer through the other MCU connected to the upper computer, so that wireless connection between the mouse and the upper computer is realized. The other MCU connected to the upper computer may be connected to the upper computer through a Universal Serial Bus (USB) connector.

As shown in fig. 2 (c), another specific schematic diagram of the connection between the mouse and the upper computer is shown. The mouse is a wired mouse and can be connected with a USB interface of the upper computer through a USB connector, so that wired connection between the mouse and the upper computer is achieved.

As shown in fig. 1, the control method may include:

step S101, when the control information corresponding to the specified mouse operation of the mouse is obtained, determining the control type of the control information corresponding to the specified mouse operation.

In this embodiment, the designated mouse operation may include at least one of a moving operation of the mouse and a pressing operation, a sliding operation, and the like of a designated key on the mouse. In some examples, the designated mouse operation may include a user operation of at least two buttons on the mouse, and may also include a user operation of at least two buttons on the mouse. The control information may be determined according to a specific operation mode of the designated mouse operation, a corresponding information generation mode, and the like. For example, if the designated mouse operation is a pressing operation of a specific key on the mouse, the control information may be a trigger signal. If the designated mouse operation is the mouse movement operation, the control information may include position change information of the mouse, and the position change information may be used to control the position of a specific element (such as a cursor, a specific control, a specific window, and the like) in the upper computer.

In this embodiment, the control type of the control information corresponding to the specified mouse operation may be determined according to an information format, an information content, and the like of the control information. In an example, the control type of the control information corresponding to the specified mouse operation may be obtained by querying from a preset control information-control type mapping table. The control type may be various, and specifically, the division of the control type may be predetermined according to a control mode, a control object, and the like of the mouse.

At this time, according to the control type, a specific control scenario corresponding to the mouse may be determined, for example, by determining the control type of the control information, it may be determined whether the control information is specifically used for controlling an external device (e.g., an upper computer) or the mouse itself.

In some embodiments, the determining, when the control information corresponding to the specified mouse operation of the mouse is obtained, a control type of the control information corresponding to the specified mouse operation includes:

when control information corresponding to the designated mouse operation of the mouse is acquired, determining that the control information corresponding to the designated mouse operation is internal control information or external control information, wherein if the control information is the external control information, determining that the control type is the target control type.

In this embodiment, the internal control information may be used to control the mouse itself. In one example, the internal control information may include internal device control information and/or internal behavior control information. The internal device control information may be used to control some components of the mouse itself, such as controlling a light on the mouse to flash. The internal behavior control information may be used to control an information processing flow of the mouse itself. For example, the internal behavior control information may be used to control the mouse to pair with a receiver of the mouse (e.g., a USB receiver for connecting to an upper computer). At this time, the receiver of the mouse may be considered as a component of the mouse, and the internal behavior control information is used to control the receiver to write the identity information of the mouse into the receiver, so that a one-to-one pairing relationship is established between the receiver of the mouse and the mouse.

The external control information may be used to control the upper computer. In this embodiment of the application, the external control information may be used to control at least two elements in the upper computer in different scenes, for example, the external control information may be used to control a cursor in a display interface of the upper computer, may also be used to control a page turning operation of a designated page of the upper computer, or may also be used to control a specific control, a display mode of a specific window, display content, and the like in the display interface of the upper computer.

And S102, if the control type is a target control type, determining a target channel from at least two preset channels according to the current control mode of the mouse, wherein information for controlling different elements in a display interface of the upper computer can be sent to the upper computer through different preset channels.

In this embodiment, the target control type may be preset according to a condition of an object to be controlled by the mouse. Illustratively, the target control type may be external control information, control information of a specific data type, and the like. The number of the preset channels and channel setting information such as the information transmission protocol respectively corresponding to each preset channel are not limited herein. In one example, The predetermined channel may be a bluetooth Human Interface Device (HID) channel.

In the embodiment of the application, the information used for controlling different elements in the display interface of the upper computer can be sent to the upper computer through different preset channels. Wherein the types of the respective elements may be various. For example, the elements corresponding to the different preset channels may include one or more of a cursor, a specific control in a display interface of the upper computer, a specific window, a specific page, and the like. It should be noted that, in some examples, two or more preset channels may also exist in different preset channels, and the two or more preset channels may be capable of sending, to the upper computer, information for controlling the same element in the display interface of the upper computer. For example, two of the at least two preset channels may also exist, and both of the two preset channels may send information for controlling a cursor in a display interface of the upper computer.

In this application embodiment, mouse can switch different preset passageways to through the different control of predetermineeing the passageway different elements in the display interface of host computer compare in traditional mouse that can only control the cursor, and the function of mouse in this embodiment is abundant greatly, makes mouse can switch different preset passageways according to the demand and controls different elements in the host computer. In practical application, the mouse can determine a specific control scene corresponding to the mouse according to the control type, and further determine a target channel from at least two preset channels in a targeted manner, and at the moment, the element to be controlled in the upper computer can be accurately determined and controlled from diversified elements which can be controlled by the mouse according to the target channel and the control information.

In some embodiments, the determining a target channel from at least two preset channels according to the current control mode of the mouse includes:

if the current control mode is a first mode, determining that the target channel is a first channel or a second channel, wherein when the current control mode is the first mode, the control information is used for controlling a designated cursor in the upper computer;

if the current control mode is a second mode, determining that the target channel is a second channel, wherein when the current control mode is the second mode, the control information is used for controlling a designated element in a display interface of the upper computer, the designated element is different from the designated cursor, and the second channel is used for realizing bidirectional communication between the mouse and the upper computer;

and if the current control mode is a third mode, determining that the target channel is a third channel, wherein when the current control mode is the third mode, the control information is used for realizing the function of the appointed key on the keyboard of the upper computer.

The first mode may be a mode of a current ordinary mouse. The designated cursor may be a cursor that can be controlled by a conventional mouse at present. The specific form of the designated cursor is not limited herein. Illustratively, the designated cursor may be in the form of an arrow image, or may be a regularly flashing vertical line or horizontal line. The designated cursor may be dynamic or static, and the state may be different in different situations.

At this time, the movement of the mouse, the operation of the right mouse button, the left mouse button and the mouse wheel may be used to control the movement, the click operation and the like of the designated cursor in the upper computer. In this embodiment, according to the setting condition of the preset channel, in the first mode, the target channel may be a first channel or a second channel. In practical applications, if the current control mode is the first mode, it may be determined that the target channel is the first channel or the second channel according to the priorities of the first channel and the second channel in the first mode, the communication conditions of the channels, and the like. For example, the default channel in the first mode may be preset as a first channel, and at this time, in general, if the current control mode is the first mode, it is determined that the target channel is the first channel. However, if the first channel has a problem that information transmission is slow, or the first channel receives related setting information for the second channel, which is generated by a user through a specific key of the mouse or through a specific application on the upper computer, the target channel may be set as the second channel when the current control mode is the first mode.

In the embodiments of the present application, the specified elements may be various. Illustratively, the specified element may be one or more of a specific control, a specific window, a specified page, and the like in the display interface of the upper computer. In a specific example, a specific control in the display interface of the upper computer may construct a characteristic region similar to a laser point or a highlight region and the like on the top layer of the display interface of the upper computer. In another specific example, a specific window in the display interface of the upper computer may form an area for enlarged display or an area for drawing annotation information on the top layer of the display interface of the upper computer.

The second channel may be a channel customized by a developer. The control information corresponding to the designated mouse operation of the mouse is sent to the upper computer through the second channel, so that the mouse can control designated elements different from the cursor in the display interface of the upper computer under the condition that the control right of the designated cursor in the upper computer is given out, and the functions of the mouse are greatly enriched and can meet the requirements of more application scenes. And after the mouse gives the control right to the designated cursor in the upper computer, when the control information is sent to the upper computer through the second channel, the control right of the designated cursor can be prevented from being seized by the mouse and the upper computer or other external equipment (such as a keyboard) of the upper computer, so that the control to the designated element and the control to the designated cursor can be effectively separated and do not influence each other.

In addition, the second channel is used for realizing bidirectional communication between the mouse and the upper computer so as to transmit at least one of mode switching information, heartbeat packets, positioning accuracy of the mouse and other parameter setting information between the upper computer and the mouse. Illustratively, the second channel may be a bi-directional HID channel between the mouse and the host computer. It can be seen that, through the second channel, the host computer can conveniently set the mouse through the second channel, for example, set the current control mode of the mouse, and the like. The traditional mouse at present can only control the upper computer in a one-way mode, and the upper computer cannot be reversely provided with the mouse. In the embodiment of the application, the problem that the upper computer cannot be reversely provided with the intelligent mouse is solved through the second channel, a richer communication mode can be provided through two-way communication, richer control contents are transmitted, and therefore the function of the mouse is greatly expanded, and complex operation of the upper computer is achieved.

The third channel can transmit control information for realizing the function of the appointed key on the keyboard of the upper computer. At this time, the designated key can be preset according to actual requirements. Illustratively, the designated key may be a Page UP key and a Page Down key on a keyboard, so as to implement a Page turning operation on a designated Page in the display interface of the upper computer.

At present, in practical application, if the functions of the keys such as Page UP/Page Down in the keyboard are simulated by software on the upper computer, the keys are usually identified as malicious software by antivirus software, and the functions are limited due to various authority problems. Through the third channel in the embodiment of the application, the mouse can send control information simulating functions of keys such as Page UP/Page Down and the like in a keyboard to the upper computer, and the control information bypasses antivirus software and a system firewall, so that the upper computer is efficiently controlled, and user experience is well improved.

In some embodiments, before determining that the target channel is the third channel if the current control mode is the third mode, the method further includes:

and if third mode setting information is received from the upper computer through the second channel, setting the current control mode of the mouse to be a third mode according to the third mode setting information.

In the embodiment of the application, the upper computer can send the mode setting information to the mouse through the second channel, so that the current control mode in the intelligent mouse is controlled. The mode setting information may be generated by a designated application on the upper computer. If the mouse receives third mode setting information from the upper computer through the second channel, the current control mode of the mouse is set to be the third mode according to the third mode setting information, so that control information representing key values of keys such as Page UP/Page Down and the like in a keyboard can be sent to the upper computer through the third channel, antivirus software and a system firewall in the upper computer are bypassed, and the upper computer is efficiently controlled.

In some embodiments, the current control mode of the mouse is determined according to mode setting information sent by the upper computer, or according to a receiving state of heartbeat packet data of the mouse, or according to a specified key operation on the mouse for a specified key.

In the embodiment of the application, the second channel is used for realizing the mouse and the two-way communication between the upper computers, therefore, the upper computers can send the mode setting information to the mouse through the second channel so as to set the current control mode of the mouse.

In addition, the mouse can also determine the current control mode of the mouse according to the receiving state of the heartbeat packet data of the mouse. For example, in one scenario, a designated application in the host computer is automatically launched when a daemon of the designated application recognizes a mouse connection. And then, the appointed application in the upper computer sends a heartbeat packet to the mouse, and the mouse receives the heartbeat packet and automatically restores the upper computer, so that the working states of the two parties are mutually identified. If the mouse loses contact with the designated application of the upper computer for a certain time (for example, no heartbeat packet is received for more than 5 seconds) when the current control mode is the second mode or the third mode, the current control mode is set to be the first mode so as to ensure that the user can use the common mouse function.

The operation of the appointed key on the mouse aiming at the appointed key can be set according to the setting condition of the key on the mouse. The number and the setting mode of the designated keys are not limited herein.

In some embodiments, the mouse includes a left mouse button, a right mouse button, a mouse wheel, and at least one preset function button, and the designated control information corresponding to the at least one preset function button can be sent to the upper computer through the second channel.

The type, position and specific function of the at least one preset function key can be various. And the functions of the left mouse button, the right mouse button and the mouse wheel can be different from those of the traditional mouse and can be adjusted according to the current control mode. Appointed control information corresponding to the at least one preset function key can be sent to the upper computer through the second channel, so that the upper computer can distinguish and isolate specific control information generated based on the at least one preset function key and conventional cursor control information generated based on the left mouse key, the right mouse key and the mouse roller, and the appointed control information is applied to different control scenes respectively.

It should be noted that the designated control information corresponding to the at least one preset function key can be sent to the upper computer through the second channel, but is not limited to being sent only through the second channel.

Illustratively, the functions of the left mouse button, the right mouse button, the mouse wheel and the at least one preset function button are illustrated by specific examples below. It should be noted that the specific example is only an exemplary illustration of the present embodiment, and is not a limitation of the present embodiment.

The at least one preset function key may include at least one of a function switching key, an execution key, a shortcut key, a Page Down key, a Page Up Page key, a full screen/exit full screen key, a blank screen/exit blank screen key, an uppermost layer display key, and a custom function key.

In one example, as shown in fig. 3, an exemplary structure diagram of a button in the mouse is shown.

The functional use of each of the keys of fig. 3 is described in detail below.

Left mouse button 1: the key has two states, one is the state of the left key of the conventional mouse, and the function of the left key is the same as that of the left key of the conventional mouse; one is the custom execution key state.

Mouse right button 2: including the right button function of a conventional mouse. In addition, when the left mouse button is in the execution button state, the right mouse button is clicked, and the left mouse button exits the execution button state and is directly recovered to the conventional left mouse button state.

Mouse wheel 3: when the left mouse button is in the state of the left mouse button, the function of the button is the same as that of a roller wheel of the conventional mouse; when the left mouse button is in the execution key state, the mouse roller is used for adjusting the aperture size of a searchlight and a magnifier on the display interface of the upper computer, or the spot size of digital laser, or the note thickness of an annotation pen, and the like, and the function of the mouse roller can be determined according to the currently controlled elements of the mouse.

Function switch key 4: and clicking a function switching key, and switching the mouse from the current function to the next function, wherein different functions correspond to different sub-modes in the second mode. Illustratively, there are four functions in total, with the initial function defaulting to searchlights; clicking once, and switching from the searchlight to digital laser; clicking once again, and switching from the digital laser to the magnifying lens; clicking once again, and switching from the magnifying glass to annotation; once again, click from comment to searchlight. And four functions, which are sequentially circulated. But the switching sequence can be changed on the software interface of the appointed application of the upper computer. When the left mouse button is in a conventional left mouse button state, the function switching button is clicked, the function of the function switching button before the last failure is activated, and the left mouse button is switched to an execution button state; clicking the function switching key once again to switch to the next function. And at the moment, clicking the right mouse button, disabling the function corresponding to the function switching button, and recovering the left mouse button to be in a conventional left mouse button state.

Execution key 5: may be the same as the left mouse button. When the key is in the execution key state, long-time pressing of the execution key is performed to move the searchlight; or long-pressing an execution key to execute the movement of the magnifier; or long-press the execution key to execute the movement of the digital laser; or long-pressing the execution key to execute the movement of the annotation brush. The specific function to be executed is determined by the function selected by the function switch. When the mouse is in the execution key state, the function of the left key of the conventional mouse is invalid; and when the mouse is in the state of the left button of the conventional mouse, the function of the execution button is invalid.

Shortcut key 6: the key is a shortcut key for function selection, and is defaulted to digital laser; clicking once, and changing the function set by the shortcut key no matter what the function of the current function switching key is; subsequently, a function switching key is clicked to switch from the current function to the next function. The functions of the shortcut keys can be changed in a specified application software interface of the upper computer.

Page down key 7: controlling the page turning down of the page such as the presentation (PowerPoint, PPT). When the upper computer is in a PPT playing state or displays other page-turning pages, the function of the key is the same as that of the left mouse button. When the left mouse button is in the execution button state, the click cannot turn pages.

Page up key 8: controlling the pages of PPT and the like to turn upwards.

Full screen/exit full screen key 9: if the upper computer opens the PPT and other pages and clicks the key, the PPT and other pages enter the full-screen state of the current page; and clicking once more, and exiting the full screen state.

Blank screen/exit blank screen key 10: clicking the key, and enabling the upper computer to enter a preset blank screen state; and clicking once more, and exiting the blank screen state. The background color of the blank screen can be set and the user can insert the picture. Switching to a blank screen or exiting a blank screen may have an animation effect.

Uppermost display key 11: clicking the key, and calling a software interface of a specified application for setting the mouse in the upper computer to the uppermost layer of the desktop of the upper computer for display; clicking the key again to hide the software interface of the designated application. Interface callouts and callouts can also have animation effects.

Custom function key 12: the short press of the key is a page turning-down key, and the long press is a self-defined function. The custom function may be at least one of the functions shown in table 1:

table 1: function of self-defined function key

In some embodiments, the second mode may include at least two sub-modes, where elements in the upper computer corresponding to different sub-modes are different. At this time, the second mode may be further classified, so that the control information of the mouse may be respectively used to implement control over elements in more detailed different application scenarios in different sub-modes.

For example, in some embodiments, the second mode may include at least one of a first sub-mode, a second sub-mode, and a third sub-mode.

The first sub-mode, the second sub-mode, and the third sub-mode are specifically described below. It should be noted that the mouse in this embodiment may implement one of the following multiple scenario embodiments, and may also implement a combination of at least two of the following multiple scenario embodiments.

1. Scene one

If the current control mode is a first sub-mode in a second mode, movement control information about mouse movement operation in the designated mouse operation in the control information is used for determining the position of a first control in a display interface of the upper computer, the first control is located at the top layer of the display interface of the upper computer, and the transparency and/or the color of the first control are determined according to preset information.

In this embodiment, the first control may be configured to implement functions such as a searchlight and a laser pointer on a display interface of the upper computer.

In one example, the first control may construct a first region in the display interface, and a region outside the first control is a second region, and the transparency of the first region is different from that of the second region, for example, the transparency of the first region is 100%, and the transparency of the second region is less than 100%, then the display content in the second region may have an occlusion effect due to the transparency, but the display content in the first region may be clearly displayed, so as to highlight the content in the first region. In some applications, the manner in which the content within the first region formed by the first control is highlighted is also referred to as a searchlight function. The position of a first area formed by the first control can be determined according to movement control information corresponding to mouse movement operation in the specified mouse operation, so that the highlighted area can be adjusted in the display interface of the upper computer.

In yet another example, the first space may constitute a third area in the display interface, the third area may be filled with a designated color, such as red or green, and the third area may be circular in shape, and the size of the third area may be determined according to the size of the laser spot, so that the laser spot may be simulated by the third area. The position of the third area can be determined according to the movement control information corresponding to the mouse movement operation in the specified mouse operation, so that the position of the laser point can be adjusted in the display interface of the upper computer. In some applications, this function is also known as a laser pointer function, used to implement digital lasers.

2. Scene two

If the current control mode is a second sub-mode in a second mode, the control information is used for determining the position of a to-be-displayed area in the amplified first image, the to-be-displayed area is displayed in a first window in a display interface of the upper computer, the first image comprises first display content of the first display interface of the upper computer, and the first window is located on the top layer of the display interface of the upper computer.

In this embodiment, for example, the control information may be used to determine the position of the feature point of the area to be displayed, so as to represent the position of the area to be displayed by the position of the feature point. The feature point of the to-be-displayed area of the first image may be a center point of the to-be-displayed area of the first image. The size, shape, and the like of the region to be displayed of the first image may be determined according to the magnification and the size of the first window. The magnification may also be determined based on the control information. For example, movement control information corresponding to a mouse movement operation may be used to determine a position of a feature point of the region to be displayed of the first image, and scroll control information corresponding to a scroll operation of a mouse wheel may be used to determine the magnification. Of course, the magnification may be predetermined.

The first display interface can be an interface displayed by the upper computer when the upper computer receives the control information, and the first image can be obtained by screen capture of the first display interface. In some examples, the first image may be stored in a cache of the host computer. The first display content may be a part of or all of the content in the first display interface. In this scenario, at least a portion of the first display content in the first display interface may be displayed in an enlarged manner, and in some applications, this function is also referred to as a magnifying glass function.

3. Scene three

And if the current control mode is a third sub-mode in the second mode, the control information is used for determining target content, the target content is used for drawing a second image displayed on a second window, the second image comprises second display content of a second display interface of the upper computer, and the second window is positioned at the top layer of the display interface of the upper computer.

In the embodiment of the present application, the second image may be the same as or different from the first image. For example, the first image and the second image may each be a different portion of a screenshot taken of the first display interface. The second image may be stored in a cache of the upper computer. The second display content may be a part of or all of the content in the second display interface.

The target content can be the track, the shape and the like drawn on the second display interface. In one example, the track may be drawn according to a timer in the upper computer and movement control information corresponding to a movement operation of the mouse. It can be seen that in this scenario, the second image may be annotated, and in some applications, this function is also referred to as an annotation function.

It can be seen that, through at least one of the first sub-mode, the second sub-mode, and the third sub-mode of this embodiment, functions of other devices such as a speech pen and the like, and functions of a magnifying glass, a searchlight of a display interface, an annotation and the like can be combined into a mouse, so that functions of operating some elements of the upper computer, and some indication functions such as PPT display and the like can be conveniently realized through the same handheld device (mouse). Therefore, many requirements in teaching and demonstration scenes are directly integrated into a mouse button, scene pain points are solved, users in different scenes can conveniently execute various control operations aiming at the upper computer through a handheld device (mouse), the functions of the mouse are greatly expanded, and the users can conveniently control the upper computer in different scenes.

As shown in fig. 4, an exemplary schematic diagram of information transmission between the upper computer and the mouse is provided for the embodiment of the present application.

The controller in the mouse may obtain control information corresponding to a button of the mouse, and determine whether the control information is internal control information (such as internal device control information or internal behavior control information) or external control information. And if the control information is external control information, determining a target channel from the first channel, the second channel and the third channel, and sending the control information to the upper computer through the target channel so as to control the upper computer to realize at least one of a conventional mouse function, a searchlight function, a laser pen function, a magnifier function, an annotation function, a timer function and the like on a display interface.

And S103, sending control information corresponding to the specified mouse operation to the upper computer through the target channel, wherein the upper computer is connected with the mouse, and the control information is used for controlling the upper computer.

The upper computer can be in wired connection or wireless connection with the mouse in advance. The control information can be used for controlling a background system in the upper computer and can also be used for controlling elements in a display interface of the upper computer.

By the embodiment of the application, when the control information corresponding to the designated mouse operation of the mouse is acquired, the control type of the control information corresponding to the designated mouse operation can be determined, so that the specific control scene corresponding to the mouse is determined according to the control type. And if the control type is a target control type, determining a target channel from at least two preset channels according to the current control mode of the mouse, wherein information for controlling different elements in a display interface of the upper computer can be sent to the upper computer through different preset channels. It is visible, mouse can switch different preset passageways to through the different control of presetting the passageway different elements in the display interface of host computer compare in traditional mouse that can only control the cursor, the function of mouse in this embodiment is abundant greatly, makes mouse can switch different preset passageways according to the demand and controls different elements in the host computer. In practical application, the mouse can determine a specific control scene corresponding to the mouse according to the control type, further determine a target channel from at least two preset channels in a targeted manner, and send control information corresponding to the designated mouse operation to the upper computer through the target channel, at this time, the element to be controlled in the upper computer can be accurately determined from diversified elements which can be controlled by the mouse according to the target channel and the control information, and the element to be controlled in the upper computer can be controlled.

Referring to the above embodiment of the control method applied to the mouse, fig. 5 shows a flowchart of another control method provided in the embodiment of the present application, where the control method may be applied to an upper computer, and the upper computer is connected to the mouse.

The specific type of the upper computer is not limited herein. For example, the host computer may be a desktop computer, a mobile phone, a tablet computer, a wearable device, an in-vehicle device, an Augmented Reality (AR)/Virtual Reality (VR) device, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, a Personal Digital Assistant (PDA), or the like.

The mouse control system comprises an upper computer, a mouse and a designated application, wherein the upper computer can be installed with the designated application, the designated application can be used for controlling the upper computer according to control information sent by the mouse and generating a control instruction sent by the upper computer to the mouse, for example, the designated application can generate a setting control instruction aiming at the current control mode of the mouse according to the operation of a user on the upper computer, so that the mouse can set the current control mode of the mouse according to the setting control instruction. In addition, the appointed application can also send heartbeat packets to the mouse in a preset period, and the connection state of the mouse and the upper computer is judged according to the feedback information of the mouse.

As shown in fig. 5, the control method may include:

step S501, control information corresponding to designated mouse operation of the mouse is obtained from the mouse through a target channel, the control type of the control information is a target control type, the upper computer is connected with the mouse, the target channel is determined from at least two preset channels based on the current control mode of the mouse, and the upper computer can obtain information used for controlling different elements in a display interface of the upper computer through different preset channels.

And step S502, controlling the upper computer according to the control information.

In some embodiments, if the current control mode is a first mode, the target channel is a first channel or a second channel, wherein when the current control mode is the first mode, the control information is used for controlling a designated cursor in the upper computer;

if the current control mode is a second mode, the target channel is a second channel, wherein when the current control mode is the second mode, the control information is used for controlling a designated element in a display interface of the upper computer, the designated element is different from the designated cursor, and the second channel is used for realizing the two-way communication between the mouse and the upper computer;

and if the current control mode is a third mode, the target channel is a third channel, wherein when the current control mode is the third mode, the control information is used for realizing the function of the appointed key on the keyboard of the upper computer.

In some embodiments, the upper computer may send third mode setting information to the mouse through the second channel, where the third mode setting information is used to instruct the mouse to set the current control mode of the mouse to a third mode according to the third mode setting information.

In some embodiments, the controlling the upper computer according to the control information includes:

if the current control mode is a first sub-mode in a second mode, determining the position of a first control in a display interface of the upper computer according to movement control information about mouse movement operation in specified mouse operation in the control information, wherein the first control is positioned at the top layer of the display interface of the upper computer, and the transparency and/or the color of the first control are determined according to preset information.

An exemplary detailed data processing flow for the host computer to execute the embodiments of the present application is described below with a specific example.

Step A1: the method comprises the steps that the mouse sends identification information for starting a searchlight mode to the upper computer to indicate that a current control mode of the mouse is the searchlight mode, or the mouse sends identification information for starting a laser pen mode to the upper computer to indicate that the current control mode of the mouse is the laser pen mode;

step A2: after an Application Programming Interface (API) of an operating system is called in a thread by a designated Application of the upper computer, a full-screen window is created after identification information of a searchlight mode is intercepted from the operating system, and a first control is created on the window, wherein the first control can be a rectangular control at the moment;

step A3: setting the window as a top-level window of an operating system, and cutting an oval or circular area in the first control by setting a fillet value of the first control in combination with the width and height of the first control, wherein the rectangle is square, and the sizes of the fillet x and y are 1/2 for the width and height of the square respectively, and at this time, the area in the first control can be regarded as a circular area or an oval area;

step A4: according to the specific application scene requirements, calling a library function of a system to set the transparency and/or color in the first control, and in addition, setting the color and/or transparency of a window where the first control is located, so that the area in the first control is used as a searchlight area or a simulated laser point;

step A5: the designated application of the upper computer can start a timer, and the movement condition of the mouse is determined in real time according to control information about mouse movement operation sent by the mouse. If the mouse is determined to move according to the control information, the position of the first control on the window can be correspondingly moved according to the control information and the time information of the timer. For example, assuming that the coordinates of the current center point in the first space are (X1, Y1) and the relative position of the coordinates of the current mouse movement is (X2, Y2), the first control needs to be moved to the coordinates (X, Y), X = X1 + W/2-X2 and Y = Y1 + H/2-Y2, so that the following effect of the searchlight or the laser point can be achieved.

if the current control mode is a second sub-mode in a second mode, acquiring a first image, wherein the first image comprises first display content of a first display interface of the upper computer;

constructing a first window on the top layer of a display interface of the upper computer;

amplifying the first image according to the amplification factor, and determining the position of a region to be displayed in the amplified first image according to the control information;

and displaying the amplified region to be displayed in the first image in the first window according to the position of the amplified region to be displayed in the first image.

In this embodiment, at least a part of the first display content in the first display interface may be displayed in an enlarged manner, and in some applications, the function is also referred to as a magnifying glass function.

An exemplary detailed data processing flow for the host computer to execute the embodiment is described below with a specific example.

Step B1: the mouse sends identification information for starting a magnifying glass mode to the upper computer so as to indicate that the current control mode of the mouse is the magnifying glass mode;

step B2: after an Application Programming Interface (API) of an operating system is called in a thread by a designated Application of the upper computer, intercepting identification information of a magnifier mode from the operating system, capturing all screen image data in a current display Interface of the upper computer by using a Graphic Device Interface (GDI) mode, obtaining a first image, and storing the first image into a cache;

step B3: creating a first window, and setting the first window as a top window of an operating system, wherein the first window is a rectangular window;

step B4: in combination with the width and height of the first window, an oval or circular area is cut in the first window by setting the fillet value of the first window, wherein the rectangle is square, and the fillet values x and y are 1/2 for the width and height of the square respectively, and at this time, the first window can be adjusted to be a circular window or an oval window;

step B5: the library function of the calling system sets the transparency and/or color in the first window, and may also set the color and/or transparency outside the first window, e.g., fully transparent inside the first window and semi-transparent outside the first window.

Step B6: the designated application of the upper computer can start a timer, and the movement condition of the mouse is determined in real time according to control information about mouse movement operation sent by the mouse. If the mouse is determined to move according to the control information, the feature point of the area to be displayed of the amplified first image can correspondingly move according to the control information and the time information of the timer.

Step B7: according to the control information about the mouse moving operation, the position of a characteristic point of a to-be-displayed area of the enlarged first image is determined, the position of the characteristic point is used for representing the position of the to-be-displayed area in the enlarged first image displayed in the first window, and the first image is enlarged according to the enlargement factor. And determining a region to be displayed in the amplified first image according to the position of the characteristic point and the size of the first window, and drawing the region to be displayed into the first window in a GDI (graphics device interface) mode, thereby realizing the function of a magnifier.

if the current control mode is a third sub-mode in the second mode, acquiring a second image, wherein the second image comprises second display content of a second display interface of the upper computer;

constructing a second window on the top layer of the display interface of the upper computer;

displaying the second image in the second window;

and drawing target content on the second image displayed by the second window according to the control information.

In this embodiment, the second image may be annotated, and in some applications, this function is also referred to as an annotation function.

Step C1: the mouse sends identification information for starting an annotation mode to the upper computer so as to indicate that the current control mode of the mouse is the annotation mode;

step C2: after an Application Programming Interface (API) of an operating system is called in a thread by a designated Application of the upper computer, intercepting identification information of a comment mode from the operating system, capturing all screen image data in a current display Interface of the upper computer by using a Graphic Device Interface (GDI) mode, obtaining a second image, and storing the second image into a cache;

step C3: creating a second window, and setting the second window as a top window of an operating system, wherein the second window is a rectangular window;

step C4: the designated application of the upper computer can start a timer, and the movement condition of the mouse is determined in real time according to control information about mouse movement operation sent by the mouse. And if the mouse is determined to move according to the control information, drawing a line on the second image according to the movement condition of the mouse.

For example, the initial position and the current position of the line may be determined according to the drawing instruction and the movement of the mouse, and then the coordinate value of the position point between the initial position and the current position of the line may be acquired using the LineDDA function. The LineDDA function is an API of the operating system, and is used to obtain known movement track data between two coordinate points, that is, to obtain coordinate values of a plurality of position points of the movement track. After the LineDDA function obtains the coordinate values of the plurality of position points, a callback function (lineddaallback function) may be defined for the LineDDA function, so as to split the movement track of the line and draw the track segment obtained by splitting. A callback function is a function called by a function pointer, and is called by another party when a specific event or condition occurs, for responding to the specific event or condition. Calling a LineDDACallback function to divide the moving track, acquiring coordinate values of a plurality of position points in the LineDDA function, sequentially transmitting the coordinate values of the position points to the LineDDACallback function as parameters, and when the coordinate values of 2 or more position points are transmitted, the LineDDACallback function responds to the transmitted coordinate values of the position points to divide the moving track. Specifically, after a coordinate value of a position point is transmitted, the LineDDACallback function obtains a track segment according to the currently transmitted parameter and the coordinate value of the position point transmitted last time, and a plurality of track segments can be obtained as the coordinate value of the position point is continuously transmitted. Constructing a moving track of a drawing point of the line; and dividing the moving track to obtain a plurality of track segments, and respectively drawing lines corresponding to each track segment. The color, thickness and other formats of the lines may be preset, and the colors and other formats of different track segments in the lines may also be different.

It should be understood that, the sequence numbers of the steps in the foregoing embodiments do not imply an execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation to the implementation process of the embodiments of the present application.

Corresponding to the control method applied to the mouse in the above embodiments, the embodiments of the present application provide a control device applied to the mouse, and for convenience of description, only the relevant portions of the embodiments of the present application are shown.

The control device includes:

the first determining module is used for determining the control type of the control information corresponding to the specified mouse operation when the control information corresponding to the specified mouse operation of the mouse is acquired;

the second determination module is used for determining a target channel from at least two preset channels according to the current control mode of the mouse if the control type is a target control type, wherein information used for controlling different elements in a display interface of the upper computer can be sent to the upper computer through different preset channels;

and the sending module is used for sending the control information corresponding to the operation of the specified mouse to the upper computer through the target channel, the upper computer is connected with the mouse, and the control information is used for controlling the upper computer.

Optionally, the second determining module includes:

the first determining unit is used for determining that the target channel is a first channel or a second channel if the current control mode is the first mode, wherein when the current control mode is the first mode, the control information is used for controlling a designated cursor in the upper computer;

the second determining unit is used for determining that the target channel is a second channel if the current control mode is a second mode, wherein when the current control mode is the second mode, the control information is used for controlling a specified element in a display interface of the upper computer, the specified element is different from the specified cursor, and the second channel is used for realizing bidirectional communication between the mouse and the upper computer;

and the third determining unit is used for determining that the target channel is a third channel if the current control mode is the third mode, wherein when the current control mode is the third mode, the control information is used for realizing the function of the appointed key on the keyboard of the upper computer.

Optionally, the control device further comprises:

and the setting module is used for setting the current control mode of the mouse to be the third mode according to the third mode setting information if the third mode setting information is received from the upper computer through the second channel.

Optionally, the mouse comprises a left mouse button, a right mouse button, a mouse roller and at least one preset function button, and the appointed control information corresponding to the at least one preset function button can be sent to the upper computer through the second channel.

Optionally, if the current control mode is a first sub-mode in the second mode, the movement control information about the mouse movement operation in the designated mouse operation in the control information is used to determine the position of a first control in the display interface of the upper computer, the first control is located at the top layer of the display interface of the upper computer, and the transparency and/or the color of the first control is determined according to preset information.

Optionally, if the current control mode is a second sub-mode in a second mode, the control information is used to determine a position of a to-be-displayed area in the amplified first image, the to-be-displayed area is displayed in a first window in a display interface of the upper computer, the first image includes first display content of the first display interface of the upper computer, and the first window is located on a top layer of the display interface of the upper computer.

Optionally, if the current control mode is a third sub-mode in the second mode, the control information is used to determine target content, the target content is used to be drawn on a second image displayed on a second window, the second image includes second display content of a second display interface of the upper computer, and the second window is located on a top layer of the display interface of the upper computer.

Optionally, the first determining module is configured to:

Optionally, the current control mode of the mouse is determined according to mode setting information sent by the upper computer, or according to a receiving state of heartbeat packet data of the mouse, or according to an operation of a designated key on the mouse for the designated key.

Corresponding to the control method applied to the upper computer in the above embodiment, the embodiment of the present application provides a control device applied to the upper computer, and for convenience of description, only the relevant parts of the embodiment of the present application are shown.

The control device includes:

the third control module is used for acquiring control information corresponding to the designated mouse operation of the mouse from the mouse through a target channel, the control type of the control information is a target control type, the upper computer is connected with the mouse, the target channel is determined from at least two preset channels based on the current control mode of the mouse, and the upper computer can acquire information for controlling different elements in a display interface of the upper computer through different preset channels;

and the control module is used for controlling the upper computer according to the control information.

Optionally, if the current control mode is a first mode, the target channel is a first channel or a second channel, and when the current control mode is the first mode, the control information is used for controlling a designated cursor in the upper computer;

Optionally, the control module is specifically configured to:

Optionally, the control module specifically includes:

the first obtaining unit is used for obtaining a first image if the current control mode is a second sub-mode in a second mode, wherein the first image comprises first display content of a first display interface of the upper computer;

the first construction unit is used for constructing a first window on the top layer of the display interface of the upper computer;

the fourth determining unit is used for amplifying the first image according to the amplification factor and determining the position of the area to be displayed in the amplified first image according to the control information;

and the first display unit is used for displaying the amplified region to be displayed in the first image in the first window according to the position of the amplified region to be displayed in the first image.

Optionally, the control module specifically includes:

the second obtaining unit is used for obtaining a second image if the current control mode is a third sub-mode in the second mode, wherein the second image comprises second display content of a second display interface of the upper computer;

the second construction unit is used for constructing a second window on the top layer of the display interface of the upper computer;

a second display unit configured to display the second image in the second window;

and the drawing unit is used for drawing the target content on the second image displayed by the second window according to the control information.

It should be noted that, for the information interaction, execution process, and other contents between the above-mentioned devices/units, the specific functions and technical effects thereof are based on the same concept as those of the embodiment of the method of the present application, and specific reference may be made to the part of the embodiment of the method, which is not described herein again.

Fig. 6 is a schematic structural diagram of a mouse according to an embodiment of the present application. As shown in fig. 6, the mouse 6 of this embodiment includes: at least one processor 60 (only one is shown in fig. 6), a memory 61, and a computer program 62 stored in the memory 61 and operable on the at least one processor 60, wherein the processor 60 executes the computer program 62 to implement the steps in any of the above-mentioned control method embodiments applied to the mouse.

The mouse 6 may include, but is not limited to, a processor 60, a memory 61. The mouse 6 may be a wired mouse or a wireless mouse. In this embodiment, the specific type of the mouse is not limited herein. It will be appreciated by those skilled in the art that fig. 6 is merely an example of the mouse 6 and is not intended to limit the mouse 6. For example, in the mouse, the memory 61 and the processor 60 may be separate components, or the memory 61 may be located inside the processor 60 as a sub-component of the processor 60. The mouse 6 may comprise more or fewer components than shown, or some of the components may be combined, or different components, such as input devices, output devices, network access devices, etc. The input device may include a keyboard, a touch pad, a fingerprint sensor (for collecting fingerprint information of a user and direction information of a fingerprint), a microphone, a camera, and the like, and the output device may include a display, a speaker, and the like.

The Processor 60 may be a Central Processing Unit (CPU), and the Processor 60 may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable Gate arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The memory 61 may be an internal storage unit of the mouse 6 in some embodiments, such as a hard disk or a memory of the mouse 6. The memory 61 may be an external storage device of the mouse 6 in other embodiments, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), and the like, which are provided on the mouse 6. Further, the memory 61 may include both an internal storage unit and an external storage device of the mouse 6. The memory 61 is used for storing an operating system, an application program, a Boot Loader (Boot Loader), data, and other programs, such as program codes of the computer programs. The above-mentioned memory 61 may also be used to temporarily store data that has been output or is to be output.

In addition, although not shown, the mouse 6 may further include a network connection module, such as a bluetooth module Wi-Fi module, a cellular network module, and the like, which will not be described herein.

Fig. 7 is a schematic structural diagram of an upper computer according to an embodiment of the present application. As shown in fig. 7, the upper computer 7 of this embodiment includes: at least one processor 70 (only one is shown in fig. 7), a memory 71, and a computer program 72 stored in the memory 71 and executable on the at least one processor 70, wherein the processor 70 implements the steps of any of the above-mentioned embodiments of the control method applied to the upper computer when executing the computer program 72.

The upper computer 7 may include, but is not limited to, a processor 70 and a memory 71. Those skilled in the art will appreciate that fig. 7 is only an example of the upper computer 7, and does not constitute a limitation to the upper computer 7, and may include more or less components than those shown, or combine some components, or different components, and may further include, for example, an input device, an output device, a network access device, and the like. The input device may include a keyboard, a touch pad, a fingerprint sensor (for collecting fingerprint information of a user and direction information of a fingerprint), a microphone, a camera, and the like, and the output device may include a display, a speaker, and the like.

The Processor 70 may be a Central Processing Unit (CPU), and the Processor 70 may also be other general-purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field-Programmable Gate arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, and the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The storage 71 may be an internal storage unit of the upper computer 7 in some embodiments, such as a hard disk or a memory of the upper computer 7. In other embodiments, the memory 71 may be an external storage device of the upper computer 7, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), or the like provided on the upper computer 7. Further, the memory 71 may include both an internal storage unit of the upper computer 7 and an external storage device. The memory 71 is used for storing an operating system, an application program, a Boot Loader (Boot Loader), data, and other programs, such as program codes of the computer programs. The above-mentioned memory 71 may also be used to temporarily store data that has been output or is to be output.

In addition, although not shown, the upper computer 7 may further include a network connection module, such as a bluetooth module Wi-Fi module, a cellular network module, and the like, which is not described herein again.

An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the steps in the control method embodiments applied to the mouse may be implemented.

The embodiment of the present application provides a computer program product, which when running on a terminal device, enables the terminal device to implement the steps in the control method embodiments applied to the mouse when executed.

The embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored, and when the computer program is executed by a processor, the steps in each control method embodiment applied to the upper computer may be implemented.

The embodiment of the application provides a computer program product, and when the computer program product runs on a terminal device, the steps applied to each control method embodiment of an upper computer can be realized when the terminal device executes.

The integrated unit may be stored in a computer-readable storage medium if it is implemented in the form of a software functional unit and sold or used as a separate product. Based on such understanding, all or part of the processes in the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium and can implement the steps of the embodiments of the methods described above when the computer program is executed by a processor. The computer program includes computer program code, and the computer program code may be in a source code form, an object code form, an executable file or some intermediate form. The computer-readable medium may include at least: any entity or device capable of carrying computer program code to a photographing apparatus/terminal apparatus, a recording medium, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), an electrical carrier signal, a telecommunications signal, and a software distribution medium. Such as a usb-disk, a removable hard disk, a magnetic or optical disk, etc. In certain jurisdictions, computer-readable media may not be an electrical carrier signal or a telecommunications signal in accordance with legislative and patent practice.

In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and reference may be made to the related descriptions of other embodiments for parts that are not described or illustrated in a certain embodiment.

Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the embodiments provided in the present application, it should be understood that the disclosed apparatus/network device and method may be implemented in other ways. For example, the above-described apparatus/network device embodiments are merely illustrative, and for example, the division of the above modules or units is only one logical function division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

The above embodiments are only used for illustrating the technical solutions of the present application, and not for limiting the same; although the present application has been described in detail with reference to the foregoing embodiments, it should be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not substantially depart from the spirit and scope of the embodiments of the present application and are intended to be included within the scope of the present application.

Claims

1. A control method is applied to a mouse, and comprises the following steps:

if the control type is a target control type, determining a target channel from at least two preset channels according to the current control mode of the mouse, wherein information for controlling different elements in a display interface of the upper computer can be sent to the upper computer through different preset channels; wherein, the preset channel may be a bluetooth human interface device HID channel, and the determining a target channel from at least two preset channels according to the current control mode of the mouse includes:

if the current control mode is a first mode which is a mode of a common mouse, determining that the target channel is a first channel or a second channel, wherein when the current control mode is the first mode, the control information is used for controlling a designated cursor in the upper computer; if the current control mode is a first mode, determining that the target channel is a first channel or a second channel according to the priorities of the first channel and the second channel in the first mode and the communication condition of the channels;

if the current control mode is a second mode, determining that the target channel is a second channel, wherein when the current control mode is the second mode, the control information is used for controlling a designated element in a display interface of the upper computer, the designated element is different from the designated cursor, and the second channel is used for realizing bidirectional communication between the mouse and the upper computer so as to be used for transmitting mode switching information, a heartbeat packet, the positioning precision of the mouse and other parameter setting information between the upper computer and the mouse;

the second mode comprises a first sub-mode, a second sub-mode and a third sub-mode, and elements in the upper computer corresponding to different sub-modes are different;

if the current control mode is a first sub-mode in a second mode, movement control information about mouse movement operation in specified mouse operation in the control information is used for determining the position of a first control in a display interface of the upper computer, the first control is located at the top layer of the display interface of the upper computer, and the transparency and/or color of the first control are determined according to preset information and are used for realizing functions of a searchlight and a laser pen on the display interface of the upper computer;

if the current control mode is a second sub-mode in a second mode, the control information is used for determining the position of a to-be-displayed area in an amplified first image, the to-be-displayed area is displayed in a first window in a display interface of the upper computer, the first image comprises first display content of the first display interface of the upper computer, and the first window is positioned on the top layer of the display interface of the upper computer; the control information is used for determining the positions of the characteristic points of the area to be displayed so as to represent the positions of the area to be displayed through the positions of the characteristic points; the characteristic point of the area to be displayed of the first image is the central point of the area to be displayed of the first image; the size and the shape of the area to be displayed of the first image are determined according to the magnification factor and the size of the first window; the magnification factor is determined according to the control information, the movement control information corresponding to the mouse movement operation is used for determining the position of the characteristic point of the area to be displayed of the first image, and the rolling control information corresponding to the rolling operation of the mouse roller is used for determining the magnification factor;

if the current control mode is a third sub-mode in the second mode, the control information is used for determining target content, the target content is used for drawing a second image displayed on a second window, the second image comprises second display content of a second display interface of the upper computer, and the second window is positioned at the top layer of the display interface of the upper computer; the target content is track and shape content drawn on the second display interface, the track is drawn according to a timer in the upper computer and movement control information corresponding to movement operation of the mouse, and the second image is annotated;

if third mode setting information is received from the upper computer through the second channel, setting the current control mode of the mouse to be a third mode according to the third mode setting information;

if the current control mode is a third mode, determining that the target channel is a third channel, wherein when the current control mode is the third mode, the control information is used for realizing the function of a designated key on a keyboard of the upper computer; sending control information corresponding to the operation of the specified mouse to the upper computer through the target channel, wherein the upper computer is connected with the mouse, and the control information is used for controlling the upper computer;

the mouse comprises a left mouse button, a right mouse button, a mouse roller and at least one preset function button, and appointed control information corresponding to the at least one preset function button can be sent to the upper computer through the second channel.

2. The method according to claim 1, wherein the determining the control type of the control information corresponding to the specified mouse operation when the control information corresponding to the specified mouse operation of the mouse is acquired includes:

3. The control method according to any one of claims 1 to 2, wherein the current control mode of the mouse is determined according to mode setting information sent by the upper computer, or according to a receiving state of heartbeat packet data of the mouse, or according to a specified key operation on the mouse for a specified key.

4. A control method is applied to an upper computer, and comprises the following steps:

the method comprises the steps that control information corresponding to designated mouse operation of a mouse is obtained from the mouse through a target channel, the control type of the control information is a target control type, the upper computer is connected with the mouse, the target channel is determined from at least two preset channels based on the current control mode of the mouse, and the upper computer can obtain information for controlling different elements in a display interface of the upper computer through different preset channels; the preset channel can be a Bluetooth Human Interface Device (HID) channel; if the current control mode is a first mode which is a mode of a common mouse, determining that the target channel is a first channel or a second channel, wherein when the current control mode is the first mode, the control information is used for controlling a designated cursor in the upper computer; if the current control mode is a first mode, determining that the target channel is a first channel or a second channel according to the priorities of the first channel and the second channel in the first mode and the communication condition of the channels;

if the current control mode is a third mode, determining that the target channel is a third channel, wherein when the current control mode is the third mode, the control information is used for realizing the function of a designated key on a keyboard of the upper computer;

controlling the upper computer according to the control information;

5. A mouse comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that the processor implements the control method according to any one of claims 1 to 3 when executing the computer program.

6. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, implements the control method according to any one of claims 1 to 3.

7. A host computer comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the control method according to claim 4 when executing the computer program.

8. A computer-readable storage medium, in which a computer program is stored, which, when being executed by a processor, implements the control method according to claim 4.