WO2014206322A1 - Terminal input signal generation method, device and terminal - Google Patents

Terminal input signal generation method, device and terminal Download PDF

Info

Publication number
WO2014206322A1
WO2014206322A1 PCT/CN2014/080866 CN2014080866W WO2014206322A1 WO 2014206322 A1 WO2014206322 A1 WO 2014206322A1 CN 2014080866 W CN2014080866 W CN 2014080866W WO 2014206322 A1 WO2014206322 A1 WO 2014206322A1
Authority
WO
WIPO (PCT)
Prior art keywords
tapping
mobile phone
signal
terminal
operating platform
Prior art date
Application number
PCT/CN2014/080866
Other languages
French (fr)
Chinese (zh)
Inventor
郭泽金
何峰
尹航
Original Assignee
华为终端有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为终端有限公司 filed Critical 华为终端有限公司
Publication of WO2014206322A1 publication Critical patent/WO2014206322A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1626Constructional details or arrangements for portable computers with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/0416Control or interface arrangements specially adapted for digitisers
    • G06F3/0418Control or interface arrangements specially adapted for digitisers for error correction or compensation, e.g. based on parallax, calibration or alignment
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/043Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means using propagating acoustic waves

Definitions

  • the present invention relates to the field of electronic technologies, and in particular, to a method, device and terminal for generating a terminal input signal.
  • the sound effect played by the user of the mobile phone when playing music on the soft keyboard keys of the mobile phone cannot be changed according to the degree of the weight of the soft keyboard of the mobile phone user, and the hot feeling of playing music by the mobile phone user cannot be stimulated.
  • the character input can only be performed through an input soft keyboard of the input method on the touch screen of the mobile phone, and the soft keyboard occupies the space of the touch screen when the character is input, so that the user inputs the character.
  • the screen space that is actually available becomes smaller, and the characters on the soft keyboard of the mobile phone input method are small and dense, and the user input is inconvenient.
  • Embodiments of the present invention provide a method for generating a terminal input signal, a device for generating a terminal input signal, and a terminal.
  • the tapping point position of the tapping signal on the first operating platform may be mapped to the operating position on the second operating platform, and the tapping signal is used as a trigger signal on the operating position on the second operating platform to generate the terminal.
  • the input signal expands the generation path of the terminal input signal, improves the convenience and interest of the terminal input signal generation, and improves the user experience of the terminal.
  • a first aspect of the embodiments of the present invention provides a method for generating a terminal input signal, including: acquiring a tap signal on a first operating platform;
  • the tapping signal is used as a trigger signal on an operation position on the second operating platform to generate a terminal input signal corresponding to the trigger signal for the terminal.
  • the first operating platform includes: the terminal body, a surface of a flat object on which the terminal is placed, and at least one of the terminal input devices;
  • the second operating platform is at least one of an input interface of an application of the terminal and a character input soft keyboard of the terminal.
  • the tapping signal includes: at least one of a vibration mechanical wave, a tapping time, and a tapping strength.
  • the determining, by the determining, the location of the tapping point of the tapping signal on the first operating platform includes: Position coordinates of each sensor in the terminal in the positioning coordinate system of the terminal, The sensor is configured to acquire the tapping signal and not less than three;
  • a timing of the vibration mechanical wave according to the tapping signal a timing at which the sensor receives the vibration mechanical wave, a tapping timing of the tapping signal, and a position of the respective sensor in a positioning coordinate system of the terminal Position coordinates, obtaining a position of a tapping point of the tap signal on the first operating platform in a positioning coordinate system of the terminal.
  • the tapping the tapping signal on the first operating platform The hit location is mapped to the operation location on the second operating platform, including:
  • the obtaining the tapping signal on the first operating platform includes: acquiring a tapping signal on the calibration point on the terminal input device, and determining that the calibration point on the terminal input device is in the positioning coordinate Location in the system;
  • mapping the location of the tapping point of the tapping signal on the first operating platform to the second operation Operating locations on the platform, including:
  • the terminal input device includes: at least one of an input keyboard drawing of the terminal, and an input drawing customized by the terminal user. kind.
  • the using the tapping signal as the second operating platform generates a terminal input signal corresponding to the trigger signal for the terminal, including:
  • tapping signal as a trigger signal on an operation position on the second operating platform, and generating a signal strength corresponding to the tapping strength of the tapping signal according to the tapping intensity of the tapping signal Terminal input signal.
  • the terminal includes: a mobile phone, a tablet computer, a notebook computer, a digital camera, a digital video camera At least one.
  • a second aspect of the embodiments of the present invention provides an apparatus for generating a terminal input signal, including: an acquiring module, configured to acquire a tapping signal on a first operating platform;
  • a positioning module configured to determine a location of a tapping point of the tapping signal on the first operating platform
  • mapping module configured to map a tapping point position of the tapping signal on the first operating platform to an operating position on the second operating platform
  • the trigger signal on the terminal generates a terminal input signal corresponding to the trigger signal for the terminal.
  • the first operating platform includes: the terminal body, a surface of a flat object on which the terminal is placed, and at least one of the terminal input devices;
  • the second operating platform is at least one of an input interface of an application of the terminal and a character input soft keyboard of the terminal.
  • the tapping signal includes: at least one of a vibration mechanical wave, a tapping time, and a tapping strength.
  • the positioning module includes:
  • a collecting unit configured to collect position coordinates of each sensor in the terminal in a positioning coordinate system of the terminal, where the sensor is configured to acquire the tapping signal and not less than three; a propagation velocity of the vibration mechanical wave according to the tapping signal, a timing at which the sensor receives the vibration mechanical wave, a tapping timing of the tapping signal, and a positioning coordinate system of the respective sensor at the terminal Position coordinates in the middle, obtaining a position of a tapping point of the tapping signal on the first operating platform in a positioning coordinate system of the terminal.
  • mapping module is specifically configured to:
  • the terminal further includes:
  • a calibration set module configured to acquire a tap signal of a calibration point on the terminal input device, and determine a position of a calibration point on the terminal input device in a positioning coordinate system of the terminal; a calibration module, configured to Determining a position of the calibration point in the positioning coordinate system of the terminal, and a position of the calibration point on the terminal input device, determining a relative position of the terminal input device and the terminal.
  • the mapping module includes:
  • a determining unit configured to determine, according to a position of a tapping point of a tapping signal on the first operating platform in a positioning coordinate system of the terminal, and a relative position of the terminal input device and the terminal, An operating position of the tap signal on the terminal input device;
  • a mapping unit configured to map a tapping point position of a tapping signal on the terminal input device according to a preset correspondence between an operation position on the terminal input device and an operation position on the second operating platform It is the operating position of the second operating platform.
  • the terminal input device includes: at least one of an input keyboard drawing of the terminal, and an input drawing customized by the terminal user kind.
  • the generating module is specifically configured to:
  • tapping signal as a trigger signal on an operation position on the second operating platform, and generating a signal strength corresponding to the tapping strength of the tapping signal according to the tapping intensity of the tapping signal Terminal input signal.
  • the terminal includes: a mobile phone, a tablet computer, a notebook computer, a digital camera, a digital video camera At least one.
  • a third aspect of the embodiments of the present invention provides a terminal, including:
  • a sensor configured to acquire a tap signal on the first operating platform
  • a processor configured to determine a tapping point position of the tapping signal on the first operating platform, and map a tapping point position of the tapping signal on the first operating platform to the second Operating the position on the platform, and using the tapping signal as a trigger signal on the operating position on the second operating platform to generate a terminal input signal corresponding to the trigger signal for the terminal.
  • the first operating platform includes: the terminal body, a surface of a flat object on which the terminal is placed, and at least one of the terminal input devices;
  • the second operating platform is at least one of an input interface of an application of the terminal and a character input soft keyboard of the terminal.
  • the tapping signal includes: at least one of a vibration mechanical wave, a tapping time, and a tapping strength.
  • the terminal further includes a memory, where the memory is used for storing
  • the processor maps the location of the tapping point on the first operating platform to the operating position on the second operating platform, specifically:
  • the processor determines that the tapping signal is in the When operating a tap point on a platform, it is also used to:
  • the processor is configured to map a tapping point position of the tapping signal on the first operating platform to the When operating the position on the second operating platform, it is also specifically used;
  • the terminal input device includes: at least one of an input keyboard drawing of the terminal and an input drawing customized by the terminal user.
  • the processor is configured to use the tapping signal as the first
  • the trigger signal on the operating position on the second operating platform is used to generate a terminal input signal corresponding to the trigger signal for the terminal, specifically for:
  • tapping signal as a trigger signal on an operation position on the second operating platform, and generating a signal strength corresponding to the tapping strength of the tapping signal according to the tapping intensity of the tapping signal Terminal input signal.
  • the terminal includes: at least one of a mobile phone, a tablet computer, a notebook computer, a digital camera, and a digital video camera.
  • the tapping signal on the first operating platform is obtained, the tapping point position of the tapping signal on the first operating platform is determined, and the tapping point of the tapping signal on the first operating platform is determined.
  • the mapping is mapped to an operation position on the second operating platform, and the tapping signal is used as a trigger signal to generate an input signal of the terminal.
  • the embodiment of the invention can convert the tapping information on the first operation platform of the terminal into the input signal of the terminal, expand the generation path of the terminal input signal, enhance the convenience and interest of generating the input signal of the terminal, and improve the terminal. User experience.
  • FIG. 1 is a schematic flow chart of a first embodiment of a method for generating a terminal input signal according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram showing the principle of determining the location of a tap point of a tap signal in the first embodiment of the method for generating a terminal input signal according to an embodiment of the present invention
  • FIG. 3 is another schematic diagram of determining a location of a tap point of a tap signal in a first embodiment of a method for generating a terminal input signal according to an embodiment of the present invention
  • FIG. 4 is an operational diagram of mapping a tap point position of a tap signal to an operation position of a second operating platform in the first embodiment of the method for generating a terminal input signal according to an embodiment of the present invention
  • FIG. 5 is a schematic flowchart diagram of a second embodiment of a method for generating a terminal input signal according to an embodiment of the present disclosure
  • FIG. 6 is a schematic diagram of a location of a terminal and a first operating platform thereof in a second embodiment of a method for generating a terminal input signal according to an embodiment of the present invention
  • FIG. 7 is a schematic diagram of another location of a terminal and its first operating platform in a second embodiment of a method for generating a terminal input signal according to an embodiment of the present invention
  • FIG. 8 is a schematic diagram of determining a positional relationship between a second operating platform and a terminal in a second embodiment of a method for generating a terminal input signal according to an embodiment of the present invention
  • FIG. 9 is a schematic structural diagram of a first embodiment of an apparatus for generating a terminal input signal according to an embodiment of the present invention.
  • FIG. 10 is a schematic structural diagram of a positioning module of a terminal in a first embodiment of an apparatus for generating a terminal input signal according to an embodiment of the present disclosure
  • FIG. 11 is a schematic structural diagram of a second embodiment of an apparatus for generating a terminal input signal according to an embodiment of the present invention.
  • FIG. 12 is a schematic structural diagram of a first embodiment of a terminal according to an embodiment of the present invention. detailed description
  • the terminal described in the embodiment of the present invention may include: a mobile phone, a tablet computer, a notebook computer, a digital camera, a digital video camera, and the like.
  • the above terminals are only examples, not exhaustive.
  • the method for generating a terminal input signal and the terminal provided by the embodiment of the present invention will be specifically described below by taking a mobile phone as an example.
  • FIG. 1 is a schematic flowchart diagram of a first embodiment of a method for generating a terminal input signal according to an embodiment of the present invention. It can include the steps of:
  • the first operating platform described in this embodiment may include: a terminal body, a surface of a flat object on which the terminal is placed, an input device of the terminal, and the like.
  • the first operating platform described in this embodiment may be The phone itself, or the horizontal desktop, ground, mobile phone input keyboard drawings, user-defined input drawings, etc.
  • the user wants to generate a terminal input signal, he can tap on the mobile phone (including the back of the mobile phone or other parts of the mobile phone) or the desktop of the mobile phone, and the mobile phone can obtain the mobile phone or place the mobile phone through its built-in sensor.
  • a tap signal on the desktop to generate an input signal of the mobile phone based on the tap signal.
  • the tapping signal on the first operating platform may include: a vibration mechanical wave, a tapping time, a tapping intensity, and the like.
  • a mobile phone user plays the game using the piano in the mobile application
  • the mobile phone function can be turned on before the game is played, that is, according to the first operation.
  • the tapping signal generates a phone function that the piano plays the input signal of the game.
  • the tapping action of playing music can be performed on the back of the mobile phone or on the desktop where the mobile phone is placed, and the mobile phone obtains the tapping signal on the back of the mobile phone or the desktop of the mobile phone through the built-in sensor.
  • the input signal of the mobile phone piano playing can be generated according to the tapping signal.
  • the mobile phone user does not need to input the playing signal through the virtual keyboard of the piano playing the game, and only needs to perform the tapping action of the playing music on the first operating platform to complete the signal input of the piano playing.
  • a startup mode of starting the function of generating the mobile phone input signal of the mobile phone may be set.
  • the mobile phone user wants to activate the mobile phone function (that is, the mobile phone function for generating the mobile phone input signal according to the tap signal)
  • the tapping action can be performed at the designated position on the first operating platform, and the mobile phone obtains the tapping signal at the specified position. This phone function can then be activated.
  • the mobile phone user can perform corresponding knocking on the designated position of the mobile phone when starting to play the music.
  • the action of the mobile phone is used to activate the function of the mobile phone.
  • the function of the mobile phone is a function of generating an input signal of a piano playing game of the mobile phone according to the tapping signal, and the built-in sensor of the mobile phone can obtain the tapping signal at the designated position of the mobile phone. Start this phone function yourself.
  • a mobile phone user plays the game on the piano in the application using the mobile phone, he can first tap on the top left corner, the upper right corner, the lower right corner, and the lower left corner of the mobile phone to start playing, and the mobile phone obtains the above mobile phone.
  • the corresponding mobile phone function can be activated (ie, the function of starting the input signal of the piano to generate the piano playing according to the tapping signal);
  • the mobile phone user wants to end the game the mobile phone can be in the lower left corner of the mobile phone. In the lower right corner, the upper right corner, and the upper left corner, each taps to indicate the end of the play.
  • the mobile game application server can be turned off by itself, and the piano playing is no longer received. input signal.
  • hand The user can also tap on the top, bottom, left, and right sides of the phone to start playing, and tap on the right, left, bottom, and top of the phone to end the play.
  • the manner in which the above actions are started and ended is only an example, not an exhaustive one.
  • the tapping point of the tapping signal on the first operating platform may be determined according to the tapping signal.
  • a positioning coordinate system of a mobile phone may be set with a specific point on the mobile phone (for example, the center of gravity of the mobile phone) as a coordinate origin, and the mobile phone may be set in a plane where the mobile phone display screen is located or a plane where the mobile phone back cover is located.
  • the direction of the bottom edge of the mobile phone is the X axis
  • the direction of the side of the mobile phone is the y axis, which is used to determine the tapping point position of the tapping signal on the operating platform such as the mobile phone or the desktop on which the mobile phone is placed.
  • the coordinate axis of the positioning coordinate system of the mobile phone may be preset in advance for the coordinate origin of the specific point on the mobile phone, and the position of each sensor in the mobile phone in the positioning coordinate system is determined according to the positioning coordinate system, for example, as shown in FIG. 2 . Shown.
  • the position of the sensor 1, the sensor 2, the sensor 3, and the sensor 4 in the positioning coordinate system is determined to be (xl, yl), (x2, y2) according to the positioning coordinate system of the mobile phone.
  • ( x 3 , y3 ) , ( x4 , y4 ) wherein, since the position of the built-in sensor of the mobile phone relative to the mobile phone is a fixed position, the positions of the above-mentioned respective sensors in the positioning coordinate system are all determined positions, that is, xl, yl , x2, y2, x3, y3, x4, y4 are all known numbers.
  • the mobile phone After determining the position of the built-in sensor 1, sensor 2, sensor 3, and sensor 4 of the mobile phone, when the mobile phone user taps on the tapping point (X, y) on the first operating platform at time t, the vibration mechanical wave is generated and directed After being spread around, the mobile phone can receive the vibration mechanical wave of the tap signal according to each sensor at time t1 (the time of the vibration mechanical wave received by the sensor 1), t 2 (the time of the vibration mechanical wave received by the sensor 2), t 3 (sensor 3) The time of the received vibrational mechanical wave), t 4 (the time of the vibration mechanical wave received by the sensor 4), and the time at which the tapping signal is generated, that is, the tapping time t of the tapping signal and the propagation velocity V of the vibrating mechanical wave, calculate each of the mobile phones Sensor The distance from the tapping point position of the tap signal.
  • the mobile phone can combine the position coordinates of each sensor in the mobile phone in the positioning coordinate system, and multiply the propagation speed of the vibration mechanical wave by the time equal to the propagation distance of the vibration mechanical wave ( That is, the distance between the position of the tapping point and each sensor is processed.
  • the distance between each sensor and the position of the striking point is obtained, the propagation speed of the vibrating mechanical wave of the striking signal, the time point when the sensor receives the vibrating mechanical wave, and the tapping time of the tapping signal.
  • the relationship equation is as follows: 4 yuan 2 equations:
  • v, t, x, and y are unknowns in the above data, you can process v, t, x, and y by a preset value, and by iterative calculation, you can know that v , t, x, and y are four.
  • the value of the unknown number determines the tapping point position (X, y) of the tapping signal on the first operating platform.
  • the propagation speed of the vibration mechanical wave in the specific medium is fixed, and the medium used for the mobile phone case is fixed and known (because the material of the mobile phone case is determined by the mobile phone, the mobile phone case is used for the mobile phone case)
  • the medium is also known to be identifiable.
  • the propagation speed of the vibrating mechanical wave on the casing of the mobile phone is also fixed and can be stored in advance in the mobile phone.
  • the propagation velocity V of the vibration mechanical wave generated by the tapping on the mobile phone becomes a known amount, and the calculation of the above-mentioned 4 yuan equation 1 is performed.
  • the propagation velocity V can be treated as a known number.
  • the position of the tapping point of the tapping signal on the mobile phone in the positioning coordinate system (X, y) can be processed by the three sensors. If there are the above four sensors, the calculation accuracy of the position of the tapping point can be estimated according to the least squares method. In this embodiment, at least three sensors for acquiring the tapping signal are required, at most, not limited.
  • the tapping signal is outside the mobile phone, that is, when the first operating platform is a platform such as a desktop on which the mobile phone is placed, since the material of the desktop may be of various types (such as wood, plastic, iron, etc.),
  • the propagation medium of the vibration mechanical wave of the hitting signal becomes an unfixed medium, and the mobile phone cannot predetermine the propagation velocity V of the vibration mechanical wave of the tapping signal on the desktop currently placed on the mobile phone, that is, the propagation velocity V of the vibration mechanical wave at this time is unknown.
  • the values of the four unknowns of v, t, x, and y can be determined according to the data acquired by the four sensors of the mobile phone, thereby determining the tapping signal.
  • the mobile phone judges, according to the data obtained by the above sensor, the speed of the vibration mechanical wave on the current propagation medium (ie, the desktop on which the mobile phone is placed), when the mobile phone user taps the second time on the same medium, that is, the mobile phone user places the mobile phone.
  • the mobile phone user can obtain the 4-element second-order equation corresponding to the tapping signal of the second tap according to the above method, and can determine the propagation velocity v of the vibrating mechanical wave (ie, the vibrating mechanical wave) in the first tapping.
  • the propagation speed on the desktop where the mobile phone is placed is substituted into the above 4-ary equation 2, and then combined with any three of the equations to obtain the tapping signal of the second tap on the first operating platform. Is the coordinates (xl, yl) in the phone coordinate system.
  • the user can directly obtain the tapping point position 2 of the tapping signal of the second tap on the first operating platform according to the above 4-ary equation 2 (assuming coordinates (x2, y2) in the mobile coordinate system. ), and according to the position 1 of the tapping point obtained in the previous processing, it is judged whether the coordinates of the tapping point position 2 (x2, y2) and the tapping point position 1 (xl, yl) coincide or whether the error is within the set error range, In this way, the calculation accuracy of the tapping point position of the tap signal on the first operating platform is estimated.
  • S103 Map a tapping point position of the tap signal on the first operating platform to an operating position on the second operating platform.
  • S 1 04 using the tapping signal as a trigger signal on an operation position on the second operating platform, and generating a terminal input signal corresponding to the trigger signal for the terminal.
  • the second operating platform is an input platform of an application input interface of the terminal, a character input soft keyboard of the terminal, and the like.
  • the virtual keyboard of the piano playing game in the application on the mobile phone the character input soft keyboard of the mobile phone input method, the shooting button on the photographing function interface of the mobile phone, and the like.
  • the above operation buttons are only examples, not exhaustive.
  • the operation position on the second operating platform may be: a key value of an input button of the application of the terminal, a key value of a character input soft keyboard of the terminal, a touch position on a touch screen of the terminal, etc., for example, an application on the mobile phone
  • a perceptible tapping area of the mobile phone may be set in advance by using the positioning coordinate system of the mobile phone as a reference system. For example, a side length of the mobile phone positioning coordinate system may be set to be 2 ⁇ long.
  • Width 2Y (where the specific values of X and Y can be set at the same time as setting the positioning coordinate system of the mobile phone, or can be customized by the user of the mobile phone), the square area of the mobile phone is the perceptible area of the mobile phone, and the above-mentioned perceptible is set.
  • the operation position on the second operating platform of the mobile phone corresponding to each tapping position in the area (specifically, the key value of the button on the second operating platform of the mobile phone, etc.), and all the corresponding relationships are stored in the mobile phone positioning database.
  • the mobile phone user places the mobile phone smoothly and determines the first operating platform of the mobile phone (such as the mobile phone body or the desktop on which the mobile phone is placed), the mobile phone can determine the current first according to its positioning coordinate system.
  • a perceptible area on the operating platform (such as a specific area on the phone body or a specific area on the desktop where the phone is placed).
  • the mobile phone user performs a tapping action within the perceptible area of the first operating platform, the mobile phone can position the tapping point of the tapping signal on the first operating platform in the positioning coordinate system and the pre-stored positioning.
  • the database performs matching to determine an operation position on the second operating platform corresponding to the position of the tap point on the current first operating platform. For example, in the scenario shown in FIG. 2, after the mobile phone user makes a tapping action on the back of the mobile phone, the mobile phone determines that the tapping point position of the tapping signal on the mobile phone can be matched through the built-in positioning database of the mobile phone.
  • tapping point on the back of the phone to the key of the phone's piano playing game.
  • the tapping point of the tapping signal is at other positions on the back of the mobile phone, it can also be matched by the built-in positioning database of the mobile phone, and it is judged that the tapping point position of the tapping signal corresponds to the key of the button on the virtual key. value.
  • the mobile phone After the mobile phone determines that the key value of the specific key of the virtual keyboard of the piano playing game of the mobile phone corresponding to the tapping point position of the tapping signal is known, the mobile phone can use the tapping signal as a trigger signal of the key value, and the knocking The signal is used to trigger the built-in virtual piano application of the mobile phone, and the music playing manager of the mobile phone is called by the built-in virtual piano application of the mobile phone to play the music corresponding to the tapping signal. That is, the mobile phone can map the tapping point position of the tapping signal to the key value of the button on the virtual piano application on the mobile phone, and convert the tapping signal into a trigger signal of the button on the virtual piano application of the mobile phone, through the virtual state of the mobile phone.
  • the piano application calls the music playback manager to emit a tone corresponding to the button Corresponding tonal sound, and adjusting the music of the volume corresponding to the tapping intensity according to the tapping intensity of the tapping signal, that is, the mobile phone can emit different tones at different volume according to the tapping position of the mobile phone user and the tapping intensity music.
  • the user can adjust the tone and volume of the music emitted by the mobile phone according to his own tapping action, better mobilize the interest and passion of the mobile phone user to play music through the mobile phone, and also trigger the inspiration of the music creation of the mobile phone user, and improve the signal input. Interesting.
  • the location of the tapping point of the tapping signal on the operating platform such as the desktop of the mobile phone or the mobile phone is mapped to the operating position on the second operating platform of the mobile phone, and the tapping signal is used as the operating position.
  • the trigger signal is used to trigger the internal application of the mobile phone, generate a mobile phone input signal corresponding to the trigger signal, expand the generation path of the input signal of the mobile phone, improve the interest of generating the input signal of the mobile phone, and improve the user experience of the mobile phone.
  • FIG. 5 is a schematic flowchart of a second embodiment of generating a terminal input signal according to an embodiment of the present invention. It can include the steps of:
  • 5201 Obtain a tap signal on a calibration point on the terminal input device, and determine a position of the calibration point on the terminal input device in the positioning coordinate system of the terminal.
  • S202 Determine a relative position of the terminal input device and the terminal according to a position of the calibration point in a positioning coordinate system of the terminal, and a position of the calibration point on the terminal input device.
  • the first operating platform described in this embodiment may include: a terminal body, a surface of a flat object on which the terminal is placed, a terminal input device, and the like.
  • the first operating platform described in this embodiment may be the mobile phone itself, or a desktop on which the mobile phone is placed, or a mobile phone input keyboard drawing printed by the mobile phone user and placed on the desktop of the mobile phone together with the mobile phone (for example, in FIG. 6 The keyboard diagram shown, or the user-defined input drawing (such as the auxiliary drawing shown in Figure 7) printed by the mobile phone user and placed on the desktop of the mobile phone together with the mobile phone.
  • the above mobile phone input keyboard drawing or mobile phone user customized input is the terminal input device in the first operating platform described in this embodiment.
  • the input keyboard drawing of the above mobile phone and the input drawing of the user defined by the mobile phone are a special type of paper, and the paper includes information such as an input keyboard picture.
  • the input keyboard drawing of the mobile phone or the user-defined input drawing of the mobile phone can be smoothly placed on the desktop where the mobile phone is placed (ie, the desktop where the mobile phone is located), and the keyboard drawing or
  • the mobile phone user can make a tapping action on the input drawing of the mobile phone, and the mobile phone can obtain the input keyboard drawing of the mobile phone or the tapping signal on the input drawing of the mobile phone user through the tapping signal acquisition module such as the built-in sensor, etc., according to the knocking
  • the input signal of the signal generating terminal is clicked.
  • the tapping signal on the first operating platform may include: a vibration mechanical wave, a tapping time, a tapping intensity, and the like.
  • the mobile phone function may be first turned on, that is, according to the first operating platform (ie, the input keyboard drawing of the mobile phone).
  • the tapping signal on the phone generates a character input signal for the phone function.
  • the mobile phone obtains a tapping signal on the input keyboard drawing (terminal input device) of the mobile phone through its built-in sensor, and before inputting the input signal of the mobile phone input method according to the tapping signal, it is also necessary to confirm the input keyboard drawing of the mobile phone first.
  • the relative position with the mobile phone that is, the transformation relationship between the positioning coordinate system of the input keyboard drawing of the mobile phone and the positioning coordinate system of the mobile phone needs to be determined.
  • the mobile phone user needs to tap the calibration point on the input keyboard drawing of the mobile phone to calibrate the relative position of the input keyboard image of the mobile phone and the mobile phone.
  • the tapping point of the tapping signal on the first operating platform may be determined according to the tapping signal. Specifically, a specific point on the mobile phone (for example, the center of gravity of the mobile phone) may be used as the coordinate origin.
  • Positioning coordinate system of the mobile phone set the positioning coordinate system of the mobile phone in the plane where the mobile phone display screen is located or the plane where the mobile phone back cover is located, with the bottom direction of the mobile phone being the X axis, and the direction of the mobile phone side being the y axis,
  • the position of the tapping point of the tapping signal on the operating platform such as the mobile phone or the desktop on which the mobile phone is placed ie, the position of the tapping signal in the positioning coordinate system of the mobile phone).
  • a specific point on the mobile phone may be used to preset a coordinate axis of the positioning coordinate system for the coordinate origin, and according to the positioning coordinate system, determine the position of each sensor in the mobile phone in the positioning coordinate system, such as figure 2.
  • the position coordinates of the sensor 1, the sensor 2, the sensor 3, and the sensor 4 in the positioning coordinate system are determined according to the positioning coordinate system of the mobile phone as (xl, yl), (x2, y2).
  • the mobile phone After determining the position of the built-in sensor 1, sensor 2, sensor 3, and sensor 4 of the mobile phone, when the mobile phone user taps on the tapping point (X, y) on the first operating platform at time t, the vibration mechanical wave is generated and directed After the four-way diffusion, the mobile phone can receive the vibration mechanical wave of the tapping signal at each time t1 (the time of the vibration mechanical wave received by the sensor 1), t 2 (the time of the vibration mechanical wave received by the sensor 2), 13 (the sensor 3 receives) The time of the vibration mechanical wave), t 4 (the time of the vibration mechanical wave received by the sensor 4), combined with the tapping time t of the tapping signal and the propagation velocity V of the vibration mechanical wave, the vibration mechanical wave is transmitted from the tapping point of the tapping signal to The distance of each sensor.
  • the distance between each sensor and the tapping point position of the tapping signal is equal to the distance that the vibrating mechanical wave propagates from the tapping point of the tapping signal to each sensor, and thus the position coordinates of each sensor in the mobile phone in the positioning coordinate system of the mobile phone are combined.
  • the propagation speed of the vibration mechanical wave multiplied by the time equal to the propagation distance of the vibration mechanical wave ie, the distance between the position of the tap point and each sensor
  • the distance between each sensor and the position of the tap point and the propagation speed of the vibration mechanical wave of the tap signal are obtained, and the sensor receives
  • the relationship between the time point of the vibration mechanical wave and the tapping time point of the tapping signal such as The next 4 yuan 2 equations:
  • the values of four unknowns of v, t, x, and y can be processed by giving a preset value of ⁇ , t, x, y and by iterative calculation. , the position (X, y) of the tapping point of the tapping signal on the first operating platform can be determined.
  • the propagation speed of the vibration mechanical wave in the specific medium is fixed, and the medium used for the mobile phone case is fixed and known (because the material of the mobile phone case is determined by the mobile phone, the mobile phone case is used for the mobile phone case)
  • the medium is also known to be identifiable.
  • the propagation speed of the vibrating mechanical wave on the mobile phone casing is also fixed. It can be pre-stored in the mobile phone, and the mobile phone user performs a tapping action on the mobile phone (ie, the mobile phone casing). At this time, the propagation velocity V of the vibrating mechanical wave generated by the tap on the mobile phone becomes a known amount.
  • the tapping point is on the mobile phone (Fig.
  • the position of the tapping point of the tapping signal on the mobile phone in the positioning coordinate system (X, y) can be calculated by the three sensors. If there are the above four sensors, the calculation accuracy of the position of the tapping point can be estimated according to the least squares method. That is, in the embodiment, at least three sensors for acquiring the tapping signal are required, at most not limited.
  • the tapping signal is outside the mobile phone, that is, when the first operating platform is a platform such as a desktop on which the mobile phone is placed, since the material of the desktop may be of various types (such as wood, plastic, iron, etc.),
  • the propagation medium of the vibration mechanical wave of the hitting signal becomes an unfixed medium, and the mobile phone cannot predetermine the propagation velocity V of the vibration mechanical wave of the tapping signal on the desktop currently placed on the mobile phone, that is, the propagation velocity V of the vibration mechanical wave at this time is unknown.
  • the values of the four unknowns of v, t, x, and y can be determined according to the data obtained by the four sensors of the mobile phone, thereby determining the knocking.
  • Letter The position of the tap point on the first operating platform.
  • the mobile phone judges, according to the data obtained by the above sensor, the speed of the vibration mechanical wave on the current propagation medium (ie, the desktop on which the mobile phone is placed), when the mobile phone user taps the second time on the same medium, that is, the mobile phone user places the mobile phone.
  • the mobile phone user can obtain the 4-element second-order equation corresponding to the tapping signal of the second tap according to the above method, and can determine the propagation velocity v of the vibrating mechanical wave (ie, the vibrating mechanical wave) in the first tapping.
  • the propagation speed on the desktop where the mobile phone is placed is substituted into the above 4-ary equation 2, and then combined with any three of the equations to obtain the tapping signal of the second tap on the first operating platform. Is the coordinates (xl, yl) in the phone coordinate system.
  • the user can directly obtain the tapping point position 2 of the tapping signal of the second tap on the first operating platform according to the above 4-ary equation 2 (assuming coordinates (x2, y2) in the mobile coordinate system. ), and according to the position 1 of the tapping point obtained in the previous processing, it is judged whether the coordinates of the tapping point position 2 (x2, y2) and the tapping point position 1 (xl, yl) coincide or whether the error is within the set error range, In this way, the calculation accuracy of the tapping point position of the tap signal on the first operating platform is estimated.
  • the tapping point of the tapping signal on the first operating platform is on the keyboard map outside the mobile phone, when not on the mobile phone.
  • the method of determining the position of the tapping point of the tapping signal on FIG. 3 determines the position of the tapping point on the first operating platform (keyboard map) in FIG. 6, and details are not described herein again.
  • the various calibration points on the input keyboard drawing of the mobile phone can be tapped.
  • the mobile phone obtains the tapping signal on the calibration point on the input keyboard drawing of the mobile phone through the built-in sensor, it can judge the respective calibration points according to the method of judging the tapping point position of the tapping signal on the first operating platform.
  • the position in the positioning coordinate system of the mobile phone can also be passed through the various calibration points on the mobile phone. Enter the position on the keyboard drawing (ie the position of each calibration point in the positioning coordinate system of the input keyboard drawing) to further determine the relative position of the input keyboard drawing of the mobile phone and the mobile phone.
  • the characters on the input keyboard drawing of the mobile phone and the position of the calibration point on the input keyboard map are fixed, and the characters on the input keyboard drawing of the mobile phone and the positioning coordinates of the calibration point on the input keyboard drawing of the mobile phone can be pre-set in advance.
  • the coordinates in the system are preset in the mobile phone application.
  • the characters on the input keyboard drawing of the mobile phone and the input characters of the mobile phone application are corresponding to, and the coordinates of each character on the keyboard drawing can be input in advance (in the input keyboard of the mobile phone)
  • the coordinates in the positioning coordinate system of the drawing are first established with the key value of the key input of the mobile phone application.
  • the key value of the character input key on the mobile phone application and the character on the input keyboard drawing of the mobile phone can be input on the mobile phone.
  • the mapping relationship of the coordinates of the positioning coordinate system of the keyboard drawing is preset in the mobile phone.
  • the relative position of the input keyboard drawing of the mobile phone and the mobile phone is an uncertain factor, and the mobile phone user uses the input keyboard drawing of the mobile phone as the mobile phone.
  • the mobile phone user determines the relative positional relationship between the mobile phone and the current input keyboard drawing of the mobile phone (also the coordinates on the positioning coordinate system of the mobile phone and the positioning coordinate system of the input keyboard drawing of the mobile phone).
  • the mobile phone's positioning coordinate system can be first marked as ( x , , the mobile phone's input keyboard map positioning coordinate system is marked as ( x , ⁇ )
  • the angle between the positioning coordinate system of the mobile phone and the coordinate system of the input keyboard map is recorded as ⁇
  • the angle between the X axis of the positioning coordinate system of the mobile phone and the X axis of the coordinate system of the input keyboard image can be recorded as ⁇ displacement ( ⁇ , the displacement is the coordinate of the origin of the coordinate system of the input keyboard diagram in the positioning coordinate system of the mobile phone, then the following coordinate transformation is X cos 6* sin 6* Ax X
  • the method of the position of the tapping point on the operating platform determines the coordinates of each calibration point in the positioning coordinate system of the mobile phone, and is respectively recorded as ( ' 1 ), ( X ' ⁇ 2), ( ' 3 ), ( ⁇ 4, ⁇ 4), you can list the following 4 relationships:
  • the mobile phone can convert the coordinates of the tap signal in the positioning coordinate system of the mobile phone to obtain the coordinates on the positioning coordinate system of the input keyboard drawing of the mobile phone.
  • the mobile phone obtains the coordinates of the button on the phone input keyboard drawing of the mobile phone in the current positioning state by tapping the signal, and learns the coordinates in the positioning coordinate system of the input keyboard drawing of the mobile phone according to the above coordinate transformation relationship. Then, the key value of the button corresponding to the coordinate in the positioning coordinate system of the input keyboard drawing of the mobile phone can be further known.
  • the mobile phone After determining, according to the obtained tapping signal on the first operating platform, the mobile phone knows that the tapping signal is in the positioning coordinate system of the mobile phone, and then according to the positioning coordinate system of the mobile phone and the positioning of the input keyboard drawing of the mobile phone.
  • the transformation relationship of the coordinate system determines the coordinates of the positioning coordinate system of the phone input keyboard drawing corresponding to the tapping point position of the tap signal. According to the correspondence between the key value of the input button on the input keyboard drawing of the pre-stored mobile phone and the coordinate of the positioning coordinate system of the input keyboard drawing of the mobile phone, it can be determined that the mobile phone input keyboard drawing of the tapping signal is in the current placed state.
  • the corresponding operation position ie, the input button corresponding to the tapping point position of the tapping signal
  • the key value of the input button on the mobile phone application so as to input the current mobile phone into the tapping point position of the tapping signal on the keyboard drawing Maps to the key value of the input button on the phone app.
  • the coordinates (1, 3) in the positioning coordinate system of the mobile phone input keyboard drawing stored in the mobile phone in advance correspond to the key value of the input key corresponding to the character " ⁇ " in the mobile phone character input application, when the mobile phone obtains the first
  • the position of the tapping point of the tapping signal on the operating platform is after the coordinates in the positioning coordinate system of the mobile phone, according to the positioning coordinate system of the mobile phone and the positioning coordinate system of the input keyboard drawing of the mobile phone.
  • the tapping signal can be input on the input keyboard of the mobile phone.
  • the tap position on the map is mapped to the key value of the input button of the character "A" of the character input application of the mobile phone, and the tap signal is used as a trigger signal to trigger the corresponding response module output character "A" in the mobile phone application.
  • the first operating platform is a user-defined input drawing (such as an application operation diagram for playing music)
  • the mobile phone user pre-stores the positioning coordinate system of the input drawing in the mobile phone.
  • the coordinates including the "thumb” in Fig. 7 are (2, 1) and the corresponding note is set to "du", that is, the coordinate (2, 1) corresponds to the key value of the input button of the note "du”.
  • the mobile phone determines, according to the tapping signal, the position of the tapping point of the tapping signal in the positioning coordinate system of the mobile phone, according to the positioning coordinate system of the mobile phone and the mobile phone input.
  • the transformation relationship of the positioning coordinate system of the drawing determines that the position of the tapping point on the input sheet of the mobile phone is a button corresponding to the "thumb", that is, the key point of the tapping point on the input pattern of the mobile phone corresponds to the button corresponding to the "thumb”
  • the key value can be mapped to the key value of the button corresponding to "du”
  • the tapping signal can be used as a trigger signal to trigger the corresponding response module in the mobile phone according to the tapping strength of the tapping signal.
  • the mobile phone can complete the calibration of the relative position of the phone input keyboard drawing and the mobile phone according to any two calibration points on the current mobile phone input keyboard drawing, and can also be based on the relative position of the other two calibration points on the input keyboard drawing of the mobile phone. Perform calibration verification to determine whether the calibration of the positional relationship between the input keyboard drawing of the mobile phone and the mobile phone is accurate, and whether calibration needs to be performed again.
  • the mobile phone can complete the calibration of the relative positional relationship between the mobile phone input keyboard drawing and the mobile phone according to any two calibration points on the current mobile phone input keyboard drawing, and after the calibration, through the first operating platform (ie, the input keyboard drawing of the mobile phone)
  • the tapping signal determines the tapping point position of the tapping signal (the position in the positioning coordinate system of the mobile phone).
  • the corresponding mobile phone inputs the key value of the input key of the keyboard drawing (for example, the input key corresponding to the character "A").
  • the mobile phone user can also complete the calibration of the relative position of the mobile phone input keyboard drawing and the mobile phone through two other calibration points on the input keyboard drawing of the mobile phone, and judge the mobile phone according to the data of the calibration.
  • the position of the tapping point of the tapping signal on the first operating platform (ie, the input keyboard drawing of the mobile phone) (the position in the positioning coordinate system of the mobile phone) corresponds to whether the key value of the input key on the mobile phone input keyboard drawing is
  • the key value of the input button determined in the previous judgment is the same, that is, whether it is the key value of the input button corresponding to the character "A", thereby judging whether the positional relationship between the previously calibrated mobile phone and the input keyboard drawing of the mobile phone is correct.
  • Map maps, according to a preset correspondence between an operation position on the terminal input device and an operation position on the second operation platform, a tap point position of the tap signal on the terminal input device as The operating position on the second operating platform.
  • the tapping action can be performed on the input keyboard drawing, and the tapping signal will pass through the desktop.
  • the tapping signal can be determined on the first operating platform (ie, the input keyboard drawing placed on the desktop of the mobile phone according to the method described in the above steps S 2 01 and step S 2 02).
  • the position of the tapping point of the tapping signal in the positioning coordinate system of the mobile phone can be determined, and the tapping signal can be judged according to the relative positional relationship between the input keyboard drawing of the current mobile phone and the mobile phone.
  • the position of the tap point on the operating platform corresponds to the operating position of the input keyboard drawing of the current mobile phone.
  • the mobile phone may correspond to the operating position of the second operating platform of the mobile phone according to the input keyboard map preset in the mobile phone application.
  • Relationship for example The input relationship between the input keyboard drawing of the mobile phone and the key input value of the input method of the mobile phone application can input the input character of the mobile phone input keyboard drawing corresponding to the input on the keyboard image of the input method application of the mobile phone.
  • the character maps the tapping point position of the tapping signal on the input keyboard drawing of the mobile phone to the key value of the input soft keyboard of the input method applied by the mobile phone.
  • the second operating platform of the mobile phone described in this embodiment may include an input interface of an application of the mobile phone, an input end of the input soft keyboard of the input method of the mobile phone (ie, a character input soft keyboard of the mobile phone), and the like.
  • the relative position of the input drawing and the mobile phone can also be calibrated according to the above method, and the input drawing of the mobile phone user can be customized and the corresponding mobile phone built in the mobile phone.
  • the key value of the input soft keyboard of the application is used to establish a connection, and according to the above method, after the tapping point position of the tapping signal is determined on the operation position of the input drawing of the mobile phone user, the tapping point of the tapping signal can be The location is mapped to the operating position of the second operating platform of the mobile phone (ie, the input soft keyboard of the corresponding mobile phone application built in the mobile phone) (specifically, the key value of the key input to the soft keyboard).
  • the tapping signal can be used as the operating position of the second operating platform of the mobile phone.
  • the trigger signal on the mobile phone generates a mobile phone input signal corresponding to the trigger signal.
  • the first operating platform is the input keyboard drawing of the mobile phone (as shown in FIG. 6 )
  • the mobile phone determines that the tapping signal is on the input keyboard drawing of the mobile phone and knocks the tapping signal on the input keyboard map of the mobile phone.
  • the mobile phone After the location of the hit point is mapped to the key value of the input soft keyboard of the input method applied by the mobile phone, the mobile phone can adjust the character corresponding to the key value in the input method of the mobile phone, and the character is used as the input of the input method of the mobile phone. Character output to mobile phone In the input box of the interface, the input signal of the mobile phone is generated.
  • the mobile phone user customizes the input sound corresponding to each operation position on the drawing (for example, the pitch corresponding to the piano key), and then the mobile phone judges After knowing the position of the tap signal on the input sheet and mapping the tapping point position of the tap signal on the input sheet to the key value of the sound button, the mobile phone can adjust the key value of the sound button in the corresponding application.
  • the corresponding tone, and the corresponding music is output according to the tone.
  • the mobile phone can determine the button of the mobile phone user's tap according to the tapping point position of the tapping signal, and use the button as a trigger signal of the mobile phone input signal, and according to the tapping The tapping intensity of the signal, generating a mobile phone input signal corresponding to the signal strength of the tapping strength of the tapping signal, playing a piece of music played by the user of the mobile phone, and completing the conversion of the tapping signal to the input signal of the mobile phone.
  • the embodiment of the invention can map the location of the tapping point of the tapping signal on the operating platform such as the input keyboard drawing of the mobile phone or the input drawing of the mobile phone to the key value of the input soft keyboard of the input method of the mobile phone or the mobile phone.
  • the key value of the input key of the input soft keyboard of the other application, and the key value of the operation position on the input device of the mobile phone, and the tapping signal is used as a trigger signal at the operating position to trigger the internal application of the mobile phone.
  • the input signal of the mobile phone corresponding to the trigger signal is generated, which expands the generation path of the input signal of the mobile phone, improves the interest of generating the input signal of the mobile phone, and improves the user experience of the mobile phone.
  • FIG. 9 is a schematic structural diagram of a first embodiment of an apparatus for generating a terminal input signal according to an embodiment of the present invention.
  • the device for generating a terminal input signal which is described in this embodiment, includes: an acquiring module 1 0, configured to acquire a tapping signal on the first operating platform.
  • a positioning module 30 configured to determine a tapping of the tap signal on the first operating platform Point location.
  • the mapping module 50 is configured to map a tapping point position of the tap signal on the first operating platform to an operating position on the second operating platform.
  • the generating module 70 is configured to use the tapping signal as a trigger signal on an operation position on the second operating platform to generate a terminal input signal corresponding to the trigger signal for the terminal.
  • the positioning module 30 (as shown in FIG. 10) includes:
  • the collecting unit 31 is configured to collect position coordinates of each sensor in the terminal in a positioning coordinate system of the terminal.
  • the collecting unit 31 may be a location coordinate from the memory in which the respective sensors in the terminal are located in the positioning coordinate system of the terminal.
  • the coordinate axis of the positioning coordinate system of the mobile phone is preset by using a specific point on the mobile phone as a coordinate origin, and according to the positioning coordinate system, the position of each sensor in the mobile phone in the positioning coordinate system can be determined, as shown in FIG. 2 After the positioning coordinate system of the mobile phone is used, the position coordinates of each sensor in the mobile phone in the positioning coordinate system of the mobile phone are determined, so that the position coordinates of each sensor in the positioning coordinate system of the mobile phone can be stored in the memory, when needed. Read it.
  • a first processing unit 32 configured to: according to a propagation speed of the vibration mechanical wave of the tapping signal, and a timing at which the sensor receives the vibration mechanical wave, a tapping moment of the tapping signal, and the respective sensors And determining, by the position coordinates in the positioning coordinate system of the terminal, a position of a tapping point of the tapping signal on the first operating platform in a positioning coordinate system of the terminal.
  • the mapping module 5 0 is specifically configured to:
  • the generating module 70 is specifically configured to:
  • the tapping signal is used as a trigger signal on an operating position on the second operating platform to generate a terminal input signal.
  • the tapping signal may be used as a trigger signal on an operation position on the second operating platform, and a tapping intensity corresponding to the tapping signal may be generated according to a tapping intensity of the tapping signal.
  • Terminal input signal for signal strength.
  • the first operating platform described in this embodiment may include: a terminal body, a surface of a flat object on which the terminal is placed, a terminal input device, and the like.
  • the first operating platform described in this embodiment may be a mobile phone. In itself, or placed on the horizontal desktop of the mobile phone, the ground, the input keyboard drawing of the mobile phone, the user-defined input drawing of the mobile phone, and the like.
  • the tapping action can be performed on the mobile phone (including the back of the mobile phone or other parts on the mobile phone) or the desktop of the mobile phone, and the acquiring module in the mobile phone 1 0 can obtain the tapping signal on the mobile phone or the desktop of the mobile phone through its built-in sensor to generate the input signal of the mobile phone according to the tapping signal.
  • the tapping signal on the first operating platform may include: a vibration mechanical wave, a tapping time, a tapping intensity, and the like.
  • the mobile phone function can be turned on before the game is played, that is, according to the first
  • the tapping signal on the operating platform generates a phone function that inputs the input signal of the piano playing game.
  • the tapping action of playing music can be performed on the back of the mobile phone or on the desktop where the mobile phone is placed, and the acquisition module 10 of the mobile phone obtains the back of the mobile phone or the desktop of the mobile phone through its built-in sensor.
  • the tapping signal can be sent to a module in the mobile phone for generating a corresponding input signal to generate an input signal of the mobile phone piano playing through the corresponding mobile phone module.
  • the mobile phone user does not need to input the playing signal through the virtual keyboard of the piano playing the game, and only needs to perform the tapping action of the playing music on the first operating platform to complete the signal input of the piano playing.
  • a startup mode of starting the function of generating the mobile phone input signal of the mobile phone may be set.
  • the tapping action can be performed at the designated position on the first operating platform, and the acquiring module 10 of the mobile phone acquires the specified position.
  • the corresponding function of the mobile phone can be activated. For example, in order to prevent the input signal of the piano playing game of the mobile phone from being generated according to the tapping signal on the mobile phone or the desktop of the mobile phone, the mobile phone user can make a corresponding tapping at the designated position of the mobile phone when starting to play the music. Action, used to activate the piano playing function of the mobile phone.
  • the piano playing function of the mobile phone can be started by itself. For example, when a mobile phone user plays the game application using the piano of the mobile phone, he can first tap each of the top left corner, the upper right corner, the lower right corner, and the lower left corner of the mobile phone to indicate that the playing is started, and the acquisition module of the mobile phone acquires 10 After the tapping signal on the above mobile phone position, the corresponding mobile phone function can be activated (ie, the function of starting the mobile phone to generate an input signal of the piano playing according to the tapping signal); when the mobile phone user wants to end the game, the mobile phone can be used in the mobile phone.
  • the lower left corner, the lower right corner, the upper right corner, and the upper left corner are tapped one by one, indicating that the end playing is performed, and after the mobile phone acquiring module 10 obtains the tapping signal at the above position, the mobile game application server can be turned off by itself.
  • the input signal that generates the piano play is no longer received.
  • the mobile phone user can also tap on the top, bottom, left, and right sides of the mobile phone to start playing, and tap on the right, left, bottom, and top of the mobile phone to end the playing.
  • the manner in which the above actions are started and ended is only an example, not an exhaustive one.
  • the positioning module 30 can determine, according to the tapping signal acquired by the acquiring module 10, the tapping signal in the first operation.
  • the positioning coordinates of a mobile phone may be set first with a specific point on the mobile phone (for example, the center of gravity of the mobile phone) as a coordinate origin.
  • the positioning coordinate system of the mobile phone set the positioning coordinate system of the mobile phone in the plane where the mobile phone display screen is located or the plane where the mobile phone back cover is located, with the bottom direction of the mobile phone as the X axis, and the mobile phone side direction as the y axis, used to determine the mobile phone or place
  • the tapping point position of the tapping signal on the operating platform such as the desktop of the mobile phone.
  • the coordinate axis of the positioning coordinate system of the mobile phone may be preset in advance for the coordinate origin of the specific point on the mobile phone, and the position of each sensor in the mobile phone in the positioning coordinate system is determined according to the positioning coordinate system, as shown in FIG.
  • the position coordinates of each sensor in the mobile phone in the positioning coordinate system of the mobile phone are determined.
  • the collecting unit 31 in the positioning module 30 of the mobile phone can be based on the position coordinates of each sensor in the positioning coordinate system in the mobile phone, as shown in FIG. 2 .
  • the collecting unit 31 can collect the position coordinates of the sensor 1, the sensor 2, the sensor 3, and the sensor 4 in the positioning coordinate system as (xl, yl), (x2, y2),
  • the first processing unit 32 in the positioning module 30 of the mobile phone can receive the vibration mechanical wave of the tap signal according to each sensor at time t1 (the time of the vibration mechanical wave received by the sensor 1), t 2 (the time of the vibration mechanical wave received by the sensor 2), t 3 (the time of the vibration mechanical wave received by the sensor 3), t 4 (the time of the vibration mechanical wave received by the sensor 4), the time at which the tapping signal is generated, that is, the tapping signal
  • the tapping time t and the propagation velocity V of the vibrating mechanical wave calculate the distance between the respective sensors in the mobile phone and the tapping point position of the tapping signal.
  • the first processing unit 32 of the mobile phone multiplies the propagation speed of the vibration mechanical wave by a time equal to the sensing distance of the vibration mechanical wave (ie, the distance between the tapping point position and each sensor), and the time at which the vibration mechanical wave of the tapping signal is received by each sensor and Tap
  • the tapping time of the signal and the propagation speed of the vibrating mechanical wave are combined with the position coordinates of the respective sensors in the mobile phone in the positioning coordinate system, and the distance between each sensor and the position of the striking point and the propagation speed of the vibrating mechanical wave of the striking signal are processed, and the sensor receives
  • the relationship between the time point of the vibration mechanical wave and the tapping time point of the tapping signal is as follows:
  • the propagation speed of the vibration mechanical wave in the specific medium is fixed, and the medium used for the mobile phone case is fixed and known (because the material of the mobile phone case is determined by the mobile phone, the mobile phone case is used for the mobile phone case)
  • the medium is also known to be identifiable.
  • the propagation speed of the vibrating mechanical wave on the casing of the mobile phone is also fixed and can be stored in advance in the mobile phone.
  • the propagation speed V of the vibration mechanical wave generated by the tapping on the mobile phone becomes a known amount, and in the process of processing the above equation, the propagation speed V can be treated as a known number.
  • the position of the tapping point of the tapping signal on the mobile phone in the positioning coordinate system (X, y) can be calculated by the three sensors. If there are the above four sensors, the calculation accuracy of the position of the tapping point can be estimated according to the least square method. In this embodiment, at least three sensors for acquiring the tapping signal are required, and at most, at most.
  • the tapping signal is outside the mobile phone, that is, when the first operating platform is a platform such as a desktop on which the mobile phone is placed, there may be many types of materials for the desktop (for example, wood, plastic, Iron sheet, etc., so that the propagation medium of the vibration mechanical wave of the tapping signal becomes an unfixed medium, and the mobile phone cannot predetermine the propagation velocity V of the vibration mechanical wave of the tapping signal on the desktop currently placed on the mobile phone, that is, the vibration mechanical wave at this time
  • the propagation velocity V is unknown.
  • the first processing unit 32 can obtain the values of the four unknowns of v, t, x, and y by acquiring the corresponding data by the four sensors of the mobile phone.
  • the tapping point position of the tap signal on the first operating platform is determined.
  • the propagation speed of the vibration mechanical wave on the current propagation medium ie, the desktop on which the mobile phone is placed
  • the mobile phone user taps the second time on the same medium, the mobile phone user is placed.
  • the mobile phone can initially estimate the tapping point position of the tapping signal on the first operating platform based on the data acquired by the above four sensors. The accuracy of the calculation. Specifically, the mobile phone user can obtain the 4-element second-order equation corresponding to the tapping signal of the second tap according to the above method, and can determine the propagation velocity v of the vibrating mechanical wave (ie, the vibrating mechanical wave) in the first tapping. The propagation speed on the desktop where the mobile phone is placed) is substituted into the above 4-ary equation 2, and then combined with any three of the equations to obtain the tapping signal of the second tap on the first operating platform.
  • the second operating platform described in this embodiment is an input interface of an application of the terminal, an input platform of a terminal such as a character input soft keyboard of the terminal.
  • a character input soft keyboard of the terminal For example, the virtual keyboard of the piano playing game in the application on the mobile phone, the input soft keyboard of the mobile phone input method, the shooting button on the camera function interface of the mobile phone, and the like.
  • the above operation buttons are only examples, not poor Lift.
  • the operation position on the second operating platform may be: a key value of an input button of the application of the terminal, a key value of a character input soft keyboard of the terminal, a touch position of the touch screen of the terminal, etc., for example, in an application on the mobile phone
  • the tapping point of the tapping signal on the first operating platform can be located on the mobile phone through the mapping module 50.
  • the position in the coordinate system is matched with the pre-stored positioning database, and the operation position on the second operating platform of the mobile phone corresponding to the tapping point position of the tapping signal on the first operating platform is determined by database matching, and will be knocked
  • the location of the hitting point on the first operating platform is mapped to the operating position on the second operating platform of the handset.
  • a perceptible tapping area of the mobile phone may be set in advance by using the positioning coordinate system of the mobile phone as a reference system.
  • a side length of the mobile phone's positioning coordinate system may be set in advance as a length of 2 X.
  • width 2Y where the specific value of X, Y can be set at the same time as setting the positioning coordinate system of the mobile phone, or can be customized by the user of the mobile phone
  • the square area of the mobile phone is the perceptible area of the mobile phone, and the above can be set
  • the operating position on the second operating platform of the mobile phone corresponding to each tapping position in the sensing area (specifically, the key value of the button on the second operating platform of the mobile phone) is stored, and all the corresponding relationships are stored as a positioning database.
  • the mobile phone can determine the perceptible area on the current first operating platform according to its positioning coordinate system (for example) a specific area on the phone body or a specific area on the desktop where the phone is placed).
  • the mapping module 50 of the mobile phone can position the tapping point of the tapping signal on the first operating platform in the positioning coordinate system. Matching with the pre-stored positioning database to determine the operating position on the second operating platform corresponding to the tapping point position on the current first operating platform. For example, as shown in FIG.
  • the positioning module 30 of the mobile phone determines that the tapping signal on the mobile phone is known.
  • the mapping module 50 can be matched by the built-in database of the mobile phone, and the button on the virtual key on the piano playing game of the mobile phone corresponding to the tapping point position of the current tap signal on the current mobile phone is determined.
  • Key value, and map the location of the tap point to the key value of the virtual key, and the generating module 70 of the mobile phone uses the tapping signal as a trigger signal on the key to generate a piano bullet corresponding to the trigger signal for the terminal. Play the input signal of the game. For example, as shown in FIG.
  • the mapping module 5 0 can be matched by the built-in positioning database of the mobile phone to know that the virtual key on the piano playing game of the mobile phone corresponding to the current tapping point position is the third button from the left of the keyboard (ie, the mapping point corresponding to FIG. 4) Press the button) to map the tapping point on the back of the phone to the key of the phone's piano playing game.
  • the mapping module 50 can also perform matching by using the built-in positioning database of the mobile phone to determine the tapping point of the tapping signal.
  • the mapping module 50 determines that the key value of the specific key of the virtual keyboard of the piano playing game of the mobile phone corresponding to the tapping point position of the tapping signal is known, the generating module 70 of the mobile phone can use the tapping signal as the key.
  • the trigger signal of the key value is used to trigger the virtual piano application built in the mobile phone, and the music playing manager of the mobile phone is called by the application of the built-in virtual piano of the mobile phone to play the music corresponding to the tapping signal.
  • the mapping module 50 of the mobile phone maps the location of the tapping point of the tapping signal to the key value of the button on the virtual piano application on the mobile phone
  • the generating module 70 converts the tapping signal into a virtual piano application of the mobile phone.
  • the trigger signal of the key value of the button is used by the virtual piano application of the mobile phone to call the music playing manager to emit a sound corresponding to the pitch of the specific button, and adjust the tapping strength according to the tapping strength of the tapping signal.
  • the music of the corresponding volume that is, the mobile phone can emit music of different pitches at different volume according to the tapping position of the mobile phone user and the tapping intensity.
  • the user can adjust the pitch and volume of the music emitted by the mobile phone according to his own tapping action, and better mobilize the mobile phone user to play music through the mobile phone.
  • the interest and passion can also trigger the inspiration of the music creation of mobile phone users, and improve the fun of signal input.
  • the mobile phone described in this embodiment can map the location of the tapping point of the tapping signal on the operating platform such as the desktop of the mobile phone or the mobile phone to the operating position on the second operating platform of the mobile phone (specifically, it can be mapped to the second operation).
  • the key value of the button on the platform, etc., and the tapping signal is used as a trigger signal at the operating position to trigger an internal application of the mobile phone, generate a mobile phone input signal corresponding to the trigger signal, and expand the input of the mobile phone
  • the signal generation path improves the interest of generating the input signal of the mobile phone and improves the user experience of the mobile phone.
  • FIG. 1 is a schematic structural diagram of a second embodiment of an apparatus for generating a terminal input signal according to an embodiment of the present invention.
  • the apparatus for generating a terminal input signal described in this embodiment includes:
  • the acquiring module 1 0 is configured to acquire a tapping signal on the first operating platform.
  • the positioning module 30 is configured to determine a tapping point position of the tap signal on the first operating platform.
  • the mapping module 60 is configured to map a tapping point position of the tapping signal on the first operating platform to an operating position on the second operating platform.
  • the generating module 70 is configured to use the tapping signal as a trigger signal on an operation position on the second operating platform to generate a terminal input signal corresponding to the trigger signal for the terminal.
  • the calibration collection module 80 is configured to acquire a tapping signal of the calibration point on the terminal input device, and determine a position of the calibration point on the terminal input device in the positioning coordinate system of the terminal.
  • a calibration module 90 configured to determine, according to a location of the calibration point in a positioning coordinate system of the terminal, and a position of the calibration point on the terminal input device, a relative orientation of the terminal input device and the terminal position.
  • the positioning module 30 (as shown in FIG. 10) includes: The collecting unit 31 is configured to collect position coordinates of each sensor in the terminal in a positioning coordinate system of the terminal.
  • a first processing unit 32 configured to: according to a propagation speed of the vibration mechanical wave of the tapping signal, a timing at which the sensor receives the vibration mechanical wave, a tapping time of the tapping signal, and the respective sensors in the Determining the position coordinates in the positioning coordinate system of the terminal, and determining the position of the tapping point of the tapping signal on the first operating platform in the positioning coordinate system of the terminal.
  • the mapping module 6 0 includes:
  • a determining unit 61 configured to determine, according to a location of a tapping point of a tapping signal on the first operating platform, a position in a positioning coordinate system of the terminal, and a relative position of the terminal input device and the terminal, The operating position of the tap signal on the terminal input device.
  • the mapping unit 63 is configured to: according to the preset correspondence between the operation position on the terminal input device and the operation position on the second operation platform, the tapping point of the tapping signal on the terminal input device The location maps to an operational location of the second operating platform.
  • the generating module 7 0 is specifically used for:
  • tapping signal as a trigger signal on an operation position on the second operating platform, and generating a signal strength corresponding to the tapping strength of the tapping signal according to the tapping intensity of the tapping signal Terminal input signal.
  • the first operating platform described in this embodiment may include: a terminal body, a flat object surface on which the terminal is placed, an instant access device of the terminal, an input keyboard drawing of the terminal, an input drawing customized by the terminal user, and the like.
  • the first operating platform described in this embodiment may be an instant access device of the mobile phone (ie, a non-mobile phone fixed access device, which can be accessed as an input device of the mobile phone in real time and can be determined by calibration when accessing.
  • a device that has a location relationship between the device and the mobile phone, such as an external physical keyboard of the mobile phone, or the mobile phone itself, or a desktop on which the mobile phone is placed, or a mobile phone user prints out and places it on the desktop where the mobile phone is placed
  • the input keyboard drawing of the mobile phone on the mobile phone (such as the keyboard diagram shown in Figure 6), or the user input print drawing of the mobile phone user and placed with the mobile phone on the desktop where the mobile phone is placed (for example, as shown in Figure 7) Auxiliary drawings) and so on.
  • the input keyboard drawing of the above mobile phone and the input drawing of the user defined by the mobile phone are a special type of paper, and the paper includes information such as an input keyboard picture.
  • the input keyboard drawing of the mobile phone or the input keyboard drawing of the mobile phone user can be smoothly placed on the desktop where the mobile phone is placed (ie, the desktop where the mobile phone is located), and Input the keyboard drawing or the user-defined input drawing of the mobile phone to make a tapping action.
  • the acquiring module 10 in the mobile phone can obtain the input keyboard drawing of the mobile phone or the input drawing of the customized user of the mobile phone through the tapping signal acquisition module such as the built-in sensor.
  • the tap signal on the top generates an input signal of the terminal according to the tap signal through a corresponding module in the mobile phone.
  • the tapping signal on the first operating platform may include: a vibration mechanical wave, a tapping time, a tapping intensity, and the like.
  • the mobile phone function can be turned on according to the first operating platform (ie, the input keyboard drawing of the mobile phone).
  • the tapping signal on the phone generates a character input signal for the phone function.
  • the tapping action can be performed on the input keyboard drawing of the mobile phone, and after the mobile phone acquiring module 10 obtains the tapping signal on the input keyboard drawing of the mobile phone through the built-in sensor, the knocking can be performed.
  • the hit signal is sent to the corresponding module in the mobile phone, and the mobile phone module can generate an input signal of the mobile phone input method according to the tap signal.
  • the mobile phone obtains a tapping signal on the input keyboard drawing (terminal input device) of the mobile phone through its built-in sensor, and before inputting the input signal of the mobile phone input method according to the tapping signal, it is also necessary to confirm the input keyboard drawing of the mobile phone first.
  • the relative position with the mobile phone that is, the transformation relationship between the positioning coordinate system of the input keyboard drawing of the mobile phone and the positioning coordinate system of the mobile phone needs to be determined.
  • the mobile phone user needs to tap the calibration point on the input keyboard drawing of the mobile phone to the relative position of the input keyboard drawing of the mobile phone and the mobile phone. Perform calibration.
  • the positioning module 30 can determine the tapping point of the tapping signal on the first operating platform according to the tapping signal. position.
  • a positioning coordinate system of a mobile phone may be set with a specific point on the mobile phone (for example, the center of gravity of the mobile phone) as a coordinate origin, and the mobile phone may be set in a plane where the mobile phone display screen is located or a plane where the mobile phone back cover is located.
  • the direction of the bottom edge of the mobile phone is the X axis
  • the direction of the side of the mobile phone is the y axis, which is used to determine the tapping point position of the tapping signal on the operating platform such as the mobile phone or the desktop on which the mobile phone is placed (ie, the tapping signal is on the mobile phone) Position in the positioning coordinate system).
  • a specific point on the mobile phone for example, the center of gravity of the mobile phone
  • the position coordinates of the sensor in the mobile phone in the positioning coordinate system of the mobile phone are determined, and the position coordinates of the sensor in the mobile phone in the positioning coordinate system of the mobile phone are stored in the memory.
  • the collection unit 31 in the positioning module 30 of the mobile phone can collect the position coordinates of each sensor in the mobile phone in the positioning coordinate system of the mobile phone.
  • the collecting unit 31 can collect the position coordinates of the sensor 1, the sensor 2, the sensor 3, and the sensor 4 in the positioning coordinate system as (xl, yl), ( X2 , y2 ), ( x 3 , y3 ) , (x4 , y4 ) , wherein, since the position of the built-in sensor of the mobile phone relative to the mobile phone is a fixed position, the positions of the above-mentioned respective sensors in the positioning coordinate system are determined positions , ie xl, yl, x2, y2, x3, y3, x4, y4 are all known numbers.
  • the first processing unit 32 in the positioning module 30 of the mobile phone can receive the time t1 of the vibration mechanical wave of the tap signal according to each sensor (the time of the vibration mechanical wave received by the sensor 1), t 2 (sensor 2 receives vibration of mechanical waves Time), t3 (time of vibration mechanical wave received by sensor 3), t4 (time of vibration mechanical wave received by sensor 4), combined with the tapping time t of the tapping signal and the propagation velocity V of the vibration mechanical wave, calculate each sensor in the mobile phone The distance from the tapping point of the tapping signal.
  • the first processing unit 32 of the mobile phone receives the data of the vibration mechanical wave of the tap signal and the tapping time of the tapping signal, the propagation speed of the vibration mechanical wave, and the like, and can be combined with each sensor in the mobile phone in the positioning coordinate system.
  • the position coordinate is obtained by multiplying the propagation velocity of the vibration mechanical wave by the time equal to the sensing distance of the vibration mechanical wave (ie, the distance between the tapping point and each sensor) to obtain the distance between each sensor and the position of the tapping point and the vibration mechanical wave of the tapping signal.
  • the relationship between the propagation speed, the time point at which the sensor receives the vibrating mechanical wave, and the tapping time of the tapping signal is as follows:
  • v, t, x, and y are unknowns in the above data, a predetermined value is obtained by v, t, x, y, and the values of four unknowns of v, t, x, and y can be processed by iterative calculation.
  • the tapping point position (X, y) of the tapping signal on the first operating platform can be determined.
  • the propagation speed of the vibration mechanical wave in the specific medium is fixed, and the medium used for the mobile phone case is fixed and known (because the material of the mobile phone case is determined by the mobile phone, the mobile phone case is used for the mobile phone case)
  • the medium is also known to be identifiable.
  • the propagation speed of the vibrating mechanical wave on the mobile phone casing is also fixed. It can be pre-stored in the mobile phone, and the mobile phone user performs a tapping action on the mobile phone (ie, the mobile phone casing). At this time, the propagation velocity V of the vibrating mechanical wave generated by the tap on the mobile phone becomes a known amount.
  • the tapping point is on the mobile phone (as shown in Fig.
  • the position (X, y) of the tapping point of the tapping signal on the mobile phone in the positioning coordinate system can be calculated by the three sensors. If there are 4 sensors above, then The calculation accuracy of the position of the tapping point is estimated according to the least squares method, that is, in the embodiment, the sensor for acquiring the tapping signal needs at least three, at most not limited.
  • the tapping signal is outside the mobile phone, that is, when the first operating platform is a platform such as a desktop on which the mobile phone is placed, since the material of the desktop may be of various types (such as wood, plastic, iron, etc.),
  • the propagation medium of the vibration mechanical wave of the hitting signal becomes an unfixed medium, and the mobile phone cannot predetermine the propagation velocity V of the vibration mechanical wave of the tapping signal on the desktop currently placed on the mobile phone, that is, the propagation velocity V of the vibration mechanical wave at this time is unknown.
  • the corresponding data can be obtained according to the four sensors of the mobile phone, and the obtained data is used to determine the four unknowns of v, t, x, and y. a value to determine the location of the tapping point of the tapping signal on the first operating platform.
  • the mobile phone judges, according to the data obtained by the above sensor, the speed of the vibration mechanical wave on the current propagation medium (ie, the desktop on which the mobile phone is placed), when the mobile phone user taps the second time on the same medium, that is, the mobile phone user places the mobile phone.
  • the second time on the desktop since the propagation velocity V of the vibration mechanical wave has been determined, the calculation accuracy of the tapping point position of the tapping signal on the first operating platform can be estimated based on the data acquired by the four sensors.
  • the first processing unit 32 of the mobile phone can obtain the 4-element second-order equation corresponding to the tapping signal of the second tap according to the foregoing method, and can determine the propagation speed of the vibrating mechanical wave that is known in the first tap.
  • the tapping point of the tapping signal of the second tapping on the first operating platform can be directly obtained according to the obtained 4-ary quadratic equation obtained (assuming coordinates in the mobile phone coordinate system (x2).
  • the positioning module 30 is The position of the tapping point on the first operating platform (keyboard map) in FIG. 6 can be determined according to the above method for determining the position of the tapping point of the tapping signal on FIG. 3, and details are not described herein again.
  • the characters on the input keyboard map of the mobile phone and the position of the calibration point on the input keyboard map are fixed, and the characters on the input keyboard drawing of the mobile phone and the positioning coordinates of the calibration point on the input keyboard drawing of the mobile phone can be pre-set in advance.
  • the coordinates in the system are preset in the mobile phone application, and the characters input into the keyboard drawing and the coordinates corresponding to the calibration point (coordinates in the positioning coordinate system of the input keyboard drawing of the mobile phone) and the character input of the mobile phone application can be input in advance.
  • the key value of the button is first established, and the operation position (ie, the coordinates corresponding to each character and the calibration point) on the phone keyboard input map is mapped to the key value of the character input button on the mobile phone application.
  • the mobile phone can only judge the position of the tapping signal in the positioning coordinate system of the mobile phone according to the obtained tapping signal, the location of the tapping point on the mobile phone input keyboard drawing is mapped to the mobile phone.
  • the key value of the character input button on the application needs to convert the position of the tap signal in the positioning coordinate system of the mobile phone to the corresponding position on the input keyboard drawing of the mobile phone, and then the coordinates of the positioning coordinate system of the mobile phone can be determined first.
  • the transformation relationship of the coordinates of the positioning coordinate system of the input keyboard drawing of the mobile phone is mapped to the mobile phone.
  • the mobile phone user determines the relative positional relationship between the mobile phone and the input keyboard drawing of the mobile phone in the current placement state (also the coordinates on the positioning coordinate system of the mobile phone and the positioning coordinate system of the input keyboard drawing of the mobile phone).
  • the coordinates of the coordinates are changed, you can click the calibration button on the phone to activate the calibration function of the phone.
  • the mobile phone's positioning coordinate system can be first marked as ( x , , the mobile phone's input keyboard map positioning coordinate system is marked as ( x , ⁇ )
  • the angle between the positioning coordinate system of the mobile phone and the coordinate system of the input keyboard map is recorded as ⁇ the X axis of the positioning coordinate system of the mobile phone Enter the angle of the X-axis of the coordinate system of the keyboard diagram as ⁇ displacement is recorded as ( ⁇ , displacement is the coordinate of the origin of the coordinate system of the input keyboard diagram in the positioning coordinate system of the mobile phone, then the following coordinate transformation relationship:
  • the calibration module 90 can determine the coordinates of the calibration point on the input keyboard drawing of the mobile phone in the positioning coordinate system of the mobile phone, and record them as ( ' 1 ), ( ' 2 ), ( ' 3 ), ( 4 , 4 ), you can list the following four relationships:
  • the transformation relationship between the positioning coordinate system of the mobile phone and the positioning coordinate system of the input keyboard of the mobile phone can be determined.
  • the calibration module 90 determines the transformation relationship between the positioning coordinate system of the mobile phone and the positioning coordinate system of the mobile phone input keyboard drawing
  • the coordinate of each button in the input coordinate system of the mobile phone obtained by the mobile phone on the positioning coordinate system of the mobile phone can be obtained.
  • the coordinates of each button on the positioning coordinate system of the input keyboard drawing of the mobile phone are obtained.
  • the mobile phone can complete the calibration of the relative position of the phone input keyboard drawing and the mobile phone according to any two calibration points on the current mobile phone input keyboard drawing, and can also be based on the relative position of the other two calibration points on the input keyboard drawing of the mobile phone. Perform calibration verification to determine whether the calibration of the positional relationship between the input keyboard drawing of the mobile phone and the mobile phone is accurate, and whether calibration needs to be performed again.
  • the mobile phone can complete the calibration of the relative positional relationship between the mobile phone input keyboard drawing and the mobile phone according to any two calibration points on the current mobile phone input keyboard drawing, and after the calibration, through the first operating platform (ie, the input keyboard drawing of the mobile phone)
  • the tapping signal determines the tapping point position of the tapping signal (the position in the positioning coordinate system of the mobile phone).
  • the corresponding mobile phone inputs the key value of the input key of the keyboard drawing (for example, the input key corresponding to the character "A").
  • the mobile phone user can also complete the calibration of the relative position of the mobile phone input keyboard drawing and the mobile phone through two other calibration points on the input keyboard drawing of the mobile phone, and judge the mobile phone user on the first operating platform (ie, the mobile phone according to the data of the calibration).
  • the tapping point of the tapping signal on the input keyboard drawing Position (position in the positioning coordinate system of the mobile phone) Whether the key value of the input key on the corresponding mobile phone input keyboard drawing is consistent with the key value of the input key judged before, that is, whether it is the input key corresponding to the character "A"
  • the key value is used to determine whether the positional relationship between the previously calibrated mobile phone and the input keyboard drawing of the mobile phone is correct.
  • the mobile phone judges the coordinates of the button on the mobile phone input keyboard drawing in the current positioning state by the tapping signal in the positioning coordinate system of the mobile phone, and judges the coordinates in the positioning coordinate system of the input keyboard drawing of the mobile phone according to the above coordinate transformation relationship.
  • the first processing unit 32 of the mobile phone determines, according to the tapping signal on the first operating platform acquired by the acquiring module 10, the coordinates of the tapping signal in the positioning coordinate system of the mobile phone.
  • the mapping module 60 can determine the coordinates of the positioning coordinate system on the mobile phone input keyboard drawing corresponding to the tapping point position of the tapping signal according to the transformation relationship between the positioning coordinate system of the mobile phone and the positioning coordinate system of the input keyboard drawing of the mobile phone.
  • the mapping module 60 can determine, according to the correspondence between the input button on the input keyboard drawing of the mobile phone and the coordinate of the positioning coordinate system of the input keyboard drawing of the mobile phone, the mobile phone input keyboard drawing of the tapping signal in the current placement state can be determined.
  • the corresponding operation position ie, the input button corresponding to the tapping point position of the tapping signal
  • the key value of the input keyboard button on the mobile phone application so as to input the current mobile phone into the tapping point of the tapping signal on the keyboard drawing
  • the location maps to the key value of the input button on the mobile app.
  • the determining unit 61 in the mapping module 60 can determine the tapping signal on the mobile phone according to the location of the tapping point on the input keyboard drawing of the mobile phone and the positional relationship between the positioning coordinate system of the mobile phone and the mobile phone. Enter the location of the tap point on the keyboard drawing.
  • the mapping unit 63 can input and input the key value and input on the input keyboard map in the input method application of the mobile phone. The correspondence between the characters, the location of the tapping point of the tapping signal on the phone input keyboard drawing is mapped to the key value of the character input button of the input method applied by the mobile phone. For example, you can store your phone in your phone in advance.
  • the coordinates (1, 3) in the positioning coordinate system of the input keyboard drawing correspond to the key value of the input key corresponding to the character "A" in the mobile phone character input application, when the mobile phone obtains the first operating platform (the input keyboard drawing of the mobile phone)
  • the tapping signal is determined according to the transformation relationship between the positioning coordinate system of the mobile phone and the positioning coordinate system of the input keyboard drawing of the mobile phone.
  • the coordinates of the tap point on the input keyboard drawing of the mobile phone are (1, 3)
  • the tapping point of the tapping signal on the input keyboard drawing of the mobile phone can be mapped to the character input application of the mobile phone.
  • the key value of the input button triggers the tapping signal as a trigger signal to trigger the corresponding response module output character "A" in the mobile phone application.
  • the first operating platform is a user-defined input drawing (such as an application operation diagram for playing music)
  • the mobile phone user pre-stores the positioning coordinate system of the input drawing in the mobile phone.
  • the coordinates of the "thumb” in Fig. 7 are (2, 1) and the key value of the input button corresponding to the note "du" is set.
  • the mobile phone is knocked according to the After the signal is judged to be the position of the tapping point of the tapping signal in the positioning coordinate system of the mobile phone, the tapping point position is determined according to the transformation relationship between the positioning coordinate system of the mobile phone and the positioning coordinate system of the mobile phone input drawing.
  • the button corresponding to the "thumb” position on the input sheet of the mobile phone that is, the key point of the button corresponding to the "thumb” corresponding to the "thumb” on the input pattern of the mobile phone, the position of the tap point can be mapped to "du"
  • the key value of the corresponding button, and the tapping signal is a trigger signal, and the corresponding response module in the triggering mobile phone outputs a note of the corresponding volume according to the tapping intensity of the tapping signal.
  • the second operating platform of the mobile phone described in this embodiment may include an input interface of an application of the mobile phone, an input soft keyboard of the input method of the mobile phone (ie, a character input soft keyboard of the mobile phone), and the like.
  • the relative position of the input drawing and the mobile phone can also be calibrated according to the above method, and the input drawing of the mobile phone user can be customized and the corresponding mobile phone built in the mobile phone.
  • the key value of the button of the input soft keyboard of the application is established.
  • the tapping point position of the tapping signal can be mapped to the second operating platform of the mobile phone (ie The operation position of the input soft keyboard of the corresponding mobile phone application built in the mobile phone (specifically, the key value of the key input to the soft keyboard).
  • the generating module 70 may use the tapping signal as the second mobile phone.
  • a trigger signal at an operating position of the operating platform generates a mobile phone input signal corresponding to the trigger signal for the mobile phone.
  • the mobile phone determines that the tapping signal is on the input keyboard drawing of the mobile phone and knocks the tapping signal on the input keyboard map of the mobile phone.
  • the mobile phone generating module 70 can adjust the input method application of the tapping point position mapping of the tapping signal in the input method application of the mobile phone. Enter the character corresponding to the key value of the key in the soft keyboard, and output the character as the input character of the input method of the mobile phone to the input box of the mobile phone interface, that is, generate an input signal of the mobile phone.
  • the mobile phone input signal is generated by the mobile phone as described in this embodiment, as long as the input keyboard drawing of the mobile phone is calibrated and the position is determined, all the characters on the mobile phone input keyboard drawing are located in the positioning coordinate system of the mobile phone for the mobile phone.
  • the mobile phone when the mobile phone user taps on the keyboard drawing, the mobile phone can judge the character that the mobile phone user taps according to the tapping point position of the tapping signal, and generate the character as the trigger signal of the mobile phone input signal to generate The input signal of the mobile phone can complete the conversion of the tap signal to the input signal of the mobile phone.
  • the mobile phone user customizes the input sound corresponding to each operation position on the drawing or input characters (for example, the pitch and volume corresponding to the piano keys), when the mobile phone Judging that the position of the tap signal on the input sheet is known and mapping the tapping point position of the tap signal on the input sheet to the key value of the button on the input soft keyboard built in the mobile phone application, the mobile phone can Transfer the corresponding application
  • the tap point of the tap signal maps the tone or volume corresponding to the key value of the button in the input soft keyboard, and outputs the corresponding music according to the tone or volume.
  • the mobile phone can judge the character that the mobile phone user taps according to the tapping point position of the tapping signal, and use the character as a trigger signal of the mobile phone input signal to generate a mobile phone input signal, and play a mobile phone user to play by himself. Music, you can complete the conversion of the tap signal to the phone's input signal.
  • the embodiment of the invention can map the location of the tapping point of the tapping signal on the operating platform such as the input keyboard drawing of the mobile phone or the input drawing of the mobile phone to the key value of the input soft keyboard of the input method of the mobile phone or the mobile phone.
  • the key value of the input soft keyboard such as the key value of the input device on the mobile phone
  • the tapping signal as a trigger signal at the operating position used to trigger the internal application of the mobile phone, generate
  • the input signal of the mobile phone corresponding to the trigger signal expands the generation path of the input signal of the mobile phone, improves the interest of generating the input signal of the mobile phone, and improves the user experience of the mobile phone.
  • FIG. 1 is a schematic structural diagram of a first embodiment of a terminal according to an embodiment of the present invention.
  • the terminal described in this embodiment includes:
  • the sensor 1 00 is configured to acquire a tap signal on the first operating platform.
  • the memory 200 can be used to store software programs and modules, and the processor 110 executes various functional applications and data processing of the terminals by running software programs and modules stored in the memory 200.
  • the memory 200 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a virtual piano application, an input method, etc.), and the like; the storage data area may be stored according to the terminal. Use the created data (such as positioning the database, etc.) and so on.
  • the memory 200 may comprise a high speed random access memory, and may also comprise a non-volatile memory, such as at least one disk storage device, Flash memory devices, or other volatile solid-state storage devices.
  • the processor 1 1 0 is specifically configured to determine a tapping point position of the tapping signal on the first operating platform, and map a tapping point position of the tapping signal on the first operating platform to An operation position on the second operating platform, and using the tapping signal as a trigger signal on an operating position on the second operating platform to generate a terminal input signal corresponding to the trigger signal for the terminal.
  • the first operating platform described in this embodiment may include: a terminal body, a flat object surface on which the terminal is placed, an input keyboard drawing of the terminal, an input drawing of the end user-defined input drawing, and the like, for example, in this embodiment
  • the first operating platform described may be the mobile phone itself, the desktop on which the mobile phone is placed, or the input keyboard drawing of the mobile phone printed by the mobile phone user and placed on the desktop of the mobile phone with the mobile phone (for example, the keyboard diagram shown in FIG. 6).
  • the input device of the mobile phone such as a mobile phone user-defined input drawing (such as the auxiliary drawing shown in FIG. 7) printed by the mobile phone user and placed on the desktop of the mobile phone with the mobile phone.
  • the input keyboard drawing of the above mobile phone and the input drawing customized by the mobile phone user are a special type of paper, and the paper includes information such as an input keyboard picture.
  • the input keyboard drawing of the mobile phone or the input drawing of the mobile phone user can be smoothly placed on the desktop where the mobile phone is placed (ie, the desktop where the mobile phone is located), and then the mobile phone
  • the input keyboard drawing or the user-defined input drawing of the mobile phone can be tapped, and the mobile phone can obtain the input keyboard drawing of the mobile phone or the tapping signal on the input drawing of the mobile phone user through its built-in sensor 100 to process
  • the device 1 10 generates an input signal of the mobile phone according to the tap signal.
  • the tapping signal on the first operating platform may include: a vibration mechanical wave, a tapping time, a tapping intensity, and the like.
  • the mobile phone function can be turned on, that is, the character input signal is generated according to the tapping signal on the first operating platform.
  • Phone features Mobile phone user After the above mobile phone function is activated, a tapping action can be performed on the input keyboard drawing of the mobile phone. After the mobile phone obtains the tapping signal on the input keyboard drawing of the mobile phone through its sensor 100, the processor 1 10 can be tapped according to the knocking signal. The hit signal generates an input signal for the mobile phone input method.
  • the mobile phone obtains a tapping signal on the input keyboard drawing (terminal input device) of the mobile phone through its built-in sensor 100, and before the processor 1 10 combines the tapping signal to generate an input signal of the mobile phone input method, First confirm the relative position of the input keyboard drawing of the mobile phone and the mobile phone, that is, it is necessary to determine the transformation relationship between the positioning coordinate system of the input keyboard drawing of the mobile phone and the positioning coordinate system of the mobile phone. Specifically, the mobile phone user needs to tap the calibration point on the input keyboard of the mobile phone to calibrate the input keyboard drawing of the mobile phone and the relative position of the mobile phone.
  • the processor when determining, by the processor, the location of the tapping point of the tapping signal on the first operating platform, the processor is specifically configured to:
  • a positioning coordinate system of a mobile phone may be set with a specific point on the mobile phone (for example, the center of gravity of the mobile phone) as a coordinate origin, and the mobile phone may be set in a plane where the mobile phone display screen is located or a plane where the mobile phone back cover is located.
  • the direction of the bottom edge of the mobile phone is the X axis
  • the direction of the side of the mobile phone is the y axis, which is used to determine the tapping point position of the tapping signal on the operating platform such as the mobile phone or the desktop on which the mobile phone is placed (ie, the tapping signal is on the mobile phone) In the positioning coordinate system Location).
  • a specific point on the mobile phone for example, the center of gravity of the mobile phone
  • the processor 110 can collect the position coordinates of the respective sensors in the mobile phone in the positioning coordinate system.
  • the processor 110 can collect the position coordinates of the sensor 1, the sensor 2, the sensor 3, and the sensor 4 in the positioning coordinate system as (xl, yl), (x2, y2), (x3, y3), (x4).
  • the processor 110 of the mobile phone can receive the time t1 of the vibration mechanical wave of the tap signal according to each sensor (the time of the vibration mechanical wave received by the sensor 1), t2 (the time of the vibration mechanical wave received by the sensor 2), t3 ( The moment of the vibration mechanical wave received by the sensor 3), 14 (the time of the vibration mechanical wave received by the sensor 4), combined with the tapping time t of the tapping signal and the propagation velocity V of the vibrating mechanical wave, can be combined with the positioning of each sensor in the mobile phone in the above-mentioned mobile phone
  • the position coordinate in the coordinate system is multiplied by the propagation velocity of the vibration mechanical wave by the time equal to the sensing distance of the vibration mechanical wave (ie, the distance between the position of the tapping point and each sensor) to obtain
  • the processor 1 10 0 can process the values of the four unknowns of v, t, x, and y according to the above relationship equation. Specifically, by giving v, t, x, y a preset value, and by using an iterative calculation, the values of the four unknowns of v, t, x, and y can be processed to determine the tapping signal on the first operating platform. The position of the tap point (X, y).
  • the propagation speed of the vibration mechanical wave in the specific medium is fixed, and the medium used for the mobile phone case is fixed and known (because the material of the mobile phone case is determined by the mobile phone, the mobile phone case is used for the mobile phone case)
  • the medium is also known to be identifiable.
  • the propagation speed of the vibrating mechanical wave on the mobile phone casing is also fixed. It can be pre-stored in the mobile phone, and the mobile phone user performs a tapping action on the mobile phone (ie, the mobile phone casing). At this time, the propagation velocity V of the vibrating mechanical wave generated by the tap on the mobile phone becomes a known amount.
  • the tapping point is on the mobile phone (as shown in FIG.
  • the processor 1 10 can calculate the position of the tapping point of the tapping signal on the mobile phone in the positioning coordinate system by using 3 sensors (X, y). ). If the above four sensors are used, the calculation accuracy of the position of the tapping point can be estimated according to the least squares method. In this embodiment, at least three sensors for acquiring the tapping signal are required, and at least the maximum is not limited.
  • the tapping signal is outside the mobile phone, that is, when the first operating platform is a platform such as a desktop on which the mobile phone is placed, since the material of the desktop may be of various types (such as wood, plastic, iron, etc.),
  • the propagation medium of the vibration mechanical wave of the hitting signal becomes an unfixed medium, and the mobile phone cannot predetermine the propagation velocity V of the vibration mechanical wave of the tapping signal on the desktop currently placed on the mobile phone, that is, the propagation velocity V of the vibration mechanical wave at this time is unknown.
  • the processor 1 10 can determine the four unknowns of v, t, x, and y according to the data obtained by the four sensors of the mobile phone. a value to determine the location of the tapping point of the tapping signal on the first operating platform.
  • the processor 1 10 of the mobile phone judges that the vibration mechanical wave is in the current propagation medium according to the data obtained by the above sensor (ie, After the propagation speed on the desktop of the mobile phone, since the propagation velocity V of the vibration mechanical wave has been determined, the calculation of the position of the tapping point of the tapping signal on the first operating platform can be initially estimated based on the data acquired by the four sensors. Precision.
  • the processor 110 can obtain the 4-element second-order equation corresponding to the tapping signal of the second tap according to the above method, and can determine the propagation speed v of the vibrating mechanical wave that is known in the first tap (ie, The propagation speed of the vibrating mechanical wave on the desktop placed on the mobile phone) is substituted into the above-mentioned 4 yuan quadratic equation, and then combined with any three equations to obtain the tapping signal of the second tapping on the first operating platform. (Assume the coordinates (xl, yl) in the phone coordinate system).
  • the processor 1 10 can also directly obtain the tapping point position 2 of the tapping signal of the second tapping on the first operating platform according to the above 4-ary equation 2 (assuming coordinates in the mobile phone coordinate system (x2) , y2 ) ) , and judge whether the coordinates of the tapping point position 2 ( x2 , y2 ) and the tapping point position 1 ( xl, yl ) coincide or whether the error is in the set error according to the tapping point position 1 obtained by the previous processing.
  • the calculation accuracy of the tapping point position of the tapping signal on the first operating platform is estimated.
  • the processor 110 can determine the first operating platform (keyboard map or auxiliary drawing) in FIG. 6 or FIG. 7 according to the above method for determining the tapping point position of the tapping signal on FIG. The location of the tap point is not repeated here.
  • the processor 110 determines the tapping point of the tapping signal on the first operating platform, the tapping point location can be mapped to the operating location on the second operating platform of the handset.
  • the processor 11 0 is specifically configured to: when mapping a tapping point of the tapping signal on the first operating platform to an operating position on the second operating platform:
  • the position of the tapping point of the tapping signal on the first operating platform in the positioning coordinate system of the mobile phone can be The positioning database pre-stored in the memory 200 is matched, and the operation position on the second operating platform of the mobile phone corresponding to the tapping point position of the tapping signal on the first operating platform is determined by database matching, and the tapping signal is The location of the tap point on the first operating platform is mapped to the operating position on the second operating platform of the mobile phone (specifically, the key value of the input button on the second platform).
  • a perceptible tapping area of the mobile phone may be set in advance by using the positioning coordinate system of the mobile phone as a reference system.
  • a side length of the mobile phone positioning coordinate system may be set to be 2 ⁇ long.
  • Width 2Y (where the specific values of X and Y can be set at the same time as setting the positioning coordinate system of the mobile phone, or can be customized by the user of the mobile phone), the square area of the mobile phone is the perceptible area of the mobile phone, and the above-mentioned perceptible is set.
  • the operation position on the second operating platform of the mobile phone corresponding to each tapping position in the area (specifically, the key value of the input button on the second operating platform), and storing all the corresponding relationships in the memory 200, the corresponding relationship This is the location database of the mobile phone.
  • the processor 1 1 0 of the mobile phone can determine the current first operating platform according to the positioning coordinate system of the mobile phone. Perceptible area on the top (such as a specific area on the phone body or a specific area on the desktop where the phone is placed).
  • the processor 1 1 0 of the mobile phone can click the tapping point of the tapping signal on the first operating platform in the positioning coordinate system.
  • the location is matched with the location database pre-stored by the memory 200 to determine an operation location on the second operating platform corresponding to the location of the tap point on the current first operating platform.
  • the mobile phone determines the mobile phone
  • the matching database stored in the mobile phone memory 200 can be matched to determine the virtual key on the piano playing game of the mobile phone corresponding to the tapping point position of the tap signal on the current mobile phone.
  • the processor 1 10 determines that the tapping point of the tapping signal on the back of the mobile phone is a point on the upper left corner of the back of the mobile phone (the hitting point shown in FIG. 4), Then, the positioning database stored in the memory 200 of the mobile phone can be used to match that the current tap point position corresponds to the virtual key on the piano playing game of the mobile phone, and the third key from the left side of the keyboard (ie, the mapping point in FIG.
  • the key value of the button can be used to map the tapping point of the tapping signal on the back of the phone to the key of the button on the virtual keyboard of the phone's piano playing game.
  • the processor 1 1 0 determines that the tapping point position of the tapping signal is at other positions on the back of the mobile phone, it can also be matched by the positioning database stored in the memory 200 of the mobile phone to determine the tapping signal.
  • the tap point position corresponds to the key value of the key on the virtual key.
  • the processor 1 10 can use the tapping signal as the trigger signal of the key key value to The tapping signal triggers the virtual piano application built into the mobile phone, and the music playing manager of the mobile phone is called by the mobile phone's built-in virtual piano application to play the music corresponding to the tapping signal.
  • the processor 1 10 0 can map the tapping point position of the tapping signal to the key value of the button on the virtual piano application on the mobile phone, and convert the tapping signal into the key value of the button on the virtual piano application of the mobile phone.
  • a trigger signal which is called by the virtual piano application of the mobile phone to call a sound of the tone corresponding to the tone of the specific button, and adjusts the music of the volume corresponding to the tapping intensity according to the tapping intensity of the tapping signal
  • the mobile phone can emit music of different pitches at different volume according to the tapping position of the mobile phone user and the tapping intensity.
  • the user can adjust the pitch and volume of the music emitted by the mobile phone according to his own tapping action, and better mobilize the mobile phone user to play music through the mobile phone.
  • the interest and passion can also trigger the inspiration of the music creation of mobile phone users, and improve the fun of signal input.
  • the processor when determining, by the processor, the location of the tapping point of the tapping signal on the first operating platform, the processor is further configured to:
  • the input keyboard drawing of the mobile phone or the input drawing of the mobile phone user can be randomly placed by the mobile phone user, that is, the relative position of the mobile phone input keyboard drawing or the user-defined input drawing of the mobile phone and the mobile phone is uncertain. Then, it is necessary to first calibrate the input keyboard drawing of the mobile phone or the input drawing of the mobile phone user to determine the relative position of the current first operating platform and the mobile phone. When the mobile phone user needs to calibrate the relative position of the input keyboard drawing of the mobile phone and the mobile phone, the calibration points on the input keyboard drawing of the mobile phone can be tapped.
  • the mobile phone After the mobile phone obtains the tapping signal on the calibration point on the input keyboard drawing of the mobile phone through the built-in sensor, it can judge the respective calibration points according to the method of judging the tapping point position of the tapping signal on the first operating platform.
  • the position in the positioning coordinate system of the mobile phone can further determine the input keyboard drawing of the mobile phone by the position of each calibration point on the input keyboard drawing of the mobile phone (ie, the position of each calibration point in the positioning coordinate system of the input keyboard drawing) The relative position of the phone.
  • each character on the input keyboard map of the mobile phone and the calibration point are in the keyboard diagram.
  • the upper position is fixed.
  • the characters on the input keyboard drawing of the mobile phone and the coordinates of the calibration point in the positioning coordinate system of the input keyboard drawing of the mobile phone can be preset in the mobile phone application, and the mobile phone can be input into the keyboard drawing in advance.
  • Each character and the coordinates corresponding to the calibration point are first connected with the key value of the key input of the mobile application, and the mobile phone is input into the operation position on the keyboard drawing ( That is, the coordinates of each character and calibration point are mapped to the key value of the character input button on the mobile phone application.
  • the relative position of the input keyboard map of the mobile phone and the mobile phone is an uncertain factor, and the mobile phone user uses the input keyboard drawing of the mobile phone as the Before the input device of the mobile phone, it is necessary to determine the relative position of the input keyboard map of the mobile phone and the mobile phone in the currently placed state, that is, the coordinate of the positioning coordinate system of the mobile phone and the coordinate of the positioning coordinate system of the input keyboard drawing of the mobile phone need to be determined. relationship.
  • the mobile phone user determines the relative positional relationship between the mobile phone and the input keyboard drawing of the mobile phone in the currently placed state (also the coordinates on the positioning coordinate system of the mobile phone and the positioning coordinates of the input keyboard drawing of the mobile phone).
  • the coordinates of the system are changed, you can click the calibration button on the phone to activate the calibration function of the phone.
  • the processor 11 0 of the mobile phone can first mark the sitting position of the positioning coordinate system of the mobile phone as ( x , , the positioning coordinate of the positioning coordinate system of the input keyboard diagram of the mobile phone when calibrating the relative positional relationship between the mobile phone and the mobile phone input keyboard drawing ( X ' J ) , the angle between the positioning coordinate system of the mobile phone and the coordinate system of the input keyboard map is recorded as ⁇
  • the angle between the X axis of the positioning coordinate system of the mobile phone and the X axis of the coordinate system of the input keyboard image is recorded as a displacement Recorded as ( ⁇ , y)
  • the displacement is the coordinate of the origin of the coordinate system of the input keyboard diagram in the positioning coordinate system of the mobile phone, and the following coordinate transformation relationship is as follows:
  • each calibration point (calibration point 1, calibration point 2, calibration point 3, calibration point 4) on the input keyboard drawing of the mobile phone in the positioning coordinate system of the input keyboard diagram as i' ⁇ i), ( 2 , ⁇ 2 ), ( , ⁇ 3 ), ( 4 , ⁇ 4 ).
  • the sensor 100 may first obtain a tapping signal on the calibration point on the input keyboard drawing of the mobile phone, and send the obtained tapping signal to the processor 110.
  • the processor 1 1 0 of the mobile phone determines the coordinates of the button on the mobile phone input keyboard drawing in the current positioning state by the tapping signal in the positioning coordinate system of the mobile phone, and After determining the coordinates in the positioning coordinate system of the input keyboard drawing of the mobile phone according to the coordinate transformation relationship, the key value of the key corresponding to the coordinate in the positioning coordinate system of the input keyboard drawing of the mobile phone can be further known.
  • the processor 1 10 determines, according to the tapping signal on the first operating platform acquired by the sensor 100, that the tapping signal is in the positioning coordinate system of the mobile phone, and then according to the positioning coordinate system of the mobile phone and the input of the mobile phone.
  • the transformation relationship of the positioning coordinate system of the keyboard drawing determines the positioning position of the mobile phone input keyboard drawing corresponding to the tapping point position of the tapping signal
  • the tapping signal is The operation position on the phone input keyboard drawing in the current placement state (ie, the input button corresponding to the tapping point position of the tap signal) and the key value of the input button on the mobile phone application, to input the current mobile phone into the keyboard drawing
  • the tapping point position of the tapping signal is mapped to the key value of the input button on the mobile phone application.
  • the coordinates (1, 3) in the positioning coordinate system of the mobile phone input keyboard drawing can be stored in the mobile phone in advance corresponding to the mobile phone character input.
  • the key value of the button corresponding to the character "A" in the application when the processor 1 1 0 of the mobile phone acquires the tapping point position of the tapping signal on the first operating platform (the input keyboard drawing of the mobile phone) is located in the mobile phone
  • the coordinates in the coordinate system it is determined according to the transformation relationship between the positioning coordinate system of the mobile phone and the positioning coordinate system of the input keyboard drawing of the mobile phone.
  • the tapping point position of the tapping signal on the input keyboard drawing of the mobile phone can be mapped to the character input application of the mobile phone.
  • the key value of the input button of the character "A”, and then the tapping signal is used as a trigger signal to trigger the corresponding response module output word in the mobile phone application Character "A”.
  • the first operating platform is a user-defined input drawing (such as an application operation diagram for playing music)
  • the mobile phone user pre-stores the positioning coordinate system of the input drawing in the mobile phone.
  • the processor 110 of the mobile phone determines, according to the tapping signal, the position of the tapping point of the tapping signal in the positioning coordinate system of the mobile phone, according to the positioning coordinates of the mobile phone.
  • the transformation relationship between the positioning coordinate system of the drawing and the mobile phone input drawing determines that the position of the tapping point on the input sheet of the mobile phone is a button corresponding to the "thumb", that is, the coordinates of the tapping point on the input sheet of the mobile phone correspond to the "thumb”
  • the key value of the corresponding button thereby mapping the location of the tap point to the key value of the button corresponding to "du”
  • the tapping signal is a trigger signal, triggering the corresponding response module in the mobile phone according to the tapping signal Percussion intensity of the output volume of the corresponding note.
  • the processor 11 0 can complete the calibration of the relative position of the mobile phone input keyboard drawing and the mobile phone according to any two calibration points on the current mobile phone input keyboard drawing, and can also be based on the other two calibration points on the input keyboard drawing of the mobile phone and the mobile phone.
  • the relative position is verified by calibration, and it is judged whether the calibration of the positional relationship of the input keyboard drawing of the mobile phone and the mobile phone is accurate, and whether calibration needs to be re-calibrated.
  • the processor 110 of the mobile phone can complete the calibration of the relative positional relationship between the input keyboard drawing of the mobile phone and the mobile phone according to any two calibration points on the current mobile phone input keyboard drawing, and pass the first operating platform (ie, the input of the mobile phone after calibration).
  • the tapping signal on the keyboard drawing determines the tapping point position of the tapping signal (the position in the positioning coordinate system of the mobile phone).
  • the corresponding input key of the input key of the mobile phone drawing for example, the input key corresponding to the character "A" value.
  • the processor 1 10 can also complete the calibration of the relative position of the mobile phone input keyboard drawing and the mobile phone through two other calibration points on the input keyboard drawing of the mobile phone, and judge the mobile phone user on the first operating platform according to the data of the calibration ( That is, the tapping point position of the tapping signal on the input keyboard drawing of the mobile phone (the position in the positioning coordinate system of the mobile phone) Whether the key value of the input key on the input keyboard drawing is consistent with the key value of the input key previously determined, that is, whether it is the key value of the input key corresponding to the character "A", thereby judging the previously calibrated mobile phone and the mobile phone Enter the correct positional relationship of the keyboard drawing.
  • the processor 110 can combine the operation position of the input keyboard map preset in the input method application of the mobile phone with the operation position of the second operating platform of the mobile phone. The correspondence between the input keyboard drawing of the mobile phone and the operating position of the second operating platform of the mobile phone is determined.
  • the processor 110 when the processor 110 maps a tapping point position of the tapping signal on the first operating platform to an operating position on the second operating platform, the processor 110 is further specifically used for ;
  • the tapping signal according to a position of a tapping point of a tapping signal on the first operating platform in a positioning coordinate system of the terminal, and a relative position of the terminal input device and the terminal
  • the terminal inputs an operation location on the device
  • the tapping action can be performed on the input keyboard drawing, and the tapping signal will pass through the desktop.
  • the processor 110 can determine the position of the tapping point of the tapping signal in the positioning coordinate system of the mobile phone according to the tapping signal, and can also input the keyboard drawing and the mobile phone according to the current mobile phone.
  • the relative positional relationship determines the operating position of the input keyboard drawing of the current mobile phone corresponding to the tapping point position of the tapping signal on the first operating platform. .
  • the processor 1 10 determines the relative position of the input keyboard drawing of the mobile phone and the mobile phone, it can further determine that the operation of the mobile phone input keyboard drawing corresponding to the tapping point position of the tapping signal on the first operating platform
  • the position can further determine that the tapping signal is on the operation position of the phone input keyboard drawing corresponding to the tapping point position on the input keyboard drawing of the mobile phone (ie, the character at the position corresponding to the tapping point can be judged), and then
  • the input characters on the phone input keyboard drawing correspond to the input characters on the input keyboard map built in the input method application of the mobile phone, so as to map the tapping point position of the tapping signal on the mobile phone input keyboard drawing to the input method built into the mobile phone.
  • the operating position of the applied character input is ie, the character at the position corresponding to the tapping point can be judged
  • the second operating platform of the mobile phone described in this embodiment includes an access device on the mobile phone (ie, an input device different from the first operating platform), an input interface of the application of the mobile phone, and an input soft keyboard of the input method of the mobile phone (That is, the phone's character input soft keyboard) and other inputs on the phone.
  • the relative position of the input drawing and the mobile phone can also be calibrated according to the above method, and the input drawing of the mobile phone user can be customized and the corresponding mobile phone built in the mobile phone.
  • the key value of the input soft keyboard of the application is used to establish a connection, and according to the above method, after the tapping point position of the tapping signal is determined on the operation position of the input drawing of the mobile phone user, the tapping point of the tapping signal can be The location is mapped to the operating position of the second operating platform of the mobile phone (ie, the input soft keyboard of the corresponding mobile phone application built in the mobile phone) (specifically, the key value of the key input to the soft keyboard).
  • the tapping signal may be used as the second operating platform of the mobile phone.
  • the trigger signal at the operating position generates a mobile phone input signal corresponding to the trigger signal for the mobile phone.
  • the processor 1 10 is configured to: when the tapping signal is used as a trigger signal on an operation position on the second operating platform, to generate a terminal input signal corresponding to the trigger signal for the terminal, specifically:
  • the processor 11 0 determines that the location of the tapping signal on the input keyboard drawing of the mobile phone and the tapping signal is on the mobile phone. After inputting the position of the tapping point on the keyboard map to the key value of the key of the input soft keyboard of the input method applied by the mobile phone, the input method of the tapping point position mapping of the tapping signal in the input method of the mobile phone is applied.
  • the character corresponding to the key value of the button in the input soft keyboard of the application, and the input character used as the input method of the mobile phone is output to the input box of the mobile phone interface, that is, the input signal of the mobile phone is generated.
  • the mobile phone input signal is generated by the mobile phone as described in this embodiment, as long as the input keyboard drawing of the mobile phone is calibrated and the position is determined, all the characters on the mobile phone input keyboard drawing are located in the positioning coordinate system of the mobile phone for the mobile phone.
  • the mobile phone when the mobile phone user taps on the keyboard drawing, the mobile phone can judge the character that the mobile phone user taps according to the tapping point position of the tapping signal, and generate the character as the trigger signal of the mobile phone input signal, and generate The input signal of the mobile phone can complete the conversion of the tap signal to the input signal of the mobile phone.
  • the mobile phone user customizes the input sound corresponding to each operation position on the drawing or inputs characters (such as the pitch and volume corresponding to the piano keys), and then processes
  • the controller 110 determines that the position of the tap signal on the input sheet and maps the tapping point position of the tap signal on the input sheet to the key value of the button built in the input soft keyboard of the mobile phone application,
  • the tone or volume corresponding to the key value of the button in the input soft keyboard of the tapping point position mapping of the tapping signal in the corresponding application is transferred, and the corresponding music is output according to the tone or the volume.
  • the processor 11 0 can determine the character tapped by the mobile phone user according to the position of the tapping point of the tapping signal, and use the character as a trigger signal of the input signal of the mobile phone to generate a mobile phone input signal and play a segment.
  • the music played by the mobile phone user can complete the tapping Signal to phone input signal conversion.
  • the embodiment of the invention can map the location of the tapping point of the tapping signal on the operating platform such as the input keyboard drawing of the mobile phone or the input drawing of the mobile phone to the key value of the input soft keyboard of the input method of the mobile phone or the mobile phone.
  • the key value of the input key of the input soft keyboard of the other application, and the key value of the operation position on the input device of the mobile phone, and the tapping signal is used as a trigger signal at the operating position to trigger the internal application of the mobile phone.
  • the input signal of the mobile phone corresponding to the trigger signal is generated, which expands the generation path of the input signal of the mobile phone, improves the interest of generating the input signal of the mobile phone, and improves the user experience of the mobile phone.
  • the storage medium may be a magnetic disk, an optical disk, or a read-only memory (ROM) or a random acco ss memory (RAM). Wait.

Abstract

Disclosed in an embodiment of the present invention is a terminal input signal generation method, comprising: obtaining a tap signal on a first operating platform; determining the tap point position of the tap signal on the first operating platform; mapping the tap point position of the tap signal on the first operating platform to an operation position on a second operating platform; using the tap signal as a trigger signal of the operation position on the second operating platform to generate a terminal input signal corresponding to the trigger signal for the terminal. Also disclosed in the embodiment of the present invention is a terminal input signal generation device. The present invention provides more ways of terminal input signal generation, improves convenience and interest of terminal input signal generation, and enhances terminal user experience.

Description

一种生成终端输入信号的方法、 装置及终端  Method, device and terminal for generating terminal input signal
本申请要求于 2013 年 6 月 26 日提交中国专利局、 申请号为 201310259999.7、 发明名称为 "一种生成终端输入信号的方法、 装置及终 端" 的中国专利申请的优先权, 其全部内容通过引用结合在本申请中。 技术领域 This application claims priority to Chinese Patent Application No. 201310259999.7, entitled "A Method, Apparatus and Terminal for Generating Terminal Input Signals", filed on June 26, 2013, the entire contents of which are incorporated by reference. Combined in this application. Technical field
本发明涉及电子技术领域, 尤其涉及一种生成终端输入信号的方法、 装 置及终端。  The present invention relates to the field of electronic technologies, and in particular, to a method, device and terminal for generating a terminal input signal.
背景技术 Background technique
随着手机技术的高速发展,手机的应用市场上已出现了较多的钢琴弹 奏音乐等游戏应用, 手机输入法的发展也逐渐成熟, 手机用户可通过手 机的触摸屏弹奏各种音乐, 可通过手机的触摸屏在手机内置的软键盘上 输入字符等。 然而, 现有技术中, 手机用户在使用手机的应用程序里面 的钢琴弹奏游戏时, 需要打开手机钢琴弹奏游戏的游戏界面, 并点亮手 机触摸屏, 在游戏应用程序的软键盘琴键上弹奏音乐。 现有技术中, 手 机用户在手机的软键盘琴键上弹奏音乐时弹奏的音效无法根据手机用户 敲击软键盘琴键的轻重程度发生变化, 无法激起手机用户弹奏音乐的热 情。 现有技术中, 手机用户通过手机输入法输入字符时, 只能通过手机 触摸屏上的输入法的输入软键盘进行字符输入, 输入字符时软键盘占用 触摸屏的空间, 使得用户在输入字符的过程中, 真正可用的屏幕空间变 小了, 而且手机输入法的软键盘上字符小并且密集, 用户输入不方便。  With the rapid development of mobile phone technology, there have been more game applications such as piano playing music in the mobile phone application market. The development of mobile phone input method has gradually matured, and mobile phone users can play various music through the touch screen of mobile phones. Enter characters on the built-in soft keyboard of the phone through the touch screen of the phone. However, in the prior art, when the mobile phone user plays the game on the piano in the application of the mobile phone, the game interface of the mobile phone piano playing game needs to be opened, and the touch screen of the mobile phone is illuminated, and the soft keyboard key of the game application is played. Playing music. In the prior art, the sound effect played by the user of the mobile phone when playing music on the soft keyboard keys of the mobile phone cannot be changed according to the degree of the weight of the soft keyboard of the mobile phone user, and the hot feeling of playing music by the mobile phone user cannot be stimulated. In the prior art, when a mobile phone user inputs a character through a mobile phone input method, the character input can only be performed through an input soft keyboard of the input method on the touch screen of the mobile phone, and the soft keyboard occupies the space of the touch screen when the character is input, so that the user inputs the character. The screen space that is actually available becomes smaller, and the characters on the soft keyboard of the mobile phone input method are small and dense, and the user input is inconvenient.
现有技术中, 手机用户玩手机游戏, 或者使用手机的输入法时, 需要 通过手机上的软键盘琴键或者软键盘字符输入按键进行输入, 操作不方 便, 而且还需要点亮手机的触摸屏幕消耗能量, 输入过程中手机的软键 盘还占用手机屏幕空间, 输入按键小并且密集, 输入不方便, 用户体验 效果低。 发明内容 In the prior art, when a mobile phone user plays a mobile game or uses an input method of a mobile phone, it needs to input through a soft keyboard key or a soft keyboard character input button on the mobile phone, which is inconvenient to operate, and also needs to light the touch screen consumption of the mobile phone. Energy, the soft key of the phone during the input process The disk also occupies the screen space of the mobile phone, the input keys are small and dense, the input is inconvenient, and the user experience is low. Summary of the invention
本发明实施例提供一种生成终端输入信号的方法、一种生成终端输入 信号的装置及一种终端。 可将第一操作平台上的敲击信号的敲击点位置 映射为第二操作平台上的操作位置, 并将该敲击信号作为第二操作平台 上的操作位置上的触发信号, 为终端生成输入信号, 拓展了终端输入信 号的生成途径, 提高了终端输入信号的生成的便捷性和趣味性, 提高了 终端的用户体验效果。  Embodiments of the present invention provide a method for generating a terminal input signal, a device for generating a terminal input signal, and a terminal. The tapping point position of the tapping signal on the first operating platform may be mapped to the operating position on the second operating platform, and the tapping signal is used as a trigger signal on the operating position on the second operating platform to generate the terminal The input signal expands the generation path of the terminal input signal, improves the convenience and interest of the terminal input signal generation, and improves the user experience of the terminal.
本发明实施例第一方面提供了一种生成终端输入信号的方法, 包括: 获取第一操作平台上的敲击信号;  A first aspect of the embodiments of the present invention provides a method for generating a terminal input signal, including: acquiring a tap signal on a first operating platform;
判断所述敲击信号在所述第一操作平台上的敲击点位置;  Determining a tapping point position of the tap signal on the first operating platform;
将所述敲击信号在所述第一操作平台上的敲击点位置映射为所述第 二操作平台上的操作位置;  Mapping a tapping point position of the tap signal on the first operating platform to an operating position on the second operating platform;
将所述敲击信号作为所述第二操作平台上的操作位置上的触发信号, 为终端生成对应于所述触发信号的终端输入信号。  The tapping signal is used as a trigger signal on an operation position on the second operating platform to generate a terminal input signal corresponding to the trigger signal for the terminal.
结合第一方面, 在第一种可能的实现方式中, 所述第一操作平台, 包 括: 所述终端本体、 放置所述终端的平整物体表面、 所述终端输入设备 中至少一种;  With reference to the first aspect, in a first possible implementation, the first operating platform includes: the terminal body, a surface of a flat object on which the terminal is placed, and at least one of the terminal input devices;
所述第二操作平台为所述终端的应用程序的输入界面、所述终端的字 符输入软键盘中至少一种。  The second operating platform is at least one of an input interface of an application of the terminal and a character input soft keyboard of the terminal.
结合第一方面第一种可能的实现方式, 在第二种可能的实现方式中, 所述敲击信号, 包括: 振动机械波、 敲击时间、 敲击强度中至少一种。  In conjunction with the first possible implementation of the first aspect, in a second possible implementation, the tapping signal includes: at least one of a vibration mechanical wave, a tapping time, and a tapping strength.
结合第一方面第二种可能的实现方式, 在第三种可能的实现方式中, 所述判断所述敲击信号在所述第一操作平台上的敲击点位置, 包括: 釆集所述终端中各个传感器在所述终端的定位坐标系中的位置坐标, 所述传感器用于获取所述敲击信号并且不少于 3个; With reference to the second possible implementation manner of the first aspect, in a third possible implementation, the determining, by the determining, the location of the tapping point of the tapping signal on the first operating platform includes: Position coordinates of each sensor in the terminal in the positioning coordinate system of the terminal, The sensor is configured to acquire the tapping signal and not less than three;
根据所述敲击信号的振动机械波的传播速度,所述传感器接收到所述 振动机械波的时刻, 所述敲击信号的敲击时刻, 以及所述各个传感器在 所述终端的定位坐标系中的位置坐标, 得到所述敲击信号在所述第一操 作平台上的敲击点在所述终端的定位坐标系中的位置。  a timing of the vibration mechanical wave according to the tapping signal, a timing at which the sensor receives the vibration mechanical wave, a tapping timing of the tapping signal, and a position of the respective sensor in a positioning coordinate system of the terminal Position coordinates, obtaining a position of a tapping point of the tap signal on the first operating platform in a positioning coordinate system of the terminal.
结合第一方面至第一方面的第三种可能的实现方式中的任一种,在第 四种可能的实现方式中, 所述将所述敲击信号在所述第一操作平台上的 敲击点位置映射为所述第二操作平台上的操作位置, 包括:  In combination with the first aspect to any one of the third possible implementation manners of the first aspect, in a fourth possible implementation, the tapping the tapping signal on the first operating platform The hit location is mapped to the operation location on the second operating platform, including:
将所述敲击信号在所述第一操作平台上的敲击点在所述终端的定位 坐标系中的位置与所述终端中预置的定位数据库进行匹配, 判断所述敲 击信号在所述第一操作平台上的敲击点位置对应的所述第二操作平台上 的操作位置, 将所述敲击信号在所述第一操作平台上的敲击点位置映射 为所述第二操作平台上的操作位置。  Matching a position of the tapping point of the tapping signal on the first operating platform in a positioning coordinate system of the terminal with a positioning database preset in the terminal, and determining that the tapping signal is in the Mapping an operation position on the second operating platform corresponding to a tapping point position on the first operating platform, mapping a tapping point position of the tapping signal on the first operating platform to the second operation The operating position on the platform.
结合第一方面第一种可能的实现方式至第三种可能的实现方式中的 任一种, 在第五种可能的实现方式中, 若所述敲击信号为所述终端输入 设备上的敲击信号,则所述获取第一操作平台上的敲击信号之前, 包括: 获取终端输入设备上的校准点上的敲击信号,并判断所述终端输入设 备上的校准点在所述定位坐标系中的位置;  With reference to any one of the first possible implementation to the third possible implementation of the first aspect, in a fifth possible implementation, if the tapping signal is a tap on the terminal input device Before the signal is struck, the obtaining the tapping signal on the first operating platform includes: acquiring a tapping signal on the calibration point on the terminal input device, and determining that the calibration point on the terminal input device is in the positioning coordinate Location in the system;
根据所述校准点在所述终端的定位坐标系中的位置,以及所述校准, 在所述终端输入设备上的位置, 确定所述终端输入设备与所述终端的相 对位置。  And determining a relative position of the terminal input device and the terminal according to a position of the calibration point in a positioning coordinate system of the terminal, and the calibration, a position on the terminal input device.
结合第一方面第五种可能的实现方式, 在第六种可能的实现方式中, 所述将所述敲击信号在所述第一操作平台上的敲击点位置映射为所述第 二操作平台上的操作位置, 包括:  With reference to the fifth possible implementation manner of the first aspect, in a sixth possible implementation, the mapping the location of the tapping point of the tapping signal on the first operating platform to the second operation Operating locations on the platform, including:
根据所述第一操作平台上的敲击信号的敲击点在所述终端的定位坐 标系中的位置, 以及所述终端输入设备与所述终端的相对位置, 判断所 述敲击信号在所述终端输入设备上的操作位置; Positioning at the terminal according to a tapping point of a tapping signal on the first operating platform a position in the marking system, and a relative position of the terminal input device and the terminal, determining an operating position of the tapping signal on the terminal input device;
根据预设的所述终端输入设备上的操作位置与所述第二操作平台上 的操作位置的对应关系, 将所述终端输入设备上的敲击信号的敲击点位 置映射为所述第二操作平台上的操作位置。  Mapping a tap point position of a tap signal on the terminal input device to the second according to a preset correspondence between an operation position on the terminal input device and an operation position on the second operation platform The operating position on the operating platform.
结合第一方面第一种可能的实现方式, 在第七种可能的实现方式中, 所述终端输入设备, 包括: 所述终端的输入键盘图纸、 所述终端用户自 定义的输入图纸中至少一种。  With reference to the first possible implementation manner of the first aspect, in a seventh possible implementation, the terminal input device includes: at least one of an input keyboard drawing of the terminal, and an input drawing customized by the terminal user. Kind.
结合第一方面第二种可能的实现方式至第七种可能的实现方式中的 任一种, 在第八种可能的实现方式中, 所述将所述敲击信号作为所述第 二操作平台上的操作位置上的触发信号, 为终端生成对应于所述触发信 号的终端输入信号, 包括:  With reference to the second possible implementation of the first aspect, the seventh possible implementation manner, in the eighth possible implementation, the using the tapping signal as the second operating platform The trigger signal on the operating position of the terminal generates a terminal input signal corresponding to the trigger signal for the terminal, including:
将所述敲击信号作为所述第二操作平台上的操作位置上的触发信号, 并根据所述敲击信号的敲击强度, 生成与所述敲击信号的敲击强度相对 应的信号强度的终端输入信号。  Using the tapping signal as a trigger signal on an operation position on the second operating platform, and generating a signal strength corresponding to the tapping strength of the tapping signal according to the tapping intensity of the tapping signal Terminal input signal.
结合第一方面至第一方面第八种可能的实现方式中任一种,在第九种 可能的实现方式中, 所述终端, 包括: 手机、 平板电脑、 笔记本电脑、 数码相机、 数码摄像机中至少一种。  With reference to the first aspect to any one of the eighth possible implementation manners of the first aspect, in the ninth possible implementation manner, the terminal includes: a mobile phone, a tablet computer, a notebook computer, a digital camera, a digital video camera At least one.
本发明实施例第二方面提供了一种生成终端输入信号的装置, 包括: 获取模块, 用于获取第一操作平台上的敲击信号;  A second aspect of the embodiments of the present invention provides an apparatus for generating a terminal input signal, including: an acquiring module, configured to acquire a tapping signal on a first operating platform;
定位模块,用于判断所述敲击信号在所述第一操作平台上的敲击点位 置;  a positioning module, configured to determine a location of a tapping point of the tapping signal on the first operating platform;
映射模块,用于将所述敲击信号在所述第一操作平台上的敲击点位置 映射为所述第二操作平台上的操作位置;  a mapping module, configured to map a tapping point position of the tapping signal on the first operating platform to an operating position on the second operating platform;
生成模块,用于将所述敲击信号作为所述第二操作平台上的操作位置 上的触发信号, 为终端生成对应于所述触发信号的终端输入信号。 Generating a module for using the tapping signal as an operating position on the second operating platform The trigger signal on the terminal generates a terminal input signal corresponding to the trigger signal for the terminal.
结合第二方面, 在第一种可能的实现方式中, 所述第一操作平台, 包 括: 所述终端本体、 放置所述终端的平整物体表面、 所述终端输入设备 中至少一种;  With reference to the second aspect, in a first possible implementation, the first operating platform includes: the terminal body, a surface of a flat object on which the terminal is placed, and at least one of the terminal input devices;
所述第二操作平台为所述终端的应用程序的输入界面、所述终端的字 符输入软键盘中至少一种。  The second operating platform is at least one of an input interface of an application of the terminal and a character input soft keyboard of the terminal.
结合第二方面第一种可能的实现方式,在第二可能的实现方式中, 所 述敲击信号, 包括: 振动机械波、 敲击时间、 敲击强度中至少一种。  In conjunction with the first possible implementation of the second aspect, in a second possible implementation, the tapping signal includes: at least one of a vibration mechanical wave, a tapping time, and a tapping strength.
结合第二方面第一种可能的实现方式, 在第三种可能的实现方式中, 所述定位模块, 包括:  With reference to the first possible implementation manner of the second aspect, in a third possible implementation manner, the positioning module includes:
釆集单元,用于釆集所述终端中各个传感器在所述终端的定位坐标系 中的位置坐标, 所述传感器用于获取所述敲击信号并且不少于 3个; 第一处理单元, 用于根据所述敲击信号的振动机械波的传播速度, 所 述传感器接收到所述振动机械波的时刻, 所述敲击信号的敲击时刻, 以 及所述各个传感器在所述终端的定位坐标系中的位置坐标, 得到所述敲 击信号在所述第一操作平台上的敲击点在所述终端的定位坐标系中的位 置。  a collecting unit, configured to collect position coordinates of each sensor in the terminal in a positioning coordinate system of the terminal, where the sensor is configured to acquire the tapping signal and not less than three; a propagation velocity of the vibration mechanical wave according to the tapping signal, a timing at which the sensor receives the vibration mechanical wave, a tapping timing of the tapping signal, and a positioning coordinate system of the respective sensor at the terminal Position coordinates in the middle, obtaining a position of a tapping point of the tapping signal on the first operating platform in a positioning coordinate system of the terminal.
结合第二方面至第二方面的第三种可能的实现方式中的任一种,在第 四种可能的实现方式中, 所述映射模块, 具体用于:  With reference to any one of the second aspect to the third possible implementation of the second aspect, in a fourth possible implementation, the mapping module is specifically configured to:
将所述敲击信号在所述第一操作平台上的敲击点在所述终端的定位 坐标系中的位置与所述终端中预置的定位数据库进行匹配, 判断所述敲 击信号在所述第一操作平台上的敲击点位置对应的所述第二操作平台上 的操作位置, 将所述敲击信号在所述第一操作平台上的敲击点位置映射 为所述第二操作平台上的操作位置。  Matching a position of the tapping point of the tapping signal on the first operating platform in a positioning coordinate system of the terminal with a positioning database preset in the terminal, and determining that the tapping signal is in the Mapping an operation position on the second operating platform corresponding to a tapping point position on the first operating platform, mapping a tapping point position of the tapping signal on the first operating platform to the second operation The operating position on the platform.
结合第二方面第一种可能的实现方式至第三种可能的实现方式中的 任一种, 在第五种可能的实现方式中, 所述终端, 还包括: Combining the first possible implementation of the second aspect with the third possible implementation In any one of the fifth possible implementation manners, the terminal further includes:
校准釆集模块, 用于获取终端输入设备上的校准点的敲击信号, 并判 断所述终端输入设备上的校准点在所述终端的定位坐标系中的位置; 校准模块, 用于根据所述校准点在所述终端的定位坐标系中的位置, 以及所述校准点在所述终端输入设备上的位置, 确定所述终端输入设备 与所述终端的相对位置。  a calibration set module, configured to acquire a tap signal of a calibration point on the terminal input device, and determine a position of a calibration point on the terminal input device in a positioning coordinate system of the terminal; a calibration module, configured to Determining a position of the calibration point in the positioning coordinate system of the terminal, and a position of the calibration point on the terminal input device, determining a relative position of the terminal input device and the terminal.
结合第二方面第五种可能的实现方式, 在第六种可能的实现方式中, 所述映射模块, 包括:  With reference to the fifth possible implementation manner of the second aspect, in a sixth possible implementation, the mapping module includes:
判断单元,用于根据所述第一操作平台上的敲击信号的敲击点在所述 终端的定位坐标系中的位置, 以及所述终端输入设备与所述终端的相对 位置, 判断所述敲击信号在所述终端输入设备上的操作位置;  a determining unit, configured to determine, according to a position of a tapping point of a tapping signal on the first operating platform in a positioning coordinate system of the terminal, and a relative position of the terminal input device and the terminal, An operating position of the tap signal on the terminal input device;
映射单元,用于根据预设的所述终端输入设备上的操作位置与所述第 二操作平台上的操作位置的对应关系, 将所述终端输入设备上的敲击信 号的敲击点位置映射为所述第二操作平台的操作位置。  a mapping unit, configured to map a tapping point position of a tapping signal on the terminal input device according to a preset correspondence between an operation position on the terminal input device and an operation position on the second operating platform It is the operating position of the second operating platform.
结合第二方面第一种可能的实现方式, 在第七种可能的实现方式中, 所述终端输入设备, 包括: 所述终端的输入键盘图纸、 所述终端用户自 定义的输入图纸中至少一种。  With reference to the first possible implementation manner of the second aspect, in a seventh possible implementation, the terminal input device includes: at least one of an input keyboard drawing of the terminal, and an input drawing customized by the terminal user Kind.
结合第二方面第二种可能的实现方式至第七种可能的实现方式中的 任一种, 在第八种可能的实现方式中, 所述生成模块, 具体用于:  With reference to the second possible implementation of the second aspect, the seventh possible implementation manner, in the eighth possible implementation, the generating module is specifically configured to:
将所述敲击信号作为所述第二操作平台上的操作位置上的触发信号, 并根据所述敲击信号的敲击强度, 生成与所述敲击信号的敲击强度相对 应的信号强度的终端输入信号。  Using the tapping signal as a trigger signal on an operation position on the second operating platform, and generating a signal strength corresponding to the tapping strength of the tapping signal according to the tapping intensity of the tapping signal Terminal input signal.
结合第二方面至第二方面第八种可能的实现方式中任一种,在第九种 可能的实现方式中, 所述终端, 包括: 手机、 平板电脑、 笔记本电脑、 数码相机、 数码摄像机中至少一种。 本发明实施例第三方面提供了一种终端, 包括: With reference to any one of the second aspect to the eighth possible implementation manner of the second aspect, in the ninth possible implementation manner, the terminal includes: a mobile phone, a tablet computer, a notebook computer, a digital camera, a digital video camera At least one. A third aspect of the embodiments of the present invention provides a terminal, including:
传感器, 用于获取第一操作平台上的敲击信号;  a sensor, configured to acquire a tap signal on the first operating platform;
处理器,用于判断所述敲击信号在所述第一操作平台上的敲击点位置, 将所述敲击信号在所述第一操作平台上的敲击点位置映射为所述第二操 作平台上的操作位置, 并将所述敲击信号作为所述第二操作平台上的操 作位置上的触发信号, 为终端生成对应于所述触发信号的终端输入信号。  a processor, configured to determine a tapping point position of the tapping signal on the first operating platform, and map a tapping point position of the tapping signal on the first operating platform to the second Operating the position on the platform, and using the tapping signal as a trigger signal on the operating position on the second operating platform to generate a terminal input signal corresponding to the trigger signal for the terminal.
结合第三方面, 在第一种可能的实现方式中, 所述第一操作平台, 包 括: 所述终端本体、 放置所述终端的平整物体表面、 所述终端输入设备 中至少一种;  With reference to the third aspect, in a first possible implementation, the first operating platform includes: the terminal body, a surface of a flat object on which the terminal is placed, and at least one of the terminal input devices;
所述第二操作平台为所述终端的应用程序的输入界面、所述终端的字 符输入软键盘中至少一种。  The second operating platform is at least one of an input interface of an application of the terminal and a character input soft keyboard of the terminal.
结合第三方面第一种可能的实现方式, 在第二种可能的实现方式中, 所述敲击信号, 包括: 振动机械波、 敲击时间、 敲击强度中至少一种。  With reference to the first possible implementation manner of the third aspect, in a second possible implementation manner, the tapping signal includes: at least one of a vibration mechanical wave, a tapping time, and a tapping strength.
结合第三方面第二种可能的实现方式, 在第三种可能的实现方式中, 所述处理器在判断所述敲击信号在所述第一操作平台上的敲击点位置时, 具体用于:  With reference to the second possible implementation manner of the third aspect, in a third possible implementation manner, when the processor determines the location of the tapping point of the tapping signal on the first operating platform, In:
釆集所述终端中各个传感器在所述终端的定位坐标系中的位置坐标, 所述传感器用于获取所述敲击信号并且不少于 3个;  And locating a position coordinate of each sensor in the terminal in a positioning coordinate system of the terminal, where the sensor is configured to acquire the tapping signal and not less than three;
根据所述敲击信号的振动机械波的传播速度,所述传感器接收到所述 振动机械波的时刻, 所述敲击信号的敲击时刻,  a time at which the sensor receives the vibration mechanical wave according to a propagation speed of the vibration mechanical wave of the tap signal, a tapping time of the tap signal,
以及所述各个传感器在所述终端的定位坐标系中的位置坐标,得到所 述敲击信号在所述第一操作平台上的敲击点在所述终端的定位坐标系中 的位置。  And the position coordinates of the respective sensors in the positioning coordinate system of the terminal, and the position of the tapping point of the tapping signal on the first operating platform in the positioning coordinate system of the terminal is obtained.
结合第三方面至第三方面的第三种可能的实现方式中的任一种,在第 四种可能的实现方式中, 所述终端还包括存储器, 所述存储器用于存储 定位数据库, 则所述处理器在将所述敲击信号在所述第一操作平台上的 敲击点位置映射为所述第二操作平台上的操作位置时, 具体为: With reference to any one of the third aspect to the third possible implementation manner of the third aspect, in a fourth possible implementation, the terminal further includes a memory, where the memory is used for storing When the database is located, the processor maps the location of the tapping point on the first operating platform to the operating position on the second operating platform, specifically:
将所述敲击信号在所述第一操作平台上的敲击点在所述终端的定位 坐标系中的位置与所述存储器中存储的定位数据库进行匹配, 判断所述 敲击信号在所述第一操作平台上的敲击点位置对应的所述第二操作平台 上的操作位置, 将所述敲击信号在所述第一操作平台上的敲击点位置映 射为所述第二操作平台上的操作位置。  Matching a position of a tapping point of the tapping signal on the first operating platform in a positioning coordinate system of the terminal with a positioning database stored in the memory, determining that the tapping signal is in the An operation position on the second operating platform corresponding to a tapping point position on the first operating platform, mapping a tapping point position of the tapping signal on the first operating platform to the second operating platform The operating position on the top.
结合第三方面第一种可能的实现方式至第三种可能的实现方式中的 任一种, 在第五种可能的实现方式中, 所述处理器在判断所述敲击信号 在所述第一操作平台上的敲击点位置时, 还具体用于:  With reference to any one of the first possible implementation to the third possible implementation of the third aspect, in a fifth possible implementation, the processor determines that the tapping signal is in the When operating a tap point on a platform, it is also used to:
获取终端输入设备上的校准点的敲击信号,并判断所述终端输入设备 上的校准点在所述终端的定位坐标系中的位置;  Obtaining a tapping signal of a calibration point on the terminal input device, and determining a position of the calibration point on the terminal input device in a positioning coordinate system of the terminal;
根据所述校准点在所述终端的定位坐标系中的位置,以及所述校准, 在所述终端输入设备上的位置, 确定所述终端输入设备与所述终端的相 对位置。  And determining a relative position of the terminal input device and the terminal according to a position of the calibration point in a positioning coordinate system of the terminal, and the calibration, a position on the terminal input device.
结合第三方面第五种可能的实现方式, 在第六种可能的实现方式中, 所述处理器在将所述敲击信号在所述第一操作平台上的敲击点位置映射 为所述第二操作平台上的操作位置时, 还具体用于;  With reference to the fifth possible implementation manner of the third aspect, in a sixth possible implementation, the processor is configured to map a tapping point position of the tapping signal on the first operating platform to the When operating the position on the second operating platform, it is also specifically used;
根据所述第一操作平台上的敲击信号的敲击点在所述终端的定位坐 标系中的位置, 以及所终端输入设备与所述终端的相对位置, 判断所述 敲击信号在所述终端输入设备上的操作位置;  Determining, according to a position of a tapping point of a tapping signal on the first operating platform in a positioning coordinate system of the terminal, and a relative position of the terminal input device and the terminal, determining the tapping signal in the The operating position on the terminal input device;
根据预设的所述终端输入设备上的操作位置与所述第二操作平台上 的操作位置的对应关系, 将所述终端输入设备上的敲击信号的敲击点位 置映射为所述第二操作平台的操作位置。  Mapping a tap point position of a tap signal on the terminal input device to the second according to a preset correspondence between an operation position on the terminal input device and an operation position on the second operation platform The operating position of the operating platform.
结合第三方面第一种可能的实现方式, 在第七种可能的实现方式中, 所述终端输入设备, 包括: 所述终端的输入键盘图纸、 所述终端用户自 定义的输入图纸中至少一种。 With reference to the first possible implementation manner of the third aspect, in a seventh possible implementation manner, The terminal input device includes: at least one of an input keyboard drawing of the terminal and an input drawing customized by the terminal user.
结合第三方面第二种可能的实现方式至第七种可能的实现方式中的 任一种, 在第八种可能的实现方式中, 所述处理器在将所述敲击信号作 为所述第二操作平台上的操作位置上的触发信号, 为终端生成对应于所 述触发信号的终端输入信号时, 具体用于:  With reference to the second possible implementation of the third aspect, to any one of the seventh possible implementations, in an eighth possible implementation, the processor is configured to use the tapping signal as the first The trigger signal on the operating position on the second operating platform is used to generate a terminal input signal corresponding to the trigger signal for the terminal, specifically for:
将所述敲击信号作为所述第二操作平台上的操作位置上的触发信号, 并根据所述敲击信号的敲击强度, 生成与所述敲击信号的敲击强度相对 应的信号强度的终端输入信号。  Using the tapping signal as a trigger signal on an operation position on the second operating platform, and generating a signal strength corresponding to the tapping strength of the tapping signal according to the tapping intensity of the tapping signal Terminal input signal.
结合第三方面至第三方面第八种可能的实现方式,在第九种可能的实 现方式中, 所述终端, 包括: 手机、 平板电脑、 笔记本电脑、 数码相机、 数码摄像机中至少一种。  With reference to the third aspect to the eighth possible implementation manner of the third aspect, in the ninth possible implementation manner, the terminal includes: at least one of a mobile phone, a tablet computer, a notebook computer, a digital camera, and a digital video camera.
实施本发明实施例, 具有如下有益效果:  Embodiments of the present invention have the following beneficial effects:
本发明实施例通过获取第一操作平台上的敲击信号,判断该敲击信号 在第一操作平台上的敲击点位置, 并将该敲击信号在第一操作平台上的 敲击点位置映射为第二操作平台上的操作位置, 并以该敲击信号作为触 发信号生成终端的输入信号。 本发明实施例可将终端的第一次操作平台 上的敲击信息转换为终端的输入信号, 拓展了终端输入信号的生成途径, 增强了生成终端输入信号的便捷性和趣味性, 提高了终端的用户体验效 果。  In the embodiment of the present invention, the tapping signal on the first operating platform is obtained, the tapping point position of the tapping signal on the first operating platform is determined, and the tapping point of the tapping signal on the first operating platform is determined. The mapping is mapped to an operation position on the second operating platform, and the tapping signal is used as a trigger signal to generate an input signal of the terminal. The embodiment of the invention can convert the tapping information on the first operation platform of the terminal into the input signal of the terminal, expand the generation path of the terminal input signal, enhance the convenience and interest of generating the input signal of the terminal, and improve the terminal. User experience.
附图说明 DRAWINGS
为了更清楚地说明本发明实施例中的技术方案, 下面将对实施例描 述中所需要使用的附图作简单地介绍, 显而易见地, 下面描述中的附图 仅仅是本发明的一些实施例, 对于本领域普通技术人员来讲, 在不付出 创造性劳动的前提下, 还可以根据这些附图获得其他的附图。 图 1 是本发明实施例提供的生成终端输入信号的方法的第一实施例 流程示意图; In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings used in the description of the embodiments will be briefly described. It is obvious that the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, Other drawings can also be obtained from these drawings on the premise of creative labor. 1 is a schematic flow chart of a first embodiment of a method for generating a terminal input signal according to an embodiment of the present invention;
图 2 是本发明实施例提供的生成终端输入信号的方法的第一实施例 中判断敲击信号的敲击点位置的一原理示意图;  2 is a schematic diagram showing the principle of determining the location of a tap point of a tap signal in the first embodiment of the method for generating a terminal input signal according to an embodiment of the present invention;
图 3 是本发明实施例提供的生成终端输入信号的方法的第一实施例 中判断敲击信号的敲击点位置的另一原理示意图;  FIG. 3 is another schematic diagram of determining a location of a tap point of a tap signal in a first embodiment of a method for generating a terminal input signal according to an embodiment of the present invention; FIG.
图 4 是本发明实施例提供的生成终端输入信号的方法的第一实施例 中将敲击信号的敲击点位置映射为第二操作平台的操作位置的一操作示 意图;  4 is an operational diagram of mapping a tap point position of a tap signal to an operation position of a second operating platform in the first embodiment of the method for generating a terminal input signal according to an embodiment of the present invention;
图 5 是本发明实施例提供的生成终端输入信号的方法的第二实施例 流程示意图;  FIG. 5 is a schematic flowchart diagram of a second embodiment of a method for generating a terminal input signal according to an embodiment of the present disclosure;
图 6 是本发明实施例提供的生成终端输入信号的方法的第二实施例 中终端及其第一操作平台的一位置示意图;  6 is a schematic diagram of a location of a terminal and a first operating platform thereof in a second embodiment of a method for generating a terminal input signal according to an embodiment of the present invention;
图 7 是本发明实施例提供的生成终端输入信号的方法的第二实施例 中终端及其第一操作平台的另一位置示意图;  7 is a schematic diagram of another location of a terminal and its first operating platform in a second embodiment of a method for generating a terminal input signal according to an embodiment of the present invention;
图 8 是本发明实施例提供的生成终端输入信号的方法的第二实施例 中判断第二操作平台与终端的位置关系的一原理示意图;  8 is a schematic diagram of determining a positional relationship between a second operating platform and a terminal in a second embodiment of a method for generating a terminal input signal according to an embodiment of the present invention;
图 9 是本发明实施例提供的生成终端输入信号的装置的第一实施例 结构示意图;  9 is a schematic structural diagram of a first embodiment of an apparatus for generating a terminal input signal according to an embodiment of the present invention;
图 1 0是本发明实施例提供的生成终端输入信号的装置的第一实施例 中终端的定位模块的结构示意图;  FIG. 10 is a schematic structural diagram of a positioning module of a terminal in a first embodiment of an apparatus for generating a terminal input signal according to an embodiment of the present disclosure;
图 1 1是本发明实施例提供的生成终端输入信号的装置的第二实施例 结构示意图;  FIG. 11 is a schematic structural diagram of a second embodiment of an apparatus for generating a terminal input signal according to an embodiment of the present invention;
图 12是本发明实施例提供的终端的第一实施例结构示意图。 具体实施方式 FIG. 12 is a schematic structural diagram of a first embodiment of a terminal according to an embodiment of the present invention. detailed description
下面将结合本发明实施例中的附图, 对本发明实施例中的技术方案 进行清楚、 完整地描述, 显然, 所描述的实施例仅仅是本发明一部分实 施例, 而不是全部的实施例。 基于本发明中的实施例, 本领域普通技术 人员在没有做出创造性劳动前提下所获得的所有其他实施例, 都属于本 发明保护的范围。  The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.
本发明实施例中所描述的终端, 可包括: 手机、 平板电脑、 笔记本 电脑、 数码相机、 数码摄像机等终端。 上述终端仅是举例, 而非穷举。 下面将以手机为例, 对本发明实施例提供的生成终端输入信号的方法以 及终端进行具体描述。  The terminal described in the embodiment of the present invention may include: a mobile phone, a tablet computer, a notebook computer, a digital camera, a digital video camera, and the like. The above terminals are only examples, not exhaustive. The method for generating a terminal input signal and the terminal provided by the embodiment of the present invention will be specifically described below by taking a mobile phone as an example.
参见图 1 ,是本发明实施例提供的生成终端输入信号的方法的第一实 施例流程示意图。 其可包括步骤:  FIG. 1 is a schematic flowchart diagram of a first embodiment of a method for generating a terminal input signal according to an embodiment of the present invention. It can include the steps of:
S 101 , 获取第一操作平台上的敲击信号。  S101. Acquire a tap signal on the first operating platform.
具体实现中, 本实施例中所描述的第一操作平台, 可包括: 终端本 体、 放置终端的平整物体表面、 终端的输入设备等, 例如, 本实施例中 所描述的第一操作平台可以是手机本身, 或者放置手机的水平桌面、 地 面, 手机的输入键盘图纸、 用户自定义的输入图纸等。 当用户希望生成 终端输入信号时,可在手机上(包括手机的背面或者手机上的其他部位)、 或者放置手机的桌面上做敲击动作, 手机则可通过其内置传感器获取手 机上或者放置手机的桌面上的敲击信号, 以根据该敲击信号生成手机的 输入信号。 其中, 上述第一操作平台上的敲击信号, 可包括: 振动机械 波、 敲击时间、 敲击强度等。 例如, 手机用户使用手机应用程序中的钢 琴弹奏这个游戏时, 若需要手机根据敲击信号生成钢琴弹奏游戏的输入 信号, 则可在玩游戏之前先开启这个手机功能, 即根据第一操作平台上 的敲击信号生成钢琴弹奏游戏的输入信号的手机功能。 手机用户启动上 述手机功能之后, 则可在手机的背面或者放置手机的桌面上做弹奏音乐 的敲击动作, 手机通过其内置传感器获取到手机的背面或者放置手机的 桌面上的敲击信号之后, 则可根据该敲击信号生成手机钢琴弹奏的输入 信号。 手机用户无需通过钢琴弹奏游戏的虚拟琴键输入弹奏信号, 只需 在上述第一操作平台上做弹奏音乐的敲击动作即可完成钢琴弹奏的信号 输入。 In a specific implementation, the first operating platform described in this embodiment may include: a terminal body, a surface of a flat object on which the terminal is placed, an input device of the terminal, and the like. For example, the first operating platform described in this embodiment may be The phone itself, or the horizontal desktop, ground, mobile phone input keyboard drawings, user-defined input drawings, etc. When the user wants to generate a terminal input signal, he can tap on the mobile phone (including the back of the mobile phone or other parts of the mobile phone) or the desktop of the mobile phone, and the mobile phone can obtain the mobile phone or place the mobile phone through its built-in sensor. A tap signal on the desktop to generate an input signal of the mobile phone based on the tap signal. The tapping signal on the first operating platform may include: a vibration mechanical wave, a tapping time, a tapping intensity, and the like. For example, when a mobile phone user plays the game using the piano in the mobile application, if the mobile phone is required to generate an input signal of the piano playing game according to the tap signal, the mobile phone function can be turned on before the game is played, that is, according to the first operation. on the platform The tapping signal generates a phone function that the piano plays the input signal of the game. After the mobile phone user activates the above mobile phone function, the tapping action of playing music can be performed on the back of the mobile phone or on the desktop where the mobile phone is placed, and the mobile phone obtains the tapping signal on the back of the mobile phone or the desktop of the mobile phone through the built-in sensor. , the input signal of the mobile phone piano playing can be generated according to the tapping signal. The mobile phone user does not need to input the playing signal through the virtual keyboard of the piano playing the game, and only needs to perform the tapping action of the playing music on the first operating platform to complete the signal input of the piano playing.
具体实现中, 为了防止手机随意根据手机上或者放置手机的桌面上 的敲击信号生成手机输入信号, 影响手机的正常使用, 可设定一个启动 手机的生成手机输入信号的功能的启动方式。 当手机用户希望启动这个 手机功能 (即根据敲击信号生成手机输入信号的手机功能) 时, 则可在 第一操作平台上的指定位置做敲击动作, 手机获取到指定位置上的敲击 信号之后则可启动这个手机功能。 例如, 为了防止手机随意根据手机上 或者放置手机的桌面上的敲击信号生成手机的钢琴弹奏游戏的输入信号, 手机用户在开始弹奏音乐时, 可在手机的指定位置上做相应的敲击动作, 用以启动这个手机功能, 上述手机功能即为根据敲击信号生成手机的钢 琴弹奏游戏的输入信号的功能, 手机的内置传感器获取到手机的指定位 置上的敲击信号之后则可自行启动这个手机功能。 例如, 手机用户在使 用手机的应用程序中的钢琴弹奏这个游戏时, 可先在手机的左上角、 右 上角、 右下角、 左下角依次各敲击一下, 表示开始弹奏, 手机获取上述 手机位置上的敲击信号之后, 则可启动相应的手机功能 (即启动手机根 据敲击信号生成钢琴弹奏的输入信号的功能) ; 当手机用户想要结束游 戏时, 则可在手机的左下角、 右下角、 右上角、 左上角依次各敲击一下, 表示结束弹奏, 手机获取到上述位置上的敲击信号之后, 则可自行关闭 手机的游戏应用服务器, 不再接收生成钢琴弹奏的输入信号。 此外, 手 机用户也可在手机的上边、 下边、 左边、 右边依次各敲击一下表示开始 弹奏、 在手机的右边、 左边、 下边、 上边依次各敲击一下表示结束弹奏。 上述开始和结束弹奏的动作定义方式仅是举例, 而非穷举。 In the specific implementation, in order to prevent the mobile phone from randomly generating a mobile phone input signal according to the tapping signal on the mobile phone or the desktop of the mobile phone, affecting the normal use of the mobile phone, a startup mode of starting the function of generating the mobile phone input signal of the mobile phone may be set. When the mobile phone user wants to activate the mobile phone function (that is, the mobile phone function for generating the mobile phone input signal according to the tap signal), the tapping action can be performed at the designated position on the first operating platform, and the mobile phone obtains the tapping signal at the specified position. This phone function can then be activated. For example, in order to prevent the mobile phone from randomly generating an input signal of the piano playing game of the mobile phone according to the tapping signal on the mobile phone or the desktop of the mobile phone, the mobile phone user can perform corresponding knocking on the designated position of the mobile phone when starting to play the music. The action of the mobile phone is used to activate the function of the mobile phone. The function of the mobile phone is a function of generating an input signal of a piano playing game of the mobile phone according to the tapping signal, and the built-in sensor of the mobile phone can obtain the tapping signal at the designated position of the mobile phone. Start this phone function yourself. For example, when a mobile phone user plays the game on the piano in the application using the mobile phone, he can first tap on the top left corner, the upper right corner, the lower right corner, and the lower left corner of the mobile phone to start playing, and the mobile phone obtains the above mobile phone. After the tap signal in the position, the corresponding mobile phone function can be activated (ie, the function of starting the input signal of the piano to generate the piano playing according to the tapping signal); when the mobile phone user wants to end the game, the mobile phone can be in the lower left corner of the mobile phone. In the lower right corner, the upper right corner, and the upper left corner, each taps to indicate the end of the play. After the mobile phone obtains the tapping signal at the above position, the mobile game application server can be turned off by itself, and the piano playing is no longer received. input signal. In addition, hand The user can also tap on the top, bottom, left, and right sides of the phone to start playing, and tap on the right, left, bottom, and top of the phone to end the play. The manner in which the above actions are started and ended is only an example, not an exhaustive one.
S 102 , 判断所述敲击信号在所述第一操作平台上的敲击点位置。  S102. Determine a tapping point position of the tap signal on the first operating platform.
手机通过其内置传感器获取到第一操作平台上的敲击信号之后, 则 可根据该敲击信号判断该敲击信号在上述第一操作平台上的敲击点位置。 具体地, 可先以手机上的特定点 (例如手机的重心) 为坐标原点设定一 个手机的定位坐标系, 在手机显示屏所在的平面或者手机后盖所在的平 面内设定所述手机的定位坐标系, 以手机底边方向为 X 轴, 手机侧边方 向为 y 轴, 用于确定手机或者放置手机的桌面等操作平台上的敲击信号 的敲击点位置。 具体的, 可以手机上的特定点为坐标原点预先设定好手 机的定位坐标系的坐标轴, 并根据该定位坐标系确定手机中各个传感器 在上述定位坐标系中的位置, 比如, 如图 2 所示。 确定好手机的定位坐 标系之后, 则可根据手机的定位坐标系确定传感器 1、 传感器 2、 传感器 3、传感器 4在上述定位坐标系中的位置为( x l , yl ) 、 (x2 , y2 )、 ( x 3 , y3 ) 、 ( x4 , y4 ) , 其中, 由于手机的内置传感器相对于手机的位置为 固定位置, 则上述各个传感器在定位坐标系中的位置均为确定的位置, 即 xl、 yl、 x2、 y2、 x 3、 y 3、 x4、 y4均为已知数。 确定好手机内置传感 器 1、 传感器 2、 传感器 3、 传感器 4的位置之后, 当手机用户在 t时刻 在第一操作平台上的敲击点 (X , y ) 敲击一下后, 振动机械波产生并向 四周扩散后, 手机则可根据各个传感器接收到敲击信号的振动机械波的 时刻 t l (传感器 1接收的振动机械波的时刻) 、 t 2 (传感器 2接收的振 动机械波的时刻 ) 、 t 3 (传感器 3接收的振动机械波的时刻) 、 t 4 (传 感器 4 接收的振动机械波的时刻) , 结合敲击信号产生的时刻, 即敲击 信号的敲击时刻 t以及振动机械波的传播速度 V ,计算手机中各个传感器 与敲击信号的敲击点位置的距离。 手机在计算各个传感器与敲击信号的 敲击点位置的距离时, 可结合手机中各个传感器在上述定位坐标系中的 位置坐标, 根据振动机械波的传播速度乘以时间等于振动机械波的传播 距离 (即敲击点位置与各个传感器的距离) 处理得到各个传感器与敲击 点位置的距离与敲击信号的振动机械波的传播速度、 传感器接收到振动 机械波的时间点、 敲击信号的敲击时间点的关系等式, 如下 4元 2次方 程组: After the mobile phone obtains the tapping signal on the first operating platform through the built-in sensor, the tapping point of the tapping signal on the first operating platform may be determined according to the tapping signal. Specifically, a positioning coordinate system of a mobile phone may be set with a specific point on the mobile phone (for example, the center of gravity of the mobile phone) as a coordinate origin, and the mobile phone may be set in a plane where the mobile phone display screen is located or a plane where the mobile phone back cover is located. Positioning the coordinate system, the direction of the bottom edge of the mobile phone is the X axis, and the direction of the side of the mobile phone is the y axis, which is used to determine the tapping point position of the tapping signal on the operating platform such as the mobile phone or the desktop on which the mobile phone is placed. Specifically, the coordinate axis of the positioning coordinate system of the mobile phone may be preset in advance for the coordinate origin of the specific point on the mobile phone, and the position of each sensor in the mobile phone in the positioning coordinate system is determined according to the positioning coordinate system, for example, as shown in FIG. 2 . Shown. After determining the positioning coordinate system of the mobile phone, the position of the sensor 1, the sensor 2, the sensor 3, and the sensor 4 in the positioning coordinate system is determined to be (xl, yl), (x2, y2) according to the positioning coordinate system of the mobile phone. ( x 3 , y3 ) , ( x4 , y4 ) , wherein, since the position of the built-in sensor of the mobile phone relative to the mobile phone is a fixed position, the positions of the above-mentioned respective sensors in the positioning coordinate system are all determined positions, that is, xl, yl , x2, y2, x3, y3, x4, y4 are all known numbers. After determining the position of the built-in sensor 1, sensor 2, sensor 3, and sensor 4 of the mobile phone, when the mobile phone user taps on the tapping point (X, y) on the first operating platform at time t, the vibration mechanical wave is generated and directed After being spread around, the mobile phone can receive the vibration mechanical wave of the tap signal according to each sensor at time t1 (the time of the vibration mechanical wave received by the sensor 1), t 2 (the time of the vibration mechanical wave received by the sensor 2), t 3 (sensor 3) The time of the received vibrational mechanical wave), t 4 (the time of the vibration mechanical wave received by the sensor 4), and the time at which the tapping signal is generated, that is, the tapping time t of the tapping signal and the propagation velocity V of the vibrating mechanical wave, calculate each of the mobile phones Sensor The distance from the tapping point position of the tap signal. When calculating the distance between each sensor and the tapping point position of the tapping signal, the mobile phone can combine the position coordinates of each sensor in the mobile phone in the positioning coordinate system, and multiply the propagation speed of the vibration mechanical wave by the time equal to the propagation distance of the vibration mechanical wave ( That is, the distance between the position of the tapping point and each sensor is processed. The distance between each sensor and the position of the striking point is obtained, the propagation speed of the vibrating mechanical wave of the striking signal, the time point when the sensor receives the vibrating mechanical wave, and the tapping time of the tapping signal. The relationship equation is as follows: 4 yuan 2 equations:
- yf - t) x v
Figure imgf000015_0001
- yf - t) xv
Figure imgf000015_0001
」 - 2 + O - yf - t) x v
Figure imgf000015_0002
- 2 + O - yf - t) xv
Figure imgf000015_0002
由于上述数据中, 只有 v、 t、 x、 y为未知数, 则可通过给 v、 t、 x、 y一个预设值, 并通过迭代计算则可处理得知 v、 t、 x、 y四个未知数的 值, 即可确定敲击信号在第一操作平台上的敲击点位置 (X , y ) 。 Since v, t, x, and y are unknowns in the above data, you can process v, t, x, and y by a preset value, and by iterative calculation, you can know that v , t, x, and y are four. The value of the unknown number determines the tapping point position (X, y) of the tapping signal on the first operating platform.
具体实现中, 由于振动机械波在特定介质中的传播速度是固定的, 而手机壳体所用的介质是固定可知的 (由于手机壳体制作材质是手机出 厂时已经确定可知的, 则手机壳体所用的介质也为确定可知的) , 则振 动机械波在手机壳体上的传播速度也为固定可知的, 可预先存储于手机 中。 当手机用户在手机上 (即手机壳体上) 做敲击动作时, 敲击所产生 的振动机械波在手机上的传播速度 V则成为一个已知量, 在上述 4元 1 次方程组的计算处理过程中, 传播速度 V 则可当作已知数处理。 当敲击 点在手机上时, 通过 3 个传感器则可处理得知敲击信号在手机上的敲击 点在上述定位坐标系中的位置 (X , y ) 。 若有上述 4 个传感器, 则可根 据最小二乘法估算敲击点位置的计算精度, 即在本实施例中, 上述用于 获取敲击信号的传感器至少需要 3个, 最多不限。 如图 3 , 若敲击信号在手机外部, 即此时第一操作平台为放置手机的 桌面等平台时, 由于桌面的制作材质可能有多种类型(例如木材、 塑料、 铁皮等) , 使得敲击信号的振动机械波的传播介质变成不固定介质, 手 机无法预先判断得知敲击信号的振动机械波在当前放置手机的桌面上的 传播速度 V , 即此时振动机械波的传播速度 V为未知数。 当敲击信号的敲 击点位置在放置手机的桌面等平台时, 可根据上述手机的 4 个传感器获 取得到的数据来确定 v、 t、 x、 y四个未知数的值, 从而确定敲击信号在 第一操作平台上的敲击点位置。 手机根据上述传感器获取得到的数据判 断得知振动机械波在当前传播介质 (即放置手机的桌面) 上的传播速度 之后, 当手机用户在相同的介质上敲击第二次, 即手机用户在放置手机 的桌面上敲击第二次时, 由于振动机械波的传播速度 V 已确定可知, 根 据上述 4 个传感器获取到的数据则可初步估算敲击信号在第一操作平台 上的敲击点位置的计算精度。 具体的, 手机用户可根据上述方法得到第 二次敲击的敲击信号对应的 4元 2次方程, 并可将第一次敲击中判断得 知的振动机械波的传播速度 v(即振动机械波在放置手机的桌面上的传播 速度) 代入上述 4元 2次方程, 再结合其中任意三个方程式处理得到第 二次敲击的敲击信号在第一操作平台上的敲击点位置 1 (假设为手机坐标 系中的坐标 (xl、 yl ) ) 。 此外, 用户还可直接根据上述 4元 2次方程 处理得到第二次敲击的敲击信号在第一操作平台上的敲击点位置 2 (假设 为手机坐标系中的坐标 ( x2、 y2 ) ) , 并根据前面处理得到的敲击点位 置 1判断敲击点位置 2 ( x2、 y2 ) 和敲击点位置 1 ( xl、 yl ) 的坐标是否 重合或者误差是否在设定的误差范围内, 以此来估算敲击信号在第一操 作平台上的敲击点位置的计算精度。 In the specific implementation, since the propagation speed of the vibration mechanical wave in the specific medium is fixed, and the medium used for the mobile phone case is fixed and known (because the material of the mobile phone case is determined by the mobile phone, the mobile phone case is used for the mobile phone case) The medium is also known to be identifiable. The propagation speed of the vibrating mechanical wave on the casing of the mobile phone is also fixed and can be stored in advance in the mobile phone. When the mobile phone user makes a tapping action on the mobile phone (ie, the mobile phone casing), the propagation velocity V of the vibration mechanical wave generated by the tapping on the mobile phone becomes a known amount, and the calculation of the above-mentioned 4 yuan equation 1 is performed. During processing, the propagation velocity V can be treated as a known number. When the tapping point is on the mobile phone, the position of the tapping point of the tapping signal on the mobile phone in the positioning coordinate system (X, y) can be processed by the three sensors. If there are the above four sensors, the calculation accuracy of the position of the tapping point can be estimated according to the least squares method. In this embodiment, at least three sensors for acquiring the tapping signal are required, at most, not limited. As shown in Figure 3, if the tapping signal is outside the mobile phone, that is, when the first operating platform is a platform such as a desktop on which the mobile phone is placed, since the material of the desktop may be of various types (such as wood, plastic, iron, etc.), The propagation medium of the vibration mechanical wave of the hitting signal becomes an unfixed medium, and the mobile phone cannot predetermine the propagation velocity V of the vibration mechanical wave of the tapping signal on the desktop currently placed on the mobile phone, that is, the propagation velocity V of the vibration mechanical wave at this time is unknown. When the tapping point of the tapping signal is on the platform such as the desktop on which the mobile phone is placed, the values of the four unknowns of v, t, x, and y can be determined according to the data acquired by the four sensors of the mobile phone, thereby determining the tapping signal. The location of the tap point on the first operating platform. The mobile phone judges, according to the data obtained by the above sensor, the speed of the vibration mechanical wave on the current propagation medium (ie, the desktop on which the mobile phone is placed), when the mobile phone user taps the second time on the same medium, that is, the mobile phone user places the mobile phone. When tapping the second time on the desktop, since the propagation velocity V of the vibrating mechanical wave has been determined, the calculation of the tapping point position of the tapping signal on the first operating platform can be initially estimated based on the data acquired by the above four sensors. Precision. Specifically, the mobile phone user can obtain the 4-element second-order equation corresponding to the tapping signal of the second tap according to the above method, and can determine the propagation velocity v of the vibrating mechanical wave (ie, the vibrating mechanical wave) in the first tapping. The propagation speed on the desktop where the mobile phone is placed) is substituted into the above 4-ary equation 2, and then combined with any three of the equations to obtain the tapping signal of the second tap on the first operating platform. Is the coordinates (xl, yl) in the phone coordinate system. In addition, the user can directly obtain the tapping point position 2 of the tapping signal of the second tap on the first operating platform according to the above 4-ary equation 2 (assuming coordinates (x2, y2) in the mobile coordinate system. ), and according to the position 1 of the tapping point obtained in the previous processing, it is judged whether the coordinates of the tapping point position 2 (x2, y2) and the tapping point position 1 (xl, yl) coincide or whether the error is within the set error range, In this way, the calculation accuracy of the tapping point position of the tap signal on the first operating platform is estimated.
S 103 , 将所述敲击信号在所述第一操作平台上的敲击点位置映射为 第二操作平台上的操作位置。 S 1 04 , 将所述敲击信号作为所述第二操作平台上的操作位置上的触 发信号, 为终端生成对应于所述触发信号的终端输入信号。 S103. Map a tapping point position of the tap signal on the first operating platform to an operating position on the second operating platform. S 1 04 , using the tapping signal as a trigger signal on an operation position on the second operating platform, and generating a terminal input signal corresponding to the trigger signal for the terminal.
具体实现中, 上述第二操作平台为终端的应用程序的输入界面、 终 端的字符输入软键盘等终端上的输入平台。 例如, 手机上的应用程序中 的钢琴弹奏游戏的虚拟琴键、 手机输入法的字符输入软键盘、 手机的拍 照功能界面上的拍摄按钮等。 上述操作按键仅是举例, 而非穷举。 上述 第二操作平台上的操作位置, 具体可为: 终端的应用程序的输入按键的 键值、 终端的字符输入软键盘的键值、 终端的触摸屏上的触摸位置等, 例如, 手机上的应用程序中的钢琴弹奏游戏的琴键的键值、 手机输入法 的字符输入键盘的键值, 手机的拍照功能的拍摄按键的键值, 手机的触 摸屏上的触摸坐标等。  In a specific implementation, the second operating platform is an input platform of an application input interface of the terminal, a character input soft keyboard of the terminal, and the like. For example, the virtual keyboard of the piano playing game in the application on the mobile phone, the character input soft keyboard of the mobile phone input method, the shooting button on the photographing function interface of the mobile phone, and the like. The above operation buttons are only examples, not exhaustive. The operation position on the second operating platform may be: a key value of an input button of the application of the terminal, a key value of a character input soft keyboard of the terminal, a touch position on a touch screen of the terminal, etc., for example, an application on the mobile phone The key value of the piano playing game in the program, the key value of the character input keyboard of the mobile phone input method, the key value of the shooting button of the camera function of the mobile phone, the touch coordinates on the touch screen of the mobile phone, and the like.
手机判断得知第一操作平台上的敲击信号的敲击点位置之后, 则可 将敲击信号在第一操作平台上的敲击点在手机的定位坐标系中的位置与 预先存储的定位数据库进行匹配, 通过数据库匹配来判断敲击信号在第 一操作平台上的敲击点位置对应的手机的第二操作平台上的操作位置, 并将在敲击信号在第一操作平台上的敲击点位置映射为手机的第二操作 平台上的操作位置。 具体实现中, 可预先以上述手机的定位坐标系为参 照系设定手机一个可感知的敲击区域, 例如, 可预先以手机的定位坐标 系的原点为中心设定一个边长为长 2X、 宽 2Y (其中, X、 Y的具体数值可 在设定手机的定位坐标系的同时设定, 也可通过手机用户 自定义设置) 的方形区域为手机的可感知区域, 并设定上述可感知区域中每一个敲击 位置对应的手机的第二操作平台上的操作位置 (具体可为手机的第二操 作平台上的按键的键值等) , 将所有对应关系存储至手机定位数据库。 当手机用户将手机放置平稳并确定好手机的第一操作平台 (例如手机本 体或者放置手机的桌面等) 时, 手机根据其定位坐标系则可确定当前第 一操作平台上的可感知区域 (例如手机本体上的特定区域或者放置手机 的桌面上的特定区域) 。 当手机用户在第一操作平台上的可感知区域范 围内做敲击动作时, 手机则可将敲击信号在第一操作平台上的敲击点在 定位坐标系中的位置与预先存储的定位数据库进行匹配, 确定当前第一 操作平台上的敲击点位置对应的第二操作平台上的操作位置。 例如, 如 图 2 所示的场景, 当手机用户在手机背面做敲击动作之后, 手机判断得 知手机上的敲击信号的敲击点位置时, 则可通过手机内置的定位数据库 进行匹配, 将当前手机上的敲击信号的敲击点位置映射为对应的手机的 钢琴弹奏游戏上的琴键的键值, 进而以该敲击信号为该琴键上的触发信 号, 为终端生成对应于该触发信号的钢琴弹奏游戏的输入信号。 例如, 如图 4 所示当手机判断得知敲击信号在手机背面的敲击点位置为手机背 面的左上角上的一个点 (如图 4 上所示的敲击点) 时, 则可通过手机的 内置定位数据库匹配得知当前的敲击点位置对应于手机的钢琴弹奏游戏 上的虚拟琴键为琴键盘上左起第三个按键(即图 4中映射点对应的按键) 的键值, 即可将敲击信号在手机背面上的敲击点位置映射为手机的钢琴 弹奏游戏的按键的键值。 同理, 当敲击信号的敲击点位置在手机背面的 其他位置上时, 也可通过手机的内置定位数据库进行匹配, 判断敲击信 号的敲击点位置对应于虚拟琴键上的按键的键值。 手机判断得知敲击信 号的敲击点位置对应的手机的钢琴弹奏游戏的虚拟键盘的特定琴键的键 值之后, 手机可以以该敲击信号作为该琴键键值的触发信号, 以该敲击 信号去触发手机内置的虚拟钢琴应用, 并通过手机的内置虚拟钢琴的应 用程序调用手机的音乐播放管理器播放对应该敲击信号的音乐。 即手机 可将敲击信号的敲击点位置映射为手机上的虚拟钢琴应用上的按键的键 值, 将该敲击信号转换为手机的虚拟钢琴应用上的按键的触发信号, 通 过手机的虚拟钢琴应用程序调用音乐播放管理器发出与该按键的音调相 对应的音调的声音, 并根据该敲击信号的敲击强度调节与该敲击强度对 应的音量的音乐, 即手机可根据手机用户的敲击位置以及敲击强度以不 同的音量发出不同音调的音乐。 用户可根据自己的敲击动作调节手机发 出的音乐的音调和音量, 更好地调动手机用户通过手机弹奏音乐的兴趣 与激情, 还可以触发手机用户的音乐创作灵感, 提高了的信号输入的趣 味性。 After the mobile phone determines that the tapping point position of the tapping signal on the first operating platform is known, the position of the tapping point of the tapping signal on the first operating platform in the positioning coordinate system of the mobile phone and the pre-stored positioning may be The database is matched, and the operation position on the second operating platform of the mobile phone corresponding to the tapping point position of the tapping signal on the first operating platform is determined by database matching, and the tapping signal is tapped on the first operating platform. The hit location is mapped to the operational location on the second operating platform of the handset. In a specific implementation, a perceptible tapping area of the mobile phone may be set in advance by using the positioning coordinate system of the mobile phone as a reference system. For example, a side length of the mobile phone positioning coordinate system may be set to be 2× long. Width 2Y (where the specific values of X and Y can be set at the same time as setting the positioning coordinate system of the mobile phone, or can be customized by the user of the mobile phone), the square area of the mobile phone is the perceptible area of the mobile phone, and the above-mentioned perceptible is set. The operation position on the second operating platform of the mobile phone corresponding to each tapping position in the area (specifically, the key value of the button on the second operating platform of the mobile phone, etc.), and all the corresponding relationships are stored in the mobile phone positioning database. When the mobile phone user places the mobile phone smoothly and determines the first operating platform of the mobile phone (such as the mobile phone body or the desktop on which the mobile phone is placed), the mobile phone can determine the current first according to its positioning coordinate system. A perceptible area on the operating platform (such as a specific area on the phone body or a specific area on the desktop where the phone is placed). When the mobile phone user performs a tapping action within the perceptible area of the first operating platform, the mobile phone can position the tapping point of the tapping signal on the first operating platform in the positioning coordinate system and the pre-stored positioning. The database performs matching to determine an operation position on the second operating platform corresponding to the position of the tap point on the current first operating platform. For example, in the scenario shown in FIG. 2, after the mobile phone user makes a tapping action on the back of the mobile phone, the mobile phone determines that the tapping point position of the tapping signal on the mobile phone can be matched through the built-in positioning database of the mobile phone. Mapping the location of the tapping point of the tap signal on the current mobile phone to the key value of the key on the piano playing game of the corresponding mobile phone, and then using the tapping signal as a trigger signal on the key to generate a corresponding The input signal of the piano playing game that triggers the signal. For example, as shown in FIG. 4, when the mobile phone determines that the tapping point of the tapping signal on the back of the mobile phone is a point on the upper left corner of the back of the mobile phone (such as the tapping point shown in FIG. 4), The built-in positioning database of the mobile phone matches that the current hitting point position corresponds to the virtual key on the mobile phone's piano playing game, and the third key from the left of the keyboard (ie, the key corresponding to the mapping point in FIG. 4) , you can map the tapping point on the back of the phone to the key of the phone's piano playing game. Similarly, when the tapping point of the tapping signal is at other positions on the back of the mobile phone, it can also be matched by the built-in positioning database of the mobile phone, and it is judged that the tapping point position of the tapping signal corresponds to the key of the button on the virtual key. value. After the mobile phone determines that the key value of the specific key of the virtual keyboard of the piano playing game of the mobile phone corresponding to the tapping point position of the tapping signal is known, the mobile phone can use the tapping signal as a trigger signal of the key value, and the knocking The signal is used to trigger the built-in virtual piano application of the mobile phone, and the music playing manager of the mobile phone is called by the built-in virtual piano application of the mobile phone to play the music corresponding to the tapping signal. That is, the mobile phone can map the tapping point position of the tapping signal to the key value of the button on the virtual piano application on the mobile phone, and convert the tapping signal into a trigger signal of the button on the virtual piano application of the mobile phone, through the virtual state of the mobile phone. The piano application calls the music playback manager to emit a tone corresponding to the button Corresponding tonal sound, and adjusting the music of the volume corresponding to the tapping intensity according to the tapping intensity of the tapping signal, that is, the mobile phone can emit different tones at different volume according to the tapping position of the mobile phone user and the tapping intensity music. The user can adjust the tone and volume of the music emitted by the mobile phone according to his own tapping action, better mobilize the interest and passion of the mobile phone user to play music through the mobile phone, and also trigger the inspiration of the music creation of the mobile phone user, and improve the signal input. Interesting.
本实施例可将手机上或者放置手机的桌面等操作平台上的敲击信号 的敲击点位置映射为手机的第二操作平台上的操作位置, 并以该敲击信 号作为该操作位置上的触发信号, 用以触发手机的内部应用, 生成与该 触发信号相对应的手机输入信号, 拓展了手机的输入信号的生成途径, 提高了生成手机输入信号的趣味性, 提高了手机的用户体验效果。  In this embodiment, the location of the tapping point of the tapping signal on the operating platform such as the desktop of the mobile phone or the mobile phone is mapped to the operating position on the second operating platform of the mobile phone, and the tapping signal is used as the operating position. The trigger signal is used to trigger the internal application of the mobile phone, generate a mobile phone input signal corresponding to the trigger signal, expand the generation path of the input signal of the mobile phone, improve the interest of generating the input signal of the mobile phone, and improve the user experience of the mobile phone. .
参见图 5 ,为本发明实施例提供的生成终端输入信号的第二实施例流 程示意图。 其可包括步骤:  FIG. 5 is a schematic flowchart of a second embodiment of generating a terminal input signal according to an embodiment of the present invention. It can include the steps of:
5201 , 获取终端输入设备上的校准点上的敲击信号, 并判断所述终 端输入设备上的校准点在终端的定位坐标系中的位置。  5201: Obtain a tap signal on a calibration point on the terminal input device, and determine a position of the calibration point on the terminal input device in the positioning coordinate system of the terminal.
5202 , 根据所述校准点在所述终端的定位坐标系中的位置, 以及所 述校准点在所述终端输入设备上的位置, 确定所述终端输入设备与所述 终端的相对位置。  S202: Determine a relative position of the terminal input device and the terminal according to a position of the calibration point in a positioning coordinate system of the terminal, and a position of the calibration point on the terminal input device.
具体实现中, 本实施例中所描述的第一操作平台, 可包括: 终端本 体、 放置终端的平整物体表面、 终端输入设备等。 例如, 本实施例中所 描述的第一操作平台可以是手机本身, 或者放置手机的桌面, 或者手机 用户打印出来并与手机一起放置在手机所在桌面上的手机输入键盘图纸 (例如图 6 中所示的键盘图) , 或者手机用户打印出来并与手机一起放 置在手机所在桌面上的手机用户自定义的输入图纸 (例如图 7 中所示的 辅助图纸) 等。 其中, 上述手机输入键盘图纸或者手机用户自定义的输 入图纸等即为本实施例中所描述第一操作平台中的终端输入设备。 具体 实现中, 上述手机的输入键盘图纸以及手机用户 自定义的输入图纸为一 种特制的纸, 纸上包括输入键盘图等信息。 In a specific implementation, the first operating platform described in this embodiment may include: a terminal body, a surface of a flat object on which the terminal is placed, a terminal input device, and the like. For example, the first operating platform described in this embodiment may be the mobile phone itself, or a desktop on which the mobile phone is placed, or a mobile phone input keyboard drawing printed by the mobile phone user and placed on the desktop of the mobile phone together with the mobile phone (for example, in FIG. 6 The keyboard diagram shown, or the user-defined input drawing (such as the auxiliary drawing shown in Figure 7) printed by the mobile phone user and placed on the desktop of the mobile phone together with the mobile phone. Wherein, the above mobile phone input keyboard drawing or mobile phone user customized input The input drawing or the like is the terminal input device in the first operating platform described in this embodiment. In the specific implementation, the input keyboard drawing of the above mobile phone and the input drawing of the user defined by the mobile phone are a special type of paper, and the paper includes information such as an input keyboard picture.
当用户希望手机根据敲击信号生成终端输入信号时, 可将手机的输 入键盘图纸或者手机用户自定义的输入图纸平稳放置在放置手机的桌面 (即手机所在桌面) 上, 并在输入键盘图纸或者手机用户 自定义的输入 图纸上做敲击动作, 手机则可通过其内置传感器等敲击信号获取模块获 取手机的输入键盘图纸或者手机用户 自定义的输入图纸上的敲击信号, 以根据该敲击信号生成终端的输入信号。 其中, 上述第一操作平台上的 敲击信号, 可包括: 振动机械波、 敲击时间、 敲击强度等。 例如, 手机 用户使用手机的输入键盘图纸进行手机字符输入时, 若需要手机根据敲 击信号生成字符输入信号, 则可先开启这个手机功能, 即根据第一操作 平台 (即手机的输入键盘图纸) 上的敲击信号生成字符输入信号的手机 功能。 手机用户启动上述手机功能之后, 则可在手机的输入键盘图纸上 做敲击动作, 手机通过其内置传感器获取手机的输入键盘图纸上的敲击 信号之后, 则可根据该敲击信号生成手机输入法的输入信号。 具体实现 中, 手机通过其内置传感器获取手机的输入键盘图纸 (终端输入设备) 上的敲击信号, 并根据该敲击信号生成手机输入法的输入信号之前, 还 需要先确认手机的输入键盘图纸与手机的相对位置, 即需要确定手机的 输入键盘图纸的定位坐标系与手机的定位坐标系的变换关系。 具体的, 手机用户需要敲击手机的输入键盘图纸上的校准点对手机的输入键盘图 纸和手机的相对位置进行校准。  When the user wants the mobile phone to generate the terminal input signal according to the tapping signal, the input keyboard drawing of the mobile phone or the user-defined input drawing of the mobile phone can be smoothly placed on the desktop where the mobile phone is placed (ie, the desktop where the mobile phone is located), and the keyboard drawing or The mobile phone user can make a tapping action on the input drawing of the mobile phone, and the mobile phone can obtain the input keyboard drawing of the mobile phone or the tapping signal on the input drawing of the mobile phone user through the tapping signal acquisition module such as the built-in sensor, etc., according to the knocking The input signal of the signal generating terminal is clicked. The tapping signal on the first operating platform may include: a vibration mechanical wave, a tapping time, a tapping intensity, and the like. For example, when a mobile phone user uses a mobile phone's input keyboard drawing to input a mobile phone character, if the mobile phone is required to generate a character input signal according to the tap signal, the mobile phone function may be first turned on, that is, according to the first operating platform (ie, the input keyboard drawing of the mobile phone). The tapping signal on the phone generates a character input signal for the phone function. After the mobile phone user activates the above mobile phone function, a tapping action can be performed on the input keyboard drawing of the mobile phone, and after the mobile phone obtains the tapping signal on the input keyboard drawing of the mobile phone through the built-in sensor, the mobile phone input can be generated according to the tapping signal. The input signal of the law. In a specific implementation, the mobile phone obtains a tapping signal on the input keyboard drawing (terminal input device) of the mobile phone through its built-in sensor, and before inputting the input signal of the mobile phone input method according to the tapping signal, it is also necessary to confirm the input keyboard drawing of the mobile phone first. The relative position with the mobile phone, that is, the transformation relationship between the positioning coordinate system of the input keyboard drawing of the mobile phone and the positioning coordinate system of the mobile phone needs to be determined. Specifically, the mobile phone user needs to tap the calibration point on the input keyboard drawing of the mobile phone to calibrate the relative position of the input keyboard image of the mobile phone and the mobile phone.
手机通过其内置传感器获取到第一操作平台上的敲击信号之后, 则 可根据该敲击信号判断该敲击信号在上述第一操作平台上的敲击点位置。 具体地, 可先以手机上的特定点 (例如手机的重心) 为坐标原点设定一 个手机的定位坐标系, 在手机显示屏所在的平面或者手机后盖所在的平 面内设定所述手机的定位坐标系, 以手机底边方向为 X 轴, 手机侧边方 向为 y 轴, 用于确定手机或者放置手机的桌面等操作平台上面的敲击信 号的敲击点位置(即敲击信号在手机的定位坐标系中的位置)。 具体的, 可以手机上的特定点 (例如手机的重心) 为坐标原点预先设定好定位坐 标系的坐标轴, 并根据该定位坐标系确定手机中各个传感器在上述定位 坐标系中的位置, 如图 2。 确定好手机的定位坐标系之后, 则可根据手机 的定位坐标系确定传感器 1、 传感器 2、 传感器 3、 传感器 4在上述定位 坐标系中的位置坐标为 (xl , yl ) 、 (x2 , y2 ) 、 (x 3 , y3 ) 、 (x4 , y4 ) , 其中, 由于手机的内置传感器相对于手机的位置为固定位置, 则 上述各个传感器在定位坐标系中的位置均为确定的位置, 即 xl、 yl、 x2、 y2、 x 3、 y3、 x4、 y4均为已知数。 确定好手机内置传感器 1、 传感器 2、 传感器 3、 传感器 4的位置之后, 当手机用户在 t时刻在第一操作平台上 的敲击点 (X , y ) 敲击一下后, 振动机械波产生并向四周扩散后, 手机 则可根据各个传感器接收到敲击信号的振动机械波的时刻 t l (传感器 1 接收的振动机械波的时刻 )、 t 2 (传感器 2接收的振动机械波的时刻 )、 13 (传感器 3接收的振动机械波的时刻 ) 、 t 4 (传感器 4接收的振动机 械波的时刻),结合敲击信号的敲击时刻 t以及振动机械波的传播速度 V , 得到振动机械波从敲击信号的敲击点传播到各个传感器的距离。 各个传 感器与敲击信号的敲击点位置的距离等于振动机械波从敲击信号的敲击 点传播到各个传感器的距离时, 因此结合手机中各个传感器在上述手机 的定位坐标系中的位置坐标, 根据振动机械波的传播速度乘以时间等于 振动机械波的传播距离 (即敲击点位置与各个传感器的距离) 得到各个 传感器与敲击点位置的距离与敲击信号的振动机械波的传播速度、 传感 器接收到振动机械波的时间点、 敲击信号的敲击时间点的关系等式, 如 下 4元 2次方程组: After the mobile phone obtains the tapping signal on the first operating platform through the built-in sensor, the tapping point of the tapping signal on the first operating platform may be determined according to the tapping signal. Specifically, a specific point on the mobile phone (for example, the center of gravity of the mobile phone) may be used as the coordinate origin. Positioning coordinate system of the mobile phone, set the positioning coordinate system of the mobile phone in the plane where the mobile phone display screen is located or the plane where the mobile phone back cover is located, with the bottom direction of the mobile phone being the X axis, and the direction of the mobile phone side being the y axis, The position of the tapping point of the tapping signal on the operating platform such as the mobile phone or the desktop on which the mobile phone is placed (ie, the position of the tapping signal in the positioning coordinate system of the mobile phone). Specifically, a specific point on the mobile phone (for example, the center of gravity of the mobile phone) may be used to preset a coordinate axis of the positioning coordinate system for the coordinate origin, and according to the positioning coordinate system, determine the position of each sensor in the mobile phone in the positioning coordinate system, such as figure 2. After determining the positioning coordinate system of the mobile phone, the position coordinates of the sensor 1, the sensor 2, the sensor 3, and the sensor 4 in the positioning coordinate system are determined according to the positioning coordinate system of the mobile phone as (xl, yl), (x2, y2). (x 3 , y3 ) , (x4 , y4 ) , wherein, since the position of the built-in sensor of the mobile phone relative to the mobile phone is a fixed position, the positions of the above-mentioned respective sensors in the positioning coordinate system are all determined positions, that is, xl, Yl, x2, y2, x3, y3, x4, y4 are all known numbers. After determining the position of the built-in sensor 1, sensor 2, sensor 3, and sensor 4 of the mobile phone, when the mobile phone user taps on the tapping point (X, y) on the first operating platform at time t, the vibration mechanical wave is generated and directed After the four-way diffusion, the mobile phone can receive the vibration mechanical wave of the tapping signal at each time t1 (the time of the vibration mechanical wave received by the sensor 1), t 2 (the time of the vibration mechanical wave received by the sensor 2), 13 (the sensor 3 receives) The time of the vibration mechanical wave), t 4 (the time of the vibration mechanical wave received by the sensor 4), combined with the tapping time t of the tapping signal and the propagation velocity V of the vibration mechanical wave, the vibration mechanical wave is transmitted from the tapping point of the tapping signal to The distance of each sensor. The distance between each sensor and the tapping point position of the tapping signal is equal to the distance that the vibrating mechanical wave propagates from the tapping point of the tapping signal to each sensor, and thus the position coordinates of each sensor in the mobile phone in the positioning coordinate system of the mobile phone are combined. According to the propagation speed of the vibration mechanical wave multiplied by the time equal to the propagation distance of the vibration mechanical wave (ie, the distance between the position of the tap point and each sensor), the distance between each sensor and the position of the tap point and the propagation speed of the vibration mechanical wave of the tap signal are obtained, and the sensor receives The relationship between the time point of the vibration mechanical wave and the tapping time point of the tapping signal, such as The next 4 yuan 2 equations:
- ^)2 + ( Ί - - y)2 - t)xv- ^) 2 + ( Ί - - y) 2 - t)xv
Figure imgf000022_0001
Figure imgf000022_0001
- 2 + O - yf = ( - t) x v - 2 + O - yf = ( - t) x v
Figure imgf000022_0002
Figure imgf000022_0002
由于上述数据中, 只有 v、 t、 x、 y为未知数, 则通过给¥、 t、 x、 y 一个预设值, 并通过迭代计算可处理得到 v、 t、 x、 y 四个未知数的值, 即可确定敲击信号在第一操作平台上的敲击点位置 (X , y ) 。  Since only v, t, x, and y are unknowns in the above data, the values of four unknowns of v, t, x, and y can be processed by giving a preset value of ¥, t, x, y and by iterative calculation. , the position (X, y) of the tapping point of the tapping signal on the first operating platform can be determined.
具体实现中, 由于振动机械波在特定介质中的传播速度是固定的, 而手机壳体所用的介质是固定可知的 (由于手机壳体制作材质是手机出 厂时已经确定可知的, 则手机壳体所用的介质也为确定可知的) , 则振 动机械波在手机壳体上的传播速度也为固定可知的, 可预先存储于手机 中, 当手机用户在手机上 (即手机壳体上) 做敲击动作时, 敲击所产生 的振动机械波在手机上的传播速度 V 则成为一个已知量。 当敲击点在手 机上(如图 2 )时, 通过 3个传感器则可计算得知敲击信号在手机上的敲 击点在上述定位坐标系中的位置 (X , y ) 。 若有上述 4 个传感器, 则可 根据最小二乘法估算敲击点位置的计算精度, 即在本实施例中, 上述用 于获取敲击信号的传感器至少需要 3个, 最多不限。  In the specific implementation, since the propagation speed of the vibration mechanical wave in the specific medium is fixed, and the medium used for the mobile phone case is fixed and known (because the material of the mobile phone case is determined by the mobile phone, the mobile phone case is used for the mobile phone case) The medium is also known to be identifiable. The propagation speed of the vibrating mechanical wave on the mobile phone casing is also fixed. It can be pre-stored in the mobile phone, and the mobile phone user performs a tapping action on the mobile phone (ie, the mobile phone casing). At this time, the propagation velocity V of the vibrating mechanical wave generated by the tap on the mobile phone becomes a known amount. When the tapping point is on the mobile phone (Fig. 2), the position of the tapping point of the tapping signal on the mobile phone in the positioning coordinate system (X, y) can be calculated by the three sensors. If there are the above four sensors, the calculation accuracy of the position of the tapping point can be estimated according to the least squares method. That is, in the embodiment, at least three sensors for acquiring the tapping signal are required, at most not limited.
如图 3 , 若敲击信号在手机外部, 即此时第一操作平台为放置手机的 桌面等平台时, 由于桌面的制作材质可能有多种类型(例如木材、 塑料、 铁皮等) , 使得敲击信号的振动机械波的传播介质变成不固定介质, 手 机无法预先判断得知敲击信号的振动机械波在当前放置手机的桌面上的 传播速度 V , 即此时振动机械波的传播速度 V为未知数。 即当敲击信号的 敲击点位置在放置手机的桌面等平台时, 则可根据上述手机的 4 个传感 器获取得到的数据来确定 v、 t、 x、 y四个未知数的值, 从而确定敲击信 号在第一操作平台上的敲击点位置。 手机根据上述传感器获取得到的数 据判断得知振动机械波在当前传播介质 (即放置手机的桌面) 上的传播 速度之后, 当手机用户在相同的介质上敲击第二次, 即手机用户在放置 手机的桌面上敲击第二次时,由于振动机械波的传播速度 V已确定可知, 根据 4 个传感器获取到的数据则可初步估算敲击信号在第一操作平台上 的敲击点位置的计算精度。 具体的, 手机用户可根据上述方法得到第二 次敲击的敲击信号对应的 4元 2次方程, 并可将第一次敲击中判断得知 的振动机械波的传播速度 v(即振动机械波在放置手机的桌面上的传播速 度) 代入上述 4元 2次方程, 再结合其中任意三个方程式处理得到第二 次敲击的敲击信号在第一操作平台上的敲击点位置 1 (假设为手机坐标系 中的坐标 (xl、 yl ) ) 。 此外, 用户还可直接根据上述 4元 2次方程处 理得到第二次敲击的敲击信号在第一操作平台上的敲击点位置 2 (假设为 手机坐标系中的坐标( x2、 y2 ) ) , 并根据前面处理得到的敲击点位置 1 判断敲击点位置 2 ( x2、 y2 ) 和敲击点位置 1 ( xl、 yl ) 的坐标是否重合 或者误差是否在设定的误差范围内, 以此来估算敲击信号在第一操作平 台上的敲击点位置的计算精度。 As shown in Figure 3, if the tapping signal is outside the mobile phone, that is, when the first operating platform is a platform such as a desktop on which the mobile phone is placed, since the material of the desktop may be of various types (such as wood, plastic, iron, etc.), The propagation medium of the vibration mechanical wave of the hitting signal becomes an unfixed medium, and the mobile phone cannot predetermine the propagation velocity V of the vibration mechanical wave of the tapping signal on the desktop currently placed on the mobile phone, that is, the propagation velocity V of the vibration mechanical wave at this time is unknown. That is, when the tapping point of the tapping signal is on the platform such as the desktop on which the mobile phone is placed, the values of the four unknowns of v, t, x, and y can be determined according to the data obtained by the four sensors of the mobile phone, thereby determining the knocking. Letter The position of the tap point on the first operating platform. The mobile phone judges, according to the data obtained by the above sensor, the speed of the vibration mechanical wave on the current propagation medium (ie, the desktop on which the mobile phone is placed), when the mobile phone user taps the second time on the same medium, that is, the mobile phone user places the mobile phone. When the second time of tapping on the desktop, since the propagation velocity V of the vibration mechanical wave has been determined, the calculation accuracy of the tapping point position of the tapping signal on the first operating platform can be estimated based on the data acquired by the four sensors. . Specifically, the mobile phone user can obtain the 4-element second-order equation corresponding to the tapping signal of the second tap according to the above method, and can determine the propagation velocity v of the vibrating mechanical wave (ie, the vibrating mechanical wave) in the first tapping. The propagation speed on the desktop where the mobile phone is placed) is substituted into the above 4-ary equation 2, and then combined with any three of the equations to obtain the tapping signal of the second tap on the first operating platform. Is the coordinates (xl, yl) in the phone coordinate system. In addition, the user can directly obtain the tapping point position 2 of the tapping signal of the second tap on the first operating platform according to the above 4-ary equation 2 (assuming coordinates (x2, y2) in the mobile coordinate system. ), and according to the position 1 of the tapping point obtained in the previous processing, it is judged whether the coordinates of the tapping point position 2 (x2, y2) and the tapping point position 1 (xl, yl) coincide or whether the error is within the set error range, In this way, the calculation accuracy of the tapping point position of the tap signal on the first operating platform is estimated.
如图 6 , 当手机用户在手机的输入键盘图纸上做敲击动作, 即第一操 作平台上的敲击信号的敲击点在手机外部的键盘图上, 不在手机上时, 则可根据上述确定图 3上的敲击信号的敲击点位置的方法确定图 6 中第 一操作平台 (键盘图 ) 上的敲击点位置, 在此不再赘述。  As shown in FIG. 6, when the mobile phone user performs a tapping action on the input keyboard drawing of the mobile phone, that is, the tapping point of the tapping signal on the first operating platform is on the keyboard map outside the mobile phone, when not on the mobile phone, The method of determining the position of the tapping point of the tapping signal on FIG. 3 determines the position of the tapping point on the first operating platform (keyboard map) in FIG. 6, and details are not described herein again.
当手机用户需要对手机的输入键盘图纸与手机的相对位置进行校准 时, 则可敲击手机的输入键盘图纸上的各个校准点。 手机通过其内置传 感器获取到手机的输入键盘图纸上的校准点上的敲击信号之后, 则可根 据上述判断敲击信号在第一操作平台上的敲击点位置的方法判断得知各 个校准点在手机的定位坐标系中的位置, 还可通过各个校准点在手机的 输入键盘图纸上的位置 (即各个校准点在输入键盘图纸的定位坐标系中 的位置) 进一步判断手机的输入键盘图纸与手机的相对位置。 When the mobile phone user needs to calibrate the relative position of the input keyboard drawing of the mobile phone and the mobile phone, the various calibration points on the input keyboard drawing of the mobile phone can be tapped. After the mobile phone obtains the tapping signal on the calibration point on the input keyboard drawing of the mobile phone through the built-in sensor, it can judge the respective calibration points according to the method of judging the tapping point position of the tapping signal on the first operating platform. The position in the positioning coordinate system of the mobile phone can also be passed through the various calibration points on the mobile phone. Enter the position on the keyboard drawing (ie the position of each calibration point in the positioning coordinate system of the input keyboard drawing) to further determine the relative position of the input keyboard drawing of the mobile phone and the mobile phone.
具体实现中, 手机的输入键盘图纸上的各个字符以及校准点在输入 键盘图上的位置是固定的, 可以预先将手机的输入键盘图纸上各个字符 以及校准点在手机的输入键盘图纸的定位坐标系中的坐标预置在手机应 用中, 手机的输入键盘图纸上的字符与手机应用的输入字符是——对应 的, 可预先将手机输入键盘图纸上的各个字符的坐标 (在手机的输入键 盘图纸的定位坐标系中的坐标) 与手机应用的字符输入的按键的键值先 建立连接, 例如可以将手机应用上的字符输入按键的键值与手机的输入 键盘图纸上的字符在手机的输入键盘图纸的定位坐标系的坐标的映射关 系预置在手机中。 当手机与手机的输入键盘图纸在放置手机的桌面或者 地面等辅助介质上任意摆放之后, 手机和手机的输入键盘图纸的相对位 置则为不确定因素, 手机用户使用手机的输入键盘图纸作为手机的输入 设备之前, 则需要先确定手机与当前放置状态下的手机输入键盘图纸的 相对位置, 即需要确定手机的定位坐标系上的坐标和手机的输入键盘图 纸的定位坐标系的坐标的变换关系。  In the specific implementation, the characters on the input keyboard drawing of the mobile phone and the position of the calibration point on the input keyboard map are fixed, and the characters on the input keyboard drawing of the mobile phone and the positioning coordinates of the calibration point on the input keyboard drawing of the mobile phone can be pre-set in advance. The coordinates in the system are preset in the mobile phone application. The characters on the input keyboard drawing of the mobile phone and the input characters of the mobile phone application are corresponding to, and the coordinates of each character on the keyboard drawing can be input in advance (in the input keyboard of the mobile phone) The coordinates in the positioning coordinate system of the drawing are first established with the key value of the key input of the mobile phone application. For example, the key value of the character input key on the mobile phone application and the character on the input keyboard drawing of the mobile phone can be input on the mobile phone. The mapping relationship of the coordinates of the positioning coordinate system of the keyboard drawing is preset in the mobile phone. When the input keyboard drawing of the mobile phone and the mobile phone is placed on the auxiliary medium such as the desktop or the ground on which the mobile phone is placed, the relative position of the input keyboard drawing of the mobile phone and the mobile phone is an uncertain factor, and the mobile phone user uses the input keyboard drawing of the mobile phone as the mobile phone. Before inputting the device, it is necessary to first determine the relative position of the mobile phone and the input keyboard drawing of the mobile phone in the currently placed state, that is, to determine the coordinate relationship between the coordinates on the positioning coordinate system of the mobile phone and the coordinates of the positioning coordinate system of the input keyboard drawing of the mobile phone. .
具体的, 如图 6 , 手机用户在确定手机与当前放置状态下的手机输入 键盘图纸之间的相对位置关系 (也为手机的定位坐标系上的坐标和手机 的输入键盘图纸的定位坐标系上的坐标的变换关系) 时, 可点击手机上 的校准按键, 启动手机的校准功能。 手机在校准手机和手机输入键盘图 纸的相对位置关系时, 可先将手机的定位坐标系的坐标记为(x, , 手机 的输入键盘图的定位坐标系的坐标记为(x,^ ) , 手机的定位坐标系与输入 键盘图的坐标系间的夹角记为 ^可以将手机的定位坐标系中 X轴与输入 键盘图的坐标系的 X轴的夹角记为^ 位移记为( , Δ , 位移为输入键盘 图的坐标系的原点在手机的定位坐标系中的坐标, 则有以下坐标变换关 X cos 6* sin 6* Ax X Specifically, as shown in FIG. 6, the mobile phone user determines the relative positional relationship between the mobile phone and the current input keyboard drawing of the mobile phone (also the coordinates on the positioning coordinate system of the mobile phone and the positioning coordinate system of the input keyboard drawing of the mobile phone). When the coordinates of the transformation relationship), you can click the calibration button on the phone to activate the calibration function of the phone. When the mobile phone and the mobile phone input the keyboard drawing relative position relationship, the mobile phone's positioning coordinate system can be first marked as ( x , , the mobile phone's input keyboard map positioning coordinate system is marked as ( x , ^ ) The angle between the positioning coordinate system of the mobile phone and the coordinate system of the input keyboard map is recorded as ^ The angle between the X axis of the positioning coordinate system of the mobile phone and the X axis of the coordinate system of the input keyboard image can be recorded as ^ displacement ( Δ , the displacement is the coordinate of the origin of the coordinate system of the input keyboard diagram in the positioning coordinate system of the mobile phone, then the following coordinate transformation is X cos 6* sin 6* Ax X
y ― - sin 6* cos 6* y  y ― - sin 6* cos 6* y
1 0 0 1 1 将手机的输入键盘图纸上的各校准点 (校准点 1、 校准点 2、 校准点 3、 校准点 4 ) 在输入键盘图的定位坐标系中的坐标分别记为 i'^i)、 ( 22)、 ( ,Λ3)、 ( 44)。 手机用户敲击手机的输入键盘图纸上的各标 准点之后, 手机则可通过其内置传感器获取各个校准点上的敲击信号, 并根据上述步骤 S201 和 S202 中所描述的确定敲击信号在第一操作平台 上的敲击点位置的方法判断各校准点在手机的定位坐标系中的坐标, 分 别记为( ' 1)、 (X '^2)、 ( ' 3)、 (^4,^4) , 则可以列出以下 4个关系式: 1 0 0 1 1 Record the coordinates of each calibration point (calibration point 1, calibration point 2, calibration point 3, calibration point 4) on the input keyboard drawing of the mobile phone in the positioning coordinate system of the input keyboard diagram as i'^ i), ( 2 , Λ 2 ), ( , Λ 3 ), ( 4 , Λ 4 ). After the mobile phone user taps each standard point on the input keyboard drawing of the mobile phone, the mobile phone can obtain the tapping signal at each calibration point through its built-in sensor, and determine the tapping signal according to the steps described in steps S201 and S202 above. The method of the position of the tapping point on the operating platform determines the coordinates of each calibration point in the positioning coordinate system of the mobile phone, and is respectively recorded as ( ' 1 ), ( X '^2), ( ' 3 ), (^4, ^ 4), you can list the following 4 relationships:
Figure imgf000025_0001
cos 6* sin 6* Ax
Figure imgf000025_0001
Cos 6* sin 6* Ax
― - sin θ cos 6*  ― - sin θ cos 6*
1 0 0 1 1  1 0 0 1 1
Figure imgf000025_0002
Figure imgf000025_0002
XsA cos 6* sin 6* Ax XsA X sA cos 6* sin 6* Ax X sA
― - sin θ cos 6*  ― - sin θ cos 6*
1 0 0 1 15 此时在以上关系式中(^1 ' 1 )、 (X:2'y:2)、 (Χ:3'Λ3)、 (^,^)、 、 (^2 , 2 )、 ( , 3)、 (Χ4)为已知数, 仅 0和 (^' )为未知数, 因此可以 取以上任意 2个关系式求解 和 ( , )。 1 0 0 1 15 At this time, in the above relationship (^1 ' 1 ), ( X : 2'y: 2), ( Χ : 3' Λ 3 ), (^, ^), , (^2 , 2 ), ( , 3 ), ( Χ4 ) is a known number, only 0 and (^' ) are unknowns, so any two of the above relations can be solved and ( , ).
一旦 和 ( , )解出, 手机则可以把敲击信号在手机的定位坐标系 中的坐标转换得到在手机的输入键盘图纸的定位坐标系上的坐标。 手机 通过敲击信号得到当前放置状态下的手机输入键盘图纸上的按键在手机 的定位坐标系中的坐标, 并根据上述坐标变换关系式得知手机的输入键 盘图纸的定位坐标系中的坐标之后, 则可进一步得知手机的输入键盘图 纸的定位坐标系中的坐标对应的按键的键值。 具体的, 手机根据获取到 的第一操作平台上的敲击信号判断得知敲击信号在手机的定位坐标系中 的坐标之后, 则可根据手机的定位坐标系和手机的输入键盘图纸的定位 坐标系的变换关系确定敲击信号的敲击点位置对应的手机输入键盘图纸 的定位坐标系的坐标。 根据预先存储的手机的输入键盘图纸上的输入按 键的键值与手机的输入键盘图纸的定位坐标系的坐标的对应关系, 则可 判断得知敲击信号在当前放置状态下的手机输入键盘图纸上的操作位置 (即敲击信号的敲击点位置对应的输入按键) 与手机应用上的输入按键 的键值的对应关系, 以将当前手机输入键盘图纸上的敲击信号的敲击点 位置映射为手机应用上的输入按键的键值。 例如, 可预先在手机中存储 手机输入键盘图纸的定位坐标系中的坐标( 1 , 3 )对应于手机字符输入应 用中的字符 "Α" 对应的输入按键的键值, 则当手机获取到第一操作平台 (手机的输入键盘图纸) 上的敲击信号的敲击点位置在手机的定位坐标 系中的坐标之后, 根据上述手机的定位坐标系和手机的输入键盘图纸的 定位坐标系的变换关系判断得知该敲击信号的敲击点位置在手机的输入 键盘图纸上的坐标为 ( 1 , 3 ) 时, 则可将敲击信号在手机的输入键盘图纸 上的敲击点位置映射为手机的字符输入应用的字符 " A" 的输入按键的键 值, 将该敲击信号作为触发信号触发手机应用中相应的响应模块输出字 符 "A" 。 再例如, 如图 7 , 若此时第一操作平台为手机用户自定义的输 入图纸 (如弹奏音乐的应用操作图) , 并且手机用户预先存储中手机中 的该输入图纸的定位坐标系的坐标中包括图 7中 "拇指"的坐标为( 2 , 1 ) 并设定其对应的音符为 " du" , 即该坐标 ( 2 , 1 ) 对应于音符 " du" 的输 入按键的键值, 则若用户敲击拇指对应的敲击点位置, 手机根据敲击信 号判断得知该敲击信号的敲击点在手机的定位坐标系中的位置之后, 根 据上述手机的定位坐标系和手机输入图纸的定位坐标系的变换关系判断 得知该敲击点位置在手机输入图纸上的位置为 "拇指" 对应的按键, 即 敲击点在手机输入图纸上坐标对应于 "拇指" 对应的按键的键值, 则可 将该敲击点位置映射为 " du" 对应的按键的键值, 并可以该敲击信号为 触发信号, 触发手机中相应的响应模块根据该敲击信号的敲击强度输出 相应音量大小的音符。 Once and ( , ) are solved, the mobile phone can convert the coordinates of the tap signal in the positioning coordinate system of the mobile phone to obtain the coordinates on the positioning coordinate system of the input keyboard drawing of the mobile phone. The mobile phone obtains the coordinates of the button on the phone input keyboard drawing of the mobile phone in the current positioning state by tapping the signal, and learns the coordinates in the positioning coordinate system of the input keyboard drawing of the mobile phone according to the above coordinate transformation relationship. Then, the key value of the button corresponding to the coordinate in the positioning coordinate system of the input keyboard drawing of the mobile phone can be further known. Specifically, after determining, according to the obtained tapping signal on the first operating platform, the mobile phone knows that the tapping signal is in the positioning coordinate system of the mobile phone, and then according to the positioning coordinate system of the mobile phone and the positioning of the input keyboard drawing of the mobile phone. The transformation relationship of the coordinate system determines the coordinates of the positioning coordinate system of the phone input keyboard drawing corresponding to the tapping point position of the tap signal. According to the correspondence between the key value of the input button on the input keyboard drawing of the pre-stored mobile phone and the coordinate of the positioning coordinate system of the input keyboard drawing of the mobile phone, it can be determined that the mobile phone input keyboard drawing of the tapping signal is in the current placed state. The corresponding operation position (ie, the input button corresponding to the tapping point position of the tapping signal) and the key value of the input button on the mobile phone application, so as to input the current mobile phone into the tapping point position of the tapping signal on the keyboard drawing Maps to the key value of the input button on the phone app. For example, the coordinates (1, 3) in the positioning coordinate system of the mobile phone input keyboard drawing stored in the mobile phone in advance correspond to the key value of the input key corresponding to the character "Α" in the mobile phone character input application, when the mobile phone obtains the first The position of the tapping point of the tapping signal on the operating platform (the input keyboard drawing of the mobile phone) is after the coordinates in the positioning coordinate system of the mobile phone, according to the positioning coordinate system of the mobile phone and the positioning coordinate system of the input keyboard drawing of the mobile phone. When the relationship judgment is that the position of the tapping point of the tapping signal is (1, 3) on the input keyboard drawing of the mobile phone, the tapping signal can be input on the input keyboard of the mobile phone. The tap position on the map is mapped to the key value of the input button of the character "A" of the character input application of the mobile phone, and the tap signal is used as a trigger signal to trigger the corresponding response module output character "A" in the mobile phone application. For another example, as shown in FIG. 7 , if the first operating platform is a user-defined input drawing (such as an application operation diagram for playing music), and the mobile phone user pre-stores the positioning coordinate system of the input drawing in the mobile phone. The coordinates including the "thumb" in Fig. 7 are (2, 1) and the corresponding note is set to "du", that is, the coordinate (2, 1) corresponds to the key value of the input button of the note "du". Then, if the user taps the position of the tap point corresponding to the thumb, the mobile phone determines, according to the tapping signal, the position of the tapping point of the tapping signal in the positioning coordinate system of the mobile phone, according to the positioning coordinate system of the mobile phone and the mobile phone input. The transformation relationship of the positioning coordinate system of the drawing determines that the position of the tapping point on the input sheet of the mobile phone is a button corresponding to the "thumb", that is, the key point of the tapping point on the input pattern of the mobile phone corresponds to the button corresponding to the "thumb" The key value can be mapped to the key value of the button corresponding to "du", and the tapping signal can be used as a trigger signal to trigger the corresponding response module in the mobile phone according to the tapping strength of the tapping signal. Outputs notes of the corresponding volume level.
此外, 手机根据当前手机输入键盘图纸上的任意两个校准点完成手 机输入键盘图纸和手机的相对位置的校准之后, 还可根据手机的输入键 盘图纸上的另外两个校准点与手机的相对位置进行校准验证, 判断本次 手机与手机的输入键盘图纸的位置关系的校准是否准确, 是否需要重新 进行校准。 具体地, 手机可根据当前手机输入键盘图纸上的任意两个校 准点完成手机输入键盘图纸与手机的相对位置关系的校准, 并在校准之 后通过第一操作平台 (即手机的输入键盘图纸) 上的敲击信号判断敲击 信号的敲击点位置 (在手机的定位坐标系中的位置) 对应的手机输入键 盘图纸的输入按键(例如字符 "A" 对应的输入按键) 的键值。 此外, 手 机用户还可以通过手机的输入键盘图纸上的另外两个校准点完成手机输 入键盘图纸和手机的相对位置的校准, 并根据这次校准的数据判断手机 用户在第一操作平台 (即手机的输入键盘图纸) 上的敲击信号的敲击点 位置 (在手机的定位坐标系中的位置) 对应的手机输入键盘图纸上的输 入按键的键值是否与前面判断得知的输入按键的键值一致, 即是否为字 符 " A" 对应的输入按键的键值, 以此来判断前面校准的手机与手机的输 入键盘图纸的位置关系是否正确。 In addition, the mobile phone can complete the calibration of the relative position of the phone input keyboard drawing and the mobile phone according to any two calibration points on the current mobile phone input keyboard drawing, and can also be based on the relative position of the other two calibration points on the input keyboard drawing of the mobile phone. Perform calibration verification to determine whether the calibration of the positional relationship between the input keyboard drawing of the mobile phone and the mobile phone is accurate, and whether calibration needs to be performed again. Specifically, the mobile phone can complete the calibration of the relative positional relationship between the mobile phone input keyboard drawing and the mobile phone according to any two calibration points on the current mobile phone input keyboard drawing, and after the calibration, through the first operating platform (ie, the input keyboard drawing of the mobile phone) The tapping signal determines the tapping point position of the tapping signal (the position in the positioning coordinate system of the mobile phone). The corresponding mobile phone inputs the key value of the input key of the keyboard drawing (for example, the input key corresponding to the character "A"). In addition, the mobile phone user can also complete the calibration of the relative position of the mobile phone input keyboard drawing and the mobile phone through two other calibration points on the input keyboard drawing of the mobile phone, and judge the mobile phone according to the data of the calibration. The position of the tapping point of the tapping signal on the first operating platform (ie, the input keyboard drawing of the mobile phone) (the position in the positioning coordinate system of the mobile phone) corresponds to whether the key value of the input key on the mobile phone input keyboard drawing is The key value of the input button determined in the previous judgment is the same, that is, whether it is the key value of the input button corresponding to the character "A", thereby judging whether the positional relationship between the previously calibrated mobile phone and the input keyboard drawing of the mobile phone is correct.
52 03 , 获取第一操作平台上的敲击信号。  52 03 , Get the tap signal on the first operating platform.
52 04 , 判断所述获取到的第一操作平台上的敲击信号的敲击点在所 述终端的定位坐标系中的位置。  52 04. Determine a position of a tap point of the tap signal on the acquired first operating platform in a positioning coordinate system of the terminal.
52 05 , 根据所述第一操作平台上的敲击信号的敲击点在所述终端的 定位坐标系中的位置, 以及所述终端输入设备与所述终端的相对位置, 得到所述敲击信号在所述终端输入设备上的操作位置。  52 05 , obtaining the tapping according to a position of a tapping point of the tapping signal on the first operating platform in a positioning coordinate system of the terminal, and a relative position of the terminal input device and the terminal The operating position of the signal on the terminal input device.
52 06 , 根据预设的所述终端输入设备上的操作位置与所述第二操作 平台上的操作位置的对应关系, 将所述终端输入设备上的敲击信号的敲 击点位置映射为所述第二操作平台上的操作位置。  52 06. Map, according to a preset correspondence between an operation position on the terminal input device and an operation position on the second operation platform, a tap point position of the tap signal on the terminal input device as The operating position on the second operating platform.
具体实现中, 当手机用户将手机的输入键盘图纸放置手机所在桌面, 并完成输入键盘图纸和手机的相对位置的校准之后, 则可在输入键盘图 纸上做敲击动作, 敲击信号将通过桌面传播至手机的内置传感器。 手机 的内置传感器获取到敲击信号之后,则可根据上述步骤 S 2 01和步骤 S 2 02 中所描述的方法确定敲击信号在第一操作平台 (即放置在手机所在桌面 上的输入键盘图纸) 上的敲击点位置, 即可确定敲击信号的敲击点在手 机的定位坐标系中的位置, 还可根据当前手机的输入键盘图纸与手机的 相对位置关系判断敲击信号在第一操作平台上的敲击点位置对应的当前 手机的输入键盘图纸的操作位置。 手机判断得知敲击信号的敲击点位置 在当前的手机输入键盘图纸上的操作位置之后, 则可根据预置在手机应 用中的输入键盘图与手机的第二操作平台的操作位置的对应关系 (例如 手机的输入键盘图纸与手机的输入法应用中的字符输入按键的键值的对 应关系) 则可将手机输入键盘图纸上的输入字符对应上内置于手机的输 入法应用中的键盘图上的输入字符, 进而可将手机的输入键盘图纸上的 敲击信号的敲击点位置映射为手机内置的输入法应用的输入软键盘的按 键的键值。 本实施例中所描述的手机的第二操作平台可包括手机的应用 程序的输入界面、 手机的输入法的输入软键盘 (即手机的字符输入软键 盘) 等手机上的输入端。 In the specific implementation, when the mobile phone user places the input keyboard drawing of the mobile phone on the desktop of the mobile phone and completes the calibration of the input keyboard drawing and the relative position of the mobile phone, the tapping action can be performed on the input keyboard drawing, and the tapping signal will pass through the desktop. Spread to the built-in sensor of the phone. After the built-in sensor of the mobile phone acquires the tapping signal, the tapping signal can be determined on the first operating platform (ie, the input keyboard drawing placed on the desktop of the mobile phone according to the method described in the above steps S 2 01 and step S 2 02). On the tapping point position, the position of the tapping point of the tapping signal in the positioning coordinate system of the mobile phone can be determined, and the tapping signal can be judged according to the relative positional relationship between the input keyboard drawing of the current mobile phone and the mobile phone. The position of the tap point on the operating platform corresponds to the operating position of the input keyboard drawing of the current mobile phone. After the mobile phone judges that the tapping point position of the tapping signal is in the operation position on the current mobile phone input keyboard drawing, the mobile phone may correspond to the operating position of the second operating platform of the mobile phone according to the input keyboard map preset in the mobile phone application. Relationship (for example The input relationship between the input keyboard drawing of the mobile phone and the key input value of the input method of the mobile phone application can input the input character of the mobile phone input keyboard drawing corresponding to the input on the keyboard image of the input method application of the mobile phone. The character, in turn, maps the tapping point position of the tapping signal on the input keyboard drawing of the mobile phone to the key value of the input soft keyboard of the input method applied by the mobile phone. The second operating platform of the mobile phone described in this embodiment may include an input interface of an application of the mobile phone, an input end of the input soft keyboard of the input method of the mobile phone (ie, a character input soft keyboard of the mobile phone), and the like.
如图 7 , 当第一操作平台为手机用户自定义的输入图纸, 则也可根据 上述方法进行输入图纸与手机的相对位置的校准, 可将手机用户自定义 的输入图纸与手机内置的对应手机应用的输入软键盘的按键的键值建立 连接, 并根据上述方法判断敲击信号的敲击点位置在手机用户自定义的 输入图纸上的操作位置之后, 则可将敲击信号的敲击点位置映射为手机 的第二操作平台 (即手机内置的对应手机应用的输入软键盘) 的操作位 置 (具体可为输入软键盘的按键的键值) 。  As shown in Figure 7, when the first operating platform is a custom input drawing for the mobile phone user, the relative position of the input drawing and the mobile phone can also be calibrated according to the above method, and the input drawing of the mobile phone user can be customized and the corresponding mobile phone built in the mobile phone. The key value of the input soft keyboard of the application is used to establish a connection, and according to the above method, after the tapping point position of the tapping signal is determined on the operation position of the input drawing of the mobile phone user, the tapping point of the tapping signal can be The location is mapped to the operating position of the second operating platform of the mobile phone (ie, the input soft keyboard of the corresponding mobile phone application built in the mobile phone) (specifically, the key value of the key input to the soft keyboard).
S 207 , 将所述敲击信号作为所述第二操作平台上的操作位置上的触 发信号, 并根据所述敲击信号的敲击强度, 生成与所述敲击信号的敲击 强度相对应的信号强度的终端输入信号。  S 207, using the tapping signal as a trigger signal on an operation position on the second operating platform, and generating a tapping strength corresponding to the tapping signal according to a tapping intensity of the tapping signal. The signal strength of the terminal input signal.
具体实现中, 手机将第一操作平台上的敲击信号的敲击点位置映射 为手机的第二操作平台的操作位置之后, 则可将该敲击信号作为手机的 第二操作平台的操作位置上的触发信号, 为手机生成对应于该触发信号 的手机输入信号。 当第一操作平台为手机的输入键盘图纸时 (如图 6 ) , 手机判断得知敲击信号在该手机的输入键盘图纸上的位置并将该敲击信 号在手机的输入键盘图上的敲击点位置映射为手机内置的输入法应用的 输入软键盘的按键的键值之后, 手机则可调动手机的输入法应用中该键 值对应的字符, 将该字符作为手机的输入法应用的输入字符输出至手机 界面的输入框中, 即生成手机的输入信号。 In a specific implementation, after the mobile phone maps the location of the tapping point of the tapping signal on the first operating platform to the operating location of the second operating platform of the mobile phone, the tapping signal can be used as the operating position of the second operating platform of the mobile phone. The trigger signal on the mobile phone generates a mobile phone input signal corresponding to the trigger signal. When the first operating platform is the input keyboard drawing of the mobile phone (as shown in FIG. 6 ), the mobile phone determines that the tapping signal is on the input keyboard drawing of the mobile phone and knocks the tapping signal on the input keyboard map of the mobile phone. After the location of the hit point is mapped to the key value of the input soft keyboard of the input method applied by the mobile phone, the mobile phone can adjust the character corresponding to the key value in the input method of the mobile phone, and the character is used as the input of the input method of the mobile phone. Character output to mobile phone In the input box of the interface, the input signal of the mobile phone is generated.
当第一操作平台为手机用户自定义的输入图纸时(如图 7 ) , 手机用 户自定义输入图纸上各个操作位置对应的声音 (例如钢琴琴键对应的音 调) 按键的键值之后, 当手机判断得知敲击信号在该输入图纸上的位置 并将该敲击信号在输入图纸上的敲击点位置映射为声音按键的键值之后, 手机则可调动相应的应用中该声音按键的键值对应的音调, 并根据该音 调输出相应的音乐。 上述描述的生成终端输入字符的方法中只要手机用 户自定义的输入图纸经过校准, 确定位置之后, 输入图纸上的所有按键 在手机的定位坐标系中位置对于手机来说则均为已知数, 当手机用户在 图纸上敲击时, 手机则可根据敲击信号的敲击点位置判断得出手机用户 敲击的按键, 并将该按键作为手机输入信号的触发信号, 并根据所述敲 击信号的敲击强度, 生成与所述敲击信号的敲击强度相对应的信号强度 的手机输入信号, 播放一段手机用户 自行弹奏的音乐, 即可完成敲击信 号到手机输入信号的转换。  When the first operating platform is a custom input drawing for the mobile phone user (as shown in FIG. 7), the mobile phone user customizes the input sound corresponding to each operation position on the drawing (for example, the pitch corresponding to the piano key), and then the mobile phone judges After knowing the position of the tap signal on the input sheet and mapping the tapping point position of the tap signal on the input sheet to the key value of the sound button, the mobile phone can adjust the key value of the sound button in the corresponding application. The corresponding tone, and the corresponding music is output according to the tone. In the method for generating a terminal input character described above, as long as the input drawing of the mobile phone user is calibrated and the position is determined, all the keys on the input drawing in the positioning coordinate system of the mobile phone are known numbers for the mobile phone. When the mobile phone user taps on the drawing, the mobile phone can determine the button of the mobile phone user's tap according to the tapping point position of the tapping signal, and use the button as a trigger signal of the mobile phone input signal, and according to the tapping The tapping intensity of the signal, generating a mobile phone input signal corresponding to the signal strength of the tapping strength of the tapping signal, playing a piece of music played by the user of the mobile phone, and completing the conversion of the tapping signal to the input signal of the mobile phone.
本发明实施例可将手机的输入键盘图纸或者手机用户自定义的输入 图纸等操作平台上的敲击信号的敲击点位置映射为手机的输入法应用的 输入软键盘的按键的键值或者手机的其他应用的输入软键盘的按键的键 值等手机上的输入设备上的操作位置上的键值, 并以该敲击信号作为该 操作位置上的触发信号, 用以触发手机的内部应用, 生成与该触发信号 相对应的手机输入信号, 拓展了手机的输入信号的生成途径, 提高了生 成手机输入信号的趣味性, 提高了手机的用户体验效果。  The embodiment of the invention can map the location of the tapping point of the tapping signal on the operating platform such as the input keyboard drawing of the mobile phone or the input drawing of the mobile phone to the key value of the input soft keyboard of the input method of the mobile phone or the mobile phone. The key value of the input key of the input soft keyboard of the other application, and the key value of the operation position on the input device of the mobile phone, and the tapping signal is used as a trigger signal at the operating position to trigger the internal application of the mobile phone. The input signal of the mobile phone corresponding to the trigger signal is generated, which expands the generation path of the input signal of the mobile phone, improves the interest of generating the input signal of the mobile phone, and improves the user experience of the mobile phone.
参见图 9 ,是本发明实施例提供的生成终端输入信号的装置的第一实 施例结构示意图。本实施例中所描述的生成终端输入信号的装置, 包括: 获取模块 1 0 , 用于获取第一操作平台上的敲击信号。  FIG. 9 is a schematic structural diagram of a first embodiment of an apparatus for generating a terminal input signal according to an embodiment of the present invention. The device for generating a terminal input signal, which is described in this embodiment, includes: an acquiring module 1 0, configured to acquire a tapping signal on the first operating platform.
定位模块 30 , 用于判断所述敲击信号在所述第一操作平台上的敲击 点位置。 a positioning module 30, configured to determine a tapping of the tap signal on the first operating platform Point location.
映射模块 50 , 用于将所述敲击信号在所述第一操作平台上的敲击点 位置映射为所述第二操作平台上的操作位置。  The mapping module 50 is configured to map a tapping point position of the tap signal on the first operating platform to an operating position on the second operating platform.
生成模块 70 , 用于将所述敲击信号作为所述第二操作平台上的操作 位置上的触发信号, 为终端生成对应于所述触发信号的终端输入信号。  The generating module 70 is configured to use the tapping signal as a trigger signal on an operation position on the second operating platform to generate a terminal input signal corresponding to the trigger signal for the terminal.
其中, 所述定位模块 30 (如图 1 0 ) , 包括:  The positioning module 30 (as shown in FIG. 10) includes:
釆集单元 31 , 用于釆集所述终端中各个传感器在所述终端的定位坐 标系中的位置坐标。  The collecting unit 31 is configured to collect position coordinates of each sensor in the terminal in a positioning coordinate system of the terminal.
具体地, 釆集单元 31 可以是从存储器中釆集所述终端中各个传感器 在所述终端的定位坐标系中的位置坐标。 以手机上的特定点为坐标原点 预先设定好手机的定位坐标系的坐标轴, 并根据该定位坐标系可以确定 手机中各个传感器在上述定位坐标系中的位置, 如图 2 , 即设定好手机的 定位坐标系后, 手机中各个传感器在上述手机的定位坐标系中的位置坐 标即确定可知, 因此可以将各个传感器在上述手机的定位坐标系中的位 置坐标存储在存储器中, 需要时进行读取。  Specifically, the collecting unit 31 may be a location coordinate from the memory in which the respective sensors in the terminal are located in the positioning coordinate system of the terminal. The coordinate axis of the positioning coordinate system of the mobile phone is preset by using a specific point on the mobile phone as a coordinate origin, and according to the positioning coordinate system, the position of each sensor in the mobile phone in the positioning coordinate system can be determined, as shown in FIG. 2 After the positioning coordinate system of the mobile phone is used, the position coordinates of each sensor in the mobile phone in the positioning coordinate system of the mobile phone are determined, so that the position coordinates of each sensor in the positioning coordinate system of the mobile phone can be stored in the memory, when needed. Read it.
第一处理单元 32 ,用于根据所述敲击信号的振动机械波的传播速度, 以及所述传感器接收到所述振动机械波的时刻, 结合所述敲击信号的敲 击时刻, 以及所述各个传感器在所述终端的定位坐标系中的位置坐标, 得到所述敲击信号在所述第一操作平台上的敲击点在所述终端的定位坐 标系中的位置。  a first processing unit 32, configured to: according to a propagation speed of the vibration mechanical wave of the tapping signal, and a timing at which the sensor receives the vibration mechanical wave, a tapping moment of the tapping signal, and the respective sensors And determining, by the position coordinates in the positioning coordinate system of the terminal, a position of a tapping point of the tapping signal on the first operating platform in a positioning coordinate system of the terminal.
其中, 所述映射模块 5 0 , 具体用于:  The mapping module 5 0 is specifically configured to:
将所述敲击信号在所述第一操作平台上的敲击点在所述终端的定位 坐标系中的位置与所述终端中预置的定位数据库进行匹配, 判断所述敲 击信号在所述第一操作平台上的敲击点位置对应的所述第二操作平台上 的操作位置, 将所述敲击信号在所述第一操作平台上的敲击点位置映射 为所述第二操作平台上的操作位置。 Matching a position of the tapping point of the tapping signal on the first operating platform in a positioning coordinate system of the terminal with a positioning database preset in the terminal, and determining that the tapping signal is in the Mapping an operation position on the second operating platform corresponding to a tapping point position on the first operating platform, mapping a tapping point position of the tapping signal on the first operating platform It is the operating position on the second operating platform.
其中, 所述生成模块 7 0 , 具体用于:  The generating module 70 is specifically configured to:
将所述敲击信号作为所述第二操作平台上的操作位置上的触发信号, 生成终端输入信号。 具体地, 可以将所述敲击信号作为所述第二操作平 台上的操作位置上的触发信号, 根据所述敲击信号的敲击强度生成与所 述敲击信号的敲击强度相对应的信号强度的终端输入信号。  The tapping signal is used as a trigger signal on an operating position on the second operating platform to generate a terminal input signal. Specifically, the tapping signal may be used as a trigger signal on an operation position on the second operating platform, and a tapping intensity corresponding to the tapping signal may be generated according to a tapping intensity of the tapping signal. Terminal input signal for signal strength.
具体实现中, 本实施例中所描述的第一操作平台, 可包括: 终端本 体、 放置终端的平整物体表面、 终端输入设备等, 例如, 本实施例中所 描述的第一操作平台可以是手机本身,或者放置手机的水平桌面、地面, 手机的输入键盘图纸、 手机用户自定义的输入图纸等。 当用户在使用本 实施例中所描述的终端的对应功能时, 可在手机上 (包括手机的背面或 者手机上的其他部位) 、 或者放置手机的桌面上做敲击动作, 手机中的 获取模块 1 0则可通过其内置传感器获取手机上或者放置手机的桌面上的 敲击信号, 以根据该敲击信号生成手机的输入信号。 其中, 上述第一操 作平台上的敲击信号, 可包括: 振动机械波、 敲击时间、 敲击强度等。 例如, 当手机用户使用手机应用程序中的钢琴弹奏这个游戏时, 若需要 手机根据敲击信号生成钢琴弹奏游戏的输入信号, 则可在玩游戏之前先 开启这个手机功能, 即根据第一操作平台上的敲击信号生成钢琴弹奏游 戏的输入信号的手机功能。 手机用户启动上述功能之后, 则可在手机的 背面或者放置手机的桌面上做弹奏音乐的敲击动作, 手机的获取模块 1 0 通过其内置传感器获取到手机的背面或者放置手机的桌面上的敲击信号 之后, 则可将该敲击信号发送给手机中用于生成相应输入信号的模块, 以通过相应的手机模块生成手机钢琴弹奏的输入信号。 手机用户无需通 过钢琴弹奏游戏的虚拟琴键输入弹奏信号, 只需在上述第一操作平台上 做弹奏音乐的敲击动作即可完成钢琴弹奏的信号输入。 具体实现中, 为了防止手机随意根据手机上或者放置手机的桌面上 的敲击信号生成手机输入信号, 影响手机的正常使用, 可设定一个启动 手机的生成手机输入信号的功能的启动方式。 当手机用户希望启动这个 手机功能 (即根据敲击信号生成手机输入信号的手机功能) 时, 则可在 第一操作平台上的指定位置做敲击动作, 手机的获取模块 1 0获取到指定 位置上的敲击信号之后则可启动手机的相应功能。 例如, 为了防止随意 根据手机上或者放置手机的桌面上的敲击信号生成手机的钢琴弹奏游戏 的输入信号, 手机用户在开始弹奏音乐时, 可在手机的指定位置上做相 应的敲击动作, 用以启动手机的钢琴弹奏功能, 手机的获取模块 1 0通过 手机的内置传感器获取到手机的指定位置上的敲击信号之后则可自行启 动手机的钢琴弹奏功能。 例如, 手机用户在使用手机的钢琴弹奏这个游 戏应用时, 可先在手机的左上角、 右上角、 右下角、 左下角依次各敲击 一下, 表示开始弹奏, 手机的获取模块 1 0获取到上述手机位置上的敲击 信号之后, 则可启动相应的手机功能 (即启动手机根据敲击信号生成钢 琴弹奏的输入信号的功能) ; 当手机用户想要结束游戏时, 则可在手机 的左下角、 右下角、 右上角、 左上角依次各敲击一下, 表示结束弹奏, 手机的获取模块 1 0获取到上述位置上的敲击信号之后, 则可自行关闭手 机的游戏应用服务器, 不再接收生成钢琴弹奏的输入信号。 此外, 手机 用户也可在手机的上边、 下边、 左边、 右边依次各敲击一下表示开始弹 奏、 在手机的右边、 左边、 下边、 上边依次各敲击一下表示结束弹奏。 上述开始和结束弹奏的动作定义方式仅是举例, 而非穷举。 In a specific implementation, the first operating platform described in this embodiment may include: a terminal body, a surface of a flat object on which the terminal is placed, a terminal input device, and the like. For example, the first operating platform described in this embodiment may be a mobile phone. In itself, or placed on the horizontal desktop of the mobile phone, the ground, the input keyboard drawing of the mobile phone, the user-defined input drawing of the mobile phone, and the like. When the user uses the corresponding function of the terminal described in this embodiment, the tapping action can be performed on the mobile phone (including the back of the mobile phone or other parts on the mobile phone) or the desktop of the mobile phone, and the acquiring module in the mobile phone 1 0 can obtain the tapping signal on the mobile phone or the desktop of the mobile phone through its built-in sensor to generate the input signal of the mobile phone according to the tapping signal. The tapping signal on the first operating platform may include: a vibration mechanical wave, a tapping time, a tapping intensity, and the like. For example, when the mobile phone user plays the game using the piano in the mobile application, if the mobile phone is required to generate an input signal of the piano playing game according to the tapping signal, the mobile phone function can be turned on before the game is played, that is, according to the first The tapping signal on the operating platform generates a phone function that inputs the input signal of the piano playing game. After the mobile phone user activates the above functions, the tapping action of playing music can be performed on the back of the mobile phone or on the desktop where the mobile phone is placed, and the acquisition module 10 of the mobile phone obtains the back of the mobile phone or the desktop of the mobile phone through its built-in sensor. After the signal is tapped, the tapping signal can be sent to a module in the mobile phone for generating a corresponding input signal to generate an input signal of the mobile phone piano playing through the corresponding mobile phone module. The mobile phone user does not need to input the playing signal through the virtual keyboard of the piano playing the game, and only needs to perform the tapping action of the playing music on the first operating platform to complete the signal input of the piano playing. In the specific implementation, in order to prevent the mobile phone from randomly generating a mobile phone input signal according to the tapping signal on the mobile phone or the desktop of the mobile phone, affecting the normal use of the mobile phone, a startup mode of starting the function of generating the mobile phone input signal of the mobile phone may be set. When the mobile phone user wants to activate the mobile phone function (that is, the mobile phone function for generating the mobile phone input signal according to the tap signal), the tapping action can be performed at the designated position on the first operating platform, and the acquiring module 10 of the mobile phone acquires the specified position. After the tap signal is on, the corresponding function of the mobile phone can be activated. For example, in order to prevent the input signal of the piano playing game of the mobile phone from being generated according to the tapping signal on the mobile phone or the desktop of the mobile phone, the mobile phone user can make a corresponding tapping at the designated position of the mobile phone when starting to play the music. Action, used to activate the piano playing function of the mobile phone. After the mobile phone acquisition module 10 obtains the tapping signal at the designated position of the mobile phone through the built-in sensor of the mobile phone, the piano playing function of the mobile phone can be started by itself. For example, when a mobile phone user plays the game application using the piano of the mobile phone, he can first tap each of the top left corner, the upper right corner, the lower right corner, and the lower left corner of the mobile phone to indicate that the playing is started, and the acquisition module of the mobile phone acquires 10 After the tapping signal on the above mobile phone position, the corresponding mobile phone function can be activated (ie, the function of starting the mobile phone to generate an input signal of the piano playing according to the tapping signal); when the mobile phone user wants to end the game, the mobile phone can be used in the mobile phone. The lower left corner, the lower right corner, the upper right corner, and the upper left corner are tapped one by one, indicating that the end playing is performed, and after the mobile phone acquiring module 10 obtains the tapping signal at the above position, the mobile game application server can be turned off by itself. The input signal that generates the piano play is no longer received. In addition, the mobile phone user can also tap on the top, bottom, left, and right sides of the mobile phone to start playing, and tap on the right, left, bottom, and top of the mobile phone to end the playing. The manner in which the above actions are started and ended is only an example, not an exhaustive one.
手机的获取模块 1 0通过手机的内置传感器获取到第一操作平台上的 敲击信号之后, 定位模块 30则可根据获取模块 1 0获取到的敲击信号判 断该敲击信号在上述第一操作平台上的敲击点位置。 具体地, 可先以手 机上的特定点 (例如手机的重心) 为坐标原点设定一个手机的定位坐标 系, 在手机显示屏所在的平面或者手机后盖所在的平面内设定所述手机 的定位坐标系, 以手机底边方向为 X轴, 手机侧边方向为 y轴, 用于确 定手机或者放置手机的桌面等操作平台上的敲击信号的敲击点位置。 具 体的, 可以手机上的特定点为坐标原点预先设定好手机的定位坐标系的 坐标轴, 并根据该定位坐标系确定手机中各个传感器在上述定位坐标系 中的位置, 如图 2 , 即设定好手机的定位坐标系后, 手机中各个传感器在 上述手机的定位坐标系中的位置坐标即确定可知。 确定好手机的定位坐 标系之后, 手机的定位模块 30 中的釆集单元 31 则可根据釆集手机中各 个传感器在上述定位坐标系中的位置坐标, 如图 2 所示。 确定好手机的 定位坐标系之后, 釆集单元 31可釆集到传感器 1、 传感器 2、 传感器 3、 传感器 4 在上述定位坐标系中的位置坐标为 (xl , yl ) 、 (x2 , y2 ) 、After the acquisition module 10 of the mobile phone acquires the tapping signal on the first operating platform by using the built-in sensor of the mobile phone, the positioning module 30 can determine, according to the tapping signal acquired by the acquiring module 10, the tapping signal in the first operation. The location of the tap point on the platform. Specifically, the positioning coordinates of a mobile phone may be set first with a specific point on the mobile phone (for example, the center of gravity of the mobile phone) as a coordinate origin. System, set the positioning coordinate system of the mobile phone in the plane where the mobile phone display screen is located or the plane where the mobile phone back cover is located, with the bottom direction of the mobile phone as the X axis, and the mobile phone side direction as the y axis, used to determine the mobile phone or place The tapping point position of the tapping signal on the operating platform such as the desktop of the mobile phone. Specifically, the coordinate axis of the positioning coordinate system of the mobile phone may be preset in advance for the coordinate origin of the specific point on the mobile phone, and the position of each sensor in the mobile phone in the positioning coordinate system is determined according to the positioning coordinate system, as shown in FIG. 2 After the positioning coordinate system of the mobile phone is set, the position coordinates of each sensor in the mobile phone in the positioning coordinate system of the mobile phone are determined. After determining the positioning coordinate system of the mobile phone, the collecting unit 31 in the positioning module 30 of the mobile phone can be based on the position coordinates of each sensor in the positioning coordinate system in the mobile phone, as shown in FIG. 2 . After determining the positioning coordinate system of the mobile phone, the collecting unit 31 can collect the position coordinates of the sensor 1, the sensor 2, the sensor 3, and the sensor 4 in the positioning coordinate system as (xl, yl), (x2, y2),
( x 3 , y3 ) 、 (x4 , y4 ) , 其中, 由于手机的内置传感器相对于手机的 位置为固定位置, 则上述各个传感器在定位坐标系中的位置均为确定的 位置, 即 xl、 yl、 x2、 y2、 x 3、 y3、 x4、 y4 均为已知数。 釆集单元 31 釆集到手机内置传感器 1、 传感器 2、 传感器 3、 传感器 4的位置坐标之 后, 当手机用户在 t 时刻在第一操作平台上的敲击点 (X , y ) 敲击一下 后, 振动机械波产生并向四周扩散后, 手机的定位模块 30中的第一处理 单元 32则可根据各个传感器接收到敲击信号的振动机械波的时刻 t l (传 感器 1接收的振动机械波的时刻 ) 、 t 2 (传感器 2接收的振动机械波的 时刻 ) 、 t 3 (传感器 3接收的振动机械波的时刻 ) 、 t 4 (传感器 4接收 的振动机械波的时刻) , 结合敲击信号产生的时刻, 即敲击信号的敲击 时刻 t以及振动机械波的传播速度 V ,计算手机中各个传感器与敲击信号 的敲击点位置的距离。 手机的第一处理单元 32根据振动机械波的传播速 度乘以时间等于振动机械波的传感距离 (即敲击点位置与各个传感器的 距离) , 利用各个传感器接收到敲击信号的振动机械波的时刻以及敲击 信号的敲击时刻、 振动机械波的传播速度结合手机中各个传感器在上述 定位坐标系中的位置坐标, 处理得到各个传感器与敲击点位置的距离与 敲击信号的振动机械波的传播速度、 传感器接收到振动机械波的时间点、 敲击信号的敲击时间点的关系等式, 如下 4元 2次方程组: (x 3 , y3 ) , (x4 , y4 ) , wherein, since the position of the built-in sensor of the mobile phone relative to the mobile phone is a fixed position, the positions of the above-mentioned respective sensors in the positioning coordinate system are all determined positions, that is, xl, yl , x2, y2, x3, y3, x4, y4 are all known numbers. After the collection unit 31 collects the position coordinates of the built-in sensor 1, the sensor 2, the sensor 3, and the sensor 4, when the mobile phone user taps on the tapping point (X, y) on the first operating platform at time t, After the vibration mechanical wave is generated and diffused to the surroundings, the first processing unit 32 in the positioning module 30 of the mobile phone can receive the vibration mechanical wave of the tap signal according to each sensor at time t1 (the time of the vibration mechanical wave received by the sensor 1), t 2 (the time of the vibration mechanical wave received by the sensor 2), t 3 (the time of the vibration mechanical wave received by the sensor 3), t 4 (the time of the vibration mechanical wave received by the sensor 4), the time at which the tapping signal is generated, that is, the tapping signal The tapping time t and the propagation velocity V of the vibrating mechanical wave calculate the distance between the respective sensors in the mobile phone and the tapping point position of the tapping signal. The first processing unit 32 of the mobile phone multiplies the propagation speed of the vibration mechanical wave by a time equal to the sensing distance of the vibration mechanical wave (ie, the distance between the tapping point position and each sensor), and the time at which the vibration mechanical wave of the tapping signal is received by each sensor and Tap The tapping time of the signal and the propagation speed of the vibrating mechanical wave are combined with the position coordinates of the respective sensors in the mobile phone in the positioning coordinate system, and the distance between each sensor and the position of the striking point and the propagation speed of the vibrating mechanical wave of the striking signal are processed, and the sensor receives The relationship between the time point of the vibration mechanical wave and the tapping time point of the tapping signal is as follows:
- yf - t) x v
Figure imgf000035_0001
- yf - t) xv
Figure imgf000035_0001
」 - 2 + O - yf - t) x v
Figure imgf000035_0002
由于上述数据中, 只有 v、 t、 x、 y为未知数, 则可通过给 v、 t、 x、 y一个预设值, 并通过迭代计算则可处理得到 v、 t、 x、 y四个未知数的 值, 即可确定敲击信号在第一操作平台上的敲击点位置 (X , y ) 。
- 2 + O - yf - t) xv
Figure imgf000035_0002
Since the above data, only the v, t, x, y is the unknown, to be by v, t, x, y a predetermined value, and v can be obtained by an iterative calculation process, t, x, y four unknowns The value of the tapping point (X, y) of the tapping signal on the first operating platform.
具体实现中, 由于振动机械波在特定介质中的传播速度是固定的, 而手机壳体所用的介质是固定可知的 (由于手机壳体制作材质是手机出 厂时已经确定可知的, 则手机壳体所用的介质也为确定可知的) , 则振 动机械波在手机壳体上的传播速度也为固定可知的, 可预先存储于手机 中。 当手机用户在手机上 (即手机壳体上) 做敲击动作时, 敲击所产生 的振动机械波在手机上的传播速度 V 则成为一个已知量, 在处理上述方 程式的过程中, 传播速度 V 可当作已知数处理。 当敲击点在手机上时, 通过 3 个传感器则可计算得知敲击信号在手机上的敲击点在上述定位坐 标系中的位置 (X , y ) 。 若有上述 4 个传感器, 则可根据最小二乘法估 算敲击点位置的计算精度, 即在本实施例中, 上述用于获取敲击信号的 传感器至少需要 3个, 最多不限。  In the specific implementation, since the propagation speed of the vibration mechanical wave in the specific medium is fixed, and the medium used for the mobile phone case is fixed and known (because the material of the mobile phone case is determined by the mobile phone, the mobile phone case is used for the mobile phone case) The medium is also known to be identifiable. The propagation speed of the vibrating mechanical wave on the casing of the mobile phone is also fixed and can be stored in advance in the mobile phone. When the mobile phone user makes a tapping action on the mobile phone (ie, the mobile phone casing), the propagation speed V of the vibration mechanical wave generated by the tapping on the mobile phone becomes a known amount, and in the process of processing the above equation, the propagation speed V can be treated as a known number. When the tapping point is on the mobile phone, the position of the tapping point of the tapping signal on the mobile phone in the positioning coordinate system (X, y) can be calculated by the three sensors. If there are the above four sensors, the calculation accuracy of the position of the tapping point can be estimated according to the least square method. In this embodiment, at least three sensors for acquiring the tapping signal are required, and at most, at most.
如图 3 , 若敲击信号在手机外部, 即此时第一操作平台为放置手机的 桌面等平台时, 由于桌面的制作材质可能有多种类型(例如木材、 塑料、 铁皮等) , 使得敲击信号的振动机械波的传播介质变成不固定介质, 手 机无法预先判断得知敲击信号的振动机械波在当前放置手机的桌面上的 传播速度 V , 即此时振动机械波的传播速度 V为未知数。 敲击信号的敲击 点位置在放置手机的桌面等平台时, 第一处理单元 32可通过上述手机的 4个传感器获取相应的数据提供确定 v、 t、 x、 y四个未知数的值, 从而 确定敲击信号在第一操作平台上的敲击点位置。 根据第一处理单元 32获 取的数据判断得知振动机械波在当前传播介质 (即放置手机的桌面) 上 的传播速度之后, 当手机用户在相同的介质上敲击第二次, 即手机用户 在放置手机的桌面上敲击第二次时, 由于振动机械波的传播速度 V 已确 定可知, 手机根据上述 4 个传感器获取到的数据则可初步估算敲击信号 在第一操作平台上的敲击点位置的计算精度。 具体的, 手机用户可根据 上述方法得到第二次敲击的敲击信号对应的 4元 2次方程, 并可将第一 次敲击中判断得知的振动机械波的传播速度 v(即振动机械波在放置手机 的桌面上的传播速度) 代入上述 4元 2次方程, 再结合其中任意三个方 程式处理得到第二次敲击的敲击信号在第一操作平台上的敲击点位置 1 (假设为手机坐标系中的坐标(xl、 yl ) ) 。 此外, 还可直接根据上述 4 元 2 次方程处理得到第二次敲击的敲击信号在第一操作平台上的敲击点 位置 2 (假设为手机坐标系中的坐标(x2、 y2 ) ) , 并根据前面处理得到 的敲击点位置 1 判断敲击点位置 2 ( x2、 y2 ) 和敲击点位置 1 ( x l、 yl ) 的坐标是否重合或者误差是否在设定的误差范围内, 以此来估算敲击信 号在第一操作平台上的敲击点位置的计算精度。 As shown in Figure 3, if the tapping signal is outside the mobile phone, that is, when the first operating platform is a platform such as a desktop on which the mobile phone is placed, there may be many types of materials for the desktop (for example, wood, plastic, Iron sheet, etc., so that the propagation medium of the vibration mechanical wave of the tapping signal becomes an unfixed medium, and the mobile phone cannot predetermine the propagation velocity V of the vibration mechanical wave of the tapping signal on the desktop currently placed on the mobile phone, that is, the vibration mechanical wave at this time The propagation velocity V is unknown. When the tapping point of the tapping signal is located on a platform such as a desktop on which the mobile phone is placed, the first processing unit 32 can obtain the values of the four unknowns of v, t, x, and y by acquiring the corresponding data by the four sensors of the mobile phone. The tapping point position of the tap signal on the first operating platform is determined. According to the data acquired by the first processing unit 32, after the propagation speed of the vibration mechanical wave on the current propagation medium (ie, the desktop on which the mobile phone is placed) is determined, when the mobile phone user taps the second time on the same medium, the mobile phone user is placed. When the mobile phone's desktop is tapped for the second time, since the propagation velocity V of the vibrating mechanical wave has been determined, the mobile phone can initially estimate the tapping point position of the tapping signal on the first operating platform based on the data acquired by the above four sensors. The accuracy of the calculation. Specifically, the mobile phone user can obtain the 4-element second-order equation corresponding to the tapping signal of the second tap according to the above method, and can determine the propagation velocity v of the vibrating mechanical wave (ie, the vibrating mechanical wave) in the first tapping. The propagation speed on the desktop where the mobile phone is placed) is substituted into the above 4-ary equation 2, and then combined with any three of the equations to obtain the tapping signal of the second tap on the first operating platform. Is the coordinates (xl, yl) in the phone coordinate system. In addition, it is also possible to directly obtain the tapping point position 2 of the tapping signal of the second tap on the first operating platform according to the above-mentioned 4-ary binary equation (assuming coordinates (x2, y2) in the mobile coordinate system) And judging whether the coordinates of the tapping point position 2 (x2, y2) and the tapping point position 1 (xl, yl) are coincident or the error is within the set error range according to the tapping point position 1 obtained in the previous processing, This estimates the accuracy of the calculation of the tapping point position of the tap signal on the first operating platform.
具体实现中, 本实施例中所描述的第二操作平台为终端的应用程序 的输入界面、 终端的字符输入软键盘等终端上的输入平台。 例如, 手机 上的应用程序中的钢琴弹奏游戏的虚拟琴键、 手机输入法的输入软键盘、 手机的拍照功能界面上的拍摄按钮等。 上述操作按键仅是举例, 而非穷 举。 上述第二操作平台上的操作位置, 具体可为: 终端的应用程序的输 入按键的键值、 终端的字符输入软键盘的键值、 终端触摸屏的触摸位置 等, 例如, 手机上的应用程序中的钢琴弹奏游戏的琴键的键值、 手机输 入法的字符输入键盘的键值, 手机的拍照功能的拍摄按键的键值等。 In a specific implementation, the second operating platform described in this embodiment is an input interface of an application of the terminal, an input platform of a terminal such as a character input soft keyboard of the terminal. For example, the virtual keyboard of the piano playing game in the application on the mobile phone, the input soft keyboard of the mobile phone input method, the shooting button on the camera function interface of the mobile phone, and the like. The above operation buttons are only examples, not poor Lift. The operation position on the second operating platform may be: a key value of an input button of the application of the terminal, a key value of a character input soft keyboard of the terminal, a touch position of the touch screen of the terminal, etc., for example, in an application on the mobile phone The key value of the key of the piano playing game, the key value of the character input keyboard of the mobile phone input method, the key value of the shooting key of the camera function of the mobile phone, and the like.
手机的定位模块 3 0判断得知第一操作平台上的敲击信号的敲击点位 置之后, 则可通过映射模块 5 0将敲击信号在第一操作平台上的敲击点在 手机的定位坐标系中的位置与预先存储的定位数据库进行匹配, 通过数 据库匹配来判断敲击信号在第一操作平台上的敲击点位置对应的手机的 第二操作平台上的操作位置, 并将在敲击信号在第一操作平台上的敲击 点位置映射为手机的第二操作平台上的操作位置。 具体实现中, 可预先 以上述手机的定位坐标系为参照系设定手机一个可感知的敲击区域, 例 如, 可预先以手机的定位坐标系的原点为中心设定一个边长为长 2 X、 宽 2Y (其中, X、 Y 的具体数值可在设定手机的定位坐标系的同时设定, 也 可通过手机用户自定义设置) 的方形区域为手机的可感知区域, 并设定 上述可感知区域中每一个敲击位置对应的手机的第二操作平台上的操作 位置 (具体可为手机的第二操作平台上的按键的键值) , 将所有对应关 系存储为定位数据库。 当手机用户将手机放置平稳并确定好手机的第一 操作平台 (例如手机本体或者放置手机的桌面等) 时, 手机根据其定位 坐标系则可确定当前第一操作平台上的可感知区域 (例如手机本体上的 特定区域或者放置手机的桌面上的特定区域) 。 当手机用户在第一操作 平台上的可感知区域范围内做敲击动作时, 手机的映射模块 5 0则可将敲 击信号在第一操作平台上的敲击点在定位坐标系中的位置与预先存储的 定位数据库进行匹配, 确定当前第一操作平台上的敲击点位置对应的第 二操作平台上的操作位置。 例如, 如图 2 所示的场景, 当手机用户在手 机背面做敲击动作之后, 手机的定位模块 30判断得知手机上的敲击信号 的敲击点位置时, 映射模块 5 0则可通过手机内置的数据库进行匹配, 判 断当前手机上的敲击信号的敲击点位置对应的手机的钢琴弹奏游戏上的 虚拟琴键上的按键的键值, 并将该敲击点位置映射为该虚拟琴键的键值, 手机的生成模块 7 0则以该敲击信号为该琴键上的触发信号, 为终端生成 对应于该触发信号的钢琴弹奏游戏的输入信号。 例如, 如图 4 所示当定 位模块 30判断得知敲击信号在手机背面的敲击点位置为手机背面的左上 角上的一个点 (图 4上所示的敲击点) 时, 映射模块 5 0则可通过手机的 内置定位数据库匹配得知当前的敲击点位置对应的手机的钢琴弹奏游戏 上的虚拟琴键为琴键盘上左起第三个按键(即图 4中映射点对应的按键), 即可将敲击信号在手机背面上的敲击点位置映射为手机的钢琴弹奏游戏 的按键的键值。 同理, 当定位模块 30判断得知敲击信号的敲击点位置在 手机背面的其他位置上时, 映射模块 5 0也可通过手机的内置定位数据库 进行匹配, 判断敲击信号的敲击点位置对应的虚拟琴键上的按键的键值。 映射模块 5 0判断得知敲击信号的敲击点位置对应的手机的钢琴弹奏游戏 的虚拟键盘的特定琴键的键值之后, 手机的生成模块 7 0可以以该敲击信 号作为该琴键的键值的触发信号, 以该敲击信号去触发手机内置的虚拟 钢琴应用, 并通过手机的内置虚拟钢琴的应用程序调用手机的音乐播放 管理器播放对应该敲击信号的音乐。 手机的映射模块 5 0将敲击信号的敲 击点位置映射为手机上的虚拟钢琴应用上的按键的键值后, 生成模块 7 0 则将该敲击信号转换为手机的虚拟钢琴应用上的按键的键值的触发信号, 通过手机的虚拟钢琴应用程序调用音乐播放管理器发出与该特定按键的 音调相对应的音调的声音, 并根据该敲击信号的敲击强度调节与该敲击 强度对应的音量的音乐, 即手机可根据手机用户的敲击位置以及敲击强 度以不同的音量发出不同音调的音乐。 用户可根据自己的敲击动作调节 手机发出的音乐的音调和音量, 更好地调动手机用户通过手机弹奏音乐 的兴趣与激情, 还可以触发手机用户的音乐创作灵感, 提高了的信号输 入的趣味性。 After the positioning module 30 of the mobile phone determines that the tapping point position of the tapping signal on the first operating platform is known, the tapping point of the tapping signal on the first operating platform can be located on the mobile phone through the mapping module 50. The position in the coordinate system is matched with the pre-stored positioning database, and the operation position on the second operating platform of the mobile phone corresponding to the tapping point position of the tapping signal on the first operating platform is determined by database matching, and will be knocked The location of the hitting point on the first operating platform is mapped to the operating position on the second operating platform of the handset. In a specific implementation, a perceptible tapping area of the mobile phone may be set in advance by using the positioning coordinate system of the mobile phone as a reference system. For example, a side length of the mobile phone's positioning coordinate system may be set in advance as a length of 2 X. , width 2Y (where the specific value of X, Y can be set at the same time as setting the positioning coordinate system of the mobile phone, or can be customized by the user of the mobile phone), the square area of the mobile phone is the perceptible area of the mobile phone, and the above can be set The operating position on the second operating platform of the mobile phone corresponding to each tapping position in the sensing area (specifically, the key value of the button on the second operating platform of the mobile phone) is stored, and all the corresponding relationships are stored as a positioning database. When the mobile phone user places the mobile phone smoothly and determines the first operating platform of the mobile phone (such as the mobile phone body or the desktop on which the mobile phone is placed), the mobile phone can determine the perceptible area on the current first operating platform according to its positioning coordinate system (for example) a specific area on the phone body or a specific area on the desktop where the phone is placed). When the mobile phone user performs a tapping action within the perceptible area of the first operating platform, the mapping module 50 of the mobile phone can position the tapping point of the tapping signal on the first operating platform in the positioning coordinate system. Matching with the pre-stored positioning database to determine the operating position on the second operating platform corresponding to the tapping point position on the current first operating platform. For example, as shown in FIG. 2, after the mobile phone user performs a tapping action on the back of the mobile phone, the positioning module 30 of the mobile phone determines that the tapping signal on the mobile phone is known. When the tapping point position is used, the mapping module 50 can be matched by the built-in database of the mobile phone, and the button on the virtual key on the piano playing game of the mobile phone corresponding to the tapping point position of the current tap signal on the current mobile phone is determined. Key value, and map the location of the tap point to the key value of the virtual key, and the generating module 70 of the mobile phone uses the tapping signal as a trigger signal on the key to generate a piano bullet corresponding to the trigger signal for the terminal. Play the input signal of the game. For example, as shown in FIG. 4, when the positioning module 30 determines that the tapping point of the tapping signal on the back of the mobile phone is a point on the upper left corner of the back of the mobile phone (the tapping point shown in FIG. 4), the mapping module 5 0 can be matched by the built-in positioning database of the mobile phone to know that the virtual key on the piano playing game of the mobile phone corresponding to the current tapping point position is the third button from the left of the keyboard (ie, the mapping point corresponding to FIG. 4) Press the button) to map the tapping point on the back of the phone to the key of the phone's piano playing game. Similarly, when the positioning module 30 determines that the tapping point position of the tapping signal is at other positions on the back of the mobile phone, the mapping module 50 can also perform matching by using the built-in positioning database of the mobile phone to determine the tapping point of the tapping signal. The key value of the button on the virtual key corresponding to the position. After the mapping module 50 determines that the key value of the specific key of the virtual keyboard of the piano playing game of the mobile phone corresponding to the tapping point position of the tapping signal is known, the generating module 70 of the mobile phone can use the tapping signal as the key. The trigger signal of the key value is used to trigger the virtual piano application built in the mobile phone, and the music playing manager of the mobile phone is called by the application of the built-in virtual piano of the mobile phone to play the music corresponding to the tapping signal. After the mapping module 50 of the mobile phone maps the location of the tapping point of the tapping signal to the key value of the button on the virtual piano application on the mobile phone, the generating module 70 converts the tapping signal into a virtual piano application of the mobile phone. The trigger signal of the key value of the button is used by the virtual piano application of the mobile phone to call the music playing manager to emit a sound corresponding to the pitch of the specific button, and adjust the tapping strength according to the tapping strength of the tapping signal. The music of the corresponding volume, that is, the mobile phone can emit music of different pitches at different volume according to the tapping position of the mobile phone user and the tapping intensity. The user can adjust the pitch and volume of the music emitted by the mobile phone according to his own tapping action, and better mobilize the mobile phone user to play music through the mobile phone. The interest and passion can also trigger the inspiration of the music creation of mobile phone users, and improve the fun of signal input.
本实施例中所描述的手机可将手机上或者放置手机的桌面等操作平 台上的敲击信号的敲击点位置映射为手机的第二操作平台上的操作位置 (具体可映射为第二操作平台上的按键的键值等) , 并以该敲击信号作 为该操作位置上的触发信号, 用以触发手机的内部应用, 生成与该触发 信号相对应的手机输入信号, 拓展了手机的输入信号的生成途径, 提高 了生成手机输入信号的趣味性, 提高了手机的用户体验效果。  The mobile phone described in this embodiment can map the location of the tapping point of the tapping signal on the operating platform such as the desktop of the mobile phone or the mobile phone to the operating position on the second operating platform of the mobile phone (specifically, it can be mapped to the second operation). The key value of the button on the platform, etc., and the tapping signal is used as a trigger signal at the operating position to trigger an internal application of the mobile phone, generate a mobile phone input signal corresponding to the trigger signal, and expand the input of the mobile phone The signal generation path improves the interest of generating the input signal of the mobile phone and improves the user experience of the mobile phone.
参见图 1 1 , 是本发明实施例提供的生成终端输入信号的装置的第二 实施例结构示意图。 本实施例中所描述的生成终端输入信号的装置, 包 括:  FIG. 1 is a schematic structural diagram of a second embodiment of an apparatus for generating a terminal input signal according to an embodiment of the present invention. The apparatus for generating a terminal input signal described in this embodiment includes:
获取模块 1 0 , 用于获取第一操作平台上的敲击信号。  The acquiring module 1 0 is configured to acquire a tapping signal on the first operating platform.
定位模块 30 , 用于判断所述敲击信号在所述第一操作平台上的敲击 点位置。  The positioning module 30 is configured to determine a tapping point position of the tap signal on the first operating platform.
映射模块 60 , 用于将所述敲击信号在所述第一操作平台上的敲击点 位置映射为所述第二操作平台上的操作位置。  The mapping module 60 is configured to map a tapping point position of the tapping signal on the first operating platform to an operating position on the second operating platform.
生成模块 70 , 用于将所述敲击信号作为所述第二操作平台上的操作 位置上的触发信号, 为终端生成对应于所述触发信号的终端输入信号。  The generating module 70 is configured to use the tapping signal as a trigger signal on an operation position on the second operating platform to generate a terminal input signal corresponding to the trigger signal for the terminal.
本实施例中所描述的生成终端输入信号的装置, 还包括:  The device for generating a terminal input signal described in this embodiment further includes:
校准釆集模块 80 , 用于获取终端输入设备上的校准点的敲击信号, 并判断所述终端输入设备上的校准点在所述终端的定位坐标系中的位置。  The calibration collection module 80 is configured to acquire a tapping signal of the calibration point on the terminal input device, and determine a position of the calibration point on the terminal input device in the positioning coordinate system of the terminal.
校准模块 90 , 用于根据所述校准点在所述终端的定位坐标系中的位 置, 以及所述校准点在所述终端输入设备上的位置, 确定所述终端输入 设备与所述终端的相对位置。  a calibration module 90, configured to determine, according to a location of the calibration point in a positioning coordinate system of the terminal, and a position of the calibration point on the terminal input device, a relative orientation of the terminal input device and the terminal position.
其中, 所述定位模块 30 (如图 1 0 ) , 包括: 釆集单元 31 , 用于釆集所述终端中各个传感器在所述终端的定位坐 标系中的位置坐标。 The positioning module 30 (as shown in FIG. 10) includes: The collecting unit 31 is configured to collect position coordinates of each sensor in the terminal in a positioning coordinate system of the terminal.
第一处理单元 32 ,用于根据所述敲击信号的振动机械波的传播速度, 所述传感器接收到所述振动机械波的时刻, 所述敲击信号的敲击时刻, 以及所述各个传感器在所述终端的定位坐标系中的位置坐标, 判断所述 敲击信号在所述第一操作平台上的敲击点在所述终端的定位坐标系中的 位置。  a first processing unit 32, configured to: according to a propagation speed of the vibration mechanical wave of the tapping signal, a timing at which the sensor receives the vibration mechanical wave, a tapping time of the tapping signal, and the respective sensors in the Determining the position coordinates in the positioning coordinate system of the terminal, and determining the position of the tapping point of the tapping signal on the first operating platform in the positioning coordinate system of the terminal.
其中, 映射模块 6 0 , 包括:  The mapping module 6 0 includes:
判断单元 61 , 用于根据所述第一操作平台上的敲击信号的敲击点在 所述终端的定位坐标系中的位置, 以及所述终端输入设备与所述终端的 相对位置, 判断所述敲击信号在所述终端输入设备上的操作位置。  a determining unit 61, configured to determine, according to a location of a tapping point of a tapping signal on the first operating platform, a position in a positioning coordinate system of the terminal, and a relative position of the terminal input device and the terminal, The operating position of the tap signal on the terminal input device.
映射单元 6 3 , 用于根据预设的所述终端输入设备上的操作位置与所 述第二操作平台上的操作位置的对应关系, 将所述终端输入设备上的敲 击信号的敲击点位置映射为所述第二操作平台的操作位置。  The mapping unit 63 is configured to: according to the preset correspondence between the operation position on the terminal input device and the operation position on the second operation platform, the tapping point of the tapping signal on the terminal input device The location maps to an operational location of the second operating platform.
其中, 生成模块 7 0 , 具体用于:  Wherein, the generating module 7 0 is specifically used for:
将所述敲击信号作为所述第二操作平台上的操作位置上的触发信号, 并根据所述敲击信号的敲击强度, 生成与所述敲击信号的敲击强度相对 应的信号强度的终端输入信号。  Using the tapping signal as a trigger signal on an operation position on the second operating platform, and generating a signal strength corresponding to the tapping strength of the tapping signal according to the tapping intensity of the tapping signal Terminal input signal.
本实施例中所描述的第一操作平台, 可包括: 终端本体、 放置终端 的平整物体表面、 终端的即时接入设备、 终端的输入键盘图纸、 终端用 户自定义的输入图纸等。 例如, 本实施例中所描述的第一操作平台可以 是手机的即时接入设备 (即非手机的固定接入设备, 可实时接入作为手 机的输入装置并且接入时通过校准才能确定接入设备与手机的位置关系 的设备, 例如手机的外接物理键盘等) , 或者手机本身, 或者放置手机 的桌面, 或者手机用户打印出来并与手机一起放置在放置手机所在桌面 上的手机的输入键盘图纸 (例如图 6 中所示的键盘图) , 或者手机用户 打印出来并与手机一起放置在放置手机所在桌面上的手机用户自定义的 输入图纸 (例如图 7 中所示的辅助图纸) 等。 具体实现中, 上述手机的 输入键盘图纸以及手机用户自定义的输入图纸为一种特制的纸, 纸上包 括输入键盘图等信息。 The first operating platform described in this embodiment may include: a terminal body, a flat object surface on which the terminal is placed, an instant access device of the terminal, an input keyboard drawing of the terminal, an input drawing customized by the terminal user, and the like. For example, the first operating platform described in this embodiment may be an instant access device of the mobile phone (ie, a non-mobile phone fixed access device, which can be accessed as an input device of the mobile phone in real time and can be determined by calibration when accessing. a device that has a location relationship between the device and the mobile phone, such as an external physical keyboard of the mobile phone, or the mobile phone itself, or a desktop on which the mobile phone is placed, or a mobile phone user prints out and places it on the desktop where the mobile phone is placed The input keyboard drawing of the mobile phone on the mobile phone (such as the keyboard diagram shown in Figure 6), or the user input print drawing of the mobile phone user and placed with the mobile phone on the desktop where the mobile phone is placed (for example, as shown in Figure 7) Auxiliary drawings) and so on. In the specific implementation, the input keyboard drawing of the above mobile phone and the input drawing of the user defined by the mobile phone are a special type of paper, and the paper includes information such as an input keyboard picture.
当用户在使用本实施例中所描述的终端的对应功能时, 可将手机的 输入键盘图纸或者手机用户自定义的输入键盘图纸平稳放置在放置手机 的桌面 (即手机所在桌面) 上, 并在输入键盘图纸或者手机用户自定义 的输入图纸上做敲击动作, 手机中的获取模块 1 0则可通过其内置传感器 等敲击信号获取模块获取手机的输入键盘图纸或者手机用户自定义的输 入图纸上的敲击信号, 以通过手机中的相应的模块根据该敲击信号生成 终端的输入信号。 其中, 上述第一操作平台上的敲击信号, 可包括: 振 动机械波、 敲击时间、 敲击强度等。 例如, 当手机用户在使用手机的输 入键盘图纸进行手机字符输入时, 若需要手机根据敲击信号生成字符输 入信号, 则可开启这个手机功能, 以根据第一操作平台 (即手机的输入 键盘图纸) 上的敲击信号生成字符输入信号的手机功能。 手机用户启动 上述手机功能之后, 则可在手机的输入键盘图纸上做敲击动作, 手机的 获取模块 1 0通过其内置传感器获取手机的输入键盘图纸上的敲击信号之 后, 则可将该敲击信号发送给手机中相应的模块, 该手机模块则可根据 该敲击信号生成手机输入法的输入信号。 具体实现中, 手机通过其内置 传感器获取手机的输入键盘图纸 (终端输入设备) 上的敲击信号, 并根 据该敲击信号生成手机输入法的输入信号之前, 还需要先确认手机的输 入键盘图纸与手机的相对位置, 即需要确定手机的输入键盘图纸的定位 坐标系与手机的定位坐标系的变换关系。 具体的, 手机用户需要敲击手 机的输入键盘图纸上的校准点对手机的输入键盘图纸和手机的相对位置 进行校准。 When the user uses the corresponding function of the terminal described in this embodiment, the input keyboard drawing of the mobile phone or the input keyboard drawing of the mobile phone user can be smoothly placed on the desktop where the mobile phone is placed (ie, the desktop where the mobile phone is located), and Input the keyboard drawing or the user-defined input drawing of the mobile phone to make a tapping action. The acquiring module 10 in the mobile phone can obtain the input keyboard drawing of the mobile phone or the input drawing of the customized user of the mobile phone through the tapping signal acquisition module such as the built-in sensor. The tap signal on the top generates an input signal of the terminal according to the tap signal through a corresponding module in the mobile phone. The tapping signal on the first operating platform may include: a vibration mechanical wave, a tapping time, a tapping intensity, and the like. For example, when the mobile phone user uses the input keyboard drawing of the mobile phone to input the mobile phone character, if the mobile phone is required to generate a character input signal according to the tapping signal, the mobile phone function can be turned on according to the first operating platform (ie, the input keyboard drawing of the mobile phone). The tapping signal on the phone generates a character input signal for the phone function. After the mobile phone user activates the above mobile phone function, the tapping action can be performed on the input keyboard drawing of the mobile phone, and after the mobile phone acquiring module 10 obtains the tapping signal on the input keyboard drawing of the mobile phone through the built-in sensor, the knocking can be performed. The hit signal is sent to the corresponding module in the mobile phone, and the mobile phone module can generate an input signal of the mobile phone input method according to the tap signal. In a specific implementation, the mobile phone obtains a tapping signal on the input keyboard drawing (terminal input device) of the mobile phone through its built-in sensor, and before inputting the input signal of the mobile phone input method according to the tapping signal, it is also necessary to confirm the input keyboard drawing of the mobile phone first. The relative position with the mobile phone, that is, the transformation relationship between the positioning coordinate system of the input keyboard drawing of the mobile phone and the positioning coordinate system of the mobile phone needs to be determined. Specifically, the mobile phone user needs to tap the calibration point on the input keyboard drawing of the mobile phone to the relative position of the input keyboard drawing of the mobile phone and the mobile phone. Perform calibration.
手机的获取模块 1 0通过手机的内置传感器获取到第一操作平台上的 敲击信号之后, 定位模块 30则可根据该敲击信号判断该敲击信号在上述 第一操作平台上的敲击点位置。 具体地, 可先以手机上的特定点 (例如 手机的重心) 为坐标原点设定一个手机的定位坐标系, 在手机显示屏所 在的平面或者手机后盖所在的平面内设定所述手机的定位坐标系, 以手 机底边方向为 X轴, 手机侧边方向为 y轴, 用于确定手机或者放置手机 的桌面等操作平台上面的敲击信号的敲击点位置 (即敲击信号在手机的 定位坐标系中的位置) 。 具体的, 可以手机上的特定点 (例如手机的重 心) 为坐标原点预先设定好定位坐标系的坐标轴, 并根据该定位坐标系 确定手机中各个传感器在上述定位坐标系中的位置, 如图 2 所示。 设定 手机的定位坐标系之后, 手机中的传感器在手机的定位坐标系中的位置 坐标则确定可知, 将手机中的传感器在手机的定位坐标系中的位置坐标 存储在存储器中。 手机的定位模块 30 中的釆集单元 31 则可釆集到手机 中各个传感器在手机的定位坐标系中的位置坐标。 具体地, 设定好手机 的定位坐标系之后, 釆集单元 31 即可釆集到传感器 1、 传感器 2、 传感 器 3、传感器 4在上述定位坐标系中的位置坐标为( xl , yl )、 ( x2 , y2 )、 ( x 3 , y3 ) 、 (x4 , y4 ) , 其中, 由于手机的内置传感器相对于手机的 位置为固定位置, 则上述各个传感器在定位坐标系中的位置均为确定的 位置, 即 xl、 yl、 x2、 y2、 x 3、 y3、 x4、 y4 均为已知数。 釆集单元 31 釆集到手机内置传感器 1、 传感器 2、 传感器 3、 传感器 4的位置之后, 当手机用户在 t 时刻在第一操作平台上的敲击点 (X , y ) 敲击一下后, 振动机械波产生并向四周扩散后, 手机的定位模块 30中的第一处理单元 32则可根据各个传感器接收到敲击信号的振动机械波的时刻时间 t l (传 感器 1接收的振动机械波的时刻) 、 t 2 (传感器 2接收的振动机械波的 时刻) 、 t3 (传感器 3接收的振动机械波的时刻) 、 t4 (传感器 4接收 的振动机械波的时刻) , 结合敲击信号的敲击时刻 t 以及振动机械波的 传播速度 V, 计算手机中各个传感器与敲击信号的敲击点位置的距离。 手 机的第一处理单元 32将上述各个传感器接收到敲击信号的振动机械波的 时刻以及敲击信号的敲击时刻、 振动机械波的传播速度等数据, 可结合 手机中各个传感器在上述定位坐标系中的位置坐标, 根据振动机械波的 传播速度乘以时间等于振动机械波的传感距离 (即敲击点位置与各个传 感器的距离) 得到各个传感器与敲击点位置的距离与敲击信号的振动机 械波的传播速度、 传感器接收到振动机械波的时间点、 敲击信号的敲击 时间的关系等式, 如下 4元 2次方程组: After the acquisition module 10 of the mobile phone acquires the tapping signal on the first operating platform by using the built-in sensor of the mobile phone, the positioning module 30 can determine the tapping point of the tapping signal on the first operating platform according to the tapping signal. position. Specifically, a positioning coordinate system of a mobile phone may be set with a specific point on the mobile phone (for example, the center of gravity of the mobile phone) as a coordinate origin, and the mobile phone may be set in a plane where the mobile phone display screen is located or a plane where the mobile phone back cover is located. Positioning the coordinate system, the direction of the bottom edge of the mobile phone is the X axis, and the direction of the side of the mobile phone is the y axis, which is used to determine the tapping point position of the tapping signal on the operating platform such as the mobile phone or the desktop on which the mobile phone is placed (ie, the tapping signal is on the mobile phone) Position in the positioning coordinate system). Specifically, a specific point on the mobile phone (for example, the center of gravity of the mobile phone) may be used to preset a coordinate axis of the positioning coordinate system for the coordinate origin, and according to the positioning coordinate system, determine the position of each sensor in the mobile phone in the positioning coordinate system, such as Figure 2 shows. After setting the positioning coordinate system of the mobile phone, the position coordinates of the sensor in the mobile phone in the positioning coordinate system of the mobile phone are determined, and the position coordinates of the sensor in the mobile phone in the positioning coordinate system of the mobile phone are stored in the memory. The collection unit 31 in the positioning module 30 of the mobile phone can collect the position coordinates of each sensor in the mobile phone in the positioning coordinate system of the mobile phone. Specifically, after the positioning coordinate system of the mobile phone is set, the collecting unit 31 can collect the position coordinates of the sensor 1, the sensor 2, the sensor 3, and the sensor 4 in the positioning coordinate system as (xl, yl), ( X2 , y2 ), ( x 3 , y3 ) , (x4 , y4 ) , wherein, since the position of the built-in sensor of the mobile phone relative to the mobile phone is a fixed position, the positions of the above-mentioned respective sensors in the positioning coordinate system are determined positions , ie xl, yl, x2, y2, x3, y3, x4, y4 are all known numbers. After the collection unit 31 collects the positions of the built-in sensor 1, the sensor 2, the sensor 3, and the sensor 4, when the mobile phone user taps on the tapping point (X, y) on the first operating platform at time t, After the vibration mechanical wave is generated and diffused to the surroundings, the first processing unit 32 in the positioning module 30 of the mobile phone can receive the time t1 of the vibration mechanical wave of the tap signal according to each sensor (the time of the vibration mechanical wave received by the sensor 1), t 2 (sensor 2 receives vibration of mechanical waves Time), t3 (time of vibration mechanical wave received by sensor 3), t4 (time of vibration mechanical wave received by sensor 4), combined with the tapping time t of the tapping signal and the propagation velocity V of the vibration mechanical wave, calculate each sensor in the mobile phone The distance from the tapping point of the tapping signal. The first processing unit 32 of the mobile phone receives the data of the vibration mechanical wave of the tap signal and the tapping time of the tapping signal, the propagation speed of the vibration mechanical wave, and the like, and can be combined with each sensor in the mobile phone in the positioning coordinate system. The position coordinate is obtained by multiplying the propagation velocity of the vibration mechanical wave by the time equal to the sensing distance of the vibration mechanical wave (ie, the distance between the tapping point and each sensor) to obtain the distance between each sensor and the position of the tapping point and the vibration mechanical wave of the tapping signal. The relationship between the propagation speed, the time point at which the sensor receives the vibrating mechanical wave, and the tapping time of the tapping signal is as follows:
-^)2 +( Ί - -y)2 -t)xv-^) 2 +( Ί - -y) 2 -t)xv
Figure imgf000043_0001
Figure imgf000043_0001
- 2 + O -yf =( -t)xv - 2 + O -yf =( -t)xv
Figure imgf000043_0002
Figure imgf000043_0002
由于上述数据中, 只有 v、 t、 x、 y为未知数, 则通过 v、 t、 x、 y 一个预设值, 并通过迭代计算可处理得到 v、 t、 x、 y 四个未知数的值, 即可确定敲击信号在第一操作平台上的敲击点位置 (X, y ) 。  Since v, t, x, and y are unknowns in the above data, a predetermined value is obtained by v, t, x, y, and the values of four unknowns of v, t, x, and y can be processed by iterative calculation. The tapping point position (X, y) of the tapping signal on the first operating platform can be determined.
具体实现中, 由于振动机械波在特定介质中的传播速度是固定的, 而手机壳体所用的介质是固定可知的 (由于手机壳体制作材质是手机出 厂时已经确定可知的, 则手机壳体所用的介质也为确定可知的) , 则振 动机械波在手机壳体上的传播速度也为固定可知的, 可预先存储于手机 中, 当手机用户在手机上 (即手机壳体上) 做敲击动作时, 敲击所产生 的振动机械波在手机上的传播速度 V 则成为一个已知量。 当敲击点在手 机上(如图 2 )时, 通过 3个传感器则可计算得知敲击信号在手机上的敲 击点在上述定位坐标系中的位置 (X, y ) 。 若有上述 4 个传感器, 则可 根据最小二乘法估算敲击点位置的计算精度, 即在本实施例中, 上述用 于获取敲击信号的传感器至少需要 3个, 最多不限。 In the specific implementation, since the propagation speed of the vibration mechanical wave in the specific medium is fixed, and the medium used for the mobile phone case is fixed and known (because the material of the mobile phone case is determined by the mobile phone, the mobile phone case is used for the mobile phone case) The medium is also known to be identifiable. The propagation speed of the vibrating mechanical wave on the mobile phone casing is also fixed. It can be pre-stored in the mobile phone, and the mobile phone user performs a tapping action on the mobile phone (ie, the mobile phone casing). At this time, the propagation velocity V of the vibrating mechanical wave generated by the tap on the mobile phone becomes a known amount. When the tapping point is on the mobile phone (as shown in Fig. 2), the position (X, y) of the tapping point of the tapping signal on the mobile phone in the positioning coordinate system can be calculated by the three sensors. If there are 4 sensors above, then The calculation accuracy of the position of the tapping point is estimated according to the least squares method, that is, in the embodiment, the sensor for acquiring the tapping signal needs at least three, at most not limited.
如图 3 , 若敲击信号在手机外部, 即此时第一操作平台为放置手机的 桌面等平台时, 由于桌面的制作材质可能有多种类型(例如木材、 塑料、 铁皮等) , 使得敲击信号的振动机械波的传播介质变成不固定介质, 手 机无法预先判断得知敲击信号的振动机械波在当前放置手机的桌面上的 传播速度 V , 即此时振动机械波的传播速度 V为未知数。 当敲击信号的敲 击点位置在放置手机的桌面等平台时, 可根据上述手机的 4 个传感器获 取相应的数据, 并利用获取得到的数据来确定 v、 t、 x、 y四个未知数的 值, 从而确定敲击信号在第一操作平台上的敲击点位置。  As shown in Figure 3, if the tapping signal is outside the mobile phone, that is, when the first operating platform is a platform such as a desktop on which the mobile phone is placed, since the material of the desktop may be of various types (such as wood, plastic, iron, etc.), The propagation medium of the vibration mechanical wave of the hitting signal becomes an unfixed medium, and the mobile phone cannot predetermine the propagation velocity V of the vibration mechanical wave of the tapping signal on the desktop currently placed on the mobile phone, that is, the propagation velocity V of the vibration mechanical wave at this time is unknown. When the tapping point of the tapping signal is on the platform such as the desktop on which the mobile phone is placed, the corresponding data can be obtained according to the four sensors of the mobile phone, and the obtained data is used to determine the four unknowns of v, t, x, and y. a value to determine the location of the tapping point of the tapping signal on the first operating platform.
手机根据上述传感器获取得到的数据判断得知振动机械波在当前传 播介质 (即放置手机的桌面) 上的传播速度之后, 当手机用户在相同的 介质上敲击第二次, 即手机用户在放置手机的桌面上敲击第二次时, 由 于振动机械波的传播速度 V 已确定可知, 根据 4个传感器获取到的数据 则可初步估算敲击信号在第一操作平台上的敲击点位置的计算精度。 具 体的, 手机的第一处理单元 32可根据上述方法得到第二次敲击的敲击信 号对应的 4元 2次方程, 可将第一次敲击中判断得知的振动机械波的传 播速度 V (即振动机械波在放置手机的桌面上的传播速度) 代入上述 4 元 2 次方程, 再结合其中任意三个方程式处理得到第二次敲击的敲击信 号在第一操作平台上的敲击点位置 1 (假设为手机坐标系中的坐标 (x l、 y l ) ) 。 此外, 还可直接根据得到的上述 4元 2次方程处理得到第二次 敲击的敲击信号在第一操作平台上的敲击点位置 2 (假设为手机坐标系中 的坐标 (x 2、 y2 ) ) , 并根据前面处理得到的敲击点位置 1 判断敲击点 位置 1 ( x 2、 y2 ) 和敲击点位置 1 ( x l、 y l ) 的坐标是否重合或者误差是 否在设定的误差范围内, 以此来估算敲击信号在第一操作平台上的敲击 点位置的计算精度。 The mobile phone judges, according to the data obtained by the above sensor, the speed of the vibration mechanical wave on the current propagation medium (ie, the desktop on which the mobile phone is placed), when the mobile phone user taps the second time on the same medium, that is, the mobile phone user places the mobile phone. When tapping the second time on the desktop, since the propagation velocity V of the vibration mechanical wave has been determined, the calculation accuracy of the tapping point position of the tapping signal on the first operating platform can be estimated based on the data acquired by the four sensors. . Specifically, the first processing unit 32 of the mobile phone can obtain the 4-element second-order equation corresponding to the tapping signal of the second tap according to the foregoing method, and can determine the propagation speed of the vibrating mechanical wave that is known in the first tap. (that is, the propagation speed of the vibrating mechanical wave on the desktop placed on the mobile phone) is substituted into the above 4-ary equation, and then combined with any three of the equations to obtain the tapping point of the tapping signal of the second tap on the first operating platform. Position 1 (assumed to be the coordinates (xl, yl) in the phone coordinate system). In addition, the tapping point of the tapping signal of the second tapping on the first operating platform can be directly obtained according to the obtained 4-ary quadratic equation obtained (assuming coordinates in the mobile phone coordinate system (x2). Y2 ) ) , and judge whether the coordinates of the tapping point position 1 ( x 2 , y2 ) and the tapping point position 1 ( xl, yl ) coincide or whether the error is in the set error according to the tapping point position 1 obtained in the previous processing. In this way, to estimate the tapping of the tapping signal on the first operating platform The calculation accuracy of the point position.
如图 6 , 当手机用户在手机的输入键盘图纸上做敲击动作, 即第一操 作平台上的敲击信号的敲击点在手机外部的键盘图上, 不在手机上时, 定位模块 30则可根据上述确定图 3上的敲击信号的敲击点位置的方法确 定图 6中第一操作平台 (键盘图) 上的敲击点位置, 在此不再赘述。  As shown in FIG. 6, when the mobile phone user performs a tapping action on the input keyboard drawing of the mobile phone, that is, the tapping point of the tapping signal on the first operating platform is on the keyboard map outside the mobile phone, when not on the mobile phone, the positioning module 30 is The position of the tapping point on the first operating platform (keyboard map) in FIG. 6 can be determined according to the above method for determining the position of the tapping point of the tapping signal on FIG. 3, and details are not described herein again.
具体实现中, 手机的输入键盘图上的各个字符以及校准点在输入键 盘图上的位置是固定的, 可以预先将手机的输入键盘图纸上各个字符以 及校准点在手机的输入键盘图纸的定位坐标系中的坐标预置在手机应用 中, 即可预先将手机输入键盘图纸上的各个字符以及校准点对应的坐标 (在手机的输入键盘图纸的定位坐标系中的坐标) 与手机应用的字符输 入的按键的键值先建立连接, 并将手机输入键盘图纸上的操作位置 (即 各个字符和校准点对应的坐标) 映射为手机应用上的字符输入按键的键 值。 具体实现中, 由于手机只能根据获取到的敲击信号判断敲击信号在 手机的定位坐标系中的位置, 则若要将敲击信号在手机输入键盘图纸上 的敲击点位置映射为手机应用上的字符输入按键的键值, 则需要将敲击 信号在手机的定位坐标系中的位置转换为手机的输入键盘图纸上对应的 位置, 即可先确定手机的定位坐标系上的坐标和手机的输入键盘图纸的 定位坐标系的坐标的变换关系。  In the specific implementation, the characters on the input keyboard map of the mobile phone and the position of the calibration point on the input keyboard map are fixed, and the characters on the input keyboard drawing of the mobile phone and the positioning coordinates of the calibration point on the input keyboard drawing of the mobile phone can be pre-set in advance. The coordinates in the system are preset in the mobile phone application, and the characters input into the keyboard drawing and the coordinates corresponding to the calibration point (coordinates in the positioning coordinate system of the input keyboard drawing of the mobile phone) and the character input of the mobile phone application can be input in advance. The key value of the button is first established, and the operation position (ie, the coordinates corresponding to each character and the calibration point) on the phone keyboard input map is mapped to the key value of the character input button on the mobile phone application. In a specific implementation, since the mobile phone can only judge the position of the tapping signal in the positioning coordinate system of the mobile phone according to the obtained tapping signal, the location of the tapping point on the mobile phone input keyboard drawing is mapped to the mobile phone. The key value of the character input button on the application needs to convert the position of the tap signal in the positioning coordinate system of the mobile phone to the corresponding position on the input keyboard drawing of the mobile phone, and then the coordinates of the positioning coordinate system of the mobile phone can be determined first. The transformation relationship of the coordinates of the positioning coordinate system of the input keyboard drawing of the mobile phone.
具体实现中, 如图 6 , 手机用户在确定手机与当前放置状态下的手机 输入键盘图纸之间的相对位置关系 (也为手机的定位坐标系上的坐标和 手机的输入键盘图纸的定位坐标系上的坐标的变换关系) 时, 可点击手 机上的校准按键, 启动手机的校准功能。 手机在校准手机和手机输入键 盘图纸的相对位置关系时, 可先将手机的定位坐标系的坐标记为(x, , 手机的输入键盘图的定位坐标系的坐标记为(x,^ ) , 手机的定位坐标系与 输入键盘图的坐标系间的夹角记为^可以将手机的定位坐标系中 X轴与 输入键盘图的坐标系的 X轴的夹角记为^ 位移记为(^ , 位移为输入 键盘图的坐标系的原点在手机的定位坐标系中的坐标, 则有以下坐标变 换关系: In a specific implementation, as shown in FIG. 6, the mobile phone user determines the relative positional relationship between the mobile phone and the input keyboard drawing of the mobile phone in the current placement state (also the coordinates on the positioning coordinate system of the mobile phone and the positioning coordinate system of the input keyboard drawing of the mobile phone). When the coordinates of the coordinates are changed, you can click the calibration button on the phone to activate the calibration function of the phone. When the mobile phone and the mobile phone input the keyboard drawing relative position relationship, the mobile phone's positioning coordinate system can be first marked as ( x , , the mobile phone's input keyboard map positioning coordinate system is marked as ( x , ^ ) The angle between the positioning coordinate system of the mobile phone and the coordinate system of the input keyboard map is recorded as ^the X axis of the positioning coordinate system of the mobile phone Enter the angle of the X-axis of the coordinate system of the keyboard diagram as ^ displacement is recorded as (^, displacement is the coordinate of the origin of the coordinate system of the input keyboard diagram in the positioning coordinate system of the mobile phone, then the following coordinate transformation relationship:
X cos 6* sin 6* Ax X X cos 6* sin 6* Ax X
y ― - sin 6* cos 6* y  y ― - sin 6* cos 6* y
1 0 0 1 1 将手机的输入键盘图纸上的各校准点 (校准点 1、 校准点 2、 校准点 3、 校准点 4 ) 在输入键盘图的定位坐标系中的坐标分别记为 i'^i)、 (X '^)、 ( 4'Λ4)。 当手机用户敲击手机的输入键盘图纸上的各 个校准点时, 手机的校准釆集模块 80则可通过手机内置传感器获取到手 机的输入键盘图纸上的校准点上的敲击信号, 并通过上述第一处理单元 32得知各个校准点在手机的定位坐标系中的位置。 具体的, 可通过校准 模块 90判断手机的输入键盘图纸上的校准点在手机的定位坐标系中的坐 标, 分别记为( ' 1)、 ( ' 2)、 ( ' 3)、 ( 4, 4) , 则可以列出以下 4个 关系式: 1 0 0 1 1 Record the coordinates of each calibration point (calibration point 1, calibration point 2, calibration point 3, calibration point 4) on the input keyboard drawing of the mobile phone in the positioning coordinate system of the input keyboard diagram as i'^ i), ( X '^), ( 4 ' Λ 4 ). When the mobile phone user taps each calibration point on the input keyboard drawing of the mobile phone, the calibration module 80 of the mobile phone can obtain the tapping signal on the calibration point on the input keyboard drawing of the mobile phone through the built-in sensor of the mobile phone, and through the above The first processing unit 32 knows the position of each calibration point in the positioning coordinate system of the handset. Specifically, the calibration module 90 can determine the coordinates of the calibration point on the input keyboard drawing of the mobile phone in the positioning coordinate system of the mobile phone, and record them as ( ' 1 ), ( ' 2 ), ( ' 3 ), ( 4 , 4 ), you can list the following four relationships:
Figure imgf000046_0001
XsA cos 6* sin 6* Ax XsA
Figure imgf000046_0001
X sA cos 6* sin 6* Ax X sA
― - sin Θ cos 6*  ― - sin Θ cos 6*
1 0 0 1 1  1 0 0 1 1
此时在以上关系式中(^1 ' 1 )、 (X:2'y:2)、 (Χ:3'Λ3)、 (^,^)、 、At this time, in the above relationship (^1 ' 1 ), ( X : 2'y: 2), ( Χ : 3' Λ 3 ), (^, ^), ,
(^2 , 2)、 (^4 ' 4 )为已知数, 仅 和 (^' )为未知数, 校准模块 (^2, 2), (^4 ' 4 ) are known numbers, only and (^' ) are unknown, calibration module
90可以取以上任意 2个关系式求解 和 ( , )。 90 can take any of the above two relations to solve and ( , ).
一旦 和 ( , )解出则可确定手机的定位坐标系和手机输入键盘图 纸的定位坐标系的变换关系。 校准模块 90确定好手机的定位坐标系和手 机输入键盘图纸的定位坐标系的变换关系之后, 就可以把手机获取到的 手机的输入键盘图纸中每个按键的在手机的定位坐标系上的坐标代入上 述坐标变换关系式中, 得到每个按键在手机的输入键盘图纸的定位坐标 系上的坐标。  Once and ( , ) are solved, the transformation relationship between the positioning coordinate system of the mobile phone and the positioning coordinate system of the input keyboard of the mobile phone can be determined. After the calibration module 90 determines the transformation relationship between the positioning coordinate system of the mobile phone and the positioning coordinate system of the mobile phone input keyboard drawing, the coordinate of each button in the input coordinate system of the mobile phone obtained by the mobile phone on the positioning coordinate system of the mobile phone can be obtained. Substituting into the above coordinate transformation relationship, the coordinates of each button on the positioning coordinate system of the input keyboard drawing of the mobile phone are obtained.
此外, 手机根据当前手机输入键盘图纸上的任意两个校准点完成手 机输入键盘图纸和手机的相对位置的校准之后, 还可根据手机的输入键 盘图纸上的另外两个校准点与手机的相对位置进行校准验证, 判断本次 手机与手机的输入键盘图纸的位置关系的校准是否准确, 是否需要重新 进行校准。 具体地, 手机可根据当前手机输入键盘图纸上的任意两个校 准点完成手机输入键盘图纸与手机的相对位置关系的校准, 并在校准之 后通过第一操作平台 (即手机的输入键盘图纸) 上的敲击信号判断敲击 信号的敲击点位置 (在手机的定位坐标系中的位置) 对应的手机输入键 盘图纸的输入按键(例如字符 "A" 对应的输入按键) 的键值。 此外, 手 机用户还可以通过手机的输入键盘图纸上的另外两个校准点完成手机输 入键盘图纸和手机的相对位置的校准, 并根据这次校准的数据判断手机 用户在第一操作平台 (即手机的输入键盘图纸) 上的敲击信号的敲击点 位置 (在手机的定位坐标系中的位置) 对应的手机输入键盘图纸上的输 入按键的键值是否与前面判断得知的输入按键的键值一致, 即是否为字 符 " A" 对应的输入按键的键值, 以此来判断前面校准的手机与手机的输 入键盘图纸的位置关系是否正确。 In addition, the mobile phone can complete the calibration of the relative position of the phone input keyboard drawing and the mobile phone according to any two calibration points on the current mobile phone input keyboard drawing, and can also be based on the relative position of the other two calibration points on the input keyboard drawing of the mobile phone. Perform calibration verification to determine whether the calibration of the positional relationship between the input keyboard drawing of the mobile phone and the mobile phone is accurate, and whether calibration needs to be performed again. Specifically, the mobile phone can complete the calibration of the relative positional relationship between the mobile phone input keyboard drawing and the mobile phone according to any two calibration points on the current mobile phone input keyboard drawing, and after the calibration, through the first operating platform (ie, the input keyboard drawing of the mobile phone) The tapping signal determines the tapping point position of the tapping signal (the position in the positioning coordinate system of the mobile phone). The corresponding mobile phone inputs the key value of the input key of the keyboard drawing (for example, the input key corresponding to the character "A"). In addition, the mobile phone user can also complete the calibration of the relative position of the mobile phone input keyboard drawing and the mobile phone through two other calibration points on the input keyboard drawing of the mobile phone, and judge the mobile phone user on the first operating platform (ie, the mobile phone according to the data of the calibration). The tapping point of the tapping signal on the input keyboard drawing) Position (position in the positioning coordinate system of the mobile phone) Whether the key value of the input key on the corresponding mobile phone input keyboard drawing is consistent with the key value of the input key judged before, that is, whether it is the input key corresponding to the character "A" The key value is used to determine whether the positional relationship between the previously calibrated mobile phone and the input keyboard drawing of the mobile phone is correct.
手机通过敲击信号判断当前放置状态下的手机输入键盘图纸上的按 键在手机的定位坐标系中的坐标, 并根据上述坐标变换关系式判断得知 手机的输入键盘图纸的定位坐标系中的坐标之后, 则可进一步判断得知 具体的, 手机的第一处理单元 32根据获取模块 1 0获取到的第一操作平 台上的敲击信号判断得知敲击信号在手机的定位坐标系中的坐标之后, 映射模块 60则可根据手机的定位坐标系和手机的输入键盘图纸的定位坐 标系的变换关系确定敲击信号的敲击点位置对应的手机输入键盘图纸上 的定位坐标系的坐标。 映射模块 60根据预先存储的手机的输入键盘图纸 上的输入按键与手机的输入键盘图纸的定位坐标系的坐标的对应关系, 则可判断得知敲击信号在当前放置状态下的手机输入键盘图纸上的操作 位置 (即敲击信号的敲击点位置对应的输入按键) 与手机应用上的输入 键盘按键的键值的对应关系, 以将当前手机输入键盘图纸上的敲击信号 的敲击点位置映射为手机应用上的输入按键的键值。 具体地, 映射模块 60 中的判断单元 61 则可根据敲击信号在手机的输入键盘图纸上的敲击 点的位置, 以及手机的定位坐标系与手机的位置关系, 判断敲击信号在 手机的输入键盘图纸上的敲击点位置。 判断单元 61判断得知敲击信号在 手机的输入键盘图纸上的敲击点位置之后, 映射单元 6 3则可根据内置于 手机的输入法应用中的输入键盘图上的输入按键键值与输入字符的对应 关系, 将手机输入键盘图纸上的敲击信号的敲击点位置映射为手机内置 的输入法应用的字符输入按键的键值。 例如, 可预先在手机中存储手机 输入键盘图纸的定位坐标系中的坐标( 1 , 3 )对应于手机字符输入应用中 的字符 "A" 对应的输入按键的键值, 则当手机获取到第一操作平台 (手 机的输入键盘图纸) 上的敲击信号的敲击点位置在手机的定位坐标系中 的坐标之后, 根据上述手机的定位坐标系和手机的输入键盘图纸的定位 坐标系的变换关系判断得知该敲击信号的敲击点位置在手机的输入键盘 图纸上的坐标为 ( 1 , 3 ) 时, 则可将敲击信号在手机的输入键盘图纸上的 敲击点位置映射为手机的字符输入应用的字符 " A" 的输入按键的键值, 将该敲击信号作为触发信号触发手机应用中相应的响应模块输出字符 "A" 。 再例如, 如图 7 , 若此时第一操作平台为手机用户自定义的输入 图纸 (如弹奏音乐的应用操作图) , 并且手机用户预先存储中手机中的 该输入图纸的定位坐标系的坐标中包括图 7 中 "拇指" 的坐标为 (2 , 1 ) 并设定其对应于音符 " du" 的输入按键的键值, 则若用户敲击拇指对应 的敲击点位置, 手机根据敲击信号判断得知该敲击信号的敲击点在手机 的定位坐标系中的位置之后, 根据上述手机的定位坐标系和手机输入图 纸的定位坐标系的变换关系判断得知该敲击点位置在手机输入图纸上的 位置为 "拇指"对应的按键, 即敲击点在手机输入图纸上坐标对应于 "拇 指" 对应的按键的键值, 则可将该敲击点位置映射为 " du" 对应的按键 的键值, 并可以该敲击信号为触发信号, 触发手机中相应的响应模块根 据该敲击信号的敲击强度输出相应音量大小的音符。 The mobile phone judges the coordinates of the button on the mobile phone input keyboard drawing in the current positioning state by the tapping signal in the positioning coordinate system of the mobile phone, and judges the coordinates in the positioning coordinate system of the input keyboard drawing of the mobile phone according to the above coordinate transformation relationship. After that, it can be further determined that the first processing unit 32 of the mobile phone determines, according to the tapping signal on the first operating platform acquired by the acquiring module 10, the coordinates of the tapping signal in the positioning coordinate system of the mobile phone. Then, the mapping module 60 can determine the coordinates of the positioning coordinate system on the mobile phone input keyboard drawing corresponding to the tapping point position of the tapping signal according to the transformation relationship between the positioning coordinate system of the mobile phone and the positioning coordinate system of the input keyboard drawing of the mobile phone. The mapping module 60 can determine, according to the correspondence between the input button on the input keyboard drawing of the mobile phone and the coordinate of the positioning coordinate system of the input keyboard drawing of the mobile phone, the mobile phone input keyboard drawing of the tapping signal in the current placement state can be determined. The corresponding operation position (ie, the input button corresponding to the tapping point position of the tapping signal) and the key value of the input keyboard button on the mobile phone application, so as to input the current mobile phone into the tapping point of the tapping signal on the keyboard drawing The location maps to the key value of the input button on the mobile app. Specifically, the determining unit 61 in the mapping module 60 can determine the tapping signal on the mobile phone according to the location of the tapping point on the input keyboard drawing of the mobile phone and the positional relationship between the positioning coordinate system of the mobile phone and the mobile phone. Enter the location of the tap point on the keyboard drawing. After the judging unit 61 judges that the tapping signal position on the input keyboard drawing of the mobile phone is known, the mapping unit 63 can input and input the key value and input on the input keyboard map in the input method application of the mobile phone. The correspondence between the characters, the location of the tapping point of the tapping signal on the phone input keyboard drawing is mapped to the key value of the character input button of the input method applied by the mobile phone. For example, you can store your phone in your phone in advance. The coordinates (1, 3) in the positioning coordinate system of the input keyboard drawing correspond to the key value of the input key corresponding to the character "A" in the mobile phone character input application, when the mobile phone obtains the first operating platform (the input keyboard drawing of the mobile phone) After the position of the tapping point of the tapping signal is in the positioning coordinate system of the mobile phone, the tapping signal is determined according to the transformation relationship between the positioning coordinate system of the mobile phone and the positioning coordinate system of the input keyboard drawing of the mobile phone. When the coordinates of the tap point on the input keyboard drawing of the mobile phone are (1, 3), the tapping point of the tapping signal on the input keyboard drawing of the mobile phone can be mapped to the character input application of the mobile phone. The key value of the input button triggers the tapping signal as a trigger signal to trigger the corresponding response module output character "A" in the mobile phone application. For another example, as shown in FIG. 7 , if the first operating platform is a user-defined input drawing (such as an application operation diagram for playing music), and the mobile phone user pre-stores the positioning coordinate system of the input drawing in the mobile phone. In the coordinates, the coordinates of the "thumb" in Fig. 7 are (2, 1) and the key value of the input button corresponding to the note "du" is set. If the user taps the position of the tap point corresponding to the thumb, the mobile phone is knocked according to the After the signal is judged to be the position of the tapping point of the tapping signal in the positioning coordinate system of the mobile phone, the tapping point position is determined according to the transformation relationship between the positioning coordinate system of the mobile phone and the positioning coordinate system of the mobile phone input drawing. The button corresponding to the "thumb" position on the input sheet of the mobile phone, that is, the key point of the button corresponding to the "thumb" corresponding to the "thumb" on the input pattern of the mobile phone, the position of the tap point can be mapped to "du" The key value of the corresponding button, and the tapping signal is a trigger signal, and the corresponding response module in the triggering mobile phone outputs a note of the corresponding volume according to the tapping intensity of the tapping signal.
在一些可行的实施方式中, 本实施例中所描述的手机的第二操作平 台可包括手机的应用程序的输入界面、 手机的输入法的输入软键盘 (即 手机的字符输入软键盘) 等。  In some possible implementation manners, the second operating platform of the mobile phone described in this embodiment may include an input interface of an application of the mobile phone, an input soft keyboard of the input method of the mobile phone (ie, a character input soft keyboard of the mobile phone), and the like.
如图 7 , 当第一操作平台为手机用户自定义的输入图纸, 则也可根据 上述方法进行输入图纸与手机的相对位置的校准, 可将手机用户自定义 的输入图纸与手机内置的对应手机应用的输入软键盘的按键的键值建立 连接, 并根据上述方法判断敲击信号的敲击点位置在手机用户自定义的 输入图纸上的操作位置之后, 则可将敲击信号的敲击点位置映射为手机 的第二操作平台 (即手机内置的对应手机应用的输入软键盘) 的操作位 置 (具体可为输入软键盘的按键的键值) 。 As shown in Figure 7, when the first operating platform is a custom input drawing for the mobile phone user, the relative position of the input drawing and the mobile phone can also be calibrated according to the above method, and the input drawing of the mobile phone user can be customized and the corresponding mobile phone built in the mobile phone. The key value of the button of the input soft keyboard of the application is established. After connecting, and determining the position of the tapping point of the tapping signal on the input drawing of the user's custom input drawing according to the above method, the tapping point position of the tapping signal can be mapped to the second operating platform of the mobile phone (ie The operation position of the input soft keyboard of the corresponding mobile phone application built in the mobile phone (specifically, the key value of the key input to the soft keyboard).
具体实现中, 映射模块 60将第一操作平台上的敲击信号的敲击点位 置映射为手机的第二操作平台的操作位置之后, 生成模块 70则可将该敲 击信号作为手机的第二操作平台的操作位置上的触发信号, 为手机生成 对应于该触发信号的手机输入信号。 当第一操作平台为手机的输入键盘 图纸时(如图 6 ) , 手机判断得知敲击信号在该手机的输入键盘图纸上的 位置并将该敲击信号在手机的输入键盘图上的敲击点位置映射为手机内 置的输入法应用的输入软键盘的按键的键值之后, 手机的生成模块 70则 可调动手机的输入法应用中该敲击信号的敲击点位置映射的输入法应用 的输入软键盘中该按键的键值对应的字符, 将该字符作为手机的输入法 应用的输入字符输出至手机界面的输入框中, 即生成手机的输入信号。 本实施例中所描述的手机生成手机输入信号时, 只要手机的输入键盘图 纸经过校准, 确定位置之后, 手机输入键盘图纸上的所有字符在手机的 定位坐标系中位置对于手机来说则均为已知数, 当手机用户在键盘图纸 上敲击时, 手机则可根据敲击信号的敲击点位置判断得出手机用户敲击 的字符,并将该字符作为手机输入信号的触发信号,生成手机输入信号, 即可完成敲击信号到手机输入信号的转换。  In a specific implementation, after the mapping module 60 maps the location of the tapping point of the tapping signal on the first operating platform to the operating location of the second operating platform of the mobile phone, the generating module 70 may use the tapping signal as the second mobile phone. A trigger signal at an operating position of the operating platform generates a mobile phone input signal corresponding to the trigger signal for the mobile phone. When the first operating platform is the input keyboard drawing of the mobile phone (as shown in FIG. 6 ), the mobile phone determines that the tapping signal is on the input keyboard drawing of the mobile phone and knocks the tapping signal on the input keyboard map of the mobile phone. After the hit point location is mapped to the key value of the input soft keyboard of the mobile phone built-in input method application, the mobile phone generating module 70 can adjust the input method application of the tapping point position mapping of the tapping signal in the input method application of the mobile phone. Enter the character corresponding to the key value of the key in the soft keyboard, and output the character as the input character of the input method of the mobile phone to the input box of the mobile phone interface, that is, generate an input signal of the mobile phone. When the mobile phone input signal is generated by the mobile phone as described in this embodiment, as long as the input keyboard drawing of the mobile phone is calibrated and the position is determined, all the characters on the mobile phone input keyboard drawing are located in the positioning coordinate system of the mobile phone for the mobile phone. Known number, when the mobile phone user taps on the keyboard drawing, the mobile phone can judge the character that the mobile phone user taps according to the tapping point position of the tapping signal, and generate the character as the trigger signal of the mobile phone input signal to generate The input signal of the mobile phone can complete the conversion of the tap signal to the input signal of the mobile phone.
当第一操作平台为手机用户自定义的输入图纸时(如图 7 ) , 手机用 户自定义输入图纸上各个操作位置对应的声音或者输入字符 (例如钢琴 琴键对应的音调及音量) 之后, 当手机判断得知敲击信号在该输入图纸 上的位置并将该敲击信号在输入图纸上的敲击点位置映射为内置于手机 应用中的输入软键盘上的按键的键值之后, 手机则可调动相应的应用中 该敲击信号的敲击点位置映射的输入软键盘中按键的键值对应的音调或 者音量, 并根据该音调或者音量输出相应的音乐。 具体地, 只要手机用 户自定义的输入图纸经过校准, 确定位置之后, 输入图纸上的所有字符 在手机的定位坐标系中位置对于手机来说则均为已知数, 当手机用户在 图纸上敲击时, 手机则可根据敲击信号的敲击点位置判断得出手机用户 敲击的字符, 并将该字符作为手机输入信号的触发信号, 生成手机输入 信号, 播放一段手机用户自行弹奏的音乐, 即可完成敲击信号到手机输 入信号的转换。 When the first operating platform is a custom input drawing for the mobile phone user (as shown in FIG. 7), the mobile phone user customizes the input sound corresponding to each operation position on the drawing or input characters (for example, the pitch and volume corresponding to the piano keys), when the mobile phone Judging that the position of the tap signal on the input sheet is known and mapping the tapping point position of the tap signal on the input sheet to the key value of the button on the input soft keyboard built in the mobile phone application, the mobile phone can Transfer the corresponding application The tap point of the tap signal maps the tone or volume corresponding to the key value of the button in the input soft keyboard, and outputs the corresponding music according to the tone or volume. Specifically, as long as the user-defined input drawing of the mobile phone is calibrated and the position is determined, all the characters on the input drawing in the positioning coordinate system of the mobile phone are known for the mobile phone, when the mobile phone user knocks on the drawing. When hitting, the mobile phone can judge the character that the mobile phone user taps according to the tapping point position of the tapping signal, and use the character as a trigger signal of the mobile phone input signal to generate a mobile phone input signal, and play a mobile phone user to play by himself. Music, you can complete the conversion of the tap signal to the phone's input signal.
本发明实施例可将手机的输入键盘图纸或者手机用户自定义的输入 图纸等操作平台上的敲击信号的敲击点位置映射为手机的输入法应用的 输入软键盘的按键的键值或者手机的其他应用的输入软键盘的按键的键 值等手机上的输入设备上的操作位置上的按键, 并以该敲击信号作为该 操作位置上的触发信号, 用以触发手机的内部应用, 生成与该触发信号 相对应的手机输入信号, 拓展了手机的输入信号的生成途径, 提高了生 成手机输入信号的趣味性, 提高了手机的用户体验效果。  The embodiment of the invention can map the location of the tapping point of the tapping signal on the operating platform such as the input keyboard drawing of the mobile phone or the input drawing of the mobile phone to the key value of the input soft keyboard of the input method of the mobile phone or the mobile phone. For other applications, the key value of the input soft keyboard, such as the key value of the input device on the mobile phone, and the tapping signal as a trigger signal at the operating position, used to trigger the internal application of the mobile phone, generate The input signal of the mobile phone corresponding to the trigger signal expands the generation path of the input signal of the mobile phone, improves the interest of generating the input signal of the mobile phone, and improves the user experience of the mobile phone.
参见图 1 2 , 是本发明实施例提供的终端的第一实施例结构示意图。 本实施例中所描述的终端, 包括:  FIG. 1 is a schematic structural diagram of a first embodiment of a terminal according to an embodiment of the present invention. The terminal described in this embodiment includes:
传感器 1 00 , 用于获取第一操作平台上的敲击信号。  The sensor 1 00 is configured to acquire a tap signal on the first operating platform.
存储器 200可用于存储软件程序以及模块, 处理器 1 1 0通过运行存 储在存储器 200 的软件程序以及模块, 从而执行终端的各种功能应用以 及数据处理。 存储器 200 可主要包括存储程序区和存储数据区, 其中, 存储程序区可存储操作系统、 至少一个功能所需的应用程序 (比如虚拟 钢琴应用、 输入法等) 等; 存储数据区可存储根据终端的使用所创建的 数据 (比如定位数据库等) 等。 此外, 存储器 2 00 可以包括高速随机存 取存储器, 还可以包括非易失性存储器, 例如至少一个磁盘存储器件、 闪存器件、 或其他易失性固态存储器件。 The memory 200 can be used to store software programs and modules, and the processor 110 executes various functional applications and data processing of the terminals by running software programs and modules stored in the memory 200. The memory 200 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function (such as a virtual piano application, an input method, etc.), and the like; the storage data area may be stored according to the terminal. Use the created data (such as positioning the database, etc.) and so on. Furthermore, the memory 200 may comprise a high speed random access memory, and may also comprise a non-volatile memory, such as at least one disk storage device, Flash memory devices, or other volatile solid-state storage devices.
处理器 1 1 0 ,具体用于判断所述敲击信号在所述第一操作平台上的敲 击点位置, 将所述敲击信号在所述第一操作平台上的敲击点位置映射为 所述第二操作平台上的操作位置, 并将所述敲击信号作为所述第二操作 平台上的操作位置上的触发信号, 为终端生成对应于所述触发信号的终 端输入信号。  The processor 1 1 0 is specifically configured to determine a tapping point position of the tapping signal on the first operating platform, and map a tapping point position of the tapping signal on the first operating platform to An operation position on the second operating platform, and using the tapping signal as a trigger signal on an operating position on the second operating platform to generate a terminal input signal corresponding to the trigger signal for the terminal.
本实施例中所描述的第一操作平台, 可包括: 终端本体、 放置终端 的平整物体表面、 终端的输入键盘图纸、 终端用户自定义的输入图纸等 终端的操作平台, 例如, 本实施例中所描述的第一操作平台可以是手机 本身、 放置手机的桌面、 或者手机用户打印出来并与手机一起放置在放 置手机的桌面上的手机的输入键盘图纸 (例如图 6 中所示的键盘图) , 或者手机用户打印出来并与手机一起放置在放置手机的桌面上的手机用 户自定义的输入图纸(例如图 7中所示的辅助图纸)等手机的输入设备。 具体实现中, 上述手机的输入键盘图纸以及手机用户自定义的输入图纸 为一种特制的纸, 纸上包括输入键盘图等信息。  The first operating platform described in this embodiment may include: a terminal body, a flat object surface on which the terminal is placed, an input keyboard drawing of the terminal, an input drawing of the end user-defined input drawing, and the like, for example, in this embodiment The first operating platform described may be the mobile phone itself, the desktop on which the mobile phone is placed, or the input keyboard drawing of the mobile phone printed by the mobile phone user and placed on the desktop of the mobile phone with the mobile phone (for example, the keyboard diagram shown in FIG. 6). , or the input device of the mobile phone, such as a mobile phone user-defined input drawing (such as the auxiliary drawing shown in FIG. 7) printed by the mobile phone user and placed on the desktop of the mobile phone with the mobile phone. In the specific implementation, the input keyboard drawing of the above mobile phone and the input drawing customized by the mobile phone user are a special type of paper, and the paper includes information such as an input keyboard picture.
手机用户在使用本实施例中所描述的终端的对应功能时, 可将手机 的输入键盘图纸或者手机用户 自定义的输入图纸平稳放置在放置手机的 桌面 (即手机所在桌面) 上, 然后在手机的输入键盘图纸或者手机用户 自定义的输入图纸上做敲击动作, 手机则可通过其内置传感器 1 00 获取 手机的输入键盘图纸或者手机用户自定义的输入图纸上的敲击信号, 以 通过处理器 1 1 0根据该敲击信号生成手机的输入信号。 其中, 上述第一 操作平台上的敲击信号, 可包括: 振动机械波、 敲击时间、 敲击强度等。 例如, 手机用户使用手机的输入键盘图纸进行手机字符输入时, 若需要 手机根据敲击信号生成字符输入信号, 则可开启这个手机功能, 即根据 第一操作平台上的敲击信号生成字符输入信号的手机功能。 手机用户启 动上述手机功能之后, 则可在手机的输入键盘图纸上做敲击动作, 手机 通过其传感器 1 00 获取手机的输入键盘图纸上的敲击信号之后, 则可通 过其处理器 1 10根据该敲击信号生成手机输入法的输入信号。 When the mobile phone user uses the corresponding function of the terminal described in this embodiment, the input keyboard drawing of the mobile phone or the input drawing of the mobile phone user can be smoothly placed on the desktop where the mobile phone is placed (ie, the desktop where the mobile phone is located), and then the mobile phone The input keyboard drawing or the user-defined input drawing of the mobile phone can be tapped, and the mobile phone can obtain the input keyboard drawing of the mobile phone or the tapping signal on the input drawing of the mobile phone user through its built-in sensor 100 to process The device 1 10 generates an input signal of the mobile phone according to the tap signal. The tapping signal on the first operating platform may include: a vibration mechanical wave, a tapping time, a tapping intensity, and the like. For example, when the mobile phone user uses the input keyboard drawing of the mobile phone to input the mobile phone character, if the mobile phone is required to generate a character input signal according to the tap signal, the mobile phone function can be turned on, that is, the character input signal is generated according to the tapping signal on the first operating platform. Phone features. Mobile phone user After the above mobile phone function is activated, a tapping action can be performed on the input keyboard drawing of the mobile phone. After the mobile phone obtains the tapping signal on the input keyboard drawing of the mobile phone through its sensor 100, the processor 1 10 can be tapped according to the knocking signal. The hit signal generates an input signal for the mobile phone input method.
具体实现中, 手机通过其内置传感器 100 获取手机的输入键盘图纸 (终端输入设备) 上的敲击信号, 并通过其处理器 1 10 结合该敲击信号 生成手机输入法的输入信号之前, 还需要先确认手机的输入键盘图纸与 手机的相对位置, 即需要确定手机的输入键盘图纸的定位坐标系与手机 的定位坐标系的变换关系。 具体的, 手机用户需要敲击手机的输入键盘 图纸上的校准点对手机的输入键盘图纸和手机的相对位置进行校准。  In a specific implementation, the mobile phone obtains a tapping signal on the input keyboard drawing (terminal input device) of the mobile phone through its built-in sensor 100, and before the processor 1 10 combines the tapping signal to generate an input signal of the mobile phone input method, First confirm the relative position of the input keyboard drawing of the mobile phone and the mobile phone, that is, it is necessary to determine the transformation relationship between the positioning coordinate system of the input keyboard drawing of the mobile phone and the positioning coordinate system of the mobile phone. Specifically, the mobile phone user needs to tap the calibration point on the input keyboard of the mobile phone to calibrate the input keyboard drawing of the mobile phone and the relative position of the mobile phone.
在一些可行的实施方式中, 处理器在判断所述敲击信号在所述第一 操作平台上的敲击点位置时, 具体用于:  In some possible implementations, when determining, by the processor, the location of the tapping point of the tapping signal on the first operating platform, the processor is specifically configured to:
釆集所述终端中各个传感器在所述终端的定位坐标系中的位置坐标; 根据所述敲击信号的振动机械波的传播速度, 以及所述传感器接收 到所述振动机械波的时刻, 结合所述敲击信号的敲击时刻, 计算所述终 端中各个传感器与所述敲击信号的敲击点位置的距离;  Locating a position coordinate of each sensor in the terminal in a positioning coordinate system of the terminal; a propagation speed of the vibration mechanical wave according to the tap signal, and a timing at which the sensor receives the vibration mechanical wave, combined with the Typing a tapping time of the signal, calculating a distance between each sensor in the terminal and a tapping point position of the tapping signal;
根据所述各个传感器在所述终端的定位坐标系中的位置坐标, 结合 所述各个传感器与所述敲击信号的敲击点位置的距离, 得到所述敲击信 号在所述第一操作平台上的敲击点在所述终端的定位坐标系中的位置。  And obtaining, according to the position coordinates of the respective sensors in the positioning coordinate system of the terminal, the distance between the respective sensors and the tapping point position of the tapping signal, obtaining the tapping signal on the first operating platform The position of the tap point on the position in the positioning coordinate system of the terminal.
手机通过其内置传感器 100 获取到第一操作平台上的敲击信号, 则 可通过其处理器 11 0 结合该敲击信号判断该敲击信号在上述第一操作平 台上的敲击点位置。 具体地, 可先以手机上的特定点(例如手机的重心) 为坐标原点设定一个手机的定位坐标系, 在手机显示屏所在的平面或者 手机后盖所在的平面内设定所述手机的定位坐标系,以手机底边方向为 X 轴, 手机侧边方向为 y 轴, 用于确定手机或者放置手机的桌面等操作平 台上面的敲击信号的敲击点位置 (即敲击信号在手机的定位坐标系中的 位置) 。 具体的, 可以手机上的特定点 (例如手机的重心) 为坐标原点 预先设定好定位坐标系的坐标轴, 并根据该定位坐标系确定手机中各个 传感器在上述定位坐标系中的位置, 如图 2。设定好手机的定位坐标系之 后, 手机中各个传感器在手机的定位坐标系中的位置坐标则确定可知。 处理器 110 则可釆集到手机中各个传感器在上述定位坐标系中的位置坐 标。 例如, 处理器 110可釆集到传感器 1、 传感器 2、 传感器 3、 传感器 4在上述定位坐标系中的位置坐标为( xl, yl )、 ( x2, y2 )、 ( x3, y3 )、 ( x4, y4 ) , 其中, 由于手机的内置传感器相对于手机的位置为固定位 置, 则上述各个传感器在定位坐标系中的位置均为确定的位置, 即 xl、 yl、 x2、 y2、 x3、 y3、 x4、 y4 均为已知数。 确定好手机内置传感器 1、 传感器 2、 传感器 3、 传感器 4的位置之后, 当手机用户在 t时刻在第一 操作平台上的敲击点 (X, y ) 敲击一下后, 振动机械波产生并向四周扩 散后, 手机的处理器 110 则可根据各个传感器接收到敲击信号的振动机 械波的时刻 tl (传感器 1接收的振动机械波的时刻 ) 、 t2 (传感器 2接 收的振动机械波的时刻) 、 t3 (传感器 3 接收的振动机械波的时刻) 、 14 (传感器 4 接收的振动机械波的时刻) , 结合敲击信号的敲击时刻 t 以及振动机械波的传播速度 V,可结合手机中各个传感器在上述手机的定 位坐标系中的位置坐标, 根据振动机械波的传播速度乘以时间等于振动 机械波的传感距离 (即敲击点位置与各个传感器的距离) 得到各个传感 器与敲击点位置的距离与敲击信号的振动机械波的传播速度、 传感器接 收到振动机械波的时间点、 敲击信号的敲击时间点的关系等式, 如下 4 元 2次方程组: When the mobile phone obtains the tapping signal on the first operating platform through the built-in sensor 100, the processor 110 can combine the tapping signal to determine the tapping point position of the tapping signal on the first operating platform. Specifically, a positioning coordinate system of a mobile phone may be set with a specific point on the mobile phone (for example, the center of gravity of the mobile phone) as a coordinate origin, and the mobile phone may be set in a plane where the mobile phone display screen is located or a plane where the mobile phone back cover is located. Positioning the coordinate system, the direction of the bottom edge of the mobile phone is the X axis, and the direction of the side of the mobile phone is the y axis, which is used to determine the tapping point position of the tapping signal on the operating platform such as the mobile phone or the desktop on which the mobile phone is placed (ie, the tapping signal is on the mobile phone) In the positioning coordinate system Location). Specifically, a specific point on the mobile phone (for example, the center of gravity of the mobile phone) may be used to preset a coordinate axis of the positioning coordinate system for the coordinate origin, and according to the positioning coordinate system, determine the position of each sensor in the mobile phone in the positioning coordinate system, such as figure 2. After the positioning coordinate system of the mobile phone is set, the position coordinates of each sensor in the mobile phone's positioning coordinate system are determined. The processor 110 can collect the position coordinates of the respective sensors in the mobile phone in the positioning coordinate system. For example, the processor 110 can collect the position coordinates of the sensor 1, the sensor 2, the sensor 3, and the sensor 4 in the positioning coordinate system as (xl, yl), (x2, y2), (x3, y3), (x4). , y4), wherein, since the position of the built-in sensor of the mobile phone relative to the mobile phone is a fixed position, the positions of the above-mentioned respective sensors in the positioning coordinate system are all determined positions, that is, xl, yl, x2, y2, x3, y3, Both x4 and y4 are known numbers. After determining the position of the built-in sensor 1, sensor 2, sensor 3, and sensor 4 of the mobile phone, when the mobile phone user taps on the tapping point (X, y) on the first operating platform at time t, the vibration mechanical wave is generated and directed After being spread around, the processor 110 of the mobile phone can receive the time t1 of the vibration mechanical wave of the tap signal according to each sensor (the time of the vibration mechanical wave received by the sensor 1), t2 (the time of the vibration mechanical wave received by the sensor 2), t3 ( The moment of the vibration mechanical wave received by the sensor 3), 14 (the time of the vibration mechanical wave received by the sensor 4), combined with the tapping time t of the tapping signal and the propagation velocity V of the vibrating mechanical wave, can be combined with the positioning of each sensor in the mobile phone in the above-mentioned mobile phone The position coordinate in the coordinate system is multiplied by the propagation velocity of the vibration mechanical wave by the time equal to the sensing distance of the vibration mechanical wave (ie, the distance between the position of the tapping point and each sensor) to obtain the distance between each sensor and the position of the tapping point and the tapping signal. The propagation speed of the vibrating mechanical wave, the time point at which the sensor receives the vibrating mechanical wave, and the knocking letter The relationship equation of the number of tapping time points is as follows:
-^)2 +( Ί - -y)2 -t)xv y/(x2 -^)2 +(y2 -y)2 = (,2 -t)xv-^) 2 +( Ί - -y) 2 -t)xv y/( x 2 -^) 2 +(y 2 -y) 2 = (,2 -t)xv
Figure imgf000054_0001
Figure imgf000055_0001
Figure imgf000054_0001
Figure imgf000055_0001
由于上述数据中, 只有 v、 t、 x、 y为未知数, 则处理器 1 1 0可根据 上述关系等式则可处理得到 v、 t、 x、 y四个未知数的值。 具体的, 可通 过给 v、 t、 x、 y —个预设值, 并通过迭代计算可处理得到 v、 t、 x、 y 四个未知数的值, 即可确定敲击信号在第一操作平台上的敲击点位置(X , y ) 。  Since v, t, x, and y are unknowns in the above data, the processor 1 10 0 can process the values of the four unknowns of v, t, x, and y according to the above relationship equation. Specifically, by giving v, t, x, y a preset value, and by using an iterative calculation, the values of the four unknowns of v, t, x, and y can be processed to determine the tapping signal on the first operating platform. The position of the tap point (X, y).
具体实现中, 由于振动机械波在特定介质中的传播速度是固定的, 而手机壳体所用的介质是固定可知的 (由于手机壳体制作材质是手机出 厂时已经确定可知的, 则手机壳体所用的介质也为确定可知的) , 则振 动机械波在手机壳体上的传播速度也为固定可知的, 可预先存储于手机 中, 当手机用户在手机上 (即手机壳体上) 做敲击动作时, 敲击所产生 的振动机械波在手机上的传播速度 V 则成为一个已知量。 当敲击点在手 机上(如图 2 )时, 处理器 1 1 0通过 3个传感器则可计算得知敲击信号在 手机上的敲击点在上述定位坐标系中的位置 (X , y ) 。 若有上述 4 个传 感器, 则可根据最小二乘法估算敲击点位置的计算精度, 即在本实施例 中, 上述用于获取敲击信号的传感器至少需要 3个, 最多不限。  In the specific implementation, since the propagation speed of the vibration mechanical wave in the specific medium is fixed, and the medium used for the mobile phone case is fixed and known (because the material of the mobile phone case is determined by the mobile phone, the mobile phone case is used for the mobile phone case) The medium is also known to be identifiable. The propagation speed of the vibrating mechanical wave on the mobile phone casing is also fixed. It can be pre-stored in the mobile phone, and the mobile phone user performs a tapping action on the mobile phone (ie, the mobile phone casing). At this time, the propagation velocity V of the vibrating mechanical wave generated by the tap on the mobile phone becomes a known amount. When the tapping point is on the mobile phone (as shown in FIG. 2), the processor 1 10 can calculate the position of the tapping point of the tapping signal on the mobile phone in the positioning coordinate system by using 3 sensors (X, y). ). If the above four sensors are used, the calculation accuracy of the position of the tapping point can be estimated according to the least squares method. In this embodiment, at least three sensors for acquiring the tapping signal are required, and at least the maximum is not limited.
如图 3 , 若敲击信号在手机外部, 即此时第一操作平台为放置手机的 桌面等平台时, 由于桌面的制作材质可能有多种类型(例如木材、 塑料、 铁皮等) , 使得敲击信号的振动机械波的传播介质变成不固定介质, 手 机无法预先判断得知敲击信号的振动机械波在当前放置手机的桌面上的 传播速度 V , 即此时振动机械波的传播速度 V为未知数。 即当敲击信号的 敲击点位置在放置手机的桌面等平台时, 处理器 1 1 0 则可根据上述手机 的 4个传感器获取得到的数据来确定 v、 t、 x、 y四个未知数的值, 从而 确定敲击信号在第一操作平台上的敲击点位置。 手机的处理器 1 1 0根据 上述传感器获取得到的数据判断得知振动机械波在当前传播介质 (即放 置手机的桌面) 上的传播速度之后, 由于振动机械波的传播速度 V 已确 定可知, 根据 4 个传感器获取到的数据则可初步估算敲击信号在第一操 作平台上的敲击点位置的计算精度。 具体的, 处理器 11 0 可根据上述方 法得到第二次敲击的敲击信号对应的 4元 2次方程, 并可将第一次敲击 中判断得知的振动机械波的传播速度 v(即振动机械波在放置手机的桌面 上的传播速度) 代入上述 4元 2次方程, 再结合其中任意三个方程式处 理得到第二次敲击的敲击信号在第一操作平台上的敲击点位置 1 (假设为 手机坐标系中的坐标 (xl、 yl ) ) 。 此外, 处理器 1 10 还可直接根据上 述 4元 2次方程处理得到第二次敲击的敲击信号在第一操作平台上的敲 击点位置 2 (假设为手机坐标系中的坐标(x2、 y2 ) ) , 并根据前面处理 得到的敲击点位置 1 判断敲击点位置 2 ( x2、 y2 ) 和敲击点位置 1 ( xl、 yl ) 的坐标是否重合或者误差是否在设定的误差范围内, 以此来估算敲 击信号在第一操作平台上的敲击点位置的计算精度。 As shown in Figure 3, if the tapping signal is outside the mobile phone, that is, when the first operating platform is a platform such as a desktop on which the mobile phone is placed, since the material of the desktop may be of various types (such as wood, plastic, iron, etc.), The propagation medium of the vibration mechanical wave of the hitting signal becomes an unfixed medium, and the mobile phone cannot predetermine the propagation velocity V of the vibration mechanical wave of the tapping signal on the desktop currently placed on the mobile phone, that is, the propagation velocity V of the vibration mechanical wave at this time is unknown. That is, when the tapping point of the tapping signal is on the platform such as the desktop on which the mobile phone is placed, the processor 1 10 can determine the four unknowns of v, t, x, and y according to the data obtained by the four sensors of the mobile phone. a value to determine the location of the tapping point of the tapping signal on the first operating platform. The processor 1 10 of the mobile phone judges that the vibration mechanical wave is in the current propagation medium according to the data obtained by the above sensor (ie, After the propagation speed on the desktop of the mobile phone, since the propagation velocity V of the vibration mechanical wave has been determined, the calculation of the position of the tapping point of the tapping signal on the first operating platform can be initially estimated based on the data acquired by the four sensors. Precision. Specifically, the processor 110 can obtain the 4-element second-order equation corresponding to the tapping signal of the second tap according to the above method, and can determine the propagation speed v of the vibrating mechanical wave that is known in the first tap (ie, The propagation speed of the vibrating mechanical wave on the desktop placed on the mobile phone) is substituted into the above-mentioned 4 yuan quadratic equation, and then combined with any three equations to obtain the tapping signal of the second tapping on the first operating platform. (Assume the coordinates (xl, yl) in the phone coordinate system). In addition, the processor 1 10 can also directly obtain the tapping point position 2 of the tapping signal of the second tapping on the first operating platform according to the above 4-ary equation 2 (assuming coordinates in the mobile phone coordinate system (x2) , y2 ) ) , and judge whether the coordinates of the tapping point position 2 ( x2 , y2 ) and the tapping point position 1 ( xl, yl ) coincide or whether the error is in the set error according to the tapping point position 1 obtained by the previous processing. In this context, the calculation accuracy of the tapping point position of the tapping signal on the first operating platform is estimated.
如图 6、 图 7 , 当手机用户在手机的输入键盘图纸上或者手机用户自 定义的输入图纸上做敲击动作, 即第一操作平台上的敲击信号的敲击点 在手机外部的键盘图上, 不在手机上时, 处理器 11 0 则可根据上述确定 图 3上的敲击信号的敲击点位置的方法确定图 6或者图 7 中第一操作平 台 (键盘图或者辅助图纸) 上的敲击点位置, 在此不再赘述。  As shown in Fig. 6 and Fig. 7, when the mobile phone user performs a tapping action on the input keyboard drawing of the mobile phone or the input drawing of the mobile phone user, the tapping point of the tapping signal on the first operating platform is on the keyboard outside the mobile phone. In the figure, when not on the mobile phone, the processor 110 can determine the first operating platform (keyboard map or auxiliary drawing) in FIG. 6 or FIG. 7 according to the above method for determining the tapping point position of the tapping signal on FIG. The location of the tap point is not repeated here.
处理器 110 确定敲击信号在第一操作平台上的敲击点位置之后, 则 可将该敲击点位置映射为手机的第二操作平台上的操作位置。处理器 11 0 在将所述敲击信号在所述第一操作平台上的敲击点位置映射为所述第二 操作平台上的操作位置时, 具体用于:  After the processor 110 determines the tapping point of the tapping signal on the first operating platform, the tapping point location can be mapped to the operating location on the second operating platform of the handset. The processor 11 0 is specifically configured to: when mapping a tapping point of the tapping signal on the first operating platform to an operating position on the second operating platform:
将所述敲击信号在所述第一操作平台上的敲击点在所述终端的定位 坐标系中的位置与所述存储器 200 中存储的定位数据库进行匹配, 判断 所述敲击信号在所述第一操作平台上的敲击点位置对应的所述第二操作 平台上的操作位置, Matching a position of a tapping point of the tapping signal on the first operating platform in a positioning coordinate system of the terminal with a positioning database stored in the memory 200, and determining that the tapping signal is in the The second operation corresponding to the position of the tap point on the first operating platform Operating position on the platform,
将所述敲击信号在所述第一操作平台上的敲击点位置映射为所述第 二操作平台上的操作位置。  Mapping a tapping point position of the tap signal on the first operating platform to an operating position on the second operating platform.
处理器 1 1 0判断得知第一操作平台上的敲击信号的敲击点位置之后, 则可将敲击信号在第一操作平台上的敲击点在手机的定位坐标系中的位 置与存储器 200 中预先存储的定位数据库进行匹配, 通过数据库匹配来 判断敲击信号在第一操作平台上的敲击点位置对应的手机的第二操作平 台上的操作位置, 并将在敲击信号在第一操作平台上的敲击点位置映射 为手机的第二操作平台上的操作位置 (具体可为第二平台上的输入按键 的键值) 。 具体实现中, 可预先以上述手机的定位坐标系为参照系设定 手机一个可感知的敲击区域, 例如, 可预先以手机的定位坐标系的原点 为中心设定一个边长为长 2X、 宽 2Y (其中, X、 Y的具体数值可在设定手 机的定位坐标系的同时设定, 也可通过手机用户 自定义设置) 的方形区 域为手机的可感知区域, 并设定上述可感知区域中每一个敲击位置对应 的手机的第二操作平台上的操作位置 (具体可为第二操作平台上的输入 按键的键值) , 将所有对应关系存储与存储器 2 00 中, 该对应关系即为 手机的定位数据库。 当手机用户将手机放置平稳并确定好手机的第一操 作平台 (例如手机本体或者放置手机的桌面等) 时, 手机的处理器 1 1 0 根据手机的定位坐标系则可确定当前第一操作平台上的可感知区域 (例 如手机本体上的特定区域或者放置手机的桌面上的特定区域) 。 当手机 用户在第一操作平台上的可感知区域范围内做敲击动作时, 手机的处理 器 1 1 0 则可将敲击信号在第一操作平台上的敲击点在定位坐标系中的位 置与存储器 200预先存储的定位数据库进行匹配, 确定当前第一操作平 台上的敲击点位置对应的第二操作平台上的操作位置。 例如, 如图 2 所 示的场景, 当手机用户在手机背面做敲击动作之后, 手机判断手机上的 敲击信号的敲击点位置时, 则可通过手机存储器 200 中存储的定位数据 库进行匹配, 判断当前手机上的敲击信号的敲击点位置对应的手机的钢 琴弹奏游戏上的虚拟琴键上的特定按键的键值, 并将该敲击点位置映射 到该琴键的键值, 进而以该敲击信号为该琴键的键值的触发信号, 为终 端生成对应于该触发信号的钢琴弹奏游戏的输入信号。 例如, 如图 4 所 示当处理器 1 1 0 判断得知敲击信号在手机背面的敲击点位置为手机背面 的左上角上的一个点 (图 4 上所示的敲击点) 时, 则可通过手机的存储 器 200存储的定位数据库匹配得知当前的敲击点位置对应于手机的钢琴 弹奏游戏上的虚拟琴键为琴键盘上左起第三个按键 (即图 4 中映射点对 应的按键) 的键值, 即可将敲击信号在手机背面上的敲击点位置映射为 手机的钢琴弹奏游戏的虚拟琴键上的按键的键值。 同理, 当处理器 1 1 0 判断得知敲击信号的敲击点位置在手机背面的其他位置上时, 也可通过 手机的存储器 2 00 中存储的定位数据库进行匹配, 判断敲击信号的敲击 点位置对应于虚拟琴键上的按键的键值。 判断得知敲击信号的敲击点位 置对应的手机的钢琴弹奏游戏的虚拟键盘的特定琴键的键值之后处理器 1 1 0可以以该敲击信号作为该琴键键值的触发信号,以该敲击信号去触发 手机内置的虚拟钢琴应用, 并通过手机的内置虚拟钢琴的应用程序调用 手机的音乐播放管理器播放对应该敲击信号的音乐。 处理器 1 1 0 可将敲 击信号的敲击点位置映射为手机上的虚拟钢琴应用上的按键的键值, 并 将该敲击信号转换为手机的虚拟钢琴应用上的按键的键值的触发信号, 通过手机的虚拟钢琴应用程序调用音乐播放管理器发出与该特定按键的 音调相对应的音调的声音, 并根据该敲击信号的敲击强度调节与该敲击 强度对应的音量的音乐, 即手机可根据手机用户的敲击位置以及敲击强 度以不同的音量发出不同音调的音乐。 用户可根据自己的敲击动作调节 手机发出的音乐的音调和音量, 更好地调动手机用户通过手机弹奏音乐 的兴趣与激情, 还可以触发手机用户的音乐创作灵感, 提高了的信号输 入的趣味性。 After the processor 1 1 0 determines that the tapping point position of the tapping signal on the first operating platform is known, the position of the tapping point of the tapping signal on the first operating platform in the positioning coordinate system of the mobile phone can be The positioning database pre-stored in the memory 200 is matched, and the operation position on the second operating platform of the mobile phone corresponding to the tapping point position of the tapping signal on the first operating platform is determined by database matching, and the tapping signal is The location of the tap point on the first operating platform is mapped to the operating position on the second operating platform of the mobile phone (specifically, the key value of the input button on the second platform). In a specific implementation, a perceptible tapping area of the mobile phone may be set in advance by using the positioning coordinate system of the mobile phone as a reference system. For example, a side length of the mobile phone positioning coordinate system may be set to be 2× long. Width 2Y (where the specific values of X and Y can be set at the same time as setting the positioning coordinate system of the mobile phone, or can be customized by the user of the mobile phone), the square area of the mobile phone is the perceptible area of the mobile phone, and the above-mentioned perceptible is set. The operation position on the second operating platform of the mobile phone corresponding to each tapping position in the area (specifically, the key value of the input button on the second operating platform), and storing all the corresponding relationships in the memory 200, the corresponding relationship This is the location database of the mobile phone. When the mobile phone user places the mobile phone smoothly and determines the first operating platform of the mobile phone (such as the mobile phone body or the desktop on which the mobile phone is placed), the processor 1 1 0 of the mobile phone can determine the current first operating platform according to the positioning coordinate system of the mobile phone. Perceptible area on the top (such as a specific area on the phone body or a specific area on the desktop where the phone is placed). When the mobile phone user performs a tapping action within the perceptible area of the first operating platform, the processor 1 1 0 of the mobile phone can click the tapping point of the tapping signal on the first operating platform in the positioning coordinate system. The location is matched with the location database pre-stored by the memory 200 to determine an operation location on the second operating platform corresponding to the location of the tap point on the current first operating platform. For example, in the scenario shown in Figure 2, after the mobile phone user makes a tapping action on the back of the mobile phone, the mobile phone determines the mobile phone When the tapping point position of the signal is tapped, the matching database stored in the mobile phone memory 200 can be matched to determine the virtual key on the piano playing game of the mobile phone corresponding to the tapping point position of the tap signal on the current mobile phone. a key value of a specific key, and mapping the location of the tap point to the key value of the key, and then generating a piano signal corresponding to the trigger signal for the terminal by using the trigger signal as a trigger signal of the key value of the key The input signal of the game. For example, as shown in FIG. 4, when the processor 1 10 determines that the tapping point of the tapping signal on the back of the mobile phone is a point on the upper left corner of the back of the mobile phone (the hitting point shown in FIG. 4), Then, the positioning database stored in the memory 200 of the mobile phone can be used to match that the current tap point position corresponds to the virtual key on the piano playing game of the mobile phone, and the third key from the left side of the keyboard (ie, the mapping point in FIG. 4 corresponds to The key value of the button can be used to map the tapping point of the tapping signal on the back of the phone to the key of the button on the virtual keyboard of the phone's piano playing game. Similarly, when the processor 1 1 0 determines that the tapping point position of the tapping signal is at other positions on the back of the mobile phone, it can also be matched by the positioning database stored in the memory 200 of the mobile phone to determine the tapping signal. The tap point position corresponds to the key value of the key on the virtual key. After determining that the key value of the specific key of the virtual keyboard of the piano playing game of the mobile phone corresponding to the tapping point position of the tapping signal is known, the processor 1 10 can use the tapping signal as the trigger signal of the key key value to The tapping signal triggers the virtual piano application built into the mobile phone, and the music playing manager of the mobile phone is called by the mobile phone's built-in virtual piano application to play the music corresponding to the tapping signal. The processor 1 10 0 can map the tapping point position of the tapping signal to the key value of the button on the virtual piano application on the mobile phone, and convert the tapping signal into the key value of the button on the virtual piano application of the mobile phone. a trigger signal, which is called by the virtual piano application of the mobile phone to call a sound of the tone corresponding to the tone of the specific button, and adjusts the music of the volume corresponding to the tapping intensity according to the tapping intensity of the tapping signal That is, the mobile phone can emit music of different pitches at different volume according to the tapping position of the mobile phone user and the tapping intensity. The user can adjust the pitch and volume of the music emitted by the mobile phone according to his own tapping action, and better mobilize the mobile phone user to play music through the mobile phone. The interest and passion can also trigger the inspiration of the music creation of mobile phone users, and improve the fun of signal input.
此外, 当第一操作平台为手机的输入法的输入键盘图或者手机用户 自定义的输入图纸时, 即敲击信号的敲击位置在手机的输入键盘图纸上 或者手机用户自定义的输入图纸上, 则在一些可行的实施方式中, 处理 器在判断所述敲击信号在所述第一操作平台上的敲击点位置时, 还具体 用于:  In addition, when the first operating platform is an input keyboard map of the input method of the mobile phone or a user-defined input drawing of the mobile phone, the tapping position of the tapping signal is on the input keyboard drawing of the mobile phone or the input drawing of the mobile phone user customization. In some feasible implementation manners, when determining, by the processor, the location of the tapping point of the tapping signal on the first operating platform, the processor is further configured to:
获取终端输入设备上的校准点的敲击信号, 并判断所述终端输入设 备上的校准点在所述终端的定位坐标系中的位置;  Obtaining a tap signal of the calibration point on the terminal input device, and determining a position of the calibration point on the terminal input device in the positioning coordinate system of the terminal;
根据所述校准点在所述终端的定位坐标系中的位置, 以及所述校准 点在所述终端输入设备上的位置, 确定所述终端输入设备与所述终端的 相对位置。  And determining a relative position of the terminal input device and the terminal according to a position of the calibration point in a positioning coordinate system of the terminal and a position of the calibration point on the terminal input device.
此时, 由于手机的输入键盘图纸或者手机用户自定义的输入图纸可 有手机用户随意放置, 即此时的手机输入键盘图纸或者手机用户自定义 的输入图纸与手机的相对位置是不确定的, 则需首先对手机的输入键盘 图纸或者手机用户自定义的输入图纸进行校准, 判断当前的第一操作平 台和手机的相对位置。 当手机用户需要对手机的输入键盘图纸与手机的 相对位置进行校准时, 则可敲击手机的输入键盘图纸上的各个校准点。 手机通过其内置传感器获取到手机的输入键盘图纸上的校准点上的敲击 信号之后, 则可根据上述判断敲击信号在第一操作平台上的敲击点位置 的方法判断得知各个校准点在手机的定位坐标系中的位置, 还可通过各 个校准点在手机的输入键盘图纸上的位置 (即各个校准点在输入键盘图 纸的定位坐标系中的位置) 进一步判断手机的输入键盘图纸与手机的相 对位置。  At this time, because the input keyboard drawing of the mobile phone or the input drawing of the mobile phone user can be randomly placed by the mobile phone user, that is, the relative position of the mobile phone input keyboard drawing or the user-defined input drawing of the mobile phone and the mobile phone is uncertain. Then, it is necessary to first calibrate the input keyboard drawing of the mobile phone or the input drawing of the mobile phone user to determine the relative position of the current first operating platform and the mobile phone. When the mobile phone user needs to calibrate the relative position of the input keyboard drawing of the mobile phone and the mobile phone, the calibration points on the input keyboard drawing of the mobile phone can be tapped. After the mobile phone obtains the tapping signal on the calibration point on the input keyboard drawing of the mobile phone through the built-in sensor, it can judge the respective calibration points according to the method of judging the tapping point position of the tapping signal on the first operating platform. The position in the positioning coordinate system of the mobile phone can further determine the input keyboard drawing of the mobile phone by the position of each calibration point on the input keyboard drawing of the mobile phone (ie, the position of each calibration point in the positioning coordinate system of the input keyboard drawing) The relative position of the phone.
具体实现中, 手机的输入键盘图上的各个字符以及校准点在键盘图 上的位置是固定的, 可以预先将手机的输入键盘图纸上各个字符以及校 准点在手机的输入键盘图纸的定位坐标系中的坐标预置在手机应用中, 即可预先将手机输入键盘图纸上的各个字符以及校准点对应的坐标 (在 手机的输入键盘图纸的定位坐标系中的坐标) 与手机应用的字符输入的 按键的键值先建立连接, 并将手机输入键盘图纸上的操作位置 (即各个 字符和校准点对应的坐标) 映射为手机应用上的字符输入按键的键值。 当手机与手机的输入键盘图在放置手机的桌面或者地面等辅助介质上任 意摆放之后, 手机和手机的输入键盘图的相对位置则为不确定因素, 手 机用户在使用手机的输入键盘图纸作为手机的输入设备之前, 需要先确 定手机与当前放置状态下的手机的输入键盘图的相对位置, 即需要确定 手机的定位坐标系上的坐标和手机的输入键盘图纸的定位坐标系的坐标 的变换关系。 In the specific implementation, each character on the input keyboard map of the mobile phone and the calibration point are in the keyboard diagram. The upper position is fixed. The characters on the input keyboard drawing of the mobile phone and the coordinates of the calibration point in the positioning coordinate system of the input keyboard drawing of the mobile phone can be preset in the mobile phone application, and the mobile phone can be input into the keyboard drawing in advance. Each character and the coordinates corresponding to the calibration point (coordinates in the positioning coordinate system of the input keyboard drawing of the mobile phone) are first connected with the key value of the key input of the mobile application, and the mobile phone is input into the operation position on the keyboard drawing ( That is, the coordinates of each character and calibration point are mapped to the key value of the character input button on the mobile phone application. When the input keyboard map of the mobile phone and the mobile phone is placed on the auxiliary medium such as the desktop or the ground on which the mobile phone is placed, the relative position of the input keyboard map of the mobile phone and the mobile phone is an uncertain factor, and the mobile phone user uses the input keyboard drawing of the mobile phone as the Before the input device of the mobile phone, it is necessary to determine the relative position of the input keyboard map of the mobile phone and the mobile phone in the currently placed state, that is, the coordinate of the positioning coordinate system of the mobile phone and the coordinate of the positioning coordinate system of the input keyboard drawing of the mobile phone need to be determined. relationship.
具体实现中, 如图 6 , 手机用户在确定手机与当前放置状态下的手机 的输入键盘图纸之间的相对位置关系 (也为手机的定位坐标系上的坐标 和手机的输入键盘图纸的定位坐标系上的坐标的变换关系) 时, 可点击 手机上的校准按键, 启动手机的校准功能。 手机的处理器 11 0 在校准手 机和手机输入键盘图纸的相对位置关系时, 可先将手机的定位坐标系的 坐标记为(x, , 手机的输入键盘图的定位坐标系的坐标记为(X' J ) , 手机 的定位坐标系与输入键盘图的坐标系间的夹角记为^可以将手机的定位 坐标系中 X 轴与输入键盘图的坐标系的 X 轴的夹角记为 位移记为 (Δτ, y),位移为输入键盘图的坐标系的原点在手机的定位坐标系中的坐标, 则有以下坐标变换关系: In a specific implementation, as shown in FIG. 6, the mobile phone user determines the relative positional relationship between the mobile phone and the input keyboard drawing of the mobile phone in the currently placed state (also the coordinates on the positioning coordinate system of the mobile phone and the positioning coordinates of the input keyboard drawing of the mobile phone). When the coordinates of the system are changed, you can click the calibration button on the phone to activate the calibration function of the phone. The processor 11 0 of the mobile phone can first mark the sitting position of the positioning coordinate system of the mobile phone as ( x , , the positioning coordinate of the positioning coordinate system of the input keyboard diagram of the mobile phone when calibrating the relative positional relationship between the mobile phone and the mobile phone input keyboard drawing ( X ' J ) , the angle between the positioning coordinate system of the mobile phone and the coordinate system of the input keyboard map is recorded as ^ The angle between the X axis of the positioning coordinate system of the mobile phone and the X axis of the coordinate system of the input keyboard image is recorded as a displacement Recorded as (Δτ, y), the displacement is the coordinate of the origin of the coordinate system of the input keyboard diagram in the positioning coordinate system of the mobile phone, and the following coordinate transformation relationship is as follows:
X cos 6* sin 6* Ax X X cos 6* sin 6* Ax X
y ― - sin 6* cos 6* y  y ― - sin 6* cos 6* y
1 0 0 1 2¾ 将手机的输入键盘图纸上的各校准点 (校准点 1、 校准点 2、 校准点 3、 校准点 4 ) 在输入键盘图的定位坐标系中的坐标分别记为 i'^i)、 ( 22)、 ( ,Λ3)、 ( 44)。 手机用户敲击手机的输入键盘图纸上的各校 准点之后, 传感器 100 则可先获取手机的输入键盘图纸上的校准点上的 敲击信号, 并将获取的敲击信号发送给处理器 110, 以通过处理器 110 判断手机的输入键盘图纸上的校准点在手机的定位坐标系中的坐标, 分 别记为( ' 1)、 (X '^2)、 ( ' 3)、 (^4,^4) , 则可以列出以下 4个关系式: 1 0 0 1 23⁄4 Record the coordinates of each calibration point (calibration point 1, calibration point 2, calibration point 3, calibration point 4) on the input keyboard drawing of the mobile phone in the positioning coordinate system of the input keyboard diagram as i'^i), ( 2 , Λ 2 ), ( , Λ 3 ), ( 4 , Λ 4 ). After the mobile phone user taps each calibration point on the input keyboard drawing of the mobile phone, the sensor 100 may first obtain a tapping signal on the calibration point on the input keyboard drawing of the mobile phone, and send the obtained tapping signal to the processor 110. The coordinates of the calibration point on the input keyboard drawing of the mobile phone in the mobile phone's positioning coordinate system are judged by the processor 110 as ( ' 1 ), ( X '^2), ( ' 3 ), (^4, ^ 4), you can list the following 4 relationships:
Figure imgf000061_0002
Figure imgf000061_0001
Figure imgf000061_0002
Figure imgf000061_0001
此时在以上关系式中(^1' 1)、 (X:2'y:2)、 (Χ:3'Λ3)、 、 (^2, 2)、 ( , 3)、 (Χ4)为已知数, 仅 0和 (^' )为未知数, 因此可以 取以上任意 2个关系式求解 和 ( , )。 一旦 和 ( , Δ 解出, 处理器 1 1 0 就可以把手机获取到的手机的输 入键盘图纸中每个按键的在手机的定位坐标系上的坐标代入上述坐标变 换关系式中, 得到每个按键在手机的输入键盘图纸的定位坐标系上的坐 标。 手机的处理器 1 1 0 通过敲击信号判断当前放置状态下的手机输入键 盘图纸上的按键在手机的定位坐标系中的坐标, 并根据上述坐标变换关 系式判断得知手机的输入键盘图纸的定位坐标系中的坐标之后, 则可进 一步得知手机的输入键盘图纸的定位坐标系中的坐标对应的按键的键值。 具体的, 处理器 1 1 0根据传感器 1 00获取到的第一操作平台上的敲击信 号判断得知敲击信号在手机的定位坐标系中的坐标之后, 则可根据手机 的定位坐标系和手机的输入键盘图纸的定位坐标系的变换关系确定敲击 信号的敲击点位置对应的手机输入键盘图纸的定位坐标系的坐标。 处理 器 1 1 0根据存储器 2 00预先存储的手机的输入键盘图纸上的输入按键与 手机的输入键盘图纸的定位坐标系的坐标的对应关系, 则可判断得知敲 击信号在当前放置状态下的手机输入键盘图纸上的操作位置 (即敲击信 号的敲击点位置对应的输入按键) 与手机应用上的输入按键的键值的对 应关系, 以将当前手机输入键盘图纸上的敲击信号的敲击点位置映射为 手机应用上的输入按键的键值。 例如, 可预先在手机中存储手机输入键 盘图纸的定位坐标系中的坐标( 1 , 3 )对应于手机字符输入应用中的字符 "A"对应的按键的键值,则当手机的处理器 1 1 0获取到第一操作平台(手 机的输入键盘图纸) 上的敲击信号的敲击点位置在手机的定位坐标系中 的坐标之后, 根据上述手机的定位坐标系和手机的输入键盘图纸的定位 坐标系的变换关系判断得知该敲击信号的敲击点位置在手机的输入键盘 图纸上的坐标为 ( 1 , 3 ) 时, 则可将敲击信号在手机的输入键盘图纸上的 敲击点位置映射为手机的字符输入应用的字符 " A" 的输入按键的键值, 进而将该敲击信号作为触发信号触发手机应用中相应的响应模块输出字 符 "A" 。 再例如, 如图 7 , 若此时第一操作平台为手机用户自定义的输 入图纸 (如弹奏音乐的应用操作图) , 并且手机用户预先存储中手机中 的该输入图纸的定位坐标系的坐标中包括图 7中 "拇指"的坐标为( 2, 1 ) 并设定其对应的音符为 " du" , 即该坐标 ( 2, 1 ) 对应于音符 " du" 的 输入按键的键值, 则若用户敲击拇指对应的敲击点位置, 手机的处理器 110 根据敲击信号判断得知该敲击信号的敲击点在手机的定位坐标系中 的位置之后, 根据上述手机的定位坐标系和手机输入图纸的定位坐标系 的变换关系判断得知该敲击点位置在手机输入图纸上的位置为 "拇指" 对应的按键, 即敲击点在手机输入图纸上坐标对应于 "拇指" 对应的按 键的键值, 进而可将该敲击点位置映射为 " du" 对应的按键的键值, 并 可以该敲击信号为触发信号, 触发手机中相应的响应模块根据该敲击信 号的敲击强度输出相应音量大小的音符。 At this time, in the above relationship (^1' 1), ( X : 2'y: 2), ( Χ : 3 ' Λ 3 ), , (^2, 2), ( , 3), ( Χ4 ) For known numbers, only 0 and (^') are unknowns, so any two of the above relations can be solved and ( , ). Once and ( , Δ is solved, the processor 1 1 0 can substitute the coordinates of each button in the input coordinate system of the mobile phone obtained by the mobile phone into the coordinate transformation relationship of the mobile phone, and obtain each The coordinates of the button on the positioning coordinate system of the input keyboard drawing of the mobile phone. The processor 1 1 0 of the mobile phone determines the coordinates of the button on the mobile phone input keyboard drawing in the current positioning state by the tapping signal in the positioning coordinate system of the mobile phone, and After determining the coordinates in the positioning coordinate system of the input keyboard drawing of the mobile phone according to the coordinate transformation relationship, the key value of the key corresponding to the coordinate in the positioning coordinate system of the input keyboard drawing of the mobile phone can be further known. The processor 1 10 determines, according to the tapping signal on the first operating platform acquired by the sensor 100, that the tapping signal is in the positioning coordinate system of the mobile phone, and then according to the positioning coordinate system of the mobile phone and the input of the mobile phone. The transformation relationship of the positioning coordinate system of the keyboard drawing determines the positioning position of the mobile phone input keyboard drawing corresponding to the tapping point position of the tapping signal The coordinates of the system. According to the correspondence between the input button on the input keyboard drawing of the mobile phone pre-stored in the memory 200 and the coordinates of the positioning coordinate system of the input keyboard drawing of the mobile phone, it can be judged that the tapping signal is The operation position on the phone input keyboard drawing in the current placement state (ie, the input button corresponding to the tapping point position of the tap signal) and the key value of the input button on the mobile phone application, to input the current mobile phone into the keyboard drawing The tapping point position of the tapping signal is mapped to the key value of the input button on the mobile phone application. For example, the coordinates (1, 3) in the positioning coordinate system of the mobile phone input keyboard drawing can be stored in the mobile phone in advance corresponding to the mobile phone character input. The key value of the button corresponding to the character "A" in the application, when the processor 1 1 0 of the mobile phone acquires the tapping point position of the tapping signal on the first operating platform (the input keyboard drawing of the mobile phone) is located in the mobile phone After the coordinates in the coordinate system, it is determined according to the transformation relationship between the positioning coordinate system of the mobile phone and the positioning coordinate system of the input keyboard drawing of the mobile phone. When the position of the hitting point of the hit signal is (1, 3) on the input keyboard drawing of the mobile phone, the tapping point position of the tapping signal on the input keyboard drawing of the mobile phone can be mapped to the character input application of the mobile phone. The key value of the input button of the character "A", and then the tapping signal is used as a trigger signal to trigger the corresponding response module output word in the mobile phone application Character "A". For another example, as shown in FIG. 7 , if the first operating platform is a user-defined input drawing (such as an application operation diagram for playing music), and the mobile phone user pre-stores the positioning coordinate system of the input drawing in the mobile phone. The coordinates including the "thumb" in Fig. 7 are (2, 1) and the corresponding note is set to "du", that is, the coordinate (2, 1) corresponds to the key value of the input button of the note "du". Then, if the user taps the position of the tap point corresponding to the thumb, the processor 110 of the mobile phone determines, according to the tapping signal, the position of the tapping point of the tapping signal in the positioning coordinate system of the mobile phone, according to the positioning coordinates of the mobile phone. The transformation relationship between the positioning coordinate system of the drawing and the mobile phone input drawing determines that the position of the tapping point on the input sheet of the mobile phone is a button corresponding to the "thumb", that is, the coordinates of the tapping point on the input sheet of the mobile phone correspond to the "thumb" The key value of the corresponding button, thereby mapping the location of the tap point to the key value of the button corresponding to "du", and the tapping signal is a trigger signal, triggering the corresponding response module in the mobile phone according to the tapping signal Percussion intensity of the output volume of the corresponding note.
此外, 处理器 11 0根据当前手机输入键盘图纸上的任意两个校准点 完成手机输入键盘图纸和手机的相对位置的校准之后, 还可根据手机的 输入键盘图纸上的另外两个校准点与手机的相对位置进行校准验证, 判 断本次手机与手机的输入键盘图纸的位置关系的校准是否准确, 是否需 要重新进行校准。 具体地, 手机的处理器 110 可根据当前手机输入键盘 图纸上的任意两个校准点完成手机输入键盘图纸与手机的相对位置关系 的校准, 并在校准之后通过第一操作平台 (即手机的输入键盘图纸) 上 的敲击信号判断敲击信号的敲击点位置(在手机的定位坐标系中的位置) 对应的手机输入键盘图纸的输入按键 (例如字符 "A" 对应的输入按键) 的键值。 此外, 处理器 1 10 还可以通过手机的输入键盘图纸上的另外两 个校准点完成手机输入键盘图纸和手机的相对位置的校准, 并根据这次 校准的数据判断手机用户在第一操作平台 (即手机的输入键盘图纸) 上 的敲击信号的敲击点位置 (在手机的定位坐标系中的位置) 对应的手机 输入键盘图纸上的输入按键的键值是否与前面判断得知的输入按键的键 值一致, 即是否为字符 "A" 对应的输入按键的键值, 以此来判断前面校 准的手机与手机的输入键盘图纸的位置关系是否正确。 In addition, the processor 11 0 can complete the calibration of the relative position of the mobile phone input keyboard drawing and the mobile phone according to any two calibration points on the current mobile phone input keyboard drawing, and can also be based on the other two calibration points on the input keyboard drawing of the mobile phone and the mobile phone. The relative position is verified by calibration, and it is judged whether the calibration of the positional relationship of the input keyboard drawing of the mobile phone and the mobile phone is accurate, and whether calibration needs to be re-calibrated. Specifically, the processor 110 of the mobile phone can complete the calibration of the relative positional relationship between the input keyboard drawing of the mobile phone and the mobile phone according to any two calibration points on the current mobile phone input keyboard drawing, and pass the first operating platform (ie, the input of the mobile phone after calibration). The tapping signal on the keyboard drawing determines the tapping point position of the tapping signal (the position in the positioning coordinate system of the mobile phone). The corresponding input key of the input key of the mobile phone drawing (for example, the input key corresponding to the character "A") value. In addition, the processor 1 10 can also complete the calibration of the relative position of the mobile phone input keyboard drawing and the mobile phone through two other calibration points on the input keyboard drawing of the mobile phone, and judge the mobile phone user on the first operating platform according to the data of the calibration ( That is, the tapping point position of the tapping signal on the input keyboard drawing of the mobile phone (the position in the positioning coordinate system of the mobile phone) Whether the key value of the input key on the input keyboard drawing is consistent with the key value of the input key previously determined, that is, whether it is the key value of the input key corresponding to the character "A", thereby judging the previously calibrated mobile phone and the mobile phone Enter the correct positional relationship of the keyboard drawing.
手机与手机的输入键盘图纸的位置校准准确之后, 处理器 110 则可 结合预置在手机的输入法应用中的输入键盘图上的操作位置与手机的第 二操作平台的操作位置的对应关系, 判断手机的输入键盘图纸与手机的 第二操作平台的操作位置的对应关系。  After the position calibration of the input keyboard drawing of the mobile phone and the mobile phone is accurate, the processor 110 can combine the operation position of the input keyboard map preset in the input method application of the mobile phone with the operation position of the second operating platform of the mobile phone. The correspondence between the input keyboard drawing of the mobile phone and the operating position of the second operating platform of the mobile phone is determined.
在一些可行的实施方式中, 处理器 1 10在将所述敲击信号在所述第 一操作平台上的敲击点位置映射为所述第二操作平台上的操作位置时, 还具体用于;  In some possible implementations, when the processor 110 maps a tapping point position of the tapping signal on the first operating platform to an operating position on the second operating platform, the processor 110 is further specifically used for ;
根据在所述第一操作平台上的敲击信号的敲击点在所述终端的定位 坐标系中的位置, 以及所述终端输入设备与所述终端的相对位置, 得到 所述敲击信号在所述终端输入设备上的操作位置;  Obtaining the tapping signal according to a position of a tapping point of a tapping signal on the first operating platform in a positioning coordinate system of the terminal, and a relative position of the terminal input device and the terminal The terminal inputs an operation location on the device;
根据预设的所述终端输入设备上的操作位置与所述第二操作平台上 的操作位置的对应关系, 将所述终端输入设备上的敲击信号的敲击点位 置映射为所述第二操作平台的操作位置。  Mapping a tap point position of a tap signal on the terminal input device to the second according to a preset correspondence between an operation position on the terminal input device and an operation position on the second operation platform The operating position of the operating platform.
具体实现中, 当手机用户将手机的输入键盘图纸放置手机所在桌面, 并完成输入键盘图纸和手机的相对位置的校准之后, 则可在输入键盘图 纸上做敲击动作, 敲击信号将通过桌面传播至手机的内置传感器。 手机 的内置传感器获取到敲击信号之后, 处理器 11 0 则可根据敲击信号确定 敲击信号的敲击点在手机的定位坐标系中的位置, 还可根据当前手机的 输入键盘图纸与手机的相对位置关系判断敲击信号在第一操作平台上的 敲击点位置对应的当前手机的输入键盘图纸的操作位置。 。 处理器 1 10 确定手机的输入键盘图纸与手机的相对位置之后, 则可进一步判断得知 敲击信号在第一操作平台上的敲击点位置对应的手机输入键盘图纸的操 作位置还可进一步判断得知敲击信号在手机的输入键盘图纸上的敲击点 位置对应的手机输入键盘图纸上的操作位置 (即可判断敲击点对应的位 置上的字符) , 进而将手机输入键盘图纸上的输入字符对应上内置于手 机的输入法应用中的输入键盘图上的输入字符, 以将手机输入键盘图纸 上的敲击信号的敲击点位置映射为手机内置的输入法应用的字符输入的 操作位置。 本实施例中所描述的手机的第二操作平台包括手机上的接入 设备 (即区别于第一操作平台的输入设备) 、 手机的应用程序的输入界 面、 手机的输入法的输入软键盘 (即手机的字符输入软键盘) 等手机上 的输入端。 In the specific implementation, when the mobile phone user places the input keyboard drawing of the mobile phone on the desktop of the mobile phone and completes the calibration of the input keyboard drawing and the relative position of the mobile phone, the tapping action can be performed on the input keyboard drawing, and the tapping signal will pass through the desktop. Spread to the built-in sensor of the phone. After the built-in sensor of the mobile phone obtains the tapping signal, the processor 110 can determine the position of the tapping point of the tapping signal in the positioning coordinate system of the mobile phone according to the tapping signal, and can also input the keyboard drawing and the mobile phone according to the current mobile phone. The relative positional relationship determines the operating position of the input keyboard drawing of the current mobile phone corresponding to the tapping point position of the tapping signal on the first operating platform. . After the processor 1 10 determines the relative position of the input keyboard drawing of the mobile phone and the mobile phone, it can further determine that the operation of the mobile phone input keyboard drawing corresponding to the tapping point position of the tapping signal on the first operating platform The position can further determine that the tapping signal is on the operation position of the phone input keyboard drawing corresponding to the tapping point position on the input keyboard drawing of the mobile phone (ie, the character at the position corresponding to the tapping point can be judged), and then The input characters on the phone input keyboard drawing correspond to the input characters on the input keyboard map built in the input method application of the mobile phone, so as to map the tapping point position of the tapping signal on the mobile phone input keyboard drawing to the input method built into the mobile phone. The operating position of the applied character input. The second operating platform of the mobile phone described in this embodiment includes an access device on the mobile phone (ie, an input device different from the first operating platform), an input interface of the application of the mobile phone, and an input soft keyboard of the input method of the mobile phone ( That is, the phone's character input soft keyboard) and other inputs on the phone.
如图 7 , 当第一操作平台为手机用户自定义的输入图纸, 则也可根据 上述方法进行输入图纸与手机的相对位置的校准, 可将手机用户自定义 的输入图纸与手机内置的对应手机应用的输入软键盘的按键的键值建立 连接, 并根据上述方法判断敲击信号的敲击点位置在手机用户自定义的 输入图纸上的操作位置之后, 则可将敲击信号的敲击点位置映射为手机 的第二操作平台 (即手机内置的对应手机应用的输入软键盘) 的操作位 置 (具体可为输入软键盘的按键的键值) 。  As shown in Figure 7, when the first operating platform is a custom input drawing for the mobile phone user, the relative position of the input drawing and the mobile phone can also be calibrated according to the above method, and the input drawing of the mobile phone user can be customized and the corresponding mobile phone built in the mobile phone. The key value of the input soft keyboard of the application is used to establish a connection, and according to the above method, after the tapping point position of the tapping signal is determined on the operation position of the input drawing of the mobile phone user, the tapping point of the tapping signal can be The location is mapped to the operating position of the second operating platform of the mobile phone (ie, the input soft keyboard of the corresponding mobile phone application built in the mobile phone) (specifically, the key value of the key input to the soft keyboard).
具体实现中, 处理器 110 将第一操作平台上的敲击信号的敲击点位 置映射为手机的第二操作平台的操作位置之后, 则可将该敲击信号作为 手机的第二操作平台的操作位置上的触发信号, 为手机生成对应于该触 发信号的手机输入信号。 处理器 1 10 在将所述敲击信号作为所述第二操 作平台上的操作位置上的触发信号, 为终端生成对应于所述触发信号的 终端输入信号时, 具体用于:  In a specific implementation, after the processor 110 maps the location of the tapping point of the tapping signal on the first operating platform to the operating location of the second operating platform of the mobile phone, the tapping signal may be used as the second operating platform of the mobile phone. The trigger signal at the operating position generates a mobile phone input signal corresponding to the trigger signal for the mobile phone. The processor 1 10 is configured to: when the tapping signal is used as a trigger signal on an operation position on the second operating platform, to generate a terminal input signal corresponding to the trigger signal for the terminal, specifically:
将所述敲击信号作为所述第二操作平台上的操作位置上的触发信号, 并根据所述敲击信号的敲击强度, 生成与所述敲击信号的敲击强度相对 应的信号强度的终端输入信号。 具体地, 当第一操作平台为手机的输入键盘图纸时(如图 6 ) , 处理 器 11 0 判断得知敲击信号在该手机的输入键盘图纸上的位置并将该敲击 信号在手机的输入键盘图上的敲击点位置映射为手机内置的输入法应用 的输入软键盘的按键的键值之后, 则可调动手机的输入法应用中该敲击 信号的敲击点位置映射的输入法应用的输入软键盘中该按键的键值对应 的字符, 将该字符作为手机的输入法应用的输入字符输出至手机界面的 输入框中, 即生成手机的输入信号。 本实施例中所描述的手机生成手机 输入信号时, 只要手机的输入键盘图纸经过校准, 确定位置之后, 手机 输入键盘图纸上的所有字符在手机的定位坐标系中位置对于手机来说则 均为已知数, 当手机用户在键盘图纸上敲击时, 手机则可根据敲击信号 的敲击点位置判断得出手机用户敲击的字符, 并将该字符作为手机输入 信号的触发信号, 生成手机输入信号, 即可完成敲击信号到手机输入信 号的转换。 Using the tapping signal as a trigger signal on an operation position on the second operating platform, and generating a signal strength corresponding to the tapping strength of the tapping signal according to the tapping intensity of the tapping signal Terminal input signal. Specifically, when the first operating platform is an input keyboard drawing of the mobile phone (as shown in FIG. 6 ), the processor 11 0 determines that the location of the tapping signal on the input keyboard drawing of the mobile phone and the tapping signal is on the mobile phone. After inputting the position of the tapping point on the keyboard map to the key value of the key of the input soft keyboard of the input method applied by the mobile phone, the input method of the tapping point position mapping of the tapping signal in the input method of the mobile phone is applied. The character corresponding to the key value of the button in the input soft keyboard of the application, and the input character used as the input method of the mobile phone is output to the input box of the mobile phone interface, that is, the input signal of the mobile phone is generated. When the mobile phone input signal is generated by the mobile phone as described in this embodiment, as long as the input keyboard drawing of the mobile phone is calibrated and the position is determined, all the characters on the mobile phone input keyboard drawing are located in the positioning coordinate system of the mobile phone for the mobile phone. Known number, when the mobile phone user taps on the keyboard drawing, the mobile phone can judge the character that the mobile phone user taps according to the tapping point position of the tapping signal, and generate the character as the trigger signal of the mobile phone input signal, and generate The input signal of the mobile phone can complete the conversion of the tap signal to the input signal of the mobile phone.
当第一操作平台为手机用户自定义的输入图纸时(如图 7 ) , 手机用 户自定义输入图纸上各个操作位置对应的声音或者输入字符 (例如钢琴 琴键对应的音调及音量) 之后, 当处理器 110 判断得知敲击信号在该输 入图纸上的位置并将该敲击信号在输入图纸上的敲击点位置映射为内置 于手机应用的输入软键盘上的按键的键值之后, 则可调动相应的应用中 该敲击信号的敲击点位置映射的输入软键盘中按键的键值对应的音调或 者音量, 并根据该音调或者音量输出相应的音乐。 具体地, 只要手机用 户自定义的输入图纸经过校准, 确定位置之后, 输入图纸上的所有字符 在手机的定位坐标系中位置对于处理器 11 0 来说则均为已知数, 当手机 用户在图纸上敲击时, 处理器 11 0 则可根据敲击信号的敲击点位置判断 得出手机用户敲击的字符, 并将该字符作为手机输入信号的触发信号, 生成手机输入信号, 播放一段手机用户自行弹奏的音乐, 即可完成敲击 信号到手机输入信号的转换。 When the first operating platform is a custom input drawing for the mobile phone user (as shown in FIG. 7), the mobile phone user customizes the input sound corresponding to each operation position on the drawing or inputs characters (such as the pitch and volume corresponding to the piano keys), and then processes The controller 110 determines that the position of the tap signal on the input sheet and maps the tapping point position of the tap signal on the input sheet to the key value of the button built in the input soft keyboard of the mobile phone application, The tone or volume corresponding to the key value of the button in the input soft keyboard of the tapping point position mapping of the tapping signal in the corresponding application is transferred, and the corresponding music is output according to the tone or the volume. Specifically, as long as the user-defined input drawing of the mobile phone is calibrated and the position is determined, all the characters on the input drawing in the positioning coordinate system of the mobile phone are known for the processor 11 0, when the mobile phone user is When tapping on the drawing, the processor 11 0 can determine the character tapped by the mobile phone user according to the position of the tapping point of the tapping signal, and use the character as a trigger signal of the input signal of the mobile phone to generate a mobile phone input signal and play a segment. The music played by the mobile phone user can complete the tapping Signal to phone input signal conversion.
本发明实施例可将手机的输入键盘图纸或者手机用户自定义的输入 图纸等操作平台上的敲击信号的敲击点位置映射为手机的输入法应用的 输入软键盘的按键的键值或者手机的其他应用的输入软键盘的按键的键 值等手机上的输入设备上的操作位置上的键值, 并以该敲击信号作为该 操作位置上的触发信号, 用以触发手机的内部应用, 生成与该触发信号 相对应的手机输入信号, 拓展了手机的输入信号的生成途径, 提高了生 成手机输入信号的趣味性, 提高了手机的用户体验效果。  The embodiment of the invention can map the location of the tapping point of the tapping signal on the operating platform such as the input keyboard drawing of the mobile phone or the input drawing of the mobile phone to the key value of the input soft keyboard of the input method of the mobile phone or the mobile phone. The key value of the input key of the input soft keyboard of the other application, and the key value of the operation position on the input device of the mobile phone, and the tapping signal is used as a trigger signal at the operating position to trigger the internal application of the mobile phone. The input signal of the mobile phone corresponding to the trigger signal is generated, which expands the generation path of the input signal of the mobile phone, improves the interest of generating the input signal of the mobile phone, and improves the user experience of the mobile phone.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分 流程, 是可以通过计算机程序来指令相关的硬件来完成, 所述的程序可 存储于计算机可读取存储介质中, 该程序在执行时, 可包括如上述各方 法的实施例的流程。 其中, 所述的存储介质可为磁碟、 光盘、 只读存储 己'! "乙体 ( Read— On l y Memory , ROM ) 或随机存 | 己'! "乙体 ( Random Acce s s Memory , RAM ) 等。  A person skilled in the art can understand that all or part of the process of implementing the above embodiment method can be completed by a computer program to instruct related hardware, and the program can be stored in a computer readable storage medium, and the program is When executed, the flow of an embodiment of the methods as described above may be included. The storage medium may be a magnetic disk, an optical disk, or a read-only memory (ROM) or a random acco ss memory (RAM). Wait.
以上所揭露的仅为本发明较佳实施例而已,当然不能以此来限定本发 明之权利范围, 因此依本发明权利要求所作的等同变化, 仍属本发明所 涵盖的范围。  The above is only the preferred embodiment of the present invention, and the scope of the present invention is not limited thereto, and the equivalent changes made in the claims of the present invention are still within the scope of the present invention.

Claims

权 利 要 求 Rights request
1、 一种生成终端输入信号的方法, 其特征在于, 包括:  A method for generating a terminal input signal, comprising:
获取第一操作平台上的敲击信号;  Obtaining a tap signal on the first operating platform;
判断所述敲击信号在所述第一操作平台上的敲击点位置;  Determining a tapping point position of the tap signal on the first operating platform;
将所述敲击信号在所述第一操作平台上的敲击点位置映射为第二操作平 台上的操作位置;  Mapping a tapping point position of the tap signal on the first operating platform to an operating position on a second operating platform;
将所述敲击信号作为所述第二操作平台上的操作位置上的触发信号,为终 端生成对应于所述触发信号的终端输入信号。  The tapping signal is used as a trigger signal on an operation position on the second operating platform, and a terminal input signal corresponding to the trigger signal is generated for the terminal.
2、 如权利要求 1所述的方法, 其特征在于, 所述第一操作平台, 包括: 所述终端本体、 放置所述终端的平整物体表面、 终端输入设备中至少一种; 所述第二操作平台为所述终端的应用程序的输入界面、所述终端的字符输 入软键盘中至少一种。 The method of claim 1, wherein the first operating platform comprises: at least one of the terminal body, a flat object surface on which the terminal is placed, and a terminal input device; The operation platform is at least one of an input interface of an application of the terminal and a character input soft keyboard of the terminal.
3、 如权利要求 2所述的方法, 其特征在于, 所述敲击信号, 包括: 振动 机械波、 敲击时间、 敲击强度中至少一种。 3. The method according to claim 2, wherein the tapping signal comprises: at least one of a vibration mechanical wave, a tapping time, and a tapping intensity.
4、 如权利要求 3所述的方法, 其特征在于, 所述判断所述敲击信号在所 述第一操作平台上的敲击点位置, 包括: The method according to claim 3, wherein the determining the location of the tapping point of the tapping signal on the first operating platform comprises:
釆集所述终端中各个传感器在所述终端的定位坐标系中的位置坐标,所述 传感器用于获取所述敲击信号并且不少于 3个;  Collecting position coordinates of each sensor in the terminal in a positioning coordinate system of the terminal, and the sensor is configured to acquire the tapping signal and not less than three;
根据所述敲击信号的振动机械波的传播速度,所述传感器接收到所述振动 机械波的时刻, 所述敲击信号的敲击时刻, 以及所述各个传感器在所述终端的 定位坐标系中的位置坐标,得到所述敲击信号在所述第一操作平台上的敲击点 在所述终端的定位坐标系中的位置。 a timing of the vibration mechanical wave according to the tapping signal, a timing at which the sensor receives the vibration mechanical wave, a tapping timing of the tapping signal, and a position of the respective sensor in a positioning coordinate system of the terminal Position coordinates, obtaining a position of a tapping point of the tap signal on the first operating platform in a positioning coordinate system of the terminal.
5、 如权利要求 1-4所述的方法, 其特征在于, 所述将所述敲击信号在所 述第一操作平台上的敲击点位置映射为所述第二操作平台上的操作位置,包括: 将所述敲击信号在所述第一操作平台上的敲击点在所述终端的定位坐标 系中的位置与所述终端中预置的定位数据库进行匹配,判断所述敲击信号在所 述第一操作平台上的敲击点位置对应的所述第二操作平台上的操作位置, 将 所述敲击信号在所述第一操作平台上的敲击点位置映射为所述第二操作平台 上的操作位置。 The method according to any one of claims 1-4, wherein the mapping of the tapping point of the tapping signal on the first operating platform to the operating position on the second operating platform The method includes: matching a location of a tapping point of the tapping signal on the first operating platform in a positioning coordinate system of the terminal with a positioning database preset in the terminal, and determining the tapping Mapping an operation position on the second operating platform corresponding to a tapping point position on the first operating platform, mapping a tapping point position of the tapping signal on the first operating platform to the The operating position on the second operating platform.
6、 如权利要求 2-4所述的方法, 其特征在于, 若所述敲击信号为所述终 端输入设备上的敲击信号,则所述获取第一操作平台上的敲击信号之前,包括: 获取终端输入设备上的校准点上的敲击信号,并判断所述终端输入设备上 的校准点在所述终端的定位坐标系中的位置; 6. The method according to claim 2-4, wherein, if the tapping signal is a tapping signal on the terminal input device, before the tapping signal on the first operating platform is acquired, The method includes: acquiring a tap signal on a calibration point on the terminal input device, and determining a position of the calibration point on the terminal input device in a positioning coordinate system of the terminal;
根据所述校准点在所述终端的定位坐标系中的位置,以及所述校准点在所 述终端输入设备上的位置, 确定所述终端输入设备与所述终端的相对位置。  And determining a relative position of the terminal input device and the terminal according to a position of the calibration point in a positioning coordinate system of the terminal and a position of the calibration point on the terminal input device.
7、 如权利要求 6所述的方法, 其特征在于, 所述将所述敲击信号在所述 第一操作平台上的敲击点位置映射为所述第二操作平台上的操作位置, 包括: 根据所述第一操作平台上的敲击信号的敲击点在所述终端的定位坐标系 中的位置, 以及所述终端输入设备与所述终端的相对位置, 判断所述敲击信号 在所述终端输入设备上的操作位置; The method according to claim 6, wherein the mapping of the tapping point position of the tapping signal on the first operating platform to the operating position on the second operating platform comprises Determining, according to a position of a tapping point of a tapping signal on the first operating platform in a positioning coordinate system of the terminal, and a relative position of the terminal input device and the terminal, determining that the tapping signal is The terminal inputs an operation location on the device;
根据预设的所述终端输入设备上的操作位置与所述第二操作平台上的操 作位置的对应关系,将所述终端输入设备上的敲击信号的敲击点位置映射为所 述第二操作平台上的操作位置。  Mapping a tap point position of a tap signal on the terminal input device to the second according to a preset correspondence between an operation position on the terminal input device and an operation position on the second operation platform The operating position on the operating platform.
8、 如权利要求 2所述的方法, 其特征在于, 所述终端输入设备, 包括: 所述终端的输入键盘图纸、 所述终端用户自定义的输入图纸中至少一种。 The method according to claim 2, wherein the terminal input device comprises: at least one of an input keyboard drawing of the terminal and an input drawing customized by the terminal user.
9、 如权利要求 3-8所述的方法, 其特征在于, 所述将所述敲击信号作为 所述第二操作平台上的操作位置上的触发信号,为终端生成对应于所述触发信 号的终端输入信号, 包括: The method according to any one of claims 3-8, wherein the tapping signal is used as a trigger signal on an operation position on the second operating platform, and the terminal generates a trigger signal corresponding to the trigger signal. Terminal input signals, including:
将所述敲击信号作为所述第二操作平台上的操作位置上的触发信号,并根 据所述敲击信号的敲击强度,生成与所述敲击信号的敲击强度相对应的信号强 度的终端输入信号。  Using the tapping signal as a trigger signal on an operation position on the second operating platform, and generating a signal strength corresponding to the tapping strength of the tapping signal according to the tapping intensity of the tapping signal Terminal input signal.
10、如权利要求 1-9任意一项所述的方法,其特征在于,所述终端,包括: 手机、 平板电脑、 笔记本电脑、 数码相机、 数码摄像机中至少一种。 The method according to any one of claims 1-9, wherein the terminal comprises: at least one of a mobile phone, a tablet computer, a notebook computer, a digital camera, and a digital video camera.
11、 一种生成终端输入信号的装置, 其特征在于, 包括: 11. A device for generating a terminal input signal, comprising:
获取模块, 用于获取第一操作平台上的敲击信号;  An obtaining module, configured to acquire a tapping signal on the first operating platform;
定位模块, 用于判断所述敲击信号在所述第一操作平台上的敲击点位置; 映射模块,用于将所述敲击信号在所述第一操作平台上的敲击点位置映射 为所述第二操作平台上的操作位置;  a positioning module, configured to determine a tapping point position of the tapping signal on the first operating platform; a mapping module, configured to map a tapping point position of the tapping signal on the first operating platform An operating position on the second operating platform;
生成模块,用于将所述敲击信号作为所述第二操作平台上的操作位置上的 触发信号, 为终端生成对应于所述触发信号的终端输入信号。  And a generating module, configured to use the tapping signal as a trigger signal on an operation position on the second operating platform to generate a terminal input signal corresponding to the trigger signal for the terminal.
12、如权利要求 11所述的装置,其特征在于, 所述第一操作平台, 包括: 所述终端本体、 放置所述终端的平整物体表面、 终端输入设备中至少一种; 所述第二操作平台为所述终端的应用程序的输入界面、所述终端的字符输 入软键盘中至少一种。 The apparatus according to claim 11, wherein the first operating platform comprises: at least one of the terminal body, a surface of a flat object on which the terminal is placed, and a terminal input device; The operation platform is at least one of an input interface of an application of the terminal and a character input soft keyboard of the terminal.
13、 如权利要求 12所述的装置, 其特征在于, 所述敲击信号, 包括: 振 动机械波、 敲击时间、 敲击强度中至少一种。 The device according to claim 12, wherein the tapping signal comprises: at least one of a vibration mechanical wave, a tapping time, and a tapping intensity.
14、 如权利要求 13所述的装置, 其特征在于, 所述定位模块, 包括: 釆集单元,用于釆集所述终端中各个传感器在所述终端的定位坐标系中的 位置坐标, 所述传感器用于获取所述敲击信号并且不少于 3个; The device according to claim 13, wherein the positioning module comprises: a collecting unit, configured to collect position coordinates of each sensor in the terminal in a positioning coordinate system of the terminal, The sensor is configured to acquire the tapping signal and not less than three;
第一处理单元, 用于根据所述敲击信号的振动机械波的传播速度, 所述传 感器接收到所述振动机械波的时刻, 所述敲击信号的敲击时刻, 以及所述各个 传感器在所述终端的定位坐标系中的位置坐标,得到所述敲击信号在所述第一 操作平台上的敲击点在所述终端的定位坐标系中的位置。  a first processing unit, configured to: according to a propagation speed of the vibration mechanical wave of the tapping signal, a timing at which the sensor receives the vibration mechanical wave, a tapping time of the tapping signal, and the respective sensors in the The position coordinates in the positioning coordinate system of the terminal obtain the position of the tapping point of the tapping signal on the first operating platform in the positioning coordinate system of the terminal.
15、 如权利要求 11-14所述的装置, 其特征在于, 所述映射模块, 具体用 于: The device according to any one of claims 11-14, wherein the mapping module is specifically configured to:
将所述敲击信号在所述第一操作平台上的敲击点在所述终端的定位坐标 系中的位置与所述终端中预置的定位数据库进行匹配,判断所述敲击信号在所 述第一操作平台上的敲击点位置对应的所述第二操作平台上的操作位置,将所 述敲击信号在所述第一操作平台上的敲击点位置映射为所述第二操作平台上 的操作位置。  Matching a position of the tapping point of the tapping signal on the first operating platform in a positioning coordinate system of the terminal with a positioning database preset in the terminal, and determining that the tapping signal is in the Mapping an operation position on the second operating platform corresponding to a tapping point position on the first operating platform, mapping a tapping point position of the tapping signal on the first operating platform to the second operation The operating position on the platform.
16、 如权利要求 12-14所述的装置, 其特征在于, 所述终端, 还包括: 校准釆集模块, 用于获取终端输入设备上的校准点的敲击信号, 并判断所 述终端输入设备上的校准点在所述终端的定位坐标系中的位置; The device according to any one of claims 12-14, wherein the terminal further comprises: a calibration collection module, configured to acquire a tapping signal of a calibration point on the terminal input device, and determine the terminal input The position of the calibration point on the device in the positioning coordinate system of the terminal;
校准模块, 用于根据所述校准点在所述终端的定位坐标系中的位置, 以及 所述校准点在所述终端输入设备上的位置 ,确定所述终端输入设备与所述终端 的相对位置。  a calibration module, configured to determine a relative position of the terminal input device and the terminal according to a position of the calibration point in a positioning coordinate system of the terminal, and a position of the calibration point on the terminal input device .
17、 如权利要求 16所述的装置, 其特征在于, 所述映射模块, 包括: 判断单元,用于根据所述第一操作平台上的敲击信号的敲击点在所述终端 的定位坐标系中的位置, 以及所述终端输入设备与所述终端的相对位置, 判断 所述敲击信号在所述终端输入设备上的操作位置; The device according to claim 16, wherein the mapping module comprises: a determining unit, configured to: at the terminal according to a tapping point of a tapping signal on the first operating platform a position in the positioning coordinate system, and a relative position of the terminal input device and the terminal, determining an operation position of the tap signal on the terminal input device;
映射单元,用于根据预设的所述终端输入设备上的操作位置与所述第二操 作平台上的操作位置的对应关系,将所述终端输入设备上的敲击信号的敲击点 位置映射为所述第二操作平台的操作位置。  a mapping unit, configured to map a tapping point position of a tapping signal on the terminal input device according to a preset correspondence between an operation position on the terminal input device and an operation position on the second operating platform It is the operating position of the second operating platform.
18、如权利要求 12所述的装置,其特征在于,所述终端输入设备, 包括: 所述终端的输入键盘图纸、 所述终端用户自定义的输入图纸中至少一种。 The device according to claim 12, wherein the terminal input device comprises: at least one of an input keyboard drawing of the terminal and an input drawing customized by the terminal user.
19、 如权利要求 13-18所述的装置, 其特征在于, 所述生成模块, 具体用 于: The device according to any one of claims 13-18, wherein the generating module is specifically configured to:
将所述敲击信号作为所述第二操作平台上的操作位置上的触发信号,并根 据所述敲击信号的敲击强度,生成与所述敲击信号的敲击强度相对应的信号强 度的终端输入信号。  Using the tapping signal as a trigger signal on an operation position on the second operating platform, and generating a signal strength corresponding to the tapping strength of the tapping signal according to the tapping intensity of the tapping signal Terminal input signal.
20、 如权利要求 11-19任意一项所述的装置, 其特征在于, 所述终端, 包 括: 手机、 平板电脑、 笔记本电脑、 数码相机、 数码摄像机中至少一种。 The device according to any one of claims 11 to 19, wherein the terminal comprises: at least one of a mobile phone, a tablet computer, a notebook computer, a digital camera, and a digital video camera.
21、 一种终端, 其特征在于, 包括: 21. A terminal, comprising:
传感器, 用于获取第一操作平台上的敲击信号;  a sensor, configured to acquire a tap signal on the first operating platform;
处理器, 用于判断所述敲击信号在所述第一操作平台上的敲击点位置, 将 所述敲击信号在所述第一操作平台上的敲击点位置映射为所述第二操作平台 上的操作位置,并将所述敲击信号作为所述第二操作平台上的操作位置上的触 发信号, 为终端生成对应于所述触发信号的终端输入信号。  a processor, configured to determine a tapping point position of the tapping signal on the first operating platform, and map a tapping point position of the tapping signal on the first operating platform to the second Operating the position on the platform, and using the tapping signal as a trigger signal on the operating position on the second operating platform to generate a terminal input signal corresponding to the trigger signal for the terminal.
22、如权利要求 21所述的终端,其特征在于,所述第一操作平台, 包括: 所述终端本体、 放置所述终端的平整物体表面、 终端输入设备中至少一种; 所述第二操作平台为所述终端的应用程序的输入界面、所述终端的字符输 入软键盘中至少一种。 The terminal of claim 21, wherein the first operating platform comprises: At least one of the terminal body, the surface of the flat object on which the terminal is placed, and the terminal input device; the second operating platform is at least one of an input interface of an application of the terminal, and a character input soft keyboard of the terminal Kind.
23、 如权利要求 22所述的终端, 其特征在于, 所述敲击信号, 包括: 振 动机械波、 敲击时间、 敲击强度中至少一种。 The terminal according to claim 22, wherein the tapping signal comprises: at least one of a vibration mechanical wave, a tapping time, and a tapping strength.
24、 如权利要求 23所述的终端, 其特征在于, 所述处理器在判断所述敲 击信号在所述第一操作平台上的敲击点位置时, 具体用于: The terminal according to claim 23, wherein the processor is specifically configured to: when determining the location of the tapping point of the tapping signal on the first operating platform:
釆集所述终端中各个传感器在所述终端的定位坐标系中的位置坐标,所述 传感器用于获取所述敲击信号并且不少于 3个;  Collecting position coordinates of each sensor in the terminal in a positioning coordinate system of the terminal, and the sensor is configured to acquire the tapping signal and not less than three;
根据所述敲击信号的振动机械波的传播速度,所述传感器接收到所述振动 机械波的时刻, 所述敲击信号的敲击时刻, 以及各个传感器在所述终端的定位 坐标系中的位置坐标,得到所述敲击信号在所述第一操作平台上的敲击点在所 述终端的定位坐标系中的位置。  a timing of the vibration mechanical wave according to the tapping signal, a timing at which the sensor receives the vibration mechanical wave, a tapping timing of the tapping signal, and a position coordinate of each sensor in a positioning coordinate system of the terminal And obtaining a position of the tapping point of the tapping signal on the first operating platform in a positioning coordinate system of the terminal.
25、如权利要求 21-24所述的终端,其特征在于,所述终端还包括存储器, 所述存储器用于存储定位数据库,则所述处理器在将所述敲击信号在所述第一 操作平台上的敲击点位置映射为所述第二操作平台上的操作位置时, 具体为: 将所述敲击信号在所述第一操作平台上的敲击点在所述终端的定位坐标 系中的位置与所述存储器中存储的定位数据库进行匹配,判断所述敲击信号在 所述第一操作平台上的敲击点位置对应的所述第二操作平台上的操作位置,将 所述敲击信号在所述第一操作平台上的敲击点位置映射为所述第二操作平台 上的操作位置。 The terminal according to any one of claims 21 to 24, wherein the terminal further comprises a memory, wherein the memory is used to store a positioning database, and the processor is in the first When the location of the tapping point on the operating platform is mapped to the operating position on the second operating platform, specifically: positioning coordinates of the tapping point of the tapping signal on the first operating platform at the terminal The position in the system is matched with the positioning database stored in the memory, and the operation position on the second operating platform corresponding to the tapping point position of the tapping signal on the first operating platform is determined. The tapping point position of the tap signal on the first operating platform is mapped to an operating position on the second operating platform.
26、 如权利要求 22-24所述的终端, 其特征在于, 所述处理器在判断所述 敲击信号在所述第一操作平台上的敲击点位置时, 还具体用于: The terminal according to claim 22-24, wherein the processor determines the When the tapping signal is at the tapping point position on the first operating platform, it is also specifically used for:
获取终端输入设备上的校准点的敲击信号,并判断所述终端输入设备上的 校准点在所述终端的定位坐标系中的位置;  Obtaining a tapping signal of a calibration point on the terminal input device, and determining a position of the calibration point on the terminal input device in a positioning coordinate system of the terminal;
根据所述校准点在所述终端的定位坐标系中的位置,以及所述校准点在所 述终端输入设备上的位置, 确定所述终端输入设备与所述终端的相对位置。  And determining a relative position of the terminal input device and the terminal according to a position of the calibration point in a positioning coordinate system of the terminal and a position of the calibration point on the terminal input device.
27、 如权利要求 26所述的终端, 其特征在于, 所述处理器在将所述敲击 信号在所述第一操作平台上的敲击点位置映射为所述第二操作平台上的操作 位置时, 还具体用于; The terminal according to claim 26, wherein the processor maps a tapping point position of the tapping signal on the first operating platform to an operation on the second operating platform When used in location, it is also used specifically;
根据所述第一操作平台上的敲击信号的敲击点在所述终端的定位坐标系 中的位置, 以及所述终端输入设备与所述终端的相对位置, 判断所述敲击信号 在所述终端输入设备上的操作位置;  Determining, according to the position of the tapping point of the tapping signal on the first operating platform in the positioning coordinate system of the terminal, and the relative position of the terminal input device and the terminal, determining that the tapping signal is in the The operating position on the terminal input device;
根据预设的所述终端输入设备上的操作位置与所述第二操作平台上的操 作位置的对应关系,将所述终端输入设备上的敲击信号的敲击点位置映射为所 述第二操作平台的操作位置。  Mapping a tap point position of a tap signal on the terminal input device to the second according to a preset correspondence between an operation position on the terminal input device and an operation position on the second operation platform The operating position of the operating platform.
28、 如权利要求 2所述的终端, 其特征在于, 所述终端输入设备, 包括: 所述终端的输入键盘图纸、 所述终端用户自定义的输入图纸中至少一种。 The terminal according to claim 2, wherein the terminal input device comprises: at least one of an input keyboard drawing of the terminal and an input drawing customized by the terminal user.
29、 如权利要求 23-28所述的终端, 其特征在于, 所述处理器在将所述敲 击信号作为所述第二操作平台上的操作位置上的触发信号,为终端生成对应于 所述触发信号的终端输入信号时, 具体用于: The terminal according to any one of claims 23-28, wherein the processor generates the corresponding terminal for the terminal by using the tapping signal as a trigger signal on an operation position on the second operating platform. When the terminal input signal of the trigger signal is described, it is specifically used to:
将所述敲击信号作为所述第二操作平台上的操作位置上的触发信号,并根 据所述敲击信号的敲击强度,生成与所述敲击信号的敲击强度相对应的信号强 度的终端输入信号。 、 如权利要求 21-29任意一项所述的终端, 其特征在于, 所述终端, 包 、 平板电脑、 笔记本电脑、 数码相机、 数码摄像机中至少一种。 Using the tapping signal as a trigger signal on an operation position on the second operating platform, and generating a signal strength corresponding to the tapping strength of the tapping signal according to the tapping intensity of the tapping signal Terminal input signal. The terminal according to any one of claims 21 to 29, wherein the terminal is at least one of a package, a tablet, a notebook computer, a digital camera, and a digital video camera.
PCT/CN2014/080866 2013-06-26 2014-06-26 Terminal input signal generation method, device and terminal WO2014206322A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN2013102599997A CN103345409A (en) 2013-06-26 2013-06-26 Method and device for generating terminal input signals and terminal
CN201310259999.7 2013-06-26

Publications (1)

Publication Number Publication Date
WO2014206322A1 true WO2014206322A1 (en) 2014-12-31

Family

ID=49280207

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/080866 WO2014206322A1 (en) 2013-06-26 2014-06-26 Terminal input signal generation method, device and terminal

Country Status (2)

Country Link
CN (1) CN103345409A (en)
WO (1) WO2014206322A1 (en)

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103345409A (en) * 2013-06-26 2013-10-09 华为终端有限公司 Method and device for generating terminal input signals and terminal
CN103645845B (en) * 2013-11-22 2016-10-05 华为终端有限公司 A kind of percussion control method and terminal
EP2916195B1 (en) * 2014-03-03 2019-09-11 LG Electronics Inc. Mobile terminal and controlling method thereof
CN104050951B (en) * 2014-05-05 2017-10-13 杭州天堂伞业集团有限公司 Wind-force music apparatus and the music parachute kit with the device
CN105425936B (en) * 2014-09-19 2020-07-07 中兴通讯股份有限公司 Method and device for adapting terminal to external device and terminal
CN105549744B (en) * 2016-01-20 2019-03-26 Oppo广东移动通信有限公司 A kind of screen luminance of terminal adjusting method and device
CN107704180A (en) * 2016-08-08 2018-02-16 中兴通讯股份有限公司 A kind of method and projection arrangement of projection arrangement operation
CN107885357A (en) * 2017-11-10 2018-04-06 无锡睿勤科技有限公司 A kind of sound control computer method, system and computer

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1848043A (en) * 2005-04-04 2006-10-18 技嘉科技股份有限公司 Virtual keyboard
CN101048725A (en) * 2004-10-25 2007-10-03 诺基亚公司 An apparatus and a method for tapping input to an electronic device, including an attachable tapping template
CN101825944A (en) * 2009-03-06 2010-09-08 英华达(上海)科技有限公司 Virtual keyboard structure of electronic device and data input method thereof
CN103345409A (en) * 2013-06-26 2013-10-09 华为终端有限公司 Method and device for generating terminal input signals and terminal
CN103513758A (en) * 2012-06-28 2014-01-15 华为终端有限公司 Input method of intelligent terminal and intelligent terminal

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5581484A (en) * 1994-06-27 1996-12-03 Prince; Kevin R. Finger mounted computer input device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101048725A (en) * 2004-10-25 2007-10-03 诺基亚公司 An apparatus and a method for tapping input to an electronic device, including an attachable tapping template
CN1848043A (en) * 2005-04-04 2006-10-18 技嘉科技股份有限公司 Virtual keyboard
CN101825944A (en) * 2009-03-06 2010-09-08 英华达(上海)科技有限公司 Virtual keyboard structure of electronic device and data input method thereof
CN103513758A (en) * 2012-06-28 2014-01-15 华为终端有限公司 Input method of intelligent terminal and intelligent terminal
CN103345409A (en) * 2013-06-26 2013-10-09 华为终端有限公司 Method and device for generating terminal input signals and terminal

Also Published As

Publication number Publication date
CN103345409A (en) 2013-10-09

Similar Documents

Publication Publication Date Title
WO2014206322A1 (en) Terminal input signal generation method, device and terminal
US11341946B2 (en) Method for determining a karaoke singing score, terminal and computer-readable storage medium
KR101657963B1 (en) Operation Method of Device based on a alteration ratio of touch area And Apparatus using the same
US8866846B2 (en) Apparatus and method for playing musical instrument using augmented reality technique in mobile terminal
EP3654335A1 (en) Method and apparatus for displaying pitch information in live broadcast room, and storage medium
WO2006026012A2 (en) Touch-screen interface
TW200813795A (en) Method, apparatus, and computer program product for entry of data or commands based on tap detection
JP2006323823A (en) Sound-based virtual keyboard, device and method
JP2006065331A (en) Apparatus and method for controlling music play in mobile communication terminal
WO2006070044A1 (en) A method and a device for localizing a sound source and performing a related action
CN110931053B (en) Method, device, terminal and storage medium for detecting recording time delay and recording audio
CN112735429B (en) Method for determining lyric timestamp information and training method of acoustic model
TW201025078A (en) Virtual keyboard of an electronic device and a data inputting method therefor
CN108848394A (en) Net cast method, apparatus, terminal and storage medium
WO2017161827A1 (en) Method for adjusting focus of camera and terminal
CN108922562A (en) Sing evaluation result display methods and device
CN109192223B (en) Audio alignment method and device
CN109361930A (en) Method for processing business, device and computer readable storage medium
CN110149557A (en) Video broadcasting method, device, terminal and storage medium
CN111933098A (en) Method and device for generating accompaniment music and computer readable storage medium
CN110392375A (en) WiFi network channel amending method, terminal, server and storage medium
WO2016088493A1 (en) Motion-controlled video game device
WO2019223268A1 (en) Method and device for storing lyric phonetic notations
CN109871497A (en) The method and apparatus of sharing information
TWI470619B (en) The percussion instrument with electronic sensors

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14816573

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14816573

Country of ref document: EP

Kind code of ref document: A1