WO2023103797A1 - Procédé d'interaction homme-machine, et dispositif électronique et support associés - Google Patents

Procédé d'interaction homme-machine, et dispositif électronique et support associés Download PDF

Info

Publication number
WO2023103797A1
WO2023103797A1 PCT/CN2022/134054 CN2022134054W WO2023103797A1 WO 2023103797 A1 WO2023103797 A1 WO 2023103797A1 CN 2022134054 W CN2022134054 W CN 2022134054W WO 2023103797 A1 WO2023103797 A1 WO 2023103797A1
Authority
WO
WIPO (PCT)
Prior art keywords
electronic device
stylus
magnetic flux
relative
tablet computer
Prior art date
Application number
PCT/CN2022/134054
Other languages
English (en)
Chinese (zh)
Inventor
肖冬
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Publication of WO2023103797A1 publication Critical patent/WO2023103797A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J50/00—Circuit arrangements or systems for wireless supply or distribution of electric power
    • H02J50/005—Mechanical details of housing or structure aiming to accommodate the power transfer means, e.g. mechanical integration of coils, antennas or transducers into emitting or receiving devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/266—Arrangements to supply power to external peripherals either directly from the computer or under computer control, e.g. supply of power through the communication port, computer controlled power-strips
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545—Pens or stylus
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038—Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0383—Signal control means within the pointing device
    • H—ELECTRICITY
    • H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J50/00—Circuit arrangements or systems for wireless supply or distribution of electric power
    • H02J50/10—Circuit arrangements or systems for wireless supply or distribution of electric power using inductive coupling
    • H—ELECTRICITY
    • H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J50/00—Circuit arrangements or systems for wireless supply or distribution of electric power
    • H02J50/60—Circuit arrangements or systems for wireless supply or distribution of electric power responsive to the presence of foreign objects, e.g. detection of living beings
    • H—ELECTRICITY
    • H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J50/00—Circuit arrangements or systems for wireless supply or distribution of electric power
    • H02J50/80—Circuit arrangements or systems for wireless supply or distribution of electric power involving the exchange of data, concerning supply or distribution of electric power, between transmitting devices and receiving devices
    • H—ELECTRICITY
    • H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J50/00—Circuit arrangements or systems for wireless supply or distribution of electric power
    • H02J50/90—Circuit arrangements or systems for wireless supply or distribution of electric power involving detection or optimisation of position, e.g. alignment
    • H—ELECTRICITY
    • H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J7/00—Circuit arrangements for charging or depolarising batteries or for supplying loads from batteries
    • H—ELECTRICITY
    • H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J7/00—Circuit arrangements for charging or depolarising batteries or for supplying loads from batteries
    • H02J7/00032—Circuit arrangements for charging or depolarising batteries or for supplying loads from batteries characterised by data exchange
    • H02J7/00036—Charger exchanging data with battery
    • H—ELECTRICITY
    • H02—GENERATION; CONVERSION OR DISTRIBUTION OF ELECTRIC POWER
    • H02J—CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER; SYSTEMS FOR STORING ELECTRIC ENERGY
    • H02J7/00—Circuit arrangements for charging or depolarising batteries or for supplying loads from batteries
    • H02J7/0068—Battery or charger load switching, e.g. concurrent charging and load supply

Definitions

  • the present application relates to the technical field of terminals, and in particular to a human-computer interaction method, electronic equipment and media thereof.
  • the stylus 200 is magnetically accommodated on the tablet computer 100 in the manner shown in FIG.
  • the tablet computer 100 will display the current power level of the stylus 200, but the prompt to the user is limited to this.
  • the stylus 200 may generate heat during charging because it is not aligned with the magnetic charging position, which is not conducive to the maintenance of the battery of the stylus 200 and further affects the service life of the stylus 200 .
  • the present application provides a human-computer interaction method, electronic equipment and its medium.
  • a position mark will be displayed on the tablet computer, which can indicate the relative position change of the stylus relative to the magnetic charging position of the tablet computer, so that The user can adjust the position of the stylus or the tablet according to the position mark, so that the stylus can be aligned with the magnetic charging position of the tablet for full power charging, avoiding the heat generated during magnetic charging under misalignment.
  • the present application provides a human-computer interaction method, which is applied to a first electronic device and a second electronic device, and the method includes: detecting that the first electronic device is located in a magnetic field provided by the second electronic device; Determine the relative position changes between the first electronic device and the second electronic device based on the obtained changes in the magnetic flux at multiple different positions on the first electronic device; The corresponding display content on the device.
  • the first electronic device or the second electronic device may detect whether the first electronic device is located in the magnetic field provided by the second electronic device through a Hall sensor provided on the first electronic device.
  • the magnetic flux of the second electronic device's magnetic field passing through the first electronic device will change, so it can pass through multiple different positions on the first electronic device Hall sensors are installed at different positions, and the change of the relative position of the first electronic device relative to the second electronic device is judged according to the change of the magnetic flux collected by the Hall sensors at multiple different positions, and according to the relative position change of the first electronic device relative to the second electronic device,
  • the relative position change of the second electronic device determines the corresponding display content on the first electronic device or the second electronic device.
  • the first electronic device or the second electronic device can display the relative position change of the first electronic device relative to the second electronic device to the user in a visual form, so that the user can to adjust the position of the first electronic device or the second electronic device.
  • the user can align the first electronic device with the standard charging position of the second electronic device (or hereinafter referred to as Magnetic charging position) for full power charging.
  • the magnetic field provided by the second electronic device can be used to charge the first electronic device, and according to the determined relative position change, determine the The corresponding display content on an electronic device or a second electronic device includes: when the second electronic device is in the state of charging the first electronic device, on the first electronic device or the second electronic device, displaying that the first electronic device A first indication of a relative position with respect to the second electronic device.
  • the first electronic device when the first electronic device is in the magnetic field of the second electronic device, the first electronic device is not necessarily in a charging state.
  • the first electronic device can detect the magnetic field of the second electronic device, the distance between the first electronic device and the second electronic device The distance between them, the received magnetic flux is not enough for charging. Therefore, in some embodiments, whether the second electronic device is in the state of charging the first electronic device can be determined according to the relationship between the magnetic flux in the first electronic device and the preset first magnetic flux. For example, when the magnetic flux in the first electronic device is greater than or equal to the preset first magnetic flux, it indicates that the second electronic device is in a state of charging the first electronic device. When the magnetic flux in the first electronic device is smaller than the preset first magnetic flux, it indicates that the second electronic device is not in the state of charging the first electronic device.
  • the specific judgment method will be introduced in the specific embodiment section below, and will not be repeated here.
  • the first sign indicates the relative position of the first electronic device relative to the second electronic device, so as long as the second electronic device is charging the first electronic device, the first electronic device or the second electronic device will display the first mark, regardless of whether the first electronic device is aligned with the standard charging position of the second electronic device.
  • determining the corresponding display content on the first electronic device or the second electronic device includes: : The moving direction of the first sign is the same as the moving direction of the first electronic device relative to the second electronic device.
  • the first mark may move along the moving direction of the first electronic device relative to the second electronic device. For example, if the first electronic device moves to the right relative to the second electronic device, the first sign also moves to the right, and then when the user adjusts the first electronic device to align with the standard charging position of the second electronic device, It is only necessary to move the first electronic device in a direction opposite to the direction in which the first sign moves.
  • the moving direction of the first sign can also be opposite to the moving direction of the first electronic device relative to the second electronic device.
  • the first electronic device needs to be moved in the same direction as the moving direction of the first sign.
  • determine the corresponding display content on the first electronic device or the second electronic device and further include:
  • On the first electronic device or the second electronic device display the second mark of the standard charging position of the first electronic device relative to the second electronic device, wherein the position of the second mark is between the first electronic device and the second electronic device remain unchanged during the move.
  • a second sign indicating that the first electronic device is aligned with the standard charging position of the second electronic device can also be displayed at the same time, and the position and shape of the second sign remain unchanged during the movement of the first electronic device relative to the second electronic device, To play a role similar to position calibration.
  • the first logo and the second logo are simultaneously displayed on the first electronic device or the second electronic device, and the user can The relative position of the mark is used to adjust the position of the first electronic device or the second electronic device more accurately, so that the first electronic device can be aligned with the standard charging position of the second electronic device.
  • the positions of the first mark and the second mark are coincident, and at this time the second mark can be mainly displayed, or The first logo may be mainly displayed.
  • the first logo and the second logo have the same shape and different colors. This allows the user to distinguish between the first location and the second location. It can be understood that, in some embodiments, the first logo and the second logo may also have different shapes and different colors, or the first logo and the second logo may also have different shapes and the same color, and this application does not make any limit.
  • the moving direction of the first sign is the same as the moving direction of the first electronic device relative to the second electronic device, including: When the first electronic device moves left or right relative to the second electronic device, the first sign moves left or right relative to the second sign.
  • the second mark is the position mark when the first electronic device is aligned with the standard charging position of the second electronic device
  • the first mark is a mark indicating the position change of the first electronic device relative to the second electronic device
  • the moving direction of the first sign is the same as the moving direction of the first electronic device relative to the second electronic device, so when the first electronic device moves left or right relative to the second electronic device, the first sign will be opposite to the second electronic device. Move left or right at the second sign.
  • the first electronic device includes a stylus
  • the second electronic device includes a tablet computer
  • the first electronic device includes a watch
  • the second electronic device includes a charging device for the watch.
  • the movement of the first electronic device relative to the second electronic device may not be a translation such as left, right, up, or down, and the first electronic device may move relative to the second electronic device. rotate.
  • the moving direction of the first sign is the same as the moving direction of the first electronic device relative to the second electronic device, including :
  • the first electronic device rotates clockwise or counterclockwise relative to the second electronic device: the first logo rotates clockwise or counterclockwise relative to the second logo, or the first logo rotates around the first electronic device or
  • the center of the screen of the second electronic device is a circle with a center, and the circle moves clockwise or counterclockwise.
  • determining the corresponding display content on the first electronic device or the second electronic device includes: : When the first electronic device is away from the second electronic device and enters an uncharged state, the movement direction of at least one icon displayed on the desktop is the same as or opposite to the movement direction of the first electronic device relative to the second electronic device. Wherein, in some embodiments, it can be judged that the first electronic device is far away from the second electronic device and enters an uncharged state based on the relationship between the magnetic flux in the first electronic device and the preset first magnetic flux and the preset second magnetic flux. That is, the first electronic device is in an uncharged state and the first electronic device has not been separated from the second electronic device.
  • the icon on the desktop of the first electronic device or the second electronic device can also be changed as the user picks up the first electronic device.
  • the relative position changes so that the user can control the direction of picking up the first electronic device according to the requirement, so as to select and click the corresponding icon to start the corresponding application.
  • the mentioned icons may be directly displayed on the desktop, or may be displayed on the desktop in the form of a shortcut application menu, which is not limited in the present application.
  • the movement direction of at least one icon displayed on the desktop is the same as that of the first electronic device relative to the second electronic device.
  • the moving directions are the same, including: when it is detected that the first electronic device moves left or right relative to the second electronic device, at least one icon displayed on the desktop moves left or right.
  • the movement of icons will be specifically introduced below in conjunction with FIG. 11 .
  • the movement direction of at least one icon displayed on the desktop is related to the movement direction of the first electronic device relative to the second electronic device
  • the direction is the same, including: when the clockwise or counterclockwise rotation of the first electronic device relative to the second electronic device is detected: at least one icon displayed on the desktop revolves around the center of the screen of the first electronic device or the second electronic device A circle with the center as the center, travels clockwise or counterclockwise.
  • the movement of the icons designed in this part will be introduced below in conjunction with FIG. 12 to FIG. 14 .
  • the movement direction of at least one icon displayed on the desktop is related to the movement direction of the first electronic device relative to the second electronic device
  • the opposite direction includes: when it is detected that the first electronic device moves left or right relative to the second electronic device, at least one icon displayed on the desktop moves right or left.
  • the movement direction of at least one icon displayed on the desktop is related to the movement direction of the first electronic device relative to the second electronic device The direction is opposite, including: when it is detected that the first electronic device rotates clockwise or counterclockwise relative to the second electronic device: at least one icon displayed on the desktop revolves around the center of the screen of the first electronic device or the second electronic device For the circle with the center, travel counterclockwise or clockwise.
  • the first electronic device or the second electronic device can During the process of picking up the first electronic device, the relative position of the first electronic device relative to the second electronic device changes, and different application option menus are displayed.
  • the display rules of the respective application icons in the different shortcut application menus may be similar to the moving direction of the icons described above.
  • the first shortcut application option menu is displayed on the first electronic device; when the user picks up the first electronic device to the left relative to the second electronic device , the second shortcut application option menu is displayed on the first electronic device, and each application icon in the second shortcut application option menu moves to the left relative to the application icon in the first shortcut application option menu.
  • the determined relative position change determines the corresponding display content on the first electronic device or the second electronic device , including: when the first electronic device is far away from the second electronic device and enters an uncharged state, displaying an application option menu corresponding to the relative position change, where the application option menu includes icons of multiple applications.
  • the plurality of application icons in the application option menu corresponding to the relative position change may be partly the same. Among them, this part of the content will be specifically introduced below in conjunction with FIG. 11 .
  • the first electronic device includes a stylus
  • the multiple different positions on the first electronic device include: the first electronic device of the stylus One end and the second end; and by obtaining changes in the magnetic flux at multiple different positions on the first electronic device, determine the relative position change between the first electronic device and the second electronic device, including: the magnetic flux at the first end
  • determine that the stylus is aligned with the standard charging position of the second electronic device; when the difference between the magnetic flux of the first end and the magnetic flux of the second end is greater than the preset difference
  • it is determined that the first end of the stylus is closer to the standard charging position than the second end; when the difference between the magnetic flux of the first end and the magnetic flux of the second end is less than the preset difference, it is determined that the second end of the stylus is closer to the charging position. It is closer to the standard charging position than the
  • the first electronic device includes a watch; and the multiple different positions on the first electronic device include: a first electronic device located around the watch A position and a second position, the first position is in the counterclockwise direction of the second position, and the angle between the line connecting the first position and the center of the watch and the line connecting the second position and the center of the watch is less than 180 degrees; and through the acquired The variation of the magnetic flux at multiple different positions on the first electronic device, determining the relative position of the first electronic device and the second electronic device, including: the difference between the magnetic flux at the first position and the magnetic flux at the second position is equal to a preset difference value, it is determined that the watch is aligned with the standard charging position of the second electronic device; when the difference between the magnetic flux at the first position and the magnetic flux at the second position is greater than the preset difference, it is determined that the watch is aligned with the second electronic device along the charging position. Moving in a clockwise direction; when the difference between the magnetic flux at the first position and the magnetic flux at the second position is greater than the prese
  • an embodiment of the present application provides an electronic device, where the electronic device includes a memory for storing instructions executed by one or more processors of the electronic device, and
  • the processor is one of the processors of the electronic device, configured to execute the first aspect and the human-computer interaction method in various possible implementation manners of the first aspect.
  • the embodiment of the present application provides a computer-readable storage medium, and instructions are stored in the computer-readable medium, and it is characterized in that, when the instructions are executed on the electronic equipment, the electronic equipment executes the above-mentioned first aspect and the first aspect Various possible implementations of human-computer interaction methods.
  • the embodiment of the present application provides a computer program product, which, when the computer program product runs on the electronic device, causes the electronic device to execute the above-mentioned first aspect and the human-computer interaction method of various possible implementation modes of the first aspect .
  • Fig. 1 is a schematic diagram of a magnetic suction charging scene of a stylus provided by some embodiments
  • Fig. 2 is a schematic diagram of the change of magnetic flux in a stylus provided by some embodiments
  • Fig. 3 is a schematic diagram of changes in magnetic flux in a stylus provided by some embodiments.
  • Fig. 4 is a schematic diagram of user interface (user interface, UI) change of an example tablet computer provided by some embodiments for prompting the charging position of the stylus;
  • Fig. 5 is a schematic diagram of charging a smart watch provided by some embodiments.
  • Fig. 6 is a schematic diagram of UI changes of an example of a smart watch providing charging location prompts provided by some embodiments
  • Fig. 7 is a schematic structural diagram of tablet computer software implementing the method of the present application provided by some embodiments.
  • Fig. 8 is a schematic diagram of the interaction between tablet computer software structures when implementing the method of the present application provided by some embodiments;
  • Fig. 9 is a schematic flowchart of an example of the applicant's computer interaction method provided by some embodiments.
  • Fig. 10 is a schematic diagram of UI changes of an example of launching a shortcut application on a tablet computer provided by some embodiments;
  • Fig. 11 is a schematic UI diagram of an example of a tablet computer displaying a shortcut application option menu provided by some embodiments;
  • Fig. 12 is a schematic UI diagram of an example of a tablet computer displaying a shortcut application option menu provided by some embodiments;
  • Fig. 13 is a schematic UI diagram of an example of a tablet computer displaying a shortcut application option menu provided by some embodiments;
  • Fig. 14 is a schematic diagram of a tablet computer displaying a shortcut application option menu UI provided by some embodiments;
  • Fig. 15 is a schematic diagram of the interaction between tablet computer software structures when implementing the method of the present application provided by some embodiments;
  • Fig. 16 is a schematic flowchart of a method for displaying a shortcut application option menu on a tablet computer provided by some embodiments;
  • Fig. 17 is a schematic diagram of the hardware structure of a stylus provided by some embodiments.
  • Fig. 18 is a schematic diagram of a hardware structure of a tablet computer provided by some embodiments.
  • the embodiment of the present application provides a human-computer interaction method.
  • the tablet computer 100 when the user magnetically attaches the stylus 200 to the tablet computer 100 for charging, the tablet computer 100 not only indicates the battery level, but also indicates whether the stylus 200 is aligned with the magnetic charging position and whether it is aligned with the magnetic attraction.
  • the prompt of the relative position of the charging position is to prompt the user to adjust the position of the stylus 200 so that it can be charged at the magnetic charging position, so as to avoid the heating phenomenon that occurs when the stylus 200 is not aligned with the magnetic charging position for charging, which is beneficial
  • the maintenance of the stylus 200 battery improves the service life of the stylus 200.
  • the tablet computer 100 determines that the stylus 200 is in the magnetic charging state, according to the difference between the magnetic flux on the left and right sides of the magnetic coil of the stylus 200 and the preset first The difference determines the position of the stylus 200 relative to the magnetic charging location.
  • the difference between the magnetic fluxes on the left and right sides of the magnetic coil of the stylus 200 is less than the preset first difference, it indicates that the magnetic flux on the left side of the magnetic coil of the stylus 200 is smaller than the magnetic flux on the right, and the stylus 200 is moving toward the magnetic charging position relative to the magnetic attraction.
  • the preset first difference is the difference between the left and right magnetic flux in the magnetic coil of the stylus 200 when the stylus 200 is aligned with the magnetic charging position for charging, and the preset first difference can be 0, for example.
  • the magnetic flux WL on the left side of the magnetic coil of the stylus 200 is greater than the magnetic flux WR on the right side, that is, (WL-WR) is greater than ⁇ W, which can indicate that the stylus 200 is relatively magnetically charged. 200' offset right.
  • the tablet computer 100 After determining the relative position of the stylus 200 and the magnetic charging position 200 ′, the tablet computer 100 displays the position prompt information corresponding to the relative position, so that the user can adjust the position of the stylus 200 according to the prompt information until the stylus 200 is in contact with the magnetic attraction.
  • the charging position is aligned. For example, when the stylus 200 deviates to the left relative to the magnetic charging position 200 ′, the tablet computer 100 displays a position mark deviated to the left; when the stylus 200 deviates to the right relative to the magnetic charging position 200 ′, the tablet 100 Shows position markers offset to the right.
  • the tablet computer 100 can determine whether the stylus 200 is in the magnetic charging state according to the magnitude relationship between the magnetic flux in the magnetic coil of the stylus 200 and the preset first magnetic flux.
  • the preset magnetic first flux may be the magnetic flux at a certain moment when the stylus 200 is magnetically charged before the stylus 200 is completely separated from the tablet computer 100 , and the preset first magnetic flux may be W0, for example.
  • the size of the magnetic flux in the magnetic coil of the stylus 200 in Figure 3(A) is W4, which is less than the preset first magnetic flux W0, then the stylus 200 and the tablet The computer 100 is separated, that is, the stylus 200 is not in the magnetic charging state.
  • the magnetic flux in the magnetic coil of the stylus 200 is W5, which is greater than the preset first magnetic flux W0, and the stylus 200 is in the magnetic charging state.
  • the tablet computer 100 can also determine whether the stylus 200 is in the magnetic charging state through the proximity light sensor.
  • the stylus 200 and the tablet computer 100 are in the magnetic charging state.
  • the tablet computer 100 determines that the stylus 200 and the tablet computer 100 are in the separated state through the proximity light sensor, it is determined that the stylus 200 and the tablet computer 100 are not in the magnetic charging state.
  • the present application does not limit the manner in which the tablet computer 100 determines whether the stylus 200 is in the magnetic charging state.
  • the applicant's computer interaction method will be described below by taking the relationship between the magnitude of the magnetic flux in the magnetic coil of the stylus 200 and the preset first magnetic flux magnitude to determine whether the stylus 200 is in the magnetic charging state as an example.
  • the "left” and “right” in the left and right sides of the above-mentioned stylus 200 are relative terms, which depend on the phase placement position of the stylus 200 and the tablet computer 100. In other embodiments, the stylus may also be 200 up and down sides, and so on.
  • the applicant's computer interaction method can be applied to various electronic devices that support magnetic charging, including stylus, such as smart watches, smart phones, smart rings, smart headphones, smart speakers, smart sweeping robots, etc.
  • stylus such as smart watches, smart phones, smart rings, smart headphones, smart speakers, smart sweeping robots, etc.
  • This application does not impose any limitation on the specific type of electronic equipment.
  • the applicant's computer interaction method is introduced by using the tablet computer 100 as the stylus 200 for magnetic charging.
  • FIG. 4 shows a schematic diagram of changes in the UI of the stylus 200 performing magnetic charging under the computer interaction method of the present applicant.
  • a pop-up window 110 will pop up on the display interface of the tablet computer 100, and the handwriting will be displayed in the pop-up window 110 simultaneously.
  • the above-mentioned pop-up window 110 can disappear after being displayed for a preset duration, so as to avoid affecting other operations of the user by being displayed for a long time.
  • the present application does not limit the display duration of the pop-up window 110 .
  • the user places the stylus 200 at the position shown in FIG. 4(B) for magnetic charging.
  • the stylus 200 deviates to the right relative to the above-mentioned magnetic charging position 200 ′, and the pop-up window 110 will display
  • the stylus 200 deviates to the right from the position mark 103 of the magnetic charging position, and in order to prompt the user to adjust the position of the stylus 200 to the left, the pop-up window 110 will still display the dotted position mark 101 .
  • the user adjusts the position of the stylus 200 according to the position mark 101 and the position mark 103, and aligns it with the magnetic charging position, as shown in FIG. .
  • the pop-up window 110 will display The stylus 200 deviates to the left from the position mark 104 of the magnetic charging position, and in order to prompt the user to adjust the position of the stylus 200 to the right, the pop-up window 110 will still display the dotted position mark 101 .
  • the user adjusts the position of the stylus 200 according to the position mark 101 and the position mark 104, and aligns it with the magnetic charging position, as shown in FIG. .
  • the user can place the stylus 200 at the magnetic attraction position 200′ for magnetic charging under the prompt of the pop-up window of the tablet computer 100, so as to avoid the phenomenon that the stylus 200 is heated before charging, and improve the use of the stylus. life.
  • the tablet computer 100 when the tablet computer 100 prompts the user to adjust the position of the stylus 200, it can not only use the pop-up window 110 to provide visual prompts, but also remind the user in combination with voice, vibration, etc. This is not limited.
  • the "arrow" used above as the position mark of the stylus 200 is exemplary and does not constitute a limitation on the form of the charging position mark in this application. In other embodiments, the above position mark can also be other This application does not limit this to the symbol of prompting function.
  • the prompting on the tablet computer 100 about the charging capacity and the charging position above is also exemplary.
  • the stylus 200 is also equipped with hardware such as a display device, a voice prompt device or a device, the above prompts can also be performed on the stylus 200, or simultaneously performed on the stylus 200 and the tablet computer 100, which is not limited in this application.
  • a brief introduction will be made below in conjunction with a schematic diagram of the hardware structure of the stylus 200 .
  • the above method is also applicable to the smart watch 300 that supports magnetic charging.
  • the charging process of the smart watch 300 using the above method will be described below with reference to FIG. 5 and FIG. 6 .
  • the difference between the charging method of the smart watch 300 and the magnetic charging method of the stylus 200 is mainly reflected in the prompts about the charging position and the charging quantity, which will be introduced below.
  • FIG. 5(A) and FIG. 5(B) respectively show the display interface 310 and the back 320 of the smart watch 300, wherein the display interface 310 is used to display prompt information about the charging location and charging capacity and realize other smart watches.
  • the display function possessed by the watch 300 is provided with a charging area 330 for magnetic charging on the back 320.
  • the magnetic charging position 331 in the charging area 330 is the same as that in the charging area 410 of the charging device 400 shown in FIG. 5(C).
  • the magnetic suction charging position 411 of the smart watch 300 is matched and placed to realize the magnetic suction charging of the smart watch 300 .
  • the display interface 310 of the smart watch 300 displays a prompt message 313 of the charging state, a current battery level 311, and the current deviation of the smart watch 300 from the figure.
  • the position mark 312 of the magnetic charging position 411 in 5(C) at this time, the user only needs to turn the smart watch 300 clockwise or the charging device 400 counterclockwise in the direction indicated by the position mark 312 until the display interface 310 of the smart watch 300 6(C) shows the position mark 315 in order to realize the magnetic charging of the smart watch 300.
  • the display interface 310 of the smart watch 300 displays the prompt information 313 of the charging state, the current battery 311, and the current smart watch 300 deviates from the position shown in Figure 5 (C)
  • the position mark 314 of the magnetic charging position 411 in (C) at this time, the user only needs to turn the smart watch 300 counterclockwise or the charging device 400 clockwise in the direction indicated by the position mark 314 until the display interface 310 of the smart watch 300 It is displayed as a position mark 315 shown in FIG. 6(C).
  • the user can align the magnetic charging position 331 of the smart watch 300 with the magnetic charging position of the charging device 400 by turning the smart watch 300 or the charging device 400 under the prompt of relevant information on the display interface 310 of the smart watch 300 .
  • the position 411 is used for magnetic charging, avoiding the heating phenomenon caused by the smart watch 300 not being aligned with the magnetic charging position 411 during charging, and improving the service life of the battery of the smart watch 300 .
  • FIG. 7 shows a schematic block diagram of a system architecture of a tablet computer 100 for implementing the human-computer interaction method of the present application according to an embodiment of the present application.
  • the system of the tablet computer 100 includes an application layer 1310 , a framework layer 1320 , a kernel layer 1330 and a hardware layer 1340 .
  • the application layer 1310 may include a series of application packages, such as shorthand application 1310a, drawing application 1310b, address book application 1310c and other programs.
  • the framework layer 1320 includes a window management service (Windows Manager Service) 1320a, a shortcut application option menu determination module 1320b, a magnetic flux acquisition module 1320c, and a position mark determination module 1320d.
  • a window management service Windows Manager Service
  • a shortcut application option menu determination module 1320b a shortcut application option menu determination module
  • a magnetic flux acquisition module 1320c a magnetic flux acquisition module
  • a position mark determination module 1320d a position mark determination module
  • system of the tablet computer 100 may further include a system library layer, which is located between the framework layer and the kernel layer, which is not limited here.
  • the kernel layer 1330 includes a display driver 1330a.
  • the kernel layer 1330 may also include other drivers, such as touch driver, audio driver, etc., which are not limited here.
  • the hardware layer 1340 includes a display screen 1340a.
  • the hardware layer 1340 may also include physical devices such as speakers, motors, Hall sensors, etc., which is not limited here.
  • FIG. 8 shows a schematic diagram of the interaction process in the system of the tablet computer 100 corresponding to the user removing the stylus 200 from the tablet computer 100 . It can be understood that, in the interaction process shown in FIG. 8 , the execution sequence of each step is not limited.
  • the interaction process 800 includes:
  • the Hall sensor 230 on the stylus 200 collects magnetic flux in the stylus 200 .
  • the tablet computer 100 obtains the magnetic flux in the magnetic coil of the stylus 200 through the Hall sensor provided on the stylus 200 .
  • the tablet computer 100 can obtain the magnetic flux on the left side of the magnetic coil of the stylus 200 through the Hall sensor 230L arranged on the left side of the stylus 200 , and obtain the magnetic flux on the left side of the magnetic coil of the stylus 200 through the Hall sensor 230L arranged on the right side of the stylus 200 .
  • the sensor 230R is used to obtain the magnetic flux on the right side of the magnetic coil of the stylus 200 .
  • the Hall sensor 230 of the stylus 200 sends the collected magnetic flux to the magnetic flux acquisition module 1320c of the tablet computer 100 .
  • the connection between the stylus 200 and the tablet computer 100 can be established through an untrusted communication module, or based on a communication protocol. This application is not limited to this. After the stylus 200 establishes a communication connection with the tablet computer 100 , the stylus 200 sends the collected magnetic flux to the magnetic flux acquisition module 1320 c of the tablet computer 100 .
  • the magnetic flux acquisition module 1320c of the tablet computer 100 sends the received magnetic flux of the stylus 200 to the position marker determination module 1320d.
  • the position marker determination module 1320d determines whether the magnetic flux of the stylus 200 is greater than or equal to a preset first magnetic flux. If so, it is determined that the stylus 200 is in the magnetic charging state, and then enters 804, that is, the direction of movement of the stylus 200 is determined according to the change of the magnetic flux on the left and right sides of the stylus 200, that is, according to the change of the magnetic flux on the left and right sides of the stylus 200 The relative position of the stylus 200 and the magnetic charging position 200 ′ is determined. If not, it means that the stylus 200 is separated from the tablet computer 100 , and then go to 801 , that is, the Hall sensor 230 of the stylus 200 continues to collect the magnetic flux of the stylus 200 .
  • the position mark determination module 1320d determines the magnitude relationship between the difference between the magnetic fluxes on the left and right sides of the stylus 200 and the preset first difference, and according to the difference between the magnetic fluxes on the left and right sides of the stylus 200 and the preset first difference The size relationship between them determines the moving direction of the stylus 200 and the corresponding position mark.
  • the position mark module 1320 d determines the position mark 103 (as shown in FIG. 4(B )) where the stylus 200 deviates to the right.
  • the difference W ⁇ of the magnetic flux on the left and right sides of the magnetic coil of the stylus 200 is less than the preset first difference ⁇ W, it indicates that the magnetic flux on the left side of the magnetic coil of the stylus 200 is smaller than the magnetic flux on the right side, and it can be determined that the stylus 200 is relatively
  • the magnetic charging position 200 ′ deviates to the left, and the position mark module 1320 d determines the position mark 104 of the position mark 104 that the stylus 200 deviates to the right (as shown in FIG. 4(C) ).
  • the position flag module 1320d determines that the position flag is handwritten The position marker 101 where the pen 200 deviates to the right (as shown in FIG. 4(D)).
  • the location marker determining module 1320d reports the moving direction of the stylus 200 and the identifier corresponding to the location marker to the window management service 1320a.
  • the moving direction of the stylus 200 and the information corresponding to the position mark can be a kind of identification, for example, the position mark of deviation to the left and the position deviation to the left can be the mark "left", deviation to the right and direction to the left
  • the right-deviating position flag may be the flag "right”.
  • the above identifier may take other forms, such as numbers, character strings, etc., which are not limited in the present application.
  • the window management service 1320a sends to the resource management module 1320e an instruction requesting to call the display resource corresponding to the shortcut application option menu.
  • the resource management module 1320e stores the display resource information related to the charging power and the location mark of the stylus 200, and when the window management service 1320a needs to display the corresponding position mark and charging power, it needs to initiate the resource management module 1320e. Resource request directive.
  • the above display resource information includes, but is not limited to, the charging quantity or the display position, display icon, display size, etc. of the location mark.
  • the resource management module 1320a returns corresponding display resource data to the window management service 1320a.
  • the window management service 1320a sends the display resource data to the display driver 1330a.
  • the display driver 1330a sends display resource data to the display screen 1340a.
  • the display screen 1340a displays the above display resource data.
  • the following human-computer interaction method can be implemented on the tablet computer 100, or can be implemented on the stylus 200, and can also be implemented by the cooperation of the tablet computer 100 and the stylus 200, for example, on the tablet computer 100 Carry out relevant data processing, display the prompt information of the current battery level on the stylus 200 and the prompt information of the relative position between the stylus 200 and the magnetic charging position 200 ′, or perform relevant data processing on the stylus 200 , and display the prompt information on the tablet computer 100
  • the power prompt information and the prompt information of the relative position of the stylus 200 and the magnetic charging position 200 ′ are displayed on the screen, which is not limited in the present application.
  • implementation of the method on the tablet computer 100 is taken as an example for description below.
  • the method 700 includes:
  • the difference W ⁇ of the magnetic flux on the left and right sides of the magnetic coil of the stylus 200 is greater than the preset first difference ⁇ W, it indicates that the magnetic flux on the left side of the magnetic coil of the stylus 200 is greater than the magnetic flux on the right side, so it can be determined
  • the stylus 200 deviates to the right relative to the magnetic charging position 200 ′, and then enters 905 , that is, the tablet computer 100 displays the position mark 103 of the stylus 200 deviated to the right (as shown in FIG. 4(B) ).
  • the difference W ⁇ of the magnetic flux on the left and right sides of the magnetic coil of the stylus 200 is less than the preset first difference ⁇ W, it indicates that the magnetic flux on the left side of the magnetic coil of the stylus 200 is smaller than the magnetic flux on the right side, and it can be determined that the stylus 200 is relatively If the magnetic charging position 200' deviates to the left, go to 906, that is, the tablet computer 100 displays the position mark 104 of the stylus 200 deviated to the left relative to the magnetic charging position 200' (as shown in FIG. 4(C)).
  • the difference W ⁇ of the magnetic flux on the left and right sides of the magnetic coil of the stylus 200 is equal to the preset first difference ⁇ W, it indicates that the stylus 200 has been aligned with the magnetic charging position 200′, and then enters 907, that is, the tablet computer 100 displays handwriting The pen 200 is aligned with the position mark 101 of the magnetic charging position 200' (as shown in FIG. 4(D)).
  • FIGS. 10(A) to 10(B) when the user picks up the stylus 200 being magnetically charged from the tablet computer 100 shown in FIG. 10(A), The tablet computer 100 enters the shorthand application interface 130 shown in FIG. 10(B) from the lock screen interface 120 shown in FIG. 10(A), so that the user can realize the shorthand function.
  • lock screen interface 120 in FIG. 10(A) is only exemplary, and in other embodiments, it can also be other interfaces, such as the main interface of the tablet computer 100, or interfaces of other applications, such as WeChat Application interface, Kugou Music The application interface and the like are not limited in this application.
  • the shorthand application interface in FIG. 10(B) is also exemplary.
  • the tablet computer 100 can start and enter the interface of other applications , such as memo interface, iQiyi
  • the application interface and the like are not limited in this application.
  • the interface displayed on the tablet 100 is the same as that of the tablet 100 when the user places the stylus 200 on the tablet 100 for magnetic charging. related to the displayed interface. For example, when the user is using the above-mentioned WeChat application to chat, the user places the stylus 200 on the tablet computer 100 for charging, and then the tablet computer 100 displays the chat interface of the WeChat application.
  • the tablet computer 100 may directly enter the lock screen state shown in FIG. 10(A) from the currently displayed interface, or, when the user puts the After the stylus 200 is placed on the tablet computer 100, at intervals of several seconds, when the user's next operation on the tablet computer 100 is not detected, the screen lock state as shown in FIG. 10(A) will be entered again. No limit.
  • the user can set the above-mentioned shortcut application as an application frequently used by the user through the system settings of the tablet computer 100, then when the user removes the stylus 200 from the tablet computer 100, the tablet computer 100 starts and Enter the interface of the application set by the user.
  • the tablet computer 100 in order to avoid conflicts between the applications started by the tablet computer 100, when the user removes the stylus 200 from the tablet computer 100, the tablet computer 100 can determine whether other applications are currently running on the tablet computer 100, if If there are no other application programs running on the tablet computer 100, start the above-mentioned shortcut application and enter the above-mentioned shortcut application interface; No restrictions are imposed.
  • the above-mentioned method of starting and entering the shortcut application is beneficial to save the user's operation steps and improve the user experience.
  • the above-mentioned method of directly entering the shortcut application interface does not give the user sufficient choice space, that is, when the user removes the stylus 200 from the tablet computer 100, he can only passively accept the information displayed on the tablet computer 100. interface, it is impossible to independently select and control the shortcut applications to be accessed by the tablet computer 100 .
  • the tablet computer 100 when the user removes the stylus 200 from the tablet computer 100, the tablet computer 100 does not directly enter the interface of a certain application, but It is an option menu interface that displays various applications. Moreover, the content of the option menu interface changes according to the direction in which the user removes the stylus 200 from the tablet computer 100 , so as to provide sufficient selection space for the user and improve user experience.
  • the tablet computer 100 judges handwriting according to the relationship between the difference between the magnetic flux on the left and right sides of the magnetic coil and the preset second difference when the stylus 200 is separated from the tablet computer 100 .
  • the orientation of the pen 200 when detached relative to the tablet computer 100 is the preset second difference is the difference between the magnetic fluxes on the left and right sides of the magnetic coil of the stylus 200 at the position where the stylus 200 is magnetically charged before it is separated from the tablet 100, and the second difference is preset For example, it can be 0. It can be understood that when the user picks up the stylus 200 from the tablet computer 100 and the stylus 200 is aligned with the magnetic charging position 200 ′, the preset second difference is equal to the preset first difference.
  • the first shortcut application option menu interface is displayed. If the tablet computer 100 is separated from the tablet computer 100 according to the stylus 200, the difference between the magnetic fluxes on the left and right sides of the magnetic coil of the stylus 100 is less than the preset second difference value, it indicates that the stylus 200 moves in a direction opposite to the position corresponding to the preset second difference, and then a second shortcut application option menu interface different from the first shortcut application option menu interface is displayed.
  • the tablet computer 100 can determine whether the stylus 200 is in the magnetic charging state according to the magnitude of the magnetic flux in the magnetic coil of the stylus 200, that is, whether the stylus 200 is connected to the tablet.
  • the computer 100 is separated.
  • the magnetic flux in the magnetic coil of the stylus 200 is greater than or equal to the preset second magnetic flux, it is determined that the stylus 200 will be separated from the tablet computer 100, and then according to the difference between the magnetic flux on the left and right sides of the magnetic coil of the stylus 200 at this time and the predetermined
  • the relationship between the first difference values is assumed to determine the direction of the stylus 200 when it is separated from the tablet computer 100 .
  • the preset second magnetic flux is the magnetic flux at a certain moment before the stylus 200 is separated from the tablet computer 100 , the preset second magnetic flux is less than or equal to the preset first magnetic flux, and the preset second magnetic flux can be, for example, W1.
  • FIG. 11 shows a schematic diagram of UI changes of the shortcut application option menu displayed on the tablet computer 100 when the stylus 200 is separated from the tablet computer 100 in different directions.
  • the S area of the tablet computer 100 displays an option menu interface 150, which Including "browser application” 143, “camera application” 144, “phone application” 145, “short message application” 146, and “contact application” 147. Comparing FIG. 11(A), it can be seen that the applications included in the interface 150 are equivalent to the applications included in the interface 140 moving to the left.
  • the S area of the tablet computer 100 displays an option menu interface 160, which It includes "gallery application” 138, “shorthand application” 139, “health application” 141, “weather application” 142, and “browser application” 143. Comparing FIG. 11(A), it can be seen that the applications included in the interface 160 are equivalent to the applications included in the interface 140 moving to the right.
  • the applications included in the above-mentioned various option menu interfaces are only exemplary.
  • the above-mentioned various option menu interfaces may also include other applications, and the arrangement order of the applications included in each option menu interface may be It has an arrangement rule similar to that of the applications included in the interface 140, the interface 150, and the interface 160, which is not limited in the present application.
  • the user picks up the smart watch 300 relative to the charging device 400, and the smart watch 300 enters an option menu interface 330 as shown in FIG. , "Camera Application” 302, "Phone Application” 303.
  • the user picks up the smart watch 300 to the right relative to the charging device 400, and the smart watch 300 enters an option menu interface 340 as shown in FIG. 13(B), and the interface 330 includes "Gallery Application” 301 , “Camera Application” 302 , “Phone Application” 303 , “Message Application” 304 , and “Contacts Application” 305 .
  • the applications included in the interface 340 in FIG. 13(B) are obtained by rotating the applications included in the interface 330 clockwise.
  • the user picks up the smart watch 300 to the left relative to the charging device 400, and the smart watch 300 enters the option menu interface 350 as shown in FIG. 14(B), and the interface 330 includes "camera application” 302 , "phone application” 303 , "information application” 304 , "contact application” 305 , and "gallery application” 306 .
  • the applications included in the interface 360 in FIG. 14(B) are obtained by rotating the applications included in the interface 330 counterclockwise.
  • the tablet computer 100 can provide the user with an option menu interface including abundant shortcut applications according to the direction in which the user picks up the stylus 200 from the tablet computer 100 for the user to choose.
  • the smart watch 300 can also provide the user with an option menu interface including a variety of shortcut applications according to the direction in which the user picks up the smart watch 300 from the charging device 400 for the user to choose.
  • FIG. 15 shows a schematic diagram of the interaction process in the system of the tablet computer 100 corresponding to the user removing the stylus 200 from the tablet computer 100 . It can be understood that, in the interaction process shown in FIG. 15 , the execution sequence of each step is not limited. In addition, for the implementation process in method 1500 that is the same as or similar to that in the above method, reference may be made to the above related description, and details will not be repeated below.
  • the interaction process 1500 includes:
  • the Hall sensor 230 on the stylus 200 collects the magnetic flux in the stylus 200 .
  • the Hall sensor 230 of the stylus 200 sends the collected magnetic flux to the magnetic flux acquisition module 1320c of the tablet computer 100 .
  • the magnetic flux acquisition module 1320c of the tablet computer 100 sends the received magnetic flux of the stylus 200 to the shortcut application option menu determination module 1320b.
  • the shortcut application option menu determination module 1320b determines whether the magnetic flux of the stylus 200 is greater than or equal to a preset second magnetic flux. If yes, it is determined that the stylus 200 and the tablet computer 100 are about to be separated, and then go to 1505 , that is, determine the moving direction of the stylus 200 according to the change of the magnetic flux on the left and right sides of the stylus 200 . If not, it indicates that the stylus 200 is in the charging state, and then go to step 1501 , that is, the Hall sensor 230 of the stylus 200 continues to collect the magnetic flux of the stylus 200 .
  • the shortcut application option menu determination module 1320b determines the size relationship between the difference between the magnetic flux on the left and right sides of the stylus 200 and the preset second difference, and according to the difference between the magnetic flux on the left and right sides of the stylus 200 and the preset second difference The magnitude relationship between the difference values determines the moving direction of the stylus 200 and the corresponding shortcut application option menu.
  • the shortcut application option menu determination module 1320b reports the moving direction of the stylus 200 and the corresponding identifier of the shortcut application option menu to the window management service 1320a.
  • the window management service 1320a sends an instruction to the resource management module 1320e requesting to call the display resource corresponding to the shortcut application option menu.
  • the resource management module 1320a returns the corresponding display resource data to the window management service 1320a.
  • the window management service 1320a sends the display resource data to the display driver 1330a.
  • the display driver 1330a sends display resource data to the display screen 1340a.
  • the display screen 1340a displays the above display resource data.
  • method 1600 includes:
  • the manner in which the tablet computer 100 obtains the magnetic flux of the magnetic coil of the stylus 200 is consistent with the method 701 described above, and will not be repeated here.
  • step 1602. Determine whether the magnetic flux in the magnetic coil of the stylus 200 is greater than or equal to a preset second magnetic flux. If the magnetic flux in the magnetic coil of the stylus 200 is greater than or equal to the preset second magnetic flux, it indicates that the stylus 200 will be separated from the tablet computer 100, and then enter 1603, that is, continue to judge the magnetic flux of the left and right sides of the magnetic coil of the stylus 100 The magnitude between the difference and the preset second difference is used to determine the direction of the stylus 100 when it is separated from the tablet computer 100; Still in the magnetic charging stage, go to step 1602 , that is, continuously detect the magnitude of the magnetic flux in the magnetic coil of the stylus 200 to determine when the stylus 200 will be separated from the tablet computer 100 .
  • the way of judging the change of the magnetic flux in the stylus 200 can refer to the relevant description in the above method 700, and will not be repeated here.
  • the preset second difference is the difference between the magnetic fluxes on the left and right sides of the magnetic coil when the stylus 200 is charging before the stylus 200 is separated from the tablet computer 100 .
  • the process enters 1605, that is, the second shortcut application option menu is displayed.
  • step 1606 When the stylus 200 is separated from the tablet computer 100, if the difference between the magnetic fluxes on the left and right sides of the magnetic coil of the stylus 200 is equal to the preset second difference, it indicates that the stylus 200 has not occurred when the tablet 100 is separated. If there is a deviation in the relative direction (as shown in FIG. 11(A)), go to step 1606, that is, display the third shortcut application option menu.
  • the preset second difference is W2 (and W2 is greater than 0).
  • the difference in magnetic flux between the left and right sides of the magnetic coil of the stylus 200 is W3, if W3 is greater than W2, It indicates that the difference between the magnetic flux on the left side and the magnetic flux on the right side in the magnetic coil of the stylus 200 further increases, that is, the stylus 200 moves to the right again relative to the above-mentioned magnetic charging position 200 ′, and at this time, the first Quick app menu.
  • the first shortcut application option menu can be set by the user through the system settings of the tablet computer 100 according to his own preferences. In some other embodiments, the first shortcut application option menu may also be generated by the tablet computer 100 according to the usage habits of the user. Wherein, the tablet computer 100 may update the first shortcut application option menu at preset time intervals according to the user's habit of using a certain application. For example, the tablet computer 100 may update the first shortcut application option menu at preset intervals according to the number of times the user uses a specific application. Wherein, the preset duration may be 1 day, 2 days or 7 days, etc., which is not limited in this application.
  • the setting method of the second shortcut application option menu is similar to that of the first shortcut application option menu above, and will not be repeated here.
  • the application options included in the second shortcut application options menu may be partly the same as the application options included in the first shortcut application options menu, for example, as shown in FIG. 11(A) to FIG. 11(C), the option Menu 140 has the same applications as options menu 150 and options menu 160 .
  • the application options included in the second shortcut application option menu may be completely different from the application options included in the first shortcut application option menu. This application is not limited to this.
  • the setting method of the third shortcut application option menu is similar to that of the first shortcut application option menu and the second shortcut application option menu above, and will not be repeated here.
  • FIG. 17 shows a schematic diagram of a hardware structure of a stylus 200 provided by an embodiment of the present application.
  • the stylus 200 may include a microprocessor 210 , a memory 220 , a Hall sensor 230 , a proximity light sensor 240 , a power management unit 250 , and a power supply 260 . It can be understood that the results shown in the embodiment of the present application do not constitute a specific limitation on the stylus 200 .
  • the stylus 200 may include more or fewer components than those shown in the illustration, for example, a display screen, a motor, a speaker, a pressure sensor, etc., or some components may be combined, or some components may be separated. components, or different arrangements of components.
  • the illustrated components may be realized in hardware, software, or a combination of software and hardware. This application is not limited to this.
  • the microprocessor 210 is used to analyze and process the data collected by the various sensors of the stylus 200, such as the Hall sensor 230 and the proximity light sensor 240, and store the processing results in the memory 220, or through the wireless communication module (in the figure) not shown) to the tablet computer 100 for subsequent processing.
  • the microprocessor 210 can use the above method to determine whether the stylus 200 is being magnetically charged according to the magnetic flux in the magnetic coil of the stylus 200 acquired by the Hall sensor 230, and the stylus 200 is relatively The position of the tablet computer 100 is moved, and then the processing result is sent to the tablet computer 100, so that the tablet computer 100 displays corresponding prompt information or a shortcut application option menu interface according to the processing result.
  • the memory 220 may be used to store computer-executable program code, which includes instructions.
  • the memory 220 may include an area for storing programs and an area for storing data.
  • the stored program area can store an operating system, an application program required by at least one function, and the like.
  • the storage data area can store data created during the use of the tablet computer 100 , such as the magnetic flux of the stylus 200 acquired by the tablet computer 100 or the intermediate results generated when the microprocessor 210 implements the methods described in the above-mentioned embodiments.
  • the memory 220 may store the display data of the display interface corresponding to the above-mentioned FIGS. 4 to 14 and the magnetic flux of the stylus 200 .
  • the power management module 250 is configured to receive charging input from the charger.
  • the power management module 250 is used for connecting the battery 260 and the microprocessor 10 .
  • the power management module 250 receives the input of the battery 260 to provide power for the microprocessor 210 , the memory 220 , the Hall sensor 230 and the proximity light sensor 240 .
  • the stylus 200 can determine whether the stylus 200 is being magnetically charged according to the detected charging power of the power management module 250. For example, assuming that the charging power is 90% when charging at full power, then when When the power management module 250 detects that the charging power of the stylus 200 is less than 5%, it can determine that the stylus 200 is not in the magnetic charging state at this time, which is not limited in this application.
  • Proximity light sensing 240 may include, for example, light emitting diodes (LEDs) and light detectors, such as photodiodes.
  • the light emitting diodes may be infrared light diodes.
  • the tablet computer 100 emits infrared light through the LED. Tablet 100 uses photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it may be determined that there is an object in the vicinity of the tablet computer 100 . When insufficient reflected light is detected, the tablet computer 100 may determine that there is no object near the tablet computer 100 .
  • the tablet computer 100 can use the proximity light sensor 240 to detect that the user holds the stylus 200 away from the tablet computer 100 to determine that the stylus 200 will be separated from the tablet computer 100 .
  • the Hall sensor 230 is used to detect the magnitude of the magnetic flux passing through the magnetic coil of the stylus 200 .
  • the magnitude of the magnetic flux detected by the Hall sensor 230 can not only be expressed directly by magnetic flux (unit: Weber), but also can be expressed in other indirect ways.
  • the Hall sensor 230 can express the magnitude of the magnetic flux by current (unit: ampere) or voltage (unit: : volts), which is not limited in this application.
  • Hall sensors 230 there may be multiple Hall sensors 230 , which are arranged regularly or randomly on the side of the stylus 200 where magnetic charging is performed.
  • the Hall sensor 230 can also be arranged in the stylus 200 in the form of a Hall sensor array. It should be understood that the present application does not limit the number and arrangement of the Hall sensors 230 .
  • FIG. 18 shows a schematic structural diagram of a tablet computer 100 according to an embodiment of the present application.
  • the tablet computer 100 may include a processor 10, a screen 21, an internal memory 11, a SIM card interface 14, a USB interface 15, a charge management module 16, a power management module 16A, a battery 16B, a motor 17, a proximity light sensor 18A, and a Hall sensor 18B , speaker 19, wireless communication module 20, display screen 21.
  • the structure shown in the embodiment of the present application does not constitute a specific limitation on the tablet computer 100 .
  • the tablet computer 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the processor 10 may include one or more processing units, for example: the processor 10 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU), etc. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • GPU graphics processing unit
  • ISP image signal processor
  • controller video codec
  • digital signal processor digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit
  • a memory may also be provided in the processor 10 for storing instructions and data.
  • the processor 10 may execute the methods described in the foregoing embodiments.
  • the internal memory 11 may be used to store computer-executable program codes including instructions.
  • the internal memory 11 may include an area for storing programs and an area for storing data.
  • the stored program area can store an operating system, an application program required by at least one function, and the like.
  • the storage data area can store data created during the use of the tablet computer 100 , such as the magnetic flux of the stylus 200 acquired by the tablet computer 100 or the intermediate results generated when the processor 10 implements the methods described in the above-mentioned embodiments.
  • the internal memory 11 may store the display data of the corresponding display interfaces in FIGS. 4 to 12 and the magnetic flux of the stylus 200 acquired by the tablet computer 100 .
  • the external memory interface 13 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the tablet computer 100.
  • the external memory card communicates with the processor 10 through the external memory interface 13 to realize the data storage function.
  • the magnetic flux data of the above-mentioned stylus 200 is stored in the external memory interface 13 .
  • USB interface 130 is the interface that accords with USB standard specification, specifically can be Mini USB interface, Micro USB interface, USB Type C interface etc.
  • the charging management module 16 is configured to receive charging input from the charger.
  • the power management module 16A is used for connecting the battery 16B, the charging management module 16 and the processor 10 .
  • the power management module 16A receives the input from the battery 16B and/or the charging management module 16 to provide power for the processor 10 , the internal memory 11 , the display screen 21 and the wireless communication module 20 .
  • the display screen 21 is used to display images, videos and the like.
  • the tablet computer 100 displays on the display screen 21 the battery prompt information of the stylus 200 , the alignment status prompt information, and the like.
  • the tablet computer 100 displays UI interfaces related to the above-mentioned embodiments on the display screen 21 .
  • the wireless communication module 20 can provide wireless local area network (wireless local area networks, WLAN) (such as wireless fidelity (wireless fidelity, Wi-Fi) network), bluetooth (bluetooth, BT), global navigation satellite Wireless communication solutions such as global navigation satellite system (GNSS), frequency modulation (FM), nearfield communication (NFC), and infrared technology (IR).
  • WLAN wireless local area networks
  • WLAN wireless local area networks
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC nearfield communication
  • IR infrared technology
  • the tablet computer 100 and the stylus 200 establish a communication connection through the wireless communication module 20 for data transmission.
  • the tablet computer 100 sends the result of judging the size of the magnetic flux of the stylus 200 to the stylus 200, and then the stylus 200 displays a power prompt and an alignment status prompt message about the stylus 200, or the stylus 200 passes through the wireless communication module 20.
  • the magnetic flux obtained by using the Hall sensor 230 is transmitted to the tablet computer 100 , so that the tablet computer 100 can subsequently determine the charging state and position of the stylus 200 . It should be understood that the present application does not impose any limitation on the data transmission process and the transmitted data between the tablet computer 100 and the stylus 200 .
  • the speaker 19 is a transducing device that converts electrical signals into acoustic signals.
  • the speaker 19 can cooperate with the motor 17 and the display screen 21 to realize the battery prompt of the stylus 200 and the The function of prompting the status is not limited in this application.
  • the speaker 19 voice broadcasts the current battery level of the stylus 200, and the voice playback prompts the user how to move the stylus 200 so that it can be aligned with the magnetic charging position. This application is not limited to this.
  • the motor 17 can generate vibration prompts.
  • Motor 17 can be used for incoming call vibration reminder.
  • the motor 17 can cooperate with the speaker 19 and the display screen 21 to realize the reminder of the battery level and the alignment state of the stylus 200.
  • the motor 17 Different vibration feedback effects can be obtained. For example, if the stylus 200 is aligned with the magnetic attraction position, the motor 17 can vibrate 3 times. If the stylus 200 deviates from the magnetic attraction position to the right, the motor 17 can vibrate 4 times. When deviating from the magnetic suction position to the left, the motor 17 can vibrate twice. This application is not limited to this.
  • Proximity light sensor 18A may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode.
  • the light emitting diodes may be infrared light diodes.
  • the tablet computer 100 emits infrared light through the LED. Tablet 100 uses photodiodes to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object in the vicinity of the tablet computer 100. When insufficient reflected light is detected, the tablet computer 100 may determine that there is no object near the tablet computer 100 .
  • the tablet computer 100 can use the proximity light sensor 18A to detect that the user holds the stylus 200 away from the tablet computer 100 to determine that the stylus 200 will be separated from the tablet computer 100 .
  • the embodiment of the present application also provides an electronic device, the electronic device includes: a Hall sensor, the user acquires the magnetic flux in the magnetic coil in the electronic device, at least one processor, a memory, and stored in the memory and can be A computer program running on the at least one processor, when the processor executes the computer program, the steps in any of the foregoing method embodiments are implemented.
  • the embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps in each of the foregoing method embodiments can be realized.
  • An embodiment of the present application provides a computer program product.
  • the computer program product When the computer program product is run on a mobile terminal, the mobile terminal can implement the steps in the foregoing method embodiments when executed.
  • the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, all or part of the procedures in the method of the above-mentioned embodiments in the present application can be completed by instructing related hardware through a computer program.
  • the computer program can be stored in a computer-readable storage medium.
  • the computer program When executed by a processor, the steps in the above-mentioned various method embodiments can be realized.
  • the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file or some intermediate form.
  • the computer-readable medium may at least include: any entity or device capable of carrying computer program codes to a photographing device/terminal device, a recording medium, a computer memory, a read-only memory (ROM), a random access memory (random access memory, RAM), electrical carrier signals, telecommunication signals, and software distribution media.
  • a photographing device/terminal device a recording medium
  • a computer memory a read-only memory (ROM), a random access memory (random access memory, RAM), electrical carrier signals, telecommunication signals, and software distribution media.
  • ROM read-only memory
  • RAM random access memory
  • electrical carrier signals telecommunication signals
  • software distribution media such as U disk, mobile hard disk, magnetic disk or optical disk, etc.
  • computer readable media may not be electrical carrier signals and telecommunication signals under legislation and patent practice.
  • the disclosed device/network device and method may be implemented in other ways.
  • the device/network device embodiments described above are only illustrative.
  • the division of the modules or units is only a logical function division.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be in electrical, mechanical or other forms.
  • the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or may be distributed to multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.
  • the term “if” may be construed as “when” or “once” or “in response to determining” or “in response to detecting” depending on the context.
  • the phrase “if determined” or “if [the described condition or event] is detected” may be construed, depending on the context, to mean “once determined” or “in response to the determination” or “once detected [the described condition or event] ]” or “in response to detection of [described condition or event]”.
  • references to "one embodiment” or “some embodiments” or the like in the specification of the present application means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the present application.
  • appearances of the phrases “in one embodiment,” “in some embodiments,” “in other embodiments,” “in other embodiments,” etc. in various places in this specification are not necessarily All refer to the same embodiment, but mean “one or more but not all embodiments” unless specifically stated otherwise.
  • the terms “including”, “comprising”, “having” and variations thereof mean “including but not limited to”, unless specifically stated otherwise.

Abstract

La présente demande concerne le domaine technique des terminaux et, en particulier, un procédé d'interaction homme-machine, et un dispositif électronique et un support associés. Dans le procédé d'interaction homme-machine de la présente demande, lorsqu'une tablette numérique charge un stylet d'écriture, un repère de positionnement peut être affiché de manière synchrone sur la tablette numérique ou le stylet d'écriture, et le repère de positionnement peut présenter, à un utilisateur, la position du stylet d'écriture par rapport à une position de charge standard de la tablette numérique, de telle sorte que l'utilisateur peut savoir, en fonction du repère de positionnement, si le stylet d'écriture est aligné avec la position de charge standard de la tablette numérique ; et lorsque le stylet d'écriture n'est pas aligné avec la position de charge, l'utilisateur peut ajuster la position du stylet d'écriture ou de la tablette numérique selon le repère de positionnement, de façon à ce que le stylet d'écriture soit aligné avec la position de charge standard de la tablette numérique. Grâce à ce procédé, un phénomène d'émission de chaleur observé dans la solution technique actuelle et provoqué par la charge d'un stylet d'écriture à une faible puissance car le stylet d'écriture n'est pas aligné avec une position de charge standard (ou une position de charge à attraction magnétique) d'une tablette numérique peut être amélioré.
PCT/CN2022/134054 2021-12-06 2022-11-24 Procédé d'interaction homme-machine, et dispositif électronique et support associés WO2023103797A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111480808.0 2021-12-06
CN202111480808.0A CN116317187A (zh) 2021-12-06 2021-12-06 人机交互方法、电子设备及其介质

Publications (1)

Publication Number Publication Date
WO2023103797A1 true WO2023103797A1 (fr) 2023-06-15

Family

ID=86729608

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/134054 WO2023103797A1 (fr) 2021-12-06 2022-11-24 Procédé d'interaction homme-machine, et dispositif électronique et support associés

Country Status (2)

Country Link
CN (1) CN116317187A (fr)
WO (1) WO2023103797A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160246265A1 (en) * 2015-02-24 2016-08-25 Samsung Electronics Co., Ltd. Electronic device and method of correcting position thereof
CN105958658A (zh) * 2016-05-20 2016-09-21 联想(北京)有限公司 一种充电位置提示方法及电子设备
CN106300703A (zh) * 2016-09-30 2017-01-04 福建工程学院 一种智能鞋的无线充电方法及系统
CN107294154A (zh) * 2016-04-05 2017-10-24 现代自动车美国技术研究所 Ev无线充电可调节磁通量角度充电器

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160246265A1 (en) * 2015-02-24 2016-08-25 Samsung Electronics Co., Ltd. Electronic device and method of correcting position thereof
CN107294154A (zh) * 2016-04-05 2017-10-24 现代自动车美国技术研究所 Ev无线充电可调节磁通量角度充电器
CN105958658A (zh) * 2016-05-20 2016-09-21 联想(北京)有限公司 一种充电位置提示方法及电子设备
CN106300703A (zh) * 2016-09-30 2017-01-04 福建工程学院 一种智能鞋的无线充电方法及系统

Also Published As

Publication number Publication date
CN116317187A (zh) 2023-06-23

Similar Documents

Publication Publication Date Title
US20220004313A1 (en) Display Method and Apparatus
KR102051908B1 (ko) 정보를 디스플레이하는 모바일 장치 및 방법
US20230110064A1 (en) Data sharing method, graphical user interface, electronic device, and system
JP6228676B2 (ja) 接続状態プロンプティング方法および装置
US20210204127A1 (en) Image Sharing Method and System, and Electronic Device
WO2014204089A1 (fr) Dispositif électronique et procédé d'exécution d'objet sur le dispositif électronique
KR102015534B1 (ko) 복수의 단말들간의 메시지 싱크 방법, 기계로 읽을 수 있는 저장 매체 및 서버
US20130331147A1 (en) Service providing system including display device and mobile device, and method for providing service using the same
CN112947823A (zh) 会话处理方法、装置、设备及存储介质
US11372537B2 (en) Image sharing method and electronic device
KR101227331B1 (ko) 데이터 송수신 방법 및 그를 이용한 디스플레이 장치
JP2017529636A (ja) 移動端末機及びその制御方法
KR20150103294A (ko) 사용자 디바이스들 사이에서 데이터를 무선으로 공유하기 위한 시스템 및 방법
KR20140127031A (ko) 대역외 채널을 이용한 무선 연결 방법, 저장 매체 및 전자 장치
JP2015115046A (ja) 情報処理装置、プログラム、情報処理方法及び情報処理システム
WO2014163333A1 (fr) Procédé d'affichage d'interface utilisateur et appareil associé
US20200162871A1 (en) Electronic apparatus and method of outputting content by the electronic apparatus
CN110870353B (zh) 一种WiFi连接的方法及终端
US20150293670A1 (en) Method for operating message and electronic device therefor
CN113518237A (zh) 语音直播方法、装置、计算机设备及存储介质
US11921968B2 (en) Method for interaction between devices based on pointing operation, and electronic device
WO2022048453A1 (fr) Procédé de déverrouillage et dispositif électronique
KR20180017638A (ko) 이동단말기 및 그 제어방법
WO2023103797A1 (fr) Procédé d'interaction homme-machine, et dispositif électronique et support associés
KR20150007090A (ko) 위치 기반 서비스를 제공하는 방법, 전자 장치 및 컴퓨터 판독 가능한 기록 매체

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22903220

Country of ref document: EP

Kind code of ref document: A1