WO2021190338A1 - 内容传输方法、设备及介质 - Google Patents

内容传输方法、设备及介质 Download PDF

Info

Publication number
WO2021190338A1
WO2021190338A1 PCT/CN2021/080794 CN2021080794W WO2021190338A1 WO 2021190338 A1 WO2021190338 A1 WO 2021190338A1 CN 2021080794 W CN2021080794 W CN 2021080794W WO 2021190338 A1 WO2021190338 A1 WO 2021190338A1
Authority
WO
WIPO (PCT)
Prior art keywords
transmission
distance
content
mobile phone
computer
Prior art date
Application number
PCT/CN2021/080794
Other languages
English (en)
French (fr)
Inventor
张大鹏
陈晨
刘国强
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP21775226.0A priority Critical patent/EP4116800A4/en
Priority to CN202180021450.7A priority patent/CN115280263A/zh
Publication of WO2021190338A1 publication Critical patent/WO2021190338A1/zh
Priority to US17/951,902 priority patent/US20230042460A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/023Services making use of location information using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1694Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/1633Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
    • G06F1/1684Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675
    • G06F1/1698Constructional details or arrangements related to integrated I/O peripherals not covered by groups G06F1/1635 - G06F1/1675 the I/O peripheral being a sending/receiving arrangement to establish a cordless communication link, e.g. radio or infrared link, integrated cellular phone
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • G06F9/453Help systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04BTRANSMISSION
    • H04B5/00Near-field transmission systems, e.g. inductive or capacitive transmission systems
    • H04B5/70Near-field transmission systems, e.g. inductive or capacitive transmission systems specially adapted for specific purposes
    • H04B5/73Near-field transmission systems, e.g. inductive or capacitive transmission systems specially adapted for specific purposes for taking measurements, e.g. using sensing coils
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72412User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72448User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions
    • H04M1/72454User interfaces specially adapted for cordless or mobile telephones with means for adapting the functionality of the device according to specific conditions according to context-related or environment-related conditions
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/80Services using short range communication, e.g. near-field communication [NFC], radio-frequency identification [RFID] or low energy communication
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/60Software deployment

Definitions

  • This application relates to a content transmission method, device and medium.
  • each user may have multiple terminal devices (such as mobile phones, tablets, desktop computers, etc.).
  • the content synchronization and transmission between terminal devices are becoming more and more frequent, and the simplicity and convenience of transmission methods will be extremely high.
  • the earth affects the work and life efficiency of users.
  • the purpose of this application is to provide a concise and easy-to-use content transmission solution.
  • the first aspect of the present application provides a content transmission method, which may include: the first device determines that the distance from the second device is less than a distance threshold; the first device prompts the user that the distance between the first device and the second device is Perform content transmission; the first device recognizes the user's gesture operation on the first device, and determines the transmission content and the transmission direction of the transmission content between the first device and the second device according to the recognized gesture operation; the first device determines In the transmission direction, the transmission content is received from the second device or the transmission content is sent to the second device.
  • the content transmission method provided by the embodiment of the present application can simplify the data transmission operation while avoiding misjudgment of the data transmission direction.
  • the first device determining the transmission content and the transmission direction of the transmission content between the first device and the second device according to the recognized gesture operation may include: the first device determines the first transmission according to the recognized first gesture operation Content, and determine that the transmission direction of the first transmission content is from the first device to the second device.
  • the first device determining the transmission content and the transmission direction of the transmission content between the first device and the second device according to the recognized gesture operation may include: the first device determines the second device according to the recognized second gesture operation The content is transmitted, and it is determined that the transmission direction of the second transmission content is from the second device to the first device.
  • the aforementioned gesture operation may be a movement mode in which the user holds the first device, for example, the user holds the first device to move left, right, forward, backward, and so on.
  • the movement mode of the user holding the first device can be obtained by detecting the change of the acceleration of the first device, and the change of the acceleration can be detected by a device such as a gravity sensor in the device.
  • the aforementioned gesture operation may be a user's touch operation on the touch screen of the first device, for example, the user's left swipe, right swipe, and long press on the device's touch screen.
  • determining that the distance between the first device and the second device is less than the distance threshold may include: the first device monitors the change in the intensity of the magnetic induction signal of the first device, and when the change in the intensity of the magnetic induction signal exceeds the preset intensity change threshold In the case of determining that the distance between the first device and the second device is less than the distance threshold.
  • the intensity of the magnetic induction signal is used as the trigger signal, and the ranging is triggered by the change of the intensity of the magnetic induction signal.
  • determining the distance between the first device and the second device by the aforementioned first device may include: the first device uses at least one of various ranging methods such as Bluetooth ranging, millimeter wave ranging, and ultrasonic ranging. Determine the distance to the second device.
  • various ranging methods such as Bluetooth ranging, millimeter wave ranging, and ultrasonic ranging. Determine the distance to the second device.
  • determining the distance between the first device and the second device by the first device through Bluetooth ranging may specifically include: the first device sends a first Bluetooth broadcast signal; the first device receives a second Bluetooth broadcast signal sent by the second device, and Information related to the second distance; wherein, the second Bluetooth broadcast signal is sent by the second device in response to receiving the first Bluetooth broadcast signal, and the information related to the second distance is used to characterize the second distance, and the second distance is the reason
  • the second device calculates the second distance between the first device and the second device according to the received first Bluetooth broadcast signal; the first device obtains the first distance according to the received second Bluetooth broadcast signal, where the first A distance is the first distance between the first device and the second device calculated by the first device according to the signal strength of the second Bluetooth broadcast signal; the larger one of the first distance and the second distance is determined as the first The distance between the device and the second device.
  • the content transmission method provided in the implementation manner provided in the first aspect of the application can simplify the data transmission process on the one hand; on the other hand, use gesture recognition to determine the transmission direction and transmit the content, and realize the two-way communication between the two devices. Transmission, while effectively avoiding errors in the transmission direction.
  • the second aspect of the present application provides a content transmission device, which has the function of implementing the method provided by the foregoing first aspect or any implementation manner of the first aspect.
  • the function can be realized by hardware, or the corresponding software can be executed by hardware.
  • the hardware or software includes one or more modules corresponding to the above-mentioned functions.
  • the third aspect of the present application provides a machine-readable medium.
  • the machine-readable medium can store instructions. When the instructions are executed by a machine, the machine can execute the first aspect or any implementation of the first aspect. The method provided by the method.
  • a fourth aspect of the present application provides a device, including: a memory and a processor, the memory stores instructions, and the processor is used to read and execute the instructions in the memory, so that the device executes: determine the connection with the second device The distance between the device and the second device is less than the distance threshold; the user is prompted to perform gesture operations on the device to transmit content, wherein the device can recognize at least two gesture operations by the user on the device. Perform content transmission; recognize the user's gesture operation on the device, and determine the transmission content and the transmission direction of the transmission content between the device and the second device according to the recognized gesture operation; The determined transmission direction is to receive the transmission content from the second device or send the transmission content to the second device.
  • the fifth aspect of the present application provides a system, which may include the device and the second device provided in the foregoing fourth aspect or any implementation manner of the fourth aspect.
  • the sixth aspect of the present application provides a computer program product.
  • the computer program product may include program code.
  • the controller executes the foregoing first aspect or any implementation of the first aspect.
  • the computer program product may be a software installation package.
  • the computer program product may be downloaded to the controller and stored on the controller Run the computer program product.
  • the content sharing solution provided in the various embodiments of this application simplifies the process of data transmission; in addition, gesture recognition is used to determine the transmission direction and transmission content, which realizes two-way transmission between two devices while effectively avoiding transmission. The direction is wrong.
  • the solution provided in this application can only be applied to a very short transmission distance compared to NFC touch and other methods, and the solution provided in this application can be used for a longer distance.
  • Figure 1 shows an example of a scenario where short-distance content transmission is performed between terminal devices
  • Figure 2 shows a flowchart of the interactive process of sharing content between a mobile phone and a computer according to an embodiment of the present application
  • Fig. 3 shows a schematic diagram of the coordinates of a gravity sensor in a mobile phone according to an embodiment of the present application
  • FIG. 4 shows a specific implementation manner of sharing content between a mobile phone and a computer according to an embodiment of the present application
  • Fig. 5 shows a schematic structural diagram of a terminal device according to an embodiment of the present application
  • Fig. 6 shows a schematic diagram of an example computing system according to an embodiment of the present application.
  • Fig. 7 shows a schematic diagram of a terminal device according to an embodiment of the present application.
  • Fig. 8 shows a schematic diagram of a terminal device according to another embodiment of the present application.
  • Illustrative embodiments of the present application include, but are not limited to, content transmission methods, devices, and media.
  • the embodiments of the present application aim to provide a solution for sharing content based on distance and gestures, which simplifies the sharing operation while avoiding misjudgment of the data transmission direction.
  • the content sharing method provided in the embodiments of the present application is suitable for content sharing between terminal devices, such as content synchronization and transmission between two terminal devices.
  • Fig. 1 shows an example of a scenario where short-distance content sharing is performed between terminal devices.
  • a data sharing system 10 may include two terminal devices 100, such as a mobile phone 100a and a computer 100b. The user can hold the mobile phone 100a close to the computer 100b to realize content sharing at close range.
  • the mobile phone 100a may include a magnetic sensor
  • the computer 100b may include a large number of magnetic devices.
  • the strength of the magnetic induction signal sensed by the mobile phone 100a through the magnetic sensor is also stable.
  • the magnetic sensor of the mobile phone 100a will be affected by the computer 100b. The influence of the magnetic device caused the intensity of the magnetic induction signal at the end of the mobile phone 100a to fluctuate drastically.
  • the mobile phone 100a it is possible to use the mobile phone 100a to detect that the change in the magnetic induction signal intensity exceeds a certain intensity change threshold as a trigger condition, and then the two terminal devices 100 can verify whether the distance between the two terminal devices 100 is close enough through Bluetooth broadcasting or ultrasound.
  • the transmission is triggered, and then the user gestures are used to determine the direction of data transmission between the mobile phone 100a and the computer 100b, thereby realizing content sharing between the two terminal devices.
  • the embodiments of the present application aim to accurately identify the distance between the devices based on the magnetic sensor, Bluetooth or ultrasonic capabilities in the terminal device, and cooperate with the user's gestures to realize convenient and accurate content sharing between the two terminal devices.
  • the terminal device 100 is not limited to the mobile phone 100a and the computer 100b shown in FIG. 1, and may be various computing devices including memory and hardware processors.
  • examples of the terminal device 100 may include: mobile phones, cameras, tablet computers, desktop computers, laptop computers, in-vehicle terminals, smart voice terminals, portable game consoles, portable music players, reader devices, wearable devices, Smart home equipment, augmented reality (AR) equipment, virtual reality (VR) equipment and other electronic equipment.
  • Exemplary embodiments of the terminal device 100 include, but are not limited to, various electronic devices equipped with IOS, Android, Microsoft, or other operating systems.
  • the terminal device 100 may be a wearable device worn by a user.
  • the terminal device 100 may be a watch, a bracelet, jewelry, glasses, etc., or as a part of them.
  • the user can view the message on the display of the terminal device 100 or can access the message, etc. via the speaker or other output device of the device.
  • the user may access the message via a headset coupled to the terminal device 100 or as a part of the terminal device 100, a speaker of the terminal device 100, a tactile feedback element of the terminal device 100, and the like.
  • the terminal device 100 may interact with other devices through a network.
  • the aforementioned network may be a wired network or a wireless network, and may have many different configurations.
  • the aforementioned network may include various interconnected data paths such as a local area network (LAN), a wide area network (WAN) (for example, the Internet).
  • the network may also be coupled to or include parts of a telecommunications network for sending data in a variety of different communication protocols.
  • the network may also include a Bluetooth communication network, Wi-Fi or cellular communication network, etc. for sending and receiving data.
  • terminal device 100 The specific structural example of the terminal device 100 will be described in detail later in conjunction with FIG. 5 to FIG. 8.
  • FIG. 2 shows the interactive process of content sharing between the mobile phone 100a and the computer 100b.
  • S1 the mobile phone 100a and the computer 100b are close, identify the identity of the other party through Bluetooth, and perform Bluetooth pairing to establish a long connection, for example, establish a Bluetooth Low Energy (BLE) long connection.
  • BLE Bluetooth Low Energy
  • the mobile phone and the computer may be communicatively coupled through the wireless communication module 160 as shown in FIG. 5 or other similar modules to establish a BLE long connection.
  • the two terminal devices After the connection is established, the two terminal devices first trigger the data transmission intention, and the mobile phone 100a monitors the change of the magnetic induction signal intensity of the mobile phone 100a in real time through the internal magnetic sensor.
  • the magnetic sensor in the mobile phone 100a can detect the characteristics of the magnetic field strength in the current environment.
  • the magnetic sensor can recognize that the current magnetic field strength data has changed abnormally.
  • the computer and other equipment itself is a complex magnetic field. There will be a large number of magnetic devices in the computer 100b.
  • the computer 100b is close to the mobile phone 100a, it can certainly become a source of magnetic interference.
  • This application uses the magnetic sensor in the mobile phone 100a. Detect the magnetic interference source to identify whether there is a device approaching.
  • the intensity of the magnetic induction signal detected by the mobile phone 100a is relatively stable, and when the computer 100b is close to the mobile phone 100a, the magnetic induction detected by the mobile phone 100a The intensity of the signal will change or fluctuate drastically.
  • the intensity of the change or fluctuation can be determined, so as to identify whether there is a source of magnetic interference approaching.
  • S4 When the mobile phone 100a detects that the change in the intensity of the magnetic induction signal exceeds the preset intensity change threshold (that is, it is judged as yes in S3), it means that the intensity of the magnetic induction signal monitored by the mobile phone 100a has changed drastically, which means There is a source of magnetic interference near the mobile phone 100a.
  • the source of magnetic interference may be the computer 100b or other equipment or devices. For example, magnets.
  • the mobile phone 100a can turn on the Bluetooth broadcast signal to measure the distance between the mobile phone 100a and the computer 100b via Bluetooth.
  • S5-S6 The long Bluetooth connection has been established between the mobile phone 100a and the computer 100b, and the computer 100b can receive the Bluetooth signal sent by the mobile phone 100a, and determine the distance between itself and the mobile phone 100a according to the strength of the received Bluetooth signal, and The determined distance is compared with the preset threshold, and it is judged whether the distance between oneself and the mobile phone 100a is less than the preset distance threshold.
  • the computer 100b can calculate the distance D between itself and the mobile phone 100a according to the Bluetooth received signal strength indicator (RSSI), as shown in the following formula (1):
  • RSSI Bluetooth received signal strength indicator
  • D is the distance between the transmitting end (i.e. mobile phone 100a) and the receiving end (i.e. computer 100b);
  • RSSI is the received signal strength (negative value
  • A is the signal strength when the transmitting end (i.e. mobile phone 100a) and the receiving end (i.e. computer 100b) are separated by 1 meter;
  • n is the environmental attenuation factor
  • distance verification can be turned on at both ends of the mobile phone 100a and the computer 100b, that is, after the computer 100b receives the Bluetooth signal of the mobile phone 100a, the Bluetooth broadcast is also turned on.
  • the mobile phone 100a can also determine the distance between itself and the computer 100b according to the received Bluetooth signal strength from the computer 100b, and determine whether the distance between itself and the computer 100b is less than the preset The distance threshold.
  • the two terminal devices of the mobile phone 100a and the computer 100b can further improve the accuracy of distance monitoring through double verification.
  • both the mobile phone 100a and the computer 100b determine that the distance between the mobile phone 100a and the computer 100b is less than the preset distance threshold, it is proved that the violent change event of the magnetic induction signal strength of the mobile phone 100a is not caused by other sources of magnetic interference. Triggered, and it is indeed a magnetic interference event caused by the proximity of the mobile phone 100a and the computer 100b.
  • a content sharing event is triggered by magnetic induction
  • further verification is performed by judging the distance between terminal devices, which can improve the security of subsequent content transmission. Otherwise, if there is no distance judgment operation, when the mobile phone 100a is far away from the computer 100b, providing various magnetic devices such as magnets near the mobile phone 100a may cause the intensity of the magnetic induction signal of the mobile phone 100a to become severe. Change, which triggers the transmission of content, which brings the risk of data leakage.
  • the magnetic induction trigger event it is also possible to verify the magnetic induction trigger event only through single-ended ranging instead of the dual verification of the two terminal devices of the mobile phone 100a and the computer 100b.
  • single-ended ranging can achieve higher accuracy. In this case, double verification at both ends is unnecessary.
  • the measurement of the distance between the mobile phone 100a and the computer 100b can also be carried out using other solutions, or a combination of multiple ranging solutions, where other ranging solutions may include, but are not limited to, Millimeter wave distance measurement, ultrasonic distance measurement, etc.
  • the mobile phone 100a can output specific patterns, sound effects, vibrations, or dynamic interface effects, etc., to remind Users can start gesture operations to share content.
  • the mobile phone 100a recognizes the user's gesture, and determines the content to be transmitted and the direction of the transmission according to the user's gesture.
  • the user's gesture may be the movement of the user holding the mobile phone 100a.
  • the user's gesture can be determined by monitoring the movement of the mobile phone 100a (such as moving left, moving right, etc.). And each gesture can be mapped to a specific operation to be initiated.
  • the movement mode of the mobile phone 100a (such as moving to the left, moving to the right, etc.) can be obtained by detecting the change in the acceleration of the mobile phone 100a through the gravity sensor in the mobile phone 100a.
  • the gravity sensor is also called a gravity sensor, which can sense the magnitude of the acceleration of the mobile phone 100a in various directions, and then use the acceleration value to determine the movement of the mobile phone 100a, such as shaking left and right, rising, and falling.
  • the gravity sensor can detect the magnitude and direction of gravity.
  • the gravity sensor in the mobile phone 100a is usually a three-axis structure, and the gravity sensor can sense acceleration in any direction through the three axes, and judge the spatial movement of the mobile phone 100a.
  • the gravity sensing coordinates are usually relative to the mobile phone 100a, rather than spatial coordinates.
  • the mobile phone is placed on the desktop in a front-facing direction, and the gravity sensor can sense the acceleration values of the mobile phone 100a on the X, Y, and Z axes as shown in the figure.
  • the X axis is the left and right direction
  • the Y axis is the front and back direction
  • the Z axis is the up and down direction.
  • the value of the three-axis acceleration measured by the gravity sensor includes the influence of gravity, and the unit is m/s ⁇ 2.
  • the X-axis acceleration is 0 by default
  • the Y-axis is 0 by default
  • the Z-axis is 9.81 by default.
  • the X-axis acceleration value In the X-axis direction, if the mobile phone 100a suddenly moves to the left, the X-axis acceleration value is positive, and if the mobile phone suddenly moves to the right, the X-axis acceleration value is negative.
  • the Y-axis acceleration value In the Y-axis direction, if the mobile phone 100a suddenly moves forward, the Y-axis acceleration value is positive, and if the mobile phone suddenly moves backward, the Y-axis acceleration value is negative.
  • the Z-axis acceleration value In the Z-axis direction, if the mobile phone 100a suddenly moves upward, the Z-axis acceleration value is greater than 9.81, and if the mobile phone suddenly moves downward, the Z-axis acceleration value is less than 9.81.
  • the acceleration signal measured by the gravity sensor will be relatively stable; when the user has gestures, the acceleration signal will change drastically, and the signal change can be displayed by the difference value of the acceleration signal When the gesture is over, the acceleration signal will return to a stable level. Therefore, the acceleration difference value can be used to determine the starting point and the end point of the movement of the mobile phone 100a in real time, and to determine the specific direction of the movement of the mobile phone 100a.
  • the specific process is as follows:
  • the acceleration data measured by the gravity sensor is sampled.
  • the three-axis acceleration difference value can be calculated by formula (2):
  • K represents Delta] a triaxial acceleration difference value of the k-th sampling point
  • ax k represents the acceleration of the x-axis at the kth sampling point
  • ax k-1 represents the acceleration of the x-axis at the k-1th sampling point
  • ay k represents the Y-axis acceleration of the k-th sampling point
  • ay k-1 represents the Y-axis acceleration of the k-1 sampling point
  • az k represents the acceleration of the Z axis at the kth sampling point
  • az k-1 represents the acceleration of the Z axis at the k-1th sampling point.
  • the mean acceleration difference value can be obtained over a period of time before the k point, e.g., prior to the N sampling points k (i.e., from the N to k kN The mean value Ma k of the acceleration difference value of the sampling point).
  • ⁇ a i represents the three-axis acceleration difference value of the i-th sampling point among the N sampling points from kN to k
  • Ma k represents the average value of the acceleration difference values in the N sampling points before k.
  • the duration of the gesture can be determined, and then the average energy E ax , E ay , E az of the gesture duration in the X, Y, and Z directions can be obtained:
  • L is the number of sampling points from the start to the end of the gesture
  • ax j is the X-axis acceleration value of the j-th sampling point during the period from the start to the end of the gesture
  • ay j is the Y-axis acceleration value of the j-th sampling point in the period from the start to the end of the gesture
  • az j is the Z-axis acceleration value of the j-th sampling point in the period from the start to the end of the gesture
  • E ax is the average energy value of the X-axis acceleration signal during the period from the start to the end of the gesture
  • E ay is the average energy value of the Y-axis acceleration signal during the period from the start to the end of the gesture
  • E az is the average energy value of the Z-axis acceleration signal during the period from the start to the end of the gesture.
  • the acceleration value ax of each sampling point of the L sampling points from the start to the end of the gesture preset the upper and lower thresholds of the acceleration of the mobile phone 100a in the X-axis direction, according to the acceleration Whether the value breaks the upper threshold first or the lower threshold first, determines whether the phone moves to the left or to the right. If the acceleration value first exceeds the upper limit threshold, it means that the mobile phone 100a is moving to the left; if the acceleration value first exceeds the lower limit threshold, it means that the mobile phone 100a is moving to the right.
  • the acceleration of the mobile phone 100a is also preset The upper threshold and the lower threshold of, and discard the peaks lower than the upper threshold and troughs higher than the lower threshold, determine the order of the remaining peaks and troughs. If the peak appears first, it means that the mobile phone 100a is moving to the left, otherwise the trough appears first. It shows that the mobile phone 100a moves to the right. In this implementation manner, by counting the number of peaks and valleys remaining after the above discarding operation, it can also be determined whether the mobile phone 100a is shaking. If the number of peaks and valleys is greater than the preset number threshold, it means that the mobile phone 100a is shaking, rather than moving in one direction.
  • the comparison of the threshold value and the judgment of the moving direction of the mobile phone 100a can be performed after a period of time (for example, 0.2 seconds) after the start of the gesture, so as to avoid misjudgment in the initial stage of the gesture.
  • the movement mode of the mobile phone 100a can be obtained, that is, the gesture operation.
  • the mapping relationship between each gesture and the specific operation to be initiated can be defined by defining the corresponding relationship between the movement mode of the mobile phone 100a and the transmission content and transmission direction.
  • the movement of the mobile phone 100a can be divided into: moving left, moving right, moving forward, moving backward, moving up, moving down, shaking, etc., and determining the mobile phone 100a for each movement.
  • Table 1 shows an example of the correspondence between the movement of the mobile phone 100a and the transmission content and the transmission direction according to some embodiments of the present application.
  • the transmission direction it is also possible to define only the transmission direction but not the transmission content.
  • the forward movement means that the mobile phone 100a sends content to the computer 100b
  • the backward movement means that the mobile phone 100a receives content from the computer 100b.
  • the above definition of the moving direction of the mobile phone 100a is based on the mobile phone 100a facing up and being held in the forward direction. If the mobile phone 100a is held in the reverse direction, the moving direction of the mobile phone 100a may be different from the actual transmission. When the content is in the opposite direction.
  • the mobile phone 100a may send the determined transmission direction and transmission content to the computer 100b.
  • the corresponding transmission direction and transmission content are: the interface and running of the desktop application of the computer 100b
  • the state is directly transferred and presented on the screen of the mobile phone 100a.
  • the mobile phone 100a can send the transmission direction and transmission content to the computer 100b, so that the computer 100b is ready to send data related to the interface and running status of the desktop application to the mobile phone 100a.
  • S12 the mobile phone 100a and the computer 100b can shake hands via Bluetooth and negotiate WIFI connection parameters to prepare for content sharing between the mobile phone 100a and the computer 100b.
  • WIFI Direct also known as WIFI P2P
  • WIFI direct connection can directly establish a TCP/IP connection between the two terminal devices of the mobile phone 100a and the computer 100b without the participation of additional access points (Access Point, AP); among them, the mobile phone One of 100a and computer 100b can be used as the group owner (GO), which functions as an AP in the traditional sense, while the other one of the mobile phone 100a and computer 100b can be used as a group client (Group Client, GC), connect to the terminal device as GO in a similar way to connect to AP.
  • group owner GO
  • GC group client
  • the WIFI connection parameters negotiated by the mobile phone 100a and the computer 100b may include the service set identifier (SSID) and password of the WIFI GO.
  • SSID service set identifier
  • S13 The mobile phone 100a and the computer 100b establish a WIFI direct connection according to the WIFI connection parameters negotiated in S12.
  • the content transmission between the mobile phone 100a and the computer 100b may use Miracast screen projection technology.
  • the end that sends data is used as the source end, and the end that receives the data is used as the sink end. Then the two can transmit data through transmission protocols such as TCP or UDP to send the content of the source side (including: desktop, applications, pictures, audio and video, etc.) to the sink side.
  • TCP or UDP transmission protocols
  • the user input back channel (UIBC) establishment function in the miracast screen projection technology can also be used to establish a UIBC to realize the reverse control of the user on the Sink end to the Source end.
  • the mobile phone 100a when it is recognized that the mobile phone 100a moves to the right, the mobile phone 100a sends data related to the interface and running status of the application to the computer 100b, the mobile phone 100a is the source end, and the computer 100b is the sink end.
  • the interface and running status of the application of the mobile phone 100a will be directly migrated and presented on the screen of the computer 100b, and the status of the computer 100b will be kept consistent with the running status of the mobile phone 100a, and the user can access the computer 100b.
  • the Bluetooth connection is used as the control channel
  • the WIFI connection is used as the data channel, so as to take advantage of the faster data transmission speed of WIFI and improve the sharing speed of content.
  • the operations of S12 and S13 may not be included, and the data to be shared is directly transmitted through Bluetooth; or, in other embodiments, the mobile phone 100a and the computer 100b It is also possible to use other communication protocols to establish other communication connections to transmit the data to be shared in other ways.
  • the mobile phone 100a can determine whether the user wants to continue sharing other content. For example, it can use an interface or sound to output a prompt message to prompt the user whether to continue sharing.
  • the method can continue to S16: disconnect the WIFI connection between the mobile phone 100a and the computer 100b.
  • the operation of S16 may not be performed immediately after the transmission is completed, but may be performed after a certain period of time after the transmission is completed.
  • a waiting event may be preset, for example, 2 minutes, and after the transmission is completed If there is no action for 2 minutes after the content is transferred, the disconnect operation of S16 is performed again.
  • control logic in the mobile phone 100a and the computer 100b can adopt various architectures, such as: layered architecture, event-driven architecture, micro-core architecture, micro-service architecture, or Cloud architecture and so on.
  • layered architecture event-driven architecture
  • micro-core architecture micro-core architecture
  • micro-service architecture or Cloud architecture and so on.
  • Cloud architecture a system with a layered architecture is taken as an example to illustrate a specific solution for implementing the content sharing system provided in the embodiment of the present application.
  • FIG. 4 shows a specific structure example of a mobile phone 100a and a computer 100b that implement the content sharing party system shown in FIG. 2.
  • control logic can be divided into several layers through a layered architecture, and each layer has a clear role and division of labor. Layers can communicate through interfaces. According to some embodiments of the present application, the control logic of the mobile phone 100a and the computer 100b can be divided into three layers, which are an application layer, a driver layer, and a device layer.
  • the application layer may include one or more application packages for preparing content sharing, triggering sharing intent, verifying sharing intent, logical judgment of sharing content and direction recognition, and data transmission Control and so on.
  • the preparation for sharing, the triggering of sharing intent, the verification of sharing intent, the logical judgment of sharing content and direction recognition can be integrated into the content sharing judgment module, which can be used for content sharing judgment, and the data transmission module can be used for Control of data transmission.
  • the application layer of the mobile phone 100a includes a first content sharing determination module 400 and a first data transmission module 414.
  • the first content sharing determination module 400 includes a first sharing preparation module 401 and a first sharing intention verification module.
  • the application layer of the computer 100b includes a second content sharing determination module 420 and a second data transmission module 421.
  • the second content sharing determination module 420 includes a second sharing preparation module 425 and a second sharing intention verification module 431.
  • Each module of the above-mentioned application layer can implement corresponding functions by calling the next-level modules respectively.
  • the first content sharing determination module 400 of the mobile phone 100a cooperates with the second content sharing determination module 420 of the computer 100b to perform content sharing determination, that is, the operations of S1-S10 in FIG. 2.
  • perform S1 the mobile phone 100a and the computer 100b are approached, identify the identity of the other party through Bluetooth, and perform Bluetooth pairing to establish a long connection.
  • Mobile phone 100a the first sharing preparation module 401 of the application layer calls the first Bluetooth communication module 402, and the first Bluetooth communication module 402 sends instructions to the first Bluetooth driver module 403 of the driver layer to call the first Bluetooth module 404 of the device layer .
  • the second sharing preparation module 425 of the application layer calls the second Bluetooth communication module 426, and the second Bluetooth communication module 426 sends instructions to the second Bluetooth driver module 427 of the driver layer to call the second Bluetooth module 428 of the device layer .
  • the first bluetooth module 404 and the second bluetooth module 428 respectively respond to the instructions of the driver layer to send bluetooth broadcast signals, and when the mobile phone 100a and the computer 100b are close to each other, they use the bluetooth name to identify the identity of each other, and perform bluetooth pairing to establish bluetooth. Long connection.
  • Various terminal devices such as the computer 100b are themselves a complex magnetic field.
  • the computer 100b there are usually a large number of magnetic devices 429.
  • the magnetic devices 429 refer to devices that cause magnetic interference.
  • a magnetic sensor in the notebook computer which is arranged on the keyboard part (commonly referred to as the C side), and correspondingly, the screen portion (commonly referred to as the B side) )
  • the magnetic device of the screen part is close to the magnetic sensor, causing the magnetic field near the magnetic sensor to change. This allows the magnetic sensor to sense the change of the screen state and allow the laptop to pass through the peripheral circuits and systems.
  • the cooling fan of a notebook computer usually contains a stator and a rotor, and both the stator and the rotor are magnetic components.
  • an additional magnetic device 429 may be installed in the computer 100b, or the existing magnetic device 429 may be optimized to make the area of the magnetic device 429 larger Or the intensity of magnetic interference is higher.
  • the magnetic sensor 410 of the device layer monitors the change of the magnetic induction signal intensity of the mobile phone 100a.
  • the magnetic sensor 410 include, but are not limited to, a Hall sensor based on the Hall effect, an AMR sensor based on an Anisotropic Magneto Resistance (AMR) effect, and the like.
  • AMR sensors can use magnetoresistance to measure the planar magnetic field, thereby detecting the strength and direction of the magnetic field.
  • the basic principle is to use anisotropic magnetoresistive materials to feel a weak magnetic field. When it changes, it causes its own resistance to change.
  • the Hall sensor detects the change of the magnetic field according to the Hall principle that a voltage difference is generated when the semiconductor changes in the direction of the peripheral magnetic field.
  • the magnetic sensor 410 in the mobile phone 100a is generally used in compass or map navigation to help users achieve accurate positioning, or to detect the opening and closing of a flip holster. In the embodiment of the present application, the magnetic sensor 410 is used to sense whether there is a magnetic device close to it.
  • the drive module 409 processes the received magnetic interference signal to determine the intensity of the magnetic induction signal, and further reports it to the magnetic induction detection module 408 of the application layer.
  • the magnetic induction detection module 408 can determine the intensity of the magnetic induction signal after receiving the information about the intensity of the magnetic induction signal. Analyze and judge the change of magnetic induction signal to determine whether it exceeds the preset magnetic induction signal intensity change threshold, and when it exceeds the preset magnetic induction signal intensity change threshold, send information to the sharing intention triggering module 407 to trigger the sharing intention .
  • S4 In order to verify whether the computer 100b that is close to the mobile phone 100a is the computer 100b that is connected to the mobile phone 100a or other sources of magnetic interference, the mobile phone 100a can verify the sharing intention.
  • Mobile phone 100a the first sharing intention trigger module 407 of the application layer sends sharing intention trigger information to the first sharing intention verification module 406, and the first sharing intention verification module 406 sends the first verification to the first Bluetooth ranging module 405 Instruction, start the first Bluetooth ranging module 405, the first Bluetooth ranging module 405 in the application layer, in response to the received first verification instruction, sends a signal to the first Bluetooth driver module 403 to pass the first Bluetooth driver module 403 to control the first Bluetooth module 404 to send Bluetooth broadcast signals.
  • the computer 100b determines the distance between itself and the mobile phone 100a according to the strength of the received Bluetooth signal, and compares the determined distance with a preset threshold to determine whether the distance between itself and the mobile phone 100a is less than the preset The distance threshold.
  • the second Bluetooth module 428 After receiving the Bluetooth broadcast signal sent by the mobile phone 100a, the second Bluetooth module 428 can report the received Bluetooth signal to the second Bluetooth driver module 427 of the driver layer, and the second Bluetooth driver module 427 can subsequently
  • the data sent by the Bluetooth module 428 is processed to determine the strength of the Bluetooth signal, etc., and report the strength of the Bluetooth signal to the second Bluetooth ranging module 430 of the application layer, so that the second Bluetooth ranging module 430 of the computer 100b can be based on
  • the strength of the received Bluetooth signal determines the distance between oneself and the mobile phone 100a.
  • the aforementioned formula (1) can be used to determine the distance between oneself and the mobile phone 100a.
  • the second Bluetooth ranging module 430 reports the determined distance to the second sharing intention verification module 431, and the second sharing intention verification module 431 determines whether the distance between itself and the mobile phone 100a is less than a preset distance threshold.
  • S7 when the distance judgment is performed on the computer 100b, S7 can be executed at the same time: Bluetooth broadcasting is also turned on, so that the distance check is turned on at both ends of the mobile phone 100a and the computer 100b.
  • the second sharing intention verification module 431 in the application layer of the computer 100b sends a second verification instruction to the second Bluetooth ranging module 430, and the second Bluetooth ranging module 430 responds to the second verification instruction to drive the second Bluetooth
  • the module 427 sends instructions to control the second Bluetooth module 428 to send Bluetooth broadcast signals through the aforementioned second Bluetooth driving module 427.
  • the mobile phone 100a can also determine the distance between itself and the computer 100b according to the received Bluetooth signal strength from the computer 100b, and determine whether the distance between itself and the computer 100b is less than the preset The distance threshold.
  • the mobile phone 100a side after receiving the Bluetooth broadcast signal sent by the computer 100b, the first Bluetooth module 404 reports the received Bluetooth signal to the first Bluetooth driver module 403 of the driver layer.
  • the first Bluetooth driver module 403 can The data sent by a Bluetooth module 404 is processed to determine the strength of the Bluetooth signal, etc., and report the strength of the Bluetooth signal to the first Bluetooth ranging module 405 in the application layer, so that the first Bluetooth ranging module 405 in the mobile phone 100a
  • the distance between oneself and the computer 100b can be judged by using the aforementioned formula (1) according to the strength of the received Bluetooth signal.
  • the two terminal devices of the mobile phone 100a and the computer 100b are double-checked to improve the accuracy of distance monitoring.
  • the mobile phone 100a can be considered
  • the magnetic interference event at the end is not a false trigger caused by other magnetic interference sources, but is indeed due to the proximity of the mobile phone 100a and the computer 100b, and the magnetic interference caused by the magnetic device 429 in the computer 100b.
  • the measurement of the distance between the mobile phone 100a and the computer 100b can also be performed by other solutions, for example, the aforementioned Bluetooth single-ended ranging, millimeter wave ranging, ultrasonic ranging, etc.
  • S10 the mobile phone 100a starts to recognize the user's gesture to determine the content to be transmitted and the direction of the transmission according to the user's gesture.
  • the identification of the transmission content and direction is determined by recognizing the user's gesture, and the user's gesture can be determined by detecting the movement of the mobile phone 100a.
  • the mapping relationship between the gesture and the specific operation to be initiated may be preset, and the mapping relationship may be pre-stored in the mobile phone 100a.
  • the movement mode of the mobile phone 100a can be determined by the gravity sensor 411 in the mobile phone 100a.
  • the gravity sensor 411 is also called a gravity sensor.
  • One of its implementations is to use elastic sensitive elements to make a cantilever type displacer, and use an energy storage spring made of elastic sensitive elements to drive the electrical contacts to complete the change from gravity to electricity. Signal conversion.
  • the gravity sensor 411 has a wide range of applications in various portable computing devices such as mobile phones and tablet computers. For example, it can be used to identify the posture or movement mode of the mobile phone 100a, switch between horizontal and vertical screens, and pedometers.
  • common gravity sensors include but are not limited to: Bosch's BMA series, ST's LIS3X series, and so on.
  • the specific method for determining the movement of the mobile phone 100a through the gravity sensor 411 in the mobile phone 100a is as follows:
  • the middle transmission direction/content determination module 413 of the application layer sends a gesture recognition instruction to the gesture recognition module 412.
  • the gesture recognition module 412 sends a signal to the sensor driving module 409 of the driving layer, so that the sensor driving module 409 turns on the gravity sensor 411 of the device layer.
  • the gravity sensor 411 detects the acceleration of the mobile phone 100a in various directions (usually three axes), and then reports the acceleration data to the sensor drive module 409 of the drive layer.
  • the sensor drive module 409 processes the received acceleration data and calculates the acceleration. The value and direction are reported to the gesture recognition module 412 of the application layer.
  • the gesture recognition module 412 uses the measured acceleration value and direction to generate an acceleration change vector to obtain the movement of the mobile phone 100a, and report the movement of the mobile phone 100a to the transmission direction/content determination module 413.
  • the transmission direction/content determination module 413 can determine the transmission content and the transmission direction according to the movement of the mobile phone 100a by referring to Table 1. For example, assuming that the movement of the mobile phone measured by the gesture recognition module 412 of the mobile phone 100a is shifted to the right, the transmission direction/content determination module 413 can determine according to Table 1 that the movement corresponds to: the interface and running status of the application program of the mobile phone 100a It is directly transferred and presented on the screen of the computer 100b. That is, the transmission direction is from the mobile phone 100a to the computer 100b, and the transmitted content is the interface and running status of the application program of the mobile phone 100a.
  • the movement of the mobile phone 100a can also be determined in other ways.
  • Other ways include but are not limited to: using a linear accelerometer, a gyroscope sensor, or a positioning system.
  • the gyroscope sensor can determine the angular velocity of the mobile phone 100a around three axes (ie, x, y, and z axes). Therefore, the gyroscope sensor can also be used to determine the movement of the mobile phone 100a.
  • a combination of a linear accelerometer, a gyroscope sensor, a gravity sensor, etc. may also be used to determine the movement of the mobile phone 100a, and thereby determine the user's gesture.
  • the transmission direction/content determination module 413 in the application layer sends the determined transmission direction (ie, the phone 100a to the computer 100b) and the transmission content (ie, the interface and running status of the application program of the phone 100a) to the first data
  • the transmission module 414, the first data transmission module 414 sends a communication instruction to the first Bluetooth communication module 402, so that the first Bluetooth communication module 402 drives the first Bluetooth module 404 through the first Bluetooth driver module 403 of the driver layer, and transfers the determined transmission direction And the transmission content is sent to the computer 100b.
  • Computer 100b After receiving the information from the mobile phone 100a, the first Bluetooth module 428 reports the received information to the second Bluetooth communication module 426 through the second Bluetooth driver module 427, and the second Bluetooth communication module 426 processes the received information Information, the transmission direction and transmission content are obtained, and reported to the second data transmission module 421, so that the computer 100b can obtain the transmission direction and transmission content determined by the mobile phone 100a.
  • S12 the mobile phone 100a and the computer 100b shake hands via Bluetooth to negotiate WIFI connection parameters.
  • the mobile phone 100a Taking the mobile phone 100a as a GO directly connected to WIFI as an example, the mobile phone 100a end: the first data transmission module 414 of the application layer sends a communication command to the first Bluetooth communication module 402, so that the first Bluetooth communication module 402 passes the first Bluetooth of the driver layer.
  • the driving module 403 drives the first Bluetooth module 404, and sends the SSID and password of the mobile phone 100a as the GO to the computer 100b.
  • the first Bluetooth module 428 of the device layer reports the received information to the second Bluetooth communication module 426 through the second Bluetooth driver module 427, and the second Bluetooth communication module 426 processes it
  • the received information, the SSID and password of the GO are obtained, and reported to the second data transmission module 421.
  • S13 The mobile phone 100a and the computer 100b establish a WIFI connection according to the WIFI connection parameters negotiated in S12.
  • the first data transmission module 414 sends a communication instruction to the first WIFI communication module 415, so that the first WIFI communication module 415 drives the first WIFI module 417 through the first WIFI driving module 416 of the driver layer, and enables the WIFI direct connection function .
  • the second data transmission module 421 sends a communication instruction to the second WIFI communication module 422, so that the second WIFI communication module 422 drives the second WIFI module 424 through the second WIFI driving module 423 of the driving layer, and turns on the WIFI direct connection function , And establish a WIFI connection with the mobile phone 100a by operating the SSID and password obtained in S12.
  • S14 Send the interface and running status of the application program of the mobile phone 100a to the computer 100b via the WIFI communication link between the mobile phone 100a and the computer 100b via WIFI.
  • the Bluetooth connection is used as the control channel
  • the WIFI connection is used as the data channel, so as to take advantage of the faster data transmission speed of WIFI and improve the sharing speed of content.
  • the operations of S12 and S13 may not be included, and the data to be shared is directly transmitted through Bluetooth; or, in other embodiments, the mobile phone 100a and the computer 100b It is also possible to use other communication protocols to establish other communication connections to transmit the data to be shared in other ways.
  • FIG. 4 the specific devices and modules shown in FIG. 4 are all examples and do not constitute a limitation to the application. In other embodiments of the present application, different devices and modules may also be used to implement the content sharing solution requested by itself in other ways.
  • the gravity sensor 411 in FIG. 4 can be replaced with other devices, such as a linear acceleration sensor, a gyroscope, etc.; or, in some embodiments, the mobile phone can also be implemented by a combination of multiple devices. 100a mobile detection.
  • the first sharing intention verification module 406 and/or the second sharing intention verification module 431 may also perform distance measurement by other devices except the Bluetooth module.
  • the first sharing intent verification module 406 and/or the second sharing intent verification module 431 may invoke the mobile phone 100a ultrasonic module, millimeter wave module, etc. through the driver layer to implement the ranging operation.
  • the operation S10 performed by the mobile phone 100a recognize user gestures, and determine the content to be transmitted and the direction of the transmission according to the user gestures.
  • the user's gesture may not be the movement of the user holding the mobile phone 100a, but other gesture operations.
  • the user's gestures may also be touch operations such as sliding, dragging, clicking, or long pressing on the touch screen surface of the mobile phone 100a.
  • the user's gestures can be determined by recognizing the touch input of the mobile phone 100a (such as left swipe, right swipe, long press, etc.), and each gesture can be mapped to a specific operation to be initiated.
  • the touch screen of the mobile phone 100a may be various types of touch screens, such as capacitive touch screens, resistive touch screens, infrared touch screens, surface acoustic wave touch screens, or other types of touch screens.
  • the touch screen of the mobile phone 100a can be used to receive user touch operations.
  • the touch screen may include a touch sensor and a display screen.
  • the touch sensor is also called a “touch device”.
  • the touch sensor may be provided on the display screen to detect touch operations on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • S10 when the mobile phone 100a starts to recognize user gestures, the mobile phone 100a end: the transmission direction/content determination module 413 of the application layer sends a gesture recognition instruction to the gesture recognition module 412.
  • the gesture recognition module 412 sends a signal to the sensor driving module 409 of the driving layer, so that the sensor driving module 409 turns on the touch sensor of the device layer.
  • the touch sensor receives a user's touch operation on the touch screen of the mobile phone 100a. For example, when the user's finger is close to or touches the mobile phone 100a with a touch screen function, the touch sensor of the mobile phone 100a detects the operation on the touch screen of the mobile phone 100a, and then reports the touch data to the sensor driving module 409 of the driving layer.
  • the sensor drive module 409 of the drive layer of the mobile phone 100a can process the data reported by the touch sensor in the touch screen, recognize clicks, slides, long presses, etc., and calculate the coordinate information of these operations, generate time stamps, etc., and include the type of operation Input events such as, coordinate information, and timestamp are reported to the gesture recognition module 412 of the application layer, and then the gesture recognition module 412 can be based on the preset mapping relationship between the touch operation and the transmitted content and direction (for example, the mapping shown in Table 2 below) Relationship) to determine the content and direction of the transmission.
  • the gesture recognition module 412 can be based on the preset mapping relationship between the touch operation and the transmitted content and direction (for example, the mapping shown in Table 2 below) Relationship) to determine the content and direction of the transmission.
  • Table 2 shows an example of the mapping relationship between the touch operation acting on the mobile phone 100a and the transmission content and the transmission direction according to some embodiments of the present application.
  • the user's gestures may also include other types, such as gesture operations that can act on the mobile phone 100a but are separated from the screen of the mobile phone 100a by a certain distance (for example, floating touch).
  • other input devices such as a stylus may also be used to input gestures.
  • the content sharing process between the mobile phone 100a and the computer 100b is taken as an example to illustrate the content sharing process between the terminal devices, it should be understood that the content sharing solution provided by the embodiment of the present application It can be applied between various terminal devices, such as between mobile phones and mobile phones, between smart watches and mobile phones, between bracelets and computers, and so on.
  • the content sharing solution provided in the embodiments of this application simplifies the process of data transmission, and can only be applied to a very short transmission distance compared to NFC touch and other methods.
  • the content sharing solution provided in this application can be used for relatively long transmission distances.
  • gesture recognition to determine the transmission direction and transmission content, two-way transmission between the two devices is realized, and at the same time, errors in the transmission direction can be effectively avoided.
  • the terminal device 100 of the present application will be described by taking a mobile phone as an example in conjunction with FIG. 5.
  • the device shown in FIG. 5 may be a mobile phone 100a or may be included in the mobile phone 100a.
  • the terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, and a battery 142 , Antenna 1, antenna 2, mobile communication module 150, wireless communication module 160, audio module 170, speaker 170A, receiver 170B, microphone 170C, earphone jack 170D, sensor module 180, button 190, motor 191, indicator 192, camera 193 , Display screen 194, subscriber identification module (subscriber identification module, SIM) card interface 195, etc.
  • SIM subscriber identification module
  • the processor 110 may include one or more processing units.
  • the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), and an image signal.
  • AP application processor
  • GPU graphics processing unit
  • ISP image signal processor
  • DSP digital signal processor
  • NPU neural-network processing unit
  • the different processing units may be independent devices or integrated in one or more processors.
  • a memory may also be provided in the processor 110 to store instructions and data.
  • the processor 110 may be configured to perform various operations performed by the mobile phone 100a described above with reference to FIGS. 2 to 4.
  • the processor 110 may include one or more interfaces.
  • the interface may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, and a universal asynchronous transmitter/receiver (universal asynchronous) interface.
  • I2C integrated circuit
  • I2S integrated circuit built-in audio
  • PCM pulse code modulation
  • PCM pulse code modulation
  • UART universal asynchronous transmitter/receiver
  • MIPI mobile industry processor interface
  • GPIO general-purpose input/output
  • SIM subscriber identity module
  • USB Universal Serial Bus
  • the interface connection relationship between the modules illustrated in the embodiment of the present application is merely a schematic description, and does not constitute a structural limitation of the terminal device 100.
  • the terminal device 100 may also adopt different interface connection modes in the foregoing embodiments, or a combination of multiple interface connection modes.
  • the sensor module 180 may include a magnetic sensor 180D.
  • the magnetic sensor 180D include, but are not limited to, a Hall sensor based on the Hall effect, and an AMR sensor based on the Anisotropic Magneto Resistance (AMR) effect.
  • the AMR sensor can use magnetoresistance to measure the planar magnetic field, thereby detecting the strength and direction of the magnetic field.
  • the basic principle is to use anisotropic magnetoresistive materials to sense weak magnetic field changes. Time causes its own resistance to change.
  • the Hall sensor detects the change of the magnetic field according to the Hall principle that a voltage difference is generated when the semiconductor changes in the direction of the peripheral magnetic field.
  • the magnetic sensor 180D in the terminal device 100 is generally used in compass or map navigation to help the user achieve accurate positioning, or to detect the opening and closing of a flip holster.
  • the terminal device 100 when the terminal device 100 is a flip machine, the terminal device 100 can detect the opening and closing of the flip according to the magnetic sensor 180D, and then set the flip automatic Features such as unlocking.
  • the terminal device 100 may use the magnetic sensor 180D to sense whether there is a magnetic device close to it.
  • the acceleration sensor 180E can detect the magnitude of the acceleration of the terminal device 100 in various directions (generally three axes). When the terminal device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture or movement of the terminal device 100, and is used in applications such as horizontal and vertical screen switching, and pedometer.
  • the acceleration sensor 180E may include a gravity sensor.
  • the gravity sensor is also called a gravity sensor.
  • One of its implementation methods is to use an elastic sensitive element to make a cantilever type displacer, and to use an elastic sensitive element to make a cantilever displacer.
  • the stored energy spring drives the electrical contacts to complete the conversion from gravity changes to electrical signals.
  • Gravity sensors are widely used in various portable computing devices such as mobile phones and tablet computers. In various terminal devices 100, common gravity sensors include but are not limited to: Bosch's BMA series, ST's LIS3X series Wait.
  • the gravity sensor can sense changes in acceleration, and then use the acceleration value to determine the movement of the terminal device 100, such as tilting, shaking left and right, rising, and falling.
  • the gravity sensor in the terminal device 100 usually has a three-axis structure, and the gravity sensor can sense acceleration in any direction through three axes, and determine the spatial movement of the terminal device 100.
  • the gravity sensing coordinates may be relative to the terminal device 100, rather than spatial coordinates.
  • the gyro sensor 180B may be used to determine the movement posture of the terminal device 100.
  • the angular velocity of the terminal device 100 around three axes ie, x, y, and z axes
  • the gyroscope sensor 180B can also be used to determine the movement of the device. Exemplarily, it can be used for shooting anti-shake.
  • the gyro sensor 180B detects the shaking angle of the terminal device 100, and calculates the distance to be compensated by the lens module according to the angle, so that the lens can offset the terminal device by reverse movement 100's jitter to achieve anti-shake.
  • the gyro sensor 180B can also be used for navigation and somatosensory game scenes.
  • Touch sensor 180K also called “touch device”.
  • the touch sensor 180K may be disposed on the display screen 194, and the touch screen is composed of the touch sensor 180K and the display screen 194, which is also called a “touch screen”.
  • the touch sensor 180K is used to detect touch operations acting on or near it.
  • the touch sensor can pass the detected touch operation to the application processor to determine the type of touch event.
  • the visual output related to the touch operation can be provided through the display screen 194.
  • the touch sensor 180K may also be disposed on the surface of the electronic device 100, which is different from the position of the display screen 194.
  • the sensor module 180 may include: a pressure sensor 180A, an air pressure sensor 180C, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.
  • the charging management module 140 is used to receive charging input from the charger.
  • the charger can be a wireless charger or a wired charger.
  • the power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110.
  • the power management module 141 receives input from the battery 142 and/or the charge management module 140, and supplies power to the processor 110, the internal memory 121, the display screen 194, the camera 193, and the wireless communication module 160.
  • the power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, and battery health status (leakage, impedance).
  • the power management module 141 may also be provided in the processor 110.
  • the power management module 141 and the charging management module 140 may also be provided in the same device.
  • the wireless communication function of the terminal device 100 can be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor, and the baseband processor.
  • the antenna 1 and the antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in the terminal device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna can be used in combination with a tuning switch.
  • the mobile communication module 150 may provide a wireless communication solution including 2G/3G/4G/5G and the like applied to the terminal device 100.
  • the mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), and the like.
  • the mobile communication module 150 can receive electromagnetic waves by the antenna 1, and perform processing such as filtering, amplifying and transmitting the received electromagnetic waves to the modem processor for demodulation.
  • the mobile communication module 150 can also amplify the signal modulated by the modem processor, and convert it into electromagnetic waves for radiation via the antenna 1.
  • at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110.
  • at least part of the functional modules of the mobile communication module 150 and at least part of the modules of the processor 110 may be provided in the same device.
  • the modem processor may include a modulator and a demodulator.
  • the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal.
  • the demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal.
  • the demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing.
  • the application processor outputs a sound signal through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays an image or video through the display screen 194.
  • the modem processor may be an independent device.
  • the modem processor may be independent of the processor 110 and be provided in the same device as the mobile communication module 150 or other functional modules.
  • the wireless communication module 160 can provide applications on the terminal device 100, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), and global navigation satellites.
  • WLAN wireless local area networks
  • BT Bluetooth
  • GNSS global navigation satellite system
  • FM frequency modulation
  • NFC near field communication technology
  • infrared technology infrared, IR
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110.
  • the wireless communication module 160 may also receive a signal to be sent from the processor 110, perform frequency modulation, amplify, and convert it into electromagnetic waves to radiate through the antenna 2.
  • the antenna 1 of the terminal device 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the terminal device 100 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC , FM, and/or IR technology, etc.
  • the GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite-based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite-based augmentation systems
  • the terminal device 100 implements a display function through a GPU, a display screen 194, and an application processor.
  • the display screen 194 is used to display images, videos, and the like.
  • the terminal device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.
  • the terminal device 100 can implement audio functions through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the earphone interface 170D, and the application processor. For example, music playback, recording, etc.
  • the external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, so as to expand the storage capacity of the terminal device 100.
  • an external memory card such as a Micro SD card
  • the internal memory 121 may be used to store computer executable program code, where the executable program code includes instructions.
  • the button 190 includes a power-on button, a volume button, and so on.
  • the button 190 may be a mechanical button. It can also be a touch button.
  • the terminal device 100 may receive key input, and generate key signal input related to user settings and function control of the terminal device 100.
  • the motor 191 can generate vibration prompts.
  • the motor 191 can be used for incoming call vibration notification, and can also be used for touch vibration feedback.
  • touch operations applied to different applications can correspond to different vibration feedback effects.
  • Acting on touch operations in different areas of the display screen 194, the motor 191 can also correspond to different vibration feedback effects.
  • Different application scenarios for example: time reminding, receiving information, alarm clock, games, etc.
  • the touch vibration feedback effect can also support customization.
  • the indicator 192 may be an indicator light, which may be used to indicate the charging status, power change, or to indicate messages, missed calls, notifications, and so on.
  • the SIM card interface 195 is used to connect to the SIM card.
  • the SIM card can be inserted into the SIM card interface 195 or pulled out from the SIM card interface 195 to achieve contact and separation with the terminal device 100.
  • the terminal device 100 may support 1 or N SIM card interfaces, and N is a positive integer greater than 1.
  • the SIM card interface 195 can support Nano SIM cards, Micro SIM cards, SIM cards, etc.
  • the same SIM card interface 195 can insert multiple cards at the same time. The types of the multiple cards can be the same or different.
  • the SIM card interface 195 can also be compatible with different types of SIM cards.
  • the SIM card interface 195 may also be compatible with external memory cards.
  • the terminal device 100 interacts with the network through the SIM card to implement functions such as call and data communication.
  • the terminal device 100 adopts an eSIM, that is, an embedded SIM card.
  • the eSIM card can be embedded in the terminal device 100 and cannot be separated from the terminal device 100.
  • the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the terminal device 100.
  • the terminal device 100 may include more or fewer components than those shown in the figure, or combine certain components, or split certain components, or arrange different components.
  • the illustrated components can be implemented in hardware, software, or a combination of software and hardware.
  • system 500 may be or may include a part of the terminal device 100, for example, the computing system 500 may be or may include a part of the computer 100b. In various embodiments, the system 500 may have more or fewer components and/or different architectures.
  • the system 500 may include one or more processors 504, a system control logic 508 connected to at least one of the processors 504, a system memory 512 connected to the system control logic 508, and a system control logic 508 connected to the system control logic 508.
  • the memory 516 (for example, a non-volatile memory (NVM)), and a network interface 520 connected to the system control logic 508.
  • NVM non-volatile memory
  • the processor 504 may include one or more single-core or multi-core processors.
  • the processor 504 may include any combination of a general-purpose processor and a special-purpose processor (for example, a graphics processor, an application processor, a baseband processor, etc.).
  • the processor 504 may be configured to perform various operations performed by the mobile phone 100a or the computer 100b described above with reference to FIGS. 2 to 4.
  • the system control logic 508 for a certain embodiment may include any suitable interface controller to provide any suitable interface to at least one of the processors 504 and/or any suitable device or component in communication with the system control logic 508 .
  • the system control logic 508 for a certain embodiment may include one or more memory controllers to provide an interface to the system memory 512.
  • the system memory 512 may be used to load and store data and/or instructions.
  • the system memory 512 used in a certain embodiment may include any suitable volatile memory, such as a suitable random access memory (random access memory). -Access memory, RAM) or dynamic random access memory (dynamic random access memory, DRAM).
  • the memory 516 may include one or more tangible, non-transitory computer-readable media for storing data and/or instructions.
  • the memory 516 may include any suitable non-volatile memory and/or any suitable non-volatile storage device, such as flash memory, hard disk drive (HDD), and solid-state drive (SSD). ), compact disk (CD) drives, and/or digital versatile disk (DVD) drives, etc.
  • the memory 516 may include a part of storage resources on the device where the system 500 is installed, or it may be accessed by the device, but not necessarily a part of the device.
  • the storage 516 can be accessed through the network via the network interface 520.
  • system memory 512 and the memory 516 may include: temporary and permanent copies of the instructions 524, respectively.
  • the instructions 524 may include instructions that, when executed by at least one of the processors 504, cause the system 500 to implement the method described above.
  • instructions 524 or hardware, firmware, and/or software components thereof may additionally/alternatively be placed in system control logic 508, network interface 520, and/or processor 504.
  • the network interface 520 may include a transceiver to provide a radio interface for the system 500, and then communicate with any other suitable devices (such as a front-end module, an antenna, etc.) through one or more networks.
  • the network interface 520 may be integrated with other components of the system 500.
  • the network interface may include the processor of the processor 504, the memory of the system memory 512, the memory of the memory 516, and/or a firmware device (not shown) with instructions, the instructions being generated by at least one of the processors 504
  • the system 500 executes the instructions of the method executed by the mobile phone 100a or the computer 100b in FIG. 2.
  • the network interface 520 may further include any suitable hardware and/or firmware to provide a multiple input multiple output radio interface.
  • the network interface 520 used in a certain embodiment may be a network adapter, a wireless network adapter, a telephone modem, and/or a wireless modem.
  • At least one of the processors 504 may be packaged with the logic of one or more controllers for the system control logic 508.
  • at least one of the processors 504 may be packaged with the logic of one or more controllers for the system control logic 508 to form a system in package (SiP).
  • at least one of the processors 504 may be integrated with the logic of one or more controllers for the system control logic 508.
  • at least one of the processors 504 may be integrated with the logic of one or more controllers for the system control logic 508 to form a system on chip (SoC).
  • SoC system on chip
  • the system 500 may further include: an input/output (I/O) device 532.
  • the I/O device 532 may include a user interface designed to enable a user to interact with the system 500; a peripheral component interface designed to enable peripheral components to also interact with the system 500; and/or a peripheral component interface designed to determine Sensors for environmental conditions and/or location information related to the system 500.
  • the user interface may include, but is not limited to, a display (e.g., liquid crystal display, touch screen display, etc.), speakers, microphone, one or more cameras (e.g., still image camera and/or video camera), flashlight/flashlight (For example, LED flash) and keyboard.
  • a display e.g., liquid crystal display, touch screen display, etc.
  • speakers e.g., speakers, microphone
  • one or more cameras e.g., still image camera and/or video camera
  • flashlight/flashlight For example, LED flash
  • the peripheral component interface may include, but is not limited to, a non-volatile memory port, an audio jack, and a power interface.
  • the sensors may include, but are not limited to, a gyroscope sensor, an accelerometer, a proximity sensor, an ambient light sensor, and a positioning unit.
  • the positioning unit may also be part of or interact with the network interface 520 to communicate with components of the positioning network (eg, global positioning system (GPS) satellites).
  • GPS global positioning system
  • Fig. 7 shows another terminal device 1100 according to an embodiment of the present application.
  • the device 1100 includes a transceiver module 1101 and a processing module 1102.
  • the terminal device 1100 can perform various operations performed by the mobile phone 100a or the computer 100b in the content sharing method shown in FIG. 2.
  • a content sharing device may be provided, and the content sharing device may be implemented in a mobile phone 100a or a computer 100b.
  • the content sharing device may include a transceiver module 1101 and a processing module 1102.
  • the content sharing device may be configured to perform various operations performed by the mobile phone 100a or the computer 100b described above in conjunction with FIG. 2.
  • the transceiver module 1101 can be used to perform operations S1, S4, receive signals from S7, and perform operations S11-S14, S16, etc.
  • the processing module 1102 can be used to perform operations S2, S3, S8-S10, and S15, etc.
  • the transceiver module 1101 can be used to receive signals sent in operations S1, S4, and S11, and perform operations S7, S12-S14, and S16, etc.
  • the processing module 1102 can be used to perform operations S5-S6 and so on.
  • FIG. 8 shows another terminal device 1200 according to an embodiment of the present application.
  • the terminal device 1200 includes at least one processor 1210, a memory 1220, and a transceiver 1230.
  • the processor 1210 is coupled with the memory 1220 and the transceiver 1230.
  • the coupling in the embodiment of the present application is a direct or indirect coupling or a communication connection between devices, units, or modules, and may be in electrical, mechanical or other forms. Information exchange between devices, units or modules.
  • the embodiment of the present application does not limit the connection medium between the transceiver 1230, the processor 1210, and the memory 1220.
  • the memory 1220, the processor 1210, and the transceiver 1230 may be connected by a bus, and the bus may be divided into an address bus, a data bus, a control bus, and the like.
  • the memory 1220 may be used to store program instructions.
  • the transceiver 1230 can be used to receive or transmit data.
  • the processor 1210 may be used to call program instructions stored in the memory 1220, so that the device 1200 executes the operations performed by the mobile phone 100a or the computer 100b in FIG. 2.
  • the processor 1210 may be a general-purpose processor, a digital signal processor, an application specific integrated circuit, a field programmable gate array or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component.
  • the general-purpose processor may be a microprocessor or any conventional processor or the like.
  • the operations combined with the methods disclosed in the embodiments of the present application may be directly embodied as being executed and completed by a hardware processor, or executed and completed by a combination of hardware and software modules in the processor.
  • the memory 1220 may be a non-volatile memory or a volatile memory.
  • the memory is any other medium that can be used to carry or store desired program codes in the form of instructions or data structures and that can be accessed by a computer, but is not limited to this.
  • the memory in the embodiments of the present application may also be a circuit or any other device capable of realizing a storage function for storing program instructions and/or data.
  • the various embodiments disclosed in this application may be implemented in hardware, software, firmware, or a combination of these implementation methods.
  • the embodiments of the application can be implemented as a computer program or program code executed on a programmable system.
  • the programmable system can include at least one processor, a storage system (including volatile and non-volatile memory and/or storage elements). ), at least one input device and at least one output device.
  • Program codes can be applied to input instructions to perform the functions described in this application and generate output information.
  • the output information can be applied to one or more output devices in a known manner.
  • a processing system includes any system having a processor such as, for example, a digital signal processor (DSP), a microcontroller, an application specific integrated circuit (ASIC), or a microprocessor.
  • DSP digital signal processor
  • ASIC application specific integrated circuit
  • the program code can be implemented in a high-level programming language or an object-oriented programming language to communicate with the processing system.
  • assembly language or machine language can also be used to implement the program code.
  • the mechanism described in this application is not limited to the scope of any particular programming language. In either case, the language can be a compiled language or an interpreted language.
  • the disclosed embodiments may be implemented in hardware, firmware, software, or any combination thereof.
  • the disclosed embodiments may also be implemented in the form of instructions or programs carried or stored on one or more transient or non-transitory machine-readable (for example, computer-readable) storage media, which may be implemented by one or more The processor, etc. read and execute.
  • machine-readable for example, computer-readable
  • the processor, etc. read and execute.
  • the instructions or programs are executed by the machine, the machine can execute the aforementioned various methods.
  • the instructions can be distributed via a network or other computer-readable media.
  • a machine-readable medium may include, but is not limited to, any mechanism for storing or transmitting information in a form readable by a machine (for example, a computer), such as floppy disks, optical disks, compact disk read-only memories (CD-ROMs), and magnetic disks.
  • a machine for example, a computer
  • ROM read-only memory
  • RAM random access memory
  • EPROM erasable programmable read-only memory
  • EEPROM electronically erasable programmable read-only memory
  • magnetic or optical card or for Flash memory or tangible machine-readable memory that transmits network information through electricity, light, sound, or other forms of signals (for example, carrier waves, infrared signals, digital signals, etc.).
  • the machine-readable medium includes any form of machine-readable medium suitable for storing or transmitting electronic instructions or machine (for example, computer) readable information.
  • the embodiments of the present application also include non-transitory tangible machine-readable media containing instructions or design data, such as hardware description language (HDL), which defines the structures, circuits, devices, and processes described herein. And/or system characteristics.
  • HDL hardware description language
  • the terminal device may include a hardware structure and/or a software module, in the form of a hardware structure, a software module, or a hardware structure plus a software module To achieve the above functions. Whether a certain function among the above-mentioned functions is executed by a hardware structure, a software module, or a hardware structure plus a software module depends on the specific application and design constraint conditions of the technical solution.
  • first, second, etc. may be used herein to describe various features, these features should not be limited by these terms. These terms are used only for distinction, and cannot be understood as indicating or implying relative importance.
  • first feature may be referred to as the second feature, and similarly the second feature may be referred to as the first feature.
  • references in the specification to "one embodiment”, “an embodiment”, “an illustrative embodiment”, etc. indicate that the described embodiment may include specific features, structures, or properties, but each embodiment may or may not necessarily include specific The characteristics, structure or properties of. Moreover, these phrases are not necessarily referring to the same embodiment. In addition, when specific features are described in conjunction with specific embodiments, the knowledge of those skilled in the art can influence the combination of these features with other embodiments, regardless of whether these embodiments are explicitly described.
  • module can refer to, as a part of it, or include: memory (shared, dedicated or group) for running one or more software or firmware programs, application specific integrated circuit (ASIC), Electronic circuits and/or processors (shared, dedicated or group), combinational logic circuits, and/or other suitable components that provide the described functions.
  • memory shared, dedicated or group
  • ASIC application specific integrated circuit
  • processors shared, dedicated or group
  • combinational logic circuits and/or other suitable components that provide the described functions.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Computer Hardware Design (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Environmental & Geological Engineering (AREA)
  • Telephone Function (AREA)

Abstract

一种内容传输方法,该方法可以包括:第一设备确定与第二设备之间的距离小于距离阈值;第一设备提示用户第一设备与第二设备之间可进行内容传输;第一设备识别用户对第一设备的手势操作,并根据识别出的手势操作确定传输内容和传输内容在第一设备与第二设备之间的传输方向;第一设备根据确定的传输方向,从第二设备接收传输内容或向第二设备发送传输内容。该方法提供的内容传输方法能够简化数据传输操作,同时避免数据传输方向的误判。

Description

内容传输方法、设备及介质
本申请要求于2020年3月25日提交中国专利局、申请号为202010219576.2、申请名称为“内容传输方法、设备及介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及一种内容传输方法、设备及介质。
背景技术
终端设备普及以来,每个用户可能会拥有多个终端设备(例如手机、平板电脑和台式计算机等),终端设备间的内容同步、传输越来越频繁,传输方式的简易度与便捷性会极大地影响用户的工作和生活效率。
目前终端设备之间数据传输的方式,主要有两大途径:一种是近距离传输:例如,通过通用串行总线(Universal Serial Bus,USB)、WIFI、蓝牙、近场通信(Near Field Communication,简称NFC)等作为直连传输通道,另一种是联网传输:借助局域网传输软件、互联网社交软件等完成终端设备间的数据传输。各种传输方式大都需要用户进行繁琐的操作。
发明内容
本申请的目的在于提供一种简洁易用的内容传输方案。
本申请的第一方面提供了一种内容传输方法,该方法可以包括:第一设备确定与第二设备之间的距离小于距离阈值;第一设备提示用户第一设备与第二设备之间可进行内容传输;第一设备识别用户对第一设备的手势操作,并根据识别出的手势操作确定传输内容和传输内容在第一设备与第二设备之间的传输方向;第一设备根据确定的传输方向,从第二设备接收传输内容或向第二设备发送传输内容。
本申请的实施例提供的内容传输方法能够简化数据传输操作,同时避免数据传输方向的误判。
进一步,第一设备根据识别出的手势操作确定传输内容和传输内容在第一设备和第二设备之间的传输方向,可以包括:第一设备根据识别出的第一手势操作,确定第一传输内容,并确定第一传输内容的传输方向是从第一设备到第二设备。
或者,第一设备根据识别出的手势操作确定传输内容和传输内容在第一设备和第二设备之间的传输方向,可以包括:第一设备根据识别出的第二手势操作,确定第二传输内容,并确定第二传输内容的传输方向是从第二设备到第一设备。
利用不同的手势对应不同的传输方向,避免传输方向的误判而导致的第一设备与第二设备之间分享的内容出错,例如,用户原本希望由第二设备传输到第一设备,但是第一设备的数据被传输到了第二设备之类的问题。
进一步,前述的手势操作可以是用户手持第一设备的移动方式,例如,用户手持第一设备进行左移、右移、前移、后移等等。其中,用户手持第一设备的移动方式可以通过检测第一设备的 加速度的变化来获取,加速度的变化可以通过设备中的重力传感器等器件来检测。
进一步,前述的手势操作可以是用户在第一设备的触摸屏上的触摸操作,例如,用户在设备的触摸屏上的左滑、右滑、长按等操作。
进一步,前述第一设备确定与第二设备之间的距离小于距离阈值,可以包括:第一设备监测第一设备的磁感应信号强度的变化,并在磁感应信号强度的变化超过预设的强度变化阈值的情况下,确定第一设备与第二设备之间的距离小于距离阈值。在这种实施方式中,将磁感应信号强度作为触发信号,通过磁感应信号强度的变化来触发测距。
进一步,前述第一设备确定第一设备与第二设备之间的距离,可以包括:第一设备通过蓝牙测距、毫米波测距和超声波测距等各种测距方式中的至少一种来确定与第二设备之间的距离。
进一步,第一设备通过蓝牙测距确定第一设备与第二设备之间的距离可以具体包括:第一设备发送第一蓝牙广播信号;第一设备接收第二设备发送的第二蓝牙广播信号和与第二距离相关的信息;其中,第二蓝牙广播信号由第二设备响应于收到第一蓝牙广播信号而发送,与第二距离相关的信息用于表征第二距离,第二距离为由第二设备根据收到的第一蓝牙广播信号计算得到的第一设备与第二设备之间的第二距离;第一设备根据收到的第二蓝牙广播信号,获取第一距离,其中,第一距离为由第一设备根据第二蓝牙广播信号的信号强度计算得到的第一设备与第二设备之间的第一距离;将第一距离和第二距离中较大的一个确定为第一设备与第二设备之间的距离。
本申请的第一方面提供的实施方式中提供的内容传输方法,一方面能够简化了数据传输的过程;另一方面借助于手势识别来确定传输方向和传输内容,实现了两个设备间的双向传输,同时能够有效地避免传输方向出错。
本申请的第二方面提供了一种内容传输装置,该装置具有实现前述第一方面或第一方面的任一实现方式提供的方法的功能。功能可以通过硬件实现,也可以通过硬件执行相应的软件实现。硬件或软件包括一个或多于一个与上述功能相对应的模块。
本申请的第三方面提供了一种机器可读介质,该机器可读介质中可以存储有指令,当该指令被机器运行时,机器可以执行如前述第一方面或第一方面的任一实现方式提供的方法。
本申请的第四方面提供了一种设备,包括:存储器和处理器,存储器中存储有指令,处理器用于读取并执行存储器中的指令,以使得该设备执行:确定与第二设备之间的距离小于距离阈值;提示用户对所述设备进行手势操作以传输内容,其中所述设备能够识别所述用户对所述设备的至少两个手势操作所述设备与所述第二设备之间可进行内容传输;识别所述用户对所述设备的手势操作,并根据识别出的所述手势操作确定传输内容和所述传输内容在所述设备与所述第二设备之间的传输方向;根据确定的传输方向,从所述第二设备接收所述传输内容或向所述第二设备发送所述传输内容。
本申请的第五方面提供了一种系统,该系统中可以包括如前述第四方面或第四方面的任一实现方式提供的设备和第二设备。
本申请的第六方面提供了一种计算机程序产品,该计算机程序产品可以包括程序代码,当该计算机程序产品被控制器执行时,该控制器执行前述第一方面或第一方面的任一实现方式提供的方法。该计算机程序产品可以为一个软件安装包,在需要使用前述第一方面或第一方面的任一实现方式提供的方法的情况下,可以下载该计算机程序产品至该控制器并在该控制器上运行该计算机程序产品。
本申请的各种实施方式中提供的内容分享方案,简化了数据传输的过程;另外借助于手势识 别来确定传输方向和传输内容,实现了两个设备间的双向传输,同时能够有效地避免传输方向出错。此外,本申请提供的方案相比于NFC触碰等方式只能应用于非常短的传输距离的情况,本申请提供的方案可以用于更长的距离。
附图说明
图1示出了终端设备间进行近距离内容传输的场景示例;
图2示出了根据本申请的实施例的手机与电脑分享内容的交互过程的流程图;
图3示出了根据本申请的实施例的手机中的重力传感器的坐标示意图;
图4示出了根据本申请的实施例的手机与电脑分享内容的一种具体实现方式;
图5示出了根据本申请的实施例的终端设备的结构示意图;
图6示出了根据本申请的实施例的示例计算系统示意图;
图7示出了根据本申请的实施例的终端设备的示意图;
图8示出了根据本申请的另一实施例的终端设备的示意图。
具体实施方式
下面结合具体实施例和附图对本申请做进一步说明。可以理解的是,此处描述的具体实施例仅仅是为了解释本申请,而非对本申请的限定。此外,为了便于描述,附图中仅示出了与本申请相关的部分而非全部的结构或过程。应注意的是,在本说明书中,相似的标号和字母在下面的附图中表示类似项。
本申请的说明性实施例包括但不限于内容传输方法、设备及介质等。
为使本申请的目的、技术方案和优点更加清楚,下面将结合附图对本申请的实施方式作进一步地详细描述。在附图中,参考数字后面的字母,例如“100a”表示对具有该特定参考数字的元素的引用。文本中没有后续字母的参考数字,例如“100”,表示对带有该参考数字的元件的实施方式的一般引用。
目前,在已有的传输技术中,在终端设备之间的数据传输方式大都需要用户进行多个步骤的繁琐操作:例如,如果第一终端设备要分享内容给第二终端设备,通常需要用户在第一终端设备上进行多步操作,例如:选定传输内容,查找、发现和选择目标设备,点击分享,再完成传输等。分享过程较为繁琐。有一些将多个步骤简化为一步分享的方式(例如采用通过NFC触碰、声音、超声波、快捷键等方式一步分享数据),但是这些方式非常容易导致数据分享方向误判,例如,用户原本希望由第一终端设备传输到第二终端设备,但是由于误触、误操作,可能会导致第二终端设备的数据被传输到了第一终端设备,影响用户体验。
本申请的实施例旨在提供一种基于距离和手势分享内容的方案,简化分享操作的同时,避免数据传输方向的误判。本申请的实施例提供的内容分享方法适用于终端设备之间的内容分享,例如两个终端设备之间的内容同步、传输等。
图1示出了一种终端设备间进行近距离内容分享的场景示例。
如图1所示,根据本申请的一些实施例,提供一种数据分享系统10,数据分享系统10中可以包括两个终端设备100,例如:手机100a和电脑100b。用户可以手持手机100a向电脑100b靠近,以实现近距离的内容分享。
在如图1所示的数据分享系统10中,手机100a中可以包括磁传感器,而电脑100b中会包括 大量的磁器件。在手机100a周围没有磁性器件或设备的平稳状态下,手机100a通过磁传感器感测到的磁感应信号的强度也是平稳的,而当手机100a与电脑100b靠近时,手机100a的磁传感器会受到电脑100b的磁器件的影响,导致手机100a端的磁感应信号强度出现剧烈波动。因此,可以以手机100a监测到磁感应信号强度的变化超过一定的强度变化阈值作为触发条件,随后两终端设备100可以通过蓝牙广播或超声波等验证两终端设备100之间的距离是否足够近,在两终端设备间的距离处于预设范围的情况下,触发传输,随后再通过用户手势来判断数据在手机100a与电脑100b之间的传输方向,从而实现两终端设备间的内容分享。本申请的实施例旨在基于终端设备中的磁传感器、蓝牙或超声波能力等来精准地识别设备间的距离,并配合用户手势,实现两终端设备间的便捷而准确的内容分享。
根据本申请的一些实施例,终端设备100不仅限于图1中所示的手机100a和电脑100b,其可以是包括内存和硬件处理器的各种计算设备。例如,终端设备100的示例可以包括:手机、相机、平板计算机、台式计算机、膝上型计算机、车载终端、智能语音终端、便携式游戏机、便携式音乐播放器、读取器设备、可穿戴设备、智能家居设备、增强现实(augmented reality,AR)设备、虚拟现实(virtual reality,VR)设备等各种电子设备。终端设备100的示例性实施例包括但不限于搭载IOS、Android、Microsoft或者其它操作系统的各种电子设备。
在一些实施方式中,终端设备100可以是由用户穿戴的可穿戴设备。例如,终端设备100可以是手表、手环、首饰、眼镜等,或者作为他们的一部分。在各种实施方式中,用户可以在终端设备100的显示器上查看消息或者可以经由设备的扬声器或其他输出设备来访问消息等。在另一示例中,用户可以经由耦合到终端设备100或作为终端设备100的一部分的耳机、终端设备100的扬声器、终端设备100的触觉反馈元件等来访问消息。
终端设备100可以通过网络与其他设备实现交互,在各种实施方式中,前述网络可以是有线网络或无线网络,并且可以具有许多不同的配置。前述网络可以包括局域网(LAN)、广域网(WAN)(例如,因特网)等各种互连数据路径。网络还可以耦合到或包括电信网络的部分,用于以各种不同的通信协议发送数据。在一些实施方式中,网络也可以包括用于发送和接收数据的蓝牙通信网络、Wi-Fi或蜂窝通信网络等。
终端设备100的具体结构示例将在后文结合图5至图8进行具体说明。
下面结合图2和图4,以图1中的手机100a和电脑100b为例,详细描述终端设备100之间分享内容的过程。
根据本申请的实施例,图2示出了手机100a与电脑100b之间分享内容的交互过程。
首先,S1:手机100a与电脑100b靠近,通过蓝牙识别对方身份,并进行蓝牙配对建立长连接,例如,建立低功耗蓝牙(Bluetooth Low Energy,BLE)长连接。在一些实施方式中,手机与电脑可以通过如图5中所示的无线通信模块160或其他类似的模块来通信地耦合,以建立BLE长连接。
S2:建立连接后,两终端设备首先进行数据传输意图的触发,手机100a通过内部的磁传感器实时监测手机100a的磁感应信号强度的变化。
在本发明的实施例中,利用了手机100a中的磁传感器可以检测当前环境中的磁场强度的特性,当有磁性干扰源靠近的时候,磁传感器可以识别到当前磁场强度数据发生了不正常变化。而电脑等设备本身作为一个复杂的磁场,在电脑100b中会存在大量的磁性器件,当电脑100b靠近手机100a的时候,是一定可以成为一个磁性干扰源的,本申请通过手机100a中的磁传感器检测磁性 干扰源来识别是否有设备靠近,在无磁性干扰源靠近手机100a时,手机100a检测到的磁感应信号的强度是比较平稳的,而当电脑100b靠近手机100a时,手机100a检测到的磁感应信号的强度会出现剧烈的变化或波动,通过监测磁感应信号强度的变化是否超过预设的强度变化阈值可以确定变化或波动的剧烈程度,从而识别是否有磁干扰源的靠近。
S3:当电脑100b靠近手机100a时,手机100a端的磁传感器会监测到磁感应信号强度的剧烈变化,该磁感应信号强度的剧烈变化可以作为手机100a与电脑100b之间意图分享内容的触发事件。
S4:在手机100a监测到磁感应信号强度的变化超过预设的强度变化阈值(即,S3中判断为是)的情况下,即说明手机100a监测到的磁感应信号的强度发生了剧烈变化,这意味着手机100a附近有磁干扰源出现,但是,手机100a监测到磁干扰并不意味着一定是电脑100b等其他终端设备在靠近,该磁干扰源可能是电脑100b,也可能是其他设备或者器件,例如磁铁等。为了验证靠近手机100a的到底是与手机100a长连接的电脑100b,还是其他磁干扰源,手机100a可以开启蓝牙广播信号,以通过蓝牙测量手机100a与电脑100b之间的距离。
S5-S6:手机100a与电脑100b之前之间已经建立蓝牙长连接,电脑100b可以接收手机100a发来的蓝牙信号,根据接收到的蓝牙信号的强度,确定自己与手机100a之间的距离,并将确定的距离与预设阈值进行比较,判断自己与手机100a之间的距离是否小于预设的距离阈值。
电脑100b可以根据蓝牙接收信号强度指示(Received Signal Strength Indicator,RSSI),来计算自己与手机100a之间的距离D,如下面的公式(1)所示:
D=10^((abs(RSSI)-A)/(10*n))      (1)
其中:
D为发射端(即手机100a)与接收端(即电脑100b)之间的距离;
RSSI为接收信号强度(负值);
A为发射端(即手机100a)和接收端(即电脑100b)相隔1米时的信号强度;
n为环境衰减因子。
S7:为了提高距离测量的准确性,可以在手机100a和电脑100b两端都开启距离校验,即电脑100b接收到手机100a的蓝牙信号后,也开启蓝牙广播。
S8-S9:在手机100a端,手机100a也可以根据接收到的来自电脑100b的蓝牙信号的强度,确定自己与电脑100b之间的距离,并判断自己与电脑100b之间的距离是否小于预设的距离阈值。
这样,手机100a和电脑100b这两个终端设备通过双重校验,可以进一步提高距离监测的准确性。在手机100a端和电脑100b端均判定手机100a与电脑100b之间的距离小于预设的距离阈值的情况下,证明手机100a端的磁感应信号强度的剧烈变化事件并不是其他磁干扰源带来的误触发,而确实是手机100a与电脑100b靠近带来的磁干扰事件。
本发明的实施例中提供的这种在磁感应触发内容分享事件后,通过判断终端设备之间的距离来进一步校验的方式可以提高后续内容传输的安全性。否则,如果没有距离判断的操作,在手机100a与电脑100b距离很远的情况下,通过在手机100a附近提供诸如磁铁之类的各种磁器件都有可能会导致手机100a的磁感应信号强度的剧烈变化,从而触发内容的传输,这会带来数据泄露的风险。
根据本申请的一些实施例,也可以不通过手机100a和电脑100b这两个终端设备的双重校验,而只通过单端测距来校验磁感应触发事件即可。此外,在手机100a或电脑100b上安装有符合蓝 牙5.1标准的蓝牙模块的情况下,单端测距即可实现较高的准确度,在这种情况下,无需再进行两端的双重校验。
此外,根据本申请的一些实施例,手机100a与电脑100b间距离的测量也可以采用其他方案进行,或者采用多种测距方案的结合来进行,其中,其他测距方案可以包括但不限于,毫米波测距、超声波测距等。
在判定手机100a与电脑100b之间的距离小于预设的距离阈值的情况下,可以确定手机100a与电脑100b之间满足内容分享条件。
根据本申请的一些实施例,通过S4至S9的距离校验操作确定手机100a与电脑100b之间满足内容分享条件后,手机100a可以输出特定的图案、音效、振动或动态界面效果等,以提醒用户可以开始手势操作以分享内容。
S10:手机100a识别用户手势,根据用户手势确定要传输的内容和传输的方向。
根据本申请的一些实施例,用户的手势可以是用户手持手机100a的移动,在这种情况下,可以通过监测手机100a的移动方式(如左移、右移等等)来判断用户的手势,并且每个手势可以被映射到要启动的特定操作。
手机100a的移动方式(如左移、右移等等)可以通过手机100a中的重力传感器来检测手机100a的加速度的变化来获取。
重力传感器又称重力感应器,它能够感知手机100a在各个方向上的加速度的大小,进而通过加速度值来判断手机100a的运动,比如左右晃动、上升、下降等。当手机100a静止时,重力传感器可检测出重力的大小及方向。手机100a中的重力传感器通常为三轴结构,重力传感器通过三轴可以感知任意方向上的加速度,判断手机100a的空间运动。
重力传感器在进行三轴的加速度运算时,重力感应坐标通常是相对于手机100a而言,而不是空间坐标。例如,参见图3,将手机正面朝上以正对方向平放在桌面上,重力传感器能够感知手机100a在图示X、Y、Z三轴的加速度数值。其中,X轴为左右方向,Y轴为前后方向,Z轴为上下方向,重力传感器测得的三轴加速度的数值包含地心引力的影响,单位是m/s^2。在静止状态下,X轴加速度默认为0,Y轴默认0,Z轴默认9.81。
在X轴方向上,如果手机100a突然向左移动,则X轴加速度值为正值,而如果手机突然向右移动,X轴加速度值则为负值。
在Y轴方向上,如果手机100a突然向前移动,则Y轴加速度值为正值,而如果手机突然向后移动,Y轴加速度值则为负值。
在Z轴方向上,如果手机100a突然向上移动,则Z轴加速度值为大于9.81,而如果手机突然向下移动,Z轴加速度值则为小于9.81。
因此,重力传感器启动后,在用户没有手势动作时,重力传感器测得的加速度信号会相对平稳;而当用户有手势动作时,加速度信号会变化剧烈,通过加速度信号的差分值可显示出信号变化的剧烈程度;当手势结束后,加速度信号会恢复平稳。因此可以用加速度差分值来实时判断手机100a移动的起点和终点,并判断手机100a移动的具体方向。具体过程如下:
首先,对于重力传感器测得的加速度数据进行采样,对于第k个采样点,三轴的加速度差分值可以通过式(2)计算:
Δa k=(ax k-ax k-1)+(ay k-ay k-1)+(az k-az k-1)     (2)
其中,
Δa k表示第k个采样点的三轴的加速度差分值,
ax k表示第k个采样点的X轴的加速度,
ax k-1表示第k-1个采样点的X轴的加速度,
ay k表示第k个采样点的Y轴的加速度,
ay k-1表示第k-1个采样点的Y轴的加速度,
az k表示第k个采样点的Z轴的加速度,
az k-1表示第k-1个采样点的Z轴的加速度。
随后,根据各个点的三轴的加速度差分值Δa k,可以得到k点之前的一段时间内的加速度差分值的均值,例如,k之前N个采样点内(即,从k-N到k这N个采样点)的加速度差分值的均值Ma k
Figure PCTCN2021080794-appb-000001
其中,
Δa i表示从k-N到k这N个采样点中的第i个采样点的三轴的加速度差分值,
Ma k表示k之前N个采样点内的加速度差分值的均值。
那么,通过比较Ma k与Δa k,便可以判断手势的起点和终点。如果Ma k<<Δa k则可以认为k点是手势的起点;而如果Ma k>>Δa k,则可以认为k点是手势的终点。
这是因为,在用户无手势操作时,手机100a处于相对稳定的状态,各个采样点的Δa k之间的差异不大,各个采样点的Δa k的值连起来将会是一条平缓的曲线,而当用户进行手势操作时,手机会被突然加速,手势操作的起点的Δa k值会激增,那么,Ma k<<Δa k。反之,当手势操作结束时,手机会回归相对稳定的状态,Ma k>>Δa k。因此,通过,Ma k与Δa k的比较,可以较为容易的判断手势的起点和终点。
在手势起点和手势终点确定后,可以确定手势的持续时间,进而可以得到在X、Y、Z三轴方向上手势持续时间内的平均能量E ax,E ay,E az
Figure PCTCN2021080794-appb-000002
其中,
L为手势起点到终点的采样点数量,
ax j为手势起点到终点的这段时间中的第j个采样点的X轴加速度值,
ay j为手势起点到终点的这段时间中的第j个采样点的Y轴加速度值,
az j为手势起点到终点的这段时间中的第j个采样点的Z轴加速度值,
E ax为手势起点到终点的这段时间中的X轴加速度信号的平均能量值,
E ay为手势起点到终点的这段时间中的Y轴加速度信号的平均能量值,
E az为手势起点到终点的这段时间中的Z轴加速度信号的平均能量值。
比较X、Y、Z三轴加速度信号的平均能量值E ax,E ay,E az,找出能量值最大的一个轴作为能量最大轴。能量最大轴为X轴则说明手机为左右晃动,能量最大轴为Y轴则说明手机为前后晃动,能量最大轴为Z轴则说明手机为上下晃动。
以X轴为能量最大轴举例,利用从手势起点到终点这L个采样点的每个采样点的加速度值ax,预设手机100a在X轴方向上的加速度的上限阈值和下限阈值,根据加速度值是首先突破上限阈值还是首先突破下限阈值,来判断手机是向左移动还是向右移动。若加速度值首先突破上限阈值,则说明手机100a向左移动,若加速度值首先突破下限阈值,则说明手机100a向右移动。
根据本申请的一些实施例,也可以在L个采样点的持续时间内,遍历各个采样点X轴方向上的加速度值,得到散点波形图,并寻找波峰和波谷,同样预设手机100a加速度的上限阈值和下限阈值,并舍弃低于上限阈值的波峰和高于下限阈值的波谷,判断剩下的波峰波谷的次序,若先出现波峰则说明手机100a为向左移动,否则先出现波谷则说明手机100a向右移动。在这种实施方式中,通过统计上述舍弃操作后剩余的波峰波谷的数量,还可以判断手机100a是否是在摇动。若波峰波谷的数量大于预设的数量阈值,则说明手机100a在摇动,而不是向一个方向移动。
为了提高判断的准确性,可以在手势开始后一段时间(例如,0.2秒)之后再进行阈值的比较和手机100a移动方向的判断,从而避免手势初期的误判。
Y轴为能量最大轴和Z轴为能量最大轴的情况与上述过程类似,在此不再赘述。
通过判断能量最大轴和能量最大轴方向上的加速度值的变化,可以得到手机100a的移动方式,也就是手势操作。得到手机100a的移动方式后,可以通过定义手机100a的移动方式与传输内容和传输方向之间的对应关系,来定义每个手势与要启动的特定操作的映射关系。例如,根据本申请的一些实施例,可以将手机100a的运动分为:左移、右移、前移、后移、上移、下移、摇动等,并分别针对各种运动来确定手机100a与电脑100b之间要传输的内容和内容传输的方向。
表1示出了根据本申请的一些实施例的手机100a的移动与传输内容和传输方向之间的对应关系示例。
表1
Figure PCTCN2021080794-appb-000003
表1所示的手机100a的运动与传输内容和传输方向之间的对应关系仅仅是举例说明,在不同的实施方式中,可以通过与手机100a中的各个应用软件配合,定义各种不同的对应关系。
根据本申请的一些实施例,也可以仅定义传输方向,而不定义传输内容,例如,直接将手机100a与电脑100b的当前的内容(包括:桌面、应用、图片、影音),从一端到另外一端,互相传递,使所见即所得,保持运行的状态一致。
比如,可以定义前移为手机100a向电脑100b发送内容,而后移则是手机100a从电脑100b 接收内容。那么,在检测到手机100a前移的情况下:如果手机100a在桌面状态(没有打开应用的情况下),则将手机100a桌面传输到电脑100b上;如果手机100a打开了一个应用,则将界面及运行状态直接迁移、并呈现在电脑100b的屏幕上,并保持运行的状态一致;如果手机100a打开图片或影音后,则将手机100a图片或影音直接迁移、并呈现在电脑100b的屏幕上。
需要注意的是,以上手机100a的移动方向的定义均以手机100a正面朝上且正向持握为基准,如果手机100a被反向持握,那么可能会出现手持手机100a的移动方向与实际传输内容的方向相反的情况。
S11:在手机100a端根据识别到的用户手势确定好传输方向和传输内容后,手机100a可以将确定的传输方向和传输内容发送给电脑100b。
例如,根据表1中示出的对应关系,假设在S10中,识别到手机100a的移动方式为左移,那么,对应的传输方向和传输内容即为:电脑100b的桌面应用程序的界面及运行状态直接迁移、并呈现在手机100a屏幕上。手机100a可以将该传输方向和传输内容发送给电脑100b,以便电脑100b做好将与桌面应用程序的界面及运行状态相关的数据发送给手机100a的准备。
随后,S12:手机100a与电脑100b可以通过蓝牙握手,协商WIFI连接参数,以准备手机100a与电脑100b之间的内容分享。
根据本申请的一些实施例,手机100a与电脑100b之间的内容分享可以通过WIFI直连(WIFI Direct,又称WIFI P2P)来进行,以获取更高的数据传输速度。WIFI直连作为一种点对点连接技术,可以无需额外的接入点(Access Point,AP)的参与,而是在手机100a和电脑100b这两台终端设备之间直接建立TCP/IP连接;其中手机100a和电脑100b中的一台可以作为组拥有者(Group Owner,GO),起到传统意义上的AP的作用,而手机100a和电脑100b中的另外一台则作为组客户端(Group Client,GC),以类似于连接AP的方式连接到作为GO的终端设备。
在操作S12中,手机100a与电脑100b协商的WIFI连接参数可以包括WIFI GO的服务集标识符(Service Set Identifier,SSID)和密码。
S13:手机100a与电脑100b根据S12中协商的WIFI连接参数,建立WIFI直连。
S14:通过WIFI将操作S10中确定的传输内容按照操作S10中确定的传输方向从手机100a和电脑100b中的一个传输到另一个。
手机100a与电脑100b之间的内容传输可以采用Miracast投屏技术。手机100a与电脑100b通过WIFI P2P组网后,发送数据的一端作为source端,而接收数据的一段则作为sink端。然后二者可以通过TCP或UDP等传输协议来进行数据的传输,以将source端的内容(包括:桌面、应用、图片、影音等)发送给sink端。在手机100a与电脑100b建立会话后,还可以利用miracast投屏技术中的用户输入反向通道(User Input Back Channel,UIBC)建立功能,建立UIBC,以实现用户在Sink端对Source端的反向控制。
例如,根据表1,在识别到手机100a的移动为右移的情况下,手机100a将与应用程序的界面及运行状态相关的数据发送给电脑100b,手机100a为source端,而电脑100b为sink端。通过Miracast投屏技术,手机100a的应用程序的界面及运行状态将直接迁移、并呈现在电脑100b的屏幕上,并保持电脑100b呈现的状态与手机100a运行的状态一致,而用户可以在电脑100b上通过键盘、鼠标或触控的方式操作手机桌面。
在本申请的实施例中,将蓝牙连接作为控制信道,WIFI连接作为数据信道,以利用WIFI传输数据速度较快的特点,提高内容的分享速度。然而,本领域技术人员应当理解,在一些实施方 式中,也可以不包括S12和S13的操作,而是直接通过蓝牙来传输要分享数据;或者,在另一些实施方式中,手机100a与电脑100b也可以利用其他通信协议来建立其他通信连接,以通过其他方式来传输要分享数据。
S15:传输完成后,手机100a可以判断用户是否要继续分享其它内容,例如,可以利用界面或者声音等输出提示消息,提示用户是否要继续分享。
在用户需要继续分享的情况下(即S15中判断为是),可以返回到操作S10,再次进行用户手势的识别,并根据识别的用户手势确定传输方向和传输内容,随后继续执行S11和S14的操作,由于手机100a与电脑100b之间已经建立了WIFI连接,所以可以跳过S12和S13的操作。
在用户不需要继续分享的情况下(即S15中判断为否),该方法可以继续到S16:断开手机100a与电脑100b之间的WIFI连接。
根据本申请的一些实施例,S16的操作可以不在传输完成后就立即执行,而是在传输完成后等待一定的时间后再执行,例如,可以预设等待事件,例如,2分钟,并在完成内容的传输后2分钟无动作的情况下,再执行S16的断开操作。
在上面结合图2介绍的本申请的各种实施例中,手机100a和电脑100b中的控制逻辑可以采用各种架构,例如:分层架构,事件驱动架构,微核架构,微服务架构,或云架构等等。下面以分层架构的系统为例,示例性地说明实现本申请的实施例中提供的内容分享系统的一种具体方案。
图4示出了实现图2所示的内容分享方系统的手机100a和电脑100b的具体结构示例。
如图4所示,可以通过分层架构将控制逻辑分成若干个层,每一层都有清晰的角色和分工。层与层之间可以通过接口进行通信。根据本申请的一些实施例,手机100a和电脑100b的控制逻辑可以分为3层,分别是应用层、驱动层和器件层。
在手机100a和电脑100b中,应用层可以包括一个或多个应用程序包,用以进行内容分享的准备、分享意图的触发、分享意图的校验、分享内容和方向识别的逻辑判断以及数据传输的控制等。其中,分享的准备、分享意图的触发、分享意图的校验、分享内容和方向识别的逻辑判断可以集成为内容分享判定模块,用于进行内容分享的判定,而数据传输模块则可以用于进行数据传输的控制。
如图4所示,手机100a的应用层包括第一内容分享判定模块400和第一数据传输模块414,其中,第一内容分享判定模块400中包括第一分享准备模块401、第一分享意图校验模块406、分享意图触发模块407和传输方向/内容确定模块413。电脑100b的应用层包括第二内容分享判定模块420和第二数据传输模块421,其中第二内容分享判定模块420中包括第二分享准备模块425和第二分享意图校验模块431。上述应用层的各个模块可以通过分别调用下一级模块来实现相应的功能。
具体地,首先,手机100a的第一内容分享判定模块400与电脑100b的第二内容分享判定模块420配合以进行内容分享判定,即图2中的S1-S10的操作。
首先,执行S1:手机100a与电脑100b靠近,通过蓝牙识别对方身份,并进行蓝牙配对建立长连接。
手机100a端:应用层的第一分享准备模块401调用第一蓝牙通信模块402,第一蓝牙通信模块402向驱动层的第一蓝牙驱动模块403发送指令,以调用器件层的第一蓝牙模块404。
电脑100b端:应用层的第二分享准备模块425调用第二蓝牙通信模块426,第二蓝牙通信模块426向驱动层的第二蓝牙驱动模块427发送指令,以调用器件层的第二蓝牙模块428。
第一蓝牙模块404和第二蓝牙模块428分别响应于驱动层的指令,发送蓝牙广播信号,并在手机100a与电脑100b靠近时,彼此通过蓝牙名称等来识别对方身份,进行蓝牙配对以建立蓝牙长连接。
随后,执行S2-S3:建立连接后,两终端设备进行数据传输意图的触发,手机100a通过内部的磁传感器实时监测手机100a的磁感应信号强度。
电脑100b等各种终端设备,本身就是一个复杂的磁场,在电脑100b中,通常会存在大量的磁器件429,在本申请中,磁器件429指的是会带来磁干扰器件。
根据本申请的一些实施例,以笔记本电脑为例,笔记本电脑中通常存在磁传感器,设置在键盘部分(即通常所称的C面),而相应的,屏幕部分(即通常所称的B面)则通常会有磁器件,以与磁传感器配合来控制电脑休眠或工作。例如,当笔记本电脑屏幕部分与键盘部分闭合时,屏幕部分的磁器件靠近磁传感器,导致磁传感器附近磁场的变化,这使得磁传感器能够感知屏幕状态的变化,并让笔记本电脑通过外围电路和系统进入休眠状态,以降低功耗;而当屏幕打开时,磁器件远离磁传感器,笔记本电脑恢复正常工作。再如,在笔记本电脑的散热风扇中,通常包含定子和转子,而定子和转子也都是磁器件。
根据本申请的一些实施例,为了提高手机100a端的磁感应信号强度的变化强度,也可以在电脑100b中安装额外的磁器件429,或者优化已有的磁器件429,使磁器件429的面积更大或者磁干扰强度更高等。
手机100a端:通过器件层的磁传感器410监测手机100a的磁感应信号强度的变化。磁传感器410的示例包括但不限于,基于霍尔效应的霍尔传感器、基于各向异性磁阻(Anisotropic Magneto Resistance,AMR)效应的AMR传感器等。在各种终端设备中,以AMR传感器为例,AMR传感器可以利用磁阻来测量平面磁场,从而检测出磁场强度以及方向位置,其基本原理是利用各向异性磁致电阻材料感受到微弱的磁场变化时导致自身电阻产生变化。而霍尔传感器则会根据半导体在外围磁场方向产生改变时,会产生电压差的霍尔原理,来检测磁场的变化。
手机100a中的磁传感器410一般用在指南针或是地图导航中,帮助用户实现准确定位,或者用于检测翻盖皮套的开合。在本申请的实施例中,磁传感器410被用来感测周围是否有磁器件靠近。
在手机100a附近出现磁干扰源时,手机100a中的磁传感器410检测到的磁感应信号的强度会剧烈变化,手机100a中的磁传感器410将检测到磁感应信号的上报给驱动层,驱动层的传感器驱动模块409对接收到的磁干扰信号进行处理,以确定磁感应信号的强度,并进一步上报给应用层的磁感应检测模块408,磁感应检测模块408接收到磁感应信号强度的信息后,可以对磁感应信号强度的变化进行分析和判断,判断其是否超过了预设的磁感应信号强度变化阈值,并在超过了预设的磁感应信号强度变化阈值的情况下,向分享意图触发模块407发送信息,以触发分享意图。
随后,S4:为了验证靠近手机100a的到底是与手机100a长连接的电脑100b,还是其他磁干扰源,手机100a可以进行分享意图的校验。
手机100a端:应用层的第一分享意图触发模块407向第一分享意图校验模块406发送分享意图触发信息,第一分享意图校验模块406向第一蓝牙测距模块405发送第一校验指令,启动第一蓝牙测距模块405,应用层中的第一蓝牙测距模块405响应于收到的第一校验指令,向第一蓝牙驱动模块403发送信号,以通过第一蓝牙驱动模块403来控制第一蓝牙模块404发送蓝牙广播信 号。
S5-S6:电脑100b根据接收到的蓝牙信号的强度,确定自己与手机100a之间的距离,并将确定的距离与预设阈值进行比较,判断自己与手机100a之间的距离是否小于预设的距离阈值。
电脑100b端:第二蓝牙模块428收到手机100a发送的蓝牙广播信号后,可以将收到的蓝牙信号上报给驱动层的第二蓝牙驱动模块427,第二蓝牙驱动模块427随后可以对第二蓝牙模块428发来的数据进行处理,以确定蓝牙信号的强度等,并将蓝牙信号的强度上报给应用层的第二蓝牙测距模块430,使电脑100b的第二蓝牙测距模块430可以根据接收到的蓝牙信号的强度,确定自己与手机100a之间的距离,例如,可以利用前述公式(1)来确定自己与手机100a之间的距离。
第二蓝牙测距模块430将确定好的距离上报给第二分享意图校验模块431,第二分享意图校验模块431判断自己与手机100a之间的距离是否小于预设的距离阈值。
根据本申请的一些实施例,在电脑100b端执行距离判断时,可以同时执行S7:也开启蓝牙广播,使手机100a和电脑100b两端都开启距离校验。
电脑100b的应用层中的第二分享意图校验模块431向第二蓝牙测距模块430发送第二校验指令,第二蓝牙测距模块430响应于第二校验指令,向第二蓝牙驱动模块427发送指令,以通过前述第二蓝牙驱动模块427来控制第二蓝牙模块428发送蓝牙广播信号。
S8-S9:在手机100a端,手机100a也可以根据接收到的来自电脑100b的蓝牙信号的强度,确定自己与电脑100b之间的距离,并判断自己与电脑100b之间的距离是否小于预设的距离阈值。
具体地,手机100a端:第一蓝牙模块404收到电脑100b发送的蓝牙广播信号后,将收到的蓝牙信号上报给驱动层的第一蓝牙驱动模块403,第一蓝牙驱动模块403可以对第一蓝牙模块404发来的数据进行处理,以确定蓝牙信号的强度等,并将蓝牙信号的强度上报给应用层的第一蓝牙测距模块405,使手机100a中的第一蓝牙测距模块405可以根据接收到的蓝牙信号的强度,利用前述公式(1)判断判断自己与电脑100b之间的距离。
这样,手机100a和电脑100b这两个终端设备通过双重校验,提高距离监测的准确性。在手机100a中的第一分享意图校验模块406与电脑100b中的第二分享意图校验模块431都测得手机100a与电脑100b之间的距离小于预设阈值的情况下,可以认为手机100a端的磁干扰事件并不是其他磁干扰源带来的误触发,而确实是由于手机100a与电脑100b靠近,由电脑100b中的磁器件429带来的磁干扰。
当然,在一些其他实施例中,手机100a与电脑100b间距离的测量也可以采用其他方案进行,例如,前文所述的蓝牙单端测距,毫米波测距、超声波测距等。
随后,S10:手机100a开始识别用户手势,以根据用户手势确定要传输的内容和传输的方向。
根据本申请的一些实施例,如上文结合图2所述,传输内容和方向的识别通过识别用户手势来确定,而用户的手势则可以通过检测手机100a的移动方式来判断。在一些实施方式中,可以预先设定手势与要启动的特定操作的映射关系(例如上文中的表1),并将该映射关系预先存储在手机100a中。
手机100a的移动方式(如左移、右移等等)可以通过手机100a中的重力传感器411来确定。重力传感器411又称重力感应器,它的一种实现方式是采用弹性敏感元件制成悬臂式位移器,与采用弹性敏感元件制成的储能弹簧来驱动电触点,完成从重力变化到电信号的转换。重力传感器411在手机、平板电脑等各种便携式计算设备中有着广泛的应用,例如,可以用于识别手机100a姿态或移动方式,应用于横竖屏切换,计步器等应用。在手机100a等各种终端设备中,常见的重 力传感器包括但不限于:博世的BMA系列,意法半导体(ST)的LIS3X系列等。
通过手机100a中的重力传感器411来确定手机100a的移动的具体方式如下:
在手机100a端:应用层的中传输方向/内容确定模块413向手势识别模块412发送手势识别指令。手势识别模块412响应于收到手势识别指令,向驱动层的传感器驱动模块409发送信号,以使传感器驱动模块409开启器件层的重力传感器411。
重力传感器411检测手机100a在各个方向上(一般为三轴)加速度的大小,进而将加速度数据上报给驱动层的传感器驱动模块409,传感器驱动模块409对接收到的加速度数据进行处理,计算得到加速度值以及方向等,并上报给应用层的手势识别模块412。
手势识别模块412利用测得的加速度值以及方向等生成加速度变化矢量,进而得到手机100a的移动,并将手机100a的移动上报给传输方向/内容确定模块413。
使得传输方向/内容确定模块413可以根据手机100a的移动,对照表1确定传输内容和传输方向。举例来说,假设手机100a的手势识别模块412测得的手机的移动是右移,传输方向/内容确定模块413可以根据表1确定该移动对应的是:手机100a的应用程序的界面及运行状态直接迁移、并呈现在电脑100b的屏幕上。即,传输方向是手机100a到电脑100b,而传输的内容是手机100a的应用程序的界面及运行状态。
在本申请的一些实施例中,也可以通过其他方式来判断手机100a的运动,其他方式包括但不限于:利用线性加速度计、陀螺仪传感器或者定位系统等。例如,陀螺仪传感器可以确定手机100a围绕三个轴(即,x,y和z轴)的角速度,因此,陀螺仪传感器同样可以用于判断手机100a的移动。或者,在一些实施方式中,也可以通过线性加速度计、陀螺仪传感器以及重力传感器等的组合来判断手机100a的运动,进而确定用户的手势。
S11:在手机100a端确定好传输方向和传输内容后,将确定的传输方向和传输内容发送给电脑100b,该信息的发送仍然可以通过蓝牙信道传输。
手机100a端:应用层中的传输方向/内容确定模块413将确定好的传输方向(即手机100a到电脑100b)和传输内容(即手机100a的应用程序的界面及运行状态)发送给第一数据传输模块414,第一数据传输模块414向第一蓝牙通信模块402发送通信指令,使第一蓝牙通信模块402通过驱动层的第一蓝牙驱动模块403驱动第一蓝牙模块404,将确定的传输方向和传输内容发送给电脑100b。
电脑100b端:第一蓝牙模块428收到手机100a发来的信息后,将收到的信息通过第二蓝牙驱动模块427上报给第二蓝牙通信模块426,第二蓝牙通信模块426处理收到的信息,获取传输方向和传输内容,并上报给第二数据传输模块421,以使电脑100b获取到手机100a确定的传输方向和传输内容。
随后,S12:手机100a与电脑100b通过蓝牙握手,协商WIFI连接参数。
以手机100a作为WIFI直连的GO为例,手机100a端:应用层的第一数据传输模块414向第一蓝牙通信模块402发送通信指令,使第一蓝牙通信模块402通过驱动层的第一蓝牙驱动模块403驱动第一蓝牙模块404,将手机100a作为GO的SSID和密码发送给电脑100b。
电脑100b端:器件层的第一蓝牙模块428收到手机100a发来的信息后,将收到的信息通过第二蓝牙驱动模块427上报给第二蓝牙通信模块426,第二蓝牙通信模块426处理收到的信息,获取GO的SSID和密码,并上报给第二数据传输模块421。
S13:手机100a与电脑100b根据S12中协商的WIFI连接参数,建立WIFI连接。
手机100a端:第一数据传输模块414向第一WIFI通信模块415发送通信指令,使第一WIFI通信模块415通过驱动层的第一WIFI驱动模块416驱动第一WIFI模块417,开启WIFI直连功能。
电脑100b端:第二数据传输模块421向第二WIFI通信模块422发送通信指令,使第二WIFI通信模块422通过驱动层的第二WIFI驱动模块423驱动第二WIFI模块424,开启WIFI直连功能,并通过操作S12中获取的SSID和密码与手机100a建立WIFI连接。
随后,S14:通过WIFI将手机100a的应用程序的界面及运行状态通过手机100a与电脑100b之间的WIFI通信链接发送给电脑100b。
在本申请的实施例中,将蓝牙连接作为控制信道,WIFI连接作为数据信道,以利用WIFI传输数据速度较快的特点,提高内容的分享速度。然而,本领域技术人员应当理解,在一些实施方式中,也可以不包括S12和S13的操作,而是直接通过蓝牙来传输要分享数据;或者,在另一些实施方式中,手机100a与电脑100b也可以利用其他通信协议来建立其他通信连接,以通过其他方式来传输要分享数据。
以上结合图2和图4说明了根据本申请的实施例的内容分享的具体过程的示例,本领域技术人员应当理解,其中的许多操作可以被并行地、并发地或者同时实施,此外,各项操作的顺序也可以被重新安排。
另外,图4中所示的具体器件和模块等都是举例说明,并不构成对本申请的限制。在本申请的其他实施例中,也可以采用不同的器件和模块以其他方式来实现本身请的内容分享方案。
例如,手机100a执行手势识别时,可以将图4中的重力传感器411替换其他器件,例如线性加速度传感器、陀螺仪等;或者,在一些实施方式中,也可以通过多个器件的组合来实现手机100a的移动检测。
再如,在进行分享意图的校验时,第一分享意图校验模块406和/或第二分享意图校验模块431也可以通过除了蓝牙模块之外的其他器件来进行测距。例如,第一分享意图校验模块406和/或第二分享意图校验模块431可以通过驱动层调用手机100a超声波模块、毫米波模块等来实现测距操作。
此外,图2和图4中示出的一些操作也可以采用其他方案来实现。例如,手机100a所执行的操作S10:识别用户手势,根据用户手势确定要传输的内容和传输的方向,该操作中,用户的手势也可以不是用户手持手机100a的移动,而是其他手势操作。
根据本申请的另一些实施例,例如,在手机100a包括触摸屏的情况下,用户的手势也可以是用户施加在手机100a的触摸屏表面的滑动、拖动、点击或者长按等触摸操作,在这种情况下,可以通过识别手机100a的触摸输入(如左滑、右滑、长按等等)来判断用户的手势,并且每个手势可以被映射到要启动的特定操作。
在该实施例中,手机100a的触摸屏可以是各种类型的触摸屏,例如电容式触摸屏、电阻式触摸屏、红外线式触摸屏、表面声波式触摸屏或其他类型的触摸屏等。可以利用手机100a的触摸屏来接收用户的触摸操作。触摸屏可以包括触摸传感器与显示屏,触摸传感器,也称“触控器件”,在一些实施例中,触摸传感器可以被设置于显示屏上,用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。
根据本申请的一些实施例,S10:手机100a开始识别用户手势时,手机100a端:应用层的中传输方向/内容确定模块413向手势识别模块412发送手势识别指令。手势识别模块412响应于收到手势识别指令,向驱动层的传感器驱动模块409发送信号,以使传感器驱动模块409开启器件 层的触摸传感器。
触摸传感器接收用户作用于手机100a的触摸屏上的触摸操作。例如,在用户的手指贴近或接触具有触摸屏功能的手机100a时,手机100a的触摸传感器检测作用于手机100a的触摸屏上的操作,进而将触摸数据上报给驱动层的传感器驱动模块409。手机100a驱动层的传感器驱动模块409可以对触摸屏中的触摸传感器上报的数据进行处理,识别点击、滑动、长按等操作,并计算这些操作的坐标信息,生成时间戳等,并将包含操作类型、坐标信息、时间戳等的输入事件上报给应用层的手势识别模块412,进而手势识别模块412可以根据预设的触摸操作与传输的内容和方向的映射关系(例如下表2示出的映射关系),判断传输的内容和方向。
表2示出了根据本申请的一些实施例的作用于手机100a的触摸操作与传输内容和传输方向之间的映射关系示例。
表2
Figure PCTCN2021080794-appb-000004
此外,根据本申请的一些实施例,用户的手势也可以包括其他类型,例如可以作用于手机100a,但与手机100a的屏幕间隔一定距离的手势操作(例如,悬浮触控)等。另外,在一些实施例中,也可以采用触控笔等其他输入设备来输入手势。
此外,虽然在图2和图4中,是以手机100a和电脑100b之间分享内容为例说明了终端设备间的内容分享过程,但是,应当理解,本申请的实施例所提供的内容分享方案可以应用在各种终端设备之间,例如手机与手机之间,智能手表与手机之间,手环与电脑之间等等。
本申请的实施例中提供的内容分享方案,简化了数据传输的过程,并且相比于NFC触碰等方式只能应用于非常短的传输距离,本申请提供的内容分享方案可以用于相对长一些的距离情况,此外,借助于手势识别来确定传输方向和传输内容,实现了两个设备间的双向传输,同时能够有效地避免传输方向出错。
下面以手机为例结合图5说明本申请的终端设备100的一种具体结构示例。在一些实施例中,图5所示的设备可以是手机100a或者可以被包括在手机100a中。
如图5所示,终端设备100可以包括处理器110,外部存储器接口120,内部存储器121,通用串行总线(universal serial bus,USB)接口130,充电管理模块140,电源管理模块141,电池142,天线1,天线2,移动通信模块150,无线通信模块160,音频模块170,扬声器170A, 受话器170B,麦克风170C,耳机接口170D,传感器模块180,按键190,马达191,指示器192,摄像头193,显示屏194,以及用户标识模块(subscriber identification module,SIM)卡接口195等。
其中,处理器110可以包括一个或多个处理单元,例如:处理器110可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。处理器110中还可以设置存储器,用于存储指令和数据。在一些情况下,处理器110可以被配置为执行上述结合图2至图4描述的手机100a所执行的各种操作。
在一些实施例中,处理器110可以包括一个或多个接口。接口可以包括集成电路(inter-integrated circuit,I2C)接口,集成电路内置音频(inter-integrated circuit sound,I2S)接口,脉冲编码调制(pulse code modulation,PCM)接口,通用异步收发传输器(universal asynchronous receiver/transmitter,UART)接口,移动产业处理器接口(mobile industry processor interface,MIPI),通用输入输出(general-purpose input/output,GPIO)接口,用户标识模块(subscriber identity module,SIM)接口,和/或通用串行总线(universal serial bus,USB)接口等。可以理解的是,本申请实施例示意的各模块间的接口连接关系,只是示意性说明,并不构成对终端设备100的结构限定。在本申请另一些实施例中,终端设备100也可以采用上述实施例中不同的接口连接方式,或多种接口连接方式的组合。
传感器模块180可以包括磁传感器180D,磁传感器180D的示例包括但不限于,基于霍尔效应的霍尔传感器、基于各向异性磁阻(Anisotropic Magneto Resistance,AMR)效应的AMR传感器等。在终端设备100中,以AMR传感器为例,AMR传感器可以利用磁阻来测量平面磁场,从而检测出磁场强度以及方向位置,其基本原理是利用各向异性磁致电阻材料感受到微弱的磁场变化时导致自身电阻产生变化。而霍尔传感器则会根据半导体在外围磁场方向产生改变时,会产生电压差的霍尔原理,来检测磁场的变化。
终端设备100中的磁传感器180D一般用在指南针或是地图导航中,帮助用户实现准确定位,或者用于检测翻盖皮套的开合。在一些实施例中,当终端设备100是翻盖机时,终端设备100可以根据磁传感器180D检测翻盖的开合,进而根据检测到的皮套的开合状态或翻盖的开合状态,设置翻盖自动解锁等特性。
在本申请的一些实施例中,终端设备100可以利用磁传感器180D来感测周围是否有磁器件靠近。
加速度传感器180E可检测终端设备100在各个方向上(一般为三轴)加速度的大小。当终端设备100静止时可检测出重力的大小及方向。还可以用于识别终端设备100姿态或移动,应用于横竖屏切换,计步器等应用。
根据本申请的一些实施例,加速度传感器180E可以包括重力传感器,重力传感器又称重力感应器,它的一种实现方式是采用弹性敏感元件制成悬臂式位移器,与采用弹性敏感元件制成的储能弹簧来驱动电触点,完成从重力变化到电信号的转换。重力传感器在手机、平板电脑等各种便携式计算设备中有着广泛的应用,在各种终端设备100中,常见的重力传感器包括但不限于:博世的BMA系列,意法半导体(ST)的LIS3X系列等。
重力传感器能够感知到加速度的变化,进而通过加速度值来判断终端设备100的运动,比如倾斜、左右晃动、上升、下降等。终端设备100中的重力传感器通常为三轴结构,重力传感器通过三轴可以感知任意方向上的加速度,判断终端设备100的空间运动。重力传感器在进行三轴的加速度运算时,重力感应坐标可以是相对于终端设备100而言,而不是空间坐标。
陀螺仪传感器180B可以用于确定终端设备100的运动姿态。在一些实施例中,可以通过陀螺仪传感器180B确定终端设备100围绕三个轴(即,x,y和z轴)的角速度。陀螺仪传感器180B同样可以用于判断设备的移动。示例性的,其可以用于拍摄防抖,当按下快门,陀螺仪传感器180B检测终端设备100抖动的角度,根据角度计算出镜头模组需要补偿的距离,让镜头通过反向运动抵消终端设备100的抖动,实现防抖。陀螺仪传感器180B还可以用于导航,体感游戏场景。
触摸传感器180K,也称“触控器件”。触摸传感器180K可以设置于显示屏194,由触摸传感器180K与显示屏194组成触摸屏,也称“触控屏”。触摸传感器180K用于检测作用于其上或附近的触摸操作。触摸传感器可以将检测到的触摸操作传递给应用处理器,以确定触摸事件类型。可以通过显示屏194提供与触摸操作相关的视觉输出。在另一些实施例中,触摸传感器180K也可以设置于电子设备100的表面,与显示屏194所处的位置不同。
此外,传感器模块180可以包括:压力传感器180A,气压传感器180C,距离传感器180F,接近光传感器180G,指纹传感器180H,温度传感器180J,环境光传感器180L,骨传导传感器180M等。
充电管理模块140用于从充电器接收充电输入。其中,充电器可以是无线充电器,也可以是有线充电器。电源管理模块141用于连接电池142,充电管理模块140与处理器110。电源管理模块141接收电池142和/或充电管理模块140的输入,为处理器110,内部存储器121,显示屏194,摄像头193,和无线通信模块160等供电。电源管理模块141还可以用于监测电池容量,电池循环次数,电池健康状态(漏电,阻抗)等参数。在其他一些实施例中,电源管理模块141也可以设置于处理器110中。在另一些实施例中,电源管理模块141和充电管理模块140也可以设置于同一个器件中。
终端设备100的无线通信功能可以通过天线1,天线2,移动通信模块150,无线通信模块160,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。终端设备100中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块150可以提供应用在终端设备100上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块150可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块150可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块150还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块150的至少部分功能模块可以被设置于处理器110中。在一些实施例中,移动通信模块150的至少部分功能模块可以与处理器110的至少部分模块被设置在同一个器件中。
调制解调处理器可以包括调制器和解调器。其中,调制器用于将待发送的低频基带信号调制成中高频信号。解调器用于将接收的电磁波信号解调为低频基带信号。随后解调器将解调得到的低频基带信号传送至基带处理器处理。低频基带信号经基带处理器处理后,被传递给应用处理器。 应用处理器通过音频设备(不限于扬声器170A,受话器170B等)输出声音信号,或通过显示屏194显示图像或视频。在一些实施例中,调制解调处理器可以是独立的器件。在另一些实施例中,调制解调处理器可以独立于处理器110,与移动通信模块150或其他功能模块设置在同一个器件中。
无线通信模块160可以提供应用在终端设备100上的包括无线局域网(wireless local area networks,WLAN)(如无线保真(wireless fidelity,Wi-Fi)网络),蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块160经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器110。无线通信模块160还可以从处理器110接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
在一些实施例中,终端设备100的天线1和移动通信模块150耦合,天线2和无线通信模块160耦合,使得终端设备100可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通讯系统(global system for mobile communications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE),BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system,GPS),全球导航卫星系统(global navigation satellite system,GLONASS),北斗卫星导航系统(beidou navigation satellite system,BDS),准天顶卫星系统(quasi-zenith satellite system,QZSS)和/或星基增强系统(satellite based augmentation systems,SBAS)。
终端设备100通过GPU,显示屏194,以及应用处理器等实现显示功能。显示屏194用于显示图像,视频等。
终端设备100可以通过ISP,摄像头193,视频编解码器,GPU,显示屏194以及应用处理器等实现拍摄功能。
终端设备100可以通过音频模块170,扬声器170A,受话器170B,麦克风170C,耳机接口170D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
外部存储器接口120可以用于连接外部存储卡,例如Micro SD卡,实现扩展终端设备100的存储能力。
内部存储器121可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。
按键190包括开机键,音量键等。按键190可以是机械按键。也可以是触摸式按键。终端设备100可以接收按键输入,产生与终端设备100的用户设置以及功能控制有关的键信号输入。
马达191可以产生振动提示。马达191可以用于来电振动提示,也可以用于触摸振动反馈。例如,作用于不同应用(例如拍照,音频播放等)的触摸操作,可以对应不同的振动反馈效果。作用于显示屏194不同区域的触摸操作,马达191也可对应不同的振动反馈效果。不同的应用场景(例如:时间提醒,接收信息,闹钟,游戏等)也可以对应不同的振动反馈效果。触摸振动反馈效果还可以支持自定义。
指示器192可以是指示灯,可以用于指示充电状态,电量变化,也可以用于指示消息,未接来电,通知等。
SIM卡接口195用于连接SIM卡。SIM卡可以通过插入SIM卡接口195,或从SIM卡接口195拔出,实现和终端设备100的接触和分离。终端设备100可以支持1个或N个SIM卡接口,N为大于1的正整数。SIM卡接口195可以支持Nano SIM卡,Micro SIM卡,SIM卡等。同一个SIM卡接口195可以同时插入多张卡。所述多张卡的类型可以相同,也可以不同。SIM卡接口195也可以兼容不同类型的SIM卡。SIM卡接口195也可以兼容外部存储卡。终端设备100通过SIM卡和网络交互,实现通话以及数据通信等功能。在一些实施例中,终端设备100采用eSIM,即:嵌入式SIM卡。eSIM卡可以嵌在终端设备100中,不能和终端设备100分离。
可以理解的是,本申请实施例示意的结构并不构成对终端设备100的具体限定。在本申请另一些实施例中,终端设备100可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
下面结合图6描述根据本申请的一些实施例的示例计算系统500。在各种实施例中,系统500可以是或者可以包括终端设备100的一部分,例如,计算系统500可以是或者可以包括电脑100b的一部分。在各种实施例中,系统500可以具有更多或更少的组件和/或不同的架构。
在一个实施例中,系统500可以包括一个或多个处理器504,与处理器504中的至少一个连接的系统控制逻辑508,与系统控制逻辑508连接的系统内存512,与系统控制逻辑508连接存储器516(例如非易失性存储器(non-volatile memory,NVM)),以及与系统控制逻辑508连接的网络接口520。
处理器504可以包括一个或多个单核或多核处理器。处理器504可以包括通用处理器和专用处理器(例如,图形处理器,应用处理器,基带处理器等)的任何组合。在一些情况下,处理器504可以被配置为执行上述结合图2至图4描述的手机100a或电脑100b所执行的各种操作。
用于某个实施例的系统控制逻辑508可以包括任何合适的接口控制器,以向处理器504中的至少一个和/或与系统控制逻辑508通信的任何合适的设备或组件提供任何合适的接口。
用于某个实施例的系统控制逻辑508可以包括一个或多个存储器控制器以提供连接到系统内存512的接口。系统内存512可以用于加载和存储数据和/或指令,例如,对于系统500,用于某个实施例的系统内存512可以包括任何合适的易失性存储器,例如合适的随机存取存储器(random-access memory,RAM)或动态随机存取存储器(dynamic random access memory,DRAM)。
存储器516可以包括用于存储数据和/或指令的一个或多个有形的、非暂时性计算机可读介质。例如,存储器516可以包括的任何合适的非易失性存储器和/或任何合适的非易失性存储设备,例如闪存、硬盘驱动器(hard disk drive,HDD),固态硬盘(solid-state drive,SSD),光盘(compact disk,CD)驱动器,和/或数字通用光盘(digital versatile disk,DVD)驱动器等。
存储器516可以包括安装系统500的装置上的一部分存储资源,或者它可以由设备访问,但不一定是设备的一部分。例如,可以经由网络接口520通过网络访问存储器516。
特别地,系统内存512和存储器516可以分别包括:指令524的暂时和永久副本。指令524可以包括:由处理器504中的至少一个执行时导致系统500实施上文所述的方法的指令。在各种实施例中,指令524或硬件、固件和/或其软件组件可另外地/替代地置于系统控制逻辑508,网络接口520和/或处理器504中。
网络接口520可以包括收发器,用于为系统500提供无线电接口,进而通过一个或多个网络与任何其他合适的设备(如前端模块,天线等)进行通信。在各种实施例中,网络接口520可以与系统500的其他组件集成。例如,网络接口可以包括处理器504的处理器,系统内存512的内 存,存储器516的存储器,和/或具有指令的固件设备(未示出),所述指令为由处理器504中的至少一个执行时导致系统500实施如图2中手机100a或电脑100b所执行的方法的指令。
网络接口520可以进一步包括任何合适的硬件和/或固件,以提供多输入多输出无线电接口。例如,用于某个实施例的网络接口520可以是网络适配器,无线网络适配器,电话调制解调器和/或无线调制解调器。
对于一个实施例,处理器504中的至少一个可以与用于系统控制逻辑508的一个或多个控制器的逻辑封装在一起。对于一个实施例,处理器504中的至少一个可以与用于系统控制逻辑508的一个或多个控制器的逻辑封装在一起,以形成系统封装(SiP)。对于一个实施例,处理器504中的至少一个可以与用于系统控制逻辑508的一个或多个控制器的逻辑集成在一起。对于一个实施例,处理器504中的至少一个可以与用于系统控制逻辑508的一个或多个控制器的逻辑集成在一起,以形成片上系统(SoC)。
系统500可以进一步包括:输入/输出(I/O)设备532。I/O设备532可以包括,被设计为使得用户能够与系统500进行交互的用户界面;被设计为使得外围组件也能够与系统500交互的外围组件接口;和/或被设计为用于确定与系统500相关的环境条件和/或位置信息的传感器等。
在各种实施例中,用户界面可包括但不限于显示器(例如,液晶显示器、触摸屏显示器等)、扬声器、麦克风、一个或多个相机(例如,静止图像相机和/或摄像机)、手电筒/闪光灯(例如、发光二极管闪光灯)和键盘。
在各种实施例中,外围组件接口可以包括但不限于非易失性存储器端口、音频插孔和电源接口。
在各种实施例中,传感器可包括但不限于陀螺仪传感器,加速度计,近程传感器,环境光线传感器和定位单元。定位单元还可以是网络接口520的一部分或与网络接口520交互,以与定位网络的组件(例如,全球定位系统(GPS)卫星)进行通信。
图7所示为根据本申请的实施例的另一种终端设备1100。示例的,设备1100包括收发模块1101和处理模块1102。
根据本申请的一些实施例,终端设备1100可以执行图2中所示的内容分享方法中的手机100a或电脑100b所执行的各种操作。例如,根据本申请的一些实施例,可以提供一种内容分享装置,该内容分享装置可以实现在手机100a或电脑100b中。内容分享装置可以包括收发模块1101和处理模块1102。根据本申请的一些实施例,该内容分享装置可以被配置为执行上述结合图2描述的手机100a或电脑100b所执行的各种操作。
例如,该内容分享装置被实现在手机100a中时,收发模块1101可用于执行操作S1,S4,接收S7发来的信号,以及执行操作S11-S14和S16等,而处理模块1102可用于执行操作S2,S3,S8-S10,以及S15等。
根据本申请的一些实施例,当该内容分享装置被实现在电脑100b中时,收发模块1101可用于接收操作S1,S4,S11中发来的信号,执行操作S7,S12-S14和S 16等,而处理模块1102可用于执行操作S5-S6等。
图8所示为根据本申请的实施例的另一种终端设备1200。终端设备1200包括至少一个处理器1210、存储器1220和收发器1230。其中,处理器1210与存储器1220和收发器1230耦合,本申请实施例中的耦合是装置、单元或模块之间的直接或间接耦合或者通信连接,可以是电性,机械或其它的形式,用于装置、单元或模块之间的信息交互。本申请实施例中不限定上述收发器1230、 处理器1210以及存储器1220之间的连接介质。例如,根据本申请的一些实施例,存储器1220、处理器1210以及收发器1230之间可以通过总线连接,所述总线可以分为地址总线、数据总线、控制总线等。
存储器1220可以用于存储程序指令。收发器1230可以用于接收或发送数据。处理器1210可以用于调用存储器1220中存储的程序指令,使得设备1200执行图2中手机100a或电脑100b所执行的操作。
根据本申请的一些实施例,处理器1210可以是通用处理器、数字信号处理器、专用集成电路、现场可编程门阵列或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件,可以实现或者执行本申请实施例中的公开的各方法、操作及逻辑框图。通用处理器可以是微处理器或者任何常规的处理器等。结合本申请实施例所公开的方法的操作可以直接体现为硬件处理器执行完成,或者用处理器中的硬件及软件模块组合执行完成。
根据本申请的一些实施例,存储器1220可以是非易失性存储器,还可以是易失性存储器。存储器是能够用于携带或存储具有指令或数据结构形式的期望的程序代码并能够由计算机存取的任何其他介质,但不限于此。本申请实施例中的存储器还可以是电路或者其它任意能够实现存储功能的装置,用于存储程序指令和/或数据。
本申请公开的各实施例可以被实现在硬件、软件、固件或这些实现方法的组合中。本申请的实施例可实现为在可编程系统上执行的计算机程序或程序代码,该可编程系统可以包括至少一个处理器、存储系统(包括易失性和非易失性存储器和/或存储元件)、至少一个输入设备以及至少一个输出设备。
可将程序代码应用于输入指令,以执行本申请描述的各功能并生成输出信息。可以按已知方式将输出信息应用于一个或多个输出设备。为了本申请的目的,处理系统包括具有诸如例如数字信号处理器(DSP)、微控制器、专用集成电路(ASIC)或微处理器之类的处理器的任何系统。
程序代码可以用高级程序化语言或面向对象的编程语言来实现,以便与处理系统通信。在需要时,也可用汇编语言或机器语言来实现程序代码。事实上,本申请中描述的机制不限于任何特定编程语言的范围。在任一情形下,该语言可以是编译语言或解释语言。
在一些情况下,所公开的实施例可以以硬件、固件、软件或其任何组合形式来实现。所公开的实施例还可以以承载或储存在一个或多个瞬态或非瞬态的机器可读(例如,计算机可读)存储介质上的指令或程序形式实现,其可以由一个或多个处理器等读取和执行。当指令或程序被机器运行时,机器可以执行前述的各种方法。例如,指令可以通过网络或其他计算机可读介质分发。因此,机器可读介质可以包括但不限于,用于以机器(例如,计算机)可读的形式存储或传输信息的任何机制,例如,软盘,光盘,光盘只读存储器(CD-ROMs),磁光盘,只读存储器(ROM),随机存取存储器(RAM),可擦除可编程只读存储器(EPROM),电子式可清除程序化只读存储器(EEPROM),磁卡或光卡,或者用于通过电、光、声或其他形式信号(例如,载波、红外信号、数字信号等)传输网络信息的闪存或有形的机器可读存储器。因此,机器可读介质包括任何形式的适合于存储或传输电子指令或机器(例如,计算机)可读信息的机器可读介质。
因此,本申请的各实施例还包括非瞬态的有形机器可读介质,该介质包含指令或包含设计数据,诸如硬件描述语言(HDL),它定义本文中描述的结构、电路、装置、处理器和/或系统特征。这些实施例也被称为程序产品。
根据本申请的一些实施例,为了实现上述本申请实施例提供的方法中的各功能,终端设备可 以包括硬件结构和/或软件模块,以硬件结构、软件模块、或硬件结构加软件模块的形式来实现上述各功能。上述各功能中的某个功能以硬件结构、软件模块、还是硬件结构加软件模块的方式来执行,取决于技术方案的特定应用和设计约束条件。
本文使用了本领域技术人员通常采用的术语来描述说明性实施例的各个方面,以将他们工作的实质传达给本领域其他技术人员。然而,对于本领域技术人员来说,使用部分所描述的特征来施行一些替代性实施例是显而易见的。出于解释的目的,阐述了具体的数字和配置,以便对说明性实施例进行更加透彻的理解。然而,对于本领域技术人员来说显而易见的是,可以在没有具体细节的情况下实施替代实施例。在一些其他情况下,本文省略或简化了一些众所周知的特征,以避免使本申请的说明性实施例模糊不清。
应当理解的是,虽然在本文中可能使用了术语“第一”、“第二”等等来描述各个特征,但是这些特征不应当受这些术语限制。使用这些术语仅仅是为了进行区分,而不能理解为指示或暗示相对重要性。举例来说,在不背离示例性实施例的范围的情况下,第一特征可以被称为第二特征,并且类似地第二特征可以被称为第一特征。
此外,各种操作将以最有助于理解说明性实施例的方式被描述为多个彼此分离的操作;然而,描述的顺序不应被解释为暗示这些操作必须依赖描述的顺序,其中的许多操作可以被并行地、并发地或者同时实施。此外,各项操作的顺序也可以被重新安排。当所描述的操作完成时,所述处理可以被终止,但是还可以具有未包括在附图中的附加操作。所述处理可以对应于方法、函数、规程、子例程、子程序等等。
说明书中对“一个实施例”,“实施例”,“说明性实施例”等的引用表示所描述的实施例可以包括特定特征、结构或性质,但是每个实施例也可能或不是必需包括特定的特征、结构或性质。而且,这些短语不一定是针对同一实施例。此外,当结合具体实施例描述特定特征,本领域技术人员的知识能够影响到这些特征与其他实施例的结合,无论这些实施例是否被明确描述。
在附图中,可能以特定布置和/或顺序示出了一些结构或方法特征。然而,应当理解的是,这样的特定布置和/或排序不是必需的。而是,在一些实施例中,这些特征可以以不同于说明性附图中所示的方式和/或顺序来进行说明。另外,特定附图中所包含得结构或方法特征并不意味着所有实施例都需要包含这样的特征,在一些实施例中,可以不包含这些特征,或者可以将这些特征与其他特征进行组合。
除非上下文另有规定,否则术语“包含”、“具有”和“包括”是同义词。短语“A/B”表示“A或B”。短语“A和/或B”表示“(A)、(B)或(A和B)”。
如本文所使用的,术语“模块”可以指代,作为其中的一部分,或者包括:用于运行一个或多个软件或固件程序的存储器(共享、专用或组),专用集成电路(ASIC),电子电路和/或处理器(共享、专用或组),组合逻辑电路,和/或提供所述功能的其他合适组件。
上面结合附图对本申请的实施例做了详细说明,但本申请技术方案的使用不仅仅局限于本专利实施例中提及的各种应用,各种结构和变型都可以参考本申请技术方案轻易地实施,以达到本文中提及的各种有益效果。在本领域普通技术人员所具备的知识范围内,在不脱离本申请宗旨的前提下做出的各种变化,均应归属于本申请专利涵盖范围。
以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应以所述权利要求的保护范围为准。

Claims (12)

  1. 一种内容传输方法,其特征在于,包括:
    第一设备确定与第二设备之间的距离小于距离阈值;
    所述第一设备提示用户所述第一设备与所述第二设备之间可进行内容传输;
    所述第一设备识别所述用户对所述第一设备的手势操作,并根据识别出的所述手势操作确定传输内容和所述传输内容在所述第一设备与所述第二设备之间的传输方向;
    所述第一设备根据确定的传输方向,从所述第二设备接收所述传输内容或向所述第二设备发送所述传输内容。
  2. 根据权利要求1所述的方法,其特征在于,
    所述第一设备根据识别出的所述手势操作确定传输内容和所述传输内容在所述第一设备和所述第二设备之间的传输方向,包括:
    所述第一设备根据识别出的第一手势操作,确定第一传输内容,并确定所述第一传输内容的传输方向是从所述第一设备到所述第二设备。
  3. 根据权利要求1所述的方法,其特征在于,
    所述第一设备根据识别出的所述手势操作确定传输内容和所述传输内容在所述第一设备和所述第二设备之间的传输方向,包括:
    所述第一设备根据识别出的第二手势操作,确定第二传输内容,并确定所述第二传输内容的传输方向是从所述第二设备到所述第一设备。
  4. 根据权利要求1所述的方法,其特征在于,所述手势操作为所述用户手持所述第一设备的移动方式。
  5. 根据权利要求4所述的方法,其特征在于,所述用户手持所述第一设备的移动方式通过检测所述第一设备的加速度的变化来获取。
  6. 根据权利要求1所述的方法,其特征在于,所述手势操作为所述用户在所述第一设备的触摸屏上的触摸操作。
  7. 根据权利要求1-6中任意一项所述的方法,其特征在于,所述第一设备确定与第二设备之间的距离小于距离阈值,包括:
    所述第一设备监测所述第一设备的磁感应信号强度的变化,并在所述磁感应信号强度的变化超过预设的强度变化阈值的情况下,检测所述第一设备与所述第二设备之间的距离小于距离阈值。
  8. 根据权利要求7所述的方法,其特征在于,所述第一设备确定所述第一设备与所述第二设备之间的距离,包括:所述第一设备通过蓝牙测距、毫米波测距和超声波测距中的至少一种确定与所述第二设备之间的距离。
  9. 根据权利要求8所述的方法,其特征在于,所述第一设备通过蓝牙测距确定所述第一设备与所述第二设备之间的距离包括:
    所述第一设备发送第一蓝牙广播信号;
    所述第一设备接收所述第二设备发送的第二蓝牙广播信号和与第二距离相关的信息;其中,第二蓝牙广播信号由所述第二设备响应于收到所述第一蓝牙广播信号而发送,与第二距离相关的信息用于表征所述第二距离,所述第二距离为由所述第二设备根据收到的所述第一蓝牙广播信号计算得到的所述第一设备与所述第二设备之间的第二距离;
    所述第一设备根据收到的所述第二蓝牙广播信号,获取第一距离,其中,所述第一距离为由 所述第一设备根据所述第二蓝牙广播信号的信号强度计算得到的所述第一设备与所述第二设备之间的第一距离;
    将所述第一距离和所述第二距离中较大的一个确定为所述第一设备与所述第二设备之间的距离。
  10. 一种内容传输装置,其特征在于,所述内容传输装置用于执行如权利要求1-9中任意一项所述的方法。
  11. 一种设备,其特征在于,包括:
    存储器,所述存储器中存储有指令,和
    处理器,用于读取所述存储器中的指令,以使所述设备执行:
    确定与第二设备之间的距离小于距离阈值;
    提示用户所述设备与所述第二设备之间可进行内容传输;
    识别所述用户对所述设备的手势操作,并根据识别出的所述手势操作确定传输内容和所述传输内容在所述设备与所述第二设备之间的传输方向;
    根据确定的传输方向,从所述第二设备接收所述传输内容或向所述第二设备发送所述传输内容。
  12. 一种机器可读介质,其特征在于,所述机器可读介质中存储有指令,该指令被机器运行时,所述机器执行:
    确定与第二设备之间的距离小于距离阈值;
    提示用户所述第一设备与所述第二设备之间可进行内容传输;
    识别所述用户对所述机器的手势操作,并根据识别出的所述手势操作确定传输内容和所述传输内容在所述机器与所述第二设备之间的传输方向;
    根据确定的传输方向,从所述第二设备接收所述传输内容或向所述第二设备发送所述传输内容。
PCT/CN2021/080794 2020-03-25 2021-03-15 内容传输方法、设备及介质 WO2021190338A1 (zh)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP21775226.0A EP4116800A4 (en) 2020-03-25 2021-03-15 CONTENT TRANSFER METHOD, DEVICE AND MEDIUM
CN202180021450.7A CN115280263A (zh) 2020-03-25 2021-03-15 内容传输方法、设备及介质
US17/951,902 US20230042460A1 (en) 2020-03-25 2022-09-23 Content Transmission Method, Device, and Medium

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010219576.2A CN111522438A (zh) 2020-03-25 2020-03-25 内容传输方法、设备及介质
CN202010219576.2 2020-03-25

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US17/951,902 Continuation US20230042460A1 (en) 2020-03-25 2022-09-23 Content Transmission Method, Device, and Medium

Publications (1)

Publication Number Publication Date
WO2021190338A1 true WO2021190338A1 (zh) 2021-09-30

Family

ID=71901410

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/080794 WO2021190338A1 (zh) 2020-03-25 2021-03-15 内容传输方法、设备及介质

Country Status (4)

Country Link
US (1) US20230042460A1 (zh)
EP (1) EP4116800A4 (zh)
CN (2) CN111522438A (zh)
WO (1) WO2021190338A1 (zh)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111522438A (zh) * 2020-03-25 2020-08-11 华为技术有限公司 内容传输方法、设备及介质
CN113569245A (zh) * 2020-04-28 2021-10-29 阿里巴巴集团控股有限公司 处理装置、嵌入式系统、片上系统以及安全控制方法
CN114531435B (zh) * 2020-10-31 2023-04-11 华为技术有限公司 一种数据分享方法及相关装置
CN113689617A (zh) * 2021-08-17 2021-11-23 浙江工业大学 一种基于蓝牙通信的智能出货系统及其出货控制方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160291696A1 (en) * 2013-12-23 2016-10-06 Tomer RIDER Method for using magnetometer together with gesture to send content to wireless display
CN106020659A (zh) * 2015-03-16 2016-10-12 联想(北京)有限公司 一种信息处理方法及电子设备
EP3293955A1 (en) * 2015-05-07 2018-03-14 Ricoh Company, Ltd. Information processing device, information processing method and information processing program
CN108718439A (zh) * 2018-05-22 2018-10-30 北京硬壳科技有限公司 数据传输方法及装置
CN111522438A (zh) * 2020-03-25 2020-08-11 华为技术有限公司 内容传输方法、设备及介质

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1950892A1 (en) * 2007-01-26 2008-07-30 Sony Deutschland Gmbh A user interface based on magnetic induction
US8250001B2 (en) * 2008-12-18 2012-08-21 Motorola Mobility Llc Increasing user input accuracy on a multifunctional electronic device
US8457651B2 (en) * 2009-10-02 2013-06-04 Qualcomm Incorporated Device movement user interface gestures for file sharing functionality
JP5589549B2 (ja) * 2010-05-14 2014-09-17 ソニー株式会社 情報処理装置及び情報処理装置の操作方法
US20130217334A1 (en) * 2010-09-21 2013-08-22 Nationz Technologies Inc. Fast access short-range communication system and method
US9041775B2 (en) * 2011-03-23 2015-05-26 Mgestyk Technologies Inc. Apparatus and system for interfacing with computers and other electronic devices through gestures by using depth sensing and methods of use
JP5994619B2 (ja) * 2012-12-17 2016-09-21 ブラザー工業株式会社 通信装置、通信システム
CN103905613B (zh) * 2012-12-25 2017-03-22 上海鼎为电子科技(集团)有限公司 一种在移动终端之间实现数据共享的方法和移动终端
US20140320387A1 (en) * 2013-04-24 2014-10-30 Research In Motion Limited Device, System and Method for Generating Display Data
KR20150065336A (ko) * 2013-12-05 2015-06-15 삼성전자주식회사 전자 장치의 제스처 인식 방법, 장치 및 컴퓨터 판독 가능한 기록 매체
SE539593C2 (en) * 2014-10-08 2017-10-17 Crunchfish Ab Communication device for improved content sharing
SE543231C2 (en) * 2014-12-10 2020-10-27 Crunchfish Proximity Ab C/O Crunchfish Ab Communication device for improved establishing a connection between devices
CN110719584B (zh) * 2019-09-02 2021-07-16 华为技术有限公司 近距离传输信息的方法和电子设备

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160291696A1 (en) * 2013-12-23 2016-10-06 Tomer RIDER Method for using magnetometer together with gesture to send content to wireless display
CN106020659A (zh) * 2015-03-16 2016-10-12 联想(北京)有限公司 一种信息处理方法及电子设备
EP3293955A1 (en) * 2015-05-07 2018-03-14 Ricoh Company, Ltd. Information processing device, information processing method and information processing program
CN108718439A (zh) * 2018-05-22 2018-10-30 北京硬壳科技有限公司 数据传输方法及装置
CN111522438A (zh) * 2020-03-25 2020-08-11 华为技术有限公司 内容传输方法、设备及介质

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4116800A4

Also Published As

Publication number Publication date
EP4116800A4 (en) 2023-08-09
EP4116800A1 (en) 2023-01-11
US20230042460A1 (en) 2023-02-09
CN111522438A (zh) 2020-08-11
CN115280263A (zh) 2022-11-01

Similar Documents

Publication Publication Date Title
WO2021190338A1 (zh) 内容传输方法、设备及介质
WO2020168965A1 (zh) 一种具有折叠屏的电子设备的控制方法及电子设备
WO2020182065A1 (zh) 快捷功能启动的方法及电子设备
EP4131911A1 (en) Application interface interaction method, electronic device, and computer readable storage medium
WO2021185105A1 (zh) SIM卡和eSIM卡的切换方法及电子设备
CN114449599A (zh) 基于电子设备位置的网络链路切换方法和电子设备
WO2022042770A1 (zh) 控制通信服务状态的方法、终端设备和可读存储介质
CN112637758B (zh) 一种设备定位方法及其相关设备
WO2021218429A1 (zh) 应用窗口的管理方法、终端设备及计算机可读存储介质
CN112445762A (zh) 一种移动终端的文件共享方法及设备
EP4184905A1 (en) Device recognition method and related apparatus
CN114090102B (zh) 启动应用程序的方法、装置、电子设备和介质
WO2022170856A1 (zh) 建立连接的方法与电子设备
CN114006712A (zh) 一种获取验证码的方法、电子设备和系统
WO2022048453A1 (zh) 解锁方法及电子设备
CN111492678B (zh) 一种文件传输方法及电子设备
EP4024877A1 (en) Video communication method and video communication apparatus
CN111061410A (zh) 一种冻屏处理方法及终端
WO2023179751A9 (zh) 一种物体寻找方法、系统以及电子设备
CN113243126B (zh) 一种用于终端的网络管理方法和终端
CN114006698B (zh) token刷新方法、装置、电子设备及可读存储介质
WO2022170854A1 (zh) 视频通话的方法与相关设备
WO2022095820A1 (zh) 一种文本输入的方法、电子设备和系统
WO2021254294A1 (zh) 一种切换音频输出通道的方法、装置和电子设备
WO2021129453A1 (zh) 一种截屏方法及相关设备

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21775226

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2021775226

Country of ref document: EP

Effective date: 20221005

NENP Non-entry into the national phase

Ref country code: DE