CN110244843B - Wearable device control method, wearable device and computer readable storage medium - Google Patents
Wearable device control method, wearable device and computer readable storage medium Download PDFInfo
- Publication number
- CN110244843B CN110244843B CN201910480274.8A CN201910480274A CN110244843B CN 110244843 B CN110244843 B CN 110244843B CN 201910480274 A CN201910480274 A CN 201910480274A CN 110244843 B CN110244843 B CN 110244843B
- Authority
- CN
- China
- Prior art keywords
- gesture
- wearable device
- screen area
- bright screen
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 85
- 230000008569 process Effects 0.000 claims abstract description 49
- 230000006870 function Effects 0.000 claims description 33
- 238000006243 chemical reaction Methods 0.000 claims description 13
- 238000012545 processing Methods 0.000 claims description 12
- 238000007781 pre-processing Methods 0.000 claims description 8
- 230000009467 reduction Effects 0.000 claims description 7
- 238000012216 screening Methods 0.000 claims description 7
- 238000013507 mapping Methods 0.000 claims description 4
- 238000004891 communication Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 6
- 238000001514 detection method Methods 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 238000010295 mobile communication Methods 0.000 description 3
- 230000001960 triggered effect Effects 0.000 description 3
- 230000008901 benefit Effects 0.000 description 2
- 239000004973 liquid crystal related substance Substances 0.000 description 2
- 230000007774 longterm Effects 0.000 description 2
- 238000010606 normalization Methods 0.000 description 2
- 238000003825 pressing Methods 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 210000000707 wrist Anatomy 0.000 description 2
- OKTJSMMVPCPJKN-UHFFFAOYSA-N Carbon Chemical compound [C] OKTJSMMVPCPJKN-UHFFFAOYSA-N 0.000 description 1
- 230000001133 acceleration Effects 0.000 description 1
- 230000009471 action Effects 0.000 description 1
- 238000013459 approach Methods 0.000 description 1
- 238000005452 bending Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 239000012769 display material Substances 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000002474 experimental method Methods 0.000 description 1
- 229910021389 graphene Inorganic materials 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 238000011946 reduction process Methods 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 230000001629 suppression Effects 0.000 description 1
- 238000010897 surface acoustic wave method Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/163—Wearable computers, e.g. on a belt
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1637—Details related to the display arrangement, including those related to the mounting of the display in the housing
- G06F1/1652—Details related to the display arrangement, including those related to the mounting of the display in the housing the display being flexible, e.g. mimicking a sheet of paper, or rollable
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D30/00—Reducing energy consumption in communication networks
- Y02D30/70—Reducing energy consumption in communication networks in wireless communication networks
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application discloses a control method of a wearable device, which is applied to the wearable device, wherein the wearable device is provided with a flexible screen, and the method comprises the following steps: when a non-contact gesture signal is sensed within a preset distance above a bright screen area of the flexible screen, analyzing the non-contact gesture signal to obtain a gesture track corresponding to the non-contact gesture signal; determining a touch event simulated by the gesture track; and acquiring the running process of the bright screen area, and executing the function corresponding to the touch event in the bright screen area by combining the running process of the bright screen area. The application also discloses wearable equipment and a computer readable storage medium. The method and the device can improve the convenience of operating the wearable equipment.
Description
Technical Field
The present application relates to the field of wearable devices, and in particular, to a wearable device control method, a wearable device, and a computer readable storage medium.
Background
The flexible screen is one kind of display screen, compares in traditional display screen, and flexible screen advantage is obvious, not only is lighter in size, and is also lower in the consumption, helps promoting equipment's duration, simultaneously based on its flexible, collapsible and the good characteristic of pliability, its durable degree is also higher than traditional display screen greatly, can reduce equipment accident damage's probability. Thus, it has become a trend to apply flexible screens to wearable devices, such as hand rings.
However, when the user wears the wearable device, the flexible screen of the wearable device is in a curved state, and the display area operable by the user is small, so that the operation is very inconvenient.
Disclosure of Invention
The application mainly aims to provide a wearable device control method, a wearable device and a computer readable storage medium, and aims to solve the technical problem that when a user wears the wearable device, the user has a smaller operable display area, so that the operation is inconvenient.
In order to achieve the above object, the present application provides a method for controlling a wearable device, the wearable device being configured with a flexible screen, the method for controlling the wearable device comprising the steps of:
when a non-contact gesture signal is sensed within a preset distance above a bright screen area of the flexible screen, analyzing the non-contact gesture signal to obtain a gesture track corresponding to the non-contact gesture signal;
determining a touch event simulated by the gesture track;
and acquiring the running process of the bright screen area, and executing the function corresponding to the touch event in the bright screen area by combining the running process of the bright screen area.
Optionally, the step of analyzing the non-contact gesture signal to obtain a gesture track corresponding to the non-contact gesture signal includes:
preprocessing the non-contact gesture signal;
converting the preprocessed non-contact gesture signal into a binary gesture characteristic value;
and matching the gesture characteristic value obtained through conversion with a pre-stored gesture track library so as to determine a gesture track corresponding to the non-contact gesture signal.
Optionally, the step of preprocessing the non-contact gesture signal includes:
performing dimension reduction processing on the non-contact gesture signal to obtain an effective non-contact gesture signal;
and normalizing the effective non-contact gesture signal.
Optionally, the step of performing the dimension reduction processing on the non-contact gesture signal to obtain an effective non-contact gesture signal includes:
grouping the non-contact gesture signals to obtain a plurality of signal groups;
and screening non-contact gesture signals belonging to a preset screening range from each signal group respectively to serve as effective non-contact gesture signals.
Optionally, the step of matching the converted gesture feature value with a pre-stored gesture track library to determine a gesture track corresponding to the non-contact gesture signal includes:
comparing the gesture characteristic value obtained through conversion with a pre-stored gesture track library, and determining a pre-stored gesture characteristic value matched with the gesture characteristic value obtained through conversion in the pre-stored gesture track library;
determining a gesture track corresponding to the gesture characteristic value obtained through conversion according to a mapping relation between the gesture characteristic value and the gesture track in a pre-stored gesture track library;
and taking the determined gesture track as the gesture track corresponding to the non-contact gesture signal.
Optionally, the step of executing the function corresponding to the touch event in the bright screen area in combination with the running process of the bright screen area includes:
when the touch event is a click operation, if the running process of the bright screen area is that no running application program exists, acquiring a background application program list;
reading the process priority of each application program in the background application program list;
and starting the application program with the highest process priority in the bright screen area.
Optionally, the step of executing the function corresponding to the touch event in the bright screen area in combination with the running process of the bright screen area further includes:
when the touch event is a click operation, if the running process of the bright screen area is that an running application program exists, determining a target visible control of the application program;
triggering the function of the target visible control.
Optionally, the step of determining the target visible control of the application program includes:
searching a visible control of the application program;
counting the number of the found visible controls;
when the number is a plurality of, reading the priority of each visible control;
and taking the visible control with the highest priority as a target visible control.
In addition, to achieve the above object, the present application also provides a wearable apparatus including: the wearable device control program comprises a memory, a processor and a wearable device control program which is stored on the memory and can run on the processor, wherein the wearable device control program realizes the steps of the wearable device control method when being executed by the processor.
In addition, to achieve the above object, the present application also provides a computer-readable storage medium having stored thereon a wearable device control program which, when executed by a processor, implements the steps of the wearable device control method as described above.
The application provides a wearable device control method, a wearable device and a computer readable storage medium, wherein the wearable device is provided with a flexible screen, and when a non-contact gesture signal is sensed within a preset distance above a bright screen area of the flexible screen, the non-contact gesture signal is analyzed to obtain a gesture track corresponding to the non-contact gesture signal; determining a touch event simulated by the gesture track; and acquiring the running process of the bright screen area, and executing the function corresponding to the touch event in the bright screen area by combining the running process of the bright screen area. Through the mode, the related functions of the wearable equipment can be triggered by combining the non-contact gesture signals sensed from the upper part of the bright screen area and the running process of the bright screen area, so that the interaction mode of operating the wearable equipment in the air is realized, a user is not limited in a smaller operation area, and the convenience of operating the wearable equipment is improved.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the application and together with the description, serve to explain the principles of the application.
In order to more clearly illustrate the embodiments of the application or the technical solutions of the prior art, the drawings which are used in the description of the embodiments or the prior art will be briefly described, and it will be obvious to a person skilled in the art that other drawings can be obtained from these drawings without inventive effort.
Fig. 1 is a schematic hardware structure of an implementation manner of a wearable device according to an embodiment of the present application;
fig. 2 is a hardware schematic diagram of an implementation manner of a wearable device according to an embodiment of the present application;
fig. 3 is a hardware schematic of an implementation manner of a wearable device according to an embodiment of the present application;
fig. 4 is a hardware schematic of an implementation manner of a wearable device according to an embodiment of the present application;
fig. 5 is a hardware schematic of an implementation manner of a wearable device according to an embodiment of the present application;
fig. 6 is a schematic flow chart of a first embodiment of a method for controlling a wearable device according to the present application;
fig. 7 is a schematic diagram of a refinement flow of a first embodiment of the wearable device control method of the present application.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the application.
In the following description, suffixes such as "module", "component", or "unit" for representing elements are used only for facilitating the description of the present application, and have no specific meaning per se. Thus, "module," "component," or "unit" may be used in combination.
The wearable equipment provided by the embodiment of the application comprises wearable equipment such as an intelligent bracelet, an intelligent watch, an intelligent mobile phone and the like. With the continuous development of screen technology, screen forms such as flexible screens and folding screens appear, and wearable devices such as smart phones can also be used as wearable devices. The wearable device provided in the embodiment of the application can comprise: RF (Radio Frequency) unit, wiFi module, audio output unit, A/V (audio/video) input unit, sensor, display unit, user input unit, interface unit, memory, processor, and power supply.
In the following description, a wearable device will be taken as an example, please refer to fig. 1, which is a schematic hardware structure of a wearable device implementing various embodiments of the present application, where the wearable device 100 may include: an RF (Radio Frequency) unit 101, a WiFi module 102, an audio output unit 103, an a/V (audio/video) input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, a processor 110, and a power supply 111. Those skilled in the art will appreciate that the wearable device structure shown in fig. 1 does not constitute a limitation of the wearable device, and that the wearable device may include more or fewer components than shown, or certain components in combination, or a different arrangement of components.
The following describes the various components of the wearable device in detail with reference to fig. 1:
the radio frequency unit 101 may be used to send and receive information or send signals in a call process, specifically, the radio frequency unit 101 may send uplink information to the base station, or may send downlink information sent by the base station to the processor 110 of the wearable device to process the downlink information, where the downlink information sent by the base station to the radio frequency unit 101 may be generated according to the uplink information sent by the radio frequency unit 101, or may be actively pushed to the radio frequency unit 101 after detecting that the information of the wearable device is updated, for example, after detecting that the geographic position where the wearable device is located changes, the base station may send a notification of the change of the geographic position to the radio frequency unit 101 of the wearable device, after receiving the notification of the message, the radio frequency unit 101 may send the notification of the message to the processor 110 of the wearable device to process, and the processor 110 of the wearable device may control the notification of the message to be displayed on the display panel 1061 of the wearable device; typically, the radio frequency unit 101 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like. In addition, the radio frequency unit 101 may also communicate with a network and other devices through wireless communication, which may specifically include: through wireless communication with a server in a network system, for example, the wearable device can download file resources from the server through wireless communication, for example, an application program can be downloaded from the server, after the wearable device finishes downloading a certain application program, if the file resources corresponding to the application program in the server are updated, the server can push a message notification of the resource update to the wearable device through wireless communication so as to remind a user to update the application program. The wireless communication may use any communication standard or protocol, including but not limited to GSM (Global System of Mobile communication, global System for Mobile communications), GPRS (General Packet Radio Service ), CDMA2000 (Code Division Multiple Access, CDMA 2000), WCDMA (Wideband Code Division Multiple Access ), TD-SCDMA (Time Division-Synchronous Code Division Multiple Access, time Division synchronous code Division multiple Access), FDD-LTE (Frequency Division Duplexing-Long Term Evolution, frequency Division Duplex Long term evolution), and TDD-LTE (Time Division Duplexing-Long Term Evolution, time Division Duplex Long term evolution), etc.
In one embodiment, the wearable device 100 may access an existing communication network by inserting a SIM card.
In another embodiment, the wearable device 100 may access an existing communication network by setting an esim card (Embedded-SIM), and by adopting the esim card, the internal space of the wearable device may be saved and the thickness may be reduced.
It will be appreciated that although fig. 1 shows a radio frequency unit 101, it will be appreciated that the radio frequency unit 101 is not an essential component of a wearable device and may be omitted entirely as required within the scope of not changing the essence of the application. The wearable device 100 may implement communication connection with other devices or communication networks through the wifi module 102 alone, which is not limited by the embodiment of the present application.
WiFi belongs to a short-distance wireless transmission technology, and the wearable device can help a user to send and receive emails, browse webpages, access streaming media and the like through the WiFi module 102, so that wireless broadband Internet access is provided for the user. Although fig. 1 shows a WiFi module 102, it is understood that it does not belong to the necessary constitution of the wearable device, and can be omitted entirely as required within the scope of not changing the essence of the application.
The audio output unit 103 may convert audio data received by the radio frequency unit 101 or the WiFi module 102 or stored in the memory 109 into an audio signal and output as sound when the wearable device 100 is in a call signal reception mode, a talk mode, a recording mode, a voice recognition mode, a broadcast reception mode, or the like. Also, the audio output unit 103 may also provide audio output (e.g., call signal reception sound, message reception sound, etc.) related to a specific function performed by the wearable device 100. The audio output unit 103 may include a speaker, a buzzer, and the like.
The a/V input unit 104 is used to receive an audio or video signal. The a/V input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, the graphics processor 1041 processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The processed image frames may be displayed on the display unit 106. The image frames processed by the graphics processor 1041 may be stored in the memory 109 (or other storage medium) or transmitted via the radio frequency unit 101 or the WiFi module 102. The microphone 1042 can receive sound (audio data) via the microphone 1042 in a phone call mode, a recording mode, a voice recognition mode, and the like, and can process such sound into audio data. The processed audio (voice) data may be converted into a format output that can be transmitted to the mobile communication base station via the radio frequency unit 101 in the case of a telephone call mode. The microphone 1042 may implement various types of noise cancellation (or suppression) algorithms to cancel (or suppress) noise or interference generated in the course of receiving and transmitting the audio signal.
In one embodiment, the wearable device 100 includes one or more cameras, and by opening the cameras, capturing of images, photographing, video recording and other functions can be achieved, and the positions of the cameras can be set as required.
The wearable device 100 further comprises at least one sensor 105, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 1061 according to the brightness of ambient light, and the proximity sensor can turn off the display panel 1061 and/or the backlight when the wearable device 100 moves to the ear. As one type of motion sensor, the accelerometer sensor can detect the acceleration in all directions (typically three axes), and can detect the gravity and direction when stationary, and can be used for applications for recognizing the gesture of a mobile phone (such as horizontal-vertical screen switching, related games, magnetometer gesture calibration), vibration recognition related functions (such as pedometer, knocking), and the like.
In one embodiment, the wearable device 100 further comprises a proximity sensor, by employing the proximity sensor, the wearable device is able to achieve non-contact manipulation, providing more modes of operation.
In one embodiment, the wearable device 100 further comprises a heart rate sensor, which when worn, enables detection of heart rate by being in close proximity to the user.
In one embodiment, the wearable device 100 may further include a fingerprint sensor, by reading a fingerprint, security verification or the like can be achieved.
The display unit 106 is used to display information input by a user or information provided to the user. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display (Liquid Crystal Display, LCD), an Organic Light-Emitting Diode (OLED), or the like.
In one embodiment, the display panel 1061 employs a flexible display screen, and the wearable device employing the flexible display screen is capable of bending when worn, thereby fitting more. Optionally, the flexible display screen may be an OLED screen body and a graphene screen body, and in other embodiments, the flexible display screen may also be other display materials, which is not limited to this embodiment.
In one embodiment, the display panel 1061 of the wearable device may take a rectangular shape for ease of wrapping when worn. In other embodiments, other approaches may be taken as well.
The user input unit 107 may be used to receive input numeric or character information and to generate key signal inputs related to user settings and function control of the wearable device. In particular, the user input unit 107 may include a touch panel 1071 and other input devices 1072. The touch panel 1071, also referred to as a touch screen, may collect touch operations thereon or thereabout by a user (e.g., operations of the user on the touch panel 1071 or thereabout by using any suitable object or accessory such as a finger, a stylus, etc.) and drive the corresponding connection device according to a predetermined program. The touch panel 1071 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch azimuth of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch detection device, converts it into touch point coordinates, and sends the touch point coordinates to the processor 110, and can receive and execute commands sent from the processor 110. Further, the touch panel 1071 may be implemented in various types such as resistive, capacitive, infrared, and surface acoustic wave. The user input unit 107 may include other input devices 1072 in addition to the touch panel 1071. In particular, other input devices 1072 may include, but are not limited to, one or more of a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, mouse, joystick, etc., as specifically not limited herein.
In one embodiment, the sides of the wearable device 100 may be provided with one or more buttons. The button can realize a plurality of modes such as short pressing, long pressing, rotation and the like, thereby realizing a plurality of operation effects. The number of the buttons can be multiple, and different buttons can be combined for use, so that multiple operation functions are realized.
Further, the touch panel 1071 may overlay the display panel 1061, and when the touch panel 1071 detects a touch operation thereon or thereabout, the touch panel 1071 is transferred to the processor 110 to determine the type of touch event, and then the processor 110 provides a corresponding visual output on the display panel 1061 according to the type of touch event. Although in fig. 1, the touch panel 1071 and the display panel 1061 are two independent components for implementing the input and output functions of the wearable device, in some embodiments, the touch panel 1071 may be integrated with the display panel 1061 to implement the input and output functions of the wearable device, which is not limited herein. For example, when a message notification of a certain application is received through the rf unit 101, the processor 110 may control the message notification to be displayed in a certain preset area of the display panel 1061, where the preset area corresponds to a certain area of the touch panel 1071, and may control the message notification displayed in the corresponding area on the display panel 1061 by performing a touch operation on the certain area of the touch panel 1071.
The interface unit 108 serves as an interface through which at least one external device can be connected with the wearable apparatus 100. For example, the external devices may include a wired or wireless headset port, an external power (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 108 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the wearable apparatus 100 or may be used to transmit data between the wearable apparatus 100 and the external device.
In one embodiment, the interface unit 108 of the wearable device 100 adopts a contact structure, and is connected with other corresponding devices through the contact, so as to realize functions of charging, connection and the like. The contact can also be waterproof.
Memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a storage program area that may store an operating system, application programs required for at least one function (such as a sound playing function, an image playing function, etc.), and a storage data area; the storage data area may store data (such as audio data, phonebook, etc.) created according to the use of the handset, etc. In addition, memory 109 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid-state storage device.
The processor 110 is a control center of the wearable device, connects various parts of the entire wearable device with various interfaces and lines, performs various functions of the wearable device and processes data by running or executing software programs and/or modules stored in the memory 109, and invoking data stored in the memory 109, thereby performing overall monitoring of the wearable device. Processor 110 may include one or more processing units; preferably, the processor 110 may integrate an application processor that primarily handles operating systems, user interfaces, applications, etc., with a modem processor that primarily handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into the processor 110.
The wearable device 100 may further include a power source 111 (such as a battery) for powering the various components, and preferably, the power source 111 may be logically connected to the processor 110 through a power management system, so as to perform functions of managing charging, discharging, and power consumption management through the power management system.
Although not shown in fig. 1, the wearable device 100 may further include a bluetooth module or the like, which is not described herein. The wearable device 100 can be connected with other wearable devices through Bluetooth, so that communication and information interaction are realized.
Fig. 2 to fig. 4 are schematic structural diagrams of a wearable device according to an embodiment of the present application. The wearable device comprises a flexible screen. When the wearable device is unfolded, the flexible screen is in a strip shape; when the wearable device is in a wearing state, the flexible screen is bent to be annular. Fig. 2 and 3 show schematic structural diagrams of the wearable device screen when unfolded, and fig. 4 shows schematic structural diagrams of the wearable device screen when bent.
Based on the above embodiments, it can be seen that if the device is a wristwatch, a bracelet, or a wearable device, the screen of the device may not cover the watchband area of the device, or may cover the watchband area of the device. The application proposes an alternative embodiment, in which the device may be a wristwatch, a bracelet or a wearable device, comprising a screen and a connection. The screen may be a flexible screen and the connection may be a wristband. Alternatively, the screen of the device or the display area of the screen may be partially or fully overlaid on the wristband of the device. Fig. 5 is a schematic hardware diagram of an implementation manner of a wearable device according to an embodiment of the present application, where a screen of the device extends to two sides, and a part of the screen is covered on a watchband of the device. In other embodiments, the screen of the device may also be entirely covered on the watchband of the device, which is not limited to the embodiment of the present application.
Based on the wearable device hardware structure and the communication network system, various embodiments of the wearable device control method are provided.
The application provides a wearable device control method.
Referring to fig. 6, fig. 6 is a flowchart of a first embodiment of a method for controlling a wearable device according to the present application.
In this embodiment, the wearable device control method may be optionally applied to the wearable device described in fig. 1, where the wearable device is configured with a flexible screen and is provided with an infrared sensor, and the wearable device control method includes the following steps:
step S10, when a non-contact gesture signal is sensed within a preset distance above a bright screen area of the flexible screen, the non-contact gesture signal is analyzed, and a gesture track corresponding to the non-contact gesture signal is obtained;
in this embodiment, considering that most users wear the wearable device in habit of viewing the display area attached to the right inner side or the right back side of the wrist by lifting the arm horizontally, the display area attached to the right inner side or the right back side of the wrist when the user wears the wearable device is defined as the main display area, the size of the main display area can be flexibly set in advance, a certain number of application icons are displayed adaptively according to the size of the main display area, and the icons of the application programs in the wearable device system can be selected. When the arm of the user is lifted horizontally to wake up the main display area, the main display area serves as a bright screen area, and the wearable device can sense non-contact gesture signals within a preset distance above the bright screen area in real time through the infrared detection technology of the infrared sensor. The preset distance is an upper limit distance from which the infrared sensor can sense the non-contact gesture signal, and can be obtained through practical experiments. A non-contact gesture signal is an air gesture signal, and can be understood as a sliding track signal of a hand in the air, where the sliding track signal includes a sliding direction signal.
When the wearable device senses a non-contact gesture signal within a preset distance above the bright screen area, analyzing the sensed non-contact gesture signal, specifically, analyzing the non-contact gesture signal, and obtaining a gesture track corresponding to the non-contact gesture signal includes:
step S11, preprocessing the non-contact gesture signal;
that is, the sensed non-contact gesture signal is preprocessed, the preprocessing includes a dimension reduction process and a normalization process, specifically, referring to fig. 7, the preprocessing includes:
performing dimension reduction processing on the non-contact gesture signal to obtain an effective non-contact gesture signal;
and normalizing the effective non-contact gesture signal.
The step of performing dimension reduction processing on the non-contact gesture signal to obtain an effective non-contact gesture signal comprises the following steps:
grouping the non-contact gesture signals to obtain a plurality of signal groups;
and screening non-contact gesture signals belonging to a preset screening range from each signal group respectively to serve as effective non-contact gesture signals.
And firstly, performing dimension reduction processing to remove redundant signals in the non-contact gesture signals. Considering that the time for a user to make one gesture action does not exceed 2S, the wearable device of the embodiment is set to continuously sense the non-contact gesture signals in 10 time units as a length, so the non-contact gesture signals are divided into 10 groups, and then the non-contact gesture signals belonging to 0.2S-2S are respectively screened out of the 10 signal groups as effective non-contact gesture signals.
After screening out the effective non-contact gesture signal, carrying out normalization processing on the effective non-contact gesture signal, and processing the effective non-contact gesture signal into an amplitude between 0 and 1.
Step S12, converting the preprocessed non-contact gesture signal into a binary gesture characteristic value;
after preprocessing the non-contact gesture signal, performing binary operation on the preprocessed non-contact gesture signal, so as to convert the preprocessed non-contact gesture signal into a binary gesture characteristic value;
and step S13, matching the gesture characteristic value obtained through conversion with a pre-stored gesture track library so as to determine a gesture track corresponding to the non-contact gesture signal.
And then matching the converted gesture characteristic value with a pre-stored gesture track library to determine a gesture track corresponding to the non-contact gesture signal. Specifically, step S13 includes:
comparing the gesture characteristic value obtained through conversion with a pre-stored gesture track library, and determining a pre-stored gesture characteristic value matched with the gesture characteristic value obtained through conversion in the pre-stored gesture track library;
determining a gesture track corresponding to the gesture characteristic value obtained through conversion according to a mapping relation between the gesture characteristic value and the gesture track in a pre-stored gesture track library;
and taking the determined gesture track as the gesture track corresponding to the non-contact gesture signal.
It should be understood that, in this embodiment, the wearable device establishes a gesture track library in advance, and the manner of establishing the gesture track library is as follows: five gesture tracks are defined from the front direction, the rear direction, the left direction, the right direction and the lower direction of the three-dimension, the five track gestures are left sliding, right sliding, forward sliding, right sliding and vertical downward sliding, then actual tests and analysis are carried out for a plurality of times to obtain experience gesture characteristic values corresponding to the six track gestures, each track gesture is stored in association with the corresponding experience gesture characteristic value, and a gesture track library can be established based on the associated stored experience gesture characteristic values and gesture tracks.
The specific process of matching the gesture characteristic value obtained through conversion with a pre-stored gesture track library comprises the following steps: comparing the converted gesture characteristic value with a pre-stored gesture track library to find a pre-stored gesture characteristic value matched with the converted gesture characteristic value from the pre-stored gesture track library, and then determining a gesture track corresponding to the converted gesture characteristic value according to the mapping relation between the pre-stored gesture characteristic value and the gesture track in the pre-stored gesture track library, wherein the determined gesture track is the gesture track corresponding to the non-contact gesture signal.
Step S20, determining a touch event simulated by the gesture track;
step S30, acquiring an operation process of the bright screen area, and responding to the touch event in the bright screen area according to the operation process of the bright screen area.
With continued reference to fig. 7, the step of responding to the touch event in the bright screen area according to the running process of the bright screen area includes:
step S31, when the touch event is a click operation, if the running process of the bright screen area is that no running application program exists, a background application program list is obtained;
step S32, reading the process priority of each application program in the background application program list;
and step S33, starting the application program with the highest process priority in the bright screen area.
After determining the gesture track of the non-contact gesture signal, determining a touch event simulated by the gesture track of the non-contact gesture signal, and then acquiring the running process of the bright screen area, and further executing the function corresponding to the touch event in the bright screen area by combining the running process of the bright screen area.
Specifically, the corresponding relationship among the gesture track, the simulated touch event and the function executed by the wearable device needs to be preset, as follows:
that is, the touch event of the gesture trajectory simulation of the non-contact gesture signal may be determined according to the correspondence. When the touch event is a click operation, if the running application program does not exist in the bright screen area, a background application program list is obtained, the process priority of each application program in the background application program list is read, and then the application program with the highest process priority is started.
The step of responding to the touch event in the bright screen area according to the running process of the bright screen area further comprises:
step S34, when the touch event is a click operation, if the running process of the bright screen area is that there is an running application program, determining a target visible control of the application program;
and step S35, triggering the function of the target visible control.
That is, when the touch event is a click operation, if there is an running application program in the bright screen area, the visibility judgment is performed by traversing a control (view) tree of the application program to find a target visible control, and then the function of the target visible control is triggered.
In more implementations, when the touch event is a left slide, if there is no running application in the bright screen area, the desktop of the bright screen area is switched from right to left; if the bright screen area exists in the running bright screen area, the page of the application program is flipped from right to left.
When the touch event is rightward sliding, if the bright screen area does not have the running application program, switching the desktop of the bright screen area from left to right; if the bright screen area exists in the running bright screen area, the page of the application program is turned from left to right.
And when the touch event is forward sliding, calling out the control center regardless of the running progress of the bright screen area.
When the touch event is backward sliding, the notification center is expired regardless of the running progress of the bright screen area.
It should be noted that, in this embodiment, the correspondence relationship among the gesture track, the simulated touch event and the function executed by the wearable device is not limited, and the user may perform the custom setting in advance.
The embodiment provides a control method of wearable equipment, which is used for analyzing a non-contact gesture signal when the non-contact gesture signal is sensed within a preset distance above a bright screen area of a flexible screen, so as to obtain a gesture track corresponding to the non-contact gesture signal; determining a touch event simulated by the gesture track; and acquiring the running process of the bright screen area, and executing the function corresponding to the touch event in the bright screen area by combining the running process of the bright screen area. Through the mode, according to the embodiment, through the non-contact gesture signals sensed from the upper part of the bright screen area and the combination of the running process of the bright screen area, the related functions of the wearable equipment can be triggered, the interaction mode of the wearable equipment operated in the air is realized, a user is not restricted in a smaller operation area, and the convenience of operating the wearable equipment is improved.
Further, a second embodiment of the wearable device control method of the present application is presented based on the first embodiment.
The second embodiment of the wearable device control method differs from the first embodiment of the wearable device control method in that the determining the target visual control of the application program step comprises:
searching a visible control of the application program;
counting the number of the found visible controls;
when the number is a plurality of, reading the priority of each visible control;
and selecting the visible control with the highest priority as the target visible control.
In this embodiment, considering that there are multiple visible controls on interfaces of some application programs, for example, an interface of photographing software, a photographing control, a video control, and the like, the priority of the control can be set in the wearable device in advance, if a running application program exists in a bright screen area when a touch event is a click operation, performing visibility judgment by traversing a control (view) tree of the application program, searching for the visible control of the application program, and then counting the number of the found visible controls, and when the number is multiple, reading the priority of each visible control, thereby taking the visible control with the highest priority as a target visible control and further triggering the function of the target visible control.
In addition, the embodiment of the application also provides a computer readable storage medium.
The computer readable storage medium of the application stores a wearable device control program, which when executed by a processor, realizes the following steps:
when a non-contact gesture signal is sensed within a preset distance above a bright screen area of the flexible screen, analyzing the non-contact gesture signal to obtain a gesture track corresponding to the non-contact gesture signal;
determining a touch event simulated by the gesture track;
and acquiring the running process of the bright screen area, and executing the function corresponding to the touch event in the bright screen area by combining the running process of the bright screen area.
The method implemented when the wearable device control program running on the processor is executed may refer to various embodiments of the wearable device control method of the present application, which are not described herein again.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present application are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) comprising several instructions for causing a wearable device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present application.
The foregoing description is only of the preferred embodiments of the present application, and is not intended to limit the scope of the application, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.
Claims (5)
1. A method of controlling a wearable device, wherein the wearable device is configured with a flexible screen, the method comprising the steps of:
when a non-contact gesture signal is sensed within a preset distance above a bright screen area of the flexible screen, analyzing the non-contact gesture signal to obtain a gesture track corresponding to the non-contact gesture signal;
determining a touch event simulated by the gesture track;
acquiring an operation process of the bright screen area, and executing a function corresponding to the touch event in the bright screen area by combining the operation process of the bright screen area;
the step of analyzing the non-contact gesture signal to obtain a gesture track corresponding to the non-contact gesture signal comprises the following steps:
preprocessing the non-contact gesture signal;
converting the preprocessed non-contact gesture signal into a binary gesture characteristic value;
matching the gesture characteristic value obtained through conversion with a pre-stored gesture track library to determine a gesture track corresponding to the non-contact gesture signal;
the step of preprocessing the non-contact gesture signal comprises the following steps:
performing dimension reduction processing on the non-contact gesture signal to obtain an effective non-contact gesture signal;
normalizing the effective non-contact gesture signal;
the step of performing dimension reduction processing on the non-contact gesture signal to obtain an effective non-contact gesture signal comprises the following steps:
grouping the non-contact gesture signals to obtain a plurality of signal groups;
screening non-contact gesture signals belonging to a preset screening range from each signal group respectively to serve as effective non-contact gesture signals;
the step of executing the function corresponding to the touch event in the bright screen area in combination with the running process of the bright screen area further comprises the following steps:
when the touch event is a click operation, if the running process of the bright screen area is that an running application program exists, determining a target visible control of the application program;
triggering the function of the target visible control;
the step of determining the target visible control of the application program comprises the following steps:
searching a visible control of the application program;
counting the number of the found visible controls;
when the number is a plurality of, reading the priority of each visible control;
and taking the visible control with the highest priority as a target visible control.
2. The method for controlling a wearable device according to claim 1, wherein the step of matching the converted gesture feature value with a pre-stored gesture track library to determine a gesture track corresponding to the non-contact gesture signal comprises:
comparing the gesture characteristic value obtained through conversion with a pre-stored gesture track library, and determining a pre-stored gesture characteristic value matched with the gesture characteristic value obtained through conversion in the pre-stored gesture track library;
determining a gesture track corresponding to the gesture characteristic value obtained through conversion according to a mapping relation between the gesture characteristic value and the gesture track in a pre-stored gesture track library;
and taking the determined gesture track as the gesture track corresponding to the non-contact gesture signal.
3. The method for controlling a wearable device according to claim 1, wherein the step of executing the function corresponding to the touch event in the bright screen area in conjunction with the running process of the bright screen area includes:
when the touch event is a click operation, if the running process of the bright screen area is that no running application program exists, acquiring a background application program list;
reading the process priority of each application program in the background application program list;
and starting the application program with the highest process priority in the bright screen area.
4. A wearable device, the wearable device comprising: a memory, a processor and a wearable device control program stored on the memory and executable on the processor, which when executed by the processor, implements the steps of the wearable device control method of any of claims 1 to 3.
5. A computer readable storage medium, characterized in that the computer readable storage medium has stored thereon a wearable device control program, which when executed by a processor, implements the steps of the wearable device control method of any of claims 1 to 3.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910480274.8A CN110244843B (en) | 2019-06-03 | 2019-06-03 | Wearable device control method, wearable device and computer readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910480274.8A CN110244843B (en) | 2019-06-03 | 2019-06-03 | Wearable device control method, wearable device and computer readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110244843A CN110244843A (en) | 2019-09-17 |
| CN110244843B true CN110244843B (en) | 2023-12-08 |
Family
ID=67886007
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910480274.8A Active CN110244843B (en) | 2019-06-03 | 2019-06-03 | Wearable device control method, wearable device and computer readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110244843B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105159539A (en) * | 2015-09-10 | 2015-12-16 | 京东方科技集团股份有限公司 | Touch control response method of wearable equipment, touch control response device of wearable equipment and wearable equipment |
| WO2018053956A1 (en) * | 2016-09-26 | 2018-03-29 | 华为技术有限公司 | Interaction method, and wearable device |
| CN109542233A (en) * | 2018-11-30 | 2019-03-29 | 哈尔滨拓博科技有限公司 | A kind of lamp control system based on dynamic gesture and recognition of face |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR101534282B1 (en) * | 2014-05-07 | 2015-07-03 | 삼성전자주식회사 | User input method of portable device and the portable device enabling the method |
-
2019
- 2019-06-03 CN CN201910480274.8A patent/CN110244843B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105159539A (en) * | 2015-09-10 | 2015-12-16 | 京东方科技集团股份有限公司 | Touch control response method of wearable equipment, touch control response device of wearable equipment and wearable equipment |
| WO2018053956A1 (en) * | 2016-09-26 | 2018-03-29 | 华为技术有限公司 | Interaction method, and wearable device |
| CN109542233A (en) * | 2018-11-30 | 2019-03-29 | 哈尔滨拓博科技有限公司 | A kind of lamp control system based on dynamic gesture and recognition of face |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110244843A (en) | 2019-09-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109982179B (en) | Audio signal output method and device, wearable device and storage medium | |
| CN110299100B (en) | Display direction adjustment method, wearable device and computer readable storage medium | |
| CN110187771B (en) | Method and device for interaction of air gestures, wearable equipment and computer storage medium | |
| CN110225282B (en) | Video recording control method, device and computer readable storage medium | |
| CN110177209B (en) | Video parameter regulation and control method, device and computer readable storage medium | |
| CN109947524B (en) | Interface display method, wearable device and computer readable storage medium | |
| CN110399195B (en) | Desktop icon dynamic replacement method, equipment and computer readable storage medium | |
| CN110187769B (en) | Preview image viewing method, equipment and computer readable storage medium | |
| CN110098845B (en) | Message processing method, wearable device, mobile terminal and readable storage medium | |
| CN110113529B (en) | Shooting parameter regulation and control method and device and computer readable storage medium | |
| CN110139270B (en) | Wearable device pairing method, wearable device and computer readable storage medium | |
| CN110086808B (en) | Account login control method and device and computer readable storage medium | |
| CN110620875B (en) | Screenshot control method, equipment and computer readable storage medium in video shooting process | |
| CN110177208B (en) | Video recording association control method, equipment and computer readable storage medium | |
| CN110198411B (en) | Depth of field control method and device in video shooting process and computer readable storage medium | |
| CN110072071B (en) | Video recording interaction control method, equipment and computer readable storage medium | |
| CN110071866B (en) | Instant messaging application control method, wearable device and storage medium | |
| CN109933400B (en) | Display interface layout method, wearable device and computer readable storage medium | |
| CN110109605B (en) | Image sharing method and device and computer readable storage medium | |
| CN110049253B (en) | Focusing control method and device and computer readable storage medium | |
| CN110650289B (en) | Shooting depth of field control method, equipment and computer readable storage medium | |
| CN110096150B (en) | Search interaction control method, equipment and computer readable storage medium | |
| CN110083427B (en) | Application program interaction control method, device and computer readable storage medium | |
| CN110244843B (en) | Wearable device control method, wearable device and computer readable storage medium | |
| CN110187770B (en) | Wrist strap voice control interaction method and device and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |