CN113220255A - Screen control method and device, computer readable medium and electronic equipment - Google Patents
Screen control method and device, computer readable medium and electronic equipment Download PDFInfo
- Publication number
- CN113220255A CN113220255A CN202110609989.6A CN202110609989A CN113220255A CN 113220255 A CN113220255 A CN 113220255A CN 202110609989 A CN202110609989 A CN 202110609989A CN 113220255 A CN113220255 A CN 113220255A
- Authority
- CN
- China
- Prior art keywords
- wearable device
- screen
- control instruction
- current state
- expansion ratio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 48
- 238000004891 communication Methods 0.000 claims abstract description 44
- 230000004044 response Effects 0.000 claims abstract description 11
- 230000006870 function Effects 0.000 claims description 41
- 238000013475 authorization Methods 0.000 claims description 33
- 230000002452 interceptive effect Effects 0.000 claims description 10
- 238000004590 computer program Methods 0.000 claims description 3
- 230000001976 improved effect Effects 0.000 description 13
- 238000012545 processing Methods 0.000 description 10
- 238000007726 management method Methods 0.000 description 8
- 230000008569 process Effects 0.000 description 8
- 238000010586 diagram Methods 0.000 description 5
- 230000003993 interaction Effects 0.000 description 4
- 238000010295 mobile communication Methods 0.000 description 4
- 238000013528 artificial neural network Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000013500 data storage Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 239000000835 fiber Substances 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- APTZNLHMIGJTEW-UHFFFAOYSA-N pyraflufen-ethyl Chemical compound C1=C(Cl)C(OCC(=O)OCC)=CC(C=2C(=C(OC(F)F)N(C)N=2)Cl)=C1F APTZNLHMIGJTEW-UHFFFAOYSA-N 0.000 description 2
- 239000004984 smart glass Substances 0.000 description 2
- 230000008093 supporting effect Effects 0.000 description 2
- 230000001133 acceleration Effects 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000004458 analytical method Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 238000013529 biological neural network Methods 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 210000004556 brain Anatomy 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000008602 contraction Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 239000011521 glass Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000001939 inductive effect Effects 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000002569 neuron Anatomy 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000003252 repetitive effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/44—Program or device authentication
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/147—Digital output to display device ; Cooperation and interconnection of the display device with other functional units using display panels
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- Computer Security & Cryptography (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The disclosure provides a screen control method and device, a computer readable medium and electronic equipment, and relates to the technical field of control. The method is applied to a terminal device, the terminal device can comprise a scalable screen, and the method comprises the following steps: authenticating the wearable device in response to establishing a communication connection with the wearable device; when the authentication passes, generating a control instruction corresponding to the current state of the wearable device; and controlling the expansion ratio of the telescopic screen through a control instruction. This openly can be when terminal equipment is connected with AR/VR equipment, according to the expansion or the shrink of the scalable screen of the operation control terminal equipment of AR/VR equipment, improve the utilization ratio of scalable screen, the simplified operation promotes user experience.
Description
Technical Field
The present disclosure relates to the field of control technologies, and in particular, to a screen control method, a screen control apparatus, a computer-readable medium, and an electronic device.
Background
Along with the continuous improvement of the living standard of people, the screen of the electronic equipment is more and more concerned by people. In order to ensure that the size of the display screen of the mobile terminal is larger and the overall size of the mobile terminal is smaller, flexible display screens are increasingly applied to the mobile terminal and used for being made into telescopic screens, for example: a scroll screen, a folding screen, a movable screen with a retractable terminal housing, etc.
At present, in a related scalable screen control scheme, a scalable screen is generally controlled to expand or contract according to an operation input by a user, for example, an input through a key or a touch, but this control interaction mode requires a user to actively operate, the control mode is single and tedious, the user experience is poor, and in some application scenarios, the utilization rate of the scalable screen is poor.
Disclosure of Invention
The present disclosure is directed to a screen control method, a screen control apparatus, a computer readable medium, and an electronic device, and further to provide a new interactive mode for controlling an expansion of a scalable screen at least to a certain extent, so as to simplify a control operation, improve user experience, and improve a utilization rate of the scalable screen.
According to a first aspect of the present disclosure, there is provided a screen control method applied to a terminal device, the terminal device including a scalable screen, the method including:
authenticating a wearable device in response to establishing a communication connection with the wearable device;
when the authentication is passed, generating a control instruction corresponding to the current state of the wearable device;
and controlling the expansion ratio of the telescopic screen through the control instruction.
According to a second aspect of the present disclosure, there is provided a screen control apparatus applied to a terminal device including a retractable screen, the apparatus including:
the device authentication module is used for responding to the establishment of communication connection with the wearable device and authenticating the wearable device;
the control instruction generation module is used for generating a control instruction corresponding to the current state of the wearable device when the authentication is passed;
and the screen control module is used for controlling the expansion ratio of the telescopic screen through the control instruction.
According to a third aspect of the present disclosure, a computer-readable medium is provided, on which a computer program is stored, which computer program, when being executed by a processor, is adapted to carry out the above-mentioned method.
According to a fourth aspect of the present disclosure, there is provided an electronic apparatus, comprising:
a processor; and
a memory for storing one or more programs that, when executed by the one or more processors, cause the one or more processors to implement the above-described method.
According to the screen control method provided by the embodiment of the disclosure, when the communication connection with the wearable device is detected, the wearable device is authenticated, and when the authentication is passed, a control instruction corresponding to the current state of the wearable device is generated, so that the expansion ratio of the telescopic screen can be controlled through the control instruction. On one hand, when the fact that communication connection is established with the wearable device is detected, the wearable device is authenticated, and communication safety is guaranteed; on the other hand, when the communication connection with the wearable device is detected, the expansion proportion of the retractable screen is automatically controlled according to the current state of the wearable device, the expansion proportion of the retractable screen is not required to be manually controlled by a user, the control flexibility of the retractable screen is improved, the user operation is simplified, and the user experience is improved; on the other hand, according to the current state of the wearable device, the expansion ratio of the telescopic screen is flexibly controlled, the utilization rate of the telescopic screen is improved, unnecessary power loss is reduced, and the cruising ability of the terminal device is improved.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure. It is to be understood that the drawings in the following description are merely exemplary of the disclosure, and that other drawings may be derived from those drawings by one of ordinary skill in the art without the exercise of inventive faculty. In the drawings:
FIG. 1 illustrates a schematic diagram of an exemplary system architecture to which embodiments of the present disclosure may be applied;
FIG. 2 shows a schematic diagram of an electronic device to which embodiments of the present disclosure may be applied;
FIG. 3 schematically illustrates a flow chart of a screen control method in an exemplary embodiment of the present disclosure;
fig. 4 schematically illustrates a flow chart for authenticating a wearable device in an exemplary embodiment of the disclosure;
fig. 5 schematically illustrates a flowchart of implementing scalable screen control when the current state of the wearable device is to perform a virtual function in an exemplary embodiment of the disclosure;
fig. 6 schematically illustrates a flowchart for implementing a scalable screen control when the current state of the wearable device is to perform a screen adjustment function in an exemplary embodiment of the disclosure;
FIG. 7 schematically illustrates a flow chart for implementing scalable screen control based on historical expansion ratio in an exemplary embodiment of the present disclosure;
fig. 8 schematically illustrates a flow chart for implementing wearable device authorization authentication in an exemplary embodiment of the present disclosure;
fig. 9 schematically shows a composition diagram of a screen control device in an exemplary embodiment of the present disclosure.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments.
Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
Fig. 1 is a schematic diagram illustrating a system architecture of an exemplary application environment to which a screen control method and apparatus according to an embodiment of the present disclosure may be applied.
As shown in fig. 1, the system architecture 100 may include one or more of terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 serves as a medium for providing communication links between the terminal devices 101, 102, 103 and the server 105. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few. The terminal devices 101, 102, 103 may be various electronic devices having computing processing functions or assisting in implementing AR/VR functions, including but not limited to desktop computers, portable computers, smart phones, tablet computers, and the like. It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation. For example, server 105 may be a server cluster comprised of multiple servers, or the like.
The screen control method provided by the embodiment of the present disclosure is generally executed by the terminal devices 101, 102, 103, and accordingly, the screen control device is generally disposed in the terminal devices 101, 102, 103. However, it is easily understood by those skilled in the art that the screen control method provided in the embodiment of the present disclosure may also be executed by the server 105, and accordingly, the screen control device may also be disposed in the server 105, which is not particularly limited in the exemplary embodiment.
An exemplary embodiment of the present disclosure provides an electronic device for implementing a screen control method, which may be the terminal device 101, 102, 103 or the server 105 in fig. 1. The electronic device includes at least a processor and a memory for storing executable instructions of the processor, the processor being configured to perform the screen control method via execution of the executable instructions.
The following takes the mobile terminal 200 in fig. 2 as an example, and exemplifies the configuration of the electronic device. It will be appreciated by those skilled in the art that the configuration of figure 2 can also be applied to fixed type devices, in addition to components specifically intended for mobile purposes. In other embodiments, mobile terminal 200 may include more or fewer components than shown, or some components may be combined, some components may be split, or a different arrangement of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. The interfacing relationship between the components is only schematically illustrated and does not constitute a structural limitation of the mobile terminal 200. In other embodiments, the mobile terminal 200 may also interface differently than shown in fig. 2, or a combination of multiple interfaces.
As shown in fig. 2, the mobile terminal 200 may specifically include: a processor 210, an internal memory 221, an external memory interface 222, a Universal Serial Bus (USB) interface 230, a charging management module 240, a power management module 241, a battery 242, an antenna 1, an antenna 2, a mobile communication module 250, a wireless communication module 260, an audio module 270, a speaker 271, a microphone 272, a microphone 273, an earphone interface 274, a sensor module 280, a display 290, a camera module 291, an indicator 292, a motor 293, a button 294, and a Subscriber Identity Module (SIM) card interface 295. Wherein the sensor module 280 may include a depth sensor 2801, a pressure sensor 2802, a gyroscope sensor 2803, and the like.
The NPU is a Neural-Network (NN) computing processor, which processes input information quickly by using a biological Neural Network structure, for example, by using a transfer mode between neurons of a human brain, and can also learn by itself continuously. The NPU can implement applications such as intelligent recognition of the mobile terminal 200, for example: image recognition, face recognition, speech recognition, text understanding, and the like.
A memory is provided in the processor 210. The memory may store instructions for implementing six modular functions: detection instructions, connection instructions, information management instructions, analysis instructions, data transmission instructions, and notification instructions, and execution is controlled by processor 210.
The charge management module 240 is configured to receive a charging input from a charger. The power management module 241 is used for connecting the battery 242, the charging management module 240 and the processor 210. The power management module 241 receives the input of the battery 242 and/or the charging management module 240, and supplies power to the processor 210, the internal memory 221, the display screen 290, the camera module 291, the wireless communication module 260, and the like.
The wireless communication function of the mobile terminal 200 may be implemented by the antenna 1, the antenna 2, the mobile communication module 250, the wireless communication module 260, a modem processor, a baseband processor, and the like. Wherein, the antenna 1 and the antenna 2 are used for transmitting and receiving electromagnetic wave signals; the mobile communication module 250 may provide a solution including wireless communication of 2G/3G/4G/5G, etc. applied to the mobile terminal 200; the modem processor may include a modulator and a demodulator; the Wireless communication module 260 may provide a solution for Wireless communication including a Wireless Local Area Network (WLAN) (e.g., a Wireless Fidelity (Wi-Fi) network), Bluetooth (BT), and the like, applied to the mobile terminal 200. In some embodiments, antenna 1 of the mobile terminal 200 is coupled to the mobile communication module 250 and antenna 2 is coupled to the wireless communication module 260, such that the mobile terminal 200 may communicate with networks and other devices via wireless communication techniques.
The mobile terminal 200 implements a display function through the GPU, the display screen 290, the application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 290 and an application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 210 may include one or more GPUs that execute program instructions to generate or alter display information.
The mobile terminal 200 may implement a photographing function through the ISP, the camera module 291, the video codec, the GPU, the display screen 290, the application processor, and the like. The ISP is used for processing data fed back by the camera module 291; the camera module 291 is used for capturing still images or videos; the digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals; the video codec is used to compress or decompress digital video, and the mobile terminal 200 may also support one or more video codecs.
The external memory interface 222 may be used to connect an external memory card, such as a Micro SD card, to extend the memory capability of the mobile terminal 200. The external memory card communicates with the processor 210 through the external memory interface 222 to implement a data storage function. For example, files such as music, video, etc. are saved in an external memory card.
Internal memory 221 may be used to store computer-executable program code, which includes instructions. The internal memory 221 may include a program storage area and a data storage area. The storage program area may store an operating system, an application program (such as a sound playing function, an image playing function, etc.) required by at least one function, and the like. The storage data area may store data (e.g., audio data, a phonebook, etc.) created during use of the mobile terminal 200, and the like. In addition, the internal memory 221 may include a high-speed random access memory, and may further include a nonvolatile memory, such as at least one magnetic disk Storage device, a Flash memory device, a Universal Flash Storage (UFS), and the like. The processor 210 executes various functional applications of the mobile terminal 200 and data processing by executing instructions stored in the internal memory 221 and/or instructions stored in a memory provided in the processor.
The mobile terminal 200 may implement an audio function through the audio module 270, the speaker 271, the receiver 272, the microphone 273, the earphone interface 274, the application processor, and the like. Such as music playing, recording, etc.
The depth sensor 2801 is used to acquire depth information of a scene. In some embodiments, a depth sensor may be provided to the camera module 291.
The pressure sensor 2802 is used to sense a pressure signal and convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 2802 may be disposed on the display screen 290. Pressure sensor 2802 can be of a wide variety, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like.
The gyro sensor 2803 may be used to determine a motion gesture of the mobile terminal 200. In some embodiments, the angular velocity of the mobile terminal 200 about three axes (i.e., x, y, and z axes) may be determined by the gyroscope sensor 2803. The gyro sensor 2803 can be used to photograph anti-shake, navigation, body-feel game scenes, and the like.
In addition, other functional sensors, such as an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc., may be provided in the sensor module 280 according to actual needs.
Other devices for providing auxiliary functions may also be included in mobile terminal 200. For example, the keys 294 include a power-on key, a volume key, and the like, and a user can generate key signal inputs related to user settings and function control of the mobile terminal 200 through key inputs. Further examples include indicator 292, motor 293, SIM card interface 295, etc.
In the related scalable screen control scheme, the scalable screen is generally controlled to expand or contract according to an operation input by a user, for example, an input through a key or a touch, but this interactive control mode requires a user to actively operate, the control mode is single and tedious, the user experience is poor, and in some application scenarios, the utilization rate of the scalable screen is poor. On the other hand, portable AR (Augmented Reality)/VR (Virtual Reality) devices such as AR smart glasses and the like are rapidly developed, and in some application scenarios, after the portable AR/VR devices are connected with terminal devices, some functions such as AR glasses can display an operation interface on the terminal devices when an AR game is run.
The following describes a screen control method according to an exemplary embodiment of the present disclosure in detail by taking an example of execution by a terminal device.
Fig. 3 shows a flow of a screen control method in the present exemplary embodiment, which may include the following steps S310 to S330:
in step S310, the wearable device is authenticated in response to establishing a communication connection with the wearable device.
In an exemplary embodiment, the wearable device may refer to a portable device with computing capability and hardware support, for example, the wearable device may be an AR smart glasses or a smart watch, which is not limited in this exemplary embodiment.
The communication connection may be a communication manner for connecting the terminal device and the wearable device and performing data transmission, for example, the communication connection may be a bluetooth communication connection, a WiFi communication connection, a communication connection based on a 2G/3G/4G/5G mobile network, or certainly, other communication manners capable of connecting the first terminal device and the second terminal device and performing data transmission may also be used, for example, the communication connection may also be a communication manner for performing wired connection by supporting interface protocols such as Micro-USB, Type-C, Thunderbolt 3(Thunderbolt 3), and the like, which is not particularly limited in this example.
In step S320, when the authentication is passed, a control instruction corresponding to the current state of the wearable device is generated.
In an exemplary embodiment, the current state of the wearable device may refer to an operating state of the wearable device when the wearable device is connected to the terminal device, for example, if the wearable device is performing a function corresponding to AR/VR, such as an AR game, when the wearable device is connected to the terminal device, the current state of the wearable device may be considered as performing the AR/VR function; if the wearable device starts the function of adjusting the screen size when the wearable device is connected to the terminal device, it may be considered that the current state of the wearable device is to execute the screen adjustment function, which is, of course, only illustrated here, and this is not specifically limited in this example embodiment.
In step S330, the expansion ratio of the retractable screen is controlled by the control instruction.
In an exemplary embodiment, the expansion ratio refers to a ratio of the visible region area of the scalable screen to the global region area of the scalable screen, for example, if the visible region area is 50 and the global region area (including the visible region and the invisible region hidden inside the terminal device structure) of the scalable screen is 100, the expansion ratio of the scalable screen is 50%; that is, if the expansion ratio of the retractable screen is 50%, the expansion or contraction of the retractable screen is controlled to make the area of the visible region 50, which is only an illustrative example and should not be any special limitation to the present exemplary embodiment.
The following describes steps S310 to S330 in detail.
In an exemplary embodiment, the authentication of the wearable device may be implemented through the steps in fig. 4, and as shown in fig. 4, the authentication may specifically include:
step S410, acquiring the device information of the wearable device and a pre-stored authorized device list;
step S420, matching the device information with the device information in the authorized device list, and determining that the wearable device passes the authentication if the matching is successful;
step S430, if the device information is not matched in the authorized device list, determining that the wearable device authentication is not passed.
The device information refers to a unique identifier for identifying the wearable device, for example, the device information may be a device manufacturer identifier, a device product identifier, a device serial number, or the like, and of course, the device information may also be other information capable of uniquely identifying the wearable device, which is not particularly limited in this example embodiment.
The authorization device list is a preset device information list recording historical authorization records of the wearable device, for example, when a new wearable device requests to establish a communication connection, the user may be notified of authorization authentication, and the authorization device list is recorded after the authorization authentication as information for subsequent authorization determination.
During authentication, the device information can be matched with the device information in the authorization device list, if the matching is successful, the wearable device can be determined to be authorized in the history record, the authorization can be directly performed at this time, and the wearable device is calibrated to pass the authentication; if the matching fails, it is indicated that the authorization record of the wearable device is not recorded in the authorization device list, and the wearable device is a new device and requires the user to perform authorization and authentication operations.
The authentication is carried out through the equipment information of the wearable equipment and the authorized equipment list, the quick authorization authentication of the wearable equipment can be realized while the safety of the connected wearable equipment is guaranteed, the operation that the user needs to carry out the authorization authentication when the communication connection is carried out every time is avoided, the user operation is reduced, and the user experience is improved.
In an exemplary embodiment, an authorization interaction interface may be provided when authentication fails, the authorization interaction interface may include an approval option, and in response to selecting the approval option, device information of the wearable device is recorded into a list of authorized devices.
The authorization interactive interface is a popup interface that pops up for authorization authentication on the terminal device or the wearable device, and is used to prompt a user whether to authorize the current wearable device, and provide an agreement option and a disagreement option, or other options such as a cancel option or a later processing option, and the like.
If the user selects the agreement option through the authorization interactive interface, recording the equipment information of the new wearable equipment into an authorization equipment list, and determining that the wearable equipment passes the authentication; and if the user selects the disagreement option through the authorization interactive interface, determining that the wearable device fails to authenticate, and finishing the current authorization authentication.
Of course, when the authentication of the new wearable device is implemented, the authorization interaction interface in this example embodiment is only an implementation manner, for example, the user may be prompted by a voice assistant built in the wearable device or the terminal device in a form of voice to perform the authentication of the new wearable device, and the user may perform the authorization authentication of the new wearable device in the form of voice, which is not limited in this example embodiment.
In an example embodiment, the wearable device may include virtual functionality, which refers to functionality capable of supporting the execution of AR/VR applications or functions related to AR/VR technology, e.g., the virtual functionality may be functionality to execute AR/VR games.
Specifically, the step in fig. 5 may be used to generate a control instruction corresponding to the current state of the wearable device, and as shown in fig. 5, the method specifically includes:
step S510, if it is detected that the current state of the wearable device is the virtual function, determining size data of an auxiliary interface of the virtual function;
and step S520, generating a control instruction corresponding to the size data so as to control the expansion ratio of the retractable screen to be matched with the auxiliary interface through the control instruction.
The auxiliary interface refers to an interface that needs to be displayed on the terminal device when the wearable device executes a virtual function, for example, the virtual function may be an AR/VR game, and the auxiliary interface may be an operation interface that is displayed on the terminal device and used for controlling and operating the AR/VR game, and the auxiliary interface needs to be adaptively changed along with the running of the AR/VR game in the wearable device, for example, the operation interface that is needed in some game scenes of the AR/VR game is larger, the operation interface that is needed in some game scenes is smaller, and the size of the auxiliary interface can be customized in the AR/VR game by a developer or a user.
The size data of the auxiliary interface refers to data representing the size of the auxiliary interface, for example, the size data may be length and width data of the auxiliary interface, or area data of the auxiliary interface, and of course, the size data of the auxiliary interface may also be associated with an expansion ratio of a scalable screen, such as a scalable screen with 30% size data of the auxiliary interface, which is not limited in this example embodiment.
The control command corresponding to the size data refers to a command for controlling the retractable screen to be unfolded to fit the size data of the auxiliary interface, for example, if the size data of the auxiliary interface is the same as the size of the retractable screen with the unfolding ratio of 30%, and the motor needs to rotate clockwise or counterclockwise for 30 turns when the current retractable screen is unfolded or contracted to 30%, the control command corresponding to the size data of the auxiliary interface at this time may be a command for controlling the motor to rotate clockwise or counterclockwise for 30 turns. Of course, the data herein are merely illustrative and should not be construed as any particular limitation on the exemplary embodiments.
The control instruction is generated by detecting the size data of the auxiliary interface which needs to be displayed on the terminal equipment, the expansion proportion of the telescopic screen is adjusted in time according to the control instruction, the telescopic screen can be matched with the auxiliary interface in size, the utilization rate of the telescopic screen is improved, the problem of power consumption waste caused by the fact that the telescopic screen with a large expansion proportion displays the auxiliary interface with a small size is avoided, the cruising ability of the terminal equipment is improved, and the use experience of a user is improved.
In an exemplary embodiment, the wearable device may include a screen adjustment function, where the screen adjustment function refers to a function in which a user actively controls a scalable screen expansion ratio of the terminal device through the wearable device, and the user may enter the screen adjustment function through a key trigger or a voice assistant voice trigger.
Specifically, the step in fig. 6 may be used to generate a control instruction corresponding to the current state of the wearable device, and as shown in fig. 6, the method specifically includes:
step S610, if the current state of the wearable device is detected to be the state for executing the screen adjusting function, determining device posture data of the wearable device;
step S620, generating a control instruction corresponding to the device gesture of the wearable device based on the device gesture data.
The device posture data refers to data used for representing a current posture of the wearable device, for example, the device posture data may be gyroscope data detected by the wearable device, may also be accelerometer data detected by the wearable device, and of course, may also be other data used for representing the current posture of the wearable device, which is not particularly limited in this example embodiment.
When a user triggers a screen adjusting function, the control of the retractable screen can be realized by detecting equipment posture data of the wearable equipment, for example, when the wearable equipment is detected to be in a left-leaning posture or a forward-leaning posture based on a gyroscope or an accelerometer of the wearable equipment, the retractable screen can be considered to be controlled to be unfolded at the moment, and a control instruction for controlling the motor to rotate clockwise at a uniform speed is generated; the gyroscope or the accelerometer based on the wearable device detects that the wearable device is in a right-leaning posture or a backward-leaning posture, and at the moment, the telescopic screen can be controlled to contract, and a control instruction for controlling the motor to rotate at a constant speed anticlockwise is generated. Of course, this is only an illustrative example, and the present exemplary embodiment is not limited thereto.
In an exemplary embodiment, a control instruction corresponding to the current state of the wearable device may be further generated through the steps in fig. 7, and as shown in fig. 7, the method specifically includes:
step S710, if a historical expansion ratio corresponding to the current state of the wearable device is detected, acquiring the historical expansion ratio;
step S720, generating a control instruction corresponding to the current state of the wearable device based on the historical expansion ratio.
For example, if the expansion ratio of the scalable screen is controlled to be 30% by the control instruction generated by the wearable device in the current state, when the wearable device and the terminal device are disconnected from communication, or when the wearable device or the terminal device is turned off, the current state of the wearable device and the expansion ratio of the current scalable screen are associated and stored, where the expansion ratio that causes the blur is the historical expansion ratio.
Through the incidence relation of the current state of the wearable device and the historical expansion proportion, when the wearable device is connected with the terminal device, if the current state of the wearable device is detected to have the relevant historical expansion proportion, the telescopic screen is directly controlled to expand or contract to the historical expansion proportion, the use habit of a user is met, the corresponding relation between the current state of the wearable device and the expansion proportion of the telescopic screen does not need to be readjusted every time according to personal preference of the user, the operation of the user is further simplified, the expansion proportion of the telescopic screen is flexibly controlled, and the user experience is improved.
Further, the expansion proportion corresponding to the current state of the wearable device can be determined in response to the disconnection of communication with the wearable device, and the expansion proportion and the current state of the wearable device are stored in an associated manner and serve as a historical expansion proportion corresponding to the current state of the wearable device, so that when the wearable device is in communication connection with the terminal device next time, the telescopic screen is directly controlled to expand to the expansion proportion adjusted by the user last time, the use habit of the user is fitted, and the operation of the user is reduced.
Fig. 8 schematically shows a flowchart for implementing wearable device authorization authentication in an exemplary embodiment of the present disclosure.
Referring to fig. 8, step S810, establishing a communication connection with the wearable device, for example, the communication connection with the wearable device may be implemented in a wired or wireless manner;
step S820, acquiring equipment information of the wearable equipment;
step S830, matching the device information with the authorized device information list, judging whether the matching is successful, if the device information is matched in the authorized device information list, considering the matching is successful, and executing step S840, otherwise executing step S860;
step 840, when the device information is successfully matched with the authorized device information list, determining that the wearable device passes the authentication, and generating a control instruction according to the current state of the wearable device;
step S850, controlling the operation of the motor according to the control instruction to control the expansion ratio of the retractable screen and end the current process;
step S860, when the matching of the device information and the authorized device information list fails, determining that the wearable device is a new device and an authorization authentication operation is required;
step S870, providing an authorization interactive interface for the user to perform authorization authentication operation, judging whether the user triggers an agreement option, if the user triggers the agreement option is determined, executing step S880, otherwise, ending the current process;
step S880, acquiring the device information of the wearable device, recording the device information into the authorized device information list, and returning to execute step S840.
In summary, in the exemplary embodiment, when it is detected that the communication connection with the wearable device is established, the wearable device is authenticated, and when the authentication is passed, a control instruction corresponding to the current state of the wearable device is generated, so that the expansion ratio of the scalable screen can be controlled through the control instruction. On one hand, when the fact that communication connection is established with the wearable device is detected, the wearable device is authenticated, and communication safety is guaranteed; on the other hand, when the communication connection with the wearable device is detected, the expansion proportion of the retractable screen is automatically controlled according to the current state of the wearable device, the expansion proportion of the retractable screen is not required to be manually controlled by a user, the control flexibility of the retractable screen is improved, the user operation is simplified, and the user experience is improved; on the other hand, according to the current state of the wearable device, the expansion ratio of the telescopic screen is flexibly controlled, the utilization rate of the telescopic screen is improved, unnecessary power loss is reduced, and the cruising ability of the terminal device is improved.
It is noted that the above-mentioned figures are merely schematic illustrations of processes involved in methods according to exemplary embodiments of the present disclosure, and are not intended to be limiting. It will be readily understood that the processes shown in the above figures are not intended to indicate or limit the chronological order of the processes. In addition, it is also readily understood that these processes may be performed synchronously or asynchronously, e.g., in multiple modules.
Further, referring to fig. 9, a screen control apparatus 900 may be provided in a terminal device, and the terminal device may include a scalable screen, and in particular, the screen control apparatus 900 may include a device authentication module 910, a control instruction generation module 920, and a screen control module 930. Wherein:
the device authentication module 910 is configured to authenticate a wearable device in response to establishing a communication connection with the wearable device;
the control instruction generating module 920 is configured to generate a control instruction corresponding to the current state of the wearable device when the authentication passes;
the screen control module 930 is configured to control the expansion ratio of the scalable screen through the control command.
In an exemplary embodiment, the device authentication module 910 may further be configured to:
acquiring the device information of the wearable device and a pre-stored authorized device list;
matching the equipment information with the equipment information in the authorized equipment list, and determining that the wearable equipment passes the authentication if the matching is successful;
if the device information is not matched in the authorized device list, determining that the wearable device authentication is not passed.
In an exemplary embodiment, the screen control device 900 may further include an authorization module, which may be configured to:
providing an authorization interactive interface when the authentication fails, wherein the authorization interactive interface comprises an agreement option;
in response to selecting the consent option, recording device information of the wearable device into the list of authorized devices.
In an exemplary embodiment, the wearable device may include a virtual function, and the control instruction generation module 920 may be configured to:
if the current state of the wearable device is detected to be the virtual function, determining size data of an auxiliary interface of the virtual function;
and generating a control instruction corresponding to the size data so as to control the expansion ratio of the retractable screen to be matched with the auxiliary interface through the control instruction.
In an exemplary embodiment, the wearable device may include a screen adjustment function, and the control instruction generation module 920 may be configured to:
if the current state of the wearable device is detected to be the state for executing the screen adjusting function, determining device posture data of the wearable device;
generating a control instruction corresponding to a device pose of the wearable device based on the device pose data.
In an exemplary embodiment, the control instruction generating module 920 may further be configured to:
if a historical expansion ratio corresponding to the current state of the wearable device is detected, acquiring the historical expansion ratio;
generating a control instruction corresponding to a current state of the wearable device based on the historical deployment rate.
In an exemplary embodiment, the screen control device 900 may further include a history expansion ratio storage module, which may be configured to:
in response to disconnecting communication with the wearable device, determining an expansion ratio corresponding to a current state of the wearable device;
and storing the expansion ratio in association with the current state of the wearable device as the historical expansion ratio.
The specific details of each module in the above apparatus have been described in detail in the method section, and details that are not disclosed may refer to the method section, and thus are not described again.
As will be appreciated by one skilled in the art, aspects of the present disclosure may be embodied as a system, method or program product. Accordingly, various aspects of the present disclosure may be embodied in the form of: an entirely hardware embodiment, an entirely software embodiment (including firmware, microcode, etc.) or an embodiment combining hardware and software aspects that may all generally be referred to herein as a "circuit," module "or" system.
Exemplary embodiments of the present disclosure also provide a computer-readable storage medium having stored thereon a program product capable of implementing the above-described method of the present specification. In some possible embodiments, various aspects of the disclosure may also be implemented in the form of a program product including program code for causing a terminal device to perform the steps according to various exemplary embodiments of the disclosure described in the above-mentioned "exemplary methods" section of this specification, when the program product is run on the terminal device, for example, any one or more of the steps in fig. 3 to 8 may be performed.
It should be noted that the computer readable media shown in the present disclosure may be computer readable signal media or computer readable storage media or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer readable signal medium may comprise a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
Furthermore, program code for carrying out operations of the present disclosure may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., through the internet using an internet service provider).
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is to be limited only by the terms of the appended claims.
Claims (10)
1. A screen control method is applied to a terminal device, wherein the terminal device comprises a scalable screen, and the method comprises the following steps:
authenticating a wearable device in response to establishing a communication connection with the wearable device;
when the authentication is passed, generating a control instruction corresponding to the current state of the wearable device;
and controlling the expansion ratio of the telescopic screen through the control instruction.
2. The method of claim 1, wherein the authenticating the wearable device comprises:
acquiring the device information of the wearable device and a pre-stored authorized device list;
matching the equipment information with the equipment information in the authorized equipment list, and determining that the wearable equipment passes the authentication if the matching is successful;
if the device information is not matched in the authorized device list, determining that the wearable device authentication is not passed.
3. The method of claim 2, further comprising:
providing an authorization interactive interface when the authentication fails, wherein the authorization interactive interface comprises an agreement option;
in response to selecting the consent option, recording device information of the wearable device into the list of authorized devices.
4. The method of claim 1, wherein the wearable device comprises a virtual function, and wherein generating the control instruction corresponding to the current state of the wearable device comprises:
if the current state of the wearable device is detected to be the virtual function, determining size data of an auxiliary interface of the virtual function;
and generating a control instruction corresponding to the size data so as to control the expansion ratio of the retractable screen to be matched with the auxiliary interface through the control instruction.
5. The method of claim 1 or 4, wherein the wearable device comprises a screen adjustment function, and wherein generating the control instruction corresponding to the current state of the wearable device comprises:
if the current state of the wearable device is detected to be the state for executing the screen adjusting function, determining device posture data of the wearable device;
generating a control instruction corresponding to a device pose of the wearable device based on the device pose data.
6. The method of claim 5, wherein generating the control instruction corresponding to the current state of the wearable device comprises:
if a historical expansion ratio corresponding to the current state of the wearable device is detected, acquiring the historical expansion ratio;
generating a control instruction corresponding to a current state of the wearable device based on the historical deployment rate.
7. The method of claim 6, further comprising:
in response to disconnecting communication with the wearable device, determining an expansion ratio corresponding to a current state of the wearable device;
and storing the expansion ratio in association with the current state of the wearable device as the historical expansion ratio.
8. A screen control device is applied to a terminal device, wherein the terminal device comprises a telescopic screen, and the device comprises:
the device authentication module is used for responding to the establishment of communication connection with the wearable device and authenticating the wearable device;
the control instruction generation module is used for generating a control instruction corresponding to the current state of the wearable device when the authentication is passed;
and the screen control module is used for controlling the expansion ratio of the telescopic screen through the control instruction.
9. A computer-readable medium, on which a computer program is stored which, when being executed by a processor, carries out the method according to any one of claims 1 to 7.
10. An electronic device, comprising:
a processor; and
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the method of any of claims 1 to 7 via execution of the executable instructions.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110609989.6A CN113220255A (en) | 2021-06-01 | 2021-06-01 | Screen control method and device, computer readable medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110609989.6A CN113220255A (en) | 2021-06-01 | 2021-06-01 | Screen control method and device, computer readable medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113220255A true CN113220255A (en) | 2021-08-06 |
Family
ID=77082457
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110609989.6A Pending CN113220255A (en) | 2021-06-01 | 2021-06-01 | Screen control method and device, computer readable medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113220255A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109752944A (en) * | 2018-12-24 | 2019-05-14 | 武汉西山艺创文化有限公司 | A kind of smartwatch based on flexible and transparent liquid crystal display |
| CN110069184A (en) * | 2019-04-29 | 2019-07-30 | 努比亚技术有限公司 | Control method, wearable device and the computer readable storage medium of mobile terminal |
| CN111459333A (en) * | 2020-03-31 | 2020-07-28 | 维沃移动通信有限公司 | Content display method and electronic equipment |
| CN111766936A (en) * | 2019-04-02 | 2020-10-13 | 广东虚拟现实科技有限公司 | Virtual content control method and device, terminal equipment and storage medium |
| KR102254597B1 (en) * | 2020-10-15 | 2021-05-21 | 삼성전자 주식회사 | electronic device including flexible and method for controlling and operating screen of the same |
-
2021
- 2021-06-01 CN CN202110609989.6A patent/CN113220255A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109752944A (en) * | 2018-12-24 | 2019-05-14 | 武汉西山艺创文化有限公司 | A kind of smartwatch based on flexible and transparent liquid crystal display |
| CN111766936A (en) * | 2019-04-02 | 2020-10-13 | 广东虚拟现实科技有限公司 | Virtual content control method and device, terminal equipment and storage medium |
| CN110069184A (en) * | 2019-04-29 | 2019-07-30 | 努比亚技术有限公司 | Control method, wearable device and the computer readable storage medium of mobile terminal |
| CN111459333A (en) * | 2020-03-31 | 2020-07-28 | 维沃移动通信有限公司 | Content display method and electronic equipment |
| KR102254597B1 (en) * | 2020-10-15 | 2021-05-21 | 삼성전자 주식회사 | electronic device including flexible and method for controlling and operating screen of the same |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11350264B2 (en) | Method and apparatus for establishing device connection | |
| CN110533585B (en) | Image face changing method, device, system, equipment and storage medium | |
| CN110830811A (en) | Live broadcast interaction method, device, system, terminal and storage medium | |
| CN111246095B (en) | Method, device and equipment for controlling lens movement and storage medium | |
| CN112188461B (en) | Control method and device of near field communication device, medium and electronic equipment | |
| US10038834B2 (en) | Video call method and device | |
| CN113238727A (en) | Screen switching method and device, computer readable medium and electronic equipment | |
| CN113289327A (en) | Display control method and device of mobile terminal, storage medium and electronic equipment | |
| CN112581358A (en) | Training method of image processing model, image processing method and device | |
| KR20200098068A (en) | Method for recommending word and apparatus thereof | |
| CN112788359A (en) | Live broadcast processing method and device, electronic equipment and storage medium | |
| US20220408164A1 (en) | Method for editing image on basis of gesture recognition, and electronic device supporting same | |
| CN111432245B (en) | Multimedia information playing control method, device, equipment and storage medium | |
| CN111241499B (en) | Application program login method, device, terminal and storage medium | |
| CN110677713B (en) | Video image processing method and device and storage medium | |
| CN110290191B (en) | Resource transfer result processing method, device, server, terminal and storage medium | |
| CN111437600A (en) | Plot showing method, plot showing device, plot showing equipment and storage medium | |
| CN113766127A (en) | Control method and device of mobile terminal, storage medium and electronic equipment | |
| CN112119372B (en) | Electronic apparatus and control method thereof | |
| CN113407318B (en) | Operating system switching method and device, computer readable medium and electronic equipment | |
| WO2023284355A9 (en) | Information processing method, apparatus, and system, storage medium, and electronic device | |
| CN113220255A (en) | Screen control method and device, computer readable medium and electronic equipment | |
| CN111367492B (en) | Webpage display method and device and storage medium | |
| CN111597468B (en) | Social content generation method, device, equipment and readable storage medium | |
| CN114595019A (en) | Theme setting method, device and equipment of application program and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |