CN113126874B - Control method and control system of terminal equipment - Google Patents
Control method and control system of terminal equipment Download PDFInfo
- Publication number
- CN113126874B CN113126874B CN202110406525.5A CN202110406525A CN113126874B CN 113126874 B CN113126874 B CN 113126874B CN 202110406525 A CN202110406525 A CN 202110406525A CN 113126874 B CN113126874 B CN 113126874B
- Authority
- CN
- China
- Prior art keywords
- coordinate
- sliding track
- screen projection
- screen
- sliding
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1454—Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The application relates to a control method and a control system of terminal equipment, wherein after the target operation on a touch screen is set as click operation, the action of the terminal equipment cannot be triggered by sliding operation; the method comprises the steps that the terminal equipment acquires a first sliding track coordinate of a finger on a touch screen and then sends the first sliding track coordinate to screen projection equipment, wherein the first sliding track coordinate comprises a starting point coordinate and a finishing point coordinate; the screen projection equipment draws a first sliding track corresponding to the analyzed first sliding track coordinate on a screen projection picture, acquires a second sliding track coordinate from a terminal coordinate to a target position of a finger and then sends the second sliding track coordinate to the screen projection equipment, the screen projection equipment draws the second sliding track on the screen projection picture, the terminal equipment acquires click operation on the target position and executes a function corresponding to the click operation, and the problem that a user needs to frequently switch between a low-head control mobile phone and a head-up viewing screen after the content displayed on a touch screen of the terminal equipment is projected on the screen is solved, and therefore the user cannot operate the terminal equipment flexibly.
Description
Technical Field
The present application relates to the field of terminal device control technologies, and in particular, to a control method and a control system for a terminal device.
Background
Along with the functions of smart phones are continuously abundant, the content required to be carried by small and small screens is more and more, and the screens of several inches are difficult to meet the increasing requirements of people, so that the existing smart phones basically have the screen projection function and project the content displayed on the touch screen to a larger screen. However, since only the video stream is transmitted after the mobile phone is projected on the screen, the actual operation needs to be implemented on the mobile phone. Therefore, the current screen-casting scenes are that video contents are played more often, and the scenes similar to browsing news and watching novels are fewer, mainly because the operation needs the user to frequently stare at the mobile phone screen, judge the current finger position and the spot touch place, and the user needs to frequently switch between the lower-head control mobile phone and the higher-head watching screen, so that the user operates the terminal device inefficiently and experiences poor.
At present, no effective solution is provided for the problems that in the related art, after contents displayed on a touch screen of a terminal device are projected onto a screen, a user needs to frequently switch between lowering the head to control a mobile phone and raising the head to watch the screen, so that the user is inflexible in operating the terminal device and poor in experience.
Disclosure of Invention
The embodiment of the application provides a control method and a control system of terminal equipment, and aims to at least solve the problems that in the related art, after contents displayed on a touch screen of the terminal equipment are projected onto a screen, a user needs to frequently switch between a head-down control mobile phone and a head-up viewing screen, so that the user is inflexible in operating the terminal equipment and poor in experience.
In a first aspect, an embodiment of the present application provides a method for controlling a terminal device, where the method is applied to control the terminal device according to a screen projection picture of a screen projection device when a user cannot see a touch screen of the terminal device after the terminal device is connected to the screen projection device, and the method includes:
setting a target operation on the touch screen as a click operation, wherein under the condition that the target operation is the click operation, the terminal equipment is triggered to execute a corresponding function after the terminal equipment is identified as the click operation;
the terminal equipment acquires a first sliding track coordinate of a finger on the touch screen and sends the first sliding track coordinate to the screen projection equipment, wherein the first sliding track coordinate comprises a start point coordinate and an end point coordinate;
the screen projection equipment analyzes the coordinates of the first sliding track to obtain an analyzed first sliding track coordinate, and draws a first sliding track corresponding to the analyzed first sliding track coordinate on the screen projection picture, wherein the first sliding track is used for indicating the position of a finger on the touch screen;
and acquiring a second sliding track coordinate of the finger from the end point coordinate to a target position, sending the second sliding track coordinate to the screen projection equipment, carrying out coordinate analysis on the second sliding track coordinate by the screen projection equipment to obtain an analyzed second sliding track coordinate, drawing a second sliding track corresponding to the analyzed second sliding track coordinate on the screen projection picture, and acquiring a clicking operation on the target position and executing a function corresponding to the clicking operation by the terminal equipment.
In some embodiments, after setting the target operation on the touch screen as a click operation, the method further comprises:
setting a target operation on a touch screen as a sliding operation, and under the condition that the target operation is the sliding operation, triggering the terminal equipment to execute a corresponding function after the terminal equipment identifies the sliding operation;
the terminal equipment acquires a first click coordinate of a finger on the touch screen and sends the first click coordinate to the screen projection equipment;
the screen projection equipment carries out coordinate analysis on the first click coordinate to obtain an analyzed first click coordinate, and the analyzed first click coordinate is displayed on the screen projection picture, wherein the analyzed first click coordinate is used for indicating the position of a finger on the touch screen;
and the terminal equipment acquires the sliding operation and executes the function corresponding to the sliding operation.
In some embodiments, setting the target operation on the touch screen as a click operation or a slide operation includes:
starting a click operation state by a target operation switching button on the terminal equipment, wherein the target operation is the click operation;
when a target operation switching button on the terminal device is opened in a sliding operation state, the target operation is the sliding operation, wherein the target operation switching button is arranged on a side key of the terminal device or in the touch screen area and is used for controlling the touch screen to switch between the click operation state and the sliding operation state;
or triggering the touch screen to work in the click operation state through a preset graph;
or, the touch screen is in the click operation state by default at the beginning.
In some embodiments, the obtaining, by the terminal device, coordinates of a sliding track of a finger on the touch screen includes:
the terminal device detects a first sliding distance of a finger on the touch screen, and generates a first coordinate when the first sliding distance is equal to a preset distance, wherein the first sliding distance is a distance from the starting point coordinate to the first coordinate;
detecting a second sliding distance of the finger on the touch screen by taking the first coordinate as an initial point, and generating a second coordinate when the second sliding distance is equal to a preset distance;
detecting the stay time of the finger on the second coordinate, wherein if the stay time is longer than the preset time, the second coordinate is used as the terminal coordinate;
the sliding track coordinates include the start point coordinates, the first coordinates, and the end point coordinates.
In some embodiments, coordinate analysis is performed on the first sliding track coordinate by the screen projection device, and obtaining the analyzed first sliding track coordinate includes:
and correspondingly amplifying each coordinate in the first sliding track coordinate according to the length-width ratio of the touch screen and the screen projection picture to obtain the analyzed first sliding track coordinate.
In some embodiments, before setting the target operation on the touch screen to be a click operation, the method further includes:
the terminal equipment initiates a screen projecting command to the screen projecting equipment, and the screen projecting equipment responds to the screen projecting command;
the terminal equipment sends screen projection content to the screen projection equipment, and the screen projection equipment performs adaptation adjustment on screen projection pictures according to the screen projection content and displays the adapted screen projection content.
In some embodiments, before the terminal device initiates a screen projection command to the screen projection device, the method further includes:
and after the terminal equipment and the screen projection equipment are connected under the same local area network, the terminal equipment and the screen projection equipment are connected in a screen projection code connection mode, or the terminal equipment and the screen projection equipment are connected in a code scanning connection mode.
In some embodiments, before the first sliding track corresponding to the parsed first sliding track coordinate is drawn on the screen projection screen, the method includes:
setting a sliding track drawing mode, wherein the sliding track drawing mode comprises sliding track color, sliding track thickness and sliding track effect.
In a second aspect, an embodiment of the present application provides a control system for a terminal device, which is applied to control the terminal device according to a screen projection picture of a screen projection device when a touch screen of the terminal device is invisible to a user after the terminal device is connected with the screen projection device, where the terminal device includes a setting module, an obtaining module, and an executing module, the screen projection device includes a drawing module,
the setting module is used for setting a target operation on the touch screen as a click operation, wherein the terminal equipment is triggered to execute a corresponding function only after the terminal equipment identifies the click operation under the condition that the target operation is the click operation;
the acquisition module is used for acquiring a first sliding track coordinate of a finger on the touch screen and sending the first sliding track coordinate to the screen projection equipment, wherein the first sliding track coordinate comprises a starting point coordinate and a terminal point coordinate;
the drawing module is used for carrying out coordinate analysis on the first sliding track coordinate to obtain an analyzed first sliding track coordinate, and drawing a first sliding track corresponding to the analyzed first sliding track coordinate on the screen projection picture, wherein the first sliding track is used for indicating the position of a finger on the touch screen;
the acquisition module is further used for acquiring a second sliding track coordinate of the finger from the end point coordinate to the target position and sending the second sliding track coordinate to the screen projection equipment, and the drawing module draws a second sliding track corresponding to the second sliding track coordinate on the screen projection picture;
the execution module is used for acquiring the click operation of the target position and executing the function corresponding to the click operation.
In some embodiments, after the target operation on the touch screen is set to be a click operation, the setting module is further used for setting the target operation on the touch screen to be a sliding operation,
under the condition that the target operation is a sliding operation, the terminal equipment is triggered to execute a corresponding function after the terminal equipment is identified as the sliding operation;
the acquisition module acquires a first click coordinate of a finger on the touch screen and sends the first click coordinate to the screen projection equipment;
the drawing module carries out coordinate analysis on the first click coordinate to obtain an analyzed first click coordinate, and the analyzed first click coordinate is displayed on the screen projection picture, wherein the analyzed first click coordinate is used for indicating the position of a finger on the touch screen;
the execution module acquires the sliding operation and executes the function corresponding to the sliding operation.
Compared with the related art, the control method of the terminal device, provided by the embodiment of the application, is applied to controlling the terminal device according to the screen projection picture of the screen projection device when the terminal device is connected with the screen projection device and a touch screen of the terminal device is invisible to a user, and setting the target operation of the touch screen as the click operation, wherein under the condition that the target operation is the click operation, the terminal device is triggered to execute the corresponding function after being identified as the click operation; the method comprises the steps that terminal equipment obtains first sliding track coordinates of fingers on a touch screen and sends the first sliding track coordinates to screen projection equipment, wherein the first sliding track coordinates comprise a start point coordinate and an end point coordinate; the screen projection equipment analyzes the coordinates of the first sliding track to obtain analyzed first sliding track coordinates, and a first sliding track corresponding to the analyzed first sliding track coordinates is drawn on a screen projection picture, wherein the first sliding track is used for indicating the position of a finger on the touch screen; the method comprises the steps of obtaining a second sliding track coordinate from a terminal coordinate to a target position of a finger, sending the second sliding track coordinate to a screen projection device, carrying out coordinate analysis on the second sliding track coordinate by the screen projection device to obtain an analyzed second sliding track coordinate, drawing a second sliding track corresponding to the analyzed second sliding track coordinate on a screen projection picture, obtaining click operation on the target position by a terminal device, and executing a function corresponding to the click operation.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a flowchart of a control method of a terminal device according to an embodiment of the present application;
fig. 2 is a flowchart of another control method of a terminal device according to an embodiment of the present application;
fig. 3 is a block diagram of a control system of a terminal device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be described and illustrated below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments provided in the present application without any inventive step are within the scope of protection of the present application. Moreover, it should be appreciated that such a development effort might be complex and tedious, but would nevertheless be a routine undertaking of design, fabrication, and manufacture for those of ordinary skill having the benefit of this disclosure, given the benefit of this disclosure, without departing from the scope of this disclosure.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the specification. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. It is to be expressly and implicitly understood by one of ordinary skill in the art that the embodiments described herein may be combined with other embodiments without conflict.
Unless defined otherwise, technical or scientific terms referred to herein shall have the ordinary meaning as understood by those of ordinary skill in the art to which this application belongs. Reference to "a," "an," "the," and similar words throughout this application are not to be construed as limiting in number, and may refer to the singular or the plural. The use of the terms "including," "comprising," "having," and any variations thereof herein, is meant to cover a non-exclusive inclusion; for example, a process, method, system, article, or apparatus that comprises a list of steps or modules (elements) is not limited to only those steps or elements but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. Reference to "connected," "coupled," and the like in this application is not intended to be limited to physical or mechanical connections, but rather can include electrical connections, whether direct or indirect. Reference herein to "a plurality" means greater than or equal to two. "and/or" describes the association relationship of the associated object, indicating that there may be three relationships, for example, "a and/or B" may indicate: a exists alone, A and B exist simultaneously, and B exists alone. Reference herein to the terms "first," "second," "third," and the like, are merely to distinguish similar objects and do not denote a particular ordering for the objects.
The embodiment provides a control method of a terminal device, which is applied to controlling the terminal device according to a screen projection picture of a screen projection device when a touch screen of the terminal device is invisible to a user after the terminal device is connected with the screen projection device, and fig. 1 is a flowchart of the control method of the terminal device according to the embodiment of the application, and as shown in fig. 1, the method includes the following steps:
step S101, setting target operation on a touch screen as click operation, wherein under the condition that the target operation is the click operation, the terminal equipment is triggered to execute corresponding functions after the terminal equipment is identified as the click operation; in this embodiment, the operation on the touch screen includes a click operation and a sliding operation, and after the target operation on the touch screen is set as the click operation, the sliding operation on the touch screen does not trigger the terminal device to execute a corresponding function, and the click operation on the touch screen can trigger the terminal device to execute a function corresponding to the click operation;
step S102, the terminal device obtains a first sliding track coordinate of a finger on a touch screen and sends the first sliding track coordinate to the screen projection device, wherein the first sliding track coordinate comprises a starting point coordinate and a terminal point coordinate; in this embodiment, after the click operation is set as the target operation of the touch screen, the sliding operation on the touch screen does not trigger the terminal device to execute a function corresponding to the sliding operation, so that the position of the finger on the touch screen can be confirmed through the first sliding track coordinate, and meanwhile, the terminal device cannot be caused to execute redundant actions;
step S103, the screen projection equipment performs coordinate analysis on the first sliding track coordinate to obtain an analyzed first sliding track coordinate, and a first sliding track corresponding to the analyzed first sliding track coordinate is drawn on a screen projection picture, wherein the first sliding track is used for indicating the position of a finger on the touch screen; in this embodiment, the first sliding track coordinate uses the length and the width of the touch screen as a coordinate system, and since the sizes of the touch screen and the screen projection picture are not consistent, if the screen projection device directly displays the first sliding track coordinate on the screen projection picture, the position is inaccurate, so the screen projection device needs to perform coordinate analysis on the first sliding track coordinate to convert the first sliding track coordinate into a coordinate using the length and the width of the screen projection picture as the coordinate system, that is, the analyzed first sliding track coordinate, and draw the first sliding track corresponding to the analyzed first sliding track coordinate on the screen projection picture, so that the position of the finger on the touch screen can be correctly indicated;
and step S104, acquiring a second sliding track coordinate from the end point coordinate to the target position of the finger, sending the second sliding track coordinate to the screen projection equipment, carrying out coordinate analysis on the second sliding track coordinate by the screen projection equipment to obtain an analyzed second sliding track coordinate, drawing a second sliding track corresponding to the analyzed second sliding track coordinate on a screen projection picture, and acquiring the clicking operation on the target position and executing a function corresponding to the clicking operation by the terminal equipment. In the embodiment, the finger slides on the touch screen and finally stops at the end point coordinate, the finger can slide from the end point coordinate to the target position according to the content of the touch screen displayed on the screen projection picture and the position of the touch screen where the finger is located, the terminal device sends the second sliding track coordinate to the screen projection device in real time, whether the finger slides to the target position or not is judged according to the second sliding track on the screen projection picture, sliding is stopped after the finger slides to the target position, clicking is carried out on the target position, and the terminal device executes a function corresponding to the clicking operation after the terminal device obtains the clicking operation on the target position.
Compared with the prior art, when a user projects a content displayed on the touch screen by the terminal device on the screen projecting picture of the screen projecting device, the user needs to frequently switch between lowering the head to control the terminal device and raising the head to watch the screen projecting picture, the terminal device can be operated without watching the screen projecting picture, the terminal device is not flexible to operate by the user, and experience feeling is poor.
In some embodiments, the operation on the touch screen includes a click operation and a slide operation, and if it is required to change the target operation on the touch screen from the click operation to the slide operation, after the target operation on the touch screen is set as the click operation, fig. 2 is a flowchart of another control method for a terminal device according to an embodiment of the present application, and as shown in fig. 2, the method includes the following steps:
step S201, setting a target operation on a touch screen as a sliding operation, and under the condition that the target operation is the sliding operation, triggering the terminal equipment to execute a corresponding function after the terminal equipment identifies the sliding operation; exemplarily, if a user wants to use a terminal device to watch novels, the sequence of target operations that the user needs to perform on a touch screen is that the user clicks reading software to enter an application program, slides a display page to search for the novels to be watched, clicks the novels to enter a watching page after finding, and performs page turning through sliding, so that the operations performed on the touch screen by the user are click operation, sliding operation, click operation and sliding operation in sequence;
step S202, the terminal equipment acquires a first click coordinate of a finger on a touch screen and sends the first click coordinate to screen projection equipment; in the embodiment, the target operation of the touch screen is set as the sliding operation, and the clicking operation of the finger on the touch screen does not trigger the terminal equipment to execute the corresponding function;
step S203, the screen projection equipment carries out coordinate analysis on the first click coordinate to obtain an analyzed first click coordinate, and the analyzed first click coordinate is displayed on a screen projection picture, wherein the analyzed first click coordinate is used for indicating the position of a finger on a touch screen; in this embodiment, when a user needs to perform a sliding operation on the touch screen, the user first clicks a finger on a certain position within a range in which the sliding operation is possible, and then slides up, down, left, or right using the position as a starting point, and if the user clicks the finger on a certain function key, then slides up, down, left, or right using the position as the starting point, and then may trigger other functions.
And step S204, the terminal equipment acquires the sliding operation and executes the function corresponding to the sliding operation.
Through the steps S201 to S204, the target operation on the touch screen is changed from the click operation to the slide operation, so that both the click operation and the slide operation on the touch screen can be performed on the terminal device through the screen projection screen.
In some embodiments, setting the target operation on the touch screen as a click operation or a slide operation includes:
starting a target operation switching button on the terminal equipment in a click operation state, wherein the target operation is a click operation; starting a target operation switching button on the terminal device in a sliding operation state, wherein the target operation is a sliding operation, and the target operation switching button is arranged on a side key of the terminal device or in a touch screen area and is used for controlling the touch screen to switch between a click operation state and a sliding operation state;
or triggering the touch screen to work in a click operation state through a preset graph; for example, when the preset graph is in the shape of a circle, the terminal device recognizes that the sliding track of the finger is the circle, the touch screen is automatically triggered to work in a click operation state, the touch screen can also be triggered to work in a sliding operation state through the preset graph, and a user can set the touch screen at will according to requirements;
alternatively, the touch screen initially operates in a click operation state by default. In this embodiment, whether the touch screen initially works in the click operation state or the sliding operation state by default may be set according to a user requirement, for example, if the number of times of the user performing the operation on the terminal device is more, the touch screen is set to be in the click operation state by default.
In some embodiments, the terminal device acquiring the sliding track coordinates of the finger on the touch screen includes:
the method comprises the steps that terminal equipment detects a first sliding distance of a finger on a touch screen, and when the first sliding distance is equal to a preset distance, a first coordinate is generated, wherein the first sliding distance is the distance from a starting point coordinate to the first coordinate; detecting a second sliding distance of the finger on the touch screen by taking the first coordinate as an initial point, and generating a second coordinate when the second sliding distance is equal to a preset distance; detecting the retention time of the finger on the second coordinate, and if the retention time is longer than the preset time, taking the second coordinate as an end point coordinate; the sliding track coordinates include a start point coordinate, a first coordinate, and an end point coordinate. Illustratively, if the preset distance is 1 cm, the preset time is 1 second, the terminal device detects that the first sliding distance of the finger on the touch screen is 1 cm, a first coordinate is generated, the first coordinate is the position of the finger on the touch screen, if the time of the finger staying at the first coordinate is more than 1 second, the first coordinate is taken as an end point coordinate, the sliding track coordinate includes a start point coordinate and an end point coordinate, if the time of the finger staying at the first coordinate is less than 1 second, the second coordinate is generated if the second sliding distance of the finger on the touch screen is 1 cm and is detected with the first coordinate as the initial point, and the time of the finger staying at the second coordinate is more than 1 second, the second coordinate is taken as the end point coordinate, the sliding track coordinate includes the start point coordinate, the first coordinate and the end point coordinate, and the number of coordinates included in the sliding track coordinate can be controlled by the size of the preset distance, the sliding track is more accurate if the number of the coordinates is large, and the transmission efficiency is higher if the number of the coordinates is small.
In some embodiments, the screen projection device performs coordinate analysis on the first sliding track coordinate, and obtaining the analyzed first sliding track coordinate includes:
and correspondingly amplifying each coordinate in the first sliding track coordinate according to the length-width ratio of the touch screen and the screen projection picture to obtain the analyzed first sliding track coordinate. For example, if the length of the touch screen is 10cm, the width of the touch screen is 5cm, the length of the projection screen is 100cm, and the width of the projection screen is 50cm, the ratio of the length to the width of the touch screen to the width of the projection screen is 10: 1, if the start point coordinate and the end coordinate in the first sliding track coordinate are (5, 1) and (6, 2), the start point coordinate and the end coordinate in the analyzed first sliding track coordinate are (50, 10) and (60, 20), the start point coordinate (5, 1) and the end coordinate (6, 2) are connected to be used as a sliding track on the screen projection, and each coordinate in the first sliding track coordinate is correspondingly enlarged according to the length-width ratio of the touch screen to the screen projection, so that the sliding track is more accurate.
In some embodiments, before the target operation on the touch screen is set to be a click operation, the terminal device initiates a screen projection command to the screen projection device, and the screen projection device responds to the screen projection command; the terminal equipment sends screen projection content to the screen projection equipment, and the screen projection equipment performs adaptation adjustment on screen projection pictures according to the screen projection content and displays the adapted screen projection content. In this embodiment, the screen projection device analyzes the size of the screen projection content, and adjusts the size of the screen projection picture according to the size of the screen projection content.
In some embodiments, before the terminal device initiates a screen projection command to the screen projection device, after the terminal device and the screen projection device are connected to the same local area network, the terminal device and the screen projection device are connected in a screen projection code connection mode, or the terminal device and the screen projection device are connected in a code scanning connection mode. In this embodiment, the screen projection is divided into a push mode and a mirror mode, in the push mode, the terminal device and the screen projection device are connected with the same wifi, through a screen projection protocol, the screen projection code connection mode is connected with the terminal device and the screen projection device, or the terminal device and the screen projection device are connected through a code scanning connection mode, the terminal device sends a video address to the screen projection device, the screen projection device starts playing after receiving the television address, and controls the terminal device to control instructions such as progress and volume of a television through watching a screen projection picture, wherein the screen projection protocol includes a DLNA protocol, an airport push protocol, and a lelink protocol.
In some embodiments, before the sliding track corresponding to the sliding track coordinates is drawn on the screen projection picture, a sliding track drawing mode is set, wherein the sliding track drawing mode comprises sliding track color, sliding track thickness and sliding track existing time. In this embodiment, the user may set a mode for drawing the sliding track according to the screen projection environment, for example, if the screen projection environment is in a dark place, the color of the sliding track is set to be darker; the ambient light sensor can be arranged in the screen projection equipment and used for sensing the ambient light condition, automatically adjusting the backlight brightness and the sliding track color of a screen projection picture and reducing the power consumption of the screen projection equipment; when the user is far away from the screen projection picture, setting the sliding track to be thicker; the distance between the screen projection equipment and the terminal equipment can be automatically judged according to the strength of a connection signal between the screen projection equipment and the terminal equipment, the thickness of a sliding track is automatically controlled, and if the distance is long, the thickness of the sliding track is set to be larger, so that a user can conveniently and clearly watch the sliding track on a screen projection picture; the sliding track is used for judging the position of the finger on the touch screen, so that the time for the sliding track to exist can be set to be shorter, the situation that a plurality of sliding tracks are displayed in an overlapped mode to cause judgment errors is avoided, and for example, the previous sliding track can disappear before the next sliding track is displayed.
It should be noted that the steps illustrated in the above-described flow diagrams or in the flow diagrams of the figures may be performed in a computer system, such as a set of computer-executable instructions, and that, although a logical order is illustrated in the flow diagrams, in some cases, the steps illustrated or described may be performed in an order different than here.
The present embodiment further provides a control system of a terminal device, where the system is used to implement the foregoing embodiments and preferred embodiments, and details of the foregoing description are omitted. As used below, the terms "module," "unit," "sub-unit," and the like may implement a combination of software and/or hardware of predetermined functions. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware or a combination of software and hardware is also possible and contemplated.
Fig. 3 is a block diagram of a control system of a terminal device according to an embodiment of the present application, which is applied to control the terminal device according to a screen projection screen of the screen projection device when a touch screen of the terminal device is invisible to a user after the terminal device is connected to the screen projection device, as shown in fig. 3, the terminal device 31 includes a setting module 310, an obtaining module 311, and an executing module 312, the screen projection device 32 includes a drawing module 320, the terminal device 31 is connected to the screen projection device 32,
the setting module 310 is configured to set a target operation on the touch screen as a click operation, where in a case that the target operation is the click operation, the terminal device 31 is triggered to execute a corresponding function only after the terminal device 31 identifies the click operation; the acquiring module 311 is configured to acquire a first sliding track coordinate of a finger on the touch screen, and send the first sliding track coordinate to the screen projection device 32, where the first sliding track coordinate includes a start point coordinate and an end point coordinate; the drawing module 320 is configured to perform coordinate analysis on the first sliding track coordinate to obtain an analyzed first sliding track coordinate, and draw a first sliding track corresponding to the analyzed first sliding track coordinate on the screen projection picture, where the first sliding track is used to indicate a position of a finger on the touch screen; the obtaining module 311 is further configured to obtain a second sliding track coordinate from the end point coordinate to the target position of the finger, send the second sliding track coordinate to the screen projection device 32, and the drawing module 320 draws a second sliding track corresponding to the second sliding track coordinate on the screen projection picture; the execution module 312 is configured to obtain a click operation on the target location, and execute a function corresponding to the click operation, so as to solve the problems that a user needs to frequently switch between lowering the head to control the mobile phone and raising the head to view the screen after the content displayed on the touch screen of the terminal device 31 is projected onto the screen, which causes the user to operate the terminal device 31 inflexibly and experiences poor experience.
It should be noted that the above modules may be functional modules or program modules, and may be implemented by software or hardware. For a module implemented by hardware, the above modules may be located in the same processor; or the modules may be located in different processors in any combination.
The present embodiment also provides an electronic device, comprising a memory having a computer program stored therein and a processor configured to run the computer program to perform the steps of any of the method embodiments described above.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
It should be noted that, for specific examples in this embodiment, reference may be made to examples described in the foregoing embodiments and optional implementations, and details of this embodiment are not described herein again.
In addition, with reference to the control method of the terminal device in the foregoing embodiment, the embodiment of the present application may be implemented by providing a storage medium. The storage medium has a computer program stored thereon; the computer program, when executed by a processor, implements the control method of any one of the terminal devices in the above embodiments.
In one embodiment, a computer device is provided, which may be a terminal. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a control method of a terminal device. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database or other medium used in the embodiments provided herein can include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
It should be understood by those skilled in the art that various technical features of the above-described embodiments can be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the above-described embodiments are not described, however, so long as there is no contradiction between the combinations of the technical features, they should be considered as being within the scope of the present description.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, and these are all within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.
Claims (10)
1. A control method of a terminal device is applied to controlling the terminal device according to a screen projection picture of the screen projection device when a touch screen of the terminal device is invisible to a user after the terminal device is connected with the screen projection device, and comprises the following steps:
setting a target operation on the touch screen as a click operation, wherein under the condition that the target operation is the click operation, the terminal equipment is triggered to execute a corresponding function after the terminal equipment is identified as the click operation;
the terminal equipment acquires a first sliding track coordinate of a finger on the touch screen and sends the first sliding track coordinate to the screen projection equipment, wherein the first sliding track coordinate comprises a starting point coordinate and a terminal point coordinate;
the screen projection equipment analyzes the coordinates of the first sliding track to obtain an analyzed first sliding track coordinate, and draws a first sliding track corresponding to the analyzed first sliding track coordinate on the screen projection picture, wherein the first sliding track is used for indicating the position of a finger on the touch screen;
and acquiring a second sliding track coordinate of the finger from the end point coordinate to a target position, sending the second sliding track coordinate to the screen projection equipment, carrying out coordinate analysis on the second sliding track coordinate by the screen projection equipment to obtain an analyzed second sliding track coordinate, drawing a second sliding track corresponding to the analyzed second sliding track coordinate on the screen projection picture, and acquiring a clicking operation on the target position and executing a function corresponding to the clicking operation by the terminal equipment.
2. The method of claim 1, wherein after setting the target operation on the touch screen as a click operation, the method further comprises:
setting a target operation on a touch screen as a sliding operation, and under the condition that the target operation is the sliding operation, triggering the terminal equipment to execute a corresponding function after the terminal equipment identifies the sliding operation;
the terminal equipment acquires a first click coordinate of a finger on the touch screen and sends the first click coordinate to the screen projection equipment;
the screen projection equipment carries out coordinate analysis on the first click coordinate to obtain an analyzed first click coordinate, and the analyzed first click coordinate is displayed on the screen projection picture, wherein the analyzed first click coordinate is used for indicating the position of a finger on the touch screen;
and the terminal equipment acquires the sliding operation and executes the function corresponding to the sliding operation.
3. The method of claim 2, wherein setting the target operation on the touch screen as a click operation or a slide operation comprises:
starting a target operation switching button on the terminal device in a click operation state, wherein the target operation is the click operation, and starting the target operation switching button on the terminal device in a sliding operation state, wherein the target operation switching button is arranged on a side key of the terminal device or in the touch screen area and is used for controlling the touch screen to switch between the click operation state and the sliding operation state;
or triggering the touch screen to work in the click operation state through a preset graph;
or the touch screen works in the click operation state by default initially.
4. The method of claim 1, wherein the terminal device acquiring coordinates of a sliding track of a finger on the touch screen comprises:
the terminal device detects a first sliding distance of a finger on the touch screen, and generates a first coordinate when the first sliding distance is equal to a preset distance, wherein the first sliding distance is a distance from the starting point coordinate to the first coordinate;
detecting a second sliding distance of the finger on the touch screen by taking the first coordinate as an initial point, and generating a second coordinate when the second sliding distance is equal to a preset distance;
detecting the stay time of the finger on the second coordinate, wherein if the stay time is longer than the preset time, the second coordinate is used as the terminal coordinate;
the sliding track coordinates include the start point coordinate, the first coordinate, and the end point coordinate, where the sliding track coordinates are the first sliding track coordinates or the second sliding track coordinates.
5. The method of claim 1, wherein the screen projection device performs coordinate resolution on the first sliding track coordinates, and obtaining the resolved first sliding track coordinates comprises:
and correspondingly amplifying each coordinate in the first sliding track coordinate according to the length-width ratio of the touch screen and the screen projection picture to obtain the analyzed first sliding track coordinate.
6. The method of claim 1, wherein before setting the target operation on the touch screen to be a click operation, the method further comprises:
the terminal equipment initiates a screen projection command to the screen projection equipment, and the screen projection equipment responds to the screen projection command;
the terminal equipment sends screen projection content to the screen projection equipment, and the screen projection equipment performs adaptation adjustment on screen projection pictures according to the screen projection content and displays the adapted screen projection content.
7. The method of claim 6, wherein before the terminal device initiates a screen projection command to the screen projection device, the method further comprises:
and after the terminal equipment and the screen projection equipment are connected under the same local area network, connecting the terminal equipment and the screen projection equipment in a screen projection code connection mode, or connecting the terminal equipment and the screen projection equipment in a code scanning connection mode.
8. The method according to claim 1, wherein before the first sliding track corresponding to the parsed first sliding track coordinate is drawn on the screen-shot picture, the method further comprises:
setting a sliding track drawing mode, wherein the sliding track drawing mode comprises sliding track color, sliding track thickness and sliding track existing time.
9. A control system of terminal equipment is characterized in that the control system is applied to controlling the terminal equipment according to a screen projection picture of the screen projection equipment when a touch screen of the terminal equipment is invisible to a user after the terminal equipment is connected with the screen projection equipment, the terminal equipment comprises a setting module, an obtaining module and an executing module, the screen projection equipment comprises a drawing module,
the setting module is used for setting a target operation of the touch screen as a click operation, wherein under the condition that the target operation is the click operation, the terminal equipment is triggered to execute a corresponding function after the terminal equipment identifies the click operation;
the acquisition module is used for acquiring a first sliding track coordinate of a finger on the touch screen and sending the first sliding track coordinate to the screen projection equipment, wherein the first sliding track coordinate comprises a start point coordinate and an end point coordinate;
the drawing module is used for carrying out coordinate analysis on the first sliding track coordinate to obtain an analyzed first sliding track coordinate, and drawing a first sliding track corresponding to the analyzed first sliding track coordinate on the screen projection picture, wherein the first sliding track is used for indicating the position of a finger on the touch screen;
the acquisition module is further used for acquiring a second sliding track coordinate from the end point coordinate to the target position of the finger and sending the second sliding track coordinate to the screen projection equipment, and the drawing module draws a second sliding track corresponding to the second sliding track coordinate on the screen projection picture;
the execution module is used for acquiring the click operation of the target position and executing the function corresponding to the click operation.
10. The system of claim 9, wherein after setting the target operation on the touch screen as a click operation, the setting module is further configured to set the target operation on the touch screen as a slide operation,
under the condition that the target operation is a sliding operation, the terminal equipment is triggered to execute a corresponding function after the terminal equipment is identified as the sliding operation;
the acquisition module acquires a first click coordinate of a finger on the touch screen and sends the first click coordinate to the screen projection equipment;
the drawing module carries out coordinate analysis on the first click coordinate to obtain an analyzed first click coordinate, and the analyzed first click coordinate is displayed on the screen projection picture, wherein the analyzed first click coordinate is used for indicating the position of a finger on the touch screen;
the execution module acquires the sliding operation and executes the function corresponding to the sliding operation.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110406525.5A CN113126874B (en) | 2021-04-15 | 2021-04-15 | Control method and control system of terminal equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110406525.5A CN113126874B (en) | 2021-04-15 | 2021-04-15 | Control method and control system of terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113126874A CN113126874A (en) | 2021-07-16 |
| CN113126874B true CN113126874B (en) | 2022-07-15 |
Family
ID=76776907
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110406525.5A Active CN113126874B (en) | 2021-04-15 | 2021-04-15 | Control method and control system of terminal equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113126874B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113590067A (en) * | 2021-07-28 | 2021-11-02 | 深圳创维－Rgb电子有限公司 | Screen projection control method, system, device and computer readable storage medium |
| CN114564139A (en) * | 2022-02-28 | 2022-05-31 | 深圳创维－Rgb电子有限公司 | Touch point position drawing method and device, screen projector and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102855088A (en) * | 2012-09-14 | 2013-01-02 | 福州瑞芯微电子有限公司 | Method for starting and setting connection in same screen as well as corresponding system and equipment thereof |
| JP2014232228A (en) * | 2013-05-29 | 2014-12-11 | ソニー株式会社 | Information processing unit and information processing system |
| CN106909297A (en) * | 2016-08-19 | 2017-06-30 | 阿里巴巴集团控股有限公司 | A kind of data communication processing method, device and electronic equipment, touch display device |
| CN111061445A (en) * | 2019-04-26 | 2020-04-24 | 华为技术有限公司 | Screen projection method and computing equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10001857B2 (en) * | 2015-05-13 | 2018-06-19 | Seiko Epson Corporation | Display apparatus and method of controlling display apparatus |
-
2021
- 2021-04-15 CN CN202110406525.5A patent/CN113126874B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102855088A (en) * | 2012-09-14 | 2013-01-02 | 福州瑞芯微电子有限公司 | Method for starting and setting connection in same screen as well as corresponding system and equipment thereof |
| JP2014232228A (en) * | 2013-05-29 | 2014-12-11 | ソニー株式会社 | Information processing unit and information processing system |
| CN106909297A (en) * | 2016-08-19 | 2017-06-30 | 阿里巴巴集团控股有限公司 | A kind of data communication processing method, device and electronic equipment, touch display device |
| CN111061445A (en) * | 2019-04-26 | 2020-04-24 | 华为技术有限公司 | Screen projection method and computing equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113126874A (en) | 2021-07-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11128802B2 (en) | Photographing method and mobile terminal | |
| KR102571369B1 (en) | Display control method, storage medium and electronic device for controlling the display | |
| CN105959553B (en) | A kind of switching method and terminal of camera | |
| CN107562322B (en) | Page switching method and device | |
| KR102027555B1 (en) | Method for displaying contents and an electronic device thereof | |
| CN110663016B (en) | Method for displaying graphical user interface and mobile terminal | |
| US9538086B2 (en) | Method of performing previewing and electronic device for implementing the same | |
| CN113126874B (en) | Control method and control system of terminal equipment | |
| US9509733B2 (en) | Program, communication apparatus and control method | |
| US20150033175A1 (en) | Portable device | |
| KR20130016655A (en) | Apparatus and method for capturing screen in portable terminal | |
| CN107172347B (en) | Photographing method and terminal | |
| US20210165670A1 (en) | Method, apparatus for adding shortcut plug-in, and intelligent device | |
| CN106293426A (en) | Screenshotss method and apparatus based on browser of mobile terminal | |
| CN114779977A (en) | Interface display method and device, electronic equipment and storage medium | |
| CN113253889A (en) | Page display processing method and device based on special-shaped screen and computer equipment | |
| CN111124584A (en) | Shortcut panel display method, terminal and readable storage medium | |
| CN114327726A (en) | Display control method, display control device, electronic equipment and storage medium | |
| US20160170596A1 (en) | Image display apparatus, image display method, and image-display program product | |
| CN110244889B (en) | Picture scaling method, device, terminal and storage medium | |
| CN111010528A (en) | Video call method, mobile terminal and computer readable storage medium | |
| KR100984826B1 (en) | Portable terminal and user interface method thereof | |
| CN115562539A (en) | Control display method and device, electronic equipment and readable storage medium | |
| CN111880707A (en) | Long screenshot method, system, device, computer and storage medium | |
| CN111316210B (en) | Control method for preventing false touch of terminal, mobile terminal and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |