CN113126874A - Control method and control system of terminal equipment - Google Patents

Control method and control system of terminal equipment Download PDF

Info

Publication number
CN113126874A
CN113126874A CN202110406525.5A CN202110406525A CN113126874A CN 113126874 A CN113126874 A CN 113126874A CN 202110406525 A CN202110406525 A CN 202110406525A CN 113126874 A CN113126874 A CN 113126874A
Authority
CN
China
Prior art keywords
coordinate
sliding track
screen
screen projection
sliding
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110406525.5A
Other languages
Chinese (zh)
Other versions
CN113126874B (en
Inventor
余锋
金凌琳
雷钧杰
王威
李振汉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dangbei Network Technology Co ltd
Original Assignee
Dangbei Network Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dangbei Network Technology Co ltd filed Critical Dangbei Network Technology Co ltd
Priority to CN202110406525.5A priority Critical patent/CN113126874B/en
Publication of CN113126874A publication Critical patent/CN113126874A/en
Application granted granted Critical
Publication of CN113126874B publication Critical patent/CN113126874B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1454Digital output to display device ; Cooperation and interconnection of the display device with other functional units involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay

Abstract

The application relates to a control method and a control system of terminal equipment, wherein after the target operation on a touch screen is set as click operation, the action of the terminal equipment cannot be triggered by sliding operation; the method comprises the steps that the terminal equipment acquires a first sliding track coordinate of a finger on a touch screen and then sends the first sliding track coordinate to screen projection equipment, wherein the first sliding track coordinate comprises a starting point coordinate and a finishing point coordinate; the screen projection equipment draws a first sliding track corresponding to the analyzed first sliding track coordinate on a screen projection picture, acquires a second sliding track coordinate from a terminal coordinate to a target position of a finger and then sends the second sliding track coordinate to the screen projection equipment, the screen projection equipment draws the second sliding track on the screen projection picture, the terminal equipment acquires click operation on the target position and executes a function corresponding to the click operation, and the problem that a user needs to frequently switch between a low-head control mobile phone and a head-up viewing screen after the content displayed on a touch screen of the terminal equipment is projected on the screen is solved, and therefore the user cannot operate the terminal equipment flexibly.

Description

Control method and control system of terminal equipment
Technical Field
The present application relates to the field of terminal device control technologies, and in particular, to a control method and a control system for a terminal device.
Background
Along with the functions of smart phones are continuously abundant, the content required to be carried by small and small screens is more and more, and the screens of several inches are difficult to meet the increasing requirements of people, so that the existing smart phones basically have the screen projection function and project the content displayed on the touch screen to a larger screen. However, since only the video stream is transmitted after the mobile phone is projected on the screen, the actual operation needs to be implemented on the mobile phone. Therefore, the current screen-casting scenes are that video contents are played more often, and scenes similar to browsing news and watching novels are fewer, mainly because such operations require a user to frequently stare at a mobile phone screen, judge the current finger position and a point-touched place, and the user needs to frequently switch between a lower-head control mobile phone and a higher-head watching screen, so that the user operates the terminal device inflexibly and experiences poor feeling.
At present, no effective solution is provided for the problems that in the related art, after contents displayed on a touch screen of a terminal device are projected onto a screen, a user needs to frequently switch between lowering the head to control a mobile phone and raising the head to watch the screen, so that the user is inflexible in operating the terminal device and poor in experience.
Disclosure of Invention
The embodiment of the application provides a control method and a control system of terminal equipment, and aims to at least solve the problems that in the related art, after contents displayed on a touch screen of the terminal equipment are projected onto a screen, a user needs to frequently switch between a head-down control mobile phone and a head-up viewing screen, so that the user is inflexible in operating the terminal equipment and poor in experience.
In a first aspect, an embodiment of the present application provides a method for controlling a terminal device, where the method is applied to control the terminal device according to a screen projection picture of a screen projection device when a user cannot see a touch screen of the terminal device after the terminal device is connected to the screen projection device, and the method includes:
setting a target operation on the touch screen as a click operation, wherein under the condition that the target operation is the click operation, the terminal equipment is triggered to execute a corresponding function after the terminal equipment is identified as the click operation;
the terminal equipment acquires a first sliding track coordinate of a finger on the touch screen and sends the first sliding track coordinate to the screen projection equipment, wherein the first sliding track coordinate comprises a starting point coordinate and a terminal point coordinate;
the screen projection equipment carries out coordinate analysis on the first sliding track coordinate to obtain an analyzed first sliding track coordinate, and a first sliding track corresponding to the analyzed first sliding track coordinate is drawn on the screen projection picture, wherein the first sliding track is used for indicating the position of a finger on the touch screen;
and acquiring a second sliding track coordinate of the finger from the end point coordinate to a target position, sending the second sliding track coordinate to the screen projection equipment, carrying out coordinate analysis on the second sliding track coordinate by the screen projection equipment to obtain an analyzed second sliding track coordinate, drawing a second sliding track corresponding to the analyzed second sliding track coordinate on the screen projection picture, and acquiring a clicking operation on the target position and executing a function corresponding to the clicking operation by the terminal equipment.
In some embodiments, after setting the target operation on the touch screen as a click operation, the method further includes:
setting a target operation on a touch screen as a sliding operation, and under the condition that the target operation is the sliding operation, triggering the terminal equipment to execute a corresponding function after the terminal equipment identifies the sliding operation;
the terminal equipment acquires a first click coordinate of a finger on the touch screen and sends the first click coordinate to the screen projection equipment;
the screen projection equipment carries out coordinate analysis on the first click coordinate to obtain an analyzed first click coordinate, and the analyzed first click coordinate is displayed on the screen projection picture, wherein the analyzed first click coordinate is used for indicating the position of a finger on the touch screen;
and the terminal equipment acquires the sliding operation and executes the function corresponding to the sliding operation.
In some embodiments, setting the target operation on the touch screen as a click operation or a slide operation includes:
starting a click operation state by a target operation switching button on the terminal equipment, wherein the target operation is the click operation;
when a target operation switching button on the terminal device is opened in a sliding operation state, the target operation is the sliding operation, wherein the target operation switching button is arranged on a side key of the terminal device or in the touch screen area and is used for controlling the touch screen to switch between the click operation state and the sliding operation state;
or triggering the touch screen to work in the click operation state through a preset graph;
or the touch screen works in the click operation state by default initially.
In some embodiments, the obtaining, by the terminal device, coordinates of a sliding track of a finger on the touch screen includes:
the terminal device detects a first sliding distance of a finger on the touch screen, and generates a first coordinate when the first sliding distance is equal to a preset distance, wherein the first sliding distance is the distance from the starting point coordinate to the first coordinate;
detecting a second sliding distance of the finger on the touch screen by taking the first coordinate as an initial point, and generating a second coordinate when the second sliding distance is equal to a preset distance;
detecting the stay time of the finger on the second coordinate, wherein if the stay time is longer than the preset time, the second coordinate is used as the terminal coordinate;
the sliding track coordinates include the start point coordinates, the first coordinates, and the end point coordinates.
In some embodiments, coordinate analysis is performed on the first sliding track coordinate by the screen projection device, and obtaining the analyzed first sliding track coordinate includes:
and correspondingly amplifying each coordinate in the first sliding track coordinate according to the length-width ratio of the touch screen and the screen projection picture to obtain the analyzed first sliding track coordinate.
In some embodiments, before setting the target operation on the touch screen to be a click operation, the method further includes:
the terminal equipment initiates a screen projecting command to the screen projecting equipment, and the screen projecting equipment responds to the screen projecting command;
the terminal equipment sends screen projection content to the screen projection equipment, and the screen projection equipment performs adaptation adjustment on screen projection pictures according to the screen projection content and displays the adapted screen projection content.
In some embodiments, before the terminal device initiates a screen projection command to the screen projection device, the method further includes:
and after the terminal equipment and the screen projection equipment are connected under the same local area network, connecting the terminal equipment and the screen projection equipment in a screen projection code connection mode, or connecting the terminal equipment and the screen projection equipment in a code scanning connection mode.
In some embodiments, before the first sliding track corresponding to the parsed first sliding track coordinate is drawn on the screen projection screen, the method includes:
setting a sliding track drawing mode, wherein the sliding track drawing mode comprises sliding track color, sliding track thickness and sliding track effect.
In a second aspect, an embodiment of the present application provides a control system for a terminal device, which is applied to control the terminal device according to a screen projection picture of a screen projection device when a touch screen of the terminal device is invisible to a user after the terminal device is connected with the screen projection device, where the terminal device includes a setting module, an obtaining module, and an executing module, the screen projection device includes a drawing module,
the setting module is used for setting a target operation on the touch screen as a click operation, wherein the terminal equipment is triggered to execute a corresponding function only after the terminal equipment identifies the click operation under the condition that the target operation is the click operation;
the acquisition module is used for acquiring a first sliding track coordinate of a finger on the touch screen and sending the first sliding track coordinate to the screen projection equipment, wherein the first sliding track coordinate comprises a starting point coordinate and a terminal point coordinate;
the drawing module is used for carrying out coordinate analysis on the first sliding track coordinate to obtain an analyzed first sliding track coordinate, and drawing a first sliding track corresponding to the analyzed first sliding track coordinate on the screen projection picture, wherein the first sliding track is used for indicating the position of a finger on the touch screen;
the acquisition module is further used for acquiring a second sliding track coordinate of the finger from the end point coordinate to the target position and sending the second sliding track coordinate to the screen projection equipment, and the drawing module draws a second sliding track corresponding to the second sliding track coordinate on the screen projection picture;
the execution module is used for acquiring the click operation of the target position and executing the function corresponding to the click operation.
In some embodiments, after the target operation on the touch screen is set to be a click operation, the setting module is further used for setting the target operation on the touch screen to be a sliding operation,
under the condition that the target operation is a sliding operation, the terminal equipment is triggered to execute a corresponding function after the terminal equipment is identified as the sliding operation;
the acquisition module acquires a first click coordinate of a finger on the touch screen and sends the first click coordinate to the screen projection equipment;
the drawing module carries out coordinate analysis on the first click coordinate to obtain an analyzed first click coordinate, and the analyzed first click coordinate is displayed on the screen projection picture, wherein the analyzed first click coordinate is used for indicating the position of a finger on the touch screen;
the execution module acquires the sliding operation and executes the function corresponding to the sliding operation.
Compared with the related art, the control method of the terminal device provided by the embodiment of the application is applied to controlling the terminal device according to the screen projection picture of the screen projection device when the terminal device is connected with the screen projection device and the touch screen of the terminal device is invisible to a user, and setting the target operation of the touch screen as the click operation, wherein under the condition that the target operation is the click operation, the terminal device is triggered to execute the corresponding function after being identified as the click operation; the method comprises the steps that terminal equipment obtains a first sliding track coordinate of a finger on a touch screen and sends the first sliding track coordinate to screen projection equipment, wherein the first sliding track coordinate comprises a starting point coordinate and a finishing point coordinate; the screen projection equipment carries out coordinate analysis on the first sliding track coordinate to obtain an analyzed first sliding track coordinate, and a first sliding track corresponding to the analyzed first sliding track coordinate is drawn on a screen projection picture, wherein the first sliding track is used for indicating the position of a finger on the touch screen; the method comprises the steps of obtaining a second sliding track coordinate of a finger from a terminal coordinate to a target position, sending the second sliding track coordinate to screen projection equipment, carrying out coordinate analysis on the second sliding track coordinate by the screen projection equipment to obtain the analyzed second sliding track coordinate, drawing a second sliding track corresponding to the analyzed second sliding track coordinate on a screen projection picture, obtaining click operation on the target position by terminal equipment, and executing a function corresponding to the click operation, and solving the problems that after contents displayed on a touch screen of the terminal equipment are projected on the screen, a user needs to frequently switch between a low-head control mobile phone and a head-up viewing screen, so that the user operates the terminal equipment inflexibly and experience is poor.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a flowchart of a control method of a terminal device according to an embodiment of the present application;
fig. 2 is a flowchart of another control method of a terminal device according to an embodiment of the present application;
fig. 3 is a block diagram of a control system of a terminal device according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be described and illustrated below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments provided in the present application without any inventive step are within the scope of protection of the present application. Moreover, it should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the specification. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of ordinary skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments without conflict.
Unless defined otherwise, technical or scientific terms referred to herein shall have the ordinary meaning as understood by those of ordinary skill in the art to which this application belongs. Reference to "a," "an," "the," and similar words throughout this application are not to be construed as limiting in number, and may refer to the singular or the plural. The present application is directed to the use of the terms "including," "comprising," "having," and any variations thereof, which are intended to cover non-exclusive inclusions; for example, a process, method, system, article, or apparatus that comprises a list of steps or modules (elements) is not limited to the listed steps or elements, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. Reference to "connected," "coupled," and the like in this application is not intended to be limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. Reference herein to "a plurality" means greater than or equal to two. "and/or" describes an association relationship of associated objects, meaning that three relationships may exist, for example, "A and/or B" may mean: a exists alone, A and B exist simultaneously, and B exists alone. Reference herein to the terms "first," "second," "third," and the like, are merely to distinguish similar objects and do not denote a particular ordering for the objects.
The embodiment provides a control method of a terminal device, which is applied to controlling the terminal device according to a screen projection picture of a screen projection device when a touch screen of the terminal device is invisible to a user after the terminal device is connected with the screen projection device, and fig. 1 is a flowchart of the control method of the terminal device according to the embodiment of the present application, and as shown in fig. 1, the method includes the following steps:
step S101, setting target operation on a touch screen as click operation, wherein under the condition that the target operation is the click operation, the terminal equipment is triggered to execute corresponding functions after the terminal equipment is identified as the click operation; in this embodiment, the operation on the touch screen includes a click operation and a sliding operation, and after the target operation on the touch screen is set as the click operation, the sliding operation on the touch screen does not trigger the terminal device to execute a corresponding function, and the click operation on the touch screen can trigger the terminal device to execute a function corresponding to the click operation;
step S102, the terminal device obtains a first sliding track coordinate of a finger on a touch screen and sends the first sliding track coordinate to the screen projection device, wherein the first sliding track coordinate comprises a starting point coordinate and a terminal point coordinate; in the embodiment, after the click operation is set as the target operation of the touch screen, the sliding operation on the touch screen does not trigger the terminal device to execute the function corresponding to the sliding operation, so that the position of the finger on the touch screen can be confirmed through the first sliding track coordinate, and meanwhile, the terminal device cannot execute redundant actions;
step S103, the screen projection equipment performs coordinate analysis on the first sliding track coordinate to obtain an analyzed first sliding track coordinate, and a first sliding track corresponding to the analyzed first sliding track coordinate is drawn on a screen projection picture, wherein the first sliding track is used for indicating the position of a finger on the touch screen; in this embodiment, the first sliding track coordinate uses the length and the width of the touch screen as a coordinate system, and since the sizes of the touch screen and the screen projection picture are not consistent, if the screen projection device directly displays the first sliding track coordinate on the screen projection picture, the position is inaccurate, so the screen projection device needs to perform coordinate analysis on the first sliding track coordinate to convert the first sliding track coordinate into a coordinate using the length and the width of the screen projection picture as the coordinate system, that is, the analyzed first sliding track coordinate, and draw the first sliding track corresponding to the analyzed first sliding track coordinate on the screen projection picture, so that the position of the finger on the touch screen can be correctly indicated;
and step S104, acquiring a second sliding track coordinate from the end point coordinate to the target position of the finger, sending the second sliding track coordinate to the screen projection equipment, carrying out coordinate analysis on the second sliding track coordinate by the screen projection equipment to obtain the analyzed second sliding track coordinate, drawing a second sliding track corresponding to the analyzed second sliding track coordinate on a screen projection picture, and acquiring the clicking operation on the target position and executing the function corresponding to the clicking operation by the terminal equipment. In this embodiment, the finger slides on the touch screen and finally stops at the end point coordinate, the finger can slide from the end point coordinate to the target position according to the content of the touch screen displayed on the screen projection screen and the position of the touch screen where the finger is located, the terminal device sends the second sliding track coordinate to the screen projection device in real time, whether the finger slides to the target position is judged according to the second sliding track on the screen projection screen, when the finger slides to the target position, the sliding is stopped, the finger is clicked at the target position, and after the terminal device obtains the click operation on the target position, the terminal device executes the function corresponding to the click operation.
Compared with the prior art, when a user projects a content displayed on the touch screen by the terminal device on the screen projecting picture of the screen projecting device, the user needs to frequently switch between lowering the head to control the terminal device and raising the head to watch the screen projecting picture, the terminal device can be operated without watching the screen projecting picture, the terminal device is not flexible to operate by the user, and experience feeling is poor.
In some embodiments, the operation on the touch screen includes a click operation and a slide operation, and if it is required to change the target operation on the touch screen from the click operation to the slide operation, after the target operation on the touch screen is set as the click operation, fig. 2 is a flowchart of another control method of a terminal device according to an embodiment of the present application, as shown in fig. 2, the method includes the following steps:
step S201, setting a target operation on a touch screen as a sliding operation, and under the condition that the target operation is the sliding operation, triggering the terminal equipment to execute a corresponding function after the terminal equipment identifies the sliding operation; exemplarily, when a user wants to use a terminal device to watch novels, the target operation sequence of the user needing to operate the touch screen is that the user clicks the reading software to enter an application program, slides a display page to search for the desired novels, clicks the novels after finding to enter a watching page, and turns pages by sliding, and then the operation of the user on the touch screen is click operation, sliding operation, click operation and sliding operation in sequence;
step S202, the terminal device obtains a first click coordinate of a finger on the touch screen and sends the first click coordinate to the screen projection device; in the embodiment, the target operation of the touch screen is set as the sliding operation, and the clicking operation of the finger on the touch screen does not trigger the terminal equipment to execute the corresponding function;
step S203, the screen projection equipment performs coordinate analysis on the first click coordinate to obtain an analyzed first click coordinate, and the analyzed first click coordinate is displayed on a screen projection picture, wherein the analyzed first click coordinate is used for indicating the position of a finger on the touch screen; in this embodiment, when a user needs to perform a sliding operation on the touch screen, the user first clicks a finger on a certain position within a slidable operation range, and then slides up, down, left, or right using the position as a starting point, and if the user clicks the finger on a certain function key, then slides up, down, left, or right using the position as the starting point, and then possibly triggers other functions.
And step S204, the terminal equipment acquires the sliding operation and executes the function corresponding to the sliding operation.
Through the steps S201 to S204, the target operation on the touch screen is changed from the click operation to the slide operation, so that both the click operation and the slide operation on the touch screen can be performed on the terminal device through the screen projection screen.
In some embodiments, setting the target operation on the touch screen as a click operation or a slide operation includes:
starting a target operation switching button on the terminal equipment in a click operation state, wherein the target operation is click operation; starting a target operation switching button on the terminal device in a sliding operation state, wherein the target operation is a sliding operation, and the target operation switching button is arranged on a side key of the terminal device or in a touch screen area and is used for controlling the touch screen to switch between a click operation state and a sliding operation state;
or triggering the touch screen to work in a click operation state through a preset graph; for example, when the preset graph is in a circle shape, the terminal device recognizes that the sliding track of the finger is the circle, the touch screen is automatically triggered to work in a click operation state, the touch screen can also be triggered to work in a sliding operation state through the preset graph, and a user can set the touch screen at will according to requirements;
alternatively, the touch screen initially operates in the click operation state by default. In this embodiment, whether the touch screen initially works in the click operation state or the sliding operation state by default may be set according to a user requirement, for example, if the number of times of the user operating the terminal device is a click operation is greater, the touch screen is set to the click operation state by default at initial.
In some embodiments, the terminal device acquiring the sliding track coordinates of the finger on the touch screen includes:
the method comprises the steps that the terminal equipment detects a first sliding distance of a finger on a touch screen, and when the first sliding distance is equal to a preset distance, a first coordinate is generated, wherein the first sliding distance is the distance from a starting point coordinate to the first coordinate; detecting a second sliding distance of the finger on the touch screen by taking the first coordinate as an initial point, and generating a second coordinate when the second sliding distance is equal to a preset distance; detecting the stay time of the finger on the second coordinate, and taking the second coordinate as an end point coordinate if the stay time is longer than the preset time; the sliding track coordinates include a start point coordinate, a first coordinate, and an end point coordinate. Illustratively, if the preset distance is 1 centimeter, the preset time is 1 second, the terminal device detects that the first sliding distance of the finger on the touch screen is 1 centimeter, a first coordinate is generated, the first coordinate is the position of the finger on the touch screen, if the time of the finger staying at the first coordinate is more than 1 second, the first coordinate is used as an end coordinate, the sliding track coordinate comprises a start point coordinate and an end point coordinate, if the time of the finger staying at the first coordinate is less than 1 second, the second sliding distance of the finger on the touch screen is detected with the first coordinate as the initial point, a second coordinate is generated, and the time of the finger staying at the second coordinate is more than 1 second, the second coordinate is used as the end coordinate, the sliding track coordinate comprises the start point coordinate, the first coordinate and the end point coordinate, and the number of coordinates contained in the sliding track coordinate can be controlled by the size of the preset distance, the sliding track is more accurate when the number of coordinates is large, and the transmission efficiency is higher when the number of coordinates is small.
In some embodiments, the screen projection device performs coordinate analysis on the first sliding track coordinate, and obtaining the analyzed first sliding track coordinate includes:
and correspondingly amplifying each coordinate in the first sliding track coordinate according to the length-width ratio of the touch screen and the screen projection picture to obtain the analyzed first sliding track coordinate. For example, if the length of the touch screen is 10cm, the width of the touch screen is 5cm, the length of the screen projection screen is 100cm, and the width of the screen projection screen is 50cm, the ratio of the length to the width of the touch screen to the width of the screen projection screen is 10: 1, if the start point coordinate and the end coordinate in the first sliding track coordinate are (5, 1) and (6, 2), the start point coordinate and the end coordinate in the analyzed first sliding track coordinate are (50, 10) and (60, 20), the start point coordinate (5, 1) and the end coordinate (6, 2) are connected to be used as a sliding track on the screen projection, and each coordinate in the first sliding track coordinate is correspondingly enlarged according to the length-width ratio of the touch screen to the screen projection, so that the sliding track is more accurate.
In some embodiments, before the target operation on the touch screen is set as a click operation, the terminal device initiates a screen projection command to the screen projection device, and the screen projection device responds to the screen projection command; the terminal equipment sends screen projection content to the screen projection equipment, the screen projection equipment performs adaptation adjustment on screen projection pictures according to the screen projection content, and displays the adapted screen projection content. In this embodiment, the screen projection device analyzes the size of the screen projection content, and adjusts the size of the screen projection picture according to the size of the screen projection content.
In some embodiments, before the terminal device initiates a screen projection command to the screen projection device, after the terminal device and the screen projection device are connected to the same local area network, the terminal device and the screen projection device are connected in a screen projection code connection mode, or the terminal device and the screen projection device are connected in a code scanning connection mode. In this embodiment, throw the screen and divide into propelling movement mode and mirror image mode, in the propelling movement mode, terminal equipment and throw the same wifi of screen equipment connection, through throwing the screen agreement, throw screen sign indicating number connected mode and throw the screen equipment, or through sweeping sign indicating number connected mode and connecting terminal equipment and throw the screen equipment, terminal equipment sends a video address for throwing the screen equipment, throw the screen equipment and receive this TV address after, begin the broadcast, control terminal equipment control instructions such as progress and volume of TV through watching throwing the screen picture, wherein, throw the screen agreement and have DLNA agreement, airplay propelling movement agreement, the lelink agreement.
In some embodiments, before the sliding track corresponding to the sliding track coordinate is drawn on the screen projection picture, a sliding track drawing mode is set, wherein the sliding track drawing mode comprises sliding track color, sliding track thickness and sliding track existing time. In this embodiment, the user may set a mode for drawing the sliding track according to the screen projection environment, for example, if the screen projection environment is in a dark place, the color of the sliding track is set to be darker; the ambient light sensor can be arranged in the screen projection equipment and used for sensing the ambient light condition, automatically adjusting the backlight brightness and the sliding track color of a screen projection picture and reducing the power consumption of the screen projection equipment; when the user is far away from the screen projection picture, setting the sliding track to be thicker; the distance between the screen projection equipment and the terminal equipment can be automatically judged according to the strength of a connection signal between the screen projection equipment and the terminal equipment, the thickness of a sliding track is automatically controlled, and if the distance is long, the thickness of the sliding track is set to be larger, so that a user can conveniently and clearly watch the sliding track on a screen projection picture; the sliding track is used for judging the position of the finger on the touch screen, so that the time for the sliding track to exist can be set to be shorter, the situation that a plurality of sliding tracks are displayed in an overlapped mode to cause judgment errors is avoided, and for example, the previous sliding track can disappear before the next sliding track is displayed.
It should be noted that the steps illustrated in the above-described flow diagrams or in the flow diagrams of the figures may be performed in a computer system, such as a set of computer-executable instructions, and that, although a logical order is illustrated in the flow diagrams, in some cases, the steps illustrated or described may be performed in an order different than here.
The present embodiment further provides a control system of a terminal device, where the system is used to implement the foregoing embodiments and preferred embodiments, and details are not repeated for what has been described. As used hereinafter, the terms "module," "unit," "subunit," and the like may implement a combination of software and/or hardware for a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 3 is a block diagram of a control system of a terminal device according to an embodiment of the present application, and is applied to control the terminal device according to a screen projection screen of the screen projection device when a touch screen of the terminal device is invisible to a user after the terminal device is connected to the screen projection device, as shown in fig. 3, the terminal device 31 includes a setting module 310, an obtaining module 311, and an executing module 312, the screen projection device 32 includes a drawing module 320, the terminal device 31 is connected to the screen projection device 32,
the setting module 310 is configured to set a target operation on the touch screen as a click operation, where in a case that the target operation is the click operation, the terminal device 31 is triggered to execute a corresponding function only after the terminal device 31 is identified as the click operation; the acquiring module 311 is configured to acquire a first sliding track coordinate of a finger on the touch screen, and send the first sliding track coordinate to the screen projection device 32, where the first sliding track coordinate includes a start point coordinate and an end point coordinate; the drawing module 320 is configured to perform coordinate analysis on the first sliding track coordinate to obtain an analyzed first sliding track coordinate, and draw a first sliding track corresponding to the analyzed first sliding track coordinate on the screen projection picture, where the first sliding track is used to indicate a position of a finger on the touch screen; the obtaining module 311 is further configured to obtain a second sliding track coordinate from the end point coordinate to the target position of the finger, send the second sliding track coordinate to the screen projection device 32, and draw the second sliding track corresponding to the second sliding track coordinate on the screen projection picture by the drawing module 320; the execution module 312 is configured to obtain a click operation on the target position, and execute a function corresponding to the click operation, so that the problems that a user needs to frequently switch between lowering the head to control the mobile phone and raising the head to watch the screen after the content displayed on the touch screen of the terminal device 31 is projected onto the screen, and the user operates the terminal device 31 inflexibly and experiences poor experience are solved.
The above modules may be functional modules or program modules, and may be implemented by software or hardware. For a module implemented by hardware, the modules may be located in the same processor; or the modules can be respectively positioned in different processors in any combination.
The present embodiment also provides an electronic device comprising a memory having a computer program stored therein and a processor configured to execute the computer program to perform the steps of any of the above method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
It should be noted that, for specific examples in this embodiment, reference may be made to examples described in the foregoing embodiments and optional implementations, and details of this embodiment are not described herein again.
In addition, with reference to the control method of the terminal device in the foregoing embodiment, the embodiment of the present application may be implemented by providing a storage medium. The storage medium having stored thereon a computer program; the computer program, when executed by a processor, implements the control method of any one of the terminal devices in the above embodiments.
In one embodiment, a computer device is provided, which may be a terminal. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a control method of a terminal device. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware instructions of a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
It should be understood by those skilled in the art that various features of the above-described embodiments can be combined in any combination, and for the sake of brevity, all possible combinations of features in the above-described embodiments are not described in detail, but rather, all combinations of features which are not inconsistent with each other should be construed as being within the scope of the present disclosure.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent shall be subject to the appended claims.

Claims (10)

1. A control method of terminal equipment is characterized in that the control method is applied to controlling the terminal equipment according to a screen projection picture of the screen projection equipment when a touch screen of the terminal equipment is invisible to a user after the terminal equipment is connected with the screen projection equipment, and the method comprises the following steps:
setting a target operation on the touch screen as a click operation, wherein under the condition that the target operation is the click operation, the terminal equipment is triggered to execute a corresponding function after the terminal equipment is identified as the click operation;
the terminal equipment acquires a first sliding track coordinate of a finger on the touch screen and sends the first sliding track coordinate to the screen projection equipment, wherein the first sliding track coordinate comprises a starting point coordinate and a terminal point coordinate;
the screen projection equipment carries out coordinate analysis on the first sliding track coordinate to obtain an analyzed first sliding track coordinate, and a first sliding track corresponding to the analyzed first sliding track coordinate is drawn on the screen projection picture, wherein the first sliding track is used for indicating the position of a finger on the touch screen;
and acquiring a second sliding track coordinate of the finger from the end point coordinate to a target position, sending the second sliding track coordinate to the screen projection equipment, carrying out coordinate analysis on the second sliding track coordinate by the screen projection equipment to obtain an analyzed second sliding track coordinate, drawing a second sliding track corresponding to the analyzed second sliding track coordinate on the screen projection picture, and acquiring a clicking operation on the target position and executing a function corresponding to the clicking operation by the terminal equipment.
2. The method of claim 1, wherein after setting the target operation on the touch screen as a click operation, the method further comprises:
setting a target operation on a touch screen as a sliding operation, and under the condition that the target operation is the sliding operation, triggering the terminal equipment to execute a corresponding function after the terminal equipment identifies the sliding operation;
the terminal equipment acquires a first click coordinate of a finger on the touch screen and sends the first click coordinate to the screen projection equipment;
the screen projection equipment carries out coordinate analysis on the first click coordinate to obtain an analyzed first click coordinate, and the analyzed first click coordinate is displayed on the screen projection picture, wherein the analyzed first click coordinate is used for indicating the position of a finger on the touch screen;
and the terminal equipment acquires the sliding operation and executes the function corresponding to the sliding operation.
3. The method of claim 2, wherein setting the target operation on the touch screen as a click operation or a slide operation comprises:
starting a target operation switching button on the terminal device in a click operation state, wherein the target operation is the click operation, and starting the target operation switching button on the terminal device in a sliding operation state, wherein the target operation switching button is arranged on a side key of the terminal device or in a touch screen area and is used for controlling the touch screen to switch between the click operation state and the sliding operation state;
or triggering the touch screen to work in the click operation state through a preset graph;
or the touch screen works in the click operation state by default initially.
4. The method of claim 1, wherein the terminal device acquiring coordinates of a sliding track of a finger on the touch screen comprises:
the terminal device detects a first sliding distance of a finger on the touch screen, and generates a first coordinate when the first sliding distance is equal to a preset distance, wherein the first sliding distance is the distance from the starting point coordinate to the first coordinate;
detecting a second sliding distance of the finger on the touch screen by taking the first coordinate as an initial point, and generating a second coordinate when the second sliding distance is equal to a preset distance;
detecting the stay time of the finger on the second coordinate, wherein if the stay time is longer than the preset time, the second coordinate is used as the terminal coordinate;
the sliding track coordinates include the start point coordinate, the first coordinate, and the end point coordinate, where the sliding track coordinates are the first sliding track coordinates or the second sliding track coordinates.
5. The method of claim 1, wherein the screen projection device performs coordinate analysis on the first sliding track coordinate, and obtaining the analyzed first sliding track coordinate comprises:
and correspondingly amplifying each coordinate in the first sliding track coordinate according to the length-width ratio of the touch screen and the screen projection picture to obtain the analyzed first sliding track coordinate.
6. The method of claim 1, wherein before setting the target operation on the touch screen to be a click operation, the method further comprises:
the terminal equipment initiates a screen projecting command to the screen projecting equipment, and the screen projecting equipment responds to the screen projecting command;
the terminal equipment sends screen projection content to the screen projection equipment, and the screen projection equipment performs adaptation adjustment on screen projection pictures according to the screen projection content and displays the adapted screen projection content.
7. The method of claim 6, wherein before the terminal device initiates a screen projection command to the screen projection device, the method further comprises:
and after the terminal equipment and the screen projection equipment are connected under the same local area network, connecting the terminal equipment and the screen projection equipment in a screen projection code connection mode, or connecting the terminal equipment and the screen projection equipment in a code scanning connection mode.
8. The method according to claim 1, wherein before the first sliding track corresponding to the parsed first sliding track coordinate is drawn on the screen-shot picture, the method further comprises:
and setting a sliding track drawing mode, wherein the sliding track drawing mode comprises sliding track color, sliding track thickness and sliding track existing time.
9. A control system of terminal equipment is characterized in that the control system is applied to controlling the terminal equipment according to a screen projection picture of the screen projection equipment when a touch screen of the terminal equipment is invisible to a user after the terminal equipment is connected with the screen projection equipment, the terminal equipment comprises a setting module, an obtaining module and an executing module, the screen projection equipment comprises a drawing module,
the setting module is used for setting a target operation on the touch screen as a click operation, wherein the terminal equipment is triggered to execute a corresponding function only after the terminal equipment identifies the click operation under the condition that the target operation is the click operation;
the acquisition module is used for acquiring a first sliding track coordinate of a finger on the touch screen and sending the first sliding track coordinate to the screen projection equipment, wherein the first sliding track coordinate comprises a starting point coordinate and a terminal point coordinate;
the drawing module is used for carrying out coordinate analysis on the first sliding track coordinate to obtain an analyzed first sliding track coordinate, and drawing a first sliding track corresponding to the analyzed first sliding track coordinate on the screen projection picture, wherein the first sliding track is used for indicating the position of a finger on the touch screen;
the acquisition module is further used for acquiring a second sliding track coordinate of the finger from the end point coordinate to the target position and sending the second sliding track coordinate to the screen projection equipment, and the drawing module draws a second sliding track corresponding to the second sliding track coordinate on the screen projection picture;
the execution module is used for acquiring the click operation of the target position and executing the function corresponding to the click operation.
10. The system of claim 9, wherein after setting the target operation on the touch screen as a click operation, the setting module is further configured to set the target operation on the touch screen as a slide operation,
under the condition that the target operation is a sliding operation, the terminal equipment is triggered to execute a corresponding function after the terminal equipment is identified as the sliding operation;
the acquisition module acquires a first click coordinate of a finger on the touch screen and sends the first click coordinate to the screen projection equipment;
the drawing module carries out coordinate analysis on the first click coordinate to obtain an analyzed first click coordinate, and the analyzed first click coordinate is displayed on the screen projection picture, wherein the analyzed first click coordinate is used for indicating the position of a finger on the touch screen;
the execution module acquires the sliding operation and executes the function corresponding to the sliding operation.
CN202110406525.5A 2021-04-15 2021-04-15 Control method and control system of terminal equipment Active CN113126874B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110406525.5A CN113126874B (en) 2021-04-15 2021-04-15 Control method and control system of terminal equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110406525.5A CN113126874B (en) 2021-04-15 2021-04-15 Control method and control system of terminal equipment

Publications (2)

Publication Number Publication Date
CN113126874A true CN113126874A (en) 2021-07-16
CN113126874B CN113126874B (en) 2022-07-15

Family

ID=76776907

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110406525.5A Active CN113126874B (en) 2021-04-15 2021-04-15 Control method and control system of terminal equipment

Country Status (1)

Country Link
CN (1) CN113126874B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114564139A (en) * 2022-02-28 2022-05-31 深圳创维-Rgb电子有限公司 Touch point position drawing method and device, screen projector and storage medium
WO2023005137A1 (en) * 2021-07-28 2023-02-02 深圳创维-Rgb电子有限公司 Mirroring control method and apparatus, and computer readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102855088A (en) * 2012-09-14 2013-01-02 福州瑞芯微电子有限公司 Method for starting and setting connection in same screen as well as corresponding system and equipment thereof
JP2014232228A (en) * 2013-05-29 2014-12-11 ソニー株式会社 Information processing unit and information processing system
US20160334911A1 (en) * 2015-05-13 2016-11-17 Seiko Epson Corporation Display apparatus and method of controlling display apparatus
CN106909297A (en) * 2016-08-19 2017-06-30 阿里巴巴集团控股有限公司 A kind of data communication processing method, device and electronic equipment, touch display device
CN111061445A (en) * 2019-04-26 2020-04-24 华为技术有限公司 Screen projection method and computing equipment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102855088A (en) * 2012-09-14 2013-01-02 福州瑞芯微电子有限公司 Method for starting and setting connection in same screen as well as corresponding system and equipment thereof
JP2014232228A (en) * 2013-05-29 2014-12-11 ソニー株式会社 Information processing unit and information processing system
US20160334911A1 (en) * 2015-05-13 2016-11-17 Seiko Epson Corporation Display apparatus and method of controlling display apparatus
CN106909297A (en) * 2016-08-19 2017-06-30 阿里巴巴集团控股有限公司 A kind of data communication processing method, device and electronic equipment, touch display device
CN111061445A (en) * 2019-04-26 2020-04-24 华为技术有限公司 Screen projection method and computing equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2023005137A1 (en) * 2021-07-28 2023-02-02 深圳创维-Rgb电子有限公司 Mirroring control method and apparatus, and computer readable storage medium
CN114564139A (en) * 2022-02-28 2022-05-31 深圳创维-Rgb电子有限公司 Touch point position drawing method and device, screen projector and storage medium

Also Published As

Publication number Publication date
CN113126874B (en) 2022-07-15

Similar Documents

Publication Publication Date Title
US11128802B2 (en) Photographing method and mobile terminal
US11257459B2 (en) Method and apparatus for controlling an electronic device
US10534534B2 (en) Method for controlling display, storage medium, and electronic device
CN107562322B (en) Page switching method and device
CN107153541B (en) Browsing interaction processing method and device
EP3279763A1 (en) Method for controlling display, storage medium, and electronic device
KR102027555B1 (en) Method for displaying contents and an electronic device thereof
KR20180134668A (en) Mobile terminal and method for controlling the same
CN116055610B (en) Method for displaying graphical user interface and mobile terminal
KR20180129432A (en) Mobile terminal and method for controlling the same
KR20150025385A (en) Mobile terminal and controlling method thereof
US20150324039A1 (en) Terminal apparatus, display system, display method, and recording medium
US9538086B2 (en) Method of performing previewing and electronic device for implementing the same
KR20160051986A (en) Mobile terminal and method for controlling the same
CN113126874B (en) Control method and control system of terminal equipment
CN107172347B (en) Photographing method and terminal
US9509733B2 (en) Program, communication apparatus and control method
EP3304875B1 (en) Mobile terminal and display operating method thereof
CN112527222A (en) Information processing method and electronic equipment
KR20150033429A (en) Mobile terminal and control method thereof
CN113253889A (en) Page display processing method and device based on special-shaped screen and computer equipment
CN111010528A (en) Video call method, mobile terminal and computer readable storage medium
CN111880707A (en) Long screenshot method, system, device, computer and storage medium
JP7455651B2 (en) Electronic equipment and its control method
KR20170071290A (en) Mobile terminal

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant