WO2023070454A1 - 终端控制方法、装置、介质与电子设备 - Google Patents

终端控制方法、装置、介质与电子设备 Download PDF

Info

Publication number
WO2023070454A1
WO2023070454A1 PCT/CN2021/127107 CN2021127107W WO2023070454A1 WO 2023070454 A1 WO2023070454 A1 WO 2023070454A1 CN 2021127107 W CN2021127107 W CN 2021127107W WO 2023070454 A1 WO2023070454 A1 WO 2023070454A1
Authority
WO
WIPO (PCT)
Prior art keywords
interface
display
range
thumbnail
trigger
Prior art date
Application number
PCT/CN2021/127107
Other languages
English (en)
French (fr)
Inventor
郑颖
Original Assignee
京东方科技集团股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 京东方科技集团股份有限公司 filed Critical 京东方科技集团股份有限公司
Priority to PCT/CN2021/127107 priority Critical patent/WO2023070454A1/zh
Priority to CN202180003133.2A priority patent/CN116368455A/zh
Publication of WO2023070454A1 publication Critical patent/WO2023070454A1/zh

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]

Definitions

  • the present disclosure relates to the technical field of intelligent control, and in particular, to a terminal control method, device, medium, and electronic equipment.
  • Intelligent control has the control methods of intelligent information processing, intelligent information feedback and intelligent control decision-making. It is an advanced stage of the development of control theory. It is mainly used to solve the control problems of complex systems that are difficult to solve with traditional methods. Most of the intelligent terminal equipment adopts Intelligent control technology realizes the control of equipment.
  • an operation page will pop up on the display screen.
  • the pop-up operation page is often not within the user's convenient operation range , the user needs to move a long distance to perform related operations on the operation page.
  • the operation page can be displayed in the designated area, but the page is often displayed in the designated area specially designed for each application. In the application When switching, the existing designated area will be invalid, and the versatility is poor.
  • the present disclosure provides a terminal control method, device, medium and electronic equipment.
  • a terminal control method including:
  • the thumbnail interface In response to a trigger operation on the thumbnail interface, the thumbnail interface is controlled to display the same content as the second display interface.
  • a terminal control device includes:
  • the parameter acquisition module is used to acquire the display range of the display interface corresponding to the trigger operation and the preset operation range;
  • a logic calculation module configured to determine the abbreviated interface of the display interface according to the display range and the preset operation range
  • a graphic generation module configured to generate the thumbnail interface according to the display range and the preset operation range, and generate a display interface according to the thumbnail interface;
  • a result output module configured to output the thumbnail interface and the display interface.
  • an electronic device includes: a processor and a memory, at least one instruction is stored in the memory, and the at least one instruction is loaded and executed by the processor to Implement the method as described in any one of the above.
  • a computer-readable storage medium is provided, at least one instruction is stored in the computer-readable storage medium, and the at least one instruction is loaded and executed by a processor, so as to implement any of the above-mentioned described method.
  • Fig. 1 is a schematic flowchart of a terminal control method in an exemplary embodiment of the present disclosure.
  • Fig. 2 is a specific operation flowchart of a terminal control method in an exemplary embodiment of the present disclosure.
  • Fig. 3 is a schematic diagram of a screen interface display of a terminal control method in an exemplary embodiment of the present disclosure.
  • Fig. 4 is an area position coordinate diagram of a terminal control method in an exemplary embodiment of the present disclosure.
  • Fig. 5 is a schematic flowchart of coordinate conversion between a thumbnail interface and a screen display interface in an exemplary embodiment of the present disclosure.
  • Fig. 6 is a schematic diagram of a movement trajectory of a gesture control method in an exemplary embodiment of the present disclosure.
  • Fig. 7 is a schematic diagram of an operation process of a floating button control method in an exemplary embodiment of the present disclosure.
  • Fig. 8 is a structural block diagram of a terminal control device in an exemplary embodiment of the present disclosure.
  • Fig. 9 is a schematic structural diagram of an electronic device in an exemplary embodiment of the present disclosure.
  • Example embodiments will now be described more fully with reference to the accompanying drawings.
  • Example embodiments may, however, be embodied in many forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art.
  • the same reference numerals in the drawings denote the same or similar structures, and thus their detailed descriptions will be omitted.
  • the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale.
  • Another method for users to operate large-screen terminal equipment is to use mobile devices to control the terminal equipment. Through the screen projection operation of the mobile device on the terminal equipment, the operation on the mobile device is used to control the flat display of the large-screen terminal equipment.
  • Such an operation method needs to add an additional mobile device, and the mobile device also needs to have an operating system that matches the terminal device, and the cost of this method is relatively high.
  • the present disclosure provides a terminal control method, which provides a small operation window, which can solve the problem of inconvenient operation for users on large-screen terminal devices, provides a user-friendly operating environment, and achieves cost savings, realizing "once and for all". the goal of.
  • FIG. 1 is a schematic flowchart of a terminal control method in an exemplary embodiment of the present disclosure. As shown in FIG. 1 , the terminal control method includes:
  • S101 In response to a trigger operation on the first display interface, determine a display range of a second display interface corresponding to the trigger operation;
  • step 101 in response to a trigger operation on the first display interface, the display range of the second display interface corresponding to the trigger operation is determined, the first display interface is a display screen, and the second display interface It is a display interface corresponding to the trigger operation that pops up on the display screen after the trigger operation is performed on the display screen.
  • This disclosure is applied to the touch screen of a large-screen intelligent terminal operating device, such as a conference all-in-one machine, a large-screen smart phone and other intelligent terminal equipment.
  • Users can touch the plane of the terminal equipment, and the touch point can be any user needs on the screen.
  • the triggered touch point will display a display interface corresponding to the user's trigger point on the screen of the smart terminal.
  • the display content of the display interface is the next operation content to be performed by the trigger point initiated by the user, and will be displayed on the screen on the display interface.
  • the device will judge the display range of the display interface on the screen. For example, if the point at the upper left corner of the screen is used as the coordinate origin, the device will give the display interface relative to the screen according to the length, width and endpoint of the display interface. Position coordinates.
  • the device Before the device performs related operations, the device needs to add gesture algorithms and custom algorithms at the system level: on the gesture algorithm, set the gesture action and save the gesture action of the device in the system, and set the gesture action switch in the system at the same time; On the custom algorithm, set the size of the thumbnail interface corresponding to the display interface, set the thumbnail interface display switch in the system, and set the user's convenient operation area range on the screen (the convenient operation area range is the user's limbs on the screen.
  • the area that is easy to touch on the screen, that is, the preset operating range) wherein the preset operating range is set according to the operating range of the user triggering the operation on the display screen, and the operating range of the triggering operation is included in the preset operating range .
  • the length and width of the thumbnail interface can be determined according to the user's actual usage habits, and can also be scaled proportionally according to the device screen resolution; the length and width of the convenient operation area can be determined according to the user's actual usage habits. It can also be scaled proportionally according to the screen resolution of the device, and the method for setting the size of the thumbnail interface and the size of the convenient operation area is not specifically limited in the present disclosure.
  • thumbnail interface display switch and gesture action switch can be set according to their own usage habits. For example, when the user needs to display the thumbnail interface, the thumbnail interface display switch can be turned on, and the user needs to gesture the device. When controlling, you can turn on the gesture action switch.
  • the thumbnail interface display switch and the gesture action switch can also be integrated into one switch, so that the user can turn on and off two functions through one switch, but the switch form of the present disclosure is not limited to the above-mentioned form, and can be set according to actual needs .
  • step S101 it is necessary to judge the display interface of the device: when the user performs a trigger operation on the control, each trigger operation will have a corresponding display result interface (the display interface corresponding to the control), if the display result interface is on the display screen ( If the preset display interface pops up and displays, the device can proceed to the next operation; if the display interface does not pop up and is displayed on the display screen, the device ends the operation.
  • step S102 if the display range is not included in the preset operation range, a thumbnail interface of the second display interface is displayed.
  • the display range of the thumbnail interface is included in the preset operation range, that is, the display range of the thumbnail interface is within the convenient operation area on the screen.
  • the trigger point displays the corresponding
  • the display interface includes the next step operation interface corresponding to the trigger point.
  • step S101 the coordinates and display range of the display interface are given, and it is judged whether the display interface is within the convenient operation area.
  • the display interface is directly displayed on the screen, and the user can directly perform the next operation on the display interface; if the display interface exceeds the range of the convenient operation area, the display and display interface within the range of the convenient operation area have the same operation content
  • the thumbnail interface of the user can complete the same operation as the display interface on the thumbnail interface.
  • step S103 in response to a trigger operation on the thumbnail interface, the thumbnail interface is controlled to display the same content as the second display interface.
  • the device will detect the position of the trigger point on the screen, and will display the display interface and the thumbnail interface of the display interface on the screen at the same time.
  • the thumbnail interface is located in the convenient operation area for the user. Perform the next operation on the thumbnail interface, and the thumbnail interface will display the interface corresponding to the next operation.
  • the display interface on the screen will undergo the same changes as the operation of the thumbnail interface
  • the interface displays the same content, and the synchronous change of the thumbnail interface and the display interface is completed.
  • the user can set the thumbnail interface according to whether to perform subsequent operations. If the user does not need the thumbnail interface in the next step after completing the operation, the thumbnail interface can be turned off by the thumbnail interface display switch to complete the operation.
  • FIG. 2 is a specific operation flowchart of a terminal control method in an exemplary embodiment of the present disclosure.
  • the shaded area A is the operating area of the current device, that is, the first trigger point of the control
  • the shaded area B is In the display interface area displayed on the screen
  • the area C in the dotted line box is the user-friendly operation area
  • the D area is the thumbnail interface area. It can be seen from the figure that when the hand-shaped trigger point is triggered on the screen, making The content of the operation in the shaded area A is displayed on the screen, and the shaded area B is obtained.
  • the B area is not included in the area C in the dotted line frame.
  • the D area with the same content as the shaded area B will be displayed on the screen.
  • Area D is within Area C of the dotted line frame area
  • the user can perform the next operation on Area D
  • the operation range of Area D is the user's convenient operation range, and the user can realize close-range operations on the screen.
  • Fig. 3 is a screen interface display diagram of a terminal control method in an exemplary embodiment of the present disclosure. Combining with the display area diagram in Fig. 2, before the user performs screen operations, the device gestures and gestures are switched and saved in the system , set the thumbnail interface size and thumbnail interface switch, and set the size of the user-friendly operation area; after the device has set the above three parameters, determine whether the thumbnail interface switch and gesture action switch are turned on; if yes, the user can perform operations on the screen.
  • the device judges whether the display interface after the user's operation action pops up on the screen; if yes, the device judges whether the display interface is within the convenient operation area; if not, the device detects The position of the trigger point on the screen, and pop up the thumbnail interface of the display interface according to the location of the trigger point; the content of the display interface of the previous stage operation is displayed on the thumbnail interface at the same time; judge whether the thumbnail interface needs to follow the gesture action If not, the user can perform the next operation on the thumbnail interface, and the same content as that after the operation on the thumbnail interface will be displayed on the screen display interface. After the operation is completed, the user can choose to exit the thumbnail interface as needed.
  • the user can give a gesture to control the thumbnail interface follow-up according to the gesture action set above, and the device detects whether the trajectory of the gesture movement is the same as the movement trajectory of the thumbnail interface. If they are the same, when the user triggers the gesture to end the control operation, the thumbnail interface stops following the gesture action, and the user can perform the next operation on the thumbnail interface.
  • the value range is [xx 0 ,x+x 0 ],[yy 0 ,y+y 0 ]; if the value of xx 0 exceeds the coordinate range of the screen display interface, that is, when (xx 0 ) ⁇ 0, it is convenient to operate
  • the value of the x-axis coordinate of the area will become [0,2x 0 ]; if (x+x 0 )>W (where W is the screen width), the value of the x-axis coordinate of the operation area will become [ W-2x 0 ,W].
  • the value range in the Y direction of the convenient operation area is determined in the same way as the value range in the X direction described above, and will not be repeated here.
  • the motion trajectory of the thumbnail interface with a height of h and a width of w in the convenient operation area is shown in Figure 4, and the above motion trajectory can be adjusted according to the size or design requirements of the specific smart terminal screen
  • a horizontal or vertical reference line can be set. When the horizontal reference line is exceeded, the thumbnail interface needs to be displayed in the right display area. When the vertical reference line is exceeded, the thumbnail interface needs to be displayed in the lower display area.
  • the possible coordinate ranges of the four vertices clockwise in the thumbnail interface in the convenient operation area are ((xx 0 ),(yy 0 )), ((xx 0 ),(y+y 0 -h) ), ((x+x 0 -w),(y+y 0 -h)), ((x+x 0 -w),(yy 0 )), therefore, the coordinates of the thumbnail interface (p,q)
  • the conditions to be met are:
  • W is the width of the screen
  • H is the height of the screen.
  • the user can trigger the trigger point of the device screen, and obtain the position area on the screen that will change related to the current operation through SurfaceFlinger, that is, the display interface, and judge Whether the display interface exceeds the range of the convenient operation area corresponding to the user's current trigger point. If it exceeds the range, a screenshot of the framebuffer will be taken, and the thumbnail interface will pop up (the control switch of the thumbnail interface is turned on by default), and the content after the screenshot will be displayed in the thumbnail In the interface, through the above steps, the operation position coordinates of the thumbnail interface are converted into the position coordinates of the actual screen interface, and then touch control is performed on the device.
  • the specific operation steps are shown in Figure 5.
  • the above-mentioned SurfaceFlinger is a service of a specific system. It is a layer between the application library and the graphics library. It is responsible for managing the interface of the application side. It can composite and superimpose all the interfaces and reflect them on the framebuffer; framebuffer (frame buffer) Is a video output device driving a video display device from a memory buffer containing complete frame data.
  • framebuffer frame buffer
  • the method for obtaining the location area of the screen and the current operation is not limited to using SurfaceFlinger, and may also be other services or applications that can be equipped with devices that can obtain the location of the screen.
  • the terminal control method provided by the present disclosure can display the thumbnail interface of the screen display interface within the convenient operation range of the user, and the user can perform the same operation as the display interface in the thumbnail interface, and at the same time, the display interface can display the same as the thumbnail interface At the same time, the thumbnail interface can also be set to follow up with the user's gestures, which is convenient for the user's operation.
  • the terminal control method provided in the present disclosure also includes a control method of an abbreviated interface.
  • the thumbnail interface control method includes a gesture control operation including: in response to a gesture control trigger operation, controlling the thumbnail interface to follow the trigger point of the gesture control operation.
  • the thumbnail interface is controlled to stop following the trigger point of the gesture control operation.
  • thumbnail interface control switch When both the thumbnail interface control switch and the gesture control switch are turned on, after the thumbnail interface is turned on, the user slides gestures on the screen or on the screen, and the thumbnail interface can change position as the position of the gesture changes, making the thumbnail The position of the interface on the screen is the same as the position reached by the gesture.
  • a thumbnail interface pops up on the screen at the trigger point, and the thumbnail interface is within the convenient operation area of the trigger point. The thumbnail interface moves along with the trigger point until the user stops the gesture control operation.
  • the gesture control action may be a trigger point for triggering on the screen, or may be a form in which the gesture is drawn over the screen without touching the screen.
  • control method of the thumbnail interface further includes a floating button control operation: in response to the trigger operation controlled by the floating button, controlling the thumbnail interface to be displayed at the trigger point of the floating button control operation.
  • controlling the thumbnail interface In response to the trigger operation of ending the control of the floating button, controlling the thumbnail interface to stop displaying at the trigger point of the ending control operation of the floating button.
  • the above-mentioned gesture control operation of the present disclosure can be replaced by a floating button control operation accordingly.
  • a floating button control operation As shown in FIG. At this time, there is no need to turn on the gesture control switch.
  • the thumbnail interface By dragging the floating button E on the screen, the thumbnail interface can be dragged to the position corresponding to the floating button E.
  • the thumbnail interface is For those that are not displayed on the screen, if you need to shorten the interface again, you can trigger the redisplay of the thumbnail interface at this position through a specific trigger action, for example, you can press and hold on this point or slide according to the specified shape or follow the specified direction Swipe etc.
  • the floating button control displays the thumbnail interface of the starting position and the ending position of the thumbnail screen on the screen, and does not display the movement process of the thumbnail interface, while the gesture control is displayed on the screen
  • the motion trajectory, start position and end position of the thumbnail interface is displayed on the screen.
  • the device can also control the thumbnail interface through face recognition, and the present disclosure includes but is not limited to the above method for controlling the thumbnail interface.
  • the terminal control method provided by the present disclosure also includes a method for controlling the thumbnail interface.
  • the user By controlling the position of the thumbnail interface, the user can make the display interface
  • the abbreviated interface can follow the position of the user, which is convenient for the user to operate the device.
  • FIG. 8 is a structural block diagram of a terminal control device in an exemplary embodiment of the present disclosure. As shown in FIG. 8 , the terminal control device includes: a parameter acquisition module 10. Logic calculation module 20 , graphic generation module 30 and result output module 40 .
  • the parameter acquisition module 10 is used to acquire the display range of the display interface corresponding to the trigger operation and the preset operation range.
  • the logic calculation module 20 is configured to determine the thumbnail interface of the display interface according to the display range and the preset operation range.
  • the graphics generation module 30 is used for generating the thumbnail interface according to the display range and the preset operation range, and generating a display interface according to the thumbnail interface.
  • the result output module 40 is configured to output the thumbnail interface and the display interface.
  • the present disclosure provides a terminal control device, which uses a terminal control method to control equipment and execute related operations through four modules: a parameter acquisition module, a graphics generation module, a logic calculation module, and a result output module, and can realize screen display
  • a parameter acquisition module a graphics generation module
  • a logic calculation module a logic calculation module
  • a result output module a result output module
  • the thumbnail interface of the interface is displayed, and the user can operate on the thumbnail interface, which facilitates the user's operation of the device.
  • FIG. 9 is a schematic structural diagram of an electronic device in an exemplary embodiment of the present disclosure.
  • the electronic device 1000 is in the form of a general computing device.
  • Components of the electronic device 1000 may include but not limited to: at least one processing unit 1010 , at least one storage unit 1020 , and a bus 1030 connecting different system components (including the storage unit 1020 and the processing unit 1010 ).
  • the storage unit stores program codes, and the program codes can be executed by the processing unit 1010, so that the processing unit 1010 executes the steps according to various exemplary embodiments of the present invention described in the “Exemplary Methods” section of this specification.
  • the processing unit 1010 may execute the method steps shown in FIG. 1 and the like.
  • the storage unit 1020 may include a volatile storage unit, such as a random access storage unit (RAM) 1021 and/or a cache storage unit 1022 , and may further include a read-only storage unit (ROM) 1023 .
  • RAM random access storage unit
  • ROM read-only storage unit
  • Storage unit 1020 may also include a program/utility 1024 having a set (at least one) of program modules 1025, such program modules 1025 including but not limited to: an operating system, one or more application programs, other program modules, and program data, Implementations of networked environments may be included in each or some combination of these examples.
  • program modules 1025 including but not limited to: an operating system, one or more application programs, other program modules, and program data, Implementations of networked environments may be included in each or some combination of these examples.
  • Bus 1030 may include a data bus, an address bus and a control bus.
  • the electronic device 1000 can also communicate with one or more external devices 1100 (such as keyboards, pointing devices, Bluetooth devices, etc.), and such communication can be performed through an input/output (I/O) interface 1040 .
  • the electronic device 1000 can also communicate with one or more networks (eg, a local area network (LAN), a wide area network (WAN), and/or a public network, such as the Internet) through the network adapter 1050 .
  • networks eg, a local area network (LAN), a wide area network (WAN), and/or a public network, such as the Internet
  • the network adapter 1050 communicates with other modules of the electronic device 1000 through the bus 1030 .
  • other hardware and/or software modules may be used in conjunction with electronic device 1000, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives And data backup storage system, etc.
  • Exemplary embodiments of the present disclosure also provide a computer-readable storage medium, which can be realized in the form of a program product, which includes program code.
  • the program product When the program product is run on the electronic device, the program code is used to make the electronic device The steps described in the "Exemplary Methods" section above in this specification according to various exemplary embodiments of the present disclosure are performed.
  • the program product can be implemented as a portable compact disk read only memory (CD-ROM) and include program code, and can run on an electronic device, such as a personal computer.
  • CD-ROM portable compact disk read only memory
  • the program product of the present disclosure is not limited thereto.
  • a readable storage medium may be any tangible medium containing or storing a program, and the program may be used by or in combination with an instruction execution system, apparatus or device.
  • a program product may take the form of any combination of one or more readable media.
  • the readable medium may be a readable signal medium or a readable storage medium.
  • the readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or device, or any combination thereof. More specific examples (non-exhaustive list) of readable storage media include: electrical connection with one or more conductors, portable disk, hard disk, random access memory (RAM), read only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
  • a computer readable signal medium may include a data signal carrying readable program code in baseband or as part of a carrier wave. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing.
  • a readable signal medium may also be any readable medium other than a readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device.
  • Program code embodied on a readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
  • Program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages—such as Java, C++, etc., as well as conventional procedural programming Language - such as "C" or similar programming language.
  • the program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device and partly on a remote computing device, or entirely on the remote computing device or server to execute.
  • the remote computing device may be connected to the user computing device through any kind of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., using an Internet service provider). business to connect via the Internet).
  • LAN local area network
  • WAN wide area network
  • Internet service provider e.g., a wide area network

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

一种终端控制方法、装置、介质与电子设备，该方法包括：响应于对第一显示界面的触发操作，确定与触发操作对应的第二显示界面的显示范围(步骤S101)；若显示范围不包含于预设的操作范围内，则显示第二显示界面的缩略界面(步骤S102)；响应于对缩略界面的触发操作，控制缩略界面与第二显示界面显示相同的内容(步骤S103)。本公开提供的终端控制方法，通过对显示屏幕进行触发操作，并将显示屏幕对应的显示界面的范围与预先设置的操作范围进行比较，将显示界面的缩略界面显示在控件触发点的周围便于操作的区域，用户可通过操作缩略界面实现对显示界面的操作，缩小了用户的操作范围，实现了近距离操作，使得用户对界面的操作更加便捷。

Description

终端控制方法、装置、介质与电子设备 技术领域
本公开涉及智能控制技术领域，具体而言，涉及一种终端控制方法、装置、介质与电子设备。
背景技术
智能控制具有智能信息处理、智能信息反馈和智能控制决策的控制方式，是控制理论发展的高级阶段，主要用于解决那些用传统方法难以解决的复杂系统的控制问题，大多数的智慧终端设备采用智慧控制技术实现设备的控制。
具有触摸功能的智慧终端设备，尤其是大尺寸智慧终端设备，用户在使用触摸功能时，会在显示屏幕上弹出操作页面，在大尺寸屏幕上，弹出的操作页面往往不在用户方便操作的范围内，用户需要进行较远距离的移动才能进行操作页面的相关操作，通过应用开发人员开发的可以在指定区域显示操作页面的方法，但往往是专门针对每一个应用设计的指定区域显示页面，在应用进行切换时，现有的指定区域便会失效，通用性差。
需要说明的是，在上述背景技术部分公开的信息仅用于加强对本公开的背景的理解，因此可以包括不构成对本领域普通技术人员已知的现有技术的信息。
发明内容
本公开提供一种终端控制方法、装置、介质与电子设备。
根据本公开的一个方面，提供了一种终端控制方法，该方法包括：
响应于对第一显示界面的触发操作，确定与所述触发操作对应的第二显示界面的显示范围；
若所述显示范围不包含于预设的操作范围内，则显示所述第二显示界面的缩略界面；
响应于对所述缩略界面的触发操作，控制所述缩略界面与所述第二 显示界面显示相同的内容。
根据本公开的另一个方面，提供了一种终端控制装置，该装置包括：
参数获取模块，用于获取触发操作对应的显示界面的显示范围、预设的操作范围；
逻辑计算模块，用于根据所述显示范围和所述预设的操作范围确定所述显示界面的缩略界面；
图形生成模块，用于根据所述显示范围和所述预设的操作范围生成所述缩略界面，并根据所述缩略界面生成显示界面；
结果输出模块，用于输出所述缩略界面和所述显示界面。
根据本公开的另一个方面，提供了一种电子设备，该电子设备包括：处理器和存储器，所述存储器中存储有至少一条指令，所述至少一条指令由所述处理器加载并执行，以实现如上述任一项所述的方法。
根据本公开的另一个方面，提供了一种计算机可读存储介质，所述计算机可读存储介质中存储至少一条指令，所述至少一条指令由处理器加载并执行，以实现上述任一项所述的方法。
应当理解的是，以上的一般描述和后文的细节描述仅是示例性和解释性的，并不能限制本公开。
附图说明
此处的附图被并入说明书中并构成本说明书的一部分，示出了符合本公开的实施例，并与说明书一起用于解释本公开的原理。显而易见地，下面描述中的附图仅仅是本公开的一些实施例，对于本领域普通技术人员来讲，在不付出创造性劳动的前提下，还可以根据这些附图获得其他的附图。
图1为本公开示例性实施例中的一种终端控制方法的流程示意图。
图2为本公开示例性实施例中的一种终端控制方法的具体操作流程图。
图3为本公开示例性实施例中的一种终端控制方法的屏幕界面显示简图。
图4为本公开示例性实施例中的一种终端控制方法的区域位置坐标 图。
图5为本公开示例性实施例中的一种缩略界面与屏幕显示界面坐标转换的流程示意图。
图6为本公开示例性实施例中的一种手势控制方法的移动轨迹简图。
图7为本公开示例性实施例中的一种悬浮按钮控制方法的操作过程简图。
图8为本公开示例性实施例中的一种终端控制装置的结构框图。
图9为本公开示例性实施例中的一种电子设备的结构示意图。
具体实施方式
现在将参考附图更全面地描述示例实施方式。然而，示例实施方式能够以多种形式实施，且不应被理解为限于在此阐述的实施方式；相反，提供这些实施方式使得本公开将全面和完整，并将示例实施方式的构思全面地传达给本领域的技术人员。图中相同的附图标记表示相同或类似的结构，因而将省略它们的详细描述。此外，附图仅为本公开的示意性图解，并非一定是按比例绘制。
在现有的大尺寸屏幕智能操作终端设备上，尤其是会议一体机，当用户使用这些具有触摸功能的终端设备时，在用户触摸操作控件后，在屏幕上会弹出相应界面，例如，用户在触摸屏幕后，会弹出诸如输入法弹框、菜单页面等需要用户大范围操作的界面，若对诸如上述的大尺寸界面不进行处理的话，用户需要触摸离自身较远位置的屏幕区域才能进行下一步操作；若使得诸如上述的大尺寸界面经过处理后只是在屏幕指定的区域范围内显示，这种处理方法是需要应用开发人员进行界面显示的专门定制开发，一旦切换为不同的应用，这种显示区域的限制就会失效，并没有做到所有应用通用的效果。
用户操作大屏幕终端设备的另一种方法是使用移动设备进行终端设备的控制，通过移动设备在终端设备上的投屏操作，利用移动设备上的操作对大屏幕终端设备的平面显示进行控制，这样的操作方法需要增加额外的移动设备，并且此移动设备还需要具有与终端设备相匹配的操作系统，此种方法的成本较高。
因此，本公开提供了一种终端控制方法，提供了操作小窗口，可以解决用户操作大屏幕终端设备不方便的问题，提供了对用户友好的操作环境，并且做到了节约成本，实现“一劳永逸”的目的。
本公开实施方式提供了一种终端控制方法，图1为本公开示例性实施例中的一种终端控制方法的流程示意图，如图1所示，该终端控制方法包括：
S101：响应于对第一显示界面的触发操作，确定与所述触发操作对应的第二显示界面的显示范围；
S102：若所述显示范围不包含于预设的操作范围内，则显示所述第二显示界面的缩略界面；
S103：响应于对所述缩略界面的触发操作，控制所述缩略界面与所述第二显示界面显示相同的内容。
其中，在步骤101中，响应于对第一显示界面的触发操作，确定与所述触发操作对应的第二显示界面的显示范围，所述第一显示界面为显示屏幕，所述第二显示界面为在显示屏幕上进行触发操作以后在显示屏幕上弹出的与触发操作对应的显示界面。
本公开是应用于大屏幕智能终端操作设备的触摸屏幕，例如，会议一体机，大屏幕智能手机等智能终端设备，用户可以对终端设备的平面进行触摸操作，触摸点可以是屏幕上任一用户需要触发的触摸点，在智能终端的屏幕上会显示出与用户触发点相对应的显示界面，显示界面的显示内容为用户启动的触发点所要进行的下一步操作内容，在显示界面显示在屏幕上后，设备会判断显示界面在屏幕上的显示范围，例如，以屏幕的左上角的点为坐标原点，设备会根据显示界面的长度、宽度以及显示界面的端点，给出显示界面相对于屏幕的位置坐标。
在设备进行相关的操作之前，设备在系统层面上需增加手势算法及自定义算法：手势算法上，设置手势动作并将设备的手势动作保存在系统中，同时在系统中设置手势动作开关；在自定义算法上，设置显示界面相对应的缩略界面的大小，并在系统中设置缩略界面显示开关，以及设置用户在屏幕上的方便操作区域范围(方便操作区域范围为用户的肢体在屏幕上便于触及的区域，即预设的操作范围)，其中，预设的操作范 围是根据用户在显示屏幕上触发操作的操作范围进行设置的，触发操作的操作范围包括在预设的操作范围内。
在一些实施例中，缩略界面的长、宽可按照用户的实际使用习惯确定，也可按照设备屏幕分辨率等比缩放；方便操作区域范围的长、宽可按照用户的实际使用习惯确定，也可按照设备屏幕分辩率等比缩放，本公开对缩略界面的大小和方便操作区域范围的大小的设置方法不做具体限定。
此外，用户可以根据自身的使用习惯，可以将缩略界面显示开关和手势动作开关进行设置，例如，用户需要进行缩略界面显示时，可以将缩略界面显示开关开启，用户需要对设备进行手势控制时，可以将手势动作开关开启。其中，缩略界面显示开关和手势动作开关也可以集成在一个开关中，这样方便用户可以通过一个开关开启和关闭两个功能，但本公开的开关形式不限于上述形式，可以根据实际需要进行设置。
在步骤S101之前，需要对设备的显示界面进行判断：当用户对控件进行触发操作后，每个触发操作都会有相对应显示结果界面(控件对应的显示界面)，若显示结果界面在显示屏幕(预设的显示界面)上弹出并显示，则设备可进行下一步的操作；若显示界面没有弹出并显示在显示屏幕上，则设备结束操作。
其中，在步骤S102中，若所述显示范围不包含于预设的操作范围内，则显示所述第二显示界面的缩略界面。
所述缩略界面的显示范围包含在所述预设的操作范围内，即缩略界面的显示范围在屏幕上的方便操作区域范围内，在用户在设备上进行触发操作时，触发点显示对应的显示界面，此显示界面包括触发点对应的下一步操作界面，在步骤S101中，给出了显示界面的坐标以及显示范围，判断此显示界面是否在方便操作区域范围内，若显示界面在方便操作区域范围内，显示界面则直接显示在屏幕上，用户可以直接对显示界面进行下一步操作；若显示界面超出方便操作区域范围内，则在方便操作区域范围内显示与显示界面具有相同操作内容的缩略界面，用户可以在缩略界面上完成与显示界面相同的操作。
其中，在步骤S103中，响应于对所述缩略界面的触发操作，控制所 述缩略界面与所述第二显示界面显示相同的内容。
在上述步骤S101和步骤S102后，设备会检测触发点所位于屏幕的位置，在屏幕上会同时显示出显示界面和显示界面的缩略界面，缩略界面位于用户方便操作区域范围内，用户可以在缩略界面上进行下一步的操作，同时缩略界面会显示与下一步操作对应的界面，与此同时，在屏幕上的显示界面会随同缩略界面的操作进行相同的变化，与缩略界面显示相同的内容，完成了缩略界面和显示界面的同步变化。
在完成上述操作后，用户可以根据是否进行后续操作进行缩略界面的设置，若用户完成操作后，下一步无需缩略界面，则可以通过缩略界面显示开关关闭缩略界面，进而完成操作。
下面结合图2和图3对本公开的终端控制方法的具体步骤进行说明：
图2为本公开示例性实施例中的一种终端控制方法的具体操作流程图，在图2中，阴影部A去为当前设备的操作区域，即控件的首次触发点，阴影部B区为显示在屏幕上的显示界面区，虚线框内的区域C区为方便用户的操作区域，D区为缩略界面区域，从图中可以看出，当手形触发点在屏幕上进行触发时，使得阴影部A区操作的内容显示在屏幕上，得到阴影部B区，B区不包含在虚线框内的区域C内，此时，屏幕上会显示出与阴影部B区具有相同内容的D区，并且D区在虚线框区域C区内，用户可以在D区上进行下一步操作，D区操作范围为用户方便操作范围区域，用户可以实现在屏幕上的近距离操作。
图3为本公开示例性实施例中的一种终端控制方法的屏幕界面显示简图，结合图2的显示区域图，用户进行屏幕操作前，设备在系统内设备手势动作及手势动作开关并保存，设置缩略界面大小和缩略界面开关，设置方便用户操作区域大小；设备设置好上述三项参数后，判断缩略界面开关和手势动作开关是否打开；若为是，则用户可进行在屏幕上进行触发操作，进行设备的相关操作；设备判断用户操作动作后的显示界面是否在屏幕上弹出；若为是，设备则判断显示界面是否在方便操作区域范围内；若为否，则设备检测屏幕上触发点所在的位置，并根据触发点所在的位置弹出显示界面的缩略界面；在缩略界面上同时显示出先阶段操作的显示界面的内容；判断缩略界面是否需要与手势动作进行随动； 若为否，则用户可以在缩略界面进行下一步操作，并在屏幕的显示界面上显示与缩略界面操作后的相同内容，完成操作后，用户可根据需要选择退出缩略界面，结束操作；若缩略界面需要与手势动作进行随动，用户可根据上述设置的手势动作给出控制缩略界面随动的手势，设备检测手势移动的轨迹与缩略界面的移动轨迹是否相同，若为相同，则用户在触发手势结束控制的操作时，缩略界面停止与手势动作的随动，并且用户可在缩略界面进行下一步操作。
其中，缩略界面与屏幕显示界面之间的位置关系及缩略界面的控制过程如下：
如图4和图5所示，结合图4和图5，确定方便操作区域的取值范围：以屏幕的左上角的点作为坐标原点，坐标原点向左的方向为X轴正向，坐标原点向下的方向为Y轴正向，获取屏幕上当前的触摸点的位置坐标为(x，y)，用户根据需要设置方便操作区域的长和宽分别为2x0、2y0，从而获取方便操作区域的取值范围为[x-x 0,x+x 0],[y-y 0,y+y 0]；若x-x 0的值超出屏幕显示界面的坐标范围，即当(x-x 0)<0时，则方便操作区域的x轴坐标的取值将变为[0,2x 0]；若(x+x 0)>W(其中，W为屏幕宽度)时，则操作区x轴坐标的取值将变为[W-2x 0,W]。方便操作区域Y方向的取值范围与上述X方向的取值范围的确定方法相同，此处不再赘述。
确定缩略界面的相对位置坐标：高度为h、宽度为w的缩略界面在方便操作区域的运动轨迹如图4所示，可以根据具体的智慧终端屏幕的大小尺寸或设计要求对上述运动轨迹加以限定，例如，可以设置横向或竖向基准线，当超过横向基准线时，缩略界面需要在右侧显示区显示，当超过竖向基准线是，缩略界面需要在下端显示区显示。其中，缩略界面在方便操作区域内按顺时针方向的四个顶点的可取坐标范围分别为((x-x 0),(y-y 0))、((x-x 0),(y+y 0-h))、((x+x 0-w),(y+y 0-h))、((x+x 0-w),(y-y 0))，因此，缩略界面的坐标(p,q)满足的条件为：
①当(x-x 0)>0且(y-y 0)>0时，
y 0<y<H-y 0
x 0<x<W-x 0
y-y 0≤q≤y+y 0-h p＝(x-x 0,x+x 0-w)
x-x 0≤p≤x+x 0-w q＝(y-y 0，y+y 0-h)
②当(x-x 0)<0且(y-y 0)<0时，
0<y<y 0
0<x<x 0
0≤q≤2y 0-h p＝(0,2x 0-w)
0≤p≤2x 0-w，q＝(0,2y 0-h)
③当(W-x 0)<x<W且(H-y 0)<y<H时，
H-2y 0≤q≤H-h p＝(W-2x 0,W-w)
W-2x 0≤p≤W-w q＝(H-2y 0，H-h)
④当0<x<x 0且(H-y 0)<y<H时，
H-2y 0≤q≤H-h p＝(0,2x 0-w)
0≤p≤2x 0-w q＝(H-2y 0，H-h)
⑤当W-x 0<x<W且0<y<y 0时，
0≤q≤2y 0-h p＝(W-2x 0,W-w)
W-2x 0≤p≤W-w q＝(0，2y 0-h)
其中，W为屏幕宽度，H为屏幕高度。
综上获取缩略界面左上角的位置坐标(p,q)与设备屏幕触发点之间的关系Φ(p,q)＝F(x,y)。当缩略界面弹出后，用户操作缩略界面，获取在缩略界面触发点的绝对坐标(α,β)，并且使得(x,y)＝(α,β)，该坐标与(p,q)的相对坐标为(α-p,β-q)，此时用户实际操作的是设备屏幕上绝对位置为(α-p,β-q)的点，进而控制设备。
通过上述方便操作区域的坐标范围与缩略界面的坐标范围的确定，用户可用户触发设备屏幕的触发点，通过SurfaceFlinger获取屏幕上与当 前操作相关的将要发生变化的位置区域，即显示界面，判断显示界面是否超出用户当前触发点对应的方便操作区域范围，若超出范围，则对framebuffer进行截屏，弹出缩略界面(默认缩略界面控制开关已打开)，并将截屏后的内容显示在缩略界面内，通过上述步骤将缩略界面的操作位置坐标转化为实际屏幕界面的位置坐标，进而对设备进行触摸控制，具体操作步骤如图5所示。
其中，上述的SurfaceFlinger是特定系统的一个服务，是介于应用库和图形库的一层，负责管理应用端的界面，可以将所有的界面进行复合叠加起来并反映到framebuffer上；framebuffer(帧缓冲)是一个视频输出设备从包含完整的帧数据的一个内存缓冲区中来驱动一个视频显示设备。但本公开对获取屏幕上与当前操作的位置区域的获取手段不限于使用SurfaceFlinger，也可以是其它的可具备获取屏幕位置的设备的服务或应用。
本公开提供的终端控制方法，可以在用户方便的操作范围内显示屏幕显示界面的缩略界面，用户可以在缩略界面中进行与显示界面相同的操作，同时显示界面可显示与缩略界面相同的内容，与此同时，缩略界面还可以设置为随着用户手势进行随动，方便用户的操作。
本公开提供的终端控制方法还包括缩略界面的控制方法。
其中，缩略界面控制方法包括手势控制操作包括：响应于手势控制的触发操作，控制所述缩略界面随动于所述手势控制操作的触发点。
响应于所述手势结束控制的触发操作，控制所述缩略界面停止随动于所述手势控制操作的触发点。
当缩略界面控制开关和手势动作控制开关均开启时，缩略界面打开后，用户在屏幕上或屏幕上的进行手势滑动，缩略界面可随着手势的位置变化而改变位置，使得缩略界面在屏幕上的位置与手势所到达的位置相同，如图6所示，在触发点处屏幕弹出缩略界面，且缩略界面在触发点的方便操作区域范围内，随着屏幕上触发点的移动，缩略界面跟随触发点进行移动，直至用户停止手势控制操作。其中，手势控制动作可以是在屏幕上进行触发的触发点，也可以是手势画过屏幕上方而不与屏幕接触的形式。
其中，缩略界面的控制方法还包括悬浮按钮控制操作：响应于所述悬浮按钮控制的触发操作，控制所述缩略界面显示在所述悬浮按钮控住操作的触发点处。
响应于所述悬浮按钮结束控制的触发操作，控制所述缩略界面停止显示在所述悬浮按钮结束控制操作的触发点处。
本公开的上述手势控制操作可以相应的替换为悬浮按钮控制操作，如图7所示，当设备的缩略界面控制开关开启后，用户通过触发屏幕上的触发点，使得缩略窗口弹出，此时无需手势控制开关的开启，通过拖动屏幕上的悬浮按钮E，即可将缩略界面拖到悬浮按钮E所对应的位置上，其中，在缩略界面移动的过程中，缩略界面是不显示在屏幕上的，若需要再次缩略界面，可以通过特定的触发动作触发缩略界面在该位置上的重新显示，例如，可以在该点上长按或按照指定形状滑动或按照指定方向进行滑动等方式。
与手势控制不同的是，悬浮按钮控制在屏幕上显示的是缩略屏幕的起始位置和终止位置的缩略界面，并不显示缩略界面的运动过程，而手势控制则是在屏幕上显示缩略界面的运动轨迹及起始位置和终止位置。
除上述两中控制缩略界面位置的方法外，设备还可以通过人脸识别方式进行缩略界面的控制，本公开包括但不限于上述的缩略界面控制方法。
本公开提供的终端控制方法，还包括缩略界面的控制方法，通过对缩略界面的位置上的控制，可以使用户在使用终端设备的过程中，根据自身的使用需要和习惯，使显示界面的缩略界面可以随着用户的位置发生随动，方便用户操作设备。
需要说明的是，尽管在附图中以特定顺序描述了本公开中终端控制方法的各个步骤，但是，这并非要求或者暗示必须按照该特定顺序来执行这些步骤，或是必须执行全部所示的步骤才能实现期望的结果。附加的或备选的，可以省略某些步骤，将多个步骤合并为一个步骤执行，以及/或者将一个步骤分解为多个步骤执行等。
本领域技术人员在考虑说明书及实践这里公开的发明后，将容易想到本公开的其它实施方案。本申请旨在涵盖本公开的任何变型、用途或 者适应性变化，这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的，本公开的真正范围和精神由所附的权利要求指出。
本公开的实施方式中还提供了一种终端控制装置，图8为本公开示例性实施例中的一种终端控制装置的结构框图，如图8所示，该终端控制装置包括：参数获取模块10、逻辑计算模块20、图形生成模块30和结果输出模块40。
其中，参数获取模块10用于获取触发操作对应的显示界面的显示范围、预设的操作范围。
其中，逻辑计算模块20用于根据所述显示范围和所述预设的操作范围确定所述显示界面的缩略界面。
其中，图形生成模块30用于根据所述显示范围和所述预设的操作范围生成所述缩略界面，并根据所述缩略界面生成显示界面。
其中，结果输出模块40用于输出所述缩略界面和所述显示界面。
本公开提供了一种终端控制装置，该装置通过参数获取模块、图形生成模块、逻辑计算模块及结果输出模块四个模块，运用终端控制方法对设备进行控制和相关操作的执行，可以实现屏幕显示界面的缩略界面的显示，用户可以在缩略界面上进行操作，方便了用户对设备的操作。
图9为本公开示例性实施例中的一种电子设备的结构示意图，如图9所示，电子设备1000以通用计算设备的形式表现。电子设备1000的组件可以包括但不限于：至少一个处理单元1010、至少一个存储单元1020、连接不同系统组件(包括存储单元1020和处理单元1010)的总线1030。
其中，存储单元存储有程序代码，程序代码可以被处理单元1010执行，使得处理单元1010执行本说明书上述“示例性方法”部分中描述的根据本发明各种示例性实施方式的步骤。例如，处理单元1010可以执行如图1所示的方法步骤等。
存储单元1020可以包括易失性存储单元，例如随机存取存储单元(RAM)1021和/或高速缓存存储单元1022，还可以进一步包括只读存 储单元(ROM)1023。
存储单元1020还可以包括具有一组(至少一个)程序模块1025的程序/实用工具1024，这样的程序模块1025包括但不限于：操作系统、一个或者多个应用程序、其它程序模块以及程序数据，这些示例中的每一个或某种组合中可能包括网络环境的实现。
总线1030可以包括数据总线、地址总线和控制总线。
电子设备1000也可以与一个或多个外部设备1100(例如键盘、指向设备、蓝牙设备等)通信，这种通信可以通过输入/输出(I/O)接口1040进行。电子设备1000还可以通过网络适配器1050与一个或者多个网络(例如局域网(LAN)，广域网(WAN)和/或公共网络，例如因特网)通信。如图所示，网络适配器1050通过总线1030与电子设备1000的其它模块通信。应当明白，尽管图中未示出，可以结合电子设备1000使用其它硬件和/或软件模块，包括但不限于：微代码、设备驱动器、冗余处理单元、外部磁盘驱动阵列、RAID系统、磁带驱动器以及数据备份存储系统等。
应当注意，尽管在上文详细描述中提及了用于动作执行的设备的若干模块或者单元，但是这种划分并非强制性的。实际上，根据本公开的示例性实施方式，上文描述的两个或更多模块或者单元的特征和功能可以在一个模块或者单元中具体化。反之，上文描述的一个模块或者单元的特征和功能可以进一步划分为由多个模块或者单元来具体化。
所属技术领域的技术人员能够理解，本公开的各个方面可以实现为系统、方法或程序产品。因此，本公开的各个方面可以具体实现为以下形式，即：完全的硬件实施方式、完全的软件实施方式(包括固件、微代码等)，或硬件和软件方面结合的实施方式，这里可以统称为“电路”、“模块”或“系统”。
本公开的示例性实施方式还提供了一种计算机可读存储介质，可以实现为一种程序产品的形式，其包括程序代码，当程序产品在电子设备上运行时，程序代码用于使电子设备执行本说明书上述“示例性方法”部分中描述的根据本公开各种示例性实施方式的步骤。在一种实施方式中，该程序产品可以实现为便携式紧凑盘只读存储器(CD-ROM)并包括程 序代码，并可以在电子设备，例如个人电脑上运行。然而，本公开的程序产品不限于此，在本文件中，可读存储介质可以是任何包含或存储程序的有形介质，该程序可以被指令执行系统、装置或者器件使用或者与其结合使用。
程序产品可以采用一个或多个可读介质的任意组合。可读介质可以是可读信号介质或者可读存储介质。可读存储介质例如可以为但不限于电、磁、光、电磁、红外线、或半导体的系统、装置或器件，或者任意以上的组合。可读存储介质的更具体的例子(非穷举的列表)包括：具有一个或多个导线的电连接、便携式盘、硬盘、随机存取存储器(RAM)、只读存储器(ROM)、可擦式可编程只读存储器(EPROM或闪存)、光纤、便携式紧凑盘只读存储器(CD-ROM)、光存储器件、磁存储器件、或者上述的任意合适的组合。
计算机可读信号介质可以包括在基带中或者作为载波一部分传播的数据信号，其中承载了可读程序代码。这种传播的数据信号可以采用多种形式，包括但不限于电磁信号、光信号或上述的任意合适的组合。可读信号介质还可以是可读存储介质以外的任何可读介质，该可读介质可以发送、传播或者传输用于由指令执行系统、装置或者器件使用或者与其结合使用的程序。
可读介质上包含的程序代码可以用任何适当的介质传输，包括但不限于无线、有线、光缆、RF等等，或者上述的任意合适的组合。
可以以一种或多种程序设计语言的任意组合来编写用于执行本公开操作的程序代码，程序设计语言包括面向对象的程序设计语言—诸如Java、C++等，还包括常规的过程式程序设计语言—诸如“C”语言或类似的程序设计语言。程序代码可以完全地在用户计算设备上执行、部分地在用户设备上执行、作为一个独立的软件包执行、部分在用户计算设备上部分在远程计算设备上执行、或者完全在远程计算设备或服务器上执行。在涉及远程计算设备的情形中，远程计算设备可以通过任意种类的网络，包括局域网(LAN)或广域网(WAN)，连接到用户计算设备，或者，可以连接到外部计算设备(例如利用因特网服务提供商来通过因特网连接)。
本领域技术人员在考虑说明书及实践这里公开的发明后，将容易想到本公开的其它实施方案。本申请旨在涵盖本公开的任何变型、用途或者适应性变化，这些变型、用途或者适应性变化遵循本公开的一般性原理并包括本公开未公开的本技术领域中的公知常识或惯用技术手段。说明书和实施例仅被视为示例性的，本公开的真正范围和精神由所附的权利要求指出。

Claims (12)

  1. 一种终端控制方法，其中，包括：
    响应于对第一显示界面的触发操作，确定与所述触发操作对应的第二显示界面的显示范围；
    若所述显示范围不包含于预设的操作范围内，则显示所述第二显示界面的缩略界面；
    响应于对所述缩略界面的触发操作，控制所述缩略界面与所述第二显示界面显示相同的内容。
  2. 根据权利要求1所述的终端控制方法，其中，所述方法还包括：
    若所述显示范围包含于所述预设的操作范围内，则显示所述第二显示界面。
  3. 根据权利要求1所述的终端控制方法，其中，所述方法还包括：
    根据所述触发操作的操作范围确定所述预设的操作范围，所述预设的操作范围包括所述触发操作的操作范围。
  4. 根据权利要求1所述的终端控制方法，其中，所述方法还包括：
    检测手势动作，响应于手势动作控制的触发操作，控制所述缩略界面随动于所述手势动作控制操作的触发点。
  5. 根据权利要求4所述的终端控制方法，其中，所述方法还包括：
    检测手势结束动作，响应于所述手势结束动作控制的触发操作，控制所述缩略界面停止随动于所述手势动作控制操作的触发点。
  6. 根据权利要求1所述的终端控制方法，其中，所述方法还包括：
    检测悬浮按钮触发动作，响应于所述悬浮按钮控制的触发操作，控制所述缩略界面显示在所述悬浮按钮控制操作的触发点处。
  7. 根据权利要求6所述的终端控制方法，其中，所述方法还包括：
    检测悬浮按钮结束触发动作，响应于所述悬浮按钮结束控制的触发操作，控制所述缩略界面停止显示在所述悬浮按钮结束控制操作的触发点处。
  8. 根据权利要求1所述的终端控制方法，其中，在响应于对第一显示界面的触发操作之后，所述方法还包括：
    若显示与所述触发操作对应的第二显示界面，则确定与所述触发操 作对应的第二显示界面的显示范围。
  9. 根据权利要求1所述的终端控制方法，其中，在响应于对第一显示界面的触发操作之后，所述方法还包括：
    若不显示与所述触发操作对应的第二显示界面，则终止终端控制方法。
  10. 一种终端控制装置，其中，包括：
    参数获取模块，用于获取触发操作对应的显示界面的显示范围、预设的操作范围；
    逻辑计算模块，用于根据所述显示范围和所述预设的操作范围确定所述显示界面的缩略界面；
    图形生成模块，用于根据所述显示范围和所述预设的操作范围生成所述缩略界面，并根据所述缩略界面生成显示界面；
    结果输出模块，用于输出所述缩略界面和所述显示界面。
  11. 一种电子设备，其中，所述电子设备包括处理器和存储器，所述存储器中存储有至少一条指令，所述至少一条指令由所述处理器加载并执行，以实现如权利要求1至9任一项所述的方法。
  12. 一种计算机可读存储介质，其中，所述计算机可读存储介质中存储至少一条指令，所述至少一条指令由处理器加载并执行，以实现如权利要求1至9任一项所述的方法。
PCT/CN2021/127107 2021-10-28 2021-10-28 终端控制方法、装置、介质与电子设备 WO2023070454A1 (zh)

Priority Applications (2)

Application Number Priority Date Filing Date Title
PCT/CN2021/127107 WO2023070454A1 (zh) 2021-10-28 2021-10-28 终端控制方法、装置、介质与电子设备
CN202180003133.2A CN116368455A (zh) 2021-10-28 2021-10-28 终端控制方法、装置、介质与电子设备

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2021/127107 WO2023070454A1 (zh) 2021-10-28 2021-10-28 终端控制方法、装置、介质与电子设备

Publications (1)

Publication Number Publication Date
WO2023070454A1 true WO2023070454A1 (zh) 2023-05-04

Family

ID=86160383

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/127107 WO2023070454A1 (zh) 2021-10-28 2021-10-28 终端控制方法、装置、介质与电子设备

Country Status (2)

Country Link
CN (1) CN116368455A (zh)
WO (1) WO2023070454A1 (zh)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104166553A (zh) * 2014-08-18 2014-11-26 联想(北京)有限公司 一种显示方法及电子设备
US20150067589A1 (en) * 2013-08-28 2015-03-05 Lenovo (Beijing) Co., Ltd. Operation Processing Method And Operation Processing Device
CN106227461A (zh) * 2016-09-06 2016-12-14 广东欧珀移动通信有限公司 一种窗口切换方法及装置

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150067589A1 (en) * 2013-08-28 2015-03-05 Lenovo (Beijing) Co., Ltd. Operation Processing Method And Operation Processing Device
CN104166553A (zh) * 2014-08-18 2014-11-26 联想(北京)有限公司 一种显示方法及电子设备
CN106227461A (zh) * 2016-09-06 2016-12-14 广东欧珀移动通信有限公司 一种窗口切换方法及装置

Also Published As

Publication number Publication date
CN116368455A (zh) 2023-06-30

Similar Documents

Publication Publication Date Title
WO2020238815A1 (zh) 显示控制方法及装置、电子设备和存储介质
US8276085B2 (en) Image navigation for touchscreen user interface
JP2022031339A (ja) 表示方法およびデバイス
US8937590B2 (en) Information processing apparatus and pointing control method
KR102059648B1 (ko) 디스플레이 장치 및 그 제어 방법
WO2022111239A1 (zh) 投屏控制方法、设备及电子设备
TW201421350A (zh) 於外部顯示裝置上顯示觸控裝置之畫面的方法
US9880642B2 (en) Mouse function provision method and terminal implementing the same
CN110347317B (zh) 一种窗口切换方法、装置、存储介质及交互智能平板
WO2015161653A1 (zh) 一种终端操作方法及终端设备
KR20140019088A (ko) 디스플레이 장치 및 그 제어 방법
KR20150055292A (ko) 터치스크린을 가지는 전자 장치 및 이의 입력 처리 방법
CN102081500A (zh) 一种显示控制方法及装置和系统
US20230004281A1 (en) Intelligent interaction method and device, and storage medium
WO2023155877A1 (zh) 应用图标管理方法、装置和电子设备
WO2022179409A1 (zh) 控件显示方法、装置、设备及介质
EP4206889A1 (en) Electronic device control method and apparatus, and terminal and storage medium
WO2019185007A1 (zh) 一种窗口控制栏的布局方法、装置及设备
US20110191713A1 (en) Information processing apparatus and image display method
JP2013097535A (ja) 電子機器および表示制御方法
CN114157889B (zh) 一种显示设备及触控协助交互方法
WO2023070454A1 (zh) 终端控制方法、装置、介质与电子设备
JP2004005582A (ja) 通信制御システムと画像転送プログラムを格納した記憶媒体
CN109901760B (zh) 一种对象控制方法及终端设备
KR101381878B1 (ko) 마우스를 이용하여 터치 입력을 구현하기 위한 방법, 장치, 및 컴퓨터 판독 가능한 기록 매체

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21961820

Country of ref document: EP

Kind code of ref document: A1