WO2025218352A1 - 显示设备和角的绘制方法 - Google Patents
显示设备和角的绘制方法Info
- Publication number
- WO2025218352A1 WO2025218352A1 PCT/CN2025/078945 CN2025078945W WO2025218352A1 WO 2025218352 A1 WO2025218352 A1 WO 2025218352A1 CN 2025078945 W CN2025078945 W CN 2025078945W WO 2025218352 A1 WO2025218352 A1 WO 2025218352A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- angle
- display device
- touch
- display
- line
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04847—Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Definitions
- the present disclosure relates to the technical field of display devices, and in particular to a display device and a method for drawing corners.
- a display device refers to a terminal device that can output specific display images.
- a display device can realize two-way human-computer interaction functions, integrating multiple functions such as audio and video, entertainment, and data to meet the diverse and personalized needs of users.
- touch-enabled display devices can run whiteboard applications and implement writing or drawing functions based on the touch areas. Users can perform various drawing operations within the touch areas, such as drawing lines, angles, and patterns.
- the whiteboard application can respond to user operations in real time, such as displaying a track line indicating the user's touch location.
- an embodiment of the present disclosure provides a display device, which may include: a display, which may be configured to display a user interface; the display is connected to a touch component, and the touch component can be used to collect a touch trajectory input by a user; at least one processor, connected to the display, and can be configured to execute computer instructions to cause the display device to execute: in response to an instruction indicating a drawing angle, controlling the display to display an angle drawing control; the angle drawing control includes an angle indicator line; in response to an instruction indicating a movement of the angle indicator line, moving the angle indicator line and obtaining a first direction of the angle indicator line after the movement; obtaining a first touch trajectory collected by the touch component, and determining a second direction of the first touch trajectory; calculating a first direction difference between the first direction and the second direction; if the first direction difference is less than or equal to a direction difference threshold, obtaining a target endpoint on the angle indicator line according to the first touch trajectory; drawing the side of the angle with the base point of the angle indicator line
- an embodiment of the present disclosure provides a method for drawing an angle, which may include: in response to an instruction indicating drawing an angle, controlling a display to display an angle drawing control; the angle drawing control includes an angle indicator line; in response to an instruction indicating moving the angle indicator line, moving the angle indicator line and obtaining a first direction of the angle indicator line after moving; obtaining a first touch trajectory captured by a touch component, and determining a second direction of the first touch trajectory; calculating a first direction difference between the first direction and the second direction; if the first direction difference is less than or equal to a direction difference threshold, obtaining a target endpoint on the angle indicator line according to the first touch trajectory; drawing the side of the angle with the base point of the angle indicator line as the vertex of the angle and the target endpoint as the endpoint of the side.
- FIG1 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments
- FIG2 is a block diagram of a hardware configuration of a display device according to some embodiments.
- FIG3 is a block diagram of a hardware configuration of a control device according to some embodiments.
- FIG4 is a diagram illustrating software configuration in a display device according to some embodiments.
- FIG5 is a schematic diagram of an application panel according to some embodiments.
- FIG6 is a schematic diagram of a touch track according to some embodiments.
- FIG7 is a schematic diagram of a whiteboard interface according to some embodiments.
- FIG8 is a schematic diagram of components of a drawing screen according to some embodiments.
- FIG9 is a schematic diagram of an acceleration layer according to some embodiments.
- FIG10 is a schematic diagram of a teaching tool according to some embodiments.
- FIG11 is a flowchart illustrating the interaction between components of a display device according to some embodiments.
- FIG12 is a schematic diagram of an option list of an auxiliary tool according to some embodiments.
- FIG13 is a schematic diagram of an angle drawing control according to some embodiments.
- FIG14 is a schematic diagram of a moving angle indicator line according to some embodiments.
- FIG15 is a schematic diagram of an angle drawing control according to some embodiments.
- FIG16 is a schematic diagram of drawing edges according to some embodiments.
- Figure 1 is a schematic diagram of an operation scenario between a display device and a control device according to some embodiments.
- a user can operate a display device 200 through a mobile terminal 300 and a control device 100.
- the control device 100 can be a remote control, a stylus, a handle, etc.
- the display device 200 generally refers to a device capable of displaying images and processing data.
- the display device 200 includes but is not limited to smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.
- the mobile terminal 300 can function as a control device for performing human-computer interaction between a user and the display device 200.
- the mobile terminal 300 can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data.
- the mobile terminal 300 can install software applications with the display device 200, enabling connection and communication via a network communication protocol, enabling one-to-one control operations and data communication. Audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 for synchronized display.
- the display device 200 also communicates data with the server 400 via various communication methods.
- the display device 200 may be connected to the server 400 via a local area network (LAN), a wireless local area network (WLAN), or other networks.
- LAN local area network
- WLAN wireless local area network
- the display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart TV, Internet Protocol television (IPTV), etc.
- IPTV Internet Protocol television
- FIG. 2 is a hardware configuration block diagram of the display device 200 shown in Figure 1.
- the display device 200 may include at least one of a tuner and demodulator 210, a communication device 220, a detector 230, a device interface 240, a processor 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.
- detector 230 is used to collect signals from the external environment or external interactions.
- detector 230 may include a light receiver, such as a sensor for collecting ambient light intensity; or an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or a sound collector, such as a microphone, for receiving external sounds.
- the display 260 includes a display component for presenting images and a driver component for driving image display.
- the display 260 is configured to receive image signals output from the processor 250 for display.
- the display 260 can be configured to display video content, image content, menu control interface components, and user control UI interfaces.
- the display device 200 may also support touch interaction, i.e., a touch component may be provided on the display device 200, which may be a built-in module or an external module.
- a touch component may be provided on the display device 200, which may be a built-in module or an external module.
- the display 260 of the display device 200 may be provided with a touch panel (TP).
- the touch panel can receive touch signals input by a finger, a contact, a stylus, etc., and execute touch interaction responses according to a pre-defined interaction strategy.
- the display device 200 may also be an integrated touch screen.
- a display device 200 with an external touch component it can connect to a terminal, device, or component with touch functionality via the device interface 240 of the display device 200.
- the USB or USB-C interface of the display device 200 can be connected to a touchpad.
- the touchpad can receive real-time touch data input by the user and transmit the touch data to the display device 200 via the USB channel.
- the display device 200 can then perform interactive responses based on the received touch data in conjunction with a touch application, enabling the display device 200 to support touch interaction operations.
- the communication device 220 is a component used to communicate with an external device or server 400 according to various communication protocol types.
- the display device 200 can be provided with multiple communication devices 220 depending on the supported communication methods. For example, if the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including WiFi functionality. If the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including Bluetooth functionality.
- the communication device 220 can establish a communication connection between the display device 200 and an external device or server 400 via a wireless or wired connection.
- a wired connection can connect the display device 200 to an external device via a data cable, an interface, or other components.
- a wireless connection can connect the display device 200 to an external device via a wireless signal or wireless network.
- the display device 200 can establish a connection with an external device directly or indirectly through a gateway, router, or connection device.
- the processor 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and may include first to nth interfaces for input/output.
- the processor 250 may control the operation of the display device and respond to user operations through various software control programs stored in a memory.
- the processor 250 controls the overall operation of the display device 200.
- the processor 250 and the tuner/demodulator 210 may be located in different separate devices, that is, the tuner/demodulator 210 may also be located in an external device of the main device where the processor 250 is located, such as an external set-top box.
- a user may input user commands through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input commands through the graphical user interface (GUI).
- GUI graphical user interface
- the audio output device 270 may be a local speaker of the display device 200, or an external audio output device connected to the display device 200.
- the display device 200 may further be provided with an external audio output terminal, through which the audio output device may be connected to the display device 200 to output the sound of the display device 200.
- the user input interface 280 may be configured to receive instructions from a user.
- FIG 3 is a block diagram of the hardware configuration of the control device in Figure 1 according to some embodiments.
- the control device 100 may include: a processor 110, a communication interface 130, a user input/output interface, a memory, and a power supply.
- the control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200 .
- the display device 200 may run an operating system.
- the operating system is a computer program used to manage and control the hardware and software resources of the display device 200.
- the operating system can control the display device to provide a user interface.
- the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application program.
- the operating system also allows the user to interact with the display device 200.
- the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.
- the operating system can be divided into different modules or levels according to the functions implemented.
- the system is divided into four layers, from top to bottom, namely the application layer (referred to as the "application layer”), the application framework layer (referred to as the "framework layer”), the system library layer and the kernel layer.
- the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications.
- the application layer can host at least one application, which can include built-in window programs, system settings programs, clock programs, and the like, or applications developed by third-party developers.
- the application packages in the application layer are not limited to the examples above.
- the framework layer provides applications with an application programming interface (API) and programming framework.
- the application framework layer includes predefined functions.
- the application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.
- the system runtime layer can provide support for the framework layer.
- the operating system will run the instruction library contained in the system runtime layer, such as the C/C++ instruction library, to implement the functions to be implemented by the framework layer.
- the kernel layer is a functional layer between the hardware and software of the display device 200.
- the kernel layer can implement functions such as hardware abstraction, multitasking, and memory management.
- the kernel layer can be configured with hardware drivers, and the drivers included in the kernel layer can be at least one of the following drivers: an audio driver, a display driver, a Bluetooth driver, a camera driver, a WIFI driver, a USB driver, an HDMI driver, a sensor driver (such as a fingerprint sensor, a temperature sensor, a pressure sensor, etc.), and a power driver.
- the display device 200 can have multiple functions, such as browsing the web, playing media, playing games, and screen projection, thereby providing users with a variety of services.
- the user can control the display device 200 to start a related application to enable the corresponding function.
- the processor 250 can control the display 260 to display a user interface.
- the user interface can include specific target images, such as various media resources obtained from a network signal source, including videos, pictures, and other content.
- the user interface can also be some UI interface of the display device, such as the system home screen, various settings screens, and various control screens of application programs.
- the user interface may include an application panel, such as a "My Applications" control.
- an application panel such as a "My Applications" control.
- My Applications Through the application panel, users can view the applications installed on the display device 200, that is, the functions supported by the display device 200.
- the applications installed on the display device 200 can be system applications or third-party applications.
- the user By launching an application, the user controls the display device 200 to implement the corresponding functions of the application.
- the user can control the display device 200 to call out the application panel to view the applications installed on the display device.
- Figure 5 is a schematic diagram of the application panel according to some embodiments. As shown in Figure 5, the application panel includes three controls: "Browser", “Online Media” and “Fitness Training”.
- the user can control the display device 200 to open the browser application by clicking the "Browser” control to browse various web pages, etc.
- the user can click the "Online Media” control to use the display device 200 to view various online media.
- the user can click the "Electronic Whiteboard” control, and the display device 200 can start the electronic whiteboard application.
- the user can use the electronic whiteboard application to draw various contents, such as various lines, angles, patterns, etc.
- the user can control the display device through touch interaction, for example, to perform various drawing operations.
- the display device 200 can collect the touch track input by the user through the touch component.
- the touch component can detect relevant parameters in the touch trajectory. For example, if the display 260 of the display device 200 has a capacitive touch layer, when a user's finger touches any position on the touch layer, the capacitance of the touch layer at the touched position will change. At this time, the touch component can record the location of the capacitance change and, in conjunction with a timer in the processor, record the time when the capacitance change occurs to generate touch interaction data.
- the physical signal detected by the touch component needs to be converted before it can be read by the processor 250 of the display device 200.
- an analog signal of capacitance change needs to be converted into a digital signal and then transmitted to the processor 250 of the display device 200.
- the touch data detected by the touch component also needs to be coordinate mapped so that the location corresponding to the touch data can correspond to the pixel point in the display 260 of the display device 200 or the user interface.
- the touch point position in the width and height directions can be mapped according to the ratio of 65536/3840 and 65536/2160, so that the display device 200 can perform relevant operation responses based on the mapped touch point position coordinates.
- the touch data may include different operation parameters according to the user's input method.
- Figure 6 is a schematic diagram of a touch trajectory according to some embodiments.
- the touch data may include the touch time, touch position, touch event type, number of touch points, etc. of the user's touch operation.
- the touch event types that can be detected by the touch component include: a drop (down) event, a move (move) event, and a lift (up) event of the touch operation.
- a starting point, a trajectory point, and an end point can be formed.
- Each touch event records the corresponding touch time and touch position.
- the display device 200 can classify different touch times, touch positions, number of touch points and touch event types, so as to detect the user's touch input gesture, thereby performing different interactive responses for different input gestures. For example, when the number of touch points in the touch data detected by the touch component is 1, the touch event type only includes a down event and an up event, and the time interval between the down event and the up event is less than the single-click event time threshold, and the touch position change distance of the down event and the up event is less than the jitter distance threshold, it can be determined that the current user's touch input gesture is a click gesture. Based on the click gesture, the display device 200 executes the operation of starting the application according to the icon in the area where the touch position corresponding to the click gesture is located.
- the display device 200 can also detect other touch interaction gestures input by the user based on the touch duration, touch location, number of touch points, and touch event type, such as a double-click gesture, a slide gesture, a long press gesture, a multi-finger click gesture, and a multi-finger slide gesture.
- touch interaction gestures can derive different touch parameters.
- a slide gesture can also generate parameters such as slide distance, slide speed, slide direction, and slide trajectory shape. Different touch parameters can be used to perform different interactive controls.
- the display device 200 can also perform complex gesture detection based on the dynamic changes in touch time, touch position, number of touch points, and touch event type. For example, when the touch component detects that the touch data input by the user includes multiple touch points, and the touch position of each touch point is close to each other as the user inputs, it can be determined that the touch gesture currently input by the user is a grabbing gesture. Based on complex gesture detection, the display device 200 can perform more interactive responses. For example, when the detected touch gesture is a grabbing operation for an image view, the display device 200 can respond to the grabbing gesture and perform a control action to move the image display position.
- touch gestures can also be combined with touch positions to form touch interaction operations based on specific positions. For example, when the touch component detects that the down event position during the touch operation is at the top of the display 260, the touch point position corresponding to the move event moves downward. When the up event is detected, the display device 200 can determine that the current touch gesture is a swiping down from the top of the screen. Therefore, the display device 200 can control the display 260 to present a drop-down list in response to the touch gesture.
- Some touch interaction gestures can be used to perform interactive actions based on the operating system of the display device 200, and are referred to as global gestures. For example, swiping down from the top of the screen in the example above on the display device 200 to bring up a drop-down list.
- Some touch interaction gestures can be used to perform interactive actions based on specific touch applications. For example, when the display device 200 is running a whiteboard application, a user-inputted slide touch action can be used to draw a track line on the whiteboard.
- the touch application can be a system application or a third-party application developed based on a specific display device type and user needs.
- the above-mentioned whiteboard application can be an independent application, an associated application, or a functional module in a touch application.
- Different forms of whiteboard applications can have different startup methods. For example, a user can start an independent whiteboard application through the application panel of the display device 200; the user can also start the whiteboard application by executing the "whiteboard" operation on the conference application; the user can also control the conference application to start the whiteboard function module by clicking the "whiteboard" icon on the conference application.
- the display device 200 may automatically enter dual-screen (or split-screen) mode.
- dual-screen (or split-screen) mode the display device 200 may display the user interface through two display areas, i.e., the main screen displays the original application (such as a conference application) interface, and the secondary screen displays the whiteboard application interface.
- FIG. 7 is a schematic diagram of a whiteboard interface according to some embodiments.
- the whiteboard interface may include drawing tool controls for drawing operations, such as pen shape, shape, line shape, color, erase, clear screen, and selection controls. Users can click any control to draw graphics according to their specific drawing needs.
- FIG8 is a schematic diagram of components for a drawing screen according to some embodiments.
- display device 200 can render and display a drawing screen in real time through an image producer module, a surface flinger module, a composer module, a video processing unit (VPU) hardware module, and a screen.
- image producer module a surface flinger module
- composer module a video processing unit (VPU) hardware module
- screen a screen
- the graphics interface (OpenGL ES) of the image generation module can be connected to the whiteboard application to generate the drawn image content and pass the image content to the image rendering module.
- the image rendering module is used to control the display content of the display 260, that is, to render the image content through the user interaction layer (UI layer) or the video layer (video layer) according to the image content.
- UI layer user interaction layer
- video layer video layer
- the image content of the UI layer can be rendered by the GPU component, thereby forming a picture frame for display in the synthesis module.
- the synthesis module can form the picture content through software or hardware.
- the synthesis module can be a hardware synthesis (HWC) module.
- the compositing module can store image frames in a frame buffer and a video buffer, respectively.
- the video processing module then creates image content on the corresponding layers. Specifically, image frames generated during video playback are created on the video plane, while image frames of other images (such as touch traces and graphics) are created on the primary OSD plane.
- the display device 200 creates the final image using the blending unit of the video processing module, which is then displayed on the display 260.
- the display device 200 should shorten the touch operation input time and the delay time of the drawing result display.
- the display device 200 can present a real-time drawing effect by setting an acceleration layer. That is, in the video process module of the display device 200, an additional extended display layer (external OSD plane) can be set on the basis of the main OSD (primary OSD plane) layer and the video layer.
- the extended display layer can be configured with different layer characteristics according to the specific display effect requirements.
- the bitmap refresh mode of the extended display layer can be modified so that the extended display layer is refreshed in real time according to the area, thereby improving the display speed of the graphics.
- the extended display layer can be used as an acceleration layer in scenes with high dynamic display effects.
- FIG. 9 is a schematic diagram of the acceleration layer according to some embodiments. As shown in Figure 9, the display level of the acceleration layer can be higher than other layers. When the user completes the touch input, the line drawn by the acceleration layer is updated to the other layers, thereby reducing input delay and improving the real-time display effect of the whiteboard application drawing process.
- the extended display layer can also work together with other graphics to improve display quality.
- the acceleration layer can respond to the touch events input by the user at the same time as the main OSD layer, and draw graphics separately.
- the graphics drawn by the acceleration layer can block the graphics drawn by the OSD layer, maintaining real-time response speed.
- the content displayed by the acceleration layer can be released directly, and the OSD layer directly forms the drawn graphics, so there is no need for the acceleration layer to refresh the drawn graphics to the OSD layer, reducing the graphics mixing time. It not only improves the real-time display effect of the graphics drawing process, but also improves the final presentation quality of the graphics drawing.
- FIG 10 is a schematic diagram of a teaching tool according to some embodiments.
- the whiteboard application run by the display device 200 used in the education field may include a "teaching tool" option.
- a teaching tool list may pop up.
- the teaching tool list may include tool options of the type "ruler”, “triangle ruler”, “protractor”, etc.
- the "triangle ruler” tool can be called to assist in drawing.
- the display device 200 can add a movable triangle ruler tool graphic to the whiteboard drawing interface, and when the user's touch track approaches the edge of the triangle ruler tool graphic, a straight line segment is drawn along the edge of the triangle ruler tool graphic.
- the whiteboard application can also store the graphic objects drawn by each user touch operation.
- a touch operation refers to the process from the user's finger (or stylus) contacting the touch layer to the user's finger (or stylus) leaving the touch layer. That is, if the user inputs a click action, a touch operation should include a down event and an up event. If the user inputs a sliding action, a touch operation should include a down event, a move event, and an up event.
- Each touch operation can generate a drawing object, and the whiteboard application can record the drawing object to facilitate the user to perform actions such as selection, undo, and redo.
- the whiteboard application can also associate them with information based on their characteristics and input state. For example, after a user draws a line, the whiteboard application can assign a shape identifier to the line object. This shape identifier can be associated with the line object and stored, and can be used by other modules of the whiteboard application or other applications to facilitate operations such as object selection, object retrieval, and object deletion.
- the whiteboard application may also support multiple gesture interactions and provide different control functions for different gesture interactions. For example, in response to a user's multi-finger swipe operation, the whiteboard application may move the whiteboard drawing area along the multi-finger swipe trajectory. The whiteboard application may also respond to a full palm swipe operation by executing an erase function, erasing the drawing object covered by the palm swipe trajectory.
- users may want to draw a corner, which is the angle formed by the intersection of two sides. Users can define the vertex of the corner and draw the two sides. However, if the user draws the corner by themselves, the angle cannot be guaranteed. To this end, users can use teaching tools to assist in drawing the corner.
- the set square is a triangle with three corners, and you can use one of the corners to draw an angle. However, you can only draw fixed angles using the set square. For example, the three corners of the set square might be 90 degrees, 60 degrees, and 30 degrees, or 90 degrees, 45 degrees, and 45 degrees. If you need to draw an angle that's not specified by the set square, you can't use the set square.
- Users can first use the Protractor tool to mark out parameters such as angles and sides. After measuring the desired angle, users can mark the corresponding side, such as the line on which it lies. After marking, users can use the Ruler tool to draw the angle's sides along the marked lines. Once completed, users can clear the markings to complete the angle.
- the user needs to clear the mark made in the process. Since the edge of the corner is near the mark, the user may mistakenly clear the edge of the corner when clearing the mark, which gives the user a poor user experience.
- the display device 200 provided in the embodiments of the present disclosure simplifies the angle drawing function, allowing users to draw angles using a single auxiliary tool.
- the user can call up a protractor and set the angle's degree using the angle indicator line. The user can then use touch to draw a straight line along the angle indicator line, directly drawing the angle's edge without requiring a ruler tool, simplifying the drawing process.
- FIG11 is a flowchart of the interaction between components of a display device according to some embodiments, including the following steps:
- the angle drawing control includes an angle indicator line
- the display and touch components are connected. Users can control the display device through touch and draw various contents.
- the touch component detects the user's touch trajectory, and the display device can perform related operations based on the user's touch trajectory.
- auxiliary tools are provided in the whiteboard application to assist in drawing various content. These auxiliary tools include an angle drawing control.
- the angle drawing control is used to assist in drawing angles, and the angle drawing control can be a protractor tool.
- FIG. 12 is a schematic diagram of an auxiliary tool option list according to some embodiments.
- the option list includes multiple auxiliary tool controls, including a ruler control, a set square control, and an angle drawing control.
- the user can directly click the angle drawing control to instruct the display device to display the angle drawing control.
- the display device can generate an instruction to draw an angle and control the display to display the angle drawing control.
- Users can also use voice input or other methods to input commands to the display device to draw angles. For example, a user can use a microphone or other device to input the voice command "I want to draw an angle" to the display device. After the display device interprets the user's voice command, it can control the display to display the angle drawing control.
- the display device can control the display to display an angle drawing control.
- Figure 13 is a schematic diagram of an angle drawing control according to some embodiments.
- the angle drawing control can be a protractor tool.
- the angle drawing control includes an angle measuring area and an angle indicator line.
- the angle measuring area can be a semicircular area, in which the angle parameters are marked.
- the center of the angle measuring area (point R in the figure) is called the center point of the angle drawing control.
- the center point of the angle drawing control is the vertex of the angle.
- the angle drawing control may include at least two angle indicator lines, and the angle indicator line is a line segment used to indicate the two sides of the drawn angle.
- One endpoint of the angle indicator line is fixed at the center of the angle measuring area of the angle drawing control, that is, the center point mentioned above.
- the endpoint fixed at the center point of the angle drawing control is called the base point of the angle indicator line.
- the base points of the two angle indicator lines are both fixed at the center point of the angle drawing control (the two angle indicator lines are L1 and L2 respectively), so that the two angle indicator lines intersect at the center point to form an angle.
- the user can control the angle formed by the two angle indicator lines by moving the angle indicator line, thereby setting the degree of the angle to be drawn.
- a movement control can be provided within the angle indicator line. As shown in Figure 13, the movement control for angle indicator line L1 is K1, and the movement control for angle indicator line L2 is K2.
- the movement control can be provided at the other end of the angle indicator line and can be a circular control that the user can touch to move it.
- the display device controls the display to display the angle drawing control, it can obtain a second touch track captured by the touch component to confirm the user's touch operation. Furthermore, the display device can also detect the position of a second starting point of the second touch track. If the second starting point is within the response range of the movement control, it indicates that the user intends to move the angle indicator line, and the display device can generate an instruction to move the angle indicator line.
- the display device may, in response to an instruction to move the angle indicator line, move the angle indicator line and obtain a first direction of the angle indicator line after the movement.
- the display device may determine the moving direction and moving distance based on the user's second touch trajectory, thereby moving the angle indicator line.
- the base point of the angle indicator line is fixed at the center point of the angle drawing control. Therefore, moving the angle indicator line can also be regarded as rotating the angle indicator line around the base point of the angle indicator line.
- the display device may set a base point of the angle indication line as a stationary point, and move the mobile control according to the second touch track to rotate the angle indication line.
- the display device can obtain the control coordinates of the mobile control after the move and the coordinates of the center point of the angle drawing control. It should be noted that during the process of moving the angle indicator line, the center point of the angle drawing control (i.e., the base point of the angle indicator line) does not move, and the coordinates of the center point are set to (x0, y0).
- the mobile control itself can be a small area, and the control coordinates of the mobile control can be set to the coordinates of the center point of the mobile control.
- the display device may calculate a first straight line equation corresponding to the moved angle indicator line based on the control coordinates and the center point coordinates, and mark the slope of the first straight line equation as the first direction.
- control coordinates of the moved control are (x1, y1).
- the slope of the first straight line equation may be used to represent the direction of the angle indication line, which is referred to as the first direction in the embodiment of the present disclosure.
- the user can move only one angle indicator line or both angle indicator lines.
- the display device can detect the user's movement of the two angle indicator lines to determine the set angle parameters. Simultaneously, the display device can calculate the first straight line equations of the two angle indicator lines after the movement, thereby obtaining the first directions of the two angle indicator lines.
- Figure 14 is a schematic diagram of moving the angle indicator line according to some embodiments.
- the degree of the currently formed angle can be displayed in real time.
- the angle drawing control includes two angle indicator lines, and the base points of the two angle indicator lines are fixedly set at the center of the angle drawing control, the angle between the two angle indicator lines is the degree of the current angle.
- the display device may obtain the included angle between the two angle indication lines and control the display to display the included angle in the angle drawing control.
- the angle drawing control can be a semicircular area, which can be further divided into a first area and a second area.
- Figure 15 is a schematic diagram of the angle drawing control according to some embodiments.
- the first area Q1 is a semicircular area, the center of which is the same as the center of the angle drawing control, both of which are point R.
- the radius of the first area Q is smaller than the radius of the angle drawing control.
- the second area is the area of the angle drawing control other than the first area, and is an annular area.
- the display device may control the display to display the included angle in the first area of the angle drawing control. For example, if the current angle indication lines L1 and L2 form an included angle D, the included angle D may be displayed in the first area Q1.
- the user can move the angle indicator line to set the degree of the angle.After setting the angle, the user can continue to draw the sides of the angle.
- the user can directly use the angle indicator line to draw the side, for example, by touching a track along the angle indicator line to represent the drawn side.
- the display device may draw the edges of the corners according to the user's touch trajectory.
- the display device may obtain a first touch track captured by the touch component and obtain a second direction of the first touch track.
- the touch operation after the user sets the angle is not necessarily an operation to draw the edge of the angle.
- the display device needs to detect the user's touch operation to confirm whether the current operation is to draw the edge. Therefore, in order to confirm the user's operation of drawing the edge, in the embodiment of the present disclosure, it can be set as follows: the user's operation of drawing a line in a specific area is an operation to draw the edge.
- the angle drawing control includes a first area and a second area, and can be configured such that a touch operation initiated by a user in the first area can indicate a drawing edge.
- the display device may first detect the position of the first starting point of the first touch track.
- the angle drawing control can be moved according to the first touch trajectory.
- the display can be controlled to display the first touch track, for example, a line corresponding to the first touch track is drawn.
- the first starting point is located in the first area, it means that the user has initiated a touch operation in the first area, and there is a possibility of drawing an edge. It should be noted that not all touch operations initiated by the user in the first area are operations of drawing an edge, so further detection is required.
- the display device can obtain the coordinates of the starting point of the first touch track, which are referred to as the first starting point coordinates in this disclosure. Further, the display device can also obtain the coordinates of the ending point of the first touch track, which are referred to as the first ending point coordinates in this disclosure.
- the display device can calculate a second straight line equation corresponding to the first touch track based on the first starting point coordinates and the first ending point coordinates.
- the first starting point coordinates are represented as (x11, y11)
- the first ending point coordinates are represented as (x12, y12).
- the display device may mark the slope of the second straight line equation as the second direction, and calculate the difference between the first direction and the second direction to represent the angular difference between the two directions, which is referred to as the first direction difference in the embodiment of the present disclosure.
- the display device can obtain a target endpoint on the angle indication line according to the first touch track.
- the target endpoint is set as the endpoint of the edge to be drawn.
- the display device when acquiring the target endpoint, may first acquire the horizontal coordinate of the first end point, which is referred to as the first horizontal coordinate in the embodiment of the present disclosure.
- the base point of the angle indicator line (that is, the above-mentioned center point) can be used as the vertex of the angle, and the target endpoint can be used as the endpoint of the side to draw the side of the angle. In this way, two corresponding sides can be drawn according to the two angle indicator lines to form an angle.
- Figure 16 is a schematic diagram of edge drawing according to some embodiments.
- the user's first touch trajectory starts at point A1 and ends at point B1.
- the display device detects the location of starting point A1. If it is located in the first area, the second direction of the first touch trajectory is obtained. If the difference between the second direction and the first direction is less than a direction difference threshold, the target endpoint is obtained based on the end point B1 of the first touch trajectory, thereby drawing the edge.
- a user may need to continue drawing an edge. For example, while drawing an edge, a user may lose touch control due to hand tremors or other reasons. Since the length of an edge is related to the user's touch trajectory, losing touch control may result in a shorter edge, which does not meet the user's needs. The user may then wish to continue drawing to extend the edge.
- the display device may acquire a third touch track captured by the touch component.
- the user may continue to draw along the direction of the edge, so the user's touch point is required to be relatively close to the originally drawn edge, that is, relatively close to the angle indicator line.
- the display device may first obtain the distance between the third starting point of the third touch track and the angle indicator line. When obtaining the distance, a perpendicular line may be drawn from the third starting point to the angle indicator line, and the distance of the perpendicular line may be calculated.
- the display device may also obtain coordinate information of the third starting point and substitute the abscissa of the third starting point into the first straight line equation of the angle indicator line to obtain the ordinate value corresponding to the angle indicator line. Specifically, the difference between the ordinate value of the third starting point and the ordinate value corresponding to the angle indicator line may be calculated, and the difference may be used as the distance between the third starting point and the angle indicator line.
- the display device After calculating the distance, if the distance is less than or equal to the distance threshold, it indicates that the user may want to continue drawing the edge, and the display device can obtain the third direction of the third touch track.
- the steps for obtaining the third direction can be referred to above and will not be repeated here.
- the display device may calculate a second direction difference between the first direction and the third direction. If the second direction difference is less than or equal to a direction difference threshold, a connection endpoint may be obtained on the angle indication line according to the third touch trajectory, and the side of the angle may be continuously drawn according to the connection endpoint.
- the touch track when the user continues to draw an edge, the touch track may be drawn toward the base point of the angle indication line, or may be drawn away from the base point of the angle indication line.
- the display device can obtain the horizontal coordinate of the third end point of the third touch track, which is called the second horizontal coordinate in the embodiment of the present disclosure, and can also obtain the horizontal coordinate of the third starting point, which is called the third horizontal coordinate in the embodiment of the present disclosure.
- the display device may acquire a first endpoint and a second endpoint on the angle indication line, wherein the abscissa of the first endpoint is the second abscissa, and the abscissa of the second endpoint is the third abscissa.
- the display device may calculate a first distance between the first endpoint and the base point of the angle indication line, and calculate a second distance between the second endpoint and the base point of the angle indication line.
- the first endpoint is set as the connection endpoint; if the first distance is less than the second distance, the second endpoint is set as the connection endpoint.
- connection endpoint After obtaining the connection endpoint, use the connection endpoint as the endpoint of the edge and continue drawing the edge.
- the present disclosure also provides a method for drawing an angle, which is applied to a display device.
- the method may include:
- the angle drawing control includes an angle indicating line
- the angle side is drawn with the base point of the angle indicator line as the vertex of the angle and the target endpoint as the endpoint of the side.
- the angle indicator line includes a mobile control.
- the method further includes: after controlling the display to display the angle drawing control, obtaining a second touch trajectory captured by the touch component; detecting the position of a second starting point of the second touch trajectory; and generating an instruction to move the angle indicator line if the second starting point is within a response range of the mobile control.
- the base point of the angle indicator line is set at the center of the angle measuring area of the angle drawing control.
- Moving the angle indicator line and obtaining the first direction of the angle indicator line after the movement includes: setting the base point of the angle indicator line as a stationary point, and moving the control according to the second touch trajectory. Obtaining the control coordinates of the control after the movement and the coordinates of the center of the angle measuring area of the angle drawing control. Calculating a first straight line equation corresponding to the angle indicator line after the movement based on the control coordinates and the coordinates of the center of the angle measuring area, and marking the slope of the first straight line equation as the first direction.
- the angle drawing control includes a first area and a second area
- obtaining the second direction of the first touch track includes: detecting the location of a first starting point of the first touch track. If the first starting point is located in the first area, obtaining the coordinates of the first starting point and the coordinates of the first ending point of the first touch track. Calculating a second straight line equation corresponding to the first touch track based on the first starting point coordinates and the first ending point coordinates, and marking the slope of the second straight line equation as the second direction.
- the method further comprises: if the first starting point is located in the second area, moving the angle drawing control according to the first touch track; and if the first starting point is located outside the angle drawing control, controlling the display to display the first touch track.
- obtaining a target endpoint on the angle indicator line according to the first touch trajectory includes: obtaining a first horizontal coordinate of the first endpoint; calculating a first straight line equation corresponding to the moved angle indicator line; calculating a first vertical coordinate based on the first horizontal coordinate and the first straight line equation; and obtaining the target endpoint, where the horizontal coordinate of the target endpoint is the first horizontal coordinate and the vertical coordinate of the target endpoint is the first vertical coordinate.
- the method further includes: after drawing the edge of the angle, obtaining a third touch track captured by the touch component; obtaining a distance between a third starting point of the third touch track and the angle indicator line; if the distance is less than or equal to a distance threshold, obtaining a third direction of the third touch track; calculating a second direction difference between the first direction and the third direction; if the second direction difference is less than or equal to the direction difference threshold, obtaining a connection endpoint on the angle indicator line based on the third touch track, and continuing to draw the edge of the angle based on the connection endpoint.
- obtaining a connection endpoint on the angle indicator line based on the third touch trajectory includes: obtaining the second horizontal coordinate of the third end point and the third horizontal coordinate of the third starting point of the third touch trajectory. Obtaining a first endpoint and a second endpoint on the angle indicator line; the horizontal coordinate of the first endpoint is the second horizontal coordinate, and the horizontal coordinate of the second endpoint is the third horizontal coordinate. Calculating a first distance between the first endpoint and a base point of the angle indicator line, and calculating a second distance between the second endpoint and the base point of the angle indicator line. If the first distance is greater than or equal to the second distance, setting the first endpoint as the connection endpoint; if the first distance is less than the second distance, setting the second endpoint as the connection endpoint.
- the angle drawing control includes at least two angle indicator lines, with base points of the at least two angle indicator lines being set at a center point of the angle drawing control.
- the method further includes: after moving the angle indicator lines, obtaining an included angle between the two angle indicator lines. Controlling the display to display the included angle in a first area of the angle drawing control.
- the technology in the embodiments of the present disclosure can be implemented by means of software plus the necessary general hardware platform.
- the implementation methods in the embodiments of the present disclosure, or the part that contributes to the existing technology can be embodied in the form of a software product.
- the computer software product can be stored in a storage medium such as ROM/RAM, a magnetic disk, an optical disk, etc., and includes a number of instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of each embodiment of the present disclosure or certain parts of the embodiments.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
本公开提供一种显示设备和角的绘制方法。显示设备可显示角度绘制控件,角度绘制控件包括角度指示线。显示设备可响应于移动角度指示线的指示,移动角度指示线并获取移动后的角度指示线的第一方向,以及确定采集到的第一触控轨迹的第二方向。通过计算第一方向和第二方向的第一方向差,在第一方向差小于或等于方向差阈值时根据第一触控轨迹在角度指示线上获取目标端点。以角度指示线的基点为角的顶点,以目标端点为边的端点,绘制角的边。以缓解相关技术中,绘制特定角度的过程中需结合量角器和直尺,操作较为繁琐的问题。
Description
相关申请的交叉引用
本公开要求在2024年04月18日提交、申请号为202410467418.7的中国申请的优先权,其全部内容通过引用结合在本公开中。
本公开涉及显示设备技术领域,尤其涉及一种显示设备和角的绘制方法。
显示设备是指能够输出具体显示画面的终端设备,显示设备可实现双向人机交互功能,集影音、娱乐、数据等多种功能于一体,用于满足用户多样化和个性化需求。
为了满足会议与教育等场景的需求,对于支持触控交互操作的显示设备,可以通过运行白板应用,并基于白板应用按照触控区域实现书写或绘画功能。用户可以在触控区域内进行各种绘制操作,例如绘制各种线条、角度、图案等内容,白板应用可以实时响应用户操作,例如显示用户触控轨迹的轨迹线等。
在绘制角时,用户可以使用三角尺工具,但三角尺只能绘制出固定角度的角。如果用户需要绘制特定角度的角,则需要利用量角器工具标注出角度和边等参数,再利用直尺工具沿着标记绘制角的边,绘制过程需要结合量角器和直尺,操作较为繁琐。
第一方面,本公开实施例提供一种显示设备,可包括:显示器,可被配置为显示用户界面;所述显示器连接触控组件,所述触控组件可用于采集用户输入的触控轨迹;至少一个处理器,与所述显示器连接,可被配置执行计算机指令以使得所述显示设备执行:响应于指示绘制角的指令,控制显示器显示角度绘制控件;所述角度绘制控件包括角度指示线;响应于指示移动角度指示线的指令,移动所述角度指示线并获取移动后的角度指示线的第一方向;获取触控组件采集的第一触控轨迹,并确定所述第一触控轨迹的第二方向;计算所述第一方向和所述第二方向的第一方向差;如果所述第一方向差小于或等于方向差阈值,则根据所述第一触控轨迹在所述角度指示线上获取目标端点;以所述角度指示线的基点为角的顶点,以所述目标端点为边的端点,绘制角的边。
第二方面,本公开实施例提供一种角的绘制方法,该方法可包括:响应于指示绘制角的指令,控制显示器显示角度绘制控件;所述角度绘制控件包括角度指示线;响应于指示移动角度指示线的指令,移动所述角度指示线并获取移动后的角度指示线的第一方向;获取触控组件采集的第一触控轨迹,并确定所述第一触控轨迹的第二方向;计算所述第一方向和所述第二方向的第一方向差;如果所述第一方向差小于或等于方向差阈值,则根据所述第一触控轨迹在所述角度指示线上获取目标端点;以所述角度指示线的基点为角的顶点,以所述目标端点为边的端点,绘制角的边。
图1为根据一些实施例的显示设备与控制设备之间操作场景的示意图;
图2为根据一些实施例的显示设备的硬件配置框图;
图3为根据一些实施例的控制设备的硬件配置框图;
图4为根据一些实施例的显示设备中软件配置图;
图5为根据一些实施例的应用面板的示意图;
图6为根据一些实施例的触控轨迹的示意图;
图7为根据一些实施例的白板界面的示意图;
图8为根据一些实施例的绘制画面的部件示意图;
图9为根据一些实施例的加速层的示意图;
图10为根据一些实施例的教学工具的示意图;
图11为根据一些实施例的显示设备各部件的交互流程图;
图12为根据一些实施例的辅助工具的选项列表的示意图;
图13为根据一些实施例的角度绘制控件的示意图;
图14为根据一些实施例的移动角度指示线的示意图;
图15为根据一些实施例的角度绘制控件的示意图;
图16为根据一些实施例的绘制边的示意图。
图1为根据一些实施例的显示设备与控制设备之间操作场景的示意图。如图1中示出,用户可通过移动终端300和控制设备100操作显示设备200。例如,控制设备100可以为遥控器、触控笔、手柄等。
本公开实施例中,显示设备200泛指具有画面显示和数据处理能力的设备。例如,显示设备200包括但不限于智能电视、移动终端、计算机、监视器、广告屏、可穿戴设备、虚拟现实设备、增强现实设备等。
移动终端300可以作为一种控制设备,用于执行用户与显示设备200之间的人机交互。移动终端300还可以作为一种通信设备,用于与显示设备200建立通信连接,进行数据交互。在一些实施例中,移动终端300可与显示设备200安装软件应用,通过网络通信协议实现连接通信,实现一对一控制操作和数据通信的目的。也可以将移动终端300上显示音视频内容传输到显示设备200上,实现同步显示功能。
如图1中还示出,显示设备200还与服务器400通过多种通信方式进行数据通信。可允许显示设备200通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。
显示设备200可以提供广播接收电视功能,还可以附加提供计算机支持功能的智能网络电视功能,包括但不限于,网络电视、智能电视、互联网协议电视(IPTV)等。
图2为图1所示显示设备200的硬件配置框图,如图2所示,显示设备200可以包括调谐解调器210、通信装置220、检测器230、装置接口240、处理器250、显示器260、音频输出装置270、存储器、供电电源、用户输入接口中的至少一种。
在一些实施例中,检测器230用于采集外部环境或与外部交互的信号。例如,检测器230包括光接收器,用于采集环境光线强度的传感器;或者,检测器230包括图像采集器,如摄像头,可以用于采集外部环境场景、用户的属性或用户交互手势,再或者,检测器230包括声音采集器,如麦克风等,用于接收外部声音。
在一些实施例中,显示器260包括用于呈现画面的显示功能组件,以及驱动图像显示的驱动组件。显示器260用于接收源自处理器250输出的图像信号进行显示。例如,显示器260可以用于显示视频内容、图像内容以及菜单操控界面的组件以及用户操控UI界面等。
在一些实施例中,显示设备200还可以支持触控交互,即在显示设备200上可以设有触控组件,触控组件可以是内置模块也可以是外接模块。例如,为了实现触控交互操作,显示设备200的显示器260上可以设有触摸屏(Touch Panel,TP),触摸屏能够接收手指、触头、触控笔等输入的触摸信号,并根据预先设定的交互策略执行触控交互响应。当然,显示设备200还可以是触控一体屏。
对于外接触控组件的显示设备200,可以通过显示设备200的装置接口240连接具有触控功能的终端、设备、组件。例如,显示设备200的USB或USB-C接口连接触控板,触控板可以实时接收用户输入的触控数据,并通过USB通道将触控数据传递给显示设备200,显示设备200则可以根据接收到的触控数据,结合触控应用执行交互响应,使显示设备200支持触控交互操作。
在一些实施例中,通信装置220是用于根据各种通信协议类型与外部设备或服务器400进行通信的组件。显示设备200可以根据支持的通信方式的不同,设置有多个通信装置220。例如,显示设备200支持无线网络通信时,显示设备200可以设有包含WiFi功能的通信装置220。显示设备200支持蓝牙连接通信时,显示设备200需要设有包含蓝牙功能的通信装置220。
通信装置220可以通过无线或有线连接的方式使显示设备200与外部设备或服务器400进行通信连接。其中,有线连接可以通过数据线、接口等组件将显示设备200与外部设备连接。无线连接则可以通过无线信号或无线网络将显示设备200与外部设备连接。显示设备200可以直接与外部设备建立连接关系,也可以通过网关、路由、连接设备等间接建立连接关系。
在一些实施例中,处理器250可以包括中央处理器、视频处理器、音频处理器、图形处理器、电源处理器中的至少一个,用于输入/输出的第一接口至第n接口,处理器250可通过存储在存储器上中各种软件控制程序,来控制显示设备的工作和响应用户的操作。处理器250控制显示设备200的整体操作。
在一些实施例中,处理器250和调谐解调器210可以位于不同的分体设备中,即调谐解调器210也可在处理器250所在的主体设备的外置设备中,如外置机顶盒等。
在一些实施例中,用户可在显示器260上显示的图形用户界面(Graphical User Interface,GUI)输入用户命令,则用户输入接口通过图形用户界面(GUI)接收用户输入命令。
在一些实施例中,音频输出装置270可以为显示设备200的本机扬声器,也可以为显示设备200外接的音频输出设备。其中,对于显示设备200外接的音频输出设备,显示设备200还可以设置有外接音频输出端子,音频输出设备可以通过外接音频输出端子接入显示设备200,以输出显示设备200的声音。
在一些实施例中,用户输入接口280,可用于接收来自用户输入的指令。
图3为根据一些实施例的图1中控制设备的硬件配置框图。如图3所示,控制设备100可以包括:处理器110、通信接口130、用户输入/输出接口、存储器、供电电源。
控制设备100被配置为控制显示设备200,以及可接收用户的输入操作指令,且将操作指令转换为显示设备200可识别和响应的指令,起到用户与显示设备200之间交互中介作用。
为了执行用户交互,在一些实施例中,显示设备200可以运行有操作系统。所述操作系统是用于管理和控制显示设备200中硬件资源和软件资源的计算机程序。操作系统可以控制显示设备提供用户界面,例如,操作系统可以直接控制显示设备提供用户界面,也可以通过运行应用程序提供用户界面。操作系统还允许用户与显示设备200进行交互。
需要说明的是,所述操作系统可以是基于特定操作平台的原生操作系统,也可以是基于特定操作平台深度定制的第三方操作系统,还可以是针对显示设备专门开发的独立操作系统。
操作系统可以根据所实现的功能划分为不同的模块或层级,例如,如图4所示,在一些实施例中,将系统分为四层,从上至下分别为应用程序(Applications)层(简称“应用层”),应用程序框架(Application Framework)层(简称“框架层”),系统库层以及内核层。
在一些实施例中,应用程序层用于为应用程序提供服务和接口,以便于显示设备200能够运行应用程序,并基于应用程序与用户交互。应用程序层中可以运行有至少一个应用程序,这些应用程序可以是操作系统自带的窗口(Window)程序、系统设置程序或时钟程序等;也可以是第三方开发者所开发的应用程序。在具体实施时,应用程序层中的应用程序包不限于以上举例。
框架层为应用程序提供应用编程接口(Application Programming Interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。应用程序框架层相当于一个处理中心,这个中心决定让应用层中的应用程序做出动作。应用程序通过API接口,可在执行中访问系统中的资源和取得系统的服务。
在一些实施例中,系统运行库层可以为框架层提供支撑,当框架层被使用时,操作系统会运行系统运行库层中包含的指令库,例如C/C++指令库,以实现框架层所要实现的功能。
在一些实施例中,内核层是介于显示设备200的硬件和软件之间的功能层级。内核层可以实现硬件抽象、多任务处理、内存管理等功能。例如,如图4所示,内核层中可以配置有硬件驱动,内核层包含的驱动可以为以下驱动中的至少一种:音频驱动、显示驱动、蓝牙驱动、摄像头驱动、WIFI驱动、USB驱动、HDMI驱动、传感器驱动(如指纹传感器,温度传感器,压力传感器等)、以及电源驱动等。
需要说明的是,上述示例仅仅是对操作系统功能的简单划分,并不对本公开实施例中显示设备200的具体操作系统形式构成限定,根据显示设备的功能、操作系统的类型等因素,操作系统所包含的层级数量和具体层级类型可以表现为其他形式。
显示设备200可以具有多种功能,例如浏览网页、播放媒资、娱乐游戏、投屏等功能,从而向用户提供多种多样的服务。用户可以控制显示设备200启动某个相关的应用程序,从而开启相应的功能。
在一些实施例中,当用户控制显示设备开机后,处理器250可以控制显示器260显示用户界面。用户界面中可以是具体的目标图像,例如从网络信号源中获取到的各种媒资,包括视频、图片等内容。用户界面也可以是显示设备的一些UI界面,例如系统主界面,各种设置界面,以及应用程序的各种控制界面等。
用户界面中可以包括应用面板,如“我的应用”控件。用户可以通过应用面板查看到显示设备200安装的应用程序,即显示设备200所支持的功能。需要说明的是,显示设备200安装的应用可以是系统应用,也可以是第三方应用。用户通过开启某个应用程序,从而控制显示设备200实现该应用程序相应的功能。
在一些实施例中,用户可以控制显示设备200调出应用面板,以查看显示设备安装的应用程序。图5为根据一些实施例的应用面板的示意图。如图5所示,应用面板中包括“浏览器”、“网络媒资”以及“健身跟练”三个控件。用户可以通过点击“浏览器”控件,从而控制显示设备200打开浏览器应用,以浏览各种网页等。用户可以点击“网络媒资”控件,从而利用显示设备200观看各种网络媒资。用户可以点击“电子白板”控件,显示设备200可以启动电子白板应用,用户可以利用电子白板应用绘制各种内容,例如绘制各种线条、角度、图案等内容。
用户可以通过触控交互的方式控制显示设备,例如进行各种绘制操作。显示设备200可以通过触控组件采集用户输入的触控轨迹。
根据触控组件的交互原理,触控组件可以检测触控轨迹中的相关参数。例如,显示设备200的显示器260屏幕上设有电容屏触控层,则在用户手指触控到触控层的任一位置时,触控层在触控位置的电容将产生变化,此时,触控组件可以记录电容变化的位置,并结合处理器中的计时器记录电容变化产生的时间,以生成触控交互数据。
在一些实施例中,触控组件检测的物理信号需要被转化后,才能够被显示设备200的处理器250读取。例如,电容变化的模拟信号需要转化为数字信号,再传输给显示设备200的处理器250。而为了适应显示设备200的屏幕显示过程,触控组件检测的触控数据还需要进行坐标映射,以使触控数据对应的位置点能够与显示设备200的显示器260或用户界面中的像素点具有对应关系。例如,触控组件的坐标位置检测精度为65536×65536,而显示设备200的显示器260分辨率为3840×2160,则在触控组件检测到触控数据后,可以按照65536/3840和65536/2160的比例,对宽度和高度方向的触控点位置进行坐标映射,使显示设备200可以基于映射后的触控点位置坐标执行相关操作响应。
其中,触控数据可以根据用户的输入方式包含不同的操作参数。图6为根据一些实施例的触控轨迹的示意图。如图6所示,触控数据可以包括用户触控操作的触控时间、触控位置、触控事件类型、触控点数量等。在一次触控交互过程中,触控组件可以检测的触控事件类型包括:触控操作的落下(down)事件、移动(move)事件以及抬起(up)事件。对应在整个触控轨迹上,可以形成起始点、轨迹点以及终止点。每一个触控事件都记录有对应的触控时间和触控位置。
在执行触控交互响应过程中,显示设备200可以将不同的触控时间、触控位置、触控点数量以及触控事件类型进行分类,即可检测用户的触控输入手势,从而针对不同的输入手势执行不同的交互响应。例如,当触控组件检测到的触控数据中,触控点数量为1、触控事件类型中仅包括落下(down)事件和抬起(up)事件,且落下(down)事件和抬起(up)事件之间的时间间隔小于单击事件时间阈值,并且,落下事件和抬起事件的触控位置变化距离小于抖动距离阈值,则可以确定当前用户的触控输入手势为点击手势。则基于点击手势,显示设备200根据点击手势对应的触控位置所在区域图标,执行启动应用程序的操作。
同理,显示设备200基于触控时间、触控位置、触控点数量以及触控事件类型还可以检测用户输入的其他触控交互操作手势,例如,双击手势、滑动手势、长按手势、多指点击手势、多指滑动手势等。不同的交互手势可以派生出不同的触控参数,例如,滑动手势还可以生成滑动距离、滑动速度、滑动方向、滑动轨迹形状等参数。不同的触控参数可以用于执行不同的交互控制。
在一些实施例中,为了丰富显示设备200所支持的触控交互类型,显示设备200还可以根据触控时间、触控位置、触控点数量以及触控事件类型的动态变化规律进行复杂手势检测。例如,当触控组件检测到用户输入的触控数据包括多个触控点,且每个触控点的触控位置随用户输入相互靠近,则可以确定用户当前输入的触控手势为抓取手势。基于复杂手势检测,显示设备200可以执行更多的交互响应。例如,当检测到的触控手势为针对图像view的抓取操作,则显示设备200可以响应抓取手势,执行对图像显示位置进行移动的控制动作。
在一些实施例中,触控手势还可以和触控位置相结合,形成基于特定位置的触控交互操作,例如,当触控组件检测到触控操作过程中的down事件位置处于显示器260顶部,move事件对应的触控点位置向下移动,至检测到up事件时,显示设备200可以确定当前触控手势为从屏幕顶部下滑,因此,显示设备200可以响应于改触控手势,控制显示器260呈现下拉列表。
部分触控交互操作手势可用于基于显示设备200的操作系统执行交互动作,被称为全局手势。例如,显示设备200上述示例中从屏幕顶部下滑呼出下拉列表的操作。部分触控交互操作手势可用于基于特定触控应用执行交互动作。例如,在显示设备200运行白板应用时,用户输入的滑动触控操作可以用于在白板上绘制轨迹线。
触控应用可以是基于特定显示设备类型和用户需求开发的系统应用或第三方应用。需要说明的是,上述白板应用可以是独立应用,也可以是关联应用,还可以是触控应用中的一个功能模块。不同形式的白板应用可以具有不同启动方式。例如,用户可以通过显示设备200的应用面板启动独立的白板应用;用户还可以通过会议应用上执行“白板”操作,关联启动白板应用;用户还可以通过点击会议应用上的“白板”图标,控制会议应用启动白板功能模块。
不同形式的白板应用在启动后所呈现的白板应用界面形式也可以不同。例如,当用户通过关联应用形式启动白板应用,显示设备200可以自动进入双屏(或分屏)模式。在双屏(或分屏)模式下,显示设备200可以通过两个显示区域进行用户界面显示,即主屏显示原应用(如会议应用)界面,副屏显示白板应用界面。
白板应用在运行后,可以使显示设备200切换至显示白板界面。图7为根据一些实施例的白板界面的示意图。如图7所示,在白板界面中可以包括用于绘制操作的绘制工具控件,例如,笔形、图形、线形、颜色、擦除、清屏、选择等操作控件。用户可以根据具体的绘制需要,点击任一控件进行图形绘制。
图8为根据一些实施例的绘制画面的部件示意图。如图8所示,显示设备200可以通过图像生成(Image Producer)模块、图像渲染(surface flinger)模块、合成(Composer)模块、视频过程(Video Processing Unit hardware,VPU hardware)模块以及显示器(screen)实时渲染并显示绘制画面。
在显示绘制画面过程中,图像生成模块的图形接口(openGLES)可与白板应用连接,用于产生绘制图像内容,并将图像内容传递至图像渲染模块。图像渲染模块用于控制显示器260显示内容,即根据图像内容通过用户交互层(UI layer)或视频层(video layer)进行图像内容渲染。为了获得更好的显示效果,UI层的图像内容可以通过GPU组件渲染,从而在合成模块形成用于显示的画面帧。其中,合成模块可以通过软件或硬件形成画面内容,例如,合成模块可以为硬件合成(Hardware Composer,HWC)模块。
合成模块中可以分别通过帧缓冲器(frame buffer)和视频缓冲器(video buffer)存储画面帧,并通过视频过程模块分别在相应的图层形成画面内容。即视频播放过程产生的图像帧通过视频层(video plane)形成画面内容,而其他图像画面(如触控轨迹、图形等)的图像帧通过主OSD层(primary OSD plane)形成画面内容。最后,显示设备200通过视频过程模块的混合单元(blend)形成最终画面,显示在显示器260上。
由于白板应用会根据用户的触控操作实时响应呈现用户的触控轨迹,因此为了呈现更好的实时响应效果,显示设备200应缩短触控操作输入时间和绘制结果显示的延迟时间。为此,在一些实施例中,显示设备200可以通过设置加速层呈现实时绘画效果。即在显示设备200的视频过程模块中可以在主OSD(primary OSD plane)层和video层的基础上,额外设置扩展显示图层(external OSD plane)。其中,扩展显示图层可以根据具体的显示效果需求,配置成不同图层特点。例如,可以修改扩展显示图层的位图刷新模式,使扩展显示图层按照区域实时刷新,从而提高图形的显示速度,此时,扩展显示图层可作为加速层用于高动态显示效果的场景中。
以显示设备200运行白板应用为例,为了提高绘线过程的实时响应速度,可以在检测到用户的触控操作后,在扩展显示图层(加速层)实时绘制触控轨迹。图9为根据一些实施例的加速层的示意图。如图9所示,加速层的显示层级可以高于其他图层,并在用户完成触控输入时,将加速层绘制的线条更新到其他图层,从而可以减小输入延迟,提高白板应用绘制过程的实时显示效果。
在一些实施例中,扩展显示图层还可以与其他图形共同作用,提高显示质量。例如,加速层可以和主OSD层同时响应用户输入的触控事件,并分别进行图形绘制。但由于加速层显示在主OSD层的上方,因此加速层绘制的图形可以遮挡住OSD层绘制的图形,保持实时响应速度。而在用户输入完触控交互动作后,加速层显示的内容可以被直接释放,而OSD层直接形成绘制图形,从而无需加速层向OSD层刷新绘制图形,减少图形混合时间。既提高图形绘制过程的实时显示效果,又可以提高图形绘制的最终呈现质量。
在一些实施例中,为了适应不同的用户需要,白板应用还可以动态配置不同的界面内容。图10为根据一些实施例的教学工具的示意图。如图10所示,应用于教育领域的显示设备200所运行的白板应用中,可以包括“教学工具”选项。当用户点击教学工具选项后,可以弹出教学工具列表。教学工具列表中可以包括“直尺”、“三角尺”、“量角器”等类型的工具选项。用户点击“三角尺”工具选项后,可以调用“三角尺”工具辅助绘制,此时,显示设备200可以在白板绘制界面中增加可移动的三角尺工具图形,并且在用户触控轨迹靠近三角尺工具图形的边时,沿着三角尺工具图形的边绘制直线段。
在一些实施例中,白板应用还可以对用户每次触控操作绘制的图形对象进行存储。其中,一次触控操作是指用户手指(或触控笔)接触触控层至用户手指(或触控笔)离开触控层的过程。即如果用户输入点击动作,则一次触控操作应包括down事件和up事件。如果用户输入滑动动作,则一次触控操作应包括down事件、move事件以及up事件。每次触控操作可以产生一个绘画对象,白板应用可以将绘画对象进行记录,从而便于用户执行选中、撤销、重做等动作。
白板应用在存储绘画对象的过程中,还可以根据绘画对象的特点和输入状态,为其设置关联信息。例如,用户在绘制一条直线后,白板应用可以为直线对象设置形状标识,形状标识可以与直线对象关联存储,并且能够被白板应用的其他模块或者其他应用调用,以便于进行对象选择、对象检索、对象删除等操作。
在一些实施例中,白板应用也可以支持多种手势交互操作,并且针对不同的手势交互操作具有不同的控制功能。例如,白板应用可以响应于用户的多指滑动操作,沿多指滑动轨迹移动白板绘制区域。白板应用还可以响应于用户整个手掌的滑动操作,执行擦除功能,擦除手掌滑动操作轨迹覆盖的绘画对象。
在一些实施例中,对于教学等场景下,用户可能想要绘制角,即两条边相交所形成的角图形。用户可以定义角的顶点位置,并绘制角的两条边。但如果仅由用户自行绘制,无法保证绘制的角度大小。为此,用户可以利用教学工具,辅助绘制角。
用户可以使用三角尺工具绘制角。三角尺整体呈现三角形,包括三个角,用户可以利用角的一端绘制角。然而,利用三角尺只能绘制出固定角度的角。例如,三角尺的三个角分别为90度、60度、30度,或者为90度、45度、45度。如果用户需要绘制出三角尺角度之外的特定角度的角,则无法利用三角尺绘制。
为了能够绘制出任意角度的角,用户可以利用量角器工具和直尺工具。
用户可以先使用量角器工具标注出角度和边等参数。用户可以量出需要的角度,并可以标记该角度对应的边,例如对其所在的直线进行标记。在标记后,用户再使用直尺工具沿着标记绘制角的边。在绘制完成后,用户将标记清除,从而得到完整的角。
需要说明的是,这种绘制过程需要结合量角器和直尺,用户使用的工具多,操作较为繁琐,绘制角所花费的时间过长。
同时,用户绘制角后,还需要将过程中所做的标记清除,由于角的边位于该标记附近,用户在清除标记时还容易误将角的边清除,给用户的使用体验较差。
为解决上述问题,本公开实施例提供的显示设备200可以简化绘制角的功能,用户可以使用单个辅助工具绘制角。在绘制角的过程中,用户可以调出量角器,并通过角度指示线设置好角的度数。用户可以沿着角度指示线以触控的方式划出直线轨迹,从而直接绘制角的边,不需要再调用直尺工具,绘制过程简单。
图11为根据一些实施例的显示设备各部件的交互流程图,包括以下步骤:
S101、响应于指示绘制角的指令,控制显示器显示角度绘制控件;
其中,角度绘制控件包括角度指示线;
S102、响应于指示移动角度指示线的指令,移动角度指示线并获取移动后的角度指示线的第一方向;
S103、获取触控组件采集的第一触控轨迹,并确定第一触控轨迹的第二方向;
S104、计算第一方向和所述第二方向的第一方向差;如果第一方向差小于或等于方向差阈值,则根据第一触控轨迹在角度指示线上获取目标端点;
S105、以角度指示线的基点为角的顶点,以目标端点为边的端点,绘制角的边。
显示设备中,显示器和触控组件相连接。用户可以通过触控的方式控制显示设备,利用绘制各种内容。触控组件检测用户的触控轨迹,显示设备可以通过用户的触控轨迹执行相关操作。
在一些实施例中,用户具有绘制角的需求时,可以向显示设备输入指示绘制角的指令。白板应用中设置有多种辅助工具,用于辅助绘制各种内容。其中,辅助工具包括角度绘制控件。角度绘制控件用于辅助绘制角,角度绘制控件可以是量角器工具。
用户可以自行调出角度绘制控件,以绘制各种角度的角。
白板应用界面中可以显示辅助工具的选项列表。图12为根据一些实施例的辅助工具的选项列表的示意图。如图12所示,选项列表包括多个辅助工具的控件,可以包括直尺控件、三角尺控件和角度绘制控件等。用户可以直接点击角度绘制控件,以指示显示设备显示角度绘制控件。显示设备可响应于用户操作,生成指示绘制角的指令,并控制显示器显示角度绘制控件。
用户也可以通过语音输入等方式,向显示设备输入指示绘制角的指令。例如,用户可以通过麦克风等设备,向显示设备输入语音指令“我要绘制角”。显示设备可解析用户的语音指令后,可以控制显示器显示角度绘制控件。
在一些实施例中,显示设备可以控制显示器显示角度绘制控件。图13为根据一些实施例的角度绘制控件的示意图。如图13所示,角度绘制控件可以是量角器工具。角度绘制控件包括量角区域和角度指示线。其中,量角区域可以是半圆形区域,其中标注有角度参数。本公开实施例中,量角区域圆心(图中R点)称为角度绘制控件的中心点。在绘制角时,角度绘制控件的中心点即为角的顶点。
角度绘制控件可包括至少两个角度指示线,角度指示线为一段线段,用于指示绘制的角的两个边。角度指示线的一个端点固定在角度绘制控件的量角区域圆心处,即前文提及的中心点。本公开实施例中,将固定在角度绘制控件中心点的端点称为角度指示线的基点。两个角度指示线的基点均固定在角度绘制控件的中心点(两个角度指示线分别为L1和L2),使得两个角度指示线相交在中心点处,形成角。用户可以通过移动角度指示线,来控制两个角度指示线形成的夹角,从而设置所要绘制的角的度数。
在一些实施例中,考虑到用户操作的多样性,为避免用户触控某个区域时会误触发角度指示线的移动,角度指示线中可以设置有移动控件。如图13所示,角度指示线L1的移动控件为K1,角度指示线L2的移动控件为K2。移动控件可以设置在角度指示线的另一个端点处,可以是圆形控件,用户可以触控该控件以进行移动。
可以设置为当用户触控移动控件时,会触发角度指示线的移动操作。即用户可以按住移动控件,从而移动角度指示线。
在一些实施例中,显示设备控制显示器显示角度绘制控件后,可以获取触控组件采集的第二触控轨迹,以确认用户的触控操作。进一步的,显示设备还可以检测第二触控轨迹的第二起始点的位置。如果第二起始点位于移动控件的响应范围内,则说明用户想要移动角度指示线,显示设备可以生成指示移动角度指示线的指令。
在一些实施例中,显示设备可响应于指示移动角度指示线的指令,移动角度指示线并获取移动后的角度指示线的第一方向。在移动角度指示线时,显示设备可以根据用户的第二触控轨迹确定移动方向和移动距离,从而移动该角度指示线。
需要说明的是,角度指示线的基点固定设置在角度绘制控件的中心点。因此,对角度指示线的移动操作也可以视为,以角度指示线的基点为中心对角度指示线进行旋转。
在一些实施例中,显示设备可以将角度指示线的基点设置为静止点,以及根据第二触控轨迹移动移动控件,以旋转角度指示线。
在一些实施例中,显示设备可以获取移动后移动控件的控件坐标以及角度绘制控件的中心点坐标。需要说明的是,在移动角度指示线的过程中,角度绘制控件的中心点(即角度指示线的基点)不会移动,设定该中心点的坐标表示为(x0,y0)。移动控件本身可以是一块小区域,可以设定移动控件的控件坐标为移动控件的中心点坐标。
在一些实施例中,显示设备可以根据控件坐标和中心点坐标计算移动后的角度指示线对应的第一直线方程,并将第一直线方程的斜率标记为第一方向。
例如,移动后的移动控件的控件坐标为(x1,y1)。则可以根据控件坐标(x1,y1)和中心点坐标(x0,y0)计算角度指示线对应的直线方程,本公开实施例中称为第一直线方程,表示为y=K1x+b1。
在一些实施例中,可利用第一直线方程的斜率表示角度指示线的方向,本公开实施例中称为第一方向。
在设置角度的过程中,用户可以只移动一个角度指示线,也可以移动两个角度指示线。显示设备可以检测用户对两个角度指示线的移动操作,从而确定设置的角度参数。同时,显示设备可以分别计算移动后两个角度指示线的第一直线方程,从而获取两个角度指示线的第一方向。
图14为根据一些实施例的移动角度指示线的示意图。在一些实施例中,为了保证用户在移动角度指示线的过程中能够确认角的度数,可以实时显示当前所形成的角的度数。
由于角度绘制控件包括两个角度指示线,并且两个角度指示线的基点固定设置在角度绘制控件的圆心处,因此两个角度指示线的夹角即为当前角的度数。
在一些实施例中,显示设备可以获取两个角度指示线的夹角角度,并控制显示器在角度绘制控件中显示该夹角角度。
角度绘制控件可以是半圆形区域,角度绘制控件可以进一步划分为第一区域和第二区域。图15为根据一些实施例的角度绘制控件的示意图。如图15所示,第一区域Q1位半圆形区域,其圆心和角度绘制控件的圆心相同,均为R点,第一区域Q的半径小于角度绘制控件的半径。第二区域为角度绘制控件中除第一区域以外的区域,呈环形区域。
在一些实施例中,显示设备可以控制显示器在角度绘制控件的第一区域中显示夹角角度。例如,当前角度指示线L1和L2形成夹角度数D,第一区域Q1中可以显示夹角度数D。
在一些实施例中,用户可以移动角度指示线,以设置角的度数。在设置角度之后,用户可以继续绘制角的边。
由于角度指示线所在直线即为角的边所在直线,用户可以直接利用角度指示线绘制边,例如沿着角度指示线触控一段轨迹,用于表示绘制的边。
在一些实施例中,显示设备可以根据用户的触控轨迹绘制角的边。
在一些实施例中,在用户移动角度指示线后,显示设备可以获取触控组件采集的第一触控轨迹,并获取第一触控轨迹的第二方向。
需要说明的是,由于用户操作的多样性,在设置角度后,用户可能想要绘制角的边,也可能做一些其他操作,例如可以在角度绘制控件以外的区域绘制其他内容,或者移动角度绘制控件等操作。因此,用户设置角度后的触控操作不一定是绘制角的边的操作。显示设备需要检测用户的触控操作,以确认当前是否为绘制边的操作。因此,为了确认用户绘制边的操作,本公开实施例中可以设定为:用户在特定区域中的绘制线条操作为绘制边的操作。
角度绘制控件包括第一区域和第二区域,可以设置为用户在第一区域内发起的触控操作可以指示绘制边。
获取第一触控轨迹后,显示设备可以先检测第一触控轨迹的第一起始点的位置。
如果第一起始点位于第二区域中,则可以认为用户想要移动角度绘制控件,则可以根据第一触控轨迹移动角度绘制控件。
如果第一起始点位于角度绘制控件之外,则说明用户未对角度绘制控件进行控制,则可以控制显示器显示第一触控轨迹,例如绘制第一触控轨迹对应的线条。
如果第一起始点位于第一区域中,则说明用户在第一区域内发起触控操作,此时具有绘制边的可能性。需要说明的是,用户在第一区域内发起的触控操作不一定全都是绘制边的操作,因此还需要进一步检测。
在一些实施例中,显示设备可以获取第一触控轨迹的起始点的坐标,本公开实施例称为第一起始点坐标。进一步的,显示设备还可以获取第一触控轨迹的终止点的坐标,本公开实施例称为第一终止点坐标。
在一些实施例中,显示设备可以根据第一起始点坐标和第一终止点坐标计算第一触控轨迹对应的第二直线方程。例如,第一起始点坐标表示为(x11,y11),第一终止点坐标表示为(x12,y12),显示设备可以根据第一起始点坐标(x11,y11)和第一终止点坐标(x12,y12)计算第一触控轨迹对应的直线方程,本公开实施例中称为第二直线方程,表示为y=K2x+b2。
在一些实施例中,显示设备可以将第二直线方程的斜率标记为第二方向。并通过计算第一方向和第二方向的差值,来表示两个方向的角度差值,该角度差值在本公开实施例中称为第一方向差。
如果第一方向差小于或等于方向差阈值,则说明用户想要绘制边,显示设备可以根据第一触控轨迹在角度指示线上获取目标端点。本公开实施例中,设定目标端点为所要绘制边的端点。
在一些实施例中,在获取目标端点时,显示设备可以先获取第一终止点的横坐标,本公开实施例称为第一横坐标。
在一些实施例中,显示设备可以计算移动后的角度指示线对应的第一直线方程,表示为y=K1x+b1。然后根据第一横坐标和第一直线方程计算第一纵坐标。具体可将第一横坐标作为x值代入到第一直线方程中,得到的y值即为第一纵坐标。由此得到目标端点。其中,目标端点的横坐标为第一横坐标,目标端点的纵坐标为第一纵坐标。即,根据第一横坐标和第一纵坐标,在角度指示线中寻找对应的点作为目标端点。接下来,可将角度指示线的基点(即上述中心点)作为角的顶点,以目标端点作为边的端点,绘制角的边。这样,可以根据两个角度指示线绘制出对应的两条边,以形成角。
图16为根据一些实施例的绘制边的示意图。如图16所示,用户的第一触控轨迹的起始点为A1,终止点为B1。显示设备检测起始点A1的位置,位于第一区域中,则获取第一触控轨迹的第二方向,并且第二方向和第一方向的差值小于方向差阈值,则可以根据第一触控轨迹的终止点B1获取目标端点,从而绘制边。
在一些实施例中,用户可能具有接续绘制边的需求。例如,用户绘制某条边时可能手抖等原因导致脱离触控操作,由于边的长度和用户的触控轨迹相关,因此用户脱离触控可能导致绘制的边的长度较短,不满足用户需求,用户希望接续绘制从而将边延长。
在一些实施例中,显示设备可以获取触控组件采集的第三触控轨迹。在接续绘制边时,用户可以沿着边的方向接续绘制,因此要求用户的触控点较为靠近原来绘制的边,即较为靠近角度指示线。
在一些实施例中,显示设备可以先获取第三触控轨迹的第三起始点和角度指示线的距离。在获取距离时,可以做一条第三起始点到角度指示线的垂足线,并计算该垂足线的距离。
在一些实施例中,显示设备也可以获取第三起始点的坐标信息,并将第三起始点的横坐标代入到角度指示线的第一直线方程中,得到角度指示线对应的纵坐标值。具体可将第三起始点的纵坐标值和角度指示线对应的纵坐标值求差值,并将该差值作为第三起始点和角度指示线的距离。
在计算出距离后,如果距离小于或等于距离阈值,则说明用户可能想要接续绘制边,显示设备可以获取第三触控轨迹的第三方向。第三方向的获取步骤可以参照前述内容,此处不再赘述。
在一些实施例中,显示设备可以计算第一方向和第三方向的第二方向差。如果第二方向差小于或等于方向差阈值,则可以根据第三触控轨迹在角度指示线上获取接续端点,并根据接续端点接续绘制角的边。
在一些实施例中,用户接续绘制边时,触控轨迹可能向着角度指示线的基点绘制,也可能远离角度指示线的基点绘制。
在一些实施例中,显示设备可以获取第三触控轨迹的第三终止点的横坐标,本公开实施例中称为第二横坐标,还可以获取第三起始点的横坐标,本公开实施例中称为第三横坐标。
在一些实施例中,显示设备可以在角度指示线上获取第一端点和第二端点。其中,第一端点的横坐标为第二横坐标,第二端点的横坐标为第三横坐标。
在一些实施例中,显示设备可以计算第一端点和角度指示线的基点的第一距离,以及计算第二端点和角度指示线的基点的第二距离。
如果第一距离大于或等于第二距离,则将第一端点设置为接续端点;如果第一距离小于第二距离,则将第二端点设置为接续端点。
在获取到接续端点后,将接续端点作为边的端点,接续绘制边。
本公开实施例还提供了一种角的绘制方法,应用于显示设备,所述方法可包括:
响应于指示绘制角的指令,控制显示器显示角度绘制控件;所述角度绘制控件包括角度指示线;
响应于指示移动角度指示线的指令,移动所述角度指示线并获取移动后的角度指示线的第一方向;
获取触控组件采集的第一触控轨迹,并确定所述第一触控轨迹的第二方向;
计算所述第一方向和所述第二方向的第一方向差;如果所述第一方向差小于或等于方向差阈值,则根据所述第一触控轨迹在所述角度指示线上获取目标端点;
以所述角度指示线的基点为角的顶点,以所述目标端点为边的端点,绘制角的边。
在一些实施例中,角度指示线包括移动控件,所述方法还包括:控制显示器显示角度绘制控件后,获取触控组件采集的第二触控轨迹。检测第二触控轨迹的第二起始点的位置。如果第二起始点位于移动控件的响应范围内,则生成指示移动角度指示线的指令。
在一些实施例中,角度指示线的基点设置在角度绘制控件的量角区域圆心,所述移动角度指示线并获取移动后的角度指示线的第一方向,包括:将角度指示线的基点设置为静止点,以及根据第二触控轨迹移动移动控件。获取移动后移动控件的控件坐标以及角度绘制控件的量角区域圆心坐标。根据控件坐标和量角区域圆心坐标计算移动后角度指示线对应的第一直线方程,并将第一直线方程的斜率标记为第一方向。
在一些实施例中,角度绘制控件包括第一区域和第二区域,所述获取第一触控轨迹的第二方向,包括:检测第一触控轨迹的第一起始点的位置。如果第一起始点位于第一区域中,获取第一起始点坐标以及第一触控轨迹的第一终止点坐标。根据第一起始点坐标和第一终止点坐标计算第一触控轨迹对应的第二直线方程,并将第二直线方程的斜率标记为第二方向。
在一些实施例中,所述方法还包括:如果第一起始点位于第二区域中,则根据第一触控轨迹移动角度绘制控件。如果第一起始点位于角度绘制控件之外,则控制显示器显示第一触控轨迹。
在一些实施例中,根据第一触控轨迹在角度指示线上获取目标端点,包括:获取第一终止点的第一横坐标。计算移动后的角度指示线对应的第一直线方程。根据第一横坐标和第一直线方程计算第一纵坐标。获取目标端点,目标端点的横坐标为第一横坐标,目标端点的纵坐标为第一纵坐标。
在一些实施例中,所述方法还包括:绘制角的边后,获取触控组件采集的第三触控轨迹。获取第三触控轨迹的第三起始点和角度指示线的距离。如果距离小于或等于距离阈值,则获取第三触控轨迹的第三方向。计算第一方向和第三方向的第二方向差。如果第二方向差小于或等于方向差阈值,则根据第三触控轨迹在角度指示线上获取接续端点,并根据接续端点接续绘制角的边。
在一些实施例中,所述根据第三触控轨迹在角度指示线上获取接续端点,包括:获取第三触控轨迹的第三终止点的第二横坐标和第三起始点的第三横坐标。在角度指示线上获取第一端点和第二端点;第一端点的横坐标为第二横坐标,第二端点的横坐标为第三横坐标。计算第一端点和角度指示线的基点的第一距离,以及计算第二端点和角度指示线的基点的第二距离。如果第一距离大于或等于第二距离,则将第一端点设置为接续端点;如果第一距离小于第二距离,则将第二端点设置为接续端点。
在一些实施例中,角度绘制控件包括至少两个角度指示线,所述至少两个角度指示线的基点设置在角度绘制控件的中心点;所述方法还包括:移动角度指示线后,获取两个角度指示线的夹角角度。控制显示器在角度绘制控件的第一区域中显示夹角角度。
本说明书中各个实施例之间相同相似的部分互相参照即可,在此不再赘述。
本领域的技术人员可以清楚地了解到本公开实施例中的技术可借助软件加必需的通用硬件平台的方式来实现。基于这样的理解,本公开实施例中的实施方式本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在存储介质中,如ROM/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本公开各个实施例或者实施例的某些部分的方法。
最后应说明的是:以上各实施例仅用以说明本公开的实施方式,而非对其限制;尽管参照前述各实施例对本公开进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的实施方式进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应的实施方式的本质脱离本公开各实施例的范围。
为了方便解释,已经结合具体的实施方式进行了上述说明。但是,上述示例性的讨论不是意图穷尽或者将实施方式限定到上述公开的具体形式。根据上述的教导,可以得到多种修改和变形。上述实施方式的选择和描述是为了更好的解释原理以及实际的应用,从而使得本领域技术人员更好的使用实施方式以及适于具体使用考虑的各种不同的变形的实施方式。
Claims (10)
- 一种显示设备,包括:显示器,被配置为显示用户界面;所述显示器连接触控组件,所述触控组件用于采集用户输入的触控轨迹;至少一个处理器,与所述显示器连接,被配置执行计算机指令以使得所述显示设备执行:响应于指示绘制角的指令,控制显示器显示角度绘制控件;所述角度绘制控件包括角度指示线;响应于指示移动角度指示线的指令,移动所述角度指示线并获取移动后的角度指示线的第一方向;获取触控组件采集的第一触控轨迹,并确定所述第一触控轨迹的第二方向;计算所述第一方向和所述第二方向的第一方向差;如果所述第一方向差小于或等于方向差阈值,则根据所述第一触控轨迹在所述角度指示线上获取目标端点;以所述角度指示线的基点为角的顶点,以所述目标端点为边的端点,绘制角的边。
- 根据权利要求1所述的显示设备,所述角度指示线包括移动控件;所述至少一个处理器,被进一步配置为执行计算机指令以使得所述显示设备执行:控制显示器显示角度绘制控件后,还获取所述触控组件采集的第二触控轨迹;检测所述第二触控轨迹的第二起始点的位置;如果所述第二起始点位于所述移动控件的响应范围内,则生成指示移动角度指示线的指令。
- 根据权利要求2所述的显示设备,所述角度指示线的基点设置在所述角度绘制控件的量角区域圆心;所述至少一个处理器,具体被配置为执行计算机指令以使得所述显示设备通过下述执行移动所述角度指示线并获取移动后的角度指示线的第一方向:将所述角度指示线的基点设置为静止点,以及根据所述第二触控轨迹移动所述移动控件;获取移动后所述移动控件的控件坐标以及所述角度绘制控件的量角区域圆心坐标;根据所述控件坐标和所述量角区域圆心坐标,计算移动后的角度指示线对应的第一直线方程,并将所述第一直线方程的斜率标记为所述第一方向。
- 根据权利要求1所述的显示设备,所述角度绘制控件包括第一区域和第二区域,所述至少一个处理器,具体被配置为执行计算机指令以使得所述显示设备通过下述执行确定所述第一触控轨迹的第二方向:检测所述第一触控轨迹的第一起始点的位置;如果所述第一起始点位于所述第一区域中,则获取所述第一起始点坐标以及所述第一触控轨迹的第一终止点坐标;根据所述第一起始点坐标和所述第一终止点坐标计算所述第一触控轨迹对应的第二直线方程,并将所述第二直线方程的斜率标记为第二方向。
- 根据权利要求4所述的显示设备,所述至少一个处理器,被进一步配置为执行计算机指令以使得所述显示设备执行:如果所述第一起始点位于所述第二区域中,则根据所述第一触控轨迹移动所述角度绘制控件;如果所述第一起始点位于所述角度绘制控件之外,则控制显示器显示所述第一触控轨迹。
- 根据权利要求4所述的显示设备,所述至少一个处理器,具体被配置为执行计算机指令以使得所述显示设备通过下述执行根据所述第一触控轨迹在所述角度指示线上获取目标端点:获取所述第一终止点的第一横坐标;计算移动后的角度指示线对应的第一直线方程;根据所述第一横坐标和所述第一直线方程计算第一纵坐标;根据所述第一横坐标和所述第一纵坐标,确定所述目标端点。
- 根据权利要求1所述的显示设备,所述至少一个处理器,被进一步配置为执行计算机指令以使得所述显示设备执行:绘制所述角的边后,获取触控组件采集的第三触控轨迹;获取所述第三触控轨迹的第三起始点和所述角度指示线的距离;如果所述距离小于或等于所述距离阈值,则获取所述第三触控轨迹的第三方向;计算所述第一方向和所述第三方向的第二方向差;如果所述第二方向差小于或等于所述方向差阈值,则根据所述第三触控轨迹在所述角度指示线上获取接续端点,并根据所述接续端点接续绘制角的边。
- 根据权利要求7所述的显示设备,所述至少一个处理器,具体被配置为执行计算机指令以使得所述显示设备通过下述执行根据所述第三触控轨迹在所述角度指示线上获取接续端点:获取所述第三触控轨迹的第三终止点的第二横坐标和所述第三起始点的第三横坐标;在所述角度指示线上获取第一端点和第二端点;所述第一端点的横坐标为所述第二横坐标,所述第二端点的横坐标为所述第三横坐标;计算所述第一端点和所述角度指示线的基点的第一距离,以及所述第二端点和所述角度指示线的基点的第二距离;如果所述第一距离大于或等于所述第二距离,则将所述第一端点设置为所述接续端点;否则,将所述第二端点设置为所述接续端点。
- 根据权利要求1所述的显示设备,所述角度绘制控件至少包括两个角度指示线,所述至少两个角度指示线的基点设置在所述角度绘制控件的量角区域圆心;所述至少一个处理器,被进一步配置为执行计算机指令以使得所述显示设备执行:移动所述角度指示线后,获取两个角度指示线的夹角角度;控制显示器在所述角度绘制控件的第一区域中显示所述夹角角度。
- 一种角的绘制方法,应用于权利要求1-9任一项所述的显示设备,所述方法包括:响应于指示绘制角的指令,控制显示器显示角度绘制控件;所述角度绘制控件包括角度指示线;响应于指示移动角度指示线的指令,移动所述角度指示线并获取移动后的角度指示线的第一方向;获取触控组件采集的第一触控轨迹,并确定所述第一触控轨迹的第二方向;计算所述第一方向和所述第二方向的第一方向差;如果所述第一方向差小于或等于方向差阈值,则根据所述第一触控轨迹在所述角度指示线上获取目标端点;以所述角度指示线的基点为角的顶点,以所述目标端点为边的端点,绘制角的边。
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410467418.7 | 2024-04-18 | ||
| CN202410467418.7A CN119960653A (zh) | 2024-04-18 | 2024-04-18 | 显示设备和角的绘制方法 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2025218352A1 true WO2025218352A1 (zh) | 2025-10-23 |
Family
ID=95599201
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2025/078945 Pending WO2025218352A1 (zh) | 2024-04-18 | 2025-02-25 | 显示设备和角的绘制方法 |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN119960653A (zh) |
| WO (1) | WO2025218352A1 (zh) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112947783A (zh) * | 2021-01-18 | 2021-06-11 | 海信视像科技股份有限公司 | 一种显示设备 |
| CN115964007A (zh) * | 2023-01-13 | 2023-04-14 | 广州朗国电子科技股份有限公司 | 一种电子白板量角尺实现方法和装置 |
| CN117330014A (zh) * | 2023-09-28 | 2024-01-02 | 广州朗国电子科技股份有限公司 | 一种电子白板的角度测量方法、系统、设备及介质 |
-
2024
- 2024-04-18 CN CN202410467418.7A patent/CN119960653A/zh active Pending
-
2025
- 2025-02-25 WO PCT/CN2025/078945 patent/WO2025218352A1/zh active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112947783A (zh) * | 2021-01-18 | 2021-06-11 | 海信视像科技股份有限公司 | 一种显示设备 |
| CN115964007A (zh) * | 2023-01-13 | 2023-04-14 | 广州朗国电子科技股份有限公司 | 一种电子白板量角尺实现方法和装置 |
| CN117330014A (zh) * | 2023-09-28 | 2024-01-02 | 广州朗国电子科技股份有限公司 | 一种电子白板的角度测量方法、系统、设备及介质 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN119960653A (zh) | 2025-05-09 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110941383B (zh) | 双屏幕显示方法、装置、设备及存储介质 | |
| US11698721B2 (en) | Managing an immersive interface in a multi-application immersive environment | |
| CN111813302B (zh) | 投屏显示方法、装置、终端设备和存储介质 | |
| US20120299968A1 (en) | Managing an immersive interface in a multi-application immersive environment | |
| CN112181207B (zh) | 一种显示设备及几何图形识别方法 | |
| KR20150134674A (ko) | 사용자 단말 및 이의 제어 방법, 그리고 멀티미디어 시스템 | |
| CN114115637B (zh) | 显示设备及电子画板优化方法 | |
| CN116795273A (zh) | 交互式屏幕展示方法、装置、介质,及电子设备 | |
| CN116048370A (zh) | 显示设备及操作切换方法 | |
| CN117422057A (zh) | 一种显示设备及便签显示方法 | |
| CN115550717A (zh) | 一种显示设备及多指触控显示方法 | |
| WO2023065766A1 (zh) | 显示设备及其显示方法 | |
| CN115550716A (zh) | 一种显示设备和颜色混色显示方法 | |
| WO2023273761A1 (zh) | 一种显示设备及图像处理方法 | |
| CN119960653A (zh) | 显示设备和角的绘制方法 | |
| CN114339343A (zh) | 控制方法、装置、电子设备、介质和产品 | |
| CN119987641A (zh) | 一种显示设备及触控轨迹校准显示方法 | |
| CN119828910A (zh) | 一种显示设备及轨迹线绘制方法 | |
| CN119828909B (zh) | 一种显示设备及多应用触控显示的加速方法 | |
| WO2025200805A1 (zh) | 一种显示设备及绘画对象选择方法 | |
| CN119828907B (zh) | 一种显示设备及多屏显示方法 | |
| CN119937858A (zh) | 一种显示设备及触控轨迹的辅助绘线方法 | |
| WO2025092138A1 (zh) | 一种显示设备及用于显示设备的触控轨迹编辑方法 | |
| US12175062B2 (en) | Managing an immersive interface in a multi-application immersive environment | |
| WO2025218723A1 (zh) | 一种显示设备及触控选择方法 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 25789224 Country of ref document: EP Kind code of ref document: A1 |