CN114727142B

CN114727142B - Display equipment and collaborative drawing method

Info

Publication number: CN114727142B
Application number: CN202210330352.8A
Authority: CN
Inventors: 董率; 张振宝; 肖媛
Original assignee: Hisense Visual Technology Co Ltd
Current assignee: Hisense Visual Technology Co Ltd
Filing date: 2022-03-30
Publication date: 2024-05-31
Anticipated expiration: 2042-03-30

Abstract

The application provides a display device and a collaborative drawing method, and provides a display device and a collaborative drawing method, wherein when a user inputs a control instruction for indicating to cancel a history drawing operation to a first display device, the control instruction is responded, and an input device for inputting the history drawing operation is detected; if the input device is a second display device which performs collaborative drawing with the first display device, sending a revocation request to the second display device to request the second display device to feed back first feedback information for indicating agreement to revoke; and in response to receiving the first feedback information, refreshing the electronic drawing board interface, and sending a synchronization instruction to the server to instruct the server to send a synchronization request to each display device participating in collaborative drawing so as to refresh the electronic drawing board interface of each second display device. The method and the device solve the problem that the user can cancel the content input by other display equipment at will when performing the cancel operation, and are beneficial to the experience of the user.

Description

Display equipment and collaborative drawing method

Technical Field

The application relates to the technical field of intelligent television drawing boards, in particular to display equipment and a collaborative drawing method.

Background

The display device refers to a terminal device capable of outputting a specific display screen, such as a smart television, a mobile terminal, a smart advertisement screen, a projector, and the like. Taking intelligent electricity as an example, the intelligent television can be based on the Internet application technology, has an open operating system and a chip, has an open application platform, can realize a bidirectional man-machine interaction function, and is a television product integrating multiple functions of video, entertainment, education, data and the like, and the intelligent television is used for meeting the diversified and personalized requirements of users. For example, a drawing board application software can be installed on the smart television for a user to draw.

In the related art, a plurality of display devices may be connected through a network to realize information sharing, so that a plurality of users may perform collaborative drawing through different display devices, so as to display the same drawing content in each display device.

However, in the above scenario, when each display device performs the undoing operation, the content edited on the drawing in the last time will be directly undone, and the content is not distinguished by which user is editing the content, that is, the target user may undo the content edited by other users at will, so as to affect the interactive experience of other users.

Disclosure of Invention

The application provides a display device and a collaborative drawing method, which are used for solving the problem that when a user performs a cancel operation, the user can cancel the content input by other display devices at will, and is beneficial to the experience of the user.

In a first aspect, the present application provides a display apparatus comprising:

the display is configured to display an electronic drawing board interface, the electronic drawing board interface comprises a control area and a drawing area, the control area comprises at least one control used for carrying out input operation on the drawing area, and the drawing area is used for presenting input content;

a communicator configured to establish a communication connection with a server to cause the display device to act as a first display device in conjunction with at least one second display device connected to the server;

A controller configured to:

acquiring a control instruction which is input by a user and indicates to cancel historical drawing operation;

An input device that detects input of the history drawing operation in response to the control instruction;

If the input device is the second display device, sending a revocation request to the input device, wherein the revocation request comprises an inquiry instruction for revoking the historical drawing operation, and the revocation request is used for requesting the second display device to feed back first feedback information for indicating approval of the revocation after approval of the revocation of the historical drawing operation;

refreshing the electronic drawing board interface in response to receiving the first feedback information;

and sending a synchronization instruction to the server, wherein the synchronization instruction is used for instructing the server to send a synchronization request to each second display device so as to refresh the electronic drawing board interface of each second display device.

In a second aspect, the present application also provides a display apparatus, including:

A communicator configured to establish a communication connection with a server to cause the display device to act as a second display device in cooperation with a first display device connected to the server;

A controller configured to:

Receiving a revocation request sent by the first display device, wherein the revocation request comprises an inquiry instruction for revoke historical drawing operations, and the revocation request is used for requesting the second display device to feed back first feedback information used for indicating approval of revocation after approval of revoked historical drawing operations;

In response to an instruction input by a user and used for agreeing to the withdrawal request, sending first feedback information to the first display device, enabling the first display device to refresh an electronic drawing board interface of the first display device when receiving the first feedback information so as to withdraw the history drawing operation displayed by the first display device, and enabling the first display device to send a synchronization instruction to the server, wherein the synchronization instruction is used for instructing the server to send a synchronization request to the second display device;

Receiving a synchronization request sent by the server;

and refreshing the electronic drawing board interface.

In a third aspect, the present application provides a collaborative drawing method, applied to a first display device, including:

Establishing a communication connection with a server to cause the first display device to co-operate with at least one second display device connected to the server;

As can be seen from the above technical solution, the present application provides a display device and a collaborative drawing method, when a user inputs a control instruction indicating to cancel a history drawing operation to a first display device, an input device for inputting the history drawing operation is detected in response to the control instruction; if the input device is a second display device which performs collaborative drawing with the first display device, sending a revocation request to the second display device to request the second display device to feed back first feedback information for indicating agreement to revoke; and in response to receiving the first feedback information, refreshing the electronic drawing board interface, and sending a synchronization instruction to the server to instruct the server to send a synchronization request to each display device participating in collaborative drawing so as to refresh the electronic drawing board interface of each second display device. The method and the device solve the problem that the user can cancel the content input by other display equipment at will when performing the cancel operation, and are beneficial to the experience of the user.

Drawings

In order to more clearly illustrate the technical solution of the present application, the drawings that are needed in the embodiments will be briefly described below, and it will be obvious to those skilled in the art that other drawings can be obtained from these drawings without inventive effort.

FIG. 1 is a usage scenario of a display device in some embodiments;

FIG. 2 is a block diagram of a hardware configuration of a display device in some embodiments;

FIG. 3 is a software configuration diagram in a display device in some embodiments;

FIG. 4 is a user interface diagram displayed by a display device in some embodiments;

FIG. 5 is a schematic diagram of an application list in some embodiments;

FIG. 6 is a schematic diagram of an electronic palette in some embodiments;

FIG. 7 is an invitation interface diagram in some embodiments;

FIG. 8 is a collaborative drawing scene graph in some embodiments;

FIG. 9 is a diagram of information interactions when performing a revocation operation in some embodiments;

FIG. 10 is a schematic diagram of an operating chain in some embodiments;

FIG. 11 is a schematic diagram of an electronic palette interface in some embodiments;

FIG. 12 is a schematic diagram of an electronic palette interface in some embodiments;

FIG. 13 is a schematic diagram of an electronic palette interface in some embodiments;

FIG. 14 is a schematic diagram of an electronic palette interface in some embodiments;

FIG. 15 is an interface diagram of a display device engaged in collaborative drawing prior to undoing operations in some embodiments;

FIG. 16 is an interface diagram of a display device engaged in collaborative drawing after a undo operation in some embodiments;

FIG. 17 is a diagram of information interaction when a revocation operation is performed in one of some embodiments;

FIG. 18 is a diagram of information interaction when a revocation operation is performed in one of some embodiments;

FIG. 19 is a diagram of information interaction when a revocation operation is performed in one of some embodiments;

FIG. 20 is a diagram of an information interaction for resuming a history drawing operation in some embodiments;

FIG. 21 is an interface diagram of a display device engaged in collaborative drawing prior to a resume operation in some embodiments;

FIG. 22 is an interface diagram of a display device engaged in collaborative drawing after a resume operation in some embodiments;

FIG. 23 is a flow chart of a collaborative painting method in some embodiments;

FIG. 24 is a flow chart of a collaborative painting method in some embodiments.

Detailed Description

Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The embodiments described in the examples below do not represent all embodiments consistent with the application. Merely exemplary of systems and methods consistent with aspects of the application as set forth in the claims.

For the purposes of making the objects and embodiments of the present application more apparent, an exemplary embodiment of the present application will be described in detail below with reference to the accompanying drawings in which exemplary embodiments of the present application are illustrated, it being apparent that the exemplary embodiments described are only some, but not all, of the embodiments of the present application.

It should be noted that the brief description of the terminology in the present application is for the purpose of facilitating understanding of the embodiments described below only and is not intended to limit the embodiments of the present application. Unless otherwise indicated, these terms should be construed in their ordinary and customary meaning.

The terms first, second, third and the like in the description and in the claims and in the above-described figures are used for distinguishing between similar or similar objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.

The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements explicitly listed, but may include other elements not expressly listed or inherent to such product or apparatus.

The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code that is capable of performing the function associated with that element.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in fig. 1, the display device 200 is also in data communication with a server 400, and a user can operate the display device 200 through the smart device 300 or the control apparatus 100.

In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device 200 includes at least one of infrared protocol communication or bluetooth protocol communication, and other short-range communication modes, and the display device 200 is controlled by a wireless or wired mode. The user may control the display apparatus 200 by inputting a user instruction through at least one of a key on a remote controller, a voice input, a control panel input, and the like.

In some embodiments, the smart device 300 may also be used to control the display device 200. For example, the display device 200 is controlled using a camera application running on a smart device.

In some embodiments, the smart device 300 and the display device 200 may also be used for communication of data.

In some embodiments, the display device 200 may also perform control in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received through a module configured inside the display device 200 device for acquiring voice commands, or the voice command control of the user may be received through a voice control apparatus configured outside the display device 200 device.

In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be permitted to make communication connections via a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display device 200. The server 400 may be a cluster, or may be multiple clusters, and may include one or more types of servers.

Fig. 2 shows a hardware configuration block diagram of a display device in accordance with an exemplary embodiment.

In some embodiments, display apparatus 200 includes at least one of a modem 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, memory, a power supply, a user interface.

In some embodiments the controller comprises a central processor, a video processor, an audio processor, a graphics processor, RAM, ROM, a first interface for input/output to an nth interface.

In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, for receiving an image signal from the controller output, for displaying video content, image content, and components of a menu manipulation interface, and a user manipulation UI interface, etc.

In some embodiments, the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, or other network communication protocol chip or a near field communication protocol chip, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the control device 100 or the server 400 through the communicator 220.

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for capturing the intensity of ambient light; either the detector 230 comprises an image collector, such as a camera, which may be used to collect external environmental scenes, user attributes or user interaction gestures, or the detector 230 comprises a sound collector, such as a microphone or the like, for receiving external sounds.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, or the like. The input/output interface may be a composite input/output interface formed by a plurality of interfaces.

In some embodiments, the controller 250 controls the operation of the display device 200 and responds to user operations through various software control programs stored on the memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command to select a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.

In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other operable control. The operations related to the selected object are: displaying an operation of connecting to a hyperlink page, a document, an image, or the like, or executing an operation of a program corresponding to the icon.

In some embodiments the controller includes at least one of a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processor (Graphics Processing Unit, GPU), RAM Random Access Memory, RAM), ROM (Read-Only Memory, ROM), first to nth interfaces for input/output, a communication Bus (Bus), and the like.

A CPU processor. The system is used for executing the operating system and camera application instructions stored in the memory and executing various camera applications, data and contents according to various interaction instructions received from the outside so as to finally display and play various audio and video contents. The CPU processor may include a plurality of processors. Such as one main processor and one or more sub-processors.

In some embodiments, a graphics processor is used to generate various graphical objects, such as: at least one of icons, operation menus, and user input instruction display graphics. The graphic processor comprises an arithmetic unit, which is used for receiving various interactive instructions input by a user to operate and displaying various objects according to display attributes; the device also comprises a renderer for rendering various objects obtained based on the arithmetic unit, wherein the rendered objects are used for being displayed on a display.

In some embodiments, a user may input a user command through a Graphical User Interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the Graphical User Interface (GUI). Or the user may input the user command by inputting a specific sound or gesture, the user input interface recognizes the sound or gesture through the sensor, and receives the user input command.

In some embodiments, a "user interface" is a media interface for interaction and exchange of information between a camera application or operating system and a user that enables conversion between an internal form of information and a form acceptable to the user. A commonly used presentation form of a user interface is a graphical user interface (Graphic User Interface, GUI), which refers to a graphically displayed user interface that is related to computer operations. It may be an interface element such as an icon, a window, a control, etc. displayed in a display screen of the electronic device, where the control may include at least one of a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.

In some embodiments, the user interface 280 is an interface (e.g., physical keys on the body of the display device 200, or the like) that may be used to receive control inputs.

In some embodiments, the system of display device 200 may include a Kernel (Kernel), a command parser (shell), a file system, and a camera application. The kernel, shell, and file system together form the basic operating system architecture that allows users to manage files, run programs, and use the system. After power-up, the kernel is started, the kernel space is activated, hardware is abstracted, hardware parameters are initialized, virtual memory, a scheduler, signal and inter-process communication (IPC) are operated and maintained. After the kernel is started, shell and user camera application are loaded. The camera application is compiled into machine code after start-up, forming a process.

Referring to fig. 3, in some embodiments, the system is divided into four layers, from top to bottom, a camera application (Applications) layer (simply "application layer"), a camera application framework (Application Framework) layer (simply "framework layer"), a An Zhuoyun line (Android runtime) and a system library layer (simply "system runtime layer"), and a kernel layer, respectively.

In some embodiments, at least one camera application is running in the camera application layer, where the camera application may be a Window (Window) program, a system setup program, or a clock program, etc. of the operating system; or may be a camera application developed by a third party developer. In particular implementations, the camera application packages in the camera application layer are not limited to the above examples.

The framework layer provides an application programming interface (application programming interface, API) and programming framework for camera applications of the camera application layer. The camera application framework layer includes some predefined functions. The camera application framework layer corresponds to a processing center that decides to let the camera application in the application layer act. The camera application can access the resources in the system and acquire the services of the system in the execution through the API interface.

As shown in fig. 3, the camera application framework layer in the embodiment of the present application includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an activity manager (ACTIVITY MANAGER) is used to interact with all activities running in the system; a Location Manager (Location Manager) is used to provide system services or applications with access to system Location services; a file package manager (PACKAGE MANAGER) for retrieving various information about camera application packages currently installed on the device; a notification manager (Notification Manager) for controlling the display and clearing of notification messages; a Window Manager (Window Manager) is used to manage bracketing icons, windows, toolbars, wallpaper, and desktop components on the user interface.

In some embodiments, the activity manager is used to manage the lifecycle of the individual camera applications and the usual navigation rollback functions, such as controlling the exit, opening, fallback, etc. of the camera applications. The window manager is used for managing all window programs, such as obtaining the size of the display screen, judging whether a status bar exists or not, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window to display, dithering display, distorting display, etc.), etc.

In some embodiments, the system runtime layer provides support for the upper layer, the framework layer, and when the framework layer is in use, the android operating system runs the C/C++ libraries contained in the system runtime layer to implement the functions to be implemented by the framework layer.

In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 3, the kernel layer contains at least one of the following drivers: audio drive, display drive, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (e.g., fingerprint sensor, temperature sensor, pressure sensor, etc.), and power supply drive, etc.

In some embodiments, the display device 200 may have a touch interaction function, and a user may touch the display 260 with a finger to implement an interaction operation instead of a keyboard, a mouse, a remote controller, etc., so that man-machine interaction is more straightforward. Based on the display device 200, the touch component can be added to enable the display device 200 to support the touch interaction function. In general, the touch assembly may together form a touch screen with the display 260. On the touch screen, the user can input different control instructions through touch operation. For example, a user may input touch instructions such as clicking, sliding, long pressing, double clicking, etc., and different touch instructions may represent different control functions.

To implement the above-mentioned different control commands, the touch assembly may generate different electrical signals when the user inputs different touch actions, and send the generated electrical signals to the controller 250. The controller 250 may perform feature extraction on the received electrical signal to determine a control function to be performed by the user based on the extracted features.

For example, when a user enters a click touch action at any program icon location in the application program interface, the touch component will sense the touch action and thereby generate an electrical signal. After receiving the electrical signal, the controller 250 may determine the duration of the level corresponding to the touch action in the electrical signal, and recognize that the user inputs the click command when the duration is less than the preset time threshold. The controller 250 then extracts the location features generated by the electrical signals to determine the touch location. When the touch position is within the application icon display range, it is determined that a click touch instruction is input by the user at the application icon position. Accordingly, the click touch instruction is used to perform a function of running a corresponding application program in the current scenario, and thus the controller 250 may start running the corresponding application program.

For another example, when the user inputs a sliding motion in the media presentation page, the touch assembly also sends the sensed electrical signal to the controller 250. The controller 250 first determines the duration of the signal corresponding to the touch action in the electrical signal. When the duration time is determined to be longer than the preset time threshold value, the position change condition generated by the signals is judged, and obviously, the generation position of the signals changes for the interactive touch action, so that the user is determined to input a sliding touch instruction. The controller 250 then determines the sliding direction of the sliding touch command according to the change condition of the signal generating position, and controls the page turning of the display screen in the media display page so as to display more media options. Further, the controller 250 may further extract characteristics such as a sliding speed and a sliding distance of the sliding touch instruction, and perform a picture control of turning pages according to the extracted characteristics, so as to achieve a following effect.

Similarly, for the touch instructions such as double-click and long-press, the controller 250 may extract different features, determine the type of the touch instruction through feature judgment, and execute corresponding control functions according to a preset interaction rule. In some embodiments, the touch assembly also supports multi-touch, such that a user may enter touch actions on the touch screen via multiple fingers, e.g., multi-finger clicks, multi-finger long presses, multi-finger swipes, etc.

The touch control action can be matched with a specific application program to realize a specific function. For example, after the user opens the drawing board application, the display 260 may present a drawing area, the user may draw a specific touch action track in the drawing area through the sliding touch instruction, and the controller 250 determines a touch action pattern through the touch action detected by the touch component and controls the display 260 to display in real time, so as to satisfy the demonstration effect.

In some embodiments, multiple applications may be installed in the display device 200, and FIG. 4 illustrates a user interface displayed by the display in some embodiments, where a user may click on "My applications" in the user interface, triggering the display of an application list. All applications that the display device 200 has installed are included in the application list.

Fig. 5 shows a schematic diagram of an application list in some embodiments. As shown in figure 6. The display device 200 may be installed with a drawing board application, a player application, a video chat application, a camera application, and a mirror application. When the application list is displayed in the display, the user can select one of the applications and open the application to trigger the interface for displaying the application, for example, the user can select to open the drawing board application to trigger the display to display the interface corresponding to the drawing board application, and the user can perform drawing operation in the interface corresponding to the drawing board application to display corresponding content in the interface.

In some embodiments, the controller may control the display of the electronic palette in the display when the user initiates the palette application. An interactive region corresponding to one or more functions of the palette application is displayed on the electronic palette interface in which may be displayed, such as text, images, icons, key buttons, drop-down menus, check boxes, selectable listings, and the like. The user may make contact with the touch screen at a location where interaction is desired to interact with the interaction area. The display device 200 detects a contact and responds to the detected contact by performing a corresponding operation.

In some embodiments, FIG. 6 is an exemplary electronic palette interface, as shown in FIG. 6, that includes a drawing area 610 and a control area 620, where the drawing area 610 is an area where content may be entered. The control section 620 may display item entries corresponding to one or more functions of the palette application, including a brush item 621, an eraser item 622, a delete item 623, a screen entry 624, a collaborative drawing item 625, a resume item 626, a cancel item 627, etc., which a user may click on to trigger the display device 200 to display a corresponding item interface, and may also set parameters of some items on the item interface. For example, the user may click on a brush item, trigger the display to display a brush toolbar, select items such as a brush type, a brush color, a line type, a line thickness, and the like based on the brush toolbar, and after the selection is completed, the brush tool is in a pickup state, and the user may control the brush tool to perform a corresponding drawing operation in the drawing area.

In some embodiments, when the user clicks the collaborative drawing item 625, the display device 200 may respond to the clicking action input by the user, display an invitation interface as shown in fig. 7, display a user list to be invited in the invitation interface, where the user list to be invited includes a plurality of user ID/device ID items that can invite to perform collaborative drawing, and the display device 200 may respond to the user selecting operation on the corresponding items, access other display devices according to the user ID/device ID of the selected item to invite the corresponding display device to perform collaborative drawing, where collaborative drawing refers to displaying the same drawing content in electronic pictures of display devices participating in collaborative drawing, for example, the display device initiating collaborative drawing may be used as a first display device, and the display device accepting the invitation of collaborative drawing may be used as a second display device.

In the related art, when the first display device and the second display device participate in collaborative drawing together, each drawing operation input in the electronic drawing board interfaces of the first display device and the second display device is stored in the memory of the first display device according to the input time sequence, after receiving the cancel/restore instruction, the first display device reads only the drawing operation of the last step each time, for example, N times of operations are stored in the memory of the first display device, and when the cancel/restore operation is executed, the cancel operation can only be executed from the nth time. And whether the most further drawing operation is input by the first display device or not, the first display device directly cancels/restores the drawing operation and sends a cancel/restore instruction to the second display device so as to cancel/restore the corresponding drawing operation in the electronic drawing board interface of the second display device, thereby reducing the experience of a user who uses the second display device to perform collaborative drawing.

In addition, if the user wants to cancel a certain painting operation input before, for example, the user wants to cancel an mth painting operation, where M is between 1 and N, all the painting operations from M to N must be sequentially cancelled, which is disadvantageous to the user experience.

Therefore, in order to solve the above technical problems and increase the experience of the user, the embodiment of the application provides a display device, wherein the display device establishes communication connection with a server through a built-in communicator, so that the display device is used as a first display device to cooperate with at least one second display device connected with the server to draw pictures.

It can be understood that the first display device and the second display device in the present application may be the same display device, for example, the first display device and the second display device are both smart televisions, and the first display device and the second display device may also be different display devices, for example, the first display device is a smart television, and the second display device is a terminal device such as a mobile phone, a tablet computer, or the like. For convenience of explanation, the controller, the memory and the communicator of the first display device in the embodiment of the present application are respectively referred to as a first controller, a first memory and a first communicator, and the electronic drawing board interface presented by the first display device is referred to as a first electronic drawing board interface; the controller, the memory, and the communicator of the second display device are referred to as a second controller, a second memory, and a second communicator, respectively, and the electronic-palette interface presented by the second display device is referred to as a second electronic-palette interface.

Fig. 8 is a schematic diagram of a collaborative drawing according to an embodiment of the present application, where, as shown in fig. 8, a first communicator establishes a communication connection with a server, a second communicator of at least one second display device also establishes a communication connection with the server, and information interaction is completed between the first display device and each second display device through the communication connection established between the first communicator, the server and the second communicator.

In some embodiments, the first controller may receive a plurality of control instructions input by a user. Each control command corresponds to a control function, and part of the control commands can be used for canceling the content displayed on the first electronic drawing board interface.

As shown in fig. 9, when a user inputs a control instruction indicating withdrawal of a history drawing operation to the first controller, the first controller may detect an input device inputting the history drawing operation in response to the control instruction.

The historical drawing operation is a drawing operation input in the first electronic drawing board interface or the second electronic drawing board interface in advance, and when a user inputs the drawing operation in the first electronic drawing board interface, the first controller responds to the drawing operation input by the user in the first electronic drawing board interface and stores the drawing operation in the first memory. The drawing operation input by the user on the first electronic drawing board interface refers to an event that the user changes the content in the first electronic drawing board interface through operation, for example, the user picks up a drawing tool, and a touch track is left on the first electronic drawing board interface and can be regarded as a drawing operation; the user picks up the rubber tool, and erases part of the content displayed in the first electronic drawing board interface to be regarded as a drawing operation; and clicking the undo item by the user to undo the content displayed on the first electronic drawing board interface by a certain input operation of the user can also be regarded as a drawing operation. The first memory stores the drawing operation input by the user on the first electronic drawing board interface, and then sends a synchronization instruction to the server, wherein the synchronization instruction is used for instructing the server to send the drawing operation input by the user on the first electronic drawing board interface to each second display device.

After the second display device receives the drawing operation input by the user on the first electronic drawing board interface, the second controller controls the second display device to store the drawing operation input by the user on the first electronic drawing board interface into the second memory, and refreshes the second electronic drawing board interface according to the drawing operation stored in the second memory, and the refreshed second electronic drawing board interface and the first electronic drawing board interface display the same drawing content. And the second controller responds to the drawing operation input by the user on the second electronic drawing board interface, can store the drawing operation input by the user on the second electronic drawing board interface into the second memory, and sends a synchronous instruction to the server so as to instruct the server to send the drawing operation input by the user on the second electronic drawing board interface to the first display device. After the first display device receives the drawing operation input by the user on the second electronic drawing board interface, the first controller controls the first electronic drawing board interface to be stored in the first memory, and refreshes the first electronic drawing board interface according to the drawing operation stored in the first memory so as to display corresponding content.

The first memory and the second memory are respectively stored with an operation record list, and the operation record list is used for storing drawing operations input by a user on the first electronic drawing board interface and the second electronic drawing board interface.

When the operation record list stores the painting operation input by the user on the first electronic drawing board interface and the second electronic drawing board interface, the first controller and the second controller mark the painting operation according to the equipment identification of the input equipment of the painting operation, and store the painting operation in the operation record list according to the time sequence of the input of each painting operation.

The operation record list may be an operation chain, where the operation chain includes a plurality of nodes, each drawing operation of the user may be stored on a node of the operation chain, as shown in fig. 10, for the first display device, after the user inputs the drawing operation a on the first electronic drawing board interface, the first controller marks the drawing operation a with the first display device, and stores the drawing operation a on the first node of the operation chain, after receiving the drawing operation B input by the user on the second electronic drawing board interface, marks the drawing operation B with the second display device, and stores the drawing operation B on the second node of the operation chain, so that, after each time the user completes a drawing operation on the first electronic drawing board interface and the second electronic drawing board interface, the first controller marks the drawing operation with the device mark input the drawing operation, and sequentially stores the marked drawing operations on the nodes of the operation chain according to the input time sequence, where the information stored on each node may include drawing type information, width information, shape information, and shape information of the drawing type input by the user, and the application may not be limited.

In addition, for the second display device, the manner in which the second controller controls the operation record list storing the drawing operations input in the first electronic drawing board interface and the second electronic drawing board interface into the second memory is the same as the manner in which the first controller controls the drawing operations input in the first electronic drawing board interface and the second electronic drawing board interface to be stored in the first memory, which is not described in detail herein.

In some embodiments, the first electronic-palette interface includes a first drawing area and a first control area, where the first drawing area is drawn in a part or all of an area of the first layer, the first control area is drawn in a part or all of an area of the second layer, the first layer and the second layer may be disposed in parallel on the first electronic-palette interface, the second layer may also be disposed in a floating manner on an upper layer of the first layer, a user may select the second layer, and move the second layer to an arbitrary position on the upper layer of the first layer through touch dragging.

In some embodiments, as further shown in fig. 6, the first control area includes a cancel item 627 for indicating that the input historical drawing operation is to be canceled, the user clicks the cancel item 627 to input a cancel instruction for the historical drawing operation to the first controller, the first controller generates a third layer after receiving the cancel instruction input by the user, and draws the third layer according to the operation record list stored in the first memory, and the third layer is arranged in a floating manner on an upper layer of the second layer to display related options of the operation record list in the first electronic drawing board interface.

The related options of the operation record list may be a thumbnail list displayed in the form of a picture as shown in fig. 11, the thumbnail list including history drawing operations input by respective display devices participating in collaborative drawing displayed in the form of a thumbnail, any one of the lists corresponding to one history drawing operation. Each history drawing operation is marked or displayed in the thumbnail, for example, when the history drawing operation input by the user is a line or a graph, each history drawing operation input by the user is in a text box to prompt the user to know the drawing operation corresponding to the current thumbnail. Or when the history drawing operation input by the user is a storage filter or a filling color, there is also a thumbnail corresponding to the history drawing operation, and a screen after the storage filter or the filling color is displayed in the thumbnail. In addition, the input device ID/user ID for inputting each history drawing operation is also marked in the thumbnail, so that the user can intuitively understand the input device for inputting each history drawing operation. The thumbnail list is arranged in a time axis, scroll controls are respectively arranged on two sides of the time axis, and clicking the scroll controls can control the time axis to scroll, so that the complete thumbnail list is browsed. After the user selects the historical drawing operation in the operation record list, the first controller responds to the selected operation to acquire the equipment identifier for marking the first target historical event, and detects the input equipment for inputting the historical drawing operation according to the equipment identifier.

In some embodiments, after receiving a control instruction input by a user and indicating to cancel a history drawing operation, the first controller may display an operation object of a selectable history drawing operation in the first electronic drawing board interface as shown in fig. 12, and after receiving a selection operation of the operation object of the history drawing operation by the user, detect an input device for inputting the history drawing operation in response to the selection operation. After receiving a control instruction input by a user and indicating to cancel the historical drawing operation, the first controller controls drawing of selectable operation objects of the historical drawing operation on a first image layer so as to display the selectable operation objects of the historical drawing operation in a first electronic drawing board interface, a user can click on any operation object to perform selected operations, and the first controller controls drawing of a selected box on the first image layer in response to the selected operation of the user so as to prompt the user that the operation object is selected.

In some embodiments, after receiving a control instruction input by the user and indicating to cancel the historical drawing operation, the first controller may generate a fourth layer, and draw the fourth layer according to the identifier of each display device participating in collaborative drawing, so as to display a user list as shown in fig. 13 in the first electronic drawing board interface. When a user performs a selection operation on an identifier of a display device in a user list, the first controller responds to the selection operation to obtain a history drawing operation input by the selected display device in an electronic drawing board interface of the user in an operation record list, arranges the history drawing operation parts according to a time sequence of the electronic drawing board interface input by the selected display device, generates an operation record list corresponding to the selected display device, and redraws a fourth layer according to the operation record list of the selected display device so as to display related options of the operation record list shown in fig. 14 on the first electronic drawing board interface, and after the user performs the selection operation on the history drawing operation in the operation record list, the first controller responds to the selection operation to directly determine the selected display device as an input device.

In some embodiments, if the first controller detects that the input device inputting the history drawing operation to be undone is the second display device, an undo request is sent to the input device, the undo request including an inquiry instruction to undo the specified history drawing operation to request the input device to feed back first feedback information indicating approval to undo after approval to undo the history drawing operation. The first display device may send the revocation request directly to the input device through a local area network, bluetooth transmission, or the like, or may send the revocation request to a server and instruct the server to forward the revocation request to the input device.

After the input device receives the revocation request sent by the first display device, the second controller responds to the received revocation request, and displays a 'revocation selection' page for selecting whether to receive the revocation request as shown in fig. 15 on a second electronic drawing board interface, wherein the 'revocation selection' confirmation interface comprises a 'receiving' option and a 'rejecting' option, and when a user selects the 'receiving' option/'rejecting' option, the second controller controls to generate feedback information for indicating agreement/rejection of revocation and sends corresponding feedback information to the first display device.

In some embodiments, after the first display device receives feedback information sent by the second display device and used for indicating that the historical drawing operation is to be cancelled, the first controller deletes the historical drawing operation from the operation record list in response to the received feedback information, redraws the first layer according to the drawing operation in the updated operation record list, and sends a synchronization instruction to the server, where the synchronization instruction is used to instruct the server to send a synchronization request to each second display device connected to the server, so as to refresh a second electronic drawing board interface of each second display device, as shown in fig. 16, so that the second display device and the first display device display the same content.

In some embodiments, the first controller detects whether other historical drawing operations are deleted in the operation record list before performing a undo operation on the historical drawing operations in response to received feedback information indicating agreement to undo the historical drawing operations; if so, judging that a revocation record list exists in the first display device, wherein the revocation record list is used for storing the history painting operation deleted in the operation record list; if the historical drawing operation does not exist, judging that a revocation record list does not exist, generating the revocation record list, and storing the historical drawing operation into the revocation record list.

The revocation record list may be a recovery chain including a plurality of nodes, the history drawing operations deleted from the operation record list by the user are sequentially stored on the nodes of the recovery chain according to the deletion time, for example, the user sequentially revokes the history drawing operations a, B, and C, which are sequentially deleted from the operation record list/operation chain and sequentially stored on the nodes of the recovery chain, that is, the history drawing operations a are stored on the first node of the recovery chain, the history drawing operations B are stored on the second node of the recovery chain, and the history drawing operations C are stored on the third node of the recovery chain.

In some embodiments, when the first controller stores the history painting operation in the revocation list, the first controller marks the history painting operation with a device identifier of the first display device, so that each second display device needs to send a recovery request to the first display device when performing a recovery operation on the history painting operation, the recovery request includes an inquiry instruction for recovering the history painting operation, when the first display device agrees to the recovery request, the first controller feeds back feedback information indicating that the recovery is agreed to the second display device, and after the second display device receives the feedback information, the second controller can perform the recovery operation on the history painting operation.

In some embodiments, as shown in fig. 17, an operation record list and a revocation record list may also be stored in the server, and after the server receives the synchronization instruction sent by the first display device, the server deletes the history drawing operation from the operation record list in the server and stores the history drawing operation in the revocation record list of the server, so as to refresh the second electronic-palette interfaces of the second display devices according to the updated operation record list of the server, so that the second electronic-palette interfaces and the first electronic-palette interfaces display the same content.

In some embodiments, as shown in fig. 18, the second memory of the second display device may also store an operation record list and a revocation record list, after the second controller receives a request from the second display device to send a revocation history drawing operation, if the user sends a grant revocation instruction to the second display device, the second controller may delete the history drawing operation from the operation record list and store the history drawing operation in the revocation record list in response to the instruction sent by the user, and then refresh the electronic drawing board interface and send a synchronization instruction to the server to instruct the server to refresh pages of the first display device and the other display devices participating in the collaborative drawing, so that each display device participating in the collaborative drawing displays the same content.

In some embodiments, referring to fig. 19, if the first controller detects that the input device inputting the history drawing operation to be undone is the first display device, the history drawing operation is directly deleted from the operation record list and stored in the undone record list, the first electronic drawing board interface is refreshed according to the updated operation record list, and a synchronization instruction is sent to the server, where the synchronization instruction is used to instruct the server to send a synchronization request to each second display device to refresh the second electronic drawing board interface of each second display device, so that the second display device and the first display device display the same content.

In some embodiments, the user may click on a resume item on the first electronic palette interface to input a resume instruction to the first controller, and the first controller triggers, in response to the resume instruction input by the user, display of a related option to undo the record list on the first electronic palette interface, the undo record list including all drawing operations deleted in the operation record list.

The revocation list may be a thumbnail list displayed in a form of a picture, the thumbnail list includes history drawing operations to be restored displayed in a form of a thumbnail, wherein any one of the revocation list corresponds to one of the history drawing operations to be restored in the revocation list, and contents executed when each of the history drawing operations is restored are marked or displayed in the thumbnail, for example, when the history drawing operations in the revocation list are lines or graphics, each of the history drawing operations to be restored is visualized in a form of a dotted line to prompt a user to know the history drawing operation to be restored corresponding to the current thumbnail. Or when the history drawing operation to be restored is a storage filter or a filling color, there is also a thumbnail corresponding to the history drawing operation, in which a screen after storing the filter or the filling color is displayed. The thumbnail list is arranged in a time axis, scroll controls are respectively arranged on two sides of the time axis, and clicking the scroll controls can control the time axis to scroll, so that the complete thumbnail list is browsed.

Fig. 20 is an information interaction diagram of a recovery history painting operation provided by some embodiments, fig. 21 is an interface diagram before a recovery operation is performed on a display device participating in collaborative painting in an embodiment of the present application, fig. 22 is an interface diagram after a recovery operation is performed on a display device participating in collaborative painting in an embodiment of the present application, as shown in fig. 20, when a user wants to recover a history painting operation, a selection operation may be performed on at least one corresponding withdrawn target history painting operation option in a thumbnail list shown in fig. 21, a first controller detects an input device performing a withdrawal operation on the history painting operation in response to a selection operation of the user, sends a request for recovering the target history painting operation to the input device, deletes the history painting operation selected by the user in a withdrawal list after the request is successful, and stores the history painting operation selected by the user in the operation list, and then, refreshes a first electronic drawing board interface and sends a synchronization instruction to a server, the synchronization instruction is used to instruct the server to send a synchronization request to each second display device connected to the server, so that the second electronic drawing board and the first electronic drawing board display device are identical to the second display device.

In some embodiments, after the first display device sends a request for restoring the second target historical drawing operation to the input device, if the user sends an approval to restore instruction to the second display device, the second controller may delete the historical drawing operation from the operation record list and store the historical drawing operation in the revocation record list in response to the instruction sent by the user, and then refresh the electronic drawing board interface and send a synchronization instruction to the server to instruct the server to refresh pages of the first display device and the other display devices participating in the collaborative drawing, so that each display device participating in the collaborative drawing displays the same content.

In some embodiments, if the first controller detects that the input device inputting the history drawing operation to be restored is the first display device, the history drawing operation to be restored is directly deleted from the revocation record list and stored in the operation record list, the first electronic-palette interface is refreshed according to the updated operation record list, and a synchronization instruction is sent to the server, where the synchronization instruction is used to instruct the server to send a synchronization request to each second display device, so that the second display device and the first display device display the same content.

In some embodiments, the present application further provides a display device, where the display device establishes communication connection with a server through a built-in communicator, so as to execute all interactive contents when the second display device participates in collaborative drawing in the above embodiments, and the present application is not repeated herein.

In some embodiments, as shown in fig. 23 and fig. 24, the present application further provides a collaborative drawing method, which is applied to the first display device in the above embodiments, and the method includes the following steps:

s1: establishing a communication connection with a server to cause the first display device to co-operate with at least one second display device connected to the server;

s2: acquiring a control instruction which is input by a user and indicates to cancel historical drawing operation;

s3: an input device that detects input of the history drawing operation in response to the control instruction;

In some embodiments, the input device that inputs the history painting operation at the detection further includes: displaying selectable operation objects of the history drawing operation in the electronic drawing board interface; receiving a selected operation input by a user aiming at the operation object; an input device that inputs the history drawing operation is detected in response to the selected operation.

In some embodiments, the input device that inputs the history painting operation at the detection further includes: displaying an operation record list on the electronic drawing board interface, wherein the operation record list comprises at least one historical drawing operation input on the electronic drawing board interface of the first display device and at least one historical drawing operation input on the electronic drawing board interface of each second display device; receiving a selected operation input by a user aiming at the operation record list; an input device that inputs the history drawing operation is detected in response to the selected operation.

In some embodiments, the input device that inputs the history painting operation at the detection further includes: displaying a user list on the electronic drawing board interface, wherein the user list comprises identifiers of display devices participating in collaborative drawing; receiving a selection operation of a user on the identification of the display equipment in the user list; and in response to the selected operation, refreshing the electronic drawing board interface to display an operation record list of the selected display device on the refreshed electronic drawing board interface, wherein the operation record list of the selected display device comprises the historical drawing operation input on the electronic drawing board interface of the selected display device.

In some embodiments, the input device that detects input of the history painting operation further comprises: if the input device is the first display device, refreshing the electronic drawing board interface; and sending a synchronization instruction to the server, wherein the synchronization instruction is used for instructing the server to send a synchronization request to each second display device so as to refresh the electronic drawing board interface of each second display device.

S4: if the input device is the second display device, sending a revocation request to the input device, wherein the revocation request comprises an inquiry instruction for revoking the historical drawing operation, and the revocation request is used for requesting the second display device to feed back first feedback information for indicating approval of the revocation after approval of the revocation of the historical drawing operation;

S5: refreshing the electronic drawing board interface in response to receiving the first feedback information;

in some embodiments, the sending a revocation request to the input device further comprises: receiving second feedback information which is fed back by the second display device and used for representing refusal of revocation; and responding to the received second feedback information, and displaying a feedback result on the electronic drawing board interface.

In some embodiments, refreshing the electronic palette interface further comprises: deleting the withdrawn historical drawing operation in the operation record list; storing the historical drawing operation that was revoked in a revocation record list; and refreshing the electronic drawing board interface according to the history drawing operation in the deleted operation record list.

In some embodiments, the method further comprises: acquiring a recovery instruction which is input by a user and indicates to recover the historical drawing operation; detecting an input device indicating to cancel the history drawing operation control instruction in response to the recovery instruction; if the input device is a second display device, sending a recovery request to the second display device, wherein the recovery request comprises an inquiry instruction for recovering the history drawing operation, and the recovery request is used for requesting the second display device to feed back third feedback information for indicating approval of recovery after approval of recovery of the history drawing operation; refreshing the electronic palette interface in response to receiving the third feedback information; and sending a synchronization instruction to the server to instruct the server to send a synchronization complex request to each second display device.

In some embodiments, the responding to receiving the third feedback information further comprises: deleting the history drawing operations in the revocation record list; and storing the history painting operation in the operation record list.

S6: and sending a synchronization instruction to the server, wherein the synchronization instruction is used for instructing the server to send a synchronization request to each second display device so as to refresh the electronic drawing board interface of each second display device.

In a specific implementation, the present invention further provides a computer storage medium, where the computer storage medium may store a program, where the program may include some or all of the steps in each embodiment of the collaborative drawing method provided by the present invention when executed. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), a random-access memory (random access memory RAM), or the like.

It will be apparent to those skilled in the art that the techniques of embodiments of the present invention may be implemented in software plus a necessary general purpose hardware platform. Based on such understanding, the technical solutions in the embodiments of the present invention may be embodied in essence or what contributes to the prior art in the form of a software product, which may be stored in a storage medium, such as a ROM/RAM, a magnetic disk, an optical disk, etc., including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the method described in the embodiments or some parts of the embodiments of the present invention.

The same or similar parts between the various embodiments in this specification are referred to each other. In particular, for the display device embodiments, since they are substantially similar to the method embodiments, the description is relatively simple, and reference should be made to the description of the method embodiments for the matters.

The embodiments of the present invention described above do not limit the scope of the present invention.

Claims

1. A display device, characterized by comprising:

A controller configured to:

2. The display device according to claim 1, wherein in the input device step of detecting the history painting operation input, the controller is further configured to:

displaying selectable operation objects of the history drawing operation in the electronic drawing board interface;

Receiving a selected operation input by a user aiming at the operation object;

an input device that inputs the history drawing operation is detected in response to the selected operation.

3. The display device according to claim 1, wherein in the input device step of detecting the history painting operation input, the controller is further configured to:

Displaying an operation record list on the electronic drawing board interface, wherein the operation record list comprises at least one historical drawing operation input on the electronic drawing board interface of the first display device and at least one historical drawing operation input on the electronic drawing board interface of each second display device;

receiving a selected operation input by a user aiming at the operation record list;

4. The display device according to claim 1, wherein in the input device step of detecting the history painting operation input, the controller is further configured to:

displaying a user list on the electronic drawing board interface, wherein the user list comprises identifiers of display devices participating in collaborative drawing;

Receiving a selection operation of a user on the identification of the display equipment in the user list;

And in response to the selected operation, refreshing the electronic drawing board interface to display an operation record list of the selected display device on the refreshed electronic drawing board interface, wherein the operation record list of the selected display device comprises the historical drawing operation input on the electronic drawing board interface of the selected display device.

5. The display device of claim 4, wherein in the step of refreshing the electronic palette interface, the controller is further configured to:

Deleting the withdrawn historical drawing operation in the operation record list;

storing the historical drawing operation that was revoked in a revocation record list;

And refreshing the electronic drawing board interface according to the history drawing operation in the deleted operation record list.

6. The display device of claim 1, wherein after the step of sending a revocation request to the input device, the controller is further configured to:

Receiving second feedback information which is fed back by the second display device and used for representing refusal of revocation;

and responding to the received second feedback information, and displaying a feedback result on the electronic drawing board interface.

7. The display device according to claim 1, wherein after the step of detecting an input device that inputs the history painting operation, the controller is further configured to:

if the input device is the first display device, refreshing the electronic drawing board interface;

8. The display device of claim 5, wherein the controller is further configured to:

acquiring a recovery instruction which is input by a user and indicates to recover the historical drawing operation;

detecting an input device indicating to cancel the history drawing operation control instruction in response to the recovery instruction;

If the input device is a second display device, sending a recovery request to the second display device, wherein the recovery request comprises an inquiry instruction for recovering the history drawing operation, and the recovery request is used for requesting the second display device to feed back third feedback information for indicating approval of recovery after approval of recovery of the history drawing operation;

refreshing the electronic palette interface in response to receiving the third feedback information;

and sending a synchronization instruction to the server to instruct the server to send a synchronization complex request to each second display device.

9. The display device of claim 8, wherein in the responsive to receiving the third feedback information step, the controller is further configured to:

Deleting the history painting operation to be restored in the revocation record list;

And storing the historical drawing operation to be restored in the operation record list.

10. A display device, characterized by comprising:

A controller configured to:

Receiving a revocation request sent by the first display device, wherein the revocation request comprises an inquiry instruction for revoke historical drawing operations, and the revocation request is used for requesting the second display device to feed back first feedback information used for indicating approval of revocation after approval of revoked historical drawing operations; the history drawing operation is input to the first display device by the second display device;

Receiving a synchronization request sent by the server;

and refreshing the electronic drawing board interface.

11. A collaborative painting method applied to a first display device, comprising:

refreshing an electronic drawing board interface of the first display device in response to receiving the first feedback information;