CN111104078A - Control method, electronic device and non-transitory computer readable recording medium device - Google Patents
Control method, electronic device and non-transitory computer readable recording medium device Download PDFInfo
- Publication number
- CN111104078A CN111104078A CN201811267701.6A CN201811267701A CN111104078A CN 111104078 A CN111104078 A CN 111104078A CN 201811267701 A CN201811267701 A CN 201811267701A CN 111104078 A CN111104078 A CN 111104078A
- Authority
- CN
- China
- Prior art keywords
- screen
- touch
- information
- virtual
- data stream
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1423—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display
- G06F3/1431—Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display using a single graphics controller
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/1633—Constructional details or arrangements of portable computers not specific to the type of enclosures covered by groups G06F1/1615 - G06F1/1626
- G06F1/1637—Details related to the display arrangement, including those related to the mounting of the display in the housing
- G06F1/1647—Details related to the display arrangement, including those related to the mounting of the display in the housing including at least an additional display
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04845—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range for image manipulation, e.g. dragging, rotation, expansion or change of colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
Abstract
The invention provides a control method which is suitable for an electronic device. The control method comprises the following steps: detecting a virtual screen signal; configuring a virtual screen image buffer module for temporarily storing virtual screen image information according to the virtual screen signal; integrating the virtual screen image information and the second screen image information into an integrated image data stream in a direct mode; outputting the first screen image data stream to a first screen of the electronic device so that the first screen displays a first image according to the first screen image data stream; and outputting the integrated image data stream to a second screen of the electronic device, so that the second screen displays a second image according to the integrated image data stream.
Description
Technical Field
The invention relates to a control method, an electronic device and a non-transitory computer readable recording medium device.
Background
In recent years, dual-screen output has been widely used in various electronic devices because it can provide better user experience for users. When the electronic device is a notebook computer, the conventional method is to use one of the screens as an extended screen of the other screen. However, this conventional method cannot provide multiple application modes for users to apply to different situations. In addition, the conventional notebook computer has a lengthy transmission flow due to inefficient interaction between the two screens, and the overall performance is affected due to low touch response efficiency.
Disclosure of Invention
The embodiment of the invention provides a control method which is suitable for an electronic device. The control method comprises the following steps: detecting a virtual screen signal; configuring a virtual screen image buffer module according to the virtual screen signal for temporarily storing the virtual screen image information; integrating the virtual on-screen image information and the second on-screen image information into an integrated image data stream in a Direct Mode (Direct Mode); outputting the first screen image data stream to a first screen of the electronic device so that the first screen displays a first image according to the first screen image data stream; and outputting the integrated image data stream to a second screen of the electronic device, so that the second screen displays a second image according to the integrated image data stream.
The present invention further provides an electronic device, comprising: a first screen for displaying a first image according to a first screen image stream; a second screen for displaying a second image according to the integrated image data stream; the virtual screen module is used for generating a virtual screen signal; and the processing circuit is used for configuring the virtual screen image buffer module according to the virtual screen signal and temporarily storing the virtual screen image information, and the processing circuit integrates the virtual screen image information and the second screen image information into an integrated image data stream in a direct mode and outputs the integrated image data stream.
The present invention further provides a non-transitory computer readable recording medium device for storing at least one program. When the electronic device loads and executes at least one program, the at least one program can cause the electronic device to perform the following steps: detecting a virtual screen signal; configuring a virtual screen image buffer module for temporarily storing virtual screen image information according to the virtual screen signal; integrating the virtual screen image information and the second screen image information into an integrated image data stream in a direct mode; outputting the first screen image data stream to a first screen of the electronic device so that the first screen displays a first image according to the first screen image data stream; and outputting the integrated image data stream to a second screen of the electronic device, so that the second screen displays a second image according to the integrated image data stream.
Other features and embodiments of the present invention will be described in detail below with reference to the drawings.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments described in the present application, and other drawings can be obtained by those skilled in the art without creative efforts.
FIG. 1 is a block schematic diagram of an embodiment of an electronic device;
FIG. 2 is a flow chart illustrating an embodiment of a control method;
FIG. 3 is a schematic diagram of an embodiment of an electronic device operating in a normal power-on mode;
FIG. 4 is a schematic diagram illustrating an embodiment of an electronic device operating in a pen-electricity multiplexing mode;
FIG. 5 is a schematic diagram illustrating an embodiment of an electronic device operating in a panorama mode;
FIG. 6 is a schematic diagram illustrating an embodiment of an electronic device operating in a panorama multiplexing mode;
FIG. 7 is a schematic diagram illustrating an embodiment of an electronic device in a book mode;
fig. 8 is a flowchart illustrating another embodiment of the control method.
Detailed Description
Referring to fig. 1 to 8, the control method according to any embodiment of the present invention can be implemented in an electronic device 100, so that the electronic device 100 can be effectively switched to various application modes to provide a user with various applications through the electronic device 100. The electronic device 100 includes a first body 101, a second body 102, a virtual screen module 130 and a processing circuit 140, wherein the first body 101 includes a first screen 110, and the second body 102 includes a second screen 120. The first body 101 and the second body 102 may be connected to each other by a hinge. In some embodiments, the virtual screen module 130 and the processing circuit 140 may be integrated into the first body 101 or the second body 102. Herein, the virtual screen module 130 and the processing circuit 140 are integrated in the first body 101, but the invention is not limited thereto.
In an embodiment, the first screen 110 may be a display screen and the second screen 120 may be a touch display screen, and the user may perform various touch actions through the second screen 120, but the invention is not limited thereto, and both the first screen 110 and the second screen 120 may also be touch display screens, so that the user may perform various touch actions through the first screen 110 and the second screen 120.
The first screen 110 is used for displaying a first image I1 according to a first screen image data stream F1. In some embodiments, the first image I1 may include a user interface and its interface items, such as a desktop, a folder, an image (icon) of an application program, a system bar W1, etc., an image display when the application program is executed, an image display of a touch operation, an image display of a key input, or a combination thereof, but the invention is not limited thereto.
The second screen 120 is used for displaying a second image I2 according to the integrated image data stream F2. The processing circuit 140 is coupled to the first screen 110 and the second screen 120, and the processing circuit 140 can determine that the electronic device 100 currently has two displays by detecting the screen signal of the first screen 110 and the screen signal of the second screen 120.
The virtual screen module 130 is coupled to the processing circuit 140. Herein, the virtual screen module 130 is not a real display capable of displaying images, but the virtual screen module 130 can generate the virtual screen signal Sp to the processing circuit 140, so that the processing circuit 140 can determine that a third display capable of displaying images exists in the electronic device 100 according to the virtual screen signal Sp.
In some embodiments, the virtual screen module 130 and the generated virtual screen signal can be implemented in various ways according to the transmission interface adopted by the processing circuit 140. For example, in one embodiment, the virtual screen module 130 may be a Microcontroller (MCU), and a hot plug (HDP) signal of an embedded display interface (eDP), a display interface (DP) or a high-definition multimedia (HDMI) interface may be controlled by a general purpose input/output interface (GPIO) of the microcontroller to serve as the virtual screen signal Sp, so that the processing circuit 140 may accordingly consider that a third display generates the virtual screen signal Sp. In one embodiment, the virtual screen signal Sp includes resolution information. In another embodiment, the virtual screen module 130 may be a Scaler (Scaler), and the processing circuit 140 may generate the virtual screen signal Sp through a high-definition multimedia interface (hdmi/D-sub) interface or a video graphics array (VGA/D-sub) interface, so as to be considered to be generated by a third display. In yet another embodiment, the virtual screen module 130 is simulated by a driver.
Referring to fig. 1 and fig. 2, in an embodiment of the control method, the processing circuit 140 may detect the virtual screen signal Sp (step S10). After detecting the virtual screen signal Sp, the processing circuit 140 may configure a virtual screen image buffer module R3 for temporarily storing the virtual screen image information D1 according to the virtual screen signal Sp (step S20). Moreover, the processing circuit 140 may retrieve the virtual on-screen image information D1 from the virtual on-screen image buffer module R3, and integrate the virtual on-screen image information D1 and the second on-screen image information D2 into an integrated image stream F2 in a Direct Mode (step S30). Thereafter, the processing circuit 140 outputs the first on-screen video stream F1 to the first screen 110 so that the first screen 110 can display the first image I1 according to the first on-screen video stream F1 (step S40), and outputs the integrated image stream F2 to the second screen 120 so that the second screen 120 can display the second image I2 according to the integrated image stream F2 (step S50).
In some embodiments, the processing circuit 140 includes a processing module 141 and an integrating module 142. In an embodiment of the step S20, the processing circuit 140 configures the virtual-screen image buffer module R3 according to the virtual-screen signal Sp through the processing module 141. In addition, the processing module 141 can further configure a first video buffer module R1 according to the screen signal of the first screen 110, and configure a second video buffer module R2 according to the screen signal of the second screen 120. The first image buffer module R1 is used for temporarily storing the first on-screen image data stream F1. The second screen buffer module R2 is used for temporarily storing the second screen information D2. The virtual screen image buffer module R3 is used for temporarily storing the virtual screen image information D1.
In an embodiment of the step S40, the processing circuit 140 can output the first screen image data stream F1 from the first image buffer module R1 to the first screen 110 through the processing module 141, so that the first screen 110 displays the corresponding first image I1 according to the first screen image data stream F1.
In an embodiment of steps S30 and S50, the processing circuit 140 can integrate the virtual on-screen image information D1 and the second on-screen image information D2 into an integrated image stream F2 in a Direct Mode (Direct Mode) according to the interface layout information D4 of the second screen 120 through the integration module 142, and output the integrated image stream F2 to the second screen 120. It should be understood that the direct mode is an image processing and output mode directly controlled by software without being controlled by a general operating system. In some embodiments, the integration module 142 may include an integration program 1421 and an output driver 1422. The integration program 1421 is used to integrate the virtual on-screen image information D1 and the second on-screen image information D2 into an integrated image data stream F2 in a direct mode according to the interface layout information D4 of the second screen 120, and then the integrated image data stream F2 is sent to the output driver 1422 to be directly outputted to the second screen 120, so that the second screen 120 can display the second image I2 according to the integrated image data stream F2. It should be understood that the direct mode is an image processing and output mode directly controlled by software without being controlled by a general operating system.
Herein, the interface layout information D4 of the second screen 120 is area configuration information in the user interface configuration of the second screen 120, and the interface layout information D4 of the second screen 120 may have different area configurations according to different application modes of the electronic device 100.
In some embodiments, the interface layout information D4 of the second screen 120 may include a virtual keyboard region a1, a virtual touchpad region a2, an extended display region A3, or a combination thereof. The virtual keyboard area a1 can display a keyboard image covering a plurality of keys, so that a user can know what symbol or function is input corresponding to each touch position in each virtual keyboard area a 1. An image representing the touch pad can be displayed in the virtual touch pad area a2, so that the user can know that he/she can perform a touch operation in the virtual touch pad area a 2. The extended display area a3 is used as an extended display screen of the first screen 110 for users to use freely.
In some embodiments, the virtual screen image information D1 may be image information of an extended frame of the first screen 110, and the second screen image information D2 may be image information of a virtual keyboard and/or a virtual touchpad. In addition, the application modes of the electronic device 100 may include a general pen mode, a panorama mode, and a book mode, but the invention is not limited thereto.
Referring to fig. 1 and fig. 3, in an embodiment in which the application mode is a general handwriting mode, the interface layout information D4 of the second screen 120 of the electronic device 100 includes a virtual keyboard area a1 and a virtual touchpad area a 2. Moreover, the integration module 142 of the processing circuit 140 can output the second on-screen image information D2 generated in the direct mode and covering the virtual keyboard and the virtual touchpad as the integrated image data stream F2 to the second screen 120 according to the interface layout information D4, and further display the second image I2 with the virtual keyboard and the virtual touchpad on the second screen 120. It should be understood that the direct mode is an image processing and output mode directly controlled by software without being controlled by a general operating system.
Therefore, when the electronic device 100 is in the normal power mode, the user can touch the keys displayed in the virtual touchpad area a1 to cause the electronic device 100 to output corresponding characters or key functions on the screen of the first screen 110, and can control the cursor displayed on the first screen 110, execute the application program, or perform scrolling, zooming, etc. operations by clicking, sliding, etc. on the virtual touchpad area a2, and the way that the user operates the electronic device 100 is substantially the same as the normal power mode.
Referring to fig. 1 and 4, in an embodiment in which the application mode is the pen-electricity multiplexing mode, the interface layout information D4 of the second screen 120 of the electronic device 100 includes a virtual keyboard region a1 and an extended display region A3. Moreover, the integration module 142 of the processing circuit 140 can integrate the second screen image information D2 covering the virtual keyboard and the virtual screen image information D1 covering the extended screen of the first screen 110 into an integrated image data stream F2 in a preset display ratio and direct mode according to the interface layout information D4, and output the integrated image data stream F2 to the second screen 120, so as to display the second image I2 having the virtual keyboard and the extended screen on the second screen 120. Here, although the example in which the interface layout information D4 includes a combination of the virtual keyboard area a1 and the extended display area A3 is described, the virtual keyboard area a1 may be replaced with the virtual touchpad area a 2. In other words, the interface layout information D4 of the second screen 120 may also include the virtual touchpad area a2 and the extended display area A3. Moreover, the integration module 142 integrates the second screen image information D2 covering the virtual touch pad and the virtual screen image information D1 covering the extended frame of the first screen 110 into an integrated image data stream F2 in a preset display ratio and direct mode according to the interface layout information D4, and then outputs the integrated image data stream F2 to the second screen 120 in the direct mode, so as to display the second image I2 having the virtual touch pad and the extended frame on the second screen 120.
Therefore, when the electronic device 100 is in the pen-electricity multiplexing mode, the user can process different tasks on the extended display area a3 of the first screen 110 and the second screen 120 at the same time. In addition, the user can adjust the setting through the interface to cause the integration module 142 to change the integration ratio for integrating the virtual screen image information D1 and the second screen image information D2, so as to adjust the proportion of the extended display area A3 in the frame of the second screen 120 and the proportion of the virtual keyboard area a1 in the frame of the second screen 120.
Referring to fig. 1 and 5, in an embodiment in which the application mode is the panorama mode, the interface layout information D4 of the second screen 120 of the electronic device 100 may only include the extended display area A3. Moreover, the integration module 142 of the processing circuit 140 can output the virtual on-screen image information D1 covering the extended screen of the first screen 110 as the integrated image data stream F2 to the second screen 120 in the direct mode according to the interface layout information D4, and further display the second image I2 with the extended screen on the second screen 120.
Therefore, when the electronic device 100 is in the panorama mode, the user can operate the entire second screen 120 as an extended screen of the first screen 110. Moreover, the first screen 110 and the second screen 120 can jointly display a single job, thereby expanding the displayable range of the single job. Here, the system job list W1 is displayed on the second screen 120.
Referring to fig. 1 and 6, in an embodiment in which the application mode is the panorama multiplexing mode, the interface layout information D4 of the second screen 120 of the electronic device 100 may only include the extended display area A3. Moreover, the integration module 142 of the processing circuit 140 can output the virtual on-screen image information D1 covering the extended screen of the first screen 110 as the integrated image data stream F2 to the second screen 120 in the direct mode according to the interface layout information D4, and further display the second image I2 with the extended screen on the second screen 120. When the electronic device 100 is in the panorama multiplexing mode, the first screen 110 and the second screen 120 may display different tasks, respectively, so that a user may process different tasks at the same time.
Referring to fig. 1 and 7, in an embodiment in which the application mode is the book mode, the interface layout information D4 of the second screen 120 of the electronic device 100 may only include the extended display area A3. Moreover, the integration module 142 of the processing circuit 140 can output the virtual on-screen image information D1 covering the extended screen of the first screen 110 as the integrated image data stream F2 to the second screen 120 in the direct mode according to the interface layout information D4, and further display the second image I2 with the extended screen on the second screen 120. When the electronic device 100 is in the book mode, the user can use the electronic device 100 by rotating the electronic device horizontally by 90 degrees. Moreover, the images displayed on the first screen 110 and the second screen 120 can be adjusted according to the rotation direction of the electronic device 100. Here, fig. 7 is illustrated by rotating 90 degrees to the left, but the invention is not limited thereto.
Referring to fig. 1 and 8, in some embodiments, the second screen 120 may generate corresponding touch information D3 in response to the touch behavior of the user. The second screen 120 may include a touch information retrieving module 121 and a transmission control module 122. The touch information retrieving module 121 is configured to retrieve corresponding touch information D3 according to a user's touch behavior, and the transmission control module 122 is configured to transmit the touch information D3 retrieved by the touch information retrieving module 121 to the processing circuit 140. For example, the touch information D3 may include coordinate information and/or force information of the touch point. Therefore, when the processing circuit 140 performs the subsequent operation, the position and force of the touch by the user can be determined according to the touch information D3 to perform the corresponding operation.
In some embodiments, the transmission control module 122 may transmit the touch information to the processing circuit 140 through various wired or Wireless communication interfaces, such as an I2C interface, a USB (Universal Serial Bus) interface, a Wireless Universal Serial Bus (WUSB), a Bluetooth (Bluetooth), and the like, but the invention is not limited thereto.
In an embodiment of the control method, the processing circuit 140 receives the touch information D3 generated by the second screen 120 in response to the touch behavior of the user (step S60), and determines whether the touch behavior of the user belongs to the touch pad operation command or the touch screen operation command according to the touch information D3 (step S70). When the processing circuit 140 determines that the touch behavior belongs to the touch pad operation command, the processing circuit 140 may trigger a corresponding touch pad operation according to the touch information D3 (step S80). When the processing circuit 140 determines that the touch behavior belongs to the touch screen operation command, the processing circuit 140 triggers a corresponding touch screen operation according to the touch information D3 (step S90).
In one embodiment of step S60, the processing circuit 140 may include a driver module 143, and the processing circuit 140 may receive the touch information D3 through the driver module 143. In addition, the processing circuit 140 may further include a retrieving program module 144, and the processing circuit 140 may retrieve the input characteristics of the touch information D3 for subsequent use through the retrieving program module 144. In some embodiments, the captured input features may include input positions, number of packets, sliding distance, sliding time, clicking time interval, or a combination thereof, but the invention is not limited thereto, and the input features may be any suitable parameters for assisting the subsequent determination.
In an embodiment of step S70, the processing circuit 140 may further include an interface setting module 145 and a determining module 146. The interface setting module 145 may be used to generate the interface layout information D4 of the second screen 120. The determining module 146 determines whether the touch behavior belongs to a touch pad operation command or a touch screen operation command according to the interface layout information D4 and the touch information D3.
In some embodiments, the determining module 146 may determine that the touch behavior belongs to a touch pad operation instruction or a touch screen operation instruction according to which region of the interface layout information D4 the input position in the touch information D3 falls in. In some embodiments, when the input position in the touch information D3 is within the touchpad operation area or the button operation area, the determining module 146 may determine that the touch action belongs to the touchpad operation instruction. When the input position in the touch information D3 is within the extended display area, the determining module 146 determines that the touch action belongs to the touch screen operation command.
In an embodiment of step S80, the processing circuit 140 may further include a touch pad information processing module 147, and when the determining module 146 determines that the touch behavior belongs to the touch pad operation command, the determining module 146 may directly output the touch information D3 or the input characteristics extracted from the touch information D3 by the extracting module 144 to the touch pad information processing module 147, and the touch pad information processing module 147 outputs the touch pad information to the operating system for corresponding touch pad operation. Here, the touch pad operation is to perform touch positioning at a relative position.
In some embodiments, when the input position in the touch information D3 is within the touch pad operation area, the touch pad operation command may include a track operation command, a click input command, and the like, but the invention is not limited thereto. Taking the track operation command as an example, the track operation command and the corresponding touch pad operation thereof may be, for example: the sliding command of one finger causes the cursor (cursor) displayed in the first screen 110 or the second screen 120 to move according to the sliding command, or the sliding command of two fingers causes the frame displayed in the first screen 110 or the second screen 120 to be scrolled or zoomed, etc. Taking the click input command as an example, the click input command and the corresponding touch operation thereof may be, for example: a click input instruction, a double click input instruction, and the like to perform operations such as clicking or starting. When the input position in the touch information D3 is located in the touch key operation area, the touch pad operation command and the corresponding touch pad operation may include outputting a corresponding character or key function in the displayed image of the first screen 110 or the second screen 120 according to the character or key function corresponding to the touch pad operation command, but the invention is not limited thereto.
In some embodiments, the operating system may execute a corresponding touch operation with an in-built driver (Inbox driver), such as a Windows precision touch pad driver (Windows precision touch pad driver).
In an embodiment of the step S90, the processing circuit 140 may further include a touch screen information processing module 148, and when the determining module 146 determines that the touch behavior belongs to a touch screen operation command, the determining module 146 may directly output the touch information D3 or the input features extracted from the touch information D3 by the extractor module 144 to the touch screen information processing module 148, and the touch screen information processing module 148 is further output to the operating system for performing the corresponding touch screen operation. Here, the touch screen operation is to perform touch positioning at an absolute position.
In some embodiments, the touch screen operation command and the corresponding touch screen operation may include a click operation command such as a single-click operation command and a double-click operation command to perform a screen operation such as clicking or starting a program, a slide operation command to perform a slide screen operation, or a zoom operation command to perform a zoom screen operation, but the invention is not limited thereto.
In some embodiments, the control method according to any of the embodiments of the present invention can be implemented by a non-transitory computer readable recording medium device. The non-transitory computer readable recording medium device stores at least one program, so that when the electronic device 100 loads and executes the at least one program, the at least one program enables the electronic device 100 to execute the control method of any of the above embodiments. In one embodiment, the non-transitory computer readable recording medium device may be a storage inside the electronic device 100. In some embodiments, the storage may be implemented by one or more storage elements, and each storage element may be, but is not limited to, a non-volatile memory, such as a Read Only Memory (ROM) or a Flash memory, or a volatile memory, such as a Random Access Memory (RAM). In another embodiment, the non-transitory computer readable recording medium device can be a remote storage device and transmitted to the electronic device 100 through a wired or wireless manner. In another embodiment, the non-transitory computer readable recording medium device can be a storage device external to the electronic device 100, and is connected to and accesses the program code of the storage device through a reader or a connector of the electronic device 100.
In some embodiments, the processing circuit 140 may be implemented by a SoC chip, a Central Processing Unit (CPU), a Microcontroller (MCU), an Application Specific Integrated Circuit (ASIC), or the like. In addition, the first screen 110 and/or the second screen 120 can be a capacitive touch display screen, a resistive touch display screen, or other touch display screens made by using suitable touch sensing elements.
In summary, in the control method, the electronic device and the non-transitory computer readable recording medium device according to the embodiments of the invention, after the processing circuit is enabled to additionally configure the virtual screen image buffer module for storing the virtual screen image information through the virtual screen signal, the processing circuit can integrate the virtual screen image information and the second screen image information into an integrated image data stream and output the integrated image data stream to the second screen for displaying, so as to provide a plurality of application modes for users to select. In addition, the judging module judges that the touch behavior belongs to the touch control panel operation instruction or the touch control screen operation instruction according to the touch control information and then executes the corresponding touch control panel operation or touch control screen operation through the operating system, so that the transmission flow of the touch control information can be simplified, the transmission rate is improved, and the mutual communication between the two screens can be realized only by one operating system.
The above-described embodiments and/or implementations are only for illustrating the preferred embodiments and/or implementations of the present technology, and are not intended to limit the implementations of the present technology in any way, and those skilled in the art may make modifications or changes to other equivalent embodiments without departing from the scope of the technical means disclosed in the present disclosure, but should be construed as the technology or implementations substantially the same as the present technology.
Claims (11)
1. An electronic device, comprising:
a first screen for displaying a first image according to a first screen image stream;
a second screen for displaying a second image according to the integrated image data stream;
the virtual screen module is used for generating a virtual screen signal; and
the processing circuit is used for configuring a virtual screen image buffer module according to the virtual screen signal and temporarily storing virtual screen image information, integrating the virtual screen image information and second screen image information into the integrated image data stream in a direct mode, and outputting the first screen image data stream and the integrated image data stream.
2. The electronic device of claim 1, wherein said processing circuit comprises:
a processing module configured to configure a first image buffer module, a second screen image buffer module and the virtual screen image buffer module, wherein the first image buffer module is used to temporarily store the first screen image data stream, the second screen image buffer module is used to temporarily store the second screen image information, and the processing module outputs the first screen image data stream from the first image buffer module to the first screen; and
the integration module integrates the virtual screen image information and the second screen image information into the integrated image data stream according to the interface layout information of the second screen, and outputs the integrated image data stream to the second screen.
3. The electronic device of claim 2, wherein the interface layout information comprises an extended display area, a virtual keyboard area, a virtual touchpad area, or a combination thereof.
4. The electronic device of claim 2, wherein the second screen is further configured to generate touch information in response to a touch action, and the processing circuit is further configured to determine whether the touch action belongs to a touch pad operation command or a touch screen operation command according to the touch information, wherein the processor triggers a corresponding touch pad operation according to the touch information when the touch action belongs to the touch pad operation command, and triggers a corresponding touch screen operation according to the touch information when the touch action belongs to the touch screen operation command.
5. The electronic device of claim 4, wherein the processing circuit comprises:
the interface setting module is used for generating the interface layout information; and
and the judging module is used for judging that the touch behavior belongs to the touch control panel operating instruction or the touch control screen operating instruction according to the touch control information and the interface layout information.
6. A control method applied to an electronic device is characterized by comprising the following steps:
detecting a virtual screen signal;
configuring a virtual screen image buffer module according to the virtual screen signal for temporarily storing virtual screen image information;
integrating the virtual screen image information and the second screen image information into an integrated image data stream in a direct mode;
outputting a first screen image data stream to a first screen of the electronic device so that the first screen displays a first image according to the first screen image data stream; and
outputting the integrated image data stream to a second screen of the electronic device, so that the second screen displays a second image according to the integrated image data stream.
7. The method of claim 6, wherein the integrating step integrates the virtual on-screen image information and the second on-screen image information into the integrated video data stream according to the interface layout information of the second screen.
8. The control method of claim 7, wherein the interface layout information comprises an extended display area, a virtual keyboard area, a virtual touchpad area, or a combination thereof.
9. The control method according to claim 6, further comprising:
receiving touch information generated by the second screen in response to the touch behavior;
judging whether the touch behavior belongs to a touch panel operation instruction or a touch screen operation instruction according to the touch information;
when the touch behavior belongs to the touch control panel operation instruction, triggering corresponding touch control panel operation according to the touch control information; and
and when the touch behavior belongs to the touch screen operation instruction, triggering corresponding touch screen operation according to the touch information.
10. The method of claim 9, wherein the determining step determines whether the touch behavior belongs to the touch pad operation command or the touch screen operation command according to the touch information and the interface layout information.
11. A non-transitory computer readable recording medium device storing a program, wherein when the program is loaded into and executed by an electronic device, the program causes the electronic device to perform the following steps:
detecting a virtual screen signal;
a virtual screen image buffer module for temporarily storing the virtual screen image information is configured according to the virtual screen signal;
integrating the virtual screen image information and the second screen image information into an integrated image data stream in a direct mode;
outputting a first screen image data stream to a first screen of the electronic device so that the first screen displays a first image according to the first screen image data stream; and
outputting the integrated image data stream to a second screen of the electronic device, so that the second screen displays a second image according to the integrated image data stream.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811267701.6A CN111104078B (en) | 2018-10-29 | 2018-10-29 | Control method, electronic device and non-transitory computer readable recording medium device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811267701.6A CN111104078B (en) | 2018-10-29 | 2018-10-29 | Control method, electronic device and non-transitory computer readable recording medium device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111104078A true CN111104078A (en) | 2020-05-05 |
| CN111104078B CN111104078B (en) | 2023-04-25 |
Family
ID=70420164
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811267701.6A Active CN111104078B (en) | 2018-10-29 | 2018-10-29 | Control method, electronic device and non-transitory computer readable recording medium device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111104078B (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060034043A1 (en) * | 2004-08-10 | 2006-02-16 | Katsumi Hisano | Electronic device, control method, and control program |
| TW200910167A (en) * | 2007-08-20 | 2009-03-01 | Inventec Appliances Corp | Computer system with multi-touch screen |
| CN102150095A (en) * | 2008-09-08 | 2011-08-10 | 高通股份有限公司 | Multi-fold mobile device with configurable interface |
| CN102187296A (en) * | 2008-09-08 | 2011-09-14 | 高通股份有限公司 | Sending a parameter based on screen size or screen resolution of a multi-panel electronic device to a server |
| CN103164137A (en) * | 2011-12-15 | 2013-06-19 | 宏碁股份有限公司 | Identification method for cross-screen operation and electronic device |
| CN103428548A (en) * | 2012-05-22 | 2013-12-04 | Lg电子株式会社 | Image display apparatus and method for operating the same |
| TW201440030A (en) * | 2013-01-04 | 2014-10-16 | Qualcomm Mems Technologies Inc | Device and method for rendering content to multiple displays |
| US20170255442A1 (en) * | 2016-03-02 | 2017-09-07 | Samsung Electronics Co., Ltd. | Electronic device and method for displaying and transmitting images thereof |
| CN107632667A (en) * | 2017-10-26 | 2018-01-26 | 上海龙旗科技股份有限公司 | A kind of equipment and double-screen notebook for realizing dummy keyboard |
-
2018
- 2018-10-29 CN CN201811267701.6A patent/CN111104078B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20060034043A1 (en) * | 2004-08-10 | 2006-02-16 | Katsumi Hisano | Electronic device, control method, and control program |
| TW200910167A (en) * | 2007-08-20 | 2009-03-01 | Inventec Appliances Corp | Computer system with multi-touch screen |
| CN102150095A (en) * | 2008-09-08 | 2011-08-10 | 高通股份有限公司 | Multi-fold mobile device with configurable interface |
| CN102187296A (en) * | 2008-09-08 | 2011-09-14 | 高通股份有限公司 | Sending a parameter based on screen size or screen resolution of a multi-panel electronic device to a server |
| CN103164137A (en) * | 2011-12-15 | 2013-06-19 | 宏碁股份有限公司 | Identification method for cross-screen operation and electronic device |
| CN103428548A (en) * | 2012-05-22 | 2013-12-04 | Lg电子株式会社 | Image display apparatus and method for operating the same |
| TW201440030A (en) * | 2013-01-04 | 2014-10-16 | Qualcomm Mems Technologies Inc | Device and method for rendering content to multiple displays |
| US20170255442A1 (en) * | 2016-03-02 | 2017-09-07 | Samsung Electronics Co., Ltd. | Electronic device and method for displaying and transmitting images thereof |
| CN107632667A (en) * | 2017-10-26 | 2018-01-26 | 上海龙旗科技股份有限公司 | A kind of equipment and double-screen notebook for realizing dummy keyboard |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111104078B (en) | 2023-04-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11402992B2 (en) | Control method, electronic device and non-transitory computer readable recording medium device | |
| WO2019184490A1 (en) | Method for use in displaying icons of hosted applications, and device and storage medium | |
| US20140089824A1 (en) | Systems And Methods For Dynamically Altering A User Interface Based On User Interface Actions | |
| CN109471692B (en) | Display control method and terminal equipment | |
| TW201421350A (en) | Method for displaying images of touch control device on external display device | |
| EP3447626A2 (en) | Display apparatus and control method thereof | |
| US11169700B2 (en) | Electronic device and control method thereof | |
| TWI471762B (en) | Touch pen, electronic device and interactive operation method | |
| CN110262985B (en) | Processing method and electronic equipment | |
| US8988369B1 (en) | Restricted carousel with built-in gesture customization | |
| US20140043267A1 (en) | Operation Method of Dual Operating Systems, Touch Sensitive Electronic Device Having Dual Operating Systems, and Computer Readable Storage Medium Having Dual Operating Systems | |
| US20220121355A1 (en) | Terminal, method for controlling same, and recording medium in which program for implementing the method is recorded | |
| US20190302952A1 (en) | Mobile device, computer input system and computer readable storage medium | |
| CN111104078B (en) | Control method, electronic device and non-transitory computer readable recording medium device | |
| CN109558051B (en) | Switching processing method and device of multifunctional page and computer readable storage medium | |
| TWI686742B (en) | Control method, electronic device and non-transitory computer readable storage medium device | |
| US20130205201A1 (en) | Touch Control Presentation System and the Method thereof | |
| CN111104079A (en) | Control method, electronic device and non-transitory computer readable recording medium device | |
| US11081088B2 (en) | Image display method, apparatus, and terminal device | |
| JP2021076959A (en) | Information processing device and information processing method | |
| US20120013550A1 (en) | Method for controlling the interactions of a user with a given zone of a touch screen panel | |
| US11762501B2 (en) | Information processing apparatus and control method | |
| KR20200033640A (en) | Terminal, method for contrlling thereof and recording medium on which a program for implemeting the method | |
| CN110730944B (en) | Amplified input panel | |
| WO2017063141A1 (en) | Setting cursor position in text on display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |