WO2019010828A1 - Smart device and operation method therefor, apparatus and computer storage medium - Google Patents

Smart device and operation method therefor, apparatus and computer storage medium Download PDF

Info

Publication number
WO2019010828A1
WO2019010828A1 PCT/CN2017/103246 CN2017103246W WO2019010828A1 WO 2019010828 A1 WO2019010828 A1 WO 2019010828A1 CN 2017103246 W CN2017103246 W CN 2017103246W WO 2019010828 A1 WO2019010828 A1 WO 2019010828A1
Authority
WO
WIPO (PCT)
Prior art keywords
touch
signal
display area
input channel
display
Prior art date
Application number
PCT/CN2017/103246
Other languages
French (fr)
Chinese (zh)
Inventor
陈俊伟
Original Assignee
广州视源电子科技股份有限公司
广州视睿电子科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广州视源电子科技股份有限公司, 广州视睿电子科技有限公司 filed Critical 广州视源电子科技股份有限公司
Publication of WO2019010828A1 publication Critical patent/WO2019010828A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range

Definitions

  • the present invention relates to the field of display technologies, and in particular, to a smart device, an operating method and apparatus thereof, and a computer storage medium.
  • smart tablets are widely used in schools such as interactive teaching, corporate meetings, and large-scale exhibition display platforms.
  • the smart tablet can display different systems of the Android system or the PC system on the display screen of the smart tablet through different input channels, such as displaying the Android system through the Android channel, and implementing the PC (personal computer) system through the PC channel.
  • the display in turn, through the touch device to achieve control of the Android system or PC system.
  • the existing smart tablet that can display different input channels can only display and control different input channels during operation, and cannot display and control the display screen of multiple input channels at the same time.
  • the embodiments of the present invention provide a smart device, an operating method and device thereof, and a computer storage medium, so as to simultaneously display and control input devices corresponding to different input channels, thereby facilitating user operations, improving display effects, and giving full play to the advantages of multiple systems.
  • an embodiment of the present invention provides a method for operating a smart device, including:
  • the split screen display instruction includes a number of display areas and a number of input channels, wherein the number of input channels is m, m is greater than or equal to 2, and the number of display areas is n, n is greater than or equal to m;
  • the touch signal including touch coordinates
  • the touch signal is fed back to the corresponding input channel according to the coordinate range corresponding to the touch coordinate.
  • an embodiment of the present invention further provides an operating device for a smart device, including:
  • the split screen display instruction receiving module is configured to receive a split screen display instruction, where the split screen display instruction includes the number of display areas and the number of input channels, wherein the number of input channels is m, m is greater than or equal to 2, and the number of display areas is n, n is greater than Equal to m;
  • a display area dividing module configured to divide a display area on the display screen according to the split screen display instruction, where each display area corresponds to an input channel, and the coordinate range corresponding to each display area is saved;
  • a touch signal receiving module configured to receive a touch signal in each display area, where the touch signal includes touch coordinates
  • the touch signal feedback module is configured to feed back the touch signal to a corresponding input channel according to a coordinate range corresponding to the touch coordinate.
  • the embodiment of the present invention further provides a smart device, including:
  • One or more processors are One or more processors;
  • Memory for storing one or more programs
  • the one or more programs are executed by the one or more processors, such that the one or more The processor implements an operation method for a smart device provided by any embodiment of the present invention.
  • the embodiment of the present invention further provides a computer readable storage medium, where the computer program is stored, and when the program is executed by the processor, the operating method for the smart device provided by any embodiment of the present invention is implemented.
  • the embodiment of the invention receives the split screen display instruction, and divides the display area on the display screen according to the split screen display instruction.
  • Each display area corresponds to an input channel, and the coordinate range corresponding to each display area is saved; receiving the display area in each display area
  • the touch signal includes a touch coordinate, and the touch signal is fed back to the corresponding input channel according to the coordinate range corresponding to the touch coordinate. It can realize the display and control of input devices corresponding to different input channels at the same time, without frequent switching of input channels, improve display effect and user experience, and give full play to the advantages of multiple systems.
  • FIG. 1 is a schematic structural diagram of a display system of a smart tablet having different input channels according to Embodiment 1 of the present invention
  • FIG. 2 is a flowchart of a method for operating a smart device according to Embodiment 1 of the present invention
  • FIG. 3 is a schematic diagram of a split screen display according to Embodiment 1 of the present invention.
  • FIG. 4 is a flowchart of a method for operating a smart device according to Embodiment 2 of the present invention.
  • FIG. 5 is a schematic diagram of file transmission according to Embodiment 2 of the present invention.
  • FIG. 6 is a schematic structural diagram of an operation device for a smart device according to Embodiment 3 of the present invention.
  • FIG. 7 is a schematic structural diagram of an intelligent terminal according to Embodiment 4 of the present invention.
  • FIG. 1 is a schematic structural diagram of a display system of a smart tablet having different input channels suitable for the embodiment according to the embodiment.
  • the touch screen 210 includes a touch frame and a display screen.
  • the touch frame is connected to the PC module 240 via a USB (Universal Serial Bus) interface 212 via a USB switch 220, and the PC module 240 passes HDMI (High Definition Multimedia Interface).
  • the high-definition multimedia interface is connected to the Android chip 250.
  • the touch frame is connected to the MCU (Micro controller unit) 230 through the serial port 211, and the MCU 230 is connected to the Android chip 250 through the USB, and the control end of the MCU 230 and the USB switch 220.
  • MCU Micro controller unit
  • the connection is used to control the USB switch 220 to send a touch signal received from the touch screen 210 to the PC module 240 or to another USB output interface
  • the Android chip 250 may include a VGA (Video Graphics Array) interface 251 and HDMI.
  • the interface 252 is configured to receive a multimedia signal from the outside, and the Android chip 250 is connected to the display screen of the touch screen 210 to drive the display screen for display.
  • the Android chip 250 is connected to the PC module 240 through the switch 260 and the network port to USB module 270.
  • the USB module 270 is used to convert the network signal of the switch 260 into a USB signal that can be recognized by the PC module 240.
  • the PC module 240 and the Android chip 250 form a local area network through the switch 260, and exchange file information.
  • the switch 260 is provided with a network port 261 for connecting the network cable to connect the PC module and the intelligent terminal to the network.
  • the touch screen 210 acquires an input channel display request, and sends an input channel display request to the Android chip 250 through the MCU 230, and the Android chip 250 determines to receive according to the received input channel display request.
  • the input channel of the video signal If the input channel display request is an input channel where the PC module is located, the touch screen 210 sends a touch signal to the PC module 240 through the USB interface 212 and the USB switch 220, and the PC module 240 processes the touch signal and sends an HDMI signal to the Android chip 250.
  • the Android chip 250 drives the display screen to display after receiving the HDMI signal, and the touch screen 210 can also send the touch signal to the Android chip 250 through the MCU 230 for implementing annotation or switching input channels and the like; if the input channel display request is the smart terminal itself On the input channel, the touch screen 210 sends a touch signal to the Android chip 250 through the MCU 230. After receiving the touch signal, the Android chip 250 performs processing and drives the display screen to display, thereby realizing display of the input devices corresponding to different input channels respectively. .
  • Embodiment 2 is a flowchart of a method for operating a smart device according to Embodiment 1 of the present invention.
  • the embodiment is applicable to a situation in which an input device corresponding to different input channels of a smart terminal needs to be displayed at the same time, and the method may be It is performed by an operating device for a smart device, which can be implemented by software and/or hardware.
  • the method includes:
  • Step 110 Receive a split screen display instruction.
  • the split screen display instruction includes the number of display areas and the number of input channels, wherein the number of input channels is m, m is greater than or equal to 2, the number of display areas is n, and n is greater than or equal to m.
  • Different input channels respectively correspond to input devices connected to each input channel, such as input channel 1 corresponding to PC module, input channel 2 corresponding to external computer 1 connected to VGA interface of Android chip, input channel 3 corresponding to HDMI interface of Android chip
  • input channel 1 corresponding to PC module
  • input channel 2 corresponding to external computer 1 connected to VGA interface of Android chip
  • input channel 3 corresponding to HDMI interface of Android chip
  • the external computer 2 the input channel 4 corresponds to the smart terminal itself.
  • the desired channel is set through the input channel setting interface.
  • the input channel such as the setting interface, may list the input channels of the smart terminal and the number of selectable display areas or the input channels of the smart terminal and the number of selectable display areas corresponding to each input channel, when the user selects through the setting interface After the displayed input channel and the number of display areas, you can receive the split screen display command.
  • Step 120 Divide a display area on the display screen according to the split screen display instruction, and each display area corresponds to an input channel, and save a coordinate range corresponding to each display area.
  • the display area of the same number of display areas is divided on the display screen of the smart terminal, and each display area corresponds to one input channel, and the coordinate range corresponding to each display area is saved.
  • FIG. 3 is a schematic diagram of a split screen display provided by this embodiment. If the split screen command includes two display areas and two input channels, one of the input channels corresponds to the PC module, and the other input channel corresponds to the smart terminal itself, after receiving the split screen command, the area of the display screen is divided into left and right.
  • the left display area can correspond to the input channel where the PC module is located
  • the right display area can correspond to the input channel where the smart terminal itself is located
  • the coordinate range corresponding to each display area is recorded and recorded, for example, the upper left corner of each display area can be recorded
  • the coordinates of the four corners of the lower left corner, the upper right corner, and the lower right corner, all the coordinates in the rectangular area formed by the four-corner coordinates are the coordinate ranges corresponding to the display area, or the coordinates of the upper left corner and the lower right corner of each display area can be recorded.
  • a rectangular area is determined, and all the coordinates in the rectangular area are the coordinate ranges corresponding to the display area.
  • the Android chip can process the video signals received from different input channels by using picture-in-picture and zoom techniques, thereby displaying the display screens of the input devices corresponding to different channels to corresponding Within the display area.
  • the Android chip will pass the HDMI signal received from the input channel where the PC module is located and the video signal of the input channel where the smart terminal itself is located.
  • the display screen is driven to display the processed signal, thereby displaying the display screen of the PC module and the display screen of the smart terminal itself to the corresponding display areas.
  • Step 130 Receive a touch signal in each display area.
  • a touch signal in each display area is received, wherein the touch signal includes touch coordinates.
  • the obtained touch coordinates are matched with the saved coordinate ranges of the respective display regions to determine a coordinate range corresponding to the touch coordinates.
  • Step 140 Feed the touch signal to the corresponding input channel according to the coordinate range corresponding to the touch coordinate.
  • the touch signal is fed back to the input channel corresponding to the display area, so that the input device corresponding to the input channel receives the touch signal, and the touch signal Respond.
  • the touch frame transmits the touch signal to the PC module through the USB interface and the USB switch, and the PC module processes the touch signal and sends the HDMI signal to the Android device.
  • the chip, the Android chip drives the display to display the HDMI signal.
  • the touch frame transmits the touch signal to the Android chip through the serial port and the MCU, and the Android chip processes the touch signal and drives the display screen to the video signal of the smart terminal itself. Display.
  • the embodiment can realize the display of the input device corresponding to the multi-input channel on the touch screen at the same time, without frequent switching of the input channel, facilitating interaction in a scene such as a conference or teaching, and avoiding the distraction due to the switching of the input channel.
  • the attention of the meeting personnel or students, the operation is simple and convenient, and the improvement Operational efficiency and user experience.
  • the display area is divided on the display screen according to the split screen display instruction, and each display area corresponds to an input channel, and the coordinate range corresponding to each display area is saved; receiving the touch in each display area
  • the signal, the touch signal includes touch coordinates; and the touch signal is fed back to the corresponding input channel according to the coordinate range corresponding to the touch coordinate.
  • FIG. 4 is a flowchart of a method for operating a smart device according to Embodiment 2 of the present invention.
  • the present embodiment is optimized based on the foregoing embodiment.
  • the method of this embodiment includes:
  • Step 210 Receive a split screen display instruction.
  • the split screen display instruction includes the number of display areas and the number of input channels, the number of input channels is m, m is greater than or equal to 2, the number of display areas is n, and n is greater than or equal to m.
  • Step 220 Divide a display area on the display screen according to the split screen display instruction, and each display area corresponds to an input channel, and save a coordinate range corresponding to each display area.
  • Step 230 Receive a touch signal in each display area.
  • the touch signal includes touch coordinates.
  • Step 240 Determine whether the touch coordinate of the touch signal is within the processing authority range. If yes, execute step 250. If no, execute step 270.
  • the touch signal in each display area is received, and if the touch signal is received, it is determined whether the touch coordinate is within the processing authority range.
  • the processing authority range may be a coordinate range other than the coordinate range corresponding to the display area of the smart terminal itself. If the touch coordinate is within the coordinate range of the display area corresponding to the PC module, the touch coordinate is within the processing weight range, and if the touch coordinate is within the coordinate range of the display area corresponding to the smart terminal itself, the touch coordinate is not within the processing authority range.
  • Step 250 Identify an input channel corresponding to the touch signal according to the touch coordinate.
  • the display area corresponding to the touch coordinate may be determined according to the touch coordinate, thereby determining an input channel corresponding to the touch signal.
  • Step 260 Acquire a first video stream signal from a corresponding input channel, and transmit the first video stream signal to a display area corresponding to the display screen.
  • the first video stream signal is obtained from the determined input channel, and the first video stream signal is transmitted to a display area corresponding to the input channel in the display screen to drive the display screen to display The first video stream signal.
  • transmitting the first video stream signal to the display area corresponding to the display screen comprises:
  • the Android chip Transmitting the first video stream signal to the Android chip by using the HDMI signal, where the first video stream signal includes corresponding touch coordinates; and the Android chip transmits the first video stream signal to the display area corresponding to the display screen according to the touch coordinates.
  • the touch frame transmits the touch signal to the PC module through the USB interface and the USB converter, and the PC module processes the touch signal and the first video is processed.
  • the stream signal is sent to the Android chip through the HDMI signal, wherein the first video stream signal includes corresponding touch coordinates, and after receiving the HDMI signal transmitted by the PC module, the Android chip determines the display area corresponding to the touch coordinate according to the touch coordinate, and the first The video stream signal is transmitted to a corresponding display area on the display screen, and the display screen is driven to display the first video stream signal.
  • Step 270 Forward the touch signal to the Android chip.
  • the touch frame transmits the touch signal to the Android chip through the serial port and the MCU.
  • Step 280 The Android chip identifies an input channel corresponding to the touch signal according to the touch coordinates.
  • the Android chip After receiving the touch signal, the Android chip processes the touch signal, and determines a corresponding display area according to the touch coordinates in the touch signal, thereby determining an input channel corresponding to the touch signal.
  • Step 290 Acquire a second video stream signal from the corresponding input channel, and transmit the second video stream signal to a display area corresponding to the display screen.
  • the second video stream signal is obtained from the determined input channel, and the second video stream signal is transmitted to the display area corresponding to the display screen. If the input channel corresponding to the touch signal is the input channel of the smart terminal itself, the Android chip acquires the second video stream signal corresponding to the smart terminal itself, and transmits the second video stream signal to the display area corresponding to the smart terminal itself, and drives the display screen to The second video stream signal is displayed.
  • Step 2100 Receive a transmission signal across the display area.
  • the transmission signal includes file information to be transmitted, initial touch coordinates of the source display area, and destination touch coordinates of the destination display area.
  • Fig. 5 is a schematic diagram of file transfer suitable for the present embodiment.
  • a transmission signal from the left display area across the display area may be received.
  • Step 2110 The transmission signal is respectively fed back to the corresponding input channel according to the initial touch coordinate and the target touch coordinate.
  • Step 2120 The input channel corresponding to the source display area sends the file to be transmitted to the input channel corresponding to the destination display area according to the transmission signal.
  • the source display area is a display area corresponding to the initial touch coordinates
  • the destination display area is a display area corresponding to the target touch coordinates.
  • the input channel corresponding to the left display area and the input channel corresponding to the right display area respectively receive the transmission signal
  • the input channel corresponding to the left display area sends the PC file to the input channel corresponding to the right display area
  • the right display The input channel corresponding to the area receives the PC file, thereby facilitating the file transfer between different input channels conveniently and quickly, and realizing resource sharing between the input channels.
  • the Android chip identifies the input channel corresponding to the touch signal according to the touch coordinates, acquires the second video stream signal from the corresponding input channel, and the second video stream signal It is transmitted to the display area corresponding to the display to realize display and control of corresponding input devices of different input channels at the same time, without frequent switching of input channels, improving display effect and user experience, and giving full play to the advantages of multiple systems.
  • the receiving signal is fed back to the corresponding input channel according to the initial touch coordinate and the target touch coordinate, and the input channel corresponding to the source display area sends the file to be transmitted to the destination display area according to the transmission signal.
  • Input channels for easy and fast implementation of each input channel Inter-transmission to achieve resource sharing between input channels.
  • FIG. 6 is a schematic structural diagram of an operation device for a smart device according to Embodiment 3 of the present invention.
  • the device is applicable to a situation in which an input device corresponding to different input channels of the smart terminal needs to be displayed and manipulated, and the device may be configured by Implemented in software and/or hardware, the apparatus is for performing the method of operation for the smart device in the above embodiments.
  • the device includes: a split screen display instruction receiving module 310, a display area dividing module 320, a touch signal receiving module 330, and a touch signal feedback module 340, wherein
  • the split screen display instruction receiving module 310 is configured to receive a split screen display instruction, where the split screen display instruction includes the number of display areas and the number of input channels, wherein the number of input channels is m, m is greater than or equal to 2, and the number of display areas is n, n Greater than or equal to m;
  • the display area dividing module 320 is configured to divide a display area on the display screen according to the split screen display instruction, where each display area corresponds to an input channel, and the coordinate range corresponding to each display area is saved;
  • the touch signal receiving module 330 is configured to receive a touch signal in each display area, where the touch signal includes touch coordinates;
  • the touch signal feedback module 340 is configured to feed back the touch signal to a corresponding input channel according to a coordinate range corresponding to the touch coordinate.
  • the split display command is received by the split screen display command receiving module, and the display area dividing module divides the display area on the display screen according to the split screen display instruction, and each display area corresponds to an input channel, and each display area is saved. a coordinate range; the touch signal receiving module receives the touch signal in each display area; the touch signal feedback module feeds back the touch signal to the corresponding input channel according to the coordinate range corresponding to the touch coordinate.
  • the touch signal feedback module includes:
  • a first input channel identifying unit configured to: if the touch coordinate of the touch signal is within a processing authority range, identify an input channel corresponding to the touch signal according to the touch coordinate;
  • a first video stream signal transmission unit configured to acquire a first video stream signal from a corresponding input channel, and transmit the first video stream signal to a display area corresponding to the display screen.
  • the first video stream signal transmission unit includes:
  • a first video stream signal acquisition subunit configured to acquire a first video stream signal from a corresponding input channel
  • a first video stream signal sending subunit configured to send the first video stream signal to an Android chip by using an HDMI signal, where the first video stream signal includes corresponding touch coordinates;
  • a first video stream signal transmission subunit configured to transmit, by the Android chip, the first video stream signal to a display area corresponding to the display screen according to the touch coordinates.
  • the touch signal feedback module includes:
  • a touch signal forwarding unit configured to forward the touch signal to an Android chip if a touch coordinate of the touch signal is within a range of processing rights
  • a second input channel identifying unit configured to identify, by the Android chip, an input channel corresponding to the touch signal according to the touch coordinate
  • a second video stream signal transmission unit configured to acquire a second video stream signal from the corresponding input channel, and transmit the second video stream signal to a display area corresponding to the display screen.
  • a transmission signal receiving module configured to receive a transmission signal across the display area, where the transmission signal includes File information to be transmitted, initial touch coordinates of the source display area, and destination touch coordinates of the destination display area;
  • a transmission signal feedback module configured to respectively feed the transmission signal to a corresponding input channel according to the initial touch coordinate and the target touch coordinate;
  • a transmission file sending module wherein the input channel corresponding to the source display area sends the file to be transmitted to an input channel corresponding to the destination display area according to the transmission signal.
  • the operating device for the smart device provided by the embodiment of the present invention may be used to perform the operating method for the smart device provided by any embodiment of the present invention, and has the corresponding functions and beneficial effects of performing the method, which is not in this embodiment.
  • the method for operating a smart device provided by any embodiment of the present invention refers to the method for operating a smart device provided by any embodiment of the present invention.
  • FIG. 7 is a schematic structural diagram of a smart device according to Embodiment 4 of the present invention.
  • the smart device includes a processor 410, a memory 420, an input device 430, and an output device 440.
  • the processor 410 of the smart device The number may be one or more.
  • one processor 410 is taken as an example; the processor 410, the memory 420, the input device 430, and the output device 440 in the smart device may be connected by a bus or other manner, and the figure is passed in FIG.
  • the bus connection is an example.
  • the memory 420 is used as a computer readable storage medium, and can be used to store a software program, a computer executable program, and a module, such as a program instruction/module corresponding to an operation method of the smart device in the embodiment of the present invention (for example, for intelligence)
  • the processor 410 executes various functional applications and data processing of the smart device by running software programs, instructions, and modules stored in the memory 420, that is, implementing the above-described operations for the smart device.
  • the memory 420 may mainly include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the smart device, and the like.
  • memory 420 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device.
  • memory 420 can further include memory remotely located relative to processor 410, which can be connected to the smart device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • the input device 430 can be configured to receive input touch information and generate key signal inputs related to user settings and function control of the smart device.
  • Output device 440 can include a display device such as a display screen.
  • the fifth embodiment of the present invention further provides a storage medium containing computer executable instructions, where the computer program is stored, and when the program is executed by the processor, the operation method for the smart device provided by any embodiment of the present invention is implemented.
  • the present invention can be implemented by software and necessary general hardware, and can also be implemented by hardware, but in many cases, the former is a better implementation. .
  • the technical solution of the present invention which is essential or contributes to the prior art, may be embodied in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk of a computer. , Read-Only Memory (ROM), Random Access Memory (RAM), Flash (FLASH), hard disk or optical disk, etc., including a number of instructions to make a computer device (can be a personal computer)
  • the server, or network device, etc. performs the methods described in various embodiments of the present invention.
  • each unit and module included is only divided according to functional logic, but is not limited to the above-mentioned division, as long as the corresponding function can be implemented.
  • the specific names of the respective functional units are only for convenience of distinguishing from each other, and are not intended to limit the scope of protection of the present invention.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A smart device and an operation method therefor, an apparatus, and a computer storage medium. The method comprises: receiving a split screen display command, the split screen display command comprising a number of display regions and a number of input channels, the number of input channels being m, m being greater than or equal to 2, and the number of display regions being n, n being greater than or equal to m; dividing a display screen into display regions according to the split screen display command, each display region corresponding to an input channel, and storing a coordinate range corresponding to each display region; receiving a touch signal in each display region, the touch signal comprising touch coordinates; feeding back the touch signal to a corresponding input channel according to a coordinate range corresponding to the touch coordinates. The present method can simultaneously implement display and control of input devices corresponding to different input channels, without needing frequent input channel switching, improving display results and user experience, and fully realizing the advantages of multiple systems.

Description

一种智能设备及其操作方法和装置及计算机存储介质Intelligent device, operation method and device thereof and computer storage medium 技术领域Technical field
本发明涉及显示技术领域,尤其涉及一种智能设备及其操作方法和装置及计算机存储介质。The present invention relates to the field of display technologies, and in particular, to a smart device, an operating method and apparatus thereof, and a computer storage medium.
背景技术Background technique
随着科学技术的不断发展,越来越多的智能终端在各个领域得到普及。如智能平板在学校的交互教学、企业的会议以及大型展会显示平台等场景中得到广泛使用。With the continuous development of science and technology, more and more intelligent terminals are popularized in various fields. For example, smart tablets are widely used in schools such as interactive teaching, corporate meetings, and large-scale exhibition display platforms.
目前智能平板可通过不同的输入通道实现安卓系统或PC系统不同系统在智能平板的显示屏上进行显示,如通过安卓通道实现安卓系统的显示,通过PC通道实现PC(personal computer,个人计算机)系统的显示,进而通过触摸设备实现对安卓系统或PC系统的控制。At present, the smart tablet can display different systems of the Android system or the PC system on the display screen of the smart tablet through different input channels, such as displaying the Android system through the Android channel, and implementing the PC (personal computer) system through the PC channel. The display, in turn, through the touch device to achieve control of the Android system or PC system.
然而,现有的可进行不同输入通道显示的智能平板在运行过程中,只能对不同的输入通道进行切换显示和操控,无法同时对多个输入通道的显示画面进行显示和操控。However, the existing smart tablet that can display different input channels can only display and control different input channels during operation, and cannot display and control the display screen of multiple input channels at the same time.
发明内容Summary of the invention
本发明实施例提供一种智能设备及其操作方法和装置及计算机存储介质,以实现同时显示和操控不同输入通道对应的输入设备,方便用户操作,提升展示效果,充分发挥多系统的优势。 The embodiments of the present invention provide a smart device, an operating method and device thereof, and a computer storage medium, so as to simultaneously display and control input devices corresponding to different input channels, thereby facilitating user operations, improving display effects, and giving full play to the advantages of multiple systems.
第一方面,本发明实施例提供了一种用于智能设备的操作方法,包括:In a first aspect, an embodiment of the present invention provides a method for operating a smart device, including:
接收分屏显示指令,所述分屏显示指令包括显示区域数量和输入通道数量,其中输入通道数量为m,m大于等于2,显示区域数量为n,n大于等于m;Receiving a split screen display instruction, the split screen display instruction includes a number of display areas and a number of input channels, wherein the number of input channels is m, m is greater than or equal to 2, and the number of display areas is n, n is greater than or equal to m;
根据所述分屏显示指令在显示屏上划分显示区域,每一个显示区域对应一输入通道,保存每个显示区域所对应的坐标范围;And displaying, according to the split screen display instruction, a display area on the display screen, each display area corresponding to an input channel, and storing a coordinate range corresponding to each display area;
接收各显示区域内的触摸信号,所述触摸信号包括触摸坐标;Receiving a touch signal in each display area, the touch signal including touch coordinates;
根据所述触摸坐标对应的坐标范围将所述触摸信号反馈给对应的输入通道。The touch signal is fed back to the corresponding input channel according to the coordinate range corresponding to the touch coordinate.
第二方面,本发明实施例还提供了一种用于智能设备的操作装置,包括:In a second aspect, an embodiment of the present invention further provides an operating device for a smart device, including:
分屏显示指令接收模块,用于接收分屏显示指令,所述分屏显示指令包括显示区域数量和输入通道数量,其中输入通道数量为m,m大于等于2,显示区域数量为n,n大于等于m;The split screen display instruction receiving module is configured to receive a split screen display instruction, where the split screen display instruction includes the number of display areas and the number of input channels, wherein the number of input channels is m, m is greater than or equal to 2, and the number of display areas is n, n is greater than Equal to m;
显示区域划分模块,用于根据所述分屏显示指令在显示屏上划分显示区域,每一个显示区域对应一输入通道,保存每个显示区域所对应的坐标范围;a display area dividing module, configured to divide a display area on the display screen according to the split screen display instruction, where each display area corresponds to an input channel, and the coordinate range corresponding to each display area is saved;
触摸信号接收模块,用于接收各显示区域内的触摸信号,所述触摸信号包括触摸坐标;a touch signal receiving module, configured to receive a touch signal in each display area, where the touch signal includes touch coordinates;
触摸信号反馈模块,用于根据所述触摸坐标对应的坐标范围将所述触摸信号反馈给对应的输入通道。The touch signal feedback module is configured to feed back the touch signal to a corresponding input channel according to a coordinate range corresponding to the touch coordinate.
第三方面,本发明实施例还提供了一种智能设备,包括:In a third aspect, the embodiment of the present invention further provides a smart device, including:
一个或多个处理器;One or more processors;
存储器,用于存储一个或多个程序,Memory for storing one or more programs,
当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多 个处理器实现本发明任一实施例提供的用于智能设备的操作方法。When the one or more programs are executed by the one or more processors, such that the one or more The processor implements an operation method for a smart device provided by any embodiment of the present invention.
第四方面,本发明实施例还提供一种计算机可读存储介质,其上存储有计算机程序,该程序被处理器执行时实现本发明任一实施例提供的用于智能设备的操作方法。In a fourth aspect, the embodiment of the present invention further provides a computer readable storage medium, where the computer program is stored, and when the program is executed by the processor, the operating method for the smart device provided by any embodiment of the present invention is implemented.
本发明实施例通过接收分屏显示指令,根据分屏显示指令在显示屏上划分显示区域,每一个显示区域对应一输入通道,保存每个显示区域所对应的坐标范围;接收各显示区域内的触摸信号,触摸信号包括触摸坐标;根据触摸坐标对应的坐标范围将触摸信号反馈给对应的输入通道。实现同时对不同输入通道对应的输入设备进行显示和操控,无须频繁进行输入通道的切换,提升展示效果及用户体验,充分发挥多系统的优势。The embodiment of the invention receives the split screen display instruction, and divides the display area on the display screen according to the split screen display instruction. Each display area corresponds to an input channel, and the coordinate range corresponding to each display area is saved; receiving the display area in each display area The touch signal includes a touch coordinate, and the touch signal is fed back to the corresponding input channel according to the coordinate range corresponding to the touch coordinate. It can realize the display and control of input devices corresponding to different input channels at the same time, without frequent switching of input channels, improve display effect and user experience, and give full play to the advantages of multiple systems.
附图说明DRAWINGS
图1是本发明实施例一提供的一种具有不同输入通道的智能平板的显示系统的结构示意图;1 is a schematic structural diagram of a display system of a smart tablet having different input channels according to Embodiment 1 of the present invention;
图2是本发明实施例一提供的一种用于智能设备的操作方法的流程图;2 is a flowchart of a method for operating a smart device according to Embodiment 1 of the present invention;
图3是本发明实施例一提供的一种分屏显示的示意图;3 is a schematic diagram of a split screen display according to Embodiment 1 of the present invention;
图4是本发明实施例二提供的一种用于智能设备的操作方法的流程图;4 is a flowchart of a method for operating a smart device according to Embodiment 2 of the present invention;
图5是本发明实施例二提供的一种文件传输的示意图;FIG. 5 is a schematic diagram of file transmission according to Embodiment 2 of the present invention; FIG.
图6是本发明实施例三提供的一种用于智能设备的操作装置的结构示意图;6 is a schematic structural diagram of an operation device for a smart device according to Embodiment 3 of the present invention;
图7是本发明实施例四提供的一种智能终端的结构示意图。 FIG. 7 is a schematic structural diagram of an intelligent terminal according to Embodiment 4 of the present invention.
具体实施方式Detailed ways
下面结合附图和实施例对本发明作进一步的详细说明。可以理解的是,此处所描述的具体实施例仅仅用于解释本发明,而非对本发明的限定。另外还需要说明的是,为了便于描述,附图中仅示出了与本发明相关的部分而非全部结构。The present invention will be further described in detail below with reference to the accompanying drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention. It should also be noted that, for ease of description, only some, but not all, of the structures related to the present invention are shown in the drawings.
图1为本实施例提供的一种适用于本实施例的具有不同输入通道的智能平板的显示系统的结构示意图。参见图1,触摸屏210包括触摸框和显示屏,触摸框通过USB(Universal Serial Bus,通用串行总线)接口212经过USB切换器220与PC模块240连接,PC模块240通过HDMI(High Definition Multimedia Interface,高清晰度多媒体接口)与安卓芯片250连接,触摸框通过串口211与MCU(Micro controller Unit,微控制单元)230连接,MCU230通过USB与安卓芯片250连接,MCU230与USB切换器220的控制端连接,用于控制USB切换器220将从触摸屏210接收到的触摸信号发送至PC模块240或者发送至另一USB输出接口,安卓芯片250可包括VGA(Video GraphicsArray,视频图形阵列)接口251和HDMI接口252,用于从外部接收多媒体信号,安卓芯片250与触摸屏210的显示屏连接,以驱动显示屏进行显示,安卓芯片250通过交换机260、网口转USB模块270与PC模块240连接,网口转USB模块270用于将交换机260的网络信号转成能被PC模块240识别的USB信号。PC模块240与安卓芯片250通过交换机260构成局域网,进行文件信息的交换。交换机260上设有网口261,用于连接网线使PC模块和智能终端连接网络。FIG. 1 is a schematic structural diagram of a display system of a smart tablet having different input channels suitable for the embodiment according to the embodiment. Referring to FIG. 1, the touch screen 210 includes a touch frame and a display screen. The touch frame is connected to the PC module 240 via a USB (Universal Serial Bus) interface 212 via a USB switch 220, and the PC module 240 passes HDMI (High Definition Multimedia Interface). The high-definition multimedia interface is connected to the Android chip 250. The touch frame is connected to the MCU (Micro controller unit) 230 through the serial port 211, and the MCU 230 is connected to the Android chip 250 through the USB, and the control end of the MCU 230 and the USB switch 220. The connection is used to control the USB switch 220 to send a touch signal received from the touch screen 210 to the PC module 240 or to another USB output interface, and the Android chip 250 may include a VGA (Video Graphics Array) interface 251 and HDMI. The interface 252 is configured to receive a multimedia signal from the outside, and the Android chip 250 is connected to the display screen of the touch screen 210 to drive the display screen for display. The Android chip 250 is connected to the PC module 240 through the switch 260 and the network port to USB module 270. The USB module 270 is used to convert the network signal of the switch 260 into a USB signal that can be recognized by the PC module 240. The PC module 240 and the Android chip 250 form a local area network through the switch 260, and exchange file information. The switch 260 is provided with a network port 261 for connecting the network cable to connect the PC module and the intelligent terminal to the network.
触摸屏210获取输入通道显示请求,并将输入通道显示请求通过MCU230发送至安卓芯片250,安卓芯片250根据接收到的输入通道显示请求确定接收 视频信号的输入通道。若输入通道显示请求为PC模块所在输入通道,则触摸屏210通过USB接口212以及USB切换器220将触摸信号发送至PC模块240,PC模块240对触摸信号进行处理并向安卓芯片250发送HDMI信号,安卓芯片250接收到HDMI信号后驱动显示屏进行显示,同时触摸屏210还可通过MCU230将触摸信号发送至安卓芯片250,以供实现批注或切换输入通道等操作;若输入通道显示请求为智能终端本身所在输入通道,则触摸屏210通过MCU230将触摸信号发送至安卓芯片250,安卓芯片250接收到触摸信号后进行处理并驱动显示屏进行显示,由此,实现分别对不同输入通道对应的输入设备的显示。The touch screen 210 acquires an input channel display request, and sends an input channel display request to the Android chip 250 through the MCU 230, and the Android chip 250 determines to receive according to the received input channel display request. The input channel of the video signal. If the input channel display request is an input channel where the PC module is located, the touch screen 210 sends a touch signal to the PC module 240 through the USB interface 212 and the USB switch 220, and the PC module 240 processes the touch signal and sends an HDMI signal to the Android chip 250. The Android chip 250 drives the display screen to display after receiving the HDMI signal, and the touch screen 210 can also send the touch signal to the Android chip 250 through the MCU 230 for implementing annotation or switching input channels and the like; if the input channel display request is the smart terminal itself On the input channel, the touch screen 210 sends a touch signal to the Android chip 250 through the MCU 230. After receiving the touch signal, the Android chip 250 performs processing and drives the display screen to display, thereby realizing display of the input devices corresponding to different input channels respectively. .
实施例一 Embodiment 1
图2为本发明实施例一提供的一种用于智能设备的操作方法的流程图,本实施例可适用于需同时对智能终端的不同输入通道对应的输入设备进行显示的情况,该方法可以由用于智能设备的操作装置来执行,该装置可以由软件和/或硬件方式实现。该方法包括:2 is a flowchart of a method for operating a smart device according to Embodiment 1 of the present invention. The embodiment is applicable to a situation in which an input device corresponding to different input channels of a smart terminal needs to be displayed at the same time, and the method may be It is performed by an operating device for a smart device, which can be implemented by software and/or hardware. The method includes:
步骤110、接收分屏显示指令。Step 110: Receive a split screen display instruction.
其中,分屏显示指令包括显示区域数量和输入通道数量,其中输入通道数量为m,m大于等于2,显示区域数量为n,n大于等于m。The split screen display instruction includes the number of display areas and the number of input channels, wherein the number of input channels is m, m is greater than or equal to 2, the number of display areas is n, and n is greater than or equal to m.
不同的输入通道分别对应与各输入通道连接的输入设备,如输入通道1对应PC模块,输入通道2对应与安卓芯片的VGA接口连接的外接电脑1,输入通道3对应与安卓芯片的HDMI接口连接的外接电脑2,输入通道4对应智能终端本身。Different input channels respectively correspond to input devices connected to each input channel, such as input channel 1 corresponding to PC module, input channel 2 corresponding to external computer 1 connected to VGA interface of Android chip, input channel 3 corresponding to HDMI interface of Android chip The external computer 2, the input channel 4 corresponds to the smart terminal itself.
示例性的,可在智能终端开机后,通过输入通道设置界面设置所需显示的 输入通道,如设置界面中可列有智能终端的各个输入通道以及可选显示区域数量或列有智能终端的各个输入通道以及各个输入通道对应的可选显示区域数量,当用户通过设置界面选择需要显示的输入通道以及显示区域数量后,即可接收到分屏显示指令。Exemplarily, after the smart terminal is powered on, the desired channel is set through the input channel setting interface. The input channel, such as the setting interface, may list the input channels of the smart terminal and the number of selectable display areas or the input channels of the smart terminal and the number of selectable display areas corresponding to each input channel, when the user selects through the setting interface After the displayed input channel and the number of display areas, you can receive the split screen display command.
步骤120、根据分屏显示指令在显示屏上划分显示区域,每一个显示区域对应一输入通道,保存每个显示区域所对应的坐标范围。Step 120: Divide a display area on the display screen according to the split screen display instruction, and each display area corresponds to an input channel, and save a coordinate range corresponding to each display area.
示例性的,接收到分屏指令后,在智能终端的显示屏上划分与显示区域数量相同的显示区域,且每个显示区域对应一个输入通道,并保存每个显示区域所对应的坐标范围。Exemplarily, after receiving the split screen command, the display area of the same number of display areas is divided on the display screen of the smart terminal, and each display area corresponds to one input channel, and the coordinate range corresponding to each display area is saved.
示例性的,图3为本实施例提供的一种分屏显示的示意图。若分屏指令中包括2个显示区域以及2个输入通道,其中一个输入通道对应PC模块,另一输入通道对应智能终端本身,则在接收到分屏指令后,将显示屏的区域划分为左右2个显示区域,左显示区域可对应PC模块所在输入通道,右显示区域可对应智能终端本身所在输入通道,并记录保存每个显示区域对应的坐标范围,如可记录每个显示区域左上角、左下角、右上角以及右下角四角的坐标,则由四角坐标构成的矩形区域内所有的坐标即为该显示区域对应的坐标范围,或者可记录每个显示区域左上角和右下角的坐标同样可确定一个矩形区域,该矩形区域内所有的坐标即为该显示区域对应的坐标范围。Exemplarily, FIG. 3 is a schematic diagram of a split screen display provided by this embodiment. If the split screen command includes two display areas and two input channels, one of the input channels corresponds to the PC module, and the other input channel corresponds to the smart terminal itself, after receiving the split screen command, the area of the display screen is divided into left and right. 2 display areas, the left display area can correspond to the input channel where the PC module is located, and the right display area can correspond to the input channel where the smart terminal itself is located, and the coordinate range corresponding to each display area is recorded and recorded, for example, the upper left corner of each display area can be recorded, The coordinates of the four corners of the lower left corner, the upper right corner, and the lower right corner, all the coordinates in the rectangular area formed by the four-corner coordinates are the coordinate ranges corresponding to the display area, or the coordinates of the upper left corner and the lower right corner of each display area can be recorded. A rectangular area is determined, and all the coordinates in the rectangular area are the coordinate ranges corresponding to the display area.
示例性的,确定各输入通道对应的显示区域后,安卓芯片可通过画中画以及缩放技术对从不同输入通道接收的视频信号进行处理,从而将不同通道对应的输入设备的显示画面显示到对应的显示区域内。如安卓芯片将从PC模块所在输入通道接收的HDMI信号以及智能终端本身所在输入通道的视频信号通过 画中画以及缩放技术进行处理后,驱动显示屏对处理后的信号进行显示,从而将PC模块的显示画面以及智能终端本身的显示画面显示到各自对应的显示区域。Exemplarily, after determining the display area corresponding to each input channel, the Android chip can process the video signals received from different input channels by using picture-in-picture and zoom techniques, thereby displaying the display screens of the input devices corresponding to different channels to corresponding Within the display area. For example, the Android chip will pass the HDMI signal received from the input channel where the PC module is located and the video signal of the input channel where the smart terminal itself is located. After the picture-in-picture and the zoom technology are processed, the display screen is driven to display the processed signal, thereby displaying the display screen of the PC module and the display screen of the smart terminal itself to the corresponding display areas.
步骤130、接收各显示区域内的触摸信号。Step 130: Receive a touch signal in each display area.
示例性的,在对各输入通道的显示画面进行显示后,接收各显示区域内的触摸信号,其中,触摸信号包括触摸坐标。Illustratively, after displaying the display screen of each input channel, a touch signal in each display area is received, wherein the touch signal includes touch coordinates.
若接收到触摸信号,则将获得的触摸坐标与保存的各显示区域对应的坐标范围进行匹配以确定该触摸坐标对应的坐标范围。If the touch signal is received, the obtained touch coordinates are matched with the saved coordinate ranges of the respective display regions to determine a coordinate range corresponding to the touch coordinates.
步骤140、根据触摸坐标对应的坐标范围将触摸信号反馈给对应的输入通道。Step 140: Feed the touch signal to the corresponding input channel according to the coordinate range corresponding to the touch coordinate.
若确定触摸坐标在保存的某一显示区域的坐标范围内,则将触摸信号反馈给该显示区域对应的输入通道,从而与该输入通道对应的输入设备在接收到触摸信号后,对该触摸信号进行响应。If it is determined that the touch coordinate is within the coordinate range of the saved display area, the touch signal is fed back to the input channel corresponding to the display area, so that the input device corresponding to the input channel receives the touch signal, and the touch signal Respond.
示例性的,若触摸坐标在左显示区域对应的坐标范围内,则触摸框通过USB接口以及USB切换器将触摸信号传送至PC模块,PC模块对触摸信号进行处理,并将HDMI信号发送至安卓芯片,安卓芯片驱动显示屏对HDMI信号进行显示。Exemplarily, if the touch coordinate is within the coordinate range corresponding to the left display area, the touch frame transmits the touch signal to the PC module through the USB interface and the USB switch, and the PC module processes the touch signal and sends the HDMI signal to the Android device. The chip, the Android chip drives the display to display the HDMI signal.
示例性的,若触摸坐标在右显示区对应的坐标范围内,则触摸框通过串口以及MCU将触摸信号传送至安卓芯片,安卓芯片对触摸信号进行处理,并驱动显示屏对智能终端本身视频信号进行显示。Exemplarily, if the touch coordinate is within the coordinate range corresponding to the right display area, the touch frame transmits the touch signal to the Android chip through the serial port and the MCU, and the Android chip processes the touch signal and drives the display screen to the video signal of the smart terminal itself. Display.
由此,本实施例可实现在触摸屏上同时将多输入通道对应的输入设备进行显示,无需频繁进行输入通道的切换,在会议或教学等场景中,便于互动,避免由于输入通道的切换,分散会议人员或学生的注意力,操作简单方便,提高 操作效率与用户体验。Therefore, the embodiment can realize the display of the input device corresponding to the multi-input channel on the touch screen at the same time, without frequent switching of the input channel, facilitating interaction in a scene such as a conference or teaching, and avoiding the distraction due to the switching of the input channel. The attention of the meeting personnel or students, the operation is simple and convenient, and the improvement Operational efficiency and user experience.
本实施例通过接收分屏显示指令,根据分屏显示指令在显示屏上划分显示区域,每一个显示区域对应一输入通道,保存每个显示区域所对应的坐标范围;接收各显示区域内的触摸信号,触摸信号包括触摸坐标;根据触摸坐标对应的坐标范围将触摸信号反馈给对应的输入通道。实现同时对不同输入通道对应的输入设备进行显示和操控,无须频繁进行输入通道的切换,提升展示效果及用户体验,充分发挥多系统的优势。In this embodiment, by receiving the split screen display instruction, the display area is divided on the display screen according to the split screen display instruction, and each display area corresponds to an input channel, and the coordinate range corresponding to each display area is saved; receiving the touch in each display area The signal, the touch signal includes touch coordinates; and the touch signal is fed back to the corresponding input channel according to the coordinate range corresponding to the touch coordinate. It can realize the display and control of input devices corresponding to different input channels at the same time, without frequent switching of input channels, improve display effect and user experience, and give full play to the advantages of multiple systems.
实施例二Embodiment 2
图4是本发明实施例二提供的一种用于智能设备的操作方法的流程图,本实施例以上述实施例为基础,进行了优化。相应的,本实施例的方法包括:FIG. 4 is a flowchart of a method for operating a smart device according to Embodiment 2 of the present invention. The present embodiment is optimized based on the foregoing embodiment. Correspondingly, the method of this embodiment includes:
步骤210、接收分屏显示指令。Step 210: Receive a split screen display instruction.
其中,分屏显示指令包括显示区域数量和输入通道数量,输入通道数量为m,m大于等于2,显示区域数量为n,n大于等于m。The split screen display instruction includes the number of display areas and the number of input channels, the number of input channels is m, m is greater than or equal to 2, the number of display areas is n, and n is greater than or equal to m.
步骤220、根据分屏显示指令在显示屏上划分显示区域,每一个显示区域对应一输入通道,保存每个显示区域所对应的坐标范围。Step 220: Divide a display area on the display screen according to the split screen display instruction, and each display area corresponds to an input channel, and save a coordinate range corresponding to each display area.
步骤230、接收各显示区域内的触摸信号。Step 230: Receive a touch signal in each display area.
其中,触摸信号包括触摸坐标。Wherein, the touch signal includes touch coordinates.
步骤240、判断触摸信号的触摸坐标是否在处理权限范围内,若是,则执行步骤250,若否,则执行步骤270。Step 240: Determine whether the touch coordinate of the touch signal is within the processing authority range. If yes, execute step 250. If no, execute step 270.
优选的,在将各输入通道的画面显示在对应的显示区域后,接收各显示区域内的触摸信号,若接收到触摸信号,则判断触摸坐标是否在处理权限范围内。 Preferably, after displaying the screen of each input channel in the corresponding display area, the touch signal in each display area is received, and if the touch signal is received, it is determined whether the touch coordinate is within the processing authority range.
示例性的,处理权限范围可为除智能终端本身显示区域对应的坐标范围之外的坐标范围。如若触摸坐标在PC模块对应的显示区域的坐标范围内,则触摸坐标在处理权项范围内,若触摸坐标在智能终端本身对应的显示区域的坐标范围内,则触摸坐标不在处理权限范围内。Exemplarily, the processing authority range may be a coordinate range other than the coordinate range corresponding to the display area of the smart terminal itself. If the touch coordinate is within the coordinate range of the display area corresponding to the PC module, the touch coordinate is within the processing weight range, and if the touch coordinate is within the coordinate range of the display area corresponding to the smart terminal itself, the touch coordinate is not within the processing authority range.
步骤250、根据触摸坐标识别出触摸信号对应的输入通道。Step 250: Identify an input channel corresponding to the touch signal according to the touch coordinate.
如果触摸信号的触摸坐标在处理权限范围内,则可根据触摸坐标确定该触摸坐标对应的显示区域,进而确定触摸信号对应的输入通道。If the touch coordinate of the touch signal is within the processing authority range, the display area corresponding to the touch coordinate may be determined according to the touch coordinate, thereby determining an input channel corresponding to the touch signal.
步骤260、从对应的输入通道获取第一视频流信号,并将第一视频流信号传输到显示屏对应的显示区域。Step 260: Acquire a first video stream signal from a corresponding input channel, and transmit the first video stream signal to a display area corresponding to the display screen.
在确定触摸信号对应的输入通道后,即可从确定的输入通道获取第一视频流信号,并将第一视频流信号传输到显示屏中该输入通道所对应的显示区域,以驱动显示屏显示第一视频流信号。After determining the input channel corresponding to the touch signal, the first video stream signal is obtained from the determined input channel, and the first video stream signal is transmitted to a display area corresponding to the input channel in the display screen to drive the display screen to display The first video stream signal.
优选的,将第一视频流信号传输到显示屏对应的显示区域包括:Preferably, transmitting the first video stream signal to the display area corresponding to the display screen comprises:
将第一视频流信号通过HDMI信号发送给安卓芯片,其中,第一视频流信号包括对应的触摸坐标;安卓芯片根据触摸坐标将第一视频流信号传输到显示屏对应的显示区域。Transmitting the first video stream signal to the Android chip by using the HDMI signal, where the first video stream signal includes corresponding touch coordinates; and the Android chip transmits the first video stream signal to the display area corresponding to the display screen according to the touch coordinates.
示例性的,若触摸信号对应的输入通道为PC模块所在的输入通道,则触摸框通过USB接口以及USB转换器将触摸信号传送至PC模块,PC模块对触摸信号进行处理,并将第一视频流信号通过HDMI信号发送至安卓芯片,其中,第一视频流信号包括对应的触摸坐标,安卓芯片接收到PC模块传输的HDMI信号后,根据触摸坐标确定触摸坐标对应的显示区域,并将第一视频流信号传输到显示屏上对应的显示区域,驱动显示屏对第一视频流信号进行显示。 Exemplarily, if the input channel corresponding to the touch signal is an input channel where the PC module is located, the touch frame transmits the touch signal to the PC module through the USB interface and the USB converter, and the PC module processes the touch signal and the first video is processed. The stream signal is sent to the Android chip through the HDMI signal, wherein the first video stream signal includes corresponding touch coordinates, and after receiving the HDMI signal transmitted by the PC module, the Android chip determines the display area corresponding to the touch coordinate according to the touch coordinate, and the first The video stream signal is transmitted to a corresponding display area on the display screen, and the display screen is driven to display the first video stream signal.
步骤270、将触摸信号转发给安卓芯片。Step 270: Forward the touch signal to the Android chip.
如果触摸信号的触摸坐标在不处理权限范围内,如若确定触摸坐标在智能终端本身对应的显示区域的坐标范围内,则触摸框通过串口以及MCU将触摸信号传送给安卓芯片。If the touch coordinate of the touch signal is within the range of the processing permission, if the touch coordinate is determined to be within the coordinate range of the display area corresponding to the smart terminal itself, the touch frame transmits the touch signal to the Android chip through the serial port and the MCU.
步骤280、安卓芯片根据触摸坐标识别出触摸信号对应的输入通道。Step 280: The Android chip identifies an input channel corresponding to the touch signal according to the touch coordinates.
安卓芯片接收到触摸信号后,对触摸信号进行处理,并根据触摸信号中的触摸坐标确定对应的显示区域,进而确定触摸信号对应的输入通道。After receiving the touch signal, the Android chip processes the touch signal, and determines a corresponding display area according to the touch coordinates in the touch signal, thereby determining an input channel corresponding to the touch signal.
步骤290、从对应的输入通道获取第二视频流信号,并将第二视频流信号传输到显示屏对应的显示区域。Step 290: Acquire a second video stream signal from the corresponding input channel, and transmit the second video stream signal to a display area corresponding to the display screen.
确定触摸信号对应的输入通道后,即可从确定的输入通道获取第二视频流信号,并将第二视频流信号传输到显示屏对应的显示区域。如若触摸信号对应的输入通道为智能终端本身所在输入通道,则安卓芯片获取智能终端本身对应的第二视频流信号,将第二视频流信号传输到智能终端本身对应的显示区域,驱动显示屏对第二视频流信号进行显示。After determining the input channel corresponding to the touch signal, the second video stream signal is obtained from the determined input channel, and the second video stream signal is transmitted to the display area corresponding to the display screen. If the input channel corresponding to the touch signal is the input channel of the smart terminal itself, the Android chip acquires the second video stream signal corresponding to the smart terminal itself, and transmits the second video stream signal to the display area corresponding to the smart terminal itself, and drives the display screen to The second video stream signal is displayed.
步骤2100、接收跨显示区域的传输信号。Step 2100: Receive a transmission signal across the display area.
其中,传输信号包括待传输文件信息、源显示区域的起始触摸坐标和目的显示区域的目的触摸坐标。The transmission signal includes file information to be transmitted, initial touch coordinates of the source display area, and destination touch coordinates of the destination display area.
图5为适用于本实施例的文件传输的示意图。示例性的,当从左显示区域拖动PC文件至左显示区域与右显示区域之间的交界处时,可接收到来自左显示区域的跨显示区域的传输信号。Fig. 5 is a schematic diagram of file transfer suitable for the present embodiment. Illustratively, when the PC file is dragged from the left display area to the boundary between the left display area and the right display area, a transmission signal from the left display area across the display area may be received.
步骤2110、根据起始触摸坐标和目的触摸坐标将传输信号分别反馈给对应的输入通道。 Step 2110: The transmission signal is respectively fed back to the corresponding input channel according to the initial touch coordinate and the target touch coordinate.
根据传输信号中的起始触摸坐标确定起始触摸坐标对应的输入通道以及根据传输信号中的目的触摸坐标确定目的触摸坐标对应的输入通道,并将接收到的传输信号分别反馈给起始触摸坐标对应的输入通道和目的触摸坐标对应的输入通道。Determining an input channel corresponding to the initial touch coordinate according to the initial touch coordinate in the transmission signal, and determining an input channel corresponding to the target touch coordinate according to the target touch coordinate in the transmission signal, and feeding back the received transmission signal to the initial touch coordinate respectively The corresponding input channel and the input channel corresponding to the target touch coordinate.
步骤2120、源显示区域对应的输入通道根据传输信号将待传输文件发送给目的显示区域对应的输入通道。Step 2120: The input channel corresponding to the source display area sends the file to be transmitted to the input channel corresponding to the destination display area according to the transmission signal.
其中,源显示区域为起始触摸坐标对应的显示区域,目的显示区域为目的触摸坐标对应的显示区域。The source display area is a display area corresponding to the initial touch coordinates, and the destination display area is a display area corresponding to the target touch coordinates.
示例性的,当左显示区域对应的输入通道与右显示区域对应的输入通道分别接收到传输信号后,左显示区域对应的输入通道将PC文件发送给右显示区域对应的输入通道,则右显示区域对应的输入通道接收PC文件,进而方便快速地实现不同输入通道之间的文件传输,实现各输入通道之间的资源共享。Exemplarily, when the input channel corresponding to the left display area and the input channel corresponding to the right display area respectively receive the transmission signal, the input channel corresponding to the left display area sends the PC file to the input channel corresponding to the right display area, and the right display The input channel corresponding to the area receives the PC file, thereby facilitating the file transfer between different input channels conveniently and quickly, and realizing resource sharing between the input channels.
本实施例通过判断触摸坐标是否在权限处理范围内,若是,根据触摸坐标识别出触摸信号对应的输入通道,并从对应的输入通道获取第一视频流信号,将第一视频流信号传输到显示屏对应的显示区域;若否,将触摸信号转发给安卓芯片,安卓芯片根据触摸坐标识别出触摸信号对应的输入通道,从对应的输入通道获取第二视频流信号,并将第二视频流信号传输到显示屏对应的显示区域,实现同时对不同输入通道的对应的输入设备进行显示和操控,无须频繁进行输入通道的切换,提升展示效果及用户体验,充分发挥多系统的优势。通过接收跨显示区域的传输信号,根据起始触摸坐标和目的触摸坐标将传输信号分别反馈给对应的输入通道,源显示区域对应的输入通道根据传输信号将待传输文件发送给目的显示区域对应的输入通道,实现简便快捷地实现各输入通道之 间的传输,实现各输入通道之间的资源共享。In this embodiment, by determining whether the touch coordinate is within the permission processing range, if yes, identifying an input channel corresponding to the touch signal according to the touch coordinate, and acquiring the first video stream signal from the corresponding input channel, and transmitting the first video stream signal to the display. The display area corresponding to the screen; if not, the touch signal is forwarded to the Android chip, the Android chip identifies the input channel corresponding to the touch signal according to the touch coordinates, acquires the second video stream signal from the corresponding input channel, and the second video stream signal It is transmitted to the display area corresponding to the display to realize display and control of corresponding input devices of different input channels at the same time, without frequent switching of input channels, improving display effect and user experience, and giving full play to the advantages of multiple systems. The receiving signal is fed back to the corresponding input channel according to the initial touch coordinate and the target touch coordinate, and the input channel corresponding to the source display area sends the file to be transmitted to the destination display area according to the transmission signal. Input channels for easy and fast implementation of each input channel Inter-transmission to achieve resource sharing between input channels.
实施例三Embodiment 3
图6为本发明实施例三提供的一种用于智能设备的操作装置的结构示意图,该装置适用于需对智能终端的不同输入通道对应的输入设备进行显示和操控的情况,该装置可以由软件和/或硬件方式实现,该装置用于执行上述实施例中的用于智能设备的操作方法。该装置包括:分屏显示指令接收模块310、显示区域划分模块320、触摸信号接收模块330和触摸信号反馈模块340,其中,FIG. 6 is a schematic structural diagram of an operation device for a smart device according to Embodiment 3 of the present invention. The device is applicable to a situation in which an input device corresponding to different input channels of the smart terminal needs to be displayed and manipulated, and the device may be configured by Implemented in software and/or hardware, the apparatus is for performing the method of operation for the smart device in the above embodiments. The device includes: a split screen display instruction receiving module 310, a display area dividing module 320, a touch signal receiving module 330, and a touch signal feedback module 340, wherein
分屏显示指令接收模块310,用于接收分屏显示指令,所述分屏显示指令包括显示区域数量和输入通道数量,其中输入通道数量为m,m大于等于2,显示区域数量为n,n大于等于m;The split screen display instruction receiving module 310 is configured to receive a split screen display instruction, where the split screen display instruction includes the number of display areas and the number of input channels, wherein the number of input channels is m, m is greater than or equal to 2, and the number of display areas is n, n Greater than or equal to m;
显示区域划分模块320,用于根据所述分屏显示指令在显示屏上划分显示区域,每一个显示区域对应一输入通道,保存每个显示区域所对应的坐标范围;The display area dividing module 320 is configured to divide a display area on the display screen according to the split screen display instruction, where each display area corresponds to an input channel, and the coordinate range corresponding to each display area is saved;
触摸信号接收模块330,用于接收各显示区域内的触摸信号,所述触摸信号包括触摸坐标;The touch signal receiving module 330 is configured to receive a touch signal in each display area, where the touch signal includes touch coordinates;
触摸信号反馈模块340,用于根据所述触摸坐标对应的坐标范围将所述触摸信号反馈给对应的输入通道。The touch signal feedback module 340 is configured to feed back the touch signal to a corresponding input channel according to a coordinate range corresponding to the touch coordinate.
本实施例通过分屏显示指令接收模块接收分屏显示指令,显示区域划分模块根据分屏显示指令在显示屏上划分显示区域,每一个显示区域对应一输入通道,保存每个显示区域所对应的坐标范围;触摸信号接收模块接收各显示区域内的触摸信号;触摸信号反馈模块根据触摸坐标对应的坐标范围将触摸信号反馈给对应的输入通道。实现同时对不同输入通道对应的输入设备进行显示和操 控,无须频繁进行输入通道的切换,提升展示效果及用户体验,充分发挥多系统的优势。In this embodiment, the split display command is received by the split screen display command receiving module, and the display area dividing module divides the display area on the display screen according to the split screen display instruction, and each display area corresponds to an input channel, and each display area is saved. a coordinate range; the touch signal receiving module receives the touch signal in each display area; the touch signal feedback module feeds back the touch signal to the corresponding input channel according to the coordinate range corresponding to the touch coordinate. Realize simultaneous display and operation of input devices corresponding to different input channels Control, no need to frequently switch the input channel, improve the display effect and user experience, give full play to the advantages of multiple systems.
上述方案中,可选的是,所述触摸信号反馈模块,包括:In the above solution, optionally, the touch signal feedback module includes:
第一输入通道识别单元,用于如果所述触摸信号的触摸坐标在处理权限范围内,则根据所述触摸坐标识别出所述触摸信号对应的输入通道;a first input channel identifying unit, configured to: if the touch coordinate of the touch signal is within a processing authority range, identify an input channel corresponding to the touch signal according to the touch coordinate;
第一视频流信号传输单元,用于从对应的输入通道获取第一视频流信号,并将所述第一视频流信号传输到所述显示屏对应的显示区域。a first video stream signal transmission unit, configured to acquire a first video stream signal from a corresponding input channel, and transmit the first video stream signal to a display area corresponding to the display screen.
上述方案中,可选的是,所述第一视频流信号传输单元,包括:In the above solution, optionally, the first video stream signal transmission unit includes:
第一视频流信号获取子单元,用于从对应的输入通道获取第一视频流信号;a first video stream signal acquisition subunit, configured to acquire a first video stream signal from a corresponding input channel;
第一视频流信号发送子单元,用于将所述第一视频流信号通过HDMI信号发送给安卓芯片,所述第一视频流信号包括对应的触摸坐标;a first video stream signal sending subunit, configured to send the first video stream signal to an Android chip by using an HDMI signal, where the first video stream signal includes corresponding touch coordinates;
第一视频流信号传输子单元,用于所述安卓芯片根据所述触摸坐标将所述第一视频流信号传输到所述显示屏对应的显示区域。a first video stream signal transmission subunit, configured to transmit, by the Android chip, the first video stream signal to a display area corresponding to the display screen according to the touch coordinates.
上述方案中,可选的是,所述触摸信号反馈模块,包括:In the above solution, optionally, the touch signal feedback module includes:
触摸信号转发单元,用于如果所述触摸信号的触摸坐标在不处理权限范围内,则将所述触摸信号转发给安卓芯片;a touch signal forwarding unit, configured to forward the touch signal to an Android chip if a touch coordinate of the touch signal is within a range of processing rights;
第二输入通道识别单元,用于所述安卓芯片根据所述触摸坐标识别出所述触摸信号对应的输入通道;a second input channel identifying unit, configured to identify, by the Android chip, an input channel corresponding to the touch signal according to the touch coordinate;
第二视频流信号传输单元,用于从对应的输入通道获取第二视频流信号,并将所述第二视频流信号传输到所述显示屏对应的显示区域。And a second video stream signal transmission unit, configured to acquire a second video stream signal from the corresponding input channel, and transmit the second video stream signal to a display area corresponding to the display screen.
上述方案中,可选的是,还包括:In the above solution, optionally, it also includes:
传输信号接收模块,用于接收跨显示区域的传输信号,所述传输信号包括 待传输文件信息、源显示区域的起始触摸坐标和目的显示区域的目的触摸坐标;a transmission signal receiving module, configured to receive a transmission signal across the display area, where the transmission signal includes File information to be transmitted, initial touch coordinates of the source display area, and destination touch coordinates of the destination display area;
传输信号反馈模块,用于根据所述起始触摸坐标和目的触摸坐标将所述传输信号分别反馈给对应的输入通道;a transmission signal feedback module, configured to respectively feed the transmission signal to a corresponding input channel according to the initial touch coordinate and the target touch coordinate;
传输文件发送模块,用于所述源显示区域对应的输入通道根据所述传输信号将所述待传输文件发送给所述目的显示区域对应的输入通道。And a transmission file sending module, wherein the input channel corresponding to the source display area sends the file to be transmitted to an input channel corresponding to the destination display area according to the transmission signal.
本发明实施例所提供的用于智能设备的操作装置可用于执行本发明任意实施例所提供的用于智能设备的操作方法,具备执行该方法相应的功能和有益效果,未在本实施例中详尽描述的技术细节,可参见本发明任意实施例所提供的用于智能设备的操作方法。The operating device for the smart device provided by the embodiment of the present invention may be used to perform the operating method for the smart device provided by any embodiment of the present invention, and has the corresponding functions and beneficial effects of performing the method, which is not in this embodiment. For a detailed description of the technical details, refer to the method for operating a smart device provided by any embodiment of the present invention.
实施例四Embodiment 4
图7为本发明实施例四提供的一种智能设备的结构示意图,如图7所示,该智能设备包括处理器410、存储器420、输入装置430和输出装置440;智能设备中处理器410的数量可以是一个或多个,图7中以一个处理器410为例;智能设备中的处理器410、存储器420、输入装置430和输出装置440可以通过总线或其他方式连接,图7中以通过总线连接为例。FIG. 7 is a schematic structural diagram of a smart device according to Embodiment 4 of the present invention. As shown in FIG. 7, the smart device includes a processor 410, a memory 420, an input device 430, and an output device 440. The processor 410 of the smart device The number may be one or more. In FIG. 7, one processor 410 is taken as an example; the processor 410, the memory 420, the input device 430, and the output device 440 in the smart device may be connected by a bus or other manner, and the figure is passed in FIG. The bus connection is an example.
存储器420作为一种计算机可读存储介质,可用于存储软件程序、计算机可执行程序以及模块,如本发明实施例中的用于智能设备的操作方法对应的程序指令/模块(例如,用于智能设备的操作装置中的分屏显示指令接收模块310、显示区域划分模块320、触摸信号接收模块330和触摸信号反馈模块340)。处理器410通过运行存储在存储器420中的软件程序、指令以及模块,从而执行智能设备的各种功能应用以及数据处理,即实现上述的用于智能设备的操作。 The memory 420 is used as a computer readable storage medium, and can be used to store a software program, a computer executable program, and a module, such as a program instruction/module corresponding to an operation method of the smart device in the embodiment of the present invention (for example, for intelligence) The split screen display instruction receiving module 310, the display area dividing module 320, the touch signal receiving module 330, and the touch signal feedback module 340) in the operating device of the device. The processor 410 executes various functional applications and data processing of the smart device by running software programs, instructions, and modules stored in the memory 420, that is, implementing the above-described operations for the smart device.
存储器420可主要包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需的应用程序;存储数据区可存储根据智能设备的使用所创建的数据等。此外,存储器420可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实例中,存储器420可进一步包括相对于处理器410远程设置的存储器,这些远程存储器可以通过网络连接至智能设备。上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。The memory 420 may mainly include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the smart device, and the like. Moreover, memory 420 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, memory 420 can further include memory remotely located relative to processor 410, which can be connected to the smart device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
输入装置430可用于接收输入的触摸信息,以及产生与智能设备的用户设置以及功能控制有关的键信号输入。输出装置440可包括显示屏等显示设备。The input device 430 can be configured to receive input touch information and generate key signal inputs related to user settings and function control of the smart device. Output device 440 can include a display device such as a display screen.
实施例五Embodiment 5
本发明实施例五还提供一种包含计算机可执行指令的存储介质,其上存储有计算机程序,该程序被处理器执行时实现本发明任意实施例提供的用于智能设备的操作方法。The fifth embodiment of the present invention further provides a storage medium containing computer executable instructions, where the computer program is stored, and when the program is executed by the processor, the operation method for the smart device provided by any embodiment of the present invention is implemented.
通过以上关于实施方式的描述,所属领域的技术人员可以清楚地了解到,本发明可借助软件及必需的通用硬件来实现,当然也可以通过硬件实现,但很多情况下前者是更佳的实施方式。基于这样的理解,本发明的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在计算机可读存储介质中,如计算机的软盘、只读存储器(Read-Only Memory,ROM)、随机存取存储器(Random Access Memory,RAM)、闪存(FLASH)、硬盘或光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例所述的方法。 Through the above description of the embodiments, those skilled in the art can clearly understand that the present invention can be implemented by software and necessary general hardware, and can also be implemented by hardware, but in many cases, the former is a better implementation. . Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product, which may be stored in a computer readable storage medium, such as a floppy disk of a computer. , Read-Only Memory (ROM), Random Access Memory (RAM), Flash (FLASH), hard disk or optical disk, etc., including a number of instructions to make a computer device (can be a personal computer) The server, or network device, etc.) performs the methods described in various embodiments of the present invention.
值得注意的是,上述用于智能设备的操作装置的实施例中,所包括的各个单元和模块只是按照功能逻辑进行划分的,但并不局限于上述的划分,只要能够实现相应的功能即可;另外,各功能单元的具体名称也只是为了便于相互区分,并不用于限制本发明的保护范围。It should be noted that, in the foregoing embodiment of the operating device for the smart device, each unit and module included is only divided according to functional logic, but is not limited to the above-mentioned division, as long as the corresponding function can be implemented. In addition, the specific names of the respective functional units are only for convenience of distinguishing from each other, and are not intended to limit the scope of protection of the present invention.
注意,上述仅为本发明的较佳实施例及所运用技术原理。本领域技术人员会理解,本发明不限于这里所述的特定实施例,对本领域技术人员来说能够进行各种明显的变化、重新调整和替代而不会脱离本发明的保护范围。因此,虽然通过以上实施例对本发明进行了较为详细的说明,但是本发明不仅仅限于以上实施例,在不脱离本发明构思的情况下,还可以包括更多其他等效实施例,而本发明的范围由所附的权利要求范围决定。 Note that the above are only the preferred embodiments of the present invention and the technical principles applied thereto. Those skilled in the art will appreciate that the present invention is not limited to the specific embodiments described herein, and that various modifications, changes and substitutions may be made without departing from the scope of the invention. Therefore, the present invention has been described in detail by the above embodiments, but the present invention is not limited to the above embodiments, and other equivalent embodiments may be included without departing from the inventive concept. The scope is determined by the scope of the appended claims.

Claims (12)

  1. 一种用于智能设备的操作方法,其特征在于,包括:A method for operating a smart device, comprising:
    接收分屏显示指令,所述分屏显示指令包括显示区域数量和输入通道数量,其中输入通道数量为m,m大于等于2,显示区域数量为n,n大于等于m;Receiving a split screen display instruction, the split screen display instruction includes a number of display areas and a number of input channels, wherein the number of input channels is m, m is greater than or equal to 2, and the number of display areas is n, n is greater than or equal to m;
    根据所述分屏显示指令在显示屏上划分显示区域,每一个显示区域对应一输入通道,保存每个显示区域所对应的坐标范围;And displaying, according to the split screen display instruction, a display area on the display screen, each display area corresponding to an input channel, and storing a coordinate range corresponding to each display area;
    接收各显示区域内的触摸信号,所述触摸信号包括触摸坐标;Receiving a touch signal in each display area, the touch signal including touch coordinates;
    根据所述触摸坐标对应的坐标范围将所述触摸信号反馈给对应的输入通道。The touch signal is fed back to the corresponding input channel according to the coordinate range corresponding to the touch coordinate.
  2. 根据权利要求1所述的用于智能设备的操作方法,其特征在于,所述根据所述触摸坐标对应的坐标范围将所述触摸信号反馈给对应的输入通道,包括:The method for operating a smart device according to claim 1, wherein the feeding back the touch signal to a corresponding input channel according to a coordinate range corresponding to the touch coordinate comprises:
    如果所述触摸信号的触摸坐标在处理权限范围内,则根据所述触摸坐标识别出所述触摸信号对应的输入通道;If the touch coordinate of the touch signal is within the processing authority range, identifying an input channel corresponding to the touch signal according to the touch coordinate;
    从对应的输入通道获取第一视频流信号,并将所述第一视频流信号传输到所述显示屏对应的显示区域。Acquiring a first video stream signal from the corresponding input channel, and transmitting the first video stream signal to a display area corresponding to the display screen.
  3. 根据权利要求2所述的用于智能设备的操作方法,其特征在于,将所述第一视频流信号传输到所述显示屏对应的显示区域包括:The method for operating a smart device according to claim 2, wherein the transmitting the first video stream signal to the display area corresponding to the display screen comprises:
    将所述第一视频流信号通过HDMI信号发送给安卓芯片,所述第一视频流信号包括对应的触摸坐标;Transmitting the first video stream signal to an Android chip by using an HDMI signal, where the first video stream signal includes corresponding touch coordinates;
    所述安卓芯片根据所述触摸坐标将所述第一视频流信号传输到所述显示屏对应的显示区域。The Android chip transmits the first video stream signal to a display area corresponding to the display screen according to the touch coordinates.
  4. 根据权利要求3所述的用于智能设备的操作方法,其特征在于,所述根据所述触摸坐标对应的坐标范围将所述触摸信号反馈给对应的输入通道,包括: The method for operating a smart device according to claim 3, wherein the feeding back the touch signal to a corresponding input channel according to a coordinate range corresponding to the touch coordinate comprises:
    如果所述触摸信号的触摸坐标在不处理权限范围内,则将所述触摸信号转发给安卓芯片;If the touch coordinates of the touch signal are within a range of processing rights, forwarding the touch signal to an Android chip;
    所述安卓芯片根据所述触摸坐标识别出所述触摸信号对应的输入通道;The Android chip identifies an input channel corresponding to the touch signal according to the touch coordinates;
    从对应的输入通道获取第二视频流信号,并将所述第二视频流信号传输到所述显示屏对应的显示区域。Acquiring a second video stream signal from the corresponding input channel, and transmitting the second video stream signal to a display area corresponding to the display screen.
  5. 根据权利要求1所述的用于智能设备的操作方法,其特征在于,还包括:The operating method for a smart device according to claim 1, further comprising:
    接收跨显示区域的传输信号,所述传输信号包括待传输文件信息、源显示区域的起始触摸坐标和目的显示区域的目的触摸坐标;Receiving a transmission signal across the display area, the transmission signal including file information to be transmitted, initial touch coordinates of the source display area, and destination touch coordinates of the destination display area;
    根据所述起始触摸坐标和目的触摸坐标将所述传输信号分别反馈给对应的输入通道;And respectively transmitting the transmission signal to the corresponding input channel according to the initial touch coordinate and the target touch coordinate;
    所述源显示区域对应的输入通道根据所述传输信号将所述待传输文件发送给所述目的显示区域对应的输入通道。The input channel corresponding to the source display area sends the file to be transmitted to an input channel corresponding to the destination display area according to the transmission signal.
  6. 一种用于智能设备的操作装置,其特征在于,包括:An operating device for a smart device, comprising:
    分屏显示指令接收模块,用于接收分屏显示指令,所述分屏显示指令包括显示区域数量和输入通道数量,其中输入通道数量为m,m大于等于2,显示区域数量为n,n大于等于m;The split screen display instruction receiving module is configured to receive a split screen display instruction, where the split screen display instruction includes the number of display areas and the number of input channels, wherein the number of input channels is m, m is greater than or equal to 2, and the number of display areas is n, n is greater than Equal to m;
    显示区域划分模块,用于根据所述分屏显示指令在显示屏上划分显示区域,每一个显示区域对应一输入通道,保存每个显示区域所对应的坐标范围;a display area dividing module, configured to divide a display area on the display screen according to the split screen display instruction, where each display area corresponds to an input channel, and the coordinate range corresponding to each display area is saved;
    触摸信号接收模块,用于接收各显示区域内的触摸信号,所述触摸信号包括触摸坐标;a touch signal receiving module, configured to receive a touch signal in each display area, where the touch signal includes touch coordinates;
    触摸信号反馈模块,用于根据所述触摸坐标对应的坐标范围将所述触摸信号反馈给对应的输入通道。 The touch signal feedback module is configured to feed back the touch signal to a corresponding input channel according to a coordinate range corresponding to the touch coordinate.
  7. 根据权利要求6所述的用于智能设备的操作装置,其特征在于,所述触摸信号反馈模块,包括:The operating device for a smart device according to claim 6, wherein the touch signal feedback module comprises:
    第一输入通道识别单元,用于如果所述触摸信号的触摸坐标在处理权限范围内,则根据所述触摸坐标识别出所述触摸信号对应的输入通道;a first input channel identifying unit, configured to: if the touch coordinate of the touch signal is within a processing authority range, identify an input channel corresponding to the touch signal according to the touch coordinate;
    第一视频流信号传输单元,用于从对应的输入通道获取第一视频流信号,并将所述第一视频流信号传输到所述显示屏对应的显示区域。a first video stream signal transmission unit, configured to acquire a first video stream signal from a corresponding input channel, and transmit the first video stream signal to a display area corresponding to the display screen.
  8. 根据权利要求7所述的用于智能设备的操作装置,其特征在于,所述第一视频流信号传输单元,包括:The operating device for a smart device according to claim 7, wherein the first video stream signal transmission unit comprises:
    第一视频流信号获取子单元,用于从对应的输入通道获取第一视频流信号;a first video stream signal acquisition subunit, configured to acquire a first video stream signal from a corresponding input channel;
    第一视频流信号发送子单元,用于将所述第一视频流信号通过HDMI信号发送给安卓芯片,所述第一视频流信号包括对应的触摸坐标;a first video stream signal sending subunit, configured to send the first video stream signal to an Android chip by using an HDMI signal, where the first video stream signal includes corresponding touch coordinates;
    第一视频流信号传输子单元,用于所述安卓芯片根据所述触摸坐标将所述第一视频流信号传输到所述显示屏对应的显示区域。a first video stream signal transmission subunit, configured to transmit, by the Android chip, the first video stream signal to a display area corresponding to the display screen according to the touch coordinates.
  9. 根据权利要求8所述的用于智能设备的操作装置,其特征在于,所述触摸信号反馈模块,包括:The operating device for a smart device according to claim 8, wherein the touch signal feedback module comprises:
    触摸信号转发单元,用于如果所述触摸信号的触摸坐标在不处理权限范围内,则将所述触摸信号转发给安卓芯片;a touch signal forwarding unit, configured to forward the touch signal to an Android chip if a touch coordinate of the touch signal is within a range of processing rights;
    第二输入通道识别单元,用于所述安卓芯片根据所述触摸坐标识别出所述触摸信号对应的输入通道;a second input channel identifying unit, configured to identify, by the Android chip, an input channel corresponding to the touch signal according to the touch coordinate;
    第二视频流信号传输单元,用于从对应的输入通道获取第二视频流信号,并将所述第二视频流信号传输到所述显示屏对应的显示区域。And a second video stream signal transmission unit, configured to acquire a second video stream signal from the corresponding input channel, and transmit the second video stream signal to a display area corresponding to the display screen.
  10. 根据权利要求6所述的用于智能设备的操作装置,其特征在于,还包 括:The operating device for a smart device according to claim 6, further comprising include:
    传输信号接收模块,用于接收跨显示区域的传输信号,所述传输信号包括待传输文件信息、源显示区域的起始触摸坐标和目的显示区域的目的触摸坐标;a transmission signal receiving module, configured to receive a transmission signal across the display area, where the transmission signal includes file information to be transmitted, initial touch coordinates of the source display area, and destination touch coordinates of the destination display area;
    传输信号反馈模块,用于根据所述起始触摸坐标和目的触摸坐标将所述传输信号分别反馈给对应的输入通道;a transmission signal feedback module, configured to respectively feed the transmission signal to a corresponding input channel according to the initial touch coordinate and the target touch coordinate;
    传输文件发送模块,用于所述源显示区域对应的输入通道根据所述传输信号将所述待传输文件发送给所述目的显示区域对应的输入通道。And a transmission file sending module, wherein the input channel corresponding to the source display area sends the file to be transmitted to an input channel corresponding to the destination display area according to the transmission signal.
  11. 一种智能设备,其特征在于,所述智能设备包括:A smart device, characterized in that the smart device comprises:
    一个或多个处理器;One or more processors;
    存储器,用于存储一个或多个程序,Memory for storing one or more programs,
    当所述一个或多个程序被所述一个或多个处理器执行,使得所述一个或多个处理器实现如权利要求1-5中任一所述的用于智能设备的操作方法。The one or more programs are executed by the one or more processors, such that the one or more processors implement the method of operation for the smart device of any of claims 1-5.
  12. 一种计算机可读存储介质,其上存储有计算机程序,其特征在于,该程序被处理器执行时实现如权利要求1-5中任一所述的用于智能设备的操作方法。 A computer readable storage medium having stored thereon a computer program, characterized in that the program, when executed by a processor, implements an operating method for a smart device as claimed in any one of claims 1-5.
PCT/CN2017/103246 2017-07-10 2017-09-25 Smart device and operation method therefor, apparatus and computer storage medium WO2019010828A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201710555550.3A CN107340967A (en) 2017-07-10 2017-07-10 A kind of smart machine and its operating method and device and computer-readable storage medium
CN201710555550.3 2017-07-10

Publications (1)

Publication Number Publication Date
WO2019010828A1 true WO2019010828A1 (en) 2019-01-17

Family

ID=60218448

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/103246 WO2019010828A1 (en) 2017-07-10 2017-09-25 Smart device and operation method therefor, apparatus and computer storage medium

Country Status (2)

Country Link
CN (1) CN107340967A (en)
WO (1) WO2019010828A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112345122A (en) * 2019-08-09 2021-02-09 北京康斯特仪表科技股份有限公司 Industrial instrument equipment and interface operation method thereof

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108113231B (en) * 2017-11-22 2020-11-03 北京新弘宝科技有限公司 Multi-user group screen splitting system and intelligent dining table
CN107959811B (en) * 2017-12-20 2022-08-16 深圳市深智电科技有限公司 Touchable interactive HDMI IN display and processing method
CN108845613B (en) * 2018-04-09 2021-07-09 广州视源电子科技股份有限公司 Interactive intelligent tablet computer and data processing method and device thereof
CN208459985U (en) * 2018-05-04 2019-02-01 广州视源电子科技股份有限公司 A kind of touch control display system
CN110543264B (en) * 2018-05-28 2022-05-10 中兴通讯股份有限公司 Method, equipment and storage medium for application interaction based on split screen mode
CN110581988B (en) * 2018-06-07 2021-01-01 杭州海康威视数字技术股份有限公司 Signal quality detection method and device, electronic equipment and storage medium
CN110457109B (en) * 2019-08-15 2021-07-23 北京字节跳动网络技术有限公司 Multi-window parallel method and device, terminal and storage medium
CN112580313B (en) * 2019-09-30 2023-06-20 广州视源电子科技股份有限公司 Annotating method, system, equipment and storage medium for courseware
CN112579019B (en) * 2019-09-30 2024-03-12 广州视源电子科技股份有限公司 Annotating method, system, equipment and storage medium for courseware
CN111427501B (en) * 2020-03-23 2021-07-23 广州视源电子科技股份有限公司 Touch control implementation method and interactive intelligent device
CN111880759A (en) * 2020-08-05 2020-11-03 深圳市嘉润原新显科技有限公司 Control method and device for multi-split screen display picture, display and storage medium
CN112099688A (en) * 2020-09-09 2020-12-18 上海商米科技集团股份有限公司 Multi-application operation self-adaption method based on Andriod, window and electronic equipment
CN113419664A (en) * 2021-07-23 2021-09-21 广州朗国电子科技股份有限公司 Whiteboard writing area adaptation method, device and medium in all-in-one machine multi-window mode

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015219743A (en) * 2014-05-19 2015-12-07 アルパイン株式会社 Information processing device and computer program
CN105446675A (en) * 2014-08-18 2016-03-30 联想(北京)有限公司 Split-screen displaying method and electronic device
CN106201413A (en) * 2016-06-24 2016-12-07 青岛海信电器股份有限公司 Touch-control distribution method, device and the liquid crystal indicator of one screen windows display
CN106502557A (en) * 2016-09-14 2017-03-15 深圳众思科技有限公司 A kind of split screen transmits the method and device of file

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106020473A (en) * 2016-05-19 2016-10-12 上海卓易科技股份有限公司 Interface operation method and system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2015219743A (en) * 2014-05-19 2015-12-07 アルパイン株式会社 Information processing device and computer program
CN105446675A (en) * 2014-08-18 2016-03-30 联想(北京)有限公司 Split-screen displaying method and electronic device
CN106201413A (en) * 2016-06-24 2016-12-07 青岛海信电器股份有限公司 Touch-control distribution method, device and the liquid crystal indicator of one screen windows display
CN106502557A (en) * 2016-09-14 2017-03-15 深圳众思科技有限公司 A kind of split screen transmits the method and device of file

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112345122A (en) * 2019-08-09 2021-02-09 北京康斯特仪表科技股份有限公司 Industrial instrument equipment and interface operation method thereof

Also Published As

Publication number Publication date
CN107340967A (en) 2017-11-10

Similar Documents

Publication Publication Date Title
WO2019010828A1 (en) Smart device and operation method therefor, apparatus and computer storage medium
WO2019120054A1 (en) Interactive control method and system, and terminal and storage medium
CN103226454B (en) A kind of method and system realizing multihead display
WO2021072926A1 (en) File sharing method, apparatus, and system, interactive smart device, source end device, and storage medium
US9639491B2 (en) Connection interface switching device for multiple portable devices
KR101887883B1 (en) Integrated mobile desktop
US10031710B2 (en) Display device constituting multi-display system and control method thereof
US20210294559A1 (en) Method and system for remote collaboration
US10824384B2 (en) Controller for providing sharing between visual devices
US20100013759A1 (en) Kvm switch with separate on-screen display and control channels
WO2017124903A1 (en) Interactive smart tablet and interactive method, mode and system therefor
EP3073731B1 (en) Video conference method, terminal, and system
WO2024045985A1 (en) Screen control method, screen control apparatus, electronic device, program, and medium
US20140380161A1 (en) Information processing apparatus, information processing method, and program
US20170185269A1 (en) Display management solution
US11362854B2 (en) Information processing apparatus, information processing method, program, and information processing system
KR102168948B1 (en) Mobile video control system and and operation method thereof
CN103336649A (en) Feedback window image sharing method and device among terminals
CN209980227U (en) Intelligent display system and device
CN110611711A (en) Teaching system, teaching system communication method and device and storage medium
CN112584065A (en) Courseware display method, system, equipment and storage medium
CN112579020A (en) Courseware annotating method, system, device and storage medium
TWI825918B (en) Display control method and related display control apparatus and display device
TWM497303U (en) Connection interface switching device for multiple computers
CN112579016B (en) Annotating method, system, equipment and storage medium for courseware

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17917336

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 14.07.2020)

122 Ep: pct application non-entry in european phase

Ref document number: 17917336

Country of ref document: EP

Kind code of ref document: A1