WO2021164756A1 - Input method and apparatus for smart television, computer device, and storage medium - Google Patents

Input method and apparatus for smart television, computer device, and storage medium Download PDF

Info

Publication number
WO2021164756A1
WO2021164756A1 PCT/CN2021/077013 CN2021077013W WO2021164756A1 WO 2021164756 A1 WO2021164756 A1 WO 2021164756A1 CN 2021077013 W CN2021077013 W CN 2021077013W WO 2021164756 A1 WO2021164756 A1 WO 2021164756A1
Authority
WO
WIPO (PCT)
Prior art keywords
smart
character information
input
virtual keyboard
input function
Prior art date
Application number
PCT/CN2021/077013
Other languages
French (fr)
Chinese (zh)
Inventor
蔡历武
陈贺良
Original Assignee
深圳市万普拉斯科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市万普拉斯科技有限公司 filed Critical 深圳市万普拉斯科技有限公司
Publication of WO2021164756A1 publication Critical patent/WO2021164756A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/475—End-user interface for inputting end-user data, e.g. personal identification number [PIN], preference data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/02—Input arrangements using manually operated switches, e.g. using keyboards or dials
    • G06F3/023—Arrangements for converting discrete items of information into a coded form, e.g. arrangements for interpreting keyboard generated codes as alphanumeric codes, operand codes or instruction codes
    • G06F3/0233—Character input methods
    • G06F3/0236—Character input methods using selection techniques to select from displayed items
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03543—Mice or pucks
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04886—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/42212—Specific keyboard arrangements
    • H04N21/42218—Specific keyboard arrangements for mapping a matrix of displayed objects on the screen to the numerical key-matrix of the remote control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/422—Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42204—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor
    • H04N21/42206—User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor characterized by hardware details
    • H04N21/4222—Remote control device emulator integrated into a non-television apparatus, e.g. a PDA, media center or smart toy

Definitions

  • This application relates to the technical field of smart TVs, and in particular to an input method, device, computer equipment and computer-readable storage medium for smart TVs.
  • smart TVs are widely used in homes. Compared with traditional TVs, smart TVs can obtain programs through the network, which makes resources more abundant and users have a stronger viewing experience.
  • a user registers an APP on a smart TV or performs a search operation, he needs to enter a user name, password or search content through the virtual keyboard on the smart TV, which requires the user to switch back and forth between letters, numbers, and symbols.
  • the content is entered incorrectly, it needs to be deleted from the current position to the error position, and then re-entered, resulting in low input efficiency.
  • An input method for smart TV includes:
  • the second character information is sent to the smart TV, wherein the smart TV invokes the input function to execute the second character information to input the first character information into the input box of the smart TV middle.
  • the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information includes:
  • the second character information is determined according to the input function with the highest priority and the first character information.
  • the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information includes:
  • the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information includes:
  • the method of obtaining the target coordinate value corresponding to the first character information on the virtual keyboard of the smart TV includes:
  • the target coordinate value corresponding to the first character information is determined according to the coordinate value of each button and the button name.
  • the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information includes:
  • the method of obtaining the target position information corresponding to the focus on the virtual keyboard of the smart TV includes:
  • the method of obtaining the target position information corresponding to the first character information on the virtual keyboard of the smart TV includes:
  • the target location information corresponding to the first character information is determined according to the location information of each button and the button name.
  • the acquiring position information of each key of the virtual keyboard in the screenshot image includes:
  • the number of steps for each key of the virtual keyboard to move to the corresponding edge key is acquired in the screenshot image, and the number of steps for each key to move to the corresponding edge key is used as the position information of each key.
  • the keys include: keys on the virtual keyboard close to the boundary of the virtual keyboard.
  • An input device for a smart TV comprising:
  • the obtaining module is used to obtain the input first character information
  • the determining module is configured to obtain the input function supported by the smart TV connected to the terminal, and determine the second character information according to the input function and the first character information;
  • the sending module is configured to send the second character information to the smart TV, wherein the smart TV invokes the input function to execute the second character information, so as to input the first character information to the The input box of the smart TV.
  • a computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when the processor executes the computer program:
  • the second character information is sent to the smart TV, wherein the smart TV invokes the input function to execute the second character information to input the first character information into the input box of the smart TV middle.
  • a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the following steps are implemented:
  • the second character information is sent to the smart TV, wherein the smart TV invokes the input function to execute the second character information to input the first character information into the input box of the smart TV middle.
  • the above-mentioned input method, device, computer equipment, and computer-readable storage medium for a smart TV obtain the input first character information, obtain the input function supported by the smart TV connected to the terminal, and determine according to the input function and the first character information
  • the second character information is to send the second character information to the smart TV, where the smart TV calls the input function to execute the second character information to input the first character information into the input box of the smart TV, so that the character information is input in the terminal ,
  • the terminal processes the character information for the input function supported by the smart TV, so that the character information can be called by the input function supported by the smart TV, which improves the input efficiency of the smart TV.
  • FIG. 1 is an application environment diagram of an input method used in a smart TV in an embodiment
  • FIG. 2 is a schematic flowchart of an input method for a smart TV in an embodiment
  • FIG. 3 is a schematic diagram of a detailed process of selecting an input function in an embodiment
  • Figure 4 is a schematic diagram of a flow of simulating physical keyboard input in an embodiment
  • FIG. 5 is a schematic diagram of a flow of simulating mouse input in an embodiment
  • FIG. 6 is a schematic diagram of a flow of simulating moving focus input in an embodiment
  • Fig. 7 is a structural block diagram of an input device for a smart TV in an embodiment
  • Fig. 8 is an internal structure diagram of a computer device in an embodiment.
  • the input method for smart TV can be applied to the application environment as shown in FIG. 1.
  • the terminal 102 communicates with the smart TV 104 through the network through the network.
  • the terminal 102 obtains the input first character information;
  • the terminal 102 obtains the input function supported by the smart TV 104 connected to the terminal 102, and determines the second character information according to the input function and the first character information;
  • the terminal 102 sends the second character information to The smart TV 104, wherein the smart TV 104 calls an input function to execute the second character information, so as to input the first character information into the input box of the smart TV 104.
  • the terminal 102 may be, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices.
  • an input method for a smart TV is provided. Taking the method applied to the terminal in FIG. 1 as an example for description, the method includes the following steps:
  • Step 202 Obtain the input first character information.
  • the first character information is character information input through the keyboard of the terminal, and the character information can be character information corresponding to any key on the keyboard of the terminal, such as character information such as English letters, numbers, punctuation marks, etc., or confirmation, Edit information such as deleting and moving.
  • the keyboard of the terminal may be a virtual keyboard or a physical keyboard built in the terminal, or a physical keyboard external to the terminal.
  • Step 204 Obtain input functions supported by the smart TV connected to the terminal, and determine second character information according to the input function and the first character information.
  • the input functions supported by the smart TV may include at least one of physical keyboard input, mouse input, and moving focus input.
  • Physical keyboard input means that the smart TV supports an external physical keyboard, and the user can input by pressing the keys of the physical keyboard
  • mouse input means that the smart TV supports an external mouse, and the user can click on the virtual keyboard of the smart TV to input through the mouse
  • move focus input is Means that the smart TV supports a virtual keyboard, and the user can control the focus to move on the virtual keyboard through a control device (such as a remote control, a mobile phone, a tablet computer, etc.), so as to select a key on the virtual keyboard through the focus to input.
  • a control device such as a remote control, a mobile phone, a tablet computer, etc.
  • the second character information is character information executable by the input function supported by the smart TV.
  • the format of the second character information may be a key value code; if the input function supported by the smart TV is mouse input, the format of the second character information may be virtual The coordinate value of the keys of the keyboard; if the input function supported by the smart TV is moving focus input, the format of the second character information can be a moving path, which refers to the moving path from the position of the focus to the position of the first character information .
  • Step 206 Send the second character information to the smart TV, where the smart TV invokes the input function to execute the second character information, so as to input the first character information to the smart TV In the input box.
  • the smart TV invokes the physical keyboard input function to execute the key value code to input the first character information in the input box of the smart TV; if the format of the second character information is The coordinate value of the key of the virtual keyboard, the smart TV calls the mouse input function to execute the coordinate value to input the first character information in the input box of the smart TV; if the format of the second character information is a virtual path, the smart TV calls the mobile focus input The function executes the virtual path to input the first character information in the input box of the smart TV.
  • the input first character information is obtained, the input function supported by the smart TV connected to the terminal is obtained, the second character information is determined according to the input function and the first character information, and the second character information is Send to the smart TV, where the smart TV invokes the input function to execute the second character information to input the first character information into the input box of the smart TV, so that the character information is input in the terminal, and the terminal is directed to the input function supported by the smart TV
  • the character information is processed so that the character information can be called by the input function supported by the smart TV, and the input efficiency of the smart TV is improved.
  • the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information includes: obtaining the smart TV connected to the terminal Supported input functions, when the smart TV supports at least two input functions, the priority of the input functions supported by the smart TV is acquired; according to the input function with the highest priority and the first The character information determines the second character information.
  • the priority of the input function supported by the smart TV is used to preferentially select the input function.
  • the priority of the input functions supported by the smart TV can be set according to actual applications.
  • the input functions supported by the smart TV include: physical keyboard input, mouse input, and focus input
  • the priority may be:
  • the physical keyboard input function takes precedence over the mouse input function
  • the mouse input function takes precedence over the focus input.
  • the terminal obtains the input functions supported by the smart TV connected to the terminal, and first checks whether it supports physical keyboard input. If it supports physical keyboard input, it simulates physical keyboard input events. If it does not support physical keyboard input, it checks whether it supports Mouse input, if it supports mouse input, simulate mouse input events, if it does not support mouse input, check whether it supports moving focus input, if it supports moving focus input, simulate moving focus events.
  • the input function supported by the smart TV connected to the terminal is obtained, and when the input function supported by the smart TV is at least two, the priority of the input function supported by the smart TV is obtained, according to
  • the input function with the highest priority and the first character information determine the second character information, and the input function with a relatively simplified operation process is preferentially selected for simulation, which saves computer resources and improves operation speed.
  • the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information includes: obtaining the smart TV connected to the terminal Supported input function, when the input function is physical keyboard input, obtain the target key value code corresponding to the first character information on the physical keyboard external to the smart TV; The target key value code is used as the second character information.
  • the physical keyboard input means that the smart TV supports an external physical keyboard, and the user can input by pressing the keys of the physical keyboard.
  • the target key value code is the key value code corresponding to the first character information.
  • each key on the physical keyboard corresponds to a unique key value code
  • the first character information can be converted into a key value code (ie, second character information) to simulate a physical keyboard input event.
  • the terminal receives the first character information; step 404, converts the first character information into a key value code; step 406, sends the key value code to the smart TV.
  • the smart TV calls the physical keyboard input function to execute the key value code.
  • the input function is physical keyboard input
  • the target key value code corresponding to the first character information on the physical keyboard external to the smart TV is obtained, and the target key value code corresponding to the first character information
  • the input of the smart TV is realized by simulating physical keyboard input events, which improves the input efficiency.
  • the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information includes:
  • the input function supported by the smart TV connected to the terminal and when the input function is mouse input, obtain the target coordinate value corresponding to the first character information on the virtual keyboard of the smart TV;
  • the target coordinate value corresponding to the first character information is used as the second character information.
  • the mouse input means that the smart TV supports an external mouse, and the user can input by clicking the virtual keyboard of the smart TV with the mouse.
  • the target coordinate value is the coordinate value corresponding to the first character information on the virtual keyboard.
  • each key on the virtual keyboard corresponds to a unique coordinate value, so the first character information can be converted into coordinate values (that is, the second character information) to simulate a mouse input event.
  • the terminal receives the first character information; step 504, convert the first character information into coordinate values; step 506, send the coordinate values to the smart TV. In this way, the smart TV calls the mouse input function to execute the coordinate value.
  • the input of smart TV is realized by simulating mouse input events, which improves the input efficiency.
  • the method of obtaining the target coordinate value corresponding to the first character information on the virtual keyboard of the smart TV includes: obtaining a screenshot image of the virtual keyboard of the smart TV; The coordinate value of each key of the virtual keyboard is acquired from the image; the target coordinate value corresponding to the first character information is determined according to the coordinate value of each key and the name of the key.
  • the terminal sends a screenshot instruction to the smart TV, and the smart TV performs a screenshot operation to obtain a screenshot image, the screenshot image includes a virtual keyboard image, and the screenshot image is returned to the terminal.
  • the terminal obtains the coordinate value of each key of the virtual keyboard in the screenshot image.
  • the target key corresponding to the first character information is determined according to the first character information and the name of each key, and then the target coordinate value of the first character information is determined. For example, if the first character information is A, then the target button corresponding to the first character information is the A button, and the target coordinate value of the first character information is the coordinate value of the A button.
  • the operation of determining the coordinate value of each button may be performed every time the mouse input is invoked.
  • the coordinate value of each button can also be stored in advance. When the mouse input is called, the coordinate value of each button can be directly called.
  • a screenshot image of the virtual keyboard of the smart TV is obtained, the coordinate value of each key of the virtual keyboard is obtained in the screenshot image, and the corresponding value of the first character information is determined according to the coordinate value of each key and the name of the key
  • the target coordinate value of the virtual keyboard is determined to simulate the mouse input event by determining the coordinate value of each button on the virtual keyboard, which improves the input efficiency.
  • the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information includes: obtaining the smart TV connected to the terminal Supported input function, when the input function is moving focus input, obtain the target position information corresponding to the first character information on the virtual keyboard of the smart TV, and the virtual keyboard with the focus on the smart TV Target position information corresponding to the keyboard; obtain a target movement path between the target position information corresponding to the first character information and the target position information corresponding to the focus; use the target movement path as the second character information.
  • mobile focus input means that the smart TV supports a virtual keyboard, and the user can control the focus to move on the virtual keyboard through a control device (such as a remote control, a mobile phone, a tablet computer, etc.) to select a key on the virtual keyboard through the focus to input.
  • a control device such as a remote control, a mobile phone, a tablet computer, etc.
  • the target position information is the first character information or the position information corresponding to the focus on the virtual keyboard.
  • the position information is used to characterize the position of a key on the virtual keyboard, which can be characterized by the number of steps a key moves to the corresponding edge key.
  • the edge key can include the key close to the virtual keyboard boundary, and the virtual keyboard boundary can include up and down. , Left and right boundaries.
  • the target movement path is a movement path between the target position information corresponding to the first character information and the target position information corresponding to the focus.
  • the movement path is used to characterize the path from one key on the virtual keyboard to another key.
  • the movement path is the path with the least number of keys.
  • the movement path can be characterized by the number of steps moving in various directions, such as setting up, down, left and right four directions, the movement path can be characterized as the number of steps moved in the four directions up, down, left and right, each step Corresponds to a button.
  • U1 indicates the number of steps a button moves up
  • D1 indicates the number of steps a button moves down
  • L1 indicates the number of steps a button moves to the left
  • R1 indicates a button moves to the right
  • the movement path from A to E is (1,0,0,2), that is, one step up and two steps to the right.
  • the position information of each key of the virtual keyboard of the smart TV is obtained, the target key corresponding to the first character information is obtained, and the target position information of the first character information is determined.
  • the focus has a color-protruding feature, and the color-protruding feature is achieved by being inconsistent with the color of each key on the virtual keyboard.
  • the image recognition technology can be used to determine the target button where the focus is located, and then the target location information of the focus can be determined.
  • the image recognition technology may be openCV technology.
  • each key on the virtual keyboard corresponds to a unique layout position, so the first character information can be converted into coordinate values (that is, the second character information) to simulate a moving focus input event.
  • the terminal receives the first character information; step 604, obtain the target position information corresponding to the first character information on the virtual keyboard of the smart TV, and the target position corresponding to the focus on the virtual keyboard of the smart TV Information; Step 606, obtain the target movement path between the target position information corresponding to the first character information and the target position information corresponding to the focus; Step 608, send the target movement path to the smart TV.
  • the target moving path between the target location information corresponding to the first character information and the target location information corresponding to the focus is the shortest moving path, which can be calculated by the shortest distance algorithm.
  • the smart TV calls the mobile focus input function to simulate a series of movement events and confirmation events to execute the target movement path.
  • the input function supported by the smart TV connected to the terminal is acquired, and when the input function is mobile focus input, the target position information corresponding to the first character information on the virtual keyboard of the smart TV is acquired, And the target position information corresponding to the focus on the virtual keyboard of the smart TV, the target moving path between the target position information corresponding to the first character information and the target position information corresponding to the focus is acquired, the target moving path is taken as the second character information, and the The input event of the mobile focus is simulated to realize the input of the smart TV, and the input efficiency is improved.
  • the method of obtaining the target position information corresponding to the focus on the virtual keyboard of the smart TV includes: obtaining a screenshot image of the virtual keyboard of the smart TV; Acquire the target button where the focus is located in the screenshot image; use the position information of the target button as the target position information corresponding to the focus.
  • the terminal sends a screenshot instruction to the smart TV, and the smart TV performs a screenshot operation to obtain a screenshot image, the screenshot image includes a virtual keyboard image, and the screenshot image is returned to the terminal.
  • the terminal obtains the position information of each key of the virtual keyboard in the screenshot image.
  • the target button with the focus is obtained in the screenshot image, and the position information of the target button is used as the target position information corresponding to the focus.
  • the coordinate value of the focus is obtained in the screenshot image according to the image recognition technology, and the target key of the focus is determined according to the coordinate value.
  • the terminal obtains the coordinate value of each key of the virtual keyboard in the screenshot image.
  • the operation of determining the position information or coordinate value of each button may be performed every time the moving focus input is invoked. It is also possible to store the position information or coordinate value of each button in advance, and extract the position information or coordinate value of each button from the memory when the moving focus input is called.
  • a screenshot image of the virtual keyboard of the smart TV is obtained, the target key with the focus is obtained in the screenshot image according to the image recognition technology, and the position information of the target key is used as the target position information corresponding to the focus.
  • the position information of each key on the virtual keyboard is determined to simulate the moving focus input event, which improves the input efficiency.
  • the method of obtaining the target position information corresponding to the first character information on the virtual keyboard of the smart TV includes: obtaining a screenshot image of the virtual keyboard of the smart TV; The position information of each key of the virtual keyboard is acquired from the image; the target position information corresponding to the first character information is determined according to the position information of each key and the name of the key.
  • the terminal sends a screenshot instruction to the smart TV, and the smart TV performs a screenshot operation to obtain a screenshot image, the screenshot image includes a virtual keyboard image, and the screenshot image is returned to the terminal.
  • the terminal obtains the position information of each key of the virtual keyboard in the screenshot image.
  • the target key corresponding to the first character information is determined according to the first character information and the name of each key, and then the target location information of the first character information is determined. For example, if the first character information is B, then the target key corresponding to the first character information is the B key, and the target position information of the first character information is the position information of the B key.
  • the operation of determining the position information of each button may be performed every time the moving focus input is invoked. It is also possible to store the position information of each button in advance, and extract the position information of each button from the memory when the moving focus input is called.
  • a screenshot image of the virtual keyboard of the smart TV is obtained; the position information of each key of the virtual keyboard is obtained in the screenshot image; according to the position information of each key and the key name, it is determined that the first character information corresponds to
  • the target position information of the virtual keyboard is determined by determining the position information of each key on the virtual keyboard to simulate the moving focus input event, which improves the input efficiency.
  • the acquiring position information of each key of the virtual keyboard in the screenshot image includes: acquiring, in the screenshot image, the step of moving each key of the virtual keyboard to a corresponding edge key.
  • the number of steps taken to move the respective keys to the corresponding edge keys is used as the position information of the respective keys
  • the edge keys include: keys in the virtual keyboard that are close to the boundary of the virtual keyboard.
  • the minimum number of steps required to move each key of the virtual keyboard to the corresponding edge key can be selected as the position information of each key.
  • the edge keys may include keys close to the boundary of the virtual keyboard, and the virtual keyboard boundary may include boundaries in four directions: up, down, left, and right.
  • the position information can be expressed as: (U2, D2, L2, R2), U2 represents the minimum number of steps for a button to move to the upper edge of the button, D2 represents the minimum number of steps for a button to move to the lower edge of the button, L2 represents a button to move The minimum number of steps to the left edge button, R2 represents the minimum number of steps to move a button to the right edge button.
  • the number of steps for each key of the virtual keyboard to move to the corresponding edge key is obtained in the screenshot image, and the number of steps for each key to be moved to the corresponding edge key is used as the position information of each key.
  • the position information of each key on the virtual keyboard is determined to simulate the moving focus input event, which improves the input efficiency.
  • steps in the flowchart of FIG. 2 are displayed in sequence as indicated by the arrows, these steps are not necessarily performed in sequence in the order indicated by the arrows. Unless specifically stated in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least part of the steps in FIG. 2 may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution of these sub-steps or stages The sequence is not necessarily performed sequentially, but may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.
  • an input device 700 for a smart TV which includes: an acquisition module 702, a determination module 704, and a sending module 706, wherein:
  • the obtaining module 702 is used to obtain the input first character information
  • the determining module 704 is configured to obtain input functions supported by the smart TV connected to the terminal, and determine second character information according to the input function and the first character information;
  • the sending module 706 is configured to send the second character information to the smart TV, where the smart TV invokes the input function to execute the second character information, so as to input the first character information to the smart TV. Describe the input box of the smart TV.
  • the above-mentioned input device 700 for a smart TV obtains the input first character information, obtains the input function supported by the smart TV connected to the terminal, determines the second character information according to the input function and the first character information, and converts the second character information Send to the smart TV, where the smart TV invokes the input function to execute the second character information to input the first character information into the input box of the smart TV, so that the character information is input in the terminal, and the terminal is directed to the input function supported by the smart TV
  • the character information is processed so that the character information can be called by the input function supported by the smart TV, and the input efficiency of the smart TV is improved.
  • the determining module 702 is further configured to: obtain the input functions supported by the smart TV connected to the terminal, and when the smart TV supports at least two input functions, obtain the The priority of the input function supported by the smart TV; the second character information is determined according to the input function with the highest priority and the first character information.
  • the determining module 702 is further configured to: obtain input functions supported by the smart TV connected to the terminal, and when the input function is physical keyboard input, obtain the first character information
  • the target key value code corresponding to the physical keyboard external to the smart TV; the target key value code corresponding to the first character information is used as the second character information.
  • the determining module 702 is further configured to: obtain the input function supported by the smart TV connected to the terminal, and when the input function is mouse input, obtain the first character information in the The target coordinate value corresponding to the virtual keyboard of the smart TV; the target coordinate value corresponding to the first character information is used as the second character information.
  • the determining module 702 is further configured to: obtain a screenshot image of the virtual keyboard of the smart TV; obtain the coordinate value of each key of the virtual keyboard in the screenshot image; The coordinate value of the button and the button name determine the target coordinate value corresponding to the first character information.
  • the determining module 702 is further configured to: obtain input functions supported by the smart TV connected to the terminal, and when the input function is mobile focus input, obtain the first character information Target position information corresponding to the virtual keyboard of the smart TV, and target position information corresponding to the focus on the virtual keyboard of the smart TV; acquiring target position information corresponding to the first character information corresponding to the focus The target moving path between the target location information; the target moving path is used as the second character information.
  • the determining module 702 is further configured to: obtain a screenshot image of the virtual keyboard of the smart TV; obtain the target key of the focus in the screenshot image according to the image recognition technology; The position information of the target button is used as the target position information corresponding to the focus.
  • the determining module 702 is further configured to: obtain a screenshot image of the virtual keyboard of the smart TV; obtain the position information of each key of the virtual keyboard in the screenshot image; The location information of the button and the button name determine the target location information corresponding to the first character information.
  • the determining module 702 is further configured to: obtain the number of steps for each key of the virtual keyboard to move to a corresponding edge key in the screenshot image, and move each key to the corresponding edge
  • the step number of the key is used as the position information of each key
  • the edge keys include: keys in the virtual keyboard that are close to the boundary of the virtual keyboard.
  • the various modules in the above-mentioned input device for a smart TV can be implemented in whole or in part by software, hardware, and a combination thereof.
  • the above-mentioned modules may be embedded in the form of hardware or independent of the processor in the computer equipment, or may be stored in the memory of the computer equipment in the form of software, so that the processor can call and execute the operations corresponding to the above-mentioned modules.
  • a computer device is provided.
  • the computer device may be a terminal, and its internal structure diagram may be as shown in FIG. 8.
  • the computer equipment includes a processor, a memory, a network interface, a display screen and an input device connected through a system bus.
  • the processor of the computer device is used to provide calculation and control capabilities.
  • the memory of the computer device includes a non-volatile storage medium and an internal memory.
  • the non-volatile storage medium stores an operating system and a computer program.
  • the internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium.
  • the network interface of the computer device is used to communicate with an external terminal through a network connection.
  • the computer program is executed by the processor to realize an input method for smart TV.
  • the display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen
  • the input device of the computer equipment can be a touch layer covered on the display screen, or it can be a button, a trackball or a touchpad set on the housing of the computer equipment , It can also be an external keyboard, touchpad, or mouse.
  • FIG. 8 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied.
  • the specific computer device may Including more or fewer parts than shown in the figure, or combining some parts, or having a different arrangement of parts.
  • a computer device including a memory and a processor, a computer program is stored in the memory, and the processor implements the following steps when the processor executes the computer program:
  • the second character information is sent to the smart TV, wherein the smart TV invokes the input function to execute the second character information to input the first character information into the input box of the smart TV middle.
  • the processor further implements the following steps when executing the computer program:
  • the second character information is determined according to the input function with the highest priority and the first character information.
  • the processor further implements the following steps when executing the computer program:
  • the processor further implements the following steps when executing the computer program:
  • the processor further implements the following steps when executing the computer program:
  • the target coordinate value corresponding to the first character information is determined according to the coordinate value of each button and the button name.
  • the processor further implements the following steps when executing the computer program:
  • the processor further implements the following steps when executing the computer program:
  • the processor further implements the following steps when executing the computer program:
  • the target location information corresponding to the first character information is determined according to the location information of each button and the button name.
  • the processor further implements the following steps when executing the computer program:
  • the number of steps for each key of the virtual keyboard to move to the corresponding edge key is acquired in the screenshot image, and the number of steps for each key to move to the corresponding edge key is used as the position information of each key.
  • the keys include: keys on the virtual keyboard close to the boundary of the virtual keyboard.
  • a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
  • the second character information is sent to the smart TV, wherein the smart TV invokes the input function to execute the second character information to input the first character information into the input box of the smart TV middle.
  • the second character information is determined according to the input function with the highest priority and the first character information.
  • the target coordinate value corresponding to the first character information is determined according to the coordinate value of each button and the button name.
  • the target location information corresponding to the first character information is determined according to the location information of each button and the button name.
  • the number of steps for each key of the virtual keyboard to move to the corresponding edge key is acquired in the screenshot image, and the number of steps for each key to move to the corresponding edge key is used as the position information of each key.
  • the keys include: keys on the virtual keyboard close to the boundary of the virtual keyboard.
  • Non-volatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory.
  • Volatile memory may include random access memory (RAM) or external cache memory.
  • RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain Channel (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Input From Keyboards Or The Like (AREA)

Abstract

The present application relates to an input method and apparatus for a smart television, a computer device, and a computer readable storage medium. The method comprises: obtaining inputted first character information; obtaining an input function supported by a smart television connected to a terminal, and determining second character information according to the input function and the first character information; and sending the second character information to the smart television, wherein the smart television invokes the input function to execute the second character information so as to input the first character information into an input box of the smart television. By using the present method, the input efficiency of a smart television can be improved.

Description

用于智能电视的输入方法、装置、计算机设备和存储介质Input method, device, computer equipment and storage medium for smart TV 技术领域Technical field
本申请涉及智能电视技术领域，特别是涉及一种用于智能电视的输入方法、装置、计算机设备和计算机可读存储介质。This application relates to the technical field of smart TVs, and in particular to an input method, device, computer equipment and computer-readable storage medium for smart TVs.
背景技术Background technique
目前，智能电视广泛应用于家庭中，相对于传统电视，智能电视可通过网络获取节目，这使得资源更加丰富，用户的观看体验也更强。但是，用户在注册智能电视上的APP或者进行搜索等操作时，需要通过智能电视上的虚拟键盘输入用户名、密码或者搜索内容等，这就需要用户在字母、数字、符号之间来回切换，并且，内容输错就需要从当前位置删除至出错位置，再重新输入，导致输入效率低下。At present, smart TVs are widely used in homes. Compared with traditional TVs, smart TVs can obtain programs through the network, which makes resources more abundant and users have a stronger viewing experience. However, when a user registers an APP on a smart TV or performs a search operation, he needs to enter a user name, password or search content through the virtual keyboard on the smart TV, which requires the user to switch back and forth between letters, numbers, and symbols. In addition, if the content is entered incorrectly, it needs to be deleted from the current position to the error position, and then re-entered, resulting in low input efficiency.
发明内容Summary of the invention
基于此，有必要针对上述技术问题，提供一种能够提高智能电视的输入效率的用于智能电视的输入方法、装置、计算机设备和计算机可读存储介质。Based on this, it is necessary to address the above technical problems and provide an input method, device, computer equipment, and computer-readable storage medium for a smart TV that can improve the input efficiency of the smart TV.
一种用于智能电视的输入方法，所述方法包括：An input method for smart TV, the method includes:
获取输入的第一字符信息；Obtain the input first character information;
获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息；Acquiring input functions supported by the smart TV connected to the terminal, and determining second character information according to the input function and the first character information;
将所述第二字符信息发送至所述智能电视，其中，所述智能电视调用所述输入功能执行所述第二字符信息，以将所述第一字符信息输入至所述智能电视的输入框中。The second character information is sent to the smart TV, wherein the smart TV invokes the input function to execute the second character information to input the first character information into the input box of the smart TV middle.
在其中一个实施例中，所述获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息，包括：In one of the embodiments, the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information includes:
获取与所述终端连接的智能电视所支持的输入功能，当所述智能电视所支持的输入功能为至少两个时，获取所述智能电视所支持的输入功能的优先级；Acquiring input functions supported by the smart TV connected to the terminal, and when the smart TV supports at least two input functions, acquiring the priority of the input functions supported by the smart TV;
根据优先级最高的所述输入功能以及所述第一字符信息确定所述第二字符信息。The second character information is determined according to the input function with the highest priority and the first character information.
在其中一个实施例中，所述获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息，包括：In one of the embodiments, the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information includes:
获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为物理键盘输入时，获取所述第一字符信息在所述智能电视外接的物理键盘上对应的目标键值码；Acquiring an input function supported by the smart TV connected to the terminal, and when the input function is a physical keyboard input, acquiring the target key value code corresponding to the first character information on the physical keyboard external to the smart TV;
将所述第一字符信息对应的所述目标键值码作为所述第二字符信息。Use the target key value code corresponding to the first character information as the second character information.
在其中一个实施例中，所述获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息，包括：In one of the embodiments, the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information includes:
获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为鼠标输入时，获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标坐标值；Acquiring an input function supported by the smart TV connected to the terminal, and when the input function is mouse input, acquiring the target coordinate value corresponding to the first character information on the virtual keyboard of the smart TV;
将所述第一字符信息对应的所述目标坐标值作为所述第二字符信息。Use the target coordinate value corresponding to the first character information as the second character information.
在其中一个实施例中，所述获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标坐标值的方式，包括：In one of the embodiments, the method of obtaining the target coordinate value corresponding to the first character information on the virtual keyboard of the smart TV includes:
获取所述智能电视的虚拟键盘的截屏图像；Acquiring a screenshot image of the virtual keyboard of the smart TV;
在所述截屏图像中获取所述虚拟键盘的各个按键的坐标值；Acquiring the coordinate value of each key of the virtual keyboard in the screenshot image;
根据所述各个按键的坐标值以及按键名称，确定所述第一字符信息对应的所述目标坐标值。The target coordinate value corresponding to the first character information is determined according to the coordinate value of each button and the button name.
在其中一个实施例中，所述获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息，包括：In one of the embodiments, the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information includes:
获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为移动焦点输入时，获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标位置信息，以及所述焦点在所述智能电视的虚拟键盘上对应的目标位置信息；Acquire the input function supported by the smart TV connected to the terminal, and when the input function is mobile focus input, obtain the target position information corresponding to the first character information on the virtual keyboard of the smart TV, and Target position information corresponding to the focus on the virtual keyboard of the smart TV;
获取所述第一字符信息对应的目标位置信息与所述焦点对应的目标位置信息之间的目标移动路径；Acquiring a target moving path between the target position information corresponding to the first character information and the target position information corresponding to the focus;
将所述目标移动路径作为所述第二字符信息。Use the target moving path as the second character information.
在其中一个实施例中，所述获取所述焦点在所述智能电视的虚拟键盘上对应的目标位置信息的方式，包括：In one of the embodiments, the method of obtaining the target position information corresponding to the focus on the virtual keyboard of the smart TV includes:
获取所述智能电视的虚拟键盘的截屏图像；Acquiring a screenshot image of the virtual keyboard of the smart TV;
根据图像识别技术在所述截屏图像中获取所述焦点所在的目标按键；Acquiring, in the screenshot image, the target button where the focus is located according to the image recognition technology;
将所述目标按键的位置信息作为所述焦点对应的所述目标位置信息。Use the position information of the target button as the target position information corresponding to the focus.
在其中一个实施例中，所述获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标位置信息的方式，包括：In one of the embodiments, the method of obtaining the target position information corresponding to the first character information on the virtual keyboard of the smart TV includes:
获取所述智能电视的虚拟键盘的截屏图像；Acquiring a screenshot image of the virtual keyboard of the smart TV;
在所述截屏图像中获取所述虚拟键盘的各个按键的位置信息；Acquiring position information of each key of the virtual keyboard in the screenshot image;
根据所述各个按键的位置信息以及按键名称，确定所述第一字符信息对应的所述目标位置信息。The target location information corresponding to the first character information is determined according to the location information of each button and the button name.
在其中一个实施例中，所述在所述截屏图像中获取所述虚拟键盘的各个按键的位置信息，包括：In one of the embodiments, the acquiring position information of each key of the virtual keyboard in the screenshot image includes:
在所述截屏图像中获取所述虚拟键盘的各个按键移动至对应的边缘按键的步数，将所述各个按键移动至对应的边缘按键的步数作为所述各个按键的位置信息，所述边缘按键包括：所述虚拟键盘中靠近虚拟键盘边界的按键。The number of steps for each key of the virtual keyboard to move to the corresponding edge key is acquired in the screenshot image, and the number of steps for each key to move to the corresponding edge key is used as the position information of each key. The keys include: keys on the virtual keyboard close to the boundary of the virtual keyboard.
一种用于智能电视的输入装置，所述装置包括：An input device for a smart TV, the device comprising:
获取模块，用于获取输入的第一字符信息；The obtaining module is used to obtain the input first character information;
确定模块，用于获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息；The determining module is configured to obtain the input function supported by the smart TV connected to the terminal, and determine the second character information according to the input function and the first character information;
发送模块，用于将所述第二字符信息发送至所述智能电视，其中，所述智能电视调用所述输入功能执行所述第二字符信息，以将所述第一字符信息输入至所述智能电视的输入框中。The sending module is configured to send the second character information to the smart TV, wherein the smart TV invokes the input function to execute the second character information, so as to input the first character information to the The input box of the smart TV.
一种计算机设备，包括存储器和处理器，所述存储器存储有计算机程序，所述处理器执行所述计算机程序时实现以下步骤：A computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when the processor executes the computer program:
获取输入的第一字符信息；Obtain the input first character information;
获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息；Acquiring input functions supported by the smart TV connected to the terminal, and determining second character information according to the input function and the first character information;
将所述第二字符信息发送至所述智能电视，其中，所述智能电视调用所述输入功能执行所述第二字符信息，以将所述第一字符信息输入至所述智能电视的输入框中。The second character information is sent to the smart TV, wherein the smart TV invokes the input function to execute the second character information to input the first character information into the input box of the smart TV middle.
一种计算机可读存储介质，其上存储有计算机程序，所述计算机程序被处理器执行时实现以下步骤：A computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the following steps are implemented:
获取输入的第一字符信息；Obtain the input first character information;
获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息；Acquiring input functions supported by the smart TV connected to the terminal, and determining second character information according to the input function and the first character information;
将所述第二字符信息发送至所述智能电视，其中，所述智能电视调用所述输入功能执行所述第二字符信息，以将所述第一字符信息输入至所述智能电视的输入框中。The second character information is sent to the smart TV, wherein the smart TV invokes the input function to execute the second character information to input the first character information into the input box of the smart TV middle.
上述用于智能电视的输入方法、装置、计算机设备和计算机可读存储介质，获取输入的第一字符信息，获取与终端连接的智能电视所支持的输入功能，根据输入功能以及第一字符信息确定第二字符信息，将第二字符信息发送至智能电视，其中，智能电视调用输入功能执行第二字符信息，以将第一字符信息输入至智能电视的输入框中，这样，在终端输入字符信息，且终端针对智能电视支持的输入功能处理该字符信息，使该字符信息可被智能电视支持的输入功能所调用，提高了智能电视的输入效率。The above-mentioned input method, device, computer equipment, and computer-readable storage medium for a smart TV obtain the input first character information, obtain the input function supported by the smart TV connected to the terminal, and determine according to the input function and the first character information The second character information is to send the second character information to the smart TV, where the smart TV calls the input function to execute the second character information to input the first character information into the input box of the smart TV, so that the character information is input in the terminal , And the terminal processes the character information for the input function supported by the smart TV, so that the character information can be called by the input function supported by the smart TV, which improves the input efficiency of the smart TV.
附图说明Description of the drawings
图1为一个实施例中用于智能电视的输入方法的应用环境图；FIG. 1 is an application environment diagram of an input method used in a smart TV in an embodiment;
图2为一个实施例中用于智能电视的输入方法的流程示意图；FIG. 2 is a schematic flowchart of an input method for a smart TV in an embodiment;
图3为一个实施例中选择输入功能的细化流程示意图；FIG. 3 is a schematic diagram of a detailed process of selecting an input function in an embodiment;
图4为一个实施例中模拟物理键盘输入的流程示意图；Figure 4 is a schematic diagram of a flow of simulating physical keyboard input in an embodiment;
图5为一个实施例中模拟鼠标输入的流程示意图；FIG. 5 is a schematic diagram of a flow of simulating mouse input in an embodiment;
图6为一个实施例中模拟移动焦点输入的流程示意图；FIG. 6 is a schematic diagram of a flow of simulating moving focus input in an embodiment;
图7为一个实施例中用于智能电视的输入装置的结构框图；Fig. 7 is a structural block diagram of an input device for a smart TV in an embodiment;
图8为一个实施例中计算机设备的内部结构图。Fig. 8 is an internal structure diagram of a computer device in an embodiment.
具体实施方式Detailed ways
为了使本申请的目的、技术方案及优点更加清楚明白，以下结合附图及实施例，对本申请进行进一步详细说明。应当理解，此处描述的具体实施例仅仅用以解释本申请，并不用于限定本申请。In order to make the purpose, technical solutions, and advantages of this application clearer and clearer, the following further describes the application in detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application.
本申请提供的用于智能电视的输入方法，可以应用于如图1所示的应用环境中。其中，终端102通过网络与智能电视104通过网络进行通信。终端102获取输入的第一字符信息；终端102获取与终端102连接的智能电视104所支持的输入功能，根据输入功能以及第一字符信息确定第二字符信息；终端102将第二字符信息发送至智能电视104，其中，智能电视104调用输入功能执行第二字符信息，以将第一字符信息输入至智能电视104的输入框中。其中，终端102可以但不限于是各种个人计算机、笔记本电脑、智能手机、平板电脑和便携式可穿戴设备。The input method for smart TV provided in this application can be applied to the application environment as shown in FIG. 1. Wherein, the terminal 102 communicates with the smart TV 104 through the network through the network. The terminal 102 obtains the input first character information; the terminal 102 obtains the input function supported by the smart TV 104 connected to the terminal 102, and determines the second character information according to the input function and the first character information; the terminal 102 sends the second character information to The smart TV 104, wherein the smart TV 104 calls an input function to execute the second character information, so as to input the first character information into the input box of the smart TV 104. Among them, the terminal 102 may be, but is not limited to, various personal computers, notebook computers, smart phones, tablet computers, and portable wearable devices.
在一个实施例中，如图2所示，提供了一种用于智能电视的输入方法，以该方法应用于图1中的终端为例进行说明，包括以下步骤：In an embodiment, as shown in FIG. 2, an input method for a smart TV is provided. Taking the method applied to the terminal in FIG. 1 as an example for description, the method includes the following steps:
步骤202，获取输入的第一字符信息。Step 202: Obtain the input first character information.
其中，第一字符信息是通过终端的键盘输入的字符信息，该字符信息可为终端的键盘上任一按键所对应的字符信息，比如英文字母、数字、标点符号等字符信息，也可以是确认、删除、移动等编辑信息。Wherein, the first character information is character information input through the keyboard of the terminal, and the character information can be character information corresponding to any key on the keyboard of the terminal, such as character information such as English letters, numbers, punctuation marks, etc., or confirmation, Edit information such as deleting and moving.
在一个实施例中，终端的键盘可为终端自带的虚拟键盘或者物理键盘，也可为终端外接的物理键盘。In one embodiment, the keyboard of the terminal may be a virtual keyboard or a physical keyboard built in the terminal, or a physical keyboard external to the terminal.
步骤204，获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息。Step 204: Obtain input functions supported by the smart TV connected to the terminal, and determine second character information according to the input function and the first character information.
其中，智能电视所支持的输入功能可包括：物理键盘输入、鼠标输入以及移动焦点输入中的至少一个。物理键盘输入是指智能电视支持外接物理键盘，用户可通过按压物理键盘的按键进行输入；鼠标输入是指智能电视支持外接鼠标，用户可通过鼠标点击智能电视的虚拟键盘进行输入；移动焦点输入是指智能电视支持虚拟键盘，用户可通过控制设备(比如遥控器、手机、平板电脑等)控制焦点在虚拟键盘上移动，以通过焦点在虚拟键盘上选择按键，进行输入。The input functions supported by the smart TV may include at least one of physical keyboard input, mouse input, and moving focus input. Physical keyboard input means that the smart TV supports an external physical keyboard, and the user can input by pressing the keys of the physical keyboard; mouse input means that the smart TV supports an external mouse, and the user can click on the virtual keyboard of the smart TV to input through the mouse; move focus input is Means that the smart TV supports a virtual keyboard, and the user can control the focus to move on the virtual keyboard through a control device (such as a remote control, a mobile phone, a tablet computer, etc.), so as to select a key on the virtual keyboard through the focus to input.
其中，第二字符信息是智能电视所支持的输入功能可执行的字符信息。可选地，若智能电视所支持的输入功能为物理键盘输入，第二字符信息的格式可为键值码；若智能电视所支持的输入功能为鼠标输入，第二字符信息的格式可为虚拟键盘的按键的坐标值；若智能电视所支持的输入功能为移动焦点输入，第二字符信息的格式可为移动路径，该移动路径是指由焦点所在位置至第一字符信息所在位置的移动路径。Wherein, the second character information is character information executable by the input function supported by the smart TV. Optionally, if the input function supported by the smart TV is physical keyboard input, the format of the second character information may be a key value code; if the input function supported by the smart TV is mouse input, the format of the second character information may be virtual The coordinate value of the keys of the keyboard; if the input function supported by the smart TV is moving focus input, the format of the second character information can be a moving path, which refers to the moving path from the position of the focus to the position of the first character information .
步骤206，将所述第二字符信息发送至所述智能电视，其中，所述智能电视调用所述输入功能执行所述第二字符信息，以将所述第一字符信息输入至所述智能电视的输入框中。Step 206: Send the second character information to the smart TV, where the smart TV invokes the input function to execute the second character information, so as to input the first character information to the smart TV In the input box.
具体地，若第二字符信息的格式为键值码，智能电视调用物理键盘输入功能执行该键值码，以在智能电视的输入框中输入第一字符信息；若第二字符信息的格式为虚拟键盘的按键的坐标值，智能电视调用鼠标输入功能执行该坐标值，以在智能电视的输入框中输入第一字符信息；若第二字符信息的格式为虚拟路径，智能电视调用移动焦点输入功能执行该虚拟路径，以在智能电视的输入框中输入第一字符信息。Specifically, if the format of the second character information is a key value code, the smart TV invokes the physical keyboard input function to execute the key value code to input the first character information in the input box of the smart TV; if the format of the second character information is The coordinate value of the key of the virtual keyboard, the smart TV calls the mouse input function to execute the coordinate value to input the first character information in the input box of the smart TV; if the format of the second character information is a virtual path, the smart TV calls the mobile focus input The function executes the virtual path to input the first character information in the input box of the smart TV.
上述用于智能电视的输入方法中，获取输入的第一字符信息，获取与终端连接的智能电视所支持的输入功能，根据输入功能以及第一字符信息确定第二字符信息，将第二字符信息发送至智能电视，其中，智能电视调用输入功能执行第二字符信息，以将第一字符信息输入至智能电视的输入框中，这样，在终端输入字符信息，且终端针对智能电视支持的输入功能处理该字符信息，使该字符信息可被智能电视支持的输入功能所调用，提高了智能电视的输入效率。In the above-mentioned input method for a smart TV, the input first character information is obtained, the input function supported by the smart TV connected to the terminal is obtained, the second character information is determined according to the input function and the first character information, and the second character information is Send to the smart TV, where the smart TV invokes the input function to execute the second character information to input the first character information into the input box of the smart TV, so that the character information is input in the terminal, and the terminal is directed to the input function supported by the smart TV The character information is processed so that the character information can be called by the input function supported by the smart TV, and the input efficiency of the smart TV is improved.
在一个实施例中，所述获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息，包括：获取与所述终端连接的智能电视所支持的输入功能，当所述智能电 视所支持的输入功能为至少两个时，获取所述智能电视所支持的输入功能的优先级；根据优先级最高的所述输入功能以及所述第一字符信息确定所述第二字符信息。In one embodiment, the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information includes: obtaining the smart TV connected to the terminal Supported input functions, when the smart TV supports at least two input functions, the priority of the input functions supported by the smart TV is acquired; according to the input function with the highest priority and the first The character information determines the second character information.
其中，智能电视所支持的输入功能的优先级用于优先选择输入功能。智能电视所支持的输入功能的优先级可根据实际应用进行设定，在一个实施例中，若智能电视所支持的输入功能包括：物理键盘输入、鼠标输入以及焦点输入，其优先级可为：物理键盘输入功能优先于鼠标输入功能，鼠标输入功能优先于焦点输入。如图3所示，终端获取与终端连接的智能电视所支持的输入功能，首先检测是否支持物理键盘输入，若支持物理键盘输入，模拟物理键盘输入事件，若不支持物理键盘输入，检测是否支持鼠标输入，若支持鼠标输入，模拟鼠标输入事件，若不支持鼠标输入，检测是否支持移动焦点输入，若支持移动焦点输入，模拟移动焦点事件。Among them, the priority of the input function supported by the smart TV is used to preferentially select the input function. The priority of the input functions supported by the smart TV can be set according to actual applications. In one embodiment, if the input functions supported by the smart TV include: physical keyboard input, mouse input, and focus input, the priority may be: The physical keyboard input function takes precedence over the mouse input function, and the mouse input function takes precedence over the focus input. As shown in Figure 3, the terminal obtains the input functions supported by the smart TV connected to the terminal, and first checks whether it supports physical keyboard input. If it supports physical keyboard input, it simulates physical keyboard input events. If it does not support physical keyboard input, it checks whether it supports Mouse input, if it supports mouse input, simulate mouse input events, if it does not support mouse input, check whether it supports moving focus input, if it supports moving focus input, simulate moving focus events.
上述用于智能电视的输入方法中，获取与终端连接的智能电视所支持的输入功能，当智能电视所支持的输入功能为至少两个时，获取智能电视所支持的输入功能的优先级，根据优先级最高的输入功能以及第一字符信息确定第二字符信息，优先选择操作流程较为简化的输入功能进行模拟，节省计算机资源，提高操作速度。In the above-mentioned input method for a smart TV, the input function supported by the smart TV connected to the terminal is obtained, and when the input function supported by the smart TV is at least two, the priority of the input function supported by the smart TV is obtained, according to The input function with the highest priority and the first character information determine the second character information, and the input function with a relatively simplified operation process is preferentially selected for simulation, which saves computer resources and improves operation speed.
在一个实施例中，所述获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息，包括：获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为物理键盘输入时，获取所述第一字符信息在所述智能电视外接的物理键盘上对应的目标键值码；将所述第一字符信息对应的所述目标键值码作为所述第二字符信息。In one embodiment, the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information includes: obtaining the smart TV connected to the terminal Supported input function, when the input function is physical keyboard input, obtain the target key value code corresponding to the first character information on the physical keyboard external to the smart TV; The target key value code is used as the second character information.
其中，物理键盘输入是指智能电视支持外接物理键盘，用户可通过按压物理键盘的按键进行输入。目标键值码是第一字符信息所对应的键值码。Among them, the physical keyboard input means that the smart TV supports an external physical keyboard, and the user can input by pressing the keys of the physical keyboard. The target key value code is the key value code corresponding to the first character information.
具体地，物理键盘上每个按键对应有唯一的键值码，因此可将第一字符信息转换为键值码(即第二字符信息)，以模拟物理键盘输入事件。如图4所示，步骤402，终端接收第一字符信息；步骤404，将第一字符信息转换为键值码；步骤406，将键值码发送给智能电视。这样，智能电视调用物理键盘输入功能来执行该键值码。Specifically, each key on the physical keyboard corresponds to a unique key value code, so the first character information can be converted into a key value code (ie, second character information) to simulate a physical keyboard input event. As shown in FIG. 4, step 402, the terminal receives the first character information; step 404, converts the first character information into a key value code; step 406, sends the key value code to the smart TV. In this way, the smart TV calls the physical keyboard input function to execute the key value code.
上述用于智能电视的输入方法中，当输入功能为物理键盘输入时，获取第一字符信息在智能电视外接的物理键盘上对应的目标键值码，将第一字符信息对应的目标键值码作为第二字符信息，通过模拟物理键盘输入事件来实现智能电视的输入，提高了输入效率。In the above input method for smart TV, when the input function is physical keyboard input, the target key value code corresponding to the first character information on the physical keyboard external to the smart TV is obtained, and the target key value code corresponding to the first character information As the second character information, the input of the smart TV is realized by simulating physical keyboard input events, which improves the input efficiency.
在一个实施例中，所述获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息，包括：In one embodiment, the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information includes:
获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为鼠标输入时，获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标坐标值；将所述第一字符信息对应的所述目标坐标值作为所述第二字符信息。Obtain the input function supported by the smart TV connected to the terminal, and when the input function is mouse input, obtain the target coordinate value corresponding to the first character information on the virtual keyboard of the smart TV; The target coordinate value corresponding to the first character information is used as the second character information.
其中，鼠标输入是指智能电视支持外接鼠标，用户可通过鼠标点击智能电视的虚拟键盘进行输入。目标坐标值是第一字符信息在虚拟键盘上所对应的坐标值。Among them, the mouse input means that the smart TV supports an external mouse, and the user can input by clicking the virtual keyboard of the smart TV with the mouse. The target coordinate value is the coordinate value corresponding to the first character information on the virtual keyboard.
具体地，虚拟键盘上每个按键对应有唯一的坐标值，因此可将第一字符信息转换为坐标值(即第二字符信息)，以模拟鼠标输入事件。如图5所示，步骤502，终端接收第一字符信息；步骤504，将第一字符信息转换为坐标值；步骤506，将坐标值发送给智能电视。这样，智能电视调用鼠标输入功能来执行该坐标值。Specifically, each key on the virtual keyboard corresponds to a unique coordinate value, so the first character information can be converted into coordinate values (that is, the second character information) to simulate a mouse input event. As shown in FIG. 5, step 502, the terminal receives the first character information; step 504, convert the first character information into coordinate values; step 506, send the coordinate values to the smart TV. In this way, the smart TV calls the mouse input function to execute the coordinate value.
上述用于智能电视的输入方法中，当输入功能为鼠标输入时，获取第一字符信息在智能电视的虚拟键盘上对应的目标坐标值，将第一字符信息对应的目标坐标值作为第二字符信息，通过模拟鼠标输入事件来实现智能电视的输入，提高了输入效率。In the above-mentioned input method for a smart TV, when the input function is mouse input, the target coordinate value corresponding to the first character information on the virtual keyboard of the smart TV is obtained, and the target coordinate value corresponding to the first character information is used as the second character Information, the input of smart TV is realized by simulating mouse input events, which improves the input efficiency.
在一个实施例中，所述获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标坐标值的方式，包括：获取所述智能电视的虚拟键盘的截屏图像；在所述截屏图像中获取所述虚拟键盘的各个按键的坐标值；根据所述各个按键的坐标值以及按键名称，确定所述第一字符信息对应的所述目标坐标值。In one embodiment, the method of obtaining the target coordinate value corresponding to the first character information on the virtual keyboard of the smart TV includes: obtaining a screenshot image of the virtual keyboard of the smart TV; The coordinate value of each key of the virtual keyboard is acquired from the image; the target coordinate value corresponding to the first character information is determined according to the coordinate value of each key and the name of the key.
具体地，终端向智能电视发送截屏指令，智能电视执行截屏操作得到截屏图像，该截屏图像包含虚拟键盘图像，并将截屏图像返回给终端。终端在截屏图像中获取虚拟键盘的各个按键的坐标值。当接收到第一字符信息时，根据第一字符信息以及各个按键的名称，确定第一字符信息对应的目标按键，进而确定第一字符信息的目标坐标值。比如，第一字符信息为A，那么第一字符信息对应的目标按键为A按键，第一字符信息的目标坐标值为A按键的坐标值。Specifically, the terminal sends a screenshot instruction to the smart TV, and the smart TV performs a screenshot operation to obtain a screenshot image, the screenshot image includes a virtual keyboard image, and the screenshot image is returned to the terminal. The terminal obtains the coordinate value of each key of the virtual keyboard in the screenshot image. When the first character information is received, the target key corresponding to the first character information is determined according to the first character information and the name of each key, and then the target coordinate value of the first character information is determined. For example, if the first character information is A, then the target button corresponding to the first character information is the A button, and the target coordinate value of the first character information is the coordinate value of the A button.
在一个实施例中，可在每次调用鼠标输入时，执行确定各个按键的坐标值的操作。也可预先存储各个按键的坐标值，当调用鼠标输入时，直接调用各个按键的坐标值。In one embodiment, the operation of determining the coordinate value of each button may be performed every time the mouse input is invoked. The coordinate value of each button can also be stored in advance. When the mouse input is called, the coordinate value of each button can be directly called.
上述用于智能电视的输入方法中，获取智能电视的虚拟键盘的截屏图像，在截屏图像中获取虚拟键盘的各个按键的坐标值，根据各个按键的坐标值以及按键名称，确定第一字符信息对应的目标坐标值，通过确定虚拟键盘上各个按键的坐标值来模拟鼠标输入事件，提高了输入效率。In the above-mentioned input method for a smart TV, a screenshot image of the virtual keyboard of the smart TV is obtained, the coordinate value of each key of the virtual keyboard is obtained in the screenshot image, and the corresponding value of the first character information is determined according to the coordinate value of each key and the name of the key The target coordinate value of the virtual keyboard is determined to simulate the mouse input event by determining the coordinate value of each button on the virtual keyboard, which improves the input efficiency.
在一个实施例中，所述获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息，包括：获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为移动焦点输入时，获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标位置信息，以及所 述焦点在所述智能电视的虚拟键盘上对应的目标位置信息；获取所述第一字符信息对应的目标位置信息与所述焦点对应的目标位置信息之间的目标移动路径；将所述目标移动路径作为所述第二字符信息。In one embodiment, the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information includes: obtaining the smart TV connected to the terminal Supported input function, when the input function is moving focus input, obtain the target position information corresponding to the first character information on the virtual keyboard of the smart TV, and the virtual keyboard with the focus on the smart TV Target position information corresponding to the keyboard; obtain a target movement path between the target position information corresponding to the first character information and the target position information corresponding to the focus; use the target movement path as the second character information.
其中，移动焦点输入是指智能电视支持虚拟键盘，用户可通过控制设备(比如遥控器、手机、平板电脑等)控制焦点在虚拟键盘上移动，以通过焦点在虚拟键盘上选择按键，进行输入。Among them, mobile focus input means that the smart TV supports a virtual keyboard, and the user can control the focus to move on the virtual keyboard through a control device (such as a remote control, a mobile phone, a tablet computer, etc.) to select a key on the virtual keyboard through the focus to input.
目标位置信息是第一字符信息或者焦点在虚拟键盘上所对应的位置信息。位置信息用于表征一个按键在虚拟键盘上的位置，其可通过一个按键移动至对应的边缘按键的步数来表征，边缘按键可包括靠近虚拟键盘边界的按键，虚拟键盘边界可包括上、下、左、右四个方向的边界。The target position information is the first character information or the position information corresponding to the focus on the virtual keyboard. The position information is used to characterize the position of a key on the virtual keyboard, which can be characterized by the number of steps a key moves to the corresponding edge key. The edge key can include the key close to the virtual keyboard boundary, and the virtual keyboard boundary can include up and down. , Left and right boundaries.
目标移动路径是第一字符信息对应的目标位置信息与焦点对应的目标位置信息之间的移动路径。移动路径用于表征虚拟键盘上一个按键移动至另一个按键的路径，可选地，该移动路径是经过按键数量最少的路径。移动路径可通过向各个方向移动的步数来表征，比如设置上、下、左、右四个方向，移动路径可表征为向上、下、左、右四个方向分别移动的步数，每一步对应一个按键。比如(U1,D1,L1,R1)，U1表示一个按键向上移动的步数，D1表示一个按键向下移动的步数，L1表示一个按键向左移动的步数，R1表示一个按键向右移动的步数。例如由A移动到E的移动路径为(1,0,0,2)，即上移一步，右移两步。The target movement path is a movement path between the target position information corresponding to the first character information and the target position information corresponding to the focus. The movement path is used to characterize the path from one key on the virtual keyboard to another key. Optionally, the movement path is the path with the least number of keys. The movement path can be characterized by the number of steps moving in various directions, such as setting up, down, left and right four directions, the movement path can be characterized as the number of steps moved in the four directions up, down, left and right, each step Corresponds to a button. For example (U1, D1, L1, R1), U1 indicates the number of steps a button moves up, D1 indicates the number of steps a button moves down, L1 indicates the number of steps a button moves to the left, R1 indicates a button moves to the right The number of steps. For example, the movement path from A to E is (1,0,0,2), that is, one step up and two steps to the right.
在一个实施例中，获取智能电视的虚拟键盘的各个按键的位置信息，获取第一字符信息对应的目标按键，进而确定第一字符信息的目标位置信息。In one embodiment, the position information of each key of the virtual keyboard of the smart TV is obtained, the target key corresponding to the first character information is obtained, and the target position information of the first character information is determined.
在一个实施例中，焦点具有颜色突出的特性，该颜色突出的特性是与虚拟键盘上的各个按键的颜色不一致来实现的。可通过图像识别技术确定焦点所在的目标按键，进而确定焦点的目标位置信息。可选地，该图像识别技术可为openCV技术。In one embodiment, the focus has a color-protruding feature, and the color-protruding feature is achieved by being inconsistent with the color of each key on the virtual keyboard. The image recognition technology can be used to determine the target button where the focus is located, and then the target location information of the focus can be determined. Optionally, the image recognition technology may be openCV technology.
具体地，虚拟键盘上每个按键对应有唯一的布局位置，因此可将第一字符信息转换为坐标值(即第二字符信息)，以模拟移动焦点输入事件。如图6所示，步骤602，终端接收第一字符信息；步骤604，获取第一字符信息在智能电视的虚拟键盘上对应的目标位置信息，以及焦点在智能电视的虚拟键盘上对应的目标位置信息；步骤606，获取第一字符信息对应的目标位置信息与焦点对应的目标位置信息之间的目标移动路径；步骤608，将目标移动路径发送给智能电视。可选地，第一字符信息对应的目标位置信息与焦点对应的目标位置信息之间的目标移动路径为最短的移动路径，可通过最短距离算法计算得到。这样，智能电视调用移动焦点输入功能，模拟一连串的移动事件和确认事件，来执行该目标移动路径。Specifically, each key on the virtual keyboard corresponds to a unique layout position, so the first character information can be converted into coordinate values (that is, the second character information) to simulate a moving focus input event. As shown in Figure 6, step 602, the terminal receives the first character information; step 604, obtain the target position information corresponding to the first character information on the virtual keyboard of the smart TV, and the target position corresponding to the focus on the virtual keyboard of the smart TV Information; Step 606, obtain the target movement path between the target position information corresponding to the first character information and the target position information corresponding to the focus; Step 608, send the target movement path to the smart TV. Optionally, the target moving path between the target location information corresponding to the first character information and the target location information corresponding to the focus is the shortest moving path, which can be calculated by the shortest distance algorithm. In this way, the smart TV calls the mobile focus input function to simulate a series of movement events and confirmation events to execute the target movement path.
上述用于智能电视的输入方法中，获取与终端连接的智能电视所支持的输入功能，当输入功能为移动焦点输入时，获取第一字符信息在智能电视的虚拟键盘上对应的目标位置信息，以及焦点在智能电视的虚拟键盘上对应的目标位置信息，获取第一字符信息对应的目标位置信息与焦点对应的目标位置信息之间的 目标移动路径，将目标移动路径作为第二字符信息，通过模拟移动焦点输入事件来实现智能电视的输入，提高了输入效率。In the above-mentioned input method for a smart TV, the input function supported by the smart TV connected to the terminal is acquired, and when the input function is mobile focus input, the target position information corresponding to the first character information on the virtual keyboard of the smart TV is acquired, And the target position information corresponding to the focus on the virtual keyboard of the smart TV, the target moving path between the target position information corresponding to the first character information and the target position information corresponding to the focus is acquired, the target moving path is taken as the second character information, and the The input event of the mobile focus is simulated to realize the input of the smart TV, and the input efficiency is improved.
在一个实施例中，所述获取所述焦点在所述智能电视的虚拟键盘上对应的目标位置信息的方式，包括：获取所述智能电视的虚拟键盘的截屏图像；根据图像识别技术在所述截屏图像中获取所述焦点所在的目标按键；将所述目标按键的位置信息作为所述焦点对应的所述目标位置信息。In one embodiment, the method of obtaining the target position information corresponding to the focus on the virtual keyboard of the smart TV includes: obtaining a screenshot image of the virtual keyboard of the smart TV; Acquire the target button where the focus is located in the screenshot image; use the position information of the target button as the target position information corresponding to the focus.
在一个实施例中，终端向智能电视发送截屏指令，智能电视执行截屏操作得到截屏图像，该截屏图像包含虚拟键盘图像，并将截屏图像返回给终端。终端在截屏图像中获取虚拟键盘的各个按键的位置信息。根据图像识别技术在截屏图像中获取焦点所在的目标按键，将目标按键的位置信息作为焦点对应的目标位置信息。In one embodiment, the terminal sends a screenshot instruction to the smart TV, and the smart TV performs a screenshot operation to obtain a screenshot image, the screenshot image includes a virtual keyboard image, and the screenshot image is returned to the terminal. The terminal obtains the position information of each key of the virtual keyboard in the screenshot image. According to the image recognition technology, the target button with the focus is obtained in the screenshot image, and the position information of the target button is used as the target position information corresponding to the focus.
可选地，根据图像识别技术在截屏图像中获取焦点所在的坐标值，根据坐标值确定焦点所在的目标按键。其中，终端在截屏图像中获取虚拟键盘的各个按键的坐标值。Optionally, the coordinate value of the focus is obtained in the screenshot image according to the image recognition technology, and the target key of the focus is determined according to the coordinate value. Among them, the terminal obtains the coordinate value of each key of the virtual keyboard in the screenshot image.
在一个实施例中，可在每次调用移动焦点输入时，执行确定各个按键的位置信息或者坐标值的操作。也可预先存储各个按键的位置信息或者坐标值，当调用移动焦点输入时，从存储器中提取各个按键的位置信息或者坐标值。In one embodiment, the operation of determining the position information or coordinate value of each button may be performed every time the moving focus input is invoked. It is also possible to store the position information or coordinate value of each button in advance, and extract the position information or coordinate value of each button from the memory when the moving focus input is called.
上述用于智能电视的输入方法中，获取智能电视的虚拟键盘的截屏图像，根据图像识别技术在截屏图像中获取焦点所在的目标按键，将目标按键的位置信息作为焦点对应的目标位置信息，通过确定虚拟键盘上各个按键的位置信息来模拟移动焦点输入事件，提高了输入效率。In the above-mentioned input method for a smart TV, a screenshot image of the virtual keyboard of the smart TV is obtained, the target key with the focus is obtained in the screenshot image according to the image recognition technology, and the position information of the target key is used as the target position information corresponding to the focus. The position information of each key on the virtual keyboard is determined to simulate the moving focus input event, which improves the input efficiency.
在一个实施例中，所述获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标位置信息的方式，包括：获取所述智能电视的虚拟键盘的截屏图像；在所述截屏图像中获取所述虚拟键盘的各个按键的位置信息；根据所述各个按键的位置信息以及按键名称，确定所述第一字符信息对应的所述目标位置信息。In one embodiment, the method of obtaining the target position information corresponding to the first character information on the virtual keyboard of the smart TV includes: obtaining a screenshot image of the virtual keyboard of the smart TV; The position information of each key of the virtual keyboard is acquired from the image; the target position information corresponding to the first character information is determined according to the position information of each key and the name of the key.
在一个实施例中，终端向智能电视发送截屏指令，智能电视执行截屏操作得到截屏图像，该截屏图像包含虚拟键盘图像，并将截屏图像返回给终端。终端在截屏图像中获取虚拟键盘的各个按键的位置信息。当接收到第一字符信息时，根据第一字符信息以及各个按键的名称，确定第一字符信息对应的目标按键，进而确定第一字符信息的目标位置信息。比如，第一字符信息为B，那么第一字符信息对应的目标按键为B按键，第一字符信息的目标位置信息为B按键的位置信息。In one embodiment, the terminal sends a screenshot instruction to the smart TV, and the smart TV performs a screenshot operation to obtain a screenshot image, the screenshot image includes a virtual keyboard image, and the screenshot image is returned to the terminal. The terminal obtains the position information of each key of the virtual keyboard in the screenshot image. When the first character information is received, the target key corresponding to the first character information is determined according to the first character information and the name of each key, and then the target location information of the first character information is determined. For example, if the first character information is B, then the target key corresponding to the first character information is the B key, and the target position information of the first character information is the position information of the B key.
在一个实施例中，可在每次调用移动焦点输入时，执行确定各个按键的位置信息的操作。也可预先存储各个按键的位置信息，当调用移动焦点输入时，从存储器中提取各个按键的位置信息。In one embodiment, the operation of determining the position information of each button may be performed every time the moving focus input is invoked. It is also possible to store the position information of each button in advance, and extract the position information of each button from the memory when the moving focus input is called.
上述用于智能电视的输入方法中，获取智能电视的虚拟键盘的截屏图像；在截屏图像中获取虚拟键盘 的各个按键的位置信息；根据各个按键的位置信息以及按键名称，确定第一字符信息对应的目标位置信息，通过确定虚拟键盘上各个按键的位置信息来模拟移动焦点输入事件，提高了输入效率。In the above-mentioned input method for a smart TV, a screenshot image of the virtual keyboard of the smart TV is obtained; the position information of each key of the virtual keyboard is obtained in the screenshot image; according to the position information of each key and the key name, it is determined that the first character information corresponds to The target position information of the virtual keyboard is determined by determining the position information of each key on the virtual keyboard to simulate the moving focus input event, which improves the input efficiency.
在一个实施例中，所述在所述截屏图像中获取所述虚拟键盘的各个按键的位置信息，包括：在所述截屏图像中获取所述虚拟键盘的各个按键移动至对应的边缘按键的步数，将所述各个按键移动至对应的边缘按键的步数作为所述各个按键的位置信息，所述边缘按键包括：所述虚拟键盘中靠近虚拟键盘边界的按键。In one embodiment, the acquiring position information of each key of the virtual keyboard in the screenshot image includes: acquiring, in the screenshot image, the step of moving each key of the virtual keyboard to a corresponding edge key. The number of steps taken to move the respective keys to the corresponding edge keys is used as the position information of the respective keys, and the edge keys include: keys in the virtual keyboard that are close to the boundary of the virtual keyboard.
其中，可选取虚拟键盘的各个按键移动至对应的边缘按键的最少步数作为各个按键的位置信息。边缘按键可包括靠近虚拟键盘边界的按键，虚拟键盘边界可包括上、下、左、右四个方向的边界。比如，位置信息可表示为：(U2,D2,L2,R2)，U2表示一个按键移动至上边缘按键的最小步数，D2表示一个按键移动至下边缘按键的最小步数，L2表示一个按键移动至左边缘按键的最小步数，R2表示一个按键移动至右边缘按键的最小步数。Among them, the minimum number of steps required to move each key of the virtual keyboard to the corresponding edge key can be selected as the position information of each key. The edge keys may include keys close to the boundary of the virtual keyboard, and the virtual keyboard boundary may include boundaries in four directions: up, down, left, and right. For example, the position information can be expressed as: (U2, D2, L2, R2), U2 represents the minimum number of steps for a button to move to the upper edge of the button, D2 represents the minimum number of steps for a button to move to the lower edge of the button, L2 represents a button to move The minimum number of steps to the left edge button, R2 represents the minimum number of steps to move a button to the right edge button.
上述用于智能电视的输入方法中，在截屏图像中获取虚拟键盘的各个按键移动至对应的边缘按键的步数，将各个按键移动至对应的边缘按键的步数作为各个按键的位置信息，通过确定虚拟键盘上各个按键的位置信息来模拟移动焦点输入事件，提高了输入效率。In the above-mentioned input method for smart TV, the number of steps for each key of the virtual keyboard to move to the corresponding edge key is obtained in the screenshot image, and the number of steps for each key to be moved to the corresponding edge key is used as the position information of each key. The position information of each key on the virtual keyboard is determined to simulate the moving focus input event, which improves the input efficiency.
应该理解的是，虽然图2的流程图中的各个步骤按照箭头的指示依次显示，但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明，这些步骤的执行并没有严格的顺序限制，这些步骤可以以其它的顺序执行。而且，图2中的至少一部分步骤可以包括多个子步骤或者多个阶段，这些子步骤或者阶段并不必然是在同一时刻执行完成，而是可以在不同的时刻执行，这些子步骤或者阶段的执行顺序也不必然是依次进行，而是可以与其它步骤或者其它步骤的子步骤或者阶段的至少一部分轮流或者交替地执行。It should be understood that although the various steps in the flowchart of FIG. 2 are displayed in sequence as indicated by the arrows, these steps are not necessarily performed in sequence in the order indicated by the arrows. Unless specifically stated in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least part of the steps in FIG. 2 may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution of these sub-steps or stages The sequence is not necessarily performed sequentially, but may be performed alternately or alternately with at least a part of other steps or sub-steps or stages of other steps.
在一个实施例中，如图7所示，提供了一种用于智能电视的输入装置700，包括：获取模块702、确定模块704和发送模块706，其中：In one embodiment, as shown in FIG. 7, an input device 700 for a smart TV is provided, which includes: an acquisition module 702, a determination module 704, and a sending module 706, wherein:
获取模块702，用于获取输入的第一字符信息；The obtaining module 702 is used to obtain the input first character information;
确定模块704，用于获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息；The determining module 704 is configured to obtain input functions supported by the smart TV connected to the terminal, and determine second character information according to the input function and the first character information;
发送模块706，用于将所述第二字符信息发送至所述智能电视，其中，所述智能电视调用所述输入功能执行所述第二字符信息，以将所述第一字符信息输入至所述智能电视的输入框中。The sending module 706 is configured to send the second character information to the smart TV, where the smart TV invokes the input function to execute the second character information, so as to input the first character information to the smart TV. Describe the input box of the smart TV.
上述用于智能电视的输入装置700，获取输入的第一字符信息，获取与终端连接的智能电视所支持的 输入功能，根据输入功能以及第一字符信息确定第二字符信息，将第二字符信息发送至智能电视，其中，智能电视调用输入功能执行第二字符信息，以将第一字符信息输入至智能电视的输入框中，这样，在终端输入字符信息，且终端针对智能电视支持的输入功能处理该字符信息，使该字符信息可被智能电视支持的输入功能所调用，提高了智能电视的输入效率。The above-mentioned input device 700 for a smart TV obtains the input first character information, obtains the input function supported by the smart TV connected to the terminal, determines the second character information according to the input function and the first character information, and converts the second character information Send to the smart TV, where the smart TV invokes the input function to execute the second character information to input the first character information into the input box of the smart TV, so that the character information is input in the terminal, and the terminal is directed to the input function supported by the smart TV The character information is processed so that the character information can be called by the input function supported by the smart TV, and the input efficiency of the smart TV is improved.
在一个实施例中，所述确定模块702，还用于：获取与所述终端连接的智能电视所支持的输入功能，当所述智能电视所支持的输入功能为至少两个时，获取所述智能电视所支持的输入功能的优先级；根据优先级最高的所述输入功能以及所述第一字符信息确定所述第二字符信息。In one embodiment, the determining module 702 is further configured to: obtain the input functions supported by the smart TV connected to the terminal, and when the smart TV supports at least two input functions, obtain the The priority of the input function supported by the smart TV; the second character information is determined according to the input function with the highest priority and the first character information.
在一个实施例中，所述确定模块702，还用于：获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为物理键盘输入时，获取所述第一字符信息在所述智能电视外接的物理键盘上对应的目标键值码；将所述第一字符信息对应的所述目标键值码作为所述第二字符信息。In one embodiment, the determining module 702 is further configured to: obtain input functions supported by the smart TV connected to the terminal, and when the input function is physical keyboard input, obtain the first character information The target key value code corresponding to the physical keyboard external to the smart TV; the target key value code corresponding to the first character information is used as the second character information.
在一个实施例中，所述确定模块702，还用于：获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为鼠标输入时，获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标坐标值；将所述第一字符信息对应的所述目标坐标值作为所述第二字符信息。In one embodiment, the determining module 702 is further configured to: obtain the input function supported by the smart TV connected to the terminal, and when the input function is mouse input, obtain the first character information in the The target coordinate value corresponding to the virtual keyboard of the smart TV; the target coordinate value corresponding to the first character information is used as the second character information.
在一个实施例中，所述确定模块702，还用于：获取所述智能电视的虚拟键盘的截屏图像；在所述截屏图像中获取所述虚拟键盘的各个按键的坐标值；根据所述各个按键的坐标值以及按键名称，确定所述第一字符信息对应的所述目标坐标值。In one embodiment, the determining module 702 is further configured to: obtain a screenshot image of the virtual keyboard of the smart TV; obtain the coordinate value of each key of the virtual keyboard in the screenshot image; The coordinate value of the button and the button name determine the target coordinate value corresponding to the first character information.
在一个实施例中，所述确定模块702，还用于：获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为移动焦点输入时，获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标位置信息，以及所述焦点在所述智能电视的虚拟键盘上对应的目标位置信息；获取所述第一字符信息对应的目标位置信息与所述焦点对应的目标位置信息之间的目标移动路径；将所述目标移动路径作为所述第二字符信息。In one embodiment, the determining module 702 is further configured to: obtain input functions supported by the smart TV connected to the terminal, and when the input function is mobile focus input, obtain the first character information Target position information corresponding to the virtual keyboard of the smart TV, and target position information corresponding to the focus on the virtual keyboard of the smart TV; acquiring target position information corresponding to the first character information corresponding to the focus The target moving path between the target location information; the target moving path is used as the second character information.
在一个实施例中，所述确定模块702，还用于：获取所述智能电视的虚拟键盘的截屏图像；根据图像识别技术在所述截屏图像中获取所述焦点所在的目标按键；将所述目标按键的位置信息作为所述焦点对应的所述目标位置信息。In one embodiment, the determining module 702 is further configured to: obtain a screenshot image of the virtual keyboard of the smart TV; obtain the target key of the focus in the screenshot image according to the image recognition technology; The position information of the target button is used as the target position information corresponding to the focus.
在一个实施例中，所述确定模块702，还用于：获取所述智能电视的虚拟键盘的截屏图像；在所述截屏图像中获取所述虚拟键盘的各个按键的位置信息；根据所述各个按键的位置信息以及按键名称，确定所述第一字符信息对应的所述目标位置信息。In one embodiment, the determining module 702 is further configured to: obtain a screenshot image of the virtual keyboard of the smart TV; obtain the position information of each key of the virtual keyboard in the screenshot image; The location information of the button and the button name determine the target location information corresponding to the first character information.
在一个实施例中，所述确定模块702，还用于：在所述截屏图像中获取所述虚拟键盘的各个按键移动 至对应的边缘按键的步数，将所述各个按键移动至对应的边缘按键的步数作为所述各个按键的位置信息，所述边缘按键包括：所述虚拟键盘中靠近虚拟键盘边界的按键。In one embodiment, the determining module 702 is further configured to: obtain the number of steps for each key of the virtual keyboard to move to a corresponding edge key in the screenshot image, and move each key to the corresponding edge The step number of the key is used as the position information of each key, and the edge keys include: keys in the virtual keyboard that are close to the boundary of the virtual keyboard.
关于用于智能电视的输入装置的具体限定可以参见上文中对于用于智能电视的输入方法的限定，在此不再赘述。上述用于智能电视的输入装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中，也可以以软件形式存储于计算机设备中的存储器中，以便于处理器调用执行以上各个模块对应的操作。Regarding the specific definition of the input device used in the smart TV, please refer to the above definition of the input method used in the smart TV, which will not be repeated here. The various modules in the above-mentioned input device for a smart TV can be implemented in whole or in part by software, hardware, and a combination thereof. The above-mentioned modules may be embedded in the form of hardware or independent of the processor in the computer equipment, or may be stored in the memory of the computer equipment in the form of software, so that the processor can call and execute the operations corresponding to the above-mentioned modules.
在一个实施例中，提供了一种计算机设备，该计算机设备可以是终端，其内部结构图可以如图8所示。该计算机设备包括通过系统总线连接的处理器、存储器、网络接口、显示屏和输入装置。其中，该计算机设备的处理器用于提供计算和控制能力。该计算机设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作系统和计算机程序。该内存储器为非易失性存储介质中的操作系统和计算机程序的运行提供环境。该计算机设备的网络接口用于与外部的终端通过网络连接通信。该计算机程序被处理器执行时以实现一种用于智能电视的输入方法。该计算机设备的显示屏可以是液晶显示屏或者电子墨水显示屏，该计算机设备的输入装置可以是显示屏上覆盖的触摸层，也可以是计算机设备外壳上设置的按键、轨迹球或触控板，还可以是外接的键盘、触控板或鼠标等。In one embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as shown in FIG. 8. The computer equipment includes a processor, a memory, a network interface, a display screen and an input device connected through a system bus. Among them, the processor of the computer device is used to provide calculation and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used to communicate with an external terminal through a network connection. The computer program is executed by the processor to realize an input method for smart TV. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, or it can be a button, a trackball or a touchpad set on the housing of the computer equipment , It can also be an external keyboard, touchpad, or mouse.
本领域技术人员可以理解，图8中示出的结构，仅仅是与本申请方案相关的部分结构的框图，并不构成对本申请方案所应用于其上的计算机设备的限定，具体的计算机设备可以包括比图中所示更多或更少的部件，或者组合某些部件，或者具有不同的部件布置。Those skilled in the art can understand that the structure shown in FIG. 8 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may Including more or fewer parts than shown in the figure, or combining some parts, or having a different arrangement of parts.
在一个实施例中，提供了一种计算机设备，包括存储器和处理器，存储器中存储有计算机程序，该处理器执行计算机程序时实现以下步骤：In one embodiment, a computer device is provided, including a memory and a processor, a computer program is stored in the memory, and the processor implements the following steps when the processor executes the computer program:
获取输入的第一字符信息；Obtain the input first character information;
获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息；Acquiring input functions supported by the smart TV connected to the terminal, and determining second character information according to the input function and the first character information;
将所述第二字符信息发送至所述智能电视，其中，所述智能电视调用所述输入功能执行所述第二字符信息，以将所述第一字符信息输入至所述智能电视的输入框中。The second character information is sent to the smart TV, wherein the smart TV invokes the input function to execute the second character information to input the first character information into the input box of the smart TV middle.
在一个实施例中，处理器执行计算机程序时还实现以下步骤：In an embodiment, the processor further implements the following steps when executing the computer program:
获取与所述终端连接的智能电视所支持的输入功能，当所述智能电视所支持的输入功能为至少两个时，获取所述智能电视所支持的输入功能的优先级；Acquiring input functions supported by the smart TV connected to the terminal, and when the smart TV supports at least two input functions, acquiring the priority of the input functions supported by the smart TV;
根据优先级最高的所述输入功能以及所述第一字符信息确定所述第二字符信息。The second character information is determined according to the input function with the highest priority and the first character information.
在一个实施例中，处理器执行计算机程序时还实现以下步骤：In an embodiment, the processor further implements the following steps when executing the computer program:
获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为物理键盘输入时，获取所述第一字符信息在所述智能电视外接的物理键盘上对应的目标键值码；Acquiring an input function supported by the smart TV connected to the terminal, and when the input function is a physical keyboard input, acquiring the target key value code corresponding to the first character information on the physical keyboard external to the smart TV;
将所述第一字符信息对应的所述目标键值码作为所述第二字符信息。Use the target key value code corresponding to the first character information as the second character information.
在一个实施例中，处理器执行计算机程序时还实现以下步骤：In an embodiment, the processor further implements the following steps when executing the computer program:
获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为鼠标输入时，获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标坐标值；Acquiring an input function supported by the smart TV connected to the terminal, and when the input function is mouse input, acquiring the target coordinate value corresponding to the first character information on the virtual keyboard of the smart TV;
将所述第一字符信息对应的所述目标坐标值作为所述第二字符信息。Use the target coordinate value corresponding to the first character information as the second character information.
在一个实施例中，处理器执行计算机程序时还实现以下步骤：In an embodiment, the processor further implements the following steps when executing the computer program:
获取所述智能电视的虚拟键盘的截屏图像；Acquiring a screenshot image of the virtual keyboard of the smart TV;
在所述截屏图像中获取所述虚拟键盘的各个按键的坐标值；Acquiring the coordinate value of each key of the virtual keyboard in the screenshot image;
根据所述各个按键的坐标值以及按键名称，确定所述第一字符信息对应的所述目标坐标值。The target coordinate value corresponding to the first character information is determined according to the coordinate value of each button and the button name.
在一个实施例中，处理器执行计算机程序时还实现以下步骤：In an embodiment, the processor further implements the following steps when executing the computer program:
获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为移动焦点输入时，获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标位置信息，以及所述焦点在所述智能电视的虚拟键盘上对应的目标位置信息；Acquire the input function supported by the smart TV connected to the terminal, and when the input function is mobile focus input, obtain the target position information corresponding to the first character information on the virtual keyboard of the smart TV, and Target position information corresponding to the focus on the virtual keyboard of the smart TV;
获取所述第一字符信息对应的目标位置信息与所述焦点对应的目标位置信息之间的目标移动路径；Acquiring a target moving path between the target position information corresponding to the first character information and the target position information corresponding to the focus;
将所述目标移动路径作为所述第二字符信息。Use the target moving path as the second character information.
在一个实施例中，处理器执行计算机程序时还实现以下步骤：In an embodiment, the processor further implements the following steps when executing the computer program:
获取所述智能电视的虚拟键盘的截屏图像；Acquiring a screenshot image of the virtual keyboard of the smart TV;
根据图像识别技术在所述截屏图像中获取所述焦点所在的目标按键；Acquiring, in the screenshot image, the target button where the focus is located according to the image recognition technology;
将所述目标按键的位置信息作为所述焦点对应的所述目标位置信息。Use the position information of the target button as the target position information corresponding to the focus.
在一个实施例中，处理器执行计算机程序时还实现以下步骤：In an embodiment, the processor further implements the following steps when executing the computer program:
获取所述智能电视的虚拟键盘的截屏图像；Acquiring a screenshot image of the virtual keyboard of the smart TV;
在所述截屏图像中获取所述虚拟键盘的各个按键的位置信息；Acquiring position information of each key of the virtual keyboard in the screenshot image;
根据所述各个按键的位置信息以及按键名称，确定所述第一字符信息对应的所述目标位置信息。The target location information corresponding to the first character information is determined according to the location information of each button and the button name.
在一个实施例中，处理器执行计算机程序时还实现以下步骤：In an embodiment, the processor further implements the following steps when executing the computer program:
在所述截屏图像中获取所述虚拟键盘的各个按键移动至对应的边缘按键的步数，将所述各个按键移动至对应的边缘按键的步数作为所述各个按键的位置信息，所述边缘按键包括：所述虚拟键盘中靠近虚拟键盘边界的按键。The number of steps for each key of the virtual keyboard to move to the corresponding edge key is acquired in the screenshot image, and the number of steps for each key to move to the corresponding edge key is used as the position information of each key. The keys include: keys on the virtual keyboard close to the boundary of the virtual keyboard.
在一个实施例中，提供了一种计算机可读存储介质，其上存储有计算机程序，计算机程序被处理器执行时实现以下步骤：In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:
获取输入的第一字符信息；Obtain the input first character information;
获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息；Acquiring input functions supported by the smart TV connected to the terminal, and determining second character information according to the input function and the first character information;
将所述第二字符信息发送至所述智能电视，其中，所述智能电视调用所述输入功能执行所述第二字符信息，以将所述第一字符信息输入至所述智能电视的输入框中。The second character information is sent to the smart TV, wherein the smart TV invokes the input function to execute the second character information to input the first character information into the input box of the smart TV middle.
在一个实施例中，计算机程序被处理器执行时还实现以下步骤：In an embodiment, when the computer program is executed by the processor, the following steps are further implemented:
获取与所述终端连接的智能电视所支持的输入功能，当所述智能电视所支持的输入功能为至少两个时，获取所述智能电视所支持的输入功能的优先级；Acquiring input functions supported by the smart TV connected to the terminal, and when the smart TV supports at least two input functions, acquiring the priority of the input functions supported by the smart TV;
根据优先级最高的所述输入功能以及所述第一字符信息确定所述第二字符信息。The second character information is determined according to the input function with the highest priority and the first character information.
在一个实施例中，计算机程序被处理器执行时还实现以下步骤：In an embodiment, when the computer program is executed by the processor, the following steps are further implemented:
获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为物理键盘输入时，获取所述第一字符信息在所述智能电视外接的物理键盘上对应的目标键值码；Acquiring an input function supported by the smart TV connected to the terminal, and when the input function is a physical keyboard input, acquiring the target key value code corresponding to the first character information on the physical keyboard external to the smart TV;
将所述第一字符信息对应的所述目标键值码作为所述第二字符信息。Use the target key value code corresponding to the first character information as the second character information.
在一个实施例中，计算机程序被处理器执行时还实现以下步骤：In an embodiment, when the computer program is executed by the processor, the following steps are further implemented:
获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为鼠标输入时，获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标坐标值；Acquiring an input function supported by the smart TV connected to the terminal, and when the input function is mouse input, acquiring the target coordinate value corresponding to the first character information on the virtual keyboard of the smart TV;
将所述第一字符信息对应的所述目标坐标值作为所述第二字符信息。Use the target coordinate value corresponding to the first character information as the second character information.
在一个实施例中，计算机程序被处理器执行时还实现以下步骤：In an embodiment, when the computer program is executed by the processor, the following steps are further implemented:
获取所述智能电视的虚拟键盘的截屏图像；Acquiring a screenshot image of the virtual keyboard of the smart TV;
在所述截屏图像中获取所述虚拟键盘的各个按键的坐标值；Acquiring the coordinate value of each key of the virtual keyboard in the screenshot image;
根据所述各个按键的坐标值以及按键名称，确定所述第一字符信息对应的所述目标坐标值。The target coordinate value corresponding to the first character information is determined according to the coordinate value of each button and the button name.
在一个实施例中，计算机程序被处理器执行时还实现以下步骤：In an embodiment, when the computer program is executed by the processor, the following steps are further implemented:
获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为移动焦点输入时，获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标位置信息，以及所述焦点在所述智能电视的虚拟键盘上对应的目标位置信息；Acquire the input function supported by the smart TV connected to the terminal, and when the input function is mobile focus input, obtain the target position information corresponding to the first character information on the virtual keyboard of the smart TV, and Target position information corresponding to the focus on the virtual keyboard of the smart TV;
获取所述第一字符信息对应的目标位置信息与所述焦点对应的目标位置信息之间的目标移动路径；Acquiring a target moving path between the target position information corresponding to the first character information and the target position information corresponding to the focus;
将所述目标移动路径作为所述第二字符信息。Use the target moving path as the second character information.
在一个实施例中，计算机程序被处理器执行时还实现以下步骤：In an embodiment, when the computer program is executed by the processor, the following steps are further implemented:
获取所述智能电视的虚拟键盘的截屏图像；Acquiring a screenshot image of the virtual keyboard of the smart TV;
根据图像识别技术在所述截屏图像中获取所述焦点所在的目标按键；Acquiring, in the screenshot image, the target button where the focus is located according to the image recognition technology;
将所述目标按键的位置信息作为所述焦点对应的所述目标位置信息。Use the position information of the target button as the target position information corresponding to the focus.
在一个实施例中，计算机程序被处理器执行时还实现以下步骤：In an embodiment, when the computer program is executed by the processor, the following steps are further implemented:
获取所述智能电视的虚拟键盘的截屏图像；Acquiring a screenshot image of the virtual keyboard of the smart TV;
在所述截屏图像中获取所述虚拟键盘的各个按键的位置信息；Acquiring position information of each key of the virtual keyboard in the screenshot image;
根据所述各个按键的位置信息以及按键名称，确定所述第一字符信息对应的所述目标位置信息。The target location information corresponding to the first character information is determined according to the location information of each button and the button name.
在一个实施例中，计算机程序被处理器执行时还实现以下步骤：In an embodiment, when the computer program is executed by the processor, the following steps are further implemented:
在所述截屏图像中获取所述虚拟键盘的各个按键移动至对应的边缘按键的步数，将所述各个按键移动至对应的边缘按键的步数作为所述各个按键的位置信息，所述边缘按键包括：所述虚拟键盘中靠近虚拟键盘边界的按键。The number of steps for each key of the virtual keyboard to move to the corresponding edge key is acquired in the screenshot image, and the number of steps for each key to move to the corresponding edge key is used as the position information of each key. The keys include: keys on the virtual keyboard close to the boundary of the virtual keyboard.
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来指令相关的硬件来完成，所述的计算机程序可存储于一非易失性计算机可读取存储介质中，该计算机程序在执行时，可包括如上述各方法的实施例的流程。其中，本申请所提供的各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用，均可包括非易失性和/或易失性存储器。非易失性存储器可包括只读存储器(ROM)、可编程ROM(PROM)、电可编程ROM(EPROM)、电可擦除可编程ROM(EEPROM)或闪存。易失性存储器可包括随机存取存储器(RAM)或者外部高速缓冲存储器。作为说明而非局限，RAM以多种形式可得，诸如静态RAM(SRAM)、动态RAM(DRAM)、同步DRAM(SDRAM)、双数据率SDRAM(DDRSDRAM)、增强型SDRAM(ESDRAM)、同步链路(Synchlink)DRAM(SLDRAM)、存储器总线(Rambus)直接RAM(RDRAM)、直接存储器总线动态RAM(DRDRAM)、以及存储器总线动态RAM(RDRAM)等。A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer readable storage. In the medium, when the computer program is executed, it may include the processes of the above-mentioned method embodiments. Wherein, any reference to memory, storage, database, or other media used in the embodiments provided in this application may include non-volatile and/or volatile memory. Non-volatile memory may include read only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not a limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous chain Channel (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.
以上实施例的各技术特征可以进行任意的组合，为使描述简洁，未对上述实施例中的各个技术特征所有可能的组合都进行描述，然而，只要这些技术特征的组合不存在矛盾，都应当认为是本说明书记载的范围。The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, all possible combinations of the technical features in the above embodiments are not described. However, as long as there is no contradiction in the combination of these technical features, they should be It is considered as the range described in this specification.
以上所述实施例仅表达了本申请的几种实施方式，其描述较为具体和详细，但并不能因此而理解为对发明专利范围的限制。应当指出的是，对于本领域的普通技术人员来说，在不脱离本申请构思的前提下，还可以做出若干变形和改进，这些都属于本申请的保护范围。因此，本申请专利的保护范围应以所附权利要求为准。The above-mentioned embodiments only express several implementation manners of the present application, and the description is relatively specific and detailed, but it should not be understood as a limitation on the scope of the invention patent. It should be pointed out that for those of ordinary skill in the art, without departing from the concept of this application, several modifications and improvements can be made, and these all fall within the protection scope of this application. Therefore, the scope of protection of the patent of this application shall be subject to the appended claims.

Claims (12)

  1. 一种用于智能电视的输入方法，所述方法包括：An input method for smart TV, the method includes:
    获取输入的第一字符信息；Obtain the input first character information;
    获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息；Acquiring input functions supported by the smart TV connected to the terminal, and determining second character information according to the input function and the first character information;
    将所述第二字符信息发送至所述智能电视，其中，所述智能电视调用所述输入功能执行所述第二字符信息，以将所述第一字符信息输入至所述智能电视的输入框中。The second character information is sent to the smart TV, wherein the smart TV invokes the input function to execute the second character information to input the first character information into the input box of the smart TV middle.
  2. 根据权利要求1所述的方法，其特征在于，所述获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息，包括：The method according to claim 1, wherein the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information comprises:
    获取与所述终端连接的智能电视所支持的输入功能，当所述智能电视所支持的输入功能为至少两个时，获取所述智能电视所支持的输入功能的优先级；Acquiring input functions supported by the smart TV connected to the terminal, and when the smart TV supports at least two input functions, acquiring the priority of the input functions supported by the smart TV;
    根据优先级最高的所述输入功能以及所述第一字符信息确定所述第二字符信息。The second character information is determined according to the input function with the highest priority and the first character information.
  3. 根据权利要求1所述的方法，其特征在于，所述获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息，包括：The method according to claim 1, wherein the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information comprises:
    获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为物理键盘输入时，获取所述第一字符信息在所述智能电视外接的物理键盘上对应的目标键值码；Acquiring an input function supported by the smart TV connected to the terminal, and when the input function is a physical keyboard input, acquiring the target key value code corresponding to the first character information on the physical keyboard external to the smart TV;
    将所述第一字符信息对应的所述目标键值码作为所述第二字符信息。Use the target key value code corresponding to the first character information as the second character information.
  4. 根据权利要求1所述的方法，其特征在于，所述获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息，包括：The method according to claim 1, wherein the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information comprises:
    获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为鼠标输入时，获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标坐标值；Acquiring an input function supported by the smart TV connected to the terminal, and when the input function is mouse input, acquiring the target coordinate value corresponding to the first character information on the virtual keyboard of the smart TV;
    将所述第一字符信息对应的所述目标坐标值作为所述第二字符信息。Use the target coordinate value corresponding to the first character information as the second character information.
  5. 根据权利要求4所述的方法，其特征在于，所述获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标坐标值的方式，包括：The method according to claim 4, wherein the method of obtaining the target coordinate value corresponding to the first character information on the virtual keyboard of the smart TV comprises:
    获取所述智能电视的虚拟键盘的截屏图像；Acquiring a screenshot image of the virtual keyboard of the smart TV;
    在所述截屏图像中获取所述虚拟键盘的各个按键的坐标值；Acquiring the coordinate value of each key of the virtual keyboard in the screenshot image;
    根据所述各个按键的坐标值以及按键名称，确定所述第一字符信息对应的所述目标坐标值。The target coordinate value corresponding to the first character information is determined according to the coordinate value of each button and the button name.
  6. 根据权利要求1所述的方法，其特征在于，所述获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息，包括：The method according to claim 1, wherein the obtaining the input function supported by the smart TV connected to the terminal, and determining the second character information according to the input function and the first character information comprises:
    获取与所述终端连接的智能电视所支持的输入功能，当所述输入功能为移动焦点输入时，获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标位置信息，以及所述焦点在所述智能电视的虚拟键盘上对应的目标位置信息；Acquire the input function supported by the smart TV connected to the terminal, and when the input function is mobile focus input, obtain the target position information corresponding to the first character information on the virtual keyboard of the smart TV, and Target position information corresponding to the focus on the virtual keyboard of the smart TV;
    获取所述第一字符信息对应的目标位置信息与所述焦点对应的目标位置信息之间的目标移动路径；Acquiring a target moving path between the target position information corresponding to the first character information and the target position information corresponding to the focus;
    将所述目标移动路径作为所述第二字符信息。Use the target moving path as the second character information.
  7. 根据权利要求6所述的方法，其特征在于，所述获取所述焦点在所述智能电视的虚拟键盘上对应的目标位置信息的方式，包括：The method according to claim 6, wherein the method of obtaining the target position information corresponding to the focus on the virtual keyboard of the smart TV comprises:
    获取所述智能电视的虚拟键盘的截屏图像；Acquiring a screenshot image of the virtual keyboard of the smart TV;
    根据图像识别技术在所述截屏图像中获取所述焦点所在的目标按键；Acquiring, in the screenshot image, the target button where the focus is located according to the image recognition technology;
    将所述目标按键的位置信息作为所述焦点对应的所述目标位置信息。Use the position information of the target button as the target position information corresponding to the focus.
  8. 根据权利要求6所述的方法，其特征在于，所述获取所述第一字符信息在所述智能电视的虚拟键盘上对应的目标位置信息的方式，包括：The method according to claim 6, wherein the method of obtaining the target position information corresponding to the first character information on the virtual keyboard of the smart TV comprises:
    获取所述智能电视的虚拟键盘的截屏图像；Acquiring a screenshot image of the virtual keyboard of the smart TV;
    在所述截屏图像中获取所述虚拟键盘的各个按键的位置信息；Acquiring position information of each key of the virtual keyboard in the screenshot image;
    根据所述各个按键的位置信息以及按键名称，确定所述第一字符信息对应的所述目标位置信息。The target location information corresponding to the first character information is determined according to the location information of each button and the button name.
  9. 根据权利要求8所述的方法，其特征在于，所述在所述截屏图像中获取所述虚拟键盘的各个按键的位置信息，包括：8. The method according to claim 8, wherein the acquiring position information of each key of the virtual keyboard in the screenshot image comprises:
    在所述截屏图像中获取所述虚拟键盘的各个按键移动至对应的边缘按键的步数，将所述各个按键移动至对应的边缘按键的步数作为所述各个按键的位置信息，所述边缘按键包括：所述虚拟键盘中靠近虚拟键盘边界的按键。The number of steps for each key of the virtual keyboard to move to the corresponding edge key is acquired in the screenshot image, and the number of steps for each key to move to the corresponding edge key is used as the position information of each key. The keys include: keys on the virtual keyboard close to the boundary of the virtual keyboard.
  10. 一种用于智能电视的输入装置，其特征在于，所述装置包括：An input device for smart TV, characterized in that the device comprises:
    获取模块，用于获取输入的第一字符信息；The obtaining module is used to obtain the input first character information;
    确定模块，用于获取与终端连接的智能电视所支持的输入功能，根据所述输入功能以及所述第一字符信息确定第二字符信息；The determining module is configured to obtain the input function supported by the smart TV connected to the terminal, and determine the second character information according to the input function and the first character information;
    发送模块，用于将所述第二字符信息发送至所述智能电视，其中，所述智能电视调用所述输入功能执行所述第二字符信息，以将所述第一字符信息输入至所述智能电视的输入框中。The sending module is configured to send the second character information to the smart TV, wherein the smart TV invokes the input function to execute the second character information, so as to input the first character information to the The input box of the smart TV.
  11. 一种计算机设备，包括存储器和处理器，所述存储器存储有计算机程序，其特征在于，所述处理器执行所述计算机程序时实现权利要求1至9中任一项所述方法的步骤。A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method according to any one of claims 1 to 9 when the computer program is executed by the processor.
  12. 一种计算机可读存储介质，其上存储有计算机程序，其特征在于，所述计算机程序被处理器执行时实现权利要求1至9中任一项所述方法的步骤。A computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the steps of any one of claims 1 to 9 when the computer program is executed by a processor.
PCT/CN2021/077013 2020-02-20 2021-02-20 Input method and apparatus for smart television, computer device, and storage medium WO2021164756A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010104900.6 2020-02-20
CN202010104900.6A CN113286203A (en) 2020-02-20 2020-02-20 Input method and device for smart television, computer equipment and storage medium

Publications (1)

Publication Number Publication Date
WO2021164756A1 true WO2021164756A1 (en) 2021-08-26

Family

ID=77275182

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/077013 WO2021164756A1 (en) 2020-02-20 2021-02-20 Input method and apparatus for smart television, computer device, and storage medium

Country Status (2)

Country Link
CN (1) CN113286203A (en)
WO (1) WO2021164756A1 (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104035709A (en) * 2013-03-07 2014-09-10 三星电子株式会社 Input Apparatus, Display Apparatus, And Control Methods Thereof
CN104423697A (en) * 2013-08-21 2015-03-18 索尼公司 Display control device, display control method, and program
CN104699228A (en) * 2013-12-04 2015-06-10 中国电信股份有限公司 Mouse realization method and system for intelligent TV screen terminal
CN105721912A (en) * 2014-12-05 2016-06-29 北京奇虎科技有限公司 Method and device for intelligent television to respond to simulation button
CN108737870A (en) * 2018-05-23 2018-11-02 深圳市茁壮网络股份有限公司 A kind of soft keyboard key assignments selection method and device
EP3462613A2 (en) * 2001-07-12 2019-04-03 Sony Corporation Remote controller and system having the same
CN110795019A (en) * 2019-10-23 2020-02-14 腾讯科技（深圳）有限公司 Key identification method and device of soft keyboard and storage medium

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102438056A (en) * 2011-11-08 2012-05-02 华为终端有限公司 Method for controlling non-touch device by using touch screen, touch device and handheld device
CN103024544B (en) * 2012-12-26 2016-01-20 四川长虹电器股份有限公司 Interaction system of television
JP6050143B2 (en) * 2013-02-25 2016-12-21 株式会社エイビット Television information system
CN105992066B (en) * 2015-02-13 2019-07-02 Tcl集团股份有限公司 A kind of characters input method and character entry apparatus applied to smart machine
CN110109596B (en) * 2019-05-08 2021-11-16 芋头科技（杭州）有限公司 Recommendation method and device of interaction mode, controller and medium

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3462613A2 (en) * 2001-07-12 2019-04-03 Sony Corporation Remote controller and system having the same
CN104035709A (en) * 2013-03-07 2014-09-10 三星电子株式会社 Input Apparatus, Display Apparatus, And Control Methods Thereof
CN104423697A (en) * 2013-08-21 2015-03-18 索尼公司 Display control device, display control method, and program
CN104699228A (en) * 2013-12-04 2015-06-10 中国电信股份有限公司 Mouse realization method and system for intelligent TV screen terminal
CN105721912A (en) * 2014-12-05 2016-06-29 北京奇虎科技有限公司 Method and device for intelligent television to respond to simulation button
CN108737870A (en) * 2018-05-23 2018-11-02 深圳市茁壮网络股份有限公司 A kind of soft keyboard key assignments selection method and device
CN110795019A (en) * 2019-10-23 2020-02-14 腾讯科技（深圳）有限公司 Key identification method and device of soft keyboard and storage medium

Also Published As

Publication number Publication date
CN113286203A (en) 2021-08-20

Similar Documents

Publication Publication Date Title
JP6338829B2 (en) Multiple input processing method and apparatus
US20090247219A1 (en) Method of generating a function output from a photographed image and related mobile computing device
CN109561271B (en) Method for guiding terminal operation, first terminal and second terminal
CN105760540A (en) Method and equipment for processing webpage and electronic equipment
WO2023071861A1 (en) Data visualization display method and apparatus, computer device, and storage medium
WO2019205634A1 (en) Touch control method and device for smart interactive tablet and smart interactive tablet
US20170185422A1 (en) Method and system for generating and controlling composite user interface control
CN111223155B (en) Image data processing method, device, computer equipment and storage medium
US20160062601A1 (en) Electronic device with touch screen and method for moving application functional interface
CN112748843A (en) Page switching method and device, computer equipment and storage medium
CN115145545A (en) Method and device for generating small program code, computer equipment and storage medium
US20080154573A1 (en) Simulating new input devices using old input devices
CN107066864B (en) Application icon display method and device
JP2019510322A (en) Control command recognition method, apparatus, and storage medium
US20150138077A1 (en) Display system and display controll device
WO2021164756A1 (en) Input method and apparatus for smart television, computer device, and storage medium
CN109753217B (en) Dynamic keyboard operation method and device, storage medium and electronic equipment
CN110475138A (en) Show focus triggering method, device, computer equipment and the storage medium of the page
CN115562539A (en) Control display method and device, electronic equipment and readable storage medium
CN115729544A (en) Desktop component generation method and device, electronic equipment and readable storage medium
CN111190574B (en) Method, device, equipment and storage medium for selecting options of multi-stage linkage assembly
CN114253449A (en) Screen capturing method, device, equipment and medium
US20200150859A1 (en) Method of operating widget on an electronic device
JP7499429B1 (en) Application remote control system, application execution control device, and application execution control method
JP7426759B2 (en) Computer systems, programs, and methods

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21757187

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 09/12/2022)

122 Ep: pct application non-entry in european phase

Ref document number: 21757187

Country of ref document: EP

Kind code of ref document: A1